2024-08-18T23:58:38.854 INFO:root:teuthology version: 1.2.0 2024-08-18T23:58:38.882 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-18T23:58:38.975 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7860043 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/dbench}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7860043' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules - exec: mon.a: - ceph mgr module enable snap_schedule name: teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_export_ephemeral_random_max: 0.1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: de09dd018de4baddfa6ca4d43bc8fb784cf75833 subvols: create: 2 subvol_options: --namespace-isolated ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount install: ceph: flavor: default sha1: de09dd018de4baddfa6ca4d43bc8fb784cf75833 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=crc - wsync syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 78215f5a1cf5eaf321d506a66539942e12851f34 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 1664 sha1: de09dd018de4baddfa6ca4d43bc8fb784cf75833 sleep_before_teardown: 0 subset: 36/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 78215f5a1cf5eaf321d506a66539942e12851f34 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi044.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEMD38XlFgojP0O4fH8f2DfxVZPwfMZd55+pseAXTysAxTg6hY9ZncZ2IyZ94K/p+sqtHSm0uUWlbZvT9dhJ+1U= smithi116.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOsIL8PmiwYDG2hioHPD1PBECIUv6qQmHOi+pdE/PRNUw5tl36+BY8DFfTIr4+q0ltwMPJ80KZ269/wHTvNJ6vA= smithi171.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCDwo1snSHERtPvSc8GdKt91HjuGqchw3IrpJq1zmkV2seKcAsqmAgGTFJx099+C2/VnSKCgmavDuGmehM9KcM8= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - exec: mon.a: - ceph config set mgr mgr/snap_schedule/log_level debug - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - quiescer: null - workunit: clients: all: - suites/dbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 67db276914d29505c9707d04f3a3b8fb9d8aee4b timestamp: 2024-08-18_21:24:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-08-18T23:58:38.976 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa; will attempt to use it 2024-08-18T23:58:38.976 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks 2024-08-18T23:58:38.977 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-08-18T23:58:38.978 INFO:teuthology.task.internal:Checking packages... 2024-08-18T23:58:38.999 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'de09dd018de4baddfa6ca4d43bc8fb784cf75833' 2024-08-18T23:58:38.999 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-18T23:58:38.999 INFO:teuthology.packaging:ref: None 2024-08-18T23:58:38.999 INFO:teuthology.packaging:tag: None 2024-08-18T23:58:38.999 INFO:teuthology.packaging:branch: squid 2024-08-18T23:58:39.000 INFO:teuthology.packaging:sha1: de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-18T23:58:39.000 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-08-18T23:58:39.195 INFO:teuthology.task.internal:Found packages for ceph version 19.1.0-1386.g78215f5a 2024-08-18T23:58:39.197 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-08-18T23:58:39.203 INFO:teuthology.task.internal:no buildpackages task found 2024-08-18T23:58:39.204 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-08-18T23:58:39.263 INFO:teuthology.task.internal:Saving configuration 2024-08-18T23:58:39.285 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-08-18T23:58:39.293 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-08-18T23:58:39.317 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi044.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7860043', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-18 23:53:29.318087', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEMD38XlFgojP0O4fH8f2DfxVZPwfMZd55+pseAXTysAxTg6hY9ZncZ2IyZ94K/p+sqtHSm0uUWlbZvT9dhJ+1U='} 2024-08-18T23:58:39.336 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi116.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7860043', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-18 23:53:29.316366', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOsIL8PmiwYDG2hioHPD1PBECIUv6qQmHOi+pdE/PRNUw5tl36+BY8DFfTIr4+q0ltwMPJ80KZ269/wHTvNJ6vA='} 2024-08-18T23:58:39.356 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi171.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7860043', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-18 23:53:29.319530', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCDwo1snSHERtPvSc8GdKt91HjuGqchw3IrpJq1zmkV2seKcAsqmAgGTFJx099+C2/VnSKCgmavDuGmehM9KcM8='} 2024-08-18T23:58:39.356 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-08-18T23:58:39.362 INFO:teuthology.task.internal:roles: ubuntu@smithi044.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-08-18T23:58:39.362 INFO:teuthology.task.internal:roles: ubuntu@smithi116.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-08-18T23:58:39.362 INFO:teuthology.task.internal:roles: ubuntu@smithi171.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-08-18T23:58:39.362 INFO:teuthology.run_tasks:Running task console_log... 2024-08-18T23:58:39.471 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7efc85333be0>, signals=[15]) 2024-08-18T23:58:39.471 INFO:teuthology.run_tasks:Running task internal.connect... 2024-08-18T23:58:39.478 INFO:teuthology.task.internal:Opening connections... 2024-08-18T23:58:39.478 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi044.front.sepia.ceph.com 2024-08-18T23:58:39.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-18T23:58:39.560 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi116.front.sepia.ceph.com 2024-08-18T23:58:39.561 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-18T23:58:39.638 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi171.front.sepia.ceph.com 2024-08-18T23:58:39.639 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-18T23:58:39.716 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-08-18T23:58:39.723 DEBUG:teuthology.orchestra.run.smithi044:> uname -m 2024-08-18T23:58:39.742 INFO:teuthology.orchestra.run.smithi044.stdout:x86_64 2024-08-18T23:58:39.742 DEBUG:teuthology.orchestra.run.smithi044:> cat /etc/os-release 2024-08-18T23:58:39.801 INFO:teuthology.orchestra.run.smithi044.stdout:NAME="CentOS Stream" 2024-08-18T23:58:39.801 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION="9" 2024-08-18T23:58:39.801 INFO:teuthology.orchestra.run.smithi044.stdout:ID="centos" 2024-08-18T23:58:39.801 INFO:teuthology.orchestra.run.smithi044.stdout:ID_LIKE="rhel fedora" 2024-08-18T23:58:39.801 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION_ID="9" 2024-08-18T23:58:39.801 INFO:teuthology.orchestra.run.smithi044.stdout:PLATFORM_ID="platform:el9" 2024-08-18T23:58:39.801 INFO:teuthology.orchestra.run.smithi044.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-18T23:58:39.801 INFO:teuthology.orchestra.run.smithi044.stdout:ANSI_COLOR="0;31" 2024-08-18T23:58:39.801 INFO:teuthology.orchestra.run.smithi044.stdout:LOGO="fedora-logo-icon" 2024-08-18T23:58:39.801 INFO:teuthology.orchestra.run.smithi044.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-18T23:58:39.802 INFO:teuthology.orchestra.run.smithi044.stdout:HOME_URL="https://centos.org/" 2024-08-18T23:58:39.802 INFO:teuthology.orchestra.run.smithi044.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-08-18T23:58:39.802 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-18T23:58:39.802 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-18T23:58:39.802 INFO:teuthology.lock.ops:Updating smithi044.front.sepia.ceph.com on lock server 2024-08-18T23:58:39.826 DEBUG:teuthology.orchestra.run.smithi116:> uname -m 2024-08-18T23:58:39.846 INFO:teuthology.orchestra.run.smithi116.stdout:x86_64 2024-08-18T23:58:39.846 DEBUG:teuthology.orchestra.run.smithi116:> cat /etc/os-release 2024-08-18T23:58:39.904 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="CentOS Stream" 2024-08-18T23:58:39.904 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="9" 2024-08-18T23:58:39.904 INFO:teuthology.orchestra.run.smithi116.stdout:ID="centos" 2024-08-18T23:58:39.905 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE="rhel fedora" 2024-08-18T23:58:39.905 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="9" 2024-08-18T23:58:39.905 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM_ID="platform:el9" 2024-08-18T23:58:39.905 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-18T23:58:39.905 INFO:teuthology.orchestra.run.smithi116.stdout:ANSI_COLOR="0;31" 2024-08-18T23:58:39.905 INFO:teuthology.orchestra.run.smithi116.stdout:LOGO="fedora-logo-icon" 2024-08-18T23:58:39.905 INFO:teuthology.orchestra.run.smithi116.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-18T23:58:39.906 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://centos.org/" 2024-08-18T23:58:39.906 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-08-18T23:58:39.906 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-18T23:58:39.906 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-18T23:58:39.906 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2024-08-18T23:58:39.926 DEBUG:teuthology.orchestra.run.smithi171:> uname -m 2024-08-18T23:58:39.945 INFO:teuthology.orchestra.run.smithi171.stdout:x86_64 2024-08-18T23:58:39.945 DEBUG:teuthology.orchestra.run.smithi171:> cat /etc/os-release 2024-08-18T23:58:40.003 INFO:teuthology.orchestra.run.smithi171.stdout:NAME="CentOS Stream" 2024-08-18T23:58:40.003 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION="9" 2024-08-18T23:58:40.003 INFO:teuthology.orchestra.run.smithi171.stdout:ID="centos" 2024-08-18T23:58:40.003 INFO:teuthology.orchestra.run.smithi171.stdout:ID_LIKE="rhel fedora" 2024-08-18T23:58:40.003 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION_ID="9" 2024-08-18T23:58:40.003 INFO:teuthology.orchestra.run.smithi171.stdout:PLATFORM_ID="platform:el9" 2024-08-18T23:58:40.003 INFO:teuthology.orchestra.run.smithi171.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-18T23:58:40.003 INFO:teuthology.orchestra.run.smithi171.stdout:ANSI_COLOR="0;31" 2024-08-18T23:58:40.003 INFO:teuthology.orchestra.run.smithi171.stdout:LOGO="fedora-logo-icon" 2024-08-18T23:58:40.003 INFO:teuthology.orchestra.run.smithi171.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-18T23:58:40.003 INFO:teuthology.orchestra.run.smithi171.stdout:HOME_URL="https://centos.org/" 2024-08-18T23:58:40.004 INFO:teuthology.orchestra.run.smithi171.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-08-18T23:58:40.004 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-18T23:58:40.004 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-18T23:58:40.004 INFO:teuthology.lock.ops:Updating smithi171.front.sepia.ceph.com on lock server 2024-08-18T23:58:40.026 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-08-18T23:58:40.039 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-08-18T23:58:40.081 INFO:teuthology.task.internal:Checking for old test directory... 2024-08-18T23:58:40.081 DEBUG:teuthology.orchestra.run.smithi044:> test '!' -e /home/ubuntu/cephtest 2024-08-18T23:58:40.083 DEBUG:teuthology.orchestra.run.smithi116:> test '!' -e /home/ubuntu/cephtest 2024-08-18T23:58:40.086 DEBUG:teuthology.orchestra.run.smithi171:> test '!' -e /home/ubuntu/cephtest 2024-08-18T23:58:40.103 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-08-18T23:58:40.110 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-08-18T23:58:40.110 DEBUG:teuthology.orchestra.run.smithi044:> test -z $(ls -A /var/lib/ceph) 2024-08-18T23:58:40.141 DEBUG:teuthology.orchestra.run.smithi116:> test -z $(ls -A /var/lib/ceph) 2024-08-18T23:58:40.144 DEBUG:teuthology.orchestra.run.smithi171:> test -z $(ls -A /var/lib/ceph) 2024-08-18T23:58:40.166 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-08-18T23:58:40.251 INFO:teuthology.run_tasks:Running task kernel... 2024-08-18T23:58:40.265 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-08-18T23:58:40.265 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-08-18T23:58:40.265 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-08-18T23:58:40.266 DEBUG:teuthology.orchestra.run.smithi044:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-18T23:58:40.283 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T23:58:40.283 DEBUG:teuthology.orchestra.run.smithi044:> uname -r 2024-08-18T23:58:40.341 INFO:teuthology.orchestra.run.smithi044.stdout:5.14.0-480.el9.x86_64 2024-08-18T23:58:40.342 INFO:teuthology.task.kernel:Running kernel on smithi044: 5.14.0-480.el9.x86_64 2024-08-18T23:58:40.342 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum install -y kernel 2024-08-18T23:58:44.296 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - BaseOS 4.1 MB/s | 8.2 MB 00:02 2024-08-18T23:58:46.197 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - AppStream 26 MB/s | 20 MB 00:00 2024-08-18T23:58:50.823 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - CRB 8.6 MB/s | 6.6 MB 00:00 2024-08-18T23:58:52.532 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - Extras packages 42 kB/s | 18 kB 00:00 2024-08-18T23:58:53.419 INFO:teuthology.orchestra.run.smithi044.stdout:Extra Packages for Enterprise Linux 29 MB/s | 22 MB 00:00 2024-08-18T23:58:59.017 INFO:teuthology.orchestra.run.smithi044.stdout:lab-extras 49 kB/s | 1.7 kB 00:00 2024-08-18T23:59:01.007 INFO:teuthology.orchestra.run.smithi044.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-08-18T23:59:01.007 INFO:teuthology.orchestra.run.smithi044.stdout:Package kernel-5.14.0-480.el9.x86_64 is already installed. 2024-08-18T23:59:01.085 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-08-18T23:59:01.086 INFO:teuthology.orchestra.run.smithi044.stdout:Nothing to do. 2024-08-18T23:59:01.086 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-08-18T23:59:01.188 DEBUG:teuthology.orchestra.run.smithi044:> echo no | sudo yum reinstall kernel || true 2024-08-18T23:59:01.718 INFO:teuthology.orchestra.run.smithi044.stdout:Last metadata expiration check: 0:00:03 ago on Sun 18 Aug 2024 11:58:58 PM UTC. 2024-08-18T23:59:01.860 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-08-18T23:59:01.871 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-08-18T23:59:01.871 INFO:teuthology.orchestra.run.smithi044.stdout: Package Architecture Version Repository Size 2024-08-18T23:59:01.871 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-08-18T23:59:01.871 INFO:teuthology.orchestra.run.smithi044.stdout:Reinstalling: 2024-08-18T23:59:01.871 INFO:teuthology.orchestra.run.smithi044.stdout: kernel x86_64 5.14.0-480.el9 baseos 1.5 M 2024-08-18T23:59:01.872 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-18T23:59:01.872 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction Summary 2024-08-18T23:59:01.872 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-08-18T23:59:01.872 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-18T23:59:01.872 INFO:teuthology.orchestra.run.smithi044.stdout:Total download size: 1.5 M 2024-08-18T23:59:01.872 INFO:teuthology.orchestra.run.smithi044.stdout:Installed size: 0 2024-08-18T23:59:01.872 INFO:teuthology.orchestra.run.smithi044.stderr:Operation aborted. 2024-08-18T23:59:01.923 INFO:teuthology.orchestra.run.smithi044.stdout:Is this ok [y/N]: 2024-08-18T23:59:01.923 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum reinstall -y kernel || true 2024-08-18T23:59:02.450 INFO:teuthology.orchestra.run.smithi044.stdout:Last metadata expiration check: 0:00:04 ago on Sun 18 Aug 2024 11:58:58 PM UTC. 2024-08-18T23:59:02.577 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-08-18T23:59:02.578 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-08-18T23:59:02.578 INFO:teuthology.orchestra.run.smithi044.stdout: Package Architecture Version Repository Size 2024-08-18T23:59:02.578 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-08-18T23:59:02.578 INFO:teuthology.orchestra.run.smithi044.stdout:Reinstalling: 2024-08-18T23:59:02.578 INFO:teuthology.orchestra.run.smithi044.stdout: kernel x86_64 5.14.0-480.el9 baseos 1.5 M 2024-08-18T23:59:02.578 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-18T23:59:02.578 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction Summary 2024-08-18T23:59:02.578 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-08-18T23:59:02.578 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-18T23:59:02.579 INFO:teuthology.orchestra.run.smithi044.stdout:Total download size: 1.5 M 2024-08-18T23:59:02.579 INFO:teuthology.orchestra.run.smithi044.stdout:Installed size: 0 2024-08-18T23:59:02.579 INFO:teuthology.orchestra.run.smithi044.stdout:Downloading Packages: 2024-08-18T23:59:02.986 INFO:teuthology.orchestra.run.smithi044.stdout:kernel-5.14.0-480.el9.x86_64.rpm 10 MB/s | 1.5 MB 00:00 2024-08-18T23:59:02.986 INFO:teuthology.orchestra.run.smithi044.stdout:-------------------------------------------------------------------------------- 2024-08-18T23:59:02.986 INFO:teuthology.orchestra.run.smithi044.stdout:Total 3.7 MB/s | 1.5 MB 00:00 2024-08-18T23:59:03.021 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction check 2024-08-18T23:59:03.273 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction check succeeded. 2024-08-18T23:59:03.273 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction test 2024-08-18T23:59:03.299 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction test succeeded. 2024-08-18T23:59:03.299 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction 2024-08-18T23:59:03.465 INFO:teuthology.orchestra.run.smithi044.stdout: Preparing : 1/1 2024-08-18T23:59:03.529 INFO:teuthology.orchestra.run.smithi044.stdout: Reinstalling : kernel-5.14.0-480.el9.x86_64 1/2 2024-08-18T23:59:03.530 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : kernel-5.14.0-480.el9.x86_64 2/2 2024-08-18T23:59:04.202 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: kernel-5.14.0-480.el9.x86_64 2/2 2024-08-18T23:59:04.203 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : kernel-5.14.0-480.el9.x86_64 1/2 2024-08-18T23:59:05.031 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : kernel-5.14.0-480.el9.x86_64 2/2 2024-08-18T23:59:05.032 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-18T23:59:05.032 INFO:teuthology.orchestra.run.smithi044.stdout:Reinstalled: 2024-08-18T23:59:05.032 INFO:teuthology.orchestra.run.smithi044.stdout: kernel-5.14.0-480.el9.x86_64 2024-08-18T23:59:05.032 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-18T23:59:05.032 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-08-18T23:59:05.199 DEBUG:teuthology.orchestra.run.smithi044:> rpm -q kernel | sort -rV | head -n 1 2024-08-18T23:59:05.256 INFO:teuthology.orchestra.run.smithi044.stdout:kernel-5.14.0-480.el9.x86_64 2024-08-18T23:59:05.256 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-480.el9.x86_64 2024-08-18T23:59:05.256 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-08-18T23:59:05.256 DEBUG:teuthology.parallel:result is None 2024-08-18T23:59:05.257 INFO:teuthology.run_tasks:Running task internal.base... 2024-08-18T23:59:05.265 INFO:teuthology.task.internal:Creating test directory... 2024-08-18T23:59:05.266 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-18T23:59:05.268 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-18T23:59:05.270 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-18T23:59:05.289 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-08-18T23:59:05.306 INFO:teuthology.run_tasks:Running task internal.archive... 2024-08-18T23:59:05.328 INFO:teuthology.task.internal:Creating archive directory... 2024-08-18T23:59:05.329 DEBUG:teuthology.orchestra.run.smithi044:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-18T23:59:05.331 DEBUG:teuthology.orchestra.run.smithi116:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-18T23:59:05.333 DEBUG:teuthology.orchestra.run.smithi171:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-18T23:59:05.431 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-08-18T23:59:05.439 INFO:teuthology.task.internal:Enabling coredump saving... 2024-08-18T23:59:05.439 DEBUG:teuthology.orchestra.run.smithi116:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-18T23:59:05.455 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T23:59:05.456 DEBUG:teuthology.orchestra.run.smithi171:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-18T23:59:05.473 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T23:59:05.474 DEBUG:teuthology.orchestra.run.smithi044:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-18T23:59:05.476 DEBUG:teuthology.orchestra.run.smithi116:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-18T23:59:05.499 DEBUG:teuthology.orchestra.run.smithi171:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-18T23:59:05.503 INFO:teuthology.orchestra.run.smithi044.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-18T23:59:05.528 INFO:teuthology.orchestra.run.smithi044.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-18T23:59:05.555 INFO:teuthology.orchestra.run.smithi116.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-18T23:59:05.560 INFO:teuthology.orchestra.run.smithi171.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-18T23:59:05.573 INFO:teuthology.orchestra.run.smithi116.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-18T23:59:05.579 INFO:teuthology.orchestra.run.smithi171.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-18T23:59:05.581 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-08-18T23:59:05.588 INFO:teuthology.task.internal:Configuring sudo... 2024-08-18T23:59:05.588 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-18T23:59:05.591 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-18T23:59:05.593 DEBUG:teuthology.orchestra.run.smithi171:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-18T23:59:05.621 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-08-18T23:59:05.655 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-08-18T23:59:05.656 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-18T23:59:05.658 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-18T23:59:05.660 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-18T23:59:05.677 DEBUG:teuthology.orchestra.run.smithi044:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-18T23:59:05.752 DEBUG:teuthology.orchestra.run.smithi044:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-18T23:59:05.800 DEBUG:teuthology.orchestra.run.smithi044:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-18T23:59:05.880 DEBUG:teuthology.orchestra.run.smithi044:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-18T23:59:05.922 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-08-18T23:59:05.922 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-18T23:59:05.987 DEBUG:teuthology.orchestra.run.smithi116:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-18T23:59:06.031 DEBUG:teuthology.orchestra.run.smithi116:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-18T23:59:06.083 DEBUG:teuthology.orchestra.run.smithi116:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-18T23:59:06.165 DEBUG:teuthology.orchestra.run.smithi116:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-18T23:59:06.207 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-08-18T23:59:06.207 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-18T23:59:06.272 DEBUG:teuthology.orchestra.run.smithi171:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-18T23:59:06.318 DEBUG:teuthology.orchestra.run.smithi171:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-18T23:59:06.380 DEBUG:teuthology.orchestra.run.smithi171:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-18T23:59:06.423 DEBUG:teuthology.orchestra.run.smithi171:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-18T23:59:06.468 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-08-18T23:59:06.468 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-18T23:59:06.535 DEBUG:teuthology.orchestra.run.smithi044:> sudo service rsyslog restart 2024-08-18T23:59:06.537 DEBUG:teuthology.orchestra.run.smithi116:> sudo service rsyslog restart 2024-08-18T23:59:06.542 DEBUG:teuthology.orchestra.run.smithi171:> sudo service rsyslog restart 2024-08-18T23:59:06.573 INFO:teuthology.orchestra.run.smithi116.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-18T23:59:06.582 INFO:teuthology.orchestra.run.smithi044.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-18T23:59:06.623 INFO:teuthology.orchestra.run.smithi171.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-18T23:59:06.910 INFO:teuthology.run_tasks:Running task internal.timer... 2024-08-18T23:59:06.917 INFO:teuthology.task.internal:Starting timer... 2024-08-18T23:59:06.917 INFO:teuthology.run_tasks:Running task pcp... 2024-08-18T23:59:06.956 INFO:teuthology.run_tasks:Running task selinux... 2024-08-18T23:59:06.981 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-08-18T23:59:06.981 DEBUG:teuthology.orchestra.run.smithi044:> sudo service auditd rotate 2024-08-18T23:59:07.036 INFO:teuthology.orchestra.run.smithi044.stdout:Rotating logs: 2024-08-18T23:59:07.038 DEBUG:teuthology.orchestra.run.smithi116:> sudo service auditd rotate 2024-08-18T23:59:07.110 INFO:teuthology.orchestra.run.smithi116.stdout:Rotating logs: 2024-08-18T23:59:07.112 DEBUG:teuthology.orchestra.run.smithi171:> sudo service auditd rotate 2024-08-18T23:59:07.183 INFO:teuthology.orchestra.run.smithi171.stdout:Rotating logs: 2024-08-18T23:59:07.185 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-08-18T23:59:07.186 DEBUG:teuthology.orchestra.run.smithi044:> /usr/sbin/getenforce 2024-08-18T23:59:07.205 INFO:teuthology.orchestra.run.smithi044.stdout:Permissive 2024-08-18T23:59:07.205 DEBUG:teuthology.orchestra.run.smithi116:> /usr/sbin/getenforce 2024-08-18T23:59:07.223 INFO:teuthology.orchestra.run.smithi116.stdout:Permissive 2024-08-18T23:59:07.224 DEBUG:teuthology.orchestra.run.smithi171:> /usr/sbin/getenforce 2024-08-18T23:59:07.246 INFO:teuthology.orchestra.run.smithi171.stdout:Permissive 2024-08-18T23:59:07.246 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi044.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi116.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi171.front.sepia.ceph.com': 'permissive'} 2024-08-18T23:59:07.247 DEBUG:teuthology.orchestra.run.smithi044:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-08-18T23:59:07.273 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T23:59:07.273 DEBUG:teuthology.orchestra.run.smithi116:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-08-18T23:59:07.300 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T23:59:07.300 DEBUG:teuthology.orchestra.run.smithi171:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-08-18T23:59:07.327 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T23:59:07.328 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-08-18T23:59:07.328 DEBUG:teuthology.orchestra.run.smithi044:> sudo /usr/sbin/setenforce permissive 2024-08-18T23:59:07.369 DEBUG:teuthology.orchestra.run.smithi116:> sudo /usr/sbin/setenforce permissive 2024-08-18T23:59:07.409 DEBUG:teuthology.orchestra.run.smithi171:> sudo /usr/sbin/setenforce permissive 2024-08-18T23:59:07.436 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-08-18T23:59:07.447 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-08-18T23:59:07.462 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-08-18T23:59:07.463 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi044.front.sepia.ceph.com,smithi116.front.sepia.ceph.com,smithi171.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-08-19T00:01:11.214 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi044.front.sepia.ceph.com'), Remote(name='ubuntu@smithi116.front.sepia.ceph.com'), Remote(name='ubuntu@smithi171.front.sepia.ceph.com')] 2024-08-19T00:01:11.215 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-08-19T00:01:11.217 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-19T00:01:11.296 DEBUG:teuthology.orchestra.run.smithi044:> true 2024-08-19T00:01:11.374 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-08-19T00:01:11.374 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-08-19T00:01:11.374 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-19T00:01:11.453 DEBUG:teuthology.orchestra.run.smithi116:> true 2024-08-19T00:01:11.531 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-08-19T00:01:11.531 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-08-19T00:01:11.531 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-19T00:01:11.608 DEBUG:teuthology.orchestra.run.smithi171:> true 2024-08-19T00:01:11.691 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-08-19T00:01:11.692 INFO:teuthology.run_tasks:Running task clock... 2024-08-19T00:01:11.706 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-08-19T00:01:11.706 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-19T00:01:11.707 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-19T00:01:11.709 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-19T00:01:11.709 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-19T00:01:11.711 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-19T00:01:11.712 DEBUG:teuthology.orchestra.run.smithi171:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-19T00:01:11.740 INFO:teuthology.orchestra.run.smithi044.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-19T00:01:11.740 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-19T00:01:11.754 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-19T00:01:11.755 INFO:teuthology.orchestra.run.smithi044.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-19T00:01:11.765 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-19T00:01:11.779 INFO:teuthology.orchestra.run.smithi116.stderr:sudo: ntpd: command not found 2024-08-19T00:01:11.781 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-19T00:01:11.781 INFO:teuthology.orchestra.run.smithi044.stderr:sudo: ntpd: command not found 2024-08-19T00:01:11.790 INFO:teuthology.orchestra.run.smithi116.stdout:506 Cannot talk to daemon 2024-08-19T00:01:11.793 INFO:teuthology.orchestra.run.smithi044.stdout:506 Cannot talk to daemon 2024-08-19T00:01:11.804 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-19T00:01:11.807 INFO:teuthology.orchestra.run.smithi171.stderr:sudo: ntpd: command not found 2024-08-19T00:01:11.808 INFO:teuthology.orchestra.run.smithi044.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-19T00:01:11.818 INFO:teuthology.orchestra.run.smithi171.stdout:506 Cannot talk to daemon 2024-08-19T00:01:11.819 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-19T00:01:11.822 INFO:teuthology.orchestra.run.smithi044.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-19T00:01:11.833 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-19T00:01:11.847 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-19T00:01:11.875 INFO:teuthology.orchestra.run.smithi116.stderr:bash: line 1: ntpq: command not found 2024-08-19T00:01:11.878 INFO:teuthology.orchestra.run.smithi116.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-19T00:01:11.878 INFO:teuthology.orchestra.run.smithi116.stdout:=============================================================================== 2024-08-19T00:01:11.879 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-19T00:01:11.879 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-19T00:01:11.879 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-19T00:01:11.879 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-19T00:01:11.882 INFO:teuthology.orchestra.run.smithi044.stderr:bash: line 1: ntpq: command not found 2024-08-19T00:01:11.886 INFO:teuthology.orchestra.run.smithi044.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-19T00:01:11.886 INFO:teuthology.orchestra.run.smithi044.stdout:=============================================================================== 2024-08-19T00:01:11.886 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-19T00:01:11.886 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-19T00:01:11.886 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-19T00:01:11.886 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-19T00:01:11.904 INFO:teuthology.orchestra.run.smithi171.stderr:bash: line 1: ntpq: command not found 2024-08-19T00:01:11.907 INFO:teuthology.orchestra.run.smithi171.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-19T00:01:11.907 INFO:teuthology.orchestra.run.smithi171.stdout:=============================================================================== 2024-08-19T00:01:11.908 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-19T00:01:11.908 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-19T00:01:11.908 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-19T00:01:11.908 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-19T00:01:11.909 INFO:teuthology.run_tasks:Running task install... 2024-08-19T00:01:11.916 DEBUG:teuthology.task.install:project ceph 2024-08-19T00:01:11.917 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'de09dd018de4baddfa6ca4d43bc8fb784cf75833'}} 2024-08-19T00:01:11.917 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'de09dd018de4baddfa6ca4d43bc8fb784cf75833'} 2024-08-19T00:01:11.917 INFO:teuthology.task.install:Using flavor: default 2024-08-19T00:01:11.922 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-08-19T00:01:11.922 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-08-19T00:01:11.923 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'de09dd018de4baddfa6ca4d43bc8fb784cf75833', 'tag': None, 'wait_for_package': False} 2024-08-19T00:01:11.923 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-19T00:01:11.925 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'de09dd018de4baddfa6ca4d43bc8fb784cf75833', 'tag': None, 'wait_for_package': False} 2024-08-19T00:01:11.926 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-19T00:01:11.927 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'de09dd018de4baddfa6ca4d43bc8fb784cf75833', 'tag': None, 'wait_for_package': False} 2024-08-19T00:01:11.927 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-19T00:01:12.067 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/centos/9/flavors/default/ 2024-08-19T00:01:12.067 INFO:teuthology.task.install.rpm:Package version is 19.1.0-1382.gde09dd01 2024-08-19T00:01:12.076 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/centos/9/flavors/default/ 2024-08-19T00:01:12.076 INFO:teuthology.task.install.rpm:Package version is 19.1.0-1382.gde09dd01 2024-08-19T00:01:12.082 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/centos/9/flavors/default/ 2024-08-19T00:01:12.082 INFO:teuthology.task.install.rpm:Package version is 19.1.0-1382.gde09dd01 2024-08-19T00:01:12.176 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-19T00:01:12.176 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-08-19T00:01:12.176 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-19T00:01:12.184 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-19T00:01:12.184 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-08-19T00:01:12.184 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-19T00:01:12.191 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-19T00:01:12.191 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-08-19T00:01:12.191 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-19T00:01:12.203 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-08-19T00:01:12.203 DEBUG:teuthology.orchestra.run.smithi044:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/de09dd018de4baddfa6ca4d43bc8fb784cf75833/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-19T00:01:12.212 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-08-19T00:01:12.212 DEBUG:teuthology.orchestra.run.smithi171:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/de09dd018de4baddfa6ca4d43bc8fb784cf75833/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-19T00:01:12.216 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-08-19T00:01:12.216 DEBUG:teuthology.orchestra.run.smithi116:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/de09dd018de4baddfa6ca4d43bc8fb784cf75833/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-19T00:01:12.269 DEBUG:teuthology.orchestra.run.smithi044:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-19T00:01:12.278 DEBUG:teuthology.orchestra.run.smithi171:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-19T00:01:12.281 DEBUG:teuthology.orchestra.run.smithi116:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-19T00:01:12.344 DEBUG:teuthology.orchestra.run.smithi044:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-19T00:01:12.353 DEBUG:teuthology.orchestra.run.smithi171:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-19T00:01:12.356 DEBUG:teuthology.orchestra.run.smithi116:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-19T00:01:12.408 INFO:teuthology.orchestra.run.smithi044.stdout:check_obsoletes = 1 2024-08-19T00:01:12.409 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum clean all 2024-08-19T00:01:12.418 INFO:teuthology.orchestra.run.smithi171.stdout:check_obsoletes = 1 2024-08-19T00:01:12.420 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum clean all 2024-08-19T00:01:12.420 INFO:teuthology.orchestra.run.smithi116.stdout:check_obsoletes = 1 2024-08-19T00:01:12.422 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum clean all 2024-08-19T00:01:12.639 INFO:teuthology.orchestra.run.smithi044.stdout:45 files removed 2024-08-19T00:01:12.646 INFO:teuthology.orchestra.run.smithi171.stdout:45 files removed 2024-08-19T00:01:12.646 INFO:teuthology.orchestra.run.smithi116.stdout:45 files removed 2024-08-19T00:01:12.666 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-08-19T00:01:12.672 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-08-19T00:01:12.673 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-08-19T00:01:13.206 INFO:teuthology.orchestra.run.smithi044.stdout:ceph packages for x86_64 321 kB/s | 84 kB 00:00 2024-08-19T00:01:13.210 INFO:teuthology.orchestra.run.smithi171.stdout:ceph packages for x86_64 318 kB/s | 84 kB 00:00 2024-08-19T00:01:13.216 INFO:teuthology.orchestra.run.smithi116.stdout:ceph packages for x86_64 308 kB/s | 84 kB 00:00 2024-08-19T00:01:13.483 INFO:teuthology.orchestra.run.smithi116.stdout:ceph noarch packages 52 kB/s | 12 kB 00:00 2024-08-19T00:01:13.494 INFO:teuthology.orchestra.run.smithi171.stdout:ceph noarch packages 48 kB/s | 12 kB 00:00 2024-08-19T00:01:13.498 INFO:teuthology.orchestra.run.smithi044.stdout:ceph noarch packages 47 kB/s | 12 kB 00:00 2024-08-19T00:01:13.742 INFO:teuthology.orchestra.run.smithi116.stdout:ceph source packages 8.5 kB/s | 1.9 kB 00:00 2024-08-19T00:01:13.761 INFO:teuthology.orchestra.run.smithi171.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-08-19T00:01:13.773 INFO:teuthology.orchestra.run.smithi044.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-08-19T00:01:15.198 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - BaseOS 5.9 MB/s | 8.2 MB 00:01 2024-08-19T00:01:15.578 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - BaseOS 4.6 MB/s | 8.2 MB 00:01 2024-08-19T00:01:16.667 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - BaseOS 2.8 MB/s | 8.2 MB 00:02 2024-08-19T00:01:16.991 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - AppStream 30 MB/s | 20 MB 00:00 2024-08-19T00:01:17.412 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - AppStream 26 MB/s | 20 MB 00:00 2024-08-19T00:01:18.435 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - AppStream 31 MB/s | 20 MB 00:00 2024-08-19T00:01:21.359 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.6 MB 00:00 2024-08-19T00:01:21.665 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.6 MB 00:00 2024-08-19T00:01:22.694 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.6 MB 00:00 2024-08-19T00:01:23.349 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - Extras packages 38 kB/s | 18 kB 00:00 2024-08-19T00:01:23.768 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 18 kB 00:01 2024-08-19T00:01:24.329 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - Extras packages 43 kB/s | 18 kB 00:00 2024-08-19T00:01:24.570 INFO:teuthology.orchestra.run.smithi171.stdout:Extra Packages for Enterprise Linux 20 MB/s | 22 MB 00:01 2024-08-19T00:01:24.619 INFO:teuthology.orchestra.run.smithi044.stdout:Extra Packages for Enterprise Linux 31 MB/s | 22 MB 00:00 2024-08-19T00:01:25.199 INFO:teuthology.orchestra.run.smithi116.stdout:Extra Packages for Enterprise Linux 30 MB/s | 22 MB 00:00 2024-08-19T00:01:29.909 INFO:teuthology.orchestra.run.smithi171.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-08-19T00:01:30.287 INFO:teuthology.orchestra.run.smithi044.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-08-19T00:01:30.638 INFO:teuthology.orchestra.run.smithi116.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-08-19T00:01:32.094 INFO:teuthology.orchestra.run.smithi171.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-19T00:01:32.095 INFO:teuthology.orchestra.run.smithi171.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-19T00:01:32.105 INFO:teuthology.orchestra.run.smithi171.stdout:Package NetworkManager-1:1.48.2-2.el9.x86_64 is already installed. 2024-08-19T00:01:32.106 INFO:teuthology.orchestra.run.smithi171.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-19T00:01:32.107 INFO:teuthology.orchestra.run.smithi171.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-08-19T00:01:32.108 INFO:teuthology.orchestra.run.smithi171.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-19T00:01:32.110 INFO:teuthology.orchestra.run.smithi171.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-19T00:01:32.112 INFO:teuthology.orchestra.run.smithi171.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-19T00:01:32.113 INFO:teuthology.orchestra.run.smithi171.stdout:Package xfsprogs-6.4.0-3.el9.x86_64 is already installed. 2024-08-19T00:01:32.172 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved. 2024-08-19T00:01:32.190 INFO:teuthology.orchestra.run.smithi171.stdout:======================================================================================= 2024-08-19T00:01:32.190 INFO:teuthology.orchestra.run.smithi171.stdout: Package Arch Version Repository Size 2024-08-19T00:01:32.191 INFO:teuthology.orchestra.run.smithi171.stdout:======================================================================================= 2024-08-19T00:01:32.191 INFO:teuthology.orchestra.run.smithi171.stdout:Installing: 2024-08-19T00:01:32.191 INFO:teuthology.orchestra.run.smithi171.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-19T00:01:32.191 INFO:teuthology.orchestra.run.smithi171.stdout: ceph x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 6.6 k 2024-08-19T00:01:32.191 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-base x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 5.4 M 2024-08-19T00:01:32.191 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-fuse x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 896 k 2024-08-19T00:01:32.191 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-immutable-object-cache x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 145 k 2024-08-19T00:01:32.191 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 1.5 M 2024-08-19T00:01:32.191 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-cephadm noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 146 k 2024-08-19T00:01:32.191 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-dashboard noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 3.6 M 2024-08-19T00:01:32.191 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 7.4 M 2024-08-19T00:01:32.191 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-rook noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 49 k 2024-08-19T00:01:32.192 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-radosgw x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 11 M 2024-08-19T00:01:32.192 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-test x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 49 M 2024-08-19T00:01:32.192 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-volume noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 285 k 2024-08-19T00:01:32.192 INFO:teuthology.orchestra.run.smithi171.stdout: cephadm noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 766 k 2024-08-19T00:01:32.192 INFO:teuthology.orchestra.run.smithi171.stdout: cephfs-mirror x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 225 k 2024-08-19T00:01:32.192 INFO:teuthology.orchestra.run.smithi171.stdout: cephfs-shell x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 27 k 2024-08-19T00:01:32.192 INFO:teuthology.orchestra.run.smithi171.stdout: cephfs-top noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 18 k 2024-08-19T00:01:32.192 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-19T00:01:32.192 INFO:teuthology.orchestra.run.smithi171.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-19T00:01:32.192 INFO:teuthology.orchestra.run.smithi171.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-19T00:01:32.192 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs-devel x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 32 k 2024-08-19T00:01:32.192 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs2 x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 753 k 2024-08-19T00:01:32.193 INFO:teuthology.orchestra.run.smithi171.stdout: librados-devel x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 127 k 2024-08-19T00:01:32.193 INFO:teuthology.orchestra.run.smithi171.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-19T00:01:32.193 INFO:teuthology.orchestra.run.smithi171.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-08-19T00:01:32.193 INFO:teuthology.orchestra.run.smithi171.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-08-19T00:01:32.193 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-08-19T00:01:32.193 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-08-19T00:01:32.193 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-08-19T00:01:32.193 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cephfs x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 188 k 2024-08-19T00:01:32.193 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rados x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 369 k 2024-08-19T00:01:32.193 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rbd x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 350 k 2024-08-19T00:01:32.193 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rgw x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 117 k 2024-08-19T00:01:32.193 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-fuse x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 85 k 2024-08-19T00:01:32.194 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-mirror x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 3.1 M 2024-08-19T00:01:32.194 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-nbd x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 170 k 2024-08-19T00:01:32.194 INFO:teuthology.orchestra.run.smithi171.stdout: xfsprogs-devel x86_64 6.4.0-3.el9 appstream 96 k 2024-08-19T00:01:32.194 INFO:teuthology.orchestra.run.smithi171.stdout:Upgrading: 2024-08-19T00:01:32.194 INFO:teuthology.orchestra.run.smithi171.stdout: librados2 x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 3.4 M 2024-08-19T00:01:32.194 INFO:teuthology.orchestra.run.smithi171.stdout: librbd1 x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 3.2 M 2024-08-19T00:01:32.194 INFO:teuthology.orchestra.run.smithi171.stdout:Installing dependencies: 2024-08-19T00:01:32.194 INFO:teuthology.orchestra.run.smithi171.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-08-19T00:01:32.194 INFO:teuthology.orchestra.run.smithi171.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-19T00:01:32.194 INFO:teuthology.orchestra.run.smithi171.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-08-19T00:01:32.194 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-common x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 21 M 2024-08-19T00:01:32.194 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-grafana-dashboards noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 32 k 2024-08-19T00:01:32.195 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mds x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 2.4 M 2024-08-19T00:01:32.195 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-modules-core noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 249 k 2024-08-19T00:01:32.195 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mon x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 4.7 M 2024-08-19T00:01:32.195 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-osd x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 17 M 2024-08-19T00:01:32.195 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-prometheus-alerts noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 16 k 2024-08-19T00:01:32.195 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-selinux x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 25 k 2024-08-19T00:01:32.195 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-19T00:01:32.195 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-19T00:01:32.195 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-19T00:01:32.195 INFO:teuthology.orchestra.run.smithi171.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-19T00:01:32.195 INFO:teuthology.orchestra.run.smithi171.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-19T00:01:32.195 INFO:teuthology.orchestra.run.smithi171.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-08-19T00:01:32.195 INFO:teuthology.orchestra.run.smithi171.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-08-19T00:01:32.196 INFO:teuthology.orchestra.run.smithi171.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-08-19T00:01:32.196 INFO:teuthology.orchestra.run.smithi171.stdout: libcephsqlite x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 163 k 2024-08-19T00:01:32.196 INFO:teuthology.orchestra.run.smithi171.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-08-19T00:01:32.196 INFO:teuthology.orchestra.run.smithi171.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-19T00:01:32.196 INFO:teuthology.orchestra.run.smithi171.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-19T00:01:32.196 INFO:teuthology.orchestra.run.smithi171.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-08-19T00:01:32.196 INFO:teuthology.orchestra.run.smithi171.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-19T00:01:32.196 INFO:teuthology.orchestra.run.smithi171.stdout: libradosstriper1 x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 507 k 2024-08-19T00:01:32.196 INFO:teuthology.orchestra.run.smithi171.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-19T00:01:32.196 INFO:teuthology.orchestra.run.smithi171.stdout: librgw2 x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 5.4 M 2024-08-19T00:01:32.196 INFO:teuthology.orchestra.run.smithi171.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-19T00:01:32.196 INFO:teuthology.orchestra.run.smithi171.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-19T00:01:32.197 INFO:teuthology.orchestra.run.smithi171.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-19T00:01:32.197 INFO:teuthology.orchestra.run.smithi171.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-08-19T00:01:32.197 INFO:teuthology.orchestra.run.smithi171.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-08-19T00:01:32.197 INFO:teuthology.orchestra.run.smithi171.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-08-19T00:01:32.197 INFO:teuthology.orchestra.run.smithi171.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-08-19T00:01:32.197 INFO:teuthology.orchestra.run.smithi171.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-08-19T00:01:32.197 INFO:teuthology.orchestra.run.smithi171.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-08-19T00:01:32.197 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-08-19T00:01:32.197 INFO:teuthology.orchestra.run.smithi171.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-08-19T00:01:32.197 INFO:teuthology.orchestra.run.smithi171.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-08-19T00:01:32.197 INFO:teuthology.orchestra.run.smithi171.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-19T00:01:32.197 INFO:teuthology.orchestra.run.smithi171.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-08-19T00:01:32.197 INFO:teuthology.orchestra.run.smithi171.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-19T00:01:32.197 INFO:teuthology.orchestra.run.smithi171.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-19T00:01:32.198 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-19T00:01:32.198 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-argparse x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 45 k 2024-08-19T00:01:32.198 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-common x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 136 k 2024-08-19T00:01:32.198 INFO:teuthology.orchestra.run.smithi171.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-19T00:01:32.198 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-19T00:01:32.198 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-19T00:01:32.198 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-19T00:01:32.198 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-08-19T00:01:32.198 INFO:teuthology.orchestra.run.smithi171.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-08-19T00:01:32.198 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-19T00:01:32.198 INFO:teuthology.orchestra.run.smithi171.stdout: python3-devel x86_64 3.9.19-4.el9 appstream 244 k 2024-08-19T00:01:32.198 INFO:teuthology.orchestra.run.smithi171.stdout: python3-google-auth noarch 1:2.33.0-1.el9 epel 220 k 2024-08-19T00:01:32.199 INFO:teuthology.orchestra.run.smithi171.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-08-19T00:01:32.199 INFO:teuthology.orchestra.run.smithi171.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-08-19T00:01:32.199 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-19T00:01:32.199 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-19T00:01:32.199 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-19T00:01:32.199 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-19T00:01:32.199 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-19T00:01:32.199 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-19T00:01:32.199 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-19T00:01:32.199 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-19T00:01:32.199 INFO:teuthology.orchestra.run.smithi171.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-19T00:01:32.199 INFO:teuthology.orchestra.run.smithi171.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-19T00:01:32.199 INFO:teuthology.orchestra.run.smithi171.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-19T00:01:32.200 INFO:teuthology.orchestra.run.smithi171.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-19T00:01:32.200 INFO:teuthology.orchestra.run.smithi171.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-19T00:01:32.200 INFO:teuthology.orchestra.run.smithi171.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-19T00:01:32.200 INFO:teuthology.orchestra.run.smithi171.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-19T00:01:32.200 INFO:teuthology.orchestra.run.smithi171.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-19T00:01:32.200 INFO:teuthology.orchestra.run.smithi171.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-19T00:01:32.200 INFO:teuthology.orchestra.run.smithi171.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-19T00:01:32.200 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-19T00:01:32.200 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-19T00:01:32.200 INFO:teuthology.orchestra.run.smithi171.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-19T00:01:32.200 INFO:teuthology.orchestra.run.smithi171.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-19T00:01:32.200 INFO:teuthology.orchestra.run.smithi171.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-08-19T00:01:32.200 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-19T00:01:32.200 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-19T00:01:32.201 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-19T00:01:32.201 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-19T00:01:32.201 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-08-19T00:01:32.201 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-19T00:01:32.201 INFO:teuthology.orchestra.run.smithi171.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-19T00:01:32.201 INFO:teuthology.orchestra.run.smithi171.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-19T00:01:32.201 INFO:teuthology.orchestra.run.smithi171.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-19T00:01:32.201 INFO:teuthology.orchestra.run.smithi171.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-19T00:01:32.201 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-19T00:01:32.201 INFO:teuthology.orchestra.run.smithi171.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-19T00:01:32.201 INFO:teuthology.orchestra.run.smithi171.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-19T00:01:32.201 INFO:teuthology.orchestra.run.smithi171.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-19T00:01:32.202 INFO:teuthology.orchestra.run.smithi171.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-19T00:01:32.202 INFO:teuthology.orchestra.run.smithi171.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-19T00:01:32.202 INFO:teuthology.orchestra.run.smithi171.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-08-19T00:01:32.202 INFO:teuthology.orchestra.run.smithi171.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-19T00:01:32.202 INFO:teuthology.orchestra.run.smithi171.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-19T00:01:32.202 INFO:teuthology.orchestra.run.smithi171.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-19T00:01:32.202 INFO:teuthology.orchestra.run.smithi171.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-19T00:01:32.202 INFO:teuthology.orchestra.run.smithi171.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-08-19T00:01:32.202 INFO:teuthology.orchestra.run.smithi171.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-08-19T00:01:32.202 INFO:teuthology.orchestra.run.smithi171.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-08-19T00:01:32.202 INFO:teuthology.orchestra.run.smithi171.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-19T00:01:32.202 INFO:teuthology.orchestra.run.smithi171.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-19T00:01:32.202 INFO:teuthology.orchestra.run.smithi171.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-08-19T00:01:32.202 INFO:teuthology.orchestra.run.smithi171.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-19T00:01:32.203 INFO:teuthology.orchestra.run.smithi171.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-19T00:01:32.203 INFO:teuthology.orchestra.run.smithi171.stdout:Installing weak dependencies: 2024-08-19T00:01:32.203 INFO:teuthology.orchestra.run.smithi171.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-08-19T00:01:32.203 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-19T00:01:32.203 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction Summary 2024-08-19T00:01:32.203 INFO:teuthology.orchestra.run.smithi171.stdout:======================================================================================= 2024-08-19T00:01:32.203 INFO:teuthology.orchestra.run.smithi171.stdout:Install 148 Packages 2024-08-19T00:01:32.203 INFO:teuthology.orchestra.run.smithi171.stdout:Upgrade 2 Packages 2024-08-19T00:01:32.203 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-19T00:01:32.204 INFO:teuthology.orchestra.run.smithi171.stdout:Total download size: 218 M 2024-08-19T00:01:32.204 INFO:teuthology.orchestra.run.smithi171.stdout:Downloading Packages: 2024-08-19T00:01:32.558 INFO:teuthology.orchestra.run.smithi044.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-19T00:01:32.559 INFO:teuthology.orchestra.run.smithi044.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-19T00:01:32.573 INFO:teuthology.orchestra.run.smithi044.stdout:Package NetworkManager-1:1.48.2-2.el9.x86_64 is already installed. 2024-08-19T00:01:32.574 INFO:teuthology.orchestra.run.smithi044.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-19T00:01:32.578 INFO:teuthology.orchestra.run.smithi044.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-08-19T00:01:32.578 INFO:teuthology.orchestra.run.smithi044.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-19T00:01:32.578 INFO:teuthology.orchestra.run.smithi044.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-19T00:01:32.581 INFO:teuthology.orchestra.run.smithi044.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-19T00:01:32.582 INFO:teuthology.orchestra.run.smithi044.stdout:Package xfsprogs-6.4.0-3.el9.x86_64 is already installed. 2024-08-19T00:01:32.648 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-08-19T00:01:32.657 INFO:teuthology.orchestra.run.smithi044.stdout:======================================================================================= 2024-08-19T00:01:32.657 INFO:teuthology.orchestra.run.smithi044.stdout: Package Arch Version Repository Size 2024-08-19T00:01:32.657 INFO:teuthology.orchestra.run.smithi044.stdout:======================================================================================= 2024-08-19T00:01:32.657 INFO:teuthology.orchestra.run.smithi044.stdout:Installing: 2024-08-19T00:01:32.657 INFO:teuthology.orchestra.run.smithi044.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-19T00:01:32.657 INFO:teuthology.orchestra.run.smithi044.stdout: ceph x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 6.6 k 2024-08-19T00:01:32.657 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-base x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 5.4 M 2024-08-19T00:01:32.657 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-fuse x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 896 k 2024-08-19T00:01:32.658 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-immutable-object-cache x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 145 k 2024-08-19T00:01:32.658 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 1.5 M 2024-08-19T00:01:32.658 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-cephadm noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 146 k 2024-08-19T00:01:32.658 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-dashboard noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 3.6 M 2024-08-19T00:01:32.658 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 7.4 M 2024-08-19T00:01:32.658 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-rook noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 49 k 2024-08-19T00:01:32.658 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-radosgw x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 11 M 2024-08-19T00:01:32.658 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-test x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 49 M 2024-08-19T00:01:32.658 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-volume noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 285 k 2024-08-19T00:01:32.658 INFO:teuthology.orchestra.run.smithi044.stdout: cephadm noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 766 k 2024-08-19T00:01:32.658 INFO:teuthology.orchestra.run.smithi044.stdout: cephfs-mirror x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 225 k 2024-08-19T00:01:32.658 INFO:teuthology.orchestra.run.smithi044.stdout: cephfs-shell x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 27 k 2024-08-19T00:01:32.658 INFO:teuthology.orchestra.run.smithi044.stdout: cephfs-top noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 18 k 2024-08-19T00:01:32.659 INFO:teuthology.orchestra.run.smithi044.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-19T00:01:32.659 INFO:teuthology.orchestra.run.smithi044.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-19T00:01:32.659 INFO:teuthology.orchestra.run.smithi044.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-19T00:01:32.659 INFO:teuthology.orchestra.run.smithi044.stdout: libcephfs-devel x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 32 k 2024-08-19T00:01:32.659 INFO:teuthology.orchestra.run.smithi044.stdout: libcephfs2 x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 753 k 2024-08-19T00:01:32.659 INFO:teuthology.orchestra.run.smithi044.stdout: librados-devel x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 127 k 2024-08-19T00:01:32.659 INFO:teuthology.orchestra.run.smithi044.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-19T00:01:32.659 INFO:teuthology.orchestra.run.smithi044.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-08-19T00:01:32.659 INFO:teuthology.orchestra.run.smithi044.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-08-19T00:01:32.659 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-08-19T00:01:32.659 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-08-19T00:01:32.659 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-08-19T00:01:32.659 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cephfs x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 188 k 2024-08-19T00:01:32.660 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rados x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 369 k 2024-08-19T00:01:32.660 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rbd x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 350 k 2024-08-19T00:01:32.660 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rgw x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 117 k 2024-08-19T00:01:32.660 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-fuse x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 85 k 2024-08-19T00:01:32.660 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-mirror x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 3.1 M 2024-08-19T00:01:32.660 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-nbd x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 170 k 2024-08-19T00:01:32.660 INFO:teuthology.orchestra.run.smithi044.stdout: xfsprogs-devel x86_64 6.4.0-3.el9 appstream 96 k 2024-08-19T00:01:32.660 INFO:teuthology.orchestra.run.smithi044.stdout:Upgrading: 2024-08-19T00:01:32.660 INFO:teuthology.orchestra.run.smithi044.stdout: librados2 x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 3.4 M 2024-08-19T00:01:32.660 INFO:teuthology.orchestra.run.smithi044.stdout: librbd1 x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 3.2 M 2024-08-19T00:01:32.660 INFO:teuthology.orchestra.run.smithi044.stdout:Installing dependencies: 2024-08-19T00:01:32.660 INFO:teuthology.orchestra.run.smithi044.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-08-19T00:01:32.660 INFO:teuthology.orchestra.run.smithi044.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-19T00:01:32.661 INFO:teuthology.orchestra.run.smithi044.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-08-19T00:01:32.661 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-common x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 21 M 2024-08-19T00:01:32.661 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-grafana-dashboards noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 32 k 2024-08-19T00:01:32.661 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mds x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 2.4 M 2024-08-19T00:01:32.661 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-modules-core noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 249 k 2024-08-19T00:01:32.661 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mon x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 4.7 M 2024-08-19T00:01:32.661 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-osd x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 17 M 2024-08-19T00:01:32.661 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-prometheus-alerts noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 16 k 2024-08-19T00:01:32.661 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-selinux x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 25 k 2024-08-19T00:01:32.661 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-19T00:01:32.661 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-19T00:01:32.661 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-19T00:01:32.661 INFO:teuthology.orchestra.run.smithi044.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-19T00:01:32.662 INFO:teuthology.orchestra.run.smithi044.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-19T00:01:32.662 INFO:teuthology.orchestra.run.smithi044.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-08-19T00:01:32.662 INFO:teuthology.orchestra.run.smithi044.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-08-19T00:01:32.662 INFO:teuthology.orchestra.run.smithi044.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-08-19T00:01:32.662 INFO:teuthology.orchestra.run.smithi044.stdout: libcephsqlite x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 163 k 2024-08-19T00:01:32.662 INFO:teuthology.orchestra.run.smithi044.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-08-19T00:01:32.662 INFO:teuthology.orchestra.run.smithi044.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-19T00:01:32.662 INFO:teuthology.orchestra.run.smithi044.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-19T00:01:32.662 INFO:teuthology.orchestra.run.smithi044.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-08-19T00:01:32.662 INFO:teuthology.orchestra.run.smithi044.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-19T00:01:32.662 INFO:teuthology.orchestra.run.smithi044.stdout: libradosstriper1 x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 507 k 2024-08-19T00:01:32.662 INFO:teuthology.orchestra.run.smithi044.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-19T00:01:32.662 INFO:teuthology.orchestra.run.smithi044.stdout: librgw2 x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 5.4 M 2024-08-19T00:01:32.663 INFO:teuthology.orchestra.run.smithi044.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-19T00:01:32.663 INFO:teuthology.orchestra.run.smithi044.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-19T00:01:32.663 INFO:teuthology.orchestra.run.smithi044.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-19T00:01:32.663 INFO:teuthology.orchestra.run.smithi044.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-08-19T00:01:32.663 INFO:teuthology.orchestra.run.smithi044.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-08-19T00:01:32.663 INFO:teuthology.orchestra.run.smithi044.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-08-19T00:01:32.663 INFO:teuthology.orchestra.run.smithi044.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-08-19T00:01:32.663 INFO:teuthology.orchestra.run.smithi044.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-08-19T00:01:32.663 INFO:teuthology.orchestra.run.smithi044.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-08-19T00:01:32.663 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-08-19T00:01:32.663 INFO:teuthology.orchestra.run.smithi044.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-08-19T00:01:32.663 INFO:teuthology.orchestra.run.smithi044.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-08-19T00:01:32.663 INFO:teuthology.orchestra.run.smithi044.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-19T00:01:32.663 INFO:teuthology.orchestra.run.smithi044.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-08-19T00:01:32.664 INFO:teuthology.orchestra.run.smithi044.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-19T00:01:32.664 INFO:teuthology.orchestra.run.smithi044.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-19T00:01:32.664 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-19T00:01:32.664 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-argparse x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 45 k 2024-08-19T00:01:32.664 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-common x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 136 k 2024-08-19T00:01:32.664 INFO:teuthology.orchestra.run.smithi044.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-19T00:01:32.664 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-19T00:01:32.664 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-19T00:01:32.664 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-19T00:01:32.664 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-08-19T00:01:32.664 INFO:teuthology.orchestra.run.smithi044.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-08-19T00:01:32.664 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-19T00:01:32.664 INFO:teuthology.orchestra.run.smithi044.stdout: python3-devel x86_64 3.9.19-4.el9 appstream 244 k 2024-08-19T00:01:32.665 INFO:teuthology.orchestra.run.smithi044.stdout: python3-google-auth noarch 1:2.33.0-1.el9 epel 220 k 2024-08-19T00:01:32.665 INFO:teuthology.orchestra.run.smithi044.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-08-19T00:01:32.665 INFO:teuthology.orchestra.run.smithi044.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-08-19T00:01:32.665 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-19T00:01:32.665 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-19T00:01:32.665 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-19T00:01:32.665 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-19T00:01:32.665 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-19T00:01:32.665 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-19T00:01:32.665 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-19T00:01:32.665 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-19T00:01:32.665 INFO:teuthology.orchestra.run.smithi044.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-19T00:01:32.665 INFO:teuthology.orchestra.run.smithi044.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-19T00:01:32.666 INFO:teuthology.orchestra.run.smithi044.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-19T00:01:32.666 INFO:teuthology.orchestra.run.smithi044.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-19T00:01:32.666 INFO:teuthology.orchestra.run.smithi044.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-19T00:01:32.666 INFO:teuthology.orchestra.run.smithi044.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-19T00:01:32.666 INFO:teuthology.orchestra.run.smithi044.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-19T00:01:32.666 INFO:teuthology.orchestra.run.smithi044.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-19T00:01:32.666 INFO:teuthology.orchestra.run.smithi044.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-19T00:01:32.666 INFO:teuthology.orchestra.run.smithi044.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-19T00:01:32.666 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-19T00:01:32.666 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-19T00:01:32.666 INFO:teuthology.orchestra.run.smithi044.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-19T00:01:32.666 INFO:teuthology.orchestra.run.smithi044.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-19T00:01:32.666 INFO:teuthology.orchestra.run.smithi044.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-08-19T00:01:32.667 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-19T00:01:32.667 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-19T00:01:32.667 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-19T00:01:32.667 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-19T00:01:32.667 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-08-19T00:01:32.667 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-19T00:01:32.667 INFO:teuthology.orchestra.run.smithi044.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-19T00:01:32.667 INFO:teuthology.orchestra.run.smithi044.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-19T00:01:32.667 INFO:teuthology.orchestra.run.smithi044.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-19T00:01:32.667 INFO:teuthology.orchestra.run.smithi044.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-19T00:01:32.667 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-19T00:01:32.667 INFO:teuthology.orchestra.run.smithi044.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-19T00:01:32.667 INFO:teuthology.orchestra.run.smithi044.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-19T00:01:32.667 INFO:teuthology.orchestra.run.smithi044.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-19T00:01:32.668 INFO:teuthology.orchestra.run.smithi044.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-19T00:01:32.668 INFO:teuthology.orchestra.run.smithi044.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-19T00:01:32.668 INFO:teuthology.orchestra.run.smithi044.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-08-19T00:01:32.668 INFO:teuthology.orchestra.run.smithi044.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-19T00:01:32.668 INFO:teuthology.orchestra.run.smithi044.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-19T00:01:32.668 INFO:teuthology.orchestra.run.smithi044.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-19T00:01:32.668 INFO:teuthology.orchestra.run.smithi044.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-19T00:01:32.668 INFO:teuthology.orchestra.run.smithi044.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-08-19T00:01:32.668 INFO:teuthology.orchestra.run.smithi044.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-08-19T00:01:32.668 INFO:teuthology.orchestra.run.smithi044.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-08-19T00:01:32.668 INFO:teuthology.orchestra.run.smithi044.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-19T00:01:32.668 INFO:teuthology.orchestra.run.smithi044.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-19T00:01:32.668 INFO:teuthology.orchestra.run.smithi044.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-08-19T00:01:32.669 INFO:teuthology.orchestra.run.smithi044.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-19T00:01:32.669 INFO:teuthology.orchestra.run.smithi044.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-19T00:01:32.669 INFO:teuthology.orchestra.run.smithi044.stdout:Installing weak dependencies: 2024-08-19T00:01:32.669 INFO:teuthology.orchestra.run.smithi044.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-08-19T00:01:32.669 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:01:32.669 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction Summary 2024-08-19T00:01:32.669 INFO:teuthology.orchestra.run.smithi044.stdout:======================================================================================= 2024-08-19T00:01:32.669 INFO:teuthology.orchestra.run.smithi044.stdout:Install 148 Packages 2024-08-19T00:01:32.669 INFO:teuthology.orchestra.run.smithi044.stdout:Upgrade 2 Packages 2024-08-19T00:01:32.669 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:01:32.670 INFO:teuthology.orchestra.run.smithi044.stdout:Total download size: 218 M 2024-08-19T00:01:32.670 INFO:teuthology.orchestra.run.smithi044.stdout:Downloading Packages: 2024-08-19T00:01:32.783 INFO:teuthology.orchestra.run.smithi116.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-19T00:01:32.784 INFO:teuthology.orchestra.run.smithi116.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-19T00:01:32.797 INFO:teuthology.orchestra.run.smithi116.stdout:Package NetworkManager-1:1.48.2-2.el9.x86_64 is already installed. 2024-08-19T00:01:32.798 INFO:teuthology.orchestra.run.smithi116.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-19T00:01:32.799 INFO:teuthology.orchestra.run.smithi116.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-08-19T00:01:32.800 INFO:teuthology.orchestra.run.smithi116.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-19T00:01:32.802 INFO:teuthology.orchestra.run.smithi116.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-19T00:01:32.805 INFO:teuthology.orchestra.run.smithi116.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-19T00:01:32.806 INFO:teuthology.orchestra.run.smithi116.stdout:Package xfsprogs-6.4.0-3.el9.x86_64 is already installed. 2024-08-19T00:01:32.810 INFO:teuthology.orchestra.run.smithi171.stdout:(1/150): ceph-19.1.0-1382.gde09dd01.el9.x86_64. 23 kB/s | 6.6 kB 00:00 2024-08-19T00:01:32.865 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-08-19T00:01:32.883 INFO:teuthology.orchestra.run.smithi116.stdout:======================================================================================= 2024-08-19T00:01:32.883 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repository Size 2024-08-19T00:01:32.883 INFO:teuthology.orchestra.run.smithi116.stdout:======================================================================================= 2024-08-19T00:01:32.883 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-08-19T00:01:32.883 INFO:teuthology.orchestra.run.smithi116.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-19T00:01:32.883 INFO:teuthology.orchestra.run.smithi116.stdout: ceph x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 6.6 k 2024-08-19T00:01:32.884 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-base x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 5.4 M 2024-08-19T00:01:32.884 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-fuse x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 896 k 2024-08-19T00:01:32.884 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-immutable-object-cache x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 145 k 2024-08-19T00:01:32.884 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 1.5 M 2024-08-19T00:01:32.884 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-cephadm noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 146 k 2024-08-19T00:01:32.884 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-dashboard noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 3.6 M 2024-08-19T00:01:32.884 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 7.4 M 2024-08-19T00:01:32.884 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-rook noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 49 k 2024-08-19T00:01:32.884 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-radosgw x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 11 M 2024-08-19T00:01:32.884 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-test x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 49 M 2024-08-19T00:01:32.884 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-volume noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 285 k 2024-08-19T00:01:32.884 INFO:teuthology.orchestra.run.smithi116.stdout: cephadm noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 766 k 2024-08-19T00:01:32.885 INFO:teuthology.orchestra.run.smithi116.stdout: cephfs-mirror x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 225 k 2024-08-19T00:01:32.885 INFO:teuthology.orchestra.run.smithi116.stdout: cephfs-shell x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 27 k 2024-08-19T00:01:32.885 INFO:teuthology.orchestra.run.smithi116.stdout: cephfs-top noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 18 k 2024-08-19T00:01:32.885 INFO:teuthology.orchestra.run.smithi116.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-19T00:01:32.885 INFO:teuthology.orchestra.run.smithi116.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-19T00:01:32.885 INFO:teuthology.orchestra.run.smithi116.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-19T00:01:32.885 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs-devel x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 32 k 2024-08-19T00:01:32.885 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs2 x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 753 k 2024-08-19T00:01:32.885 INFO:teuthology.orchestra.run.smithi116.stdout: librados-devel x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 127 k 2024-08-19T00:01:32.885 INFO:teuthology.orchestra.run.smithi116.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-19T00:01:32.885 INFO:teuthology.orchestra.run.smithi116.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-08-19T00:01:32.885 INFO:teuthology.orchestra.run.smithi116.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-08-19T00:01:32.885 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-08-19T00:01:32.886 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-08-19T00:01:32.886 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-08-19T00:01:32.886 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cephfs x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 188 k 2024-08-19T00:01:32.886 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rados x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 369 k 2024-08-19T00:01:32.886 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rbd x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 350 k 2024-08-19T00:01:32.886 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rgw x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 117 k 2024-08-19T00:01:32.886 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-fuse x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 85 k 2024-08-19T00:01:32.886 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-mirror x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 3.1 M 2024-08-19T00:01:32.886 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-nbd x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 170 k 2024-08-19T00:01:32.886 INFO:teuthology.orchestra.run.smithi116.stdout: xfsprogs-devel x86_64 6.4.0-3.el9 appstream 96 k 2024-08-19T00:01:32.886 INFO:teuthology.orchestra.run.smithi116.stdout:Upgrading: 2024-08-19T00:01:32.886 INFO:teuthology.orchestra.run.smithi116.stdout: librados2 x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 3.4 M 2024-08-19T00:01:32.887 INFO:teuthology.orchestra.run.smithi116.stdout: librbd1 x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 3.2 M 2024-08-19T00:01:32.887 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2024-08-19T00:01:32.887 INFO:teuthology.orchestra.run.smithi116.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-08-19T00:01:32.887 INFO:teuthology.orchestra.run.smithi116.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-19T00:01:32.887 INFO:teuthology.orchestra.run.smithi116.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-08-19T00:01:32.887 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-common x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 21 M 2024-08-19T00:01:32.887 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-grafana-dashboards noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 32 k 2024-08-19T00:01:32.887 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mds x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 2.4 M 2024-08-19T00:01:32.887 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-modules-core noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 249 k 2024-08-19T00:01:32.887 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mon x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 4.7 M 2024-08-19T00:01:32.887 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-osd x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 17 M 2024-08-19T00:01:32.887 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-prometheus-alerts noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 16 k 2024-08-19T00:01:32.887 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-selinux x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 25 k 2024-08-19T00:01:32.887 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-19T00:01:32.888 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-19T00:01:32.888 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-19T00:01:32.888 INFO:teuthology.orchestra.run.smithi116.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-19T00:01:32.888 INFO:teuthology.orchestra.run.smithi116.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-19T00:01:32.888 INFO:teuthology.orchestra.run.smithi116.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-08-19T00:01:32.888 INFO:teuthology.orchestra.run.smithi116.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-08-19T00:01:32.888 INFO:teuthology.orchestra.run.smithi116.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-08-19T00:01:32.888 INFO:teuthology.orchestra.run.smithi116.stdout: libcephsqlite x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 163 k 2024-08-19T00:01:32.888 INFO:teuthology.orchestra.run.smithi116.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-08-19T00:01:32.888 INFO:teuthology.orchestra.run.smithi116.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-19T00:01:32.888 INFO:teuthology.orchestra.run.smithi116.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-19T00:01:32.888 INFO:teuthology.orchestra.run.smithi116.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-08-19T00:01:32.888 INFO:teuthology.orchestra.run.smithi116.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-19T00:01:32.889 INFO:teuthology.orchestra.run.smithi116.stdout: libradosstriper1 x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 507 k 2024-08-19T00:01:32.889 INFO:teuthology.orchestra.run.smithi116.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-19T00:01:32.889 INFO:teuthology.orchestra.run.smithi116.stdout: librgw2 x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 5.4 M 2024-08-19T00:01:32.889 INFO:teuthology.orchestra.run.smithi116.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-19T00:01:32.889 INFO:teuthology.orchestra.run.smithi116.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-19T00:01:32.889 INFO:teuthology.orchestra.run.smithi116.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-19T00:01:32.889 INFO:teuthology.orchestra.run.smithi116.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-08-19T00:01:32.889 INFO:teuthology.orchestra.run.smithi116.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-08-19T00:01:32.889 INFO:teuthology.orchestra.run.smithi116.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-08-19T00:01:32.889 INFO:teuthology.orchestra.run.smithi116.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-08-19T00:01:32.889 INFO:teuthology.orchestra.run.smithi116.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-08-19T00:01:32.889 INFO:teuthology.orchestra.run.smithi116.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-08-19T00:01:32.889 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-08-19T00:01:32.890 INFO:teuthology.orchestra.run.smithi116.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-08-19T00:01:32.890 INFO:teuthology.orchestra.run.smithi116.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-08-19T00:01:32.890 INFO:teuthology.orchestra.run.smithi116.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-19T00:01:32.890 INFO:teuthology.orchestra.run.smithi116.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-08-19T00:01:32.890 INFO:teuthology.orchestra.run.smithi116.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-19T00:01:32.890 INFO:teuthology.orchestra.run.smithi116.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-19T00:01:32.890 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-19T00:01:32.890 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-argparse x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 45 k 2024-08-19T00:01:32.890 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-common x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 136 k 2024-08-19T00:01:32.890 INFO:teuthology.orchestra.run.smithi116.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-19T00:01:32.890 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-19T00:01:32.890 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-19T00:01:32.890 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-19T00:01:32.891 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-08-19T00:01:32.891 INFO:teuthology.orchestra.run.smithi116.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-08-19T00:01:32.891 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-19T00:01:32.891 INFO:teuthology.orchestra.run.smithi116.stdout: python3-devel x86_64 3.9.19-4.el9 appstream 244 k 2024-08-19T00:01:32.891 INFO:teuthology.orchestra.run.smithi116.stdout: python3-google-auth noarch 1:2.33.0-1.el9 epel 220 k 2024-08-19T00:01:32.891 INFO:teuthology.orchestra.run.smithi116.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-08-19T00:01:32.891 INFO:teuthology.orchestra.run.smithi116.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-08-19T00:01:32.891 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-19T00:01:32.891 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-19T00:01:32.891 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-19T00:01:32.891 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-19T00:01:32.891 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-19T00:01:32.891 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-19T00:01:32.892 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-19T00:01:32.892 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-19T00:01:32.892 INFO:teuthology.orchestra.run.smithi116.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-19T00:01:32.892 INFO:teuthology.orchestra.run.smithi116.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-19T00:01:32.892 INFO:teuthology.orchestra.run.smithi116.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-19T00:01:32.892 INFO:teuthology.orchestra.run.smithi116.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-19T00:01:32.892 INFO:teuthology.orchestra.run.smithi116.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-19T00:01:32.892 INFO:teuthology.orchestra.run.smithi116.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-19T00:01:32.892 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-19T00:01:32.892 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-19T00:01:32.892 INFO:teuthology.orchestra.run.smithi116.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-19T00:01:32.892 INFO:teuthology.orchestra.run.smithi116.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-19T00:01:32.892 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-19T00:01:32.892 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-19T00:01:32.893 INFO:teuthology.orchestra.run.smithi116.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-19T00:01:32.893 INFO:teuthology.orchestra.run.smithi116.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-19T00:01:32.893 INFO:teuthology.orchestra.run.smithi116.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-08-19T00:01:32.893 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-19T00:01:32.893 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-19T00:01:32.893 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-19T00:01:32.893 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-19T00:01:32.893 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-08-19T00:01:32.893 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-19T00:01:32.893 INFO:teuthology.orchestra.run.smithi116.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-19T00:01:32.893 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-19T00:01:32.893 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-19T00:01:32.894 INFO:teuthology.orchestra.run.smithi116.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-19T00:01:32.894 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-19T00:01:32.894 INFO:teuthology.orchestra.run.smithi116.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-19T00:01:32.894 INFO:teuthology.orchestra.run.smithi116.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-19T00:01:32.894 INFO:teuthology.orchestra.run.smithi116.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-19T00:01:32.894 INFO:teuthology.orchestra.run.smithi116.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-19T00:01:32.894 INFO:teuthology.orchestra.run.smithi116.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-19T00:01:32.894 INFO:teuthology.orchestra.run.smithi116.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-08-19T00:01:32.894 INFO:teuthology.orchestra.run.smithi116.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-19T00:01:32.894 INFO:teuthology.orchestra.run.smithi116.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-19T00:01:32.894 INFO:teuthology.orchestra.run.smithi116.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-19T00:01:32.895 INFO:teuthology.orchestra.run.smithi116.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-19T00:01:32.895 INFO:teuthology.orchestra.run.smithi116.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-08-19T00:01:32.895 INFO:teuthology.orchestra.run.smithi116.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-08-19T00:01:32.895 INFO:teuthology.orchestra.run.smithi116.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-08-19T00:01:32.895 INFO:teuthology.orchestra.run.smithi116.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-19T00:01:32.895 INFO:teuthology.orchestra.run.smithi116.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-19T00:01:32.895 INFO:teuthology.orchestra.run.smithi116.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-08-19T00:01:32.895 INFO:teuthology.orchestra.run.smithi116.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-19T00:01:32.895 INFO:teuthology.orchestra.run.smithi116.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-19T00:01:32.895 INFO:teuthology.orchestra.run.smithi116.stdout:Installing weak dependencies: 2024-08-19T00:01:32.895 INFO:teuthology.orchestra.run.smithi116.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-08-19T00:01:32.895 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-08-19T00:01:32.895 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-08-19T00:01:32.895 INFO:teuthology.orchestra.run.smithi116.stdout:======================================================================================= 2024-08-19T00:01:32.896 INFO:teuthology.orchestra.run.smithi116.stdout:Install 148 Packages 2024-08-19T00:01:32.896 INFO:teuthology.orchestra.run.smithi116.stdout:Upgrade 2 Packages 2024-08-19T00:01:32.896 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-08-19T00:01:32.896 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 218 M 2024-08-19T00:01:32.896 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-08-19T00:01:33.055 INFO:teuthology.orchestra.run.smithi044.stdout:(1/150): ceph-19.1.0-1382.gde09dd01.el9.x86_64. 44 kB/s | 6.6 kB 00:00 2024-08-19T00:01:33.102 INFO:teuthology.orchestra.run.smithi171.stdout:(2/150): ceph-fuse-19.1.0-1382.gde09dd01.el9.x8 3.0 MB/s | 896 kB 00:00 2024-08-19T00:01:33.194 INFO:teuthology.orchestra.run.smithi171.stdout:(3/150): ceph-immutable-object-cache-19.1.0-138 1.5 MB/s | 145 kB 00:00 2024-08-19T00:01:33.303 INFO:teuthology.orchestra.run.smithi171.stdout:(4/150): ceph-base-19.1.0-1382.gde09dd01.el9.x8 6.9 MB/s | 5.4 MB 00:00 2024-08-19T00:01:33.628 INFO:teuthology.orchestra.run.smithi171.stdout:(5/150): ceph-mds-19.1.0-1382.gde09dd01.el9.x86 5.5 MB/s | 2.4 MB 00:00 2024-08-19T00:01:33.713 INFO:teuthology.orchestra.run.smithi044.stdout:(2/150): ceph-fuse-19.1.0-1382.gde09dd01.el9.x8 1.3 MB/s | 896 kB 00:00 2024-08-19T00:01:33.822 INFO:teuthology.orchestra.run.smithi044.stdout:(3/150): ceph-immutable-object-cache-19.1.0-138 1.3 MB/s | 145 kB 00:00 2024-08-19T00:01:33.865 INFO:teuthology.orchestra.run.smithi116.stdout:(1/150): ceph-19.1.0-1382.gde09dd01.el9.x86_64. 33 kB/s | 6.6 kB 00:00 2024-08-19T00:01:34.228 INFO:teuthology.orchestra.run.smithi171.stdout:(6/150): ceph-common-19.1.0-1382.gde09dd01.el9. 12 MB/s | 21 MB 00:01 2024-08-19T00:01:34.336 INFO:teuthology.orchestra.run.smithi171.stdout:(7/150): ceph-mon-19.1.0-1382.gde09dd01.el9.x86 6.6 MB/s | 4.7 MB 00:00 2024-08-19T00:01:34.482 INFO:teuthology.orchestra.run.smithi116.stdout:(2/150): ceph-fuse-19.1.0-1382.gde09dd01.el9.x8 1.4 MB/s | 896 kB 00:00 2024-08-19T00:01:34.503 INFO:teuthology.orchestra.run.smithi171.stdout:(8/150): ceph-mgr-19.1.0-1382.gde09dd01.el9.x86 1.3 MB/s | 1.5 MB 00:01 2024-08-19T00:01:34.604 INFO:teuthology.orchestra.run.smithi171.stdout:(9/150): ceph-selinux-19.1.0-1382.gde09dd01.el9 251 kB/s | 25 kB 00:00 2024-08-19T00:01:34.639 INFO:teuthology.orchestra.run.smithi044.stdout:(4/150): ceph-mds-19.1.0-1382.gde09dd01.el9.x86 2.9 MB/s | 2.4 MB 00:00 2024-08-19T00:01:34.657 INFO:teuthology.orchestra.run.smithi116.stdout:(3/150): ceph-immutable-object-cache-19.1.0-138 830 kB/s | 145 kB 00:00 2024-08-19T00:01:35.231 INFO:teuthology.orchestra.run.smithi044.stdout:(5/150): ceph-mgr-19.1.0-1382.gde09dd01.el9.x86 2.6 MB/s | 1.5 MB 00:00 2024-08-19T00:01:35.549 INFO:teuthology.orchestra.run.smithi116.stdout:(4/150): ceph-common-19.1.0-1382.gde09dd01.el9. 11 MB/s | 21 MB 00:01 2024-08-19T00:01:35.741 INFO:teuthology.orchestra.run.smithi116.stdout:(5/150): ceph-mgr-19.1.0-1382.gde09dd01.el9.x86 8.0 MB/s | 1.5 MB 00:00 2024-08-19T00:01:36.083 INFO:teuthology.orchestra.run.smithi116.stdout:(6/150): ceph-mon-19.1.0-1382.gde09dd01.el9.x86 14 MB/s | 4.7 MB 00:00 2024-08-19T00:01:36.129 INFO:teuthology.orchestra.run.smithi171.stdout:(10/150): ceph-osd-19.1.0-1382.gde09dd01.el9.x8 8.9 MB/s | 17 MB 00:01 2024-08-19T00:01:36.263 INFO:teuthology.orchestra.run.smithi171.stdout:(11/150): ceph-radosgw-19.1.0-1382.gde09dd01.el 5.5 MB/s | 11 MB 00:01 2024-08-19T00:01:36.288 INFO:teuthology.orchestra.run.smithi171.stdout:(12/150): cephfs-mirror-19.1.0-1382.gde09dd01.e 1.4 MB/s | 225 kB 00:00 2024-08-19T00:01:36.300 INFO:teuthology.orchestra.run.smithi116.stdout:(7/150): ceph-mds-19.1.0-1382.gde09dd01.el9.x86 1.5 MB/s | 2.4 MB 00:01 2024-08-19T00:01:36.338 INFO:teuthology.orchestra.run.smithi171.stdout:(13/150): cephfs-shell-19.1.0-1382.gde09dd01.el 360 kB/s | 27 kB 00:00 2024-08-19T00:01:36.363 INFO:teuthology.orchestra.run.smithi171.stdout:(14/150): libcephfs-devel-19.1.0-1382.gde09dd01 422 kB/s | 32 kB 00:00 2024-08-19T00:01:36.464 INFO:teuthology.orchestra.run.smithi171.stdout:(15/150): libcephsqlite-19.1.0-1382.gde09dd01.e 1.6 MB/s | 163 kB 00:00 2024-08-19T00:01:36.505 INFO:teuthology.orchestra.run.smithi171.stdout:(16/150): libcephfs2-19.1.0-1382.gde09dd01.el9. 4.4 MB/s | 753 kB 00:00 2024-08-19T00:01:36.556 INFO:teuthology.orchestra.run.smithi171.stdout:(17/150): librados-devel-19.1.0-1382.gde09dd01. 1.3 MB/s | 127 kB 00:00 2024-08-19T00:01:36.572 INFO:teuthology.orchestra.run.smithi044.stdout:(6/150): ceph-mon-19.1.0-1382.gde09dd01.el9.x86 3.5 MB/s | 4.7 MB 00:01 2024-08-19T00:01:36.690 INFO:teuthology.orchestra.run.smithi171.stdout:(18/150): libradosstriper1-19.1.0-1382.gde09dd0 2.7 MB/s | 507 kB 00:00 2024-08-19T00:01:36.708 INFO:teuthology.orchestra.run.smithi116.stdout:(8/150): ceph-base-19.1.0-1382.gde09dd01.el9.x8 1.8 MB/s | 5.4 MB 00:03 2024-08-19T00:01:36.781 INFO:teuthology.orchestra.run.smithi171.stdout:(19/150): python3-ceph-argparse-19.1.0-1382.gde 492 kB/s | 45 kB 00:00 2024-08-19T00:01:37.256 INFO:teuthology.orchestra.run.smithi044.stdout:(7/150): ceph-base-19.1.0-1382.gde09dd01.el9.x8 1.2 MB/s | 5.4 MB 00:04 2024-08-19T00:01:37.348 INFO:teuthology.orchestra.run.smithi171.stdout:(20/150): librgw2-19.1.0-1382.gde09dd01.el9.x86 6.8 MB/s | 5.4 MB 00:00 2024-08-19T00:01:37.366 INFO:teuthology.orchestra.run.smithi116.stdout:(9/150): ceph-osd-19.1.0-1382.gde09dd01.el9.x86 13 MB/s | 17 MB 00:01 2024-08-19T00:01:37.373 INFO:teuthology.orchestra.run.smithi171.stdout:(21/150): python3-ceph-common-19.1.0-1382.gde09 229 kB/s | 136 kB 00:00 2024-08-19T00:01:37.392 INFO:teuthology.orchestra.run.smithi116.stdout:(10/150): ceph-selinux-19.1.0-1382.gde09dd01.el 37 kB/s | 25 kB 00:00 2024-08-19T00:01:37.415 INFO:teuthology.orchestra.run.smithi171.stdout:(22/150): python3-cephfs-19.1.0-1382.gde09dd01. 2.8 MB/s | 188 kB 00:00 2024-08-19T00:01:37.475 INFO:teuthology.orchestra.run.smithi116.stdout:(11/150): cephfs-mirror-19.1.0-1382.gde09dd01.e 2.6 MB/s | 225 kB 00:00 2024-08-19T00:01:37.516 INFO:teuthology.orchestra.run.smithi171.stdout:(23/150): python3-rbd-19.1.0-1382.gde09dd01.el9 3.4 MB/s | 350 kB 00:00 2024-08-19T00:01:37.541 INFO:teuthology.orchestra.run.smithi171.stdout:(24/150): python3-rados-19.1.0-1382.gde09dd01.e 2.2 MB/s | 369 kB 00:00 2024-08-19T00:01:37.550 INFO:teuthology.orchestra.run.smithi116.stdout:(12/150): cephfs-shell-19.1.0-1382.gde09dd01.el 361 kB/s | 27 kB 00:00 2024-08-19T00:01:37.591 INFO:teuthology.orchestra.run.smithi171.stdout:(25/150): python3-rgw-19.1.0-1382.gde09dd01.el9 1.5 MB/s | 117 kB 00:00 2024-08-19T00:01:37.616 INFO:teuthology.orchestra.run.smithi171.stdout:(26/150): rbd-fuse-19.1.0-1382.gde09dd01.el9.x8 1.1 MB/s | 85 kB 00:00 2024-08-19T00:01:37.634 INFO:teuthology.orchestra.run.smithi116.stdout:(13/150): libcephfs-devel-19.1.0-1382.gde09dd01 380 kB/s | 32 kB 00:00 2024-08-19T00:01:37.700 INFO:teuthology.orchestra.run.smithi171.stdout:(27/150): rbd-nbd-19.1.0-1382.gde09dd01.el9.x86 2.0 MB/s | 170 kB 00:00 2024-08-19T00:01:37.735 INFO:teuthology.orchestra.run.smithi116.stdout:(14/150): libcephfs2-19.1.0-1382.gde09dd01.el9. 7.4 MB/s | 753 kB 00:00 2024-08-19T00:01:37.792 INFO:teuthology.orchestra.run.smithi171.stdout:(28/150): ceph-grafana-dashboards-19.1.0-1382.g 348 kB/s | 32 kB 00:00 2024-08-19T00:01:37.826 INFO:teuthology.orchestra.run.smithi116.stdout:(15/150): libcephsqlite-19.1.0-1382.gde09dd01.e 1.7 MB/s | 163 kB 00:00 2024-08-19T00:01:37.876 INFO:teuthology.orchestra.run.smithi171.stdout:(29/150): ceph-mgr-cephadm-19.1.0-1382.gde09dd0 1.7 MB/s | 146 kB 00:00 2024-08-19T00:01:37.910 INFO:teuthology.orchestra.run.smithi116.stdout:(16/150): librados-devel-19.1.0-1382.gde09dd01. 1.5 MB/s | 127 kB 00:00 2024-08-19T00:01:38.010 INFO:teuthology.orchestra.run.smithi116.stdout:(17/150): libradosstriper1-19.1.0-1382.gde09dd0 5.0 MB/s | 507 kB 00:00 2024-08-19T00:01:38.026 INFO:teuthology.orchestra.run.smithi171.stdout:(30/150): rbd-mirror-19.1.0-1382.gde09dd01.el9. 7.1 MB/s | 3.1 MB 00:00 2024-08-19T00:01:38.577 INFO:teuthology.orchestra.run.smithi116.stdout:(18/150): librgw2-19.1.0-1382.gde09dd01.el9.x86 9.5 MB/s | 5.4 MB 00:00 2024-08-19T00:01:38.661 INFO:teuthology.orchestra.run.smithi116.stdout:(19/150): python3-ceph-argparse-19.1.0-1382.gde 543 kB/s | 45 kB 00:00 2024-08-19T00:01:38.744 INFO:teuthology.orchestra.run.smithi116.stdout:(20/150): python3-ceph-common-19.1.0-1382.gde09 1.6 MB/s | 136 kB 00:00 2024-08-19T00:01:38.828 INFO:teuthology.orchestra.run.smithi116.stdout:(21/150): python3-cephfs-19.1.0-1382.gde09dd01. 2.2 MB/s | 188 kB 00:00 2024-08-19T00:01:38.868 INFO:teuthology.orchestra.run.smithi171.stdout:(31/150): ceph-mgr-dashboard-19.1.0-1382.gde09d 3.6 MB/s | 3.6 MB 00:00 2024-08-19T00:01:38.895 INFO:teuthology.orchestra.run.smithi116.stdout:(22/150): python3-rados-19.1.0-1382.gde09dd01.e 5.4 MB/s | 369 kB 00:00 2024-08-19T00:01:38.970 INFO:teuthology.orchestra.run.smithi116.stdout:(23/150): python3-rbd-19.1.0-1382.gde09dd01.el9 4.6 MB/s | 350 kB 00:00 2024-08-19T00:01:38.985 INFO:teuthology.orchestra.run.smithi171.stdout:(32/150): ceph-mgr-diskprediction-local-19.1.0- 7.7 MB/s | 7.4 MB 00:00 2024-08-19T00:01:39.018 INFO:teuthology.orchestra.run.smithi171.stdout:(33/150): ceph-mgr-modules-core-19.1.0-1382.gde 1.6 MB/s | 249 kB 00:00 2024-08-19T00:01:39.029 INFO:teuthology.orchestra.run.smithi116.stdout:(24/150): python3-rgw-19.1.0-1382.gde09dd01.el9 1.9 MB/s | 117 kB 00:00 2024-08-19T00:01:39.052 INFO:teuthology.orchestra.run.smithi171.stdout:(34/150): ceph-mgr-rook-19.1.0-1382.gde09dd01.e 740 kB/s | 49 kB 00:00 2024-08-19T00:01:39.077 INFO:teuthology.orchestra.run.smithi171.stdout:(35/150): ceph-prometheus-alerts-19.1.0-1382.gd 280 kB/s | 16 kB 00:00 2024-08-19T00:01:39.087 INFO:teuthology.orchestra.run.smithi116.stdout:(25/150): rbd-fuse-19.1.0-1382.gde09dd01.el9.x8 1.4 MB/s | 85 kB 00:00 2024-08-19T00:01:39.119 INFO:teuthology.orchestra.run.smithi171.stdout:(36/150): ceph-volume-19.1.0-1382.gde09dd01.el9 4.2 MB/s | 285 kB 00:00 2024-08-19T00:01:39.203 INFO:teuthology.orchestra.run.smithi171.stdout:(37/150): cephfs-top-19.1.0-1382.gde09dd01.el9. 219 kB/s | 18 kB 00:00 2024-08-19T00:01:39.328 INFO:teuthology.orchestra.run.smithi171.stdout:(38/150): fuse-2.9.9-16.el9.x86_64.rpm 637 kB/s | 80 kB 00:00 2024-08-19T00:01:39.354 INFO:teuthology.orchestra.run.smithi171.stdout:(39/150): cephadm-19.1.0-1382.gde09dd01.el9.noa 2.7 MB/s | 766 kB 00:00 2024-08-19T00:01:39.363 INFO:teuthology.orchestra.run.smithi116.stdout:(26/150): rbd-mirror-19.1.0-1382.gde09dd01.el9. 11 MB/s | 3.1 MB 00:00 2024-08-19T00:01:39.430 INFO:teuthology.orchestra.run.smithi116.stdout:(27/150): rbd-nbd-19.1.0-1382.gde09dd01.el9.x86 2.5 MB/s | 170 kB 00:00 2024-08-19T00:01:39.462 INFO:teuthology.orchestra.run.smithi171.stdout:(40/150): libgfortran-11.4.1-3.el9.x86_64.rpm 5.9 MB/s | 803 kB 00:00 2024-08-19T00:01:39.488 INFO:teuthology.orchestra.run.smithi116.stdout:(28/150): ceph-grafana-dashboards-19.1.0-1382.g 547 kB/s | 32 kB 00:00 2024-08-19T00:01:39.512 INFO:teuthology.orchestra.run.smithi171.stdout:(41/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.0 MB/s | 253 kB 00:00 2024-08-19T00:01:39.538 INFO:teuthology.orchestra.run.smithi171.stdout:(42/150): libquadmath-11.4.1-3.el9.x86_64.rpm 1.0 MB/s | 195 kB 00:00 2024-08-19T00:01:39.555 INFO:teuthology.orchestra.run.smithi116.stdout:(29/150): ceph-mgr-cephadm-19.1.0-1382.gde09dd0 2.1 MB/s | 146 kB 00:00 2024-08-19T00:01:39.605 INFO:teuthology.orchestra.run.smithi171.stdout:(43/150): python3-cryptography-36.0.1-4.el9.x86 13 MB/s | 1.2 MB 00:00 2024-08-19T00:01:39.630 INFO:teuthology.orchestra.run.smithi171.stdout:(44/150): python3-ply-3.11-14.el9.noarch.rpm 1.1 MB/s | 106 kB 00:00 2024-08-19T00:01:39.655 INFO:teuthology.orchestra.run.smithi171.stdout:(45/150): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-08-19T00:01:39.689 INFO:teuthology.orchestra.run.smithi171.stdout:(46/150): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-08-19T00:01:39.714 INFO:teuthology.orchestra.run.smithi171.stdout:(47/150): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-08-19T00:01:39.781 INFO:teuthology.orchestra.run.smithi171.stdout:(48/150): bison-3.7.4-5.el9.x86_64.rpm 14 MB/s | 943 kB 00:00 2024-08-19T00:01:39.806 INFO:teuthology.orchestra.run.smithi171.stdout:(49/150): automake-1.16.2-8.el9.noarch.rpm 5.8 MB/s | 689 kB 00:00 2024-08-19T00:01:39.832 INFO:teuthology.orchestra.run.smithi171.stdout:(50/150): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 107 kB 00:00 2024-08-19T00:01:39.849 INFO:teuthology.orchestra.run.smithi171.stdout:(51/150): elfutils-libelf-devel-0.191-4.el9.x86 518 kB/s | 22 kB 00:00 2024-08-19T00:01:39.864 INFO:teuthology.orchestra.run.smithi116.stdout:(30/150): ceph-mgr-dashboard-19.1.0-1382.gde09d 12 MB/s | 3.6 MB 00:00 2024-08-19T00:01:39.882 INFO:teuthology.orchestra.run.smithi171.stdout:(52/150): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-08-19T00:01:39.907 INFO:teuthology.orchestra.run.smithi171.stdout:(53/150): flexiblas-3.0.4-8.el9.x86_64.rpm 557 kB/s | 33 kB 00:00 2024-08-19T00:01:39.966 INFO:teuthology.orchestra.run.smithi171.stdout:(54/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 36 MB/s | 3.0 MB 00:00 2024-08-19T00:01:39.992 INFO:teuthology.orchestra.run.smithi171.stdout:(55/150): flexiblas-openblas-openmp-3.0.4-8.el9 217 kB/s | 18 kB 00:00 2024-08-19T00:01:40.017 INFO:teuthology.orchestra.run.smithi171.stdout:(56/150): libaio-devel-0.3.111-13.el9.x86_64.rp 221 kB/s | 11 kB 00:00 2024-08-19T00:01:40.051 INFO:teuthology.orchestra.run.smithi171.stdout:(57/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-08-19T00:01:40.076 INFO:teuthology.orchestra.run.smithi171.stdout:(58/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 774 kB/s | 45 kB 00:00 2024-08-19T00:01:40.109 INFO:teuthology.orchestra.run.smithi171.stdout:(59/150): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-08-19T00:01:40.151 INFO:teuthology.orchestra.run.smithi171.stdout:(60/150): libtool-2.4.6-46.el9.x86_64.rpm 7.5 MB/s | 581 kB 00:00 2024-08-19T00:01:40.176 INFO:teuthology.orchestra.run.smithi171.stdout:(61/150): libuuid-devel-2.37.4-18.el9.x86_64.rp 380 kB/s | 25 kB 00:00 2024-08-19T00:01:40.202 INFO:teuthology.orchestra.run.smithi171.stdout:(62/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 942 kB/s | 47 kB 00:00 2024-08-19T00:01:40.227 INFO:teuthology.orchestra.run.smithi171.stdout:(63/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-08-19T00:01:40.252 INFO:teuthology.orchestra.run.smithi171.stdout:(64/150): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-08-19T00:01:40.278 INFO:teuthology.orchestra.run.smithi171.stdout:(65/150): openblas-0.3.21-2.el9.x86_64.rpm 702 kB/s | 35 kB 00:00 2024-08-19T00:01:40.314 INFO:teuthology.orchestra.run.smithi116.stdout:(31/150): ceph-mgr-diskprediction-local-19.1.0- 16 MB/s | 7.4 MB 00:00 2024-08-19T00:01:40.364 INFO:teuthology.orchestra.run.smithi116.stdout:(32/150): ceph-mgr-modules-core-19.1.0-1382.gde 4.9 MB/s | 249 kB 00:00 2024-08-19T00:01:40.414 INFO:teuthology.orchestra.run.smithi116.stdout:(33/150): ceph-mgr-rook-19.1.0-1382.gde09dd01.e 987 kB/s | 49 kB 00:00 2024-08-19T00:01:40.456 INFO:teuthology.orchestra.run.smithi116.stdout:(34/150): ceph-prometheus-alerts-19.1.0-1382.gd 395 kB/s | 16 kB 00:00 2024-08-19T00:01:40.507 INFO:teuthology.orchestra.run.smithi116.stdout:(35/150): ceph-volume-19.1.0-1382.gde09dd01.el9 5.6 MB/s | 285 kB 00:00 2024-08-19T00:01:40.574 INFO:teuthology.orchestra.run.smithi116.stdout:(36/150): cephadm-19.1.0-1382.gde09dd01.el9.noa 11 MB/s | 766 kB 00:00 2024-08-19T00:01:40.589 INFO:teuthology.orchestra.run.smithi044.stdout:(8/150): ceph-osd-19.1.0-1382.gde09dd01.el9.x86 4.2 MB/s | 17 MB 00:04 2024-08-19T00:01:40.607 INFO:teuthology.orchestra.run.smithi116.stdout:(37/150): cephfs-top-19.1.0-1382.gde09dd01.el9. 548 kB/s | 18 kB 00:00 2024-08-19T00:01:40.631 INFO:teuthology.orchestra.run.smithi044.stdout:(9/150): ceph-selinux-19.1.0-1382.gde09dd01.el9 609 kB/s | 25 kB 00:00 2024-08-19T00:01:40.703 INFO:teuthology.orchestra.run.smithi171.stdout:(66/150): ceph-test-19.1.0-1382.gde09dd01.el9.x 8.0 MB/s | 49 MB 00:06 2024-08-19T00:01:40.758 INFO:teuthology.orchestra.run.smithi116.stdout:(38/150): ceph-radosgw-19.1.0-1382.gde09dd01.el 2.4 MB/s | 11 MB 00:04 2024-08-19T00:01:40.787 INFO:teuthology.orchestra.run.smithi171.stdout:(67/150): openssl-devel-3.2.2-2.el9.x86_64.rpm 8.7 MB/s | 4.4 MB 00:00 2024-08-19T00:01:40.808 INFO:teuthology.orchestra.run.smithi116.stdout:(39/150): fuse-2.9.9-16.el9.x86_64.rpm 398 kB/s | 80 kB 00:00 2024-08-19T00:01:40.854 INFO:teuthology.orchestra.run.smithi171.stdout:(68/150): openblas-openmp-0.3.21-2.el9.x86_64.r 7.9 MB/s | 4.7 MB 00:00 2024-08-19T00:01:40.904 INFO:teuthology.orchestra.run.smithi171.stdout:(69/150): postgresql-contrib-13.14-1.el9.x86_64 7.6 MB/s | 911 kB 00:00 2024-08-19T00:01:40.916 INFO:teuthology.orchestra.run.smithi116.stdout:(40/150): libquadmath-11.4.1-3.el9.x86_64.rpm 1.8 MB/s | 195 kB 00:00 2024-08-19T00:01:40.929 INFO:teuthology.orchestra.run.smithi171.stdout:(70/150): postgresql-private-libs-13.14-1.el9.x 1.7 MB/s | 133 kB 00:00 2024-08-19T00:01:40.940 INFO:teuthology.orchestra.run.smithi044.stdout:(10/150): ceph-radosgw-19.1.0-1382.gde09dd01.el 2.9 MB/s | 11 MB 00:03 2024-08-19T00:01:41.000 INFO:teuthology.orchestra.run.smithi116.stdout:(41/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-08-19T00:01:41.007 INFO:teuthology.orchestra.run.smithi044.stdout:(11/150): cephfs-mirror-19.1.0-1382.gde09dd01.e 3.3 MB/s | 225 kB 00:00 2024-08-19T00:01:41.030 INFO:teuthology.orchestra.run.smithi171.stdout:(71/150): postgresql-server-13.14-1.el9.x86_64. 46 MB/s | 5.8 MB 00:00 2024-08-19T00:01:41.033 INFO:teuthology.orchestra.run.smithi116.stdout:(42/150): libgfortran-11.4.1-3.el9.x86_64.rpm 2.8 MB/s | 803 kB 00:00 2024-08-19T00:01:41.048 INFO:teuthology.orchestra.run.smithi044.stdout:(12/150): cephfs-shell-19.1.0-1382.gde09dd01.el 653 kB/s | 27 kB 00:00 2024-08-19T00:01:41.063 INFO:teuthology.orchestra.run.smithi171.stdout:(72/150): protobuf-3.14.0-13.el9.x86_64.rpm 7.6 MB/s | 1.0 MB 00:00 2024-08-19T00:01:41.088 INFO:teuthology.orchestra.run.smithi171.stdout:(73/150): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-08-19T00:01:41.090 INFO:teuthology.orchestra.run.smithi044.stdout:(13/150): libcephfs-devel-19.1.0-1382.gde09dd01 764 kB/s | 32 kB 00:00 2024-08-19T00:01:41.094 INFO:teuthology.orchestra.run.smithi116.stdout:(43/150): python3-ply-3.11-14.el9.noarch.rpm 1.7 MB/s | 106 kB 00:00 2024-08-19T00:01:41.128 INFO:teuthology.orchestra.run.smithi116.stdout:(44/150): python3-cryptography-36.0.1-4.el9.x86 9.6 MB/s | 1.2 MB 00:00 2024-08-19T00:01:41.130 INFO:teuthology.orchestra.run.smithi171.stdout:(74/150): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-08-19T00:01:41.154 INFO:teuthology.orchestra.run.smithi116.stdout:(45/150): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-08-19T00:01:41.181 INFO:teuthology.orchestra.run.smithi171.stdout:(75/150): python3-devel-3.9.19-4.el9.x86_64.rpm 4.8 MB/s | 244 kB 00:00 2024-08-19T00:01:41.187 INFO:teuthology.orchestra.run.smithi116.stdout:(46/150): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-08-19T00:01:41.212 INFO:teuthology.orchestra.run.smithi116.stdout:(47/150): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-08-19T00:01:41.222 INFO:teuthology.orchestra.run.smithi171.stdout:(76/150): python3-jinja2-2.11.3-6.el9.noarch.rp 5.8 MB/s | 248 kB 00:00 2024-08-19T00:01:41.224 INFO:teuthology.orchestra.run.smithi044.stdout:(14/150): libcephfs2-19.1.0-1382.gde09dd01.el9. 5.5 MB/s | 753 kB 00:00 2024-08-19T00:01:41.291 INFO:teuthology.orchestra.run.smithi044.stdout:(15/150): libcephsqlite-19.1.0-1382.gde09dd01.e 2.4 MB/s | 163 kB 00:00 2024-08-19T00:01:41.298 INFO:teuthology.orchestra.run.smithi171.stdout:(77/150): python3-babel-2.9.1-2.el9.noarch.rpm 25 MB/s | 6.0 MB 00:00 2024-08-19T00:01:41.323 INFO:teuthology.orchestra.run.smithi171.stdout:(78/150): python3-jsonpatch-1.21-16.el9.noarch. 256 kB/s | 26 kB 00:00 2024-08-19T00:01:41.341 INFO:teuthology.orchestra.run.smithi044.stdout:(16/150): librados-devel-19.1.0-1382.gde09dd01. 2.5 MB/s | 127 kB 00:00 2024-08-19T00:01:41.348 INFO:teuthology.orchestra.run.smithi171.stdout:(79/150): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-08-19T00:01:41.391 INFO:teuthology.orchestra.run.smithi171.stdout:(80/150): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-08-19T00:01:41.416 INFO:teuthology.orchestra.run.smithi171.stdout:(81/150): python3-markupsafe-1.1.1-12.el9.x86_6 521 kB/s | 35 kB 00:00 2024-08-19T00:01:41.457 INFO:teuthology.orchestra.run.smithi171.stdout:(82/150): postgresql-13.14-1.el9.x86_64.rpm 2.1 MB/s | 1.6 MB 00:00 2024-08-19T00:01:41.483 INFO:teuthology.orchestra.run.smithi171.stdout:(83/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.7 MB/s | 250 kB 00:00 2024-08-19T00:01:41.533 INFO:teuthology.orchestra.run.smithi171.stdout:(84/150): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-08-19T00:01:41.558 INFO:teuthology.orchestra.run.smithi171.stdout:(85/150): python3-oauthlib-3.1.1-5.el9.noarch.r 2.2 MB/s | 222 kB 00:00 2024-08-19T00:01:41.575 INFO:teuthology.orchestra.run.smithi171.stdout:(86/150): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-08-19T00:01:41.634 INFO:teuthology.orchestra.run.smithi044.stdout:(17/150): ceph-common-19.1.0-1382.gde09dd01.el9 2.4 MB/s | 21 MB 00:08 2024-08-19T00:01:41.643 INFO:teuthology.orchestra.run.smithi171.stdout:(87/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 20 MB/s | 5.1 MB 00:00 2024-08-19T00:01:41.659 INFO:teuthology.orchestra.run.smithi044.stdout:(18/150): libradosstriper1-19.1.0-1382.gde09dd0 1.6 MB/s | 507 kB 00:00 2024-08-19T00:01:41.668 INFO:teuthology.orchestra.run.smithi171.stdout:(88/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 159 kB 00:00 2024-08-19T00:01:41.693 INFO:teuthology.orchestra.run.smithi171.stdout:(89/150): python3-protobuf-3.14.0-13.el9.noarch 2.0 MB/s | 269 kB 00:00 2024-08-19T00:01:41.709 INFO:teuthology.orchestra.run.smithi044.stdout:(19/150): python3-ceph-argparse-19.1.0-1382.gde 907 kB/s | 45 kB 00:00 2024-08-19T00:01:41.718 INFO:teuthology.orchestra.run.smithi171.stdout:(90/150): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-08-19T00:01:41.752 INFO:teuthology.orchestra.run.smithi171.stdout:(91/150): python3-pyasn1-modules-0.4.8-6.el9.no 2.5 MB/s | 279 kB 00:00 2024-08-19T00:01:41.776 INFO:teuthology.orchestra.run.smithi044.stdout:(20/150): python3-ceph-common-19.1.0-1382.gde09 2.0 MB/s | 136 kB 00:00 2024-08-19T00:01:41.777 INFO:teuthology.orchestra.run.smithi171.stdout:(92/150): python3-requests-oauthlib-1.3.0-12.el 641 kB/s | 54 kB 00:00 2024-08-19T00:01:41.802 INFO:teuthology.orchestra.run.smithi171.stdout:(93/150): python3-toml-0.10.2-6.el9.noarch.rpm 829 kB/s | 42 kB 00:00 2024-08-19T00:01:41.827 INFO:teuthology.orchestra.run.smithi171.stdout:(94/150): python3-wcwidth-0.2.5-8.el9.noarch.rp 881 kB/s | 44 kB 00:00 2024-08-19T00:01:41.843 INFO:teuthology.orchestra.run.smithi044.stdout:(21/150): python3-cephfs-19.1.0-1382.gde09dd01. 2.8 MB/s | 188 kB 00:00 2024-08-19T00:01:41.861 INFO:teuthology.orchestra.run.smithi171.stdout:(95/150): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-08-19T00:01:41.895 INFO:teuthology.orchestra.run.smithi171.stdout:(96/150): qatlib-service-24.02.0-1.el9.x86_64.r 534 kB/s | 36 kB 00:00 2024-08-19T00:01:41.910 INFO:teuthology.orchestra.run.smithi044.stdout:(22/150): python3-rados-19.1.0-1382.gde09dd01.e 5.4 MB/s | 369 kB 00:00 2024-08-19T00:01:41.920 INFO:teuthology.orchestra.run.smithi171.stdout:(97/150): qatzip-libs-1.2.0-1.el9.x86_64.rpm 807 kB/s | 47 kB 00:00 2024-08-19T00:01:41.962 INFO:teuthology.orchestra.run.smithi171.stdout:(98/150): uuid-1.6.2-55.el9.x86_64.rpm 1.4 MB/s | 58 kB 00:00 2024-08-19T00:01:41.977 INFO:teuthology.orchestra.run.smithi044.stdout:(23/150): python3-rbd-19.1.0-1382.gde09dd01.el9 5.1 MB/s | 350 kB 00:00 2024-08-19T00:01:42.004 INFO:teuthology.orchestra.run.smithi171.stdout:(99/150): socat-1.7.4.1-6.el9.x86_64.rpm 2.7 MB/s | 304 kB 00:00 2024-08-19T00:01:42.027 INFO:teuthology.orchestra.run.smithi044.stdout:(24/150): python3-rgw-19.1.0-1382.gde09dd01.el9 2.3 MB/s | 117 kB 00:00 2024-08-19T00:01:42.029 INFO:teuthology.orchestra.run.smithi171.stdout:(100/150): xfsprogs-devel-6.4.0-3.el9.x86_64.rp 1.4 MB/s | 96 kB 00:00 2024-08-19T00:01:42.063 INFO:teuthology.orchestra.run.smithi171.stdout:(101/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-08-19T00:01:42.077 INFO:teuthology.orchestra.run.smithi044.stdout:(25/150): rbd-fuse-19.1.0-1382.gde09dd01.el9.x8 1.7 MB/s | 85 kB 00:00 2024-08-19T00:01:42.087 INFO:teuthology.orchestra.run.smithi116.stdout:(48/150): automake-1.16.2-8.el9.noarch.rpm 765 kB/s | 689 kB 00:00 2024-08-19T00:01:42.088 INFO:teuthology.orchestra.run.smithi171.stdout:(102/150): zlib-devel-1.2.11-41.el9.x86_64.rpm 767 kB/s | 45 kB 00:00 2024-08-19T00:01:42.129 INFO:teuthology.orchestra.run.smithi116.stdout:(49/150): bison-3.7.4-5.el9.x86_64.rpm 1.0 MB/s | 943 kB 00:00 2024-08-19T00:01:42.322 INFO:teuthology.orchestra.run.smithi171.stdout:(103/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 27 MB/s | 16 MB 00:00 2024-08-19T00:01:42.347 INFO:teuthology.orchestra.run.smithi171.stdout:(104/150): lua-devel-5.4.4-4.el9.x86_64.rpm 79 kB/s | 22 kB 00:00 2024-08-19T00:01:42.398 INFO:teuthology.orchestra.run.smithi171.stdout:(105/150): abseil-cpp-20211102.0-3.el9.x86_64.r 7.1 MB/s | 548 kB 00:00 2024-08-19T00:01:42.423 INFO:teuthology.orchestra.run.smithi171.stdout:(106/150): grpc-data-1.46.7-10.el9.noarch.rpm 783 kB/s | 19 kB 00:00 2024-08-19T00:01:42.444 INFO:teuthology.orchestra.run.smithi044.stdout:(26/150): librgw2-19.1.0-1382.gde09dd01.el9.x86 6.8 MB/s | 5.4 MB 00:00 2024-08-19T00:01:42.448 INFO:teuthology.orchestra.run.smithi171.stdout:(107/150): gperftools-libs-2.9.1-2.el9.x86_64.r 3.0 MB/s | 309 kB 00:00 2024-08-19T00:01:42.482 INFO:teuthology.orchestra.run.smithi171.stdout:(108/150): libarrow-doc-9.0.0-11.el9.noarch.rpm 780 kB/s | 26 kB 00:00 2024-08-19T00:01:42.495 INFO:teuthology.orchestra.run.smithi044.stdout:(27/150): rbd-nbd-19.1.0-1382.gde09dd01.el9.x86 3.4 MB/s | 170 kB 00:00 2024-08-19T00:01:42.507 INFO:teuthology.orchestra.run.smithi171.stdout:(109/150): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-08-19T00:01:42.532 INFO:teuthology.orchestra.run.smithi171.stdout:(110/150): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-08-19T00:01:42.553 INFO:teuthology.orchestra.run.smithi044.stdout:(28/150): rbd-mirror-19.1.0-1382.gde09dd01.el9. 6.5 MB/s | 3.1 MB 00:00 2024-08-19T00:01:42.557 INFO:teuthology.orchestra.run.smithi171.stdout:(111/150): protobuf-compiler-3.14.0-13.el9.x86_ 1.8 MB/s | 863 kB 00:00 2024-08-19T00:01:42.578 INFO:teuthology.orchestra.run.smithi044.stdout:(29/150): ceph-grafana-dashboards-19.1.0-1382.g 381 kB/s | 32 kB 00:00 2024-08-19T00:01:42.591 INFO:teuthology.orchestra.run.smithi171.stdout:(112/150): luarocks-3.9.2-5.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-08-19T00:01:42.604 INFO:teuthology.orchestra.run.smithi044.stdout:(30/150): ceph-mgr-cephadm-19.1.0-1382.gde09dd0 2.8 MB/s | 146 kB 00:00 2024-08-19T00:01:42.633 INFO:teuthology.orchestra.run.smithi171.stdout:(113/150): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-08-19T00:01:42.655 INFO:teuthology.orchestra.run.smithi116.stdout:(50/150): elfutils-libelf-devel-0.191-4.el9.x86 41 kB/s | 22 kB 00:00 2024-08-19T00:01:42.658 INFO:teuthology.orchestra.run.smithi171.stdout:(114/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-08-19T00:01:42.683 INFO:teuthology.orchestra.run.smithi171.stdout:(115/150): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-08-19T00:01:42.709 INFO:teuthology.orchestra.run.smithi171.stdout:(116/150): python3-certifi-2023.05.07-4.el9.noa 570 kB/s | 14 kB 00:00 2024-08-19T00:01:42.742 INFO:teuthology.orchestra.run.smithi171.stdout:(117/150): python3-cheroot-8.6.0-4.el9.noarch.r 5.0 MB/s | 172 kB 00:00 2024-08-19T00:01:42.776 INFO:teuthology.orchestra.run.smithi171.stdout:(118/150): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.8 MB/s | 839 kB 00:00 2024-08-19T00:01:42.780 INFO:teuthology.orchestra.run.smithi116.stdout:(51/150): boost-program-options-1.75.0-8.el9.x8 154 kB/s | 107 kB 00:00 2024-08-19T00:01:42.802 INFO:teuthology.orchestra.run.smithi171.stdout:(119/150): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-08-19T00:01:42.835 INFO:teuthology.orchestra.run.smithi171.stdout:(120/150): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-08-19T00:01:42.860 INFO:teuthology.orchestra.run.smithi171.stdout:(121/150): python3-google-auth-2.33.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-08-19T00:01:42.886 INFO:teuthology.orchestra.run.smithi171.stdout:(122/150): python3-grpcio-tools-1.46.7-10.el9.x 5.6 MB/s | 144 kB 00:00 2024-08-19T00:01:42.911 INFO:teuthology.orchestra.run.smithi171.stdout:(123/150): python3-jaraco-8.2.1-3.el9.noarch.rp 431 kB/s | 11 kB 00:00 2024-08-19T00:01:42.936 INFO:teuthology.orchestra.run.smithi171.stdout:(124/150): python3-jaraco-classes-3.2.1-5.el9.n 707 kB/s | 18 kB 00:00 2024-08-19T00:01:43.029 INFO:teuthology.orchestra.run.smithi171.stdout:(125/150): libarrow-9.0.0-11.el9.x86_64.rpm 7.3 MB/s | 4.4 MB 00:00 2024-08-19T00:01:43.029 INFO:teuthology.orchestra.run.smithi044.stdout:(31/150): ceph-mgr-dashboard-19.1.0-1382.gde09d 7.9 MB/s | 3.6 MB 00:00 2024-08-19T00:01:43.045 INFO:teuthology.orchestra.run.smithi171.stdout:(126/150): python3-jaraco-collections-3.0.0-8.e 213 kB/s | 23 kB 00:00 2024-08-19T00:01:43.062 INFO:teuthology.orchestra.run.smithi171.stdout:(127/150): python3-jaraco-functools-3.5.0-2.el9 579 kB/s | 19 kB 00:00 2024-08-19T00:01:43.079 INFO:teuthology.orchestra.run.smithi171.stdout:(128/150): python3-jaraco-text-3.2.0-6.el9.noar 586 kB/s | 20 kB 00:00 2024-08-19T00:01:43.097 INFO:teuthology.orchestra.run.smithi044.stdout:(32/150): ceph-mgr-modules-core-19.1.0-1382.gde 3.7 MB/s | 249 kB 00:00 2024-08-19T00:01:43.097 INFO:teuthology.orchestra.run.smithi171.stdout:(129/150): python3-logutils-0.3.5-21.el9.noarch 2.7 MB/s | 46 kB 00:00 2024-08-19T00:01:43.122 INFO:teuthology.orchestra.run.smithi171.stdout:(130/150): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-08-19T00:01:43.138 INFO:teuthology.orchestra.run.smithi044.stdout:(33/150): ceph-mgr-rook-19.1.0-1382.gde09dd01.e 1.2 MB/s | 49 kB 00:00 2024-08-19T00:01:43.147 INFO:teuthology.orchestra.run.smithi171.stdout:(131/150): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-08-19T00:01:43.172 INFO:teuthology.orchestra.run.smithi044.stdout:(34/150): ceph-prometheus-alerts-19.1.0-1382.gd 494 kB/s | 16 kB 00:00 2024-08-19T00:01:43.180 INFO:teuthology.orchestra.run.smithi171.stdout:(132/150): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-08-19T00:01:43.214 INFO:teuthology.orchestra.run.smithi171.stdout:(133/150): python3-kubernetes-26.1.0-2.el9.noar 6.8 MB/s | 1.0 MB 00:00 2024-08-19T00:01:43.239 INFO:teuthology.orchestra.run.smithi044.stdout:(35/150): ceph-volume-19.1.0-1382.gde09dd01.el9 4.2 MB/s | 285 kB 00:00 2024-08-19T00:01:43.239 INFO:teuthology.orchestra.run.smithi171.stdout:(134/150): python3-portend-3.1.0-2.el9.noarch.r 281 kB/s | 16 kB 00:00 2024-08-19T00:01:43.264 INFO:teuthology.orchestra.run.smithi171.stdout:(135/150): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-08-19T00:01:43.290 INFO:teuthology.orchestra.run.smithi171.stdout:(136/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-08-19T00:01:43.315 INFO:teuthology.orchestra.run.smithi171.stdout:(137/150): python3-repoze-lru-0.7-16.el9.noarch 611 kB/s | 31 kB 00:00 2024-08-19T00:01:43.338 INFO:teuthology.orchestra.run.smithi116.stdout:(52/150): flexiblas-3.0.4-8.el9.x86_64.rpm 59 kB/s | 33 kB 00:00 2024-08-19T00:01:43.340 INFO:teuthology.orchestra.run.smithi171.stdout:(138/150): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-08-19T00:01:43.356 INFO:teuthology.orchestra.run.smithi044.stdout:(36/150): cephadm-19.1.0-1382.gde09dd01.el9.noa 6.4 MB/s | 766 kB 00:00 2024-08-19T00:01:43.391 INFO:teuthology.orchestra.run.smithi171.stdout:(139/150): python3-grpcio-1.46.7-10.el9.x86_64. 3.7 MB/s | 2.0 MB 00:00 2024-08-19T00:01:43.397 INFO:teuthology.orchestra.run.smithi044.stdout:(37/150): cephfs-top-19.1.0-1382.gde09dd01.el9. 440 kB/s | 18 kB 00:00 2024-08-19T00:01:43.441 INFO:teuthology.orchestra.run.smithi171.stdout:(140/150): python3-tempora-5.0.0-2.el9.noarch.r 358 kB/s | 36 kB 00:00 2024-08-19T00:01:43.455 INFO:teuthology.orchestra.run.smithi116.stdout:(53/150): flex-2.6.4-9.el9.x86_64.rpm 392 kB/s | 313 kB 00:00 2024-08-19T00:01:43.466 INFO:teuthology.orchestra.run.smithi171.stdout:(141/150): python3-routes-2.5.1-5.el9.noarch.rp 1.0 MB/s | 188 kB 00:00 2024-08-19T00:01:43.492 INFO:teuthology.orchestra.run.smithi171.stdout:(142/150): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-08-19T00:01:43.517 INFO:teuthology.orchestra.run.smithi171.stdout:(143/150): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-08-19T00:01:43.540 INFO:teuthology.orchestra.run.smithi044.stdout:(38/150): ceph-mgr-diskprediction-local-19.1.0- 7.9 MB/s | 7.4 MB 00:00 2024-08-19T00:01:43.542 INFO:teuthology.orchestra.run.smithi171.stdout:(144/150): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-08-19T00:01:43.565 INFO:teuthology.orchestra.run.smithi044.stdout:(39/150): fuse-2.9.9-16.el9.x86_64.rpm 478 kB/s | 80 kB 00:00 2024-08-19T00:01:43.576 INFO:teuthology.orchestra.run.smithi171.stdout:(145/150): python3-zc-lockfile-2.0-10.el9.noarc 340 kB/s | 20 kB 00:00 2024-08-19T00:01:43.601 INFO:teuthology.orchestra.run.smithi171.stdout:(146/150): re2-20211101-3.el9.x86_64.rpm 3.2 MB/s | 192 kB 00:00 2024-08-19T00:01:43.626 INFO:teuthology.orchestra.run.smithi171.stdout:(147/150): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-08-19T00:01:43.668 INFO:teuthology.orchestra.run.smithi171.stdout:(148/150): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-08-19T00:01:43.699 INFO:teuthology.orchestra.run.smithi044.stdout:(40/150): libquadmath-11.4.1-3.el9.x86_64.rpm 1.4 MB/s | 195 kB 00:00 2024-08-19T00:01:43.782 INFO:teuthology.orchestra.run.smithi044.stdout:(41/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-08-19T00:01:43.808 INFO:teuthology.orchestra.run.smithi044.stdout:(42/150): libgfortran-11.4.1-3.el9.x86_64.rpm 2.9 MB/s | 803 kB 00:00 2024-08-19T00:01:43.858 INFO:teuthology.orchestra.run.smithi044.stdout:(43/150): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-08-19T00:01:43.893 INFO:teuthology.orchestra.run.smithi171.stdout:(149/150): librbd1-19.1.0-1382.gde09dd01.el9.x8 12 MB/s | 3.2 MB 00:00 2024-08-19T00:01:43.908 INFO:teuthology.orchestra.run.smithi044.stdout:(44/150): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-08-19T00:01:43.931 INFO:teuthology.orchestra.run.smithi116.stdout:(54/150): flexiblas-openblas-openmp-3.0.4-8.el9 38 kB/s | 18 kB 00:00 2024-08-19T00:01:44.050 INFO:teuthology.orchestra.run.smithi044.stdout:(45/150): python3-requests-2.25.1-8.el9.noarch. 882 kB/s | 125 kB 00:00 2024-08-19T00:01:44.102 INFO:teuthology.orchestra.run.smithi171.stdout:(150/150): librados2-19.1.0-1382.gde09dd01.el9. 6.8 MB/s | 3.4 MB 00:00 2024-08-19T00:01:44.107 INFO:teuthology.orchestra.run.smithi171.stdout:-------------------------------------------------------------------------------- 2024-08-19T00:01:44.108 INFO:teuthology.orchestra.run.smithi171.stdout:Total 18 MB/s | 218 MB 00:11 2024-08-19T00:01:44.134 INFO:teuthology.orchestra.run.smithi044.stdout:(46/150): python3-urllib3-1.26.5-6.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-08-19T00:01:44.251 INFO:teuthology.orchestra.run.smithi044.stdout:(47/150): python3-cryptography-36.0.1-4.el9.x86 2.6 MB/s | 1.2 MB 00:00 2024-08-19T00:01:44.373 INFO:teuthology.orchestra.run.smithi116.stdout:(55/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.9 MB/s | 3.0 MB 00:01 2024-08-19T00:01:44.398 INFO:teuthology.orchestra.run.smithi116.stdout:(56/150): libaio-devel-0.3.111-13.el9.x86_64.rp 24 kB/s | 11 kB 00:00 2024-08-19T00:01:44.426 INFO:teuthology.orchestra.run.smithi044.stdout:(48/150): automake-1.16.2-8.el9.noarch.rpm 2.3 MB/s | 689 kB 00:00 2024-08-19T00:01:44.485 INFO:teuthology.orchestra.run.smithi044.stdout:(49/150): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-08-19T00:01:44.535 INFO:teuthology.orchestra.run.smithi044.stdout:(50/150): elfutils-libelf-devel-0.191-4.el9.x86 434 kB/s | 22 kB 00:00 2024-08-19T00:01:44.569 INFO:teuthology.orchestra.run.smithi044.stdout:(51/150): bison-3.7.4-5.el9.x86_64.rpm 2.9 MB/s | 943 kB 00:00 2024-08-19T00:01:44.594 INFO:teuthology.orchestra.run.smithi044.stdout:(52/150): flex-2.6.4-9.el9.x86_64.rpm 5.2 MB/s | 313 kB 00:00 2024-08-19T00:01:44.623 INFO:teuthology.orchestra.run.smithi044.stdout:(53/150): flexiblas-3.0.4-8.el9.x86_64.rpm 653 kB/s | 33 kB 00:00 2024-08-19T00:01:44.670 INFO:teuthology.orchestra.run.smithi044.stdout:(54/150): flexiblas-openblas-openmp-3.0.4-8.el9 364 kB/s | 18 kB 00:00 2024-08-19T00:01:44.720 INFO:teuthology.orchestra.run.smithi044.stdout:(55/150): libaio-devel-0.3.111-13.el9.x86_64.rp 223 kB/s | 11 kB 00:00 2024-08-19T00:01:44.779 INFO:teuthology.orchestra.run.smithi044.stdout:(56/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-08-19T00:01:44.829 INFO:teuthology.orchestra.run.smithi044.stdout:(57/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 909 kB/s | 45 kB 00:00 2024-08-19T00:01:44.913 INFO:teuthology.orchestra.run.smithi044.stdout:(58/150): librdkafka-1.6.1-102.el9.x86_64.rpm 7.8 MB/s | 662 kB 00:00 2024-08-19T00:01:44.971 INFO:teuthology.orchestra.run.smithi044.stdout:(59/150): libtool-2.4.6-46.el9.x86_64.rpm 9.7 MB/s | 581 kB 00:00 2024-08-19T00:01:44.981 INFO:teuthology.orchestra.run.smithi116.stdout:(57/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 78 kB/s | 45 kB 00:00 2024-08-19T00:01:45.022 INFO:teuthology.orchestra.run.smithi044.stdout:(60/150): libuuid-devel-2.37.4-18.el9.x86_64.rp 509 kB/s | 25 kB 00:00 2024-08-19T00:01:45.072 INFO:teuthology.orchestra.run.smithi044.stdout:(61/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 951 kB/s | 47 kB 00:00 2024-08-19T00:01:45.073 INFO:teuthology.orchestra.run.smithi116.stdout:(58/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 229 kB/s | 160 kB 00:00 2024-08-19T00:01:45.220 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction check 2024-08-19T00:01:45.346 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction check succeeded. 2024-08-19T00:01:45.346 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction test 2024-08-19T00:01:45.647 INFO:teuthology.orchestra.run.smithi044.stdout:(62/150): ceph-test-19.1.0-1382.gde09dd01.el9.x 9.7 MB/s | 49 MB 00:05 2024-08-19T00:01:45.673 INFO:teuthology.orchestra.run.smithi044.stdout:(63/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 487 kB/s | 292 kB 00:00 2024-08-19T00:01:45.731 INFO:teuthology.orchestra.run.smithi044.stdout:(64/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.6 MB/s | 3.0 MB 00:01 2024-08-19T00:01:45.748 INFO:teuthology.orchestra.run.smithi044.stdout:(65/150): openblas-0.3.21-2.el9.x86_64.rpm 470 kB/s | 35 kB 00:00 2024-08-19T00:01:45.873 INFO:teuthology.orchestra.run.smithi044.stdout:(66/150): lua-5.4.4-4.el9.x86_64.rpm 836 kB/s | 188 kB 00:00 2024-08-19T00:01:45.899 INFO:teuthology.orchestra.run.smithi116.stdout:(59/150): ceph-test-19.1.0-1382.gde09dd01.el9.x 5.7 MB/s | 49 MB 00:08 2024-08-19T00:01:46.299 INFO:teuthology.orchestra.run.smithi044.stdout:(67/150): openblas-openmp-0.3.21-2.el9.x86_64.r 8.4 MB/s | 4.7 MB 00:00 2024-08-19T00:01:46.332 INFO:teuthology.orchestra.run.smithi044.stdout:(68/150): postgresql-13.14-1.el9.x86_64.rpm 3.5 MB/s | 1.6 MB 00:00 2024-08-19T00:01:46.366 INFO:teuthology.orchestra.run.smithi044.stdout:(69/150): postgresql-contrib-13.14-1.el9.x86_64 13 MB/s | 911 kB 00:00 2024-08-19T00:01:46.449 INFO:teuthology.orchestra.run.smithi116.stdout:(60/150): libuuid-devel-2.37.4-18.el9.x86_64.rp 46 kB/s | 25 kB 00:00 2024-08-19T00:01:46.449 INFO:teuthology.orchestra.run.smithi044.stdout:(70/150): postgresql-private-libs-13.14-1.el9.x 1.1 MB/s | 133 kB 00:00 2024-08-19T00:01:46.625 INFO:teuthology.orchestra.run.smithi044.stdout:(71/150): protobuf-3.14.0-13.el9.x86_64.rpm 5.8 MB/s | 1.0 MB 00:00 2024-08-19T00:01:46.725 INFO:teuthology.orchestra.run.smithi044.stdout:(72/150): postgresql-server-13.14-1.el9.x86_64. 16 MB/s | 5.8 MB 00:00 2024-08-19T00:01:46.750 INFO:teuthology.orchestra.run.smithi044.stdout:(73/150): python3-attrs-20.3.0-7.el9.noarch.rpm 699 kB/s | 87 kB 00:00 2024-08-19T00:01:46.782 INFO:teuthology.orchestra.run.smithi116.stdout:(61/150): libtool-2.4.6-46.el9.x86_64.rpm 340 kB/s | 581 kB 00:01 2024-08-19T00:01:46.803 INFO:teuthology.orchestra.run.smithi044.stdout:(74/150): python3-colorama-0.4.6-3.el9.noarch.r 1.1 MB/s | 61 kB 00:00 2024-08-19T00:01:46.816 INFO:teuthology.orchestra.run.smithi116.stdout:(62/150): librdkafka-1.6.1-102.el9.x86_64.rpm 361 kB/s | 662 kB 00:01 2024-08-19T00:01:46.953 INFO:teuthology.orchestra.run.smithi044.stdout:(75/150): python3-devel-3.9.19-4.el9.x86_64.rpm 1.6 MB/s | 244 kB 00:00 2024-08-19T00:01:47.024 INFO:teuthology.orchestra.run.smithi116.stdout:(63/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 82 kB/s | 47 kB 00:00 2024-08-19T00:01:47.057 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction test succeeded. 2024-08-19T00:01:47.057 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction 2024-08-19T00:01:47.095 INFO:teuthology.orchestra.run.smithi044.stdout:(76/150): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-08-19T00:01:47.120 INFO:teuthology.orchestra.run.smithi044.stdout:(77/150): python3-jinja2-2.11.3-6.el9.noarch.rp 1.5 MB/s | 248 kB 00:00 2024-08-19T00:01:47.145 INFO:teuthology.orchestra.run.smithi044.stdout:(78/150): python3-jsonpatch-1.21-16.el9.noarch. 510 kB/s | 26 kB 00:00 2024-08-19T00:01:47.170 INFO:teuthology.orchestra.run.smithi044.stdout:(79/150): python3-jsonpointer-2.0-4.el9.noarch. 380 kB/s | 19 kB 00:00 2024-08-19T00:01:47.204 INFO:teuthology.orchestra.run.smithi044.stdout:(80/150): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-08-19T00:01:47.229 INFO:teuthology.orchestra.run.smithi044.stdout:(81/150): python3-markupsafe-1.1.1-12.el9.x86_6 592 kB/s | 35 kB 00:00 2024-08-19T00:01:47.380 INFO:teuthology.orchestra.run.smithi044.stdout:(82/150): openssl-devel-3.2.2-2.el9.x86_64.rpm 2.7 MB/s | 4.4 MB 00:01 2024-08-19T00:01:47.405 INFO:teuthology.orchestra.run.smithi044.stdout:(83/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.4 MB/s | 250 kB 00:00 2024-08-19T00:01:47.489 INFO:teuthology.orchestra.run.smithi044.stdout:(84/150): python3-packaging-20.9-5.el9.noarch.r 926 kB/s | 77 kB 00:00 2024-08-19T00:01:47.541 INFO:teuthology.orchestra.run.smithi116.stdout:(64/150): lua-5.4.4-4.el9.x86_64.rpm 260 kB/s | 188 kB 00:00 2024-08-19T00:01:47.556 INFO:teuthology.orchestra.run.smithi044.stdout:(85/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 15 MB/s | 5.1 MB 00:00 2024-08-19T00:01:47.581 INFO:teuthology.orchestra.run.smithi044.stdout:(86/150): python3-oauthlib-3.1.1-5.el9.noarch.r 1.1 MB/s | 222 kB 00:00 2024-08-19T00:01:47.591 INFO:teuthology.orchestra.run.smithi116.stdout:(65/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 362 kB/s | 292 kB 00:00 2024-08-19T00:01:47.598 INFO:teuthology.orchestra.run.smithi044.stdout:(87/150): python3-prettytable-0.7.2-27.el9.noar 389 kB/s | 42 kB 00:00 2024-08-19T00:01:47.608 INFO:teuthology.orchestra.run.smithi116.stdout:(66/150): openblas-0.3.21-2.el9.x86_64.rpm 60 kB/s | 35 kB 00:00 2024-08-19T00:01:47.623 INFO:teuthology.orchestra.run.smithi044.stdout:(88/150): python3-protobuf-3.14.0-13.el9.noarch 3.9 MB/s | 269 kB 00:00 2024-08-19T00:01:47.673 INFO:teuthology.orchestra.run.smithi044.stdout:(89/150): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-08-19T00:01:47.723 INFO:teuthology.orchestra.run.smithi044.stdout:(90/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-08-19T00:01:47.749 INFO:teuthology.orchestra.run.smithi044.stdout:(91/150): python3-requests-oauthlib-1.3.0-12.el 713 kB/s | 54 kB 00:00 2024-08-19T00:01:47.799 INFO:teuthology.orchestra.run.smithi044.stdout:(92/150): python3-pyasn1-modules-0.4.8-6.el9.no 1.4 MB/s | 279 kB 00:00 2024-08-19T00:01:47.816 INFO:teuthology.orchestra.run.smithi044.stdout:(93/150): python3-toml-0.10.2-6.el9.noarch.rpm 623 kB/s | 42 kB 00:00 2024-08-19T00:01:47.841 INFO:teuthology.orchestra.run.smithi044.stdout:(94/150): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.0 MB/s | 44 kB 00:00 2024-08-19T00:01:47.886 INFO:teuthology.orchestra.run.smithi044.stdout:(95/150): qatlib-service-24.02.0-1.el9.x86_64.r 866 kB/s | 36 kB 00:00 2024-08-19T00:01:47.925 INFO:teuthology.orchestra.run.smithi044.stdout:(96/150): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-08-19T00:01:47.967 INFO:teuthology.orchestra.run.smithi044.stdout:(97/150): qatlib-24.02.0-1.el9.x86_64.rpm 1.4 MB/s | 221 kB 00:00 2024-08-19T00:01:47.992 INFO:teuthology.orchestra.run.smithi044.stdout:(98/150): socat-1.7.4.1-6.el9.x86_64.rpm 4.4 MB/s | 304 kB 00:00 2024-08-19T00:01:48.009 INFO:teuthology.orchestra.run.smithi044.stdout:(99/150): uuid-1.6.2-55.el9.x86_64.rpm 1.3 MB/s | 58 kB 00:00 2024-08-19T00:01:48.043 INFO:teuthology.orchestra.run.smithi044.stdout:(100/150): xfsprogs-devel-6.4.0-3.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-08-19T00:01:48.093 INFO:teuthology.orchestra.run.smithi044.stdout:(101/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 762 kB/s | 64 kB 00:00 2024-08-19T00:01:48.110 INFO:teuthology.orchestra.run.smithi044.stdout:(102/150): zlib-devel-1.2.11-41.el9.x86_64.rpm 669 kB/s | 45 kB 00:00 2024-08-19T00:01:48.202 INFO:teuthology.orchestra.run.smithi044.stdout:(103/150): lua-devel-5.4.4-4.el9.x86_64.rpm 206 kB/s | 22 kB 00:00 2024-08-19T00:01:48.261 INFO:teuthology.orchestra.run.smithi044.stdout:(104/150): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-08-19T00:01:48.295 INFO:teuthology.orchestra.run.smithi044.stdout:(105/150): gperftools-libs-2.9.1-2.el9.x86_64.r 9.0 MB/s | 309 kB 00:00 2024-08-19T00:01:48.320 INFO:teuthology.orchestra.run.smithi044.stdout:(106/150): grpc-data-1.46.7-10.el9.noarch.rpm 783 kB/s | 19 kB 00:00 2024-08-19T00:01:48.353 INFO:teuthology.orchestra.run.smithi044.stdout:(107/150): protobuf-compiler-3.14.0-13.el9.x86_ 3.5 MB/s | 863 kB 00:00 2024-08-19T00:01:48.404 INFO:teuthology.orchestra.run.smithi044.stdout:(108/150): libarrow-doc-9.0.0-11.el9.noarch.rpm 520 kB/s | 26 kB 00:00 2024-08-19T00:01:48.437 INFO:teuthology.orchestra.run.smithi044.stdout:(109/150): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-08-19T00:01:48.463 INFO:teuthology.orchestra.run.smithi044.stdout:(110/150): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-08-19T00:01:48.498 INFO:teuthology.orchestra.run.smithi044.stdout:(111/150): luarocks-3.9.2-5.el9.noarch.rpm 4.4 MB/s | 151 kB 00:00 2024-08-19T00:01:48.538 INFO:teuthology.orchestra.run.smithi044.stdout:(112/150): parquet-libs-9.0.0-11.el9.x86_64.rpm 20 MB/s | 839 kB 00:00 2024-08-19T00:01:48.600 INFO:teuthology.orchestra.run.smithi116.stdout:(67/150): postgresql-13.14-1.el9.x86_64.rpm 1.6 MB/s | 1.6 MB 00:00 2024-08-19T00:01:48.605 INFO:teuthology.orchestra.run.smithi044.stdout:(113/150): libarrow-9.0.0-11.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-08-19T00:01:48.667 INFO:teuthology.orchestra.run.smithi116.stdout:(68/150): openblas-openmp-0.3.21-2.el9.x86_64.r 4.2 MB/s | 4.7 MB 00:01 2024-08-19T00:01:48.706 INFO:teuthology.orchestra.run.smithi044.stdout:(114/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 434 kB/s | 43 kB 00:00 2024-08-19T00:01:48.739 INFO:teuthology.orchestra.run.smithi044.stdout:(115/150): python3-cachetools-4.2.4-1.el9.noarc 967 kB/s | 32 kB 00:00 2024-08-19T00:01:48.742 INFO:teuthology.orchestra.run.smithi116.stdout:(69/150): openssl-devel-3.2.2-2.el9.x86_64.rpm 3.9 MB/s | 4.4 MB 00:01 2024-08-19T00:01:48.764 INFO:teuthology.orchestra.run.smithi044.stdout:(116/150): python3-certifi-2023.05.07-4.el9.noa 564 kB/s | 14 kB 00:00 2024-08-19T00:01:48.790 INFO:teuthology.orchestra.run.smithi044.stdout:(117/150): python3-cheroot-8.6.0-4.el9.noarch.r 6.7 MB/s | 172 kB 00:00 2024-08-19T00:01:48.815 INFO:teuthology.orchestra.run.smithi044.stdout:(118/150): python3-asyncssh-2.13.2-5.el9.noarch 1.9 MB/s | 548 kB 00:00 2024-08-19T00:01:48.848 INFO:teuthology.orchestra.run.smithi044.stdout:(119/150): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-08-19T00:01:48.874 INFO:teuthology.orchestra.run.smithi044.stdout:(120/150): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-08-19T00:01:48.899 INFO:teuthology.orchestra.run.smithi044.stdout:(121/150): python3-google-auth-2.33.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-08-19T00:01:48.933 INFO:teuthology.orchestra.run.smithi044.stdout:(122/150): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-08-19T00:01:48.958 INFO:teuthology.orchestra.run.smithi044.stdout:(123/150): python3-jaraco-8.2.1-3.el9.noarch.rp 426 kB/s | 11 kB 00:00 2024-08-19T00:01:48.983 INFO:teuthology.orchestra.run.smithi044.stdout:(124/150): python3-jaraco-classes-3.2.1-5.el9.n 710 kB/s | 18 kB 00:00 2024-08-19T00:01:49.008 INFO:teuthology.orchestra.run.smithi044.stdout:(125/150): python3-jaraco-collections-3.0.0-8.e 935 kB/s | 23 kB 00:00 2024-08-19T00:01:49.034 INFO:teuthology.orchestra.run.smithi044.stdout:(126/150): python3-jaraco-functools-3.5.0-2.el9 777 kB/s | 19 kB 00:00 2024-08-19T00:01:49.059 INFO:teuthology.orchestra.run.smithi044.stdout:(127/150): python3-jaraco-text-3.2.0-6.el9.noar 786 kB/s | 20 kB 00:00 2024-08-19T00:01:49.118 INFO:teuthology.orchestra.run.smithi044.stdout:(128/150): python3-grpcio-1.46.7-10.el9.x86_64. 8.4 MB/s | 2.0 MB 00:00 2024-08-19T00:01:49.143 INFO:teuthology.orchestra.run.smithi044.stdout:(129/150): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-08-19T00:01:49.168 INFO:teuthology.orchestra.run.smithi044.stdout:(130/150): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-08-19T00:01:49.194 INFO:teuthology.orchestra.run.smithi044.stdout:(131/150): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-08-19T00:01:49.227 INFO:teuthology.orchestra.run.smithi044.stdout:(132/150): python3-kubernetes-26.1.0-2.el9.noar 6.1 MB/s | 1.0 MB 00:00 2024-08-19T00:01:49.244 INFO:teuthology.orchestra.run.smithi044.stdout:(133/150): python3-portend-3.1.0-2.el9.noarch.r 967 kB/s | 16 kB 00:00 2024-08-19T00:01:49.261 INFO:teuthology.orchestra.run.smithi044.stdout:(134/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 5.3 MB/s | 90 kB 00:00 2024-08-19T00:01:49.287 INFO:teuthology.orchestra.run.smithi044.stdout:(135/150): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2024-08-19T00:01:49.304 INFO:teuthology.orchestra.run.smithi044.stdout:(136/150): python3-pyperclip-1.8.2-2.el9.noarch 677 kB/s | 28 kB 00:00 2024-08-19T00:01:49.329 INFO:teuthology.orchestra.run.smithi044.stdout:(137/150): python3-repoze-lru-0.7-16.el9.noarch 733 kB/s | 31 kB 00:00 2024-08-19T00:01:49.354 INFO:teuthology.orchestra.run.smithi044.stdout:(138/150): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-08-19T00:01:49.380 INFO:teuthology.orchestra.run.smithi044.stdout:(139/150): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-08-19T00:01:49.393 INFO:teuthology.orchestra.run.smithi116.stdout:(70/150): postgresql-private-libs-13.14-1.el9.x 184 kB/s | 133 kB 00:00 2024-08-19T00:01:49.405 INFO:teuthology.orchestra.run.smithi044.stdout:(140/150): python3-tempora-5.0.0-2.el9.noarch.r 711 kB/s | 36 kB 00:00 2024-08-19T00:01:49.430 INFO:teuthology.orchestra.run.smithi044.stdout:(141/150): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-08-19T00:01:49.455 INFO:teuthology.orchestra.run.smithi044.stdout:(142/150): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-08-19T00:01:49.481 INFO:teuthology.orchestra.run.smithi044.stdout:(143/150): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-08-19T00:01:49.501 INFO:teuthology.orchestra.run.smithi116.stdout:(71/150): postgresql-contrib-13.14-1.el9.x86_64 1.0 MB/s | 911 kB 00:00 2024-08-19T00:01:49.506 INFO:teuthology.orchestra.run.smithi044.stdout:(144/150): python3-zc-lockfile-2.0-10.el9.noarc 804 kB/s | 20 kB 00:00 2024-08-19T00:01:49.531 INFO:teuthology.orchestra.run.smithi044.stdout:(145/150): re2-20211101-3.el9.x86_64.rpm 7.5 MB/s | 192 kB 00:00 2024-08-19T00:01:49.556 INFO:teuthology.orchestra.run.smithi044.stdout:(146/150): python3-werkzeug-2.0.3-3.el9.1.noarc 4.1 MB/s | 427 kB 00:00 2024-08-19T00:01:49.615 INFO:teuthology.orchestra.run.smithi044.stdout:(147/150): thrift-0.15.0-2.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-08-19T00:01:49.894 INFO:teuthology.orchestra.run.smithi116.stdout:(72/150): postgresql-server-13.14-1.el9.x86_64. 5.0 MB/s | 5.8 MB 00:01 2024-08-19T00:01:49.899 INFO:teuthology.orchestra.run.smithi044.stdout:(148/150): librados2-19.1.0-1382.gde09dd01.el9. 10 MB/s | 3.4 MB 00:00 2024-08-19T00:01:50.099 INFO:teuthology.orchestra.run.smithi044.stdout:(149/150): librbd1-19.1.0-1382.gde09dd01.el9.x8 6.5 MB/s | 3.2 MB 00:00 2024-08-19T00:01:50.352 INFO:teuthology.orchestra.run.smithi116.stdout:(73/150): python3-attrs-20.3.0-7.el9.noarch.rpm 103 kB/s | 87 kB 00:00 2024-08-19T00:01:50.519 INFO:teuthology.orchestra.run.smithi116.stdout:(74/150): protobuf-3.14.0-13.el9.x86_64.rpm 918 kB/s | 1.0 MB 00:01 2024-08-19T00:01:51.436 INFO:teuthology.orchestra.run.smithi116.stdout:(75/150): python3-babel-2.9.1-2.el9.noarch.rpm 3.9 MB/s | 6.0 MB 00:01 2024-08-19T00:01:51.603 INFO:teuthology.orchestra.run.smithi116.stdout:(76/150): python3-colorama-0.4.6-3.el9.noarch.r 49 kB/s | 61 kB 00:01 2024-08-19T00:01:51.945 INFO:teuthology.orchestra.run.smithi116.stdout:(77/150): python3-devel-3.9.19-4.el9.x86_64.rpm 171 kB/s | 244 kB 00:01 2024-08-19T00:01:52.328 INFO:teuthology.orchestra.run.smithi116.stdout:(78/150): python3-jsonpatch-1.21-16.el9.noarch. 35 kB/s | 26 kB 00:00 2024-08-19T00:01:52.428 INFO:teuthology.orchestra.run.smithi116.stdout:(79/150): python3-jinja2-2.11.3-6.el9.noarch.rp 250 kB/s | 248 kB 00:00 2024-08-19T00:01:52.453 INFO:teuthology.orchestra.run.smithi116.stdout:(80/150): python3-jsonpointer-2.0-4.el9.noarch. 38 kB/s | 19 kB 00:00 2024-08-19T00:01:52.997 INFO:teuthology.orchestra.run.smithi116.stdout:(81/150): python3-markupsafe-1.1.1-12.el9.x86_6 61 kB/s | 35 kB 00:00 2024-08-19T00:01:53.019 INFO:teuthology.orchestra.run.smithi171.stdout: Preparing : 1/1 2024-08-19T00:01:53.062 INFO:teuthology.orchestra.run.smithi116.stdout:(82/150): python3-mako-1.1.4-6.el9.noarch.rpm 235 kB/s | 172 kB 00:00 2024-08-19T00:01:53.104 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2024-08-19T00:01:53.129 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2024-08-19T00:01:53.173 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2024-08-19T00:01:53.502 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/152 2024-08-19T00:01:53.614 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : librados2-2:19.1.0-1382.gde09dd01.el9.x86_64 5/152 2024-08-19T00:01:53.655 INFO:teuthology.orchestra.run.smithi116.stdout:(83/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.2 MB/s | 5.1 MB 00:01 2024-08-19T00:01:53.736 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librados2-2:19.1.0-1382.gde09dd01.el9.x86_64 5/152 2024-08-19T00:01:53.765 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libcephfs2-2:19.1.0-1382.gde09dd01.el9.x86_64 6/152 2024-08-19T00:01:53.851 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libcephfs2-2:19.1.0-1382.gde09dd01.el9.x86_64 6/152 2024-08-19T00:01:53.879 INFO:teuthology.orchestra.run.smithi116.stdout:(84/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 284 kB/s | 250 kB 00:00 2024-08-19T00:01:53.890 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-rados-2:19.1.0-1382.gde09dd01.el9.x86_64 7/152 2024-08-19T00:01:53.913 INFO:teuthology.orchestra.run.smithi116.stdout:(85/150): python3-oauthlib-3.1.1-5.el9.noarch.r 261 kB/s | 222 kB 00:00 2024-08-19T00:01:53.919 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/152 2024-08-19T00:01:53.945 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/152 2024-08-19T00:01:54.032 INFO:teuthology.orchestra.run.smithi044.stdout:(150/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 2.6 MB/s | 16 MB 00:06 2024-08-19T00:01:54.037 INFO:teuthology.orchestra.run.smithi044.stdout:-------------------------------------------------------------------------------- 2024-08-19T00:01:54.037 INFO:teuthology.orchestra.run.smithi044.stdout:Total 10 MB/s | 218 MB 00:21 2024-08-19T00:01:54.104 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 10/152 2024-08-19T00:01:54.159 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : postgresql-13.14-1.el9.x86_64 11/152 2024-08-19T00:01:54.187 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libcephsqlite-2:19.1.0-1382.gde09dd01.el9.x86_64 12/152 2024-08-19T00:01:54.299 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libcephsqlite-2:19.1.0-1382.gde09dd01.el9.x86_64 12/152 2024-08-19T00:01:54.322 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libradosstriper1-2:19.1.0-1382.gde09dd01.el9.x86 13/152 2024-08-19T00:01:54.376 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libradosstriper1-2:19.1.0-1382.gde09dd01.el9.x86 13/152 2024-08-19T00:01:54.397 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-19T00:01:54.421 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-19T00:01:54.447 INFO:teuthology.orchestra.run.smithi116.stdout:(86/150): python3-prettytable-0.7.2-27.el9.noar 75 kB/s | 42 kB 00:00 2024-08-19T00:01:54.472 INFO:teuthology.orchestra.run.smithi116.stdout:(87/150): python3-packaging-20.9-5.el9.noarch.r 94 kB/s | 77 kB 00:00 2024-08-19T00:01:54.672 INFO:teuthology.orchestra.run.smithi116.stdout:(88/150): python3-protobuf-3.14.0-13.el9.noarch 355 kB/s | 269 kB 00:00 2024-08-19T00:01:54.715 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-19T00:01:54.748 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-19T00:01:54.860 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : re2-1:20211101-3.el9.x86_64 16/152 2024-08-19T00:01:54.956 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/152 2024-08-19T00:01:54.997 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/152 2024-08-19T00:01:55.033 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/152 2024-08-19T00:01:55.108 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/152 2024-08-19T00:01:55.152 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction check 2024-08-19T00:01:55.158 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/152 2024-08-19T00:01:55.180 INFO:teuthology.orchestra.run.smithi116.stdout:(89/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 216 kB/s | 159 kB 00:00 2024-08-19T00:01:55.198 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-packaging-20.9-5.el9.noarch 22/152 2024-08-19T00:01:55.231 INFO:teuthology.orchestra.run.smithi116.stdout:(90/150): python3-pyasn1-modules-0.4.8-6.el9.no 368 kB/s | 279 kB 00:00 2024-08-19T00:01:55.241 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/152 2024-08-19T00:01:55.264 INFO:teuthology.orchestra.run.smithi116.stdout:(91/150): python3-pytz-2021.1-5.el9.noarch.rpm 87 kB/s | 51 kB 00:00 2024-08-19T00:01:55.274 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/152 2024-08-19T00:01:55.291 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction check succeeded. 2024-08-19T00:01:55.291 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction test 2024-08-19T00:01:55.302 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/152 2024-08-19T00:01:55.372 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/152 2024-08-19T00:01:55.425 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 27/152 2024-08-19T00:01:55.455 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/152 2024-08-19T00:01:55.498 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/152 2024-08-19T00:01:55.576 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/152 2024-08-19T00:01:55.609 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-ceph-common-2:19.1.0-1382.gde09dd01.el9. 31/152 2024-08-19T00:01:55.655 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-ceph-argparse-2:19.1.0-1382.gde09dd01.el 32/152 2024-08-19T00:01:55.681 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cephfs-2:19.1.0-1382.gde09dd01.el9.x86_6 33/152 2024-08-19T00:01:55.754 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/152 2024-08-19T00:01:55.805 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : luarocks-3.9.2-5.el9.noarch 35/152 2024-08-19T00:01:55.814 INFO:teuthology.orchestra.run.smithi116.stdout:(92/150): python3-requests-oauthlib-1.3.0-12.el 85 kB/s | 54 kB 00:00 2024-08-19T00:01:55.832 INFO:teuthology.orchestra.run.smithi116.stdout:(93/150): python3-toml-0.10.2-6.el9.noarch.rpm 73 kB/s | 42 kB 00:00 2024-08-19T00:01:55.882 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/152 2024-08-19T00:01:56.018 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/152 2024-08-19T00:01:56.075 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/152 2024-08-19T00:01:56.407 INFO:teuthology.orchestra.run.smithi116.stdout:(94/150): python3-wcwidth-0.2.5-8.el9.noarch.rp 75 kB/s | 44 kB 00:00 2024-08-19T00:01:56.624 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/152 2024-08-19T00:01:56.674 INFO:teuthology.orchestra.run.smithi116.stdout:(95/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-08-19T00:01:56.699 INFO:teuthology.orchestra.run.smithi116.stdout:(96/150): qatlib-24.02.0-1.el9.x86_64.rpm 254 kB/s | 221 kB 00:00 2024-08-19T00:01:56.704 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/152 2024-08-19T00:01:56.739 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 41/152 2024-08-19T00:01:56.783 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/152 2024-08-19T00:01:56.821 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : librados-devel-2:19.1.0-1382.gde09dd01.el9.x86_6 43/152 2024-08-19T00:01:56.854 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/152 2024-08-19T00:01:56.910 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 45/152 2024-08-19T00:01:56.984 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/152 2024-08-19T00:01:57.021 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 47/152 2024-08-19T00:01:57.058 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 48/152 2024-08-19T00:01:57.091 INFO:teuthology.orchestra.run.smithi116.stdout:(97/150): qatlib-service-24.02.0-1.el9.x86_64.r 52 kB/s | 36 kB 00:00 2024-08-19T00:01:57.105 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/152 2024-08-19T00:01:57.122 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction test succeeded. 2024-08-19T00:01:57.122 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction 2024-08-19T00:01:57.140 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/152 2024-08-19T00:01:57.184 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 51/152 2024-08-19T00:01:57.226 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/152 2024-08-19T00:01:57.249 INFO:teuthology.orchestra.run.smithi116.stdout:(98/150): qatzip-libs-1.2.0-1.el9.x86_64.rpm 82 kB/s | 47 kB 00:00 2024-08-19T00:01:57.367 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/152 2024-08-19T00:01:57.411 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/152 2024-08-19T00:01:57.453 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 55/152 2024-08-19T00:01:57.525 INFO:teuthology.orchestra.run.smithi116.stdout:(99/150): socat-1.7.4.1-6.el9.x86_64.rpm 369 kB/s | 304 kB 00:00 2024-08-19T00:01:57.558 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/152 2024-08-19T00:01:57.602 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-google-auth-1:2.33.0-1.el9.noarch 57/152 2024-08-19T00:01:57.651 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/152 2024-08-19T00:01:57.676 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/152 2024-08-19T00:01:57.701 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 60/152 2024-08-19T00:01:57.708 INFO:teuthology.orchestra.run.smithi116.stdout:(100/150): uuid-1.6.2-55.el9.x86_64.rpm 94 kB/s | 58 kB 00:00 2024-08-19T00:01:57.778 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/152 2024-08-19T00:01:57.915 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/152 2024-08-19T00:01:57.933 INFO:teuthology.orchestra.run.smithi116.stdout:(101/150): xfsprogs-devel-6.4.0-3.el9.x86_64.rp 140 kB/s | 96 kB 00:00 2024-08-19T00:01:57.958 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/152 2024-08-19T00:01:57.995 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/152 2024-08-19T00:01:58.029 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/152 2024-08-19T00:01:58.073 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : uuid-1.6.2-55.el9.x86_64 66/152 2024-08-19T00:01:58.111 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 67/152 2024-08-19T00:01:58.134 INFO:teuthology.orchestra.run.smithi116.stdout:(102/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 105 kB/s | 64 kB 00:00 2024-08-19T00:01:58.150 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/152 2024-08-19T00:01:58.180 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/152 2024-08-19T00:01:58.192 INFO:teuthology.orchestra.run.smithi116.stdout:(103/150): lua-devel-5.4.4-4.el9.x86_64.rpm 89 kB/s | 22 kB 00:00 2024-08-19T00:01:58.215 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/152 2024-08-19T00:01:58.248 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/152 2024-08-19T00:01:58.251 INFO:teuthology.orchestra.run.smithi116.stdout:(104/150): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-08-19T00:01:58.276 INFO:teuthology.orchestra.run.smithi116.stdout:(105/150): gperftools-libs-2.9.1-2.el9.x86_64.r 12 MB/s | 309 kB 00:00 2024-08-19T00:01:58.290 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/152 2024-08-19T00:01:58.301 INFO:teuthology.orchestra.run.smithi116.stdout:(106/150): grpc-data-1.46.7-10.el9.noarch.rpm 786 kB/s | 19 kB 00:00 2024-08-19T00:01:58.327 INFO:teuthology.orchestra.run.smithi116.stdout:(107/150): zlib-devel-1.2.11-41.el9.x86_64.rpm 72 kB/s | 45 kB 00:00 2024-08-19T00:01:58.377 INFO:teuthology.orchestra.run.smithi116.stdout:(108/150): libarrow-doc-9.0.0-11.el9.noarch.rpm 520 kB/s | 26 kB 00:00 2024-08-19T00:01:58.411 INFO:teuthology.orchestra.run.smithi116.stdout:(109/150): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-08-19T00:01:58.412 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/152 2024-08-19T00:01:58.444 INFO:teuthology.orchestra.run.smithi116.stdout:(110/150): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-08-19T00:01:58.478 INFO:teuthology.orchestra.run.smithi116.stdout:(111/150): luarocks-3.9.2-5.el9.noarch.rpm 4.5 MB/s | 151 kB 00:00 2024-08-19T00:01:58.545 INFO:teuthology.orchestra.run.smithi116.stdout:(112/150): libarrow-9.0.0-11.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-08-19T00:01:58.728 INFO:teuthology.orchestra.run.smithi116.stdout:(113/150): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.3 MB/s | 839 kB 00:00 2024-08-19T00:01:58.777 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/152 2024-08-19T00:01:58.821 INFO:teuthology.orchestra.run.smithi116.stdout:(114/150): python3-asyncssh-2.13.2-5.el9.noarch 1.9 MB/s | 548 kB 00:00 2024-08-19T00:01:58.831 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 75/152 2024-08-19T00:01:58.846 INFO:teuthology.orchestra.run.smithi116.stdout:(115/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 371 kB/s | 43 kB 00:00 2024-08-19T00:01:58.861 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 76/152 2024-08-19T00:01:58.871 INFO:teuthology.orchestra.run.smithi116.stdout:(116/150): python3-cachetools-4.2.4-1.el9.noarc 642 kB/s | 32 kB 00:00 2024-08-19T00:01:58.896 INFO:teuthology.orchestra.run.smithi116.stdout:(117/150): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-08-19T00:01:58.922 INFO:teuthology.orchestra.run.smithi116.stdout:(118/150): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-08-19T00:01:58.955 INFO:teuthology.orchestra.run.smithi116.stdout:(119/150): protobuf-compiler-3.14.0-13.el9.x86_ 1.0 MB/s | 863 kB 00:00 2024-08-19T00:01:58.969 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 77/152 2024-08-19T00:01:58.989 INFO:teuthology.orchestra.run.smithi116.stdout:(120/150): python3-cherrypy-18.6.1-2.el9.noarch 3.8 MB/s | 358 kB 00:00 2024-08-19T00:01:59.014 INFO:teuthology.orchestra.run.smithi116.stdout:(121/150): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.2 MB/s | 303 kB 00:00 2024-08-19T00:01:59.021 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 78/152 2024-08-19T00:01:59.039 INFO:teuthology.orchestra.run.smithi116.stdout:(122/150): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-08-19T00:01:59.064 INFO:teuthology.orchestra.run.smithi116.stdout:(123/150): python3-jaraco-8.2.1-3.el9.noarch.rp 431 kB/s | 11 kB 00:00 2024-08-19T00:01:59.090 INFO:teuthology.orchestra.run.smithi116.stdout:(124/150): python3-google-auth-2.33.0-1.el9.noa 1.6 MB/s | 220 kB 00:00 2024-08-19T00:01:59.123 INFO:teuthology.orchestra.run.smithi116.stdout:(125/150): python3-jaraco-classes-3.2.1-5.el9.n 301 kB/s | 18 kB 00:00 2024-08-19T00:01:59.148 INFO:teuthology.orchestra.run.smithi116.stdout:(126/150): python3-jaraco-collections-3.0.0-8.e 396 kB/s | 23 kB 00:00 2024-08-19T00:01:59.174 INFO:teuthology.orchestra.run.smithi116.stdout:(127/150): python3-jaraco-functools-3.5.0-2.el9 389 kB/s | 19 kB 00:00 2024-08-19T00:01:59.199 INFO:teuthology.orchestra.run.smithi116.stdout:(128/150): python3-jaraco-text-3.2.0-6.el9.noar 390 kB/s | 20 kB 00:00 2024-08-19T00:01:59.224 INFO:teuthology.orchestra.run.smithi116.stdout:(129/150): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-08-19T00:01:59.258 INFO:teuthology.orchestra.run.smithi116.stdout:(130/150): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-08-19T00:01:59.283 INFO:teuthology.orchestra.run.smithi116.stdout:(131/150): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-08-19T00:01:59.325 INFO:teuthology.orchestra.run.smithi116.stdout:(132/150): python3-kubernetes-26.1.0-2.el9.noar 6.8 MB/s | 1.0 MB 00:00 2024-08-19T00:01:59.359 INFO:teuthology.orchestra.run.smithi116.stdout:(133/150): python3-portend-3.1.0-2.el9.noarch.r 492 kB/s | 16 kB 00:00 2024-08-19T00:01:59.384 INFO:teuthology.orchestra.run.smithi116.stdout:(134/150): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-08-19T00:01:59.410 INFO:teuthology.orchestra.run.smithi116.stdout:(135/150): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-08-19T00:01:59.435 INFO:teuthology.orchestra.run.smithi116.stdout:(136/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-08-19T00:01:59.452 INFO:teuthology.orchestra.run.smithi116.stdout:(137/150): python3-repoze-lru-0.7-16.el9.noarch 737 kB/s | 31 kB 00:00 2024-08-19T00:01:59.469 INFO:teuthology.orchestra.run.smithi116.stdout:(138/150): python3-rsa-4.9-2.el9.noarch.rpm 3.5 MB/s | 59 kB 00:00 2024-08-19T00:01:59.494 INFO:teuthology.orchestra.run.smithi116.stdout:(139/150): python3-routes-2.5.1-5.el9.noarch.rp 3.1 MB/s | 188 kB 00:00 2024-08-19T00:01:59.511 INFO:teuthology.orchestra.run.smithi116.stdout:(140/150): python3-tempora-5.0.0-2.el9.noarch.r 853 kB/s | 36 kB 00:00 2024-08-19T00:01:59.553 INFO:teuthology.orchestra.run.smithi116.stdout:(141/150): python3-grpcio-1.46.7-10.el9.x86_64. 3.6 MB/s | 2.0 MB 00:00 2024-08-19T00:01:59.578 INFO:teuthology.orchestra.run.smithi116.stdout:(142/150): python3-typing-extensions-4.12.2-2.e 890 kB/s | 74 kB 00:00 2024-08-19T00:01:59.604 INFO:teuthology.orchestra.run.smithi116.stdout:(143/150): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-08-19T00:01:59.620 INFO:teuthology.orchestra.run.smithi116.stdout:(144/150): python3-zc-lockfile-2.0-10.el9.noarc 1.2 MB/s | 20 kB 00:00 2024-08-19T00:01:59.646 INFO:teuthology.orchestra.run.smithi116.stdout:(145/150): python3-webob-1.8.7-6.el9.noarch.rpm 1.7 MB/s | 230 kB 00:00 2024-08-19T00:01:59.671 INFO:teuthology.orchestra.run.smithi116.stdout:(146/150): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2024-08-19T00:01:59.696 INFO:teuthology.orchestra.run.smithi116.stdout:(147/150): python3-werkzeug-2.0.3-3.el9.1.noarc 3.6 MB/s | 427 kB 00:00 2024-08-19T00:01:59.747 INFO:teuthology.orchestra.run.smithi116.stdout:(148/150): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-08-19T00:01:59.782 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 79/152 2024-08-19T00:01:59.836 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 80/152 2024-08-19T00:01:59.894 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 81/152 2024-08-19T00:02:00.000 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 82/152 2024-08-19T00:02:00.050 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-devel-3.9.19-4.el9.x86_64 83/152 2024-08-19T00:02:00.072 INFO:teuthology.orchestra.run.smithi116.stdout:(149/150): librbd1-19.1.0-1382.gde09dd01.el9.x8 8.4 MB/s | 3.2 MB 00:00 2024-08-19T00:02:00.095 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 84/152 2024-08-19T00:02:00.185 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 85/152 2024-08-19T00:02:00.230 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/152 2024-08-19T00:02:00.288 INFO:teuthology.orchestra.run.smithi116.stdout:(150/150): librados2-19.1.0-1382.gde09dd01.el9. 5.5 MB/s | 3.4 MB 00:00 2024-08-19T00:02:00.295 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-08-19T00:02:00.295 INFO:teuthology.orchestra.run.smithi116.stdout:Total 8.0 MB/s | 218 MB 00:27 2024-08-19T00:02:00.407 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : openblas-0.3.21-2.el9.x86_64 87/152 2024-08-19T00:02:00.436 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 88/152 2024-08-19T00:02:00.513 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/152 2024-08-19T00:02:01.187 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/152 2024-08-19T00:02:01.303 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/152 2024-08-19T00:02:01.394 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-08-19T00:02:01.522 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-08-19T00:02:01.522 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-08-19T00:02:02.590 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/152 2024-08-19T00:02:02.690 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-19T00:02:02.726 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2024-08-19T00:02:02.759 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 95/152 2024-08-19T00:02:03.067 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/152 2024-08-19T00:02:03.122 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : librbd1-2:19.1.0-1382.gde09dd01.el9.x86_64 97/152 2024-08-19T00:02:03.185 INFO:teuthology.orchestra.run.smithi044.stdout: Preparing : 1/1 2024-08-19T00:02:03.226 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librbd1-2:19.1.0-1382.gde09dd01.el9.x86_64 97/152 2024-08-19T00:02:03.236 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-08-19T00:02:03.236 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-08-19T00:02:03.252 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2024-08-19T00:02:03.260 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-rbd-2:19.1.0-1382.gde09dd01.el9.x86_64 98/152 2024-08-19T00:02:03.276 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2024-08-19T00:02:03.296 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/152 2024-08-19T00:02:03.320 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2024-08-19T00:02:03.695 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/152 2024-08-19T00:02:03.770 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 100/152 2024-08-19T00:02:03.794 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : librados2-2:19.1.0-1382.gde09dd01.el9.x86_64 5/152 2024-08-19T00:02:03.800 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : librgw2-2:19.1.0-1382.gde09dd01.el9.x86_64 101/152 2024-08-19T00:02:03.872 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librgw2-2:19.1.0-1382.gde09dd01.el9.x86_64 101/152 2024-08-19T00:02:03.902 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-rgw-2:19.1.0-1382.gde09dd01.el9.x86_64 102/152 2024-08-19T00:02:03.919 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librados2-2:19.1.0-1382.gde09dd01.el9.x86_64 5/152 2024-08-19T00:02:03.945 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libcephfs2-2:19.1.0-1382.gde09dd01.el9.x86_64 6/152 2024-08-19T00:02:04.183 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: libcephfs2-2:19.1.0-1382.gde09dd01.el9.x86_64 6/152 2024-08-19T00:02:04.230 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-rados-2:19.1.0-1382.gde09dd01.el9.x86_64 7/152 2024-08-19T00:02:04.258 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/152 2024-08-19T00:02:04.284 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/152 2024-08-19T00:02:04.444 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 10/152 2024-08-19T00:02:04.490 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : postgresql-13.14-1.el9.x86_64 11/152 2024-08-19T00:02:04.517 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libcephsqlite-2:19.1.0-1382.gde09dd01.el9.x86_64 12/152 2024-08-19T00:02:04.622 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: libcephsqlite-2:19.1.0-1382.gde09dd01.el9.x86_64 12/152 2024-08-19T00:02:04.651 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libradosstriper1-2:19.1.0-1382.gde09dd01.el9.x86 13/152 2024-08-19T00:02:04.714 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: libradosstriper1-2:19.1.0-1382.gde09dd01.el9.x86 13/152 2024-08-19T00:02:04.735 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-19T00:02:04.762 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-19T00:02:05.054 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-19T00:02:05.085 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-19T00:02:05.197 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : re2-1:20211101-3.el9.x86_64 16/152 2024-08-19T00:02:05.293 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/152 2024-08-19T00:02:05.334 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/152 2024-08-19T00:02:05.370 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/152 2024-08-19T00:02:05.465 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/152 2024-08-19T00:02:05.515 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/152 2024-08-19T00:02:05.553 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-packaging-20.9-5.el9.noarch 22/152 2024-08-19T00:02:05.597 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/152 2024-08-19T00:02:05.629 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/152 2024-08-19T00:02:05.657 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/152 2024-08-19T00:02:05.729 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/152 2024-08-19T00:02:05.781 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 27/152 2024-08-19T00:02:05.814 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/152 2024-08-19T00:02:05.854 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/152 2024-08-19T00:02:05.941 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/152 2024-08-19T00:02:05.981 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-ceph-common-2:19.1.0-1382.gde09dd01.el9. 31/152 2024-08-19T00:02:06.027 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-ceph-argparse-2:19.1.0-1382.gde09dd01.el 32/152 2024-08-19T00:02:06.054 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cephfs-2:19.1.0-1382.gde09dd01.el9.x86_6 33/152 2024-08-19T00:02:06.129 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/152 2024-08-19T00:02:06.176 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : luarocks-3.9.2-5.el9.noarch 35/152 2024-08-19T00:02:06.255 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/152 2024-08-19T00:02:06.384 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-common-2:19.1.0-1382.gde09dd01.el9.x86_64 103/152 2024-08-19T00:02:06.403 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/152 2024-08-19T00:02:06.415 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-common-2:19.1.0-1382.gde09dd01.el9.x86_64 103/152 2024-08-19T00:02:06.464 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/152 2024-08-19T00:02:06.964 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-common-2:19.1.0-1382.gde09dd01.el9.x86_64 103/152 2024-08-19T00:02:07.002 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-base-2:19.1.0-1382.gde09dd01.el9.x86_64 104/152 2024-08-19T00:02:07.026 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/152 2024-08-19T00:02:07.103 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-base-2:19.1.0-1382.gde09dd01.el9.x86_64 104/152 2024-08-19T00:02:07.103 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-19T00:02:07.103 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-19T00:02:07.103 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-19T00:02:07.110 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/152 2024-08-19T00:02:07.137 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-selinux-2:19.1.0-1382.gde09dd01.el9.x86_64 105/152 2024-08-19T00:02:07.144 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 41/152 2024-08-19T00:02:07.188 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/152 2024-08-19T00:02:07.226 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : librados-devel-2:19.1.0-1382.gde09dd01.el9.x86_6 43/152 2024-08-19T00:02:07.259 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/152 2024-08-19T00:02:07.316 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 45/152 2024-08-19T00:02:07.391 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/152 2024-08-19T00:02:07.427 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 47/152 2024-08-19T00:02:07.463 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 48/152 2024-08-19T00:02:07.511 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/152 2024-08-19T00:02:07.546 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/152 2024-08-19T00:02:07.590 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 51/152 2024-08-19T00:02:07.632 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/152 2024-08-19T00:02:07.777 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/152 2024-08-19T00:02:07.824 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/152 2024-08-19T00:02:07.866 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 55/152 2024-08-19T00:02:07.973 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/152 2024-08-19T00:02:08.008 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-google-auth-1:2.33.0-1.el9.noarch 57/152 2024-08-19T00:02:08.048 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/152 2024-08-19T00:02:08.073 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/152 2024-08-19T00:02:08.098 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 60/152 2024-08-19T00:02:08.175 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/152 2024-08-19T00:02:08.314 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/152 2024-08-19T00:02:08.355 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/152 2024-08-19T00:02:08.384 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/152 2024-08-19T00:02:08.418 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/152 2024-08-19T00:02:08.462 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : uuid-1.6.2-55.el9.x86_64 66/152 2024-08-19T00:02:08.500 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 67/152 2024-08-19T00:02:08.540 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/152 2024-08-19T00:02:08.569 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/152 2024-08-19T00:02:08.683 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/152 2024-08-19T00:02:08.729 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/152 2024-08-19T00:02:08.771 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/152 2024-08-19T00:02:08.805 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/152 2024-08-19T00:02:08.897 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/152 2024-08-19T00:02:08.952 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 75/152 2024-08-19T00:02:08.983 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 76/152 2024-08-19T00:02:09.094 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 77/152 2024-08-19T00:02:09.144 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 78/152 2024-08-19T00:02:09.387 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-08-19T00:02:09.474 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2024-08-19T00:02:09.499 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2024-08-19T00:02:09.550 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2024-08-19T00:02:09.884 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/152 2024-08-19T00:02:09.952 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 79/152 2024-08-19T00:02:09.999 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 80/152 2024-08-19T00:02:10.008 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : librados2-2:19.1.0-1382.gde09dd01.el9.x86_64 5/152 2024-08-19T00:02:10.033 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 81/152 2024-08-19T00:02:10.131 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librados2-2:19.1.0-1382.gde09dd01.el9.x86_64 5/152 2024-08-19T00:02:10.137 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 82/152 2024-08-19T00:02:10.160 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libcephfs2-2:19.1.0-1382.gde09dd01.el9.x86_64 6/152 2024-08-19T00:02:10.189 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-devel-3.9.19-4.el9.x86_64 83/152 2024-08-19T00:02:10.235 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 84/152 2024-08-19T00:02:10.246 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libcephfs2-2:19.1.0-1382.gde09dd01.el9.x86_64 6/152 2024-08-19T00:02:10.284 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rados-2:19.1.0-1382.gde09dd01.el9.x86_64 7/152 2024-08-19T00:02:10.314 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/152 2024-08-19T00:02:10.325 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 85/152 2024-08-19T00:02:10.361 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/152 2024-08-19T00:02:10.364 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/152 2024-08-19T00:02:10.515 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 10/152 2024-08-19T00:02:10.543 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : openblas-0.3.21-2.el9.x86_64 87/152 2024-08-19T00:02:10.566 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 88/152 2024-08-19T00:02:10.570 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : postgresql-13.14-1.el9.x86_64 11/152 2024-08-19T00:02:10.598 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libcephsqlite-2:19.1.0-1382.gde09dd01.el9.x86_64 12/152 2024-08-19T00:02:10.645 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/152 2024-08-19T00:02:10.702 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libcephsqlite-2:19.1.0-1382.gde09dd01.el9.x86_64 12/152 2024-08-19T00:02:10.724 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libradosstriper1-2:19.1.0-1382.gde09dd01.el9.x86 13/152 2024-08-19T00:02:10.787 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libradosstriper1-2:19.1.0-1382.gde09dd01.el9.x86 13/152 2024-08-19T00:02:10.809 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-19T00:02:10.831 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-19T00:02:11.149 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-19T00:02:11.190 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-19T00:02:11.303 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : re2-1:20211101-3.el9.x86_64 16/152 2024-08-19T00:02:11.340 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/152 2024-08-19T00:02:11.399 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/152 2024-08-19T00:02:11.432 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/152 2024-08-19T00:02:11.454 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/152 2024-08-19T00:02:11.467 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/152 2024-08-19T00:02:11.540 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/152 2024-08-19T00:02:11.585 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/152 2024-08-19T00:02:11.625 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-packaging-20.9-5.el9.noarch 22/152 2024-08-19T00:02:11.668 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/152 2024-08-19T00:02:11.701 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/152 2024-08-19T00:02:11.729 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/152 2024-08-19T00:02:11.798 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/152 2024-08-19T00:02:11.851 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 27/152 2024-08-19T00:02:11.882 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/152 2024-08-19T00:02:11.925 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/152 2024-08-19T00:02:12.002 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/152 2024-08-19T00:02:12.036 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-ceph-common-2:19.1.0-1382.gde09dd01.el9. 31/152 2024-08-19T00:02:12.081 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-ceph-argparse-2:19.1.0-1382.gde09dd01.el 32/152 2024-08-19T00:02:12.109 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cephfs-2:19.1.0-1382.gde09dd01.el9.x86_6 33/152 2024-08-19T00:02:12.182 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/152 2024-08-19T00:02:12.231 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : luarocks-3.9.2-5.el9.noarch 35/152 2024-08-19T00:02:12.306 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/152 2024-08-19T00:02:12.447 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/152 2024-08-19T00:02:12.500 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/152 2024-08-19T00:02:12.770 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/152 2024-08-19T00:02:12.845 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-19T00:02:12.873 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2024-08-19T00:02:12.906 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 95/152 2024-08-19T00:02:13.029 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/152 2024-08-19T00:02:13.113 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/152 2024-08-19T00:02:13.141 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 41/152 2024-08-19T00:02:13.184 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/152 2024-08-19T00:02:13.222 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librados-devel-2:19.1.0-1382.gde09dd01.el9.x86_6 43/152 2024-08-19T00:02:13.232 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/152 2024-08-19T00:02:13.255 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/152 2024-08-19T00:02:13.277 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : librbd1-2:19.1.0-1382.gde09dd01.el9.x86_64 97/152 2024-08-19T00:02:13.310 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 45/152 2024-08-19T00:02:13.373 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librbd1-2:19.1.0-1382.gde09dd01.el9.x86_64 97/152 2024-08-19T00:02:13.384 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/152 2024-08-19T00:02:13.399 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-rbd-2:19.1.0-1382.gde09dd01.el9.x86_64 98/152 2024-08-19T00:02:13.423 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 47/152 2024-08-19T00:02:13.435 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/152 2024-08-19T00:02:13.459 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 48/152 2024-08-19T00:02:13.506 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/152 2024-08-19T00:02:13.542 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/152 2024-08-19T00:02:13.585 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 51/152 2024-08-19T00:02:13.627 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/152 2024-08-19T00:02:13.765 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/152 2024-08-19T00:02:13.804 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/152 2024-08-19T00:02:13.845 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 55/152 2024-08-19T00:02:13.936 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 100/152 2024-08-19T00:02:13.948 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/152 2024-08-19T00:02:13.964 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : librgw2-2:19.1.0-1382.gde09dd01.el9.x86_64 101/152 2024-08-19T00:02:13.987 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-google-auth-1:2.33.0-1.el9.noarch 57/152 2024-08-19T00:02:14.026 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/152 2024-08-19T00:02:14.028 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librgw2-2:19.1.0-1382.gde09dd01.el9.x86_64 101/152 2024-08-19T00:02:14.052 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/152 2024-08-19T00:02:14.057 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-rgw-2:19.1.0-1382.gde09dd01.el9.x86_64 102/152 2024-08-19T00:02:14.077 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 60/152 2024-08-19T00:02:14.152 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/152 2024-08-19T00:02:14.279 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/152 2024-08-19T00:02:14.318 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/152 2024-08-19T00:02:14.345 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/152 2024-08-19T00:02:14.380 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/152 2024-08-19T00:02:14.426 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : uuid-1.6.2-55.el9.x86_64 66/152 2024-08-19T00:02:14.461 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 67/152 2024-08-19T00:02:14.493 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/152 2024-08-19T00:02:14.523 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/152 2024-08-19T00:02:14.557 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/152 2024-08-19T00:02:14.591 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/152 2024-08-19T00:02:14.632 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/152 2024-08-19T00:02:14.666 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/152 2024-08-19T00:02:14.754 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/152 2024-08-19T00:02:14.797 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 75/152 2024-08-19T00:02:14.828 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 76/152 2024-08-19T00:02:14.932 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 77/152 2024-08-19T00:02:15.013 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 78/152 2024-08-19T00:02:15.740 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 79/152 2024-08-19T00:02:15.784 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 80/152 2024-08-19T00:02:15.819 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 81/152 2024-08-19T00:02:15.918 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 82/152 2024-08-19T00:02:15.966 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-devel-3.9.19-4.el9.x86_64 83/152 2024-08-19T00:02:16.027 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 84/152 2024-08-19T00:02:16.115 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 85/152 2024-08-19T00:02:16.163 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/152 2024-08-19T00:02:16.338 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : openblas-0.3.21-2.el9.x86_64 87/152 2024-08-19T00:02:16.378 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 88/152 2024-08-19T00:02:16.455 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/152 2024-08-19T00:02:16.746 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-common-2:19.1.0-1382.gde09dd01.el9.x86_64 103/152 2024-08-19T00:02:16.779 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-common-2:19.1.0-1382.gde09dd01.el9.x86_64 103/152 2024-08-19T00:02:17.109 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/152 2024-08-19T00:02:17.226 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/152 2024-08-19T00:02:17.353 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-common-2:19.1.0-1382.gde09dd01.el9.x86_64 103/152 2024-08-19T00:02:17.399 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-base-2:19.1.0-1382.gde09dd01.el9.x86_64 104/152 2024-08-19T00:02:17.489 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-base-2:19.1.0-1382.gde09dd01.el9.x86_64 104/152 2024-08-19T00:02:17.489 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-19T00:02:17.489 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-19T00:02:17.490 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:02:17.517 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-selinux-2:19.1.0-1382.gde09dd01.el9.x86_64 105/152 2024-08-19T00:02:18.465 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/152 2024-08-19T00:02:18.548 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-19T00:02:18.576 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2024-08-19T00:02:18.609 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 95/152 2024-08-19T00:02:18.904 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-selinux-2:19.1.0-1382.gde09dd01.el9.x86_64 105/152 2024-08-19T00:02:18.904 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /sys 2024-08-19T00:02:18.904 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /proc 2024-08-19T00:02:18.905 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /mnt 2024-08-19T00:02:18.905 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /var/tmp 2024-08-19T00:02:18.905 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /home 2024-08-19T00:02:18.905 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /root 2024-08-19T00:02:18.905 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /tmp 2024-08-19T00:02:18.905 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-19T00:02:18.909 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/152 2024-08-19T00:02:18.955 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : librbd1-2:19.1.0-1382.gde09dd01.el9.x86_64 97/152 2024-08-19T00:02:19.032 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librbd1-2:19.1.0-1382.gde09dd01.el9.x86_64 97/152 2024-08-19T00:02:19.060 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rbd-2:19.1.0-1382.gde09dd01.el9.x86_64 98/152 2024-08-19T00:02:19.082 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-volume-2:19.1.0-1382.gde09dd01.el9.noarch 106/152 2024-08-19T00:02:19.095 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/152 2024-08-19T00:02:19.099 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-volume-2:19.1.0-1382.gde09dd01.el9.noarch 106/152 2024-08-19T00:02:19.099 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T00:02:19.099 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-19T00:02:19.099 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-19T00:02:19.567 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 100/152 2024-08-19T00:02:19.608 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librgw2-2:19.1.0-1382.gde09dd01.el9.x86_64 101/152 2024-08-19T00:02:19.681 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librgw2-2:19.1.0-1382.gde09dd01.el9.x86_64 101/152 2024-08-19T00:02:19.710 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rgw-2:19.1.0-1382.gde09dd01.el9.x86_64 102/152 2024-08-19T00:02:20.602 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-osd-2:19.1.0-1382.gde09dd01.el9.x86_64 107/152 2024-08-19T00:02:20.629 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-osd-2:19.1.0-1382.gde09dd01.el9.x86_64 107/152 2024-08-19T00:02:20.629 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T00:02:20.629 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-19T00:02:20.629 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-19T00:02:20.629 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-19T00:02:20.629 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-19T00:02:20.853 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mds-2:19.1.0-1382.gde09dd01.el9.x86_64 108/152 2024-08-19T00:02:20.876 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mds-2:19.1.0-1382.gde09dd01.el9.x86_64 108/152 2024-08-19T00:02:20.876 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T00:02:20.876 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-19T00:02:20.877 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-19T00:02:20.877 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-19T00:02:20.877 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-19T00:02:21.312 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mon-2:19.1.0-1382.gde09dd01.el9.x86_64 109/152 2024-08-19T00:02:21.336 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mon-2:19.1.0-1382.gde09dd01.el9.x86_64 109/152 2024-08-19T00:02:21.336 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T00:02:21.336 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-19T00:02:21.336 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-19T00:02:21.336 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-19T00:02:21.336 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-19T00:02:21.442 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : automake-1.16.2-8.el9.noarch 110/152 2024-08-19T00:02:21.499 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-ply-3.11-14.el9.noarch 111/152 2024-08-19T00:02:21.556 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 112/152 2024-08-19T00:02:21.752 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 113/152 2024-08-19T00:02:21.796 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 114/152 2024-08-19T00:02:21.875 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/152 2024-08-19T00:02:21.940 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-common-2:19.1.0-1382.gde09dd01.el9.x86_64 103/152 2024-08-19T00:02:21.963 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 116/152 2024-08-19T00:02:21.972 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-common-2:19.1.0-1382.gde09dd01.el9.x86_64 103/152 2024-08-19T00:02:22.139 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 117/152 2024-08-19T00:02:22.179 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 118/152 2024-08-19T00:02:22.211 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 119/152 2024-08-19T00:02:22.239 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : fuse-2.9.9-16.el9.x86_64 120/152 2024-08-19T00:02:22.519 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-common-2:19.1.0-1382.gde09dd01.el9.x86_64 103/152 2024-08-19T00:02:22.552 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-base-2:19.1.0-1382.gde09dd01.el9.x86_64 104/152 2024-08-19T00:02:22.644 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-base-2:19.1.0-1382.gde09dd01.el9.x86_64 104/152 2024-08-19T00:02:22.644 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-19T00:02:22.645 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-19T00:02:22.645 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-08-19T00:02:22.678 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-selinux-2:19.1.0-1382.gde09dd01.el9.x86_64 105/152 2024-08-19T00:02:22.702 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: cephadm-2:19.1.0-1382.gde09dd01.el9.noarch 121/152 2024-08-19T00:02:22.729 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : cephadm-2:19.1.0-1382.gde09dd01.el9.noarch 121/152 2024-08-19T00:02:22.761 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-prometheus-alerts-2:19.1.0-1382.gde09dd01.e 122/152 2024-08-19T00:02:22.823 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-grafana-dashboards-2:19.1.0-1382.gde09dd01. 123/152 2024-08-19T00:02:22.861 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-cephadm-2:19.1.0-1382.gde09dd01.el9.noa 124/152 2024-08-19T00:02:23.912 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.0-1382.gde09dd01.el9.noa 124/152 2024-08-19T00:02:23.946 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-dashboard-2:19.1.0-1382.gde09dd01.el9.n 125/152 2024-08-19T00:02:24.910 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.0-1382.gde09dd01.el9.n 125/152 2024-08-19T00:02:24.930 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.0-1382.gde0 126/152 2024-08-19T00:02:25.034 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.0-1382.gde0 126/152 2024-08-19T00:02:25.201 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-modules-core-2:19.1.0-1382.gde09dd01.el 127/152 2024-08-19T00:02:25.232 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-2:19.1.0-1382.gde09dd01.el9.x86_64 128/152 2024-08-19T00:02:25.255 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-2:19.1.0-1382.gde09dd01.el9.x86_64 128/152 2024-08-19T00:02:25.256 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T00:02:25.256 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-19T00:02:25.256 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-19T00:02:25.256 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-19T00:02:25.256 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-19T00:02:25.307 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-rook-2:19.1.0-1382.gde09dd01.el9.noarch 129/152 2024-08-19T00:02:25.319 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.0-1382.gde09dd01.el9.noarch 129/152 2024-08-19T00:02:25.416 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-2:19.1.0-1382.gde09dd01.el9.x86_64 130/152 2024-08-19T00:02:25.464 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-fuse-2:19.1.0-1382.gde09dd01.el9.x86_64 131/152 2024-08-19T00:02:26.378 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libtool-2.4.6-46.el9.x86_64 132/152 2024-08-19T00:02:26.410 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-radosgw-2:19.1.0-1382.gde09dd01.el9.x86_64 133/152 2024-08-19T00:02:26.434 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-radosgw-2:19.1.0-1382.gde09dd01.el9.x86_64 133/152 2024-08-19T00:02:26.434 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T00:02:26.434 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-19T00:02:26.434 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-19T00:02:26.434 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-19T00:02:26.434 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-19T00:02:26.478 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-immutable-object-cache-2:19.1.0-1382.gde09d 134/152 2024-08-19T00:02:26.501 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.0-1382.gde09d 134/152 2024-08-19T00:02:26.501 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T00:02:26.501 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-19T00:02:26.501 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-19T00:02:26.553 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : cephfs-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 135/152 2024-08-19T00:02:26.577 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: cephfs-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 135/152 2024-08-19T00:02:26.577 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T00:02:26.577 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-19T00:02:26.577 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-19T00:02:26.577 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-19T00:02:26.577 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-19T00:02:26.887 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : rbd-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 136/152 2024-08-19T00:02:26.911 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: rbd-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 136/152 2024-08-19T00:02:26.911 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T00:02:26.911 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-19T00:02:26.912 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-19T00:02:26.912 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-19T00:02:26.912 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-19T00:02:29.443 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-selinux-2:19.1.0-1382.gde09dd01.el9.x86_64 105/152 2024-08-19T00:02:29.444 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /sys 2024-08-19T00:02:29.444 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /proc 2024-08-19T00:02:29.444 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /mnt 2024-08-19T00:02:29.444 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /var/tmp 2024-08-19T00:02:29.444 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /home 2024-08-19T00:02:29.444 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /root 2024-08-19T00:02:29.444 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /tmp 2024-08-19T00:02:29.444 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:02:29.638 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-volume-2:19.1.0-1382.gde09dd01.el9.noarch 106/152 2024-08-19T00:02:29.654 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-volume-2:19.1.0-1382.gde09dd01.el9.noarch 106/152 2024-08-19T00:02:29.654 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T00:02:29.654 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-19T00:02:29.654 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:02:31.182 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-osd-2:19.1.0-1382.gde09dd01.el9.x86_64 107/152 2024-08-19T00:02:31.209 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-osd-2:19.1.0-1382.gde09dd01.el9.x86_64 107/152 2024-08-19T00:02:31.209 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T00:02:31.209 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-19T00:02:31.209 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-19T00:02:31.209 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-19T00:02:31.210 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:02:31.441 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mds-2:19.1.0-1382.gde09dd01.el9.x86_64 108/152 2024-08-19T00:02:31.464 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mds-2:19.1.0-1382.gde09dd01.el9.x86_64 108/152 2024-08-19T00:02:31.464 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T00:02:31.464 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-19T00:02:31.464 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-19T00:02:31.464 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-19T00:02:31.465 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:02:31.465 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-test-2:19.1.0-1382.gde09dd01.el9.x86_64 137/152 2024-08-19T00:02:31.506 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : rbd-fuse-2:19.1.0-1382.gde09dd01.el9.x86_64 138/152 2024-08-19T00:02:31.547 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : rbd-nbd-2:19.1.0-1382.gde09dd01.el9.x86_64 139/152 2024-08-19T00:02:31.579 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : xfsprogs-devel-6.4.0-3.el9.x86_64 140/152 2024-08-19T00:02:31.607 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 141/152 2024-08-19T00:02:31.792 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : cephfs-shell-2:19.1.0-1382.gde09dd01.el9.x86_64 142/152 2024-08-19T00:02:31.836 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 143/152 2024-08-19T00:02:31.866 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libcephfs-devel-2:19.1.0-1382.gde09dd01.el9.x86_ 144/152 2024-08-19T00:02:31.925 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mon-2:19.1.0-1382.gde09dd01.el9.x86_64 109/152 2024-08-19T00:02:31.949 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mon-2:19.1.0-1382.gde09dd01.el9.x86_64 109/152 2024-08-19T00:02:31.949 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T00:02:31.949 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-19T00:02:31.949 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-19T00:02:31.949 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-19T00:02:31.950 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:02:32.048 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : automake-1.16.2-8.el9.noarch 110/152 2024-08-19T00:02:32.106 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-ply-3.11-14.el9.noarch 111/152 2024-08-19T00:02:32.170 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 112/152 2024-08-19T00:02:32.362 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 113/152 2024-08-19T00:02:32.410 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 114/152 2024-08-19T00:02:32.491 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 145/152 2024-08-19T00:02:32.498 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/152 2024-08-19T00:02:32.531 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 145/152 2024-08-19T00:02:32.552 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 145/152 2024-08-19T00:02:32.589 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 116/152 2024-08-19T00:02:32.730 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 117/152 2024-08-19T00:02:32.768 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 118/152 2024-08-19T00:02:32.800 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 119/152 2024-08-19T00:02:32.827 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : fuse-2.9.9-16.el9.x86_64 120/152 2024-08-19T00:02:33.257 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: cephadm-2:19.1.0-1382.gde09dd01.el9.noarch 121/152 2024-08-19T00:02:33.285 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : cephadm-2:19.1.0-1382.gde09dd01.el9.noarch 121/152 2024-08-19T00:02:33.316 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-prometheus-alerts-2:19.1.0-1382.gde09dd01.e 122/152 2024-08-19T00:02:33.381 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-grafana-dashboards-2:19.1.0-1382.gde09dd01. 123/152 2024-08-19T00:02:33.402 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : cephfs-top-2:19.1.0-1382.gde09dd01.el9.noarch 146/152 2024-08-19T00:02:33.416 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-cephadm-2:19.1.0-1382.gde09dd01.el9.noa 124/152 2024-08-19T00:02:33.494 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 147/152 2024-08-19T00:02:33.560 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/152 2024-08-19T00:02:33.652 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/152 2024-08-19T00:02:33.682 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/152 2024-08-19T00:02:33.682 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-19T00:02:33.774 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-19T00:02:33.774 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-19T00:02:33.936 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-selinux-2:19.1.0-1382.gde09dd01.el9.x86_64 105/152 2024-08-19T00:02:33.936 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /sys 2024-08-19T00:02:33.936 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /proc 2024-08-19T00:02:33.936 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /mnt 2024-08-19T00:02:33.936 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /var/tmp 2024-08-19T00:02:33.936 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /home 2024-08-19T00:02:33.936 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /root 2024-08-19T00:02:33.936 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /tmp 2024-08-19T00:02:33.936 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-08-19T00:02:34.105 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-volume-2:19.1.0-1382.gde09dd01.el9.noarch 106/152 2024-08-19T00:02:34.122 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-volume-2:19.1.0-1382.gde09dd01.el9.noarch 106/152 2024-08-19T00:02:34.122 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T00:02:34.122 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-19T00:02:34.122 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-08-19T00:02:34.514 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.0-1382.gde09dd01.el9.noa 124/152 2024-08-19T00:02:34.551 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-dashboard-2:19.1.0-1382.gde09dd01.el9.n 125/152 2024-08-19T00:02:35.563 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.0-1382.gde09dd01.el9.n 125/152 2024-08-19T00:02:35.584 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-osd-2:19.1.0-1382.gde09dd01.el9.x86_64 107/152 2024-08-19T00:02:35.593 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.0-1382.gde0 126/152 2024-08-19T00:02:35.610 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-osd-2:19.1.0-1382.gde09dd01.el9.x86_64 107/152 2024-08-19T00:02:35.611 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T00:02:35.611 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-19T00:02:35.611 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-19T00:02:35.611 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-19T00:02:35.611 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-08-19T00:02:35.701 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.0-1382.gde0 126/152 2024-08-19T00:02:35.835 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mds-2:19.1.0-1382.gde09dd01.el9.x86_64 108/152 2024-08-19T00:02:35.858 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mds-2:19.1.0-1382.gde09dd01.el9.x86_64 108/152 2024-08-19T00:02:35.858 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T00:02:35.858 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-19T00:02:35.858 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-19T00:02:35.858 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-19T00:02:35.858 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-08-19T00:02:35.872 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-modules-core-2:19.1.0-1382.gde09dd01.el 127/152 2024-08-19T00:02:35.903 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-2:19.1.0-1382.gde09dd01.el9.x86_64 128/152 2024-08-19T00:02:35.927 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-2:19.1.0-1382.gde09dd01.el9.x86_64 128/152 2024-08-19T00:02:35.927 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T00:02:35.927 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-19T00:02:35.927 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-19T00:02:35.927 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-19T00:02:35.927 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:02:35.979 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-rook-2:19.1.0-1382.gde09dd01.el9.noarch 129/152 2024-08-19T00:02:35.991 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.0-1382.gde09dd01.el9.noarch 129/152 2024-08-19T00:02:36.093 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-2:19.1.0-1382.gde09dd01.el9.x86_64 130/152 2024-08-19T00:02:36.145 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-fuse-2:19.1.0-1382.gde09dd01.el9.x86_64 131/152 2024-08-19T00:02:36.294 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mon-2:19.1.0-1382.gde09dd01.el9.x86_64 109/152 2024-08-19T00:02:36.317 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mon-2:19.1.0-1382.gde09dd01.el9.x86_64 109/152 2024-08-19T00:02:36.317 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T00:02:36.317 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-19T00:02:36.317 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-19T00:02:36.317 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-19T00:02:36.317 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-08-19T00:02:36.415 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : automake-1.16.2-8.el9.noarch 110/152 2024-08-19T00:02:36.464 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-ply-3.11-14.el9.noarch 111/152 2024-08-19T00:02:36.520 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 112/152 2024-08-19T00:02:36.703 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 113/152 2024-08-19T00:02:36.752 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 114/152 2024-08-19T00:02:36.821 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/152 2024-08-19T00:02:36.919 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 116/152 2024-08-19T00:02:37.057 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 117/152 2024-08-19T00:02:37.094 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 118/152 2024-08-19T00:02:37.108 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libtool-2.4.6-46.el9.x86_64 132/152 2024-08-19T00:02:37.126 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 119/152 2024-08-19T00:02:37.142 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-radosgw-2:19.1.0-1382.gde09dd01.el9.x86_64 133/152 2024-08-19T00:02:37.153 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : fuse-2.9.9-16.el9.x86_64 120/152 2024-08-19T00:02:37.163 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-radosgw-2:19.1.0-1382.gde09dd01.el9.x86_64 133/152 2024-08-19T00:02:37.163 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T00:02:37.163 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-19T00:02:37.163 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-19T00:02:37.163 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-19T00:02:37.163 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:02:37.224 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-immutable-object-cache-2:19.1.0-1382.gde09d 134/152 2024-08-19T00:02:37.247 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.0-1382.gde09d 134/152 2024-08-19T00:02:37.247 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T00:02:37.247 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-19T00:02:37.247 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:02:37.291 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : cephfs-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 135/152 2024-08-19T00:02:37.315 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: cephfs-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 135/152 2024-08-19T00:02:37.315 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T00:02:37.315 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-19T00:02:37.315 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-19T00:02:37.315 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-19T00:02:37.315 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:02:37.626 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: cephadm-2:19.1.0-1382.gde09dd01.el9.noarch 121/152 2024-08-19T00:02:37.633 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : rbd-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 136/152 2024-08-19T00:02:37.652 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : cephadm-2:19.1.0-1382.gde09dd01.el9.noarch 121/152 2024-08-19T00:02:37.657 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: rbd-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 136/152 2024-08-19T00:02:37.657 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T00:02:37.657 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-19T00:02:37.657 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-19T00:02:37.657 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-19T00:02:37.657 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:02:37.683 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-prometheus-alerts-2:19.1.0-1382.gde09dd01.e 122/152 2024-08-19T00:02:37.747 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-grafana-dashboards-2:19.1.0-1382.gde09dd01. 123/152 2024-08-19T00:02:37.775 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-cephadm-2:19.1.0-1382.gde09dd01.el9.noa 124/152 2024-08-19T00:02:38.812 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.0-1382.gde09dd01.el9.noa 124/152 2024-08-19T00:02:38.852 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-dashboard-2:19.1.0-1382.gde09dd01.el9.n 125/152 2024-08-19T00:02:39.812 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.0-1382.gde09dd01.el9.n 125/152 2024-08-19T00:02:39.844 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.0-1382.gde0 126/152 2024-08-19T00:02:39.920 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-19T00:02:39.920 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-2:19.1.0-1382.gde09dd01.el9.x86_64 1/152 2024-08-19T00:02:39.920 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-base-2:19.1.0-1382.gde09dd01.el9.x86_64 2/152 2024-08-19T00:02:39.920 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-common-2:19.1.0-1382.gde09dd01.el9.x86_64 3/152 2024-08-19T00:02:39.920 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-fuse-2:19.1.0-1382.gde09dd01.el9.x86_64 4/152 2024-08-19T00:02:39.920 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-immutable-object-cache-2:19.1.0-1382.gde09d 5/152 2024-08-19T00:02:39.920 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mds-2:19.1.0-1382.gde09dd01.el9.x86_64 6/152 2024-08-19T00:02:39.920 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-2:19.1.0-1382.gde09dd01.el9.x86_64 7/152 2024-08-19T00:02:39.921 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mon-2:19.1.0-1382.gde09dd01.el9.x86_64 8/152 2024-08-19T00:02:39.921 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-osd-2:19.1.0-1382.gde09dd01.el9.x86_64 9/152 2024-08-19T00:02:39.921 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-radosgw-2:19.1.0-1382.gde09dd01.el9.x86_64 10/152 2024-08-19T00:02:39.921 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-selinux-2:19.1.0-1382.gde09dd01.el9.x86_64 11/152 2024-08-19T00:02:39.921 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-test-2:19.1.0-1382.gde09dd01.el9.x86_64 12/152 2024-08-19T00:02:39.921 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : cephfs-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 13/152 2024-08-19T00:02:39.921 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : cephfs-shell-2:19.1.0-1382.gde09dd01.el9.x86_64 14/152 2024-08-19T00:02:39.921 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libcephfs-devel-2:19.1.0-1382.gde09dd01.el9.x86_ 15/152 2024-08-19T00:02:39.921 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libcephfs2-2:19.1.0-1382.gde09dd01.el9.x86_64 16/152 2024-08-19T00:02:39.921 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libcephsqlite-2:19.1.0-1382.gde09dd01.el9.x86_64 17/152 2024-08-19T00:02:39.921 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librados-devel-2:19.1.0-1382.gde09dd01.el9.x86_6 18/152 2024-08-19T00:02:39.921 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libradosstriper1-2:19.1.0-1382.gde09dd01.el9.x86 19/152 2024-08-19T00:02:39.922 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librgw2-2:19.1.0-1382.gde09dd01.el9.x86_64 20/152 2024-08-19T00:02:39.922 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-ceph-argparse-2:19.1.0-1382.gde09dd01.el 21/152 2024-08-19T00:02:39.922 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-ceph-common-2:19.1.0-1382.gde09dd01.el9. 22/152 2024-08-19T00:02:39.922 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cephfs-2:19.1.0-1382.gde09dd01.el9.x86_6 23/152 2024-08-19T00:02:39.922 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-rados-2:19.1.0-1382.gde09dd01.el9.x86_64 24/152 2024-08-19T00:02:39.922 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-rbd-2:19.1.0-1382.gde09dd01.el9.x86_64 25/152 2024-08-19T00:02:39.922 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-rgw-2:19.1.0-1382.gde09dd01.el9.x86_64 26/152 2024-08-19T00:02:39.922 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : rbd-fuse-2:19.1.0-1382.gde09dd01.el9.x86_64 27/152 2024-08-19T00:02:39.922 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : rbd-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 28/152 2024-08-19T00:02:39.922 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : rbd-nbd-2:19.1.0-1382.gde09dd01.el9.x86_64 29/152 2024-08-19T00:02:39.922 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-grafana-dashboards-2:19.1.0-1382.gde09dd01. 30/152 2024-08-19T00:02:39.932 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-cephadm-2:19.1.0-1382.gde09dd01.el9.noa 31/152 2024-08-19T00:02:39.933 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-dashboard-2:19.1.0-1382.gde09dd01.el9.n 32/152 2024-08-19T00:02:39.933 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.0-1382.gde0 33/152 2024-08-19T00:02:39.933 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-modules-core-2:19.1.0-1382.gde09dd01.el 34/152 2024-08-19T00:02:39.933 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-rook-2:19.1.0-1382.gde09dd01.el9.noarch 35/152 2024-08-19T00:02:39.933 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-prometheus-alerts-2:19.1.0-1382.gde09dd01.e 36/152 2024-08-19T00:02:39.933 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-volume-2:19.1.0-1382.gde09dd01.el9.noarch 37/152 2024-08-19T00:02:39.933 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : cephadm-2:19.1.0-1382.gde09dd01.el9.noarch 38/152 2024-08-19T00:02:39.933 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : cephfs-top-2:19.1.0-1382.gde09dd01.el9.noarch 39/152 2024-08-19T00:02:39.933 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/152 2024-08-19T00:02:39.933 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/152 2024-08-19T00:02:39.933 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/152 2024-08-19T00:02:39.934 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/152 2024-08-19T00:02:39.934 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/152 2024-08-19T00:02:39.934 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/152 2024-08-19T00:02:39.934 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/152 2024-08-19T00:02:39.934 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/152 2024-08-19T00:02:39.934 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/152 2024-08-19T00:02:39.934 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/152 2024-08-19T00:02:39.934 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/152 2024-08-19T00:02:39.934 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/152 2024-08-19T00:02:39.934 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/152 2024-08-19T00:02:39.934 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/152 2024-08-19T00:02:39.934 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/152 2024-08-19T00:02:39.935 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/152 2024-08-19T00:02:39.935 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/152 2024-08-19T00:02:39.935 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/152 2024-08-19T00:02:39.935 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/152 2024-08-19T00:02:39.935 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/152 2024-08-19T00:02:39.935 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/152 2024-08-19T00:02:39.935 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/152 2024-08-19T00:02:39.935 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/152 2024-08-19T00:02:39.935 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/152 2024-08-19T00:02:39.935 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/152 2024-08-19T00:02:39.935 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/152 2024-08-19T00:02:39.935 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/152 2024-08-19T00:02:39.936 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/152 2024-08-19T00:02:39.936 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 68/152 2024-08-19T00:02:39.936 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/152 2024-08-19T00:02:39.936 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/152 2024-08-19T00:02:39.936 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/152 2024-08-19T00:02:39.936 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/152 2024-08-19T00:02:39.936 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/152 2024-08-19T00:02:39.936 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/152 2024-08-19T00:02:39.936 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/152 2024-08-19T00:02:39.936 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/152 2024-08-19T00:02:39.936 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-devel-3.9.19-4.el9.x86_64 77/152 2024-08-19T00:02:39.936 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/152 2024-08-19T00:02:39.936 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/152 2024-08-19T00:02:39.937 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/152 2024-08-19T00:02:39.937 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/152 2024-08-19T00:02:39.937 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/152 2024-08-19T00:02:39.937 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/152 2024-08-19T00:02:39.937 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/152 2024-08-19T00:02:39.937 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/152 2024-08-19T00:02:39.937 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/152 2024-08-19T00:02:39.937 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/152 2024-08-19T00:02:39.937 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/152 2024-08-19T00:02:39.937 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/152 2024-08-19T00:02:39.937 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/152 2024-08-19T00:02:39.937 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/152 2024-08-19T00:02:39.937 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/152 2024-08-19T00:02:39.938 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-19T00:02:39.938 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/152 2024-08-19T00:02:39.938 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/152 2024-08-19T00:02:39.938 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/152 2024-08-19T00:02:39.938 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/152 2024-08-19T00:02:39.938 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/152 2024-08-19T00:02:39.938 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/152 2024-08-19T00:02:39.938 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/152 2024-08-19T00:02:39.938 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : xfsprogs-devel-6.4.0-3.el9.x86_64 101/152 2024-08-19T00:02:39.938 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/152 2024-08-19T00:02:39.938 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/152 2024-08-19T00:02:39.938 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/152 2024-08-19T00:02:39.938 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/152 2024-08-19T00:02:39.939 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/152 2024-08-19T00:02:39.939 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/152 2024-08-19T00:02:39.939 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/152 2024-08-19T00:02:39.939 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/152 2024-08-19T00:02:39.939 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/152 2024-08-19T00:02:39.939 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/152 2024-08-19T00:02:39.939 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/152 2024-08-19T00:02:39.939 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/152 2024-08-19T00:02:39.939 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/152 2024-08-19T00:02:39.939 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/152 2024-08-19T00:02:39.939 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/152 2024-08-19T00:02:39.940 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/152 2024-08-19T00:02:39.940 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/152 2024-08-19T00:02:39.940 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/152 2024-08-19T00:02:39.940 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/152 2024-08-19T00:02:39.940 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/152 2024-08-19T00:02:39.940 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-google-auth-1:2.33.0-1.el9.noarch 122/152 2024-08-19T00:02:39.940 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/152 2024-08-19T00:02:39.940 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/152 2024-08-19T00:02:39.940 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/152 2024-08-19T00:02:39.940 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/152 2024-08-19T00:02:39.940 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/152 2024-08-19T00:02:39.940 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/152 2024-08-19T00:02:39.940 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/152 2024-08-19T00:02:39.941 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/152 2024-08-19T00:02:39.941 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/152 2024-08-19T00:02:39.941 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/152 2024-08-19T00:02:39.941 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/152 2024-08-19T00:02:39.941 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/152 2024-08-19T00:02:39.941 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/152 2024-08-19T00:02:39.941 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/152 2024-08-19T00:02:39.941 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/152 2024-08-19T00:02:39.941 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/152 2024-08-19T00:02:39.941 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/152 2024-08-19T00:02:39.941 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/152 2024-08-19T00:02:39.941 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/152 2024-08-19T00:02:39.941 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/152 2024-08-19T00:02:39.941 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/152 2024-08-19T00:02:39.942 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/152 2024-08-19T00:02:39.942 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/152 2024-08-19T00:02:39.942 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/152 2024-08-19T00:02:39.942 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/152 2024-08-19T00:02:39.942 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/152 2024-08-19T00:02:39.942 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librados2-2:19.1.0-1382.gde09dd01.el9.x86_64 149/152 2024-08-19T00:02:39.942 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/152 2024-08-19T00:02:39.942 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librbd1-2:19.1.0-1382.gde09dd01.el9.x86_64 151/152 2024-08-19T00:02:39.945 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.0-1382.gde0 126/152 2024-08-19T00:02:40.107 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-modules-core-2:19.1.0-1382.gde09dd01.el 127/152 2024-08-19T00:02:40.137 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-2:19.1.0-1382.gde09dd01.el9.x86_64 128/152 2024-08-19T00:02:40.162 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-2:19.1.0-1382.gde09dd01.el9.x86_64 128/152 2024-08-19T00:02:40.162 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T00:02:40.162 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-19T00:02:40.162 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-19T00:02:40.162 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-19T00:02:40.162 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-08-19T00:02:40.213 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-rook-2:19.1.0-1382.gde09dd01.el9.noarch 129/152 2024-08-19T00:02:40.224 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.0-1382.gde09dd01.el9.noarch 129/152 2024-08-19T00:02:40.322 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-2:19.1.0-1382.gde09dd01.el9.x86_64 130/152 2024-08-19T00:02:40.370 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-fuse-2:19.1.0-1382.gde09dd01.el9.x86_64 131/152 2024-08-19T00:02:41.286 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libtool-2.4.6-46.el9.x86_64 132/152 2024-08-19T00:02:41.315 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-radosgw-2:19.1.0-1382.gde09dd01.el9.x86_64 133/152 2024-08-19T00:02:41.340 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-radosgw-2:19.1.0-1382.gde09dd01.el9.x86_64 133/152 2024-08-19T00:02:41.340 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T00:02:41.340 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-19T00:02:41.340 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-19T00:02:41.340 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-19T00:02:41.341 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-08-19T00:02:41.383 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-immutable-object-cache-2:19.1.0-1382.gde09d 134/152 2024-08-19T00:02:41.406 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.0-1382.gde09d 134/152 2024-08-19T00:02:41.406 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T00:02:41.406 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-19T00:02:41.407 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-08-19T00:02:41.450 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : cephfs-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 135/152 2024-08-19T00:02:41.474 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: cephfs-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 135/152 2024-08-19T00:02:41.474 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T00:02:41.474 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-19T00:02:41.474 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-19T00:02:41.474 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-19T00:02:41.474 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-08-19T00:02:41.776 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : rbd-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 136/152 2024-08-19T00:02:41.800 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: rbd-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 136/152 2024-08-19T00:02:41.800 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T00:02:41.800 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-19T00:02:41.800 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-19T00:02:41.801 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-19T00:02:41.801 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-08-19T00:02:42.204 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/152 2024-08-19T00:02:42.204 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-19T00:02:42.204 INFO:teuthology.orchestra.run.smithi171.stdout:Upgraded: 2024-08-19T00:02:42.205 INFO:teuthology.orchestra.run.smithi171.stdout: librados2-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:42.205 INFO:teuthology.orchestra.run.smithi171.stdout: librbd1-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:42.205 INFO:teuthology.orchestra.run.smithi171.stdout:Installed: 2024-08-19T00:02:42.205 INFO:teuthology.orchestra.run.smithi171.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-08-19T00:02:42.205 INFO:teuthology.orchestra.run.smithi171.stdout: automake-1.16.2-8.el9.noarch 2024-08-19T00:02:42.205 INFO:teuthology.orchestra.run.smithi171.stdout: bison-3.7.4-5.el9.x86_64 2024-08-19T00:02:42.205 INFO:teuthology.orchestra.run.smithi171.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-08-19T00:02:42.205 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:42.205 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-base-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:42.205 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-common-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:42.205 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-fuse-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:42.205 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-grafana-dashboards-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-19T00:02:42.206 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-immutable-object-cache-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:42.206 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mds-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:42.206 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:42.206 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-cephadm-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-19T00:02:42.206 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-dashboard-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-19T00:02:42.206 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-diskprediction-local-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-19T00:02:42.206 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-modules-core-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-19T00:02:42.206 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-rook-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-19T00:02:42.206 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mon-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:42.206 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-osd-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:42.206 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-prometheus-alerts-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-19T00:02:42.206 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-radosgw-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:42.207 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-selinux-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:42.207 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-test-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:42.207 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-volume-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-19T00:02:42.207 INFO:teuthology.orchestra.run.smithi171.stdout: cephadm-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-19T00:02:42.207 INFO:teuthology.orchestra.run.smithi171.stdout: cephfs-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:42.207 INFO:teuthology.orchestra.run.smithi171.stdout: cephfs-shell-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:42.207 INFO:teuthology.orchestra.run.smithi171.stdout: cephfs-top-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-19T00:02:42.207 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-19T00:02:42.207 INFO:teuthology.orchestra.run.smithi171.stdout: flex-2.6.4-9.el9.x86_64 2024-08-19T00:02:42.207 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-19T00:02:42.207 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-19T00:02:42.207 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-19T00:02:42.208 INFO:teuthology.orchestra.run.smithi171.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-19T00:02:42.208 INFO:teuthology.orchestra.run.smithi171.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-19T00:02:42.208 INFO:teuthology.orchestra.run.smithi171.stdout: grpc-data-1.46.7-10.el9.noarch 2024-08-19T00:02:42.208 INFO:teuthology.orchestra.run.smithi171.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-19T00:02:42.208 INFO:teuthology.orchestra.run.smithi171.stdout: libarrow-9.0.0-11.el9.x86_64 2024-08-19T00:02:42.208 INFO:teuthology.orchestra.run.smithi171.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-08-19T00:02:42.208 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs-devel-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:42.208 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs2-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:42.208 INFO:teuthology.orchestra.run.smithi171.stdout: libcephsqlite-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:42.208 INFO:teuthology.orchestra.run.smithi171.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-08-19T00:02:42.208 INFO:teuthology.orchestra.run.smithi171.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-19T00:02:42.208 INFO:teuthology.orchestra.run.smithi171.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-19T00:02:42.209 INFO:teuthology.orchestra.run.smithi171.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-08-19T00:02:42.209 INFO:teuthology.orchestra.run.smithi171.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-19T00:02:42.209 INFO:teuthology.orchestra.run.smithi171.stdout: librados-devel-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:42.209 INFO:teuthology.orchestra.run.smithi171.stdout: libradosstriper1-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:42.209 INFO:teuthology.orchestra.run.smithi171.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-19T00:02:42.209 INFO:teuthology.orchestra.run.smithi171.stdout: librgw2-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:42.209 INFO:teuthology.orchestra.run.smithi171.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-19T00:02:42.209 INFO:teuthology.orchestra.run.smithi171.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-19T00:02:42.209 INFO:teuthology.orchestra.run.smithi171.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-08-19T00:02:42.209 INFO:teuthology.orchestra.run.smithi171.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-19T00:02:42.209 INFO:teuthology.orchestra.run.smithi171.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-19T00:02:42.209 INFO:teuthology.orchestra.run.smithi171.stdout: lua-5.4.4-4.el9.x86_64 2024-08-19T00:02:42.209 INFO:teuthology.orchestra.run.smithi171.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-08-19T00:02:42.210 INFO:teuthology.orchestra.run.smithi171.stdout: luarocks-3.9.2-5.el9.noarch 2024-08-19T00:02:42.210 INFO:teuthology.orchestra.run.smithi171.stdout: openblas-0.3.21-2.el9.x86_64 2024-08-19T00:02:42.210 INFO:teuthology.orchestra.run.smithi171.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-08-19T00:02:42.210 INFO:teuthology.orchestra.run.smithi171.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-08-19T00:02:42.210 INFO:teuthology.orchestra.run.smithi171.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-08-19T00:02:42.210 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-13.14-1.el9.x86_64 2024-08-19T00:02:42.210 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-08-19T00:02:42.210 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-08-19T00:02:42.210 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-server-13.14-1.el9.x86_64 2024-08-19T00:02:42.210 INFO:teuthology.orchestra.run.smithi171.stdout: protobuf-3.14.0-13.el9.x86_64 2024-08-19T00:02:42.210 INFO:teuthology.orchestra.run.smithi171.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-08-19T00:02:42.210 INFO:teuthology.orchestra.run.smithi171.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-19T00:02:42.210 INFO:teuthology.orchestra.run.smithi171.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-08-19T00:02:42.210 INFO:teuthology.orchestra.run.smithi171.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-19T00:02:42.211 INFO:teuthology.orchestra.run.smithi171.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-19T00:02:42.211 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-19T00:02:42.211 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-argparse-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:42.211 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-common-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:42.211 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cephfs-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:42.211 INFO:teuthology.orchestra.run.smithi171.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-19T00:02:42.211 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-19T00:02:42.211 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-19T00:02:42.211 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-19T00:02:42.211 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-08-19T00:02:42.211 INFO:teuthology.orchestra.run.smithi171.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-08-19T00:02:42.211 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-19T00:02:42.212 INFO:teuthology.orchestra.run.smithi171.stdout: python3-devel-3.9.19-4.el9.x86_64 2024-08-19T00:02:42.212 INFO:teuthology.orchestra.run.smithi171.stdout: python3-google-auth-1:2.33.0-1.el9.noarch 2024-08-19T00:02:42.212 INFO:teuthology.orchestra.run.smithi171.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-08-19T00:02:42.212 INFO:teuthology.orchestra.run.smithi171.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-08-19T00:02:42.212 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-19T00:02:42.212 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-19T00:02:42.212 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-19T00:02:42.212 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-19T00:02:42.212 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-19T00:02:42.212 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-19T00:02:42.212 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-19T00:02:42.212 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-19T00:02:42.213 INFO:teuthology.orchestra.run.smithi171.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-19T00:02:42.213 INFO:teuthology.orchestra.run.smithi171.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-19T00:02:42.213 INFO:teuthology.orchestra.run.smithi171.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-19T00:02:42.213 INFO:teuthology.orchestra.run.smithi171.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-19T00:02:42.213 INFO:teuthology.orchestra.run.smithi171.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-19T00:02:42.213 INFO:teuthology.orchestra.run.smithi171.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-19T00:02:42.213 INFO:teuthology.orchestra.run.smithi171.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-19T00:02:42.213 INFO:teuthology.orchestra.run.smithi171.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-19T00:02:42.213 INFO:teuthology.orchestra.run.smithi171.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-19T00:02:42.213 INFO:teuthology.orchestra.run.smithi171.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-19T00:02:42.213 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-19T00:02:42.213 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ply-3.11-14.el9.noarch 2024-08-19T00:02:42.213 INFO:teuthology.orchestra.run.smithi171.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-19T00:02:42.214 INFO:teuthology.orchestra.run.smithi171.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-19T00:02:42.214 INFO:teuthology.orchestra.run.smithi171.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-08-19T00:02:42.214 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-19T00:02:42.214 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-19T00:02:42.214 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-19T00:02:42.214 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-19T00:02:42.214 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-08-19T00:02:42.214 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-19T00:02:42.214 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rados-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:42.214 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rbd-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:42.214 INFO:teuthology.orchestra.run.smithi171.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-19T00:02:42.214 INFO:teuthology.orchestra.run.smithi171.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-19T00:02:42.214 INFO:teuthology.orchestra.run.smithi171.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-19T00:02:42.215 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rgw-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:42.215 INFO:teuthology.orchestra.run.smithi171.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-19T00:02:42.215 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-19T00:02:42.215 INFO:teuthology.orchestra.run.smithi171.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-19T00:02:42.215 INFO:teuthology.orchestra.run.smithi171.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-19T00:02:42.215 INFO:teuthology.orchestra.run.smithi171.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-19T00:02:42.215 INFO:teuthology.orchestra.run.smithi171.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-19T00:02:42.215 INFO:teuthology.orchestra.run.smithi171.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-19T00:02:42.215 INFO:teuthology.orchestra.run.smithi171.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-08-19T00:02:42.215 INFO:teuthology.orchestra.run.smithi171.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-19T00:02:42.215 INFO:teuthology.orchestra.run.smithi171.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-19T00:02:42.215 INFO:teuthology.orchestra.run.smithi171.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-19T00:02:42.215 INFO:teuthology.orchestra.run.smithi171.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-19T00:02:42.216 INFO:teuthology.orchestra.run.smithi171.stdout: qatlib-24.02.0-1.el9.x86_64 2024-08-19T00:02:42.216 INFO:teuthology.orchestra.run.smithi171.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-08-19T00:02:42.216 INFO:teuthology.orchestra.run.smithi171.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-08-19T00:02:42.216 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-fuse-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:42.216 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:42.216 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-nbd-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:42.216 INFO:teuthology.orchestra.run.smithi171.stdout: re2-1:20211101-3.el9.x86_64 2024-08-19T00:02:42.216 INFO:teuthology.orchestra.run.smithi171.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-19T00:02:42.216 INFO:teuthology.orchestra.run.smithi171.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-19T00:02:42.216 INFO:teuthology.orchestra.run.smithi171.stdout: uuid-1.6.2-55.el9.x86_64 2024-08-19T00:02:42.216 INFO:teuthology.orchestra.run.smithi171.stdout: xfsprogs-devel-6.4.0-3.el9.x86_64 2024-08-19T00:02:42.216 INFO:teuthology.orchestra.run.smithi171.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-19T00:02:42.217 INFO:teuthology.orchestra.run.smithi171.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-19T00:02:42.217 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-19T00:02:42.217 INFO:teuthology.orchestra.run.smithi171.stdout:Complete! 2024-08-19T00:02:42.438 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-test-2:19.1.0-1382.gde09dd01.el9.x86_64 137/152 2024-08-19T00:02:42.479 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : rbd-fuse-2:19.1.0-1382.gde09dd01.el9.x86_64 138/152 2024-08-19T00:02:42.521 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : rbd-nbd-2:19.1.0-1382.gde09dd01.el9.x86_64 139/152 2024-08-19T00:02:42.547 DEBUG:teuthology.parallel:result is None 2024-08-19T00:02:42.552 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : xfsprogs-devel-6.4.0-3.el9.x86_64 140/152 2024-08-19T00:02:42.579 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 141/152 2024-08-19T00:02:42.776 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : cephfs-shell-2:19.1.0-1382.gde09dd01.el9.x86_64 142/152 2024-08-19T00:02:42.817 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 143/152 2024-08-19T00:02:42.847 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libcephfs-devel-2:19.1.0-1382.gde09dd01.el9.x86_ 144/152 2024-08-19T00:02:43.498 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 145/152 2024-08-19T00:02:43.536 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 145/152 2024-08-19T00:02:43.557 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 145/152 2024-08-19T00:02:44.440 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : cephfs-top-2:19.1.0-1382.gde09dd01.el9.noarch 146/152 2024-08-19T00:02:44.533 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 147/152 2024-08-19T00:02:44.574 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/152 2024-08-19T00:02:44.658 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/152 2024-08-19T00:02:44.699 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/152 2024-08-19T00:02:44.700 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-19T00:02:44.779 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-19T00:02:44.780 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-19T00:02:46.304 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-test-2:19.1.0-1382.gde09dd01.el9.x86_64 137/152 2024-08-19T00:02:46.345 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : rbd-fuse-2:19.1.0-1382.gde09dd01.el9.x86_64 138/152 2024-08-19T00:02:46.386 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : rbd-nbd-2:19.1.0-1382.gde09dd01.el9.x86_64 139/152 2024-08-19T00:02:46.418 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : xfsprogs-devel-6.4.0-3.el9.x86_64 140/152 2024-08-19T00:02:46.445 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 141/152 2024-08-19T00:02:46.626 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : cephfs-shell-2:19.1.0-1382.gde09dd01.el9.x86_64 142/152 2024-08-19T00:02:46.975 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 143/152 2024-08-19T00:02:46.975 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libcephfs-devel-2:19.1.0-1382.gde09dd01.el9.x86_ 144/152 2024-08-19T00:02:47.308 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 145/152 2024-08-19T00:02:47.344 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 145/152 2024-08-19T00:02:47.366 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 145/152 2024-08-19T00:02:48.197 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : cephfs-top-2:19.1.0-1382.gde09dd01.el9.noarch 146/152 2024-08-19T00:02:48.290 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 147/152 2024-08-19T00:02:48.331 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/152 2024-08-19T00:02:48.413 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/152 2024-08-19T00:02:48.444 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/152 2024-08-19T00:02:48.445 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-19T00:02:48.528 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-19T00:02:48.528 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-19T00:02:50.745 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-19T00:02:50.745 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-2:19.1.0-1382.gde09dd01.el9.x86_64 1/152 2024-08-19T00:02:50.745 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-base-2:19.1.0-1382.gde09dd01.el9.x86_64 2/152 2024-08-19T00:02:50.745 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-common-2:19.1.0-1382.gde09dd01.el9.x86_64 3/152 2024-08-19T00:02:50.745 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-fuse-2:19.1.0-1382.gde09dd01.el9.x86_64 4/152 2024-08-19T00:02:50.745 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-immutable-object-cache-2:19.1.0-1382.gde09d 5/152 2024-08-19T00:02:50.745 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mds-2:19.1.0-1382.gde09dd01.el9.x86_64 6/152 2024-08-19T00:02:50.745 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-2:19.1.0-1382.gde09dd01.el9.x86_64 7/152 2024-08-19T00:02:50.745 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mon-2:19.1.0-1382.gde09dd01.el9.x86_64 8/152 2024-08-19T00:02:50.746 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-osd-2:19.1.0-1382.gde09dd01.el9.x86_64 9/152 2024-08-19T00:02:50.746 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-radosgw-2:19.1.0-1382.gde09dd01.el9.x86_64 10/152 2024-08-19T00:02:50.746 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-selinux-2:19.1.0-1382.gde09dd01.el9.x86_64 11/152 2024-08-19T00:02:50.746 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-test-2:19.1.0-1382.gde09dd01.el9.x86_64 12/152 2024-08-19T00:02:50.746 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : cephfs-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 13/152 2024-08-19T00:02:50.746 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : cephfs-shell-2:19.1.0-1382.gde09dd01.el9.x86_64 14/152 2024-08-19T00:02:50.746 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libcephfs-devel-2:19.1.0-1382.gde09dd01.el9.x86_ 15/152 2024-08-19T00:02:50.746 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libcephfs2-2:19.1.0-1382.gde09dd01.el9.x86_64 16/152 2024-08-19T00:02:50.746 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libcephsqlite-2:19.1.0-1382.gde09dd01.el9.x86_64 17/152 2024-08-19T00:02:50.746 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librados-devel-2:19.1.0-1382.gde09dd01.el9.x86_6 18/152 2024-08-19T00:02:50.746 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libradosstriper1-2:19.1.0-1382.gde09dd01.el9.x86 19/152 2024-08-19T00:02:50.747 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librgw2-2:19.1.0-1382.gde09dd01.el9.x86_64 20/152 2024-08-19T00:02:50.747 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-ceph-argparse-2:19.1.0-1382.gde09dd01.el 21/152 2024-08-19T00:02:50.747 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-ceph-common-2:19.1.0-1382.gde09dd01.el9. 22/152 2024-08-19T00:02:50.747 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cephfs-2:19.1.0-1382.gde09dd01.el9.x86_6 23/152 2024-08-19T00:02:50.747 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-rados-2:19.1.0-1382.gde09dd01.el9.x86_64 24/152 2024-08-19T00:02:50.747 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-rbd-2:19.1.0-1382.gde09dd01.el9.x86_64 25/152 2024-08-19T00:02:50.747 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-rgw-2:19.1.0-1382.gde09dd01.el9.x86_64 26/152 2024-08-19T00:02:50.747 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : rbd-fuse-2:19.1.0-1382.gde09dd01.el9.x86_64 27/152 2024-08-19T00:02:50.747 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : rbd-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 28/152 2024-08-19T00:02:50.747 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : rbd-nbd-2:19.1.0-1382.gde09dd01.el9.x86_64 29/152 2024-08-19T00:02:50.747 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-grafana-dashboards-2:19.1.0-1382.gde09dd01. 30/152 2024-08-19T00:02:50.758 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-cephadm-2:19.1.0-1382.gde09dd01.el9.noa 31/152 2024-08-19T00:02:50.758 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-dashboard-2:19.1.0-1382.gde09dd01.el9.n 32/152 2024-08-19T00:02:50.758 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.0-1382.gde0 33/152 2024-08-19T00:02:50.758 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-modules-core-2:19.1.0-1382.gde09dd01.el 34/152 2024-08-19T00:02:50.758 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-rook-2:19.1.0-1382.gde09dd01.el9.noarch 35/152 2024-08-19T00:02:50.758 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-prometheus-alerts-2:19.1.0-1382.gde09dd01.e 36/152 2024-08-19T00:02:50.758 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-volume-2:19.1.0-1382.gde09dd01.el9.noarch 37/152 2024-08-19T00:02:50.759 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : cephadm-2:19.1.0-1382.gde09dd01.el9.noarch 38/152 2024-08-19T00:02:50.759 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : cephfs-top-2:19.1.0-1382.gde09dd01.el9.noarch 39/152 2024-08-19T00:02:50.759 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/152 2024-08-19T00:02:50.759 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/152 2024-08-19T00:02:50.759 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/152 2024-08-19T00:02:50.759 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/152 2024-08-19T00:02:50.759 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/152 2024-08-19T00:02:50.759 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/152 2024-08-19T00:02:50.759 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/152 2024-08-19T00:02:50.759 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/152 2024-08-19T00:02:50.759 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/152 2024-08-19T00:02:50.759 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/152 2024-08-19T00:02:50.759 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/152 2024-08-19T00:02:50.760 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/152 2024-08-19T00:02:50.760 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/152 2024-08-19T00:02:50.760 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/152 2024-08-19T00:02:50.760 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/152 2024-08-19T00:02:50.760 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/152 2024-08-19T00:02:50.760 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/152 2024-08-19T00:02:50.760 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/152 2024-08-19T00:02:50.760 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/152 2024-08-19T00:02:50.760 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/152 2024-08-19T00:02:50.761 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/152 2024-08-19T00:02:50.761 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/152 2024-08-19T00:02:50.761 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/152 2024-08-19T00:02:50.761 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/152 2024-08-19T00:02:50.761 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/152 2024-08-19T00:02:50.761 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/152 2024-08-19T00:02:50.761 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/152 2024-08-19T00:02:50.761 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/152 2024-08-19T00:02:50.761 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 68/152 2024-08-19T00:02:50.761 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/152 2024-08-19T00:02:50.761 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/152 2024-08-19T00:02:50.761 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/152 2024-08-19T00:02:50.762 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/152 2024-08-19T00:02:50.762 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/152 2024-08-19T00:02:50.762 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/152 2024-08-19T00:02:50.762 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/152 2024-08-19T00:02:50.762 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/152 2024-08-19T00:02:50.762 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-devel-3.9.19-4.el9.x86_64 77/152 2024-08-19T00:02:50.762 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/152 2024-08-19T00:02:50.762 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/152 2024-08-19T00:02:50.762 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/152 2024-08-19T00:02:50.762 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/152 2024-08-19T00:02:50.762 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/152 2024-08-19T00:02:50.762 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/152 2024-08-19T00:02:50.763 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/152 2024-08-19T00:02:50.763 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/152 2024-08-19T00:02:50.763 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/152 2024-08-19T00:02:50.763 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/152 2024-08-19T00:02:50.763 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/152 2024-08-19T00:02:50.763 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/152 2024-08-19T00:02:50.763 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/152 2024-08-19T00:02:50.763 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/152 2024-08-19T00:02:50.763 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/152 2024-08-19T00:02:50.763 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-19T00:02:50.763 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/152 2024-08-19T00:02:50.763 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/152 2024-08-19T00:02:50.763 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/152 2024-08-19T00:02:50.764 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/152 2024-08-19T00:02:50.764 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/152 2024-08-19T00:02:50.764 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/152 2024-08-19T00:02:50.764 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/152 2024-08-19T00:02:50.764 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : xfsprogs-devel-6.4.0-3.el9.x86_64 101/152 2024-08-19T00:02:50.764 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/152 2024-08-19T00:02:50.764 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/152 2024-08-19T00:02:50.764 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/152 2024-08-19T00:02:50.764 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/152 2024-08-19T00:02:50.764 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/152 2024-08-19T00:02:50.764 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/152 2024-08-19T00:02:50.764 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/152 2024-08-19T00:02:50.764 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/152 2024-08-19T00:02:50.765 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/152 2024-08-19T00:02:50.765 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/152 2024-08-19T00:02:50.765 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/152 2024-08-19T00:02:50.765 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/152 2024-08-19T00:02:50.765 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/152 2024-08-19T00:02:50.765 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/152 2024-08-19T00:02:50.765 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/152 2024-08-19T00:02:50.765 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/152 2024-08-19T00:02:50.765 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/152 2024-08-19T00:02:50.765 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/152 2024-08-19T00:02:50.765 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/152 2024-08-19T00:02:50.765 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/152 2024-08-19T00:02:50.765 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-google-auth-1:2.33.0-1.el9.noarch 122/152 2024-08-19T00:02:50.766 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/152 2024-08-19T00:02:50.766 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/152 2024-08-19T00:02:50.766 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/152 2024-08-19T00:02:50.766 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/152 2024-08-19T00:02:50.766 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/152 2024-08-19T00:02:50.766 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/152 2024-08-19T00:02:50.766 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/152 2024-08-19T00:02:50.766 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/152 2024-08-19T00:02:50.766 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/152 2024-08-19T00:02:50.766 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/152 2024-08-19T00:02:50.766 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/152 2024-08-19T00:02:50.766 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/152 2024-08-19T00:02:50.767 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/152 2024-08-19T00:02:50.767 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/152 2024-08-19T00:02:50.767 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/152 2024-08-19T00:02:50.767 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/152 2024-08-19T00:02:50.767 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/152 2024-08-19T00:02:50.767 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/152 2024-08-19T00:02:50.767 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/152 2024-08-19T00:02:50.767 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/152 2024-08-19T00:02:50.767 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/152 2024-08-19T00:02:50.767 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/152 2024-08-19T00:02:50.767 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/152 2024-08-19T00:02:50.767 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/152 2024-08-19T00:02:50.767 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/152 2024-08-19T00:02:50.767 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/152 2024-08-19T00:02:50.768 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librados2-2:19.1.0-1382.gde09dd01.el9.x86_64 149/152 2024-08-19T00:02:50.768 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/152 2024-08-19T00:02:50.768 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librbd1-2:19.1.0-1382.gde09dd01.el9.x86_64 151/152 2024-08-19T00:02:53.077 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/152 2024-08-19T00:02:53.078 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:02:53.078 INFO:teuthology.orchestra.run.smithi044.stdout:Upgraded: 2024-08-19T00:02:53.078 INFO:teuthology.orchestra.run.smithi044.stdout: librados2-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:53.078 INFO:teuthology.orchestra.run.smithi044.stdout: librbd1-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:53.078 INFO:teuthology.orchestra.run.smithi044.stdout:Installed: 2024-08-19T00:02:53.078 INFO:teuthology.orchestra.run.smithi044.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-08-19T00:02:53.078 INFO:teuthology.orchestra.run.smithi044.stdout: automake-1.16.2-8.el9.noarch 2024-08-19T00:02:53.082 INFO:teuthology.orchestra.run.smithi044.stdout: bison-3.7.4-5.el9.x86_64 2024-08-19T00:02:53.082 INFO:teuthology.orchestra.run.smithi044.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-08-19T00:02:53.082 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:53.082 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-base-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:53.082 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-common-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:53.082 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-fuse-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:53.083 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-grafana-dashboards-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-19T00:02:53.083 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-immutable-object-cache-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:53.083 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mds-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:53.083 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:53.083 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-cephadm-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-19T00:02:53.083 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-dashboard-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-19T00:02:53.083 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-diskprediction-local-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-19T00:02:53.083 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-modules-core-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-19T00:02:53.083 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-rook-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-19T00:02:53.083 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mon-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:53.083 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-osd-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:53.083 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-prometheus-alerts-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-19T00:02:53.084 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-radosgw-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:53.084 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-selinux-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:53.084 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-test-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:53.084 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-volume-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-19T00:02:53.084 INFO:teuthology.orchestra.run.smithi044.stdout: cephadm-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-19T00:02:53.084 INFO:teuthology.orchestra.run.smithi044.stdout: cephfs-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:53.084 INFO:teuthology.orchestra.run.smithi044.stdout: cephfs-shell-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:53.084 INFO:teuthology.orchestra.run.smithi044.stdout: cephfs-top-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-19T00:02:53.084 INFO:teuthology.orchestra.run.smithi044.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-19T00:02:53.084 INFO:teuthology.orchestra.run.smithi044.stdout: flex-2.6.4-9.el9.x86_64 2024-08-19T00:02:53.084 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-19T00:02:53.084 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-19T00:02:53.085 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-19T00:02:53.085 INFO:teuthology.orchestra.run.smithi044.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-19T00:02:53.085 INFO:teuthology.orchestra.run.smithi044.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-19T00:02:53.085 INFO:teuthology.orchestra.run.smithi044.stdout: grpc-data-1.46.7-10.el9.noarch 2024-08-19T00:02:53.085 INFO:teuthology.orchestra.run.smithi044.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-19T00:02:53.085 INFO:teuthology.orchestra.run.smithi044.stdout: libarrow-9.0.0-11.el9.x86_64 2024-08-19T00:02:53.085 INFO:teuthology.orchestra.run.smithi044.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-08-19T00:02:53.085 INFO:teuthology.orchestra.run.smithi044.stdout: libcephfs-devel-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:53.085 INFO:teuthology.orchestra.run.smithi044.stdout: libcephfs2-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:53.085 INFO:teuthology.orchestra.run.smithi044.stdout: libcephsqlite-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:53.085 INFO:teuthology.orchestra.run.smithi044.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-08-19T00:02:53.086 INFO:teuthology.orchestra.run.smithi044.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-19T00:02:53.086 INFO:teuthology.orchestra.run.smithi044.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-19T00:02:53.086 INFO:teuthology.orchestra.run.smithi044.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-08-19T00:02:53.086 INFO:teuthology.orchestra.run.smithi044.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-19T00:02:53.086 INFO:teuthology.orchestra.run.smithi044.stdout: librados-devel-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:53.086 INFO:teuthology.orchestra.run.smithi044.stdout: libradosstriper1-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:53.086 INFO:teuthology.orchestra.run.smithi044.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-19T00:02:53.086 INFO:teuthology.orchestra.run.smithi044.stdout: librgw2-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:53.086 INFO:teuthology.orchestra.run.smithi044.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-19T00:02:53.087 INFO:teuthology.orchestra.run.smithi044.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-19T00:02:53.087 INFO:teuthology.orchestra.run.smithi044.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-08-19T00:02:53.087 INFO:teuthology.orchestra.run.smithi044.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-19T00:02:53.087 INFO:teuthology.orchestra.run.smithi044.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-19T00:02:53.087 INFO:teuthology.orchestra.run.smithi044.stdout: lua-5.4.4-4.el9.x86_64 2024-08-19T00:02:53.087 INFO:teuthology.orchestra.run.smithi044.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-08-19T00:02:53.087 INFO:teuthology.orchestra.run.smithi044.stdout: luarocks-3.9.2-5.el9.noarch 2024-08-19T00:02:53.087 INFO:teuthology.orchestra.run.smithi044.stdout: openblas-0.3.21-2.el9.x86_64 2024-08-19T00:02:53.087 INFO:teuthology.orchestra.run.smithi044.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-08-19T00:02:53.087 INFO:teuthology.orchestra.run.smithi044.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-08-19T00:02:53.088 INFO:teuthology.orchestra.run.smithi044.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-08-19T00:02:53.088 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-13.14-1.el9.x86_64 2024-08-19T00:02:53.088 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-08-19T00:02:53.088 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-08-19T00:02:53.088 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-server-13.14-1.el9.x86_64 2024-08-19T00:02:53.088 INFO:teuthology.orchestra.run.smithi044.stdout: protobuf-3.14.0-13.el9.x86_64 2024-08-19T00:02:53.088 INFO:teuthology.orchestra.run.smithi044.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-08-19T00:02:53.088 INFO:teuthology.orchestra.run.smithi044.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-19T00:02:53.088 INFO:teuthology.orchestra.run.smithi044.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-08-19T00:02:53.088 INFO:teuthology.orchestra.run.smithi044.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-19T00:02:53.089 INFO:teuthology.orchestra.run.smithi044.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-19T00:02:53.089 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-19T00:02:53.089 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-argparse-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:53.089 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-common-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:53.089 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cephfs-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:53.089 INFO:teuthology.orchestra.run.smithi044.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-19T00:02:53.089 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-19T00:02:53.089 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-19T00:02:53.089 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-19T00:02:53.089 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-08-19T00:02:53.089 INFO:teuthology.orchestra.run.smithi044.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-08-19T00:02:53.089 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-19T00:02:53.089 INFO:teuthology.orchestra.run.smithi044.stdout: python3-devel-3.9.19-4.el9.x86_64 2024-08-19T00:02:53.090 INFO:teuthology.orchestra.run.smithi044.stdout: python3-google-auth-1:2.33.0-1.el9.noarch 2024-08-19T00:02:53.090 INFO:teuthology.orchestra.run.smithi044.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-08-19T00:02:53.090 INFO:teuthology.orchestra.run.smithi044.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-08-19T00:02:53.090 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-19T00:02:53.090 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-19T00:02:53.090 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-19T00:02:53.090 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-19T00:02:53.090 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-19T00:02:53.090 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-19T00:02:53.090 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-19T00:02:53.090 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-19T00:02:53.090 INFO:teuthology.orchestra.run.smithi044.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-19T00:02:53.090 INFO:teuthology.orchestra.run.smithi044.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-19T00:02:53.091 INFO:teuthology.orchestra.run.smithi044.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-19T00:02:53.091 INFO:teuthology.orchestra.run.smithi044.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-19T00:02:53.091 INFO:teuthology.orchestra.run.smithi044.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-19T00:02:53.091 INFO:teuthology.orchestra.run.smithi044.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-19T00:02:53.091 INFO:teuthology.orchestra.run.smithi044.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-19T00:02:53.091 INFO:teuthology.orchestra.run.smithi044.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-19T00:02:53.091 INFO:teuthology.orchestra.run.smithi044.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-19T00:02:53.091 INFO:teuthology.orchestra.run.smithi044.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-19T00:02:53.091 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-19T00:02:53.091 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ply-3.11-14.el9.noarch 2024-08-19T00:02:53.091 INFO:teuthology.orchestra.run.smithi044.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-19T00:02:53.091 INFO:teuthology.orchestra.run.smithi044.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-19T00:02:53.092 INFO:teuthology.orchestra.run.smithi044.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-08-19T00:02:53.092 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-19T00:02:53.092 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-19T00:02:53.092 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-19T00:02:53.092 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-19T00:02:53.092 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-08-19T00:02:53.092 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-19T00:02:53.092 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rados-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:53.092 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rbd-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:53.092 INFO:teuthology.orchestra.run.smithi044.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-19T00:02:53.092 INFO:teuthology.orchestra.run.smithi044.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-19T00:02:53.092 INFO:teuthology.orchestra.run.smithi044.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-19T00:02:53.093 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rgw-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:53.093 INFO:teuthology.orchestra.run.smithi044.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-19T00:02:53.093 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-19T00:02:53.093 INFO:teuthology.orchestra.run.smithi044.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-19T00:02:53.093 INFO:teuthology.orchestra.run.smithi044.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-19T00:02:53.093 INFO:teuthology.orchestra.run.smithi044.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-19T00:02:53.093 INFO:teuthology.orchestra.run.smithi044.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-19T00:02:53.093 INFO:teuthology.orchestra.run.smithi044.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-19T00:02:53.093 INFO:teuthology.orchestra.run.smithi044.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-08-19T00:02:53.093 INFO:teuthology.orchestra.run.smithi044.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-19T00:02:53.093 INFO:teuthology.orchestra.run.smithi044.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-19T00:02:53.093 INFO:teuthology.orchestra.run.smithi044.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-19T00:02:53.094 INFO:teuthology.orchestra.run.smithi044.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-19T00:02:53.094 INFO:teuthology.orchestra.run.smithi044.stdout: qatlib-24.02.0-1.el9.x86_64 2024-08-19T00:02:53.094 INFO:teuthology.orchestra.run.smithi044.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-08-19T00:02:53.094 INFO:teuthology.orchestra.run.smithi044.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-08-19T00:02:53.094 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-fuse-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:53.094 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:53.094 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-nbd-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:53.094 INFO:teuthology.orchestra.run.smithi044.stdout: re2-1:20211101-3.el9.x86_64 2024-08-19T00:02:53.094 INFO:teuthology.orchestra.run.smithi044.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-19T00:02:53.094 INFO:teuthology.orchestra.run.smithi044.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-19T00:02:53.095 INFO:teuthology.orchestra.run.smithi044.stdout: uuid-1.6.2-55.el9.x86_64 2024-08-19T00:02:53.095 INFO:teuthology.orchestra.run.smithi044.stdout: xfsprogs-devel-6.4.0-3.el9.x86_64 2024-08-19T00:02:53.095 INFO:teuthology.orchestra.run.smithi044.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-19T00:02:53.095 INFO:teuthology.orchestra.run.smithi044.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-19T00:02:53.095 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:02:53.095 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-08-19T00:02:53.427 DEBUG:teuthology.parallel:result is None 2024-08-19T00:02:54.252 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-19T00:02:54.252 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-2:19.1.0-1382.gde09dd01.el9.x86_64 1/152 2024-08-19T00:02:54.252 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-base-2:19.1.0-1382.gde09dd01.el9.x86_64 2/152 2024-08-19T00:02:54.252 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-common-2:19.1.0-1382.gde09dd01.el9.x86_64 3/152 2024-08-19T00:02:54.253 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-fuse-2:19.1.0-1382.gde09dd01.el9.x86_64 4/152 2024-08-19T00:02:54.253 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-immutable-object-cache-2:19.1.0-1382.gde09d 5/152 2024-08-19T00:02:54.253 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mds-2:19.1.0-1382.gde09dd01.el9.x86_64 6/152 2024-08-19T00:02:54.253 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-2:19.1.0-1382.gde09dd01.el9.x86_64 7/152 2024-08-19T00:02:54.253 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mon-2:19.1.0-1382.gde09dd01.el9.x86_64 8/152 2024-08-19T00:02:54.253 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-osd-2:19.1.0-1382.gde09dd01.el9.x86_64 9/152 2024-08-19T00:02:54.253 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-radosgw-2:19.1.0-1382.gde09dd01.el9.x86_64 10/152 2024-08-19T00:02:54.253 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-selinux-2:19.1.0-1382.gde09dd01.el9.x86_64 11/152 2024-08-19T00:02:54.253 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-test-2:19.1.0-1382.gde09dd01.el9.x86_64 12/152 2024-08-19T00:02:54.253 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : cephfs-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 13/152 2024-08-19T00:02:54.253 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : cephfs-shell-2:19.1.0-1382.gde09dd01.el9.x86_64 14/152 2024-08-19T00:02:54.253 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libcephfs-devel-2:19.1.0-1382.gde09dd01.el9.x86_ 15/152 2024-08-19T00:02:54.253 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libcephfs2-2:19.1.0-1382.gde09dd01.el9.x86_64 16/152 2024-08-19T00:02:54.254 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libcephsqlite-2:19.1.0-1382.gde09dd01.el9.x86_64 17/152 2024-08-19T00:02:54.254 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librados-devel-2:19.1.0-1382.gde09dd01.el9.x86_6 18/152 2024-08-19T00:02:54.254 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libradosstriper1-2:19.1.0-1382.gde09dd01.el9.x86 19/152 2024-08-19T00:02:54.254 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librgw2-2:19.1.0-1382.gde09dd01.el9.x86_64 20/152 2024-08-19T00:02:54.254 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-ceph-argparse-2:19.1.0-1382.gde09dd01.el 21/152 2024-08-19T00:02:54.254 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-ceph-common-2:19.1.0-1382.gde09dd01.el9. 22/152 2024-08-19T00:02:54.254 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cephfs-2:19.1.0-1382.gde09dd01.el9.x86_6 23/152 2024-08-19T00:02:54.254 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rados-2:19.1.0-1382.gde09dd01.el9.x86_64 24/152 2024-08-19T00:02:54.254 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rbd-2:19.1.0-1382.gde09dd01.el9.x86_64 25/152 2024-08-19T00:02:54.254 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rgw-2:19.1.0-1382.gde09dd01.el9.x86_64 26/152 2024-08-19T00:02:54.254 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : rbd-fuse-2:19.1.0-1382.gde09dd01.el9.x86_64 27/152 2024-08-19T00:02:54.254 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : rbd-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 28/152 2024-08-19T00:02:54.254 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : rbd-nbd-2:19.1.0-1382.gde09dd01.el9.x86_64 29/152 2024-08-19T00:02:54.255 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-grafana-dashboards-2:19.1.0-1382.gde09dd01. 30/152 2024-08-19T00:02:54.265 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-cephadm-2:19.1.0-1382.gde09dd01.el9.noa 31/152 2024-08-19T00:02:54.265 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-dashboard-2:19.1.0-1382.gde09dd01.el9.n 32/152 2024-08-19T00:02:54.265 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.0-1382.gde0 33/152 2024-08-19T00:02:54.265 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-modules-core-2:19.1.0-1382.gde09dd01.el 34/152 2024-08-19T00:02:54.265 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-rook-2:19.1.0-1382.gde09dd01.el9.noarch 35/152 2024-08-19T00:02:54.265 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-prometheus-alerts-2:19.1.0-1382.gde09dd01.e 36/152 2024-08-19T00:02:54.266 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-volume-2:19.1.0-1382.gde09dd01.el9.noarch 37/152 2024-08-19T00:02:54.266 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : cephadm-2:19.1.0-1382.gde09dd01.el9.noarch 38/152 2024-08-19T00:02:54.266 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : cephfs-top-2:19.1.0-1382.gde09dd01.el9.noarch 39/152 2024-08-19T00:02:54.266 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/152 2024-08-19T00:02:54.266 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/152 2024-08-19T00:02:54.266 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/152 2024-08-19T00:02:54.266 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/152 2024-08-19T00:02:54.266 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/152 2024-08-19T00:02:54.266 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/152 2024-08-19T00:02:54.266 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/152 2024-08-19T00:02:54.266 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/152 2024-08-19T00:02:54.266 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/152 2024-08-19T00:02:54.266 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/152 2024-08-19T00:02:54.267 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/152 2024-08-19T00:02:54.267 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/152 2024-08-19T00:02:54.267 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/152 2024-08-19T00:02:54.267 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/152 2024-08-19T00:02:54.267 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/152 2024-08-19T00:02:54.267 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/152 2024-08-19T00:02:54.267 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/152 2024-08-19T00:02:54.267 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/152 2024-08-19T00:02:54.267 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/152 2024-08-19T00:02:54.267 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/152 2024-08-19T00:02:54.267 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/152 2024-08-19T00:02:54.268 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/152 2024-08-19T00:02:54.268 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/152 2024-08-19T00:02:54.268 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/152 2024-08-19T00:02:54.268 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/152 2024-08-19T00:02:54.268 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/152 2024-08-19T00:02:54.268 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/152 2024-08-19T00:02:54.268 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/152 2024-08-19T00:02:54.268 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 68/152 2024-08-19T00:02:54.268 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/152 2024-08-19T00:02:54.268 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/152 2024-08-19T00:02:54.268 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/152 2024-08-19T00:02:54.268 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/152 2024-08-19T00:02:54.269 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/152 2024-08-19T00:02:54.269 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/152 2024-08-19T00:02:54.269 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/152 2024-08-19T00:02:54.269 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/152 2024-08-19T00:02:54.269 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-devel-3.9.19-4.el9.x86_64 77/152 2024-08-19T00:02:54.269 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/152 2024-08-19T00:02:54.269 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/152 2024-08-19T00:02:54.269 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/152 2024-08-19T00:02:54.269 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/152 2024-08-19T00:02:54.269 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/152 2024-08-19T00:02:54.269 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/152 2024-08-19T00:02:54.269 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/152 2024-08-19T00:02:54.269 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/152 2024-08-19T00:02:54.270 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/152 2024-08-19T00:02:54.270 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/152 2024-08-19T00:02:54.270 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/152 2024-08-19T00:02:54.270 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/152 2024-08-19T00:02:54.270 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/152 2024-08-19T00:02:54.270 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/152 2024-08-19T00:02:54.270 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/152 2024-08-19T00:02:54.270 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-19T00:02:54.270 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/152 2024-08-19T00:02:54.270 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/152 2024-08-19T00:02:54.270 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/152 2024-08-19T00:02:54.270 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/152 2024-08-19T00:02:54.270 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/152 2024-08-19T00:02:54.271 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/152 2024-08-19T00:02:54.271 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/152 2024-08-19T00:02:54.271 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : xfsprogs-devel-6.4.0-3.el9.x86_64 101/152 2024-08-19T00:02:54.271 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/152 2024-08-19T00:02:54.271 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/152 2024-08-19T00:02:54.271 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/152 2024-08-19T00:02:54.271 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/152 2024-08-19T00:02:54.271 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/152 2024-08-19T00:02:54.271 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/152 2024-08-19T00:02:54.271 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/152 2024-08-19T00:02:54.271 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/152 2024-08-19T00:02:54.271 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/152 2024-08-19T00:02:54.272 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/152 2024-08-19T00:02:54.272 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/152 2024-08-19T00:02:54.272 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/152 2024-08-19T00:02:54.272 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/152 2024-08-19T00:02:54.272 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/152 2024-08-19T00:02:54.272 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/152 2024-08-19T00:02:54.272 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/152 2024-08-19T00:02:54.272 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/152 2024-08-19T00:02:54.272 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/152 2024-08-19T00:02:54.272 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/152 2024-08-19T00:02:54.272 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/152 2024-08-19T00:02:54.272 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-google-auth-1:2.33.0-1.el9.noarch 122/152 2024-08-19T00:02:54.272 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/152 2024-08-19T00:02:54.273 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/152 2024-08-19T00:02:54.273 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/152 2024-08-19T00:02:54.273 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/152 2024-08-19T00:02:54.273 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/152 2024-08-19T00:02:54.273 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/152 2024-08-19T00:02:54.273 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/152 2024-08-19T00:02:54.273 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/152 2024-08-19T00:02:54.273 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/152 2024-08-19T00:02:54.273 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/152 2024-08-19T00:02:54.273 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/152 2024-08-19T00:02:54.273 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/152 2024-08-19T00:02:54.273 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/152 2024-08-19T00:02:54.273 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/152 2024-08-19T00:02:54.273 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/152 2024-08-19T00:02:54.274 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/152 2024-08-19T00:02:54.274 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/152 2024-08-19T00:02:54.274 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/152 2024-08-19T00:02:54.274 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/152 2024-08-19T00:02:54.274 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/152 2024-08-19T00:02:54.274 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/152 2024-08-19T00:02:54.274 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/152 2024-08-19T00:02:54.274 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/152 2024-08-19T00:02:54.274 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/152 2024-08-19T00:02:54.274 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/152 2024-08-19T00:02:54.274 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/152 2024-08-19T00:02:54.274 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librados2-2:19.1.0-1382.gde09dd01.el9.x86_64 149/152 2024-08-19T00:02:54.274 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/152 2024-08-19T00:02:54.275 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librbd1-2:19.1.0-1382.gde09dd01.el9.x86_64 151/152 2024-08-19T00:02:56.366 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/152 2024-08-19T00:02:56.367 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-08-19T00:02:56.367 INFO:teuthology.orchestra.run.smithi116.stdout:Upgraded: 2024-08-19T00:02:56.367 INFO:teuthology.orchestra.run.smithi116.stdout: librados2-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:56.367 INFO:teuthology.orchestra.run.smithi116.stdout: librbd1-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:56.367 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-08-19T00:02:56.367 INFO:teuthology.orchestra.run.smithi116.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-08-19T00:02:56.367 INFO:teuthology.orchestra.run.smithi116.stdout: automake-1.16.2-8.el9.noarch 2024-08-19T00:02:56.367 INFO:teuthology.orchestra.run.smithi116.stdout: bison-3.7.4-5.el9.x86_64 2024-08-19T00:02:56.367 INFO:teuthology.orchestra.run.smithi116.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-08-19T00:02:56.367 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:56.367 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-base-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:56.368 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-common-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:56.368 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-fuse-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:56.368 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-grafana-dashboards-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-19T00:02:56.368 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-immutable-object-cache-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:56.368 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mds-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:56.368 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:56.368 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-cephadm-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-19T00:02:56.368 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-dashboard-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-19T00:02:56.368 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-diskprediction-local-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-19T00:02:56.368 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-modules-core-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-19T00:02:56.368 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-rook-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-19T00:02:56.368 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mon-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:56.369 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-osd-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:56.369 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-prometheus-alerts-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-19T00:02:56.369 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-radosgw-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:56.369 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-selinux-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:56.369 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-test-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:56.369 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-volume-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-19T00:02:56.369 INFO:teuthology.orchestra.run.smithi116.stdout: cephadm-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-19T00:02:56.369 INFO:teuthology.orchestra.run.smithi116.stdout: cephfs-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:56.369 INFO:teuthology.orchestra.run.smithi116.stdout: cephfs-shell-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:56.369 INFO:teuthology.orchestra.run.smithi116.stdout: cephfs-top-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-19T00:02:56.369 INFO:teuthology.orchestra.run.smithi116.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-19T00:02:56.369 INFO:teuthology.orchestra.run.smithi116.stdout: flex-2.6.4-9.el9.x86_64 2024-08-19T00:02:56.369 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-19T00:02:56.370 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-19T00:02:56.370 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-19T00:02:56.370 INFO:teuthology.orchestra.run.smithi116.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-19T00:02:56.370 INFO:teuthology.orchestra.run.smithi116.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-19T00:02:56.370 INFO:teuthology.orchestra.run.smithi116.stdout: grpc-data-1.46.7-10.el9.noarch 2024-08-19T00:02:56.370 INFO:teuthology.orchestra.run.smithi116.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-19T00:02:56.370 INFO:teuthology.orchestra.run.smithi116.stdout: libarrow-9.0.0-11.el9.x86_64 2024-08-19T00:02:56.370 INFO:teuthology.orchestra.run.smithi116.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-08-19T00:02:56.370 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs-devel-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:56.370 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs2-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:56.370 INFO:teuthology.orchestra.run.smithi116.stdout: libcephsqlite-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:56.370 INFO:teuthology.orchestra.run.smithi116.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-08-19T00:02:56.371 INFO:teuthology.orchestra.run.smithi116.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-19T00:02:56.371 INFO:teuthology.orchestra.run.smithi116.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-19T00:02:56.371 INFO:teuthology.orchestra.run.smithi116.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-08-19T00:02:56.371 INFO:teuthology.orchestra.run.smithi116.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-19T00:02:56.371 INFO:teuthology.orchestra.run.smithi116.stdout: librados-devel-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:56.371 INFO:teuthology.orchestra.run.smithi116.stdout: libradosstriper1-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:56.371 INFO:teuthology.orchestra.run.smithi116.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-19T00:02:56.371 INFO:teuthology.orchestra.run.smithi116.stdout: librgw2-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:56.371 INFO:teuthology.orchestra.run.smithi116.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-19T00:02:56.371 INFO:teuthology.orchestra.run.smithi116.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-19T00:02:56.371 INFO:teuthology.orchestra.run.smithi116.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-08-19T00:02:56.371 INFO:teuthology.orchestra.run.smithi116.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-19T00:02:56.371 INFO:teuthology.orchestra.run.smithi116.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-19T00:02:56.372 INFO:teuthology.orchestra.run.smithi116.stdout: lua-5.4.4-4.el9.x86_64 2024-08-19T00:02:56.372 INFO:teuthology.orchestra.run.smithi116.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-08-19T00:02:56.372 INFO:teuthology.orchestra.run.smithi116.stdout: luarocks-3.9.2-5.el9.noarch 2024-08-19T00:02:56.372 INFO:teuthology.orchestra.run.smithi116.stdout: openblas-0.3.21-2.el9.x86_64 2024-08-19T00:02:56.372 INFO:teuthology.orchestra.run.smithi116.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-08-19T00:02:56.372 INFO:teuthology.orchestra.run.smithi116.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-08-19T00:02:56.372 INFO:teuthology.orchestra.run.smithi116.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-08-19T00:02:56.372 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-13.14-1.el9.x86_64 2024-08-19T00:02:56.372 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-08-19T00:02:56.372 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-08-19T00:02:56.372 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-server-13.14-1.el9.x86_64 2024-08-19T00:02:56.372 INFO:teuthology.orchestra.run.smithi116.stdout: protobuf-3.14.0-13.el9.x86_64 2024-08-19T00:02:56.372 INFO:teuthology.orchestra.run.smithi116.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-08-19T00:02:56.373 INFO:teuthology.orchestra.run.smithi116.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-19T00:02:56.373 INFO:teuthology.orchestra.run.smithi116.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-08-19T00:02:56.373 INFO:teuthology.orchestra.run.smithi116.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-19T00:02:56.373 INFO:teuthology.orchestra.run.smithi116.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-19T00:02:56.373 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-19T00:02:56.373 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-argparse-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:56.373 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-common-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:56.373 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cephfs-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:56.373 INFO:teuthology.orchestra.run.smithi116.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-19T00:02:56.373 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-19T00:02:56.373 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-19T00:02:56.373 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-19T00:02:56.373 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-08-19T00:02:56.374 INFO:teuthology.orchestra.run.smithi116.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-08-19T00:02:56.374 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-19T00:02:56.374 INFO:teuthology.orchestra.run.smithi116.stdout: python3-devel-3.9.19-4.el9.x86_64 2024-08-19T00:02:56.374 INFO:teuthology.orchestra.run.smithi116.stdout: python3-google-auth-1:2.33.0-1.el9.noarch 2024-08-19T00:02:56.374 INFO:teuthology.orchestra.run.smithi116.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-08-19T00:02:56.374 INFO:teuthology.orchestra.run.smithi116.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-08-19T00:02:56.374 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-19T00:02:56.374 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-19T00:02:56.374 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-19T00:02:56.374 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-19T00:02:56.374 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-19T00:02:56.374 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-19T00:02:56.374 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-19T00:02:56.375 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-19T00:02:56.375 INFO:teuthology.orchestra.run.smithi116.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-19T00:02:56.375 INFO:teuthology.orchestra.run.smithi116.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-19T00:02:56.375 INFO:teuthology.orchestra.run.smithi116.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-19T00:02:56.375 INFO:teuthology.orchestra.run.smithi116.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-19T00:02:56.375 INFO:teuthology.orchestra.run.smithi116.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-19T00:02:56.375 INFO:teuthology.orchestra.run.smithi116.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-19T00:02:56.375 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-19T00:02:56.375 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-19T00:02:56.375 INFO:teuthology.orchestra.run.smithi116.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-19T00:02:56.375 INFO:teuthology.orchestra.run.smithi116.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-19T00:02:56.375 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-19T00:02:56.375 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ply-3.11-14.el9.noarch 2024-08-19T00:02:56.376 INFO:teuthology.orchestra.run.smithi116.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-19T00:02:56.376 INFO:teuthology.orchestra.run.smithi116.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-19T00:02:56.376 INFO:teuthology.orchestra.run.smithi116.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-08-19T00:02:56.376 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-19T00:02:56.376 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-19T00:02:56.376 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-19T00:02:56.376 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-19T00:02:56.376 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-08-19T00:02:56.376 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-19T00:02:56.376 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rados-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:56.376 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rbd-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:56.376 INFO:teuthology.orchestra.run.smithi116.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-19T00:02:56.376 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-19T00:02:56.377 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-19T00:02:56.377 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rgw-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:56.377 INFO:teuthology.orchestra.run.smithi116.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-19T00:02:56.377 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-19T00:02:56.377 INFO:teuthology.orchestra.run.smithi116.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-19T00:02:56.377 INFO:teuthology.orchestra.run.smithi116.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-19T00:02:56.377 INFO:teuthology.orchestra.run.smithi116.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-19T00:02:56.377 INFO:teuthology.orchestra.run.smithi116.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-19T00:02:56.377 INFO:teuthology.orchestra.run.smithi116.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-19T00:02:56.377 INFO:teuthology.orchestra.run.smithi116.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-08-19T00:02:56.377 INFO:teuthology.orchestra.run.smithi116.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-19T00:02:56.377 INFO:teuthology.orchestra.run.smithi116.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-19T00:02:56.377 INFO:teuthology.orchestra.run.smithi116.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-19T00:02:56.377 INFO:teuthology.orchestra.run.smithi116.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-19T00:02:56.378 INFO:teuthology.orchestra.run.smithi116.stdout: qatlib-24.02.0-1.el9.x86_64 2024-08-19T00:02:56.378 INFO:teuthology.orchestra.run.smithi116.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-08-19T00:02:56.378 INFO:teuthology.orchestra.run.smithi116.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-08-19T00:02:56.378 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-fuse-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:56.378 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:56.378 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-nbd-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-19T00:02:56.378 INFO:teuthology.orchestra.run.smithi116.stdout: re2-1:20211101-3.el9.x86_64 2024-08-19T00:02:56.378 INFO:teuthology.orchestra.run.smithi116.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-19T00:02:56.378 INFO:teuthology.orchestra.run.smithi116.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-19T00:02:56.378 INFO:teuthology.orchestra.run.smithi116.stdout: uuid-1.6.2-55.el9.x86_64 2024-08-19T00:02:56.378 INFO:teuthology.orchestra.run.smithi116.stdout: xfsprogs-devel-6.4.0-3.el9.x86_64 2024-08-19T00:02:56.378 INFO:teuthology.orchestra.run.smithi116.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-19T00:02:56.379 INFO:teuthology.orchestra.run.smithi116.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-19T00:02:56.379 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-08-19T00:02:56.379 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-08-19T00:02:56.753 DEBUG:teuthology.parallel:result is None 2024-08-19T00:02:56.754 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-19T00:02:56.905 DEBUG:teuthology.orchestra.run.smithi044:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-19T00:02:56.929 INFO:teuthology.orchestra.run.smithi044.stdout:19.1.0-1382.gde09dd01.el9 2024-08-19T00:02:56.930 INFO:teuthology.packaging:The installed version of ceph is 19.1.0-1382.gde09dd01.el9 2024-08-19T00:02:56.930 INFO:teuthology.task.install:The correct ceph version 19.1.0-1382.gde09dd01 is installed. 2024-08-19T00:02:56.932 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-19T00:02:57.073 DEBUG:teuthology.orchestra.run.smithi116:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-19T00:02:57.103 INFO:teuthology.orchestra.run.smithi116.stdout:19.1.0-1382.gde09dd01.el9 2024-08-19T00:02:57.103 INFO:teuthology.packaging:The installed version of ceph is 19.1.0-1382.gde09dd01.el9 2024-08-19T00:02:57.104 INFO:teuthology.task.install:The correct ceph version 19.1.0-1382.gde09dd01 is installed. 2024-08-19T00:02:57.105 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-19T00:02:57.249 DEBUG:teuthology.orchestra.run.smithi171:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-19T00:02:57.276 INFO:teuthology.orchestra.run.smithi171.stdout:19.1.0-1382.gde09dd01.el9 2024-08-19T00:02:57.276 INFO:teuthology.packaging:The installed version of ceph is 19.1.0-1382.gde09dd01.el9 2024-08-19T00:02:57.276 INFO:teuthology.task.install:The correct ceph version 19.1.0-1382.gde09dd01 is installed. 2024-08-19T00:02:57.278 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-08-19T00:02:57.278 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-08-19T00:02:57.278 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-19T00:02:57.307 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-08-19T00:02:57.307 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-19T00:02:57.336 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-08-19T00:02:57.336 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-19T00:02:57.369 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-08-19T00:02:57.369 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-08-19T00:02:57.369 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/usr/bin/daemon-helper 2024-08-19T00:02:57.396 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-19T00:02:57.461 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-08-19T00:02:57.461 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/usr/bin/daemon-helper 2024-08-19T00:02:57.486 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-19T00:02:57.551 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-08-19T00:02:57.551 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/usr/bin/daemon-helper 2024-08-19T00:02:57.581 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-19T00:02:57.650 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-08-19T00:02:57.650 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-08-19T00:02:57.650 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-19T00:02:57.676 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-19T00:02:57.741 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-08-19T00:02:57.741 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-19T00:02:57.765 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-19T00:02:57.832 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-08-19T00:02:57.832 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-19T00:02:57.857 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-19T00:02:57.923 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-08-19T00:02:57.923 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-08-19T00:02:57.923 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/usr/bin/stdin-killer 2024-08-19T00:02:57.949 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-19T00:02:58.014 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-08-19T00:02:58.015 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/usr/bin/stdin-killer 2024-08-19T00:02:58.040 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-19T00:02:58.107 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-08-19T00:02:58.107 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/usr/bin/stdin-killer 2024-08-19T00:02:58.132 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-19T00:02:58.197 INFO:teuthology.run_tasks:Running task cephadm... 2024-08-19T00:02:58.291 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_export_ephemeral_random_max': 0.1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': 'de09dd018de4baddfa6ca4d43bc8fb784cf75833', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-08-19T00:02:58.291 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-19T00:02:58.292 INFO:tasks.cephadm:Cluster fsid is 647ded64-5dbe-11ef-bccf-c7b262605968 2024-08-19T00:02:58.292 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-08-19T00:02:58.292 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.44', 'mon.b': '172.21.15.116', 'mon.c': '172.21.15.171'} 2024-08-19T00:02:58.292 INFO:tasks.cephadm:First mon is mon.a on smithi044 2024-08-19T00:02:58.292 INFO:tasks.cephadm:First mgr is x 2024-08-19T00:02:58.292 INFO:tasks.cephadm:Normalizing hostnames... 2024-08-19T00:02:58.292 DEBUG:teuthology.orchestra.run.smithi044:> sudo hostname $(hostname -s) 2024-08-19T00:02:58.319 DEBUG:teuthology.orchestra.run.smithi116:> sudo hostname $(hostname -s) 2024-08-19T00:02:58.344 DEBUG:teuthology.orchestra.run.smithi171:> sudo hostname $(hostname -s) 2024-08-19T00:02:58.368 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-08-19T00:02:58.369 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-19T00:02:58.515 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'de09dd018de4baddfa6ca4d43bc8fb784cf75833', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/55869/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.0-1382-gde09dd01', 'node_name': '172.21.5.40+adami10', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.0-1382.gde09dd01'}, 'url': 'https://1.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-08-18 16:22:46.893995', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-08-19T00:02:58.654 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref squid, sha1 de09dd018de4baddfa6ca4d43bc8fb784cf75833 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-19T00:02:58.655 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/centos/9/x86_64/flavors/default/cephadm 2024-08-19T00:02:58.655 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/centos/9/x86_64/flavors/default/cephadm 2024-08-19T00:02:58.656 DEBUG:teuthology.orchestra.run.smithi044:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-08-19T00:02:59.035 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r--. 1 ubuntu ubuntu 784608 Aug 19 00:02 /home/ubuntu/cephtest/cephadm 2024-08-19T00:02:59.035 DEBUG:teuthology.orchestra.run.smithi116:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-08-19T00:02:59.434 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-r--r--. 1 ubuntu ubuntu 784608 Aug 19 00:02 /home/ubuntu/cephtest/cephadm 2024-08-19T00:02:59.434 DEBUG:teuthology.orchestra.run.smithi171:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-08-19T00:02:59.913 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r--. 1 ubuntu ubuntu 784608 Aug 19 00:02 /home/ubuntu/cephtest/cephadm 2024-08-19T00:02:59.913 DEBUG:teuthology.orchestra.run.smithi044:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-08-19T00:02:59.933 DEBUG:teuthology.orchestra.run.smithi116:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-08-19T00:02:59.949 DEBUG:teuthology.orchestra.run.smithi171:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-08-19T00:02:59.982 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 on all hosts... 2024-08-19T00:02:59.982 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 pull 2024-08-19T00:02:59.985 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 pull 2024-08-19T00:02:59.992 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 pull 2024-08-19T00:03:01.564 INFO:teuthology.orchestra.run.smithi044.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833... 2024-08-19T00:03:01.639 INFO:teuthology.orchestra.run.smithi116.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833... 2024-08-19T00:03:01.729 INFO:teuthology.orchestra.run.smithi171.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833... 2024-08-19T00:03:31.295 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-08-19T00:03:31.295 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_version": "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)", 2024-08-19T00:03:31.295 INFO:teuthology.orchestra.run.smithi116.stdout: "image_id": "ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba", 2024-08-19T00:03:31.295 INFO:teuthology.orchestra.run.smithi116.stdout: "repo_digests": [ 2024-08-19T00:03:31.295 INFO:teuthology.orchestra.run.smithi116.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9" 2024-08-19T00:03:31.296 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-08-19T00:03:31.296 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-08-19T00:03:31.801 INFO:teuthology.orchestra.run.smithi171.stdout:{ 2024-08-19T00:03:31.801 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_version": "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)", 2024-08-19T00:03:31.801 INFO:teuthology.orchestra.run.smithi171.stdout: "image_id": "ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba", 2024-08-19T00:03:31.801 INFO:teuthology.orchestra.run.smithi171.stdout: "repo_digests": [ 2024-08-19T00:03:31.801 INFO:teuthology.orchestra.run.smithi171.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9" 2024-08-19T00:03:31.801 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-08-19T00:03:31.801 INFO:teuthology.orchestra.run.smithi171.stdout:} 2024-08-19T00:03:34.967 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-08-19T00:03:34.967 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_version": "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)", 2024-08-19T00:03:34.967 INFO:teuthology.orchestra.run.smithi044.stdout: "image_id": "ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba", 2024-08-19T00:03:34.968 INFO:teuthology.orchestra.run.smithi044.stdout: "repo_digests": [ 2024-08-19T00:03:34.968 INFO:teuthology.orchestra.run.smithi044.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9" 2024-08-19T00:03:34.968 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-08-19T00:03:34.968 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-08-19T00:03:34.995 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /etc/ceph 2024-08-19T00:03:35.032 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /etc/ceph 2024-08-19T00:03:35.065 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /etc/ceph 2024-08-19T00:03:35.097 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 777 /etc/ceph 2024-08-19T00:03:35.122 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 777 /etc/ceph 2024-08-19T00:03:35.151 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 777 /etc/ceph 2024-08-19T00:03:35.179 INFO:tasks.cephadm:Writing seed config... 2024-08-19T00:03:35.180 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-08-19T00:03:35.180 INFO:tasks.cephadm: override: [client] debug client = 20 2024-08-19T00:03:35.180 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-08-19T00:03:35.180 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-08-19T00:03:35.180 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-08-19T00:03:35.180 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-08-19T00:03:35.180 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-08-19T00:03:35.180 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-08-19T00:03:35.180 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-08-19T00:03:35.181 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-08-19T00:03:35.181 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-08-19T00:03:35.181 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-08-19T00:03:35.181 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-08-19T00:03:35.181 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-08-19T00:03:35.181 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-08-19T00:03:35.181 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-08-19T00:03:35.181 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-08-19T00:03:35.181 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-08-19T00:03:35.181 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-08-19T00:03:35.181 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-08-19T00:03:35.181 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-08-19T00:03:35.181 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-08-19T00:03:35.182 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-08-19T00:03:35.182 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-08-19T00:03:35.182 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-08-19T00:03:35.182 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-08-19T00:03:35.182 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-08-19T00:03:35.182 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-08-19T00:03:35.182 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-08-19T00:03:35.182 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-08-19T00:03:35.182 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-08-19T00:03:35.182 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-08-19T00:03:35.182 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-08-19T00:03:35.182 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-08-19T00:03:35.182 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-08-19T00:03:35.183 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-08-19T00:03:35.183 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-08-19T00:03:35.183 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-08-19T00:03:35.183 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-08-19T00:03:35.183 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-08-19T00:03:35.183 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-08-19T00:03:35.183 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-08-19T00:03:35.183 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-08-19T00:03:35.183 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-08-19T00:03:35.183 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-08-19T00:03:35.183 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-08-19T00:03:35.183 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-08-19T00:03:35.184 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-08-19T00:03:35.184 DEBUG:teuthology.orchestra.run.smithi044:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-08-19T00:03:35.199 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 647ded64-5dbe-11ef-bccf-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_export_ephemeral_random_max = 0.1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-08-19T00:03:35.200 DEBUG:teuthology.orchestra.run.smithi044:mon.a> sudo journalctl -f -n 0 -u ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mon.a.service 2024-08-19T00:03:35.243 DEBUG:teuthology.orchestra.run.smithi044:mgr.x> sudo journalctl -f -n 0 -u ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mgr.x.service 2024-08-19T00:03:35.284 INFO:tasks.cephadm:Bootstrapping... 2024-08-19T00:03:35.285 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 -v bootstrap --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.44 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-08-19T00:03:35.491 INFO:teuthology.orchestra.run.smithi044.stdout:-------------------------------------------------------------------------------- 2024-08-19T00:03:35.491 INFO:teuthology.orchestra.run.smithi044.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833', '-v', 'bootstrap', '--fsid', '647ded64-5dbe-11ef-bccf-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.44', '--skip-admin-label'] 2024-08-19T00:03:35.491 INFO:teuthology.orchestra.run.smithi044.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-08-19T00:03:35.492 INFO:teuthology.orchestra.run.smithi044.stdout:Verifying podman|docker is present... 2024-08-19T00:03:35.516 INFO:teuthology.orchestra.run.smithi044.stdout:/bin/podman: stdout 5.1.2 2024-08-19T00:03:35.517 INFO:teuthology.orchestra.run.smithi044.stdout:Verifying lvm2 is present... 2024-08-19T00:03:35.517 INFO:teuthology.orchestra.run.smithi044.stdout:Verifying time synchronization is in place... 2024-08-19T00:03:35.525 INFO:teuthology.orchestra.run.smithi044.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-08-19T00:03:35.525 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-08-19T00:03:35.531 INFO:teuthology.orchestra.run.smithi044.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-08-19T00:03:35.531 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stdout inactive 2024-08-19T00:03:35.537 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stdout enabled 2024-08-19T00:03:35.543 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stdout active 2024-08-19T00:03:35.543 INFO:teuthology.orchestra.run.smithi044.stdout:Unit chronyd.service is enabled and running 2024-08-19T00:03:35.543 INFO:teuthology.orchestra.run.smithi044.stdout:Repeating the final host check... 2024-08-19T00:03:35.577 INFO:teuthology.orchestra.run.smithi044.stdout:/bin/podman: stdout 5.1.2 2024-08-19T00:03:35.577 INFO:teuthology.orchestra.run.smithi044.stdout:podman (/bin/podman) version 5.1.2 is present 2024-08-19T00:03:35.577 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl is present 2024-08-19T00:03:35.577 INFO:teuthology.orchestra.run.smithi044.stdout:lvcreate is present 2024-08-19T00:03:35.583 INFO:teuthology.orchestra.run.smithi044.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-08-19T00:03:35.583 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-08-19T00:03:35.589 INFO:teuthology.orchestra.run.smithi044.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-08-19T00:03:35.589 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stdout inactive 2024-08-19T00:03:35.596 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stdout enabled 2024-08-19T00:03:35.603 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stdout active 2024-08-19T00:03:35.603 INFO:teuthology.orchestra.run.smithi044.stdout:Unit chronyd.service is enabled and running 2024-08-19T00:03:35.603 INFO:teuthology.orchestra.run.smithi044.stdout:Host looks OK 2024-08-19T00:03:35.603 INFO:teuthology.orchestra.run.smithi044.stdout:Cluster fsid: 647ded64-5dbe-11ef-bccf-c7b262605968 2024-08-19T00:03:35.603 INFO:teuthology.orchestra.run.smithi044.stdout:Acquiring lock 139846410903712 on /run/cephadm/647ded64-5dbe-11ef-bccf-c7b262605968.lock 2024-08-19T00:03:35.603 INFO:teuthology.orchestra.run.smithi044.stdout:Lock 139846410903712 acquired on /run/cephadm/647ded64-5dbe-11ef-bccf-c7b262605968.lock 2024-08-19T00:03:35.603 INFO:teuthology.orchestra.run.smithi044.stdout:Verifying IP 172.21.15.44 port 3300 ... 2024-08-19T00:03:35.604 INFO:teuthology.orchestra.run.smithi044.stdout:Verifying IP 172.21.15.44 port 6789 ... 2024-08-19T00:03:35.604 INFO:teuthology.orchestra.run.smithi044.stdout:Base mon IP(s) is [172.21.15.44:3300, 172.21.15.44:6789], mon addrv is [v2:172.21.15.44:3300,v1:172.21.15.44:6789] 2024-08-19T00:03:35.607 INFO:teuthology.orchestra.run.smithi044.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.44 metric 100 2024-08-19T00:03:35.607 INFO:teuthology.orchestra.run.smithi044.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.44 metric 100 2024-08-19T00:03:35.610 INFO:teuthology.orchestra.run.smithi044.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-08-19T00:03:35.610 INFO:teuthology.orchestra.run.smithi044.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 1024 pref medium 2024-08-19T00:03:35.610 INFO:teuthology.orchestra.run.smithi044.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 100 pref medium 2024-08-19T00:03:35.612 INFO:teuthology.orchestra.run.smithi044.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-08-19T00:03:35.612 INFO:teuthology.orchestra.run.smithi044.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-08-19T00:03:35.612 INFO:teuthology.orchestra.run.smithi044.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-08-19T00:03:35.612 INFO:teuthology.orchestra.run.smithi044.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-08-19T00:03:35.612 INFO:teuthology.orchestra.run.smithi044.stdout:/sbin/ip: stdout inet6 fe80::9c56:c472:40c2:758e/64 scope link noprefixroute 2024-08-19T00:03:35.612 INFO:teuthology.orchestra.run.smithi044.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-08-19T00:03:35.613 INFO:teuthology.orchestra.run.smithi044.stdout:Mon IP `172.21.15.44` is in CIDR network `172.21.0.0/20` 2024-08-19T00:03:35.613 INFO:teuthology.orchestra.run.smithi044.stdout:Mon IP `172.21.15.44` is in CIDR network `172.21.0.0/20` 2024-08-19T00:03:35.613 INFO:teuthology.orchestra.run.smithi044.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-08-19T00:03:35.613 INFO:teuthology.orchestra.run.smithi044.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-08-19T00:03:35.614 INFO:teuthology.orchestra.run.smithi044.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833... 2024-08-19T00:03:36.053 INFO:teuthology.orchestra.run.smithi044.stdout:/bin/podman: stdout ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba 2024-08-19T00:03:36.053 INFO:teuthology.orchestra.run.smithi044.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833... 2024-08-19T00:03:36.053 INFO:teuthology.orchestra.run.smithi044.stdout:/bin/podman: stderr Getting image source signatures 2024-08-19T00:03:36.054 INFO:teuthology.orchestra.run.smithi044.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-08-19T00:03:36.054 INFO:teuthology.orchestra.run.smithi044.stdout:/bin/podman: stderr Copying blob sha256:7556061847b3cc957dc118ff2516cc1cd809c4272dcb16074c5c7fe28afc4774 2024-08-19T00:03:36.054 INFO:teuthology.orchestra.run.smithi044.stdout:/bin/podman: stderr Copying config sha256:ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba 2024-08-19T00:03:36.054 INFO:teuthology.orchestra.run.smithi044.stdout:/bin/podman: stderr Writing manifest to image destination 2024-08-19T00:03:36.916 INFO:teuthology.orchestra.run.smithi044.stdout:ceph: stdout ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc) 2024-08-19T00:03:36.916 INFO:teuthology.orchestra.run.smithi044.stdout:Ceph version: ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc) 2024-08-19T00:03:36.916 INFO:teuthology.orchestra.run.smithi044.stdout:Extracting ceph user uid/gid from container image... 2024-08-19T00:03:37.713 INFO:teuthology.orchestra.run.smithi044.stdout:stat: stdout 167 167 2024-08-19T00:03:37.713 INFO:teuthology.orchestra.run.smithi044.stdout:Creating initial keys... 2024-08-19T00:03:38.621 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-authtool: stdout AQDai8JmNj6wAxAAWOmxT9G6YldxnrCvJzUzSg== 2024-08-19T00:03:39.549 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-authtool: stdout AQDai8JmZgGwNxAACg6dhHMkX3wir4jvlQ4XBQ== 2024-08-19T00:03:40.504 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-authtool: stdout AQDbi8JmUaYDMxAA5tgL22ncuKpuJwPV7VPaQA== 2024-08-19T00:03:40.504 INFO:teuthology.orchestra.run.smithi044.stdout:Creating initial monmap... 2024-08-19T00:03:41.353 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-08-19T00:03:41.353 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-08-19T00:03:41.353 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 647ded64-5dbe-11ef-bccf-c7b262605968 2024-08-19T00:03:41.353 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-08-19T00:03:41.353 INFO:teuthology.orchestra.run.smithi044.stdout:monmaptool for a [v2:172.21.15.44:3300,v1:172.21.15.44:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-08-19T00:03:41.353 INFO:teuthology.orchestra.run.smithi044.stdout:setting min_mon_release = quincy 2024-08-19T00:03:41.353 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/monmaptool: set fsid to 647ded64-5dbe-11ef-bccf-c7b262605968 2024-08-19T00:03:41.353 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-08-19T00:03:41.353 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:03:41.353 INFO:teuthology.orchestra.run.smithi044.stdout:Creating mon... 2024-08-19T00:03:42.215 INFO:teuthology.orchestra.run.smithi044.stdout:create mon.a on 2024-08-19T00:03:42.435 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-08-19T00:03:42.584 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-08-19T00:03:42.752 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-647ded64-5dbe-11ef-bccf-c7b262605968.target → /etc/systemd/system/ceph-647ded64-5dbe-11ef-bccf-c7b262605968.target. 2024-08-19T00:03:42.752 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-647ded64-5dbe-11ef-bccf-c7b262605968.target → /etc/systemd/system/ceph-647ded64-5dbe-11ef-bccf-c7b262605968.target. 2024-08-19T00:03:42.989 INFO:teuthology.orchestra.run.smithi044.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mon.a 2024-08-19T00:03:42.989 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stderr Failed to reset failed state of unit ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mon.a.service: Unit ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mon.a.service not loaded. 2024-08-19T00:03:43.153 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-647ded64-5dbe-11ef-bccf-c7b262605968.target.wants/ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mon.a.service → /etc/systemd/system/ceph-647ded64-5dbe-11ef-bccf-c7b262605968@.service. 2024-08-19T00:03:43.724 INFO:teuthology.orchestra.run.smithi044.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-19T00:03:43.724 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stdout disabled 2024-08-19T00:03:43.731 INFO:teuthology.orchestra.run.smithi044.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-19T00:03:43.731 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stdout inactive 2024-08-19T00:03:43.731 INFO:teuthology.orchestra.run.smithi044.stdout:firewalld.service is not enabled 2024-08-19T00:03:43.731 INFO:teuthology.orchestra.run.smithi044.stdout:Not possible to enable service . firewalld.service is not available 2024-08-19T00:03:43.731 INFO:teuthology.orchestra.run.smithi044.stdout:Waiting for mon to start... 2024-08-19T00:03:43.731 INFO:teuthology.orchestra.run.smithi044.stdout:Waiting for mon... 2024-08-19T00:03:44.774 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout cluster: 2024-08-19T00:03:44.775 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout id: 647ded64-5dbe-11ef-bccf-c7b262605968 2024-08-19T00:03:44.775 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-08-19T00:03:44.775 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 2024-08-19T00:03:44.775 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout services: 2024-08-19T00:03:44.775 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.560019s) 2024-08-19T00:03:44.775 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-08-19T00:03:44.775 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-08-19T00:03:44.775 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 2024-08-19T00:03:44.775 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout data: 2024-08-19T00:03:44.775 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-08-19T00:03:44.775 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-08-19T00:03:44.776 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-08-19T00:03:44.776 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout pgs: 2024-08-19T00:03:44.776 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 2024-08-19T00:03:44.776 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:44.156+0000 7f487c0a3640 1 Processor -- start 2024-08-19T00:03:44.776 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:44.156+0000 7f487c0a3640 1 -- start start 2024-08-19T00:03:44.776 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:44.156+0000 7f487c0a3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4874107d60 0x7f487410a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:03:44.776 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:44.156+0000 7f487c0a3640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f487407be30 con 0x7f4874107d60 2024-08-19T00:03:44.776 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:44.157+0000 7f4879e3f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4874107d60 0x7f487410a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:03:44.776 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:44.157+0000 7f4879e3f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4874107d60 0x7f487410a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40460/0 (socket says 172.21.15.44:40460) 2024-08-19T00:03:44.776 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:44.157+0000 7f4879e3f640 1 -- 172.21.15.44:0/3509405757 learned_addr learned my addr 172.21.15.44:0/3509405757 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:03:44.776 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:44.157+0000 7f4879e3f640 1 -- 172.21.15.44:0/3509405757 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f487410a690 con 0x7f4874107d60 2024-08-19T00:03:44.776 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:44.159+0000 7f4879e3f640 1 --2- 172.21.15.44:0/3509405757 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4874107d60 0x7f487410a150 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f4870009820 tx=0x7f487002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed813c85c95794d8 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:03:44.777 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:44.159+0000 7f4878e3d640 1 -- 172.21.15.44:0/3509405757 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4870037070 con 0x7f4874107d60 2024-08-19T00:03:44.777 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:44.159+0000 7f4878e3d640 1 -- 172.21.15.44:0/3509405757 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4870032440 con 0x7f4874107d60 2024-08-19T00:03:44.777 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:44.159+0000 7f4878e3d640 1 -- 172.21.15.44:0/3509405757 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4870032740 con 0x7f4874107d60 2024-08-19T00:03:44.777 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:44.160+0000 7f487c0a3640 1 -- 172.21.15.44:0/3509405757 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4874107d60 msgr2=0x7f487410a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:03:44.777 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:44.160+0000 7f487c0a3640 1 --2- 172.21.15.44:0/3509405757 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4874107d60 0x7f487410a150 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f4870009820 tx=0x7f487002a270 comp rx=0 tx=0).stop 2024-08-19T00:03:44.777 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:44.160+0000 7f487c0a3640 1 -- 172.21.15.44:0/3509405757 shutdown_connections 2024-08-19T00:03:44.777 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:44.160+0000 7f487c0a3640 1 --2- 172.21.15.44:0/3509405757 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4874107d60 0x7f487410a150 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:03:44.777 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:44.160+0000 7f487c0a3640 1 -- 172.21.15.44:0/3509405757 >> 172.21.15.44:0/3509405757 conn(0x7f4874101a00 msgr2=0x7f4874103e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:03:44.777 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:44.160+0000 7f487c0a3640 1 -- 172.21.15.44:0/3509405757 shutdown_connections 2024-08-19T00:03:44.777 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:44.160+0000 7f487c0a3640 1 -- 172.21.15.44:0/3509405757 wait complete. 2024-08-19T00:03:44.777 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:44.160+0000 7f487c0a3640 1 Processor -- start 2024-08-19T00:03:44.777 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:44.160+0000 7f487c0a3640 1 -- start start 2024-08-19T00:03:44.777 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:44.161+0000 7f487c0a3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4874107d60 0x7f487419aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:03:44.778 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:44.161+0000 7f487c0a3640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f487410abd0 con 0x7f4874107d60 2024-08-19T00:03:44.778 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:44.161+0000 7f4879e3f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4874107d60 0x7f487419aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:03:44.778 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:44.161+0000 7f4879e3f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4874107d60 0x7f487419aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40474/0 (socket says 172.21.15.44:40474) 2024-08-19T00:03:44.778 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:44.161+0000 7f4879e3f640 1 -- 172.21.15.44:0/997019789 learned_addr learned my addr 172.21.15.44:0/997019789 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:03:44.778 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:44.161+0000 7f4879e3f640 1 -- 172.21.15.44:0/997019789 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f487419b020 con 0x7f4874107d60 2024-08-19T00:03:44.778 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:44.161+0000 7f4879e3f640 1 --2- 172.21.15.44:0/997019789 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4874107d60 0x7f487419aae0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f48700090b0 tx=0x7f48700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:03:44.778 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:44.161+0000 7f486affd640 1 -- 172.21.15.44:0/997019789 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4870041070 con 0x7f4874107d60 2024-08-19T00:03:44.778 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:44.161+0000 7f486affd640 1 -- 172.21.15.44:0/997019789 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f487003c7a0 con 0x7f4874107d60 2024-08-19T00:03:44.778 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:44.161+0000 7f486affd640 1 -- 172.21.15.44:0/997019789 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4870037040 con 0x7f4874107d60 2024-08-19T00:03:44.778 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:44.161+0000 7f487c0a3640 1 -- 172.21.15.44:0/997019789 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f487419b2b0 con 0x7f4874107d60 2024-08-19T00:03:44.778 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:44.162+0000 7f487c0a3640 1 -- 172.21.15.44:0/997019789 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f487419dfa0 con 0x7f4874107d60 2024-08-19T00:03:44.778 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:44.162+0000 7f486affd640 1 -- 172.21.15.44:0/997019789 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4870044070 con 0x7f4874107d60 2024-08-19T00:03:44.778 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:44.162+0000 7f486affd640 1 -- 172.21.15.44:0/997019789 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f487003d3f0 con 0x7f4874107d60 2024-08-19T00:03:44.779 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:44.162+0000 7f487c0a3640 1 -- 172.21.15.44:0/997019789 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48741081c0 con 0x7f4874107d60 2024-08-19T00:03:44.779 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:44.165+0000 7f486affd640 1 -- 172.21.15.44:0/997019789 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73482 (secure 0 0 0) 0x7f4870046450 con 0x7f4874107d60 2024-08-19T00:03:44.779 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:44.225+0000 7f487c0a3640 1 -- 172.21.15.44:0/997019789 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f487402d720 con 0x7f4874107d60 2024-08-19T00:03:44.779 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:44.226+0000 7f486affd640 1 -- 172.21.15.44:0/997019789 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f4870046630 con 0x7f4874107d60 2024-08-19T00:03:44.779 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:44.226+0000 7f487c0a3640 1 -- 172.21.15.44:0/997019789 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4874107d60 msgr2=0x7f487419aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:03:44.779 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:44.226+0000 7f487c0a3640 1 --2- 172.21.15.44:0/997019789 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4874107d60 0x7f487419aae0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f48700090b0 tx=0x7f48700046c0 comp rx=0 tx=0).stop 2024-08-19T00:03:44.779 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:44.226+0000 7f487c0a3640 1 -- 172.21.15.44:0/997019789 shutdown_connections 2024-08-19T00:03:44.779 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:44.226+0000 7f487c0a3640 1 --2- 172.21.15.44:0/997019789 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4874107d60 0x7f487419aae0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:03:44.779 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:44.226+0000 7f487c0a3640 1 -- 172.21.15.44:0/997019789 >> 172.21.15.44:0/997019789 conn(0x7f4874101a00 msgr2=0x7f4874102af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:03:44.779 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:44.227+0000 7f487c0a3640 1 -- 172.21.15.44:0/997019789 shutdown_connections 2024-08-19T00:03:44.779 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:44.227+0000 7f487c0a3640 1 -- 172.21.15.44:0/997019789 wait complete. 2024-08-19T00:03:44.779 INFO:teuthology.orchestra.run.smithi044.stdout:mon is available 2024-08-19T00:03:44.779 INFO:teuthology.orchestra.run.smithi044.stdout:Assimilating anything we can from ceph.conf... 2024-08-19T00:03:45.723 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 2024-08-19T00:03:45.723 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout [global] 2024-08-19T00:03:45.723 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout fsid = 647ded64-5dbe-11ef-bccf-c7b262605968 2024-08-19T00:03:45.723 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.44:3300,v1:172.21.15.44:6789] 2024-08-19T00:03:45.723 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-08-19T00:03:45.723 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-08-19T00:03:45.723 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-08-19T00:03:45.723 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-08-19T00:03:45.723 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 2024-08-19T00:03:45.723 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout [mgr] 2024-08-19T00:03:45.723 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-08-19T00:03:45.724 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 2024-08-19T00:03:45.724 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout [osd] 2024-08-19T00:03:45.724 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-08-19T00:03:45.724 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-08-19T00:03:45.724 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-08-19T00:03:45.724 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-08-19T00:03:45.724 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-08-19T00:03:45.724 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:45.183+0000 7f0208135640 1 Processor -- start 2024-08-19T00:03:45.724 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:45.183+0000 7f0208135640 1 -- start start 2024-08-19T00:03:45.724 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:45.183+0000 7f0208135640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02001073e0 0x7f02001077e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:03:45.724 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:45.183+0000 7f0208135640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0200107d20 con 0x7f02001073e0 2024-08-19T00:03:45.724 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:45.183+0000 7f0205ed1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02001073e0 0x7f02001077e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:03:45.724 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:45.183+0000 7f0205ed1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02001073e0 0x7f02001077e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40476/0 (socket says 172.21.15.44:40476) 2024-08-19T00:03:45.724 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:45.183+0000 7f0205ed1640 1 -- 172.21.15.44:0/1401534051 learned_addr learned my addr 172.21.15.44:0/1401534051 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:03:45.725 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:45.184+0000 7f0205ed1640 1 -- 172.21.15.44:0/1401534051 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0200107ea0 con 0x7f02001073e0 2024-08-19T00:03:45.725 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:45.184+0000 7f0205ed1640 1 --2- 172.21.15.44:0/1401534051 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02001073e0 0x7f02001077e0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f01fc009820 tx=0x7f01fc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5330ae3675399b2f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:03:45.725 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:45.185+0000 7f0204ecf640 1 -- 172.21.15.44:0/1401534051 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01fc037070 con 0x7f02001073e0 2024-08-19T00:03:45.725 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:45.185+0000 7f0204ecf640 1 -- 172.21.15.44:0/1401534051 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01fc032440 con 0x7f02001073e0 2024-08-19T00:03:45.725 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:45.185+0000 7f0204ecf640 1 -- 172.21.15.44:0/1401534051 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01fc032740 con 0x7f02001073e0 2024-08-19T00:03:45.725 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:45.185+0000 7f0208135640 1 -- 172.21.15.44:0/1401534051 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02001073e0 msgr2=0x7f02001077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:03:45.725 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:45.185+0000 7f0208135640 1 --2- 172.21.15.44:0/1401534051 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02001073e0 0x7f02001077e0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f01fc009820 tx=0x7f01fc02a270 comp rx=0 tx=0).stop 2024-08-19T00:03:45.725 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:45.185+0000 7f0208135640 1 -- 172.21.15.44:0/1401534051 shutdown_connections 2024-08-19T00:03:45.725 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:45.185+0000 7f0208135640 1 --2- 172.21.15.44:0/1401534051 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02001073e0 0x7f02001077e0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:03:45.725 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:45.185+0000 7f0208135640 1 -- 172.21.15.44:0/1401534051 >> 172.21.15.44:0/1401534051 conn(0x7f0200102c50 msgr2=0x7f0200105070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:03:45.725 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:45.185+0000 7f0208135640 1 -- 172.21.15.44:0/1401534051 shutdown_connections 2024-08-19T00:03:45.725 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:45.185+0000 7f0208135640 1 -- 172.21.15.44:0/1401534051 wait complete. 2024-08-19T00:03:45.725 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:45.186+0000 7f0208135640 1 Processor -- start 2024-08-19T00:03:45.726 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:45.186+0000 7f0208135640 1 -- start start 2024-08-19T00:03:45.726 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:45.186+0000 7f0208135640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02001073e0 0x7f020019aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:03:45.726 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:45.186+0000 7f0208135640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f02001088b0 con 0x7f02001073e0 2024-08-19T00:03:45.726 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:45.186+0000 7f0205ed1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02001073e0 0x7f020019aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:03:45.726 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:45.186+0000 7f0205ed1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02001073e0 0x7f020019aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40478/0 (socket says 172.21.15.44:40478) 2024-08-19T00:03:45.726 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:45.186+0000 7f0205ed1640 1 -- 172.21.15.44:0/2056406833 learned_addr learned my addr 172.21.15.44:0/2056406833 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:03:45.726 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:45.186+0000 7f0205ed1640 1 -- 172.21.15.44:0/2056406833 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f020019b010 con 0x7f02001073e0 2024-08-19T00:03:45.726 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:45.187+0000 7f0205ed1640 1 --2- 172.21.15.44:0/2056406833 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02001073e0 0x7f020019aad0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f01fc0090b0 tx=0x7f01fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:03:45.726 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:45.187+0000 7f01f6ffd640 1 -- 172.21.15.44:0/2056406833 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01fc041070 con 0x7f02001073e0 2024-08-19T00:03:45.726 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:45.187+0000 7f01f6ffd640 1 -- 172.21.15.44:0/2056406833 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01fc03c7a0 con 0x7f02001073e0 2024-08-19T00:03:45.726 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:45.187+0000 7f0208135640 1 -- 172.21.15.44:0/2056406833 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f020019b2a0 con 0x7f02001073e0 2024-08-19T00:03:45.726 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:45.187+0000 7f01f6ffd640 1 -- 172.21.15.44:0/2056406833 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01fc037040 con 0x7f02001073e0 2024-08-19T00:03:45.727 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:45.187+0000 7f0208135640 1 -- 172.21.15.44:0/2056406833 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f020019df90 con 0x7f02001073e0 2024-08-19T00:03:45.727 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:45.187+0000 7f01f6ffd640 1 -- 172.21.15.44:0/2056406833 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f01fc044070 con 0x7f02001073e0 2024-08-19T00:03:45.727 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:45.187+0000 7f01f6ffd640 1 -- 172.21.15.44:0/2056406833 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f01fc03d3f0 con 0x7f02001073e0 2024-08-19T00:03:45.727 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:45.188+0000 7f0208135640 1 -- 172.21.15.44:0/2056406833 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0200107860 con 0x7f02001073e0 2024-08-19T00:03:45.727 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:45.190+0000 7f01f6ffd640 1 -- 172.21.15.44:0/2056406833 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73482 (secure 0 0 0) 0x7f01fc046450 con 0x7f02001073e0 2024-08-19T00:03:45.727 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:45.249+0000 7f0208135640 1 -- 172.21.15.44:0/2056406833 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f020019e160 con 0x7f02001073e0 2024-08-19T00:03:45.727 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:45.253+0000 7f01f6ffd640 1 -- 172.21.15.44:0/2056406833 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+429 (secure 0 0 0) 0x7f01fc046630 con 0x7f02001073e0 2024-08-19T00:03:45.727 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:45.253+0000 7f01f6ffd640 1 -- 172.21.15.44:0/2056406833 <== mon.0 v2:172.21.15.44:3300/0 8 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f01fc056070 con 0x7f02001073e0 2024-08-19T00:03:45.727 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:45.254+0000 7f0208135640 1 -- 172.21.15.44:0/2056406833 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02001073e0 msgr2=0x7f020019aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:03:45.727 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:45.254+0000 7f0208135640 1 --2- 172.21.15.44:0/2056406833 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02001073e0 0x7f020019aad0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f01fc0090b0 tx=0x7f01fc0046c0 comp rx=0 tx=0).stop 2024-08-19T00:03:45.727 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:45.254+0000 7f0208135640 1 -- 172.21.15.44:0/2056406833 shutdown_connections 2024-08-19T00:03:45.727 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:45.254+0000 7f0208135640 1 --2- 172.21.15.44:0/2056406833 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02001073e0 0x7f020019aad0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:03:45.727 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:45.254+0000 7f0208135640 1 -- 172.21.15.44:0/2056406833 >> 172.21.15.44:0/2056406833 conn(0x7f0200102c50 msgr2=0x7f020018ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:03:45.727 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:45.254+0000 7f0208135640 1 -- 172.21.15.44:0/2056406833 shutdown_connections 2024-08-19T00:03:45.728 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:45.254+0000 7f0208135640 1 -- 172.21.15.44:0/2056406833 wait complete. 2024-08-19T00:03:45.728 INFO:teuthology.orchestra.run.smithi044.stdout:Generating new minimal ceph.conf... 2024-08-19T00:03:46.786 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:46.160+0000 7f09bbda4640 1 Processor -- start 2024-08-19T00:03:46.786 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:46.160+0000 7f09bbda4640 1 -- start start 2024-08-19T00:03:46.786 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:46.160+0000 7f09bbda4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09b4107e20 0x7f09b410a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:03:46.786 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:46.160+0000 7f09bbda4640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f09b407bd70 con 0x7f09b4107e20 2024-08-19T00:03:46.787 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:46.161+0000 7f09b9b40640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09b4107e20 0x7f09b410a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:03:46.787 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:46.161+0000 7f09b9b40640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09b4107e20 0x7f09b410a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40482/0 (socket says 172.21.15.44:40482) 2024-08-19T00:03:46.787 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:46.161+0000 7f09b9b40640 1 -- 172.21.15.44:0/2188662221 learned_addr learned my addr 172.21.15.44:0/2188662221 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:03:46.787 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:46.161+0000 7f09b9b40640 1 -- 172.21.15.44:0/2188662221 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09b410a750 con 0x7f09b4107e20 2024-08-19T00:03:46.787 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:46.162+0000 7f09b9b40640 1 --2- 172.21.15.44:0/2188662221 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09b4107e20 0x7f09b410a210 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f09ac009820 tx=0x7f09ac02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98a863424b7b278 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:03:46.787 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:46.162+0000 7f09b8b3e640 1 -- 172.21.15.44:0/2188662221 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09ac037070 con 0x7f09b4107e20 2024-08-19T00:03:46.787 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:46.162+0000 7f09b8b3e640 1 -- 172.21.15.44:0/2188662221 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f09ac032900 con 0x7f09b4107e20 2024-08-19T00:03:46.787 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:46.162+0000 7f09b8b3e640 1 -- 172.21.15.44:0/2188662221 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09ac030850 con 0x7f09b4107e20 2024-08-19T00:03:46.787 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:46.162+0000 7f09bbda4640 1 -- 172.21.15.44:0/2188662221 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09b4107e20 msgr2=0x7f09b410a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:03:46.787 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:46.162+0000 7f09bbda4640 1 --2- 172.21.15.44:0/2188662221 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09b4107e20 0x7f09b410a210 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f09ac009820 tx=0x7f09ac02a270 comp rx=0 tx=0).stop 2024-08-19T00:03:46.787 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:46.162+0000 7f09bbda4640 1 -- 172.21.15.44:0/2188662221 shutdown_connections 2024-08-19T00:03:46.787 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:46.162+0000 7f09bbda4640 1 --2- 172.21.15.44:0/2188662221 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09b4107e20 0x7f09b410a210 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:03:46.788 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:46.162+0000 7f09bbda4640 1 -- 172.21.15.44:0/2188662221 >> 172.21.15.44:0/2188662221 conn(0x7f09b41019c0 msgr2=0x7f09b4103de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:03:46.788 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:46.163+0000 7f09bbda4640 1 -- 172.21.15.44:0/2188662221 shutdown_connections 2024-08-19T00:03:46.788 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:46.163+0000 7f09bbda4640 1 -- 172.21.15.44:0/2188662221 wait complete. 2024-08-19T00:03:46.788 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:46.163+0000 7f09bbda4640 1 Processor -- start 2024-08-19T00:03:46.788 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:46.163+0000 7f09bbda4640 1 -- start start 2024-08-19T00:03:46.788 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:46.163+0000 7f09bbda4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09b4107e20 0x7f09b419b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:03:46.788 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:46.163+0000 7f09bbda4640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f09b410b730 con 0x7f09b4107e20 2024-08-19T00:03:46.788 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:46.163+0000 7f09b9b40640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09b4107e20 0x7f09b419b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:03:46.788 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:46.163+0000 7f09b9b40640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09b4107e20 0x7f09b419b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40488/0 (socket says 172.21.15.44:40488) 2024-08-19T00:03:46.788 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:46.163+0000 7f09b9b40640 1 -- 172.21.15.44:0/876143388 learned_addr learned my addr 172.21.15.44:0/876143388 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:03:46.788 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:46.164+0000 7f09b9b40640 1 -- 172.21.15.44:0/876143388 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09b419b830 con 0x7f09b4107e20 2024-08-19T00:03:46.788 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:46.164+0000 7f09b9b40640 1 --2- 172.21.15.44:0/876143388 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09b4107e20 0x7f09b419b2f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f09ac0097f0 tx=0x7f09ac030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:03:46.788 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:46.164+0000 7f09b2ffd640 1 -- 172.21.15.44:0/876143388 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09ac037040 con 0x7f09b4107e20 2024-08-19T00:03:46.788 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:46.164+0000 7f09b2ffd640 1 -- 172.21.15.44:0/876143388 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f09ac040070 con 0x7f09b4107e20 2024-08-19T00:03:46.789 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:46.164+0000 7f09bbda4640 1 -- 172.21.15.44:0/876143388 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09b419bac0 con 0x7f09b4107e20 2024-08-19T00:03:46.789 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:46.164+0000 7f09b2ffd640 1 -- 172.21.15.44:0/876143388 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09ac03a390 con 0x7f09b4107e20 2024-08-19T00:03:46.789 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:46.164+0000 7f09bbda4640 1 -- 172.21.15.44:0/876143388 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09b419e7b0 con 0x7f09b4107e20 2024-08-19T00:03:46.789 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:46.164+0000 7f09b2ffd640 1 -- 172.21.15.44:0/876143388 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f09ac03a5e0 con 0x7f09b4107e20 2024-08-19T00:03:46.789 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:46.164+0000 7f09b2ffd640 1 -- 172.21.15.44:0/876143388 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f09ac045950 con 0x7f09b4107e20 2024-08-19T00:03:46.789 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:46.165+0000 7f09bbda4640 1 -- 172.21.15.44:0/876143388 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09b4108280 con 0x7f09b4107e20 2024-08-19T00:03:46.789 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:46.167+0000 7f09b2ffd640 1 -- 172.21.15.44:0/876143388 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73482 (secure 0 0 0) 0x7f09ac045460 con 0x7f09b4107e20 2024-08-19T00:03:46.789 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:46.226+0000 7f09bbda4640 1 -- 172.21.15.44:0/876143388 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f09b419e980 con 0x7f09b4107e20 2024-08-19T00:03:46.789 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:46.227+0000 7f09b2ffd640 1 -- 172.21.15.44:0/876143388 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7f09ac03b430 con 0x7f09b4107e20 2024-08-19T00:03:46.789 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:46.227+0000 7f09bbda4640 1 -- 172.21.15.44:0/876143388 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09b4107e20 msgr2=0x7f09b419b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:03:46.789 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:46.227+0000 7f09bbda4640 1 --2- 172.21.15.44:0/876143388 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09b4107e20 0x7f09b419b2f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f09ac0097f0 tx=0x7f09ac030d80 comp rx=0 tx=0).stop 2024-08-19T00:03:46.789 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:46.228+0000 7f09bbda4640 1 -- 172.21.15.44:0/876143388 shutdown_connections 2024-08-19T00:03:46.789 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:46.228+0000 7f09bbda4640 1 --2- 172.21.15.44:0/876143388 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09b4107e20 0x7f09b419b2f0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:03:46.790 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:46.228+0000 7f09bbda4640 1 -- 172.21.15.44:0/876143388 >> 172.21.15.44:0/876143388 conn(0x7f09b41019c0 msgr2=0x7f09b4102560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:03:46.790 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:46.228+0000 7f09bbda4640 1 -- 172.21.15.44:0/876143388 shutdown_connections 2024-08-19T00:03:46.790 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:46.228+0000 7f09bbda4640 1 -- 172.21.15.44:0/876143388 wait complete. 2024-08-19T00:03:46.790 INFO:teuthology.orchestra.run.smithi044.stdout:Restarting the monitor... 2024-08-19T00:03:47.049 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:46 smithi044 systemd[1]: Stopping Ceph mon.a for 647ded64-5dbe-11ef-bccf-c7b262605968... 2024-08-19T00:03:47.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:47 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mon-a[18114]: 2024-08-19T00:03:47.047+0000 7f05538f0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-19T00:03:47.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:47 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mon-a[18114]: 2024-08-19T00:03:47.047+0000 7f05538f0640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-08-19T00:03:47.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:47 smithi044 podman[18362]: 2024-08-19 00:03:47.191397158 +0000 UTC m=+0.227527507 container died b1b321ec19da6722dc2ce2d2bee19afc8b5764a822b3faf3ba9359600248c54f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mon-a, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-de09dd0) 2024-08-19T00:03:47.807 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:47 smithi044 podman[18362]: 2024-08-19 00:03:47.547763125 +0000 UTC m=+0.583893465 container cleanup b1b321ec19da6722dc2ce2d2bee19afc8b5764a822b3faf3ba9359600248c54f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-de09dd0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-08-19T00:03:47.807 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:47 smithi044 bash[18362]: ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mon-a 2024-08-19T00:03:48.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:47 smithi044 podman[18376]: 2024-08-19 00:03:47.80679132 +0000 UTC m=+0.614951893 container remove b1b321ec19da6722dc2ce2d2bee19afc8b5764a822b3faf3ba9359600248c54f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-de09dd0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.36.0) 2024-08-19T00:03:48.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:47 smithi044 systemd[1]: ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mon.a.service: Deactivated successfully. 2024-08-19T00:03:48.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:47 smithi044 systemd[1]: Stopped Ceph mon.a for 647ded64-5dbe-11ef-bccf-c7b262605968. 2024-08-19T00:03:48.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:47 smithi044 systemd[1]: Starting Ceph mon.a for 647ded64-5dbe-11ef-bccf-c7b262605968... 2024-08-19T00:03:48.447 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 podman[18470]: 2024-08-19 00:03:48.096546492 +0000 UTC m=+0.017673146 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-19T00:03:48.447 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 podman[18470]: 2024-08-19 00:03:48.207719172 +0000 UTC m=+0.128845812 container create c88c8e2b95d4f27928d02091762fa7eaed22ecd96f0a528af3eef69dd063d035 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mon-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-de09dd0, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0) 2024-08-19T00:03:48.447 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 podman[18470]: 2024-08-19 00:03:48.418146386 +0000 UTC m=+0.339273019 container init c88c8e2b95d4f27928d02091762fa7eaed22ecd96f0a528af3eef69dd063d035 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mon-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-de09dd0, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=) 2024-08-19T00:03:48.447 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 podman[18470]: 2024-08-19 00:03:48.421272683 +0000 UTC m=+0.342399315 container start c88c8e2b95d4f27928d02091762fa7eaed22ecd96f0a528af3eef69dd063d035 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mon-a, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-de09dd0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-19T00:03:48.447 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: set uid:gid to 167:167 (ceph:ceph) 2024-08-19T00:03:48.447 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc), process ceph-mon, pid 2 2024-08-19T00:03:48.447 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: pidfile_write: ignore empty --pid-file 2024-08-19T00:03:48.447 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: load: jerasure load: lrc 2024-08-19T00:03:48.506 INFO:teuthology.orchestra.run.smithi044.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-08-19T00:03:48.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: RocksDB version: 7.9.2 2024-08-19T00:03:48.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Git sha 0 2024-08-19T00:03:48.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Compile date 2024-08-18 15:19:56 2024-08-19T00:03:48.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: DB SUMMARY 2024-08-19T00:03:48.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: DB Session ID: 9RP0LF9BNOUADXXFKUTQ 2024-08-19T00:03:48.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: CURRENT file: CURRENT 2024-08-19T00:03:48.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: IDENTITY file: IDENTITY 2024-08-19T00:03:48.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-08-19T00:03:48.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-08-19T00:03:48.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 105284 ; 2024-08-19T00:03:48.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.error_if_exists: 0 2024-08-19T00:03:48.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.create_if_missing: 0 2024-08-19T00:03:48.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.paranoid_checks: 1 2024-08-19T00:03:48.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.flush_verify_memtable_count: 1 2024-08-19T00:03:48.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-08-19T00:03:48.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-08-19T00:03:48.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.env: 0x5642074d77a0 2024-08-19T00:03:48.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.fs: PosixFileSystem 2024-08-19T00:03:48.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.info_log: 0x56420944d500 2024-08-19T00:03:48.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.max_file_opening_threads: 16 2024-08-19T00:03:48.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.statistics: (nil) 2024-08-19T00:03:48.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.use_fsync: 0 2024-08-19T00:03:48.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.max_log_file_size: 0 2024-08-19T00:03:48.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-08-19T00:03:48.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.log_file_time_to_roll: 0 2024-08-19T00:03:48.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.keep_log_file_num: 1000 2024-08-19T00:03:48.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.recycle_log_file_num: 0 2024-08-19T00:03:48.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.allow_fallocate: 1 2024-08-19T00:03:48.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.allow_mmap_reads: 0 2024-08-19T00:03:48.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.allow_mmap_writes: 0 2024-08-19T00:03:48.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.use_direct_reads: 0 2024-08-19T00:03:48.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-08-19T00:03:48.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.create_missing_column_families: 0 2024-08-19T00:03:48.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.db_log_dir: 2024-08-19T00:03:48.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.wal_dir: 2024-08-19T00:03:48.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.table_cache_numshardbits: 6 2024-08-19T00:03:48.741 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.WAL_ttl_seconds: 0 2024-08-19T00:03:48.741 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.WAL_size_limit_MB: 0 2024-08-19T00:03:48.741 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-08-19T00:03:48.742 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-08-19T00:03:48.742 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.is_fd_close_on_exec: 1 2024-08-19T00:03:48.742 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.advise_random_on_open: 1 2024-08-19T00:03:48.742 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.db_write_buffer_size: 0 2024-08-19T00:03:48.742 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.write_buffer_manager: 0x56420945cdc0 2024-08-19T00:03:48.742 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-08-19T00:03:48.743 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-08-19T00:03:48.743 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.use_adaptive_mutex: 0 2024-08-19T00:03:48.743 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.rate_limiter: (nil) 2024-08-19T00:03:48.743 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-08-19T00:03:48.743 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.wal_recovery_mode: 2 2024-08-19T00:03:48.743 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.enable_thread_tracking: 0 2024-08-19T00:03:48.743 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.enable_pipelined_write: 0 2024-08-19T00:03:48.743 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.unordered_write: 0 2024-08-19T00:03:48.743 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-08-19T00:03:48.743 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-08-19T00:03:48.743 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-08-19T00:03:48.743 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-08-19T00:03:48.743 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.row_cache: None 2024-08-19T00:03:48.744 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.wal_filter: None 2024-08-19T00:03:48.744 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-08-19T00:03:48.744 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.allow_ingest_behind: 0 2024-08-19T00:03:48.744 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.two_write_queues: 0 2024-08-19T00:03:48.744 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.manual_wal_flush: 0 2024-08-19T00:03:48.744 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.wal_compression: 0 2024-08-19T00:03:48.744 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.atomic_flush: 0 2024-08-19T00:03:48.744 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-08-19T00:03:48.744 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.persist_stats_to_disk: 0 2024-08-19T00:03:48.744 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.write_dbid_to_manifest: 0 2024-08-19T00:03:48.744 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.log_readahead_size: 0 2024-08-19T00:03:48.744 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-08-19T00:03:48.744 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.best_efforts_recovery: 0 2024-08-19T00:03:48.745 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-08-19T00:03:48.745 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-08-19T00:03:48.745 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.allow_data_in_errors: 0 2024-08-19T00:03:48.745 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.db_host_id: __hostname__ 2024-08-19T00:03:48.745 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.enforce_single_del_contracts: true 2024-08-19T00:03:48.745 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.max_background_jobs: 2 2024-08-19T00:03:48.745 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.max_background_compactions: -1 2024-08-19T00:03:48.745 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.max_subcompactions: 1 2024-08-19T00:03:48.745 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-08-19T00:03:48.745 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-08-19T00:03:48.745 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.delayed_write_rate : 16777216 2024-08-19T00:03:48.745 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.max_total_wal_size: 0 2024-08-19T00:03:48.745 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-08-19T00:03:48.745 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.stats_dump_period_sec: 600 2024-08-19T00:03:48.746 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.stats_persist_period_sec: 600 2024-08-19T00:03:48.746 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-08-19T00:03:48.746 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.max_open_files: -1 2024-08-19T00:03:48.746 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.bytes_per_sync: 0 2024-08-19T00:03:48.746 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.wal_bytes_per_sync: 0 2024-08-19T00:03:48.746 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.strict_bytes_per_sync: 0 2024-08-19T00:03:48.746 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.compaction_readahead_size: 0 2024-08-19T00:03:48.746 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.max_background_flushes: -1 2024-08-19T00:03:48.746 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Compression algorithms supported: 2024-08-19T00:03:48.746 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: kZSTD supported: 0 2024-08-19T00:03:48.746 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: kXpressCompression supported: 0 2024-08-19T00:03:48.746 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: kBZip2Compression supported: 0 2024-08-19T00:03:48.746 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-08-19T00:03:48.746 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: kLZ4Compression supported: 1 2024-08-19T00:03:48.747 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: kZlibCompression supported: 1 2024-08-19T00:03:48.747 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: kLZ4HCCompression supported: 1 2024-08-19T00:03:48.747 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: kSnappyCompression supported: 1 2024-08-19T00:03:48.747 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Fast CRC32 supported: Supported on x86 2024-08-19T00:03:48.747 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: DMutex implementation: pthread_mutex_t 2024-08-19T00:03:48.747 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-08-19T00:03:48.747 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-08-19T00:03:48.747 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-08-19T00:03:48.747 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.merge_operator: 2024-08-19T00:03:48.747 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.compaction_filter: None 2024-08-19T00:03:48.747 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.compaction_filter_factory: None 2024-08-19T00:03:48.747 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.sst_partitioner_factory: None 2024-08-19T00:03:48.747 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.memtable_factory: SkipListFactory 2024-08-19T00:03:48.747 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.table_factory: BlockBasedTable 2024-08-19T00:03:48.747 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56420944d120) 2024-08-19T00:03:48.748 INFO:journalctl@ceph.mon.a.smithi044.stdout: cache_index_and_filter_blocks: 1 2024-08-19T00:03:48.748 INFO:journalctl@ceph.mon.a.smithi044.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-08-19T00:03:48.748 INFO:journalctl@ceph.mon.a.smithi044.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-08-19T00:03:48.748 INFO:journalctl@ceph.mon.a.smithi044.stdout: pin_top_level_index_and_filter: 1 2024-08-19T00:03:48.748 INFO:journalctl@ceph.mon.a.smithi044.stdout: index_type: 0 2024-08-19T00:03:48.748 INFO:journalctl@ceph.mon.a.smithi044.stdout: data_block_index_type: 0 2024-08-19T00:03:48.748 INFO:journalctl@ceph.mon.a.smithi044.stdout: index_shortening: 1 2024-08-19T00:03:48.748 INFO:journalctl@ceph.mon.a.smithi044.stdout: data_block_hash_table_util_ratio: 0.750000 2024-08-19T00:03:48.748 INFO:journalctl@ceph.mon.a.smithi044.stdout: checksum: 4 2024-08-19T00:03:48.748 INFO:journalctl@ceph.mon.a.smithi044.stdout: no_block_cache: 0 2024-08-19T00:03:48.748 INFO:journalctl@ceph.mon.a.smithi044.stdout: block_cache: 0x564209441090 2024-08-19T00:03:48.748 INFO:journalctl@ceph.mon.a.smithi044.stdout: block_cache_name: BinnedLRUCache 2024-08-19T00:03:48.748 INFO:journalctl@ceph.mon.a.smithi044.stdout: block_cache_options: 2024-08-19T00:03:48.749 INFO:journalctl@ceph.mon.a.smithi044.stdout: capacity : 536870912 2024-08-19T00:03:48.749 INFO:journalctl@ceph.mon.a.smithi044.stdout: num_shard_bits : 4 2024-08-19T00:03:48.749 INFO:journalctl@ceph.mon.a.smithi044.stdout: strict_capacity_limit : 0 2024-08-19T00:03:48.749 INFO:journalctl@ceph.mon.a.smithi044.stdout: high_pri_pool_ratio: 0.000 2024-08-19T00:03:48.749 INFO:journalctl@ceph.mon.a.smithi044.stdout: block_cache_compressed: (nil) 2024-08-19T00:03:48.749 INFO:journalctl@ceph.mon.a.smithi044.stdout: persistent_cache: (nil) 2024-08-19T00:03:48.749 INFO:journalctl@ceph.mon.a.smithi044.stdout: block_size: 4096 2024-08-19T00:03:48.749 INFO:journalctl@ceph.mon.a.smithi044.stdout: block_size_deviation: 10 2024-08-19T00:03:48.749 INFO:journalctl@ceph.mon.a.smithi044.stdout: block_restart_interval: 16 2024-08-19T00:03:48.749 INFO:journalctl@ceph.mon.a.smithi044.stdout: index_block_restart_interval: 1 2024-08-19T00:03:48.749 INFO:journalctl@ceph.mon.a.smithi044.stdout: metadata_block_size: 4096 2024-08-19T00:03:48.749 INFO:journalctl@ceph.mon.a.smithi044.stdout: partition_filters: 0 2024-08-19T00:03:48.749 INFO:journalctl@ceph.mon.a.smithi044.stdout: use_delta_encoding: 1 2024-08-19T00:03:48.749 INFO:journalctl@ceph.mon.a.smithi044.stdout: filter_policy: bloomfilter 2024-08-19T00:03:48.749 INFO:journalctl@ceph.mon.a.smithi044.stdout: whole_key_filtering: 1 2024-08-19T00:03:48.750 INFO:journalctl@ceph.mon.a.smithi044.stdout: verify_compression: 0 2024-08-19T00:03:48.750 INFO:journalctl@ceph.mon.a.smithi044.stdout: read_amp_bytes_per_bit: 0 2024-08-19T00:03:48.750 INFO:journalctl@ceph.mon.a.smithi044.stdout: format_version: 5 2024-08-19T00:03:48.750 INFO:journalctl@ceph.mon.a.smithi044.stdout: enable_index_compression: 1 2024-08-19T00:03:48.750 INFO:journalctl@ceph.mon.a.smithi044.stdout: block_align: 0 2024-08-19T00:03:48.750 INFO:journalctl@ceph.mon.a.smithi044.stdout: max_auto_readahead_size: 262144 2024-08-19T00:03:48.750 INFO:journalctl@ceph.mon.a.smithi044.stdout: prepopulate_block_cache: 0 2024-08-19T00:03:48.750 INFO:journalctl@ceph.mon.a.smithi044.stdout: initial_auto_readahead_size: 8192 2024-08-19T00:03:48.750 INFO:journalctl@ceph.mon.a.smithi044.stdout: num_file_reads_for_auto_readahead: 2 2024-08-19T00:03:48.750 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.write_buffer_size: 33554432 2024-08-19T00:03:48.750 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.max_write_buffer_number: 2 2024-08-19T00:03:48.750 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.compression: NoCompression 2024-08-19T00:03:48.750 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.bottommost_compression: Disabled 2024-08-19T00:03:48.750 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.prefix_extractor: nullptr 2024-08-19T00:03:48.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-08-19T00:03:48.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.num_levels: 7 2024-08-19T00:03:48.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-08-19T00:03:48.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-08-19T00:03:48.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-08-19T00:03:48.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-08-19T00:03:48.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-08-19T00:03:48.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-08-19T00:03:48.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-08-19T00:03:48.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-08-19T00:03:48.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-08-19T00:03:48.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-08-19T00:03:48.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-08-19T00:03:48.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-08-19T00:03:48.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.compression_opts.window_bits: -14 2024-08-19T00:03:48.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.compression_opts.level: 32767 2024-08-19T00:03:48.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.compression_opts.strategy: 0 2024-08-19T00:03:48.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-08-19T00:03:48.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-08-19T00:03:48.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-08-19T00:03:48.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-08-19T00:03:48.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.compression_opts.enabled: false 2024-08-19T00:03:48.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-08-19T00:03:48.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-08-19T00:03:48.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-08-19T00:03:48.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-08-19T00:03:48.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.target_file_size_base: 67108864 2024-08-19T00:03:48.753 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.target_file_size_multiplier: 1 2024-08-19T00:03:48.753 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-08-19T00:03:48.753 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-08-19T00:03:48.753 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-08-19T00:03:48.753 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-08-19T00:03:48.753 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-08-19T00:03:48.753 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-08-19T00:03:48.753 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-08-19T00:03:48.753 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-08-19T00:03:48.753 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-08-19T00:03:48.753 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-08-19T00:03:48.753 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-08-19T00:03:48.753 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-08-19T00:03:48.753 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-08-19T00:03:48.753 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.arena_block_size: 1048576 2024-08-19T00:03:48.754 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-08-19T00:03:48.754 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-08-19T00:03:48.754 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.disable_auto_compactions: 0 2024-08-19T00:03:48.754 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-08-19T00:03:48.754 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-08-19T00:03:48.754 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-08-19T00:03:48.754 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-08-19T00:03:48.754 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-08-19T00:03:48.754 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-08-19T00:03:48.754 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-08-19T00:03:48.754 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-08-19T00:03:48.754 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-08-19T00:03:48.754 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-08-19T00:03:48.755 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-08-19T00:03:48.755 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.inplace_update_support: 0 2024-08-19T00:03:48.755 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.inplace_update_num_locks: 10000 2024-08-19T00:03:48.755 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-08-19T00:03:48.755 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-08-19T00:03:48.755 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.memtable_huge_page_size: 0 2024-08-19T00:03:48.755 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.bloom_locality: 0 2024-08-19T00:03:48.755 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.max_successive_merges: 0 2024-08-19T00:03:48.755 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.optimize_filters_for_hits: 0 2024-08-19T00:03:48.755 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.paranoid_file_checks: 0 2024-08-19T00:03:48.755 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.force_consistency_checks: 1 2024-08-19T00:03:48.755 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.report_bg_io_stats: 0 2024-08-19T00:03:48.755 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.ttl: 2592000 2024-08-19T00:03:48.755 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.periodic_compaction_seconds: 0 2024-08-19T00:03:48.756 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-08-19T00:03:48.756 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-08-19T00:03:48.756 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.enable_blob_files: false 2024-08-19T00:03:48.756 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.min_blob_size: 0 2024-08-19T00:03:48.756 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.blob_file_size: 268435456 2024-08-19T00:03:48.756 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.blob_compression_type: NoCompression 2024-08-19T00:03:48.756 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.enable_blob_garbage_collection: false 2024-08-19T00:03:48.756 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-08-19T00:03:48.756 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-08-19T00:03:48.756 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-08-19T00:03:48.756 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.blob_file_starting_level: 0 2024-08-19T00:03:48.756 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-08-19T00:03:48.756 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-08-19T00:03:48.757 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-08-19T00:03:48.757 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: a34b2460-afc2-411f-b42b-3eaf5296e0c5 2024-08-19T00:03:48.757 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724025828448436, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-08-19T00:03:48.757 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-08-19T00:03:48.757 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724025828449465, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 100340, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 328, "table_properties": {"data_size": 98234, "index_size": 298, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14300, "raw_average_key_size": 49, "raw_value_size": 90499, "raw_average_value_size": 315, "num_data_blocks": 12, "num_entries": 287, "num_filter_entries": 287, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1724025828, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "a34b2460-afc2-411f-b42b-3eaf5296e0c5", "db_session_id": "9RP0LF9BNOUADXXFKUTQ", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-08-19T00:03:48.757 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724025828449560, "job": 1, "event": "recovery_finished"} 2024-08-19T00:03:48.757 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-08-19T00:03:48.757 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-08-19T00:03:48.757 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x56420946ee00 2024-08-19T00:03:48.757 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: DB pointer 0x564209568000 2024-08-19T00:03:48.757 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-08-19T00:03:48.757 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-08-19T00:03:48.757 INFO:journalctl@ceph.mon.a.smithi044.stdout: ** DB Stats ** 2024-08-19T00:03:48.757 INFO:journalctl@ceph.mon.a.smithi044.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-19T00:03:48.758 INFO:journalctl@ceph.mon.a.smithi044.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-08-19T00:03:48.758 INFO:journalctl@ceph.mon.a.smithi044.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-19T00:03:48.758 INFO:journalctl@ceph.mon.a.smithi044.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-19T00:03:48.758 INFO:journalctl@ceph.mon.a.smithi044.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-08-19T00:03:48.758 INFO:journalctl@ceph.mon.a.smithi044.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-19T00:03:48.758 INFO:journalctl@ceph.mon.a.smithi044.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-19T00:03:48.758 INFO:journalctl@ceph.mon.a.smithi044.stdout: 2024-08-19T00:03:48.758 INFO:journalctl@ceph.mon.a.smithi044.stdout: ** Compaction Stats [default] ** 2024-08-19T00:03:48.758 INFO:journalctl@ceph.mon.a.smithi044.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-19T00:03:48.758 INFO:journalctl@ceph.mon.a.smithi044.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-08-19T00:03:48.758 INFO:journalctl@ceph.mon.a.smithi044.stdout: L0 2/0 99.85 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 144.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-19T00:03:48.758 INFO:journalctl@ceph.mon.a.smithi044.stdout: Sum 2/0 99.85 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 144.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-19T00:03:48.759 INFO:journalctl@ceph.mon.a.smithi044.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 144.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-19T00:03:48.759 INFO:journalctl@ceph.mon.a.smithi044.stdout: 2024-08-19T00:03:48.759 INFO:journalctl@ceph.mon.a.smithi044.stdout: ** Compaction Stats [default] ** 2024-08-19T00:03:48.759 INFO:journalctl@ceph.mon.a.smithi044.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-19T00:03:48.759 INFO:journalctl@ceph.mon.a.smithi044.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-08-19T00:03:48.759 INFO:journalctl@ceph.mon.a.smithi044.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 144.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-19T00:03:48.759 INFO:journalctl@ceph.mon.a.smithi044.stdout: 2024-08-19T00:03:48.759 INFO:journalctl@ceph.mon.a.smithi044.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-08-19T00:03:48.759 INFO:journalctl@ceph.mon.a.smithi044.stdout: 2024-08-19T00:03:48.759 INFO:journalctl@ceph.mon.a.smithi044.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-19T00:03:48.759 INFO:journalctl@ceph.mon.a.smithi044.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-08-19T00:03:48.759 INFO:journalctl@ceph.mon.a.smithi044.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-08-19T00:03:48.759 INFO:journalctl@ceph.mon.a.smithi044.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-08-19T00:03:48.760 INFO:journalctl@ceph.mon.a.smithi044.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-08-19T00:03:48.760 INFO:journalctl@ceph.mon.a.smithi044.stdout: AddFile(Keys): cumulative 0, interval 0 2024-08-19T00:03:48.760 INFO:journalctl@ceph.mon.a.smithi044.stdout: Cumulative compaction: 0.00 GB write, 29.80 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-19T00:03:48.760 INFO:journalctl@ceph.mon.a.smithi044.stdout: Interval compaction: 0.00 GB write, 29.80 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-19T00:03:48.760 INFO:journalctl@ceph.mon.a.smithi044.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-08-19T00:03:48.760 INFO:journalctl@ceph.mon.a.smithi044.stdout: Block cache BinnedLRUCache@0x564209441090#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-08-19T00:03:48.760 INFO:journalctl@ceph.mon.a.smithi044.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-08-19T00:03:48.760 INFO:journalctl@ceph.mon.a.smithi044.stdout: 2024-08-19T00:03:48.760 INFO:journalctl@ceph.mon.a.smithi044.stdout: ** File Read Latency Histogram By Level [default] ** 2024-08-19T00:03:48.760 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: starting mon.a rank 0 at public addrs [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] at bind addrs [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 647ded64-5dbe-11ef-bccf-c7b262605968 2024-08-19T00:03:48.760 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: mon.a@-1(???) e1 preinit fsid 647ded64-5dbe-11ef-bccf-c7b262605968 2024-08-19T00:03:48.760 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: mon.a@-1(???).mds e1 new map 2024-08-19T00:03:48.760 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: mon.a@-1(???).mds e1 print_map 2024-08-19T00:03:48.760 INFO:journalctl@ceph.mon.a.smithi044.stdout: e1 2024-08-19T00:03:48.761 INFO:journalctl@ceph.mon.a.smithi044.stdout: btime 2024-08-19T00:03:43:667716+0000 2024-08-19T00:03:48.761 INFO:journalctl@ceph.mon.a.smithi044.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T00:03:48.761 INFO:journalctl@ceph.mon.a.smithi044.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-19T00:03:48.761 INFO:journalctl@ceph.mon.a.smithi044.stdout: legacy client fscid: -1 2024-08-19T00:03:48.761 INFO:journalctl@ceph.mon.a.smithi044.stdout: 2024-08-19T00:03:48.761 INFO:journalctl@ceph.mon.a.smithi044.stdout: No filesystems configured 2024-08-19T00:03:48.761 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-08-19T00:03:48.761 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-08-19T00:03:48.761 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-08-19T00:03:48.761 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-08-19T00:03:48.761 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-08-19T00:03:48.761 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 bash[18470]: c88c8e2b95d4f27928d02091762fa7eaed22ecd96f0a528af3eef69dd063d035 2024-08-19T00:03:48.761 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 systemd[1]: Started Ceph mon.a for 647ded64-5dbe-11ef-bccf-c7b262605968. 2024-08-19T00:03:48.762 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: mon.a is new leader, mons a in quorum (ranks 0) 2024-08-19T00:03:48.762 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: monmap epoch 1 2024-08-19T00:03:48.762 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: fsid 647ded64-5dbe-11ef-bccf-c7b262605968 2024-08-19T00:03:48.762 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: last_changed 2024-08-19T00:03:40.850741+0000 2024-08-19T00:03:48.762 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: created 2024-08-19T00:03:40.850741+0000 2024-08-19T00:03:48.762 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: min_mon_release 19 (squid) 2024-08-19T00:03:48.762 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: election_strategy: 1 2024-08-19T00:03:48.762 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: 0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-08-19T00:03:48.762 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: fsmap 2024-08-19T00:03:48.762 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: osdmap e1: 0 total, 0 up, 0 in 2024-08-19T00:03:48.762 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:48 smithi044 ceph-mon[18489]: mgrmap e1: no daemons active 2024-08-19T00:03:49.558 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:48.935+0000 7efec4da2640 1 Processor -- start 2024-08-19T00:03:49.559 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:48.935+0000 7efec4da2640 1 -- start start 2024-08-19T00:03:49.559 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:48.936+0000 7efec4da2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efec007bc60 0x7efec0109d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:03:49.559 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:48.936+0000 7efec4da2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7efec010a2e0 con 0x7efec007bc60 2024-08-19T00:03:49.559 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:48.936+0000 7efebf7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efec007bc60 0x7efec0109d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:03:49.559 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:48.936+0000 7efebf7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efec007bc60 0x7efec0109d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54162/0 (socket says 172.21.15.44:54162) 2024-08-19T00:03:49.559 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:48.936+0000 7efebf7fe640 1 -- 172.21.15.44:0/2193942670 learned_addr learned my addr 172.21.15.44:0/2193942670 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:03:49.559 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:48.936+0000 7efebf7fe640 1 -- 172.21.15.44:0/2193942670 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efec010a460 con 0x7efec007bc60 2024-08-19T00:03:49.559 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:48.938+0000 7efebf7fe640 1 --2- 172.21.15.44:0/2193942670 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efec007bc60 0x7efec0109d10 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7efeb0009820 tx=0x7efeb002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e66fe817e0236c5 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:03:49.559 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:48.938+0000 7efebe7fc640 1 -- 172.21.15.44:0/2193942670 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efeb0037070 con 0x7efec007bc60 2024-08-19T00:03:49.559 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:48.938+0000 7efebe7fc640 1 -- 172.21.15.44:0/2193942670 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efeb0032900 con 0x7efec007bc60 2024-08-19T00:03:49.560 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:48.938+0000 7efebe7fc640 1 -- 172.21.15.44:0/2193942670 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efeb0030850 con 0x7efec007bc60 2024-08-19T00:03:49.560 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:48.939+0000 7efec4da2640 1 -- 172.21.15.44:0/2193942670 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efec007bc60 msgr2=0x7efec0109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:03:49.560 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:48.939+0000 7efec4da2640 1 --2- 172.21.15.44:0/2193942670 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efec007bc60 0x7efec0109d10 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7efeb0009820 tx=0x7efeb002a270 comp rx=0 tx=0).stop 2024-08-19T00:03:49.560 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:48.939+0000 7efec4da2640 1 -- 172.21.15.44:0/2193942670 shutdown_connections 2024-08-19T00:03:49.560 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:48.939+0000 7efec4da2640 1 --2- 172.21.15.44:0/2193942670 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efec007bc60 0x7efec0109d10 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:03:49.560 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:48.939+0000 7efec4da2640 1 -- 172.21.15.44:0/2193942670 >> 172.21.15.44:0/2193942670 conn(0x7efec0101900 msgr2=0x7efec0103d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:03:49.560 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:48.939+0000 7efec4da2640 1 -- 172.21.15.44:0/2193942670 shutdown_connections 2024-08-19T00:03:49.560 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:48.939+0000 7efec4da2640 1 -- 172.21.15.44:0/2193942670 wait complete. 2024-08-19T00:03:49.560 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:48.940+0000 7efec4da2640 1 Processor -- start 2024-08-19T00:03:49.560 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:48.940+0000 7efec4da2640 1 -- start start 2024-08-19T00:03:49.560 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:48.940+0000 7efec4da2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efec007bc60 0x7efec019b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:03:49.560 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:48.940+0000 7efec4da2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7efec010b560 con 0x7efec007bc60 2024-08-19T00:03:49.560 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:48.940+0000 7efebf7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efec007bc60 0x7efec019b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:03:49.560 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:48.940+0000 7efebf7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efec007bc60 0x7efec019b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54170/0 (socket says 172.21.15.44:54170) 2024-08-19T00:03:49.561 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:48.940+0000 7efebf7fe640 1 -- 172.21.15.44:0/3289023291 learned_addr learned my addr 172.21.15.44:0/3289023291 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:03:49.561 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:48.940+0000 7efebf7fe640 1 -- 172.21.15.44:0/3289023291 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efec019b6e0 con 0x7efec007bc60 2024-08-19T00:03:49.561 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:48.941+0000 7efebf7fe640 1 --2- 172.21.15.44:0/3289023291 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efec007bc60 0x7efec019b1a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7efeb0031000 tx=0x7efeb00326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:03:49.561 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:48.941+0000 7efebcff9640 1 -- 172.21.15.44:0/3289023291 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efeb0042070 con 0x7efec007bc60 2024-08-19T00:03:49.561 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:48.941+0000 7efebcff9640 1 -- 172.21.15.44:0/3289023291 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efeb0032be0 con 0x7efec007bc60 2024-08-19T00:03:49.561 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:48.941+0000 7efec4da2640 1 -- 172.21.15.44:0/3289023291 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efec019b970 con 0x7efec007bc60 2024-08-19T00:03:49.561 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:48.941+0000 7efebcff9640 1 -- 172.21.15.44:0/3289023291 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efeb0037040 con 0x7efec007bc60 2024-08-19T00:03:49.561 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:48.941+0000 7efec4da2640 1 -- 172.21.15.44:0/3289023291 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efec019e660 con 0x7efec007bc60 2024-08-19T00:03:49.561 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:48.941+0000 7efebcff9640 1 -- 172.21.15.44:0/3289023291 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7efeb0045070 con 0x7efec007bc60 2024-08-19T00:03:49.561 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:48.941+0000 7efebcff9640 1 -- 172.21.15.44:0/3289023291 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7efeb0047b70 con 0x7efec007bc60 2024-08-19T00:03:49.561 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:48.942+0000 7efec4da2640 1 -- 172.21.15.44:0/3289023291 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efec0107d80 con 0x7efec007bc60 2024-08-19T00:03:49.561 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:48.944+0000 7efebcff9640 1 -- 172.21.15.44:0/3289023291 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73482 (secure 0 0 0) 0x7efeb004c030 con 0x7efec007bc60 2024-08-19T00:03:49.561 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:49.003+0000 7efec4da2640 1 -- 172.21.15.44:0/3289023291 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7efec0106080 con 0x7efec007bc60 2024-08-19T00:03:49.562 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:49.008+0000 7efebcff9640 1 -- 172.21.15.44:0/3289023291 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7efeb0032d90 con 0x7efec007bc60 2024-08-19T00:03:49.562 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:49.009+0000 7efec4da2640 1 -- 172.21.15.44:0/3289023291 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efec007bc60 msgr2=0x7efec019b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:03:49.562 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:49.009+0000 7efec4da2640 1 --2- 172.21.15.44:0/3289023291 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efec007bc60 0x7efec019b1a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7efeb0031000 tx=0x7efeb00326e0 comp rx=0 tx=0).stop 2024-08-19T00:03:49.562 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:49.009+0000 7efec4da2640 1 -- 172.21.15.44:0/3289023291 shutdown_connections 2024-08-19T00:03:49.562 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:49.009+0000 7efec4da2640 1 --2- 172.21.15.44:0/3289023291 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efec007bc60 0x7efec019b1a0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:03:49.562 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:49.009+0000 7efec4da2640 1 -- 172.21.15.44:0/3289023291 >> 172.21.15.44:0/3289023291 conn(0x7efec0101900 msgr2=0x7efec01024e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:03:49.562 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:49.009+0000 7efec4da2640 1 -- 172.21.15.44:0/3289023291 shutdown_connections 2024-08-19T00:03:49.562 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:49.009+0000 7efec4da2640 1 -- 172.21.15.44:0/3289023291 wait complete. 2024-08-19T00:03:49.562 INFO:teuthology.orchestra.run.smithi044.stdout:Wrote config to /etc/ceph/ceph.conf 2024-08-19T00:03:49.585 INFO:teuthology.orchestra.run.smithi044.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-08-19T00:03:49.585 INFO:teuthology.orchestra.run.smithi044.stdout:Creating mgr... 2024-08-19T00:03:49.585 INFO:teuthology.orchestra.run.smithi044.stdout:Verifying port 0.0.0.0:9283 ... 2024-08-19T00:03:49.586 INFO:teuthology.orchestra.run.smithi044.stdout:Verifying port 0.0.0.0:8765 ... 2024-08-19T00:03:49.836 INFO:teuthology.orchestra.run.smithi044.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mgr.x 2024-08-19T00:03:49.836 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stderr Failed to reset failed state of unit ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mgr.x.service: Unit ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mgr.x.service not loaded. 2024-08-19T00:03:49.988 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-647ded64-5dbe-11ef-bccf-c7b262605968.target.wants/ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-647ded64-5dbe-11ef-bccf-c7b262605968@.service. 2024-08-19T00:03:50.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:50 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/3289023291' entity='client.admin' 2024-08-19T00:03:50.119 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:03:50 smithi044 systemd[1]: Starting Ceph mgr.x for 647ded64-5dbe-11ef-bccf-c7b262605968... 2024-08-19T00:03:50.481 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:03:50 smithi044 podman[18702]: 2024-08-19 00:03:50.130749555 +0000 UTC m=+0.016932251 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-19T00:03:50.481 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:03:50 smithi044 podman[18702]: 2024-08-19 00:03:50.237118565 +0000 UTC m=+0.123301317 container create 1173df5df0ba273065b24c14635dc40ec5e482ed0be6c4a5e11c0cca74daf1e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-de09dd0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-19T00:03:50.481 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:03:50 smithi044 podman[18702]: 2024-08-19 00:03:50.431414461 +0000 UTC m=+0.317597173 container init 1173df5df0ba273065b24c14635dc40ec5e482ed0be6c4a5e11c0cca74daf1e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-de09dd0, GIT_CLEAN=True, io.buildah.version=1.36.0, ceph=True, org.label-schema.schema-version=1.0) 2024-08-19T00:03:50.481 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:03:50 smithi044 podman[18702]: 2024-08-19 00:03:50.434504894 +0000 UTC m=+0.320687599 container start 1173df5df0ba273065b24c14635dc40ec5e482ed0be6c4a5e11c0cca74daf1e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=squid-de09dd0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-08-19T00:03:50.481 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:03:50 smithi044 bash[18702]: 1173df5df0ba273065b24c14635dc40ec5e482ed0be6c4a5e11c0cca74daf1e5 2024-08-19T00:03:50.496 INFO:teuthology.orchestra.run.smithi044.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-19T00:03:50.497 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stdout disabled 2024-08-19T00:03:50.504 INFO:teuthology.orchestra.run.smithi044.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-19T00:03:50.504 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stdout inactive 2024-08-19T00:03:50.504 INFO:teuthology.orchestra.run.smithi044.stdout:firewalld.service is not enabled 2024-08-19T00:03:50.504 INFO:teuthology.orchestra.run.smithi044.stdout:Not possible to enable service . firewalld.service is not available 2024-08-19T00:03:50.513 INFO:teuthology.orchestra.run.smithi044.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-19T00:03:50.513 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stdout disabled 2024-08-19T00:03:50.520 INFO:teuthology.orchestra.run.smithi044.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-19T00:03:50.521 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stdout inactive 2024-08-19T00:03:50.521 INFO:teuthology.orchestra.run.smithi044.stdout:firewalld.service is not enabled 2024-08-19T00:03:50.521 INFO:teuthology.orchestra.run.smithi044.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-08-19T00:03:50.521 INFO:teuthology.orchestra.run.smithi044.stdout:Waiting for mgr to start... 2024-08-19T00:03:50.521 INFO:teuthology.orchestra.run.smithi044.stdout:Waiting for mgr... 2024-08-19T00:03:50.734 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:03:50 smithi044 systemd[1]: Started Ceph mgr.x for 647ded64-5dbe-11ef-bccf-c7b262605968. 2024-08-19T00:03:50.734 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:03:50 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:03:50.665+0000 7ff006473040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-19T00:03:51.000 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:03:50 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:03:50.736+0000 7ff006473040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-19T00:03:51.000 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:03:50 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:03:50.883+0000 7ff006473040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-19T00:03:51.312 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:51 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/2431682441' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-08-19T00:03:51.313 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:03:51 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:03:51.055+0000 7ff006473040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-19T00:03:51.313 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:03:51 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:03:51.203+0000 7ff006473040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-19T00:03:51.619 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:03:51 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:03:51.334+0000 7ff006473040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-19T00:03:51.619 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:03:51 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:03:51.463+0000 7ff006473040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-19T00:03:51.619 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:03:51 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:03:51.522+0000 7ff006473040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-19T00:03:51.643 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 2024-08-19T00:03:51.643 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout { 2024-08-19T00:03:51.643 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "fsid": "647ded64-5dbe-11ef-bccf-c7b262605968", 2024-08-19T00:03:51.643 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "health": { 2024-08-19T00:03:51.643 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-08-19T00:03:51.643 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-08-19T00:03:51.643 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-08-19T00:03:51.643 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-08-19T00:03:51.644 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-08-19T00:03:51.644 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-08-19T00:03:51.644 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 0 2024-08-19T00:03:51.644 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout ], 2024-08-19T00:03:51.644 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-08-19T00:03:51.644 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "a" 2024-08-19T00:03:51.644 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout ], 2024-08-19T00:03:51.644 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-08-19T00:03:51.644 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "monmap": { 2024-08-19T00:03:51.644 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-19T00:03:51.644 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-08-19T00:03:51.644 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-08-19T00:03:51.644 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-08-19T00:03:51.644 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-08-19T00:03:51.645 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-19T00:03:51.645 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-08-19T00:03:51.645 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-08-19T00:03:51.645 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-08-19T00:03:51.652 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-08-19T00:03:51.652 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-08-19T00:03:51.652 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-08-19T00:03:51.652 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-08-19T00:03:51.652 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-08-19T00:03:51.653 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-08-19T00:03:51.653 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-08-19T00:03:51.653 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-08-19T00:03:51.653 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-08-19T00:03:51.653 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-08-19T00:03:51.653 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-08-19T00:03:51.653 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-08-19T00:03:51.653 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-08-19T00:03:51.653 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-08-19T00:03:51.653 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-08-19T00:03:51.653 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-19T00:03:51.653 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "btime": "2024-08-19T00:03:43:667716+0000", 2024-08-19T00:03:51.653 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-08-19T00:03:51.654 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-08-19T00:03:51.654 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-08-19T00:03:51.654 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-08-19T00:03:51.654 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "available": false, 2024-08-19T00:03:51.654 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-08-19T00:03:51.654 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "modules": [ 2024-08-19T00:03:51.654 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "iostat", 2024-08-19T00:03:51.654 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "nfs", 2024-08-19T00:03:51.654 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "restful" 2024-08-19T00:03:51.654 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout ], 2024-08-19T00:03:51.654 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-19T00:03:51.654 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-08-19T00:03:51.655 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-08-19T00:03:51.655 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-19T00:03:51.655 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "modified": "2024-08-19T00:03:43.668414+0000", 2024-08-19T00:03:51.655 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-19T00:03:51.655 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-08-19T00:03:51.655 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-08-19T00:03:51.655 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout } 2024-08-19T00:03:51.655 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:50.929+0000 7f31825c0640 1 Processor -- start 2024-08-19T00:03:51.655 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:50.930+0000 7f31825c0640 1 -- start start 2024-08-19T00:03:51.655 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:50.930+0000 7f31825c0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f317c105600 0x7f317c105a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:03:51.655 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:50.930+0000 7f31825c0640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f317c105fd0 con 0x7f317c105600 2024-08-19T00:03:51.655 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:50.930+0000 7f317bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f317c105600 0x7f317c105a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:03:51.655 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:50.930+0000 7f317bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f317c105600 0x7f317c105a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54186/0 (socket says 172.21.15.44:54186) 2024-08-19T00:03:51.655 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:50.930+0000 7f317bfff640 1 -- 172.21.15.44:0/2301088991 learned_addr learned my addr 172.21.15.44:0/2301088991 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:03:51.656 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:50.930+0000 7f317bfff640 1 -- 172.21.15.44:0/2301088991 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f317c1085e0 con 0x7f317c105600 2024-08-19T00:03:51.656 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:50.931+0000 7f317bfff640 1 --2- 172.21.15.44:0/2301088991 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f317c105600 0x7f317c105a00 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f316c009820 tx=0x7f316c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1378c21cec3d4902 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:03:51.656 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:50.931+0000 7f317affd640 1 -- 172.21.15.44:0/2301088991 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f316c037070 con 0x7f317c105600 2024-08-19T00:03:51.656 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:50.931+0000 7f317affd640 1 -- 172.21.15.44:0/2301088991 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f316c032900 con 0x7f317c105600 2024-08-19T00:03:51.656 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:50.931+0000 7f317affd640 1 -- 172.21.15.44:0/2301088991 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f316c030850 con 0x7f317c105600 2024-08-19T00:03:51.656 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:50.932+0000 7f31825c0640 1 -- 172.21.15.44:0/2301088991 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f317c105600 msgr2=0x7f317c105a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:03:51.656 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:50.932+0000 7f31825c0640 1 --2- 172.21.15.44:0/2301088991 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f317c105600 0x7f317c105a00 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f316c009820 tx=0x7f316c02a270 comp rx=0 tx=0).stop 2024-08-19T00:03:51.656 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:50.932+0000 7f31825c0640 1 -- 172.21.15.44:0/2301088991 shutdown_connections 2024-08-19T00:03:51.656 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:50.932+0000 7f31825c0640 1 --2- 172.21.15.44:0/2301088991 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f317c105600 0x7f317c105a00 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:03:51.656 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:50.932+0000 7f31825c0640 1 -- 172.21.15.44:0/2301088991 >> 172.21.15.44:0/2301088991 conn(0x7f317c101150 msgr2=0x7f317c103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:03:51.656 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:50.932+0000 7f31825c0640 1 -- 172.21.15.44:0/2301088991 shutdown_connections 2024-08-19T00:03:51.656 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:50.932+0000 7f31825c0640 1 -- 172.21.15.44:0/2301088991 wait complete. 2024-08-19T00:03:51.656 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:50.933+0000 7f31825c0640 1 Processor -- start 2024-08-19T00:03:51.657 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:50.933+0000 7f31825c0640 1 -- start start 2024-08-19T00:03:51.657 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:50.933+0000 7f31825c0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f317c105600 0x7f317c107e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:03:51.657 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:50.933+0000 7f31825c0640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f317c10b810 con 0x7f317c105600 2024-08-19T00:03:51.657 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:50.933+0000 7f317bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f317c105600 0x7f317c107e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:03:51.657 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:50.933+0000 7f317bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f317c105600 0x7f317c107e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54198/0 (socket says 172.21.15.44:54198) 2024-08-19T00:03:51.657 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:50.933+0000 7f317bfff640 1 -- 172.21.15.44:0/2431682441 learned_addr learned my addr 172.21.15.44:0/2431682441 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:03:51.657 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:50.933+0000 7f317bfff640 1 -- 172.21.15.44:0/2431682441 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f317c1083a0 con 0x7f317c105600 2024-08-19T00:03:51.657 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:50.934+0000 7f317bfff640 1 --2- 172.21.15.44:0/2431682441 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f317c105600 0x7f317c107e60 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f316c0097f0 tx=0x7f316c030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:03:51.657 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:50.934+0000 7f31797fa640 1 -- 172.21.15.44:0/2431682441 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f316c037040 con 0x7f317c105600 2024-08-19T00:03:51.657 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:50.934+0000 7f31797fa640 1 -- 172.21.15.44:0/2431682441 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f316c040070 con 0x7f317c105600 2024-08-19T00:03:51.657 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:50.934+0000 7f31797fa640 1 -- 172.21.15.44:0/2431682441 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f316c03a390 con 0x7f317c105600 2024-08-19T00:03:51.657 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:50.934+0000 7f31825c0640 1 -- 172.21.15.44:0/2431682441 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f317c106590 con 0x7f317c105600 2024-08-19T00:03:51.657 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:50.934+0000 7f31825c0640 1 -- 172.21.15.44:0/2431682441 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f317c106a70 con 0x7f317c105600 2024-08-19T00:03:51.658 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:50.934+0000 7f31797fa640 1 -- 172.21.15.44:0/2431682441 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f316c03a5e0 con 0x7f317c105600 2024-08-19T00:03:51.658 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:50.934+0000 7f31797fa640 1 -- 172.21.15.44:0/2431682441 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f316c045950 con 0x7f317c105600 2024-08-19T00:03:51.658 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:50.935+0000 7f31825c0640 1 -- 172.21.15.44:0/2431682441 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f317c105a80 con 0x7f317c105600 2024-08-19T00:03:51.658 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:50.937+0000 7f31797fa640 1 -- 172.21.15.44:0/2431682441 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73482 (secure 0 0 0) 0x7f316c045460 con 0x7f317c105600 2024-08-19T00:03:51.658 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:50.998+0000 7f31825c0640 1 -- 172.21.15.44:0/2431682441 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f317c106db0 con 0x7f317c105600 2024-08-19T00:03:51.658 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:50.999+0000 7f31797fa640 1 -- 172.21.15.44:0/2431682441 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f316c03b430 con 0x7f317c105600 2024-08-19T00:03:51.658 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:51.000+0000 7f31825c0640 1 -- 172.21.15.44:0/2431682441 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f317c105600 msgr2=0x7f317c107e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:03:51.658 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:51.000+0000 7f31825c0640 1 --2- 172.21.15.44:0/2431682441 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f317c105600 0x7f317c107e60 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f316c0097f0 tx=0x7f316c030d80 comp rx=0 tx=0).stop 2024-08-19T00:03:51.658 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:51.001+0000 7f31825c0640 1 -- 172.21.15.44:0/2431682441 shutdown_connections 2024-08-19T00:03:51.658 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:51.001+0000 7f31825c0640 1 --2- 172.21.15.44:0/2431682441 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f317c105600 0x7f317c107e60 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:03:51.658 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:51.001+0000 7f31825c0640 1 -- 172.21.15.44:0/2431682441 >> 172.21.15.44:0/2431682441 conn(0x7f317c101150 msgr2=0x7f317c101d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:03:51.658 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:51.001+0000 7f31825c0640 1 -- 172.21.15.44:0/2431682441 shutdown_connections 2024-08-19T00:03:51.659 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:51.001+0000 7f31825c0640 1 -- 172.21.15.44:0/2431682441 wait complete. 2024-08-19T00:03:51.659 INFO:teuthology.orchestra.run.smithi044.stdout:mgr not available, waiting (1/15)... 2024-08-19T00:03:51.900 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:03:51 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:03:51.836+0000 7ff006473040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-19T00:03:51.900 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:03:51 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:03:51.899+0000 7ff006473040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-19T00:03:52.184 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:03:51 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:03:51.968+0000 7ff006473040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-19T00:03:52.184 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:03:52 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:03:52.121+0000 7ff006473040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-08-19T00:03:52.184 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:03:52 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:03:52.182+0000 7ff006473040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-19T00:03:52.444 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:03:52 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:03:52.250+0000 7ff006473040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-19T00:03:52.444 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:03:52 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:03:52.442+0000 7ff006473040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-19T00:03:52.856 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:03:52 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:03:52.504+0000 7ff006473040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-19T00:03:52.856 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:03:52 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:03:52.566+0000 7ff006473040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-19T00:03:52.856 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:03:52 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:03:52.635+0000 7ff006473040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-19T00:03:53.119 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:03:52 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:03:52.854+0000 7ff006473040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-19T00:03:53.119 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:03:52 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:03:52.915+0000 7ff006473040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-19T00:03:53.755 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:03:53 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:03:53.460+0000 7ff006473040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-19T00:03:54.016 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:03:53 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:03:53.791+0000 7ff006473040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-19T00:03:54.291 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:54 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/1903838167' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-08-19T00:03:54.292 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:03:54 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:03:54.232+0000 7ff006473040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-19T00:03:54.292 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:03:54 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:03:54.290+0000 7ff006473040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-19T00:03:54.619 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:03:54 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:03:54.352+0000 7ff006473040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-19T00:03:54.647 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 2024-08-19T00:03:54.657 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout { 2024-08-19T00:03:54.657 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "fsid": "647ded64-5dbe-11ef-bccf-c7b262605968", 2024-08-19T00:03:54.658 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "health": { 2024-08-19T00:03:54.658 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-08-19T00:03:54.658 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-08-19T00:03:54.658 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-08-19T00:03:54.658 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-08-19T00:03:54.658 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-08-19T00:03:54.658 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-08-19T00:03:54.658 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 0 2024-08-19T00:03:54.658 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout ], 2024-08-19T00:03:54.658 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-08-19T00:03:54.658 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "a" 2024-08-19T00:03:54.658 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout ], 2024-08-19T00:03:54.659 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-08-19T00:03:54.659 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "monmap": { 2024-08-19T00:03:54.659 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-19T00:03:54.659 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-08-19T00:03:54.659 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-08-19T00:03:54.659 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-08-19T00:03:54.659 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-08-19T00:03:54.659 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-19T00:03:54.659 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-08-19T00:03:54.659 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-08-19T00:03:54.659 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-08-19T00:03:54.659 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-08-19T00:03:54.659 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-08-19T00:03:54.659 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-08-19T00:03:54.660 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-08-19T00:03:54.660 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-08-19T00:03:54.660 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-08-19T00:03:54.660 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-08-19T00:03:54.660 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-08-19T00:03:54.660 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-08-19T00:03:54.660 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-08-19T00:03:54.660 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-08-19T00:03:54.660 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-08-19T00:03:54.660 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-08-19T00:03:54.660 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-08-19T00:03:54.660 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-08-19T00:03:54.661 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-19T00:03:54.661 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "btime": "2024-08-19T00:03:43:667716+0000", 2024-08-19T00:03:54.661 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-08-19T00:03:54.661 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-08-19T00:03:54.661 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-08-19T00:03:54.661 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-08-19T00:03:54.661 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "available": false, 2024-08-19T00:03:54.661 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-08-19T00:03:54.661 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "modules": [ 2024-08-19T00:03:54.661 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "iostat", 2024-08-19T00:03:54.661 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "nfs", 2024-08-19T00:03:54.661 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "restful" 2024-08-19T00:03:54.661 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout ], 2024-08-19T00:03:54.661 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-19T00:03:54.662 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-08-19T00:03:54.662 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-08-19T00:03:54.662 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-19T00:03:54.662 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "modified": "2024-08-19T00:03:43.668414+0000", 2024-08-19T00:03:54.662 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-19T00:03:54.662 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-08-19T00:03:54.662 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-08-19T00:03:54.662 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout } 2024-08-19T00:03:54.662 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:54.016+0000 7fcc94cd9640 1 Processor -- start 2024-08-19T00:03:54.662 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:54.016+0000 7fcc94cd9640 1 -- start start 2024-08-19T00:03:54.662 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:54.016+0000 7fcc94cd9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc901061f0 0x7fcc901065f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:03:54.662 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:54.016+0000 7fcc94cd9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fcc90106bc0 con 0x7fcc901061f0 2024-08-19T00:03:54.662 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:54.017+0000 7fcc8e59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc901061f0 0x7fcc901065f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:03:54.663 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:54.017+0000 7fcc8e59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc901061f0 0x7fcc901065f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54214/0 (socket says 172.21.15.44:54214) 2024-08-19T00:03:54.663 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:54.017+0000 7fcc8e59c640 1 -- 172.21.15.44:0/1874325793 learned_addr learned my addr 172.21.15.44:0/1874325793 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:03:54.663 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:54.017+0000 7fcc8e59c640 1 -- 172.21.15.44:0/1874325793 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc901073f0 con 0x7fcc901061f0 2024-08-19T00:03:54.663 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:54.018+0000 7fcc8e59c640 1 --2- 172.21.15.44:0/1874325793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc901061f0 0x7fcc901065f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcc88009e80 tx=0x7fcc8802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea3849da0213a967 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:03:54.663 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:54.018+0000 7fcc8d59a640 1 -- 172.21.15.44:0/1874325793 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc88036070 con 0x7fcc901061f0 2024-08-19T00:03:54.663 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:54.018+0000 7fcc8d59a640 1 -- 172.21.15.44:0/1874325793 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcc880318c0 con 0x7fcc901061f0 2024-08-19T00:03:54.663 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:54.018+0000 7fcc8d59a640 1 -- 172.21.15.44:0/1874325793 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc88007ab0 con 0x7fcc901061f0 2024-08-19T00:03:54.663 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:54.018+0000 7fcc94cd9640 1 -- 172.21.15.44:0/1874325793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc901061f0 msgr2=0x7fcc901065f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:03:54.663 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:54.018+0000 7fcc94cd9640 1 --2- 172.21.15.44:0/1874325793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc901061f0 0x7fcc901065f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcc88009e80 tx=0x7fcc8802a7a0 comp rx=0 tx=0).stop 2024-08-19T00:03:54.663 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:54.019+0000 7fcc94cd9640 1 -- 172.21.15.44:0/1874325793 shutdown_connections 2024-08-19T00:03:54.663 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:54.019+0000 7fcc94cd9640 1 --2- 172.21.15.44:0/1874325793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc901061f0 0x7fcc901065f0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:03:54.663 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:54.019+0000 7fcc94cd9640 1 -- 172.21.15.44:0/1874325793 >> 172.21.15.44:0/1874325793 conn(0x7fcc90101a00 msgr2=0x7fcc90103e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:03:54.663 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:54.019+0000 7fcc94cd9640 1 -- 172.21.15.44:0/1874325793 shutdown_connections 2024-08-19T00:03:54.664 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:54.019+0000 7fcc94cd9640 1 -- 172.21.15.44:0/1874325793 wait complete. 2024-08-19T00:03:54.664 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:54.019+0000 7fcc94cd9640 1 Processor -- start 2024-08-19T00:03:54.664 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:54.019+0000 7fcc94cd9640 1 -- start start 2024-08-19T00:03:54.664 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:54.020+0000 7fcc94cd9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc901061f0 0x7fcc9019d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:03:54.664 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:54.020+0000 7fcc94cd9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fcc9010a7a0 con 0x7fcc901061f0 2024-08-19T00:03:54.664 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:54.020+0000 7fcc8e59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc901061f0 0x7fcc9019d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:03:54.664 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:54.020+0000 7fcc8e59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc901061f0 0x7fcc9019d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54230/0 (socket says 172.21.15.44:54230) 2024-08-19T00:03:54.664 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:54.020+0000 7fcc8e59c640 1 -- 172.21.15.44:0/1903838167 learned_addr learned my addr 172.21.15.44:0/1903838167 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:03:54.664 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:54.020+0000 7fcc8e59c640 1 -- 172.21.15.44:0/1903838167 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc9019dac0 con 0x7fcc901061f0 2024-08-19T00:03:54.664 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:54.020+0000 7fcc8e59c640 1 --2- 172.21.15.44:0/1903838167 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc901061f0 0x7fcc9019d580 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcc8802acc0 tx=0x7fcc88031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:03:54.664 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:54.020+0000 7fcc877fe640 1 -- 172.21.15.44:0/1903838167 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc88036050 con 0x7fcc901061f0 2024-08-19T00:03:54.664 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:54.020+0000 7fcc877fe640 1 -- 172.21.15.44:0/1903838167 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcc88037040 con 0x7fcc901061f0 2024-08-19T00:03:54.664 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:54.020+0000 7fcc94cd9640 1 -- 172.21.15.44:0/1903838167 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc9019dd50 con 0x7fcc901061f0 2024-08-19T00:03:54.664 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:54.020+0000 7fcc877fe640 1 -- 172.21.15.44:0/1903838167 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc8803d8c0 con 0x7fcc901061f0 2024-08-19T00:03:54.665 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:54.020+0000 7fcc94cd9640 1 -- 172.21.15.44:0/1903838167 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc901a0a40 con 0x7fcc901061f0 2024-08-19T00:03:54.665 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:54.021+0000 7fcc877fe640 1 -- 172.21.15.44:0/1903838167 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fcc88044020 con 0x7fcc901061f0 2024-08-19T00:03:54.665 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:54.021+0000 7fcc877fe640 1 -- 172.21.15.44:0/1903838167 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fcc88042020 con 0x7fcc901061f0 2024-08-19T00:03:54.665 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:54.021+0000 7fcc94cd9640 1 -- 172.21.15.44:0/1903838167 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc9010a920 con 0x7fcc901061f0 2024-08-19T00:03:54.665 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:54.023+0000 7fcc877fe640 1 -- 172.21.15.44:0/1903838167 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73482 (secure 0 0 0) 0x7fcc8804b020 con 0x7fcc901061f0 2024-08-19T00:03:54.665 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:54.085+0000 7fcc94cd9640 1 -- 172.21.15.44:0/1903838167 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fcc9002d810 con 0x7fcc901061f0 2024-08-19T00:03:54.665 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:54.086+0000 7fcc877fe640 1 -- 172.21.15.44:0/1903838167 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7fcc880073b0 con 0x7fcc901061f0 2024-08-19T00:03:54.665 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:54.087+0000 7fcc94cd9640 1 -- 172.21.15.44:0/1903838167 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc901061f0 msgr2=0x7fcc9019d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:03:54.665 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:54.087+0000 7fcc94cd9640 1 --2- 172.21.15.44:0/1903838167 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc901061f0 0x7fcc9019d580 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcc8802acc0 tx=0x7fcc88031ca0 comp rx=0 tx=0).stop 2024-08-19T00:03:54.665 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:54.087+0000 7fcc94cd9640 1 -- 172.21.15.44:0/1903838167 shutdown_connections 2024-08-19T00:03:54.665 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:54.087+0000 7fcc94cd9640 1 --2- 172.21.15.44:0/1903838167 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc901061f0 0x7fcc9019d580 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:03:54.665 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:54.087+0000 7fcc94cd9640 1 -- 172.21.15.44:0/1903838167 >> 172.21.15.44:0/1903838167 conn(0x7fcc90101a00 msgr2=0x7fcc90102940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:03:54.665 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:54.087+0000 7fcc94cd9640 1 -- 172.21.15.44:0/1903838167 shutdown_connections 2024-08-19T00:03:54.666 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:54.087+0000 7fcc94cd9640 1 -- 172.21.15.44:0/1903838167 wait complete. 2024-08-19T00:03:54.666 INFO:teuthology.orchestra.run.smithi044.stdout:mgr not available, waiting (2/15)... 2024-08-19T00:03:55.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:55 smithi044 ceph-mon[18489]: Activating manager daemon x 2024-08-19T00:03:55.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:55 smithi044 ceph-mon[18489]: mgrmap e2: x(active, starting, since 0.00288741s) 2024-08-19T00:03:55.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:55 smithi044 ceph-mon[18489]: from='mgr.14100 172.21.15.44:0/1707818348' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-19T00:03:55.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:55 smithi044 ceph-mon[18489]: from='mgr.14100 172.21.15.44:0/1707818348' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-19T00:03:55.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:55 smithi044 ceph-mon[18489]: from='mgr.14100 172.21.15.44:0/1707818348' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-19T00:03:55.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:55 smithi044 ceph-mon[18489]: from='mgr.14100 172.21.15.44:0/1707818348' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-19T00:03:55.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:55 smithi044 ceph-mon[18489]: from='mgr.14100 172.21.15.44:0/1707818348' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-08-19T00:03:55.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:55 smithi044 ceph-mon[18489]: Manager daemon x is now available 2024-08-19T00:03:55.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:55 smithi044 ceph-mon[18489]: from='mgr.14100 172.21.15.44:0/1707818348' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-08-19T00:03:55.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:55 smithi044 ceph-mon[18489]: from='mgr.14100 172.21.15.44:0/1707818348' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-08-19T00:03:55.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:55 smithi044 ceph-mon[18489]: from='mgr.14100 172.21.15.44:0/1707818348' entity='mgr.x' 2024-08-19T00:03:55.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:55 smithi044 ceph-mon[18489]: from='mgr.14100 172.21.15.44:0/1707818348' entity='mgr.x' 2024-08-19T00:03:55.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:55 smithi044 ceph-mon[18489]: from='mgr.14100 172.21.15.44:0/1707818348' entity='mgr.x' 2024-08-19T00:03:57.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:57 smithi044 ceph-mon[18489]: mgrmap e3: x(active, since 1.00677s) 2024-08-19T00:03:57.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:57 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/148694634' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-08-19T00:03:58.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:03:58 smithi044 ceph-mon[18489]: mgrmap e4: x(active, since 2s) 2024-08-19T00:03:59.755 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 2024-08-19T00:03:59.756 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout { 2024-08-19T00:03:59.756 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "fsid": "647ded64-5dbe-11ef-bccf-c7b262605968", 2024-08-19T00:03:59.756 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "health": { 2024-08-19T00:03:59.756 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-08-19T00:03:59.756 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-08-19T00:03:59.756 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-08-19T00:03:59.756 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-08-19T00:03:59.756 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-08-19T00:03:59.756 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-08-19T00:03:59.756 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 0 2024-08-19T00:03:59.756 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout ], 2024-08-19T00:03:59.757 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-08-19T00:03:59.757 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "a" 2024-08-19T00:03:59.757 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout ], 2024-08-19T00:03:59.757 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-08-19T00:03:59.757 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "monmap": { 2024-08-19T00:03:59.757 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-19T00:03:59.757 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-08-19T00:03:59.757 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-08-19T00:03:59.757 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-08-19T00:03:59.757 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-08-19T00:03:59.757 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-19T00:03:59.757 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-08-19T00:03:59.757 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-08-19T00:03:59.758 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-08-19T00:03:59.766 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-08-19T00:03:59.766 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-08-19T00:03:59.766 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-08-19T00:03:59.766 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-08-19T00:03:59.767 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-08-19T00:03:59.767 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-08-19T00:03:59.767 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-08-19T00:03:59.767 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-08-19T00:03:59.767 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-08-19T00:03:59.767 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-08-19T00:03:59.767 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-08-19T00:03:59.767 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-08-19T00:03:59.767 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-08-19T00:03:59.767 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-08-19T00:03:59.767 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-08-19T00:03:59.767 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-19T00:03:59.767 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "btime": "2024-08-19T00:03:43:667716+0000", 2024-08-19T00:03:59.767 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-08-19T00:03:59.768 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-08-19T00:03:59.768 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-08-19T00:03:59.768 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-08-19T00:03:59.768 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "available": true, 2024-08-19T00:03:59.768 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-08-19T00:03:59.768 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "modules": [ 2024-08-19T00:03:59.768 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "iostat", 2024-08-19T00:03:59.768 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "nfs", 2024-08-19T00:03:59.768 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "restful" 2024-08-19T00:03:59.768 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout ], 2024-08-19T00:03:59.768 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-19T00:03:59.768 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-08-19T00:03:59.768 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-08-19T00:03:59.769 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-19T00:03:59.769 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "modified": "2024-08-19T00:03:43.668414+0000", 2024-08-19T00:03:59.769 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-19T00:03:59.769 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-08-19T00:03:59.769 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-08-19T00:03:59.769 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout } 2024-08-19T00:03:59.769 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:57.046+0000 7f177478e640 1 Processor -- start 2024-08-19T00:03:59.769 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:57.046+0000 7f177478e640 1 -- start start 2024-08-19T00:03:59.769 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:57.046+0000 7f177478e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f176c106290 0x7f176c106690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:03:59.769 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:57.046+0000 7f177478e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f176c106c60 con 0x7f176c106290 2024-08-19T00:03:59.769 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:57.046+0000 7f177252a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f176c106290 0x7f176c106690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:03:59.769 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:57.046+0000 7f177252a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f176c106290 0x7f176c106690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54292/0 (socket says 172.21.15.44:54292) 2024-08-19T00:03:59.769 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:57.046+0000 7f177252a640 1 -- 172.21.15.44:0/1632794436 learned_addr learned my addr 172.21.15.44:0/1632794436 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:03:59.770 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:57.047+0000 7f177252a640 1 -- 172.21.15.44:0/1632794436 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f176c107440 con 0x7f176c106290 2024-08-19T00:03:59.770 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:57.047+0000 7f177252a640 1 --2- 172.21.15.44:0/1632794436 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f176c106290 0x7f176c106690 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1768009820 tx=0x7f176802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18f0dd9d77080343 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:03:59.770 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:57.047+0000 7f1771528640 1 -- 172.21.15.44:0/1632794436 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1768037070 con 0x7f176c106290 2024-08-19T00:03:59.770 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:57.048+0000 7f1771528640 1 -- 172.21.15.44:0/1632794436 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1768032900 con 0x7f176c106290 2024-08-19T00:03:59.770 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:57.048+0000 7f1771528640 1 -- 172.21.15.44:0/1632794436 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1768030850 con 0x7f176c106290 2024-08-19T00:03:59.770 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:57.048+0000 7f177478e640 1 -- 172.21.15.44:0/1632794436 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f176c106290 msgr2=0x7f176c106690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:03:59.770 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:57.048+0000 7f177478e640 1 --2- 172.21.15.44:0/1632794436 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f176c106290 0x7f176c106690 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1768009820 tx=0x7f176802a270 comp rx=0 tx=0).stop 2024-08-19T00:03:59.770 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:57.048+0000 7f177478e640 1 -- 172.21.15.44:0/1632794436 shutdown_connections 2024-08-19T00:03:59.770 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:57.048+0000 7f177478e640 1 --2- 172.21.15.44:0/1632794436 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f176c106290 0x7f176c106690 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:03:59.770 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:57.048+0000 7f177478e640 1 -- 172.21.15.44:0/1632794436 >> 172.21.15.44:0/1632794436 conn(0x7f176c101ac0 msgr2=0x7f176c103ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:03:59.770 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:57.048+0000 7f177478e640 1 -- 172.21.15.44:0/1632794436 shutdown_connections 2024-08-19T00:03:59.770 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:57.048+0000 7f177478e640 1 -- 172.21.15.44:0/1632794436 wait complete. 2024-08-19T00:03:59.771 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:57.049+0000 7f177478e640 1 Processor -- start 2024-08-19T00:03:59.771 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:57.049+0000 7f177478e640 1 -- start start 2024-08-19T00:03:59.771 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:57.049+0000 7f177478e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f176c106290 0x7f176c07b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:03:59.771 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:57.049+0000 7f177478e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f176c10a7f0 con 0x7f176c106290 2024-08-19T00:03:59.771 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:57.049+0000 7f177252a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f176c106290 0x7f176c07b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:03:59.771 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:57.049+0000 7f177252a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f176c106290 0x7f176c07b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54296/0 (socket says 172.21.15.44:54296) 2024-08-19T00:03:59.771 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:57.049+0000 7f177252a640 1 -- 172.21.15.44:0/148694634 learned_addr learned my addr 172.21.15.44:0/148694634 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:03:59.771 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:57.049+0000 7f177252a640 1 -- 172.21.15.44:0/148694634 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f176c19e060 con 0x7f176c106290 2024-08-19T00:03:59.771 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:57.050+0000 7f177252a640 1 --2- 172.21.15.44:0/148694634 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f176c106290 0x7f176c07b9d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1768009940 tx=0x7f1768032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:03:59.771 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:57.050+0000 7f17637fe640 1 -- 172.21.15.44:0/148694634 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1768042070 con 0x7f176c106290 2024-08-19T00:03:59.771 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:57.050+0000 7f17637fe640 1 -- 172.21.15.44:0/148694634 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f17680308c0 con 0x7f176c106290 2024-08-19T00:03:59.771 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:57.050+0000 7f177478e640 1 -- 172.21.15.44:0/148694634 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f176c19e230 con 0x7f176c106290 2024-08-19T00:03:59.771 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:57.050+0000 7f17637fe640 1 -- 172.21.15.44:0/148694634 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1768037040 con 0x7f176c106290 2024-08-19T00:03:59.771 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:57.050+0000 7f177478e640 1 -- 172.21.15.44:0/148694634 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f176c19e5d0 con 0x7f176c106290 2024-08-19T00:03:59.772 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:57.051+0000 7f17637fe640 1 -- 172.21.15.44:0/148694634 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 3) ==== 46170+0+0 (secure 0 0 0) 0x7f1768045070 con 0x7f176c106290 2024-08-19T00:03:59.772 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:57.051+0000 7f17637fe640 1 --2- 172.21.15.44:0/148694634 >> [v2:172.21.15.44:6800/1374527587,v1:172.21.15.44:6801/1374527587] conn(0x7f1758038e10 0x7f175803b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:03:59.772 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:57.051+0000 7f177478e640 1 -- 172.21.15.44:0/148694634 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f176c10a970 con 0x7f176c106290 2024-08-19T00:03:59.772 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:57.051+0000 7f17637fe640 1 -- 172.21.15.44:0/148694634 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f176806bdd0 con 0x7f176c106290 2024-08-19T00:03:59.772 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:57.051+0000 7f1771d29640 1 --2- 172.21.15.44:0/148694634 >> [v2:172.21.15.44:6800/1374527587,v1:172.21.15.44:6801/1374527587] conn(0x7f1758038e10 0x7f175803b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:03:59.772 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:57.052+0000 7f1771d29640 1 --2- 172.21.15.44:0/148694634 >> [v2:172.21.15.44:6800/1374527587,v1:172.21.15.44:6801/1374527587] conn(0x7f1758038e10 0x7f175803b2d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f175c0098c0 tx=0x7f175c006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:03:59.772 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:57.056+0000 7f17637fe640 1 -- 172.21.15.44:0/148694634 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f176803cd90 con 0x7f176c106290 2024-08-19T00:03:59.772 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:57.296+0000 7f177478e640 1 -- 172.21.15.44:0/148694634 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f176c106710 con 0x7f176c106290 2024-08-19T00:03:59.772 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:57.296+0000 7f17637fe640 1 -- 172.21.15.44:0/148694634 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1290 (secure 0 0 0) 0x7f176803c820 con 0x7f176c106290 2024-08-19T00:03:59.772 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:57.298+0000 7f177478e640 1 -- 172.21.15.44:0/148694634 >> [v2:172.21.15.44:6800/1374527587,v1:172.21.15.44:6801/1374527587] conn(0x7f1758038e10 msgr2=0x7f175803b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:03:59.772 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:57.298+0000 7f177478e640 1 --2- 172.21.15.44:0/148694634 >> [v2:172.21.15.44:6800/1374527587,v1:172.21.15.44:6801/1374527587] conn(0x7f1758038e10 0x7f175803b2d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f175c0098c0 tx=0x7f175c006db0 comp rx=0 tx=0).stop 2024-08-19T00:03:59.772 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:57.298+0000 7f177478e640 1 -- 172.21.15.44:0/148694634 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f176c106290 msgr2=0x7f176c07b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:03:59.772 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:57.298+0000 7f177478e640 1 --2- 172.21.15.44:0/148694634 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f176c106290 0x7f176c07b9d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1768009940 tx=0x7f1768032ce0 comp rx=0 tx=0).stop 2024-08-19T00:03:59.772 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:57.299+0000 7f177478e640 1 -- 172.21.15.44:0/148694634 shutdown_connections 2024-08-19T00:03:59.773 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:57.299+0000 7f177478e640 1 --2- 172.21.15.44:0/148694634 >> [v2:172.21.15.44:6800/1374527587,v1:172.21.15.44:6801/1374527587] conn(0x7f1758038e10 0x7f175803b2d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:03:59.773 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:57.299+0000 7f177478e640 1 --2- 172.21.15.44:0/148694634 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f176c106290 0x7f176c07b9d0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:03:59.773 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:57.299+0000 7f177478e640 1 -- 172.21.15.44:0/148694634 >> 172.21.15.44:0/148694634 conn(0x7f176c101ac0 msgr2=0x7f176c1025f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:03:59.773 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:57.299+0000 7f177478e640 1 -- 172.21.15.44:0/148694634 shutdown_connections 2024-08-19T00:03:59.773 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:03:57.299+0000 7f177478e640 1 -- 172.21.15.44:0/148694634 wait complete. 2024-08-19T00:03:59.773 INFO:teuthology.orchestra.run.smithi044.stdout:mgr is available 2024-08-19T00:04:03.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:02 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/1268368839' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-08-19T00:04:08.762 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 2024-08-19T00:04:08.762 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout [global] 2024-08-19T00:04:08.763 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout fsid = 647ded64-5dbe-11ef-bccf-c7b262605968 2024-08-19T00:04:08.763 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.44:3300,v1:172.21.15.44:6789] 2024-08-19T00:04:08.763 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-08-19T00:04:08.763 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-08-19T00:04:08.763 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-08-19T00:04:08.763 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-08-19T00:04:08.763 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 2024-08-19T00:04:08.763 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout [mgr] 2024-08-19T00:04:08.763 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-08-19T00:04:08.763 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 2024-08-19T00:04:08.763 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout [osd] 2024-08-19T00:04:08.763 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-08-19T00:04:08.764 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-08-19T00:04:08.764 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-08-19T00:04:08.764 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-08-19T00:04:08.764 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-08-19T00:04:08.764 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:02.585+0000 7f2c3dbfe640 1 Processor -- start 2024-08-19T00:04:08.764 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:02.585+0000 7f2c3dbfe640 1 -- start start 2024-08-19T00:04:08.764 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:02.585+0000 7f2c3dbfe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2c3807dcc0 0x7f2c3807c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:08.764 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:02.585+0000 7f2c3dbfe640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2c3807e0c0 con 0x7f2c3807dcc0 2024-08-19T00:04:08.764 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:02.586+0000 7f2c377fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2c3807dcc0 0x7f2c3807c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:08.764 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:02.586+0000 7f2c377fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2c3807dcc0 0x7f2c3807c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49200/0 (socket says 172.21.15.44:49200) 2024-08-19T00:04:08.764 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:02.586+0000 7f2c377fe640 1 -- 172.21.15.44:0/1423019893 learned_addr learned my addr 172.21.15.44:0/1423019893 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:04:08.764 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:02.586+0000 7f2c377fe640 1 -- 172.21.15.44:0/1423019893 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c3807c7c0 con 0x7f2c3807dcc0 2024-08-19T00:04:08.764 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:02.587+0000 7f2c377fe640 1 --2- 172.21.15.44:0/1423019893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2c3807dcc0 0x7f2c3807c280 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2c28009820 tx=0x7f2c2802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2c7e48297ba2d82 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:08.765 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:02.587+0000 7f2c367fc640 1 -- 172.21.15.44:0/1423019893 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c28037070 con 0x7f2c3807dcc0 2024-08-19T00:04:08.765 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:02.587+0000 7f2c367fc640 1 -- 172.21.15.44:0/1423019893 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2c28032900 con 0x7f2c3807dcc0 2024-08-19T00:04:08.765 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:02.587+0000 7f2c367fc640 1 -- 172.21.15.44:0/1423019893 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c28030850 con 0x7f2c3807dcc0 2024-08-19T00:04:08.765 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:02.588+0000 7f2c3dbfe640 1 -- 172.21.15.44:0/1423019893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2c3807dcc0 msgr2=0x7f2c3807c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:08.765 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:02.588+0000 7f2c3dbfe640 1 --2- 172.21.15.44:0/1423019893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2c3807dcc0 0x7f2c3807c280 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2c28009820 tx=0x7f2c2802a270 comp rx=0 tx=0).stop 2024-08-19T00:04:08.765 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:02.588+0000 7f2c3dbfe640 1 -- 172.21.15.44:0/1423019893 shutdown_connections 2024-08-19T00:04:08.765 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:02.588+0000 7f2c3dbfe640 1 --2- 172.21.15.44:0/1423019893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2c3807dcc0 0x7f2c3807c280 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:08.765 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:02.588+0000 7f2c3dbfe640 1 -- 172.21.15.44:0/1423019893 >> 172.21.15.44:0/1423019893 conn(0x7f2c38102c50 msgr2=0x7f2c38105070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:04:08.765 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:02.588+0000 7f2c3dbfe640 1 -- 172.21.15.44:0/1423019893 shutdown_connections 2024-08-19T00:04:08.765 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:02.588+0000 7f2c3dbfe640 1 -- 172.21.15.44:0/1423019893 wait complete. 2024-08-19T00:04:08.765 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:02.588+0000 7f2c3dbfe640 1 Processor -- start 2024-08-19T00:04:08.766 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:02.589+0000 7f2c3dbfe640 1 -- start start 2024-08-19T00:04:08.766 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:02.589+0000 7f2c3dbfe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2c3807dcc0 0x7f2c3819d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:08.766 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:02.589+0000 7f2c3dbfe640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2c3810d900 con 0x7f2c3807dcc0 2024-08-19T00:04:08.766 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:02.589+0000 7f2c377fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2c3807dcc0 0x7f2c3819d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:08.766 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:02.589+0000 7f2c377fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2c3807dcc0 0x7f2c3819d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49214/0 (socket says 172.21.15.44:49214) 2024-08-19T00:04:08.766 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:02.589+0000 7f2c377fe640 1 -- 172.21.15.44:0/1268368839 learned_addr learned my addr 172.21.15.44:0/1268368839 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:04:08.766 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:02.589+0000 7f2c377fe640 1 -- 172.21.15.44:0/1268368839 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c3819da20 con 0x7f2c3807dcc0 2024-08-19T00:04:08.766 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:02.589+0000 7f2c377fe640 1 --2- 172.21.15.44:0/1268368839 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2c3807dcc0 0x7f2c3819d4e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2c28032ce0 tx=0x7f2c28032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:08.766 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:02.590+0000 7f2c34ff9640 1 -- 172.21.15.44:0/1268368839 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c28042070 con 0x7f2c3807dcc0 2024-08-19T00:04:08.766 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:02.590+0000 7f2c34ff9640 1 -- 172.21.15.44:0/1268368839 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2c280308c0 con 0x7f2c3807dcc0 2024-08-19T00:04:08.766 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:02.590+0000 7f2c3dbfe640 1 -- 172.21.15.44:0/1268368839 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c3819dcb0 con 0x7f2c3807dcc0 2024-08-19T00:04:08.766 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:02.590+0000 7f2c34ff9640 1 -- 172.21.15.44:0/1268368839 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c28037040 con 0x7f2c3807dcc0 2024-08-19T00:04:08.766 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:02.590+0000 7f2c3dbfe640 1 -- 172.21.15.44:0/1268368839 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c381a09a0 con 0x7f2c3807dcc0 2024-08-19T00:04:08.767 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:02.591+0000 7f2c34ff9640 1 -- 172.21.15.44:0/1268368839 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7f2c28045070 con 0x7f2c3807dcc0 2024-08-19T00:04:08.767 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:02.591+0000 7f2c34ff9640 1 --2- 172.21.15.44:0/1268368839 >> [v2:172.21.15.44:6800/1374527587,v1:172.21.15.44:6801/1374527587] conn(0x7f2c20038f20 0x7f2c2003b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:08.767 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:02.591+0000 7f2c34ff9640 1 -- 172.21.15.44:0/1268368839 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f2c2806bfe0 con 0x7f2c3807dcc0 2024-08-19T00:04:08.767 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:02.591+0000 7f2c36ffd640 1 --2- 172.21.15.44:0/1268368839 >> [v2:172.21.15.44:6800/1374527587,v1:172.21.15.44:6801/1374527587] conn(0x7f2c20038f20 0x7f2c2003b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:08.767 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:02.591+0000 7f2c3dbfe640 1 -- 172.21.15.44:0/1268368839 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c3807c300 con 0x7f2c3807dcc0 2024-08-19T00:04:08.767 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:02.591+0000 7f2c36ffd640 1 --2- 172.21.15.44:0/1268368839 >> [v2:172.21.15.44:6800/1374527587,v1:172.21.15.44:6801/1374527587] conn(0x7f2c20038f20 0x7f2c2003b3e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c0098c0 tx=0x7f2c2c006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:08.767 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:02.596+0000 7f2c34ff9640 1 -- 172.21.15.44:0/1268368839 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f2c2803cd50 con 0x7f2c3807dcc0 2024-08-19T00:04:08.767 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:02.772+0000 7f2c3dbfe640 1 -- 172.21.15.44:0/1268368839 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f2c381a2080 con 0x7f2c3807dcc0 2024-08-19T00:04:08.767 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:02.773+0000 7f2c34ff9640 1 -- 172.21.15.44:0/1268368839 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+429 (secure 0 0 0) 0x7f2c2803c7e0 con 0x7f2c3807dcc0 2024-08-19T00:04:08.767 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:02.775+0000 7f2c3dbfe640 1 -- 172.21.15.44:0/1268368839 >> [v2:172.21.15.44:6800/1374527587,v1:172.21.15.44:6801/1374527587] conn(0x7f2c20038f20 msgr2=0x7f2c2003b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:08.767 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:02.775+0000 7f2c3dbfe640 1 --2- 172.21.15.44:0/1268368839 >> [v2:172.21.15.44:6800/1374527587,v1:172.21.15.44:6801/1374527587] conn(0x7f2c20038f20 0x7f2c2003b3e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c0098c0 tx=0x7f2c2c006db0 comp rx=0 tx=0).stop 2024-08-19T00:04:08.767 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:02.776+0000 7f2c3dbfe640 1 -- 172.21.15.44:0/1268368839 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2c3807dcc0 msgr2=0x7f2c3819d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:08.767 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:02.776+0000 7f2c3dbfe640 1 --2- 172.21.15.44:0/1268368839 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2c3807dcc0 0x7f2c3819d4e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2c28032ce0 tx=0x7f2c28032d10 comp rx=0 tx=0).stop 2024-08-19T00:04:08.768 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:02.776+0000 7f2c3dbfe640 1 -- 172.21.15.44:0/1268368839 shutdown_connections 2024-08-19T00:04:08.768 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:02.776+0000 7f2c3dbfe640 1 --2- 172.21.15.44:0/1268368839 >> [v2:172.21.15.44:6800/1374527587,v1:172.21.15.44:6801/1374527587] conn(0x7f2c20038f20 0x7f2c2003b3e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:08.768 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:02.776+0000 7f2c3dbfe640 1 --2- 172.21.15.44:0/1268368839 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2c3807dcc0 0x7f2c3819d4e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:08.768 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:02.776+0000 7f2c3dbfe640 1 -- 172.21.15.44:0/1268368839 >> 172.21.15.44:0/1268368839 conn(0x7f2c38102c50 msgr2=0x7f2c381037a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:04:08.768 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:02.776+0000 7f2c3dbfe640 1 -- 172.21.15.44:0/1268368839 shutdown_connections 2024-08-19T00:04:08.768 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:02.776+0000 7f2c3dbfe640 1 -- 172.21.15.44:0/1268368839 wait complete. 2024-08-19T00:04:08.768 INFO:teuthology.orchestra.run.smithi044.stdout:Enabling cephadm module... 2024-08-19T00:04:09.579 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:09 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/4109705205' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-08-19T00:04:09.843 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:09 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: ignoring --setuser ceph since I am not root 2024-08-19T00:04:09.844 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:09 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: ignoring --setgroup ceph since I am not root 2024-08-19T00:04:09.844 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:09 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:04:09.773+0000 7f4190731040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-19T00:04:09.844 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:09 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:04:09.842+0000 7f4190731040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-19T00:04:10.094 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:09.246+0000 7f705f4be640 1 Processor -- start 2024-08-19T00:04:10.094 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:09.246+0000 7f705f4be640 1 -- start start 2024-08-19T00:04:10.095 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:09.246+0000 7f705f4be640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7058106210 0x7f7058106610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:10.095 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:09.246+0000 7f705f4be640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7058106be0 con 0x7f7058106210 2024-08-19T00:04:10.095 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:09.247+0000 7f705d25a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7058106210 0x7f7058106610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:10.095 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:09.247+0000 7f705d25a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7058106210 0x7f7058106610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34098/0 (socket says 172.21.15.44:34098) 2024-08-19T00:04:10.095 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:09.247+0000 7f705d25a640 1 -- 172.21.15.44:0/3822798316 learned_addr learned my addr 172.21.15.44:0/3822798316 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:04:10.095 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:09.247+0000 7f705d25a640 1 -- 172.21.15.44:0/3822798316 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7058107410 con 0x7f7058106210 2024-08-19T00:04:10.095 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:09.248+0000 7f705d25a640 1 --2- 172.21.15.44:0/3822798316 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7058106210 0x7f7058106610 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7054009820 tx=0x7f705402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2117797a93f37227 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:10.095 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:09.248+0000 7f704ffff640 1 -- 172.21.15.44:0/3822798316 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7054037070 con 0x7f7058106210 2024-08-19T00:04:10.095 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:09.248+0000 7f704ffff640 1 -- 172.21.15.44:0/3822798316 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7054032900 con 0x7f7058106210 2024-08-19T00:04:10.095 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:09.248+0000 7f704ffff640 1 -- 172.21.15.44:0/3822798316 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7054030850 con 0x7f7058106210 2024-08-19T00:04:10.095 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:09.249+0000 7f705f4be640 1 -- 172.21.15.44:0/3822798316 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7058106210 msgr2=0x7f7058106610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:10.096 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:09.249+0000 7f705f4be640 1 --2- 172.21.15.44:0/3822798316 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7058106210 0x7f7058106610 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7054009820 tx=0x7f705402a270 comp rx=0 tx=0).stop 2024-08-19T00:04:10.096 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:09.249+0000 7f705f4be640 1 -- 172.21.15.44:0/3822798316 shutdown_connections 2024-08-19T00:04:10.096 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:09.249+0000 7f705f4be640 1 --2- 172.21.15.44:0/3822798316 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7058106210 0x7f7058106610 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:10.096 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:09.249+0000 7f705f4be640 1 -- 172.21.15.44:0/3822798316 >> 172.21.15.44:0/3822798316 conn(0x7f7058101a60 msgr2=0x7f7058103e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:04:10.096 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:09.249+0000 7f705f4be640 1 -- 172.21.15.44:0/3822798316 shutdown_connections 2024-08-19T00:04:10.096 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:09.249+0000 7f705f4be640 1 -- 172.21.15.44:0/3822798316 wait complete. 2024-08-19T00:04:10.096 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:09.249+0000 7f705f4be640 1 Processor -- start 2024-08-19T00:04:10.096 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:09.249+0000 7f705f4be640 1 -- start start 2024-08-19T00:04:10.096 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:09.250+0000 7f705f4be640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7058106210 0x7f705819d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:10.096 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:09.250+0000 7f705f4be640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f705810a7c0 con 0x7f7058106210 2024-08-19T00:04:10.096 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:09.250+0000 7f705d25a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7058106210 0x7f705819d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:10.096 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:09.250+0000 7f705d25a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7058106210 0x7f705819d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34106/0 (socket says 172.21.15.44:34106) 2024-08-19T00:04:10.096 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:09.250+0000 7f705d25a640 1 -- 172.21.15.44:0/4109705205 learned_addr learned my addr 172.21.15.44:0/4109705205 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:04:10.097 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:09.250+0000 7f705d25a640 1 -- 172.21.15.44:0/4109705205 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f705819db20 con 0x7f7058106210 2024-08-19T00:04:10.097 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:09.250+0000 7f705d25a640 1 --2- 172.21.15.44:0/4109705205 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7058106210 0x7f705819d5e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7054009940 tx=0x7f7054032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:10.097 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:09.250+0000 7f704e7fc640 1 -- 172.21.15.44:0/4109705205 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7054042070 con 0x7f7058106210 2024-08-19T00:04:10.097 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:09.250+0000 7f704e7fc640 1 -- 172.21.15.44:0/4109705205 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f70540308c0 con 0x7f7058106210 2024-08-19T00:04:10.097 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:09.250+0000 7f705f4be640 1 -- 172.21.15.44:0/4109705205 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f705819ddb0 con 0x7f7058106210 2024-08-19T00:04:10.097 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:09.250+0000 7f705f4be640 1 -- 172.21.15.44:0/4109705205 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70581a0aa0 con 0x7f7058106210 2024-08-19T00:04:10.097 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:09.250+0000 7f704e7fc640 1 -- 172.21.15.44:0/4109705205 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7054037040 con 0x7f7058106210 2024-08-19T00:04:10.097 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:09.251+0000 7f704e7fc640 1 -- 172.21.15.44:0/4109705205 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7f7054045070 con 0x7f7058106210 2024-08-19T00:04:10.097 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:09.251+0000 7f704e7fc640 1 --2- 172.21.15.44:0/4109705205 >> [v2:172.21.15.44:6800/1374527587,v1:172.21.15.44:6801/1374527587] conn(0x7f7044038f70 0x7f704403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:10.097 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:09.251+0000 7f704e7fc640 1 -- 172.21.15.44:0/4109705205 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f705406c240 con 0x7f7058106210 2024-08-19T00:04:10.097 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:09.252+0000 7f705ca59640 1 --2- 172.21.15.44:0/4109705205 >> [v2:172.21.15.44:6800/1374527587,v1:172.21.15.44:6801/1374527587] conn(0x7f7044038f70 0x7f704403b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:10.097 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:09.252+0000 7f705f4be640 1 -- 172.21.15.44:0/4109705205 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f705810a940 con 0x7f7058106210 2024-08-19T00:04:10.098 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:09.252+0000 7f705ca59640 1 --2- 172.21.15.44:0/4109705205 >> [v2:172.21.15.44:6800/1374527587,v1:172.21.15.44:6801/1374527587] conn(0x7f7044038f70 0x7f704403b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f70480098c0 tx=0x7f7048006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:10.098 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:09.257+0000 7f704e7fc640 1 -- 172.21.15.44:0/4109705205 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f705403cd60 con 0x7f7058106210 2024-08-19T00:04:10.098 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:09.481+0000 7f705f4be640 1 -- 172.21.15.44:0/4109705205 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f705802d6e0 con 0x7f7058106210 2024-08-19T00:04:10.098 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:09.532+0000 7f704e7fc640 1 -- 172.21.15.44:0/4109705205 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f705403c820 con 0x7f7058106210 2024-08-19T00:04:10.098 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:09.534+0000 7f704e7fc640 1 -- 172.21.15.44:0/4109705205 <== mon.0 v2:172.21.15.44:3300/0 8 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f7054062090 con 0x7f7058106210 2024-08-19T00:04:10.098 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:09.535+0000 7f705f4be640 1 -- 172.21.15.44:0/4109705205 >> [v2:172.21.15.44:6800/1374527587,v1:172.21.15.44:6801/1374527587] conn(0x7f7044038f70 msgr2=0x7f704403b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:10.098 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:09.535+0000 7f705f4be640 1 --2- 172.21.15.44:0/4109705205 >> [v2:172.21.15.44:6800/1374527587,v1:172.21.15.44:6801/1374527587] conn(0x7f7044038f70 0x7f704403b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f70480098c0 tx=0x7f7048006db0 comp rx=0 tx=0).stop 2024-08-19T00:04:10.098 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:09.535+0000 7f705f4be640 1 -- 172.21.15.44:0/4109705205 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7058106210 msgr2=0x7f705819d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:10.098 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:09.535+0000 7f705f4be640 1 --2- 172.21.15.44:0/4109705205 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7058106210 0x7f705819d5e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7054009940 tx=0x7f7054032ce0 comp rx=0 tx=0).stop 2024-08-19T00:04:10.098 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:09.535+0000 7f705f4be640 1 -- 172.21.15.44:0/4109705205 shutdown_connections 2024-08-19T00:04:10.098 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:09.535+0000 7f705f4be640 1 --2- 172.21.15.44:0/4109705205 >> [v2:172.21.15.44:6800/1374527587,v1:172.21.15.44:6801/1374527587] conn(0x7f7044038f70 0x7f704403b430 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:10.098 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:09.535+0000 7f705f4be640 1 --2- 172.21.15.44:0/4109705205 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7058106210 0x7f705819d5e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:10.099 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:09.535+0000 7f705f4be640 1 -- 172.21.15.44:0/4109705205 >> 172.21.15.44:0/4109705205 conn(0x7f7058101a60 msgr2=0x7f70581029c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:04:10.099 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:09.536+0000 7f705f4be640 1 -- 172.21.15.44:0/4109705205 shutdown_connections 2024-08-19T00:04:10.099 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:09.536+0000 7f705f4be640 1 -- 172.21.15.44:0/4109705205 wait complete. 2024-08-19T00:04:10.119 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:09 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:04:09.993+0000 7f4190731040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-19T00:04:10.440 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:10 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:04:10.169+0000 7f4190731040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-19T00:04:10.440 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:10 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:04:10.322+0000 7f4190731040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-19T00:04:10.725 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:10 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/4109705205' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-08-19T00:04:10.725 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:10 smithi044 ceph-mon[18489]: mgrmap e5: x(active, since 14s) 2024-08-19T00:04:10.726 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:10 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:04:10.453+0000 7f4190731040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-19T00:04:10.726 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:10 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:04:10.609+0000 7f4190731040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-19T00:04:10.726 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:10 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:04:10.668+0000 7f4190731040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-19T00:04:11.279 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:10 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:04:10.990+0000 7f4190731040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-19T00:04:11.280 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:11 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:04:11.054+0000 7f4190731040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-19T00:04:11.280 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:11 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:04:11.125+0000 7f4190731040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-19T00:04:11.280 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:11 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:04:11.278+0000 7f4190731040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-08-19T00:04:11.329 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout { 2024-08-19T00:04:11.335 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-08-19T00:04:11.336 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "available": true, 2024-08-19T00:04:11.336 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-08-19T00:04:11.336 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-08-19T00:04:11.336 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout } 2024-08-19T00:04:11.336 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:10.518+0000 7f5164ec7640 1 Processor -- start 2024-08-19T00:04:11.336 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:10.518+0000 7f5164ec7640 1 -- start start 2024-08-19T00:04:11.336 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:10.518+0000 7f5164ec7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5160107d60 0x7f516010a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:11.336 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:10.518+0000 7f5164ec7640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f516007be30 con 0x7f5160107d60 2024-08-19T00:04:11.336 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:10.518+0000 7f515e59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5160107d60 0x7f516010a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:11.336 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:10.519+0000 7f515e59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5160107d60 0x7f516010a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34136/0 (socket says 172.21.15.44:34136) 2024-08-19T00:04:11.337 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:10.519+0000 7f515e59c640 1 -- 172.21.15.44:0/4151865939 learned_addr learned my addr 172.21.15.44:0/4151865939 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:04:11.337 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:10.519+0000 7f515e59c640 1 -- 172.21.15.44:0/4151865939 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f516010a690 con 0x7f5160107d60 2024-08-19T00:04:11.337 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:10.519+0000 7f515e59c640 1 --2- 172.21.15.44:0/4151865939 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5160107d60 0x7f516010a150 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5150009820 tx=0x7f515002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b4903249fb8f077 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:11.337 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:10.520+0000 7f515dd9b640 1 -- 172.21.15.44:0/4151865939 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5150037070 con 0x7f5160107d60 2024-08-19T00:04:11.337 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:10.520+0000 7f515dd9b640 1 -- 172.21.15.44:0/4151865939 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5150032900 con 0x7f5160107d60 2024-08-19T00:04:11.337 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:10.520+0000 7f515dd9b640 1 -- 172.21.15.44:0/4151865939 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5150030850 con 0x7f5160107d60 2024-08-19T00:04:11.337 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:10.520+0000 7f5164ec7640 1 -- 172.21.15.44:0/4151865939 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5160107d60 msgr2=0x7f516010a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:11.337 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:10.520+0000 7f5164ec7640 1 --2- 172.21.15.44:0/4151865939 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5160107d60 0x7f516010a150 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5150009820 tx=0x7f515002a270 comp rx=0 tx=0).stop 2024-08-19T00:04:11.337 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:10.520+0000 7f5164ec7640 1 -- 172.21.15.44:0/4151865939 shutdown_connections 2024-08-19T00:04:11.337 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:10.520+0000 7f5164ec7640 1 --2- 172.21.15.44:0/4151865939 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5160107d60 0x7f516010a150 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:11.337 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:10.520+0000 7f5164ec7640 1 -- 172.21.15.44:0/4151865939 >> 172.21.15.44:0/4151865939 conn(0x7f5160101a00 msgr2=0x7f5160103e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:04:11.337 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:10.520+0000 7f5164ec7640 1 -- 172.21.15.44:0/4151865939 shutdown_connections 2024-08-19T00:04:11.337 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:10.520+0000 7f5164ec7640 1 -- 172.21.15.44:0/4151865939 wait complete. 2024-08-19T00:04:11.338 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:10.521+0000 7f5164ec7640 1 Processor -- start 2024-08-19T00:04:11.338 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:10.521+0000 7f5164ec7640 1 -- start start 2024-08-19T00:04:11.338 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:10.521+0000 7f5164ec7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5160107d60 0x7f516019b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:11.338 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:10.521+0000 7f5164ec7640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f516010b730 con 0x7f5160107d60 2024-08-19T00:04:11.338 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:10.522+0000 7f515e59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5160107d60 0x7f516019b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:11.338 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:10.522+0000 7f515e59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5160107d60 0x7f516019b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34152/0 (socket says 172.21.15.44:34152) 2024-08-19T00:04:11.338 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:10.522+0000 7f515e59c640 1 -- 172.21.15.44:0/1216060470 learned_addr learned my addr 172.21.15.44:0/1216060470 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:04:11.338 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:10.522+0000 7f515e59c640 1 -- 172.21.15.44:0/1216060470 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f516019b830 con 0x7f5160107d60 2024-08-19T00:04:11.338 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:10.522+0000 7f515e59c640 1 --2- 172.21.15.44:0/1216060470 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5160107d60 0x7f516019b2f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f51500097f0 tx=0x7f5150030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:11.338 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:10.522+0000 7f51577fe640 1 -- 172.21.15.44:0/1216060470 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5150037040 con 0x7f5160107d60 2024-08-19T00:04:11.338 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:10.522+0000 7f51577fe640 1 -- 172.21.15.44:0/1216060470 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5150040070 con 0x7f5160107d60 2024-08-19T00:04:11.338 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:10.522+0000 7f5164ec7640 1 -- 172.21.15.44:0/1216060470 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f516019bac0 con 0x7f5160107d60 2024-08-19T00:04:11.339 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:10.522+0000 7f51577fe640 1 -- 172.21.15.44:0/1216060470 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f515003a390 con 0x7f5160107d60 2024-08-19T00:04:11.339 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:10.522+0000 7f5164ec7640 1 -- 172.21.15.44:0/1216060470 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f516019e7b0 con 0x7f5160107d60 2024-08-19T00:04:11.339 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:10.523+0000 7f51577fe640 1 -- 172.21.15.44:0/1216060470 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f515003a5e0 con 0x7f5160107d60 2024-08-19T00:04:11.339 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:10.523+0000 7f51577fe640 1 --2- 172.21.15.44:0/1216060470 >> [v2:172.21.15.44:6800/1374527587,v1:172.21.15.44:6801/1374527587] conn(0x7f514c038fc0 0x7f514c03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:11.339 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:10.523+0000 7f51577fe640 1 -- 172.21.15.44:0/1216060470 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f515006c130 con 0x7f5160107d60 2024-08-19T00:04:11.339 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:10.523+0000 7f5157fff640 1 -- 172.21.15.44:0/1216060470 >> [v2:172.21.15.44:6800/1374527587,v1:172.21.15.44:6801/1374527587] conn(0x7f514c038fc0 msgr2=0x7f514c03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.44:6800/1374527587 2024-08-19T00:04:11.339 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:10.523+0000 7f5157fff640 1 --2- 172.21.15.44:0/1216060470 >> [v2:172.21.15.44:6800/1374527587,v1:172.21.15.44:6801/1374527587] conn(0x7f514c038fc0 0x7f514c03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T00:04:11.339 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:10.524+0000 7f5164ec7640 1 -- 172.21.15.44:0/1216060470 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51601081c0 con 0x7f5160107d60 2024-08-19T00:04:11.339 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:10.528+0000 7f51577fe640 1 -- 172.21.15.44:0/1216060470 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f515006be90 con 0x7f5160107d60 2024-08-19T00:04:11.339 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:10.724+0000 7f5157fff640 1 -- 172.21.15.44:0/1216060470 >> [v2:172.21.15.44:6800/1374527587,v1:172.21.15.44:6801/1374527587] conn(0x7f514c038fc0 msgr2=0x7f514c03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.44:6800/1374527587 2024-08-19T00:04:11.339 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:10.724+0000 7f5157fff640 1 --2- 172.21.15.44:0/1216060470 >> [v2:172.21.15.44:6800/1374527587,v1:172.21.15.44:6801/1374527587] conn(0x7f514c038fc0 0x7f514c03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T00:04:11.339 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:10.779+0000 7f5164ec7640 1 -- 172.21.15.44:0/1216060470 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f516019ed70 con 0x7f5160107d60 2024-08-19T00:04:11.339 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:10.779+0000 7f51577fe640 1 -- 172.21.15.44:0/1216060470 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f515003a920 con 0x7f5160107d60 2024-08-19T00:04:11.340 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:10.782+0000 7f5164ec7640 1 -- 172.21.15.44:0/1216060470 >> [v2:172.21.15.44:6800/1374527587,v1:172.21.15.44:6801/1374527587] conn(0x7f514c038fc0 msgr2=0x7f514c03b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T00:04:11.340 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:10.782+0000 7f5164ec7640 1 --2- 172.21.15.44:0/1216060470 >> [v2:172.21.15.44:6800/1374527587,v1:172.21.15.44:6801/1374527587] conn(0x7f514c038fc0 0x7f514c03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:11.340 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:10.782+0000 7f5164ec7640 1 -- 172.21.15.44:0/1216060470 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5160107d60 msgr2=0x7f516019b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:11.340 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:10.782+0000 7f5164ec7640 1 --2- 172.21.15.44:0/1216060470 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5160107d60 0x7f516019b2f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f51500097f0 tx=0x7f5150030d80 comp rx=0 tx=0).stop 2024-08-19T00:04:11.340 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:10.782+0000 7f5164ec7640 1 -- 172.21.15.44:0/1216060470 shutdown_connections 2024-08-19T00:04:11.340 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:10.783+0000 7f5164ec7640 1 --2- 172.21.15.44:0/1216060470 >> [v2:172.21.15.44:6800/1374527587,v1:172.21.15.44:6801/1374527587] conn(0x7f514c038fc0 0x7f514c03b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:11.340 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:10.783+0000 7f5164ec7640 1 --2- 172.21.15.44:0/1216060470 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5160107d60 0x7f516019b2f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:11.340 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:10.783+0000 7f5164ec7640 1 -- 172.21.15.44:0/1216060470 >> 172.21.15.44:0/1216060470 conn(0x7f5160101a00 msgr2=0x7f51601025b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:04:11.340 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:10.783+0000 7f5164ec7640 1 -- 172.21.15.44:0/1216060470 shutdown_connections 2024-08-19T00:04:11.340 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:10.783+0000 7f5164ec7640 1 -- 172.21.15.44:0/1216060470 wait complete. 2024-08-19T00:04:11.340 INFO:teuthology.orchestra.run.smithi044.stdout:Waiting for the mgr to restart... 2024-08-19T00:04:11.340 INFO:teuthology.orchestra.run.smithi044.stdout:Waiting for mgr epoch 5... 2024-08-19T00:04:11.531 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:11 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:04:11.341+0000 7f4190731040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-19T00:04:11.531 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:11 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:04:11.411+0000 7f4190731040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-19T00:04:11.806 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:11 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/1216060470' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-08-19T00:04:11.806 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:11 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:04:11.606+0000 7f4190731040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-19T00:04:11.806 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:11 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:04:11.670+0000 7f4190731040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-19T00:04:11.806 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:11 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:04:11.735+0000 7f4190731040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-19T00:04:11.806 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:11 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:04:11.804+0000 7f4190731040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-19T00:04:12.086 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:12 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:04:12.024+0000 7f4190731040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-19T00:04:12.087 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:12 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:04:12.085+0000 7f4190731040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-19T00:04:12.940 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:12 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:04:12.619+0000 7f4190731040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-19T00:04:13.369 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:12 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:04:12.939+0000 7f4190731040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-19T00:04:13.869 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:13 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:04:13.368+0000 7f4190731040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-19T00:04:13.869 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:13 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:04:13.426+0000 7f4190731040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-19T00:04:13.869 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:13 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:04:13.488+0000 7f4190731040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-19T00:04:14.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:14 smithi044 ceph-mon[18489]: Active manager daemon x restarted 2024-08-19T00:04:14.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:14 smithi044 ceph-mon[18489]: Activating manager daemon x 2024-08-19T00:04:14.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:14 smithi044 ceph-mon[18489]: osdmap e2: 0 total, 0 up, 0 in 2024-08-19T00:04:14.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:14 smithi044 ceph-mon[18489]: mgrmap e6: x(active, starting, since 0.00326772s) 2024-08-19T00:04:14.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:14 smithi044 ceph-mon[18489]: from='mgr.14118 172.21.15.44:0/3360564934' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-19T00:04:14.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:14 smithi044 ceph-mon[18489]: from='mgr.14118 172.21.15.44:0/3360564934' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-08-19T00:04:14.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:14 smithi044 ceph-mon[18489]: from='mgr.14118 172.21.15.44:0/3360564934' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-19T00:04:14.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:14 smithi044 ceph-mon[18489]: from='mgr.14118 172.21.15.44:0/3360564934' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-19T00:04:14.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:14 smithi044 ceph-mon[18489]: from='mgr.14118 172.21.15.44:0/3360564934' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-19T00:04:14.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:14 smithi044 ceph-mon[18489]: Manager daemon x is now available 2024-08-19T00:04:14.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:14 smithi044 ceph-mon[18489]: from='mgr.14118 172.21.15.44:0/3360564934' entity='mgr.x' 2024-08-19T00:04:14.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:14 smithi044 ceph-mon[18489]: from='mgr.14118 172.21.15.44:0/3360564934' entity='mgr.x' 2024-08-19T00:04:14.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:14 smithi044 ceph-mon[18489]: from='mgr.14118 172.21.15.44:0/3360564934' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:04:14.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:14 smithi044 ceph-mon[18489]: from='mgr.14118 172.21.15.44:0/3360564934' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:04:14.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:14 smithi044 ceph-mon[18489]: from='mgr.14118 172.21.15.44:0/3360564934' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-08-19T00:04:14.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:14 smithi044 ceph-mon[18489]: from='mgr.14118 172.21.15.44:0/3360564934' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-08-19T00:04:16.143 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout { 2024-08-19T00:04:16.143 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-08-19T00:04:16.143 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "initialized": true 2024-08-19T00:04:16.143 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout } 2024-08-19T00:04:16.143 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:11.717+0000 7f681b1d2640 1 Processor -- start 2024-08-19T00:04:16.143 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:11.717+0000 7f681b1d2640 1 -- start start 2024-08-19T00:04:16.143 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:11.717+0000 7f681b1d2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68141073f0 0x7f68141077f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:16.143 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:11.717+0000 7f681b1d2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6814107dc0 con 0x7f68141073f0 2024-08-19T00:04:16.143 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:11.717+0000 7f6818f6e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68141073f0 0x7f68141077f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:16.143 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:11.717+0000 7f6818f6e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68141073f0 0x7f68141077f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34166/0 (socket says 172.21.15.44:34166) 2024-08-19T00:04:16.143 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:11.717+0000 7f6818f6e640 1 -- 172.21.15.44:0/2629792092 learned_addr learned my addr 172.21.15.44:0/2629792092 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:04:16.144 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:11.717+0000 7f6818f6e640 1 -- 172.21.15.44:0/2629792092 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6814108550 con 0x7f68141073f0 2024-08-19T00:04:16.144 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:11.718+0000 7f6818f6e640 1 --2- 172.21.15.44:0/2629792092 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68141073f0 0x7f68141077f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6808009820 tx=0x7f680802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ec12006b7394569 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:16.144 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:11.718+0000 7f68137fe640 1 -- 172.21.15.44:0/2629792092 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6808037070 con 0x7f68141073f0 2024-08-19T00:04:16.144 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:11.719+0000 7f68137fe640 1 -- 172.21.15.44:0/2629792092 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6808032900 con 0x7f68141073f0 2024-08-19T00:04:16.144 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:11.719+0000 7f68137fe640 1 -- 172.21.15.44:0/2629792092 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6808030850 con 0x7f68141073f0 2024-08-19T00:04:16.144 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:11.719+0000 7f681b1d2640 1 -- 172.21.15.44:0/2629792092 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68141073f0 msgr2=0x7f68141077f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:16.144 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:11.719+0000 7f681b1d2640 1 --2- 172.21.15.44:0/2629792092 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68141073f0 0x7f68141077f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6808009820 tx=0x7f680802a270 comp rx=0 tx=0).stop 2024-08-19T00:04:16.144 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:11.719+0000 7f681b1d2640 1 -- 172.21.15.44:0/2629792092 shutdown_connections 2024-08-19T00:04:16.144 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:11.719+0000 7f681b1d2640 1 --2- 172.21.15.44:0/2629792092 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68141073f0 0x7f68141077f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:16.144 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:11.719+0000 7f681b1d2640 1 -- 172.21.15.44:0/2629792092 >> 172.21.15.44:0/2629792092 conn(0x7f6814102ba0 msgr2=0x7f6814104fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:04:16.144 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:11.719+0000 7f681b1d2640 1 -- 172.21.15.44:0/2629792092 shutdown_connections 2024-08-19T00:04:16.144 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:11.719+0000 7f681b1d2640 1 -- 172.21.15.44:0/2629792092 wait complete. 2024-08-19T00:04:16.144 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:11.720+0000 7f681b1d2640 1 Processor -- start 2024-08-19T00:04:16.145 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:11.720+0000 7f681b1d2640 1 -- start start 2024-08-19T00:04:16.145 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:11.720+0000 7f681b1d2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68141073f0 0x7f681407daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:16.145 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:11.720+0000 7f681b1d2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f681410b900 con 0x7f68141073f0 2024-08-19T00:04:16.145 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:11.720+0000 7f6818f6e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68141073f0 0x7f681407daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:16.145 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:11.720+0000 7f6818f6e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68141073f0 0x7f681407daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34178/0 (socket says 172.21.15.44:34178) 2024-08-19T00:04:16.145 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:11.720+0000 7f6818f6e640 1 -- 172.21.15.44:0/865727878 learned_addr learned my addr 172.21.15.44:0/865727878 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:04:16.145 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:11.721+0000 7f6818f6e640 1 -- 172.21.15.44:0/865727878 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f681407e030 con 0x7f68141073f0 2024-08-19T00:04:16.145 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:11.721+0000 7f6818f6e640 1 --2- 172.21.15.44:0/865727878 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68141073f0 0x7f681407daf0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f68080097f0 tx=0x7f6808030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:16.145 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:11.721+0000 7f6811ffb640 1 -- 172.21.15.44:0/865727878 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6808042070 con 0x7f68141073f0 2024-08-19T00:04:16.145 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:11.721+0000 7f6811ffb640 1 -- 172.21.15.44:0/865727878 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6808032ca0 con 0x7f68141073f0 2024-08-19T00:04:16.145 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:11.721+0000 7f681b1d2640 1 -- 172.21.15.44:0/865727878 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f681407c220 con 0x7f68141073f0 2024-08-19T00:04:16.145 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:11.721+0000 7f6811ffb640 1 -- 172.21.15.44:0/865727878 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6808037040 con 0x7f68141073f0 2024-08-19T00:04:16.145 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:11.721+0000 7f681b1d2640 1 -- 172.21.15.44:0/865727878 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f681407c760 con 0x7f68141073f0 2024-08-19T00:04:16.145 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:11.722+0000 7f6811ffb640 1 -- 172.21.15.44:0/865727878 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f6808045070 con 0x7f68141073f0 2024-08-19T00:04:16.146 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:11.722+0000 7f6811ffb640 1 --2- 172.21.15.44:0/865727878 >> [v2:172.21.15.44:6800/1374527587,v1:172.21.15.44:6801/1374527587] conn(0x7f6804038f70 0x7f680403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:16.146 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:11.722+0000 7f681b1d2640 1 -- 172.21.15.44:0/865727878 --> [v2:172.21.15.44:6800/1374527587,v1:172.21.15.44:6801/1374527587] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f6814107870 con 0x7f6804038f70 2024-08-19T00:04:16.146 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:11.722+0000 7f6811ffb640 1 -- 172.21.15.44:0/865727878 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f680806bea0 con 0x7f68141073f0 2024-08-19T00:04:16.146 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:11.722+0000 7f6813fff640 1 -- 172.21.15.44:0/865727878 >> [v2:172.21.15.44:6800/1374527587,v1:172.21.15.44:6801/1374527587] conn(0x7f6804038f70 msgr2=0x7f680403b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.44:6800/1374527587 2024-08-19T00:04:16.146 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:11.722+0000 7f6813fff640 1 --2- 172.21.15.44:0/865727878 >> [v2:172.21.15.44:6800/1374527587,v1:172.21.15.44:6801/1374527587] conn(0x7f6804038f70 0x7f680403b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T00:04:16.146 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:11.923+0000 7f6813fff640 1 -- 172.21.15.44:0/865727878 >> [v2:172.21.15.44:6800/1374527587,v1:172.21.15.44:6801/1374527587] conn(0x7f6804038f70 msgr2=0x7f680403b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.44:6800/1374527587 2024-08-19T00:04:16.146 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:11.923+0000 7f6813fff640 1 --2- 172.21.15.44:0/865727878 >> [v2:172.21.15.44:6800/1374527587,v1:172.21.15.44:6801/1374527587] conn(0x7f6804038f70 0x7f680403b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T00:04:16.146 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:12.324+0000 7f6813fff640 1 -- 172.21.15.44:0/865727878 >> [v2:172.21.15.44:6800/1374527587,v1:172.21.15.44:6801/1374527587] conn(0x7f6804038f70 msgr2=0x7f680403b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.44:6800/1374527587 2024-08-19T00:04:16.146 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:12.324+0000 7f6813fff640 1 --2- 172.21.15.44:0/865727878 >> [v2:172.21.15.44:6800/1374527587,v1:172.21.15.44:6801/1374527587] conn(0x7f6804038f70 0x7f680403b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T00:04:16.146 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:13.125+0000 7f6813fff640 1 -- 172.21.15.44:0/865727878 >> [v2:172.21.15.44:6800/1374527587,v1:172.21.15.44:6801/1374527587] conn(0x7f6804038f70 msgr2=0x7f680403b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.44:6800/1374527587 2024-08-19T00:04:16.146 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:13.125+0000 7f6813fff640 1 --2- 172.21.15.44:0/865727878 >> [v2:172.21.15.44:6800/1374527587,v1:172.21.15.44:6801/1374527587] conn(0x7f6804038f70 0x7f680403b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T00:04:16.146 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:14.605+0000 7f6811ffb640 1 -- 172.21.15.44:0/865727878 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mgrmap(e 6) ==== 46054+0+0 (secure 0 0 0) 0x7f680806a960 con 0x7f68141073f0 2024-08-19T00:04:16.147 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:14.605+0000 7f6811ffb640 1 -- 172.21.15.44:0/865727878 >> [v2:172.21.15.44:6800/1374527587,v1:172.21.15.44:6801/1374527587] conn(0x7f6804038f70 msgr2=0x7f680403b430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T00:04:16.147 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:14.605+0000 7f6811ffb640 1 --2- 172.21.15.44:0/865727878 >> [v2:172.21.15.44:6800/1374527587,v1:172.21.15.44:6801/1374527587] conn(0x7f6804038f70 0x7f680403b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:16.147 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:15.606+0000 7f6811ffb640 1 -- 172.21.15.44:0/865727878 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7f68080313a0 con 0x7f68141073f0 2024-08-19T00:04:16.147 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:15.607+0000 7f6811ffb640 1 --2- 172.21.15.44:0/865727878 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7f680403c6b0 0x7f680403eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:16.147 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:15.607+0000 7f6811ffb640 1 -- 172.21.15.44:0/865727878 --> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f6814107870 con 0x7f680403c6b0 2024-08-19T00:04:16.147 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:15.607+0000 7f6813fff640 1 --2- 172.21.15.44:0/865727878 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7f680403c6b0 0x7f680403eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:16.147 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:15.607+0000 7f6813fff640 1 --2- 172.21.15.44:0/865727878 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7f680403c6b0 0x7f680403eaa0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f6800003980 tx=0x7f6800006e10 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:16.147 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:15.608+0000 7f6811ffb640 1 -- 172.21.15.44:0/865727878 <== mgr.14118 v2:172.21.15.44:6800/1300308907 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f6814107870 con 0x7f680403c6b0 2024-08-19T00:04:16.147 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:15.615+0000 7f681b1d2640 1 -- 172.21.15.44:0/865727878 --> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f681410ba80 con 0x7f680403c6b0 2024-08-19T00:04:16.147 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:15.615+0000 7f6811ffb640 1 -- 172.21.15.44:0/865727878 <== mgr.14118 v2:172.21.15.44:6800/1300308907 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f681410ba80 con 0x7f680403c6b0 2024-08-19T00:04:16.147 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:15.616+0000 7f681b1d2640 1 -- 172.21.15.44:0/865727878 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7f680403c6b0 msgr2=0x7f680403eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:16.147 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:15.616+0000 7f681b1d2640 1 --2- 172.21.15.44:0/865727878 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7f680403c6b0 0x7f680403eaa0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f6800003980 tx=0x7f6800006e10 comp rx=0 tx=0).stop 2024-08-19T00:04:16.147 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:15.616+0000 7f681b1d2640 1 -- 172.21.15.44:0/865727878 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68141073f0 msgr2=0x7f681407daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:16.147 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:15.616+0000 7f681b1d2640 1 --2- 172.21.15.44:0/865727878 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68141073f0 0x7f681407daf0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f68080097f0 tx=0x7f6808030ec0 comp rx=0 tx=0).stop 2024-08-19T00:04:16.148 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:15.616+0000 7f681b1d2640 1 -- 172.21.15.44:0/865727878 shutdown_connections 2024-08-19T00:04:16.148 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:15.616+0000 7f681b1d2640 1 --2- 172.21.15.44:0/865727878 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7f680403c6b0 0x7f680403eaa0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:16.148 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:15.616+0000 7f681b1d2640 1 --2- 172.21.15.44:0/865727878 >> [v2:172.21.15.44:6800/1374527587,v1:172.21.15.44:6801/1374527587] conn(0x7f6804038f70 0x7f680403b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:16.148 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:15.616+0000 7f681b1d2640 1 --2- 172.21.15.44:0/865727878 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68141073f0 0x7f681407daf0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:16.148 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:15.616+0000 7f681b1d2640 1 -- 172.21.15.44:0/865727878 >> 172.21.15.44:0/865727878 conn(0x7f6814102ba0 msgr2=0x7f6814103790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:04:16.148 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:15.616+0000 7f681b1d2640 1 -- 172.21.15.44:0/865727878 shutdown_connections 2024-08-19T00:04:16.148 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:15.616+0000 7f681b1d2640 1 -- 172.21.15.44:0/865727878 wait complete. 2024-08-19T00:04:16.148 INFO:teuthology.orchestra.run.smithi044.stdout:mgr epoch 5 is available 2024-08-19T00:04:16.148 INFO:teuthology.orchestra.run.smithi044.stdout:Setting orchestrator backend to cephadm... 2024-08-19T00:04:16.517 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:16 smithi044 ceph-mon[18489]: Found migration_current of "None". Setting to last migration. 2024-08-19T00:04:16.517 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:16 smithi044 ceph-mon[18489]: from='mgr.14118 172.21.15.44:0/3360564934' entity='mgr.x' 2024-08-19T00:04:16.517 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:16 smithi044 ceph-mon[18489]: from='mgr.14118 172.21.15.44:0/3360564934' entity='mgr.x' 2024-08-19T00:04:16.517 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:16 smithi044 ceph-mon[18489]: mgrmap e7: x(active, since 1.00561s) 2024-08-19T00:04:17.230 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:16.505+0000 7fb3fc36d640 1 Processor -- start 2024-08-19T00:04:17.231 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:16.505+0000 7fb3fc36d640 1 -- start start 2024-08-19T00:04:17.231 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:16.505+0000 7fb3fc36d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb3f4107d60 0x7fb3f410a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:17.231 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:16.505+0000 7fb3fc36d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb3f407be30 con 0x7fb3f4107d60 2024-08-19T00:04:17.231 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:16.505+0000 7fb3fa109640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb3f4107d60 0x7fb3f410a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:17.231 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:16.506+0000 7fb3fa109640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb3f4107d60 0x7fb3f410a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34256/0 (socket says 172.21.15.44:34256) 2024-08-19T00:04:17.231 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:16.506+0000 7fb3fa109640 1 -- 172.21.15.44:0/964075942 learned_addr learned my addr 172.21.15.44:0/964075942 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:04:17.231 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:16.506+0000 7fb3fa109640 1 -- 172.21.15.44:0/964075942 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3f410a690 con 0x7fb3f4107d60 2024-08-19T00:04:17.231 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:16.506+0000 7fb3fa109640 1 --2- 172.21.15.44:0/964075942 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb3f4107d60 0x7fb3f410a150 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb3e8009820 tx=0x7fb3e802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89d120cbda3e37e1 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:17.231 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:16.507+0000 7fb3f9107640 1 -- 172.21.15.44:0/964075942 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3e8037070 con 0x7fb3f4107d60 2024-08-19T00:04:17.232 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:16.507+0000 7fb3f9107640 1 -- 172.21.15.44:0/964075942 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb3e8032900 con 0x7fb3f4107d60 2024-08-19T00:04:17.232 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:16.507+0000 7fb3f9107640 1 -- 172.21.15.44:0/964075942 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3e8030850 con 0x7fb3f4107d60 2024-08-19T00:04:17.232 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:16.507+0000 7fb3fc36d640 1 -- 172.21.15.44:0/964075942 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb3f4107d60 msgr2=0x7fb3f410a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:17.232 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:16.507+0000 7fb3fc36d640 1 --2- 172.21.15.44:0/964075942 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb3f4107d60 0x7fb3f410a150 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb3e8009820 tx=0x7fb3e802a270 comp rx=0 tx=0).stop 2024-08-19T00:04:17.232 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:16.507+0000 7fb3fc36d640 1 -- 172.21.15.44:0/964075942 shutdown_connections 2024-08-19T00:04:17.232 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:16.507+0000 7fb3fc36d640 1 --2- 172.21.15.44:0/964075942 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb3f4107d60 0x7fb3f410a150 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:17.232 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:16.507+0000 7fb3fc36d640 1 -- 172.21.15.44:0/964075942 >> 172.21.15.44:0/964075942 conn(0x7fb3f4101a00 msgr2=0x7fb3f4103e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:04:17.232 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:16.507+0000 7fb3fc36d640 1 -- 172.21.15.44:0/964075942 shutdown_connections 2024-08-19T00:04:17.232 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:16.507+0000 7fb3fc36d640 1 -- 172.21.15.44:0/964075942 wait complete. 2024-08-19T00:04:17.232 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:16.508+0000 7fb3fc36d640 1 Processor -- start 2024-08-19T00:04:17.232 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:16.508+0000 7fb3fc36d640 1 -- start start 2024-08-19T00:04:17.232 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:16.508+0000 7fb3fc36d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb3f4107d60 0x7fb3f419b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:17.232 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:16.508+0000 7fb3fc36d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb3f410b730 con 0x7fb3f4107d60 2024-08-19T00:04:17.233 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:16.508+0000 7fb3fa109640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb3f4107d60 0x7fb3f419b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:17.233 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:16.508+0000 7fb3fa109640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb3f4107d60 0x7fb3f419b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34260/0 (socket says 172.21.15.44:34260) 2024-08-19T00:04:17.233 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:16.508+0000 7fb3fa109640 1 -- 172.21.15.44:0/2189971278 learned_addr learned my addr 172.21.15.44:0/2189971278 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:04:17.233 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:16.509+0000 7fb3fa109640 1 -- 172.21.15.44:0/2189971278 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3f419b830 con 0x7fb3f4107d60 2024-08-19T00:04:17.233 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:16.509+0000 7fb3fa109640 1 --2- 172.21.15.44:0/2189971278 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb3f4107d60 0x7fb3f419b2f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb3e8032ce0 tx=0x7fb3e8032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:17.233 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:16.509+0000 7fb3e77fe640 1 -- 172.21.15.44:0/2189971278 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3e8042070 con 0x7fb3f4107d60 2024-08-19T00:04:17.234 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:16.509+0000 7fb3e77fe640 1 -- 172.21.15.44:0/2189971278 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb3e80308c0 con 0x7fb3f4107d60 2024-08-19T00:04:17.234 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:16.509+0000 7fb3fc36d640 1 -- 172.21.15.44:0/2189971278 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3f419bac0 con 0x7fb3f4107d60 2024-08-19T00:04:17.234 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:16.509+0000 7fb3e77fe640 1 -- 172.21.15.44:0/2189971278 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3e8037040 con 0x7fb3f4107d60 2024-08-19T00:04:17.234 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:16.509+0000 7fb3fc36d640 1 -- 172.21.15.44:0/2189971278 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3f419e7b0 con 0x7fb3f4107d60 2024-08-19T00:04:17.234 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:16.510+0000 7fb3fc36d640 1 -- 172.21.15.44:0/2189971278 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3f41081c0 con 0x7fb3f4107d60 2024-08-19T00:04:17.234 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:16.510+0000 7fb3e77fe640 1 -- 172.21.15.44:0/2189971278 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7fb3e8045070 con 0x7fb3f4107d60 2024-08-19T00:04:17.234 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:16.511+0000 7fb3e77fe640 1 --2- 172.21.15.44:0/2189971278 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7fb3e0038eb0 0x7fb3e003b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:17.234 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:16.511+0000 7fb3e77fe640 1 -- 172.21.15.44:0/2189971278 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fb3e806be10 con 0x7fb3f4107d60 2024-08-19T00:04:17.234 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:16.511+0000 7fb3f9908640 1 --2- 172.21.15.44:0/2189971278 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7fb3e0038eb0 0x7fb3e003b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:17.234 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:16.511+0000 7fb3f9908640 1 --2- 172.21.15.44:0/2189971278 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7fb3e0038eb0 0x7fb3e003b370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb3f00098c0 tx=0x7fb3f0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:17.234 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:16.515+0000 7fb3e77fe640 1 -- 172.21.15.44:0/2189971278 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fb3e804b170 con 0x7fb3f4107d60 2024-08-19T00:04:17.234 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:16.705+0000 7fb3fc36d640 1 -- 172.21.15.44:0/2189971278 --> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7fb3f4102cc0 con 0x7fb3e0038eb0 2024-08-19T00:04:17.234 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:16.710+0000 7fb3e77fe640 1 -- 172.21.15.44:0/2189971278 <== mgr.14118 v2:172.21.15.44:6800/1300308907 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb3f4102cc0 con 0x7fb3e0038eb0 2024-08-19T00:04:17.235 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:16.712+0000 7fb3fc36d640 1 -- 172.21.15.44:0/2189971278 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7fb3e0038eb0 msgr2=0x7fb3e003b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:17.235 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:16.712+0000 7fb3fc36d640 1 --2- 172.21.15.44:0/2189971278 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7fb3e0038eb0 0x7fb3e003b370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb3f00098c0 tx=0x7fb3f0006db0 comp rx=0 tx=0).stop 2024-08-19T00:04:17.235 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:16.712+0000 7fb3fc36d640 1 -- 172.21.15.44:0/2189971278 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb3f4107d60 msgr2=0x7fb3f419b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:17.235 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:16.712+0000 7fb3fc36d640 1 --2- 172.21.15.44:0/2189971278 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb3f4107d60 0x7fb3f419b2f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb3e8032ce0 tx=0x7fb3e8032d10 comp rx=0 tx=0).stop 2024-08-19T00:04:17.235 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:16.712+0000 7fb3fc36d640 1 -- 172.21.15.44:0/2189971278 shutdown_connections 2024-08-19T00:04:17.235 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:16.712+0000 7fb3fc36d640 1 --2- 172.21.15.44:0/2189971278 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7fb3e0038eb0 0x7fb3e003b370 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:17.235 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:16.712+0000 7fb3fc36d640 1 --2- 172.21.15.44:0/2189971278 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb3f4107d60 0x7fb3f419b2f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:17.235 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:16.712+0000 7fb3fc36d640 1 -- 172.21.15.44:0/2189971278 >> 172.21.15.44:0/2189971278 conn(0x7fb3f4101a00 msgr2=0x7fb3f41025b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:04:17.235 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:16.712+0000 7fb3fc36d640 1 -- 172.21.15.44:0/2189971278 shutdown_connections 2024-08-19T00:04:17.235 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:16.712+0000 7fb3fc36d640 1 -- 172.21.15.44:0/2189971278 wait complete. 2024-08-19T00:04:17.551 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:17 smithi044 ceph-mon[18489]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-08-19T00:04:17.551 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:17 smithi044 ceph-mon[18489]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-08-19T00:04:17.551 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:17 smithi044 ceph-mon[18489]: from='mgr.14118 172.21.15.44:0/3360564934' entity='mgr.x' 2024-08-19T00:04:17.551 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:17 smithi044 ceph-mon[18489]: from='mgr.14118 172.21.15.44:0/3360564934' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:04:17.551 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:17 smithi044 ceph-mon[18489]: from='mgr.14118 172.21.15.44:0/3360564934' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:04:17.551 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:17 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:04:17.276+0000 7f40f7bff640 -1 log_channel(cephadm) log [ERR] : [19/Aug/2024:00:04:17] ENGINE Error in HTTPServer.serve 2024-08-19T00:04:17.552 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:17 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: Traceback (most recent call last): 2024-08-19T00:04:17.552 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:17 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-19T00:04:17.552 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:17 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: self._connections.run(self.expiration_interval) 2024-08-19T00:04:17.552 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:17 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-19T00:04:17.552 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:17 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: self._run(expiration_interval) 2024-08-19T00:04:17.552 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:17 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-19T00:04:17.552 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:17 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: new_conn = self._from_server_socket(self.server.socket) 2024-08-19T00:04:17.552 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:17 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-19T00:04:17.552 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:17 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-19T00:04:17.552 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:17 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-19T00:04:17.552 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:17 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: s = self.context.wrap_socket( 2024-08-19T00:04:17.552 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:17 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-19T00:04:17.552 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:17 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: return self.sslsocket_class._create( 2024-08-19T00:04:17.553 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:17 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-19T00:04:17.553 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:17 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: self.do_handshake() 2024-08-19T00:04:17.553 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:17 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-19T00:04:17.553 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:17 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: self._sslobj.do_handshake() 2024-08-19T00:04:17.553 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:17 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-19T00:04:17.553 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:17 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:04:18.370 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout value unchanged 2024-08-19T00:04:18.370 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:17.628+0000 7f8eda71e640 1 Processor -- start 2024-08-19T00:04:18.370 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:17.628+0000 7f8eda71e640 1 -- start start 2024-08-19T00:04:18.370 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:17.628+0000 7f8eda71e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ed41073d0 0x7f8ed41077d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:18.371 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:17.628+0000 7f8eda71e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8ed4107da0 con 0x7f8ed41073d0 2024-08-19T00:04:18.371 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:17.628+0000 7f8ed3fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ed41073d0 0x7f8ed41077d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:18.371 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:17.628+0000 7f8ed3fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ed41073d0 0x7f8ed41077d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34266/0 (socket says 172.21.15.44:34266) 2024-08-19T00:04:18.371 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:17.628+0000 7f8ed3fff640 1 -- 172.21.15.44:0/711747928 learned_addr learned my addr 172.21.15.44:0/711747928 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:04:18.371 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:17.628+0000 7f8ed3fff640 1 -- 172.21.15.44:0/711747928 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ed4108530 con 0x7f8ed41073d0 2024-08-19T00:04:18.371 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:17.629+0000 7f8ed3fff640 1 --2- 172.21.15.44:0/711747928 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ed41073d0 0x7f8ed41077d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8ec4009820 tx=0x7f8ec402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df9353d0047d6198 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:18.371 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:17.629+0000 7f8ed2ffd640 1 -- 172.21.15.44:0/711747928 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ec4037070 con 0x7f8ed41073d0 2024-08-19T00:04:18.371 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:17.629+0000 7f8ed2ffd640 1 -- 172.21.15.44:0/711747928 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8ec4032900 con 0x7f8ed41073d0 2024-08-19T00:04:18.371 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:17.629+0000 7f8ed2ffd640 1 -- 172.21.15.44:0/711747928 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ec4030850 con 0x7f8ed41073d0 2024-08-19T00:04:18.371 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:17.630+0000 7f8eda71e640 1 -- 172.21.15.44:0/711747928 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ed41073d0 msgr2=0x7f8ed41077d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:18.371 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:17.630+0000 7f8eda71e640 1 --2- 172.21.15.44:0/711747928 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ed41073d0 0x7f8ed41077d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8ec4009820 tx=0x7f8ec402a270 comp rx=0 tx=0).stop 2024-08-19T00:04:18.371 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:17.630+0000 7f8eda71e640 1 -- 172.21.15.44:0/711747928 shutdown_connections 2024-08-19T00:04:18.372 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:17.630+0000 7f8eda71e640 1 --2- 172.21.15.44:0/711747928 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ed41073d0 0x7f8ed41077d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:18.372 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:17.630+0000 7f8eda71e640 1 -- 172.21.15.44:0/711747928 >> 172.21.15.44:0/711747928 conn(0x7f8ed4102b80 msgr2=0x7f8ed4104fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:04:18.372 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:17.630+0000 7f8eda71e640 1 -- 172.21.15.44:0/711747928 shutdown_connections 2024-08-19T00:04:18.372 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:17.630+0000 7f8eda71e640 1 -- 172.21.15.44:0/711747928 wait complete. 2024-08-19T00:04:18.372 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:17.631+0000 7f8eda71e640 1 Processor -- start 2024-08-19T00:04:18.372 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:17.631+0000 7f8eda71e640 1 -- start start 2024-08-19T00:04:18.372 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:17.631+0000 7f8eda71e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ed41073d0 0x7f8ed419b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:18.372 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:17.631+0000 7f8eda71e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8ed410b8e0 con 0x7f8ed41073d0 2024-08-19T00:04:18.372 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:17.631+0000 7f8ed3fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ed41073d0 0x7f8ed419b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:18.372 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:17.631+0000 7f8ed3fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ed41073d0 0x7f8ed419b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34276/0 (socket says 172.21.15.44:34276) 2024-08-19T00:04:18.372 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:17.631+0000 7f8ed3fff640 1 -- 172.21.15.44:0/295906291 learned_addr learned my addr 172.21.15.44:0/295906291 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:04:18.372 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:17.631+0000 7f8ed3fff640 1 -- 172.21.15.44:0/295906291 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ed419b860 con 0x7f8ed41073d0 2024-08-19T00:04:18.372 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:17.632+0000 7f8ed3fff640 1 --2- 172.21.15.44:0/295906291 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ed41073d0 0x7f8ed419b320 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8ec40097f0 tx=0x7f8ec4030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:18.372 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:17.632+0000 7f8ed17fa640 1 -- 172.21.15.44:0/295906291 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ec4037040 con 0x7f8ed41073d0 2024-08-19T00:04:18.373 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:17.632+0000 7f8ed17fa640 1 -- 172.21.15.44:0/295906291 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8ec4040070 con 0x7f8ed41073d0 2024-08-19T00:04:18.373 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:17.632+0000 7f8eda71e640 1 -- 172.21.15.44:0/295906291 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ed419baf0 con 0x7f8ed41073d0 2024-08-19T00:04:18.373 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:17.632+0000 7f8ed17fa640 1 -- 172.21.15.44:0/295906291 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ec403a390 con 0x7f8ed41073d0 2024-08-19T00:04:18.373 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:17.632+0000 7f8eda71e640 1 -- 172.21.15.44:0/295906291 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ed419e7e0 con 0x7f8ed41073d0 2024-08-19T00:04:18.373 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:17.633+0000 7f8ed17fa640 1 -- 172.21.15.44:0/295906291 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f8ec403a5e0 con 0x7f8ed41073d0 2024-08-19T00:04:18.373 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:17.633+0000 7f8ed17fa640 1 --2- 172.21.15.44:0/295906291 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7f8ebc038fc0 0x7f8ebc03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:18.373 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:17.633+0000 7f8ed17fa640 1 -- 172.21.15.44:0/295906291 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f8ec406c5c0 con 0x7f8ed41073d0 2024-08-19T00:04:18.373 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:17.633+0000 7f8ed37fe640 1 --2- 172.21.15.44:0/295906291 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7f8ebc038fc0 0x7f8ebc03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:18.373 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:17.633+0000 7f8eda71e640 1 -- 172.21.15.44:0/295906291 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ed410ba60 con 0x7f8ed41073d0 2024-08-19T00:04:18.373 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:17.633+0000 7f8ed37fe640 1 --2- 172.21.15.44:0/295906291 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7f8ebc038fc0 0x7f8ebc03b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8ec80098c0 tx=0x7f8ec8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:18.373 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:17.638+0000 7f8ed17fa640 1 -- 172.21.15.44:0/295906291 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f8ec403b430 con 0x7f8ed41073d0 2024-08-19T00:04:18.373 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:17.813+0000 7f8eda71e640 1 -- 172.21.15.44:0/295906291 --> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f8ed4103db0 con 0x7f8ebc038fc0 2024-08-19T00:04:18.374 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:17.814+0000 7f8ed17fa640 1 -- 172.21.15.44:0/295906291 <== mgr.14118 v2:172.21.15.44:6800/1300308907 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f8ed4103db0 con 0x7f8ebc038fc0 2024-08-19T00:04:18.374 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:17.816+0000 7f8eda71e640 1 -- 172.21.15.44:0/295906291 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7f8ebc038fc0 msgr2=0x7f8ebc03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:18.374 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:17.816+0000 7f8eda71e640 1 --2- 172.21.15.44:0/295906291 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7f8ebc038fc0 0x7f8ebc03b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8ec80098c0 tx=0x7f8ec8006db0 comp rx=0 tx=0).stop 2024-08-19T00:04:18.374 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:17.816+0000 7f8eda71e640 1 -- 172.21.15.44:0/295906291 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ed41073d0 msgr2=0x7f8ed419b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:18.374 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:17.816+0000 7f8eda71e640 1 --2- 172.21.15.44:0/295906291 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ed41073d0 0x7f8ed419b320 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8ec40097f0 tx=0x7f8ec4030d80 comp rx=0 tx=0).stop 2024-08-19T00:04:18.374 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:17.817+0000 7f8eda71e640 1 -- 172.21.15.44:0/295906291 shutdown_connections 2024-08-19T00:04:18.374 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:17.817+0000 7f8eda71e640 1 --2- 172.21.15.44:0/295906291 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7f8ebc038fc0 0x7f8ebc03b480 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:18.374 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:17.817+0000 7f8eda71e640 1 --2- 172.21.15.44:0/295906291 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ed41073d0 0x7f8ed419b320 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:18.374 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:17.817+0000 7f8eda71e640 1 -- 172.21.15.44:0/295906291 >> 172.21.15.44:0/295906291 conn(0x7f8ed4102b80 msgr2=0x7f8ed41036a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:04:18.374 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:17.817+0000 7f8eda71e640 1 -- 172.21.15.44:0/295906291 shutdown_connections 2024-08-19T00:04:18.374 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:17.817+0000 7f8eda71e640 1 -- 172.21.15.44:0/295906291 wait complete. 2024-08-19T00:04:18.374 INFO:teuthology.orchestra.run.smithi044.stdout:Generating ssh key... 2024-08-19T00:04:18.622 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:18 smithi044 ceph-mon[18489]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:04:18.622 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:18 smithi044 ceph-mon[18489]: [19/Aug/2024:00:04:17] ENGINE Bus STARTING 2024-08-19T00:04:18.622 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:18 smithi044 ceph-mon[18489]: [19/Aug/2024:00:04:17] ENGINE Serving on http://172.21.15.44:8765 2024-08-19T00:04:18.622 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:18 smithi044 ceph-mon[18489]: [19/Aug/2024:00:04:17] ENGINE Serving on https://172.21.15.44:7150 2024-08-19T00:04:18.622 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:18 smithi044 ceph-mon[18489]: [19/Aug/2024:00:04:17] ENGINE Bus STARTED 2024-08-19T00:04:18.623 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:18 smithi044 ceph-mon[18489]: [19/Aug/2024:00:04:17] ENGINE Error in HTTPServer.serve 2024-08-19T00:04:18.623 INFO:journalctl@ceph.mon.a.smithi044.stdout: Traceback (most recent call last): 2024-08-19T00:04:18.623 INFO:journalctl@ceph.mon.a.smithi044.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-19T00:04:18.623 INFO:journalctl@ceph.mon.a.smithi044.stdout: self._connections.run(self.expiration_interval) 2024-08-19T00:04:18.623 INFO:journalctl@ceph.mon.a.smithi044.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-19T00:04:18.623 INFO:journalctl@ceph.mon.a.smithi044.stdout: self._run(expiration_interval) 2024-08-19T00:04:18.623 INFO:journalctl@ceph.mon.a.smithi044.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-19T00:04:18.623 INFO:journalctl@ceph.mon.a.smithi044.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-19T00:04:18.623 INFO:journalctl@ceph.mon.a.smithi044.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-19T00:04:18.623 INFO:journalctl@ceph.mon.a.smithi044.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-19T00:04:18.623 INFO:journalctl@ceph.mon.a.smithi044.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-19T00:04:18.623 INFO:journalctl@ceph.mon.a.smithi044.stdout: s = self.context.wrap_socket( 2024-08-19T00:04:18.623 INFO:journalctl@ceph.mon.a.smithi044.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-19T00:04:18.624 INFO:journalctl@ceph.mon.a.smithi044.stdout: return self.sslsocket_class._create( 2024-08-19T00:04:18.624 INFO:journalctl@ceph.mon.a.smithi044.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-19T00:04:18.624 INFO:journalctl@ceph.mon.a.smithi044.stdout: self.do_handshake() 2024-08-19T00:04:18.624 INFO:journalctl@ceph.mon.a.smithi044.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-19T00:04:18.624 INFO:journalctl@ceph.mon.a.smithi044.stdout: self._sslobj.do_handshake() 2024-08-19T00:04:18.624 INFO:journalctl@ceph.mon.a.smithi044.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-19T00:04:18.624 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:18 smithi044 ceph-mon[18489]: mgrmap e8: x(active, since 2s) 2024-08-19T00:04:19.602 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:19 smithi044 ceph-mon[18489]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:04:19.602 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:19 smithi044 ceph-mon[18489]: from='mgr.14118 172.21.15.44:0/3360564934' entity='mgr.x' 2024-08-19T00:04:19.602 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:19 smithi044 ceph-mon[18489]: from='mgr.14118 172.21.15.44:0/3360564934' entity='mgr.x' 2024-08-19T00:04:19.603 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:19 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: Generating public/private rsa key pair. 2024-08-19T00:04:19.603 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:19 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: Your identification has been saved in /tmp/tmpwz1v8it7/key 2024-08-19T00:04:19.603 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:19 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: Your public key has been saved in /tmp/tmpwz1v8it7/key.pub 2024-08-19T00:04:19.603 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:19 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: The key fingerprint is: 2024-08-19T00:04:19.603 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:19 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: SHA256:ypAtvDjYI+JFYpES3N/kXQDatlWgIV1v0DrSl9UnFP0 ceph-647ded64-5dbe-11ef-bccf-c7b262605968 2024-08-19T00:04:19.603 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:19 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: The key's randomart image is: 2024-08-19T00:04:19.603 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:19 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: +---[RSA 3072]----+ 2024-08-19T00:04:19.604 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:19 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: |o . ..oo=+. .+o | 2024-08-19T00:04:19.604 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:19 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: | o.. +oo +o ...o| 2024-08-19T00:04:19.604 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:19 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: |.o ..++o.ooo .o| 2024-08-19T00:04:19.604 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:19 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: |. .. +.+o=.o E| 2024-08-19T00:04:19.604 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:19 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: | o .= ..S o | 2024-08-19T00:04:19.604 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:19 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: |.oo. = . | 2024-08-19T00:04:19.604 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:19 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: |+ =.. o | 2024-08-19T00:04:19.604 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:19 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: |o..o | 2024-08-19T00:04:19.604 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:19 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: | . | 2024-08-19T00:04:19.604 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:19 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: +----[SHA256]-----+ 2024-08-19T00:04:19.869 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:18.788+0000 7f973f7e7640 1 Processor -- start 2024-08-19T00:04:19.869 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:18.788+0000 7f973f7e7640 1 -- start start 2024-08-19T00:04:19.869 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:18.788+0000 7f973f7e7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97381073e0 0x7f97381077e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:19.869 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:18.788+0000 7f973f7e7640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9738107d20 con 0x7f97381073e0 2024-08-19T00:04:19.870 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:18.789+0000 7f973d583640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97381073e0 0x7f97381077e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:19.870 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:18.789+0000 7f973d583640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97381073e0 0x7f97381077e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52640/0 (socket says 172.21.15.44:52640) 2024-08-19T00:04:19.870 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:18.789+0000 7f973d583640 1 -- 172.21.15.44:0/1685631997 learned_addr learned my addr 172.21.15.44:0/1685631997 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:04:19.870 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:18.789+0000 7f973d583640 1 -- 172.21.15.44:0/1685631997 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9738107ea0 con 0x7f97381073e0 2024-08-19T00:04:19.870 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:18.790+0000 7f973d583640 1 --2- 172.21.15.44:0/1685631997 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97381073e0 0x7f97381077e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9730009820 tx=0x7f973002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41cf27c6873d5cfb server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:19.870 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:18.790+0000 7f9737fff640 1 -- 172.21.15.44:0/1685631997 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9730037070 con 0x7f97381073e0 2024-08-19T00:04:19.870 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:18.790+0000 7f9737fff640 1 -- 172.21.15.44:0/1685631997 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9730032900 con 0x7f97381073e0 2024-08-19T00:04:19.870 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:18.790+0000 7f9737fff640 1 -- 172.21.15.44:0/1685631997 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9730030850 con 0x7f97381073e0 2024-08-19T00:04:19.870 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:18.790+0000 7f973f7e7640 1 -- 172.21.15.44:0/1685631997 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97381073e0 msgr2=0x7f97381077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:19.870 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:18.790+0000 7f973f7e7640 1 --2- 172.21.15.44:0/1685631997 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97381073e0 0x7f97381077e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9730009820 tx=0x7f973002a270 comp rx=0 tx=0).stop 2024-08-19T00:04:19.870 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:18.790+0000 7f973f7e7640 1 -- 172.21.15.44:0/1685631997 shutdown_connections 2024-08-19T00:04:19.871 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:18.790+0000 7f973f7e7640 1 --2- 172.21.15.44:0/1685631997 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97381073e0 0x7f97381077e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:19.871 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:18.790+0000 7f973f7e7640 1 -- 172.21.15.44:0/1685631997 >> 172.21.15.44:0/1685631997 conn(0x7f9738102c50 msgr2=0x7f9738105070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:04:19.871 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:18.791+0000 7f973f7e7640 1 -- 172.21.15.44:0/1685631997 shutdown_connections 2024-08-19T00:04:19.871 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:18.791+0000 7f973f7e7640 1 -- 172.21.15.44:0/1685631997 wait complete. 2024-08-19T00:04:19.871 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:18.791+0000 7f973f7e7640 1 Processor -- start 2024-08-19T00:04:19.871 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:18.791+0000 7f973f7e7640 1 -- start start 2024-08-19T00:04:19.871 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:18.791+0000 7f973f7e7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97381073e0 0x7f973819b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:19.871 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:18.791+0000 7f973f7e7640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f973810b800 con 0x7f97381073e0 2024-08-19T00:04:19.871 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:18.792+0000 7f973d583640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97381073e0 0x7f973819b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:19.871 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:18.792+0000 7f973d583640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97381073e0 0x7f973819b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52644/0 (socket says 172.21.15.44:52644) 2024-08-19T00:04:19.872 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:18.792+0000 7f973d583640 1 -- 172.21.15.44:0/3568710563 learned_addr learned my addr 172.21.15.44:0/3568710563 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:04:19.872 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:18.792+0000 7f973d583640 1 -- 172.21.15.44:0/3568710563 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f973819b830 con 0x7f97381073e0 2024-08-19T00:04:19.872 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:18.792+0000 7f973d583640 1 --2- 172.21.15.44:0/3568710563 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97381073e0 0x7f973819b2f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9730032ce0 tx=0x7f9730032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:19.872 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:18.792+0000 7f97367fc640 1 -- 172.21.15.44:0/3568710563 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9730042070 con 0x7f97381073e0 2024-08-19T00:04:19.872 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:18.792+0000 7f97367fc640 1 -- 172.21.15.44:0/3568710563 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f97300308c0 con 0x7f97381073e0 2024-08-19T00:04:19.872 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:18.792+0000 7f973f7e7640 1 -- 172.21.15.44:0/3568710563 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f973819bac0 con 0x7f97381073e0 2024-08-19T00:04:19.872 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:18.792+0000 7f97367fc640 1 -- 172.21.15.44:0/3568710563 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9730037040 con 0x7f97381073e0 2024-08-19T00:04:19.872 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:18.792+0000 7f973f7e7640 1 -- 172.21.15.44:0/3568710563 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f973819e7b0 con 0x7f97381073e0 2024-08-19T00:04:19.872 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:18.793+0000 7f97367fc640 1 -- 172.21.15.44:0/3568710563 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f9730045070 con 0x7f97381073e0 2024-08-19T00:04:19.872 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:18.793+0000 7f973f7e7640 1 -- 172.21.15.44:0/3568710563 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9738107860 con 0x7f97381073e0 2024-08-19T00:04:19.872 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:18.793+0000 7f97367fc640 1 --2- 172.21.15.44:0/3568710563 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7f9720038f70 0x7f972003b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:19.873 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:18.793+0000 7f97367fc640 1 -- 172.21.15.44:0/3568710563 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f973006c1a0 con 0x7f97381073e0 2024-08-19T00:04:19.873 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:18.793+0000 7f973cd82640 1 --2- 172.21.15.44:0/3568710563 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7f9720038f70 0x7f972003b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:19.873 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:18.794+0000 7f973cd82640 1 --2- 172.21.15.44:0/3568710563 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7f9720038f70 0x7f972003b430 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f972c0098c0 tx=0x7f972c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:19.873 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:18.798+0000 7f97367fc640 1 -- 172.21.15.44:0/3568710563 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f973003cd00 con 0x7f97381073e0 2024-08-19T00:04:19.873 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:18.976+0000 7f973f7e7640 1 -- 172.21.15.44:0/3568710563 --> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f9738103de0 con 0x7f9720038f70 2024-08-19T00:04:19.873 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:19.326+0000 7f97367fc640 1 -- 172.21.15.44:0/3568710563 <== mgr.14118 v2:172.21.15.44:6800/1300308907 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f9738103de0 con 0x7f9720038f70 2024-08-19T00:04:19.873 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:19.328+0000 7f973f7e7640 1 -- 172.21.15.44:0/3568710563 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7f9720038f70 msgr2=0x7f972003b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:19.873 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:19.328+0000 7f973f7e7640 1 --2- 172.21.15.44:0/3568710563 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7f9720038f70 0x7f972003b430 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f972c0098c0 tx=0x7f972c006db0 comp rx=0 tx=0).stop 2024-08-19T00:04:19.873 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:19.328+0000 7f973f7e7640 1 -- 172.21.15.44:0/3568710563 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97381073e0 msgr2=0x7f973819b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:19.874 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:19.328+0000 7f973f7e7640 1 --2- 172.21.15.44:0/3568710563 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97381073e0 0x7f973819b2f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9730032ce0 tx=0x7f9730032d10 comp rx=0 tx=0).stop 2024-08-19T00:04:19.874 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:19.328+0000 7f973f7e7640 1 -- 172.21.15.44:0/3568710563 shutdown_connections 2024-08-19T00:04:19.874 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:19.328+0000 7f973f7e7640 1 --2- 172.21.15.44:0/3568710563 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7f9720038f70 0x7f972003b430 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:19.874 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:19.328+0000 7f973f7e7640 1 --2- 172.21.15.44:0/3568710563 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97381073e0 0x7f973819b2f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:19.874 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:19.328+0000 7f973f7e7640 1 -- 172.21.15.44:0/3568710563 >> 172.21.15.44:0/3568710563 conn(0x7f9738102c50 msgr2=0x7f97381036d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:04:19.874 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:19.328+0000 7f973f7e7640 1 -- 172.21.15.44:0/3568710563 shutdown_connections 2024-08-19T00:04:19.874 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:19.328+0000 7f973f7e7640 1 -- 172.21.15.44:0/3568710563 wait complete. 2024-08-19T00:04:20.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:20 smithi044 ceph-mon[18489]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:04:20.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:20 smithi044 ceph-mon[18489]: Generating ssh key... 2024-08-19T00:04:21.017 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDvw3z3CuXtOgC0hKfSfQvJQ/L+DkfjdFIqfC0rQocYCRJrKCb7Mpd1rJ9rXWLSquYMe1hGL0cGp74/b0sMVhgmNWSyT2/izjXQmJJRh917ZTxR2GFIWFzEtfBZQ3VZh/M3wXra7jweKaLXwafHkacVwBi8uC2+vQHuewMsEWE2F8HA7OdbS2SM4SS8CfibBvhI/BUfHQQW312GDt8nlTu57PJWUvYUz6J9vB7yxCF9E7s/xwcVgAHtFh74pvn8J854xDJc1jEMnDlG54cvl/3RG1SxE5lnQwklCemILlzlxacu77WIwBxMVpRJ15HobY6HEALibnOPiajvdFpqoKUT8mKe1WfG22c4XhBkuXanFnD5vSXM5SwUAR/KeCd+xSS/shgSqSd3gByM+B5XPUIkizGbCmmXM4J1qbuitokfWs1T28bkVUasOJ5j9w/RWeKq+VkcF+TG1eXN06fQXGmGQ6uMCKyjc8M7BNF1t8QtEsB+sxmnoKsWhPHZCRaKiRs= ceph-647ded64-5dbe-11ef-bccf-c7b262605968 2024-08-19T00:04:21.018 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:20.233+0000 7f9846587640 1 Processor -- start 2024-08-19T00:04:21.018 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:20.233+0000 7f9846587640 1 -- start start 2024-08-19T00:04:21.018 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:20.233+0000 7f9846587640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98401061f0 0x7f98401065f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:21.018 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:20.233+0000 7f9846587640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9840106bc0 con 0x7f98401061f0 2024-08-19T00:04:21.018 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:20.233+0000 7f983ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98401061f0 0x7f98401065f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:21.018 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:20.233+0000 7f983ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98401061f0 0x7f98401065f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52648/0 (socket says 172.21.15.44:52648) 2024-08-19T00:04:21.018 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:20.233+0000 7f983ffff640 1 -- 172.21.15.44:0/3606840591 learned_addr learned my addr 172.21.15.44:0/3606840591 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:04:21.018 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:20.234+0000 7f983ffff640 1 -- 172.21.15.44:0/3606840591 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98401073f0 con 0x7f98401061f0 2024-08-19T00:04:21.018 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:20.234+0000 7f983ffff640 1 --2- 172.21.15.44:0/3606840591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98401061f0 0x7f98401065f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9830009820 tx=0x7f983002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=307a4430943d3c8b server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:21.018 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:20.235+0000 7f983effd640 1 -- 172.21.15.44:0/3606840591 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9830037070 con 0x7f98401061f0 2024-08-19T00:04:21.018 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:20.235+0000 7f983effd640 1 -- 172.21.15.44:0/3606840591 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9830032900 con 0x7f98401061f0 2024-08-19T00:04:21.019 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:20.235+0000 7f983effd640 1 -- 172.21.15.44:0/3606840591 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9830030850 con 0x7f98401061f0 2024-08-19T00:04:21.019 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:20.235+0000 7f9846587640 1 -- 172.21.15.44:0/3606840591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98401061f0 msgr2=0x7f98401065f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:21.019 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:20.235+0000 7f9846587640 1 --2- 172.21.15.44:0/3606840591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98401061f0 0x7f98401065f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9830009820 tx=0x7f983002a270 comp rx=0 tx=0).stop 2024-08-19T00:04:21.019 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:20.235+0000 7f9846587640 1 -- 172.21.15.44:0/3606840591 shutdown_connections 2024-08-19T00:04:21.019 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:20.235+0000 7f9846587640 1 --2- 172.21.15.44:0/3606840591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98401061f0 0x7f98401065f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:21.019 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:20.235+0000 7f9846587640 1 -- 172.21.15.44:0/3606840591 >> 172.21.15.44:0/3606840591 conn(0x7f9840101a00 msgr2=0x7f9840103e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:04:21.019 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:20.235+0000 7f9846587640 1 -- 172.21.15.44:0/3606840591 shutdown_connections 2024-08-19T00:04:21.019 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:20.235+0000 7f9846587640 1 -- 172.21.15.44:0/3606840591 wait complete. 2024-08-19T00:04:21.019 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:20.236+0000 7f9846587640 1 Processor -- start 2024-08-19T00:04:21.019 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:20.236+0000 7f9846587640 1 -- start start 2024-08-19T00:04:21.019 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:20.236+0000 7f9846587640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98401061f0 0x7f984007b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:21.019 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:20.236+0000 7f9846587640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f984010a7a0 con 0x7f98401061f0 2024-08-19T00:04:21.020 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:20.236+0000 7f983ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98401061f0 0x7f984007b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:21.020 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:20.236+0000 7f983ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98401061f0 0x7f984007b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52650/0 (socket says 172.21.15.44:52650) 2024-08-19T00:04:21.020 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:20.236+0000 7f983ffff640 1 -- 172.21.15.44:0/2839138299 learned_addr learned my addr 172.21.15.44:0/2839138299 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:04:21.020 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:20.237+0000 7f983ffff640 1 -- 172.21.15.44:0/2839138299 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f984019e0e0 con 0x7f98401061f0 2024-08-19T00:04:21.020 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:20.237+0000 7f983ffff640 1 --2- 172.21.15.44:0/2839138299 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98401061f0 0x7f984007b9d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9830009940 tx=0x7f9830032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:21.020 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:20.237+0000 7f983d7fa640 1 -- 172.21.15.44:0/2839138299 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9830042070 con 0x7f98401061f0 2024-08-19T00:04:21.020 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:20.237+0000 7f983d7fa640 1 -- 172.21.15.44:0/2839138299 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f98300308c0 con 0x7f98401061f0 2024-08-19T00:04:21.020 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:20.237+0000 7f9846587640 1 -- 172.21.15.44:0/2839138299 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f984019e2b0 con 0x7f98401061f0 2024-08-19T00:04:21.020 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:20.237+0000 7f983d7fa640 1 -- 172.21.15.44:0/2839138299 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9830037040 con 0x7f98401061f0 2024-08-19T00:04:21.020 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:20.237+0000 7f9846587640 1 -- 172.21.15.44:0/2839138299 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f984019e650 con 0x7f98401061f0 2024-08-19T00:04:21.020 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:20.238+0000 7f983d7fa640 1 -- 172.21.15.44:0/2839138299 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f9830045070 con 0x7f98401061f0 2024-08-19T00:04:21.020 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:20.238+0000 7f9846587640 1 -- 172.21.15.44:0/2839138299 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f984010a920 con 0x7f98401061f0 2024-08-19T00:04:21.020 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:20.238+0000 7f983d7fa640 1 --2- 172.21.15.44:0/2839138299 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7f9828038f70 0x7f982803b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:21.021 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:20.238+0000 7f983d7fa640 1 -- 172.21.15.44:0/2839138299 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f983006c040 con 0x7f98401061f0 2024-08-19T00:04:21.021 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:20.238+0000 7f983f7fe640 1 --2- 172.21.15.44:0/2839138299 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7f9828038f70 0x7f982803b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:21.021 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:20.239+0000 7f983f7fe640 1 --2- 172.21.15.44:0/2839138299 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7f9828038f70 0x7f982803b430 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f98340098c0 tx=0x7f9834006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:21.021 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:20.243+0000 7f983d7fa640 1 -- 172.21.15.44:0/2839138299 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f9830045520 con 0x7f98401061f0 2024-08-19T00:04:21.021 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:20.445+0000 7f9846587640 1 -- 172.21.15.44:0/2839138299 --> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f9840102cc0 con 0x7f9828038f70 2024-08-19T00:04:21.021 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:20.445+0000 7f983d7fa640 1 -- 172.21.15.44:0/2839138299 <== mgr.14118 v2:172.21.15.44:6800/1300308907 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f9840102cc0 con 0x7f9828038f70 2024-08-19T00:04:21.021 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:20.447+0000 7f9846587640 1 -- 172.21.15.44:0/2839138299 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7f9828038f70 msgr2=0x7f982803b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:21.021 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:20.447+0000 7f9846587640 1 --2- 172.21.15.44:0/2839138299 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7f9828038f70 0x7f982803b430 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f98340098c0 tx=0x7f9834006db0 comp rx=0 tx=0).stop 2024-08-19T00:04:21.021 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:20.447+0000 7f9846587640 1 -- 172.21.15.44:0/2839138299 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98401061f0 msgr2=0x7f984007b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:21.021 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:20.447+0000 7f9846587640 1 --2- 172.21.15.44:0/2839138299 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98401061f0 0x7f984007b9d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9830009940 tx=0x7f9830032ce0 comp rx=0 tx=0).stop 2024-08-19T00:04:21.021 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:20.447+0000 7f9846587640 1 -- 172.21.15.44:0/2839138299 shutdown_connections 2024-08-19T00:04:21.021 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:20.447+0000 7f9846587640 1 --2- 172.21.15.44:0/2839138299 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7f9828038f70 0x7f982803b430 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:21.021 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:20.447+0000 7f9846587640 1 --2- 172.21.15.44:0/2839138299 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98401061f0 0x7f984007b9d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:21.022 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:20.447+0000 7f9846587640 1 -- 172.21.15.44:0/2839138299 >> 172.21.15.44:0/2839138299 conn(0x7f9840101a00 msgr2=0x7f98401025b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:04:21.022 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:20.447+0000 7f9846587640 1 -- 172.21.15.44:0/2839138299 shutdown_connections 2024-08-19T00:04:21.022 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:20.447+0000 7f9846587640 1 -- 172.21.15.44:0/2839138299 wait complete. 2024-08-19T00:04:21.022 INFO:teuthology.orchestra.run.smithi044.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-08-19T00:04:21.022 INFO:teuthology.orchestra.run.smithi044.stdout:Adding key to root@localhost authorized_keys... 2024-08-19T00:04:21.022 INFO:teuthology.orchestra.run.smithi044.stdout:Adding host smithi044... 2024-08-19T00:04:21.604 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:21 smithi044 ceph-mon[18489]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:04:22.936 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:22 smithi044 ceph-mon[18489]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi044", "addr": "172.21.15.44", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:04:23.823 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:23 smithi044 ceph-mon[18489]: Deploying cephadm binary to smithi044 2024-08-19T00:04:26.093 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout Added host 'smithi044' with addr '172.21.15.44' 2024-08-19T00:04:26.093 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:21.414+0000 7fa83c9a5640 1 Processor -- start 2024-08-19T00:04:26.093 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:21.414+0000 7fa83c9a5640 1 -- start start 2024-08-19T00:04:26.093 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:21.414+0000 7fa83c9a5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa838105630 0x7fa838105a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:26.093 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:21.414+0000 7fa83c9a5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa838106000 con 0x7fa838105630 2024-08-19T00:04:26.093 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:21.414+0000 7fa83659c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa838105630 0x7fa838105a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:26.094 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:21.414+0000 7fa83659c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa838105630 0x7fa838105a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52658/0 (socket says 172.21.15.44:52658) 2024-08-19T00:04:26.094 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:21.414+0000 7fa83659c640 1 -- 172.21.15.44:0/3634040145 learned_addr learned my addr 172.21.15.44:0/3634040145 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:04:26.094 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:21.415+0000 7fa83659c640 1 -- 172.21.15.44:0/3634040145 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa838108610 con 0x7fa838105630 2024-08-19T00:04:26.094 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:21.415+0000 7fa83659c640 1 --2- 172.21.15.44:0/3634040145 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa838105630 0x7fa838105a30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa828009820 tx=0x7fa82802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=963d51a14e81a2d6 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:26.094 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:21.416+0000 7fa83559a640 1 -- 172.21.15.44:0/3634040145 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa828037070 con 0x7fa838105630 2024-08-19T00:04:26.094 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:21.416+0000 7fa83559a640 1 -- 172.21.15.44:0/3634040145 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa828032900 con 0x7fa838105630 2024-08-19T00:04:26.094 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:21.416+0000 7fa83559a640 1 -- 172.21.15.44:0/3634040145 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa828030850 con 0x7fa838105630 2024-08-19T00:04:26.094 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:21.416+0000 7fa83c9a5640 1 -- 172.21.15.44:0/3634040145 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa838105630 msgr2=0x7fa838105a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:26.094 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:21.416+0000 7fa83c9a5640 1 --2- 172.21.15.44:0/3634040145 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa838105630 0x7fa838105a30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa828009820 tx=0x7fa82802a270 comp rx=0 tx=0).stop 2024-08-19T00:04:26.094 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:21.416+0000 7fa83c9a5640 1 -- 172.21.15.44:0/3634040145 shutdown_connections 2024-08-19T00:04:26.094 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:21.416+0000 7fa83c9a5640 1 --2- 172.21.15.44:0/3634040145 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa838105630 0x7fa838105a30 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:26.094 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:21.416+0000 7fa83c9a5640 1 -- 172.21.15.44:0/3634040145 >> 172.21.15.44:0/3634040145 conn(0x7fa8381011a0 msgr2=0x7fa8381035c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:04:26.094 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:21.416+0000 7fa83c9a5640 1 -- 172.21.15.44:0/3634040145 shutdown_connections 2024-08-19T00:04:26.095 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:21.416+0000 7fa83c9a5640 1 -- 172.21.15.44:0/3634040145 wait complete. 2024-08-19T00:04:26.095 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:21.417+0000 7fa83c9a5640 1 Processor -- start 2024-08-19T00:04:26.095 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:21.417+0000 7fa83c9a5640 1 -- start start 2024-08-19T00:04:26.095 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:21.417+0000 7fa83c9a5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa838105630 0x7fa838107e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:26.095 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:21.417+0000 7fa83c9a5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa83810b840 con 0x7fa838105630 2024-08-19T00:04:26.095 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:21.417+0000 7fa83659c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa838105630 0x7fa838107e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:26.095 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:21.417+0000 7fa83659c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa838105630 0x7fa838107e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52664/0 (socket says 172.21.15.44:52664) 2024-08-19T00:04:26.095 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:21.417+0000 7fa83659c640 1 -- 172.21.15.44:0/1213642656 learned_addr learned my addr 172.21.15.44:0/1213642656 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:04:26.095 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:21.418+0000 7fa83659c640 1 -- 172.21.15.44:0/1213642656 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8381083d0 con 0x7fa838105630 2024-08-19T00:04:26.095 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:21.418+0000 7fa83659c640 1 --2- 172.21.15.44:0/1213642656 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa838105630 0x7fa838107e90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa828009940 tx=0x7fa828032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:26.095 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:21.418+0000 7fa8277fe640 1 -- 172.21.15.44:0/1213642656 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa828042070 con 0x7fa838105630 2024-08-19T00:04:26.095 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:21.418+0000 7fa8277fe640 1 -- 172.21.15.44:0/1213642656 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa8280308c0 con 0x7fa838105630 2024-08-19T00:04:26.095 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:21.418+0000 7fa83c9a5640 1 -- 172.21.15.44:0/1213642656 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8381065c0 con 0x7fa838105630 2024-08-19T00:04:26.096 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:21.418+0000 7fa8277fe640 1 -- 172.21.15.44:0/1213642656 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa828037040 con 0x7fa838105630 2024-08-19T00:04:26.096 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:21.418+0000 7fa83c9a5640 1 -- 172.21.15.44:0/1213642656 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa838106b00 con 0x7fa838105630 2024-08-19T00:04:26.096 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:21.419+0000 7fa8277fe640 1 -- 172.21.15.44:0/1213642656 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fa828045070 con 0x7fa838105630 2024-08-19T00:04:26.096 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:21.419+0000 7fa8277fe640 1 --2- 172.21.15.44:0/1213642656 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7fa820038f70 0x7fa82003b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:26.096 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:21.419+0000 7fa83c9a5640 1 -- 172.21.15.44:0/1213642656 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa838105ab0 con 0x7fa838105630 2024-08-19T00:04:26.096 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:21.419+0000 7fa8277fe640 1 -- 172.21.15.44:0/1213642656 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa82806c290 con 0x7fa838105630 2024-08-19T00:04:26.096 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:21.419+0000 7fa835d9b640 1 --2- 172.21.15.44:0/1213642656 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7fa820038f70 0x7fa82003b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:26.096 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:21.420+0000 7fa835d9b640 1 --2- 172.21.15.44:0/1213642656 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7fa820038f70 0x7fa82003b430 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa82c0098c0 tx=0x7fa82c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:26.096 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:21.424+0000 7fa8277fe640 1 -- 172.21.15.44:0/1213642656 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fa82803cd90 con 0x7fa838105630 2024-08-19T00:04:26.096 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:21.603+0000 7fa83c9a5640 1 -- 172.21.15.44:0/1213642656 --> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi044", "addr": "172.21.15.44", "target": ["mon-mgr", ""]}) -- 0x7fa838107430 con 0x7fa820038f70 2024-08-19T00:04:26.096 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:25.464+0000 7fa8277fe640 1 -- 172.21.15.44:0/1213642656 <== mgr.14118 v2:172.21.15.44:6800/1300308907 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7fa838107430 con 0x7fa820038f70 2024-08-19T00:04:26.096 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:25.467+0000 7fa83c9a5640 1 -- 172.21.15.44:0/1213642656 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7fa820038f70 msgr2=0x7fa82003b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:26.097 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:25.467+0000 7fa83c9a5640 1 --2- 172.21.15.44:0/1213642656 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7fa820038f70 0x7fa82003b430 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa82c0098c0 tx=0x7fa82c006db0 comp rx=0 tx=0).stop 2024-08-19T00:04:26.097 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:25.467+0000 7fa83c9a5640 1 -- 172.21.15.44:0/1213642656 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa838105630 msgr2=0x7fa838107e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:26.097 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:25.467+0000 7fa83c9a5640 1 --2- 172.21.15.44:0/1213642656 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa838105630 0x7fa838107e90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa828009940 tx=0x7fa828032ce0 comp rx=0 tx=0).stop 2024-08-19T00:04:26.097 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:25.467+0000 7fa83c9a5640 1 -- 172.21.15.44:0/1213642656 shutdown_connections 2024-08-19T00:04:26.097 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:25.467+0000 7fa83c9a5640 1 --2- 172.21.15.44:0/1213642656 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7fa820038f70 0x7fa82003b430 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:26.097 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:25.467+0000 7fa83c9a5640 1 --2- 172.21.15.44:0/1213642656 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa838105630 0x7fa838107e90 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:26.097 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:25.467+0000 7fa83c9a5640 1 -- 172.21.15.44:0/1213642656 >> 172.21.15.44:0/1213642656 conn(0x7fa8381011a0 msgr2=0x7fa838101d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:04:26.097 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:25.467+0000 7fa83c9a5640 1 -- 172.21.15.44:0/1213642656 shutdown_connections 2024-08-19T00:04:26.097 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:25.467+0000 7fa83c9a5640 1 -- 172.21.15.44:0/1213642656 wait complete. 2024-08-19T00:04:26.097 INFO:teuthology.orchestra.run.smithi044.stdout:Deploying unmanaged mon service... 2024-08-19T00:04:26.715 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:26 smithi044 ceph-mon[18489]: from='mgr.14118 172.21.15.44:0/3360564934' entity='mgr.x' 2024-08-19T00:04:26.716 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:26 smithi044 ceph-mon[18489]: Added host smithi044 2024-08-19T00:04:26.716 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:26 smithi044 ceph-mon[18489]: from='mgr.14118 172.21.15.44:0/3360564934' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:04:27.451 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-08-19T00:04:27.451 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:26.478+0000 7f2aeaad2640 1 Processor -- start 2024-08-19T00:04:27.451 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:26.478+0000 7f2aeaad2640 1 -- start start 2024-08-19T00:04:27.451 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:26.478+0000 7f2aeaad2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ae4107da0 0x7f2ae410a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:27.451 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:26.478+0000 7f2aeaad2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae407bdf0 con 0x7f2ae4107da0 2024-08-19T00:04:27.451 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:26.479+0000 7f2ae886e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ae4107da0 0x7f2ae410a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:27.451 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:26.479+0000 7f2ae886e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ae4107da0 0x7f2ae410a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52666/0 (socket says 172.21.15.44:52666) 2024-08-19T00:04:27.451 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:26.479+0000 7f2ae886e640 1 -- 172.21.15.44:0/1127721196 learned_addr learned my addr 172.21.15.44:0/1127721196 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:04:27.451 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:26.479+0000 7f2ae886e640 1 -- 172.21.15.44:0/1127721196 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ae410a6d0 con 0x7f2ae4107da0 2024-08-19T00:04:27.451 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:26.480+0000 7f2ae886e640 1 --2- 172.21.15.44:0/1127721196 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ae4107da0 0x7f2ae410a190 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4009e80 tx=0x7f2ad402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c46761a1acdbfc2 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:27.452 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:26.480+0000 7f2ae37fe640 1 -- 172.21.15.44:0/1127721196 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ad4036070 con 0x7f2ae4107da0 2024-08-19T00:04:27.452 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:26.480+0000 7f2ae37fe640 1 -- 172.21.15.44:0/1127721196 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2ad40318c0 con 0x7f2ae4107da0 2024-08-19T00:04:27.452 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:26.480+0000 7f2ae37fe640 1 -- 172.21.15.44:0/1127721196 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ad4007ab0 con 0x7f2ae4107da0 2024-08-19T00:04:27.452 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:26.480+0000 7f2aeaad2640 1 -- 172.21.15.44:0/1127721196 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ae4107da0 msgr2=0x7f2ae410a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:27.452 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:26.480+0000 7f2aeaad2640 1 --2- 172.21.15.44:0/1127721196 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ae4107da0 0x7f2ae410a190 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4009e80 tx=0x7f2ad402a7a0 comp rx=0 tx=0).stop 2024-08-19T00:04:27.452 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:26.480+0000 7f2aeaad2640 1 -- 172.21.15.44:0/1127721196 shutdown_connections 2024-08-19T00:04:27.452 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:26.480+0000 7f2aeaad2640 1 --2- 172.21.15.44:0/1127721196 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ae4107da0 0x7f2ae410a190 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:27.452 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:26.480+0000 7f2aeaad2640 1 -- 172.21.15.44:0/1127721196 >> 172.21.15.44:0/1127721196 conn(0x7f2ae4101a00 msgr2=0x7f2ae4103e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:04:27.452 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:26.480+0000 7f2aeaad2640 1 -- 172.21.15.44:0/1127721196 shutdown_connections 2024-08-19T00:04:27.452 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:26.480+0000 7f2aeaad2640 1 -- 172.21.15.44:0/1127721196 wait complete. 2024-08-19T00:04:27.452 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:26.481+0000 7f2aeaad2640 1 Processor -- start 2024-08-19T00:04:27.452 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:26.481+0000 7f2aeaad2640 1 -- start start 2024-08-19T00:04:27.452 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:26.481+0000 7f2aeaad2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ae4107da0 0x7f2ae419b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:27.453 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:26.481+0000 7f2aeaad2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae410b710 con 0x7f2ae4107da0 2024-08-19T00:04:27.453 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:26.481+0000 7f2ae886e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ae4107da0 0x7f2ae419b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:27.453 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:26.481+0000 7f2ae886e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ae4107da0 0x7f2ae419b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52676/0 (socket says 172.21.15.44:52676) 2024-08-19T00:04:27.453 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:26.481+0000 7f2ae886e640 1 -- 172.21.15.44:0/249357820 learned_addr learned my addr 172.21.15.44:0/249357820 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:04:27.453 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:26.482+0000 7f2ae886e640 1 -- 172.21.15.44:0/249357820 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ae419b830 con 0x7f2ae4107da0 2024-08-19T00:04:27.453 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:26.482+0000 7f2ae886e640 1 --2- 172.21.15.44:0/249357820 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ae4107da0 0x7f2ae419b2f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2ad402acc0 tx=0x7f2ad4031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:27.453 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:26.482+0000 7f2ae1ffb640 1 -- 172.21.15.44:0/249357820 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ad4036050 con 0x7f2ae4107da0 2024-08-19T00:04:27.453 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:26.482+0000 7f2ae1ffb640 1 -- 172.21.15.44:0/249357820 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2ad4037040 con 0x7f2ae4107da0 2024-08-19T00:04:27.453 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:26.482+0000 7f2aeaad2640 1 -- 172.21.15.44:0/249357820 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ae419bac0 con 0x7f2ae4107da0 2024-08-19T00:04:27.453 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:26.482+0000 7f2ae1ffb640 1 -- 172.21.15.44:0/249357820 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ad403d850 con 0x7f2ae4107da0 2024-08-19T00:04:27.453 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:26.482+0000 7f2aeaad2640 1 -- 172.21.15.44:0/249357820 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ae419e7b0 con 0x7f2ae4107da0 2024-08-19T00:04:27.453 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:26.483+0000 7f2ae1ffb640 1 -- 172.21.15.44:0/249357820 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f2ad4044020 con 0x7f2ae4107da0 2024-08-19T00:04:27.453 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:26.483+0000 7f2aeaad2640 1 -- 172.21.15.44:0/249357820 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ae4108200 con 0x7f2ae4107da0 2024-08-19T00:04:27.454 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:26.483+0000 7f2ae1ffb640 1 --2- 172.21.15.44:0/249357820 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7f2ad0038fc0 0x7f2ad003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:27.454 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:26.483+0000 7f2ae1ffb640 1 -- 172.21.15.44:0/249357820 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f2ad4042020 con 0x7f2ae4107da0 2024-08-19T00:04:27.454 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:26.483+0000 7f2ae3fff640 1 --2- 172.21.15.44:0/249357820 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7f2ad0038fc0 0x7f2ad003b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:27.454 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:26.484+0000 7f2ae3fff640 1 --2- 172.21.15.44:0/249357820 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7f2ad0038fc0 0x7f2ad003b480 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2acc0098c0 tx=0x7f2acc006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:27.454 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:26.488+0000 7f2ae1ffb640 1 -- 172.21.15.44:0/249357820 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f2ad404b020 con 0x7f2ae4107da0 2024-08-19T00:04:27.454 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:26.709+0000 7f2aeaad2640 1 -- 172.21.15.44:0/249357820 --> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f2ae4102cf0 con 0x7f2ad0038fc0 2024-08-19T00:04:27.454 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:26.714+0000 7f2ae1ffb640 1 -- 172.21.15.44:0/249357820 <== mgr.14118 v2:172.21.15.44:6800/1300308907 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f2ae4102cf0 con 0x7f2ad0038fc0 2024-08-19T00:04:27.454 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:26.716+0000 7f2aeaad2640 1 -- 172.21.15.44:0/249357820 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7f2ad0038fc0 msgr2=0x7f2ad003b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:27.454 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:26.716+0000 7f2aeaad2640 1 --2- 172.21.15.44:0/249357820 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7f2ad0038fc0 0x7f2ad003b480 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2acc0098c0 tx=0x7f2acc006db0 comp rx=0 tx=0).stop 2024-08-19T00:04:27.454 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:26.716+0000 7f2aeaad2640 1 -- 172.21.15.44:0/249357820 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ae4107da0 msgr2=0x7f2ae419b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:27.454 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:26.716+0000 7f2aeaad2640 1 --2- 172.21.15.44:0/249357820 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ae4107da0 0x7f2ae419b2f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2ad402acc0 tx=0x7f2ad4031ca0 comp rx=0 tx=0).stop 2024-08-19T00:04:27.454 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:26.716+0000 7f2aeaad2640 1 -- 172.21.15.44:0/249357820 shutdown_connections 2024-08-19T00:04:27.455 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:26.716+0000 7f2aeaad2640 1 --2- 172.21.15.44:0/249357820 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7f2ad0038fc0 0x7f2ad003b480 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:27.455 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:26.716+0000 7f2aeaad2640 1 --2- 172.21.15.44:0/249357820 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ae4107da0 0x7f2ae419b2f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:27.455 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:26.716+0000 7f2aeaad2640 1 -- 172.21.15.44:0/249357820 >> 172.21.15.44:0/249357820 conn(0x7f2ae4101a00 msgr2=0x7f2ae41025e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:04:27.455 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:26.716+0000 7f2aeaad2640 1 -- 172.21.15.44:0/249357820 shutdown_connections 2024-08-19T00:04:27.455 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:26.716+0000 7f2aeaad2640 1 -- 172.21.15.44:0/249357820 wait complete. 2024-08-19T00:04:27.455 INFO:teuthology.orchestra.run.smithi044.stdout:Deploying unmanaged mgr service... 2024-08-19T00:04:27.983 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:27 smithi044 ceph-mon[18489]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:04:27.983 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:27 smithi044 ceph-mon[18489]: Saving service mon spec with placement count:5 2024-08-19T00:04:27.983 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:27 smithi044 ceph-mon[18489]: from='mgr.14118 172.21.15.44:0/3360564934' entity='mgr.x' 2024-08-19T00:04:28.868 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-08-19T00:04:28.868 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:27.809+0000 7f6dfeb9f640 1 Processor -- start 2024-08-19T00:04:28.868 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:27.809+0000 7f6dfeb9f640 1 -- start start 2024-08-19T00:04:28.868 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:27.810+0000 7f6dfeb9f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6df8107d60 0x7f6df810a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:28.868 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:27.810+0000 7f6dfeb9f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6df807be30 con 0x7f6df8107d60 2024-08-19T00:04:28.868 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:27.810+0000 7f6dfc93b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6df8107d60 0x7f6df810a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:28.868 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:27.810+0000 7f6dfc93b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6df8107d60 0x7f6df810a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52678/0 (socket says 172.21.15.44:52678) 2024-08-19T00:04:28.868 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:27.810+0000 7f6dfc93b640 1 -- 172.21.15.44:0/3814875849 learned_addr learned my addr 172.21.15.44:0/3814875849 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:04:28.868 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:27.810+0000 7f6dfc93b640 1 -- 172.21.15.44:0/3814875849 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6df810a690 con 0x7f6df8107d60 2024-08-19T00:04:28.869 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:27.811+0000 7f6dfc93b640 1 --2- 172.21.15.44:0/3814875849 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6df8107d60 0x7f6df810a150 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6dec009820 tx=0x7f6dec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f6d9b402c224aa1 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:28.869 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:27.811+0000 7f6df77fe640 1 -- 172.21.15.44:0/3814875849 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6dec037070 con 0x7f6df8107d60 2024-08-19T00:04:28.869 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:27.811+0000 7f6df77fe640 1 -- 172.21.15.44:0/3814875849 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6dec032900 con 0x7f6df8107d60 2024-08-19T00:04:28.869 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:27.811+0000 7f6df77fe640 1 -- 172.21.15.44:0/3814875849 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6dec030850 con 0x7f6df8107d60 2024-08-19T00:04:28.869 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:27.812+0000 7f6dfeb9f640 1 -- 172.21.15.44:0/3814875849 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6df8107d60 msgr2=0x7f6df810a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:28.869 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:27.812+0000 7f6dfeb9f640 1 --2- 172.21.15.44:0/3814875849 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6df8107d60 0x7f6df810a150 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6dec009820 tx=0x7f6dec02a270 comp rx=0 tx=0).stop 2024-08-19T00:04:28.869 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:27.812+0000 7f6dfeb9f640 1 -- 172.21.15.44:0/3814875849 shutdown_connections 2024-08-19T00:04:28.869 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:27.812+0000 7f6dfeb9f640 1 --2- 172.21.15.44:0/3814875849 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6df8107d60 0x7f6df810a150 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:28.869 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:27.812+0000 7f6dfeb9f640 1 -- 172.21.15.44:0/3814875849 >> 172.21.15.44:0/3814875849 conn(0x7f6df8101a00 msgr2=0x7f6df8103e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:04:28.869 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:27.812+0000 7f6dfeb9f640 1 -- 172.21.15.44:0/3814875849 shutdown_connections 2024-08-19T00:04:28.869 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:27.812+0000 7f6dfeb9f640 1 -- 172.21.15.44:0/3814875849 wait complete. 2024-08-19T00:04:28.869 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:27.812+0000 7f6dfeb9f640 1 Processor -- start 2024-08-19T00:04:28.869 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:27.812+0000 7f6dfeb9f640 1 -- start start 2024-08-19T00:04:28.870 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:27.813+0000 7f6dfeb9f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6df8107d60 0x7f6df819d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:28.870 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:27.813+0000 7f6dfeb9f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6df810b730 con 0x7f6df8107d60 2024-08-19T00:04:28.870 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:27.813+0000 7f6dfc93b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6df8107d60 0x7f6df819d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:28.870 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:27.813+0000 7f6dfc93b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6df8107d60 0x7f6df819d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52694/0 (socket says 172.21.15.44:52694) 2024-08-19T00:04:28.870 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:27.813+0000 7f6dfc93b640 1 -- 172.21.15.44:0/2137336011 learned_addr learned my addr 172.21.15.44:0/2137336011 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:04:28.870 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:27.813+0000 7f6dfc93b640 1 -- 172.21.15.44:0/2137336011 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6df819da50 con 0x7f6df8107d60 2024-08-19T00:04:28.870 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:27.813+0000 7f6dfc93b640 1 --2- 172.21.15.44:0/2137336011 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6df8107d60 0x7f6df819d510 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6dec0097f0 tx=0x7f6dec030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:28.870 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:27.813+0000 7f6df5ffb640 1 -- 172.21.15.44:0/2137336011 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6dec037040 con 0x7f6df8107d60 2024-08-19T00:04:28.870 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:27.813+0000 7f6df5ffb640 1 -- 172.21.15.44:0/2137336011 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6dec040070 con 0x7f6df8107d60 2024-08-19T00:04:28.870 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:27.813+0000 7f6dfeb9f640 1 -- 172.21.15.44:0/2137336011 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6df819dce0 con 0x7f6df8107d60 2024-08-19T00:04:28.870 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:27.813+0000 7f6df5ffb640 1 -- 172.21.15.44:0/2137336011 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6dec03a390 con 0x7f6df8107d60 2024-08-19T00:04:28.870 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:27.814+0000 7f6dfeb9f640 1 -- 172.21.15.44:0/2137336011 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6df81a09d0 con 0x7f6df8107d60 2024-08-19T00:04:28.870 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:27.814+0000 7f6df5ffb640 1 -- 172.21.15.44:0/2137336011 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f6dec03a630 con 0x7f6df8107d60 2024-08-19T00:04:28.871 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:27.814+0000 7f6dfeb9f640 1 -- 172.21.15.44:0/2137336011 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6df81081c0 con 0x7f6df8107d60 2024-08-19T00:04:28.871 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:27.815+0000 7f6df5ffb640 1 --2- 172.21.15.44:0/2137336011 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7f6de8038f70 0x7f6de803b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:28.871 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:27.815+0000 7f6df5ffb640 1 -- 172.21.15.44:0/2137336011 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f6dec06c4d0 con 0x7f6df8107d60 2024-08-19T00:04:28.871 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:27.815+0000 7f6df7fff640 1 --2- 172.21.15.44:0/2137336011 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7f6de8038f70 0x7f6de803b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:28.871 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:27.815+0000 7f6df7fff640 1 --2- 172.21.15.44:0/2137336011 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7f6de8038f70 0x7f6de803b430 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6de40098c0 tx=0x7f6de4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:28.871 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:27.820+0000 7f6df5ffb640 1 -- 172.21.15.44:0/2137336011 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f6dec04a200 con 0x7f6df8107d60 2024-08-19T00:04:28.871 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:28.012+0000 7f6dfeb9f640 1 -- 172.21.15.44:0/2137336011 --> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f6df8102c40 con 0x7f6de8038f70 2024-08-19T00:04:28.871 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:28.016+0000 7f6df5ffb640 1 -- 172.21.15.44:0/2137336011 <== mgr.14118 v2:172.21.15.44:6800/1300308907 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f6df8102c40 con 0x7f6de8038f70 2024-08-19T00:04:28.871 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:28.019+0000 7f6dfeb9f640 1 -- 172.21.15.44:0/2137336011 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7f6de8038f70 msgr2=0x7f6de803b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:28.871 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:28.019+0000 7f6dfeb9f640 1 --2- 172.21.15.44:0/2137336011 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7f6de8038f70 0x7f6de803b430 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6de40098c0 tx=0x7f6de4006db0 comp rx=0 tx=0).stop 2024-08-19T00:04:28.871 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:28.019+0000 7f6dfeb9f640 1 -- 172.21.15.44:0/2137336011 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6df8107d60 msgr2=0x7f6df819d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:28.871 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:28.019+0000 7f6dfeb9f640 1 --2- 172.21.15.44:0/2137336011 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6df8107d60 0x7f6df819d510 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6dec0097f0 tx=0x7f6dec030d80 comp rx=0 tx=0).stop 2024-08-19T00:04:28.871 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:28.019+0000 7f6dfeb9f640 1 -- 172.21.15.44:0/2137336011 shutdown_connections 2024-08-19T00:04:28.872 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:28.019+0000 7f6dfeb9f640 1 --2- 172.21.15.44:0/2137336011 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7f6de8038f70 0x7f6de803b430 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:28.872 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:28.019+0000 7f6dfeb9f640 1 --2- 172.21.15.44:0/2137336011 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6df8107d60 0x7f6df819d510 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:28.872 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:28.019+0000 7f6dfeb9f640 1 -- 172.21.15.44:0/2137336011 >> 172.21.15.44:0/2137336011 conn(0x7f6df8101a00 msgr2=0x7f6df8102530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:04:28.872 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:28.019+0000 7f6dfeb9f640 1 -- 172.21.15.44:0/2137336011 shutdown_connections 2024-08-19T00:04:28.872 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:28.019+0000 7f6dfeb9f640 1 -- 172.21.15.44:0/2137336011 wait complete. 2024-08-19T00:04:29.370 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:29 smithi044 ceph-mon[18489]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:04:29.370 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:29 smithi044 ceph-mon[18489]: Saving service mgr spec with placement count:2 2024-08-19T00:04:29.370 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:29 smithi044 ceph-mon[18489]: from='mgr.14118 172.21.15.44:0/3360564934' entity='mgr.x' 2024-08-19T00:04:30.329 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:29.241+0000 7fee33b23640 1 Processor -- start 2024-08-19T00:04:30.329 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:29.241+0000 7fee33b23640 1 -- start start 2024-08-19T00:04:30.330 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:29.241+0000 7fee33b23640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee2c107d60 0x7fee2c10a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:30.330 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:29.241+0000 7fee33b23640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fee2c07be30 con 0x7fee2c107d60 2024-08-19T00:04:30.330 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:29.242+0000 7fee318bf640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee2c107d60 0x7fee2c10a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:30.330 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:29.242+0000 7fee318bf640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee2c107d60 0x7fee2c10a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57488/0 (socket says 172.21.15.44:57488) 2024-08-19T00:04:30.330 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:29.242+0000 7fee318bf640 1 -- 172.21.15.44:0/426237325 learned_addr learned my addr 172.21.15.44:0/426237325 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:04:30.330 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:29.242+0000 7fee318bf640 1 -- 172.21.15.44:0/426237325 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee2c10a690 con 0x7fee2c107d60 2024-08-19T00:04:30.330 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:29.243+0000 7fee318bf640 1 --2- 172.21.15.44:0/426237325 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee2c107d60 0x7fee2c10a150 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fee24009820 tx=0x7fee2402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=430ba06b54746b4c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:30.330 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:29.243+0000 7fee308bd640 1 -- 172.21.15.44:0/426237325 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee24037070 con 0x7fee2c107d60 2024-08-19T00:04:30.330 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:29.243+0000 7fee308bd640 1 -- 172.21.15.44:0/426237325 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fee24032900 con 0x7fee2c107d60 2024-08-19T00:04:30.330 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:29.243+0000 7fee308bd640 1 -- 172.21.15.44:0/426237325 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee24030850 con 0x7fee2c107d60 2024-08-19T00:04:30.330 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:29.243+0000 7fee33b23640 1 -- 172.21.15.44:0/426237325 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee2c107d60 msgr2=0x7fee2c10a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:30.330 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:29.243+0000 7fee33b23640 1 --2- 172.21.15.44:0/426237325 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee2c107d60 0x7fee2c10a150 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fee24009820 tx=0x7fee2402a270 comp rx=0 tx=0).stop 2024-08-19T00:04:30.331 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:29.243+0000 7fee33b23640 1 -- 172.21.15.44:0/426237325 shutdown_connections 2024-08-19T00:04:30.331 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:29.243+0000 7fee33b23640 1 --2- 172.21.15.44:0/426237325 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee2c107d60 0x7fee2c10a150 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:30.331 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:29.244+0000 7fee33b23640 1 -- 172.21.15.44:0/426237325 >> 172.21.15.44:0/426237325 conn(0x7fee2c101a00 msgr2=0x7fee2c103e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:04:30.331 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:29.244+0000 7fee33b23640 1 -- 172.21.15.44:0/426237325 shutdown_connections 2024-08-19T00:04:30.331 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:29.244+0000 7fee33b23640 1 -- 172.21.15.44:0/426237325 wait complete. 2024-08-19T00:04:30.331 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:29.244+0000 7fee33b23640 1 Processor -- start 2024-08-19T00:04:30.331 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:29.244+0000 7fee33b23640 1 -- start start 2024-08-19T00:04:30.331 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:29.244+0000 7fee33b23640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee2c107d60 0x7fee2c19d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:30.331 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:29.244+0000 7fee33b23640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fee2c10b730 con 0x7fee2c107d60 2024-08-19T00:04:30.331 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:29.244+0000 7fee318bf640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee2c107d60 0x7fee2c19d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:30.331 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:29.245+0000 7fee318bf640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee2c107d60 0x7fee2c19d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57500/0 (socket says 172.21.15.44:57500) 2024-08-19T00:04:30.331 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:29.245+0000 7fee318bf640 1 -- 172.21.15.44:0/1529630208 learned_addr learned my addr 172.21.15.44:0/1529630208 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:04:30.331 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:29.245+0000 7fee318bf640 1 -- 172.21.15.44:0/1529630208 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee2c19da20 con 0x7fee2c107d60 2024-08-19T00:04:30.332 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:29.245+0000 7fee318bf640 1 --2- 172.21.15.44:0/1529630208 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee2c107d60 0x7fee2c19d4e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fee24032ce0 tx=0x7fee24032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:30.332 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:29.245+0000 7fee2affd640 1 -- 172.21.15.44:0/1529630208 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee24042070 con 0x7fee2c107d60 2024-08-19T00:04:30.332 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:29.245+0000 7fee2affd640 1 -- 172.21.15.44:0/1529630208 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fee240308c0 con 0x7fee2c107d60 2024-08-19T00:04:30.332 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:29.245+0000 7fee33b23640 1 -- 172.21.15.44:0/1529630208 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee2c19dcb0 con 0x7fee2c107d60 2024-08-19T00:04:30.332 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:29.245+0000 7fee2affd640 1 -- 172.21.15.44:0/1529630208 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee24037040 con 0x7fee2c107d60 2024-08-19T00:04:30.332 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:29.245+0000 7fee33b23640 1 -- 172.21.15.44:0/1529630208 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee2c1a09a0 con 0x7fee2c107d60 2024-08-19T00:04:30.332 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:29.246+0000 7fee2affd640 1 -- 172.21.15.44:0/1529630208 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fee24045070 con 0x7fee2c107d60 2024-08-19T00:04:30.332 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:29.246+0000 7fee33b23640 1 -- 172.21.15.44:0/1529630208 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee180052c0 con 0x7fee2c107d60 2024-08-19T00:04:30.332 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:29.246+0000 7fee2affd640 1 --2- 172.21.15.44:0/1529630208 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7fee14038f70 0x7fee1403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:30.332 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:29.246+0000 7fee2affd640 1 -- 172.21.15.44:0/1529630208 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fee2406c160 con 0x7fee2c107d60 2024-08-19T00:04:30.332 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:29.246+0000 7fee310be640 1 --2- 172.21.15.44:0/1529630208 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7fee14038f70 0x7fee1403b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:30.332 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:29.247+0000 7fee310be640 1 --2- 172.21.15.44:0/1529630208 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7fee14038f70 0x7fee1403b430 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fee200098c0 tx=0x7fee20006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:30.332 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:29.251+0000 7fee2affd640 1 -- 172.21.15.44:0/1529630208 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fee2403cd00 con 0x7fee2c107d60 2024-08-19T00:04:30.333 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:29.429+0000 7fee33b23640 1 -- 172.21.15.44:0/1529630208 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7fee180055b0 con 0x7fee2c107d60 2024-08-19T00:04:30.333 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:29.432+0000 7fee2affd640 1 -- 172.21.15.44:0/1529630208 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v6)=0 v6) ==== 142+0+0 (secure 0 0 0) 0x7fee2403c830 con 0x7fee2c107d60 2024-08-19T00:04:30.333 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:29.434+0000 7fee33b23640 1 -- 172.21.15.44:0/1529630208 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7fee14038f70 msgr2=0x7fee1403b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:30.333 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:29.434+0000 7fee33b23640 1 --2- 172.21.15.44:0/1529630208 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7fee14038f70 0x7fee1403b430 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fee200098c0 tx=0x7fee20006db0 comp rx=0 tx=0).stop 2024-08-19T00:04:30.333 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:29.434+0000 7fee33b23640 1 -- 172.21.15.44:0/1529630208 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee2c107d60 msgr2=0x7fee2c19d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:30.333 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:29.434+0000 7fee33b23640 1 --2- 172.21.15.44:0/1529630208 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee2c107d60 0x7fee2c19d4e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fee24032ce0 tx=0x7fee24032d10 comp rx=0 tx=0).stop 2024-08-19T00:04:30.333 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:29.434+0000 7fee33b23640 1 -- 172.21.15.44:0/1529630208 shutdown_connections 2024-08-19T00:04:30.333 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:29.434+0000 7fee33b23640 1 --2- 172.21.15.44:0/1529630208 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7fee14038f70 0x7fee1403b430 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:30.333 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:29.434+0000 7fee33b23640 1 --2- 172.21.15.44:0/1529630208 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee2c107d60 0x7fee2c19d4e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:30.333 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:29.434+0000 7fee33b23640 1 -- 172.21.15.44:0/1529630208 >> 172.21.15.44:0/1529630208 conn(0x7fee2c101a00 msgr2=0x7fee2c102580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:04:30.333 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:29.435+0000 7fee33b23640 1 -- 172.21.15.44:0/1529630208 shutdown_connections 2024-08-19T00:04:30.333 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:29.435+0000 7fee33b23640 1 -- 172.21.15.44:0/1529630208 wait complete. 2024-08-19T00:04:30.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:30 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/1529630208' entity='client.admin' 2024-08-19T00:04:30.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:30 smithi044 ceph-mon[18489]: from='mgr.14118 172.21.15.44:0/3360564934' entity='mgr.x' 2024-08-19T00:04:30.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:30 smithi044 ceph-mon[18489]: from='mgr.14118 172.21.15.44:0/3360564934' entity='mgr.x' 2024-08-19T00:04:31.924 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:30.712+0000 7f6abcf02640 1 Processor -- start 2024-08-19T00:04:31.924 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:30.712+0000 7f6abcf02640 1 -- start start 2024-08-19T00:04:31.924 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:30.713+0000 7f6abcf02640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ab81073e0 0x7f6ab81077e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:31.925 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:30.713+0000 7f6abcf02640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab8107d20 con 0x7f6ab81073e0 2024-08-19T00:04:31.925 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:30.713+0000 7f6ab659c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ab81073e0 0x7f6ab81077e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:31.925 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:30.713+0000 7f6ab659c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ab81073e0 0x7f6ab81077e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57502/0 (socket says 172.21.15.44:57502) 2024-08-19T00:04:31.925 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:30.713+0000 7f6ab659c640 1 -- 172.21.15.44:0/1524946969 learned_addr learned my addr 172.21.15.44:0/1524946969 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:04:31.925 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:30.713+0000 7f6ab659c640 1 -- 172.21.15.44:0/1524946969 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ab8107ea0 con 0x7f6ab81073e0 2024-08-19T00:04:31.925 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:30.714+0000 7f6ab659c640 1 --2- 172.21.15.44:0/1524946969 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ab81073e0 0x7f6ab81077e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6aa8009820 tx=0x7f6aa802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7f1098dc393db0a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:31.925 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:30.714+0000 7f6ab559a640 1 -- 172.21.15.44:0/1524946969 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6aa8037070 con 0x7f6ab81073e0 2024-08-19T00:04:31.925 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:30.714+0000 7f6ab559a640 1 -- 172.21.15.44:0/1524946969 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6aa8032920 con 0x7f6ab81073e0 2024-08-19T00:04:31.925 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:30.714+0000 7f6ab559a640 1 -- 172.21.15.44:0/1524946969 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6aa8030810 con 0x7f6ab81073e0 2024-08-19T00:04:31.925 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:30.715+0000 7f6abcf02640 1 -- 172.21.15.44:0/1524946969 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ab81073e0 msgr2=0x7f6ab81077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:31.925 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:30.715+0000 7f6abcf02640 1 --2- 172.21.15.44:0/1524946969 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ab81073e0 0x7f6ab81077e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6aa8009820 tx=0x7f6aa802a270 comp rx=0 tx=0).stop 2024-08-19T00:04:31.925 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:30.715+0000 7f6abcf02640 1 -- 172.21.15.44:0/1524946969 shutdown_connections 2024-08-19T00:04:31.925 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:30.715+0000 7f6abcf02640 1 --2- 172.21.15.44:0/1524946969 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ab81073e0 0x7f6ab81077e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:31.926 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:30.715+0000 7f6abcf02640 1 -- 172.21.15.44:0/1524946969 >> 172.21.15.44:0/1524946969 conn(0x7f6ab8102c50 msgr2=0x7f6ab8105070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:04:31.926 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:30.715+0000 7f6abcf02640 1 -- 172.21.15.44:0/1524946969 shutdown_connections 2024-08-19T00:04:31.926 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:30.715+0000 7f6abcf02640 1 -- 172.21.15.44:0/1524946969 wait complete. 2024-08-19T00:04:31.926 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:30.716+0000 7f6abcf02640 1 Processor -- start 2024-08-19T00:04:31.926 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:30.716+0000 7f6abcf02640 1 -- start start 2024-08-19T00:04:31.926 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:30.716+0000 7f6abcf02640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ab81073e0 0x7f6ab807daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:31.926 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:30.716+0000 7f6abcf02640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab810b800 con 0x7f6ab81073e0 2024-08-19T00:04:31.926 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:30.716+0000 7f6ab659c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ab81073e0 0x7f6ab807daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:31.926 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:30.716+0000 7f6ab659c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ab81073e0 0x7f6ab807daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57512/0 (socket says 172.21.15.44:57512) 2024-08-19T00:04:31.926 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:30.716+0000 7f6ab659c640 1 -- 172.21.15.44:0/709472132 learned_addr learned my addr 172.21.15.44:0/709472132 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:04:31.926 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:30.716+0000 7f6ab659c640 1 -- 172.21.15.44:0/709472132 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ab807e030 con 0x7f6ab81073e0 2024-08-19T00:04:31.926 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:30.716+0000 7f6ab659c640 1 --2- 172.21.15.44:0/709472132 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ab81073e0 0x7f6ab807daf0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6aa8030380 tx=0x7f6aa8032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:31.926 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:30.717+0000 7f6aa77fe640 1 -- 172.21.15.44:0/709472132 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6aa8037040 con 0x7f6ab81073e0 2024-08-19T00:04:31.927 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:30.717+0000 7f6abcf02640 1 -- 172.21.15.44:0/709472132 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ab807c220 con 0x7f6ab81073e0 2024-08-19T00:04:31.927 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:30.717+0000 7f6aa77fe640 1 -- 172.21.15.44:0/709472132 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6aa8040070 con 0x7f6ab81073e0 2024-08-19T00:04:31.927 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:30.717+0000 7f6aa77fe640 1 -- 172.21.15.44:0/709472132 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6aa803a7b0 con 0x7f6ab81073e0 2024-08-19T00:04:31.927 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:30.717+0000 7f6abcf02640 1 -- 172.21.15.44:0/709472132 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ab807c760 con 0x7f6ab81073e0 2024-08-19T00:04:31.927 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:30.718+0000 7f6aa77fe640 1 -- 172.21.15.44:0/709472132 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f6aa803aa30 con 0x7f6ab81073e0 2024-08-19T00:04:31.927 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:30.718+0000 7f6abcf02640 1 -- 172.21.15.44:0/709472132 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ab8107860 con 0x7f6ab81073e0 2024-08-19T00:04:31.927 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:30.718+0000 7f6aa77fe640 1 --2- 172.21.15.44:0/709472132 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7f6aa0038f70 0x7f6aa003b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:31.927 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:30.718+0000 7f6aa77fe640 1 -- 172.21.15.44:0/709472132 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f6aa806c750 con 0x7f6ab81073e0 2024-08-19T00:04:31.927 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:30.718+0000 7f6ab5d9b640 1 --2- 172.21.15.44:0/709472132 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7f6aa0038f70 0x7f6aa003b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:31.927 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:30.719+0000 7f6ab5d9b640 1 --2- 172.21.15.44:0/709472132 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7f6aa0038f70 0x7f6aa003b430 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6aac0098c0 tx=0x7f6aac006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:31.927 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:30.723+0000 7f6aa77fe640 1 -- 172.21.15.44:0/709472132 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f6aa8044c70 con 0x7f6ab81073e0 2024-08-19T00:04:31.927 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:30.911+0000 7f6abcf02640 1 -- 172.21.15.44:0/709472132 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f6ab807cf70 con 0x7f6ab81073e0 2024-08-19T00:04:31.927 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:30.916+0000 7f6aa77fe640 1 -- 172.21.15.44:0/709472132 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f6aa803ae20 con 0x7f6ab81073e0 2024-08-19T00:04:31.928 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:30.918+0000 7f6abcf02640 1 -- 172.21.15.44:0/709472132 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7f6aa0038f70 msgr2=0x7f6aa003b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:31.928 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:30.918+0000 7f6abcf02640 1 --2- 172.21.15.44:0/709472132 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7f6aa0038f70 0x7f6aa003b430 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6aac0098c0 tx=0x7f6aac006db0 comp rx=0 tx=0).stop 2024-08-19T00:04:31.928 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:30.918+0000 7f6abcf02640 1 -- 172.21.15.44:0/709472132 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ab81073e0 msgr2=0x7f6ab807daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:31.928 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:30.918+0000 7f6abcf02640 1 --2- 172.21.15.44:0/709472132 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ab81073e0 0x7f6ab807daf0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6aa8030380 tx=0x7f6aa8032670 comp rx=0 tx=0).stop 2024-08-19T00:04:31.928 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:30.918+0000 7f6abcf02640 1 -- 172.21.15.44:0/709472132 shutdown_connections 2024-08-19T00:04:31.928 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:30.918+0000 7f6abcf02640 1 --2- 172.21.15.44:0/709472132 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7f6aa0038f70 0x7f6aa003b430 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:31.928 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:30.918+0000 7f6abcf02640 1 --2- 172.21.15.44:0/709472132 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ab81073e0 0x7f6ab807daf0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:31.928 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:30.918+0000 7f6abcf02640 1 -- 172.21.15.44:0/709472132 >> 172.21.15.44:0/709472132 conn(0x7f6ab8102c50 msgr2=0x7f6ab8103750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:04:31.928 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:30.918+0000 7f6abcf02640 1 -- 172.21.15.44:0/709472132 shutdown_connections 2024-08-19T00:04:31.928 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:30.918+0000 7f6abcf02640 1 -- 172.21.15.44:0/709472132 wait complete. 2024-08-19T00:04:31.928 INFO:teuthology.orchestra.run.smithi044.stdout:Enabling the dashboard module... 2024-08-19T00:04:31.938 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:31 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/709472132' entity='client.admin' 2024-08-19T00:04:31.938 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:31 smithi044 ceph-mon[18489]: from='mgr.14118 172.21.15.44:0/3360564934' entity='mgr.x' 2024-08-19T00:04:33.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:33 smithi044 ceph-mon[18489]: from='mgr.14118 172.21.15.44:0/3360564934' entity='mgr.x' 2024-08-19T00:04:33.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:33 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/2774244630' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-08-19T00:04:33.619 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:33 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: ignoring --setuser ceph since I am not root 2024-08-19T00:04:33.619 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:33 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: ignoring --setgroup ceph since I am not root 2024-08-19T00:04:33.620 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:33 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:04:33.586+0000 7fca9cf16040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-19T00:04:33.973 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:33 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:04:33.655+0000 7fca9cf16040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-19T00:04:33.973 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:33 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:04:33.804+0000 7fca9cf16040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-19T00:04:33.973 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:33 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:04:33.970+0000 7fca9cf16040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-19T00:04:34.246 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:34 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:04:34.119+0000 7fca9cf16040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-19T00:04:34.253 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:32.292+0000 7f8a01de6640 1 Processor -- start 2024-08-19T00:04:34.253 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:32.292+0000 7f8a01de6640 1 -- start start 2024-08-19T00:04:34.253 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:32.292+0000 7f8a01de6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89fc107e40 0x7f89fc10a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:34.253 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:32.292+0000 7f8a01de6640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f89fc07bda0 con 0x7f89fc107e40 2024-08-19T00:04:34.253 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:32.293+0000 7f89fb7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89fc107e40 0x7f89fc10a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:34.253 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:32.293+0000 7f89fb7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89fc107e40 0x7f89fc10a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57528/0 (socket says 172.21.15.44:57528) 2024-08-19T00:04:34.253 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:32.293+0000 7f89fb7fe640 1 -- 172.21.15.44:0/2892657606 learned_addr learned my addr 172.21.15.44:0/2892657606 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:04:34.254 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:32.293+0000 7f89fb7fe640 1 -- 172.21.15.44:0/2892657606 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89fc10a770 con 0x7f89fc107e40 2024-08-19T00:04:34.254 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:32.294+0000 7f89fb7fe640 1 --2- 172.21.15.44:0/2892657606 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89fc107e40 0x7f89fc10a230 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f89ec009820 tx=0x7f89ec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1da9616e3fd298e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:34.254 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:32.294+0000 7f89fa7fc640 1 -- 172.21.15.44:0/2892657606 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89ec037070 con 0x7f89fc107e40 2024-08-19T00:04:34.254 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:32.294+0000 7f89fa7fc640 1 -- 172.21.15.44:0/2892657606 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f89ec032920 con 0x7f89fc107e40 2024-08-19T00:04:34.254 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:32.294+0000 7f89fa7fc640 1 -- 172.21.15.44:0/2892657606 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89ec030810 con 0x7f89fc107e40 2024-08-19T00:04:34.254 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:32.295+0000 7f8a01de6640 1 -- 172.21.15.44:0/2892657606 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89fc107e40 msgr2=0x7f89fc10a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:34.254 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:32.295+0000 7f8a01de6640 1 --2- 172.21.15.44:0/2892657606 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89fc107e40 0x7f89fc10a230 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f89ec009820 tx=0x7f89ec02a270 comp rx=0 tx=0).stop 2024-08-19T00:04:34.254 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:32.295+0000 7f8a01de6640 1 -- 172.21.15.44:0/2892657606 shutdown_connections 2024-08-19T00:04:34.254 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:32.295+0000 7f8a01de6640 1 --2- 172.21.15.44:0/2892657606 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89fc107e40 0x7f89fc10a230 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:34.254 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:32.295+0000 7f8a01de6640 1 -- 172.21.15.44:0/2892657606 >> 172.21.15.44:0/2892657606 conn(0x7f89fc101ac0 msgr2=0x7f89fc103ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:04:34.254 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:32.295+0000 7f8a01de6640 1 -- 172.21.15.44:0/2892657606 shutdown_connections 2024-08-19T00:04:34.254 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:32.295+0000 7f8a01de6640 1 -- 172.21.15.44:0/2892657606 wait complete. 2024-08-19T00:04:34.254 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:32.295+0000 7f8a01de6640 1 Processor -- start 2024-08-19T00:04:34.255 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:32.296+0000 7f8a01de6640 1 -- start start 2024-08-19T00:04:34.255 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:32.296+0000 7f8a01de6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89fc107e40 0x7f89fc1076c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:34.255 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:32.296+0000 7f8a01de6640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f89fc10b790 con 0x7f89fc107e40 2024-08-19T00:04:34.255 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:32.296+0000 7f89fb7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89fc107e40 0x7f89fc1076c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:34.255 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:32.296+0000 7f89fb7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89fc107e40 0x7f89fc1076c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57544/0 (socket says 172.21.15.44:57544) 2024-08-19T00:04:34.255 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:32.296+0000 7f89fb7fe640 1 -- 172.21.15.44:0/2774244630 learned_addr learned my addr 172.21.15.44:0/2774244630 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:04:34.255 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:32.296+0000 7f89fb7fe640 1 -- 172.21.15.44:0/2774244630 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89fc107c00 con 0x7f89fc107e40 2024-08-19T00:04:34.255 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:32.297+0000 7f89fb7fe640 1 --2- 172.21.15.44:0/2774244630 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89fc107e40 0x7f89fc1076c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f89ec0097f0 tx=0x7f89ec0327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:34.255 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:32.297+0000 7f89f8ff9640 1 -- 172.21.15.44:0/2774244630 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89ec037040 con 0x7f89fc107e40 2024-08-19T00:04:34.255 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:32.297+0000 7f89f8ff9640 1 -- 172.21.15.44:0/2774244630 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f89ec030cc0 con 0x7f89fc107e40 2024-08-19T00:04:34.255 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:32.297+0000 7f8a01de6640 1 -- 172.21.15.44:0/2774244630 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89fc105df0 con 0x7f89fc107e40 2024-08-19T00:04:34.255 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:32.297+0000 7f89f8ff9640 1 -- 172.21.15.44:0/2774244630 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89ec03a6b0 con 0x7f89fc107e40 2024-08-19T00:04:34.255 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:32.297+0000 7f8a01de6640 1 -- 172.21.15.44:0/2774244630 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89fc106330 con 0x7f89fc107e40 2024-08-19T00:04:34.255 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:32.298+0000 7f8a01de6640 1 -- 172.21.15.44:0/2774244630 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89fc1082a0 con 0x7f89fc107e40 2024-08-19T00:04:34.255 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:32.298+0000 7f89f8ff9640 1 -- 172.21.15.44:0/2774244630 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f89ec03a850 con 0x7f89fc107e40 2024-08-19T00:04:34.256 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:32.298+0000 7f89f8ff9640 1 --2- 172.21.15.44:0/2774244630 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7f89e4038fc0 0x7f89e403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:34.256 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:32.298+0000 7f89f8ff9640 1 -- 172.21.15.44:0/2774244630 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f89ec06c4b0 con 0x7f89fc107e40 2024-08-19T00:04:34.256 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:32.299+0000 7f89faffd640 1 --2- 172.21.15.44:0/2774244630 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7f89e4038fc0 0x7f89e403b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:34.256 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:32.299+0000 7f89faffd640 1 --2- 172.21.15.44:0/2774244630 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7f89e4038fc0 0x7f89e403b480 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f89f00098c0 tx=0x7f89f0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:34.256 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:32.303+0000 7f89f8ff9640 1 -- 172.21.15.44:0/2774244630 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f89ec0371e0 con 0x7f89fc107e40 2024-08-19T00:04:34.256 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:32.539+0000 7f8a01de6640 1 -- 172.21.15.44:0/2774244630 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f89fc106ad0 con 0x7f89fc107e40 2024-08-19T00:04:34.256 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:33.343+0000 7f89f8ff9640 1 -- 172.21.15.44:0/2774244630 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f89ec031c30 con 0x7f89fc107e40 2024-08-19T00:04:34.256 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:33.345+0000 7f89f8ff9640 1 -- 172.21.15.44:0/2774244630 <== mon.0 v2:172.21.15.44:3300/0 8 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f89ec044920 con 0x7f89fc107e40 2024-08-19T00:04:34.256 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:33.347+0000 7f8a01de6640 1 -- 172.21.15.44:0/2774244630 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7f89e4038fc0 msgr2=0x7f89e403b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:34.256 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:33.347+0000 7f8a01de6640 1 --2- 172.21.15.44:0/2774244630 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7f89e4038fc0 0x7f89e403b480 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f89f00098c0 tx=0x7f89f0006db0 comp rx=0 tx=0).stop 2024-08-19T00:04:34.256 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:33.347+0000 7f8a01de6640 1 -- 172.21.15.44:0/2774244630 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89fc107e40 msgr2=0x7f89fc1076c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:34.256 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:33.347+0000 7f8a01de6640 1 --2- 172.21.15.44:0/2774244630 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89fc107e40 0x7f89fc1076c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f89ec0097f0 tx=0x7f89ec0327b0 comp rx=0 tx=0).stop 2024-08-19T00:04:34.256 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:33.347+0000 7f8a01de6640 1 -- 172.21.15.44:0/2774244630 shutdown_connections 2024-08-19T00:04:34.257 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:33.347+0000 7f8a01de6640 1 --2- 172.21.15.44:0/2774244630 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7f89e4038fc0 0x7f89e403b480 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:34.257 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:33.347+0000 7f8a01de6640 1 --2- 172.21.15.44:0/2774244630 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89fc107e40 0x7f89fc1076c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:34.257 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:33.347+0000 7f8a01de6640 1 -- 172.21.15.44:0/2774244630 >> 172.21.15.44:0/2774244630 conn(0x7f89fc101ac0 msgr2=0x7f89fc102620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:04:34.257 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:33.347+0000 7f8a01de6640 1 -- 172.21.15.44:0/2774244630 shutdown_connections 2024-08-19T00:04:34.257 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:33.347+0000 7f8a01de6640 1 -- 172.21.15.44:0/2774244630 wait complete. 2024-08-19T00:04:34.571 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:34 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/2774244630' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-08-19T00:04:34.571 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:34 smithi044 ceph-mon[18489]: mgrmap e9: x(active, since 18s) 2024-08-19T00:04:34.571 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:34 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:04:34.248+0000 7fca9cf16040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-19T00:04:34.571 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:34 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:04:34.379+0000 7fca9cf16040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-19T00:04:34.571 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:34 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:04:34.439+0000 7fca9cf16040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-19T00:04:34.825 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:34 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:04:34.759+0000 7fca9cf16040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-19T00:04:34.825 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:34 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:04:34.823+0000 7fca9cf16040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-19T00:04:35.113 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:34 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:04:34.894+0000 7fca9cf16040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-19T00:04:35.113 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:35 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:04:35.048+0000 7fca9cf16040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-08-19T00:04:35.113 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:35 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:04:35.110+0000 7fca9cf16040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-19T00:04:35.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:35 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/2342107309' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-08-19T00:04:35.369 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:35 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:04:35.179+0000 7fca9cf16040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-19T00:04:35.469 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout { 2024-08-19T00:04:35.469 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-08-19T00:04:35.469 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "available": true, 2024-08-19T00:04:35.469 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-08-19T00:04:35.469 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-08-19T00:04:35.469 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout } 2024-08-19T00:04:35.469 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:34.647+0000 7f1771c6a640 1 Processor -- start 2024-08-19T00:04:35.470 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:34.647+0000 7f1771c6a640 1 -- start start 2024-08-19T00:04:35.470 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:34.647+0000 7f1771c6a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f176c1073e0 0x7f176c1077e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:35.470 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:34.647+0000 7f1771c6a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f176c107d20 con 0x7f176c1073e0 2024-08-19T00:04:35.470 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:34.648+0000 7f176b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f176c1073e0 0x7f176c1077e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:35.470 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:34.648+0000 7f176b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f176c1073e0 0x7f176c1077e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57574/0 (socket says 172.21.15.44:57574) 2024-08-19T00:04:35.470 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:34.648+0000 7f176b7fe640 1 -- 172.21.15.44:0/4044694822 learned_addr learned my addr 172.21.15.44:0/4044694822 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:04:35.470 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:34.648+0000 7f176b7fe640 1 -- 172.21.15.44:0/4044694822 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f176c107ea0 con 0x7f176c1073e0 2024-08-19T00:04:35.470 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:34.649+0000 7f176b7fe640 1 --2- 172.21.15.44:0/4044694822 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f176c1073e0 0x7f176c1077e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f175c009820 tx=0x7f175c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16637c3de155fc8a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:35.470 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:34.649+0000 7f176a7fc640 1 -- 172.21.15.44:0/4044694822 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f175c037070 con 0x7f176c1073e0 2024-08-19T00:04:35.470 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:34.649+0000 7f176a7fc640 1 -- 172.21.15.44:0/4044694822 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f175c032920 con 0x7f176c1073e0 2024-08-19T00:04:35.470 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:34.649+0000 7f176a7fc640 1 -- 172.21.15.44:0/4044694822 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f175c030810 con 0x7f176c1073e0 2024-08-19T00:04:35.470 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:34.649+0000 7f1771c6a640 1 -- 172.21.15.44:0/4044694822 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f176c1073e0 msgr2=0x7f176c1077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:35.471 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:34.649+0000 7f1771c6a640 1 --2- 172.21.15.44:0/4044694822 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f176c1073e0 0x7f176c1077e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f175c009820 tx=0x7f175c02a270 comp rx=0 tx=0).stop 2024-08-19T00:04:35.471 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:34.649+0000 7f1771c6a640 1 -- 172.21.15.44:0/4044694822 shutdown_connections 2024-08-19T00:04:35.471 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:34.649+0000 7f1771c6a640 1 --2- 172.21.15.44:0/4044694822 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f176c1073e0 0x7f176c1077e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:35.471 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:34.649+0000 7f1771c6a640 1 -- 172.21.15.44:0/4044694822 >> 172.21.15.44:0/4044694822 conn(0x7f176c102c50 msgr2=0x7f176c105070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:04:35.471 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:34.650+0000 7f1771c6a640 1 -- 172.21.15.44:0/4044694822 shutdown_connections 2024-08-19T00:04:35.471 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:34.650+0000 7f1771c6a640 1 -- 172.21.15.44:0/4044694822 wait complete. 2024-08-19T00:04:35.471 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:34.650+0000 7f1771c6a640 1 Processor -- start 2024-08-19T00:04:35.471 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:34.650+0000 7f1771c6a640 1 -- start start 2024-08-19T00:04:35.471 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:34.651+0000 7f1771c6a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f176c1073e0 0x7f176c07daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:35.471 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:34.651+0000 7f1771c6a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f176c10b800 con 0x7f176c1073e0 2024-08-19T00:04:35.471 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:34.651+0000 7f176b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f176c1073e0 0x7f176c07daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:35.471 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:34.651+0000 7f176b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f176c1073e0 0x7f176c07daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57578/0 (socket says 172.21.15.44:57578) 2024-08-19T00:04:35.471 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:34.651+0000 7f176b7fe640 1 -- 172.21.15.44:0/2342107309 learned_addr learned my addr 172.21.15.44:0/2342107309 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:04:35.472 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:34.651+0000 7f176b7fe640 1 -- 172.21.15.44:0/2342107309 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f176c07e030 con 0x7f176c1073e0 2024-08-19T00:04:35.472 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:34.651+0000 7f176b7fe640 1 --2- 172.21.15.44:0/2342107309 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f176c1073e0 0x7f176c07daf0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f175c030380 tx=0x7f175c032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:35.472 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:34.651+0000 7f1768ff9640 1 -- 172.21.15.44:0/2342107309 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f175c037040 con 0x7f176c1073e0 2024-08-19T00:04:35.472 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:34.651+0000 7f1768ff9640 1 -- 172.21.15.44:0/2342107309 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f175c040070 con 0x7f176c1073e0 2024-08-19T00:04:35.472 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:34.651+0000 7f1771c6a640 1 -- 172.21.15.44:0/2342107309 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f176c07c220 con 0x7f176c1073e0 2024-08-19T00:04:35.472 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:34.651+0000 7f1768ff9640 1 -- 172.21.15.44:0/2342107309 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f175c03a7b0 con 0x7f176c1073e0 2024-08-19T00:04:35.472 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:34.651+0000 7f1771c6a640 1 -- 172.21.15.44:0/2342107309 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f176c07c760 con 0x7f176c1073e0 2024-08-19T00:04:35.472 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:34.652+0000 7f1768ff9640 1 -- 172.21.15.44:0/2342107309 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f175c03aa30 con 0x7f176c1073e0 2024-08-19T00:04:35.472 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:34.653+0000 7f1771c6a640 1 -- 172.21.15.44:0/2342107309 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f176c107860 con 0x7f176c1073e0 2024-08-19T00:04:35.472 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:34.653+0000 7f1768ff9640 1 --2- 172.21.15.44:0/2342107309 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7f1758038fc0 0x7f175803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:35.472 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:34.653+0000 7f1768ff9640 1 -- 172.21.15.44:0/2342107309 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f175c06c930 con 0x7f176c1073e0 2024-08-19T00:04:35.472 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:34.653+0000 7f176affd640 1 -- 172.21.15.44:0/2342107309 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7f1758038fc0 msgr2=0x7f175803b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.44:6800/1300308907 2024-08-19T00:04:35.472 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:34.653+0000 7f176affd640 1 --2- 172.21.15.44:0/2342107309 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7f1758038fc0 0x7f175803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T00:04:35.472 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:34.658+0000 7f1768ff9640 1 -- 172.21.15.44:0/2342107309 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f175c041270 con 0x7f176c1073e0 2024-08-19T00:04:35.473 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:34.854+0000 7f176affd640 1 -- 172.21.15.44:0/2342107309 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7f1758038fc0 msgr2=0x7f175803b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.44:6800/1300308907 2024-08-19T00:04:35.473 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:34.854+0000 7f176affd640 1 --2- 172.21.15.44:0/2342107309 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7f1758038fc0 0x7f175803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T00:04:35.473 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:34.886+0000 7f1771c6a640 1 -- 172.21.15.44:0/2342107309 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f176c07cf00 con 0x7f176c1073e0 2024-08-19T00:04:35.473 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:34.886+0000 7f1768ff9640 1 -- 172.21.15.44:0/2342107309 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f175c045980 con 0x7f176c1073e0 2024-08-19T00:04:35.473 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:34.888+0000 7f1771c6a640 1 -- 172.21.15.44:0/2342107309 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7f1758038fc0 msgr2=0x7f175803b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T00:04:35.473 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:34.888+0000 7f1771c6a640 1 --2- 172.21.15.44:0/2342107309 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7f1758038fc0 0x7f175803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:35.473 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:34.888+0000 7f1771c6a640 1 -- 172.21.15.44:0/2342107309 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f176c1073e0 msgr2=0x7f176c07daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:35.473 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:34.888+0000 7f1771c6a640 1 --2- 172.21.15.44:0/2342107309 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f176c1073e0 0x7f176c07daf0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f175c030380 tx=0x7f175c032670 comp rx=0 tx=0).stop 2024-08-19T00:04:35.473 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:34.889+0000 7f1771c6a640 1 -- 172.21.15.44:0/2342107309 shutdown_connections 2024-08-19T00:04:35.473 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:34.889+0000 7f1771c6a640 1 --2- 172.21.15.44:0/2342107309 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7f1758038fc0 0x7f175803b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:35.473 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:34.889+0000 7f1771c6a640 1 --2- 172.21.15.44:0/2342107309 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f176c1073e0 0x7f176c07daf0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:35.473 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:34.889+0000 7f1771c6a640 1 -- 172.21.15.44:0/2342107309 >> 172.21.15.44:0/2342107309 conn(0x7f176c102c50 msgr2=0x7f176c103750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:04:35.473 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:34.889+0000 7f1771c6a640 1 -- 172.21.15.44:0/2342107309 shutdown_connections 2024-08-19T00:04:35.474 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:34.889+0000 7f1771c6a640 1 -- 172.21.15.44:0/2342107309 wait complete. 2024-08-19T00:04:35.474 INFO:teuthology.orchestra.run.smithi044.stdout:Waiting for the mgr to restart... 2024-08-19T00:04:35.474 INFO:teuthology.orchestra.run.smithi044.stdout:Waiting for mgr epoch 9... 2024-08-19T00:04:35.708 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:35 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:04:35.374+0000 7fca9cf16040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-19T00:04:35.708 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:35 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:04:35.437+0000 7fca9cf16040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-19T00:04:35.709 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:35 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:04:35.506+0000 7fca9cf16040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-19T00:04:35.709 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:35 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:04:35.576+0000 7fca9cf16040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-19T00:04:36.116 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:35 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:04:35.800+0000 7fca9cf16040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-19T00:04:36.116 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:35 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:04:35.862+0000 7fca9cf16040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-19T00:04:36.721 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:36 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:04:36.399+0000 7fca9cf16040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-19T00:04:37.119 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:36 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:04:36.720+0000 7fca9cf16040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-19T00:04:37.619 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:37 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:04:37.149+0000 7fca9cf16040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-19T00:04:37.619 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:37 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:04:37.208+0000 7fca9cf16040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-19T00:04:37.619 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:37 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:04:37.269+0000 7fca9cf16040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-19T00:04:38.648 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:38 smithi044 ceph-mon[18489]: Active manager daemon x restarted 2024-08-19T00:04:38.648 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:38 smithi044 ceph-mon[18489]: Activating manager daemon x 2024-08-19T00:04:38.648 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:38 smithi044 ceph-mon[18489]: osdmap e3: 0 total, 0 up, 0 in 2024-08-19T00:04:38.648 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:38 smithi044 ceph-mon[18489]: mgrmap e10: x(active, starting, since 0.00371804s) 2024-08-19T00:04:38.648 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:38 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-19T00:04:38.648 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:38 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-08-19T00:04:38.649 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:38 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-19T00:04:38.649 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:38 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-19T00:04:38.649 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:38 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-19T00:04:38.649 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:38 smithi044 ceph-mon[18489]: Manager daemon x is now available 2024-08-19T00:04:38.649 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:38 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:04:38.649 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:38 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-08-19T00:04:38.649 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:38 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-08-19T00:04:40.229 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout { 2024-08-19T00:04:40.230 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-08-19T00:04:40.230 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "initialized": true 2024-08-19T00:04:40.230 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout } 2024-08-19T00:04:40.230 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:35.908+0000 7efe205c2640 1 Processor -- start 2024-08-19T00:04:40.230 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:35.908+0000 7efe205c2640 1 -- start start 2024-08-19T00:04:40.230 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:35.909+0000 7efe205c2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe18107390 0x7efe18107790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:40.230 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:35.909+0000 7efe205c2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7efe18107d60 con 0x7efe18107390 2024-08-19T00:04:40.230 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:35.909+0000 7efe1e35e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe18107390 0x7efe18107790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:40.230 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:35.909+0000 7efe1e35e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe18107390 0x7efe18107790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57582/0 (socket says 172.21.15.44:57582) 2024-08-19T00:04:40.231 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:35.909+0000 7efe1e35e640 1 -- 172.21.15.44:0/3285429022 learned_addr learned my addr 172.21.15.44:0/3285429022 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:04:40.231 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:35.909+0000 7efe1e35e640 1 -- 172.21.15.44:0/3285429022 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe18108540 con 0x7efe18107390 2024-08-19T00:04:40.231 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:35.910+0000 7efe1e35e640 1 --2- 172.21.15.44:0/3285429022 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe18107390 0x7efe18107790 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efe14009820 tx=0x7efe1402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=868009a665f5117d server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:40.231 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:35.910+0000 7efe1d35c640 1 -- 172.21.15.44:0/3285429022 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe14037070 con 0x7efe18107390 2024-08-19T00:04:40.231 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:35.910+0000 7efe1d35c640 1 -- 172.21.15.44:0/3285429022 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe14032920 con 0x7efe18107390 2024-08-19T00:04:40.231 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:35.910+0000 7efe1d35c640 1 -- 172.21.15.44:0/3285429022 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe14030810 con 0x7efe18107390 2024-08-19T00:04:40.231 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:35.911+0000 7efe205c2640 1 -- 172.21.15.44:0/3285429022 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe18107390 msgr2=0x7efe18107790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:40.231 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:35.911+0000 7efe205c2640 1 --2- 172.21.15.44:0/3285429022 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe18107390 0x7efe18107790 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efe14009820 tx=0x7efe1402a270 comp rx=0 tx=0).stop 2024-08-19T00:04:40.231 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:35.911+0000 7efe205c2640 1 -- 172.21.15.44:0/3285429022 shutdown_connections 2024-08-19T00:04:40.231 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:35.911+0000 7efe205c2640 1 --2- 172.21.15.44:0/3285429022 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe18107390 0x7efe18107790 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:40.231 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:35.911+0000 7efe205c2640 1 -- 172.21.15.44:0/3285429022 >> 172.21.15.44:0/3285429022 conn(0x7efe18102be0 msgr2=0x7efe18105000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:04:40.231 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:35.911+0000 7efe205c2640 1 -- 172.21.15.44:0/3285429022 shutdown_connections 2024-08-19T00:04:40.231 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:35.911+0000 7efe205c2640 1 -- 172.21.15.44:0/3285429022 wait complete. 2024-08-19T00:04:40.232 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:35.912+0000 7efe205c2640 1 Processor -- start 2024-08-19T00:04:40.232 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:35.912+0000 7efe205c2640 1 -- start start 2024-08-19T00:04:40.232 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:35.912+0000 7efe205c2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe18107390 0x7efe1819b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:40.232 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:35.912+0000 7efe205c2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7efe1810b8f0 con 0x7efe18107390 2024-08-19T00:04:40.232 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:35.912+0000 7efe1e35e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe18107390 0x7efe1819b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:40.232 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:35.912+0000 7efe1e35e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe18107390 0x7efe1819b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57592/0 (socket says 172.21.15.44:57592) 2024-08-19T00:04:40.232 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:35.912+0000 7efe1e35e640 1 -- 172.21.15.44:0/822793496 learned_addr learned my addr 172.21.15.44:0/822793496 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:04:40.232 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:35.912+0000 7efe1e35e640 1 -- 172.21.15.44:0/822793496 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe1819b910 con 0x7efe18107390 2024-08-19T00:04:40.232 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:35.913+0000 7efe1e35e640 1 --2- 172.21.15.44:0/822793496 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe18107390 0x7efe1819b3d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efe14030560 tx=0x7efe14032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:40.232 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:35.913+0000 7efe0f7fe640 1 -- 172.21.15.44:0/822793496 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe14037040 con 0x7efe18107390 2024-08-19T00:04:40.232 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:35.913+0000 7efe0f7fe640 1 -- 172.21.15.44:0/822793496 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe14040070 con 0x7efe18107390 2024-08-19T00:04:40.232 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:35.913+0000 7efe205c2640 1 -- 172.21.15.44:0/822793496 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe1819bba0 con 0x7efe18107390 2024-08-19T00:04:40.232 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:35.913+0000 7efe0f7fe640 1 -- 172.21.15.44:0/822793496 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe1403a6d0 con 0x7efe18107390 2024-08-19T00:04:40.233 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:35.913+0000 7efe205c2640 1 -- 172.21.15.44:0/822793496 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe1819e890 con 0x7efe18107390 2024-08-19T00:04:40.233 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:35.914+0000 7efe0f7fe640 1 -- 172.21.15.44:0/822793496 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7efe1403a940 con 0x7efe18107390 2024-08-19T00:04:40.233 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:35.914+0000 7efe0f7fe640 1 --2- 172.21.15.44:0/822793496 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7efe04038fc0 0x7efe0403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:40.233 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:35.914+0000 7efe205c2640 1 -- 172.21.15.44:0/822793496 --> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7efe18107810 con 0x7efe04038fc0 2024-08-19T00:04:40.233 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:35.914+0000 7efe0f7fe640 1 -- 172.21.15.44:0/822793496 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7efe1406c570 con 0x7efe18107390 2024-08-19T00:04:40.233 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:35.914+0000 7efe1db5d640 1 -- 172.21.15.44:0/822793496 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7efe04038fc0 msgr2=0x7efe0403b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.44:6800/1300308907 2024-08-19T00:04:40.233 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:35.914+0000 7efe1db5d640 1 --2- 172.21.15.44:0/822793496 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7efe04038fc0 0x7efe0403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T00:04:40.233 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:36.115+0000 7efe1db5d640 1 -- 172.21.15.44:0/822793496 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7efe04038fc0 msgr2=0x7efe0403b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.44:6800/1300308907 2024-08-19T00:04:40.233 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:36.115+0000 7efe1db5d640 1 --2- 172.21.15.44:0/822793496 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7efe04038fc0 0x7efe0403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T00:04:40.233 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:36.516+0000 7efe1db5d640 1 -- 172.21.15.44:0/822793496 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7efe04038fc0 msgr2=0x7efe0403b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.44:6800/1300308907 2024-08-19T00:04:40.233 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:36.516+0000 7efe1db5d640 1 --2- 172.21.15.44:0/822793496 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7efe04038fc0 0x7efe0403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T00:04:40.233 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:37.317+0000 7efe1db5d640 1 -- 172.21.15.44:0/822793496 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7efe04038fc0 msgr2=0x7efe0403b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.44:6800/1300308907 2024-08-19T00:04:40.234 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:37.317+0000 7efe1db5d640 1 --2- 172.21.15.44:0/822793496 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7efe04038fc0 0x7efe0403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T00:04:40.234 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:38.394+0000 7efe0f7fe640 1 -- 172.21.15.44:0/822793496 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mgrmap(e 10) ==== 46067+0+0 (secure 0 0 0) 0x7efe1406b020 con 0x7efe18107390 2024-08-19T00:04:40.234 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:38.394+0000 7efe0f7fe640 1 -- 172.21.15.44:0/822793496 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7efe04038fc0 msgr2=0x7efe0403b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T00:04:40.234 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:38.394+0000 7efe0f7fe640 1 --2- 172.21.15.44:0/822793496 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7efe04038fc0 0x7efe0403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:40.234 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:39.396+0000 7efe0f7fe640 1 -- 172.21.15.44:0/822793496 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7efe14045460 con 0x7efe18107390 2024-08-19T00:04:40.234 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:39.396+0000 7efe0f7fe640 1 --2- 172.21.15.44:0/822793496 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7efe0403c890 0x7efe0403ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:40.234 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:39.396+0000 7efe0f7fe640 1 -- 172.21.15.44:0/822793496 --> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7efe18107810 con 0x7efe0403c890 2024-08-19T00:04:40.234 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:39.396+0000 7efe1db5d640 1 --2- 172.21.15.44:0/822793496 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7efe0403c890 0x7efe0403ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:40.234 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:39.397+0000 7efe1db5d640 1 --2- 172.21.15.44:0/822793496 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7efe0403c890 0x7efe0403ec80 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7efe08003980 tx=0x7efe08006e10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:40.234 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:39.398+0000 7efe0f7fe640 1 -- 172.21.15.44:0/822793496 <== mgr.14150 v2:172.21.15.44:6800/1330072146 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7efe18107810 con 0x7efe0403c890 2024-08-19T00:04:40.234 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:39.405+0000 7efe205c2640 1 -- 172.21.15.44:0/822793496 --> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7efe1810ba70 con 0x7efe0403c890 2024-08-19T00:04:40.234 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:39.405+0000 7efe0f7fe640 1 -- 172.21.15.44:0/822793496 <== mgr.14150 v2:172.21.15.44:6800/1330072146 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7efe1810ba70 con 0x7efe0403c890 2024-08-19T00:04:40.235 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:39.405+0000 7efe205c2640 1 -- 172.21.15.44:0/822793496 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7efe0403c890 msgr2=0x7efe0403ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:40.235 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:39.405+0000 7efe205c2640 1 --2- 172.21.15.44:0/822793496 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7efe0403c890 0x7efe0403ec80 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7efe08003980 tx=0x7efe08006e10 comp rx=0 tx=0).stop 2024-08-19T00:04:40.235 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:39.405+0000 7efe205c2640 1 -- 172.21.15.44:0/822793496 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe18107390 msgr2=0x7efe1819b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:40.235 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:39.405+0000 7efe205c2640 1 --2- 172.21.15.44:0/822793496 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe18107390 0x7efe1819b3d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efe14030560 tx=0x7efe14032670 comp rx=0 tx=0).stop 2024-08-19T00:04:40.235 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:39.405+0000 7efe205c2640 1 -- 172.21.15.44:0/822793496 shutdown_connections 2024-08-19T00:04:40.235 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:39.405+0000 7efe205c2640 1 --2- 172.21.15.44:0/822793496 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7efe0403c890 0x7efe0403ec80 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:40.235 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:39.405+0000 7efe205c2640 1 --2- 172.21.15.44:0/822793496 >> [v2:172.21.15.44:6800/1300308907,v1:172.21.15.44:6801/1300308907] conn(0x7efe04038fc0 0x7efe0403b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:40.235 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:39.405+0000 7efe205c2640 1 --2- 172.21.15.44:0/822793496 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe18107390 0x7efe1819b3d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:40.235 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:39.405+0000 7efe205c2640 1 -- 172.21.15.44:0/822793496 >> 172.21.15.44:0/822793496 conn(0x7efe18102be0 msgr2=0x7efe18103830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:04:40.235 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:39.405+0000 7efe205c2640 1 -- 172.21.15.44:0/822793496 shutdown_connections 2024-08-19T00:04:40.235 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:39.405+0000 7efe205c2640 1 -- 172.21.15.44:0/822793496 wait complete. 2024-08-19T00:04:40.235 INFO:teuthology.orchestra.run.smithi044.stdout:mgr epoch 9 is available 2024-08-19T00:04:40.235 INFO:teuthology.orchestra.run.smithi044.stdout:Generating a dashboard self-signed certificate... 2024-08-19T00:04:40.605 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:40 smithi044 ceph-mon[18489]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-08-19T00:04:40.605 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:40 smithi044 ceph-mon[18489]: mgrmap e11: x(active, since 1.00638s) 2024-08-19T00:04:40.605 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:40 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:04:41.341 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:40 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:04:40.955+0000 7fca029d3640 -1 log_channel(cephadm) log [ERR] : [19/Aug/2024:00:04:40] ENGINE Error in HTTPServer.serve 2024-08-19T00:04:41.341 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:40 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: Traceback (most recent call last): 2024-08-19T00:04:41.342 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:40 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-19T00:04:41.342 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:40 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: self._connections.run(self.expiration_interval) 2024-08-19T00:04:41.342 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:40 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-19T00:04:41.342 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:40 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: self._run(expiration_interval) 2024-08-19T00:04:41.342 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:40 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-19T00:04:41.342 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:40 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: new_conn = self._from_server_socket(self.server.socket) 2024-08-19T00:04:41.342 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:40 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-19T00:04:41.342 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:40 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-19T00:04:41.342 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:40 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-19T00:04:41.342 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:40 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: s = self.context.wrap_socket( 2024-08-19T00:04:41.343 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:40 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-19T00:04:41.343 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:40 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: return self.sslsocket_class._create( 2024-08-19T00:04:41.343 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:40 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-19T00:04:41.343 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:40 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: self.do_handshake() 2024-08-19T00:04:41.343 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:40 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-19T00:04:41.343 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:40 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: self._sslobj.do_handshake() 2024-08-19T00:04:41.343 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:40 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-19T00:04:41.343 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:04:40 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:04:41.459 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-08-19T00:04:41.459 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:40.602+0000 7fa7eab43640 1 Processor -- start 2024-08-19T00:04:41.459 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:40.602+0000 7fa7eab43640 1 -- start start 2024-08-19T00:04:41.460 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:40.602+0000 7fa7eab43640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa7e4105b50 0x7fa7e4107f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:41.460 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:40.602+0000 7fa7eab43640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa7e407be30 con 0x7fa7e4105b50 2024-08-19T00:04:41.460 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:40.603+0000 7fa7e88df640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa7e4105b50 0x7fa7e4107f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:41.460 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:40.603+0000 7fa7e88df640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa7e4105b50 0x7fa7e4107f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42080/0 (socket says 172.21.15.44:42080) 2024-08-19T00:04:41.460 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:40.603+0000 7fa7e88df640 1 -- 172.21.15.44:0/1180023220 learned_addr learned my addr 172.21.15.44:0/1180023220 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:04:41.460 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:40.603+0000 7fa7e88df640 1 -- 172.21.15.44:0/1180023220 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7e41084a0 con 0x7fa7e4105b50 2024-08-19T00:04:41.460 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:40.604+0000 7fa7e88df640 1 --2- 172.21.15.44:0/1180023220 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa7e4105b50 0x7fa7e4107f60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8009820 tx=0x7fa7d802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=835bda2c793428a6 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:41.460 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:40.605+0000 7fa7e37fe640 1 -- 172.21.15.44:0/1180023220 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7d8037070 con 0x7fa7e4105b50 2024-08-19T00:04:41.460 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:40.605+0000 7fa7e37fe640 1 -- 172.21.15.44:0/1180023220 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7d8032920 con 0x7fa7e4105b50 2024-08-19T00:04:41.460 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:40.605+0000 7fa7e37fe640 1 -- 172.21.15.44:0/1180023220 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7d8030810 con 0x7fa7e4105b50 2024-08-19T00:04:41.460 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:40.606+0000 7fa7eab43640 1 -- 172.21.15.44:0/1180023220 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa7e4105b50 msgr2=0x7fa7e4107f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:41.460 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:40.606+0000 7fa7eab43640 1 --2- 172.21.15.44:0/1180023220 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa7e4105b50 0x7fa7e4107f60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8009820 tx=0x7fa7d802a270 comp rx=0 tx=0).stop 2024-08-19T00:04:41.461 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:40.606+0000 7fa7eab43640 1 -- 172.21.15.44:0/1180023220 shutdown_connections 2024-08-19T00:04:41.461 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:40.606+0000 7fa7eab43640 1 --2- 172.21.15.44:0/1180023220 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa7e4105b50 0x7fa7e4107f60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:41.461 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:40.606+0000 7fa7eab43640 1 -- 172.21.15.44:0/1180023220 >> 172.21.15.44:0/1180023220 conn(0x7fa7e4101a00 msgr2=0x7fa7e4103e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:04:41.461 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:40.606+0000 7fa7eab43640 1 -- 172.21.15.44:0/1180023220 shutdown_connections 2024-08-19T00:04:41.461 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:40.606+0000 7fa7eab43640 1 -- 172.21.15.44:0/1180023220 wait complete. 2024-08-19T00:04:41.461 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:40.607+0000 7fa7eab43640 1 Processor -- start 2024-08-19T00:04:41.461 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:40.607+0000 7fa7eab43640 1 -- start start 2024-08-19T00:04:41.461 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:40.607+0000 7fa7eab43640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa7e4105b50 0x7fa7e41a1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:41.461 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:40.607+0000 7fa7eab43640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa7e41095e0 con 0x7fa7e4105b50 2024-08-19T00:04:41.461 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:40.607+0000 7fa7e88df640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa7e4105b50 0x7fa7e41a1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:41.461 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:40.607+0000 7fa7e88df640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa7e4105b50 0x7fa7e41a1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42084/0 (socket says 172.21.15.44:42084) 2024-08-19T00:04:41.461 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:40.607+0000 7fa7e88df640 1 -- 172.21.15.44:0/1647648395 learned_addr learned my addr 172.21.15.44:0/1647648395 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:04:41.461 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:40.607+0000 7fa7e88df640 1 -- 172.21.15.44:0/1647648395 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7e41a1c40 con 0x7fa7e4105b50 2024-08-19T00:04:41.461 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:40.607+0000 7fa7e88df640 1 --2- 172.21.15.44:0/1647648395 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa7e4105b50 0x7fa7e41a1700 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8030a10 tx=0x7fa7d80327d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:41.462 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:40.608+0000 7fa7e1ffb640 1 -- 172.21.15.44:0/1647648395 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7d8037040 con 0x7fa7e4105b50 2024-08-19T00:04:41.462 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:40.608+0000 7fa7e1ffb640 1 -- 172.21.15.44:0/1647648395 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7d8032d00 con 0x7fa7e4105b50 2024-08-19T00:04:41.462 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:40.608+0000 7fa7eab43640 1 -- 172.21.15.44:0/1647648395 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7e41a1ed0 con 0x7fa7e4105b50 2024-08-19T00:04:41.462 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:40.608+0000 7fa7e1ffb640 1 -- 172.21.15.44:0/1647648395 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7d803a670 con 0x7fa7e4105b50 2024-08-19T00:04:41.462 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:40.608+0000 7fa7eab43640 1 -- 172.21.15.44:0/1647648395 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7e41a4bc0 con 0x7fa7e4105b50 2024-08-19T00:04:41.462 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:40.609+0000 7fa7e1ffb640 1 -- 172.21.15.44:0/1647648395 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7fa7d803a970 con 0x7fa7e4105b50 2024-08-19T00:04:41.462 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:40.609+0000 7fa7e1ffb640 1 --2- 172.21.15.44:0/1647648395 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fa7d4038eb0 0x7fa7d403b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:41.462 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:40.609+0000 7fa7eab43640 1 -- 172.21.15.44:0/1647648395 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7e40748c0 con 0x7fa7e4105b50 2024-08-19T00:04:41.462 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:40.609+0000 7fa7e1ffb640 1 -- 172.21.15.44:0/1647648395 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fa7d806c740 con 0x7fa7e4105b50 2024-08-19T00:04:41.462 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:40.610+0000 7fa7e3fff640 1 --2- 172.21.15.44:0/1647648395 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fa7d4038eb0 0x7fa7d403b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:41.462 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:40.610+0000 7fa7e3fff640 1 --2- 172.21.15.44:0/1647648395 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fa7d4038eb0 0x7fa7d403b370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa7d00098c0 tx=0x7fa7d0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:41.462 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:40.619+0000 7fa7e1ffb640 1 -- 172.21.15.44:0/1647648395 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fa7d803ba40 con 0x7fa7e4105b50 2024-08-19T00:04:41.462 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:40.813+0000 7fa7eab43640 1 -- 172.21.15.44:0/1647648395 --> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7fa7e402d8a0 con 0x7fa7d4038eb0 2024-08-19T00:04:41.463 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:40.840+0000 7fa7e1ffb640 1 -- 172.21.15.44:0/1647648395 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7fa7d8044920 con 0x7fa7e4105b50 2024-08-19T00:04:41.463 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:40.917+0000 7fa7e1ffb640 1 -- 172.21.15.44:0/1647648395 <== mgr.14150 v2:172.21.15.44:6800/1330072146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7fa7e402d8a0 con 0x7fa7d4038eb0 2024-08-19T00:04:41.463 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:40.919+0000 7fa7eab43640 1 -- 172.21.15.44:0/1647648395 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fa7d4038eb0 msgr2=0x7fa7d403b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:41.463 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:40.919+0000 7fa7eab43640 1 --2- 172.21.15.44:0/1647648395 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fa7d4038eb0 0x7fa7d403b370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa7d00098c0 tx=0x7fa7d0006db0 comp rx=0 tx=0).stop 2024-08-19T00:04:41.463 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:40.919+0000 7fa7eab43640 1 -- 172.21.15.44:0/1647648395 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa7e4105b50 msgr2=0x7fa7e41a1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:41.463 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:40.919+0000 7fa7eab43640 1 --2- 172.21.15.44:0/1647648395 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa7e4105b50 0x7fa7e41a1700 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8030a10 tx=0x7fa7d80327d0 comp rx=0 tx=0).stop 2024-08-19T00:04:41.463 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:40.920+0000 7fa7eab43640 1 -- 172.21.15.44:0/1647648395 shutdown_connections 2024-08-19T00:04:41.463 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:40.920+0000 7fa7eab43640 1 --2- 172.21.15.44:0/1647648395 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fa7d4038eb0 0x7fa7d403b370 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:41.463 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:40.920+0000 7fa7eab43640 1 --2- 172.21.15.44:0/1647648395 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa7e4105b50 0x7fa7e41a1700 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:41.464 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:40.920+0000 7fa7eab43640 1 -- 172.21.15.44:0/1647648395 >> 172.21.15.44:0/1647648395 conn(0x7fa7e4101a00 msgr2=0x7fa7e4103df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:04:41.464 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:40.920+0000 7fa7eab43640 1 -- 172.21.15.44:0/1647648395 shutdown_connections 2024-08-19T00:04:41.464 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:40.920+0000 7fa7eab43640 1 -- 172.21.15.44:0/1647648395 wait complete. 2024-08-19T00:04:41.464 INFO:teuthology.orchestra.run.smithi044.stdout:Creating initial admin user... 2024-08-19T00:04:41.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:41 smithi044 ceph-mon[18489]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-08-19T00:04:41.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:41 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:04:41.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:41 smithi044 ceph-mon[18489]: mgrmap e12: x(active, since 2s) 2024-08-19T00:04:41.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:41 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:04:41.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:41 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:04:42.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:42 smithi044 ceph-mon[18489]: [19/Aug/2024:00:04:40] ENGINE Bus STARTING 2024-08-19T00:04:42.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:42 smithi044 ceph-mon[18489]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:04:42.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:42 smithi044 ceph-mon[18489]: [19/Aug/2024:00:04:40] ENGINE Serving on http://172.21.15.44:8765 2024-08-19T00:04:42.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:42 smithi044 ceph-mon[18489]: [19/Aug/2024:00:04:40] ENGINE Serving on https://172.21.15.44:7150 2024-08-19T00:04:42.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:42 smithi044 ceph-mon[18489]: [19/Aug/2024:00:04:40] ENGINE Bus STARTED 2024-08-19T00:04:42.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:42 smithi044 ceph-mon[18489]: [19/Aug/2024:00:04:40] ENGINE Error in HTTPServer.serve 2024-08-19T00:04:42.620 INFO:journalctl@ceph.mon.a.smithi044.stdout: Traceback (most recent call last): 2024-08-19T00:04:42.620 INFO:journalctl@ceph.mon.a.smithi044.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-19T00:04:42.620 INFO:journalctl@ceph.mon.a.smithi044.stdout: self._connections.run(self.expiration_interval) 2024-08-19T00:04:42.620 INFO:journalctl@ceph.mon.a.smithi044.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-19T00:04:42.620 INFO:journalctl@ceph.mon.a.smithi044.stdout: self._run(expiration_interval) 2024-08-19T00:04:42.620 INFO:journalctl@ceph.mon.a.smithi044.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-19T00:04:42.620 INFO:journalctl@ceph.mon.a.smithi044.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-19T00:04:42.620 INFO:journalctl@ceph.mon.a.smithi044.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-19T00:04:42.620 INFO:journalctl@ceph.mon.a.smithi044.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-19T00:04:42.620 INFO:journalctl@ceph.mon.a.smithi044.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-19T00:04:42.621 INFO:journalctl@ceph.mon.a.smithi044.stdout: s = self.context.wrap_socket( 2024-08-19T00:04:42.621 INFO:journalctl@ceph.mon.a.smithi044.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-19T00:04:42.621 INFO:journalctl@ceph.mon.a.smithi044.stdout: return self.sslsocket_class._create( 2024-08-19T00:04:42.621 INFO:journalctl@ceph.mon.a.smithi044.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-19T00:04:42.621 INFO:journalctl@ceph.mon.a.smithi044.stdout: self.do_handshake() 2024-08-19T00:04:42.621 INFO:journalctl@ceph.mon.a.smithi044.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-19T00:04:42.621 INFO:journalctl@ceph.mon.a.smithi044.stdout: self._sslobj.do_handshake() 2024-08-19T00:04:42.621 INFO:journalctl@ceph.mon.a.smithi044.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-19T00:04:42.621 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:42 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:04:43.136 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$Hx8o/WT88uMRunmEzFleW.YMwgGCQqh71uoH7rc9VsxomhrFjRAUO", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1724025882, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-08-19T00:04:43.136 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:41.863+0000 7f24d9de2640 1 Processor -- start 2024-08-19T00:04:43.136 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:41.863+0000 7f24d9de2640 1 -- start start 2024-08-19T00:04:43.136 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:41.863+0000 7f24d9de2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24d4107dc0 0x7f24d410a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:43.136 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:41.863+0000 7f24d9de2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f24d407bdd0 con 0x7f24d4107dc0 2024-08-19T00:04:43.136 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:41.863+0000 7f24d37fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24d4107dc0 0x7f24d410a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:43.136 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:41.863+0000 7f24d37fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24d4107dc0 0x7f24d410a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42100/0 (socket says 172.21.15.44:42100) 2024-08-19T00:04:43.136 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:41.863+0000 7f24d37fe640 1 -- 172.21.15.44:0/2271920506 learned_addr learned my addr 172.21.15.44:0/2271920506 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:04:43.137 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:41.864+0000 7f24d37fe640 1 -- 172.21.15.44:0/2271920506 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24d410a6f0 con 0x7f24d4107dc0 2024-08-19T00:04:43.137 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:41.865+0000 7f24d37fe640 1 --2- 172.21.15.44:0/2271920506 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24d4107dc0 0x7f24d410a1b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f24c8009820 tx=0x7f24c802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9df77a764d367755 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:43.137 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:41.865+0000 7f24d27fc640 1 -- 172.21.15.44:0/2271920506 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24c8037070 con 0x7f24d4107dc0 2024-08-19T00:04:43.137 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:41.865+0000 7f24d27fc640 1 -- 172.21.15.44:0/2271920506 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f24c8032920 con 0x7f24d4107dc0 2024-08-19T00:04:43.137 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:41.865+0000 7f24d27fc640 1 -- 172.21.15.44:0/2271920506 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24c8030810 con 0x7f24d4107dc0 2024-08-19T00:04:43.137 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:41.866+0000 7f24d9de2640 1 -- 172.21.15.44:0/2271920506 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24d4107dc0 msgr2=0x7f24d410a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:43.137 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:41.866+0000 7f24d9de2640 1 --2- 172.21.15.44:0/2271920506 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24d4107dc0 0x7f24d410a1b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f24c8009820 tx=0x7f24c802a270 comp rx=0 tx=0).stop 2024-08-19T00:04:43.137 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:41.866+0000 7f24d9de2640 1 -- 172.21.15.44:0/2271920506 shutdown_connections 2024-08-19T00:04:43.137 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:41.866+0000 7f24d9de2640 1 --2- 172.21.15.44:0/2271920506 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24d4107dc0 0x7f24d410a1b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:43.137 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:41.866+0000 7f24d9de2640 1 -- 172.21.15.44:0/2271920506 >> 172.21.15.44:0/2271920506 conn(0x7f24d4101a00 msgr2=0x7f24d4103e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:04:43.137 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:41.866+0000 7f24d9de2640 1 -- 172.21.15.44:0/2271920506 shutdown_connections 2024-08-19T00:04:43.137 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:41.866+0000 7f24d9de2640 1 -- 172.21.15.44:0/2271920506 wait complete. 2024-08-19T00:04:43.138 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:41.866+0000 7f24d9de2640 1 Processor -- start 2024-08-19T00:04:43.138 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:41.867+0000 7f24d9de2640 1 -- start start 2024-08-19T00:04:43.138 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:41.867+0000 7f24d9de2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24d4107dc0 0x7f24d4107640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:43.138 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:41.867+0000 7f24d9de2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f24d410b770 con 0x7f24d4107dc0 2024-08-19T00:04:43.138 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:41.867+0000 7f24d37fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24d4107dc0 0x7f24d4107640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:43.138 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:41.867+0000 7f24d37fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24d4107dc0 0x7f24d4107640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42112/0 (socket says 172.21.15.44:42112) 2024-08-19T00:04:43.138 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:41.867+0000 7f24d37fe640 1 -- 172.21.15.44:0/1344269746 learned_addr learned my addr 172.21.15.44:0/1344269746 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:04:43.138 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:41.867+0000 7f24d37fe640 1 -- 172.21.15.44:0/1344269746 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24d4107b80 con 0x7f24d4107dc0 2024-08-19T00:04:43.138 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:41.867+0000 7f24d37fe640 1 --2- 172.21.15.44:0/1344269746 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24d4107dc0 0x7f24d4107640 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f24c80097f0 tx=0x7f24c80327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:43.138 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:41.868+0000 7f24d0ff9640 1 -- 172.21.15.44:0/1344269746 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24c8037040 con 0x7f24d4107dc0 2024-08-19T00:04:43.138 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:41.868+0000 7f24d0ff9640 1 -- 172.21.15.44:0/1344269746 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f24c8030cc0 con 0x7f24d4107dc0 2024-08-19T00:04:43.139 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:41.868+0000 7f24d9de2640 1 -- 172.21.15.44:0/1344269746 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24d4105d70 con 0x7f24d4107dc0 2024-08-19T00:04:43.139 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:41.868+0000 7f24d0ff9640 1 -- 172.21.15.44:0/1344269746 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24c803a6b0 con 0x7f24d4107dc0 2024-08-19T00:04:43.139 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:41.868+0000 7f24d9de2640 1 -- 172.21.15.44:0/1344269746 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24d41062b0 con 0x7f24d4107dc0 2024-08-19T00:04:43.139 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:41.869+0000 7f24d0ff9640 1 -- 172.21.15.44:0/1344269746 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f24c803a8a0 con 0x7f24d4107dc0 2024-08-19T00:04:43.139 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:41.869+0000 7f24d9de2640 1 -- 172.21.15.44:0/1344269746 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24d4108220 con 0x7f24d4107dc0 2024-08-19T00:04:43.139 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:41.869+0000 7f24d0ff9640 1 --2- 172.21.15.44:0/1344269746 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f24bc038fc0 0x7f24bc03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:43.139 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:41.869+0000 7f24d0ff9640 1 -- 172.21.15.44:0/1344269746 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f24c806c620 con 0x7f24d4107dc0 2024-08-19T00:04:43.139 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:41.869+0000 7f24d2ffd640 1 --2- 172.21.15.44:0/1344269746 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f24bc038fc0 0x7f24bc03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:43.139 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:41.869+0000 7f24d2ffd640 1 --2- 172.21.15.44:0/1344269746 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f24bc038fc0 0x7f24bc03b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f24c40098c0 tx=0x7f24c4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:43.140 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:41.874+0000 7f24d0ff9640 1 -- 172.21.15.44:0/1344269746 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f24c803ace0 con 0x7f24d4107dc0 2024-08-19T00:04:43.140 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:42.069+0000 7f24d9de2640 1 -- 172.21.15.44:0/1344269746 --> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f24d4106a50 con 0x7f24bc038fc0 2024-08-19T00:04:43.140 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:42.318+0000 7f24d0ff9640 1 -- 172.21.15.44:0/1344269746 <== mgr.14150 v2:172.21.15.44:6800/1330072146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f24d4106a50 con 0x7f24bc038fc0 2024-08-19T00:04:43.140 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:42.320+0000 7f24d9de2640 1 -- 172.21.15.44:0/1344269746 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f24bc038fc0 msgr2=0x7f24bc03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:43.140 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:42.320+0000 7f24d9de2640 1 --2- 172.21.15.44:0/1344269746 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f24bc038fc0 0x7f24bc03b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f24c40098c0 tx=0x7f24c4006db0 comp rx=0 tx=0).stop 2024-08-19T00:04:43.140 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:42.320+0000 7f24d9de2640 1 -- 172.21.15.44:0/1344269746 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24d4107dc0 msgr2=0x7f24d4107640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:43.140 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:42.320+0000 7f24d9de2640 1 --2- 172.21.15.44:0/1344269746 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24d4107dc0 0x7f24d4107640 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f24c80097f0 tx=0x7f24c80327b0 comp rx=0 tx=0).stop 2024-08-19T00:04:43.140 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:42.320+0000 7f24d9de2640 1 -- 172.21.15.44:0/1344269746 shutdown_connections 2024-08-19T00:04:43.141 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:42.320+0000 7f24d9de2640 1 --2- 172.21.15.44:0/1344269746 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f24bc038fc0 0x7f24bc03b480 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:43.141 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:42.320+0000 7f24d9de2640 1 --2- 172.21.15.44:0/1344269746 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24d4107dc0 0x7f24d4107640 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:43.141 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:42.320+0000 7f24d9de2640 1 -- 172.21.15.44:0/1344269746 >> 172.21.15.44:0/1344269746 conn(0x7f24d4101a00 msgr2=0x7f24d4102580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:04:43.141 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:42.320+0000 7f24d9de2640 1 -- 172.21.15.44:0/1344269746 shutdown_connections 2024-08-19T00:04:43.141 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:42.320+0000 7f24d9de2640 1 -- 172.21.15.44:0/1344269746 wait complete. 2024-08-19T00:04:43.141 INFO:teuthology.orchestra.run.smithi044.stdout:Fetching dashboard port number... 2024-08-19T00:04:43.717 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:43 smithi044 ceph-mon[18489]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:04:44.662 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:44 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/4292206717' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-08-19T00:04:44.670 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 8443 2024-08-19T00:04:44.670 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:43.536+0000 7f41885b6640 1 Processor -- start 2024-08-19T00:04:44.670 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:43.536+0000 7f41885b6640 1 -- start start 2024-08-19T00:04:44.670 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:43.536+0000 7f41885b6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4180107dc0 0x7f418010a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:44.670 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:43.536+0000 7f41885b6640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f418007bdd0 con 0x7f4180107dc0 2024-08-19T00:04:44.671 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:43.537+0000 7f4186352640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4180107dc0 0x7f418010a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:44.671 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:43.537+0000 7f4186352640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4180107dc0 0x7f418010a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42122/0 (socket says 172.21.15.44:42122) 2024-08-19T00:04:44.671 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:43.537+0000 7f4186352640 1 -- 172.21.15.44:0/3854736967 learned_addr learned my addr 172.21.15.44:0/3854736967 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:04:44.671 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:43.537+0000 7f4186352640 1 -- 172.21.15.44:0/3854736967 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f418010a6f0 con 0x7f4180107dc0 2024-08-19T00:04:44.671 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:43.538+0000 7f4186352640 1 --2- 172.21.15.44:0/3854736967 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4180107dc0 0x7f418010a1b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f417c009820 tx=0x7f417c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60b8598acb1d6cfd server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:44.671 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:43.538+0000 7f4185350640 1 -- 172.21.15.44:0/3854736967 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f417c037070 con 0x7f4180107dc0 2024-08-19T00:04:44.671 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:43.538+0000 7f4185350640 1 -- 172.21.15.44:0/3854736967 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f417c032920 con 0x7f4180107dc0 2024-08-19T00:04:44.671 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:43.538+0000 7f4185350640 1 -- 172.21.15.44:0/3854736967 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f417c030810 con 0x7f4180107dc0 2024-08-19T00:04:44.671 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:43.539+0000 7f41885b6640 1 -- 172.21.15.44:0/3854736967 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4180107dc0 msgr2=0x7f418010a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:44.671 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:43.539+0000 7f41885b6640 1 --2- 172.21.15.44:0/3854736967 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4180107dc0 0x7f418010a1b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f417c009820 tx=0x7f417c02a270 comp rx=0 tx=0).stop 2024-08-19T00:04:44.671 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:43.539+0000 7f41885b6640 1 -- 172.21.15.44:0/3854736967 shutdown_connections 2024-08-19T00:04:44.672 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:43.539+0000 7f41885b6640 1 --2- 172.21.15.44:0/3854736967 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4180107dc0 0x7f418010a1b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:44.672 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:43.539+0000 7f41885b6640 1 -- 172.21.15.44:0/3854736967 >> 172.21.15.44:0/3854736967 conn(0x7f4180101a00 msgr2=0x7f4180103e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:04:44.672 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:43.539+0000 7f41885b6640 1 -- 172.21.15.44:0/3854736967 shutdown_connections 2024-08-19T00:04:44.672 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:43.539+0000 7f41885b6640 1 -- 172.21.15.44:0/3854736967 wait complete. 2024-08-19T00:04:44.672 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:43.539+0000 7f41885b6640 1 Processor -- start 2024-08-19T00:04:44.672 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:43.539+0000 7f41885b6640 1 -- start start 2024-08-19T00:04:44.672 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:43.540+0000 7f41885b6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4180107dc0 0x7f418019b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:44.672 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:43.540+0000 7f41885b6640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f418010b770 con 0x7f4180107dc0 2024-08-19T00:04:44.672 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:43.540+0000 7f4186352640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4180107dc0 0x7f418019b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:44.672 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:43.540+0000 7f4186352640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4180107dc0 0x7f418019b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42128/0 (socket says 172.21.15.44:42128) 2024-08-19T00:04:44.672 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:43.540+0000 7f4186352640 1 -- 172.21.15.44:0/4292206717 learned_addr learned my addr 172.21.15.44:0/4292206717 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:04:44.672 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:43.540+0000 7f4186352640 1 -- 172.21.15.44:0/4292206717 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f418019b850 con 0x7f4180107dc0 2024-08-19T00:04:44.672 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:43.540+0000 7f4186352640 1 --2- 172.21.15.44:0/4292206717 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4180107dc0 0x7f418019b310 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f417c0097f0 tx=0x7f417c0327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:44.672 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:43.540+0000 7f41777fe640 1 -- 172.21.15.44:0/4292206717 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f417c037040 con 0x7f4180107dc0 2024-08-19T00:04:44.673 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:43.540+0000 7f41777fe640 1 -- 172.21.15.44:0/4292206717 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f417c030cc0 con 0x7f4180107dc0 2024-08-19T00:04:44.673 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:43.540+0000 7f41777fe640 1 -- 172.21.15.44:0/4292206717 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f417c03a6b0 con 0x7f4180107dc0 2024-08-19T00:04:44.673 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:43.540+0000 7f41885b6640 1 -- 172.21.15.44:0/4292206717 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f418019bae0 con 0x7f4180107dc0 2024-08-19T00:04:44.673 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:43.541+0000 7f41885b6640 1 -- 172.21.15.44:0/4292206717 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f418019bf00 con 0x7f4180107dc0 2024-08-19T00:04:44.673 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:43.541+0000 7f41777fe640 1 -- 172.21.15.44:0/4292206717 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f417c03a8a0 con 0x7f4180107dc0 2024-08-19T00:04:44.673 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:43.542+0000 7f41777fe640 1 --2- 172.21.15.44:0/4292206717 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f416c038fc0 0x7f416c03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:44.673 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:43.542+0000 7f41777fe640 1 -- 172.21.15.44:0/4292206717 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f417c06c660 con 0x7f4180107dc0 2024-08-19T00:04:44.673 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:43.542+0000 7f41885b6640 1 -- 172.21.15.44:0/4292206717 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4180108220 con 0x7f4180107dc0 2024-08-19T00:04:44.673 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:43.542+0000 7f4185b51640 1 --2- 172.21.15.44:0/4292206717 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f416c038fc0 0x7f416c03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:44.673 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:43.542+0000 7f4185b51640 1 --2- 172.21.15.44:0/4292206717 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f416c038fc0 0x7f416c03b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f41700098c0 tx=0x7f4170006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:44.673 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:43.547+0000 7f41777fe640 1 -- 172.21.15.44:0/4292206717 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f417c02fd40 con 0x7f4180107dc0 2024-08-19T00:04:44.673 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:43.733+0000 7f41885b6640 1 -- 172.21.15.44:0/4292206717 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f418019e890 con 0x7f4180107dc0 2024-08-19T00:04:44.673 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:43.733+0000 7f41777fe640 1 -- 172.21.15.44:0/4292206717 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f417c0448d0 con 0x7f4180107dc0 2024-08-19T00:04:44.674 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:43.735+0000 7f41885b6640 1 -- 172.21.15.44:0/4292206717 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f416c038fc0 msgr2=0x7f416c03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:44.674 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:43.735+0000 7f41885b6640 1 --2- 172.21.15.44:0/4292206717 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f416c038fc0 0x7f416c03b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f41700098c0 tx=0x7f4170006db0 comp rx=0 tx=0).stop 2024-08-19T00:04:44.674 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:43.735+0000 7f41885b6640 1 -- 172.21.15.44:0/4292206717 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4180107dc0 msgr2=0x7f418019b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:44.674 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:43.735+0000 7f41885b6640 1 --2- 172.21.15.44:0/4292206717 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4180107dc0 0x7f418019b310 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f417c0097f0 tx=0x7f417c0327b0 comp rx=0 tx=0).stop 2024-08-19T00:04:44.674 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:43.735+0000 7f41885b6640 1 -- 172.21.15.44:0/4292206717 shutdown_connections 2024-08-19T00:04:44.674 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:43.735+0000 7f41885b6640 1 --2- 172.21.15.44:0/4292206717 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f416c038fc0 0x7f416c03b480 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:44.674 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:43.735+0000 7f41885b6640 1 --2- 172.21.15.44:0/4292206717 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4180107dc0 0x7f418019b310 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:44.674 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:43.735+0000 7f41885b6640 1 -- 172.21.15.44:0/4292206717 >> 172.21.15.44:0/4292206717 conn(0x7f4180101a00 msgr2=0x7f41801025b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:04:44.674 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:43.735+0000 7f41885b6640 1 -- 172.21.15.44:0/4292206717 shutdown_connections 2024-08-19T00:04:44.674 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:43.736+0000 7f41885b6640 1 -- 172.21.15.44:0/4292206717 wait complete. 2024-08-19T00:04:44.681 INFO:teuthology.orchestra.run.smithi044.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-19T00:04:44.681 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stdout disabled 2024-08-19T00:04:44.689 INFO:teuthology.orchestra.run.smithi044.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-19T00:04:44.689 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stdout inactive 2024-08-19T00:04:44.689 INFO:teuthology.orchestra.run.smithi044.stdout:firewalld.service is not enabled 2024-08-19T00:04:44.689 INFO:teuthology.orchestra.run.smithi044.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-08-19T00:04:44.691 INFO:teuthology.orchestra.run.smithi044.stdout:Ceph Dashboard is now available at: 2024-08-19T00:04:44.691 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:04:44.691 INFO:teuthology.orchestra.run.smithi044.stdout: URL: https://smithi044:8443/ 2024-08-19T00:04:44.692 INFO:teuthology.orchestra.run.smithi044.stdout: User: admin 2024-08-19T00:04:44.692 INFO:teuthology.orchestra.run.smithi044.stdout: Password: p5m3224y54 2024-08-19T00:04:44.692 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:04:44.692 INFO:teuthology.orchestra.run.smithi044.stdout:Saving cluster configuration to /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/config directory 2024-08-19T00:04:45.668 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:45 smithi044 ceph-mon[18489]: mgrmap e13: x(active, since 6s) 2024-08-19T00:04:45.668 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:45 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/3485289932' entity='client.admin' 2024-08-19T00:04:45.943 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:45.093+0000 7f4118d34640 1 Processor -- start 2024-08-19T00:04:45.943 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:45.093+0000 7f4118d34640 1 -- start start 2024-08-19T00:04:45.943 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:45.094+0000 7f4118d34640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f411407dd00 0x7f411407c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:45.943 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:45.094+0000 7f4118d34640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f411407c800 con 0x7f411407dd00 2024-08-19T00:04:45.943 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:45.094+0000 7f411259c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f411407dd00 0x7f411407c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:45.943 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:45.094+0000 7f411259c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f411407dd00 0x7f411407c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42142/0 (socket says 172.21.15.44:42142) 2024-08-19T00:04:45.943 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:45.094+0000 7f411259c640 1 -- 172.21.15.44:0/762334002 learned_addr learned my addr 172.21.15.44:0/762334002 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:04:45.944 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:45.094+0000 7f411259c640 1 -- 172.21.15.44:0/762334002 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f411407c980 con 0x7f411407dd00 2024-08-19T00:04:45.944 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:45.095+0000 7f411259c640 1 --2- 172.21.15.44:0/762334002 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f411407dd00 0x7f411407c2c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4104009e80 tx=0x7f410402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99961b35b552e8b2 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:45.944 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:45.095+0000 7f411159a640 1 -- 172.21.15.44:0/762334002 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4104036070 con 0x7f411407dd00 2024-08-19T00:04:45.944 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:45.095+0000 7f411159a640 1 -- 172.21.15.44:0/762334002 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f41040318e0 con 0x7f411407dd00 2024-08-19T00:04:45.944 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:45.095+0000 7f411159a640 1 -- 172.21.15.44:0/762334002 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4104007a00 con 0x7f411407dd00 2024-08-19T00:04:45.944 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:45.096+0000 7f4118d34640 1 -- 172.21.15.44:0/762334002 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f411407dd00 msgr2=0x7f411407c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:45.944 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:45.096+0000 7f4118d34640 1 --2- 172.21.15.44:0/762334002 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f411407dd00 0x7f411407c2c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4104009e80 tx=0x7f410402a7a0 comp rx=0 tx=0).stop 2024-08-19T00:04:45.944 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:45.096+0000 7f4118d34640 1 -- 172.21.15.44:0/762334002 shutdown_connections 2024-08-19T00:04:45.944 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:45.096+0000 7f4118d34640 1 --2- 172.21.15.44:0/762334002 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f411407dd00 0x7f411407c2c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:45.944 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:45.096+0000 7f4118d34640 1 -- 172.21.15.44:0/762334002 >> 172.21.15.44:0/762334002 conn(0x7f4114102c50 msgr2=0x7f4114105070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:04:45.944 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:45.096+0000 7f4118d34640 1 -- 172.21.15.44:0/762334002 shutdown_connections 2024-08-19T00:04:45.944 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:45.096+0000 7f4118d34640 1 -- 172.21.15.44:0/762334002 wait complete. 2024-08-19T00:04:45.944 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:45.097+0000 7f4118d34640 1 Processor -- start 2024-08-19T00:04:45.945 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:45.097+0000 7f4118d34640 1 -- start start 2024-08-19T00:04:45.945 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:45.097+0000 7f4118d34640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f411407dd00 0x7f41141a1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:45.945 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:45.097+0000 7f4118d34640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f41141094c0 con 0x7f411407dd00 2024-08-19T00:04:45.945 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:45.097+0000 7f411259c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f411407dd00 0x7f41141a1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:45.945 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:45.097+0000 7f411259c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f411407dd00 0x7f41141a1910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42154/0 (socket says 172.21.15.44:42154) 2024-08-19T00:04:45.945 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:45.097+0000 7f411259c640 1 -- 172.21.15.44:0/3485289932 learned_addr learned my addr 172.21.15.44:0/3485289932 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:04:45.945 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:45.097+0000 7f411259c640 1 -- 172.21.15.44:0/3485289932 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41141a1e50 con 0x7f411407dd00 2024-08-19T00:04:45.945 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:45.097+0000 7f411259c640 1 --2- 172.21.15.44:0/3485289932 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f411407dd00 0x7f41141a1910 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f410402acc0 tx=0x7f4104031cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:45.945 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:45.098+0000 7f410b7fe640 1 -- 172.21.15.44:0/3485289932 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4104036050 con 0x7f411407dd00 2024-08-19T00:04:45.945 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:45.098+0000 7f410b7fe640 1 -- 172.21.15.44:0/3485289932 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4104037040 con 0x7f411407dd00 2024-08-19T00:04:45.945 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:45.098+0000 7f4118d34640 1 -- 172.21.15.44:0/3485289932 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41141a20e0 con 0x7f411407dd00 2024-08-19T00:04:45.945 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:45.098+0000 7f410b7fe640 1 -- 172.21.15.44:0/3485289932 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f410403d8e0 con 0x7f411407dd00 2024-08-19T00:04:45.945 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:45.098+0000 7f4118d34640 1 -- 172.21.15.44:0/3485289932 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41141a4dd0 con 0x7f411407dd00 2024-08-19T00:04:45.946 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:45.099+0000 7f410b7fe640 1 -- 172.21.15.44:0/3485289932 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f4104044020 con 0x7f411407dd00 2024-08-19T00:04:45.946 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:45.099+0000 7f410b7fe640 1 --2- 172.21.15.44:0/3485289932 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f41000390c0 0x7f410003b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:45.946 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:45.099+0000 7f410b7fe640 1 -- 172.21.15.44:0/3485289932 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f4104042020 con 0x7f411407dd00 2024-08-19T00:04:45.946 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:45.099+0000 7f4118d34640 1 -- 172.21.15.44:0/3485289932 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f411407c340 con 0x7f411407dd00 2024-08-19T00:04:45.946 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:45.099+0000 7f4111d9b640 1 --2- 172.21.15.44:0/3485289932 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f41000390c0 0x7f410003b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:45.946 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:45.100+0000 7f4111d9b640 1 --2- 172.21.15.44:0/3485289932 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f41000390c0 0x7f410003b580 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f40fc0098c0 tx=0x7f40fc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:45.946 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:45.104+0000 7f410b7fe640 1 -- 172.21.15.44:0/3485289932 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f410404b020 con 0x7f411407dd00 2024-08-19T00:04:45.946 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:45.368+0000 7f4118d34640 1 -- 172.21.15.44:0/3485289932 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f411402d730 con 0x7f411407dd00 2024-08-19T00:04:45.946 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:45.371+0000 7f410b7fe640 1 -- 172.21.15.44:0/3485289932 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7f410403b990 con 0x7f411407dd00 2024-08-19T00:04:45.946 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-08-19T00:04:45.946 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:45.373+0000 7f4118d34640 1 -- 172.21.15.44:0/3485289932 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f41000390c0 msgr2=0x7f410003b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:45.946 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:45.373+0000 7f4118d34640 1 --2- 172.21.15.44:0/3485289932 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f41000390c0 0x7f410003b580 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f40fc0098c0 tx=0x7f40fc006db0 comp rx=0 tx=0).stop 2024-08-19T00:04:45.946 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:45.373+0000 7f4118d34640 1 -- 172.21.15.44:0/3485289932 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f411407dd00 msgr2=0x7f41141a1910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:45.947 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:45.373+0000 7f4118d34640 1 --2- 172.21.15.44:0/3485289932 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f411407dd00 0x7f41141a1910 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f410402acc0 tx=0x7f4104031cc0 comp rx=0 tx=0).stop 2024-08-19T00:04:45.947 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:45.373+0000 7f4118d34640 1 -- 172.21.15.44:0/3485289932 shutdown_connections 2024-08-19T00:04:45.947 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:45.373+0000 7f4118d34640 1 --2- 172.21.15.44:0/3485289932 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f41000390c0 0x7f410003b580 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:45.947 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:45.373+0000 7f4118d34640 1 --2- 172.21.15.44:0/3485289932 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f411407dd00 0x7f41141a1910 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:45.947 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:45.373+0000 7f4118d34640 1 -- 172.21.15.44:0/3485289932 >> 172.21.15.44:0/3485289932 conn(0x7f4114102c50 msgr2=0x7f4114105040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:04:45.947 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:45.373+0000 7f4118d34640 1 -- 172.21.15.44:0/3485289932 shutdown_connections 2024-08-19T00:04:45.947 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-08-19T00:04:45.373+0000 7f4118d34640 1 -- 172.21.15.44:0/3485289932 wait complete. 2024-08-19T00:04:45.947 INFO:teuthology.orchestra.run.smithi044.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-08-19T00:04:45.947 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:04:45.947 INFO:teuthology.orchestra.run.smithi044.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-08-19T00:04:45.947 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:04:45.947 INFO:teuthology.orchestra.run.smithi044.stdout:Or, if you are only running a single cluster on this host: 2024-08-19T00:04:45.947 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:04:45.948 INFO:teuthology.orchestra.run.smithi044.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-08-19T00:04:45.948 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:04:45.948 INFO:teuthology.orchestra.run.smithi044.stdout:Please consider enabling telemetry to help improve Ceph: 2024-08-19T00:04:45.948 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:04:45.948 INFO:teuthology.orchestra.run.smithi044.stdout: ceph telemetry on 2024-08-19T00:04:45.948 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:04:45.948 INFO:teuthology.orchestra.run.smithi044.stdout:For more information see: 2024-08-19T00:04:45.948 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:04:45.948 INFO:teuthology.orchestra.run.smithi044.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-08-19T00:04:45.948 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:04:45.948 INFO:teuthology.orchestra.run.smithi044.stdout:Bootstrap complete. 2024-08-19T00:04:45.982 INFO:tasks.cephadm:Fetching config... 2024-08-19T00:04:45.983 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-08-19T00:04:45.983 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-08-19T00:04:45.999 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-08-19T00:04:45.999 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-08-19T00:04:45.999 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-08-19T00:04:46.054 INFO:tasks.cephadm:Fetching mon keyring... 2024-08-19T00:04:46.054 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-08-19T00:04:46.054 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/keyring of=/dev/stdout 2024-08-19T00:04:46.120 INFO:tasks.cephadm:Fetching pub ssh key... 2024-08-19T00:04:46.120 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-08-19T00:04:46.120 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-08-19T00:04:46.175 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-08-19T00:04:46.175 DEBUG:teuthology.orchestra.run.smithi044:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDvw3z3CuXtOgC0hKfSfQvJQ/L+DkfjdFIqfC0rQocYCRJrKCb7Mpd1rJ9rXWLSquYMe1hGL0cGp74/b0sMVhgmNWSyT2/izjXQmJJRh917ZTxR2GFIWFzEtfBZQ3VZh/M3wXra7jweKaLXwafHkacVwBi8uC2+vQHuewMsEWE2F8HA7OdbS2SM4SS8CfibBvhI/BUfHQQW312GDt8nlTu57PJWUvYUz6J9vB7yxCF9E7s/xwcVgAHtFh74pvn8J854xDJc1jEMnDlG54cvl/3RG1SxE5lnQwklCemILlzlxacu77WIwBxMVpRJ15HobY6HEALibnOPiajvdFpqoKUT8mKe1WfG22c4XhBkuXanFnD5vSXM5SwUAR/KeCd+xSS/shgSqSd3gByM+B5XPUIkizGbCmmXM4J1qbuitokfWs1T28bkVUasOJ5j9w/RWeKq+VkcF+TG1eXN06fQXGmGQ6uMCKyjc8M7BNF1t8QtEsB+sxmnoKsWhPHZCRaKiRs= ceph-647ded64-5dbe-11ef-bccf-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-08-19T00:04:46.248 INFO:teuthology.orchestra.run.smithi044.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDvw3z3CuXtOgC0hKfSfQvJQ/L+DkfjdFIqfC0rQocYCRJrKCb7Mpd1rJ9rXWLSquYMe1hGL0cGp74/b0sMVhgmNWSyT2/izjXQmJJRh917ZTxR2GFIWFzEtfBZQ3VZh/M3wXra7jweKaLXwafHkacVwBi8uC2+vQHuewMsEWE2F8HA7OdbS2SM4SS8CfibBvhI/BUfHQQW312GDt8nlTu57PJWUvYUz6J9vB7yxCF9E7s/xwcVgAHtFh74pvn8J854xDJc1jEMnDlG54cvl/3RG1SxE5lnQwklCemILlzlxacu77WIwBxMVpRJ15HobY6HEALibnOPiajvdFpqoKUT8mKe1WfG22c4XhBkuXanFnD5vSXM5SwUAR/KeCd+xSS/shgSqSd3gByM+B5XPUIkizGbCmmXM4J1qbuitokfWs1T28bkVUasOJ5j9w/RWeKq+VkcF+TG1eXN06fQXGmGQ6uMCKyjc8M7BNF1t8QtEsB+sxmnoKsWhPHZCRaKiRs= ceph-647ded64-5dbe-11ef-bccf-c7b262605968 2024-08-19T00:04:46.261 DEBUG:teuthology.orchestra.run.smithi116:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDvw3z3CuXtOgC0hKfSfQvJQ/L+DkfjdFIqfC0rQocYCRJrKCb7Mpd1rJ9rXWLSquYMe1hGL0cGp74/b0sMVhgmNWSyT2/izjXQmJJRh917ZTxR2GFIWFzEtfBZQ3VZh/M3wXra7jweKaLXwafHkacVwBi8uC2+vQHuewMsEWE2F8HA7OdbS2SM4SS8CfibBvhI/BUfHQQW312GDt8nlTu57PJWUvYUz6J9vB7yxCF9E7s/xwcVgAHtFh74pvn8J854xDJc1jEMnDlG54cvl/3RG1SxE5lnQwklCemILlzlxacu77WIwBxMVpRJ15HobY6HEALibnOPiajvdFpqoKUT8mKe1WfG22c4XhBkuXanFnD5vSXM5SwUAR/KeCd+xSS/shgSqSd3gByM+B5XPUIkizGbCmmXM4J1qbuitokfWs1T28bkVUasOJ5j9w/RWeKq+VkcF+TG1eXN06fQXGmGQ6uMCKyjc8M7BNF1t8QtEsB+sxmnoKsWhPHZCRaKiRs= ceph-647ded64-5dbe-11ef-bccf-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-08-19T00:04:46.303 INFO:teuthology.orchestra.run.smithi116.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDvw3z3CuXtOgC0hKfSfQvJQ/L+DkfjdFIqfC0rQocYCRJrKCb7Mpd1rJ9rXWLSquYMe1hGL0cGp74/b0sMVhgmNWSyT2/izjXQmJJRh917ZTxR2GFIWFzEtfBZQ3VZh/M3wXra7jweKaLXwafHkacVwBi8uC2+vQHuewMsEWE2F8HA7OdbS2SM4SS8CfibBvhI/BUfHQQW312GDt8nlTu57PJWUvYUz6J9vB7yxCF9E7s/xwcVgAHtFh74pvn8J854xDJc1jEMnDlG54cvl/3RG1SxE5lnQwklCemILlzlxacu77WIwBxMVpRJ15HobY6HEALibnOPiajvdFpqoKUT8mKe1WfG22c4XhBkuXanFnD5vSXM5SwUAR/KeCd+xSS/shgSqSd3gByM+B5XPUIkizGbCmmXM4J1qbuitokfWs1T28bkVUasOJ5j9w/RWeKq+VkcF+TG1eXN06fQXGmGQ6uMCKyjc8M7BNF1t8QtEsB+sxmnoKsWhPHZCRaKiRs= ceph-647ded64-5dbe-11ef-bccf-c7b262605968 2024-08-19T00:04:46.315 DEBUG:teuthology.orchestra.run.smithi171:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDvw3z3CuXtOgC0hKfSfQvJQ/L+DkfjdFIqfC0rQocYCRJrKCb7Mpd1rJ9rXWLSquYMe1hGL0cGp74/b0sMVhgmNWSyT2/izjXQmJJRh917ZTxR2GFIWFzEtfBZQ3VZh/M3wXra7jweKaLXwafHkacVwBi8uC2+vQHuewMsEWE2F8HA7OdbS2SM4SS8CfibBvhI/BUfHQQW312GDt8nlTu57PJWUvYUz6J9vB7yxCF9E7s/xwcVgAHtFh74pvn8J854xDJc1jEMnDlG54cvl/3RG1SxE5lnQwklCemILlzlxacu77WIwBxMVpRJ15HobY6HEALibnOPiajvdFpqoKUT8mKe1WfG22c4XhBkuXanFnD5vSXM5SwUAR/KeCd+xSS/shgSqSd3gByM+B5XPUIkizGbCmmXM4J1qbuitokfWs1T28bkVUasOJ5j9w/RWeKq+VkcF+TG1eXN06fQXGmGQ6uMCKyjc8M7BNF1t8QtEsB+sxmnoKsWhPHZCRaKiRs= ceph-647ded64-5dbe-11ef-bccf-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-08-19T00:04:46.357 INFO:teuthology.orchestra.run.smithi171.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDvw3z3CuXtOgC0hKfSfQvJQ/L+DkfjdFIqfC0rQocYCRJrKCb7Mpd1rJ9rXWLSquYMe1hGL0cGp74/b0sMVhgmNWSyT2/izjXQmJJRh917ZTxR2GFIWFzEtfBZQ3VZh/M3wXra7jweKaLXwafHkacVwBi8uC2+vQHuewMsEWE2F8HA7OdbS2SM4SS8CfibBvhI/BUfHQQW312GDt8nlTu57PJWUvYUz6J9vB7yxCF9E7s/xwcVgAHtFh74pvn8J854xDJc1jEMnDlG54cvl/3RG1SxE5lnQwklCemILlzlxacu77WIwBxMVpRJ15HobY6HEALibnOPiajvdFpqoKUT8mKe1WfG22c4XhBkuXanFnD5vSXM5SwUAR/KeCd+xSS/shgSqSd3gByM+B5XPUIkizGbCmmXM4J1qbuitokfWs1T28bkVUasOJ5j9w/RWeKq+VkcF+TG1eXN06fQXGmGQ6uMCKyjc8M7BNF1t8QtEsB+sxmnoKsWhPHZCRaKiRs= ceph-647ded64-5dbe-11ef-bccf-c7b262605968 2024-08-19T00:04:46.370 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-08-19T00:04:46.623 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:04:47.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:47.081+0000 7fb3a2a4a640 1 -- 172.21.15.44:0/591767544 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb39c0ffc10 msgr2=0x7fb39c100010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:47.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:47.081+0000 7fb3a2a4a640 1 --2- 172.21.15.44:0/591767544 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb39c0ffc10 0x7fb39c100010 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb38c009880 tx=0x7fb38c02a5d0 comp rx=0 tx=0).stop 2024-08-19T00:04:47.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:47.081+0000 7fb3a2a4a640 1 -- 172.21.15.44:0/591767544 shutdown_connections 2024-08-19T00:04:47.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:47.081+0000 7fb3a2a4a640 1 --2- 172.21.15.44:0/591767544 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb39c0ffc10 0x7fb39c100010 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:47.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:47.081+0000 7fb3a2a4a640 1 -- 172.21.15.44:0/591767544 >> 172.21.15.44:0/591767544 conn(0x7fb39c0fb9c0 msgr2=0x7fb39c0fde00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:04:47.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:47.081+0000 7fb3a2a4a640 1 -- 172.21.15.44:0/591767544 shutdown_connections 2024-08-19T00:04:47.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:47.081+0000 7fb3a2a4a640 1 -- 172.21.15.44:0/591767544 wait complete. 2024-08-19T00:04:47.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:47.082+0000 7fb3a2a4a640 1 Processor -- start 2024-08-19T00:04:47.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:47.082+0000 7fb3a2a4a640 1 -- start start 2024-08-19T00:04:47.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:47.082+0000 7fb3a2a4a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb39c0ffc10 0x7fb39c19d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:47.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:47.082+0000 7fb3a2a4a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb39c103340 con 0x7fb39c0ffc10 2024-08-19T00:04:47.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:47.082+0000 7fb39bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb39c0ffc10 0x7fb39c19d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:47.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:47.082+0000 7fb39bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb39c0ffc10 0x7fb39c19d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42166/0 (socket says 172.21.15.44:42166) 2024-08-19T00:04:47.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:47.082+0000 7fb39bfff640 1 -- 172.21.15.44:0/3028941671 learned_addr learned my addr 172.21.15.44:0/3028941671 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:04:47.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:47.083+0000 7fb39bfff640 1 -- 172.21.15.44:0/3028941671 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb39c19d5c0 con 0x7fb39c0ffc10 2024-08-19T00:04:47.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:47.083+0000 7fb39bfff640 1 --2- 172.21.15.44:0/3028941671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb39c0ffc10 0x7fb39c19d080 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb38c004f60 tx=0x7fb38c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:47.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:47.083+0000 7fb3997fa640 1 -- 172.21.15.44:0/3028941671 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb38c03f070 con 0x7fb39c0ffc10 2024-08-19T00:04:47.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:47.083+0000 7fb3a2a4a640 1 -- 172.21.15.44:0/3028941671 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb39c19d850 con 0x7fb39c0ffc10 2024-08-19T00:04:47.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:47.083+0000 7fb3997fa640 1 -- 172.21.15.44:0/3028941671 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb38c003ad0 con 0x7fb39c0ffc10 2024-08-19T00:04:47.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:47.083+0000 7fb3997fa640 1 -- 172.21.15.44:0/3028941671 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb38c035030 con 0x7fb39c0ffc10 2024-08-19T00:04:47.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:47.083+0000 7fb3a2a4a640 1 -- 172.21.15.44:0/3028941671 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb39c1a0540 con 0x7fb39c0ffc10 2024-08-19T00:04:47.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:47.084+0000 7fb3997fa640 1 -- 172.21.15.44:0/3028941671 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fb38c042070 con 0x7fb39c0ffc10 2024-08-19T00:04:47.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:47.084+0000 7fb3997fa640 1 --2- 172.21.15.44:0/3028941671 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fb384039060 0x7fb38403b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:47.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:47.084+0000 7fb3997fa640 1 -- 172.21.15.44:0/3028941671 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fb38c06ce00 con 0x7fb39c0ffc10 2024-08-19T00:04:47.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:47.084+0000 7fb39b7fe640 1 --2- 172.21.15.44:0/3028941671 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fb384039060 0x7fb38403b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:47.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:47.085+0000 7fb3a2a4a640 1 -- 172.21.15.44:0/3028941671 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb39c103ac0 con 0x7fb39c0ffc10 2024-08-19T00:04:47.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:47.085+0000 7fb39b7fe640 1 --2- 172.21.15.44:0/3028941671 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fb384039060 0x7fb38403b520 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb3900098c0 tx=0x7fb390006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:47.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:47.090+0000 7fb3997fa640 1 -- 172.21.15.44:0/3028941671 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fb38c039350 con 0x7fb39c0ffc10 2024-08-19T00:04:47.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:47.268+0000 7fb3a2a4a640 1 -- 172.21.15.44:0/3028941671 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7fb39c1a0850 con 0x7fb39c0ffc10 2024-08-19T00:04:47.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:47.271+0000 7fb3997fa640 1 -- 172.21.15.44:0/3028941671 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7fb38c02f300 con 0x7fb39c0ffc10 2024-08-19T00:04:47.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:47.273+0000 7fb3a2a4a640 1 -- 172.21.15.44:0/3028941671 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fb384039060 msgr2=0x7fb38403b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:47.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:47.273+0000 7fb3a2a4a640 1 --2- 172.21.15.44:0/3028941671 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fb384039060 0x7fb38403b520 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb3900098c0 tx=0x7fb390006db0 comp rx=0 tx=0).stop 2024-08-19T00:04:47.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:47.273+0000 7fb3a2a4a640 1 -- 172.21.15.44:0/3028941671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb39c0ffc10 msgr2=0x7fb39c19d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:47.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:47.273+0000 7fb3a2a4a640 1 --2- 172.21.15.44:0/3028941671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb39c0ffc10 0x7fb39c19d080 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb38c004f60 tx=0x7fb38c0048f0 comp rx=0 tx=0).stop 2024-08-19T00:04:47.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:47.273+0000 7fb3a2a4a640 1 -- 172.21.15.44:0/3028941671 shutdown_connections 2024-08-19T00:04:47.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:47.273+0000 7fb3a2a4a640 1 --2- 172.21.15.44:0/3028941671 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fb384039060 0x7fb38403b520 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:47.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:47.273+0000 7fb3a2a4a640 1 --2- 172.21.15.44:0/3028941671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb39c0ffc10 0x7fb39c19d080 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:47.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:47.273+0000 7fb3a2a4a640 1 -- 172.21.15.44:0/3028941671 >> 172.21.15.44:0/3028941671 conn(0x7fb39c0fb9c0 msgr2=0x7fb39c106140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:04:47.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:47.273+0000 7fb3a2a4a640 1 -- 172.21.15.44:0/3028941671 shutdown_connections 2024-08-19T00:04:47.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:47.273+0000 7fb3a2a4a640 1 -- 172.21.15.44:0/3028941671 wait complete. 2024-08-19T00:04:48.309 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:48 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/3028941671' entity='client.admin' 2024-08-19T00:04:48.309 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:48 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:04:48.309 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:48 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:04:48.309 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:48 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi044", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:04:48.310 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:48 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:04:48.310 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:48 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:04:48.310 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:48 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:04:48.335 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-08-19T00:04:48.336 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-08-19T00:04:48.778 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:04:49.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:49.244+0000 7f93b57c8640 1 -- 172.21.15.44:0/2294303728 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93b0101310 msgr2=0x7f93b0101710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:49.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:49.244+0000 7f93b57c8640 1 --2- 172.21.15.44:0/2294303728 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93b0101310 0x7f93b0101710 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f93a0009880 tx=0x7f93a002a5d0 comp rx=0 tx=0).stop 2024-08-19T00:04:49.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:49.244+0000 7f93b57c8640 1 -- 172.21.15.44:0/2294303728 shutdown_connections 2024-08-19T00:04:49.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:49.244+0000 7f93b57c8640 1 --2- 172.21.15.44:0/2294303728 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93b0101310 0x7f93b0101710 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:49.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:49.244+0000 7f93b57c8640 1 -- 172.21.15.44:0/2294303728 >> 172.21.15.44:0/2294303728 conn(0x7f93b00fcaa0 msgr2=0x7f93b00feee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:04:49.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:49.244+0000 7f93b57c8640 1 -- 172.21.15.44:0/2294303728 shutdown_connections 2024-08-19T00:04:49.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:49.244+0000 7f93b57c8640 1 -- 172.21.15.44:0/2294303728 wait complete. 2024-08-19T00:04:49.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:49.245+0000 7f93b57c8640 1 Processor -- start 2024-08-19T00:04:49.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:49.245+0000 7f93b57c8640 1 -- start start 2024-08-19T00:04:49.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:49.245+0000 7f93b57c8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93b0101310 0x7f93b0196a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:49.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:49.245+0000 7f93b57c8640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f93b0107420 con 0x7f93b0101310 2024-08-19T00:04:49.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:49.245+0000 7f93aeffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93b0101310 0x7f93b0196a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:49.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:49.245+0000 7f93aeffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93b0101310 0x7f93b0196a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59870/0 (socket says 172.21.15.44:59870) 2024-08-19T00:04:49.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:49.245+0000 7f93aeffd640 1 -- 172.21.15.44:0/2308703726 learned_addr learned my addr 172.21.15.44:0/2308703726 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:04:49.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:49.245+0000 7f93aeffd640 1 -- 172.21.15.44:0/2308703726 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93b0196fd0 con 0x7f93b0101310 2024-08-19T00:04:49.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:49.246+0000 7f93aeffd640 1 --2- 172.21.15.44:0/2308703726 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93b0101310 0x7f93b0196a90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f93a0004f60 tx=0x7f93a00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:49.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:49.246+0000 7f93acff9640 1 -- 172.21.15.44:0/2308703726 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93a003f070 con 0x7f93b0101310 2024-08-19T00:04:49.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:49.246+0000 7f93b57c8640 1 -- 172.21.15.44:0/2308703726 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93b0197260 con 0x7f93b0101310 2024-08-19T00:04:49.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:49.246+0000 7f93acff9640 1 -- 172.21.15.44:0/2308703726 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93a0004d40 con 0x7f93b0101310 2024-08-19T00:04:49.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:49.246+0000 7f93acff9640 1 -- 172.21.15.44:0/2308703726 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93a0035030 con 0x7f93b0101310 2024-08-19T00:04:49.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:49.246+0000 7f93b57c8640 1 -- 172.21.15.44:0/2308703726 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93b0199f50 con 0x7f93b0101310 2024-08-19T00:04:49.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:49.247+0000 7f93acff9640 1 -- 172.21.15.44:0/2308703726 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f93a0042070 con 0x7f93b0101310 2024-08-19T00:04:49.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:49.247+0000 7f93b57c8640 1 -- 172.21.15.44:0/2308703726 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93b0197740 con 0x7f93b0101310 2024-08-19T00:04:49.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:49.247+0000 7f93acff9640 1 --2- 172.21.15.44:0/2308703726 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f939c0390c0 0x7f939c03b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:49.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:49.247+0000 7f93acff9640 1 -- 172.21.15.44:0/2308703726 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f93a006dd60 con 0x7f93b0101310 2024-08-19T00:04:49.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:49.247+0000 7f93a7fff640 1 --2- 172.21.15.44:0/2308703726 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f939c0390c0 0x7f939c03b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:49.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:49.248+0000 7f93a7fff640 1 --2- 172.21.15.44:0/2308703726 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f939c0390c0 0x7f939c03b580 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f93980098c0 tx=0x7f9398006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:49.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:49.252+0000 7f93acff9640 1 -- 172.21.15.44:0/2308703726 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f93b0197740 con 0x7f93b0101310 2024-08-19T00:04:49.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:49.446+0000 7f93b57c8640 1 -- 172.21.15.44:0/2308703726 --> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f93b002d650 con 0x7f939c0390c0 2024-08-19T00:04:49.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:49.449+0000 7f93acff9640 1 -- 172.21.15.44:0/2308703726 <== mgr.14150 v2:172.21.15.44:6800/1330072146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f93b002d650 con 0x7f939c0390c0 2024-08-19T00:04:49.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:49.452+0000 7f93b57c8640 1 -- 172.21.15.44:0/2308703726 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f939c0390c0 msgr2=0x7f939c03b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:49.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:49.452+0000 7f93b57c8640 1 --2- 172.21.15.44:0/2308703726 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f939c0390c0 0x7f939c03b580 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f93980098c0 tx=0x7f9398006db0 comp rx=0 tx=0).stop 2024-08-19T00:04:49.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:49.452+0000 7f93b57c8640 1 -- 172.21.15.44:0/2308703726 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93b0101310 msgr2=0x7f93b0196a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:49.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:49.452+0000 7f93b57c8640 1 --2- 172.21.15.44:0/2308703726 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93b0101310 0x7f93b0196a90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f93a0004f60 tx=0x7f93a00048f0 comp rx=0 tx=0).stop 2024-08-19T00:04:49.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:49.452+0000 7f93b57c8640 1 -- 172.21.15.44:0/2308703726 shutdown_connections 2024-08-19T00:04:49.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:49.452+0000 7f93b57c8640 1 --2- 172.21.15.44:0/2308703726 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f939c0390c0 0x7f939c03b580 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:49.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:49.452+0000 7f93b57c8640 1 --2- 172.21.15.44:0/2308703726 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93b0101310 0x7f93b0196a90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:49.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:49.452+0000 7f93b57c8640 1 -- 172.21.15.44:0/2308703726 >> 172.21.15.44:0/2308703726 conn(0x7f93b00fcaa0 msgr2=0x7f93b00fd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:04:49.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:49.452+0000 7f93b57c8640 1 -- 172.21.15.44:0/2308703726 shutdown_connections 2024-08-19T00:04:49.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:49.452+0000 7f93b57c8640 1 -- 172.21.15.44:0/2308703726 wait complete. 2024-08-19T00:04:50.170 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi116 2024-08-19T00:04:50.170 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-08-19T00:04:50.171 DEBUG:teuthology.orchestra.run.smithi116:> dd of=/etc/ceph/ceph.conf 2024-08-19T00:04:50.190 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-08-19T00:04:50.190 DEBUG:teuthology.orchestra.run.smithi116:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-19T00:04:50.247 INFO:tasks.cephadm:Adding host smithi116 to orchestrator... 2024-08-19T00:04:50.248 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph orch host add smithi116 2024-08-19T00:04:50.607 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:04:50.727 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:50 smithi044 ceph-mon[18489]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:04:50.727 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:50 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:04:50.727 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:50 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:04:50.727 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:50 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:04:50.727 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:50 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:04:50.727 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:50 smithi044 ceph-mon[18489]: Updating smithi044:/etc/ceph/ceph.conf 2024-08-19T00:04:50.727 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:50 smithi044 ceph-mon[18489]: Updating smithi044:/var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-19T00:04:50.727 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:50 smithi044 ceph-mon[18489]: Updating smithi044:/etc/ceph/ceph.client.admin.keyring 2024-08-19T00:04:50.727 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:50 smithi044 ceph-mon[18489]: Updating smithi044:/var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-19T00:04:50.727 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:50 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:04:50.728 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:50 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:04:50.728 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:50 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:04:51.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:51.002+0000 7ffb6733b640 1 -- 172.21.15.44:0/2343926730 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffb60100400 msgr2=0x7ffb601007e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:51.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:51.002+0000 7ffb6733b640 1 --2- 172.21.15.44:0/2343926730 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffb60100400 0x7ffb601007e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c009810 tx=0x7ffb5c02a540 comp rx=0 tx=0).stop 2024-08-19T00:04:51.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:51.002+0000 7ffb6733b640 1 -- 172.21.15.44:0/2343926730 shutdown_connections 2024-08-19T00:04:51.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:51.002+0000 7ffb6733b640 1 --2- 172.21.15.44:0/2343926730 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffb60100400 0x7ffb601007e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:51.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:51.002+0000 7ffb6733b640 1 -- 172.21.15.44:0/2343926730 >> 172.21.15.44:0/2343926730 conn(0x7ffb60077040 msgr2=0x7ffb600fe370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:04:51.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:51.002+0000 7ffb6733b640 1 -- 172.21.15.44:0/2343926730 shutdown_connections 2024-08-19T00:04:51.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:51.002+0000 7ffb6733b640 1 -- 172.21.15.44:0/2343926730 wait complete. 2024-08-19T00:04:51.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:51.003+0000 7ffb6733b640 1 Processor -- start 2024-08-19T00:04:51.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:51.003+0000 7ffb6733b640 1 -- start start 2024-08-19T00:04:51.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:51.003+0000 7ffb6733b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffb60100400 0x7ffb60101ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:51.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:51.003+0000 7ffb6733b640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ffb6010a850 con 0x7ffb60100400 2024-08-19T00:04:51.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:51.003+0000 7ffb650d7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffb60100400 0x7ffb60101ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:51.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:51.003+0000 7ffb650d7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffb60100400 0x7ffb60101ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59888/0 (socket says 172.21.15.44:59888) 2024-08-19T00:04:51.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:51.003+0000 7ffb650d7640 1 -- 172.21.15.44:0/3198824484 learned_addr learned my addr 172.21.15.44:0/3198824484 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:04:51.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:51.003+0000 7ffb650d7640 1 -- 172.21.15.44:0/3198824484 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb60103d90 con 0x7ffb60100400 2024-08-19T00:04:51.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:51.003+0000 7ffb650d7640 1 --2- 172.21.15.44:0/3198824484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffb60100400 0x7ffb60101ea0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c0045e0 tx=0x7ffb5c004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:51.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:51.004+0000 7ffb567fc640 1 -- 172.21.15.44:0/3198824484 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb5c030e70 con 0x7ffb60100400 2024-08-19T00:04:51.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:51.004+0000 7ffb567fc640 1 -- 172.21.15.44:0/3198824484 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb5c0318e0 con 0x7ffb60100400 2024-08-19T00:04:51.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:51.004+0000 7ffb6733b640 1 -- 172.21.15.44:0/3198824484 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb60102440 con 0x7ffb60100400 2024-08-19T00:04:51.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:51.004+0000 7ffb567fc640 1 -- 172.21.15.44:0/3198824484 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb5c0049c0 con 0x7ffb60100400 2024-08-19T00:04:51.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:51.004+0000 7ffb6733b640 1 -- 172.21.15.44:0/3198824484 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb60102900 con 0x7ffb60100400 2024-08-19T00:04:51.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:51.004+0000 7ffb567fc640 1 -- 172.21.15.44:0/3198824484 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7ffb5c039040 con 0x7ffb60100400 2024-08-19T00:04:51.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:51.005+0000 7ffb567fc640 1 --2- 172.21.15.44:0/3198824484 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7ffb4c0390c0 0x7ffb4c03b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:51.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:51.005+0000 7ffb567fc640 1 -- 172.21.15.44:0/3198824484 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ffb5c06d230 con 0x7ffb60100400 2024-08-19T00:04:51.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:51.005+0000 7ffb648d6640 1 --2- 172.21.15.44:0/3198824484 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7ffb4c0390c0 0x7ffb4c03b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:51.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:51.005+0000 7ffb6733b640 1 -- 172.21.15.44:0/3198824484 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb601018e0 con 0x7ffb60100400 2024-08-19T00:04:51.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:51.005+0000 7ffb648d6640 1 --2- 172.21.15.44:0/3198824484 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7ffb4c0390c0 0x7ffb4c03b580 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ffb500098c0 tx=0x7ffb50006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:51.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:51.010+0000 7ffb567fc640 1 -- 172.21.15.44:0/3198824484 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7ffb5c040030 con 0x7ffb60100400 2024-08-19T00:04:51.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:51.188+0000 7ffb6733b640 1 -- 172.21.15.44:0/3198824484 --> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi116", "target": ["mon-mgr", ""]}) -- 0x7ffb60100860 con 0x7ffb4c0390c0 2024-08-19T00:04:51.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:51 smithi044 ceph-mon[18489]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi116", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:04:52.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:52 smithi044 ceph-mon[18489]: Deploying cephadm binary to smithi116 2024-08-19T00:04:55.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:55.062+0000 7ffb567fc640 1 -- 172.21.15.44:0/3198824484 <== mgr.14150 v2:172.21.15.44:6800/1330072146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7ffb60100860 con 0x7ffb4c0390c0 2024-08-19T00:04:55.064 INFO:teuthology.orchestra.run.smithi044.stdout:Added host 'smithi116' with addr '172.21.15.116' 2024-08-19T00:04:55.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:55.064+0000 7ffb6733b640 1 -- 172.21.15.44:0/3198824484 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7ffb4c0390c0 msgr2=0x7ffb4c03b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:55.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:55.064+0000 7ffb6733b640 1 --2- 172.21.15.44:0/3198824484 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7ffb4c0390c0 0x7ffb4c03b580 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ffb500098c0 tx=0x7ffb50006db0 comp rx=0 tx=0).stop 2024-08-19T00:04:55.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:55.064+0000 7ffb6733b640 1 -- 172.21.15.44:0/3198824484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffb60100400 msgr2=0x7ffb60101ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:55.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:55.064+0000 7ffb6733b640 1 --2- 172.21.15.44:0/3198824484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffb60100400 0x7ffb60101ea0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c0045e0 tx=0x7ffb5c004610 comp rx=0 tx=0).stop 2024-08-19T00:04:55.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:55.064+0000 7ffb6733b640 1 -- 172.21.15.44:0/3198824484 shutdown_connections 2024-08-19T00:04:55.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:55.064+0000 7ffb6733b640 1 --2- 172.21.15.44:0/3198824484 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7ffb4c0390c0 0x7ffb4c03b580 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:55.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:55.064+0000 7ffb6733b640 1 --2- 172.21.15.44:0/3198824484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffb60100400 0x7ffb60101ea0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:55.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:55.064+0000 7ffb6733b640 1 -- 172.21.15.44:0/3198824484 >> 172.21.15.44:0/3198824484 conn(0x7ffb60077040 msgr2=0x7ffb600693e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:04:55.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:55.064+0000 7ffb6733b640 1 -- 172.21.15.44:0/3198824484 shutdown_connections 2024-08-19T00:04:55.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:55.064+0000 7ffb6733b640 1 -- 172.21.15.44:0/3198824484 wait complete. 2024-08-19T00:04:55.613 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph orch host ls --format=json 2024-08-19T00:04:55.864 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:04:56.260 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:56 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:04:56.260 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:56 smithi044 ceph-mon[18489]: Added host smithi116 2024-08-19T00:04:56.260 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:56 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:04:56.260 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:56 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:04:56.260 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:56 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:04:56.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:56.264+0000 7fd180d61640 1 -- 172.21.15.44:0/803466036 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd17c100400 msgr2=0x7fd17c1007e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:56.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:56.264+0000 7fd180d61640 1 --2- 172.21.15.44:0/803466036 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd17c100400 0x7fd17c1007e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd16c009810 tx=0x7fd16c02a540 comp rx=0 tx=0).stop 2024-08-19T00:04:56.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:56.265+0000 7fd180d61640 1 -- 172.21.15.44:0/803466036 shutdown_connections 2024-08-19T00:04:56.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:56.265+0000 7fd180d61640 1 --2- 172.21.15.44:0/803466036 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd17c100400 0x7fd17c1007e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:56.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:56.265+0000 7fd180d61640 1 -- 172.21.15.44:0/803466036 >> 172.21.15.44:0/803466036 conn(0x7fd17c077040 msgr2=0x7fd17c0fe370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:04:56.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:56.265+0000 7fd180d61640 1 -- 172.21.15.44:0/803466036 shutdown_connections 2024-08-19T00:04:56.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:56.265+0000 7fd180d61640 1 -- 172.21.15.44:0/803466036 wait complete. 2024-08-19T00:04:56.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:56.265+0000 7fd180d61640 1 Processor -- start 2024-08-19T00:04:56.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:56.265+0000 7fd180d61640 1 -- start start 2024-08-19T00:04:56.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:56.266+0000 7fd180d61640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd17c100400 0x7fd17c196ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:56.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:56.266+0000 7fd180d61640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd17c10a850 con 0x7fd17c100400 2024-08-19T00:04:56.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:56.266+0000 7fd17a59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd17c100400 0x7fd17c196ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:56.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:56.266+0000 7fd17a59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd17c100400 0x7fd17c196ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59906/0 (socket says 172.21.15.44:59906) 2024-08-19T00:04:56.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:56.266+0000 7fd17a59c640 1 -- 172.21.15.44:0/3062465569 learned_addr learned my addr 172.21.15.44:0/3062465569 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:04:56.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:56.266+0000 7fd17a59c640 1 -- 172.21.15.44:0/3062465569 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd17c1973e0 con 0x7fd17c100400 2024-08-19T00:04:56.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:56.266+0000 7fd17a59c640 1 --2- 172.21.15.44:0/3062465569 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd17c100400 0x7fd17c196ea0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd16c0045e0 tx=0x7fd16c004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:56.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:56.266+0000 7fd16b7fe640 1 -- 172.21.15.44:0/3062465569 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd16c030e70 con 0x7fd17c100400 2024-08-19T00:04:56.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:56.266+0000 7fd16b7fe640 1 -- 172.21.15.44:0/3062465569 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd16c0318e0 con 0x7fd17c100400 2024-08-19T00:04:56.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:56.266+0000 7fd180d61640 1 -- 172.21.15.44:0/3062465569 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd17c1976d0 con 0x7fd17c100400 2024-08-19T00:04:56.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:56.266+0000 7fd16b7fe640 1 -- 172.21.15.44:0/3062465569 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd16c0049c0 con 0x7fd17c100400 2024-08-19T00:04:56.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:56.266+0000 7fd180d61640 1 -- 172.21.15.44:0/3062465569 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd17c19b770 con 0x7fd17c100400 2024-08-19T00:04:56.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:56.267+0000 7fd16b7fe640 1 -- 172.21.15.44:0/3062465569 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fd16c039040 con 0x7fd17c100400 2024-08-19T00:04:56.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:56.268+0000 7fd180d61640 1 -- 172.21.15.44:0/3062465569 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd17c1018e0 con 0x7fd17c100400 2024-08-19T00:04:56.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:56.268+0000 7fd16b7fe640 1 --2- 172.21.15.44:0/3062465569 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fd164039060 0x7fd16403b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:56.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:56.268+0000 7fd16b7fe640 1 -- 172.21.15.44:0/3062465569 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fd16c06d430 con 0x7fd17c100400 2024-08-19T00:04:56.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:56.268+0000 7fd179d9b640 1 --2- 172.21.15.44:0/3062465569 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fd164039060 0x7fd16403b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:56.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:56.268+0000 7fd179d9b640 1 --2- 172.21.15.44:0/3062465569 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fd164039060 0x7fd16403b520 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd1700098c0 tx=0x7fd170006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:56.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:56.273+0000 7fd16b7fe640 1 -- 172.21.15.44:0/3062465569 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fd16c040030 con 0x7fd17c100400 2024-08-19T00:04:56.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:56.454+0000 7fd180d61640 1 -- 172.21.15.44:0/3062465569 --> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd17c198200 con 0x7fd164039060 2024-08-19T00:04:56.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:56.455+0000 7fd16b7fe640 1 -- 172.21.15.44:0/3062465569 <== mgr.14150 v2:172.21.15.44:6800/1330072146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+160 (secure 0 0 0) 0x7fd17c198200 con 0x7fd164039060 2024-08-19T00:04:56.459 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:04:56.459 INFO:teuthology.orchestra.run.smithi044.stdout:[{"addr": "172.21.15.44", "hostname": "smithi044", "labels": [], "status": ""}, {"addr": "172.21.15.116", "hostname": "smithi116", "labels": [], "status": ""}] 2024-08-19T00:04:56.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:56.457+0000 7fd180d61640 1 -- 172.21.15.44:0/3062465569 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fd164039060 msgr2=0x7fd16403b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:56.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:56.457+0000 7fd180d61640 1 --2- 172.21.15.44:0/3062465569 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fd164039060 0x7fd16403b520 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd1700098c0 tx=0x7fd170006db0 comp rx=0 tx=0).stop 2024-08-19T00:04:56.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:56.457+0000 7fd180d61640 1 -- 172.21.15.44:0/3062465569 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd17c100400 msgr2=0x7fd17c196ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:56.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:56.457+0000 7fd180d61640 1 --2- 172.21.15.44:0/3062465569 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd17c100400 0x7fd17c196ea0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd16c0045e0 tx=0x7fd16c004610 comp rx=0 tx=0).stop 2024-08-19T00:04:56.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:56.457+0000 7fd180d61640 1 -- 172.21.15.44:0/3062465569 shutdown_connections 2024-08-19T00:04:56.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:56.457+0000 7fd180d61640 1 --2- 172.21.15.44:0/3062465569 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fd164039060 0x7fd16403b520 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:56.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:56.457+0000 7fd180d61640 1 --2- 172.21.15.44:0/3062465569 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd17c100400 0x7fd17c196ea0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:56.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:56.457+0000 7fd180d61640 1 -- 172.21.15.44:0/3062465569 >> 172.21.15.44:0/3062465569 conn(0x7fd17c077040 msgr2=0x7fd17c0693e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:04:56.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:56.457+0000 7fd180d61640 1 -- 172.21.15.44:0/3062465569 shutdown_connections 2024-08-19T00:04:56.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:56.457+0000 7fd180d61640 1 -- 172.21.15.44:0/3062465569 wait complete. 2024-08-19T00:04:57.018 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi171 2024-08-19T00:04:57.018 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-08-19T00:04:57.018 DEBUG:teuthology.orchestra.run.smithi171:> dd of=/etc/ceph/ceph.conf 2024-08-19T00:04:57.039 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-08-19T00:04:57.039 DEBUG:teuthology.orchestra.run.smithi171:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-19T00:04:57.097 INFO:tasks.cephadm:Adding host smithi171 to orchestrator... 2024-08-19T00:04:57.098 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph orch host add smithi171 2024-08-19T00:04:57.357 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:04:57.691 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:57 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:04:57.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:57.706+0000 7fbb66eaf640 1 -- 172.21.15.44:0/1251102591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb60100400 msgr2=0x7fbb601007e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:04:57.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:57.706+0000 7fbb66eaf640 1 --2- 172.21.15.44:0/1251102591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb60100400 0x7fbb601007e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbb54009810 tx=0x7fbb5402a540 comp rx=0 tx=0).stop 2024-08-19T00:04:57.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:57.706+0000 7fbb66eaf640 1 -- 172.21.15.44:0/1251102591 shutdown_connections 2024-08-19T00:04:57.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:57.706+0000 7fbb66eaf640 1 --2- 172.21.15.44:0/1251102591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb60100400 0x7fbb601007e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:04:57.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:57.706+0000 7fbb66eaf640 1 -- 172.21.15.44:0/1251102591 >> 172.21.15.44:0/1251102591 conn(0x7fbb60077040 msgr2=0x7fbb600fe370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:04:57.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:57.706+0000 7fbb66eaf640 1 -- 172.21.15.44:0/1251102591 shutdown_connections 2024-08-19T00:04:57.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:57.706+0000 7fbb66eaf640 1 -- 172.21.15.44:0/1251102591 wait complete. 2024-08-19T00:04:57.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:57.706+0000 7fbb66eaf640 1 Processor -- start 2024-08-19T00:04:57.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:57.707+0000 7fbb66eaf640 1 -- start start 2024-08-19T00:04:57.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:57.707+0000 7fbb66eaf640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb60100400 0x7fbb60195da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:57.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:57.707+0000 7fbb66eaf640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbb6010a850 con 0x7fbb60100400 2024-08-19T00:04:57.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:57.707+0000 7fbb64c4b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb60100400 0x7fbb60195da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:57.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:57.707+0000 7fbb64c4b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb60100400 0x7fbb60195da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59930/0 (socket says 172.21.15.44:59930) 2024-08-19T00:04:57.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:57.707+0000 7fbb64c4b640 1 -- 172.21.15.44:0/80565103 learned_addr learned my addr 172.21.15.44:0/80565103 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:04:57.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:57.707+0000 7fbb64c4b640 1 -- 172.21.15.44:0/80565103 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb601962e0 con 0x7fbb60100400 2024-08-19T00:04:57.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:57.707+0000 7fbb64c4b640 1 --2- 172.21.15.44:0/80565103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb60100400 0x7fbb60195da0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbb540045e0 tx=0x7fbb54004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:57.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:57.708+0000 7fbb5dffb640 1 -- 172.21.15.44:0/80565103 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb54030e70 con 0x7fbb60100400 2024-08-19T00:04:57.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:57.708+0000 7fbb5dffb640 1 -- 172.21.15.44:0/80565103 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb540318e0 con 0x7fbb60100400 2024-08-19T00:04:57.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:57.708+0000 7fbb66eaf640 1 -- 172.21.15.44:0/80565103 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb601965d0 con 0x7fbb60100400 2024-08-19T00:04:57.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:57.708+0000 7fbb5dffb640 1 -- 172.21.15.44:0/80565103 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb540049c0 con 0x7fbb60100400 2024-08-19T00:04:57.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:57.708+0000 7fbb66eaf640 1 -- 172.21.15.44:0/80565103 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb6019a670 con 0x7fbb60100400 2024-08-19T00:04:57.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:57.709+0000 7fbb5dffb640 1 -- 172.21.15.44:0/80565103 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fbb54039040 con 0x7fbb60100400 2024-08-19T00:04:57.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:57.709+0000 7fbb66eaf640 1 -- 172.21.15.44:0/80565103 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb601018e0 con 0x7fbb60100400 2024-08-19T00:04:57.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:57.709+0000 7fbb5dffb640 1 --2- 172.21.15.44:0/80565103 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fbb50039060 0x7fbb5003b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:04:57.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:57.709+0000 7fbb5dffb640 1 -- 172.21.15.44:0/80565103 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fbb5406d3a0 con 0x7fbb60100400 2024-08-19T00:04:57.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:57.709+0000 7fbb5ffff640 1 --2- 172.21.15.44:0/80565103 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fbb50039060 0x7fbb5003b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:04:57.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:57.709+0000 7fbb5ffff640 1 --2- 172.21.15.44:0/80565103 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fbb50039060 0x7fbb5003b520 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c0098c0 tx=0x7fbb4c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:04:57.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:57.714+0000 7fbb5dffb640 1 -- 172.21.15.44:0/80565103 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fbb54040030 con 0x7fbb60100400 2024-08-19T00:04:57.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:04:57.893+0000 7fbb66eaf640 1 -- 172.21.15.44:0/80565103 --> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi171", "target": ["mon-mgr", ""]}) -- 0x7fbb60197100 con 0x7fbb50039060 2024-08-19T00:04:58.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:58 smithi044 ceph-mon[18489]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-19T00:04:59.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:59 smithi044 ceph-mon[18489]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi171", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:04:59.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:59 smithi044 ceph-mon[18489]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:04:59.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:59 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:04:59.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:59 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:04:59.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:59 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:04:59.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:59 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:04:59.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:59 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi116", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:04:59.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:59 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:04:59.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:04:59 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:05:00.877 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:00 smithi044 ceph-mon[18489]: Deploying cephadm binary to smithi171 2024-08-19T00:05:00.878 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:00 smithi044 ceph-mon[18489]: Updating smithi116:/etc/ceph/ceph.conf 2024-08-19T00:05:00.878 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:00 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:00.878 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:00 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:00.878 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:00 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:01.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:01.820+0000 7fbb5dffb640 1 -- 172.21.15.44:0/80565103 <== mgr.14150 v2:172.21.15.44:6800/1330072146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fbb60197100 con 0x7fbb50039060 2024-08-19T00:05:01.822 INFO:teuthology.orchestra.run.smithi044.stdout:Added host 'smithi171' with addr '172.21.15.171' 2024-08-19T00:05:01.822 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:01 smithi044 ceph-mon[18489]: Updating smithi116:/var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-19T00:05:01.823 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:01 smithi044 ceph-mon[18489]: Updating smithi116:/etc/ceph/ceph.client.admin.keyring 2024-08-19T00:05:01.823 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:01 smithi044 ceph-mon[18489]: Updating smithi116:/var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-19T00:05:01.823 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:01 smithi044 ceph-mon[18489]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:01.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:01.823+0000 7fbb66eaf640 1 -- 172.21.15.44:0/80565103 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fbb50039060 msgr2=0x7fbb5003b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:05:01.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:01.823+0000 7fbb66eaf640 1 --2- 172.21.15.44:0/80565103 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fbb50039060 0x7fbb5003b520 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c0098c0 tx=0x7fbb4c006db0 comp rx=0 tx=0).stop 2024-08-19T00:05:01.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:01.823+0000 7fbb66eaf640 1 -- 172.21.15.44:0/80565103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb60100400 msgr2=0x7fbb60195da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:05:01.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:01.823+0000 7fbb66eaf640 1 --2- 172.21.15.44:0/80565103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb60100400 0x7fbb60195da0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbb540045e0 tx=0x7fbb54004610 comp rx=0 tx=0).stop 2024-08-19T00:05:01.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:01.823+0000 7fbb66eaf640 1 -- 172.21.15.44:0/80565103 shutdown_connections 2024-08-19T00:05:01.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:01.823+0000 7fbb66eaf640 1 --2- 172.21.15.44:0/80565103 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fbb50039060 0x7fbb5003b520 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:05:01.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:01.823+0000 7fbb66eaf640 1 --2- 172.21.15.44:0/80565103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb60100400 0x7fbb60195da0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:05:01.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:01.823+0000 7fbb66eaf640 1 -- 172.21.15.44:0/80565103 >> 172.21.15.44:0/80565103 conn(0x7fbb60077040 msgr2=0x7fbb60102250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:05:01.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:01.823+0000 7fbb66eaf640 1 -- 172.21.15.44:0/80565103 shutdown_connections 2024-08-19T00:05:01.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:01.823+0000 7fbb66eaf640 1 -- 172.21.15.44:0/80565103 wait complete. 2024-08-19T00:05:02.343 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph orch host ls --format=json 2024-08-19T00:05:02.598 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:05:03.030 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:02 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:03.030 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:02 smithi044 ceph-mon[18489]: Added host smithi171 2024-08-19T00:05:03.030 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:02 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:05:03.030 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:02 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:03.030 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:02 smithi044 ceph-mon[18489]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:03.030 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:02 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:03.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:03.028+0000 7f026fc0f640 1 -- 172.21.15.44:0/291318674 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0268101520 msgr2=0x7f0268101900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:05:03.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:03.028+0000 7f026fc0f640 1 --2- 172.21.15.44:0/291318674 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0268101520 0x7f0268101900 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0258009c20 tx=0x7f025802aa90 comp rx=0 tx=0).stop 2024-08-19T00:05:03.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:03.028+0000 7f026fc0f640 1 -- 172.21.15.44:0/291318674 shutdown_connections 2024-08-19T00:05:03.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:03.028+0000 7f026fc0f640 1 --2- 172.21.15.44:0/291318674 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0268101520 0x7f0268101900 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:05:03.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:03.028+0000 7f026fc0f640 1 -- 172.21.15.44:0/291318674 >> 172.21.15.44:0/291318674 conn(0x7f02680fcfc0 msgr2=0x7f02680ff3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:05:03.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:03.028+0000 7f026fc0f640 1 -- 172.21.15.44:0/291318674 shutdown_connections 2024-08-19T00:05:03.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:03.028+0000 7f026fc0f640 1 -- 172.21.15.44:0/291318674 wait complete. 2024-08-19T00:05:03.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:03.029+0000 7f026fc0f640 1 Processor -- start 2024-08-19T00:05:03.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:03.029+0000 7f026fc0f640 1 -- start start 2024-08-19T00:05:03.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:03.029+0000 7f026fc0f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0268101520 0x7f0268196ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:05:03.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:03.029+0000 7f026fc0f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f026810b970 con 0x7f0268101520 2024-08-19T00:05:03.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:03.029+0000 7f026d9ab640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0268101520 0x7f0268196ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:05:03.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:03.029+0000 7f026d9ab640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0268101520 0x7f0268196ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45680/0 (socket says 172.21.15.44:45680) 2024-08-19T00:05:03.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:03.029+0000 7f026d9ab640 1 -- 172.21.15.44:0/2055040719 learned_addr learned my addr 172.21.15.44:0/2055040719 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:05:03.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:03.030+0000 7f026d9ab640 1 -- 172.21.15.44:0/2055040719 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02681973e0 con 0x7f0268101520 2024-08-19T00:05:03.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:03.030+0000 7f026d9ab640 1 --2- 172.21.15.44:0/2055040719 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0268101520 0x7f0268196ea0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0258005e30 tx=0x7f025802fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:05:03.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:03.030+0000 7f0266ffd640 1 -- 172.21.15.44:0/2055040719 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0258047070 con 0x7f0268101520 2024-08-19T00:05:03.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:03.030+0000 7f0266ffd640 1 -- 172.21.15.44:0/2055040719 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0258003df0 con 0x7f0268101520 2024-08-19T00:05:03.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:03.030+0000 7f026fc0f640 1 -- 172.21.15.44:0/2055040719 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02681976d0 con 0x7f0268101520 2024-08-19T00:05:03.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:03.030+0000 7f0266ffd640 1 -- 172.21.15.44:0/2055040719 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0258033050 con 0x7f0268101520 2024-08-19T00:05:03.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:03.030+0000 7f026fc0f640 1 -- 172.21.15.44:0/2055040719 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f026819b770 con 0x7f0268101520 2024-08-19T00:05:03.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:03.031+0000 7f0266ffd640 1 -- 172.21.15.44:0/2055040719 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f025804a070 con 0x7f0268101520 2024-08-19T00:05:03.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:03.031+0000 7f0266ffd640 1 --2- 172.21.15.44:0/2055040719 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f02500390c0 0x7f025003b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:05:03.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:03.031+0000 7f0266ffd640 1 -- 172.21.15.44:0/2055040719 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f025803e030 con 0x7f0268101520 2024-08-19T00:05:03.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:03.031+0000 7f026d1aa640 1 --2- 172.21.15.44:0/2055040719 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f02500390c0 0x7f025003b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:05:03.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:03.031+0000 7f026fc0f640 1 -- 172.21.15.44:0/2055040719 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0268102a00 con 0x7f0268101520 2024-08-19T00:05:03.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:03.031+0000 7f026d1aa640 1 --2- 172.21.15.44:0/2055040719 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f02500390c0 0x7f025003b580 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f025c0098c0 tx=0x7f025c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:05:03.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:03.036+0000 7f0266ffd640 1 -- 172.21.15.44:0/2055040719 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f0258051080 con 0x7f0268101520 2024-08-19T00:05:03.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:03.219+0000 7f026fc0f640 1 -- 172.21.15.44:0/2055040719 --> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0268198200 con 0x7f02500390c0 2024-08-19T00:05:03.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:03.220+0000 7f0266ffd640 1 -- 172.21.15.44:0/2055040719 <== mgr.14150 v2:172.21.15.44:6800/1330072146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+240 (secure 0 0 0) 0x7f0268198200 con 0x7f02500390c0 2024-08-19T00:05:03.222 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:05:03.222 INFO:teuthology.orchestra.run.smithi044.stdout:[{"addr": "172.21.15.44", "hostname": "smithi044", "labels": [], "status": ""}, {"addr": "172.21.15.116", "hostname": "smithi116", "labels": [], "status": ""}, {"addr": "172.21.15.171", "hostname": "smithi171", "labels": [], "status": ""}] 2024-08-19T00:05:03.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:03.222+0000 7f026fc0f640 1 -- 172.21.15.44:0/2055040719 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f02500390c0 msgr2=0x7f025003b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:05:03.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:03.222+0000 7f026fc0f640 1 --2- 172.21.15.44:0/2055040719 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f02500390c0 0x7f025003b580 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f025c0098c0 tx=0x7f025c006db0 comp rx=0 tx=0).stop 2024-08-19T00:05:03.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:03.222+0000 7f026fc0f640 1 -- 172.21.15.44:0/2055040719 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0268101520 msgr2=0x7f0268196ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:05:03.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:03.222+0000 7f026fc0f640 1 --2- 172.21.15.44:0/2055040719 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0268101520 0x7f0268196ea0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0258005e30 tx=0x7f025802fc10 comp rx=0 tx=0).stop 2024-08-19T00:05:03.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:03.222+0000 7f026fc0f640 1 -- 172.21.15.44:0/2055040719 shutdown_connections 2024-08-19T00:05:03.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:03.222+0000 7f026fc0f640 1 --2- 172.21.15.44:0/2055040719 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f02500390c0 0x7f025003b580 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:05:03.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:03.222+0000 7f026fc0f640 1 --2- 172.21.15.44:0/2055040719 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0268101520 0x7f0268196ea0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:05:03.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:03.222+0000 7f026fc0f640 1 -- 172.21.15.44:0/2055040719 >> 172.21.15.44:0/2055040719 conn(0x7f02680fcfc0 msgr2=0x7f02680fdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:05:03.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:03.222+0000 7f026fc0f640 1 -- 172.21.15.44:0/2055040719 shutdown_connections 2024-08-19T00:05:03.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:03.222+0000 7f026fc0f640 1 -- 172.21.15.44:0/2055040719 wait complete. 2024-08-19T00:05:03.847 INFO:tasks.cephadm:Setting crush tunables to default 2024-08-19T00:05:03.848 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph osd crush tunables default 2024-08-19T00:05:04.098 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:05:04.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:04 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:04.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:04 smithi044 ceph-mon[18489]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-19T00:05:04.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:04.500+0000 7f2a492fc640 1 -- 172.21.15.44:0/1132440698 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a44100420 msgr2=0x7f2a44100800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:05:04.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:04.500+0000 7f2a492fc640 1 --2- 172.21.15.44:0/1132440698 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a44100420 0x7f2a44100800 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2a34009c20 tx=0x7f2a3402aa90 comp rx=0 tx=0).stop 2024-08-19T00:05:04.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:04.500+0000 7f2a492fc640 1 -- 172.21.15.44:0/1132440698 shutdown_connections 2024-08-19T00:05:04.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:04.500+0000 7f2a492fc640 1 --2- 172.21.15.44:0/1132440698 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a44100420 0x7f2a44100800 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:05:04.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:04.500+0000 7f2a492fc640 1 -- 172.21.15.44:0/1132440698 >> 172.21.15.44:0/1132440698 conn(0x7f2a440fbee0 msgr2=0x7f2a440fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:05:04.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:04.500+0000 7f2a492fc640 1 -- 172.21.15.44:0/1132440698 shutdown_connections 2024-08-19T00:05:04.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:04.500+0000 7f2a492fc640 1 -- 172.21.15.44:0/1132440698 wait complete. 2024-08-19T00:05:04.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:04.501+0000 7f2a492fc640 1 Processor -- start 2024-08-19T00:05:04.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:04.501+0000 7f2a492fc640 1 -- start start 2024-08-19T00:05:04.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:04.501+0000 7f2a492fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a44100420 0x7f2a44199080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:05:04.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:04.501+0000 7f2a492fc640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2a4410a870 con 0x7f2a44100420 2024-08-19T00:05:04.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:04.501+0000 7f2a42ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a44100420 0x7f2a44199080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:05:04.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:04.501+0000 7f2a42ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a44100420 0x7f2a44199080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45684/0 (socket says 172.21.15.44:45684) 2024-08-19T00:05:04.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:04.501+0000 7f2a42ffd640 1 -- 172.21.15.44:0/311338943 learned_addr learned my addr 172.21.15.44:0/311338943 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:05:04.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:04.501+0000 7f2a42ffd640 1 -- 172.21.15.44:0/311338943 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a441995c0 con 0x7f2a44100420 2024-08-19T00:05:04.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:04.501+0000 7f2a42ffd640 1 --2- 172.21.15.44:0/311338943 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a44100420 0x7f2a44199080 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2a34005e30 tx=0x7f2a3402fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:05:04.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:04.502+0000 7f2a2bfff640 1 -- 172.21.15.44:0/311338943 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a34047070 con 0x7f2a44100420 2024-08-19T00:05:04.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:04.502+0000 7f2a2bfff640 1 -- 172.21.15.44:0/311338943 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a34003df0 con 0x7f2a44100420 2024-08-19T00:05:04.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:04.502+0000 7f2a492fc640 1 -- 172.21.15.44:0/311338943 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a441998b0 con 0x7f2a44100420 2024-08-19T00:05:04.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:04.502+0000 7f2a2bfff640 1 -- 172.21.15.44:0/311338943 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a34033050 con 0x7f2a44100420 2024-08-19T00:05:04.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:04.502+0000 7f2a492fc640 1 -- 172.21.15.44:0/311338943 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a4419d950 con 0x7f2a44100420 2024-08-19T00:05:04.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:04.503+0000 7f2a2bfff640 1 -- 172.21.15.44:0/311338943 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f2a3404a070 con 0x7f2a44100420 2024-08-19T00:05:04.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:04.503+0000 7f2a492fc640 1 -- 172.21.15.44:0/311338943 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a44101900 con 0x7f2a44100420 2024-08-19T00:05:04.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:04.503+0000 7f2a2bfff640 1 --2- 172.21.15.44:0/311338943 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f2a2c039060 0x7f2a2c03b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:05:04.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:04.503+0000 7f2a2bfff640 1 -- 172.21.15.44:0/311338943 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f2a3403e030 con 0x7f2a44100420 2024-08-19T00:05:04.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:04.503+0000 7f2a427fc640 1 --2- 172.21.15.44:0/311338943 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f2a2c039060 0x7f2a2c03b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:05:04.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:04.504+0000 7f2a427fc640 1 --2- 172.21.15.44:0/311338943 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f2a2c039060 0x7f2a2c03b520 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2a380098c0 tx=0x7f2a38006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:05:04.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:04.508+0000 7f2a2bfff640 1 -- 172.21.15.44:0/311338943 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f2a340373b0 con 0x7f2a44100420 2024-08-19T00:05:04.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:04.689+0000 7f2a492fc640 1 -- 172.21.15.44:0/311338943 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f2a4419a3e0 con 0x7f2a44100420 2024-08-19T00:05:05.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:05.189+0000 7f2a2bfff640 1 -- 172.21.15.44:0/311338943 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f2a340492c0 con 0x7f2a44100420 2024-08-19T00:05:05.190 INFO:teuthology.orchestra.run.smithi044.stderr:adjusted tunables profile to default 2024-08-19T00:05:05.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:05.191+0000 7f2a492fc640 1 -- 172.21.15.44:0/311338943 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f2a2c039060 msgr2=0x7f2a2c03b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:05:05.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:05.191+0000 7f2a492fc640 1 --2- 172.21.15.44:0/311338943 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f2a2c039060 0x7f2a2c03b520 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2a380098c0 tx=0x7f2a38006db0 comp rx=0 tx=0).stop 2024-08-19T00:05:05.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:05.191+0000 7f2a492fc640 1 -- 172.21.15.44:0/311338943 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a44100420 msgr2=0x7f2a44199080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:05:05.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:05.191+0000 7f2a492fc640 1 --2- 172.21.15.44:0/311338943 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a44100420 0x7f2a44199080 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2a34005e30 tx=0x7f2a3402fc10 comp rx=0 tx=0).stop 2024-08-19T00:05:05.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:05.191+0000 7f2a492fc640 1 -- 172.21.15.44:0/311338943 shutdown_connections 2024-08-19T00:05:05.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:05.191+0000 7f2a492fc640 1 --2- 172.21.15.44:0/311338943 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f2a2c039060 0x7f2a2c03b520 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:05:05.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:05.191+0000 7f2a492fc640 1 --2- 172.21.15.44:0/311338943 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a44100420 0x7f2a44199080 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:05:05.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:05.191+0000 7f2a492fc640 1 -- 172.21.15.44:0/311338943 >> 172.21.15.44:0/311338943 conn(0x7f2a440fbee0 msgr2=0x7f2a44107e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:05:05.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:05.192+0000 7f2a492fc640 1 -- 172.21.15.44:0/311338943 shutdown_connections 2024-08-19T00:05:05.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:05.192+0000 7f2a492fc640 1 -- 172.21.15.44:0/311338943 wait complete. 2024-08-19T00:05:05.548 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:05 smithi044 ceph-mon[18489]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:05.548 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:05 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/311338943' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-08-19T00:05:05.842 INFO:tasks.cephadm:Adding mon.a on smithi044 2024-08-19T00:05:05.842 INFO:tasks.cephadm:Adding mon.b on smithi116 2024-08-19T00:05:05.842 INFO:tasks.cephadm:Adding mon.c on smithi171 2024-08-19T00:05:05.842 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph orch apply mon '3;smithi044:172.21.15.44=a;smithi116:172.21.15.116=b;smithi171:172.21.15.171=c' 2024-08-19T00:05:06.089 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-19T00:05:06.138 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-19T00:05:06.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:06 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/311338943' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-08-19T00:05:06.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:06 smithi044 ceph-mon[18489]: osdmap e4: 0 total, 0 up, 0 in 2024-08-19T00:05:06.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:06 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:06.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:06 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:06.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:06 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:06.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:06 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:06.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:06 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi171", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:05:06.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:06 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:05:06.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:06 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:05:06.631 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:06.589+0000 7f5685fef640 1 -- 172.21.15.171:0/1637421848 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56800ff630 msgr2=0x7f56800ffa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:05:06.631 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:06.589+0000 7f5685fef640 1 --2- 172.21.15.171:0/1637421848 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56800ff630 0x7f56800ffa30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5670009880 tx=0x7f567002a5d0 comp rx=0 tx=0).stop 2024-08-19T00:05:06.631 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:06.590+0000 7f5685fef640 1 -- 172.21.15.171:0/1637421848 shutdown_connections 2024-08-19T00:05:06.631 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:06.590+0000 7f5685fef640 1 --2- 172.21.15.171:0/1637421848 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56800ff630 0x7f56800ffa30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:05:06.631 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:06.590+0000 7f5685fef640 1 -- 172.21.15.171:0/1637421848 >> 172.21.15.171:0/1637421848 conn(0x7f56800fb180 msgr2=0x7f56800fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:05:06.631 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:06.590+0000 7f5685fef640 1 -- 172.21.15.171:0/1637421848 shutdown_connections 2024-08-19T00:05:06.632 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:06.590+0000 7f5685fef640 1 -- 172.21.15.171:0/1637421848 wait complete. 2024-08-19T00:05:06.632 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:06.590+0000 7f5685fef640 1 Processor -- start 2024-08-19T00:05:06.632 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:06.590+0000 7f5685fef640 1 -- start start 2024-08-19T00:05:06.632 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:06.591+0000 7f5685fef640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56800ff630 0x7f5680101e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:05:06.632 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:06.591+0000 7f5685fef640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5680107410 con 0x7f56800ff630 2024-08-19T00:05:06.632 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:06.591+0000 7f567f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56800ff630 0x7f5680101e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:05:06.632 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:06.591+0000 7f567f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56800ff630 0x7f5680101e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.171:59198/0 (socket says 172.21.15.171:59198) 2024-08-19T00:05:06.632 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:06.591+0000 7f567f7fe640 1 -- 172.21.15.171:0/3255619750 learned_addr learned my addr 172.21.15.171:0/3255619750 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-08-19T00:05:06.632 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:06.591+0000 7f567f7fe640 1 -- 172.21.15.171:0/3255619750 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56801023d0 con 0x7f56800ff630 2024-08-19T00:05:06.632 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:06.591+0000 7f567f7fe640 1 --2- 172.21.15.171:0/3255619750 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56800ff630 0x7f5680101e90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5670004f60 tx=0x7f56700048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:05:06.632 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:06.591+0000 7f567cff9640 1 -- 172.21.15.171:0/3255619750 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f567003f070 con 0x7f56800ff630 2024-08-19T00:05:06.632 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:06.591+0000 7f567cff9640 1 -- 172.21.15.171:0/3255619750 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5670004d40 con 0x7f56800ff630 2024-08-19T00:05:06.632 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:06.591+0000 7f5685fef640 1 -- 172.21.15.171:0/3255619750 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56801005c0 con 0x7f56800ff630 2024-08-19T00:05:06.633 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:06.592+0000 7f567cff9640 1 -- 172.21.15.171:0/3255619750 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5670035030 con 0x7f56800ff630 2024-08-19T00:05:06.633 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:06.592+0000 7f5685fef640 1 -- 172.21.15.171:0/3255619750 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5680100b00 con 0x7f56800ff630 2024-08-19T00:05:06.633 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:06.592+0000 7f567cff9640 1 -- 172.21.15.171:0/3255619750 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f5670042070 con 0x7f56800ff630 2024-08-19T00:05:06.633 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:06.592+0000 7f5685fef640 1 -- 172.21.15.171:0/3255619750 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5680107b90 con 0x7f56800ff630 2024-08-19T00:05:06.633 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:06.593+0000 7f567cff9640 1 --2- 172.21.15.171:0/3255619750 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f566c039060 0x7f566c03b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:05:06.633 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:06.593+0000 7f567cff9640 1 -- 172.21.15.171:0/3255619750 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f567006cf40 con 0x7f56800ff630 2024-08-19T00:05:06.633 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:06.593+0000 7f567effd640 1 --2- 172.21.15.171:0/3255619750 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f566c039060 0x7f566c03b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:05:06.633 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:06.593+0000 7f567effd640 1 --2- 172.21.15.171:0/3255619750 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f566c039060 0x7f566c03b520 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f56680098c0 tx=0x7f5668006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:05:06.633 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:06.598+0000 7f567cff9640 1 -- 172.21.15.171:0/3255619750 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f5670039350 con 0x7f56800ff630 2024-08-19T00:05:06.789 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:06.787+0000 7f5685fef640 1 -- 172.21.15.171:0/3255619750 --> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi044:172.21.15.44=a;smithi116:172.21.15.116=b;smithi171:172.21.15.171=c", "target": ["mon-mgr", ""]}) -- 0x7f568018ff70 con 0x7f566c039060 2024-08-19T00:05:06.795 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:06.793+0000 7f567cff9640 1 -- 172.21.15.171:0/3255619750 <== mgr.14150 v2:172.21.15.44:6800/1330072146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f568018ff70 con 0x7f566c039060 2024-08-19T00:05:06.795 INFO:teuthology.orchestra.run.smithi171.stdout:Scheduled mon update... 2024-08-19T00:05:06.797 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:06.795+0000 7f5685fef640 1 -- 172.21.15.171:0/3255619750 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f566c039060 msgr2=0x7f566c03b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:05:06.797 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:06.795+0000 7f5685fef640 1 --2- 172.21.15.171:0/3255619750 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f566c039060 0x7f566c03b520 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f56680098c0 tx=0x7f5668006db0 comp rx=0 tx=0).stop 2024-08-19T00:05:06.798 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:06.795+0000 7f5685fef640 1 -- 172.21.15.171:0/3255619750 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56800ff630 msgr2=0x7f5680101e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:05:06.798 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:06.795+0000 7f5685fef640 1 --2- 172.21.15.171:0/3255619750 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56800ff630 0x7f5680101e90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5670004f60 tx=0x7f56700048f0 comp rx=0 tx=0).stop 2024-08-19T00:05:06.798 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:06.795+0000 7f5685fef640 1 -- 172.21.15.171:0/3255619750 shutdown_connections 2024-08-19T00:05:06.798 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:06.795+0000 7f5685fef640 1 --2- 172.21.15.171:0/3255619750 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f566c039060 0x7f566c03b520 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:05:06.798 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:06.795+0000 7f5685fef640 1 --2- 172.21.15.171:0/3255619750 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56800ff630 0x7f5680101e90 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:05:06.798 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:06.795+0000 7f5685fef640 1 -- 172.21.15.171:0/3255619750 >> 172.21.15.171:0/3255619750 conn(0x7f56800fb180 msgr2=0x7f56800fbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:05:06.798 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:06.796+0000 7f5685fef640 1 -- 172.21.15.171:0/3255619750 shutdown_connections 2024-08-19T00:05:06.798 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:06.796+0000 7f5685fef640 1 -- 172.21.15.171:0/3255619750 wait complete. 2024-08-19T00:05:07.450 DEBUG:teuthology.orchestra.run.smithi116:mon.b> sudo journalctl -f -n 0 -u ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mon.b.service 2024-08-19T00:05:07.453 DEBUG:teuthology.orchestra.run.smithi171:mon.c> sudo journalctl -f -n 0 -u ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mon.c.service 2024-08-19T00:05:07.456 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-19T00:05:07.456 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph mon dump -f json 2024-08-19T00:05:07.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:07 smithi044 ceph-mon[18489]: Updating smithi171:/etc/ceph/ceph.conf 2024-08-19T00:05:07.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:07 smithi044 ceph-mon[18489]: Updating smithi171:/var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-19T00:05:07.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:07 smithi044 ceph-mon[18489]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:07.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:07 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:07.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:07 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:07.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:07 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:07.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:07 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:07.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:07 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-19T00:05:07.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:07 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:05:08.187 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-19T00:05:08.606 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:08.602+0000 7f1e5acd4640 1 -- 172.21.15.171:0/3520425460 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e54100400 msgr2=0x7f1e541007e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:05:08.606 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:08.602+0000 7f1e5acd4640 1 --2- 172.21.15.171:0/3520425460 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e54100400 0x7f1e541007e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c009c10 tx=0x7f1e3c02aa10 comp rx=0 tx=0).stop 2024-08-19T00:05:08.607 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:08.602+0000 7f1e5acd4640 1 -- 172.21.15.171:0/3520425460 shutdown_connections 2024-08-19T00:05:08.607 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:08.602+0000 7f1e5acd4640 1 --2- 172.21.15.171:0/3520425460 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e54100400 0x7f1e541007e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:05:08.607 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:08.602+0000 7f1e5acd4640 1 -- 172.21.15.171:0/3520425460 >> 172.21.15.171:0/3520425460 conn(0x7f1e54077040 msgr2=0x7f1e540fe370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:05:08.607 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:08.602+0000 7f1e5acd4640 1 -- 172.21.15.171:0/3520425460 shutdown_connections 2024-08-19T00:05:08.607 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:08.602+0000 7f1e5acd4640 1 -- 172.21.15.171:0/3520425460 wait complete. 2024-08-19T00:05:08.607 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:08.603+0000 7f1e5acd4640 1 Processor -- start 2024-08-19T00:05:08.607 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:08.603+0000 7f1e5acd4640 1 -- start start 2024-08-19T00:05:08.607 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:08.603+0000 7f1e5acd4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e54100400 0x7f1e54196e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:05:08.608 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:08.603+0000 7f1e5acd4640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1e5410a850 con 0x7f1e54100400 2024-08-19T00:05:08.608 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:08.603+0000 7f1e58a70640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e54100400 0x7f1e54196e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:05:08.608 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:08.603+0000 7f1e58a70640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e54100400 0x7f1e54196e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.171:59214/0 (socket says 172.21.15.171:59214) 2024-08-19T00:05:08.608 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:08.603+0000 7f1e58a70640 1 -- 172.21.15.171:0/1931949730 learned_addr learned my addr 172.21.15.171:0/1931949730 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-08-19T00:05:08.608 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:08.604+0000 7f1e58a70640 1 -- 172.21.15.171:0/1931949730 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e541973b0 con 0x7f1e54100400 2024-08-19T00:05:08.608 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:08.604+0000 7f1e58a70640 1 --2- 172.21.15.171:0/1931949730 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e54100400 0x7f1e54196e70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c005dd0 tx=0x7f1e3c030c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:05:08.608 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:08.604+0000 7f1e51ffb640 1 -- 172.21.15.171:0/1931949730 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e3c034070 con 0x7f1e54100400 2024-08-19T00:05:08.609 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:08.604+0000 7f1e5acd4640 1 -- 172.21.15.171:0/1931949730 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e54197640 con 0x7f1e54100400 2024-08-19T00:05:08.609 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:08.604+0000 7f1e51ffb640 1 -- 172.21.15.171:0/1931949730 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e3c02f8c0 con 0x7f1e54100400 2024-08-19T00:05:08.609 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:08.604+0000 7f1e51ffb640 1 -- 172.21.15.171:0/1931949730 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e3c004520 con 0x7f1e54100400 2024-08-19T00:05:08.609 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:08.604+0000 7f1e5acd4640 1 -- 172.21.15.171:0/1931949730 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e54197aa0 con 0x7f1e54100400 2024-08-19T00:05:08.611 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:08.605+0000 7f1e51ffb640 1 -- 172.21.15.171:0/1931949730 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f1e3c037020 con 0x7f1e54100400 2024-08-19T00:05:08.611 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:08.605+0000 7f1e5acd4640 1 -- 172.21.15.171:0/1931949730 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e541018e0 con 0x7f1e54100400 2024-08-19T00:05:08.611 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:08.605+0000 7f1e51ffb640 1 --2- 172.21.15.171:0/1931949730 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f1e40039060 0x7f1e4003b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:05:08.611 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:08.605+0000 7f1e51ffb640 1 -- 172.21.15.171:0/1931949730 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f1e3c06ce80 con 0x7f1e54100400 2024-08-19T00:05:08.611 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:08.606+0000 7f1e53fff640 1 --2- 172.21.15.171:0/1931949730 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f1e40039060 0x7f1e4003b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:05:08.611 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:08.606+0000 7f1e53fff640 1 --2- 172.21.15.171:0/1931949730 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f1e40039060 0x7f1e4003b520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1e440098c0 tx=0x7f1e44006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:05:08.613 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:08.611+0000 7f1e51ffb640 1 -- 172.21.15.171:0/1931949730 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f1e3c03f070 con 0x7f1e54100400 2024-08-19T00:05:08.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:08 smithi044 ceph-mon[18489]: Updating smithi171:/etc/ceph/ceph.client.admin.keyring 2024-08-19T00:05:08.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:08 smithi044 ceph-mon[18489]: Updating smithi171:/var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-19T00:05:08.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:08 smithi044 ceph-mon[18489]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi044:172.21.15.44=a;smithi116:172.21.15.116=b;smithi171:172.21.15.171=c", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:05:08.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:08 smithi044 ceph-mon[18489]: Saving service mon spec with placement smithi044:172.21.15.44=a;smithi116:172.21.15.116=b;smithi171:172.21.15.171=c;count:3 2024-08-19T00:05:08.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:08 smithi044 ceph-mon[18489]: Deploying daemon mon.c on smithi171 2024-08-19T00:05:08.845 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:08.843+0000 7f1e5acd4640 1 -- 172.21.15.171:0/1931949730 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f1e54198230 con 0x7f1e54100400 2024-08-19T00:05:08.845 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:08.843+0000 7f1e51ffb640 1 -- 172.21.15.171:0/1931949730 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7f1e3c02c040 con 0x7f1e54100400 2024-08-19T00:05:08.846 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-19T00:05:08.846 INFO:teuthology.orchestra.run.smithi171.stdout:{"epoch":1,"fsid":"647ded64-5dbe-11ef-bccf-c7b262605968","modified":"2024-08-19T00:03:40.850741Z","created":"2024-08-19T00:03:40.850741Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:3300","nonce":0},{"type":"v1","addr":"172.21.15.44:6789","nonce":0}]},"addr":"172.21.15.44:6789/0","public_addr":"172.21.15.44:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-19T00:05:08.846 INFO:teuthology.orchestra.run.smithi171.stderr:dumped monmap epoch 1 2024-08-19T00:05:08.848 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:08.845+0000 7f1e5acd4640 1 -- 172.21.15.171:0/1931949730 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f1e40039060 msgr2=0x7f1e4003b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:05:08.848 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:08.845+0000 7f1e5acd4640 1 --2- 172.21.15.171:0/1931949730 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f1e40039060 0x7f1e4003b520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1e440098c0 tx=0x7f1e44006db0 comp rx=0 tx=0).stop 2024-08-19T00:05:08.848 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:08.845+0000 7f1e5acd4640 1 -- 172.21.15.171:0/1931949730 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e54100400 msgr2=0x7f1e54196e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:05:08.848 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:08.845+0000 7f1e5acd4640 1 --2- 172.21.15.171:0/1931949730 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e54100400 0x7f1e54196e70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c005dd0 tx=0x7f1e3c030c30 comp rx=0 tx=0).stop 2024-08-19T00:05:08.848 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:08.846+0000 7f1e5acd4640 1 -- 172.21.15.171:0/1931949730 shutdown_connections 2024-08-19T00:05:08.848 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:08.846+0000 7f1e5acd4640 1 --2- 172.21.15.171:0/1931949730 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f1e40039060 0x7f1e4003b520 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:05:08.848 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:08.846+0000 7f1e5acd4640 1 --2- 172.21.15.171:0/1931949730 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e54100400 0x7f1e54196e70 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:05:08.848 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:08.846+0000 7f1e5acd4640 1 -- 172.21.15.171:0/1931949730 >> 172.21.15.171:0/1931949730 conn(0x7f1e54077040 msgr2=0x7f1e540fe8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:05:08.848 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:08.846+0000 7f1e5acd4640 1 -- 172.21.15.171:0/1931949730 shutdown_connections 2024-08-19T00:05:08.848 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:08.846+0000 7f1e5acd4640 1 -- 172.21.15.171:0/1931949730 wait complete. 2024-08-19T00:05:09.520 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:09 smithi044 ceph-mon[18489]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:09.521 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:09 smithi044 ceph-mon[18489]: from='client.? 172.21.15.171:0/1931949730' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-19T00:05:10.537 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-19T00:05:10.537 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph mon dump -f json 2024-08-19T00:05:10.744 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:10 smithi044 ceph-mon[18489]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:10.836 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.c/config 2024-08-19T00:05:11.469 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:11.458+0000 7f797a883640 1 -- 172.21.15.171:0/3124990440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7974100540 msgr2=0x7f7974100920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:05:11.469 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:11.458+0000 7f797a883640 1 --2- 172.21.15.171:0/3124990440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7974100540 0x7f7974100920 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7964009880 tx=0x7f796402a5d0 comp rx=0 tx=0).stop 2024-08-19T00:05:11.469 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:11.458+0000 7f797a883640 1 -- 172.21.15.171:0/3124990440 shutdown_connections 2024-08-19T00:05:11.469 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:11.458+0000 7f797a883640 1 --2- 172.21.15.171:0/3124990440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7974100540 0x7f7974100920 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:05:11.470 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:11.458+0000 7f797a883640 1 -- 172.21.15.171:0/3124990440 >> 172.21.15.171:0/3124990440 conn(0x7f79740fbfc0 msgr2=0x7f79740fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:05:11.470 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:11.458+0000 7f797a883640 1 -- 172.21.15.171:0/3124990440 shutdown_connections 2024-08-19T00:05:11.470 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:11.458+0000 7f797a883640 1 -- 172.21.15.171:0/3124990440 wait complete. 2024-08-19T00:05:11.470 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:11.459+0000 7f797a883640 1 Processor -- start 2024-08-19T00:05:11.470 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:11.459+0000 7f797a883640 1 -- start start 2024-08-19T00:05:11.470 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:11.459+0000 7f797a883640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79741971c0 0x7f79741975a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:05:11.470 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:11.459+0000 7f797a883640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f797410a990 con 0x7f79741971c0 2024-08-19T00:05:11.470 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:11.460+0000 7f7973fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79741971c0 0x7f79741975a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:05:11.470 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:11.460+0000 7f7973fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79741971c0 0x7f79741975a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.171:59232/0 (socket says 172.21.15.171:59232) 2024-08-19T00:05:11.470 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:11.460+0000 7f7973fff640 1 -- 172.21.15.171:0/2636586092 learned_addr learned my addr 172.21.15.171:0/2636586092 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-08-19T00:05:11.470 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:11.460+0000 7f7973fff640 1 -- 172.21.15.171:0/2636586092 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7974197ae0 con 0x7f79741971c0 2024-08-19T00:05:11.470 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:11.460+0000 7f7973fff640 1 --2- 172.21.15.171:0/2636586092 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79741971c0 0x7f79741975a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7964006010 tx=0x7f7964003e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:05:11.471 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:11.460+0000 7f79717fa640 1 -- 172.21.15.171:0/2636586092 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f796403f070 con 0x7f79741971c0 2024-08-19T00:05:11.471 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:11.460+0000 7f797a883640 1 -- 172.21.15.171:0/2636586092 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7974197dd0 con 0x7f79741971c0 2024-08-19T00:05:11.471 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:11.461+0000 7f797a883640 1 -- 172.21.15.171:0/2636586092 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f797419bc60 con 0x7f79741971c0 2024-08-19T00:05:11.471 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:11.461+0000 7f79717fa640 1 -- 172.21.15.171:0/2636586092 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f796403bc80 con 0x7f79741971c0 2024-08-19T00:05:11.471 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:11.461+0000 7f79717fa640 1 -- 172.21.15.171:0/2636586092 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7964049060 con 0x7f79741971c0 2024-08-19T00:05:11.471 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:11.461+0000 7f79717fa640 1 -- 172.21.15.171:0/2636586092 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f7964042070 con 0x7f79741971c0 2024-08-19T00:05:11.471 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:11.462+0000 7f79717fa640 1 --2- 172.21.15.171:0/2636586092 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f795c039060 0x7f795c03b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:05:11.471 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:11.462+0000 7f79717fa640 1 -- 172.21.15.171:0/2636586092 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f796406db20 con 0x7f79741971c0 2024-08-19T00:05:11.471 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:11.462+0000 7f797a883640 1 -- 172.21.15.171:0/2636586092 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7974101a20 con 0x7f79741971c0 2024-08-19T00:05:11.471 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:11.462+0000 7f79737fe640 1 --2- 172.21.15.171:0/2636586092 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f795c039060 0x7f795c03b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:05:11.471 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:11.462+0000 7f79737fe640 1 --2- 172.21.15.171:0/2636586092 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f795c039060 0x7f795c03b520 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f79680098c0 tx=0x7f7968006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:05:11.471 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:11.467+0000 7f79717fa640 1 -- 172.21.15.171:0/2636586092 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f7964039c30 con 0x7f79741971c0 2024-08-19T00:05:11.728 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:11.725+0000 7f797a883640 1 -- 172.21.15.171:0/2636586092 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f7974198520 con 0x7f79741971c0 2024-08-19T00:05:11.728 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:11.726+0000 7f79717fa640 1 -- 172.21.15.171:0/2636586092 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7f7964040260 con 0x7f79741971c0 2024-08-19T00:05:11.728 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-19T00:05:11.728 INFO:teuthology.orchestra.run.smithi171.stdout:{"epoch":1,"fsid":"647ded64-5dbe-11ef-bccf-c7b262605968","modified":"2024-08-19T00:03:40.850741Z","created":"2024-08-19T00:03:40.850741Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:3300","nonce":0},{"type":"v1","addr":"172.21.15.44:6789","nonce":0}]},"addr":"172.21.15.44:6789/0","public_addr":"172.21.15.44:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-19T00:05:11.728 INFO:teuthology.orchestra.run.smithi171.stderr:dumped monmap epoch 1 2024-08-19T00:05:11.730 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:11.728+0000 7f797a883640 1 -- 172.21.15.171:0/2636586092 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f795c039060 msgr2=0x7f795c03b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:05:11.730 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:11.728+0000 7f797a883640 1 --2- 172.21.15.171:0/2636586092 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f795c039060 0x7f795c03b520 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f79680098c0 tx=0x7f7968006db0 comp rx=0 tx=0).stop 2024-08-19T00:05:11.730 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:11.728+0000 7f797a883640 1 -- 172.21.15.171:0/2636586092 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79741971c0 msgr2=0x7f79741975a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:05:11.730 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:11.728+0000 7f797a883640 1 --2- 172.21.15.171:0/2636586092 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79741971c0 0x7f79741975a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7964006010 tx=0x7f7964003e10 comp rx=0 tx=0).stop 2024-08-19T00:05:11.730 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:11.728+0000 7f797a883640 1 -- 172.21.15.171:0/2636586092 shutdown_connections 2024-08-19T00:05:11.730 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:11.728+0000 7f797a883640 1 --2- 172.21.15.171:0/2636586092 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f795c039060 0x7f795c03b520 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:05:11.730 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:11.728+0000 7f797a883640 1 --2- 172.21.15.171:0/2636586092 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79741971c0 0x7f79741975a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:05:11.730 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:11.728+0000 7f797a883640 1 -- 172.21.15.171:0/2636586092 >> 172.21.15.171:0/2636586092 conn(0x7f79740fbfc0 msgr2=0x7f7974108080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:05:11.730 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:11.728+0000 7f797a883640 1 -- 172.21.15.171:0/2636586092 shutdown_connections 2024-08-19T00:05:11.730 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:11.728+0000 7f797a883640 1 -- 172.21.15.171:0/2636586092 wait complete. 2024-08-19T00:05:12.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:11 smithi044 ceph-mon[18489]: from='client.? 172.21.15.171:0/2636586092' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-19T00:05:12.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:12 smithi171 systemd[1]: Started Ceph mon.c for 647ded64-5dbe-11ef-bccf-c7b262605968. 2024-08-19T00:05:13.379 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-19T00:05:13.380 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph mon dump -f json 2024-08-19T00:05:13.625 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.c/config 2024-08-19T00:05:17.630 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:17.625+0000 7f05858c9640 1 -- 172.21.15.171:0/161738059 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0568003530 msgr2=0x7f05680059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:05:17.631 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:17.625+0000 7f05858c9640 1 --2- 172.21.15.171:0/161738059 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0568003530 0x7f05680059c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f058006a790 tx=0x7f057802c3f0 comp rx=0 tx=0).stop 2024-08-19T00:05:17.631 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:17.625+0000 7f05858c9640 1 -- 172.21.15.171:0/161738059 shutdown_connections 2024-08-19T00:05:17.631 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:17.625+0000 7f05858c9640 1 --2- 172.21.15.171:0/161738059 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0568003530 0x7f05680059c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:05:17.631 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:17.625+0000 7f05858c9640 1 -- 172.21.15.171:0/161738059 >> 172.21.15.171:0/161738059 conn(0x7f05800fbf50 msgr2=0x7f05800fe370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:05:17.631 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:17.626+0000 7f05858c9640 1 -- 172.21.15.171:0/161738059 shutdown_connections 2024-08-19T00:05:17.631 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:17.626+0000 7f05858c9640 1 -- 172.21.15.171:0/161738059 wait complete. 2024-08-19T00:05:17.631 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:17.626+0000 7f05858c9640 1 Processor -- start 2024-08-19T00:05:17.631 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:17.627+0000 7f05858c9640 1 -- start start 2024-08-19T00:05:17.631 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:17.627+0000 7f05858c9640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0568003530 0x7f0580101da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:05:17.631 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:17.627+0000 7f05858c9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f05801001b0 0x7f0580100610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:05:17.631 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:17.627+0000 7f05858c9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f05801094b0 con 0x7f05801001b0 2024-08-19T00:05:17.631 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:17.627+0000 7f05858c9640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0580109330 con 0x7f0568003530 2024-08-19T00:05:17.632 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:17.627+0000 7f057effd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0568003530 0x7f0580101da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:05:17.632 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:17.627+0000 7f057effd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0568003530 0x7f0580101da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:51052/0 (socket says 172.21.15.171:51052) 2024-08-19T00:05:17.632 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:17.627+0000 7f057effd640 1 -- 172.21.15.171:0/1181468329 learned_addr learned my addr 172.21.15.171:0/1181468329 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-08-19T00:05:17.632 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:17.627+0000 7f057e7fc640 1 --2- 172.21.15.171:0/1181468329 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f05801001b0 0x7f0580100610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:05:17.632 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:17.627+0000 7f057effd640 1 -- 172.21.15.171:0/1181468329 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0568003530 msgr2=0x7f0580101da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-08-19T00:05:17.632 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:17.627+0000 7f057effd640 1 -- 172.21.15.171:0/1181468329 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0568003530 msgr2=0x7f0580101da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T00:05:17.632 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:17.627+0000 7f057effd640 1 --2- 172.21.15.171:0/1181468329 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0568003530 0x7f0580101da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T00:05:17.632 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:17.627+0000 7f057effd640 1 --2- 172.21.15.171:0/1181468329 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0568003530 0x7f0580101da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T00:05:17.632 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:17.628+0000 7f057e7fc640 1 -- 172.21.15.171:0/1181468329 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0568003530 msgr2=0x7f0580101da0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T00:05:17.632 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:17.628+0000 7f057e7fc640 1 --2- 172.21.15.171:0/1181468329 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0568003530 0x7f0580101da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:05:17.632 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:17.628+0000 7f057e7fc640 1 -- 172.21.15.171:0/1181468329 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0580100b50 con 0x7f05801001b0 2024-08-19T00:05:17.632 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:17.628+0000 7f057e7fc640 1 --2- 172.21.15.171:0/1181468329 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f05801001b0 0x7f0580100610 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f057400b9e0 tx=0x7f057400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:05:17.632 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:17.628+0000 7f05848c7640 1 -- 172.21.15.171:0/1181468329 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f057400c920 con 0x7f05801001b0 2024-08-19T00:05:17.633 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:17.628+0000 7f05848c7640 1 -- 172.21.15.171:0/1181468329 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0574014440 con 0x7f05801001b0 2024-08-19T00:05:17.633 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:17.628+0000 7f05858c9640 1 -- 172.21.15.171:0/1181468329 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0580100e40 con 0x7f05801001b0 2024-08-19T00:05:17.633 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:17.628+0000 7f05848c7640 1 -- 172.21.15.171:0/1181468329 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f0574012500 con 0x7f05801001b0 2024-08-19T00:05:17.633 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:17.628+0000 7f05858c9640 1 -- 172.21.15.171:0/1181468329 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05801a7bf0 con 0x7f05801001b0 2024-08-19T00:05:17.634 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:17.629+0000 7f05848c7640 1 -- 172.21.15.171:0/1181468329 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f05740126a0 con 0x7f05801001b0 2024-08-19T00:05:17.634 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:17.629+0000 7f05848c7640 1 --2- 172.21.15.171:0/1181468329 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f056c038e50 0x7f056c03b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:05:17.634 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:17.629+0000 7f05848c7640 1 -- 172.21.15.171:0/1181468329 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f057404c960 con 0x7f05801001b0 2024-08-19T00:05:17.634 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:17.629+0000 7f05858c9640 1 -- 172.21.15.171:0/1181468329 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f058006aa40 con 0x7f05801001b0 2024-08-19T00:05:17.634 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:17.630+0000 7f057effd640 1 --2- 172.21.15.171:0/1181468329 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f056c038e50 0x7f056c03b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:05:17.634 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:17.630+0000 7f057effd640 1 --2- 172.21.15.171:0/1181468329 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f056c038e50 0x7f056c03b310 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0578014a90 tx=0x7f0578005f60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:05:17.637 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:17.635+0000 7f05848c7640 1 -- 172.21.15.171:0/1181468329 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f057401a270 con 0x7f05801001b0 2024-08-19T00:05:17.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:17 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-19T00:05:17.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:17 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-19T00:05:17.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:17 smithi044 ceph-mon[18489]: mon.a calling monitor election 2024-08-19T00:05:17.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:17 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-19T00:05:17.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:17 smithi044 ceph-mon[18489]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:17.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:17 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-19T00:05:17.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:17 smithi044 ceph-mon[18489]: mon.c calling monitor election 2024-08-19T00:05:17.871 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:17 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-19T00:05:17.871 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:17 smithi044 ceph-mon[18489]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:17.871 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:17 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-19T00:05:17.871 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:17 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-19T00:05:17.871 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:17 smithi044 ceph-mon[18489]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-08-19T00:05:17.871 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:17 smithi044 ceph-mon[18489]: monmap epoch 2 2024-08-19T00:05:17.871 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:17 smithi044 ceph-mon[18489]: fsid 647ded64-5dbe-11ef-bccf-c7b262605968 2024-08-19T00:05:17.871 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:17 smithi044 ceph-mon[18489]: last_changed 2024-08-19T00:05:12.541266+0000 2024-08-19T00:05:17.871 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:17 smithi044 ceph-mon[18489]: created 2024-08-19T00:03:40.850741+0000 2024-08-19T00:05:17.871 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:17 smithi044 ceph-mon[18489]: min_mon_release 19 (squid) 2024-08-19T00:05:17.871 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:17 smithi044 ceph-mon[18489]: election_strategy: 1 2024-08-19T00:05:17.871 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:17 smithi044 ceph-mon[18489]: 0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-08-19T00:05:17.872 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:17 smithi044 ceph-mon[18489]: 1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.c 2024-08-19T00:05:17.872 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:17 smithi044 ceph-mon[18489]: fsmap 2024-08-19T00:05:17.872 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:17 smithi044 ceph-mon[18489]: osdmap e4: 0 total, 0 up, 0 in 2024-08-19T00:05:17.872 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:17 smithi044 ceph-mon[18489]: mgrmap e13: x(active, since 39s) 2024-08-19T00:05:17.872 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:17 smithi044 ceph-mon[18489]: overall HEALTH_OK 2024-08-19T00:05:17.872 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:17 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:17.872 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:17 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:17.872 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:17 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:17.872 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:17 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-19T00:05:17.872 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:17 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:05:17.873 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:17.870+0000 7f05858c9640 1 -- 172.21.15.171:0/1181468329 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f0580190c20 con 0x7f05801001b0 2024-08-19T00:05:17.873 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:17.871+0000 7f05848c7640 1 -- 172.21.15.171:0/1181468329 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f0574007730 con 0x7f05801001b0 2024-08-19T00:05:17.873 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:17 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-19T00:05:17.873 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:17 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-19T00:05:17.873 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:17 smithi171 ceph-mon[21810]: mon.a calling monitor election 2024-08-19T00:05:17.873 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:17 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-19T00:05:17.874 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:17 smithi171 ceph-mon[21810]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:17.874 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:17 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-19T00:05:17.874 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:17 smithi171 ceph-mon[21810]: mon.c calling monitor election 2024-08-19T00:05:17.874 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:17 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-19T00:05:17.874 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:17 smithi171 ceph-mon[21810]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:17.874 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:17 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-19T00:05:17.874 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:17 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-19T00:05:17.874 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:17 smithi171 ceph-mon[21810]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-08-19T00:05:17.874 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:17 smithi171 ceph-mon[21810]: monmap epoch 2 2024-08-19T00:05:17.874 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:17 smithi171 ceph-mon[21810]: fsid 647ded64-5dbe-11ef-bccf-c7b262605968 2024-08-19T00:05:17.874 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:17 smithi171 ceph-mon[21810]: last_changed 2024-08-19T00:05:12.541266+0000 2024-08-19T00:05:17.874 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:17 smithi171 ceph-mon[21810]: created 2024-08-19T00:03:40.850741+0000 2024-08-19T00:05:17.875 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:17 smithi171 ceph-mon[21810]: min_mon_release 19 (squid) 2024-08-19T00:05:17.875 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:17 smithi171 ceph-mon[21810]: election_strategy: 1 2024-08-19T00:05:17.875 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:17 smithi171 ceph-mon[21810]: 0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-08-19T00:05:17.875 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:17 smithi171 ceph-mon[21810]: 1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.c 2024-08-19T00:05:17.875 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:17 smithi171 ceph-mon[21810]: fsmap 2024-08-19T00:05:17.875 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:17 smithi171 ceph-mon[21810]: osdmap e4: 0 total, 0 up, 0 in 2024-08-19T00:05:17.875 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:17 smithi171 ceph-mon[21810]: mgrmap e13: x(active, since 39s) 2024-08-19T00:05:17.875 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:17 smithi171 ceph-mon[21810]: overall HEALTH_OK 2024-08-19T00:05:17.875 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:17 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:17.875 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:17 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:17.875 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:17 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:17.875 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:17 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-19T00:05:17.875 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:17 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:05:17.876 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-19T00:05:17.876 INFO:teuthology.orchestra.run.smithi171.stdout:{"epoch":2,"fsid":"647ded64-5dbe-11ef-bccf-c7b262605968","modified":"2024-08-19T00:05:12.541266Z","created":"2024-08-19T00:03:40.850741Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:3300","nonce":0},{"type":"v1","addr":"172.21.15.44:6789","nonce":0}]},"addr":"172.21.15.44:6789/0","public_addr":"172.21.15.44:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:3300","nonce":0},{"type":"v1","addr":"172.21.15.171:6789","nonce":0}]},"addr":"172.21.15.171:6789/0","public_addr":"172.21.15.171:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-08-19T00:05:17.877 INFO:teuthology.orchestra.run.smithi171.stderr:dumped monmap epoch 2 2024-08-19T00:05:17.877 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:17.873+0000 7f05858c9640 1 -- 172.21.15.171:0/1181468329 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f056c038e50 msgr2=0x7f056c03b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:05:17.877 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:17.873+0000 7f05858c9640 1 --2- 172.21.15.171:0/1181468329 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f056c038e50 0x7f056c03b310 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0578014a90 tx=0x7f0578005f60 comp rx=0 tx=0).stop 2024-08-19T00:05:17.877 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:17.873+0000 7f05858c9640 1 -- 172.21.15.171:0/1181468329 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f05801001b0 msgr2=0x7f0580100610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:05:17.877 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:17.873+0000 7f05858c9640 1 --2- 172.21.15.171:0/1181468329 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f05801001b0 0x7f0580100610 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f057400b9e0 tx=0x7f057400bea0 comp rx=0 tx=0).stop 2024-08-19T00:05:17.877 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:17.873+0000 7f05858c9640 1 -- 172.21.15.171:0/1181468329 shutdown_connections 2024-08-19T00:05:17.877 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:17.873+0000 7f05858c9640 1 --2- 172.21.15.171:0/1181468329 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f056c038e50 0x7f056c03b310 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:05:17.877 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:17.873+0000 7f05858c9640 1 --2- 172.21.15.171:0/1181468329 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f05801001b0 0x7f0580100610 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:05:17.877 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:17.873+0000 7f05858c9640 1 --2- 172.21.15.171:0/1181468329 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0568003530 0x7f0580101da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:05:17.877 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:17.873+0000 7f05858c9640 1 -- 172.21.15.171:0/1181468329 >> 172.21.15.171:0/1181468329 conn(0x7f05800fbf50 msgr2=0x7f05800fdee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:05:17.877 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:17.873+0000 7f05858c9640 1 -- 172.21.15.171:0/1181468329 shutdown_connections 2024-08-19T00:05:17.878 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:17.873+0000 7f05858c9640 1 -- 172.21.15.171:0/1181468329 wait complete. 2024-08-19T00:05:18.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:18 smithi171 ceph-mon[21810]: Deploying daemon mon.b on smithi116 2024-08-19T00:05:18.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:18 smithi171 ceph-mon[21810]: from='client.? 172.21.15.171:0/1181468329' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-19T00:05:18.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:18 smithi171 ceph-mon[21810]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:18.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:18 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-19T00:05:18.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:18 smithi044 ceph-mon[18489]: Deploying daemon mon.b on smithi116 2024-08-19T00:05:18.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:18 smithi044 ceph-mon[18489]: from='client.? 172.21.15.171:0/1181468329' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-19T00:05:18.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:18 smithi044 ceph-mon[18489]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:18.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:18 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-19T00:05:19.459 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-19T00:05:19.459 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph mon dump -f json 2024-08-19T00:05:19.712 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.c/config 2024-08-19T00:05:20.107 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:20.104+0000 7fe1aab42640 1 -- 172.21.15.171:0/498706442 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1a4100510 msgr2=0x7fe1a41008f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:05:20.107 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:20.104+0000 7fe1aab42640 1 --2- 172.21.15.171:0/498706442 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1a4100510 0x7fe1a41008f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe18c009880 tx=0x7fe18c02a5d0 comp rx=0 tx=0).stop 2024-08-19T00:05:20.107 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:20.104+0000 7fe1aab42640 1 -- 172.21.15.171:0/498706442 shutdown_connections 2024-08-19T00:05:20.107 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:20.104+0000 7fe1aab42640 1 --2- 172.21.15.171:0/498706442 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1a4100510 0x7fe1a41008f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:05:20.107 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:20.104+0000 7fe1aab42640 1 -- 172.21.15.171:0/498706442 >> 172.21.15.171:0/498706442 conn(0x7fe1a40fbfb0 msgr2=0x7fe1a40fe3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:05:20.108 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:20.104+0000 7fe1aab42640 1 -- 172.21.15.171:0/498706442 shutdown_connections 2024-08-19T00:05:20.108 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:20.104+0000 7fe1aab42640 1 -- 172.21.15.171:0/498706442 wait complete. 2024-08-19T00:05:20.108 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:20.105+0000 7fe1aab42640 1 Processor -- start 2024-08-19T00:05:20.108 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:20.105+0000 7fe1aab42640 1 -- start start 2024-08-19T00:05:20.108 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:20.105+0000 7fe1aab42640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1a4100510 0x7fe1a4195d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:05:20.108 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:20.105+0000 7fe1aab42640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe1a41962a0 0x7fe1a4196700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:05:20.108 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:20.105+0000 7fe1aab42640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a410a960 con 0x7fe1a4100510 2024-08-19T00:05:20.108 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:20.105+0000 7fe1aab42640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a410a7e0 con 0x7fe1a41962a0 2024-08-19T00:05:20.108 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:20.105+0000 7fe1a3fff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe1a41962a0 0x7fe1a4196700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:05:20.108 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:20.105+0000 7fe1a88de640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1a4100510 0x7fe1a4195d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:05:20.108 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:20.105+0000 7fe1a88de640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1a4100510 0x7fe1a4195d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.171:37000/0 (socket says 172.21.15.171:37000) 2024-08-19T00:05:20.108 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:20.105+0000 7fe1a88de640 1 -- 172.21.15.171:0/21736917 learned_addr learned my addr 172.21.15.171:0/21736917 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-08-19T00:05:20.109 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:20.105+0000 7fe1a3fff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe1a41962a0 0x7fe1a4196700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:51064/0 (socket says 172.21.15.171:51064) 2024-08-19T00:05:20.109 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:20.105+0000 7fe1a3fff640 1 -- 172.21.15.171:0/21736917 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe1a41962a0 msgr2=0x7fe1a4196700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-08-19T00:05:20.109 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:20.105+0000 7fe1a3fff640 1 -- 172.21.15.171:0/21736917 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe1a41962a0 msgr2=0x7fe1a4196700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T00:05:20.109 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:20.105+0000 7fe1a3fff640 1 --2- 172.21.15.171:0/21736917 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe1a41962a0 0x7fe1a4196700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T00:05:20.109 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:20.105+0000 7fe1a3fff640 1 --2- 172.21.15.171:0/21736917 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe1a41962a0 0x7fe1a4196700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T00:05:20.109 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:20.105+0000 7fe1a88de640 1 -- 172.21.15.171:0/21736917 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe1a41962a0 msgr2=0x7fe1a4196700 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T00:05:20.109 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:20.105+0000 7fe1a88de640 1 --2- 172.21.15.171:0/21736917 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe1a41962a0 0x7fe1a4196700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:05:20.109 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:20.105+0000 7fe1a88de640 1 -- 172.21.15.171:0/21736917 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1a406a740 con 0x7fe1a4100510 2024-08-19T00:05:20.109 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:20.106+0000 7fe1a88de640 1 --2- 172.21.15.171:0/21736917 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1a4100510 0x7fe1a4195d60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe18c032c50 tx=0x7fe18c032c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:05:20.109 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:20.106+0000 7fe1a1ffb640 1 -- 172.21.15.171:0/21736917 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fe18c035070 con 0x7fe1a4100510 2024-08-19T00:05:20.109 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:20.106+0000 7fe1aab42640 1 -- 172.21.15.171:0/21736917 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1a41a33d0 con 0x7fe1a4100510 2024-08-19T00:05:20.109 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:20.106+0000 7fe1a1ffb640 1 -- 172.21.15.171:0/21736917 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe18c003ce0 con 0x7fe1a4100510 2024-08-19T00:05:20.109 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:20.106+0000 7fe1a1ffb640 1 -- 172.21.15.171:0/21736917 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fe18c03bc20 con 0x7fe1a4100510 2024-08-19T00:05:20.110 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:20.106+0000 7fe1aab42640 1 -- 172.21.15.171:0/21736917 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1a41a3880 con 0x7fe1a4100510 2024-08-19T00:05:20.110 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:20.107+0000 7fe1aab42640 1 -- 172.21.15.171:0/21736917 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1a41019f0 con 0x7fe1a4100510 2024-08-19T00:05:20.111 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:20.107+0000 7fe1a1ffb640 1 -- 172.21.15.171:0/21736917 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fe18c042030 con 0x7fe1a4100510 2024-08-19T00:05:20.111 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:20.107+0000 7fe1a1ffb640 1 --2- 172.21.15.171:0/21736917 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fe190038e00 0x7fe19003b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:05:20.111 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:20.107+0000 7fe1a1ffb640 1 -- 172.21.15.171:0/21736917 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fe18c040070 con 0x7fe1a4100510 2024-08-19T00:05:20.111 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:20.107+0000 7fe1a3fff640 1 --2- 172.21.15.171:0/21736917 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fe190038e00 0x7fe19003b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:05:20.111 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:20.108+0000 7fe1a3fff640 1 --2- 172.21.15.171:0/21736917 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fe190038e00 0x7fe19003b2c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe1940070b0 tx=0x7fe194007040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:05:20.113 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:20.113+0000 7fe1a1ffb640 1 -- 172.21.15.171:0/21736917 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fe18c0433c0 con 0x7fe1a4100510 2024-08-19T00:05:20.342 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:20.340+0000 7fe1aab42640 1 -- 172.21.15.171:0/21736917 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fe1a41a3bc0 con 0x7fe1a4100510 2024-08-19T00:05:20.342 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:20.341+0000 7fe1a1ffb640 1 -- 172.21.15.171:0/21736917 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7fe18c003800 con 0x7fe1a4100510 2024-08-19T00:05:20.342 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-19T00:05:20.343 INFO:teuthology.orchestra.run.smithi171.stdout:{"epoch":2,"fsid":"647ded64-5dbe-11ef-bccf-c7b262605968","modified":"2024-08-19T00:05:12.541266Z","created":"2024-08-19T00:03:40.850741Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:3300","nonce":0},{"type":"v1","addr":"172.21.15.44:6789","nonce":0}]},"addr":"172.21.15.44:6789/0","public_addr":"172.21.15.44:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:3300","nonce":0},{"type":"v1","addr":"172.21.15.171:6789","nonce":0}]},"addr":"172.21.15.171:6789/0","public_addr":"172.21.15.171:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-08-19T00:05:20.343 INFO:teuthology.orchestra.run.smithi171.stderr:dumped monmap epoch 2 2024-08-19T00:05:20.344 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:20.343+0000 7fe1aab42640 1 -- 172.21.15.171:0/21736917 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fe190038e00 msgr2=0x7fe19003b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:05:20.344 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:20.343+0000 7fe1aab42640 1 --2- 172.21.15.171:0/21736917 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fe190038e00 0x7fe19003b2c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe1940070b0 tx=0x7fe194007040 comp rx=0 tx=0).stop 2024-08-19T00:05:20.344 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:20.343+0000 7fe1aab42640 1 -- 172.21.15.171:0/21736917 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1a4100510 msgr2=0x7fe1a4195d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:05:20.345 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:20.343+0000 7fe1aab42640 1 --2- 172.21.15.171:0/21736917 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1a4100510 0x7fe1a4195d60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe18c032c50 tx=0x7fe18c032c80 comp rx=0 tx=0).stop 2024-08-19T00:05:20.345 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:20.343+0000 7fe1aab42640 1 -- 172.21.15.171:0/21736917 shutdown_connections 2024-08-19T00:05:20.345 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:20.343+0000 7fe1aab42640 1 --2- 172.21.15.171:0/21736917 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fe190038e00 0x7fe19003b2c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:05:20.345 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:20.343+0000 7fe1aab42640 1 --2- 172.21.15.171:0/21736917 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe1a41962a0 0x7fe1a4196700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:05:20.345 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:20.343+0000 7fe1aab42640 1 --2- 172.21.15.171:0/21736917 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1a4100510 0x7fe1a4195d60 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:05:20.345 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:20.343+0000 7fe1aab42640 1 -- 172.21.15.171:0/21736917 >> 172.21.15.171:0/21736917 conn(0x7fe1a40fbfb0 msgr2=0x7fe1a4108050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:05:20.345 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:20.343+0000 7fe1aab42640 1 -- 172.21.15.171:0/21736917 shutdown_connections 2024-08-19T00:05:20.345 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:20.343+0000 7fe1aab42640 1 -- 172.21.15.171:0/21736917 wait complete. 2024-08-19T00:05:20.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:20 smithi044 ceph-mon[18489]: from='client.? 172.21.15.171:0/21736917' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-19T00:05:20.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:20 smithi171 ceph-mon[21810]: from='client.? 172.21.15.171:0/21736917' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-19T00:05:21.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 podman[21854]: 2024-08-19 00:05:20.983637086 +0000 UTC m=+0.017038086 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-19T00:05:21.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 podman[21854]: 2024-08-19 00:05:21.265279826 +0000 UTC m=+0.298680814 container init 1bd427db0f97ca1d6fc215bd46433c637335d87b66236d6064fe9b94b81591b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mon-b, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, RELEASE=squid-de09dd0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-19T00:05:21.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 podman[21854]: 2024-08-19 00:05:21.268237456 +0000 UTC m=+0.301638439 container start 1bd427db0f97ca1d6fc215bd46433c637335d87b66236d6064fe9b94b81591b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mon-b, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-de09dd0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-08-19T00:05:21.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: set uid:gid to 167:167 (ceph:ceph) 2024-08-19T00:05:21.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc), process ceph-mon, pid 2 2024-08-19T00:05:21.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: pidfile_write: ignore empty --pid-file 2024-08-19T00:05:21.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: load: jerasure load: lrc 2024-08-19T00:05:21.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: RocksDB version: 7.9.2 2024-08-19T00:05:21.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Git sha 0 2024-08-19T00:05:21.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Compile date 2024-08-18 15:19:56 2024-08-19T00:05:21.617 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: DB SUMMARY 2024-08-19T00:05:21.617 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: DB Session ID: 1CZHSY7L1JUEVQVR7R2L 2024-08-19T00:05:21.617 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: CURRENT file: CURRENT 2024-08-19T00:05:21.617 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: IDENTITY file: IDENTITY 2024-08-19T00:05:21.617 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-08-19T00:05:21.617 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-08-19T00:05:21.617 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-08-19T00:05:21.617 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.error_if_exists: 0 2024-08-19T00:05:21.617 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.create_if_missing: 0 2024-08-19T00:05:21.617 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.paranoid_checks: 1 2024-08-19T00:05:21.617 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.flush_verify_memtable_count: 1 2024-08-19T00:05:21.617 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-08-19T00:05:21.617 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-08-19T00:05:21.617 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.env: 0x55af60a297a0 2024-08-19T00:05:21.618 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.fs: PosixFileSystem 2024-08-19T00:05:21.618 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.info_log: 0x55af6215d500 2024-08-19T00:05:21.618 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.max_file_opening_threads: 16 2024-08-19T00:05:21.619 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.statistics: (nil) 2024-08-19T00:05:21.619 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.use_fsync: 0 2024-08-19T00:05:21.619 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.max_log_file_size: 0 2024-08-19T00:05:21.620 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-08-19T00:05:21.620 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.log_file_time_to_roll: 0 2024-08-19T00:05:21.620 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.keep_log_file_num: 1000 2024-08-19T00:05:21.620 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.recycle_log_file_num: 0 2024-08-19T00:05:21.620 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.allow_fallocate: 1 2024-08-19T00:05:21.620 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.allow_mmap_reads: 0 2024-08-19T00:05:21.620 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.allow_mmap_writes: 0 2024-08-19T00:05:21.620 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.use_direct_reads: 0 2024-08-19T00:05:21.620 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-08-19T00:05:21.620 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.create_missing_column_families: 0 2024-08-19T00:05:21.620 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.db_log_dir: 2024-08-19T00:05:21.620 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.wal_dir: 2024-08-19T00:05:21.621 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.table_cache_numshardbits: 6 2024-08-19T00:05:21.621 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.WAL_ttl_seconds: 0 2024-08-19T00:05:21.621 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.WAL_size_limit_MB: 0 2024-08-19T00:05:21.621 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-08-19T00:05:21.621 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-08-19T00:05:21.621 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.is_fd_close_on_exec: 1 2024-08-19T00:05:21.621 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.advise_random_on_open: 1 2024-08-19T00:05:21.621 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.db_write_buffer_size: 0 2024-08-19T00:05:21.621 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.write_buffer_manager: 0x55af6216cdc0 2024-08-19T00:05:21.621 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-08-19T00:05:21.621 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-08-19T00:05:21.621 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.use_adaptive_mutex: 0 2024-08-19T00:05:21.621 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.rate_limiter: (nil) 2024-08-19T00:05:21.621 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-08-19T00:05:21.622 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.wal_recovery_mode: 2 2024-08-19T00:05:21.622 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.enable_thread_tracking: 0 2024-08-19T00:05:21.622 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.enable_pipelined_write: 0 2024-08-19T00:05:21.622 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.unordered_write: 0 2024-08-19T00:05:21.622 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-08-19T00:05:21.622 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-08-19T00:05:21.622 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-08-19T00:05:21.622 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-08-19T00:05:21.622 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.row_cache: None 2024-08-19T00:05:21.622 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.wal_filter: None 2024-08-19T00:05:21.622 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-08-19T00:05:21.622 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.allow_ingest_behind: 0 2024-08-19T00:05:21.622 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.two_write_queues: 0 2024-08-19T00:05:21.622 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.manual_wal_flush: 0 2024-08-19T00:05:21.622 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.wal_compression: 0 2024-08-19T00:05:21.623 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.atomic_flush: 0 2024-08-19T00:05:21.623 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-08-19T00:05:21.623 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.persist_stats_to_disk: 0 2024-08-19T00:05:21.623 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.write_dbid_to_manifest: 0 2024-08-19T00:05:21.623 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.log_readahead_size: 0 2024-08-19T00:05:21.623 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-08-19T00:05:21.623 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.best_efforts_recovery: 0 2024-08-19T00:05:21.623 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-08-19T00:05:21.623 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-08-19T00:05:21.623 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.allow_data_in_errors: 0 2024-08-19T00:05:21.623 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.db_host_id: __hostname__ 2024-08-19T00:05:21.623 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.enforce_single_del_contracts: true 2024-08-19T00:05:21.623 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.max_background_jobs: 2 2024-08-19T00:05:21.623 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.max_background_compactions: -1 2024-08-19T00:05:21.624 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.max_subcompactions: 1 2024-08-19T00:05:21.624 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-08-19T00:05:21.624 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-08-19T00:05:21.624 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.delayed_write_rate : 16777216 2024-08-19T00:05:21.624 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.max_total_wal_size: 0 2024-08-19T00:05:21.624 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-08-19T00:05:21.624 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.stats_dump_period_sec: 600 2024-08-19T00:05:21.624 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.stats_persist_period_sec: 600 2024-08-19T00:05:21.624 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-08-19T00:05:21.624 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.max_open_files: -1 2024-08-19T00:05:21.624 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.bytes_per_sync: 0 2024-08-19T00:05:21.624 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.wal_bytes_per_sync: 0 2024-08-19T00:05:21.624 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.strict_bytes_per_sync: 0 2024-08-19T00:05:21.625 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.compaction_readahead_size: 0 2024-08-19T00:05:21.625 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.max_background_flushes: -1 2024-08-19T00:05:21.625 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Compression algorithms supported: 2024-08-19T00:05:21.625 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: kZSTD supported: 0 2024-08-19T00:05:21.625 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: kXpressCompression supported: 0 2024-08-19T00:05:21.625 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: kBZip2Compression supported: 0 2024-08-19T00:05:21.625 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-08-19T00:05:21.625 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: kLZ4Compression supported: 1 2024-08-19T00:05:21.625 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: kZlibCompression supported: 1 2024-08-19T00:05:21.625 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: kLZ4HCCompression supported: 1 2024-08-19T00:05:21.625 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: kSnappyCompression supported: 1 2024-08-19T00:05:21.625 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Fast CRC32 supported: Supported on x86 2024-08-19T00:05:21.625 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: DMutex implementation: pthread_mutex_t 2024-08-19T00:05:21.626 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-08-19T00:05:21.626 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-08-19T00:05:21.626 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-08-19T00:05:21.626 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.merge_operator: 2024-08-19T00:05:21.626 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.compaction_filter: None 2024-08-19T00:05:21.626 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.compaction_filter_factory: None 2024-08-19T00:05:21.626 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.sst_partitioner_factory: None 2024-08-19T00:05:21.626 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.memtable_factory: SkipListFactory 2024-08-19T00:05:21.626 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.table_factory: BlockBasedTable 2024-08-19T00:05:21.626 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55af6215d120) 2024-08-19T00:05:21.626 INFO:journalctl@ceph.mon.b.smithi116.stdout: cache_index_and_filter_blocks: 1 2024-08-19T00:05:21.626 INFO:journalctl@ceph.mon.b.smithi116.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-08-19T00:05:21.626 INFO:journalctl@ceph.mon.b.smithi116.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-08-19T00:05:21.627 INFO:journalctl@ceph.mon.b.smithi116.stdout: pin_top_level_index_and_filter: 1 2024-08-19T00:05:21.627 INFO:journalctl@ceph.mon.b.smithi116.stdout: index_type: 0 2024-08-19T00:05:21.627 INFO:journalctl@ceph.mon.b.smithi116.stdout: data_block_index_type: 0 2024-08-19T00:05:21.627 INFO:journalctl@ceph.mon.b.smithi116.stdout: index_shortening: 1 2024-08-19T00:05:21.627 INFO:journalctl@ceph.mon.b.smithi116.stdout: data_block_hash_table_util_ratio: 0.750000 2024-08-19T00:05:21.627 INFO:journalctl@ceph.mon.b.smithi116.stdout: checksum: 4 2024-08-19T00:05:21.627 INFO:journalctl@ceph.mon.b.smithi116.stdout: no_block_cache: 0 2024-08-19T00:05:21.627 INFO:journalctl@ceph.mon.b.smithi116.stdout: block_cache: 0x55af62151090 2024-08-19T00:05:21.627 INFO:journalctl@ceph.mon.b.smithi116.stdout: block_cache_name: BinnedLRUCache 2024-08-19T00:05:21.627 INFO:journalctl@ceph.mon.b.smithi116.stdout: block_cache_options: 2024-08-19T00:05:21.627 INFO:journalctl@ceph.mon.b.smithi116.stdout: capacity : 536870912 2024-08-19T00:05:21.627 INFO:journalctl@ceph.mon.b.smithi116.stdout: num_shard_bits : 4 2024-08-19T00:05:21.627 INFO:journalctl@ceph.mon.b.smithi116.stdout: strict_capacity_limit : 0 2024-08-19T00:05:21.627 INFO:journalctl@ceph.mon.b.smithi116.stdout: high_pri_pool_ratio: 0.000 2024-08-19T00:05:21.628 INFO:journalctl@ceph.mon.b.smithi116.stdout: block_cache_compressed: (nil) 2024-08-19T00:05:21.628 INFO:journalctl@ceph.mon.b.smithi116.stdout: persistent_cache: (nil) 2024-08-19T00:05:21.628 INFO:journalctl@ceph.mon.b.smithi116.stdout: block_size: 4096 2024-08-19T00:05:21.628 INFO:journalctl@ceph.mon.b.smithi116.stdout: block_size_deviation: 10 2024-08-19T00:05:21.628 INFO:journalctl@ceph.mon.b.smithi116.stdout: block_restart_interval: 16 2024-08-19T00:05:21.628 INFO:journalctl@ceph.mon.b.smithi116.stdout: index_block_restart_interval: 1 2024-08-19T00:05:21.628 INFO:journalctl@ceph.mon.b.smithi116.stdout: metadata_block_size: 4096 2024-08-19T00:05:21.628 INFO:journalctl@ceph.mon.b.smithi116.stdout: partition_filters: 0 2024-08-19T00:05:21.628 INFO:journalctl@ceph.mon.b.smithi116.stdout: use_delta_encoding: 1 2024-08-19T00:05:21.628 INFO:journalctl@ceph.mon.b.smithi116.stdout: filter_policy: bloomfilter 2024-08-19T00:05:21.628 INFO:journalctl@ceph.mon.b.smithi116.stdout: whole_key_filtering: 1 2024-08-19T00:05:21.628 INFO:journalctl@ceph.mon.b.smithi116.stdout: verify_compression: 0 2024-08-19T00:05:21.628 INFO:journalctl@ceph.mon.b.smithi116.stdout: read_amp_bytes_per_bit: 0 2024-08-19T00:05:21.629 INFO:journalctl@ceph.mon.b.smithi116.stdout: format_version: 5 2024-08-19T00:05:21.629 INFO:journalctl@ceph.mon.b.smithi116.stdout: enable_index_compression: 1 2024-08-19T00:05:21.629 INFO:journalctl@ceph.mon.b.smithi116.stdout: block_align: 0 2024-08-19T00:05:21.629 INFO:journalctl@ceph.mon.b.smithi116.stdout: max_auto_readahead_size: 262144 2024-08-19T00:05:21.629 INFO:journalctl@ceph.mon.b.smithi116.stdout: prepopulate_block_cache: 0 2024-08-19T00:05:21.629 INFO:journalctl@ceph.mon.b.smithi116.stdout: initial_auto_readahead_size: 8192 2024-08-19T00:05:21.629 INFO:journalctl@ceph.mon.b.smithi116.stdout: num_file_reads_for_auto_readahead: 2 2024-08-19T00:05:21.629 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.write_buffer_size: 33554432 2024-08-19T00:05:21.629 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.max_write_buffer_number: 2 2024-08-19T00:05:21.629 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.compression: NoCompression 2024-08-19T00:05:21.629 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.bottommost_compression: Disabled 2024-08-19T00:05:21.629 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.prefix_extractor: nullptr 2024-08-19T00:05:21.629 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-08-19T00:05:21.629 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.num_levels: 7 2024-08-19T00:05:21.629 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-08-19T00:05:21.629 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-08-19T00:05:21.630 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-08-19T00:05:21.630 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-08-19T00:05:21.630 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-08-19T00:05:21.630 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-08-19T00:05:21.630 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-08-19T00:05:21.630 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-08-19T00:05:21.630 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-08-19T00:05:21.630 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-08-19T00:05:21.630 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-08-19T00:05:21.630 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-08-19T00:05:21.630 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.compression_opts.window_bits: -14 2024-08-19T00:05:21.630 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.compression_opts.level: 32767 2024-08-19T00:05:21.630 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.compression_opts.strategy: 0 2024-08-19T00:05:21.631 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-08-19T00:05:21.631 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-08-19T00:05:21.631 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-08-19T00:05:21.631 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-08-19T00:05:21.631 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.compression_opts.enabled: false 2024-08-19T00:05:21.631 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-08-19T00:05:21.631 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-08-19T00:05:21.631 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-08-19T00:05:21.631 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-08-19T00:05:21.631 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.target_file_size_base: 67108864 2024-08-19T00:05:21.631 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.target_file_size_multiplier: 1 2024-08-19T00:05:21.631 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-08-19T00:05:21.631 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-08-19T00:05:21.631 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-08-19T00:05:21.631 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-08-19T00:05:21.631 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-08-19T00:05:21.632 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-08-19T00:05:21.632 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-08-19T00:05:21.632 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-08-19T00:05:21.632 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-08-19T00:05:21.632 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-08-19T00:05:21.632 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-08-19T00:05:21.632 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-08-19T00:05:21.632 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-08-19T00:05:21.632 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.arena_block_size: 1048576 2024-08-19T00:05:21.632 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-08-19T00:05:21.632 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-08-19T00:05:21.632 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.disable_auto_compactions: 0 2024-08-19T00:05:21.632 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-08-19T00:05:21.632 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-08-19T00:05:21.632 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-08-19T00:05:21.633 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-08-19T00:05:21.633 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-08-19T00:05:21.633 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-08-19T00:05:21.633 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-08-19T00:05:21.633 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-08-19T00:05:21.633 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-08-19T00:05:21.633 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-08-19T00:05:21.633 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-08-19T00:05:21.633 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.inplace_update_support: 0 2024-08-19T00:05:21.633 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.inplace_update_num_locks: 10000 2024-08-19T00:05:21.633 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-08-19T00:05:21.633 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-08-19T00:05:21.633 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.memtable_huge_page_size: 0 2024-08-19T00:05:21.633 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.bloom_locality: 0 2024-08-19T00:05:21.633 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.max_successive_merges: 0 2024-08-19T00:05:21.634 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.optimize_filters_for_hits: 0 2024-08-19T00:05:21.634 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.paranoid_file_checks: 0 2024-08-19T00:05:21.634 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.force_consistency_checks: 1 2024-08-19T00:05:21.634 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.report_bg_io_stats: 0 2024-08-19T00:05:21.634 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.ttl: 2592000 2024-08-19T00:05:21.634 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.periodic_compaction_seconds: 0 2024-08-19T00:05:21.634 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-08-19T00:05:21.634 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-08-19T00:05:21.634 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.enable_blob_files: false 2024-08-19T00:05:21.634 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.min_blob_size: 0 2024-08-19T00:05:21.634 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.blob_file_size: 268435456 2024-08-19T00:05:21.634 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.blob_compression_type: NoCompression 2024-08-19T00:05:21.634 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.enable_blob_garbage_collection: false 2024-08-19T00:05:21.635 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-08-19T00:05:21.635 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-08-19T00:05:21.635 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-08-19T00:05:21.635 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.blob_file_starting_level: 0 2024-08-19T00:05:21.635 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-08-19T00:05:21.635 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-08-19T00:05:21.635 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-08-19T00:05:21.635 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 40ccea1f-af0b-4b1d-87b1-5c0e65b4eb9c 2024-08-19T00:05:21.635 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724025921295057, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-08-19T00:05:21.635 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-08-19T00:05:21.635 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724025921295511, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1724025921, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "40ccea1f-af0b-4b1d-87b1-5c0e65b4eb9c", "db_session_id": "1CZHSY7L1JUEVQVR7R2L", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-08-19T00:05:21.635 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724025921295613, "job": 1, "event": "recovery_finished"} 2024-08-19T00:05:21.635 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-08-19T00:05:21.635 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-08-19T00:05:21.635 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55af6217ee00 2024-08-19T00:05:21.636 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: DB pointer 0x55af62278000 2024-08-19T00:05:21.636 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-08-19T00:05:21.636 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-08-19T00:05:21.636 INFO:journalctl@ceph.mon.b.smithi116.stdout: ** DB Stats ** 2024-08-19T00:05:21.636 INFO:journalctl@ceph.mon.b.smithi116.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-19T00:05:21.636 INFO:journalctl@ceph.mon.b.smithi116.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-08-19T00:05:21.636 INFO:journalctl@ceph.mon.b.smithi116.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-19T00:05:21.636 INFO:journalctl@ceph.mon.b.smithi116.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-19T00:05:21.636 INFO:journalctl@ceph.mon.b.smithi116.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-08-19T00:05:21.636 INFO:journalctl@ceph.mon.b.smithi116.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-19T00:05:21.636 INFO:journalctl@ceph.mon.b.smithi116.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-19T00:05:21.636 INFO:journalctl@ceph.mon.b.smithi116.stdout: 2024-08-19T00:05:21.636 INFO:journalctl@ceph.mon.b.smithi116.stdout: ** Compaction Stats [default] ** 2024-08-19T00:05:21.636 INFO:journalctl@ceph.mon.b.smithi116.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-19T00:05:21.636 INFO:journalctl@ceph.mon.b.smithi116.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-08-19T00:05:21.637 INFO:journalctl@ceph.mon.b.smithi116.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-19T00:05:21.637 INFO:journalctl@ceph.mon.b.smithi116.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-19T00:05:21.637 INFO:journalctl@ceph.mon.b.smithi116.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-19T00:05:21.637 INFO:journalctl@ceph.mon.b.smithi116.stdout: 2024-08-19T00:05:21.637 INFO:journalctl@ceph.mon.b.smithi116.stdout: ** Compaction Stats [default] ** 2024-08-19T00:05:21.637 INFO:journalctl@ceph.mon.b.smithi116.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-19T00:05:21.637 INFO:journalctl@ceph.mon.b.smithi116.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-08-19T00:05:21.637 INFO:journalctl@ceph.mon.b.smithi116.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-19T00:05:21.637 INFO:journalctl@ceph.mon.b.smithi116.stdout: 2024-08-19T00:05:21.637 INFO:journalctl@ceph.mon.b.smithi116.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-08-19T00:05:21.637 INFO:journalctl@ceph.mon.b.smithi116.stdout: 2024-08-19T00:05:21.637 INFO:journalctl@ceph.mon.b.smithi116.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-19T00:05:21.637 INFO:journalctl@ceph.mon.b.smithi116.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-08-19T00:05:21.637 INFO:journalctl@ceph.mon.b.smithi116.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-08-19T00:05:21.638 INFO:journalctl@ceph.mon.b.smithi116.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-08-19T00:05:21.638 INFO:journalctl@ceph.mon.b.smithi116.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-08-19T00:05:21.638 INFO:journalctl@ceph.mon.b.smithi116.stdout: AddFile(Keys): cumulative 0, interval 0 2024-08-19T00:05:21.638 INFO:journalctl@ceph.mon.b.smithi116.stdout: Cumulative compaction: 0.00 GB write, 0.63 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-19T00:05:21.638 INFO:journalctl@ceph.mon.b.smithi116.stdout: Interval compaction: 0.00 GB write, 0.63 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-19T00:05:21.638 INFO:journalctl@ceph.mon.b.smithi116.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-08-19T00:05:21.638 INFO:journalctl@ceph.mon.b.smithi116.stdout: Block cache BinnedLRUCache@0x55af62151090#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-08-19T00:05:21.638 INFO:journalctl@ceph.mon.b.smithi116.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-08-19T00:05:21.638 INFO:journalctl@ceph.mon.b.smithi116.stdout: 2024-08-19T00:05:21.638 INFO:journalctl@ceph.mon.b.smithi116.stdout: ** File Read Latency Histogram By Level [default] ** 2024-08-19T00:05:21.638 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-08-19T00:05:21.638 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: using public_addr v2:172.21.15.116:0/0 -> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-08-19T00:05:21.638 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: starting mon.b rank -1 at public addrs [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] at bind addrs [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 647ded64-5dbe-11ef-bccf-c7b262605968 2024-08-19T00:05:21.638 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: mon.b@-1(???) e0 preinit fsid 647ded64-5dbe-11ef-bccf-c7b262605968 2024-08-19T00:05:21.639 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: mon.b@-1(synchronizing).mds e1 new map 2024-08-19T00:05:21.639 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: mon.b@-1(synchronizing).mds e1 print_map 2024-08-19T00:05:21.639 INFO:journalctl@ceph.mon.b.smithi116.stdout: e1 2024-08-19T00:05:21.639 INFO:journalctl@ceph.mon.b.smithi116.stdout: btime 2024-08-19T00:03:43:667716+0000 2024-08-19T00:05:21.639 INFO:journalctl@ceph.mon.b.smithi116.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T00:05:21.639 INFO:journalctl@ceph.mon.b.smithi116.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-19T00:05:21.639 INFO:journalctl@ceph.mon.b.smithi116.stdout: legacy client fscid: -1 2024-08-19T00:05:21.639 INFO:journalctl@ceph.mon.b.smithi116.stdout: 2024-08-19T00:05:21.639 INFO:journalctl@ceph.mon.b.smithi116.stdout: No filesystems configured 2024-08-19T00:05:21.639 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-08-19T00:05:21.639 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-08-19T00:05:21.639 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-08-19T00:05:21.639 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-08-19T00:05:21.640 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-08-19T00:05:21.640 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-08-19T00:05:21.640 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-08-19T00:05:21.640 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-08-19T00:05:21.640 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-08-19T00:05:21.640 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-08-19T00:05:21.640 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:21.640 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-19T00:05:21.640 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:21.640 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/311338943' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-08-19T00:05:21.640 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/311338943' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-08-19T00:05:21.640 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: osdmap e4: 0 total, 0 up, 0 in 2024-08-19T00:05:21.640 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:21.641 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:21.641 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:21.641 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:21.641 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi171", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:05:21.641 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:05:21.641 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:05:21.641 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: Updating smithi171:/etc/ceph/ceph.conf 2024-08-19T00:05:21.641 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: Updating smithi171:/var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-19T00:05:21.641 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:21.641 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:21.641 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:21.641 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:21.641 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:21.642 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-19T00:05:21.642 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:05:21.642 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: Updating smithi171:/etc/ceph/ceph.client.admin.keyring 2024-08-19T00:05:21.642 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: Updating smithi171:/var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-19T00:05:21.642 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi044:172.21.15.44=a;smithi116:172.21.15.116=b;smithi171:172.21.15.171=c", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:05:21.642 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: Saving service mon spec with placement smithi044:172.21.15.44=a;smithi116:172.21.15.116=b;smithi171:172.21.15.171=c;count:3 2024-08-19T00:05:21.642 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: Deploying daemon mon.c on smithi171 2024-08-19T00:05:21.642 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:21.642 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: from='client.? 172.21.15.171:0/1931949730' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-19T00:05:21.642 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:21.642 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: from='client.? 172.21.15.171:0/2636586092' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-19T00:05:21.642 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-19T00:05:21.642 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-19T00:05:21.643 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: mon.a calling monitor election 2024-08-19T00:05:21.643 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-19T00:05:21.643 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:21.643 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-19T00:05:21.643 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: mon.c calling monitor election 2024-08-19T00:05:21.643 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-19T00:05:21.643 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:21.643 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-19T00:05:21.643 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-19T00:05:21.643 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-08-19T00:05:21.643 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: monmap epoch 2 2024-08-19T00:05:21.643 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: fsid 647ded64-5dbe-11ef-bccf-c7b262605968 2024-08-19T00:05:21.644 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: last_changed 2024-08-19T00:05:12.541266+0000 2024-08-19T00:05:21.644 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: created 2024-08-19T00:03:40.850741+0000 2024-08-19T00:05:21.644 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: min_mon_release 19 (squid) 2024-08-19T00:05:21.644 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: election_strategy: 1 2024-08-19T00:05:21.644 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: 0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-08-19T00:05:21.644 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: 1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.c 2024-08-19T00:05:21.644 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: fsmap 2024-08-19T00:05:21.644 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: osdmap e4: 0 total, 0 up, 0 in 2024-08-19T00:05:21.644 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: mgrmap e13: x(active, since 39s) 2024-08-19T00:05:21.644 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: overall HEALTH_OK 2024-08-19T00:05:21.644 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:21.644 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:21.644 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:21.644 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-19T00:05:21.645 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:05:21.645 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: Deploying daemon mon.b on smithi116 2024-08-19T00:05:21.645 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: from='client.? 172.21.15.171:0/1181468329' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-19T00:05:21.645 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:21.645 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-19T00:05:21.645 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: from='client.? 172.21.15.171:0/21736917' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-19T00:05:21.645 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 ceph-mon[21873]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-08-19T00:05:21.645 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 bash[21854]: 1bd427db0f97ca1d6fc215bd46433c637335d87b66236d6064fe9b94b81591b5 2024-08-19T00:05:21.645 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:21 smithi116 systemd[1]: Started Ceph mon.b for 647ded64-5dbe-11ef-bccf-c7b262605968. 2024-08-19T00:05:21.916 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-19T00:05:21.916 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph mon dump -f json 2024-08-19T00:05:22.171 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.c/config 2024-08-19T00:05:26.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:26 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-19T00:05:26.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:26 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-19T00:05:26.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:26 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-19T00:05:26.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:26 smithi171 ceph-mon[21810]: mon.a calling monitor election 2024-08-19T00:05:26.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:26 smithi171 ceph-mon[21810]: mon.c calling monitor election 2024-08-19T00:05:26.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:26 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-19T00:05:26.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:26 smithi171 ceph-mon[21810]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:26.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:26 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-19T00:05:26.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:26 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-19T00:05:26.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:26 smithi171 ceph-mon[21810]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:26.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:26 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-19T00:05:26.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:26 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-19T00:05:26.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:26 smithi171 ceph-mon[21810]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-08-19T00:05:26.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:26 smithi171 ceph-mon[21810]: monmap epoch 3 2024-08-19T00:05:26.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:26 smithi171 ceph-mon[21810]: fsid 647ded64-5dbe-11ef-bccf-c7b262605968 2024-08-19T00:05:26.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:26 smithi171 ceph-mon[21810]: last_changed 2024-08-19T00:05:21.320665+0000 2024-08-19T00:05:26.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:26 smithi171 ceph-mon[21810]: created 2024-08-19T00:03:40.850741+0000 2024-08-19T00:05:26.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:26 smithi171 ceph-mon[21810]: min_mon_release 19 (squid) 2024-08-19T00:05:26.844 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:26 smithi171 ceph-mon[21810]: election_strategy: 1 2024-08-19T00:05:26.844 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:26 smithi171 ceph-mon[21810]: 0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-08-19T00:05:26.844 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:26 smithi171 ceph-mon[21810]: 1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.c 2024-08-19T00:05:26.844 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:26 smithi171 ceph-mon[21810]: 2: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.b 2024-08-19T00:05:26.844 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:26 smithi171 ceph-mon[21810]: fsmap 2024-08-19T00:05:26.844 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:26 smithi171 ceph-mon[21810]: osdmap e4: 0 total, 0 up, 0 in 2024-08-19T00:05:26.844 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:26 smithi171 ceph-mon[21810]: mgrmap e13: x(active, since 47s) 2024-08-19T00:05:26.844 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:26 smithi171 ceph-mon[21810]: overall HEALTH_OK 2024-08-19T00:05:26.844 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:26 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:26.844 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:26 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:26.844 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:26 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:26.844 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:26 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:26.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:26 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-19T00:05:26.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:26 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-19T00:05:26.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:26 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-19T00:05:26.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:26 smithi044 ceph-mon[18489]: mon.a calling monitor election 2024-08-19T00:05:26.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:26 smithi044 ceph-mon[18489]: mon.c calling monitor election 2024-08-19T00:05:26.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:26 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-19T00:05:26.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:26 smithi044 ceph-mon[18489]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:26.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:26 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-19T00:05:26.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:26 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-19T00:05:26.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:26 smithi044 ceph-mon[18489]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:26.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:26 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-19T00:05:26.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:26 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-19T00:05:26.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:26 smithi044 ceph-mon[18489]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-08-19T00:05:26.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:26 smithi044 ceph-mon[18489]: monmap epoch 3 2024-08-19T00:05:26.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:26 smithi044 ceph-mon[18489]: fsid 647ded64-5dbe-11ef-bccf-c7b262605968 2024-08-19T00:05:26.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:26 smithi044 ceph-mon[18489]: last_changed 2024-08-19T00:05:21.320665+0000 2024-08-19T00:05:26.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:26 smithi044 ceph-mon[18489]: created 2024-08-19T00:03:40.850741+0000 2024-08-19T00:05:26.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:26 smithi044 ceph-mon[18489]: min_mon_release 19 (squid) 2024-08-19T00:05:26.871 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:26 smithi044 ceph-mon[18489]: election_strategy: 1 2024-08-19T00:05:26.871 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:26 smithi044 ceph-mon[18489]: 0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-08-19T00:05:26.871 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:26 smithi044 ceph-mon[18489]: 1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.c 2024-08-19T00:05:26.871 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:26 smithi044 ceph-mon[18489]: 2: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.b 2024-08-19T00:05:26.871 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:26 smithi044 ceph-mon[18489]: fsmap 2024-08-19T00:05:26.871 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:26 smithi044 ceph-mon[18489]: osdmap e4: 0 total, 0 up, 0 in 2024-08-19T00:05:26.871 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:26 smithi044 ceph-mon[18489]: mgrmap e13: x(active, since 47s) 2024-08-19T00:05:26.871 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:26 smithi044 ceph-mon[18489]: overall HEALTH_OK 2024-08-19T00:05:26.871 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:26 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:26.871 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:26 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:26.871 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:26 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:26.871 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:26 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:26.981 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:26.979+0000 7fa6e08d2640 1 -- 172.21.15.171:0/1870315478 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa6c4003530 msgr2=0x7fa6c40059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:05:26.981 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:26.979+0000 7fa6e08d2640 1 --2- 172.21.15.171:0/1870315478 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa6c4003530 0x7fa6c40059c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc06a790 tx=0x7fa6cc02c490 comp rx=0 tx=0).stop 2024-08-19T00:05:26.981 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:26.979+0000 7fa6e08d2640 1 -- 172.21.15.171:0/1870315478 shutdown_connections 2024-08-19T00:05:26.981 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:26.979+0000 7fa6e08d2640 1 --2- 172.21.15.171:0/1870315478 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa6c4003530 0x7fa6c40059c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:05:26.981 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:26.979+0000 7fa6e08d2640 1 -- 172.21.15.171:0/1870315478 >> 172.21.15.171:0/1870315478 conn(0x7fa6dc0fbf50 msgr2=0x7fa6dc0fe370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:05:26.981 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:26.980+0000 7fa6e08d2640 1 -- 172.21.15.171:0/1870315478 shutdown_connections 2024-08-19T00:05:26.981 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:26.980+0000 7fa6e08d2640 1 -- 172.21.15.171:0/1870315478 wait complete. 2024-08-19T00:05:26.983 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:26.980+0000 7fa6e08d2640 1 Processor -- start 2024-08-19T00:05:26.983 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:26.981+0000 7fa6e08d2640 1 -- start start 2024-08-19T00:05:26.983 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:26.981+0000 7fa6e08d2640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa6c4003530 0x7fa6dc197130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:05:26.983 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:26.981+0000 7fa6e08d2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa6dc197670 0x7fa6dc19ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:05:26.984 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:26.981+0000 7fa6e08d2640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa6dc19bf40 0x7fa6dc19c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:05:26.984 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:26.981+0000 7fa6e08d2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa6dc109460 con 0x7fa6dc197670 2024-08-19T00:05:26.984 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:26.981+0000 7fa6e08d2640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fa6dc1092e0 con 0x7fa6c4003530 2024-08-19T00:05:26.984 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:26.981+0000 7fa6e08d2640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa6dc1095e0 con 0x7fa6dc19bf40 2024-08-19T00:05:26.984 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:26.981+0000 7fa6dad9d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa6dc19bf40 0x7fa6dc19c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:05:26.984 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:26.981+0000 7fa6dad9d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa6dc19bf40 0x7fa6dc19c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:52596/0 (socket says 172.21.15.171:52596) 2024-08-19T00:05:26.984 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:26.981+0000 7fa6dad9d640 1 -- 172.21.15.171:0/1775787833 learned_addr learned my addr 172.21.15.171:0/1775787833 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-08-19T00:05:26.984 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:26.981+0000 7fa6d9d9b640 1 --2- 172.21.15.171:0/1775787833 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa6dc197670 0x7fa6dc19ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:05:26.984 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:26.981+0000 7fa6dad9d640 1 -- 172.21.15.171:0/1775787833 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa6dc19bf40 msgr2=0x7fa6dc19c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-08-19T00:05:26.984 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:26.981+0000 7fa6dad9d640 1 -- 172.21.15.171:0/1775787833 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa6dc19bf40 msgr2=0x7fa6dc19c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T00:05:26.984 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:26.981+0000 7fa6dad9d640 1 --2- 172.21.15.171:0/1775787833 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa6dc19bf40 0x7fa6dc19c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T00:05:26.984 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:26.981+0000 7fa6dad9d640 1 --2- 172.21.15.171:0/1775787833 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa6dc19bf40 0x7fa6dc19c3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T00:05:26.985 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:26.981+0000 7fa6da59c640 1 --2- 172.21.15.171:0/1775787833 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa6c4003530 0x7fa6dc197130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:05:26.985 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:26.981+0000 7fa6da59c640 1 -- 172.21.15.171:0/1775787833 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa6c4003530 msgr2=0x7fa6dc197130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-08-19T00:05:26.985 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:26.981+0000 7fa6da59c640 1 -- 172.21.15.171:0/1775787833 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa6c4003530 msgr2=0x7fa6dc197130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T00:05:26.985 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:26.981+0000 7fa6da59c640 1 --2- 172.21.15.171:0/1775787833 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa6c4003530 0x7fa6dc197130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T00:05:26.985 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:26.981+0000 7fa6da59c640 1 --2- 172.21.15.171:0/1775787833 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa6c4003530 0x7fa6dc197130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T00:05:26.985 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:26.981+0000 7fa6d9d9b640 1 -- 172.21.15.171:0/1775787833 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa6dc19bf40 msgr2=0x7fa6dc19c3f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T00:05:26.985 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:26.981+0000 7fa6d9d9b640 1 --2- 172.21.15.171:0/1775787833 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa6dc19bf40 0x7fa6dc19c3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:05:26.985 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:26.981+0000 7fa6d9d9b640 1 -- 172.21.15.171:0/1775787833 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa6c4003530 msgr2=0x7fa6dc197130 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T00:05:26.985 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:26.981+0000 7fa6d9d9b640 1 --2- 172.21.15.171:0/1775787833 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa6c4003530 0x7fa6dc197130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:05:26.985 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:26.981+0000 7fa6d9d9b640 1 -- 172.21.15.171:0/1775787833 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6dc1a3cb0 con 0x7fa6dc197670 2024-08-19T00:05:26.985 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:26.982+0000 7fa6d9d9b640 1 --2- 172.21.15.171:0/1775787833 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa6dc197670 0x7fa6dc19ba00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa6d000b450 tx=0x7fa6d000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:05:26.985 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:26.982+0000 7fa6cb7fe640 1 -- 172.21.15.171:0/1775787833 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d0004230 con 0x7fa6dc197670 2024-08-19T00:05:26.985 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:26.982+0000 7fa6e08d2640 1 -- 172.21.15.171:0/1775787833 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6dc1a3ee0 con 0x7fa6dc197670 2024-08-19T00:05:26.985 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:26.982+0000 7fa6e08d2640 1 -- 172.21.15.171:0/1775787833 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6dc1a43e0 con 0x7fa6dc197670 2024-08-19T00:05:26.986 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:26.982+0000 7fa6cb7fe640 1 -- 172.21.15.171:0/1775787833 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6d00043d0 con 0x7fa6dc197670 2024-08-19T00:05:26.986 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:26.982+0000 7fa6cb7fe640 1 -- 172.21.15.171:0/1775787833 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d0003b80 con 0x7fa6dc197670 2024-08-19T00:05:26.986 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:26.983+0000 7fa6e08d2640 1 -- 172.21.15.171:0/1775787833 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6c4002ac0 con 0x7fa6dc197670 2024-08-19T00:05:26.987 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:26.983+0000 7fa6cb7fe640 1 -- 172.21.15.171:0/1775787833 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fa6d000f050 con 0x7fa6dc197670 2024-08-19T00:05:26.987 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:26.983+0000 7fa6cb7fe640 1 --2- 172.21.15.171:0/1775787833 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fa6bc0394f0 0x7fa6bc03b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:05:26.987 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:26.983+0000 7fa6cb7fe640 1 -- 172.21.15.171:0/1775787833 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa6d004bba0 con 0x7fa6dc197670 2024-08-19T00:05:26.987 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:26.984+0000 7fa6da59c640 1 --2- 172.21.15.171:0/1775787833 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fa6bc0394f0 0x7fa6bc03b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:05:26.987 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:26.984+0000 7fa6da59c640 1 --2- 172.21.15.171:0/1775787833 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fa6bc0394f0 0x7fa6bc03b9b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc005940 tx=0x7fa6cc005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:05:26.989 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:26.988+0000 7fa6cb7fe640 1 -- 172.21.15.171:0/1775787833 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fa6d001f070 con 0x7fa6dc197670 2024-08-19T00:05:27.229 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:27.228+0000 7fa6e08d2640 1 -- 172.21.15.171:0/1775787833 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fa6c4002db0 con 0x7fa6dc197670 2024-08-19T00:05:27.229 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:27.229+0000 7fa6cb7fe640 1 -- 172.21.15.171:0/1775787833 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1283 (secure 0 0 0) 0x7fa6d000d040 con 0x7fa6dc197670 2024-08-19T00:05:27.230 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-19T00:05:27.230 INFO:teuthology.orchestra.run.smithi171.stdout:{"epoch":3,"fsid":"647ded64-5dbe-11ef-bccf-c7b262605968","modified":"2024-08-19T00:05:21.320665Z","created":"2024-08-19T00:03:40.850741Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:3300","nonce":0},{"type":"v1","addr":"172.21.15.44:6789","nonce":0}]},"addr":"172.21.15.44:6789/0","public_addr":"172.21.15.44:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:3300","nonce":0},{"type":"v1","addr":"172.21.15.171:6789","nonce":0}]},"addr":"172.21.15.171:6789/0","public_addr":"172.21.15.171:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:3300","nonce":0},{"type":"v1","addr":"172.21.15.116:6789","nonce":0}]},"addr":"172.21.15.116:6789/0","public_addr":"172.21.15.116:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-08-19T00:05:27.230 INFO:teuthology.orchestra.run.smithi171.stderr:dumped monmap epoch 3 2024-08-19T00:05:27.232 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:27.231+0000 7fa6e08d2640 1 -- 172.21.15.171:0/1775787833 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fa6bc0394f0 msgr2=0x7fa6bc03b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:05:27.232 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:27.231+0000 7fa6e08d2640 1 --2- 172.21.15.171:0/1775787833 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fa6bc0394f0 0x7fa6bc03b9b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc005940 tx=0x7fa6cc005850 comp rx=0 tx=0).stop 2024-08-19T00:05:27.232 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:27.231+0000 7fa6e08d2640 1 -- 172.21.15.171:0/1775787833 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa6dc197670 msgr2=0x7fa6dc19ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:05:27.232 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:27.231+0000 7fa6e08d2640 1 --2- 172.21.15.171:0/1775787833 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa6dc197670 0x7fa6dc19ba00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa6d000b450 tx=0x7fa6d000b910 comp rx=0 tx=0).stop 2024-08-19T00:05:27.232 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:27.231+0000 7fa6e08d2640 1 -- 172.21.15.171:0/1775787833 shutdown_connections 2024-08-19T00:05:27.232 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:27.231+0000 7fa6e08d2640 1 --2- 172.21.15.171:0/1775787833 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fa6bc0394f0 0x7fa6bc03b9b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:05:27.232 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:27.231+0000 7fa6e08d2640 1 --2- 172.21.15.171:0/1775787833 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa6dc19bf40 0x7fa6dc19c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:05:27.232 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:27.231+0000 7fa6e08d2640 1 --2- 172.21.15.171:0/1775787833 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa6dc197670 0x7fa6dc19ba00 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:05:27.232 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:27.231+0000 7fa6e08d2640 1 --2- 172.21.15.171:0/1775787833 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa6c4003530 0x7fa6dc197130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:05:27.232 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:27.231+0000 7fa6e08d2640 1 -- 172.21.15.171:0/1775787833 >> 172.21.15.171:0/1775787833 conn(0x7fa6dc0fbf50 msgr2=0x7fa6dc0fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:05:27.232 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:27.231+0000 7fa6e08d2640 1 -- 172.21.15.171:0/1775787833 shutdown_connections 2024-08-19T00:05:27.232 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:27.231+0000 7fa6e08d2640 1 -- 172.21.15.171:0/1775787833 wait complete. 2024-08-19T00:05:27.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:27 smithi171 ceph-mon[21810]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:27.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:27 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:05:27.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:27 smithi171 ceph-mon[21810]: from='client.? 172.21.15.171:0/1775787833' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-19T00:05:27.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:27 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-19T00:05:27.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:27 smithi044 ceph-mon[18489]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:27.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:27 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:05:27.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:27 smithi044 ceph-mon[18489]: from='client.? 172.21.15.171:0/1775787833' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-19T00:05:27.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:27 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-19T00:05:28.100 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-08-19T00:05:28.101 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph config generate-minimal-conf 2024-08-19T00:05:28.361 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:05:28.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:28 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-19T00:05:28.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:28 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-19T00:05:28.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:28 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-19T00:05:28.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:28 smithi116 ceph-mon[21873]: mon.a calling monitor election 2024-08-19T00:05:28.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:28 smithi116 ceph-mon[21873]: mon.c calling monitor election 2024-08-19T00:05:28.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:28 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-19T00:05:28.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:28 smithi116 ceph-mon[21873]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:28.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:28 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-19T00:05:28.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:28 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-19T00:05:28.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:28 smithi116 ceph-mon[21873]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:28.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:28 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-19T00:05:28.617 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:28 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-19T00:05:28.617 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:28 smithi116 ceph-mon[21873]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-08-19T00:05:28.617 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:28 smithi116 ceph-mon[21873]: monmap epoch 3 2024-08-19T00:05:28.617 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:28 smithi116 ceph-mon[21873]: fsid 647ded64-5dbe-11ef-bccf-c7b262605968 2024-08-19T00:05:28.617 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:28 smithi116 ceph-mon[21873]: last_changed 2024-08-19T00:05:21.320665+0000 2024-08-19T00:05:28.617 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:28 smithi116 ceph-mon[21873]: created 2024-08-19T00:03:40.850741+0000 2024-08-19T00:05:28.617 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:28 smithi116 ceph-mon[21873]: min_mon_release 19 (squid) 2024-08-19T00:05:28.617 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:28 smithi116 ceph-mon[21873]: election_strategy: 1 2024-08-19T00:05:28.617 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:28 smithi116 ceph-mon[21873]: 0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-08-19T00:05:28.617 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:28 smithi116 ceph-mon[21873]: 1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.c 2024-08-19T00:05:28.617 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:28 smithi116 ceph-mon[21873]: 2: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.b 2024-08-19T00:05:28.617 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:28 smithi116 ceph-mon[21873]: fsmap 2024-08-19T00:05:28.617 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:28 smithi116 ceph-mon[21873]: osdmap e4: 0 total, 0 up, 0 in 2024-08-19T00:05:28.617 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:28 smithi116 ceph-mon[21873]: mgrmap e13: x(active, since 47s) 2024-08-19T00:05:28.617 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:28 smithi116 ceph-mon[21873]: overall HEALTH_OK 2024-08-19T00:05:28.618 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:28 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:28.618 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:28 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:28.618 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:28 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:28.618 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:28 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:28.618 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:28 smithi116 ceph-mon[21873]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:28.618 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:28 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:05:28.618 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:28 smithi116 ceph-mon[21873]: from='client.? 172.21.15.171:0/1775787833' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-19T00:05:28.618 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:28 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-19T00:05:28.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:28.856+0000 7f921af16640 1 -- 172.21.15.44:0/1013240556 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9214100400 msgr2=0x7f92141007e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:05:28.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:28.856+0000 7f921af16640 1 --2- 172.21.15.44:0/1013240556 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9214100400 0x7f92141007e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9208009880 tx=0x7f920802a5d0 comp rx=0 tx=0).stop 2024-08-19T00:05:28.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:28.856+0000 7f921af16640 1 -- 172.21.15.44:0/1013240556 shutdown_connections 2024-08-19T00:05:28.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:28.857+0000 7f921af16640 1 --2- 172.21.15.44:0/1013240556 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9214100400 0x7f92141007e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:05:28.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:28.857+0000 7f921af16640 1 -- 172.21.15.44:0/1013240556 >> 172.21.15.44:0/1013240556 conn(0x7f92140fbe60 msgr2=0x7f92140fe280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:05:28.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:28.857+0000 7f921af16640 1 -- 172.21.15.44:0/1013240556 shutdown_connections 2024-08-19T00:05:28.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:28.857+0000 7f921af16640 1 -- 172.21.15.44:0/1013240556 wait complete. 2024-08-19T00:05:28.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:28.857+0000 7f921af16640 1 Processor -- start 2024-08-19T00:05:28.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:28.857+0000 7f921af16640 1 -- start start 2024-08-19T00:05:28.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:28.857+0000 7f921af16640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9214100400 0x7f9214199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:05:28.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:28.857+0000 7f921af16640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9214199870 0x7f921419dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:05:28.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:28.857+0000 7f921af16640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f921419e140 0x7f921419e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:05:28.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:28.857+0000 7f921af16640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f921410a800 con 0x7f921419e140 2024-08-19T00:05:28.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:28.857+0000 7f921af16640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f921410a680 con 0x7f9214199870 2024-08-19T00:05:28.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:28.857+0000 7f921af16640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f921410a980 con 0x7f9214100400 2024-08-19T00:05:28.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:28.858+0000 7f92194b3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f921419e140 0x7f921419e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:05:28.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:28.858+0000 7f92194b3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f921419e140 0x7f921419e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41402/0 (socket says 172.21.15.44:41402) 2024-08-19T00:05:28.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:28.858+0000 7f92194b3640 1 -- 172.21.15.44:0/2556051345 learned_addr learned my addr 172.21.15.44:0/2556051345 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:05:28.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:28.858+0000 7f9218cb2640 1 --2- 172.21.15.44:0/2556051345 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9214100400 0x7f9214199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:05:28.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:28.858+0000 7f9213fff640 1 --2- 172.21.15.44:0/2556051345 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9214199870 0x7f921419dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:05:28.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:28.858+0000 7f92194b3640 1 -- 172.21.15.44:0/2556051345 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9214100400 msgr2=0x7f9214199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:05:28.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:28.858+0000 7f92194b3640 1 --2- 172.21.15.44:0/2556051345 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9214100400 0x7f9214199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:05:28.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:28.858+0000 7f92194b3640 1 -- 172.21.15.44:0/2556051345 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9214199870 msgr2=0x7f921419dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:05:28.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:28.858+0000 7f92194b3640 1 --2- 172.21.15.44:0/2556051345 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9214199870 0x7f921419dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:05:28.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:28.858+0000 7f92194b3640 1 -- 172.21.15.44:0/2556051345 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92141a5eb0 con 0x7f921419e140 2024-08-19T00:05:28.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:28.858+0000 7f92194b3640 1 --2- 172.21.15.44:0/2556051345 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f921419e140 0x7f921419e5f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f920c00ba50 tx=0x7f920c00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:05:28.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:28.858+0000 7f9211ffb640 1 -- 172.21.15.44:0/2556051345 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f920c019070 con 0x7f921419e140 2024-08-19T00:05:28.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:28.858+0000 7f9211ffb640 1 -- 172.21.15.44:0/2556051345 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f920c00cbe0 con 0x7f921419e140 2024-08-19T00:05:28.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:28.858+0000 7f9211ffb640 1 -- 172.21.15.44:0/2556051345 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f920c0076a0 con 0x7f921419e140 2024-08-19T00:05:28.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:28.858+0000 7f921af16640 1 -- 172.21.15.44:0/2556051345 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92141a60e0 con 0x7f921419e140 2024-08-19T00:05:28.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:28.859+0000 7f921af16640 1 -- 172.21.15.44:0/2556051345 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92141a6640 con 0x7f921419e140 2024-08-19T00:05:28.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:28.859+0000 7f9211ffb640 1 -- 172.21.15.44:0/2556051345 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f920c01c070 con 0x7f921419e140 2024-08-19T00:05:28.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:28.860+0000 7f9211ffb640 1 --2- 172.21.15.44:0/2556051345 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f92040394f0 0x7f920403b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:05:28.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:28.860+0000 7f9211ffb640 1 -- 172.21.15.44:0/2556051345 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f920c04b9d0 con 0x7f921419e140 2024-08-19T00:05:28.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:28.860+0000 7f921af16640 1 -- 172.21.15.44:0/2556051345 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9214100860 con 0x7f921419e140 2024-08-19T00:05:28.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:28.860+0000 7f9218cb2640 1 --2- 172.21.15.44:0/2556051345 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f92040394f0 0x7f920403b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:05:28.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:28.860+0000 7f9218cb2640 1 --2- 172.21.15.44:0/2556051345 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f92040394f0 0x7f920403b9b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9208009230 tx=0x7f9208005a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:05:28.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:28.865+0000 7f9211ffb640 1 -- 172.21.15.44:0/2556051345 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f920c0133a0 con 0x7f921419e140 2024-08-19T00:05:29.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:29.047+0000 7f921af16640 1 -- 172.21.15.44:0/2556051345 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f92141a6900 con 0x7f921419e140 2024-08-19T00:05:29.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:29.047+0000 7f9211ffb640 1 -- 172.21.15.44:0/2556051345 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+275 (secure 0 0 0) 0x7f920c012340 con 0x7f921419e140 2024-08-19T00:05:29.049 INFO:teuthology.orchestra.run.smithi044.stdout:# minimal ceph.conf for 647ded64-5dbe-11ef-bccf-c7b262605968 2024-08-19T00:05:29.049 INFO:teuthology.orchestra.run.smithi044.stdout:[global] 2024-08-19T00:05:29.049 INFO:teuthology.orchestra.run.smithi044.stdout: fsid = 647ded64-5dbe-11ef-bccf-c7b262605968 2024-08-19T00:05:29.049 INFO:teuthology.orchestra.run.smithi044.stdout: mon_host = [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-08-19T00:05:29.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:29.049+0000 7f921af16640 1 -- 172.21.15.44:0/2556051345 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f92040394f0 msgr2=0x7f920403b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:05:29.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:29.049+0000 7f921af16640 1 --2- 172.21.15.44:0/2556051345 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f92040394f0 0x7f920403b9b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9208009230 tx=0x7f9208005a40 comp rx=0 tx=0).stop 2024-08-19T00:05:29.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:29.049+0000 7f921af16640 1 -- 172.21.15.44:0/2556051345 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f921419e140 msgr2=0x7f921419e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:05:29.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:29.049+0000 7f921af16640 1 --2- 172.21.15.44:0/2556051345 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f921419e140 0x7f921419e5f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f920c00ba50 tx=0x7f920c00bf10 comp rx=0 tx=0).stop 2024-08-19T00:05:29.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:29.050+0000 7f921af16640 1 -- 172.21.15.44:0/2556051345 shutdown_connections 2024-08-19T00:05:29.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:29.050+0000 7f921af16640 1 --2- 172.21.15.44:0/2556051345 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f92040394f0 0x7f920403b9b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:05:29.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:29.050+0000 7f921af16640 1 --2- 172.21.15.44:0/2556051345 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f921419e140 0x7f921419e5f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:05:29.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:29.050+0000 7f921af16640 1 --2- 172.21.15.44:0/2556051345 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9214199870 0x7f921419dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:05:29.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:29.050+0000 7f921af16640 1 --2- 172.21.15.44:0/2556051345 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9214100400 0x7f9214199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:05:29.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:29.050+0000 7f921af16640 1 -- 172.21.15.44:0/2556051345 >> 172.21.15.44:0/2556051345 conn(0x7f92140fbe60 msgr2=0x7f9214069bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:05:29.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:29.050+0000 7f921af16640 1 -- 172.21.15.44:0/2556051345 shutdown_connections 2024-08-19T00:05:29.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:29.050+0000 7f921af16640 1 -- 172.21.15.44:0/2556051345 wait complete. 2024-08-19T00:05:29.305 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:29 smithi044 ceph-mon[18489]: mon.b calling monitor election 2024-08-19T00:05:29.305 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:29 smithi044 ceph-mon[18489]: Updating smithi044:/etc/ceph/ceph.conf 2024-08-19T00:05:29.305 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:29 smithi044 ceph-mon[18489]: Updating smithi116:/etc/ceph/ceph.conf 2024-08-19T00:05:29.305 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:29 smithi044 ceph-mon[18489]: Updating smithi171:/etc/ceph/ceph.conf 2024-08-19T00:05:29.305 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:29 smithi044 ceph-mon[18489]: Updating smithi171:/var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-19T00:05:29.305 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:29 smithi044 ceph-mon[18489]: Updating smithi116:/var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-19T00:05:29.305 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:29 smithi044 ceph-mon[18489]: Updating smithi044:/var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-19T00:05:29.305 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:29 smithi044 ceph-mon[18489]: Reconfiguring mon.a (unknown last config time)... 2024-08-19T00:05:29.305 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:29 smithi044 ceph-mon[18489]: Reconfiguring daemon mon.a on smithi044 2024-08-19T00:05:29.305 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:29 smithi044 ceph-mon[18489]: mon.b calling monitor election 2024-08-19T00:05:29.306 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:29 smithi044 ceph-mon[18489]: mon.c calling monitor election 2024-08-19T00:05:29.306 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:29 smithi044 ceph-mon[18489]: mon.a calling monitor election 2024-08-19T00:05:29.306 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:29 smithi044 ceph-mon[18489]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-08-19T00:05:29.306 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:29 smithi044 ceph-mon[18489]: monmap epoch 3 2024-08-19T00:05:29.306 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:29 smithi044 ceph-mon[18489]: fsid 647ded64-5dbe-11ef-bccf-c7b262605968 2024-08-19T00:05:29.306 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:29 smithi044 ceph-mon[18489]: last_changed 2024-08-19T00:05:21.320665+0000 2024-08-19T00:05:29.306 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:29 smithi044 ceph-mon[18489]: created 2024-08-19T00:03:40.850741+0000 2024-08-19T00:05:29.306 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:29 smithi044 ceph-mon[18489]: min_mon_release 19 (squid) 2024-08-19T00:05:29.306 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:29 smithi044 ceph-mon[18489]: election_strategy: 1 2024-08-19T00:05:29.306 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:29 smithi044 ceph-mon[18489]: 0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-08-19T00:05:29.306 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:29 smithi044 ceph-mon[18489]: 1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.c 2024-08-19T00:05:29.306 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:29 smithi044 ceph-mon[18489]: 2: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.b 2024-08-19T00:05:29.306 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:29 smithi044 ceph-mon[18489]: fsmap 2024-08-19T00:05:29.307 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:29 smithi044 ceph-mon[18489]: osdmap e4: 0 total, 0 up, 0 in 2024-08-19T00:05:29.307 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:29 smithi044 ceph-mon[18489]: mgrmap e13: x(active, since 49s) 2024-08-19T00:05:29.307 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:29 smithi044 ceph-mon[18489]: overall HEALTH_OK 2024-08-19T00:05:29.307 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:29 smithi044 ceph-mon[18489]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:29.307 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:29 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:29.307 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:29 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/2556051345' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:05:29.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:29 smithi171 ceph-mon[21810]: mon.b calling monitor election 2024-08-19T00:05:29.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:29 smithi171 ceph-mon[21810]: Updating smithi044:/etc/ceph/ceph.conf 2024-08-19T00:05:29.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:29 smithi171 ceph-mon[21810]: Updating smithi116:/etc/ceph/ceph.conf 2024-08-19T00:05:29.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:29 smithi171 ceph-mon[21810]: Updating smithi171:/etc/ceph/ceph.conf 2024-08-19T00:05:29.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:29 smithi171 ceph-mon[21810]: Updating smithi171:/var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-19T00:05:29.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:29 smithi171 ceph-mon[21810]: Updating smithi116:/var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-19T00:05:29.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:29 smithi171 ceph-mon[21810]: Updating smithi044:/var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-19T00:05:29.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:29 smithi171 ceph-mon[21810]: Reconfiguring mon.a (unknown last config time)... 2024-08-19T00:05:29.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:29 smithi171 ceph-mon[21810]: Reconfiguring daemon mon.a on smithi044 2024-08-19T00:05:29.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:29 smithi171 ceph-mon[21810]: mon.b calling monitor election 2024-08-19T00:05:29.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:29 smithi171 ceph-mon[21810]: mon.c calling monitor election 2024-08-19T00:05:29.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:29 smithi171 ceph-mon[21810]: mon.a calling monitor election 2024-08-19T00:05:29.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:29 smithi171 ceph-mon[21810]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-08-19T00:05:29.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:29 smithi171 ceph-mon[21810]: monmap epoch 3 2024-08-19T00:05:29.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:29 smithi171 ceph-mon[21810]: fsid 647ded64-5dbe-11ef-bccf-c7b262605968 2024-08-19T00:05:29.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:29 smithi171 ceph-mon[21810]: last_changed 2024-08-19T00:05:21.320665+0000 2024-08-19T00:05:29.594 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:29 smithi171 ceph-mon[21810]: created 2024-08-19T00:03:40.850741+0000 2024-08-19T00:05:29.594 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:29 smithi171 ceph-mon[21810]: min_mon_release 19 (squid) 2024-08-19T00:05:29.594 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:29 smithi171 ceph-mon[21810]: election_strategy: 1 2024-08-19T00:05:29.594 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:29 smithi171 ceph-mon[21810]: 0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-08-19T00:05:29.594 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:29 smithi171 ceph-mon[21810]: 1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.c 2024-08-19T00:05:29.594 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:29 smithi171 ceph-mon[21810]: 2: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.b 2024-08-19T00:05:29.594 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:29 smithi171 ceph-mon[21810]: fsmap 2024-08-19T00:05:29.594 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:29 smithi171 ceph-mon[21810]: osdmap e4: 0 total, 0 up, 0 in 2024-08-19T00:05:29.594 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:29 smithi171 ceph-mon[21810]: mgrmap e13: x(active, since 49s) 2024-08-19T00:05:29.594 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:29 smithi171 ceph-mon[21810]: overall HEALTH_OK 2024-08-19T00:05:29.594 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:29 smithi171 ceph-mon[21810]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:29.594 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:29 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:29.594 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:29 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/2556051345' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:05:29.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:29 smithi116 ceph-mon[21873]: mon.b calling monitor election 2024-08-19T00:05:29.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:29 smithi116 ceph-mon[21873]: Updating smithi044:/etc/ceph/ceph.conf 2024-08-19T00:05:29.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:29 smithi116 ceph-mon[21873]: Updating smithi116:/etc/ceph/ceph.conf 2024-08-19T00:05:29.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:29 smithi116 ceph-mon[21873]: Updating smithi171:/etc/ceph/ceph.conf 2024-08-19T00:05:29.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:29 smithi116 ceph-mon[21873]: Updating smithi171:/var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-19T00:05:29.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:29 smithi116 ceph-mon[21873]: Updating smithi116:/var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-19T00:05:29.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:29 smithi116 ceph-mon[21873]: Updating smithi044:/var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-19T00:05:29.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:29 smithi116 ceph-mon[21873]: Reconfiguring mon.a (unknown last config time)... 2024-08-19T00:05:29.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:29 smithi116 ceph-mon[21873]: Reconfiguring daemon mon.a on smithi044 2024-08-19T00:05:29.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:29 smithi116 ceph-mon[21873]: mon.b calling monitor election 2024-08-19T00:05:29.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:29 smithi116 ceph-mon[21873]: mon.c calling monitor election 2024-08-19T00:05:29.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:29 smithi116 ceph-mon[21873]: mon.a calling monitor election 2024-08-19T00:05:29.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:29 smithi116 ceph-mon[21873]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-08-19T00:05:29.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:29 smithi116 ceph-mon[21873]: monmap epoch 3 2024-08-19T00:05:29.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:29 smithi116 ceph-mon[21873]: fsid 647ded64-5dbe-11ef-bccf-c7b262605968 2024-08-19T00:05:29.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:29 smithi116 ceph-mon[21873]: last_changed 2024-08-19T00:05:21.320665+0000 2024-08-19T00:05:29.617 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:29 smithi116 ceph-mon[21873]: created 2024-08-19T00:03:40.850741+0000 2024-08-19T00:05:29.617 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:29 smithi116 ceph-mon[21873]: min_mon_release 19 (squid) 2024-08-19T00:05:29.617 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:29 smithi116 ceph-mon[21873]: election_strategy: 1 2024-08-19T00:05:29.617 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:29 smithi116 ceph-mon[21873]: 0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-08-19T00:05:29.617 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:29 smithi116 ceph-mon[21873]: 1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.c 2024-08-19T00:05:29.617 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:29 smithi116 ceph-mon[21873]: 2: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.b 2024-08-19T00:05:29.617 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:29 smithi116 ceph-mon[21873]: fsmap 2024-08-19T00:05:29.617 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:29 smithi116 ceph-mon[21873]: osdmap e4: 0 total, 0 up, 0 in 2024-08-19T00:05:29.617 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:29 smithi116 ceph-mon[21873]: mgrmap e13: x(active, since 49s) 2024-08-19T00:05:29.617 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:29 smithi116 ceph-mon[21873]: overall HEALTH_OK 2024-08-19T00:05:29.617 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:29 smithi116 ceph-mon[21873]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:29.617 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:29 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:29.617 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:29 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/2556051345' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:05:29.954 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-08-19T00:05:29.955 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-08-19T00:05:29.955 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/ceph/ceph.conf 2024-08-19T00:05:29.983 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-08-19T00:05:29.983 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-19T00:05:30.049 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-08-19T00:05:30.050 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/ceph/ceph.conf 2024-08-19T00:05:30.079 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-08-19T00:05:30.079 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-19T00:05:30.146 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-08-19T00:05:30.146 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/ceph/ceph.conf 2024-08-19T00:05:30.178 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-08-19T00:05:30.178 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-19T00:05:30.250 INFO:tasks.cephadm:Adding mgr.x on smithi044 2024-08-19T00:05:30.250 INFO:tasks.cephadm:Adding mgr.y on smithi116 2024-08-19T00:05:30.250 INFO:tasks.cephadm:Adding mgr.z on smithi171 2024-08-19T00:05:30.250 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph orch apply mgr '3;smithi044=x;smithi116=y;smithi171=z' 2024-08-19T00:05:30.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:30 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-19T00:05:30.542 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.c/config 2024-08-19T00:05:30.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:30 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-19T00:05:30.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:30 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-19T00:05:30.984 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:30.981+0000 7f874a3fe640 1 -- 172.21.15.171:0/2366098378 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8744100320 msgr2=0x7f8744100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:05:30.984 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:30.981+0000 7f874a3fe640 1 --2- 172.21.15.171:0/2366098378 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8744100320 0x7f8744100720 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8734009880 tx=0x7f873402a5d0 comp rx=0 tx=0).stop 2024-08-19T00:05:30.984 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:30.981+0000 7f874a3fe640 1 -- 172.21.15.171:0/2366098378 shutdown_connections 2024-08-19T00:05:30.984 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:30.981+0000 7f874a3fe640 1 --2- 172.21.15.171:0/2366098378 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8744100320 0x7f8744100720 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:05:30.984 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:30.981+0000 7f874a3fe640 1 -- 172.21.15.171:0/2366098378 >> 172.21.15.171:0/2366098378 conn(0x7f87440fbad0 msgr2=0x7f87440fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:05:30.984 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:30.981+0000 7f874a3fe640 1 -- 172.21.15.171:0/2366098378 shutdown_connections 2024-08-19T00:05:30.984 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:30.981+0000 7f874a3fe640 1 -- 172.21.15.171:0/2366098378 wait complete. 2024-08-19T00:05:30.985 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:30.981+0000 7f874a3fe640 1 Processor -- start 2024-08-19T00:05:30.985 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:30.981+0000 7f874a3fe640 1 -- start start 2024-08-19T00:05:30.985 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:30.981+0000 7f874a3fe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8744100320 0x7f874406acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:05:30.985 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:30.981+0000 7f874a3fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f874419be30 0x7f874419e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:05:30.985 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:30.982+0000 7f874a3fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f874419e760 0x7f87441a0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:05:30.985 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:30.982+0000 7f874a3fe640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f87441063e0 con 0x7f874419be30 2024-08-19T00:05:30.985 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:30.982+0000 7f874a3fe640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f8744106260 con 0x7f874419e760 2024-08-19T00:05:30.985 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:30.982+0000 7f874a3fe640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8744106560 con 0x7f8744100320 2024-08-19T00:05:30.985 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:30.982+0000 7f8743fff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8744100320 0x7f874406acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:05:30.985 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:30.982+0000 7f873bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f874419be30 0x7f874419e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:05:30.985 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:30.982+0000 7f8743fff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8744100320 0x7f874406acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:52604/0 (socket says 172.21.15.171:52604) 2024-08-19T00:05:30.985 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:30.982+0000 7f8743fff640 1 -- 172.21.15.171:0/2548143222 learned_addr learned my addr 172.21.15.171:0/2548143222 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-08-19T00:05:30.985 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:30.982+0000 7f8743fff640 1 -- 172.21.15.171:0/2548143222 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f874419e760 msgr2=0x7f87441a0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:05:30.986 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:30.982+0000 7f8743fff640 1 --2- 172.21.15.171:0/2548143222 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f874419e760 0x7f87441a0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:05:30.986 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:30.982+0000 7f8743fff640 1 -- 172.21.15.171:0/2548143222 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f874419be30 msgr2=0x7f874419e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:05:30.986 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:30.982+0000 7f8743fff640 1 --2- 172.21.15.171:0/2548143222 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f874419be30 0x7f874419e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:05:30.986 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:30.982+0000 7f8743fff640 1 -- 172.21.15.171:0/2548143222 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87441a1340 con 0x7f8744100320 2024-08-19T00:05:30.986 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:30.982+0000 7f873bfff640 1 --2- 172.21.15.171:0/2548143222 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f874419be30 0x7f874419e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:05:30.986 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:30.982+0000 7f8743fff640 1 --2- 172.21.15.171:0/2548143222 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8744100320 0x7f874406acc0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8734031610 tx=0x7f87340043c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:05:30.986 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:30.982+0000 7f8741ffb640 1 -- 172.21.15.171:0/2548143222 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f873403f030 con 0x7f8744100320 2024-08-19T00:05:30.986 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:30.983+0000 7f8741ffb640 1 -- 172.21.15.171:0/2548143222 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8734003ce0 con 0x7f8744100320 2024-08-19T00:05:30.986 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:30.983+0000 7f874a3fe640 1 -- 172.21.15.171:0/2548143222 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87441a1570 con 0x7f8744100320 2024-08-19T00:05:30.986 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:30.983+0000 7f8741ffb640 1 -- 172.21.15.171:0/2548143222 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8734035070 con 0x7f8744100320 2024-08-19T00:05:30.986 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:30.983+0000 7f874a3fe640 1 -- 172.21.15.171:0/2548143222 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87441a1b20 con 0x7f8744100320 2024-08-19T00:05:30.987 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:30.983+0000 7f8741ffb640 1 -- 172.21.15.171:0/2548143222 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f8734042030 con 0x7f8744100320 2024-08-19T00:05:30.987 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:30.984+0000 7f8741ffb640 1 --2- 172.21.15.171:0/2548143222 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f8730039520 0x7f873003b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:05:30.987 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:30.984+0000 7f8741ffb640 1 -- 172.21.15.171:0/2548143222 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f873406ca50 con 0x7f8744100320 2024-08-19T00:05:30.987 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:30.984+0000 7f874a3fe640 1 -- 172.21.15.171:0/2548143222 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f874418f1a0 con 0x7f8744100320 2024-08-19T00:05:30.987 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:30.984+0000 7f873bfff640 1 --2- 172.21.15.171:0/2548143222 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f8730039520 0x7f873003b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:05:30.988 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:30.984+0000 7f873bfff640 1 --2- 172.21.15.171:0/2548143222 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f8730039520 0x7f873003b9e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f874406b240 tx=0x7f872c009190 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:05:30.990 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:30.989+0000 7f8741ffb640 1 -- 172.21.15.171:0/2548143222 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f873404c350 con 0x7f8744100320 2024-08-19T00:05:31.166 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:31.165+0000 7f874a3fe640 1 -- 172.21.15.171:0/2548143222 --> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi044=x;smithi116=y;smithi171=z", "target": ["mon-mgr", ""]}) -- 0x7f87440623f0 con 0x7f8730039520 2024-08-19T00:05:31.172 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:31.172+0000 7f8741ffb640 1 -- 172.21.15.171:0/2548143222 <== mgr.14150 v2:172.21.15.44:6800/1330072146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f87440623f0 con 0x7f8730039520 2024-08-19T00:05:31.173 INFO:teuthology.orchestra.run.smithi171.stdout:Scheduled mgr update... 2024-08-19T00:05:31.175 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:31.174+0000 7f874a3fe640 1 -- 172.21.15.171:0/2548143222 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f8730039520 msgr2=0x7f873003b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:05:31.175 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:31.174+0000 7f874a3fe640 1 --2- 172.21.15.171:0/2548143222 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f8730039520 0x7f873003b9e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f874406b240 tx=0x7f872c009190 comp rx=0 tx=0).stop 2024-08-19T00:05:31.175 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:31.174+0000 7f874a3fe640 1 -- 172.21.15.171:0/2548143222 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8744100320 msgr2=0x7f874406acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:05:31.175 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:31.174+0000 7f874a3fe640 1 --2- 172.21.15.171:0/2548143222 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8744100320 0x7f874406acc0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8734031610 tx=0x7f87340043c0 comp rx=0 tx=0).stop 2024-08-19T00:05:31.175 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:31.174+0000 7f874a3fe640 1 -- 172.21.15.171:0/2548143222 shutdown_connections 2024-08-19T00:05:31.175 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:31.174+0000 7f874a3fe640 1 --2- 172.21.15.171:0/2548143222 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f8730039520 0x7f873003b9e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:05:31.175 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:31.174+0000 7f874a3fe640 1 --2- 172.21.15.171:0/2548143222 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f874419e760 0x7f87441a0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:05:31.175 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:31.174+0000 7f874a3fe640 1 --2- 172.21.15.171:0/2548143222 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f874419be30 0x7f874419e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:05:31.175 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:31.174+0000 7f874a3fe640 1 --2- 172.21.15.171:0/2548143222 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8744100320 0x7f874406acc0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:05:31.175 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:31.174+0000 7f874a3fe640 1 -- 172.21.15.171:0/2548143222 >> 172.21.15.171:0/2548143222 conn(0x7f87440fbad0 msgr2=0x7f87440fc620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:05:31.176 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:31.174+0000 7f874a3fe640 1 -- 172.21.15.171:0/2548143222 shutdown_connections 2024-08-19T00:05:31.176 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:05:31.174+0000 7f874a3fe640 1 -- 172.21.15.171:0/2548143222 wait complete. 2024-08-19T00:05:31.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:31 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:31.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:31 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:31.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:31 smithi116 ceph-mon[21873]: Reconfiguring mon.b (monmap changed)... 2024-08-19T00:05:31.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:31 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-19T00:05:31.617 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:31 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-19T00:05:31.617 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:31 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:05:31.617 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:31 smithi116 ceph-mon[21873]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:31.617 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:31 smithi116 ceph-mon[21873]: Reconfiguring daemon mon.b on smithi116 2024-08-19T00:05:31.617 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:31 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:31.683 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:31 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:31.683 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:31 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:31.683 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:31 smithi171 ceph-mon[21810]: Reconfiguring mon.b (monmap changed)... 2024-08-19T00:05:31.683 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:31 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-19T00:05:31.684 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:31 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-19T00:05:31.684 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:31 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:05:31.684 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:31 smithi171 ceph-mon[21810]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:31.684 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:31 smithi171 ceph-mon[21810]: Reconfiguring daemon mon.b on smithi116 2024-08-19T00:05:31.684 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:31 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:31.789 DEBUG:teuthology.orchestra.run.smithi116:mgr.y> sudo journalctl -f -n 0 -u ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mgr.y.service 2024-08-19T00:05:31.792 DEBUG:teuthology.orchestra.run.smithi171:mgr.z> sudo journalctl -f -n 0 -u ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mgr.z.service 2024-08-19T00:05:31.794 INFO:tasks.cephadm:Deploying OSDs... 2024-08-19T00:05:31.794 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-08-19T00:05:31.794 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/scratch_devs of=/dev/stdout 2024-08-19T00:05:31.814 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-19T00:05:31.817 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_1 2024-08-19T00:05:31.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:31 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:31.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:31 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:31.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:31 smithi044 ceph-mon[18489]: Reconfiguring mon.b (monmap changed)... 2024-08-19T00:05:31.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:31 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-19T00:05:31.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:31 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-19T00:05:31.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:31 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:05:31.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:31 smithi044 ceph-mon[18489]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:31.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:31 smithi044 ceph-mon[18489]: Reconfiguring daemon mon.b on smithi116 2024-08-19T00:05:31.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:31 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:31.872 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-19T00:05:31.872 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-19T00:05:31.872 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-08-19T00:05:31.872 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-19T00:05:31.872 INFO:teuthology.orchestra.run.smithi044.stdout:Context: system_u:object_r:device_t:s0 2024-08-19T00:05:31.873 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-08-19 00:04:49.078750881 +0000 2024-08-19T00:05:31.873 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-08-19 00:00:33.874230425 +0000 2024-08-19T00:05:31.873 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-08-19 00:00:33.874230425 +0000 2024-08-19T00:05:31.873 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: 2024-08-19 00:00:33.874230425 +0000 2024-08-19T00:05:31.873 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-19T00:05:31.939 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-08-19T00:05:31.939 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-08-19T00:05:31.940 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000223528 s, 2.3 MB/s 2024-08-19T00:05:31.941 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-19T00:05:31.999 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_2 2024-08-19T00:05:32.056 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-19T00:05:32.056 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-19T00:05:32.056 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-08-19T00:05:32.056 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-19T00:05:32.056 INFO:teuthology.orchestra.run.smithi044.stdout:Context: system_u:object_r:device_t:s0 2024-08-19T00:05:32.056 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-08-19 00:04:49.105750485 +0000 2024-08-19T00:05:32.056 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-08-19 00:00:34.200229596 +0000 2024-08-19T00:05:32.056 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-08-19 00:00:34.200229596 +0000 2024-08-19T00:05:32.056 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: 2024-08-19 00:00:34.200229596 +0000 2024-08-19T00:05:32.057 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-19T00:05:32.121 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-08-19T00:05:32.122 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-08-19T00:05:32.122 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000235662 s, 2.2 MB/s 2024-08-19T00:05:32.123 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-19T00:05:32.180 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_3 2024-08-19T00:05:32.238 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-19T00:05:32.238 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-19T00:05:32.238 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 5h/5d Inode: 701 Links: 1 2024-08-19T00:05:32.238 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-19T00:05:32.238 INFO:teuthology.orchestra.run.smithi044.stdout:Context: system_u:object_r:device_t:s0 2024-08-19T00:05:32.238 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-08-19 00:04:49.131750103 +0000 2024-08-19T00:05:32.238 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-08-19 00:00:34.533228749 +0000 2024-08-19T00:05:32.238 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-08-19 00:00:34.533228749 +0000 2024-08-19T00:05:32.238 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: 2024-08-19 00:00:34.533228749 +0000 2024-08-19T00:05:32.239 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-19T00:05:32.304 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-08-19T00:05:32.304 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-08-19T00:05:32.304 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000236868 s, 2.2 MB/s 2024-08-19T00:05:32.306 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-19T00:05:32.363 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_4 2024-08-19T00:05:32.420 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-19T00:05:32.420 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-19T00:05:32.420 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-08-19T00:05:32.420 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-19T00:05:32.420 INFO:teuthology.orchestra.run.smithi044.stdout:Context: system_u:object_r:device_t:s0 2024-08-19T00:05:32.420 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-08-19 00:04:49.158749706 +0000 2024-08-19T00:05:32.420 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-08-19 00:00:34.861227915 +0000 2024-08-19T00:05:32.420 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-08-19 00:00:34.861227915 +0000 2024-08-19T00:05:32.420 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: 2024-08-19 00:00:34.861227915 +0000 2024-08-19T00:05:32.420 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-19T00:05:32.485 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-08-19T00:05:32.485 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-08-19T00:05:32.485 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000242204 s, 2.1 MB/s 2024-08-19T00:05:32.486 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-19T00:05:32.543 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-08-19T00:05:32.543 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/scratch_devs of=/dev/stdout 2024-08-19T00:05:32.559 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-19T00:05:32.560 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_1 2024-08-19T00:05:32.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:32 smithi171 ceph-mon[21810]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi044=x;smithi116=y;smithi171=z", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:05:32.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:32 smithi171 ceph-mon[21810]: Saving service mgr spec with placement smithi044=x;smithi116=y;smithi171=z;count:3 2024-08-19T00:05:32.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:32 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:32.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:32 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:32.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:32 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-19T00:05:32.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:32 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-19T00:05:32.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:32 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:05:32.616 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-19T00:05:32.616 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-19T00:05:32.616 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-08-19T00:05:32.616 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-19T00:05:32.616 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2024-08-19T00:05:32.617 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2024-08-19 00:05:20.790319910 +0000 2024-08-19T00:05:32.617 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2024-08-19 00:00:49.915667934 +0000 2024-08-19T00:05:32.617 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2024-08-19 00:00:49.915667934 +0000 2024-08-19T00:05:32.617 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: 2024-08-19 00:00:49.915667934 +0000 2024-08-19T00:05:32.617 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-19T00:05:32.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:32 smithi044 ceph-mon[18489]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi044=x;smithi116=y;smithi171=z", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:05:32.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:32 smithi044 ceph-mon[18489]: Saving service mgr spec with placement smithi044=x;smithi116=y;smithi171=z;count:3 2024-08-19T00:05:32.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:32 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:32.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:32 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:32.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:32 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-19T00:05:32.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:32 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-19T00:05:32.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:32 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:05:32.679 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:32 smithi116 ceph-mon[21873]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi044=x;smithi116=y;smithi171=z", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:05:32.679 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:32 smithi116 ceph-mon[21873]: Saving service mgr spec with placement smithi044=x;smithi116=y;smithi171=z;count:3 2024-08-19T00:05:32.679 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:32 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:32.679 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:32 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:32.679 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:32 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-19T00:05:32.679 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:32 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-19T00:05:32.679 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:32 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:05:32.681 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2024-08-19T00:05:32.681 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2024-08-19T00:05:32.681 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.00025105 s, 2.0 MB/s 2024-08-19T00:05:32.683 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-19T00:05:32.739 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_2 2024-08-19T00:05:32.795 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-19T00:05:32.795 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-19T00:05:32.795 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-08-19T00:05:32.795 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-19T00:05:32.795 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2024-08-19T00:05:32.795 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2024-08-19 00:05:20.790319910 +0000 2024-08-19T00:05:32.795 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2024-08-19 00:00:50.234667990 +0000 2024-08-19T00:05:32.795 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2024-08-19 00:00:50.234667990 +0000 2024-08-19T00:05:32.796 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: 2024-08-19 00:00:50.234667990 +0000 2024-08-19T00:05:32.796 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-19T00:05:32.859 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2024-08-19T00:05:32.859 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2024-08-19T00:05:32.859 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000225593 s, 2.3 MB/s 2024-08-19T00:05:32.860 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-19T00:05:32.916 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_3 2024-08-19T00:05:32.971 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-19T00:05:32.971 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-19T00:05:32.972 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-08-19T00:05:32.972 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-19T00:05:32.972 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2024-08-19T00:05:32.972 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2024-08-19 00:05:20.790319910 +0000 2024-08-19T00:05:32.972 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2024-08-19 00:00:50.563668048 +0000 2024-08-19T00:05:32.972 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2024-08-19 00:00:50.563668048 +0000 2024-08-19T00:05:32.972 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: 2024-08-19 00:00:50.563668048 +0000 2024-08-19T00:05:32.972 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-19T00:05:33.034 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2024-08-19T00:05:33.035 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2024-08-19T00:05:33.036 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000203276 s, 2.5 MB/s 2024-08-19T00:05:33.037 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-19T00:05:33.093 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_4 2024-08-19T00:05:33.147 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-19T00:05:33.148 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-19T00:05:33.148 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-08-19T00:05:33.148 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-19T00:05:33.148 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2024-08-19T00:05:33.148 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2024-08-19 00:05:20.791319895 +0000 2024-08-19T00:05:33.148 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2024-08-19 00:00:50.883668104 +0000 2024-08-19T00:05:33.148 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2024-08-19 00:00:50.883668104 +0000 2024-08-19T00:05:33.148 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: 2024-08-19 00:00:50.883668104 +0000 2024-08-19T00:05:33.148 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-19T00:05:33.210 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2024-08-19T00:05:33.210 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2024-08-19T00:05:33.210 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.00019753 s, 2.6 MB/s 2024-08-19T00:05:33.211 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-19T00:05:33.267 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-08-19T00:05:33.267 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/scratch_devs of=/dev/stdout 2024-08-19T00:05:33.283 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-19T00:05:33.283 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_1 2024-08-19T00:05:33.338 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-19T00:05:33.338 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-19T00:05:33.338 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-08-19T00:05:33.339 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-19T00:05:33.339 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0 2024-08-19T00:05:33.339 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-08-19 00:05:11.385865143 +0000 2024-08-19T00:05:33.339 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-08-19 00:00:50.792985801 +0000 2024-08-19T00:05:33.339 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-08-19 00:00:50.792985801 +0000 2024-08-19T00:05:33.339 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: 2024-08-19 00:00:50.792985801 +0000 2024-08-19T00:05:33.339 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-19T00:05:33.402 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-08-19T00:05:33.402 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-08-19T00:05:33.403 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.00020908 s, 2.4 MB/s 2024-08-19T00:05:33.404 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-19T00:05:33.459 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_2 2024-08-19T00:05:33.515 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-19T00:05:33.515 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-19T00:05:33.515 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 5h/5d Inode: 682 Links: 1 2024-08-19T00:05:33.515 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-19T00:05:33.515 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0 2024-08-19T00:05:33.515 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-08-19 00:05:11.385865143 +0000 2024-08-19T00:05:33.515 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-08-19 00:00:51.130981823 +0000 2024-08-19T00:05:33.516 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-08-19 00:00:51.130981823 +0000 2024-08-19T00:05:33.516 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: 2024-08-19 00:00:51.130981823 +0000 2024-08-19T00:05:33.516 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-19T00:05:33.578 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:33 smithi171 ceph-mon[21810]: Reconfiguring mon.c (monmap changed)... 2024-08-19T00:05:33.578 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:33 smithi171 ceph-mon[21810]: Reconfiguring daemon mon.c on smithi171 2024-08-19T00:05:33.578 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:33 smithi171 ceph-mon[21810]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:33.578 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:33 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:33.578 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:33 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:33.578 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:33 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:05:33.578 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:33 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:05:33.578 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:33 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:05:33.578 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:33 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:33.579 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:33 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-19T00:05:33.579 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:33 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-19T00:05:33.579 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:33 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-19T00:05:33.579 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:33 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:05:33.580 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-08-19T00:05:33.580 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-08-19T00:05:33.580 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000246554 s, 2.1 MB/s 2024-08-19T00:05:33.581 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-19T00:05:33.638 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_3 2024-08-19T00:05:33.693 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-19T00:05:33.693 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-19T00:05:33.693 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-08-19T00:05:33.693 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-19T00:05:33.693 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0 2024-08-19T00:05:33.693 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-08-19 00:05:11.385865143 +0000 2024-08-19T00:05:33.694 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-08-19 00:00:51.442978150 +0000 2024-08-19T00:05:33.694 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-08-19 00:00:51.442978150 +0000 2024-08-19T00:05:33.694 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: 2024-08-19 00:00:51.442978150 +0000 2024-08-19T00:05:33.694 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-19T00:05:33.757 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-08-19T00:05:33.757 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-08-19T00:05:33.757 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000214447 s, 2.4 MB/s 2024-08-19T00:05:33.758 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-19T00:05:33.814 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_4 2024-08-19T00:05:33.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:33 smithi116 ceph-mon[21873]: Reconfiguring mon.c (monmap changed)... 2024-08-19T00:05:33.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:33 smithi116 ceph-mon[21873]: Reconfiguring daemon mon.c on smithi171 2024-08-19T00:05:33.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:33 smithi116 ceph-mon[21873]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:33.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:33 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:33.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:33 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:33.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:33 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:05:33.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:33 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:05:33.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:33 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:05:33.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:33 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:33.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:33 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-19T00:05:33.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:33 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-19T00:05:33.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:33 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-19T00:05:33.867 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:33 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:05:33.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:33 smithi044 ceph-mon[18489]: Reconfiguring mon.c (monmap changed)... 2024-08-19T00:05:33.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:33 smithi044 ceph-mon[18489]: Reconfiguring daemon mon.c on smithi171 2024-08-19T00:05:33.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:33 smithi044 ceph-mon[18489]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:33.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:33 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:33.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:33 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:33.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:33 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:05:33.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:33 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:05:33.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:33 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:05:33.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:33 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:33.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:33 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-19T00:05:33.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:33 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-19T00:05:33.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:33 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-19T00:05:33.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:33 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:05:33.872 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-19T00:05:33.872 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-19T00:05:33.872 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-08-19T00:05:33.872 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-19T00:05:33.872 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0 2024-08-19T00:05:33.872 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-08-19 00:05:11.386865124 +0000 2024-08-19T00:05:33.872 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-08-19 00:00:51.769974301 +0000 2024-08-19T00:05:33.872 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-08-19 00:00:51.769974301 +0000 2024-08-19T00:05:33.872 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: 2024-08-19 00:00:51.769974301 +0000 2024-08-19T00:05:33.873 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-19T00:05:33.935 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-08-19T00:05:33.935 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-08-19T00:05:33.935 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000191337 s, 2.7 MB/s 2024-08-19T00:05:33.936 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-19T00:05:33.993 INFO:tasks.cephadm:Deploying osd.0 on smithi044 with /dev/vg_nvme/lv_4... 2024-08-19T00:05:33.993 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-08-19T00:05:34.254 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:05:34.504 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:34 smithi171 ceph-mon[21810]: Deploying daemon mgr.z on smithi171 2024-08-19T00:05:34.655 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:34 smithi044 ceph-mon[18489]: Deploying daemon mgr.z on smithi171 2024-08-19T00:05:34.842 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:05:34 smithi171 systemd[1]: Starting Ceph mgr.z for 647ded64-5dbe-11ef-bccf-c7b262605968... 2024-08-19T00:05:34.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:34 smithi116 ceph-mon[21873]: Deploying daemon mgr.z on smithi171 2024-08-19T00:05:35.292 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:05:34 smithi171 podman[23609]: 2024-08-19 00:05:34.883256211 +0000 UTC m=+0.108780425 container create b3b6a174db6ef44f1c5008b7ba8c315b7676fb48c0214384e664b5ecc7de3959 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-de09dd0) 2024-08-19T00:05:35.292 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:05:34 smithi171 podman[23609]: 2024-08-19 00:05:34.791600445 +0000 UTC m=+0.017124658 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-19T00:05:35.292 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:05:35 smithi171 podman[23609]: 2024-08-19 00:05:35.052609263 +0000 UTC m=+0.278133492 container init b3b6a174db6ef44f1c5008b7ba8c315b7676fb48c0214384e664b5ecc7de3959 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-z, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-de09dd0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-08-19T00:05:35.292 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:05:35 smithi171 podman[23609]: 2024-08-19 00:05:35.055548647 +0000 UTC m=+0.281072872 container start b3b6a174db6ef44f1c5008b7ba8c315b7676fb48c0214384e664b5ecc7de3959 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-z, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-de09dd0) 2024-08-19T00:05:35.292 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:05:35 smithi171 ceph-mgr[23628]: -- 172.21.15.171:0/359091330 <== mon.1 v2:172.21.15.171:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562576a150e0 con 0x5625769f2800 2024-08-19T00:05:35.293 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:05:35 smithi171 bash[23609]: b3b6a174db6ef44f1c5008b7ba8c315b7676fb48c0214384e664b5ecc7de3959 2024-08-19T00:05:35.293 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:05:35 smithi171 systemd[1]: Started Ceph mgr.z for 647ded64-5dbe-11ef-bccf-c7b262605968. 2024-08-19T00:05:35.293 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:05:35 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-z[23624]: 2024-08-19T00:05:35.290+0000 7fbd321e8040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-19T00:05:35.529 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:35 smithi044 ceph-mon[18489]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:35.529 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:35 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:35.529 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:35 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:35.529 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:35 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:35.529 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:35 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-19T00:05:35.529 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:35 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-19T00:05:35.529 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:35 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-19T00:05:35.529 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:35 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:05:35.529 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:35 smithi044 ceph-mon[18489]: Deploying daemon mgr.y on smithi116 2024-08-19T00:05:35.592 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:05:35 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-z[23624]: 2024-08-19T00:05:35.356+0000 7fbd321e8040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-19T00:05:35.592 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:05:35 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-z[23624]: 2024-08-19T00:05:35.499+0000 7fbd321e8040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-19T00:05:35.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:35 smithi171 ceph-mon[21810]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:35.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:35 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:35.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:35 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:35.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:35 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:35.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:35 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-19T00:05:35.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:35 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-19T00:05:35.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:35 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-19T00:05:35.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:35 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:05:35.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:35 smithi171 ceph-mon[21810]: Deploying daemon mgr.y on smithi116 2024-08-19T00:05:35.736 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:35 smithi116 ceph-mon[21873]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:35.736 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:35 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:35.736 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:35 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:35.736 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:35 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:35.736 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:35 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-19T00:05:35.736 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:35 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-19T00:05:35.736 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:35 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-19T00:05:35.736 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:35 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:05:35.736 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:35 smithi116 ceph-mon[21873]: Deploying daemon mgr.y on smithi116 2024-08-19T00:05:35.922 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:05:35 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-z[23624]: 2024-08-19T00:05:35.658+0000 7fbd321e8040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-19T00:05:35.922 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:05:35 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-z[23624]: 2024-08-19T00:05:35.799+0000 7fbd321e8040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-19T00:05:35.922 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:05:35 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-z[23624]: 2024-08-19T00:05:35.920+0000 7fbd321e8040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-19T00:05:36.342 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:05:36 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-z[23624]: 2024-08-19T00:05:36.046+0000 7fbd321e8040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-19T00:05:36.342 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:05:36 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-z[23624]: 2024-08-19T00:05:36.101+0000 7fbd321e8040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-19T00:05:36.476 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:05:36.500 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi044:vg_nvme/lv_4 2024-08-19T00:05:36.679 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:36 smithi171 ceph-mon[21810]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:36.679 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:05:36 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-z[23624]: 2024-08-19T00:05:36.404+0000 7fbd321e8040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-19T00:05:36.679 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:05:36 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-z[23624]: 2024-08-19T00:05:36.466+0000 7fbd321e8040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-19T00:05:36.679 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:05:36 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-z[23624]: 2024-08-19T00:05:36.532+0000 7fbd321e8040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-19T00:05:36.679 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:05:36 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-z[23624]: 2024-08-19T00:05:36.677+0000 7fbd321e8040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-08-19T00:05:36.699 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:36 smithi116 ceph-mon[21873]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:36.752 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:05:36.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:36 smithi044 ceph-mon[18489]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:36.988 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:05:36 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-z[23624]: 2024-08-19T00:05:36.737+0000 7fbd321e8040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-19T00:05:36.988 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:05:36 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-z[23624]: 2024-08-19T00:05:36.803+0000 7fbd321e8040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-19T00:05:36.988 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:05:36 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-z[23624]: 2024-08-19T00:05:36.987+0000 7fbd321e8040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-19T00:05:37.115 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:05:36 smithi116 systemd[1]: Starting Ceph mgr.y for 647ded64-5dbe-11ef-bccf-c7b262605968... 2024-08-19T00:05:37.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:37.174+0000 7f208b80c640 1 -- 172.21.15.44:0/3125502854 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2084101a40 msgr2=0x7f2084101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:05:37.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:37.174+0000 7f208b80c640 1 --2- 172.21.15.44:0/3125502854 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2084101a40 0x7f2084101ec0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2074009900 tx=0x7f207402a410 comp rx=0 tx=0).stop 2024-08-19T00:05:37.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:37.174+0000 7f208b80c640 1 -- 172.21.15.44:0/3125502854 shutdown_connections 2024-08-19T00:05:37.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:37.174+0000 7f208b80c640 1 --2- 172.21.15.44:0/3125502854 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2084102400 0x7f2084108c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:05:37.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:37.174+0000 7f208b80c640 1 --2- 172.21.15.44:0/3125502854 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2084101a40 0x7f2084101ec0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:05:37.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:37.174+0000 7f208b80c640 1 --2- 172.21.15.44:0/3125502854 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2084100840 0x7f2084100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:05:37.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:37.174+0000 7f208b80c640 1 -- 172.21.15.44:0/3125502854 >> 172.21.15.44:0/3125502854 conn(0x7f20840fbfd0 msgr2=0x7f20840fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:05:37.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:37.175+0000 7f208b80c640 1 -- 172.21.15.44:0/3125502854 shutdown_connections 2024-08-19T00:05:37.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:37.175+0000 7f208b80c640 1 -- 172.21.15.44:0/3125502854 wait complete. 2024-08-19T00:05:37.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:37.175+0000 7f208b80c640 1 Processor -- start 2024-08-19T00:05:37.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:37.175+0000 7f208b80c640 1 -- start start 2024-08-19T00:05:37.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:37.175+0000 7f208b80c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2084100840 0x7f20841047d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:05:37.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:37.175+0000 7f208b80c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2084101a40 0x7f2084102e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:05:37.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:37.175+0000 7f208b80c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2084102400 0x7f2084103360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:05:37.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:37.175+0000 7f208b80c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f208410c570 con 0x7f2084101a40 2024-08-19T00:05:37.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:37.175+0000 7f208b80c640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f208410c3f0 con 0x7f2084100840 2024-08-19T00:05:37.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:37.175+0000 7f208b80c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f208410c6f0 con 0x7f2084102400 2024-08-19T00:05:37.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:37.175+0000 7f2088da7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2084101a40 0x7f2084102e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:05:37.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:37.175+0000 7f2088da7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2084101a40 0x7f2084102e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41428/0 (socket says 172.21.15.44:41428) 2024-08-19T00:05:37.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:37.175+0000 7f2088da7640 1 -- 172.21.15.44:0/2090195917 learned_addr learned my addr 172.21.15.44:0/2090195917 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:05:37.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:37.176+0000 7f2089da9640 1 --2- 172.21.15.44:0/2090195917 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2084102400 0x7f2084103360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:05:37.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:37.176+0000 7f20895a8640 1 --2- 172.21.15.44:0/2090195917 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2084100840 0x7f20841047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:05:37.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:37.176+0000 7f2088da7640 1 -- 172.21.15.44:0/2090195917 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2084102400 msgr2=0x7f2084103360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:05:37.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:37.176+0000 7f2088da7640 1 --2- 172.21.15.44:0/2090195917 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2084102400 0x7f2084103360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:05:37.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:37.176+0000 7f2088da7640 1 -- 172.21.15.44:0/2090195917 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2084100840 msgr2=0x7f20841047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:05:37.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:37.176+0000 7f2088da7640 1 --2- 172.21.15.44:0/2090195917 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2084100840 0x7f20841047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:05:37.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:37.176+0000 7f2088da7640 1 -- 172.21.15.44:0/2090195917 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2084103c20 con 0x7f2084101a40 2024-08-19T00:05:37.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:37.176+0000 7f20895a8640 1 --2- 172.21.15.44:0/2090195917 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2084100840 0x7f20841047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:05:37.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:37.176+0000 7f2088da7640 1 --2- 172.21.15.44:0/2090195917 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2084101a40 0x7f2084102e20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2074009230 tx=0x7f2074004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:05:37.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:37.176+0000 7f207a7fc640 1 -- 172.21.15.44:0/2090195917 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f207403f030 con 0x7f2084101a40 2024-08-19T00:05:37.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:37.176+0000 7f207a7fc640 1 -- 172.21.15.44:0/2090195917 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2074003ce0 con 0x7f2084101a40 2024-08-19T00:05:37.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:37.176+0000 7f208b80c640 1 -- 172.21.15.44:0/2090195917 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20841a1de0 con 0x7f2084101a40 2024-08-19T00:05:37.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:37.176+0000 7f207a7fc640 1 -- 172.21.15.44:0/2090195917 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2074035070 con 0x7f2084101a40 2024-08-19T00:05:37.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:37.176+0000 7f208b80c640 1 -- 172.21.15.44:0/2090195917 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20841a22b0 con 0x7f2084101a40 2024-08-19T00:05:37.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:37.177+0000 7f207a7fc640 1 -- 172.21.15.44:0/2090195917 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f2074042030 con 0x7f2084101a40 2024-08-19T00:05:37.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:37.177+0000 7f207a7fc640 1 --2- 172.21.15.44:0/2090195917 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f2070039290 0x7f207003b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:05:37.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:37.177+0000 7f208b80c640 1 -- 172.21.15.44:0/2090195917 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20841a24e0 con 0x7f2084101a40 2024-08-19T00:05:37.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:37.177+0000 7f207a7fc640 1 -- 172.21.15.44:0/2090195917 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f207406c9f0 con 0x7f2084101a40 2024-08-19T00:05:37.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:37.177+0000 7f20895a8640 1 --2- 172.21.15.44:0/2090195917 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f2070039290 0x7f207003b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:05:37.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:37.178+0000 7f20895a8640 1 --2- 172.21.15.44:0/2090195917 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f2070039290 0x7f207003b750 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f20841018a0 tx=0x7f2080008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:05:37.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:37.182+0000 7f207a7fc640 1 -- 172.21.15.44:0/2090195917 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f207403bdc0 con 0x7f2084101a40 2024-08-19T00:05:37.342 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:05:37 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-z[23624]: 2024-08-19T00:05:37.048+0000 7fbd321e8040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-19T00:05:37.342 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:05:37 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-z[23624]: 2024-08-19T00:05:37.107+0000 7fbd321e8040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-19T00:05:37.342 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:05:37 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-z[23624]: 2024-08-19T00:05:37.174+0000 7fbd321e8040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-19T00:05:37.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:37.367+0000 7f208b80c640 1 -- 172.21.15.44:0/2090195917 --> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f208406abd0 con 0x7f2070039290 2024-08-19T00:05:37.410 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:05:37 smithi116 podman[23222]: 2024-08-19 00:05:37.024515495 +0000 UTC m=+0.016921218 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-19T00:05:37.410 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:05:37 smithi116 podman[23222]: 2024-08-19 00:05:37.133432408 +0000 UTC m=+0.125838120 container create c21caa90bb7690046d01201773dc1a0500020beec1e06fb4d77457ee2e8557ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-y, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-de09dd0) 2024-08-19T00:05:37.410 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:05:37 smithi116 podman[23222]: 2024-08-19 00:05:37.334367278 +0000 UTC m=+0.326772989 container init c21caa90bb7690046d01201773dc1a0500020beec1e06fb4d77457ee2e8557ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-de09dd0, GIT_BRANCH=HEAD) 2024-08-19T00:05:37.410 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:05:37 smithi116 podman[23222]: 2024-08-19 00:05:37.337134577 +0000 UTC m=+0.329540289 container start c21caa90bb7690046d01201773dc1a0500020beec1e06fb4d77457ee2e8557ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-y, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, RELEASE=squid-de09dd0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-08-19T00:05:37.410 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:05:37 smithi116 ceph-mgr[23241]: -- 172.21.15.116:0/815743429 <== mon.2 v2:172.21.15.116:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c80b3cb0e0 con 0x55c80b3a9000 2024-08-19T00:05:37.410 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:05:37 smithi116 bash[23222]: c21caa90bb7690046d01201773dc1a0500020beec1e06fb4d77457ee2e8557ba 2024-08-19T00:05:37.785 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:37 smithi044 ceph-mon[18489]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:05:37.785 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:37 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-19T00:05:37.785 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:37 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-19T00:05:37.785 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:37 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:05:37.786 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:37 smithi116 ceph-mon[21873]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:05:37.786 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:37 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-19T00:05:37.786 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:37 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-19T00:05:37.786 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:37 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:05:37.787 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:05:37 smithi116 systemd[1]: Started Ceph mgr.y for 647ded64-5dbe-11ef-bccf-c7b262605968. 2024-08-19T00:05:37.787 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:05:37 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-y[23237]: 2024-08-19T00:05:37.567+0000 7ff908fa6040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-19T00:05:37.787 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:05:37 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-y[23237]: 2024-08-19T00:05:37.636+0000 7ff908fa6040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-19T00:05:37.787 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:05:37 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-y[23237]: 2024-08-19T00:05:37.785+0000 7ff908fa6040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-19T00:05:37.842 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:05:37 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-z[23624]: 2024-08-19T00:05:37.383+0000 7fbd321e8040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-19T00:05:37.842 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:05:37 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-z[23624]: 2024-08-19T00:05:37.442+0000 7fbd321e8040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-19T00:05:37.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:37 smithi171 ceph-mon[21810]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:05:37.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:37 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-19T00:05:37.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:37 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-19T00:05:37.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:37 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:05:38.110 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:05:37 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-y[23237]: 2024-08-19T00:05:37.961+0000 7ff908fa6040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-19T00:05:38.110 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:05:38 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-y[23237]: 2024-08-19T00:05:38.109+0000 7ff908fa6040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-19T00:05:38.324 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:05:38 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-z[23624]: 2024-08-19T00:05:38.001+0000 7fbd321e8040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-19T00:05:38.324 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:05:38 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-z[23624]: 2024-08-19T00:05:38.322+0000 7fbd321e8040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-19T00:05:38.365 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:05:38 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-y[23237]: 2024-08-19T00:05:38.235+0000 7ff908fa6040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-19T00:05:38.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:38 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:38.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:38 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:38.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:38 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:38.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:38 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:38.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:38 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:05:38.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:38 smithi171 ceph-mon[21810]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:38.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:38 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:38.746 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:05:38 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-y[23237]: 2024-08-19T00:05:38.367+0000 7ff908fa6040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-19T00:05:38.747 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:05:38 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-y[23237]: 2024-08-19T00:05:38.424+0000 7ff908fa6040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-19T00:05:38.747 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:38 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:38.747 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:38 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:38.747 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:38 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:38.747 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:38 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:38.747 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:38 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:05:38.747 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:38 smithi116 ceph-mon[21873]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:38.747 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:38 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:38.787 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:38 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:38.787 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:38 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:38.787 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:38 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:38.788 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:38 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:38.788 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:38 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:05:38.788 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:38 smithi044 ceph-mon[18489]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:38.788 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:38 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:39.024 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:05:38 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-y[23237]: 2024-08-19T00:05:38.745+0000 7ff908fa6040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-19T00:05:39.024 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:05:38 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-y[23237]: 2024-08-19T00:05:38.809+0000 7ff908fa6040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-19T00:05:39.024 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:05:38 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-y[23237]: 2024-08-19T00:05:38.877+0000 7ff908fa6040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-19T00:05:39.024 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:05:39 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-y[23237]: 2024-08-19T00:05:39.023+0000 7ff908fa6040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-08-19T00:05:39.092 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:05:38 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-z[23624]: 2024-08-19T00:05:38.760+0000 7fbd321e8040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-19T00:05:39.092 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:05:38 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-z[23624]: 2024-08-19T00:05:38.817+0000 7fbd321e8040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-19T00:05:39.092 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:05:38 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-z[23624]: 2024-08-19T00:05:38.880+0000 7fbd321e8040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-19T00:05:39.329 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:05:39 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-y[23237]: 2024-08-19T00:05:39.081+0000 7ff908fa6040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-19T00:05:39.329 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:05:39 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-y[23237]: 2024-08-19T00:05:39.146+0000 7ff908fa6040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-19T00:05:39.330 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:05:39 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-y[23237]: 2024-08-19T00:05:39.328+0000 7ff908fa6040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-19T00:05:39.615 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:05:39 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-y[23237]: 2024-08-19T00:05:39.388+0000 7ff908fa6040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-19T00:05:39.615 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:05:39 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-y[23237]: 2024-08-19T00:05:39.447+0000 7ff908fa6040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-19T00:05:39.615 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:05:39 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-y[23237]: 2024-08-19T00:05:39.514+0000 7ff908fa6040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-19T00:05:40.051 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:39 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:40.051 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:39 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:40.051 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:39 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:40.051 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:39 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:40.051 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:39 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:05:40.051 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:39 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:05:40.051 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:39 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:40.051 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:39 smithi044 ceph-mon[18489]: Reconfiguring mgr.x (unknown last config time)... 2024-08-19T00:05:40.051 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:39 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-19T00:05:40.051 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:39 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-19T00:05:40.052 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:39 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:05:40.052 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:39 smithi044 ceph-mon[18489]: Reconfiguring daemon mgr.x on smithi044 2024-08-19T00:05:40.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:39 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:40.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:39 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:40.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:39 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:40.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:39 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:40.093 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:39 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:05:40.093 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:39 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:05:40.093 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:39 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:40.093 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:39 smithi171 ceph-mon[21810]: Reconfiguring mgr.x (unknown last config time)... 2024-08-19T00:05:40.093 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:39 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-19T00:05:40.093 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:39 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-19T00:05:40.093 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:39 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:05:40.093 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:39 smithi171 ceph-mon[21810]: Reconfiguring daemon mgr.x on smithi044 2024-08-19T00:05:40.115 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:05:39 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-y[23237]: 2024-08-19T00:05:39.723+0000 7ff908fa6040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-19T00:05:40.115 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:05:39 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-y[23237]: 2024-08-19T00:05:39.783+0000 7ff908fa6040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-19T00:05:40.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:39 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:40.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:39 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:40.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:39 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:40.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:39 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:40.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:39 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:05:40.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:39 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:05:40.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:39 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:40.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:39 smithi116 ceph-mon[21873]: Reconfiguring mgr.x (unknown last config time)... 2024-08-19T00:05:40.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:39 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-19T00:05:40.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:39 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-19T00:05:40.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:39 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:05:40.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:39 smithi116 ceph-mon[21873]: Reconfiguring daemon mgr.x on smithi044 2024-08-19T00:05:40.615 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:05:40 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-y[23237]: 2024-08-19T00:05:40.303+0000 7ff908fa6040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-19T00:05:40.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:40.843+0000 7f207a7fc640 1 -- 172.21.15.44:0/2090195917 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mgrmap(e 14) ==== 92060+0+0 (secure 0 0 0) 0x7f2074003800 con 0x7f2084101a40 2024-08-19T00:05:41.031 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:05:40 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-y[23237]: 2024-08-19T00:05:40.615+0000 7ff908fa6040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-19T00:05:41.031 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:40 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/1952984316' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b15ad904-d07d-4ecb-be8f-d99323425eed"}]: dispatch 2024-08-19T00:05:41.032 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:40 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/1952984316' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b15ad904-d07d-4ecb-be8f-d99323425eed"}]': finished 2024-08-19T00:05:41.032 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:40 smithi116 ceph-mon[21873]: osdmap e5: 1 total, 0 up, 1 in 2024-08-19T00:05:41.032 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:40 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-19T00:05:41.032 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:40 smithi116 ceph-mon[21873]: Standby manager daemon z started 2024-08-19T00:05:41.032 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:40 smithi116 ceph-mon[21873]: from='mgr.? 172.21.15.171:0/1149095377' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-08-19T00:05:41.032 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:40 smithi116 ceph-mon[21873]: from='mgr.? 172.21.15.171:0/1149095377' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-19T00:05:41.032 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:40 smithi116 ceph-mon[21873]: from='mgr.? 172.21.15.171:0/1149095377' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-08-19T00:05:41.032 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:40 smithi116 ceph-mon[21873]: from='mgr.? 172.21.15.171:0/1149095377' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-19T00:05:41.032 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:40 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/4187890513' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-19T00:05:41.032 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:40 smithi116 ceph-mon[21873]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:41.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:40 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/1952984316' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b15ad904-d07d-4ecb-be8f-d99323425eed"}]: dispatch 2024-08-19T00:05:41.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:40 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/1952984316' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b15ad904-d07d-4ecb-be8f-d99323425eed"}]': finished 2024-08-19T00:05:41.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:40 smithi171 ceph-mon[21810]: osdmap e5: 1 total, 0 up, 1 in 2024-08-19T00:05:41.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:40 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-19T00:05:41.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:40 smithi171 ceph-mon[21810]: Standby manager daemon z started 2024-08-19T00:05:41.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:40 smithi171 ceph-mon[21810]: from='mgr.? 172.21.15.171:0/1149095377' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-08-19T00:05:41.093 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:40 smithi171 ceph-mon[21810]: from='mgr.? 172.21.15.171:0/1149095377' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-19T00:05:41.093 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:40 smithi171 ceph-mon[21810]: from='mgr.? 172.21.15.171:0/1149095377' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-08-19T00:05:41.093 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:40 smithi171 ceph-mon[21810]: from='mgr.? 172.21.15.171:0/1149095377' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-19T00:05:41.093 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:40 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/4187890513' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-19T00:05:41.093 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:40 smithi171 ceph-mon[21810]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:41.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:40 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/1952984316' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b15ad904-d07d-4ecb-be8f-d99323425eed"}]: dispatch 2024-08-19T00:05:41.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:40 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/1952984316' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b15ad904-d07d-4ecb-be8f-d99323425eed"}]': finished 2024-08-19T00:05:41.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:40 smithi044 ceph-mon[18489]: osdmap e5: 1 total, 0 up, 1 in 2024-08-19T00:05:41.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:40 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-19T00:05:41.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:40 smithi044 ceph-mon[18489]: Standby manager daemon z started 2024-08-19T00:05:41.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:40 smithi044 ceph-mon[18489]: from='mgr.? 172.21.15.171:0/1149095377' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-08-19T00:05:41.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:40 smithi044 ceph-mon[18489]: from='mgr.? 172.21.15.171:0/1149095377' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-19T00:05:41.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:40 smithi044 ceph-mon[18489]: from='mgr.? 172.21.15.171:0/1149095377' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-08-19T00:05:41.120 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:40 smithi044 ceph-mon[18489]: from='mgr.? 172.21.15.171:0/1149095377' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-19T00:05:41.120 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:40 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/4187890513' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-19T00:05:41.120 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:40 smithi044 ceph-mon[18489]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:41.365 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:05:41 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-y[23237]: 2024-08-19T00:05:41.030+0000 7ff908fa6040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-19T00:05:41.365 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:05:41 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-y[23237]: 2024-08-19T00:05:41.087+0000 7ff908fa6040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-19T00:05:41.365 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:05:41 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-y[23237]: 2024-08-19T00:05:41.146+0000 7ff908fa6040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-19T00:05:42.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:41 smithi116 ceph-mon[21873]: mgrmap e14: x(active, since 62s), standbys: z 2024-08-19T00:05:42.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:41 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-08-19T00:05:42.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:41 smithi044 ceph-mon[18489]: mgrmap e14: x(active, since 62s), standbys: z 2024-08-19T00:05:42.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:41 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-08-19T00:05:42.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:41 smithi171 ceph-mon[21810]: mgrmap e14: x(active, since 62s), standbys: z 2024-08-19T00:05:42.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:41 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-08-19T00:05:42.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:42.852+0000 7f207a7fc640 1 -- 172.21.15.44:0/2090195917 <== mon.0 v2:172.21.15.44:3300/0 8 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f207403b460 con 0x7f2084101a40 2024-08-19T00:05:43.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:42 smithi116 ceph-mon[21873]: Standby manager daemon y started 2024-08-19T00:05:43.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:42 smithi116 ceph-mon[21873]: from='mgr.? 172.21.15.116:0/4170355246' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-08-19T00:05:43.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:42 smithi116 ceph-mon[21873]: from='mgr.? 172.21.15.116:0/4170355246' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-19T00:05:43.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:42 smithi116 ceph-mon[21873]: from='mgr.? 172.21.15.116:0/4170355246' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-08-19T00:05:43.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:42 smithi116 ceph-mon[21873]: from='mgr.? 172.21.15.116:0/4170355246' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-19T00:05:43.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:42 smithi116 ceph-mon[21873]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:43.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:42 smithi044 ceph-mon[18489]: Standby manager daemon y started 2024-08-19T00:05:43.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:42 smithi044 ceph-mon[18489]: from='mgr.? 172.21.15.116:0/4170355246' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-08-19T00:05:43.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:42 smithi044 ceph-mon[18489]: from='mgr.? 172.21.15.116:0/4170355246' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-19T00:05:43.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:42 smithi044 ceph-mon[18489]: from='mgr.? 172.21.15.116:0/4170355246' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-08-19T00:05:43.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:42 smithi044 ceph-mon[18489]: from='mgr.? 172.21.15.116:0/4170355246' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-19T00:05:43.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:42 smithi044 ceph-mon[18489]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:43.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:42 smithi171 ceph-mon[21810]: Standby manager daemon y started 2024-08-19T00:05:43.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:42 smithi171 ceph-mon[21810]: from='mgr.? 172.21.15.116:0/4170355246' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-08-19T00:05:43.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:42 smithi171 ceph-mon[21810]: from='mgr.? 172.21.15.116:0/4170355246' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-19T00:05:43.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:42 smithi171 ceph-mon[21810]: from='mgr.? 172.21.15.116:0/4170355246' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-08-19T00:05:43.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:42 smithi171 ceph-mon[21810]: from='mgr.? 172.21.15.116:0/4170355246' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-19T00:05:43.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:42 smithi171 ceph-mon[21810]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:44.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:43 smithi116 ceph-mon[21873]: mgrmap e15: x(active, since 64s), standbys: z, y 2024-08-19T00:05:44.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:43 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-08-19T00:05:44.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:43 smithi044 ceph-mon[18489]: mgrmap e15: x(active, since 64s), standbys: z, y 2024-08-19T00:05:44.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:43 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-08-19T00:05:44.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:43 smithi171 ceph-mon[21810]: mgrmap e15: x(active, since 64s), standbys: z, y 2024-08-19T00:05:44.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:43 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-08-19T00:05:45.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:44 smithi116 ceph-mon[21873]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:45.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:44 smithi044 ceph-mon[18489]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:45.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:44 smithi171 ceph-mon[21810]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:46.525 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:46 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:46.526 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:46 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:46.526 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:46 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:05:46.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:46 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:46.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:46 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:46.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:46 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:05:46.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:46 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:46.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:46 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:46.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:46 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:05:47.493 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:47 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:05:47.493 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:47 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:05:47.494 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:47 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:47.494 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:47 smithi171 ceph-mon[21810]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:47.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:47 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:05:47.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:47 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:05:47.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:47 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:47.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:47 smithi116 ceph-mon[21873]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:47.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:47 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:05:47.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:47 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:05:47.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:47 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:47.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:47 smithi044 ceph-mon[18489]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:48.517 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:48 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-08-19T00:05:48.517 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:48 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:05:48.517 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:48 smithi116 ceph-mon[21873]: Deploying daemon osd.0 on smithi044 2024-08-19T00:05:48.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:48 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-08-19T00:05:48.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:48 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:05:48.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:48 smithi171 ceph-mon[21810]: Deploying daemon osd.0 on smithi044 2024-08-19T00:05:48.592 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:48 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-08-19T00:05:48.592 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:48 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:05:48.593 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:48 smithi044 ceph-mon[18489]: Deploying daemon osd.0 on smithi044 2024-08-19T00:05:49.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:49 smithi171 ceph-mon[21810]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:49.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:49 smithi116 ceph-mon[21873]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:49.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:49 smithi044 ceph-mon[18489]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:50.678 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:50 smithi044 ceph-mon[18489]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:50.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:50 smithi171 ceph-mon[21810]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:50.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:50 smithi116 ceph-mon[21873]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:52.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:52 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:05:52.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:52 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:52.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:52 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:52.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:52 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:05:52.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:52 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:52.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:52 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:52.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:52 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:05:52.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:52 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:52.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:52 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:53.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:53 smithi116 ceph-mon[21873]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:53.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:53 smithi044 ceph-mon[18489]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:53.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:53 smithi171 ceph-mon[21810]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:55.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:55.093+0000 7f207a7fc640 1 -- 172.21.15.44:0/2090195917 <== mgr.14150 v2:172.21.15.44:6800/1330072146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f208406abd0 con 0x7f2070039290 2024-08-19T00:05:55.095 INFO:teuthology.orchestra.run.smithi044.stdout:Created osd(s) 0 on host 'smithi044' 2024-08-19T00:05:55.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:55.095+0000 7f208b80c640 1 -- 172.21.15.44:0/2090195917 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f2070039290 msgr2=0x7f207003b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:05:55.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:55.095+0000 7f208b80c640 1 --2- 172.21.15.44:0/2090195917 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f2070039290 0x7f207003b750 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f20841018a0 tx=0x7f2080008040 comp rx=0 tx=0).stop 2024-08-19T00:05:55.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:55.095+0000 7f208b80c640 1 -- 172.21.15.44:0/2090195917 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2084101a40 msgr2=0x7f2084102e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:05:55.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:55.095+0000 7f208b80c640 1 --2- 172.21.15.44:0/2090195917 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2084101a40 0x7f2084102e20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2074009230 tx=0x7f2074004360 comp rx=0 tx=0).stop 2024-08-19T00:05:55.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:55.095+0000 7f208b80c640 1 -- 172.21.15.44:0/2090195917 shutdown_connections 2024-08-19T00:05:55.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:55.095+0000 7f208b80c640 1 --2- 172.21.15.44:0/2090195917 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f2070039290 0x7f207003b750 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:05:55.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:55.095+0000 7f208b80c640 1 --2- 172.21.15.44:0/2090195917 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2084102400 0x7f2084103360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:05:55.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:55.095+0000 7f208b80c640 1 --2- 172.21.15.44:0/2090195917 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2084101a40 0x7f2084102e20 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:05:55.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:55.095+0000 7f208b80c640 1 --2- 172.21.15.44:0/2090195917 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2084100840 0x7f20841047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:05:55.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:55.095+0000 7f208b80c640 1 -- 172.21.15.44:0/2090195917 >> 172.21.15.44:0/2090195917 conn(0x7f20840fbfd0 msgr2=0x7f208406a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:05:55.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:55.096+0000 7f208b80c640 1 -- 172.21.15.44:0/2090195917 shutdown_connections 2024-08-19T00:05:55.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:05:55.096+0000 7f208b80c640 1 -- 172.21.15.44:0/2090195917 wait complete. 2024-08-19T00:05:55.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:55 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:55.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:55 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:55.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:55 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:05:55.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:55 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:05:55.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:55 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:55.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:55 smithi044 ceph-mon[18489]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:55.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:55 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:05:55.370 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:55 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:55.370 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:55 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:55.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:55 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:55.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:55 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:55.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:55 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:05:55.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:55 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:05:55.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:55 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:55.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:55 smithi171 ceph-mon[21810]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:55.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:55 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:05:55.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:55 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:55.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:55 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:55.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:55 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:55.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:55 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:55.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:55 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:05:55.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:55 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:05:55.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:55 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:55.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:55 smithi116 ceph-mon[21873]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:55.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:55 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:05:55.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:55 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:55.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:55 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:55.760 DEBUG:teuthology.orchestra.run.smithi044:osd.0> sudo journalctl -f -n 0 -u ceph-647ded64-5dbe-11ef-bccf-c7b262605968@osd.0.service 2024-08-19T00:05:55.763 INFO:tasks.cephadm:Deploying osd.1 on smithi116 with /dev/vg_nvme/lv_4... 2024-08-19T00:05:55.763 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-08-19T00:05:56.022 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.b/config 2024-08-19T00:05:56.089 INFO:journalctl@ceph.osd.0.smithi044.stdout:Aug 19 00:05:55 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-0[32356]: 2024-08-19T00:05:55.931+0000 7f2762aa6640 -1 osd.0 0 log_to_monitors true 2024-08-19T00:05:56.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:56 smithi044 ceph-mon[18489]: from='osd.0 [v2:172.21.15.44:6802/600251465,v1:172.21.15.44:6803/600251465]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-08-19T00:05:56.443 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:56 smithi116 ceph-mon[21873]: from='osd.0 [v2:172.21.15.44:6802/600251465,v1:172.21.15.44:6803/600251465]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-08-19T00:05:56.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:56 smithi171 ceph-mon[21810]: from='osd.0 [v2:172.21.15.44:6802/600251465,v1:172.21.15.44:6803/600251465]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-08-19T00:05:57.179 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:57 smithi116 ceph-mon[21873]: from='osd.0 [v2:172.21.15.44:6802/600251465,v1:172.21.15.44:6803/600251465]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-19T00:05:57.179 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:57 smithi116 ceph-mon[21873]: osdmap e6: 1 total, 0 up, 1 in 2024-08-19T00:05:57.179 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:57 smithi116 ceph-mon[21873]: from='osd.0 [v2:172.21.15.44:6802/600251465,v1:172.21.15.44:6803/600251465]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-08-19T00:05:57.179 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:57 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-19T00:05:57.179 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:57 smithi116 ceph-mon[21873]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:57.413 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:57 smithi044 ceph-mon[18489]: from='osd.0 [v2:172.21.15.44:6802/600251465,v1:172.21.15.44:6803/600251465]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-19T00:05:57.413 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:57 smithi044 ceph-mon[18489]: osdmap e6: 1 total, 0 up, 1 in 2024-08-19T00:05:57.413 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:57 smithi044 ceph-mon[18489]: from='osd.0 [v2:172.21.15.44:6802/600251465,v1:172.21.15.44:6803/600251465]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-08-19T00:05:57.413 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:57 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-19T00:05:57.414 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:57 smithi044 ceph-mon[18489]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:57.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:57 smithi171 ceph-mon[21810]: from='osd.0 [v2:172.21.15.44:6802/600251465,v1:172.21.15.44:6803/600251465]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-19T00:05:57.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:57 smithi171 ceph-mon[21810]: osdmap e6: 1 total, 0 up, 1 in 2024-08-19T00:05:57.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:57 smithi171 ceph-mon[21810]: from='osd.0 [v2:172.21.15.44:6802/600251465,v1:172.21.15.44:6803/600251465]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-08-19T00:05:57.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:57 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-19T00:05:57.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:57 smithi171 ceph-mon[21810]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:58.130 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-08-19T00:05:58.158 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi116:vg_nvme/lv_4 2024-08-19T00:05:58.341 INFO:journalctl@ceph.osd.0.smithi044.stdout:Aug 19 00:05:57 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-0[32356]: 2024-08-19T00:05:57.893+0000 7f275ea29640 -1 osd.0 0 waiting for initial osdmap 2024-08-19T00:05:58.342 INFO:journalctl@ceph.osd.0.smithi044.stdout:Aug 19 00:05:57 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-0[32356]: 2024-08-19T00:05:57.897+0000 7f2756849640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-19T00:05:58.342 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:58 smithi044 ceph-mon[18489]: from='osd.0 [v2:172.21.15.44:6802/600251465,v1:172.21.15.44:6803/600251465]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-08-19T00:05:58.342 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:58 smithi044 ceph-mon[18489]: osdmap e7: 1 total, 0 up, 1 in 2024-08-19T00:05:58.342 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:58 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-19T00:05:58.342 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:58 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-19T00:05:58.342 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:58 smithi044 ceph-mon[18489]: from='osd.0 [v2:172.21.15.44:6802/600251465,v1:172.21.15.44:6803/600251465]' entity='osd.0' 2024-08-19T00:05:58.405 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.b/config 2024-08-19T00:05:58.520 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:58 smithi116 ceph-mon[21873]: from='osd.0 [v2:172.21.15.44:6802/600251465,v1:172.21.15.44:6803/600251465]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-08-19T00:05:58.520 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:58 smithi116 ceph-mon[21873]: osdmap e7: 1 total, 0 up, 1 in 2024-08-19T00:05:58.520 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:58 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-19T00:05:58.521 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:58 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-19T00:05:58.521 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:58 smithi116 ceph-mon[21873]: from='osd.0 [v2:172.21.15.44:6802/600251465,v1:172.21.15.44:6803/600251465]' entity='osd.0' 2024-08-19T00:05:58.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:58 smithi171 ceph-mon[21810]: from='osd.0 [v2:172.21.15.44:6802/600251465,v1:172.21.15.44:6803/600251465]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-08-19T00:05:58.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:58 smithi171 ceph-mon[21810]: osdmap e7: 1 total, 0 up, 1 in 2024-08-19T00:05:58.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:58 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-19T00:05:58.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:58 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-19T00:05:58.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:58 smithi171 ceph-mon[21810]: from='osd.0 [v2:172.21.15.44:6802/600251465,v1:172.21.15.44:6803/600251465]' entity='osd.0' 2024-08-19T00:05:58.839 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:05:58.832+0000 7f4787869640 1 -- 172.21.15.116:0/3332446409 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4780104cc0 msgr2=0x7f47801070b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:05:58.839 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:05:58.832+0000 7f4787869640 1 --2- 172.21.15.116:0/3332446409 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4780104cc0 0x7f47801070b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4770009860 tx=0x7f477002a340 comp rx=0 tx=0).stop 2024-08-19T00:05:58.839 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:05:58.832+0000 7f4787869640 1 -- 172.21.15.116:0/3332446409 shutdown_connections 2024-08-19T00:05:58.839 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:05:58.832+0000 7f4787869640 1 --2- 172.21.15.116:0/3332446409 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47801075f0 0x7f4780109a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:05:58.839 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:05:58.832+0000 7f4787869640 1 --2- 172.21.15.116:0/3332446409 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4780104cc0 0x7f47801070b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:05:58.839 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:05:58.832+0000 7f4787869640 1 --2- 172.21.15.116:0/3332446409 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4780102390 0x7f4780104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:05:58.839 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:05:58.832+0000 7f4787869640 1 -- 172.21.15.116:0/3332446409 >> 172.21.15.116:0/3332446409 conn(0x7f47800fbfb0 msgr2=0x7f47800fe3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:05:58.840 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:05:58.832+0000 7f4787869640 1 -- 172.21.15.116:0/3332446409 shutdown_connections 2024-08-19T00:05:58.840 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:05:58.832+0000 7f4787869640 1 -- 172.21.15.116:0/3332446409 wait complete. 2024-08-19T00:05:58.840 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:05:58.832+0000 7f4787869640 1 Processor -- start 2024-08-19T00:05:58.840 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:05:58.832+0000 7f4787869640 1 -- start start 2024-08-19T00:05:58.840 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:05:58.832+0000 7f4787869640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4780102390 0x7f4780101cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:05:58.840 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:05:58.833+0000 7f4787869640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4780104cc0 0x7f4780100340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:05:58.840 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:05:58.833+0000 7f4787869640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47801075f0 0x7f4780100880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:05:58.840 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:05:58.833+0000 7f4787869640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f478010d590 con 0x7f47801075f0 2024-08-19T00:05:58.840 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:05:58.833+0000 7f4785605640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4780102390 0x7f4780101cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:05:58.840 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:05:58.833+0000 7f4787869640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f478010d410 con 0x7f4780102390 2024-08-19T00:05:58.840 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:05:58.833+0000 7f4787869640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f478010d710 con 0x7f4780104cc0 2024-08-19T00:05:58.841 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:05:58.833+0000 7f4785605640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4780102390 0x7f4780101cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:59746/0 (socket says 172.21.15.116:59746) 2024-08-19T00:05:58.841 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:05:58.833+0000 7f4785605640 1 -- 172.21.15.116:0/603205009 learned_addr learned my addr 172.21.15.116:0/603205009 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-08-19T00:05:58.841 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:05:58.833+0000 7f4784e04640 1 --2- 172.21.15.116:0/603205009 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4780104cc0 0x7f4780100340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:05:58.841 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:05:58.833+0000 7f4785605640 1 -- 172.21.15.116:0/603205009 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4780104cc0 msgr2=0x7f4780100340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:05:58.841 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:05:58.833+0000 7f4785605640 1 --2- 172.21.15.116:0/603205009 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4780104cc0 0x7f4780100340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:05:58.841 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:05:58.833+0000 7f4785605640 1 -- 172.21.15.116:0/603205009 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47801075f0 msgr2=0x7f4780100880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:05:58.841 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:05:58.833+0000 7f4785e06640 1 --2- 172.21.15.116:0/603205009 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47801075f0 0x7f4780100880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:05:58.841 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:05:58.833+0000 7f4785605640 1 --2- 172.21.15.116:0/603205009 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47801075f0 0x7f4780100880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:05:58.841 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:05:58.833+0000 7f4785605640 1 -- 172.21.15.116:0/603205009 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4780101140 con 0x7f4780102390 2024-08-19T00:05:58.841 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:05:58.833+0000 7f4785605640 1 --2- 172.21.15.116:0/603205009 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4780102390 0x7f4780101cf0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f477c00e9c0 tx=0x7f477c00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:05:58.841 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:05:58.833+0000 7f47767fc640 1 -- 172.21.15.116:0/603205009 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f477c00cde0 con 0x7f4780102390 2024-08-19T00:05:58.841 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:05:58.833+0000 7f47767fc640 1 -- 172.21.15.116:0/603205009 <== mon.2 v2:172.21.15.116:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f477c0035f0 con 0x7f4780102390 2024-08-19T00:05:58.842 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:05:58.833+0000 7f4787869640 1 -- 172.21.15.116:0/603205009 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47801a1dd0 con 0x7f4780102390 2024-08-19T00:05:58.842 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:05:58.833+0000 7f47767fc640 1 -- 172.21.15.116:0/603205009 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f477c010650 con 0x7f4780102390 2024-08-19T00:05:58.842 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:05:58.833+0000 7f4787869640 1 -- 172.21.15.116:0/603205009 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47801a21c0 con 0x7f4780102390 2024-08-19T00:05:58.842 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:05:58.834+0000 7f4787869640 1 -- 172.21.15.116:0/603205009 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47800fdaa0 con 0x7f4780102390 2024-08-19T00:05:58.842 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:05:58.835+0000 7f47767fc640 1 -- 172.21.15.116:0/603205009 <== mon.2 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f477c0037a0 con 0x7f4780102390 2024-08-19T00:05:58.842 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:05:58.836+0000 7f47767fc640 1 --2- 172.21.15.116:0/603205009 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f476c0a2af0 0x7f476c0a4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:05:58.842 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:05:58.836+0000 7f4784e04640 1 --2- 172.21.15.116:0/603205009 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f476c0a2af0 0x7f476c0a4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:05:58.842 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:05:58.836+0000 7f47767fc640 1 -- 172.21.15.116:0/603205009 <== mon.2 v2:172.21.15.116:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7f477c0cd900 con 0x7f4780102390 2024-08-19T00:05:58.842 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:05:58.837+0000 7f4784e04640 1 --2- 172.21.15.116:0/603205009 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f476c0a2af0 0x7f476c0a4fb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f477002a930 tx=0x7f4770030550 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:05:58.843 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:05:58.841+0000 7f47767fc640 1 -- 172.21.15.116:0/603205009 <== mon.2 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f477c09c3f0 con 0x7f4780102390 2024-08-19T00:05:59.017 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:05:59.016+0000 7f4787869640 1 -- 172.21.15.116:0/603205009 --> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f4780062360 con 0x7f476c0a2af0 2024-08-19T00:05:59.415 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:59 smithi116 ceph-mon[21873]: purged_snaps scrub starts 2024-08-19T00:05:59.415 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:59 smithi116 ceph-mon[21873]: purged_snaps scrub ok 2024-08-19T00:05:59.415 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:59 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-19T00:05:59.415 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:59 smithi116 ceph-mon[21873]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:59.415 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:59 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:59.415 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:59 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:59.415 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:59 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:05:59.415 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:59 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:59.415 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:59 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:05:59.416 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:59 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:05:59.416 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:59 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:59.416 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:59 smithi116 ceph-mon[21873]: osd.0 [v2:172.21.15.44:6802/600251465,v1:172.21.15.44:6803/600251465] boot 2024-08-19T00:05:59.416 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:59 smithi116 ceph-mon[21873]: osdmap e8: 1 total, 1 up, 1 in 2024-08-19T00:05:59.416 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:59 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-19T00:05:59.416 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:59 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-19T00:05:59.416 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:59 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-19T00:05:59.416 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:05:59 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:05:59.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:59 smithi171 ceph-mon[21810]: purged_snaps scrub starts 2024-08-19T00:05:59.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:59 smithi171 ceph-mon[21810]: purged_snaps scrub ok 2024-08-19T00:05:59.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:59 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-19T00:05:59.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:59 smithi171 ceph-mon[21810]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:59.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:59 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:59.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:59 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:59.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:59 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:05:59.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:59 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:59.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:59 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:05:59.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:59 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:05:59.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:59 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:59.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:59 smithi171 ceph-mon[21810]: osd.0 [v2:172.21.15.44:6802/600251465,v1:172.21.15.44:6803/600251465] boot 2024-08-19T00:05:59.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:59 smithi171 ceph-mon[21810]: osdmap e8: 1 total, 1 up, 1 in 2024-08-19T00:05:59.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:59 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-19T00:05:59.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:59 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-19T00:05:59.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:59 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-19T00:05:59.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:05:59 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:05:59.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:59 smithi044 ceph-mon[18489]: purged_snaps scrub starts 2024-08-19T00:05:59.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:59 smithi044 ceph-mon[18489]: purged_snaps scrub ok 2024-08-19T00:05:59.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:59 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-19T00:05:59.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:59 smithi044 ceph-mon[18489]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:05:59.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:59 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:59.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:59 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:59.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:59 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:05:59.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:59 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:59.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:59 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:05:59.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:59 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:05:59.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:59 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:05:59.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:59 smithi044 ceph-mon[18489]: osd.0 [v2:172.21.15.44:6802/600251465,v1:172.21.15.44:6803/600251465] boot 2024-08-19T00:05:59.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:59 smithi044 ceph-mon[18489]: osdmap e8: 1 total, 1 up, 1 in 2024-08-19T00:05:59.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:59 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-19T00:05:59.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:59 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-19T00:05:59.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:59 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-19T00:05:59.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:05:59 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:06:00.345 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:00 smithi116 ceph-mon[21873]: Detected new or changed devices on smithi044 2024-08-19T00:06:00.345 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:00 smithi116 ceph-mon[21873]: Adjusting osd_memory_target on smithi044 to 17092M 2024-08-19T00:06:00.345 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:00 smithi116 ceph-mon[21873]: from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:06:00.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:00 smithi171 ceph-mon[21810]: Detected new or changed devices on smithi044 2024-08-19T00:06:00.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:00 smithi171 ceph-mon[21810]: Adjusting osd_memory_target on smithi044 to 17092M 2024-08-19T00:06:00.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:00 smithi171 ceph-mon[21810]: from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:06:00.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:00 smithi044 ceph-mon[18489]: Detected new or changed devices on smithi044 2024-08-19T00:06:00.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:00 smithi044 ceph-mon[18489]: Adjusting osd_memory_target on smithi044 to 17092M 2024-08-19T00:06:00.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:00 smithi044 ceph-mon[18489]: from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:06:01.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:01 smithi116 ceph-mon[21873]: osdmap e9: 1 total, 1 up, 1 in 2024-08-19T00:06:01.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:01 smithi116 ceph-mon[21873]: pgmap v40: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-19T00:06:01.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:01 smithi171 ceph-mon[21810]: osdmap e9: 1 total, 1 up, 1 in 2024-08-19T00:06:01.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:01 smithi171 ceph-mon[21810]: pgmap v40: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-19T00:06:01.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:01 smithi044 ceph-mon[18489]: osdmap e9: 1 total, 1 up, 1 in 2024-08-19T00:06:01.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:01 smithi044 ceph-mon[18489]: pgmap v40: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-19T00:06:02.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:02 smithi171 ceph-mon[21810]: from='client.? 172.21.15.116:0/1661837151' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8f70512f-21a3-4fec-8278-04b2bc9b2d4e"}]: dispatch 2024-08-19T00:06:02.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:02 smithi171 ceph-mon[21810]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8f70512f-21a3-4fec-8278-04b2bc9b2d4e"}]: dispatch 2024-08-19T00:06:02.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:02 smithi171 ceph-mon[21810]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8f70512f-21a3-4fec-8278-04b2bc9b2d4e"}]': finished 2024-08-19T00:06:02.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:02 smithi171 ceph-mon[21810]: osdmap e10: 2 total, 1 up, 2 in 2024-08-19T00:06:02.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:02 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-19T00:06:02.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:02 smithi171 ceph-mon[21810]: from='client.? 172.21.15.116:0/2497365133' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-19T00:06:02.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:02 smithi116 ceph-mon[21873]: from='client.? 172.21.15.116:0/1661837151' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8f70512f-21a3-4fec-8278-04b2bc9b2d4e"}]: dispatch 2024-08-19T00:06:02.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:02 smithi116 ceph-mon[21873]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8f70512f-21a3-4fec-8278-04b2bc9b2d4e"}]: dispatch 2024-08-19T00:06:02.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:02 smithi116 ceph-mon[21873]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8f70512f-21a3-4fec-8278-04b2bc9b2d4e"}]': finished 2024-08-19T00:06:02.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:02 smithi116 ceph-mon[21873]: osdmap e10: 2 total, 1 up, 2 in 2024-08-19T00:06:02.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:02 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-19T00:06:02.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:02 smithi116 ceph-mon[21873]: from='client.? 172.21.15.116:0/2497365133' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-19T00:06:02.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:02 smithi044 ceph-mon[18489]: from='client.? 172.21.15.116:0/1661837151' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8f70512f-21a3-4fec-8278-04b2bc9b2d4e"}]: dispatch 2024-08-19T00:06:02.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:02 smithi044 ceph-mon[18489]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8f70512f-21a3-4fec-8278-04b2bc9b2d4e"}]: dispatch 2024-08-19T00:06:02.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:02 smithi044 ceph-mon[18489]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8f70512f-21a3-4fec-8278-04b2bc9b2d4e"}]': finished 2024-08-19T00:06:02.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:02 smithi044 ceph-mon[18489]: osdmap e10: 2 total, 1 up, 2 in 2024-08-19T00:06:02.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:02 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-19T00:06:02.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:02 smithi044 ceph-mon[18489]: from='client.? 172.21.15.116:0/2497365133' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-19T00:06:03.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:03 smithi171 ceph-mon[21810]: pgmap v42: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-19T00:06:03.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:03 smithi116 ceph-mon[21873]: pgmap v42: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-19T00:06:03.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:03 smithi044 ceph-mon[18489]: pgmap v42: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-19T00:06:04.740 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:04 smithi116 ceph-mon[21873]: pgmap v43: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-19T00:06:04.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:04 smithi171 ceph-mon[21810]: pgmap v43: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-19T00:06:04.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:04 smithi044 ceph-mon[18489]: pgmap v43: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-19T00:06:06.801 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:06 smithi116 ceph-mon[21873]: pgmap v44: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-19T00:06:06.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:06 smithi171 ceph-mon[21810]: pgmap v44: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-19T00:06:06.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:06 smithi044 ceph-mon[18489]: pgmap v44: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-19T00:06:08.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:08 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-08-19T00:06:08.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:08 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:06:08.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:08 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-08-19T00:06:08.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:08 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:06:08.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:08 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-08-19T00:06:08.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:08 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:06:09.288 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:09 smithi116 ceph-mon[21873]: Deploying daemon osd.1 on smithi116 2024-08-19T00:06:09.288 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:09 smithi116 ceph-mon[21873]: pgmap v45: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-19T00:06:09.292 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:09 smithi044 ceph-mon[18489]: Deploying daemon osd.1 on smithi116 2024-08-19T00:06:09.293 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:09 smithi044 ceph-mon[18489]: pgmap v45: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-19T00:06:09.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:09 smithi171 ceph-mon[21810]: Deploying daemon osd.1 on smithi116 2024-08-19T00:06:09.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:09 smithi171 ceph-mon[21810]: pgmap v45: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-19T00:06:10.714 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:10 smithi116 ceph-mon[21873]: pgmap v46: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-19T00:06:10.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:10 smithi171 ceph-mon[21810]: pgmap v46: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-19T00:06:10.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:10 smithi044 ceph-mon[18489]: pgmap v46: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-19T00:06:12.572 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:12 smithi116 ceph-mon[21873]: pgmap v47: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-19T00:06:12.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:12 smithi171 ceph-mon[21810]: pgmap v47: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-19T00:06:12.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:12 smithi044 ceph-mon[18489]: pgmap v47: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-19T00:06:13.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:13 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:06:13.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:13 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:13.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:13 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:13.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:13 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:06:13.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:13 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:13.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:13 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:13.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:13 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:06:13.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:13 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:13.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:13 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:14.831 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:14 smithi116 ceph-mon[21873]: pgmap v48: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-19T00:06:14.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:14 smithi171 ceph-mon[21810]: pgmap v48: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-19T00:06:14.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:14 smithi044 ceph-mon[18489]: pgmap v48: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-19T00:06:16.111 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:06:16.109+0000 7f47767fc640 1 -- 172.21.15.116:0/603205009 <== mgr.14150 v2:172.21.15.44:6800/1330072146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4780062360 con 0x7f476c0a2af0 2024-08-19T00:06:16.111 INFO:teuthology.orchestra.run.smithi116.stdout:Created osd(s) 1 on host 'smithi116' 2024-08-19T00:06:16.113 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:06:16.111+0000 7f4787869640 1 -- 172.21.15.116:0/603205009 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f476c0a2af0 msgr2=0x7f476c0a4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:06:16.113 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:06:16.111+0000 7f4787869640 1 --2- 172.21.15.116:0/603205009 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f476c0a2af0 0x7f476c0a4fb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f477002a930 tx=0x7f4770030550 comp rx=0 tx=0).stop 2024-08-19T00:06:16.113 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:06:16.111+0000 7f4787869640 1 -- 172.21.15.116:0/603205009 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4780102390 msgr2=0x7f4780101cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:06:16.113 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:06:16.111+0000 7f4787869640 1 --2- 172.21.15.116:0/603205009 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4780102390 0x7f4780101cf0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f477c00e9c0 tx=0x7f477c00ee80 comp rx=0 tx=0).stop 2024-08-19T00:06:16.113 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:06:16.111+0000 7f4787869640 1 -- 172.21.15.116:0/603205009 shutdown_connections 2024-08-19T00:06:16.113 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:06:16.111+0000 7f4787869640 1 --2- 172.21.15.116:0/603205009 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f476c0a2af0 0x7f476c0a4fb0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:06:16.113 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:06:16.111+0000 7f4787869640 1 --2- 172.21.15.116:0/603205009 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4780104cc0 0x7f4780100340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:06:16.113 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:06:16.111+0000 7f4787869640 1 --2- 172.21.15.116:0/603205009 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47801075f0 0x7f4780100880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:06:16.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:06:16.111+0000 7f4787869640 1 --2- 172.21.15.116:0/603205009 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4780102390 0x7f4780101cf0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:06:16.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:06:16.111+0000 7f4787869640 1 -- 172.21.15.116:0/603205009 >> 172.21.15.116:0/603205009 conn(0x7f47800fbfb0 msgr2=0x7f4780102d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:06:16.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:06:16.112+0000 7f4787869640 1 -- 172.21.15.116:0/603205009 shutdown_connections 2024-08-19T00:06:16.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:06:16.112+0000 7f4787869640 1 -- 172.21.15.116:0/603205009 wait complete. 2024-08-19T00:06:16.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:16 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:16.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:16 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:16.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:16 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:06:16.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:16 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:06:16.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:16 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:16.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:16 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:06:16.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:16 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:16.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:16 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:16.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:16 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:16.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:16 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:16.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:16 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:06:16.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:16 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:06:16.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:16 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:16.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:16 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:06:16.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:16 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:16.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:16 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:16.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:16 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:16.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:16 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:16.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:16 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:06:16.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:16 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:06:16.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:16 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:16.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:16 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:06:16.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:16 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:16.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:16 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:16.700 DEBUG:teuthology.orchestra.run.smithi116:osd.1> sudo journalctl -f -n 0 -u ceph-647ded64-5dbe-11ef-bccf-c7b262605968@osd.1.service 2024-08-19T00:06:16.703 INFO:tasks.cephadm:Deploying osd.2 on smithi171 with /dev/vg_nvme/lv_4... 2024-08-19T00:06:16.703 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-08-19T00:06:16.959 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.c/config 2024-08-19T00:06:17.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:17 smithi171 ceph-mon[21810]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-19T00:06:17.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:17 smithi171 ceph-mon[21810]: from='osd.1 [v2:172.21.15.116:6800/613509556,v1:172.21.15.116:6801/613509556]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-08-19T00:06:17.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:17 smithi171 ceph-mon[21810]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-08-19T00:06:17.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:17 smithi116 ceph-mon[21873]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-19T00:06:17.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:17 smithi116 ceph-mon[21873]: from='osd.1 [v2:172.21.15.116:6800/613509556,v1:172.21.15.116:6801/613509556]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-08-19T00:06:17.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:17 smithi116 ceph-mon[21873]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-08-19T00:06:17.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:17 smithi044 ceph-mon[18489]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-19T00:06:17.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:17 smithi044 ceph-mon[18489]: from='osd.1 [v2:172.21.15.116:6800/613509556,v1:172.21.15.116:6801/613509556]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-08-19T00:06:17.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:17 smithi044 ceph-mon[18489]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-08-19T00:06:18.279 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:18 smithi171 ceph-mon[21810]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-19T00:06:18.279 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:18 smithi171 ceph-mon[21810]: from='osd.1 [v2:172.21.15.116:6800/613509556,v1:172.21.15.116:6801/613509556]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-08-19T00:06:18.279 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:18 smithi171 ceph-mon[21810]: osdmap e11: 2 total, 1 up, 2 in 2024-08-19T00:06:18.279 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:18 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-19T00:06:18.279 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:18 smithi171 ceph-mon[21810]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-08-19T00:06:18.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:18 smithi116 ceph-mon[21873]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-19T00:06:18.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:18 smithi116 ceph-mon[21873]: from='osd.1 [v2:172.21.15.116:6800/613509556,v1:172.21.15.116:6801/613509556]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-08-19T00:06:18.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:18 smithi116 ceph-mon[21873]: osdmap e11: 2 total, 1 up, 2 in 2024-08-19T00:06:18.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:18 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-19T00:06:18.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:18 smithi116 ceph-mon[21873]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-08-19T00:06:18.366 INFO:journalctl@ceph.osd.1.smithi116.stdout:Aug 19 00:06:18 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-1[26202]: 2024-08-19T00:06:18.174+0000 7f9025ad1640 -1 osd.1 0 waiting for initial osdmap 2024-08-19T00:06:18.366 INFO:journalctl@ceph.osd.1.smithi116.stdout:Aug 19 00:06:18 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-1[26202]: 2024-08-19T00:06:18.176+0000 7f90218f9640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-19T00:06:18.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:18 smithi044 ceph-mon[18489]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-19T00:06:18.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:18 smithi044 ceph-mon[18489]: from='osd.1 [v2:172.21.15.116:6800/613509556,v1:172.21.15.116:6801/613509556]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-08-19T00:06:18.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:18 smithi044 ceph-mon[18489]: osdmap e11: 2 total, 1 up, 2 in 2024-08-19T00:06:18.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:18 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-19T00:06:18.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:18 smithi044 ceph-mon[18489]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-08-19T00:06:19.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:19 smithi171 ceph-mon[21810]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-08-19T00:06:19.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:19 smithi171 ceph-mon[21810]: osdmap e12: 2 total, 1 up, 2 in 2024-08-19T00:06:19.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:19 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-19T00:06:19.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:19 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-19T00:06:19.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:19 smithi171 ceph-mon[21810]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-19T00:06:19.367 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-19T00:06:19.393 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi171:vg_nvme/lv_4 2024-08-19T00:06:19.497 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:19 smithi116 ceph-mon[21873]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-08-19T00:06:19.497 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:19 smithi116 ceph-mon[21873]: osdmap e12: 2 total, 1 up, 2 in 2024-08-19T00:06:19.497 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:19 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-19T00:06:19.498 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:19 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-19T00:06:19.498 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:19 smithi116 ceph-mon[21873]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-19T00:06:19.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:19 smithi044 ceph-mon[18489]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-08-19T00:06:19.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:19 smithi044 ceph-mon[18489]: osdmap e12: 2 total, 1 up, 2 in 2024-08-19T00:06:19.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:19 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-19T00:06:19.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:19 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-19T00:06:19.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:19 smithi044 ceph-mon[18489]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-19T00:06:19.646 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.c/config 2024-08-19T00:06:20.104 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:06:20.100+0000 7f4411410640 1 -- 172.21.15.171:0/3470835546 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f440c100840 msgr2=0x7f440c100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:06:20.104 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:06:20.100+0000 7f4411410640 1 --2- 172.21.15.171:0/3470835546 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f440c100840 0x7f440c100c40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f43fc009900 tx=0x7f43fc02a410 comp rx=0 tx=0).stop 2024-08-19T00:06:20.104 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:06:20.100+0000 7f4411410640 1 -- 172.21.15.171:0/3470835546 shutdown_connections 2024-08-19T00:06:20.104 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:06:20.100+0000 7f4411410640 1 --2- 172.21.15.171:0/3470835546 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f440c102400 0x7f440c108c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:06:20.104 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:06:20.100+0000 7f4411410640 1 --2- 172.21.15.171:0/3470835546 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f440c101a40 0x7f440c101ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:06:20.105 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:06:20.100+0000 7f4411410640 1 --2- 172.21.15.171:0/3470835546 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f440c100840 0x7f440c100c40 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:06:20.105 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:06:20.100+0000 7f4411410640 1 -- 172.21.15.171:0/3470835546 >> 172.21.15.171:0/3470835546 conn(0x7f440c0fbfd0 msgr2=0x7f440c0fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:06:20.105 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:06:20.100+0000 7f4411410640 1 -- 172.21.15.171:0/3470835546 shutdown_connections 2024-08-19T00:06:20.105 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:06:20.100+0000 7f4411410640 1 -- 172.21.15.171:0/3470835546 wait complete. 2024-08-19T00:06:20.105 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:06:20.101+0000 7f4411410640 1 Processor -- start 2024-08-19T00:06:20.105 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:06:20.101+0000 7f4411410640 1 -- start start 2024-08-19T00:06:20.105 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:06:20.101+0000 7f4411410640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f440c100840 0x7f440c197ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:06:20.105 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:06:20.101+0000 7f4411410640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f440c101a40 0x7f440c1981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:06:20.105 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:06:20.101+0000 7f4411410640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f440c102400 0x7f440c19f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:06:20.105 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:06:20.101+0000 7f4411410640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f440c10c4c0 con 0x7f440c102400 2024-08-19T00:06:20.106 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:06:20.101+0000 7f4411410640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f440c10c340 con 0x7f440c101a40 2024-08-19T00:06:20.106 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:06:20.101+0000 7f4411410640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f440c10c640 con 0x7f440c100840 2024-08-19T00:06:20.106 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:06:20.101+0000 7f440affd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f440c100840 0x7f440c197ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:06:20.106 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:06:20.101+0000 7f440affd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f440c100840 0x7f440c197ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:56564/0 (socket says 172.21.15.171:56564) 2024-08-19T00:06:20.106 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:06:20.101+0000 7f440affd640 1 -- 172.21.15.171:0/1623661432 learned_addr learned my addr 172.21.15.171:0/1623661432 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-08-19T00:06:20.106 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:06:20.101+0000 7f4403fff640 1 --2- 172.21.15.171:0/1623661432 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f440c101a40 0x7f440c1981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:06:20.106 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:06:20.102+0000 7f440b7fe640 1 --2- 172.21.15.171:0/1623661432 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f440c102400 0x7f440c19f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:06:20.106 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:06:20.102+0000 7f440affd640 1 -- 172.21.15.171:0/1623661432 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f440c101a40 msgr2=0x7f440c1981e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:06:20.107 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:06:20.102+0000 7f440affd640 1 --2- 172.21.15.171:0/1623661432 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f440c101a40 0x7f440c1981e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:06:20.107 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:06:20.102+0000 7f440affd640 1 -- 172.21.15.171:0/1623661432 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f440c102400 msgr2=0x7f440c19f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:06:20.107 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:06:20.102+0000 7f440affd640 1 --2- 172.21.15.171:0/1623661432 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f440c102400 0x7f440c19f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:06:20.107 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:06:20.102+0000 7f440affd640 1 -- 172.21.15.171:0/1623661432 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f440c19f8c0 con 0x7f440c100840 2024-08-19T00:06:20.107 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:06:20.102+0000 7f440affd640 1 --2- 172.21.15.171:0/1623661432 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f440c100840 0x7f440c197ca0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f43fc031610 tx=0x7f43fc004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:06:20.107 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:06:20.102+0000 7f4408ff9640 1 -- 172.21.15.171:0/1623661432 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43fc03f030 con 0x7f440c100840 2024-08-19T00:06:20.107 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:06:20.102+0000 7f4408ff9640 1 -- 172.21.15.171:0/1623661432 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43fc003ad0 con 0x7f440c100840 2024-08-19T00:06:20.107 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:06:20.102+0000 7f4411410640 1 -- 172.21.15.171:0/1623661432 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f440c19fb50 con 0x7f440c100840 2024-08-19T00:06:20.107 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:06:20.102+0000 7f4408ff9640 1 -- 172.21.15.171:0/1623661432 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43fc035070 con 0x7f440c100840 2024-08-19T00:06:20.107 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:06:20.102+0000 7f4411410640 1 -- 172.21.15.171:0/1623661432 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f440c1a0080 con 0x7f440c100840 2024-08-19T00:06:20.107 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:06:20.103+0000 7f4411410640 1 -- 172.21.15.171:0/1623661432 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f440c1a0250 con 0x7f440c100840 2024-08-19T00:06:20.109 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:06:20.104+0000 7f4408ff9640 1 -- 172.21.15.171:0/1623661432 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f43fc042030 con 0x7f440c100840 2024-08-19T00:06:20.109 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:06:20.105+0000 7f4408ff9640 1 --2- 172.21.15.171:0/1623661432 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f43f80a2b70 0x7f43f80a5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:06:20.109 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:06:20.105+0000 7f4408ff9640 1 -- 172.21.15.171:0/1623661432 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2309+0+0 (secure 0 0 0) 0x7f43fc0ede80 con 0x7f440c100840 2024-08-19T00:06:20.109 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:06:20.105+0000 7f4403fff640 1 --2- 172.21.15.171:0/1623661432 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f43f80a2b70 0x7f43f80a5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:06:20.109 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:06:20.106+0000 7f4403fff640 1 --2- 172.21.15.171:0/1623661432 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f43f80a2b70 0x7f43f80a5030 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f440c1991b0 tx=0x7f43f4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:06:20.110 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:06:20.109+0000 7f4408ff9640 1 -- 172.21.15.171:0/1623661432 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f43fc0bc630 con 0x7f440c100840 2024-08-19T00:06:20.285 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:06:20.284+0000 7f4411410640 1 -- 172.21.15.171:0/1623661432 --> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f440c06ac00 con 0x7f43f80a2b70 2024-08-19T00:06:20.285 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:20 smithi171 ceph-mon[21810]: purged_snaps scrub starts 2024-08-19T00:06:20.286 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:20 smithi171 ceph-mon[21810]: purged_snaps scrub ok 2024-08-19T00:06:20.286 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:20 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-19T00:06:20.286 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:20 smithi171 ceph-mon[21810]: osd.1 [v2:172.21.15.116:6800/613509556,v1:172.21.15.116:6801/613509556] boot 2024-08-19T00:06:20.286 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:20 smithi171 ceph-mon[21810]: osdmap e13: 2 total, 2 up, 2 in 2024-08-19T00:06:20.286 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:20 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-19T00:06:20.286 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:20 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:20.286 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:20 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:20.286 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:20 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:06:20.286 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:20 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:20.286 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:20 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:06:20.286 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:20 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:06:20.286 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:20 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:20.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:20 smithi044 ceph-mon[18489]: purged_snaps scrub starts 2024-08-19T00:06:20.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:20 smithi044 ceph-mon[18489]: purged_snaps scrub ok 2024-08-19T00:06:20.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:20 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-19T00:06:20.370 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:20 smithi044 ceph-mon[18489]: osd.1 [v2:172.21.15.116:6800/613509556,v1:172.21.15.116:6801/613509556] boot 2024-08-19T00:06:20.370 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:20 smithi044 ceph-mon[18489]: osdmap e13: 2 total, 2 up, 2 in 2024-08-19T00:06:20.370 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:20 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-19T00:06:20.370 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:20 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:20.370 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:20 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:20.370 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:20 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:06:20.370 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:20 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:20.370 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:20 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:06:20.370 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:20 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:06:20.370 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:20 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:20.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:20 smithi116 ceph-mon[21873]: purged_snaps scrub starts 2024-08-19T00:06:20.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:20 smithi116 ceph-mon[21873]: purged_snaps scrub ok 2024-08-19T00:06:20.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:20 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-19T00:06:20.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:20 smithi116 ceph-mon[21873]: osd.1 [v2:172.21.15.116:6800/613509556,v1:172.21.15.116:6801/613509556] boot 2024-08-19T00:06:20.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:20 smithi116 ceph-mon[21873]: osdmap e13: 2 total, 2 up, 2 in 2024-08-19T00:06:20.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:20 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-19T00:06:20.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:20 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:20.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:20 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:20.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:20 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:06:20.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:20 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:20.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:20 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:06:20.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:20 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:06:20.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:20 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:21.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:21 smithi171 ceph-mon[21810]: Detected new or changed devices on smithi116 2024-08-19T00:06:21.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:21 smithi171 ceph-mon[21810]: Adjusting osd_memory_target on smithi116 to 17088M 2024-08-19T00:06:21.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:21 smithi171 ceph-mon[21810]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:06:21.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:21 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-19T00:06:21.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:21 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-19T00:06:21.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:21 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:06:21.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:21 smithi171 ceph-mon[21810]: pgmap v54: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-19T00:06:21.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:21 smithi171 ceph-mon[21810]: osdmap e14: 2 total, 2 up, 2 in 2024-08-19T00:06:21.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:21 smithi116 ceph-mon[21873]: Detected new or changed devices on smithi116 2024-08-19T00:06:21.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:21 smithi116 ceph-mon[21873]: Adjusting osd_memory_target on smithi116 to 17088M 2024-08-19T00:06:21.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:21 smithi116 ceph-mon[21873]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:06:21.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:21 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-19T00:06:21.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:21 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-19T00:06:21.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:21 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:06:21.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:21 smithi116 ceph-mon[21873]: pgmap v54: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-19T00:06:21.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:21 smithi116 ceph-mon[21873]: osdmap e14: 2 total, 2 up, 2 in 2024-08-19T00:06:21.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:21 smithi044 ceph-mon[18489]: Detected new or changed devices on smithi116 2024-08-19T00:06:21.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:21 smithi044 ceph-mon[18489]: Adjusting osd_memory_target on smithi116 to 17088M 2024-08-19T00:06:21.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:21 smithi044 ceph-mon[18489]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:06:21.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:21 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-19T00:06:21.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:21 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-19T00:06:21.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:21 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:06:21.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:21 smithi044 ceph-mon[18489]: pgmap v54: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-19T00:06:21.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:21 smithi044 ceph-mon[18489]: osdmap e14: 2 total, 2 up, 2 in 2024-08-19T00:06:22.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:22 smithi171 ceph-mon[21810]: pgmap v56: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-19T00:06:22.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:22 smithi116 ceph-mon[21873]: pgmap v56: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-19T00:06:22.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:22 smithi044 ceph-mon[18489]: pgmap v56: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-19T00:06:23.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:23 smithi171 ceph-mon[21810]: from='client.? 172.21.15.171:0/2342459831' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "56994dfd-5fcf-4d82-addf-38764239d82a"}]: dispatch 2024-08-19T00:06:23.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:23 smithi171 ceph-mon[21810]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "56994dfd-5fcf-4d82-addf-38764239d82a"}]: dispatch 2024-08-19T00:06:23.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:23 smithi171 ceph-mon[21810]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "56994dfd-5fcf-4d82-addf-38764239d82a"}]': finished 2024-08-19T00:06:23.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:23 smithi171 ceph-mon[21810]: osdmap e15: 3 total, 2 up, 3 in 2024-08-19T00:06:23.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:23 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-19T00:06:23.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:23 smithi171 ceph-mon[21810]: from='client.? 172.21.15.171:0/970059650' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-19T00:06:23.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:23 smithi116 ceph-mon[21873]: from='client.? 172.21.15.171:0/2342459831' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "56994dfd-5fcf-4d82-addf-38764239d82a"}]: dispatch 2024-08-19T00:06:23.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:23 smithi116 ceph-mon[21873]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "56994dfd-5fcf-4d82-addf-38764239d82a"}]: dispatch 2024-08-19T00:06:23.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:23 smithi116 ceph-mon[21873]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "56994dfd-5fcf-4d82-addf-38764239d82a"}]': finished 2024-08-19T00:06:23.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:23 smithi116 ceph-mon[21873]: osdmap e15: 3 total, 2 up, 3 in 2024-08-19T00:06:23.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:23 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-19T00:06:23.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:23 smithi116 ceph-mon[21873]: from='client.? 172.21.15.171:0/970059650' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-19T00:06:23.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:23 smithi044 ceph-mon[18489]: from='client.? 172.21.15.171:0/2342459831' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "56994dfd-5fcf-4d82-addf-38764239d82a"}]: dispatch 2024-08-19T00:06:23.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:23 smithi044 ceph-mon[18489]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "56994dfd-5fcf-4d82-addf-38764239d82a"}]: dispatch 2024-08-19T00:06:23.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:23 smithi044 ceph-mon[18489]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "56994dfd-5fcf-4d82-addf-38764239d82a"}]': finished 2024-08-19T00:06:23.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:23 smithi044 ceph-mon[18489]: osdmap e15: 3 total, 2 up, 3 in 2024-08-19T00:06:23.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:23 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-19T00:06:23.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:23 smithi044 ceph-mon[18489]: from='client.? 172.21.15.171:0/970059650' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-19T00:06:24.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:24 smithi171 ceph-mon[21810]: pgmap v58: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-19T00:06:24.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:24 smithi116 ceph-mon[21873]: pgmap v58: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-19T00:06:24.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:24 smithi044 ceph-mon[18489]: pgmap v58: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-19T00:06:26.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:26 smithi171 ceph-mon[21810]: pgmap v59: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-19T00:06:26.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:26 smithi116 ceph-mon[21873]: pgmap v59: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-19T00:06:26.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:26 smithi044 ceph-mon[18489]: pgmap v59: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-19T00:06:28.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:28 smithi171 ceph-mon[21810]: pgmap v60: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-19T00:06:28.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:28 smithi116 ceph-mon[21873]: pgmap v60: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-19T00:06:28.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:28 smithi044 ceph-mon[18489]: pgmap v60: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-19T00:06:29.737 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:29 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-08-19T00:06:29.737 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:29 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:06:29.737 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:29 smithi171 ceph-mon[21810]: Deploying daemon osd.2 on smithi171 2024-08-19T00:06:29.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:29 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-08-19T00:06:29.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:29 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:06:29.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:29 smithi116 ceph-mon[21873]: Deploying daemon osd.2 on smithi171 2024-08-19T00:06:29.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:29 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-08-19T00:06:29.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:29 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:06:29.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:29 smithi044 ceph-mon[18489]: Deploying daemon osd.2 on smithi171 2024-08-19T00:06:30.701 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:30 smithi171 ceph-mon[21810]: pgmap v61: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-19T00:06:30.764 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:30 smithi116 ceph-mon[21873]: pgmap v61: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-19T00:06:30.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:30 smithi044 ceph-mon[18489]: pgmap v61: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-19T00:06:32.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:32 smithi171 ceph-mon[21810]: pgmap v62: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-19T00:06:32.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:32 smithi116 ceph-mon[21873]: pgmap v62: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-19T00:06:32.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:32 smithi044 ceph-mon[18489]: pgmap v62: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-19T00:06:34.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:33 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:06:34.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:33 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:34.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:33 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:34.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:33 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:06:34.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:33 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:34.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:33 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:34.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:33 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:06:34.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:33 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:34.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:33 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:35.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:34 smithi116 ceph-mon[21873]: pgmap v63: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-19T00:06:35.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:34 smithi044 ceph-mon[18489]: pgmap v63: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-19T00:06:35.238 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:34 smithi171 ceph-mon[21810]: pgmap v63: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-19T00:06:36.797 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:36 smithi171 ceph-mon[21810]: pgmap v64: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-19T00:06:36.834 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:06:36.833+0000 7f4408ff9640 1 -- 172.21.15.171:0/1623661432 <== mgr.14150 v2:172.21.15.44:6800/1330072146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f440c06ac00 con 0x7f43f80a2b70 2024-08-19T00:06:36.834 INFO:teuthology.orchestra.run.smithi171.stdout:Created osd(s) 2 on host 'smithi171' 2024-08-19T00:06:36.836 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:06:36.835+0000 7f4411410640 1 -- 172.21.15.171:0/1623661432 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f43f80a2b70 msgr2=0x7f43f80a5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:06:36.836 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:06:36.835+0000 7f4411410640 1 --2- 172.21.15.171:0/1623661432 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f43f80a2b70 0x7f43f80a5030 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f440c1991b0 tx=0x7f43f4005f90 comp rx=0 tx=0).stop 2024-08-19T00:06:36.837 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:06:36.835+0000 7f4411410640 1 -- 172.21.15.171:0/1623661432 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f440c100840 msgr2=0x7f440c197ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:06:36.837 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:06:36.835+0000 7f4411410640 1 --2- 172.21.15.171:0/1623661432 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f440c100840 0x7f440c197ca0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f43fc031610 tx=0x7f43fc004270 comp rx=0 tx=0).stop 2024-08-19T00:06:36.837 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:06:36.835+0000 7f4411410640 1 -- 172.21.15.171:0/1623661432 shutdown_connections 2024-08-19T00:06:36.837 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:06:36.835+0000 7f4411410640 1 --2- 172.21.15.171:0/1623661432 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f43f80a2b70 0x7f43f80a5030 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:06:36.837 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:06:36.835+0000 7f4411410640 1 --2- 172.21.15.171:0/1623661432 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f440c102400 0x7f440c19f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:06:36.837 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:06:36.835+0000 7f4411410640 1 --2- 172.21.15.171:0/1623661432 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f440c101a40 0x7f440c1981e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:06:36.837 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:06:36.835+0000 7f4411410640 1 --2- 172.21.15.171:0/1623661432 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f440c100840 0x7f440c197ca0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:06:36.837 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:06:36.835+0000 7f4411410640 1 -- 172.21.15.171:0/1623661432 >> 172.21.15.171:0/1623661432 conn(0x7f440c0fbfd0 msgr2=0x7f440c06a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:06:36.837 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:06:36.835+0000 7f4411410640 1 -- 172.21.15.171:0/1623661432 shutdown_connections 2024-08-19T00:06:36.838 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:06:36.835+0000 7f4411410640 1 -- 172.21.15.171:0/1623661432 wait complete. 2024-08-19T00:06:36.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:36 smithi116 ceph-mon[21873]: pgmap v64: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-19T00:06:36.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:36 smithi044 ceph-mon[18489]: pgmap v64: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-19T00:06:37.469 DEBUG:teuthology.orchestra.run.smithi171:osd.2> sudo journalctl -f -n 0 -u ceph-647ded64-5dbe-11ef-bccf-c7b262605968@osd.2.service 2024-08-19T00:06:37.472 INFO:tasks.cephadm:Deploying osd.3 on smithi044 with /dev/vg_nvme/lv_3... 2024-08-19T00:06:37.472 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-08-19T00:06:37.743 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:06:37.830 INFO:journalctl@ceph.osd.2.smithi171.stdout:Aug 19 00:06:37 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-2[26744]: 2024-08-19T00:06:37.677+0000 7f0b4124e640 -1 osd.2 0 log_to_monitors true 2024-08-19T00:06:38.083 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:37 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:38.083 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:37 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:38.083 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:37 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:38.083 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:37 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:38.083 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:37 smithi171 ceph-mon[21810]: from='osd.2 [v2:172.21.15.171:6800/2130938937,v1:172.21.15.171:6801/2130938937]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-08-19T00:06:38.083 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:37 smithi171 ceph-mon[21810]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-08-19T00:06:38.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:37 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:38.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:37 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:38.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:37 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:38.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:37 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:38.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:37 smithi116 ceph-mon[21873]: from='osd.2 [v2:172.21.15.171:6800/2130938937,v1:172.21.15.171:6801/2130938937]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-08-19T00:06:38.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:37 smithi116 ceph-mon[21873]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-08-19T00:06:38.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:37 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:38.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:37 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:38.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:37 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:38.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:37 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:38.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:37 smithi044 ceph-mon[18489]: from='osd.2 [v2:172.21.15.171:6800/2130938937,v1:172.21.15.171:6801/2130938937]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-08-19T00:06:38.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:37 smithi044 ceph-mon[18489]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-08-19T00:06:39.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:38 smithi171 ceph-mon[21810]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-19T00:06:39.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:38 smithi171 ceph-mon[21810]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-19T00:06:39.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:38 smithi171 ceph-mon[21810]: osdmap e16: 3 total, 2 up, 3 in 2024-08-19T00:06:39.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:38 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-19T00:06:39.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:38 smithi171 ceph-mon[21810]: from='osd.2 [v2:172.21.15.171:6800/2130938937,v1:172.21.15.171:6801/2130938937]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-08-19T00:06:39.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:38 smithi171 ceph-mon[21810]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-08-19T00:06:39.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:38 smithi116 ceph-mon[21873]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-19T00:06:39.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:38 smithi116 ceph-mon[21873]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-19T00:06:39.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:38 smithi116 ceph-mon[21873]: osdmap e16: 3 total, 2 up, 3 in 2024-08-19T00:06:39.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:38 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-19T00:06:39.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:38 smithi116 ceph-mon[21873]: from='osd.2 [v2:172.21.15.171:6800/2130938937,v1:172.21.15.171:6801/2130938937]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-08-19T00:06:39.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:38 smithi116 ceph-mon[21873]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-08-19T00:06:39.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:38 smithi044 ceph-mon[18489]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-19T00:06:39.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:38 smithi044 ceph-mon[18489]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-19T00:06:39.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:38 smithi044 ceph-mon[18489]: osdmap e16: 3 total, 2 up, 3 in 2024-08-19T00:06:39.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:38 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-19T00:06:39.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:38 smithi044 ceph-mon[18489]: from='osd.2 [v2:172.21.15.171:6800/2130938937,v1:172.21.15.171:6801/2130938937]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-08-19T00:06:39.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:38 smithi044 ceph-mon[18489]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-08-19T00:06:40.526 INFO:journalctl@ceph.osd.2.smithi171.stdout:Aug 19 00:06:40 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-2[26744]: 2024-08-19T00:06:40.218+0000 7f0b3d9e5640 -1 osd.2 0 waiting for initial osdmap 2024-08-19T00:06:40.526 INFO:journalctl@ceph.osd.2.smithi171.stdout:Aug 19 00:06:40 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-2[26744]: 2024-08-19T00:06:40.224+0000 7f0b34ff1640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-19T00:06:40.613 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:40 smithi044 ceph-mon[18489]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]': finished 2024-08-19T00:06:40.614 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:40 smithi044 ceph-mon[18489]: osdmap e17: 3 total, 2 up, 3 in 2024-08-19T00:06:40.614 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:40 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-19T00:06:40.614 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:40 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-19T00:06:40.614 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:40 smithi044 ceph-mon[18489]: from='osd.2 ' entity='osd.2' 2024-08-19T00:06:40.614 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:40 smithi044 ceph-mon[18489]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-19T00:06:40.617 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:06:40.646 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi044:vg_nvme/lv_3 2024-08-19T00:06:40.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:40 smithi171 ceph-mon[21810]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]': finished 2024-08-19T00:06:40.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:40 smithi171 ceph-mon[21810]: osdmap e17: 3 total, 2 up, 3 in 2024-08-19T00:06:40.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:40 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-19T00:06:40.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:40 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-19T00:06:40.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:40 smithi171 ceph-mon[21810]: from='osd.2 ' entity='osd.2' 2024-08-19T00:06:40.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:40 smithi171 ceph-mon[21810]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-19T00:06:40.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:40 smithi116 ceph-mon[21873]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]': finished 2024-08-19T00:06:40.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:40 smithi116 ceph-mon[21873]: osdmap e17: 3 total, 2 up, 3 in 2024-08-19T00:06:40.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:40 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-19T00:06:40.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:40 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-19T00:06:40.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:40 smithi116 ceph-mon[21873]: from='osd.2 ' entity='osd.2' 2024-08-19T00:06:40.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:40 smithi116 ceph-mon[21873]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-19T00:06:40.906 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:06:41.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:06:41.376+0000 7f89fca54640 1 -- 172.21.15.44:0/1332803762 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89f81076b0 msgr2=0x7f89f8109aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:06:41.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:06:41.376+0000 7f89fca54640 1 --2- 172.21.15.44:0/1332803762 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89f81076b0 0x7f89f8109aa0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f89f0009ca0 tx=0x7f89f002a8c0 comp rx=0 tx=0).stop 2024-08-19T00:06:41.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:06:41.376+0000 7f89fca54640 1 -- 172.21.15.44:0/1332803762 shutdown_connections 2024-08-19T00:06:41.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:06:41.376+0000 7f89fca54640 1 --2- 172.21.15.44:0/1332803762 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f89f8104d80 0x7f89f8107170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:06:41.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:06:41.376+0000 7f89fca54640 1 --2- 172.21.15.44:0/1332803762 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89f81076b0 0x7f89f8109aa0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:06:41.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:06:41.376+0000 7f89fca54640 1 --2- 172.21.15.44:0/1332803762 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f89f8102450 0x7f89f8104840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:06:41.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:06:41.376+0000 7f89fca54640 1 -- 172.21.15.44:0/1332803762 >> 172.21.15.44:0/1332803762 conn(0x7f89f80fbfb0 msgr2=0x7f89f80fe3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:06:41.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:06:41.376+0000 7f89fca54640 1 -- 172.21.15.44:0/1332803762 shutdown_connections 2024-08-19T00:06:41.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:06:41.376+0000 7f89fca54640 1 -- 172.21.15.44:0/1332803762 wait complete. 2024-08-19T00:06:41.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:06:41.377+0000 7f89fca54640 1 Processor -- start 2024-08-19T00:06:41.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:06:41.377+0000 7f89fca54640 1 -- start start 2024-08-19T00:06:41.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:06:41.377+0000 7f89fca54640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f89f8102450 0x7f89f8101db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:06:41.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:06:41.377+0000 7f89fca54640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89f8104d80 0x7f89f8100400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:06:41.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:06:41.377+0000 7f89fca54640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f89f81076b0 0x7f89f8100940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:06:41.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:06:41.377+0000 7f89fca54640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f89f810d5a0 con 0x7f89f8104d80 2024-08-19T00:06:41.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:06:41.377+0000 7f89fca54640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f89f810d420 con 0x7f89f8102450 2024-08-19T00:06:41.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:06:41.377+0000 7f89fca54640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f89f810d720 con 0x7f89f81076b0 2024-08-19T00:06:41.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:06:41.377+0000 7f89f5d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89f8104d80 0x7f89f8100400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:06:41.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:06:41.378+0000 7f89f5d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89f8104d80 0x7f89f8100400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53900/0 (socket says 172.21.15.44:53900) 2024-08-19T00:06:41.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:06:41.378+0000 7f89f5d9b640 1 -- 172.21.15.44:0/3167818533 learned_addr learned my addr 172.21.15.44:0/3167818533 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:06:41.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:06:41.378+0000 7f89f6d9d640 1 --2- 172.21.15.44:0/3167818533 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f89f81076b0 0x7f89f8100940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:06:41.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:06:41.378+0000 7f89f659c640 1 --2- 172.21.15.44:0/3167818533 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f89f8102450 0x7f89f8101db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:06:41.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:06:41.378+0000 7f89f5d9b640 1 -- 172.21.15.44:0/3167818533 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f89f81076b0 msgr2=0x7f89f8100940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:06:41.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:06:41.378+0000 7f89f5d9b640 1 --2- 172.21.15.44:0/3167818533 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f89f81076b0 0x7f89f8100940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:06:41.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:06:41.378+0000 7f89f5d9b640 1 -- 172.21.15.44:0/3167818533 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f89f8102450 msgr2=0x7f89f8101db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:06:41.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:06:41.378+0000 7f89f5d9b640 1 --2- 172.21.15.44:0/3167818533 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f89f8102450 0x7f89f8101db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:06:41.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:06:41.378+0000 7f89f5d9b640 1 -- 172.21.15.44:0/3167818533 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89f8101200 con 0x7f89f8104d80 2024-08-19T00:06:41.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:06:41.378+0000 7f89f5d9b640 1 --2- 172.21.15.44:0/3167818533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89f8104d80 0x7f89f8100400 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f89ec00c970 tx=0x7f89ec00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:06:41.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:06:41.378+0000 7f89e77fe640 1 -- 172.21.15.44:0/3167818533 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89ec007bb0 con 0x7f89f8104d80 2024-08-19T00:06:41.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:06:41.378+0000 7f89e77fe640 1 -- 172.21.15.44:0/3167818533 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f89ec007d50 con 0x7f89f8104d80 2024-08-19T00:06:41.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:06:41.378+0000 7f89fca54640 1 -- 172.21.15.44:0/3167818533 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89f81a1d60 con 0x7f89f8104d80 2024-08-19T00:06:41.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:06:41.378+0000 7f89e77fe640 1 -- 172.21.15.44:0/3167818533 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89ec00f450 con 0x7f89f8104d80 2024-08-19T00:06:41.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:06:41.378+0000 7f89fca54640 1 -- 172.21.15.44:0/3167818533 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89f81a2210 con 0x7f89f8104d80 2024-08-19T00:06:41.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:06:41.379+0000 7f89fca54640 1 -- 172.21.15.44:0/3167818533 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89f80fdaa0 con 0x7f89f8104d80 2024-08-19T00:06:41.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:06:41.381+0000 7f89e77fe640 1 -- 172.21.15.44:0/3167818533 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f89ec0046c0 con 0x7f89f8104d80 2024-08-19T00:06:41.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:06:41.382+0000 7f89e77fe640 1 --2- 172.21.15.44:0/3167818533 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f89e00a2af0 0x7f89e00a4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:06:41.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:06:41.382+0000 7f89f659c640 1 --2- 172.21.15.44:0/3167818533 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f89e00a2af0 0x7f89e00a4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:06:41.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:06:41.382+0000 7f89e77fe640 1 -- 172.21.15.44:0/3167818533 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2851+0+0 (secure 0 0 0) 0x7f89ec0cd930 con 0x7f89f8104d80 2024-08-19T00:06:41.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:06:41.383+0000 7f89f659c640 1 --2- 172.21.15.44:0/3167818533 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f89e00a2af0 0x7f89e00a4fb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f89e800bbe0 tx=0x7f89e800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:06:41.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:06:41.386+0000 7f89e77fe640 1 -- 172.21.15.44:0/3167818533 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f89ec014030 con 0x7f89f8104d80 2024-08-19T00:06:41.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:06:41.574+0000 7f89fca54640 1 -- 172.21.15.44:0/3167818533 --> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f89f8062360 con 0x7f89e00a2af0 2024-08-19T00:06:41.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:41 smithi171 ceph-mon[21810]: purged_snaps scrub starts 2024-08-19T00:06:41.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:41 smithi171 ceph-mon[21810]: purged_snaps scrub ok 2024-08-19T00:06:41.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:41 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-19T00:06:41.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:41 smithi171 ceph-mon[21810]: Detected new or changed devices on smithi171 2024-08-19T00:06:41.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:41 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:41.844 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:41 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:41.844 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:41 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:06:41.844 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:41 smithi171 ceph-mon[21810]: Adjusting osd_memory_target on smithi171 to 17088M 2024-08-19T00:06:41.844 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:41 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:41.844 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:41 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:06:41.844 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:41 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:06:41.845 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:41 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:41.845 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:41 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:06:41.845 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:41 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:06:41.845 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:41 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:06:41.845 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:41 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:41.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:41 smithi171 ceph-mon[21810]: osd.2 [v2:172.21.15.171:6800/2130938937,v1:172.21.15.171:6801/2130938937] boot 2024-08-19T00:06:41.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:41 smithi171 ceph-mon[21810]: osdmap e18: 3 total, 3 up, 3 in 2024-08-19T00:06:41.846 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:41 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-19T00:06:41.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:41 smithi116 ceph-mon[21873]: purged_snaps scrub starts 2024-08-19T00:06:41.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:41 smithi116 ceph-mon[21873]: purged_snaps scrub ok 2024-08-19T00:06:41.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:41 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-19T00:06:41.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:41 smithi116 ceph-mon[21873]: Detected new or changed devices on smithi171 2024-08-19T00:06:41.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:41 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:41.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:41 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:41.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:41 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:06:41.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:41 smithi116 ceph-mon[21873]: Adjusting osd_memory_target on smithi171 to 17088M 2024-08-19T00:06:41.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:41 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:41.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:41 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:06:41.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:41 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:06:41.867 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:41 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:41.867 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:41 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:06:41.867 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:41 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:06:41.867 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:41 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:06:41.867 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:41 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:41.867 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:41 smithi116 ceph-mon[21873]: osd.2 [v2:172.21.15.171:6800/2130938937,v1:172.21.15.171:6801/2130938937] boot 2024-08-19T00:06:41.867 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:41 smithi116 ceph-mon[21873]: osdmap e18: 3 total, 3 up, 3 in 2024-08-19T00:06:41.867 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:41 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-19T00:06:41.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:41 smithi044 ceph-mon[18489]: purged_snaps scrub starts 2024-08-19T00:06:41.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:41 smithi044 ceph-mon[18489]: purged_snaps scrub ok 2024-08-19T00:06:41.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:41 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-19T00:06:41.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:41 smithi044 ceph-mon[18489]: Detected new or changed devices on smithi171 2024-08-19T00:06:41.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:41 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:41.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:41 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:41.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:41 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:06:41.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:41 smithi044 ceph-mon[18489]: Adjusting osd_memory_target on smithi171 to 17088M 2024-08-19T00:06:41.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:41 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:41.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:41 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:06:41.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:41 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:06:41.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:41 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:41.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:41 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:06:41.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:41 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:06:41.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:41 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:06:41.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:41 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:41.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:41 smithi044 ceph-mon[18489]: osd.2 [v2:172.21.15.171:6800/2130938937,v1:172.21.15.171:6801/2130938937] boot 2024-08-19T00:06:41.871 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:41 smithi044 ceph-mon[18489]: osdmap e18: 3 total, 3 up, 3 in 2024-08-19T00:06:41.871 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:41 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-19T00:06:42.907 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:42 smithi044 ceph-mon[18489]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:06:42.907 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:42 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-19T00:06:42.907 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:42 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-19T00:06:42.907 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:42 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:06:42.907 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:42 smithi044 ceph-mon[18489]: pgmap v70: 0 pgs: ; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-08-19T00:06:43.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:42 smithi171 ceph-mon[21810]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:06:43.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:42 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-19T00:06:43.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:42 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-19T00:06:43.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:42 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:06:43.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:42 smithi171 ceph-mon[21810]: pgmap v70: 0 pgs: ; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-08-19T00:06:43.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:42 smithi116 ceph-mon[21873]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:06:43.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:42 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-19T00:06:43.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:42 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-19T00:06:43.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:42 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:06:43.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:42 smithi116 ceph-mon[21873]: pgmap v70: 0 pgs: ; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-08-19T00:06:43.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:43 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-08-19T00:06:43.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:43 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-08-19T00:06:43.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:43 smithi044 ceph-mon[18489]: osdmap e19: 3 total, 3 up, 3 in 2024-08-19T00:06:43.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:43 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-08-19T00:06:44.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:43 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-08-19T00:06:44.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:43 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-08-19T00:06:44.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:43 smithi171 ceph-mon[21810]: osdmap e19: 3 total, 3 up, 3 in 2024-08-19T00:06:44.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:43 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-08-19T00:06:44.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:43 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-08-19T00:06:44.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:43 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-08-19T00:06:44.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:43 smithi116 ceph-mon[21873]: osdmap e19: 3 total, 3 up, 3 in 2024-08-19T00:06:44.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:43 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-08-19T00:06:44.339 INFO:journalctl@ceph.osd.0.smithi044.stdout:Aug 19 00:06:44 smithi044 sudo[36853]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-19T00:06:44.339 INFO:journalctl@ceph.osd.0.smithi044.stdout:Aug 19 00:06:44 smithi044 sudo[36853]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-19T00:06:44.339 INFO:journalctl@ceph.osd.0.smithi044.stdout:Aug 19 00:06:44 smithi044 sudo[36853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-19T00:06:44.339 INFO:journalctl@ceph.osd.0.smithi044.stdout:Aug 19 00:06:44 smithi044 sudo[36853]: pam_unix(sudo:session): session closed for user root 2024-08-19T00:06:44.619 INFO:journalctl@ceph.osd.0.smithi044.stdout:Aug 19 00:06:44 smithi044 sudo[36881]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-19T00:06:44.619 INFO:journalctl@ceph.osd.0.smithi044.stdout:Aug 19 00:06:44 smithi044 sudo[36881]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-19T00:06:44.619 INFO:journalctl@ceph.osd.0.smithi044.stdout:Aug 19 00:06:44 smithi044 sudo[36881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-19T00:06:44.619 INFO:journalctl@ceph.osd.0.smithi044.stdout:Aug 19 00:06:44 smithi044 sudo[36881]: pam_unix(sudo:session): session closed for user root 2024-08-19T00:06:44.875 INFO:journalctl@ceph.osd.1.smithi116.stdout:Aug 19 00:06:44 smithi116 sudo[29978]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-19T00:06:44.875 INFO:journalctl@ceph.osd.1.smithi116.stdout:Aug 19 00:06:44 smithi116 sudo[29978]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-19T00:06:44.875 INFO:journalctl@ceph.osd.1.smithi116.stdout:Aug 19 00:06:44 smithi116 sudo[29978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-19T00:06:44.875 INFO:journalctl@ceph.osd.1.smithi116.stdout:Aug 19 00:06:44 smithi116 sudo[29978]: pam_unix(sudo:session): session closed for user root 2024-08-19T00:06:44.875 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:44 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-08-19T00:06:44.875 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:44 smithi116 ceph-mon[21873]: osdmap e20: 3 total, 3 up, 3 in 2024-08-19T00:06:44.875 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:44 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/1104625507' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6d2ddb19-74e0-4e68-b9ea-58b73fd1e9fe"}]: dispatch 2024-08-19T00:06:44.876 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:44 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/1104625507' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6d2ddb19-74e0-4e68-b9ea-58b73fd1e9fe"}]': finished 2024-08-19T00:06:44.876 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:44 smithi116 ceph-mon[21873]: osdmap e21: 4 total, 3 up, 4 in 2024-08-19T00:06:44.876 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:44 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-19T00:06:44.876 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:44 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:44.876 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:44 smithi116 ceph-mon[21873]: pgmap v74: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-08-19T00:06:44.876 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:44 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/3333535808' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-19T00:06:45.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:44 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-08-19T00:06:45.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:44 smithi171 ceph-mon[21810]: osdmap e20: 3 total, 3 up, 3 in 2024-08-19T00:06:45.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:44 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/1104625507' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6d2ddb19-74e0-4e68-b9ea-58b73fd1e9fe"}]: dispatch 2024-08-19T00:06:45.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:44 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/1104625507' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6d2ddb19-74e0-4e68-b9ea-58b73fd1e9fe"}]': finished 2024-08-19T00:06:45.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:44 smithi171 ceph-mon[21810]: osdmap e21: 4 total, 3 up, 4 in 2024-08-19T00:06:45.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:44 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-19T00:06:45.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:44 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:45.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:44 smithi171 ceph-mon[21810]: pgmap v74: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-08-19T00:06:45.093 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:44 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/3333535808' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-19T00:06:45.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:44 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-08-19T00:06:45.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:44 smithi044 ceph-mon[18489]: osdmap e20: 3 total, 3 up, 3 in 2024-08-19T00:06:45.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:44 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/1104625507' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6d2ddb19-74e0-4e68-b9ea-58b73fd1e9fe"}]: dispatch 2024-08-19T00:06:45.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:44 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/1104625507' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6d2ddb19-74e0-4e68-b9ea-58b73fd1e9fe"}]': finished 2024-08-19T00:06:45.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:44 smithi044 ceph-mon[18489]: osdmap e21: 4 total, 3 up, 4 in 2024-08-19T00:06:45.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:44 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-19T00:06:45.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:44 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:45.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:44 smithi044 ceph-mon[18489]: pgmap v74: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-08-19T00:06:45.120 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:44 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/3333535808' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-19T00:06:45.365 INFO:journalctl@ceph.osd.1.smithi116.stdout:Aug 19 00:06:44 smithi116 sudo[29981]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-19T00:06:45.365 INFO:journalctl@ceph.osd.1.smithi116.stdout:Aug 19 00:06:44 smithi116 sudo[29981]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-19T00:06:45.365 INFO:journalctl@ceph.osd.1.smithi116.stdout:Aug 19 00:06:44 smithi116 sudo[29981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-19T00:06:45.365 INFO:journalctl@ceph.osd.1.smithi116.stdout:Aug 19 00:06:44 smithi116 sudo[29981]: pam_unix(sudo:session): session closed for user root 2024-08-19T00:06:45.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:06:45.379+0000 7f89e77fe640 1 -- 172.21.15.44:0/3167818533 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f89ec097ee0 con 0x7f89f8104d80 2024-08-19T00:06:45.408 INFO:journalctl@ceph.osd.2.smithi171.stdout:Aug 19 00:06:45 smithi171 sudo[30348]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-19T00:06:45.408 INFO:journalctl@ceph.osd.2.smithi171.stdout:Aug 19 00:06:45 smithi171 sudo[30348]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-19T00:06:45.408 INFO:journalctl@ceph.osd.2.smithi171.stdout:Aug 19 00:06:45 smithi171 sudo[30348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-19T00:06:45.408 INFO:journalctl@ceph.osd.2.smithi171.stdout:Aug 19 00:06:45 smithi171 sudo[30348]: pam_unix(sudo:session): session closed for user root 2024-08-19T00:06:45.842 INFO:journalctl@ceph.osd.2.smithi171.stdout:Aug 19 00:06:45 smithi171 sudo[30351]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-19T00:06:45.842 INFO:journalctl@ceph.osd.2.smithi171.stdout:Aug 19 00:06:45 smithi171 sudo[30351]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-19T00:06:45.842 INFO:journalctl@ceph.osd.2.smithi171.stdout:Aug 19 00:06:45 smithi171 sudo[30351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-19T00:06:45.842 INFO:journalctl@ceph.osd.2.smithi171.stdout:Aug 19 00:06:45 smithi171 sudo[30351]: pam_unix(sudo:session): session closed for user root 2024-08-19T00:06:45.960 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:45 smithi044 sudo[37299]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-19T00:06:45.961 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:45 smithi044 sudo[37299]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-19T00:06:45.961 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:45 smithi044 sudo[37299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-19T00:06:45.961 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:45 smithi044 sudo[37299]: pam_unix(sudo:session): session closed for user root 2024-08-19T00:06:46.222 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:45 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:46.222 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:45 smithi171 ceph-mon[21810]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-08-19T00:06:46.222 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:45 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:46.222 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:45 smithi171 ceph-mon[21810]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-19T00:06:46.222 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:46 smithi171 sudo[30354]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-19T00:06:46.222 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:46 smithi171 sudo[30354]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-19T00:06:46.222 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:46 smithi171 sudo[30354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-19T00:06:46.222 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:46 smithi171 sudo[30354]: pam_unix(sudo:session): session closed for user root 2024-08-19T00:06:46.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:45 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:46.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:45 smithi116 ceph-mon[21873]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-08-19T00:06:46.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:45 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:46.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:45 smithi116 ceph-mon[21873]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-19T00:06:46.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:45 smithi044 sudo[37486]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-19T00:06:46.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:45 smithi044 sudo[37486]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-19T00:06:46.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:45 smithi044 sudo[37486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-19T00:06:46.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:45 smithi044 sudo[37486]: pam_unix(sudo:session): session closed for user root 2024-08-19T00:06:46.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:45 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:46.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:45 smithi044 ceph-mon[18489]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-08-19T00:06:46.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:45 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:46.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:45 smithi044 ceph-mon[18489]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-19T00:06:46.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:46 smithi171 sudo[30357]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-19T00:06:46.594 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:46 smithi171 sudo[30357]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-19T00:06:46.594 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:46 smithi171 sudo[30357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-19T00:06:46.595 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:46 smithi171 sudo[30357]: pam_unix(sudo:session): session closed for user root 2024-08-19T00:06:46.966 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:46 smithi116 sudo[29984]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-19T00:06:46.966 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:46 smithi116 sudo[29984]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-19T00:06:46.967 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:46 smithi116 sudo[29984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-19T00:06:46.967 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:46 smithi116 sudo[29984]: pam_unix(sudo:session): session closed for user root 2024-08-19T00:06:47.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:46 smithi171 ceph-mon[21810]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-19T00:06:47.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:46 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-19T00:06:47.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:46 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-19T00:06:47.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:46 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-19T00:06:47.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:46 smithi171 ceph-mon[21810]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-19T00:06:47.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:46 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-19T00:06:47.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:46 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-19T00:06:47.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:46 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-19T00:06:47.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:46 smithi171 ceph-mon[21810]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 93 MiB used, 268 GiB / 268 GiB avail 2024-08-19T00:06:47.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:46 smithi171 ceph-mon[21810]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-19T00:06:47.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:46 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-19T00:06:47.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:46 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-19T00:06:47.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:46 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-19T00:06:47.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:46 smithi116 sudo[29987]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-19T00:06:47.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:46 smithi116 sudo[29987]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-19T00:06:47.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:46 smithi116 sudo[29987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-19T00:06:47.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:46 smithi116 sudo[29987]: pam_unix(sudo:session): session closed for user root 2024-08-19T00:06:47.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:46 smithi116 ceph-mon[21873]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-19T00:06:47.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:46 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-19T00:06:47.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:46 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-19T00:06:47.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:46 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-19T00:06:47.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:46 smithi116 ceph-mon[21873]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-19T00:06:47.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:46 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-19T00:06:47.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:46 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-19T00:06:47.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:46 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-19T00:06:47.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:46 smithi116 ceph-mon[21873]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 93 MiB used, 268 GiB / 268 GiB avail 2024-08-19T00:06:47.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:46 smithi116 ceph-mon[21873]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-19T00:06:47.367 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:46 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-19T00:06:47.367 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:46 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-19T00:06:47.367 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:46 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-19T00:06:47.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:46 smithi044 ceph-mon[18489]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-19T00:06:47.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:46 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-19T00:06:47.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:46 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-19T00:06:47.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:46 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-19T00:06:47.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:46 smithi044 ceph-mon[18489]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-19T00:06:47.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:46 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-19T00:06:47.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:46 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-19T00:06:47.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:46 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-19T00:06:47.370 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:46 smithi044 ceph-mon[18489]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 93 MiB used, 268 GiB / 268 GiB avail 2024-08-19T00:06:47.370 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:46 smithi044 ceph-mon[18489]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-19T00:06:47.370 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:46 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-19T00:06:47.370 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:46 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-19T00:06:47.370 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:46 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-19T00:06:48.066 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:47 smithi044 ceph-mon[18489]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-19T00:06:48.066 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:47 smithi044 ceph-mon[18489]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-19T00:06:48.267 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:47 smithi116 ceph-mon[21873]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-19T00:06:48.267 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:47 smithi116 ceph-mon[21873]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-19T00:06:48.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:47 smithi171 ceph-mon[21810]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-19T00:06:48.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:47 smithi171 ceph-mon[21810]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-19T00:06:49.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:48 smithi044 ceph-mon[18489]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-08-19T00:06:49.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:48 smithi171 ceph-mon[21810]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-08-19T00:06:49.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:48 smithi116 ceph-mon[21873]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-08-19T00:06:50.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:50 smithi044 ceph-mon[18489]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 5.0 KiB/s rd, 196 KiB/s wr, 14 op/s 2024-08-19T00:06:50.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:50 smithi171 ceph-mon[21810]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 5.0 KiB/s rd, 196 KiB/s wr, 14 op/s 2024-08-19T00:06:50.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:50 smithi116 ceph-mon[21873]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 5.0 KiB/s rd, 196 KiB/s wr, 14 op/s 2024-08-19T00:06:51.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:51 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-08-19T00:06:51.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:51 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:06:51.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:51 smithi171 ceph-mon[21810]: Deploying daemon osd.3 on smithi044 2024-08-19T00:06:51.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:51 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-08-19T00:06:51.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:51 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:06:51.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:51 smithi116 ceph-mon[21873]: Deploying daemon osd.3 on smithi044 2024-08-19T00:06:51.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:51 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-08-19T00:06:51.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:51 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:06:51.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:51 smithi044 ceph-mon[18489]: Deploying daemon osd.3 on smithi044 2024-08-19T00:06:52.565 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:52 smithi044 ceph-mon[18489]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-08-19T00:06:52.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:52 smithi171 ceph-mon[21810]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-08-19T00:06:52.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:52 smithi116 ceph-mon[21873]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-08-19T00:06:54.656 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:54 smithi044 ceph-mon[18489]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 98 KiB/s wr, 7 op/s 2024-08-19T00:06:54.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:54 smithi171 ceph-mon[21810]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 98 KiB/s wr, 7 op/s 2024-08-19T00:06:54.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:54 smithi116 ceph-mon[21873]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 98 KiB/s wr, 7 op/s 2024-08-19T00:06:56.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:55 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:06:56.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:55 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:56.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:55 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:56.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:55 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:06:56.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:55 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:56.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:55 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:56.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:55 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:06:56.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:55 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:56.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:55 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:57.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:56 smithi171 ceph-mon[21810]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-08-19T00:06:57.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:56 smithi116 ceph-mon[21873]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-08-19T00:06:57.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:56 smithi044 ceph-mon[18489]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-08-19T00:06:59.090 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:58 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:59.091 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:58 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:59.091 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:58 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:06:59.091 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:58 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:06:59.091 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:58 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:59.091 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:58 smithi044 ceph-mon[18489]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-08-19T00:06:59.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:06:59.127+0000 7f89e77fe640 1 -- 172.21.15.44:0/3167818533 <== mgr.14150 v2:172.21.15.44:6800/1330072146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f89f8062360 con 0x7f89e00a2af0 2024-08-19T00:06:59.128 INFO:teuthology.orchestra.run.smithi044.stdout:Created osd(s) 3 on host 'smithi044' 2024-08-19T00:06:59.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:06:59.129+0000 7f89fca54640 1 -- 172.21.15.44:0/3167818533 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f89e00a2af0 msgr2=0x7f89e00a4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:06:59.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:06:59.129+0000 7f89fca54640 1 --2- 172.21.15.44:0/3167818533 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f89e00a2af0 0x7f89e00a4fb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f89e800bbe0 tx=0x7f89e800b390 comp rx=0 tx=0).stop 2024-08-19T00:06:59.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:06:59.129+0000 7f89fca54640 1 -- 172.21.15.44:0/3167818533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89f8104d80 msgr2=0x7f89f8100400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:06:59.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:06:59.129+0000 7f89fca54640 1 --2- 172.21.15.44:0/3167818533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89f8104d80 0x7f89f8100400 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f89ec00c970 tx=0x7f89ec00ce30 comp rx=0 tx=0).stop 2024-08-19T00:06:59.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:06:59.129+0000 7f89fca54640 1 -- 172.21.15.44:0/3167818533 shutdown_connections 2024-08-19T00:06:59.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:06:59.129+0000 7f89fca54640 1 --2- 172.21.15.44:0/3167818533 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f89e00a2af0 0x7f89e00a4fb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:06:59.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:06:59.129+0000 7f89fca54640 1 --2- 172.21.15.44:0/3167818533 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f89f81076b0 0x7f89f8100940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:06:59.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:06:59.129+0000 7f89fca54640 1 --2- 172.21.15.44:0/3167818533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89f8104d80 0x7f89f8100400 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:06:59.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:06:59.129+0000 7f89fca54640 1 --2- 172.21.15.44:0/3167818533 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f89f8102450 0x7f89f8101db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:06:59.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:06:59.129+0000 7f89fca54640 1 -- 172.21.15.44:0/3167818533 >> 172.21.15.44:0/3167818533 conn(0x7f89f80fbfb0 msgr2=0x7f89f8102cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:06:59.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:06:59.129+0000 7f89fca54640 1 -- 172.21.15.44:0/3167818533 shutdown_connections 2024-08-19T00:06:59.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:06:59.129+0000 7f89fca54640 1 -- 172.21.15.44:0/3167818533 wait complete. 2024-08-19T00:06:59.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:58 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:59.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:58 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:59.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:58 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:06:59.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:58 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:06:59.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:58 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:59.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:58 smithi171 ceph-mon[21810]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-08-19T00:06:59.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:58 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:59.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:58 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:59.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:58 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:06:59.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:58 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:06:59.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:58 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:59.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:58 smithi116 ceph-mon[21873]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-08-19T00:06:59.737 DEBUG:teuthology.orchestra.run.smithi044:osd.3> sudo journalctl -f -n 0 -u ceph-647ded64-5dbe-11ef-bccf-c7b262605968@osd.3.service 2024-08-19T00:06:59.739 INFO:tasks.cephadm:Deploying osd.4 on smithi116 with /dev/vg_nvme/lv_3... 2024-08-19T00:06:59.739 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-08-19T00:06:59.973 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:59 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:06:59.973 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:59 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:59.973 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:59 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:06:59.973 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:06:59 smithi044 ceph-mon[18489]: from='osd.3 [v2:172.21.15.44:6810/3537027669,v1:172.21.15.44:6811/3537027669]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-08-19T00:07:00.001 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.b/config 2024-08-19T00:07:00.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:59 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:07:00.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:59 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:00.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:59 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:00.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:06:59 smithi116 ceph-mon[21873]: from='osd.3 [v2:172.21.15.44:6810/3537027669,v1:172.21.15.44:6811/3537027669]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-08-19T00:07:00.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:59 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:07:00.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:59 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:00.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:59 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:00.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:06:59 smithi171 ceph-mon[21810]: from='osd.3 [v2:172.21.15.44:6810/3537027669,v1:172.21.15.44:6811/3537027669]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-08-19T00:07:01.439 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:01 smithi116 ceph-mon[21873]: from='osd.3 [v2:172.21.15.44:6810/3537027669,v1:172.21.15.44:6811/3537027669]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-08-19T00:07:01.440 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:01 smithi116 ceph-mon[21873]: osdmap e22: 4 total, 3 up, 4 in 2024-08-19T00:07:01.440 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:01 smithi116 ceph-mon[21873]: from='osd.3 [v2:172.21.15.44:6810/3537027669,v1:172.21.15.44:6811/3537027669]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-08-19T00:07:01.440 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:01 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-19T00:07:01.440 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:01 smithi116 ceph-mon[21873]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-08-19T00:07:01.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:01 smithi171 ceph-mon[21810]: from='osd.3 [v2:172.21.15.44:6810/3537027669,v1:172.21.15.44:6811/3537027669]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-08-19T00:07:01.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:01 smithi171 ceph-mon[21810]: osdmap e22: 4 total, 3 up, 4 in 2024-08-19T00:07:01.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:01 smithi171 ceph-mon[21810]: from='osd.3 [v2:172.21.15.44:6810/3537027669,v1:172.21.15.44:6811/3537027669]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-08-19T00:07:01.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:01 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-19T00:07:01.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:01 smithi171 ceph-mon[21810]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-08-19T00:07:01.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:01 smithi044 ceph-mon[18489]: from='osd.3 [v2:172.21.15.44:6810/3537027669,v1:172.21.15.44:6811/3537027669]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-08-19T00:07:01.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:01 smithi044 ceph-mon[18489]: osdmap e22: 4 total, 3 up, 4 in 2024-08-19T00:07:01.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:01 smithi044 ceph-mon[18489]: from='osd.3 [v2:172.21.15.44:6810/3537027669,v1:172.21.15.44:6811/3537027669]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-08-19T00:07:01.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:01 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-19T00:07:01.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:01 smithi044 ceph-mon[18489]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-08-19T00:07:02.256 INFO:journalctl@ceph.osd.3.smithi044.stdout:Aug 19 00:07:01 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-3[38857]: 2024-08-19T00:07:01.902+0000 7fed95a0e640 -1 osd.3 0 waiting for initial osdmap 2024-08-19T00:07:02.257 INFO:journalctl@ceph.osd.3.smithi044.stdout:Aug 19 00:07:01 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-3[38857]: 2024-08-19T00:07:01.909+0000 7fed8d82e640 -1 osd.3 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-19T00:07:02.493 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:02 smithi116 ceph-mon[21873]: from='osd.3 [v2:172.21.15.44:6810/3537027669,v1:172.21.15.44:6811/3537027669]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-08-19T00:07:02.493 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:02 smithi116 ceph-mon[21873]: osdmap e23: 4 total, 3 up, 4 in 2024-08-19T00:07:02.493 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:02 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-19T00:07:02.494 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:02 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-19T00:07:02.494 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:02 smithi116 ceph-mon[21873]: from='osd.3 [v2:172.21.15.44:6810/3537027669,v1:172.21.15.44:6811/3537027669]' entity='osd.3' 2024-08-19T00:07:02.494 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:02 smithi116 ceph-mon[21873]: osd.3 [v2:172.21.15.44:6810/3537027669,v1:172.21.15.44:6811/3537027669] boot 2024-08-19T00:07:02.494 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:02 smithi116 ceph-mon[21873]: osdmap e24: 4 total, 4 up, 4 in 2024-08-19T00:07:02.494 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:02 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-19T00:07:02.495 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-08-19T00:07:02.521 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi116:vg_nvme/lv_3 2024-08-19T00:07:02.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:02 smithi171 ceph-mon[21810]: from='osd.3 [v2:172.21.15.44:6810/3537027669,v1:172.21.15.44:6811/3537027669]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-08-19T00:07:02.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:02 smithi171 ceph-mon[21810]: osdmap e23: 4 total, 3 up, 4 in 2024-08-19T00:07:02.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:02 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-19T00:07:02.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:02 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-19T00:07:02.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:02 smithi171 ceph-mon[21810]: from='osd.3 [v2:172.21.15.44:6810/3537027669,v1:172.21.15.44:6811/3537027669]' entity='osd.3' 2024-08-19T00:07:02.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:02 smithi171 ceph-mon[21810]: osd.3 [v2:172.21.15.44:6810/3537027669,v1:172.21.15.44:6811/3537027669] boot 2024-08-19T00:07:02.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:02 smithi171 ceph-mon[21810]: osdmap e24: 4 total, 4 up, 4 in 2024-08-19T00:07:02.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:02 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-19T00:07:02.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:02 smithi044 ceph-mon[18489]: from='osd.3 [v2:172.21.15.44:6810/3537027669,v1:172.21.15.44:6811/3537027669]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-08-19T00:07:02.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:02 smithi044 ceph-mon[18489]: osdmap e23: 4 total, 3 up, 4 in 2024-08-19T00:07:02.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:02 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-19T00:07:02.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:02 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-19T00:07:02.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:02 smithi044 ceph-mon[18489]: from='osd.3 [v2:172.21.15.44:6810/3537027669,v1:172.21.15.44:6811/3537027669]' entity='osd.3' 2024-08-19T00:07:02.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:02 smithi044 ceph-mon[18489]: osd.3 [v2:172.21.15.44:6810/3537027669,v1:172.21.15.44:6811/3537027669] boot 2024-08-19T00:07:02.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:02 smithi044 ceph-mon[18489]: osdmap e24: 4 total, 4 up, 4 in 2024-08-19T00:07:02.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:02 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-19T00:07:02.780 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.b/config 2024-08-19T00:07:03.258 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:07:03.238+0000 7f0cff772640 1 -- 172.21.15.116:0/3393532008 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0cf81075f0 msgr2=0x7f0cf8109a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:07:03.258 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:07:03.238+0000 7f0cff772640 1 --2- 172.21.15.116:0/3393532008 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0cf81075f0 0x7f0cf8109a40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4009ca0 tx=0x7f0cf402a8c0 comp rx=0 tx=0).stop 2024-08-19T00:07:03.258 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:07:03.238+0000 7f0cff772640 1 -- 172.21.15.116:0/3393532008 shutdown_connections 2024-08-19T00:07:03.258 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:07:03.238+0000 7f0cff772640 1 --2- 172.21.15.116:0/3393532008 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0cf81075f0 0x7f0cf8109a40 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:07:03.259 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:07:03.238+0000 7f0cff772640 1 --2- 172.21.15.116:0/3393532008 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cf8104cc0 0x7f0cf81070b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:07:03.259 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:07:03.238+0000 7f0cff772640 1 --2- 172.21.15.116:0/3393532008 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0cf8102390 0x7f0cf8104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:07:03.259 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:07:03.238+0000 7f0cff772640 1 -- 172.21.15.116:0/3393532008 >> 172.21.15.116:0/3393532008 conn(0x7f0cf80fbfb0 msgr2=0x7f0cf80fe3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:07:03.259 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:07:03.238+0000 7f0cff772640 1 -- 172.21.15.116:0/3393532008 shutdown_connections 2024-08-19T00:07:03.259 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:07:03.238+0000 7f0cff772640 1 -- 172.21.15.116:0/3393532008 wait complete. 2024-08-19T00:07:03.259 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:07:03.239+0000 7f0cff772640 1 Processor -- start 2024-08-19T00:07:03.259 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:07:03.239+0000 7f0cff772640 1 -- start start 2024-08-19T00:07:03.259 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:07:03.239+0000 7f0cff772640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cf8102390 0x7f0cf8197b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:07:03.259 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:07:03.239+0000 7f0cff772640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0cf8104cc0 0x7f0cf81980a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:07:03.259 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:07:03.239+0000 7f0cff772640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0cf81075f0 0x7f0cf819f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:07:03.259 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:07:03.239+0000 7f0cff772640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf810d590 con 0x7f0cf8102390 2024-08-19T00:07:03.259 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:07:03.239+0000 7f0cff772640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf810d410 con 0x7f0cf8104cc0 2024-08-19T00:07:03.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:07:03.239+0000 7f0cff772640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf810d710 con 0x7f0cf81075f0 2024-08-19T00:07:03.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:07:03.239+0000 7f0cfcd0d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0cf8104cc0 0x7f0cf81980a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:07:03.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:07:03.239+0000 7f0cfcd0d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0cf8104cc0 0x7f0cf81980a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:41304/0 (socket says 172.21.15.116:41304) 2024-08-19T00:07:03.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:07:03.239+0000 7f0cfcd0d640 1 -- 172.21.15.116:0/2184381958 learned_addr learned my addr 172.21.15.116:0/2184381958 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-08-19T00:07:03.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:07:03.239+0000 7f0cfd50e640 1 --2- 172.21.15.116:0/2184381958 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cf8102390 0x7f0cf8197b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:07:03.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:07:03.239+0000 7f0cfdd0f640 1 --2- 172.21.15.116:0/2184381958 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0cf81075f0 0x7f0cf819f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:07:03.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:07:03.239+0000 7f0cfcd0d640 1 -- 172.21.15.116:0/2184381958 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0cf81075f0 msgr2=0x7f0cf819f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:07:03.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:07:03.239+0000 7f0cfcd0d640 1 --2- 172.21.15.116:0/2184381958 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0cf81075f0 0x7f0cf819f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:07:03.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:07:03.239+0000 7f0cfcd0d640 1 -- 172.21.15.116:0/2184381958 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cf8102390 msgr2=0x7f0cf8197b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:07:03.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:07:03.239+0000 7f0cfcd0d640 1 --2- 172.21.15.116:0/2184381958 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cf8102390 0x7f0cf8197b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:07:03.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:07:03.239+0000 7f0cfcd0d640 1 -- 172.21.15.116:0/2184381958 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cf819f790 con 0x7f0cf8104cc0 2024-08-19T00:07:03.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:07:03.240+0000 7f0cfcd0d640 1 --2- 172.21.15.116:0/2184381958 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0cf8104cc0 0x7f0cf81980a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0ce800c970 tx=0x7f0ce800cd70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:07:03.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:07:03.240+0000 7f0cee7fc640 1 -- 172.21.15.116:0/2184381958 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce8007bb0 con 0x7f0cf8104cc0 2024-08-19T00:07:03.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:07:03.240+0000 7f0cff772640 1 -- 172.21.15.116:0/2184381958 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cf819fa80 con 0x7f0cf8104cc0 2024-08-19T00:07:03.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:07:03.240+0000 7f0cee7fc640 1 -- 172.21.15.116:0/2184381958 <== mon.2 v2:172.21.15.116:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ce8007d50 con 0x7f0cf8104cc0 2024-08-19T00:07:03.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:07:03.240+0000 7f0cee7fc640 1 -- 172.21.15.116:0/2184381958 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce800f450 con 0x7f0cf8104cc0 2024-08-19T00:07:03.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:07:03.240+0000 7f0cff772640 1 -- 172.21.15.116:0/2184381958 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cf81a0010 con 0x7f0cf8104cc0 2024-08-19T00:07:03.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:07:03.241+0000 7f0cff772640 1 -- 172.21.15.116:0/2184381958 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cf80fdaa0 con 0x7f0cf8104cc0 2024-08-19T00:07:03.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:07:03.242+0000 7f0cee7fc640 1 -- 172.21.15.116:0/2184381958 <== mon.2 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f0ce8004e80 con 0x7f0cf8104cc0 2024-08-19T00:07:03.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:07:03.243+0000 7f0cee7fc640 1 --2- 172.21.15.116:0/2184381958 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f0ce40a2bb0 0x7f0ce40a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:07:03.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:07:03.243+0000 7f0cee7fc640 1 -- 172.21.15.116:0/2184381958 <== mon.2 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 3702+0+0 (secure 0 0 0) 0x7f0ce80cde70 con 0x7f0cf8104cc0 2024-08-19T00:07:03.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:07:03.243+0000 7f0cfd50e640 1 --2- 172.21.15.116:0/2184381958 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f0ce40a2bb0 0x7f0ce40a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:07:03.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:07:03.244+0000 7f0cfd50e640 1 --2- 172.21.15.116:0/2184381958 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f0ce40a2bb0 0x7f0ce40a5070 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0cf000abe0 tx=0x7f0cf000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:07:03.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:07:03.246+0000 7f0cee7fc640 1 -- 172.21.15.116:0/2184381958 <== mon.2 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f0ce8014030 con 0x7f0cf8104cc0 2024-08-19T00:07:03.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:03 smithi116 ceph-mon[21873]: purged_snaps scrub starts 2024-08-19T00:07:03.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:03 smithi116 ceph-mon[21873]: purged_snaps scrub ok 2024-08-19T00:07:03.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:03 smithi116 ceph-mon[21873]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 525 MiB used, 357 GiB / 358 GiB avail 2024-08-19T00:07:03.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:03 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:03.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:03 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:03.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:03 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:07:03.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:03 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:07:03.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:03 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:03.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:03 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:07:03.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:03 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:07:03.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:03 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:03.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:03 smithi116 ceph-mon[21873]: osdmap e25: 4 total, 4 up, 4 in 2024-08-19T00:07:03.437 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:07:03.435+0000 7f0cff772640 1 -- 172.21.15.116:0/2184381958 --> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f0cf8062360 con 0x7f0ce40a2bb0 2024-08-19T00:07:03.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:03 smithi171 ceph-mon[21810]: purged_snaps scrub starts 2024-08-19T00:07:03.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:03 smithi171 ceph-mon[21810]: purged_snaps scrub ok 2024-08-19T00:07:03.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:03 smithi171 ceph-mon[21810]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 525 MiB used, 357 GiB / 358 GiB avail 2024-08-19T00:07:03.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:03 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:03.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:03 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:03.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:03 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:07:03.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:03 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:07:03.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:03 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:03.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:03 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:07:03.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:03 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:07:03.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:03 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:03.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:03 smithi171 ceph-mon[21810]: osdmap e25: 4 total, 4 up, 4 in 2024-08-19T00:07:03.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:03 smithi044 ceph-mon[18489]: purged_snaps scrub starts 2024-08-19T00:07:03.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:03 smithi044 ceph-mon[18489]: purged_snaps scrub ok 2024-08-19T00:07:03.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:03 smithi044 ceph-mon[18489]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 525 MiB used, 357 GiB / 358 GiB avail 2024-08-19T00:07:03.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:03 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:03.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:03 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:03.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:03 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:07:03.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:03 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:07:03.621 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:03 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:03.621 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:03 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:07:03.621 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:03 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:07:03.621 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:03 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:03.621 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:03 smithi044 ceph-mon[18489]: osdmap e25: 4 total, 4 up, 4 in 2024-08-19T00:07:04.557 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:04 smithi116 ceph-mon[21873]: Detected new or changed devices on smithi044 2024-08-19T00:07:04.557 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:04 smithi116 ceph-mon[21873]: Adjusting osd_memory_target on smithi044 to 8546M 2024-08-19T00:07:04.557 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:04 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-19T00:07:04.557 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:04 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-19T00:07:04.557 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:04 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:07:04.557 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:04 smithi116 ceph-mon[21873]: osdmap e26: 4 total, 4 up, 4 in 2024-08-19T00:07:04.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:04 smithi171 ceph-mon[21810]: Detected new or changed devices on smithi044 2024-08-19T00:07:04.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:04 smithi171 ceph-mon[21810]: Adjusting osd_memory_target on smithi044 to 8546M 2024-08-19T00:07:04.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:04 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-19T00:07:04.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:04 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-19T00:07:04.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:04 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:07:04.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:04 smithi171 ceph-mon[21810]: osdmap e26: 4 total, 4 up, 4 in 2024-08-19T00:07:04.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:04 smithi044 ceph-mon[18489]: Detected new or changed devices on smithi044 2024-08-19T00:07:04.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:04 smithi044 ceph-mon[18489]: Adjusting osd_memory_target on smithi044 to 8546M 2024-08-19T00:07:04.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:04 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-19T00:07:04.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:04 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-19T00:07:04.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:04 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:07:04.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:04 smithi044 ceph-mon[18489]: osdmap e26: 4 total, 4 up, 4 in 2024-08-19T00:07:05.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:05 smithi116 ceph-mon[21873]: from='client.24215 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:07:05.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:05 smithi116 ceph-mon[21873]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 525 MiB used, 357 GiB / 358 GiB avail 2024-08-19T00:07:05.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:05 smithi171 ceph-mon[21810]: from='client.24215 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:07:05.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:05 smithi171 ceph-mon[21810]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 525 MiB used, 357 GiB / 358 GiB avail 2024-08-19T00:07:05.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:05 smithi044 ceph-mon[18489]: from='client.24215 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:07:05.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:05 smithi044 ceph-mon[18489]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 525 MiB used, 357 GiB / 358 GiB avail 2024-08-19T00:07:06.356 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:06 smithi116 ceph-mon[21873]: osdmap e27: 4 total, 4 up, 4 in 2024-08-19T00:07:06.356 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:06 smithi116 ceph-mon[21873]: from='client.? 172.21.15.116:0/440884843' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "190d208e-ae54-497d-ad72-d07a5a26991b"}]: dispatch 2024-08-19T00:07:06.356 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:06 smithi116 ceph-mon[21873]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "190d208e-ae54-497d-ad72-d07a5a26991b"}]: dispatch 2024-08-19T00:07:06.356 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:06 smithi116 ceph-mon[21873]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "190d208e-ae54-497d-ad72-d07a5a26991b"}]': finished 2024-08-19T00:07:06.357 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:06 smithi116 ceph-mon[21873]: osdmap e28: 5 total, 4 up, 5 in 2024-08-19T00:07:06.357 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:06 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-19T00:07:06.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:06 smithi171 ceph-mon[21810]: osdmap e27: 4 total, 4 up, 4 in 2024-08-19T00:07:06.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:06 smithi171 ceph-mon[21810]: from='client.? 172.21.15.116:0/440884843' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "190d208e-ae54-497d-ad72-d07a5a26991b"}]: dispatch 2024-08-19T00:07:06.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:06 smithi171 ceph-mon[21810]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "190d208e-ae54-497d-ad72-d07a5a26991b"}]: dispatch 2024-08-19T00:07:06.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:06 smithi171 ceph-mon[21810]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "190d208e-ae54-497d-ad72-d07a5a26991b"}]': finished 2024-08-19T00:07:06.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:06 smithi171 ceph-mon[21810]: osdmap e28: 5 total, 4 up, 5 in 2024-08-19T00:07:06.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:06 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-19T00:07:06.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:06 smithi044 ceph-mon[18489]: osdmap e27: 4 total, 4 up, 4 in 2024-08-19T00:07:06.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:06 smithi044 ceph-mon[18489]: from='client.? 172.21.15.116:0/440884843' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "190d208e-ae54-497d-ad72-d07a5a26991b"}]: dispatch 2024-08-19T00:07:06.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:06 smithi044 ceph-mon[18489]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "190d208e-ae54-497d-ad72-d07a5a26991b"}]: dispatch 2024-08-19T00:07:06.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:06 smithi044 ceph-mon[18489]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "190d208e-ae54-497d-ad72-d07a5a26991b"}]': finished 2024-08-19T00:07:06.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:06 smithi044 ceph-mon[18489]: osdmap e28: 5 total, 4 up, 5 in 2024-08-19T00:07:06.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:06 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-19T00:07:07.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:07 smithi171 ceph-mon[21810]: from='client.? 172.21.15.116:0/4255081677' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-19T00:07:07.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:07 smithi171 ceph-mon[21810]: pgmap v92: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 524 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-08-19T00:07:07.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:07 smithi116 ceph-mon[21873]: from='client.? 172.21.15.116:0/4255081677' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-19T00:07:07.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:07 smithi116 ceph-mon[21873]: pgmap v92: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 524 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-08-19T00:07:07.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:07 smithi044 ceph-mon[18489]: from='client.? 172.21.15.116:0/4255081677' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-19T00:07:07.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:07 smithi044 ceph-mon[18489]: pgmap v92: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 524 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-08-19T00:07:08.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:08 smithi171 ceph-mon[21810]: pgmap v93: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 111 KiB/s, 0 objects/s recovering 2024-08-19T00:07:08.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:08 smithi116 ceph-mon[21873]: pgmap v93: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 111 KiB/s, 0 objects/s recovering 2024-08-19T00:07:08.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:08 smithi044 ceph-mon[18489]: pgmap v93: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 111 KiB/s, 0 objects/s recovering 2024-08-19T00:07:10.669 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:10 smithi116 ceph-mon[21873]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-08-19T00:07:10.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:10 smithi171 ceph-mon[21810]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-08-19T00:07:10.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:10 smithi044 ceph-mon[18489]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-08-19T00:07:13.825 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:13 smithi116 ceph-mon[21873]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-19T00:07:13.825 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:13 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-08-19T00:07:13.826 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:13 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:07:13.826 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:13 smithi116 ceph-mon[21873]: Deploying daemon osd.4 on smithi116 2024-08-19T00:07:13.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:13 smithi171 ceph-mon[21810]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-19T00:07:13.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:13 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-08-19T00:07:13.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:13 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:07:13.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:13 smithi171 ceph-mon[21810]: Deploying daemon osd.4 on smithi116 2024-08-19T00:07:13.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:13 smithi044 ceph-mon[18489]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-19T00:07:13.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:13 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-08-19T00:07:13.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:13 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:07:13.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:13 smithi044 ceph-mon[18489]: Deploying daemon osd.4 on smithi116 2024-08-19T00:07:15.748 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:15 smithi116 ceph-mon[21873]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-08-19T00:07:15.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:15 smithi171 ceph-mon[21810]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-08-19T00:07:15.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:15 smithi044 ceph-mon[18489]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-08-19T00:07:17.497 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:17 smithi116 ceph-mon[21873]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-08-19T00:07:17.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:17 smithi171 ceph-mon[21810]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-08-19T00:07:17.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:17 smithi044 ceph-mon[18489]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-08-19T00:07:18.553 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:18 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:07:18.553 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:18 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:18.553 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:18 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:18.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:18 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:07:18.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:18 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:18.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:18 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:18.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:18 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:07:18.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:18 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:18.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:18 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:19.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:19 smithi116 ceph-mon[21873]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-08-19T00:07:20.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:19 smithi171 ceph-mon[21810]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-08-19T00:07:20.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:19 smithi044 ceph-mon[18489]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-08-19T00:07:20.925 INFO:teuthology.orchestra.run.smithi116.stdout:Created osd(s) 4 on host 'smithi116' 2024-08-19T00:07:20.925 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:07:20.923+0000 7f0cee7fc640 1 -- 172.21.15.116:0/2184381958 <== mgr.14150 v2:172.21.15.44:6800/1330072146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f0cf8062360 con 0x7f0ce40a2bb0 2024-08-19T00:07:20.927 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:07:20.926+0000 7f0cff772640 1 -- 172.21.15.116:0/2184381958 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f0ce40a2bb0 msgr2=0x7f0ce40a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:07:20.927 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:07:20.926+0000 7f0cff772640 1 --2- 172.21.15.116:0/2184381958 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f0ce40a2bb0 0x7f0ce40a5070 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0cf000abe0 tx=0x7f0cf000a2d0 comp rx=0 tx=0).stop 2024-08-19T00:07:20.927 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:07:20.926+0000 7f0cff772640 1 -- 172.21.15.116:0/2184381958 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0cf8104cc0 msgr2=0x7f0cf81980a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:07:20.927 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:07:20.926+0000 7f0cff772640 1 --2- 172.21.15.116:0/2184381958 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0cf8104cc0 0x7f0cf81980a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0ce800c970 tx=0x7f0ce800cd70 comp rx=0 tx=0).stop 2024-08-19T00:07:20.927 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:07:20.926+0000 7f0cff772640 1 -- 172.21.15.116:0/2184381958 shutdown_connections 2024-08-19T00:07:20.927 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:07:20.926+0000 7f0cff772640 1 --2- 172.21.15.116:0/2184381958 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f0ce40a2bb0 0x7f0ce40a5070 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:07:20.927 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:07:20.926+0000 7f0cff772640 1 --2- 172.21.15.116:0/2184381958 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0cf81075f0 0x7f0cf819f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:07:20.927 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:07:20.926+0000 7f0cff772640 1 --2- 172.21.15.116:0/2184381958 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0cf8104cc0 0x7f0cf81980a0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:07:20.927 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:07:20.926+0000 7f0cff772640 1 --2- 172.21.15.116:0/2184381958 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cf8102390 0x7f0cf8197b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:07:20.928 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:07:20.926+0000 7f0cff772640 1 -- 172.21.15.116:0/2184381958 >> 172.21.15.116:0/2184381958 conn(0x7f0cf80fbfb0 msgr2=0x7f0cf8102c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:07:20.928 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:07:20.926+0000 7f0cff772640 1 -- 172.21.15.116:0/2184381958 shutdown_connections 2024-08-19T00:07:20.928 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:07:20.926+0000 7f0cff772640 1 -- 172.21.15.116:0/2184381958 wait complete. 2024-08-19T00:07:21.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:21 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:21.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:21 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:21.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:21 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:07:21.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:21 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:07:21.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:21 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:21.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:21 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:07:21.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:21 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:21.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:21 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:21.386 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:21 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:21.386 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:21 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:21.386 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:21 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:07:21.386 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:21 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:07:21.386 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:21 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:21.386 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:21 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:07:21.386 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:21 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:21.387 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:21 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:21.594 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:21 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:21.594 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:21 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:21.595 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:21 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:07:21.595 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:21 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:07:21.595 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:21 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:21.595 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:21 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:07:21.595 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:21 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:21.595 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:21 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:21.679 DEBUG:teuthology.orchestra.run.smithi116:osd.4> sudo journalctl -f -n 0 -u ceph-647ded64-5dbe-11ef-bccf-c7b262605968@osd.4.service 2024-08-19T00:07:21.681 INFO:tasks.cephadm:Deploying osd.5 on smithi171 with /dev/vg_nvme/lv_3... 2024-08-19T00:07:21.682 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-08-19T00:07:21.944 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.c/config 2024-08-19T00:07:22.327 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:22 smithi171 ceph-mon[21810]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-08-19T00:07:22.327 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:22 smithi171 ceph-mon[21810]: from='osd.4 [v2:172.21.15.116:6808/3768627455,v1:172.21.15.116:6809/3768627455]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-08-19T00:07:22.327 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:22 smithi171 ceph-mon[21810]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-08-19T00:07:22.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:22 smithi116 ceph-mon[21873]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-08-19T00:07:22.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:22 smithi116 ceph-mon[21873]: from='osd.4 [v2:172.21.15.116:6808/3768627455,v1:172.21.15.116:6809/3768627455]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-08-19T00:07:22.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:22 smithi116 ceph-mon[21873]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-08-19T00:07:22.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:22 smithi044 ceph-mon[18489]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-08-19T00:07:22.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:22 smithi044 ceph-mon[18489]: from='osd.4 [v2:172.21.15.116:6808/3768627455,v1:172.21.15.116:6809/3768627455]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-08-19T00:07:22.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:22 smithi044 ceph-mon[18489]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-08-19T00:07:23.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:23 smithi171 ceph-mon[21810]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-08-19T00:07:23.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:23 smithi171 ceph-mon[21810]: from='osd.4 [v2:172.21.15.116:6808/3768627455,v1:172.21.15.116:6809/3768627455]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-08-19T00:07:23.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:23 smithi171 ceph-mon[21810]: osdmap e29: 5 total, 4 up, 5 in 2024-08-19T00:07:23.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:23 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-19T00:07:23.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:23 smithi171 ceph-mon[21810]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-08-19T00:07:23.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:23 smithi171 ceph-mon[21810]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-08-19T00:07:23.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:23 smithi116 ceph-mon[21873]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-08-19T00:07:23.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:23 smithi116 ceph-mon[21873]: from='osd.4 [v2:172.21.15.116:6808/3768627455,v1:172.21.15.116:6809/3768627455]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-08-19T00:07:23.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:23 smithi116 ceph-mon[21873]: osdmap e29: 5 total, 4 up, 5 in 2024-08-19T00:07:23.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:23 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-19T00:07:23.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:23 smithi116 ceph-mon[21873]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-08-19T00:07:23.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:23 smithi116 ceph-mon[21873]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-08-19T00:07:23.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:23 smithi044 ceph-mon[18489]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-08-19T00:07:23.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:23 smithi044 ceph-mon[18489]: from='osd.4 [v2:172.21.15.116:6808/3768627455,v1:172.21.15.116:6809/3768627455]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-08-19T00:07:23.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:23 smithi044 ceph-mon[18489]: osdmap e29: 5 total, 4 up, 5 in 2024-08-19T00:07:23.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:23 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-19T00:07:23.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:23 smithi044 ceph-mon[18489]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-08-19T00:07:23.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:23 smithi044 ceph-mon[18489]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-08-19T00:07:24.116 INFO:journalctl@ceph.osd.4.smithi116.stdout:Aug 19 00:07:23 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-4[32637]: 2024-08-19T00:07:23.857+0000 7f26654aa640 -1 osd.4 0 waiting for initial osdmap 2024-08-19T00:07:24.116 INFO:journalctl@ceph.osd.4.smithi116.stdout:Aug 19 00:07:23 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-4[32637]: 2024-08-19T00:07:23.862+0000 7f265d2ca640 -1 osd.4 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-19T00:07:24.524 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:24 smithi171 ceph-mon[21810]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-08-19T00:07:24.524 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:24 smithi171 ceph-mon[21810]: osdmap e30: 5 total, 4 up, 5 in 2024-08-19T00:07:24.524 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:24 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-19T00:07:24.524 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:24 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-19T00:07:24.524 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:24 smithi171 ceph-mon[21810]: from='osd.4 ' entity='osd.4' 2024-08-19T00:07:24.524 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:24 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-19T00:07:24.526 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-19T00:07:24.533 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:24 smithi116 ceph-mon[21873]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-08-19T00:07:24.533 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:24 smithi116 ceph-mon[21873]: osdmap e30: 5 total, 4 up, 5 in 2024-08-19T00:07:24.533 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:24 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-19T00:07:24.534 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:24 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-19T00:07:24.534 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:24 smithi116 ceph-mon[21873]: from='osd.4 ' entity='osd.4' 2024-08-19T00:07:24.534 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:24 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-19T00:07:24.553 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi171:vg_nvme/lv_3 2024-08-19T00:07:24.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:24 smithi044 ceph-mon[18489]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-08-19T00:07:24.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:24 smithi044 ceph-mon[18489]: osdmap e30: 5 total, 4 up, 5 in 2024-08-19T00:07:24.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:24 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-19T00:07:24.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:24 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-19T00:07:24.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:24 smithi044 ceph-mon[18489]: from='osd.4 ' entity='osd.4' 2024-08-19T00:07:24.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:24 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-19T00:07:24.818 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.c/config 2024-08-19T00:07:25.300 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:07:25.296+0000 7f8fa3cfc640 1 -- 172.21.15.171:0/2454939972 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8f9c1023c0 msgr2=0x7f8f9c108c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:07:25.300 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:07:25.296+0000 7f8fa3cfc640 1 --2- 172.21.15.171:0/2454939972 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8f9c1023c0 0x7f8f9c108c50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8f94009ca0 tx=0x7f8f9402a8c0 comp rx=0 tx=0).stop 2024-08-19T00:07:25.300 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:07:25.296+0000 7f8fa3cfc640 1 -- 172.21.15.171:0/2454939972 shutdown_connections 2024-08-19T00:07:25.300 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:07:25.296+0000 7f8fa3cfc640 1 --2- 172.21.15.171:0/2454939972 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8f9c1023c0 0x7f8f9c108c50 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:07:25.300 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:07:25.296+0000 7f8fa3cfc640 1 --2- 172.21.15.171:0/2454939972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f9c101a00 0x7f8f9c101e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:07:25.300 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:07:25.296+0000 7f8fa3cfc640 1 --2- 172.21.15.171:0/2454939972 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f9c100800 0x7f8f9c100c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:07:25.300 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:07:25.296+0000 7f8fa3cfc640 1 -- 172.21.15.171:0/2454939972 >> 172.21.15.171:0/2454939972 conn(0x7f8f9c0fbfb0 msgr2=0x7f8f9c0fe3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:07:25.300 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:07:25.296+0000 7f8fa3cfc640 1 -- 172.21.15.171:0/2454939972 shutdown_connections 2024-08-19T00:07:25.300 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:07:25.296+0000 7f8fa3cfc640 1 -- 172.21.15.171:0/2454939972 wait complete. 2024-08-19T00:07:25.301 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:07:25.296+0000 7f8fa3cfc640 1 Processor -- start 2024-08-19T00:07:25.301 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:07:25.296+0000 7f8fa3cfc640 1 -- start start 2024-08-19T00:07:25.301 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:07:25.297+0000 7f8fa3cfc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f9c100800 0x7f8f9c06a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:07:25.301 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:07:25.297+0000 7f8fa3cfc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f9c101a00 0x7f8f9c19c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:07:25.301 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:07:25.297+0000 7f8fa3cfc640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8f9c1023c0 0x7f8f9c19efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:07:25.301 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:07:25.297+0000 7f8fa3cfc640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8f9c10c4e0 con 0x7f8f9c100800 2024-08-19T00:07:25.301 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:07:25.297+0000 7f8fa3cfc640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f8f9c10c360 con 0x7f8f9c101a00 2024-08-19T00:07:25.301 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:07:25.297+0000 7f8fa3cfc640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8f9c10c660 con 0x7f8f9c1023c0 2024-08-19T00:07:25.301 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:07:25.297+0000 7f8fa2299640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8f9c1023c0 0x7f8f9c19efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:07:25.301 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:07:25.297+0000 7f8fa2299640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8f9c1023c0 0x7f8f9c19efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:42222/0 (socket says 172.21.15.171:42222) 2024-08-19T00:07:25.301 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:07:25.297+0000 7f8fa2299640 1 -- 172.21.15.171:0/2102158684 learned_addr learned my addr 172.21.15.171:0/2102158684 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-08-19T00:07:25.301 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:07:25.297+0000 7f8fa1297640 1 --2- 172.21.15.171:0/2102158684 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f9c101a00 0x7f8f9c19c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:07:25.302 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:07:25.297+0000 7f8fa1a98640 1 --2- 172.21.15.171:0/2102158684 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f9c100800 0x7f8f9c06a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:07:25.302 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:07:25.297+0000 7f8fa2299640 1 -- 172.21.15.171:0/2102158684 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f9c101a00 msgr2=0x7f8f9c19c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:07:25.302 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:07:25.297+0000 7f8fa2299640 1 --2- 172.21.15.171:0/2102158684 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f9c101a00 0x7f8f9c19c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:07:25.302 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:07:25.297+0000 7f8fa2299640 1 -- 172.21.15.171:0/2102158684 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f9c100800 msgr2=0x7f8f9c06a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:07:25.302 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:07:25.297+0000 7f8fa2299640 1 --2- 172.21.15.171:0/2102158684 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f9c100800 0x7f8f9c06a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:07:25.302 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:07:25.297+0000 7f8fa2299640 1 -- 172.21.15.171:0/2102158684 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f9c19f8c0 con 0x7f8f9c1023c0 2024-08-19T00:07:25.302 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:07:25.297+0000 7f8fa2299640 1 --2- 172.21.15.171:0/2102158684 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8f9c1023c0 0x7f8f9c19efb0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8f94005e30 tx=0x7f8f94031ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:07:25.302 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:07:25.298+0000 7f8f8effd640 1 -- 172.21.15.171:0/2102158684 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f94003b70 con 0x7f8f9c1023c0 2024-08-19T00:07:25.303 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:07:25.298+0000 7f8fa3cfc640 1 -- 172.21.15.171:0/2102158684 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f9c19faf0 con 0x7f8f9c1023c0 2024-08-19T00:07:25.303 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:07:25.298+0000 7f8f8effd640 1 -- 172.21.15.171:0/2102158684 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f94003d10 con 0x7f8f9c1023c0 2024-08-19T00:07:25.303 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:07:25.298+0000 7f8f8effd640 1 -- 172.21.15.171:0/2102158684 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f9402fd30 con 0x7f8f9c1023c0 2024-08-19T00:07:25.303 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:07:25.298+0000 7f8fa3cfc640 1 -- 172.21.15.171:0/2102158684 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f9c1a0100 con 0x7f8f9c1023c0 2024-08-19T00:07:25.303 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:07:25.299+0000 7f8fa3cfc640 1 -- 172.21.15.171:0/2102158684 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f9c107ba0 con 0x7f8f9c1023c0 2024-08-19T00:07:25.304 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:07:25.300+0000 7f8f8effd640 1 -- 172.21.15.171:0/2102158684 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f8f94004050 con 0x7f8f9c1023c0 2024-08-19T00:07:25.304 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:07:25.300+0000 7f8f8effd640 1 --2- 172.21.15.171:0/2102158684 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f8f880a2b80 0x7f8f880a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:07:25.304 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:07:25.300+0000 7f8f8effd640 1 -- 172.21.15.171:0/2102158684 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4101+0+0 (secure 0 0 0) 0x7f8f940ef1d0 con 0x7f8f9c1023c0 2024-08-19T00:07:25.304 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:07:25.301+0000 7f8fa1a98640 1 --2- 172.21.15.171:0/2102158684 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f8f880a2b80 0x7f8f880a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:07:25.304 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:07:25.301+0000 7f8fa1a98640 1 --2- 172.21.15.171:0/2102158684 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f8f880a2b80 0x7f8f880a5040 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c101860 tx=0x7f8f9000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:07:25.305 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:07:25.305+0000 7f8f8effd640 1 -- 172.21.15.171:0/2102158684 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f8f940bd2c0 con 0x7f8f9c1023c0 2024-08-19T00:07:25.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:25 smithi171 ceph-mon[21810]: purged_snaps scrub starts 2024-08-19T00:07:25.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:25 smithi171 ceph-mon[21810]: purged_snaps scrub ok 2024-08-19T00:07:25.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:25 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:25.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:25 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:25.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:25 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:07:25.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:25 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:07:25.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:25 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:25.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:25 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:07:25.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:25 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:07:25.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:25 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:25.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:25 smithi171 ceph-mon[21810]: osd.4 [v2:172.21.15.116:6808/3768627455,v1:172.21.15.116:6809/3768627455] boot 2024-08-19T00:07:25.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:25 smithi171 ceph-mon[21810]: osdmap e31: 5 total, 5 up, 5 in 2024-08-19T00:07:25.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:25 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-19T00:07:25.485 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:07:25.484+0000 7f8fa3cfc640 1 -- 172.21.15.171:0/2102158684 --> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f8f9c062360 con 0x7f8f880a2b80 2024-08-19T00:07:25.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:25 smithi116 ceph-mon[21873]: purged_snaps scrub starts 2024-08-19T00:07:25.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:25 smithi116 ceph-mon[21873]: purged_snaps scrub ok 2024-08-19T00:07:25.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:25 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:25.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:25 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:25.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:25 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:07:25.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:25 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:07:25.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:25 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:25.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:25 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:07:25.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:25 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:07:25.617 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:25 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:25.617 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:25 smithi116 ceph-mon[21873]: osd.4 [v2:172.21.15.116:6808/3768627455,v1:172.21.15.116:6809/3768627455] boot 2024-08-19T00:07:25.617 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:25 smithi116 ceph-mon[21873]: osdmap e31: 5 total, 5 up, 5 in 2024-08-19T00:07:25.617 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:25 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-19T00:07:25.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:25 smithi044 ceph-mon[18489]: purged_snaps scrub starts 2024-08-19T00:07:25.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:25 smithi044 ceph-mon[18489]: purged_snaps scrub ok 2024-08-19T00:07:25.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:25 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:25.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:25 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:25.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:25 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:07:25.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:25 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:07:25.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:25 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:25.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:25 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:07:25.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:25 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:07:25.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:25 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:25.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:25 smithi044 ceph-mon[18489]: osd.4 [v2:172.21.15.116:6808/3768627455,v1:172.21.15.116:6809/3768627455] boot 2024-08-19T00:07:25.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:25 smithi044 ceph-mon[18489]: osdmap e31: 5 total, 5 up, 5 in 2024-08-19T00:07:25.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:25 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-19T00:07:26.569 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:26 smithi171 ceph-mon[21810]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-08-19T00:07:26.570 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:26 smithi171 ceph-mon[21810]: Detected new or changed devices on smithi116 2024-08-19T00:07:26.570 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:26 smithi171 ceph-mon[21810]: Adjusting osd_memory_target on smithi116 to 8544M 2024-08-19T00:07:26.570 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:26 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-19T00:07:26.570 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:26 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-19T00:07:26.570 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:26 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:07:26.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:26 smithi116 ceph-mon[21873]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-08-19T00:07:26.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:26 smithi116 ceph-mon[21873]: Detected new or changed devices on smithi116 2024-08-19T00:07:26.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:26 smithi116 ceph-mon[21873]: Adjusting osd_memory_target on smithi116 to 8544M 2024-08-19T00:07:26.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:26 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-19T00:07:26.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:26 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-19T00:07:26.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:26 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:07:26.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:26 smithi044 ceph-mon[18489]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-08-19T00:07:26.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:26 smithi044 ceph-mon[18489]: Detected new or changed devices on smithi116 2024-08-19T00:07:26.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:26 smithi044 ceph-mon[18489]: Adjusting osd_memory_target on smithi116 to 8544M 2024-08-19T00:07:26.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:26 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-19T00:07:26.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:26 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-19T00:07:26.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:26 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:07:27.483 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:27 smithi171 ceph-mon[21810]: from='client.24223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:07:27.484 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:27 smithi171 ceph-mon[21810]: osdmap e32: 5 total, 5 up, 5 in 2024-08-19T00:07:27.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:27 smithi116 ceph-mon[21873]: from='client.24223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:07:27.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:27 smithi116 ceph-mon[21873]: osdmap e32: 5 total, 5 up, 5 in 2024-08-19T00:07:27.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:27 smithi044 ceph-mon[18489]: from='client.24223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:07:27.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:27 smithi044 ceph-mon[18489]: osdmap e32: 5 total, 5 up, 5 in 2024-08-19T00:07:28.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:28 smithi171 ceph-mon[21810]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-08-19T00:07:28.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:28 smithi171 ceph-mon[21810]: from='client.? 172.21.15.171:0/1562809837' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d8afacad-6d3d-4703-9744-8d01ff2a2047"}]: dispatch 2024-08-19T00:07:28.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:28 smithi171 ceph-mon[21810]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d8afacad-6d3d-4703-9744-8d01ff2a2047"}]: dispatch 2024-08-19T00:07:28.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:28 smithi171 ceph-mon[21810]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d8afacad-6d3d-4703-9744-8d01ff2a2047"}]': finished 2024-08-19T00:07:28.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:28 smithi171 ceph-mon[21810]: osdmap e33: 6 total, 5 up, 6 in 2024-08-19T00:07:28.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:28 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-19T00:07:28.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:28 smithi116 ceph-mon[21873]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-08-19T00:07:28.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:28 smithi116 ceph-mon[21873]: from='client.? 172.21.15.171:0/1562809837' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d8afacad-6d3d-4703-9744-8d01ff2a2047"}]: dispatch 2024-08-19T00:07:28.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:28 smithi116 ceph-mon[21873]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d8afacad-6d3d-4703-9744-8d01ff2a2047"}]: dispatch 2024-08-19T00:07:28.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:28 smithi116 ceph-mon[21873]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d8afacad-6d3d-4703-9744-8d01ff2a2047"}]': finished 2024-08-19T00:07:28.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:28 smithi116 ceph-mon[21873]: osdmap e33: 6 total, 5 up, 6 in 2024-08-19T00:07:28.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:28 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-19T00:07:28.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:28 smithi044 ceph-mon[18489]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-08-19T00:07:28.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:28 smithi044 ceph-mon[18489]: from='client.? 172.21.15.171:0/1562809837' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d8afacad-6d3d-4703-9744-8d01ff2a2047"}]: dispatch 2024-08-19T00:07:28.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:28 smithi044 ceph-mon[18489]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d8afacad-6d3d-4703-9744-8d01ff2a2047"}]: dispatch 2024-08-19T00:07:28.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:28 smithi044 ceph-mon[18489]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d8afacad-6d3d-4703-9744-8d01ff2a2047"}]': finished 2024-08-19T00:07:28.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:28 smithi044 ceph-mon[18489]: osdmap e33: 6 total, 5 up, 6 in 2024-08-19T00:07:28.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:28 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-19T00:07:29.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:29 smithi116 ceph-mon[21873]: from='client.? 172.21.15.171:0/2841336469' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-19T00:07:29.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:29 smithi171 ceph-mon[21810]: from='client.? 172.21.15.171:0/2841336469' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-19T00:07:29.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:29 smithi044 ceph-mon[18489]: from='client.? 172.21.15.171:0/2841336469' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-19T00:07:30.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:30 smithi171 ceph-mon[21810]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-08-19T00:07:30.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:30 smithi116 ceph-mon[21873]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-08-19T00:07:30.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:30 smithi044 ceph-mon[18489]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-08-19T00:07:32.539 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:32 smithi171 ceph-mon[21810]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-08-19T00:07:32.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:32 smithi116 ceph-mon[21873]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-08-19T00:07:32.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:32 smithi044 ceph-mon[18489]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-08-19T00:07:34.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:34 smithi171 ceph-mon[21810]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-08-19T00:07:34.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:34 smithi116 ceph-mon[21873]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-08-19T00:07:34.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:34 smithi044 ceph-mon[18489]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-08-19T00:07:35.356 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:35 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-08-19T00:07:35.357 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:35 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:07:35.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:35 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-08-19T00:07:35.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:35 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:07:35.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:35 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-08-19T00:07:35.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:35 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:07:36.470 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:36 smithi171 ceph-mon[21810]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-08-19T00:07:36.471 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:36 smithi171 ceph-mon[21810]: Deploying daemon osd.5 on smithi171 2024-08-19T00:07:36.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:36 smithi116 ceph-mon[21873]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-08-19T00:07:36.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:36 smithi116 ceph-mon[21873]: Deploying daemon osd.5 on smithi171 2024-08-19T00:07:36.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:36 smithi044 ceph-mon[18489]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-08-19T00:07:36.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:36 smithi044 ceph-mon[18489]: Deploying daemon osd.5 on smithi171 2024-08-19T00:07:38.450 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:38 smithi171 ceph-mon[21810]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-08-19T00:07:38.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:38 smithi116 ceph-mon[21873]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-08-19T00:07:38.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:38 smithi044 ceph-mon[18489]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-08-19T00:07:40.516 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:40 smithi171 ceph-mon[21810]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-08-19T00:07:40.516 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:40 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:07:40.516 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:40 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:40.516 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:40 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:40.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:40 smithi116 ceph-mon[21873]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-08-19T00:07:40.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:40 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:07:40.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:40 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:40.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:40 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:40.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:40 smithi044 ceph-mon[18489]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-08-19T00:07:40.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:40 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:07:40.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:40 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:40.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:40 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:42.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:42 smithi171 ceph-mon[21810]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-08-19T00:07:42.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:42 smithi116 ceph-mon[21873]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-08-19T00:07:42.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:42 smithi044 ceph-mon[18489]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-08-19T00:07:43.160 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:07:43.158+0000 7f8f8effd640 1 -- 172.21.15.171:0/2102158684 <== mgr.14150 v2:172.21.15.44:6800/1330072146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8f9c062360 con 0x7f8f880a2b80 2024-08-19T00:07:43.160 INFO:teuthology.orchestra.run.smithi171.stdout:Created osd(s) 5 on host 'smithi171' 2024-08-19T00:07:43.162 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:07:43.161+0000 7f8fa3cfc640 1 -- 172.21.15.171:0/2102158684 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f8f880a2b80 msgr2=0x7f8f880a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:07:43.162 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:07:43.161+0000 7f8fa3cfc640 1 --2- 172.21.15.171:0/2102158684 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f8f880a2b80 0x7f8f880a5040 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c101860 tx=0x7f8f9000b390 comp rx=0 tx=0).stop 2024-08-19T00:07:43.162 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:07:43.161+0000 7f8fa3cfc640 1 -- 172.21.15.171:0/2102158684 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8f9c1023c0 msgr2=0x7f8f9c19efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:07:43.162 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:07:43.161+0000 7f8fa3cfc640 1 --2- 172.21.15.171:0/2102158684 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8f9c1023c0 0x7f8f9c19efb0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8f94005e30 tx=0x7f8f94031ee0 comp rx=0 tx=0).stop 2024-08-19T00:07:43.162 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:07:43.161+0000 7f8fa3cfc640 1 -- 172.21.15.171:0/2102158684 shutdown_connections 2024-08-19T00:07:43.162 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:07:43.161+0000 7f8fa3cfc640 1 --2- 172.21.15.171:0/2102158684 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f8f880a2b80 0x7f8f880a5040 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:07:43.163 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:07:43.161+0000 7f8fa3cfc640 1 --2- 172.21.15.171:0/2102158684 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8f9c1023c0 0x7f8f9c19efb0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:07:43.163 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:07:43.161+0000 7f8fa3cfc640 1 --2- 172.21.15.171:0/2102158684 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f9c101a00 0x7f8f9c19c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:07:43.163 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:07:43.161+0000 7f8fa3cfc640 1 --2- 172.21.15.171:0/2102158684 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f9c100800 0x7f8f9c06a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:07:43.163 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:07:43.161+0000 7f8fa3cfc640 1 -- 172.21.15.171:0/2102158684 >> 172.21.15.171:0/2102158684 conn(0x7f8f9c0fbfb0 msgr2=0x7f8f9c104d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:07:43.163 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:07:43.161+0000 7f8fa3cfc640 1 -- 172.21.15.171:0/2102158684 shutdown_connections 2024-08-19T00:07:43.163 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:07:43.161+0000 7f8fa3cfc640 1 -- 172.21.15.171:0/2102158684 wait complete. 2024-08-19T00:07:43.480 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:43 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:43.480 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:43 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:43.480 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:43 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:07:43.481 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:43 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:07:43.481 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:43 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:43.481 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:43 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:07:43.481 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:43 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:43.481 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:43 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:43.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:43 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:43.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:43 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:43.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:43 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:07:43.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:43 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:07:43.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:43 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:43.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:43 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:07:43.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:43 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:43.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:43 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:43.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:43 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:43.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:43 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:43.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:43 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:07:43.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:43 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:07:43.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:43 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:43.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:43 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:07:43.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:43 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:43.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:43 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:43.825 DEBUG:teuthology.orchestra.run.smithi171:osd.5> sudo journalctl -f -n 0 -u ceph-647ded64-5dbe-11ef-bccf-c7b262605968@osd.5.service 2024-08-19T00:07:43.827 INFO:tasks.cephadm:Deploying osd.6 on smithi044 with /dev/vg_nvme/lv_2... 2024-08-19T00:07:43.828 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-08-19T00:07:44.095 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:07:44.576 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:44 smithi044 ceph-mon[18489]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-08-19T00:07:44.576 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:44 smithi044 ceph-mon[18489]: from='osd.5 [v2:172.21.15.171:6808/938785018,v1:172.21.15.171:6809/938785018]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-08-19T00:07:44.576 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:44 smithi044 ceph-mon[18489]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-08-19T00:07:44.589 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:44 smithi171 ceph-mon[21810]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-08-19T00:07:44.589 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:44 smithi171 ceph-mon[21810]: from='osd.5 [v2:172.21.15.171:6808/938785018,v1:172.21.15.171:6809/938785018]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-08-19T00:07:44.589 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:44 smithi171 ceph-mon[21810]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-08-19T00:07:44.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:44 smithi116 ceph-mon[21873]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-08-19T00:07:44.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:44 smithi116 ceph-mon[21873]: from='osd.5 [v2:172.21.15.171:6808/938785018,v1:172.21.15.171:6809/938785018]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-08-19T00:07:44.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:44 smithi116 ceph-mon[21873]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-08-19T00:07:45.534 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:45 smithi044 ceph-mon[18489]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-08-19T00:07:45.534 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:45 smithi044 ceph-mon[18489]: from='osd.5 [v2:172.21.15.171:6808/938785018,v1:172.21.15.171:6809/938785018]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-08-19T00:07:45.534 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:45 smithi044 ceph-mon[18489]: osdmap e34: 6 total, 5 up, 6 in 2024-08-19T00:07:45.534 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:45 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-19T00:07:45.535 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:45 smithi044 ceph-mon[18489]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-08-19T00:07:45.535 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:45 smithi044 ceph-mon[18489]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]': finished 2024-08-19T00:07:45.535 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:45 smithi044 ceph-mon[18489]: osdmap e35: 6 total, 5 up, 6 in 2024-08-19T00:07:45.535 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:45 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-19T00:07:45.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:45 smithi171 ceph-mon[21810]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-08-19T00:07:45.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:45 smithi171 ceph-mon[21810]: from='osd.5 [v2:172.21.15.171:6808/938785018,v1:172.21.15.171:6809/938785018]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-08-19T00:07:45.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:45 smithi171 ceph-mon[21810]: osdmap e34: 6 total, 5 up, 6 in 2024-08-19T00:07:45.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:45 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-19T00:07:45.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:45 smithi171 ceph-mon[21810]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-08-19T00:07:45.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:45 smithi171 ceph-mon[21810]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]': finished 2024-08-19T00:07:45.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:45 smithi171 ceph-mon[21810]: osdmap e35: 6 total, 5 up, 6 in 2024-08-19T00:07:45.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:45 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-19T00:07:45.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:45 smithi116 ceph-mon[21873]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-08-19T00:07:45.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:45 smithi116 ceph-mon[21873]: from='osd.5 [v2:172.21.15.171:6808/938785018,v1:172.21.15.171:6809/938785018]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-08-19T00:07:45.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:45 smithi116 ceph-mon[21873]: osdmap e34: 6 total, 5 up, 6 in 2024-08-19T00:07:45.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:45 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-19T00:07:45.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:45 smithi116 ceph-mon[21873]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-08-19T00:07:45.867 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:45 smithi116 ceph-mon[21873]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]': finished 2024-08-19T00:07:45.867 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:45 smithi116 ceph-mon[21873]: osdmap e35: 6 total, 5 up, 6 in 2024-08-19T00:07:45.867 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:45 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-19T00:07:46.342 INFO:journalctl@ceph.osd.5.smithi171.stdout:Aug 19 00:07:46 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-5[33174]: 2024-08-19T00:07:46.057+0000 7ff740028640 -1 osd.5 0 waiting for initial osdmap 2024-08-19T00:07:46.342 INFO:journalctl@ceph.osd.5.smithi171.stdout:Aug 19 00:07:46 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-5[33174]: 2024-08-19T00:07:46.062+0000 7ff737e48640 -1 osd.5 35 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-19T00:07:46.513 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:46 smithi044 ceph-mon[18489]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-08-19T00:07:46.513 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:46 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-19T00:07:46.513 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:46 smithi044 ceph-mon[18489]: from='osd.5 ' entity='osd.5' 2024-08-19T00:07:46.513 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:46 smithi044 ceph-mon[18489]: osd.5 [v2:172.21.15.171:6808/938785018,v1:172.21.15.171:6809/938785018] boot 2024-08-19T00:07:46.513 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:46 smithi044 ceph-mon[18489]: osdmap e36: 6 total, 6 up, 6 in 2024-08-19T00:07:46.513 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:46 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-19T00:07:46.759 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:46 smithi171 ceph-mon[21810]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-08-19T00:07:46.759 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:46 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-19T00:07:46.760 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:46 smithi171 ceph-mon[21810]: from='osd.5 ' entity='osd.5' 2024-08-19T00:07:46.760 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:46 smithi171 ceph-mon[21810]: osd.5 [v2:172.21.15.171:6808/938785018,v1:172.21.15.171:6809/938785018] boot 2024-08-19T00:07:46.760 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:46 smithi171 ceph-mon[21810]: osdmap e36: 6 total, 6 up, 6 in 2024-08-19T00:07:46.760 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:46 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-19T00:07:46.833 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:07:46.859 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi044:vg_nvme/lv_2 2024-08-19T00:07:46.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:46 smithi116 ceph-mon[21873]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-08-19T00:07:46.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:46 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-19T00:07:46.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:46 smithi116 ceph-mon[21873]: from='osd.5 ' entity='osd.5' 2024-08-19T00:07:46.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:46 smithi116 ceph-mon[21873]: osd.5 [v2:172.21.15.171:6808/938785018,v1:172.21.15.171:6809/938785018] boot 2024-08-19T00:07:46.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:46 smithi116 ceph-mon[21873]: osdmap e36: 6 total, 6 up, 6 in 2024-08-19T00:07:46.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:46 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-19T00:07:47.115 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:07:47.493 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:47 smithi044 ceph-mon[18489]: purged_snaps scrub starts 2024-08-19T00:07:47.493 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:47 smithi044 ceph-mon[18489]: purged_snaps scrub ok 2024-08-19T00:07:47.493 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:47 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:47.493 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:47 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:47.493 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:47 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:07:47.493 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:47 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:07:47.493 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:47 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:47.494 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:47 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:07:47.494 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:47 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:07:47.494 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:47 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:47.494 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:47 smithi044 ceph-mon[18489]: osdmap e37: 6 total, 6 up, 6 in 2024-08-19T00:07:47.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:07:47.575+0000 7fcdc333b640 1 -- 172.21.15.44:0/210566637 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcdbc1034f0 msgr2=0x7fcdbc109d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:07:47.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:07:47.575+0000 7fcdc333b640 1 --2- 172.21.15.44:0/210566637 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcdbc1034f0 0x7fcdbc109d80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcdb4009900 tx=0x7fcdb402a410 comp rx=0 tx=0).stop 2024-08-19T00:07:47.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:07:47.575+0000 7fcdc333b640 1 -- 172.21.15.44:0/210566637 shutdown_connections 2024-08-19T00:07:47.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:07:47.575+0000 7fcdc333b640 1 --2- 172.21.15.44:0/210566637 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcdbc1034f0 0x7fcdbc109d80 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:07:47.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:07:47.575+0000 7fcdc333b640 1 --2- 172.21.15.44:0/210566637 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcdbc102b30 0x7fcdbc102fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:07:47.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:07:47.575+0000 7fcdc333b640 1 --2- 172.21.15.44:0/210566637 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcdbc101930 0x7fcdbc101d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:07:47.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:07:47.575+0000 7fcdc333b640 1 -- 172.21.15.44:0/210566637 >> 172.21.15.44:0/210566637 conn(0x7fcdbc0fd0c0 msgr2=0x7fcdbc0ff500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:07:47.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:07:47.576+0000 7fcdc333b640 1 -- 172.21.15.44:0/210566637 shutdown_connections 2024-08-19T00:07:47.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:07:47.576+0000 7fcdc333b640 1 -- 172.21.15.44:0/210566637 wait complete. 2024-08-19T00:07:47.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:07:47.576+0000 7fcdc333b640 1 Processor -- start 2024-08-19T00:07:47.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:07:47.576+0000 7fcdc333b640 1 -- start start 2024-08-19T00:07:47.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:07:47.576+0000 7fcdc333b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcdbc101930 0x7fcdbc199da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:07:47.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:07:47.576+0000 7fcdc333b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcdbc102b30 0x7fcdbc19a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:07:47.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:07:47.576+0000 7fcdc333b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcdbc1034f0 0x7fcdbc1a1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:07:47.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:07:47.576+0000 7fcdc333b640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fcdbc074ba0 con 0x7fcdbc1034f0 2024-08-19T00:07:47.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:07:47.576+0000 7fcdc333b640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fcdbc074a20 con 0x7fcdbc101930 2024-08-19T00:07:47.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:07:47.576+0000 7fcdc333b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fcdbc074d20 con 0x7fcdbc102b30 2024-08-19T00:07:47.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:07:47.576+0000 7fcdc18d8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcdbc1034f0 0x7fcdbc1a1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:07:47.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:07:47.576+0000 7fcdc18d8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcdbc1034f0 0x7fcdbc1a1360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43648/0 (socket says 172.21.15.44:43648) 2024-08-19T00:07:47.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:07:47.576+0000 7fcdc18d8640 1 -- 172.21.15.44:0/1201918617 learned_addr learned my addr 172.21.15.44:0/1201918617 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:07:47.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:07:47.577+0000 7fcdc08d6640 1 --2- 172.21.15.44:0/1201918617 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcdbc102b30 0x7fcdbc19a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:07:47.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:07:47.577+0000 7fcdc10d7640 1 --2- 172.21.15.44:0/1201918617 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcdbc101930 0x7fcdbc199da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:07:47.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:07:47.577+0000 7fcdc18d8640 1 -- 172.21.15.44:0/1201918617 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcdbc102b30 msgr2=0x7fcdbc19a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:07:47.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:07:47.577+0000 7fcdc18d8640 1 --2- 172.21.15.44:0/1201918617 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcdbc102b30 0x7fcdbc19a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:07:47.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:07:47.577+0000 7fcdc18d8640 1 -- 172.21.15.44:0/1201918617 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcdbc101930 msgr2=0x7fcdbc199da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:07:47.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:07:47.577+0000 7fcdc18d8640 1 --2- 172.21.15.44:0/1201918617 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcdbc101930 0x7fcdbc199da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:07:47.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:07:47.577+0000 7fcdc18d8640 1 -- 172.21.15.44:0/1201918617 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdbc1a19d0 con 0x7fcdbc1034f0 2024-08-19T00:07:47.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:07:47.577+0000 7fcdc18d8640 1 --2- 172.21.15.44:0/1201918617 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcdbc1034f0 0x7fcdbc1a1360 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fcdb40314e0 tx=0x7fcdb4031b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:07:47.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:07:47.577+0000 7fcdba7fc640 1 -- 172.21.15.44:0/1201918617 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb403f030 con 0x7fcdbc1034f0 2024-08-19T00:07:47.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:07:47.577+0000 7fcdba7fc640 1 -- 172.21.15.44:0/1201918617 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcdb4003ad0 con 0x7fcdbc1034f0 2024-08-19T00:07:47.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:07:47.577+0000 7fcdc333b640 1 -- 172.21.15.44:0/1201918617 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdbc1a1c60 con 0x7fcdbc1034f0 2024-08-19T00:07:47.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:07:47.577+0000 7fcdba7fc640 1 -- 172.21.15.44:0/1201918617 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb4035070 con 0x7fcdbc1034f0 2024-08-19T00:07:47.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:07:47.577+0000 7fcdc333b640 1 -- 172.21.15.44:0/1201918617 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdbc1a2140 con 0x7fcdbc1034f0 2024-08-19T00:07:47.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:07:47.578+0000 7fcdc333b640 1 -- 172.21.15.44:0/1201918617 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdbc1a2310 con 0x7fcdbc1034f0 2024-08-19T00:07:47.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:07:47.579+0000 7fcdba7fc640 1 -- 172.21.15.44:0/1201918617 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fcdb4042030 con 0x7fcdbc1034f0 2024-08-19T00:07:47.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:07:47.580+0000 7fcdba7fc640 1 --2- 172.21.15.44:0/1201918617 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fcda40a2bb0 0x7fcda40a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:07:47.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:07:47.580+0000 7fcdc10d7640 1 --2- 172.21.15.44:0/1201918617 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fcda40a2bb0 0x7fcda40a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:07:47.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:07:47.580+0000 7fcdba7fc640 1 -- 172.21.15.44:0/1201918617 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4562+0+0 (secure 0 0 0) 0x7fcdb40ee690 con 0x7fcdbc1034f0 2024-08-19T00:07:47.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:07:47.581+0000 7fcdc10d7640 1 --2- 172.21.15.44:0/1201918617 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fcda40a2bb0 0x7fcda40a5070 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc102990 tx=0x7fcdac009670 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:07:47.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:07:47.585+0000 7fcdba7fc640 1 -- 172.21.15.44:0/1201918617 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fcdb40bbe40 con 0x7fcdbc1034f0 2024-08-19T00:07:47.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:07:47.769+0000 7fcdc333b640 1 -- 172.21.15.44:0/1201918617 --> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fcdbc0fe1c0 con 0x7fcda40a2bb0 2024-08-19T00:07:47.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:47 smithi171 ceph-mon[21810]: purged_snaps scrub starts 2024-08-19T00:07:47.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:47 smithi171 ceph-mon[21810]: purged_snaps scrub ok 2024-08-19T00:07:47.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:47 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:47.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:47 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:47.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:47 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:07:47.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:47 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:07:47.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:47 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:47.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:47 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:07:47.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:47 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:07:47.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:47 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:47.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:47 smithi171 ceph-mon[21810]: osdmap e37: 6 total, 6 up, 6 in 2024-08-19T00:07:47.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:47 smithi116 ceph-mon[21873]: purged_snaps scrub starts 2024-08-19T00:07:47.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:47 smithi116 ceph-mon[21873]: purged_snaps scrub ok 2024-08-19T00:07:47.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:47 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:47.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:47 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:47.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:47 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:07:47.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:47 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:07:47.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:47 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:47.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:47 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:07:47.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:47 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:07:47.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:47 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:07:47.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:47 smithi116 ceph-mon[21873]: osdmap e37: 6 total, 6 up, 6 in 2024-08-19T00:07:48.504 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:48 smithi044 ceph-mon[18489]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 586 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:07:48.504 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:48 smithi044 ceph-mon[18489]: Detected new or changed devices on smithi171 2024-08-19T00:07:48.504 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:48 smithi044 ceph-mon[18489]: Adjusting osd_memory_target on smithi171 to 8544M 2024-08-19T00:07:48.504 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:48 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-19T00:07:48.504 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:48 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-19T00:07:48.504 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:48 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:07:48.504 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:48 smithi044 ceph-mon[18489]: osdmap e38: 6 total, 6 up, 6 in 2024-08-19T00:07:48.767 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:48 smithi116 ceph-mon[21873]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 586 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:07:48.767 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:48 smithi116 ceph-mon[21873]: Detected new or changed devices on smithi171 2024-08-19T00:07:48.767 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:48 smithi116 ceph-mon[21873]: Adjusting osd_memory_target on smithi171 to 8544M 2024-08-19T00:07:48.767 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:48 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-19T00:07:48.767 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:48 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-19T00:07:48.767 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:48 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:07:48.767 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:48 smithi116 ceph-mon[21873]: osdmap e38: 6 total, 6 up, 6 in 2024-08-19T00:07:48.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:48 smithi171 ceph-mon[21810]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 586 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:07:48.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:48 smithi171 ceph-mon[21810]: Detected new or changed devices on smithi171 2024-08-19T00:07:48.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:48 smithi171 ceph-mon[21810]: Adjusting osd_memory_target on smithi171 to 8544M 2024-08-19T00:07:48.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:48 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-19T00:07:48.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:48 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-19T00:07:48.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:48 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:07:48.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:48 smithi171 ceph-mon[21810]: osdmap e38: 6 total, 6 up, 6 in 2024-08-19T00:07:49.570 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:49 smithi044 ceph-mon[18489]: from='client.14358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:07:49.570 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:49 smithi044 ceph-mon[18489]: osdmap e39: 6 total, 6 up, 6 in 2024-08-19T00:07:49.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:49 smithi171 ceph-mon[21810]: from='client.14358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:07:49.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:49 smithi171 ceph-mon[21810]: osdmap e39: 6 total, 6 up, 6 in 2024-08-19T00:07:49.791 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:49 smithi116 ceph-mon[21873]: from='client.14358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:07:49.791 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:49 smithi116 ceph-mon[21873]: osdmap e39: 6 total, 6 up, 6 in 2024-08-19T00:07:50.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:50 smithi044 ceph-mon[18489]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 586 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:07:50.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:50 smithi044 ceph-mon[18489]: osdmap e40: 6 total, 6 up, 6 in 2024-08-19T00:07:50.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:50 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/1135252262' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "55bf1f89-99e5-409d-99fa-f0124aa042df"}]: dispatch 2024-08-19T00:07:50.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:50 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/1135252262' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "55bf1f89-99e5-409d-99fa-f0124aa042df"}]': finished 2024-08-19T00:07:50.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:50 smithi044 ceph-mon[18489]: osdmap e41: 7 total, 6 up, 7 in 2024-08-19T00:07:50.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:50 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-19T00:07:50.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:50 smithi171 ceph-mon[21810]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 586 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:07:50.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:50 smithi171 ceph-mon[21810]: osdmap e40: 6 total, 6 up, 6 in 2024-08-19T00:07:50.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:50 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/1135252262' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "55bf1f89-99e5-409d-99fa-f0124aa042df"}]: dispatch 2024-08-19T00:07:50.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:50 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/1135252262' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "55bf1f89-99e5-409d-99fa-f0124aa042df"}]': finished 2024-08-19T00:07:50.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:50 smithi171 ceph-mon[21810]: osdmap e41: 7 total, 6 up, 7 in 2024-08-19T00:07:50.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:50 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-19T00:07:50.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:50 smithi116 ceph-mon[21873]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 586 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:07:50.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:50 smithi116 ceph-mon[21873]: osdmap e40: 6 total, 6 up, 6 in 2024-08-19T00:07:50.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:50 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/1135252262' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "55bf1f89-99e5-409d-99fa-f0124aa042df"}]: dispatch 2024-08-19T00:07:50.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:50 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/1135252262' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "55bf1f89-99e5-409d-99fa-f0124aa042df"}]': finished 2024-08-19T00:07:50.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:50 smithi116 ceph-mon[21873]: osdmap e41: 7 total, 6 up, 7 in 2024-08-19T00:07:50.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:50 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-19T00:07:51.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:51 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/165056514' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-19T00:07:51.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:51 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/165056514' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-19T00:07:51.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:51 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/165056514' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-19T00:07:52.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:52 smithi171 ceph-mon[21810]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 586 MiB used, 536 GiB / 536 GiB avail; 188 KiB/s, 0 objects/s recovering 2024-08-19T00:07:52.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:52 smithi116 ceph-mon[21873]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 586 MiB used, 536 GiB / 536 GiB avail; 188 KiB/s, 0 objects/s recovering 2024-08-19T00:07:52.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:52 smithi044 ceph-mon[18489]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 586 MiB used, 536 GiB / 536 GiB avail; 188 KiB/s, 0 objects/s recovering 2024-08-19T00:07:54.670 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:54 smithi044 ceph-mon[18489]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 142 KiB/s, 0 objects/s recovering 2024-08-19T00:07:54.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:54 smithi171 ceph-mon[21810]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 142 KiB/s, 0 objects/s recovering 2024-08-19T00:07:54.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:54 smithi116 ceph-mon[21873]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 142 KiB/s, 0 objects/s recovering 2024-08-19T00:07:56.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:56 smithi044 ceph-mon[18489]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-19T00:07:56.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:56 smithi171 ceph-mon[21810]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-19T00:07:56.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:56 smithi116 ceph-mon[21873]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-19T00:07:57.730 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:57 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-08-19T00:07:57.730 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:57 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:07:57.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:57 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-08-19T00:07:57.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:57 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:07:57.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:57 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-08-19T00:07:57.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:57 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:07:58.732 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:58 smithi044 ceph-mon[18489]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-08-19T00:07:58.733 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:07:58 smithi044 ceph-mon[18489]: Deploying daemon osd.6 on smithi044 2024-08-19T00:07:58.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:58 smithi171 ceph-mon[21810]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-08-19T00:07:58.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:07:58 smithi171 ceph-mon[21810]: Deploying daemon osd.6 on smithi044 2024-08-19T00:07:58.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:58 smithi116 ceph-mon[21873]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-08-19T00:07:58.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:07:58 smithi116 ceph-mon[21873]: Deploying daemon osd.6 on smithi044 2024-08-19T00:08:00.475 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:00 smithi116 ceph-mon[21873]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-08-19T00:08:00.546 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:00 smithi044 ceph-mon[18489]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-08-19T00:08:00.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:00 smithi171 ceph-mon[21810]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-08-19T00:08:02.711 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:02 smithi044 ceph-mon[18489]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-08-19T00:08:02.712 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:02 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:08:02.712 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:02 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:02.712 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:02 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:02.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:02 smithi171 ceph-mon[21810]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-08-19T00:08:02.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:02 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:08:02.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:02 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:02.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:02 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:02.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:02 smithi116 ceph-mon[21873]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-08-19T00:08:02.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:02 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:08:02.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:02 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:02.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:02 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:04.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:04 smithi171 ceph-mon[21810]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:08:04.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:04 smithi116 ceph-mon[21873]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:08:04.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:04 smithi044 ceph-mon[18489]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:08:05.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:08:05.562+0000 7fcdba7fc640 1 -- 172.21.15.44:0/1201918617 <== mgr.14150 v2:172.21.15.44:6800/1330072146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fcdbc0fe1c0 con 0x7fcda40a2bb0 2024-08-19T00:08:05.564 INFO:teuthology.orchestra.run.smithi044.stdout:Created osd(s) 6 on host 'smithi044' 2024-08-19T00:08:05.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:08:05.565+0000 7fcdc333b640 1 -- 172.21.15.44:0/1201918617 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fcda40a2bb0 msgr2=0x7fcda40a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:08:05.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:08:05.565+0000 7fcdc333b640 1 --2- 172.21.15.44:0/1201918617 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fcda40a2bb0 0x7fcda40a5070 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc102990 tx=0x7fcdac009670 comp rx=0 tx=0).stop 2024-08-19T00:08:05.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:08:05.565+0000 7fcdc333b640 1 -- 172.21.15.44:0/1201918617 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcdbc1034f0 msgr2=0x7fcdbc1a1360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:08:05.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:08:05.565+0000 7fcdc333b640 1 --2- 172.21.15.44:0/1201918617 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcdbc1034f0 0x7fcdbc1a1360 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fcdb40314e0 tx=0x7fcdb4031b60 comp rx=0 tx=0).stop 2024-08-19T00:08:05.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:08:05.565+0000 7fcdc333b640 1 -- 172.21.15.44:0/1201918617 shutdown_connections 2024-08-19T00:08:05.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:08:05.565+0000 7fcdc333b640 1 --2- 172.21.15.44:0/1201918617 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fcda40a2bb0 0x7fcda40a5070 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:08:05.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:08:05.565+0000 7fcdc333b640 1 --2- 172.21.15.44:0/1201918617 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcdbc102b30 0x7fcdbc19a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:08:05.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:08:05.565+0000 7fcdc333b640 1 --2- 172.21.15.44:0/1201918617 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcdbc1034f0 0x7fcdbc1a1360 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:08:05.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:08:05.565+0000 7fcdc333b640 1 --2- 172.21.15.44:0/1201918617 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcdbc101930 0x7fcdbc199da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:08:05.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:08:05.565+0000 7fcdc333b640 1 -- 172.21.15.44:0/1201918617 >> 172.21.15.44:0/1201918617 conn(0x7fcdbc0fd0c0 msgr2=0x7fcdbc0fdab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:08:05.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:08:05.565+0000 7fcdc333b640 1 -- 172.21.15.44:0/1201918617 shutdown_connections 2024-08-19T00:08:05.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:08:05.565+0000 7fcdc333b640 1 -- 172.21.15.44:0/1201918617 wait complete. 2024-08-19T00:08:06.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:05 smithi171 ceph-mon[21810]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:08:06.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:05 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:06.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:05 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:06.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:05 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:08:06.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:05 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:08:06.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:05 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:06.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:05 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:06.093 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:05 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:06.093 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:05 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:08:06.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:05 smithi116 ceph-mon[21873]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:08:06.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:05 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:06.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:05 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:06.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:05 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:08:06.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:05 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:08:06.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:05 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:06.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:05 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:06.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:05 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:06.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:05 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:08:06.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:05 smithi044 ceph-mon[18489]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:08:06.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:05 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:06.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:05 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:06.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:05 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:08:06.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:05 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:08:06.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:05 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:06.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:05 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:06.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:05 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:06.120 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:05 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:08:06.185 DEBUG:teuthology.orchestra.run.smithi044:osd.6> sudo journalctl -f -n 0 -u ceph-647ded64-5dbe-11ef-bccf-c7b262605968@osd.6.service 2024-08-19T00:08:06.187 INFO:tasks.cephadm:Deploying osd.7 on smithi116 with /dev/vg_nvme/lv_2... 2024-08-19T00:08:06.187 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-08-19T00:08:06.451 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.b/config 2024-08-19T00:08:07.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:06 smithi171 ceph-mon[21810]: from='osd.6 [v2:172.21.15.44:6818/1219334797,v1:172.21.15.44:6819/1219334797]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-08-19T00:08:07.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:06 smithi116 ceph-mon[21873]: from='osd.6 [v2:172.21.15.44:6818/1219334797,v1:172.21.15.44:6819/1219334797]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-08-19T00:08:07.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:06 smithi044 ceph-mon[18489]: from='osd.6 [v2:172.21.15.44:6818/1219334797,v1:172.21.15.44:6819/1219334797]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-08-19T00:08:08.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:07 smithi116 ceph-mon[21873]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:08:08.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:07 smithi116 ceph-mon[21873]: from='osd.6 [v2:172.21.15.44:6818/1219334797,v1:172.21.15.44:6819/1219334797]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-08-19T00:08:08.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:07 smithi116 ceph-mon[21873]: osdmap e42: 7 total, 6 up, 7 in 2024-08-19T00:08:08.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:07 smithi116 ceph-mon[21873]: from='osd.6 [v2:172.21.15.44:6818/1219334797,v1:172.21.15.44:6819/1219334797]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-08-19T00:08:08.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:07 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-19T00:08:08.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:07 smithi044 ceph-mon[18489]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:08:08.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:07 smithi044 ceph-mon[18489]: from='osd.6 [v2:172.21.15.44:6818/1219334797,v1:172.21.15.44:6819/1219334797]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-08-19T00:08:08.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:07 smithi044 ceph-mon[18489]: osdmap e42: 7 total, 6 up, 7 in 2024-08-19T00:08:08.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:07 smithi044 ceph-mon[18489]: from='osd.6 [v2:172.21.15.44:6818/1219334797,v1:172.21.15.44:6819/1219334797]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-08-19T00:08:08.120 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:07 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-19T00:08:08.120 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:08:07 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6[45317]: 2024-08-19T00:08:07.854+0000 7f59129b4640 -1 osd.6 0 waiting for initial osdmap 2024-08-19T00:08:08.120 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:08:07 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6[45317]: 2024-08-19T00:08:07.865+0000 7f590e7dc640 -1 osd.6 43 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-19T00:08:08.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:07 smithi171 ceph-mon[21810]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:08:08.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:07 smithi171 ceph-mon[21810]: from='osd.6 [v2:172.21.15.44:6818/1219334797,v1:172.21.15.44:6819/1219334797]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-08-19T00:08:08.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:07 smithi171 ceph-mon[21810]: osdmap e42: 7 total, 6 up, 7 in 2024-08-19T00:08:08.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:07 smithi171 ceph-mon[21810]: from='osd.6 [v2:172.21.15.44:6818/1219334797,v1:172.21.15.44:6819/1219334797]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-08-19T00:08:08.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:07 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-19T00:08:08.988 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:08 smithi116 ceph-mon[21873]: from='osd.6 [v2:172.21.15.44:6818/1219334797,v1:172.21.15.44:6819/1219334797]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-08-19T00:08:08.989 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:08 smithi116 ceph-mon[21873]: osdmap e43: 7 total, 6 up, 7 in 2024-08-19T00:08:08.989 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:08 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-19T00:08:08.989 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:08 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-19T00:08:08.991 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-08-19T00:08:09.016 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi116:vg_nvme/lv_2 2024-08-19T00:08:09.117 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:08 smithi044 ceph-mon[18489]: from='osd.6 [v2:172.21.15.44:6818/1219334797,v1:172.21.15.44:6819/1219334797]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-08-19T00:08:09.117 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:08 smithi044 ceph-mon[18489]: osdmap e43: 7 total, 6 up, 7 in 2024-08-19T00:08:09.117 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:08 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-19T00:08:09.118 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:08 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-19T00:08:09.273 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.b/config 2024-08-19T00:08:09.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:08 smithi171 ceph-mon[21810]: from='osd.6 [v2:172.21.15.44:6818/1219334797,v1:172.21.15.44:6819/1219334797]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-08-19T00:08:09.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:08 smithi171 ceph-mon[21810]: osdmap e43: 7 total, 6 up, 7 in 2024-08-19T00:08:09.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:08 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-19T00:08:09.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:08 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-19T00:08:09.801 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:08:09.763+0000 7f47ceed3640 1 -- 172.21.15.116:0/3299198091 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47c8107650 msgr2=0x7f47c8109a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:08:09.801 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:08:09.763+0000 7f47ceed3640 1 --2- 172.21.15.116:0/3299198091 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47c8107650 0x7f47c8109a40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f47c0009ca0 tx=0x7f47c002a8c0 comp rx=0 tx=0).stop 2024-08-19T00:08:09.801 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:08:09.763+0000 7f47ceed3640 1 -- 172.21.15.116:0/3299198091 shutdown_connections 2024-08-19T00:08:09.802 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:08:09.763+0000 7f47ceed3640 1 --2- 172.21.15.116:0/3299198091 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47c8104d20 0x7f47c8107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:08:09.802 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:08:09.764+0000 7f47ceed3640 1 --2- 172.21.15.116:0/3299198091 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47c8107650 0x7f47c8109a40 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:08:09.802 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:08:09.764+0000 7f47ceed3640 1 --2- 172.21.15.116:0/3299198091 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47c81023f0 0x7f47c81047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:08:09.802 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:08:09.764+0000 7f47ceed3640 1 -- 172.21.15.116:0/3299198091 >> 172.21.15.116:0/3299198091 conn(0x7f47c80fbfb0 msgr2=0x7f47c80fe3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:08:09.802 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:08:09.764+0000 7f47ceed3640 1 -- 172.21.15.116:0/3299198091 shutdown_connections 2024-08-19T00:08:09.802 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:08:09.764+0000 7f47ceed3640 1 -- 172.21.15.116:0/3299198091 wait complete. 2024-08-19T00:08:09.802 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:08:09.764+0000 7f47ceed3640 1 Processor -- start 2024-08-19T00:08:09.802 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:08:09.764+0000 7f47ceed3640 1 -- start start 2024-08-19T00:08:09.802 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:08:09.764+0000 7f47ceed3640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47c81023f0 0x7f47c8197be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:08:09.802 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:08:09.764+0000 7f47ceed3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47c8104d20 0x7f47c8198120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:08:09.802 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:08:09.764+0000 7f47ceed3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47c8107650 0x7f47c819f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:08:09.803 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:08:09.764+0000 7f47ceed3640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f47c810d610 con 0x7f47c8104d20 2024-08-19T00:08:09.803 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:08:09.764+0000 7f47ceed3640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f47c810d490 con 0x7f47c81023f0 2024-08-19T00:08:09.803 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:08:09.764+0000 7f47ceed3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f47c810d790 con 0x7f47c8107650 2024-08-19T00:08:09.803 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:08:09.764+0000 7f47ccc6f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47c81023f0 0x7f47c8197be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:08:09.803 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:08:09.765+0000 7f47ccc6f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47c81023f0 0x7f47c8197be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:35528/0 (socket says 172.21.15.116:35528) 2024-08-19T00:08:09.803 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:08:09.765+0000 7f47ccc6f640 1 -- 172.21.15.116:0/2579586823 learned_addr learned my addr 172.21.15.116:0/2579586823 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-08-19T00:08:09.803 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:08:09.765+0000 7f47cd470640 1 --2- 172.21.15.116:0/2579586823 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47c8107650 0x7f47c819f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:08:09.803 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:08:09.765+0000 7f47c7fff640 1 --2- 172.21.15.116:0/2579586823 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47c8104d20 0x7f47c8198120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:08:09.803 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:08:09.765+0000 7f47ccc6f640 1 -- 172.21.15.116:0/2579586823 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47c8107650 msgr2=0x7f47c819f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:08:09.803 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:08:09.765+0000 7f47ccc6f640 1 --2- 172.21.15.116:0/2579586823 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47c8107650 0x7f47c819f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:08:09.803 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:08:09.765+0000 7f47ccc6f640 1 -- 172.21.15.116:0/2579586823 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47c8104d20 msgr2=0x7f47c8198120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:08:09.804 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:08:09.765+0000 7f47ccc6f640 1 --2- 172.21.15.116:0/2579586823 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47c8104d20 0x7f47c8198120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:08:09.804 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:08:09.765+0000 7f47ccc6f640 1 -- 172.21.15.116:0/2579586823 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47c819f810 con 0x7f47c81023f0 2024-08-19T00:08:09.804 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:08:09.765+0000 7f47cd470640 1 --2- 172.21.15.116:0/2579586823 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47c8107650 0x7f47c819f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:08:09.804 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:08:09.765+0000 7f47c7fff640 1 --2- 172.21.15.116:0/2579586823 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47c8104d20 0x7f47c8198120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:08:09.804 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:08:09.765+0000 7f47ccc6f640 1 --2- 172.21.15.116:0/2579586823 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47c81023f0 0x7f47c8197be0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f47b800b4a0 tx=0x7f47b800b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:08:09.804 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:08:09.765+0000 7f47c5ffb640 1 -- 172.21.15.116:0/2579586823 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b8014070 con 0x7f47c81023f0 2024-08-19T00:08:09.804 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:08:09.765+0000 7f47ceed3640 1 -- 172.21.15.116:0/2579586823 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47c819fb00 con 0x7f47c81023f0 2024-08-19T00:08:09.804 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:08:09.765+0000 7f47c5ffb640 1 -- 172.21.15.116:0/2579586823 <== mon.2 v2:172.21.15.116:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47b8010af0 con 0x7f47c81023f0 2024-08-19T00:08:09.804 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:08:09.765+0000 7f47c5ffb640 1 -- 172.21.15.116:0/2579586823 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b8017d10 con 0x7f47c81023f0 2024-08-19T00:08:09.804 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:08:09.765+0000 7f47ceed3640 1 -- 172.21.15.116:0/2579586823 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47c81a0090 con 0x7f47c81023f0 2024-08-19T00:08:09.804 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:08:09.766+0000 7f47ceed3640 1 -- 172.21.15.116:0/2579586823 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47c80fdaa0 con 0x7f47c81023f0 2024-08-19T00:08:09.804 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:08:09.768+0000 7f47c5ffb640 1 -- 172.21.15.116:0/2579586823 <== mon.2 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f47b8017070 con 0x7f47c81023f0 2024-08-19T00:08:09.804 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:08:09.768+0000 7f47c5ffb640 1 --2- 172.21.15.116:0/2579586823 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f47b00a2bb0 0x7f47b00a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:08:09.805 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:08:09.768+0000 7f47c5ffb640 1 -- 172.21.15.116:0/2579586823 <== mon.2 v2:172.21.15.116:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 4965+0+0 (secure 0 0 0) 0x7f47b80cdba0 con 0x7f47c81023f0 2024-08-19T00:08:09.805 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:08:09.768+0000 7f47c7fff640 1 --2- 172.21.15.116:0/2579586823 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f47b00a2bb0 0x7f47b00a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:08:09.805 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:08:09.769+0000 7f47c7fff640 1 --2- 172.21.15.116:0/2579586823 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f47b00a2bb0 0x7f47b00a5070 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f47c8199100 tx=0x7f47bc005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:08:09.805 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:08:09.771+0000 7f47c5ffb640 1 -- 172.21.15.116:0/2579586823 <== mon.2 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f47b80cde20 con 0x7f47c81023f0 2024-08-19T00:08:09.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:08:09.947+0000 7f47ceed3640 1 -- 172.21.15.116:0/2579586823 --> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f47c8062360 con 0x7f47b00a2bb0 2024-08-19T00:08:09.950 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:09 smithi116 ceph-mon[21873]: purged_snaps scrub starts 2024-08-19T00:08:09.950 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:09 smithi116 ceph-mon[21873]: purged_snaps scrub ok 2024-08-19T00:08:09.950 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:09 smithi116 ceph-mon[21873]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:08:09.950 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:09 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-19T00:08:09.951 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:09 smithi116 ceph-mon[21873]: osd.6 [v2:172.21.15.44:6818/1219334797,v1:172.21.15.44:6819/1219334797] boot 2024-08-19T00:08:09.951 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:09 smithi116 ceph-mon[21873]: osdmap e44: 7 total, 7 up, 7 in 2024-08-19T00:08:09.951 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:09 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-19T00:08:09.951 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:09 smithi116 ceph-mon[21873]: Detected new or changed devices on smithi044 2024-08-19T00:08:09.951 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:09 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:09.951 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:09 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:09.951 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:09 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:08:09.951 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:09 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:08:09.952 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:09 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:08:09.952 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:09 smithi116 ceph-mon[21873]: Adjusting osd_memory_target on smithi044 to 5697M 2024-08-19T00:08:09.952 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:09 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:09.952 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:09 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:08:09.952 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:09 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:08:09.952 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:09 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:10.120 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:09 smithi044 ceph-mon[18489]: purged_snaps scrub starts 2024-08-19T00:08:10.120 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:09 smithi044 ceph-mon[18489]: purged_snaps scrub ok 2024-08-19T00:08:10.120 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:09 smithi044 ceph-mon[18489]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:08:10.120 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:09 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-19T00:08:10.120 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:09 smithi044 ceph-mon[18489]: osd.6 [v2:172.21.15.44:6818/1219334797,v1:172.21.15.44:6819/1219334797] boot 2024-08-19T00:08:10.120 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:09 smithi044 ceph-mon[18489]: osdmap e44: 7 total, 7 up, 7 in 2024-08-19T00:08:10.120 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:09 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-19T00:08:10.120 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:09 smithi044 ceph-mon[18489]: Detected new or changed devices on smithi044 2024-08-19T00:08:10.120 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:09 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:10.120 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:09 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:10.120 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:09 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:08:10.120 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:09 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:08:10.121 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:09 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:08:10.121 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:09 smithi044 ceph-mon[18489]: Adjusting osd_memory_target on smithi044 to 5697M 2024-08-19T00:08:10.121 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:09 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:10.121 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:09 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:08:10.121 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:09 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:08:10.121 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:09 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:10.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:09 smithi171 ceph-mon[21810]: purged_snaps scrub starts 2024-08-19T00:08:10.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:09 smithi171 ceph-mon[21810]: purged_snaps scrub ok 2024-08-19T00:08:10.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:09 smithi171 ceph-mon[21810]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:08:10.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:09 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-19T00:08:10.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:09 smithi171 ceph-mon[21810]: osd.6 [v2:172.21.15.44:6818/1219334797,v1:172.21.15.44:6819/1219334797] boot 2024-08-19T00:08:10.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:09 smithi171 ceph-mon[21810]: osdmap e44: 7 total, 7 up, 7 in 2024-08-19T00:08:10.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:09 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-19T00:08:10.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:09 smithi171 ceph-mon[21810]: Detected new or changed devices on smithi044 2024-08-19T00:08:10.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:09 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:10.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:09 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:10.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:09 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:08:10.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:09 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:08:10.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:09 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:08:10.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:09 smithi171 ceph-mon[21810]: Adjusting osd_memory_target on smithi044 to 5697M 2024-08-19T00:08:10.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:09 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:10.344 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:09 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:08:10.344 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:09 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:08:10.344 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:09 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:11.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:10 smithi116 ceph-mon[21873]: osdmap e45: 7 total, 7 up, 7 in 2024-08-19T00:08:11.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:10 smithi116 ceph-mon[21873]: from='client.24278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:08:11.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:10 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-19T00:08:11.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:10 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-19T00:08:11.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:10 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:08:11.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:10 smithi044 ceph-mon[18489]: osdmap e45: 7 total, 7 up, 7 in 2024-08-19T00:08:11.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:10 smithi044 ceph-mon[18489]: from='client.24278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:08:11.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:10 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-19T00:08:11.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:10 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-19T00:08:11.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:10 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:08:11.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:10 smithi171 ceph-mon[21810]: osdmap e45: 7 total, 7 up, 7 in 2024-08-19T00:08:11.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:10 smithi171 ceph-mon[21810]: from='client.24278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:08:11.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:10 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-19T00:08:11.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:10 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-19T00:08:11.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:10 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:08:12.087 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:11 smithi116 ceph-mon[21873]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-19T00:08:12.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:11 smithi171 ceph-mon[21810]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-19T00:08:12.348 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:11 smithi044 ceph-mon[18489]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-19T00:08:12.979 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:12 smithi116 ceph-mon[21873]: from='client.? 172.21.15.116:0/1859052061' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "70130d71-d28c-4a58-b603-75610c8d3ea0"}]: dispatch 2024-08-19T00:08:12.979 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:12 smithi116 ceph-mon[21873]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "70130d71-d28c-4a58-b603-75610c8d3ea0"}]: dispatch 2024-08-19T00:08:12.979 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:12 smithi116 ceph-mon[21873]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "70130d71-d28c-4a58-b603-75610c8d3ea0"}]': finished 2024-08-19T00:08:12.979 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:12 smithi116 ceph-mon[21873]: osdmap e46: 8 total, 7 up, 8 in 2024-08-19T00:08:12.979 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:12 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-19T00:08:13.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:12 smithi171 ceph-mon[21810]: from='client.? 172.21.15.116:0/1859052061' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "70130d71-d28c-4a58-b603-75610c8d3ea0"}]: dispatch 2024-08-19T00:08:13.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:12 smithi171 ceph-mon[21810]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "70130d71-d28c-4a58-b603-75610c8d3ea0"}]: dispatch 2024-08-19T00:08:13.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:12 smithi171 ceph-mon[21810]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "70130d71-d28c-4a58-b603-75610c8d3ea0"}]': finished 2024-08-19T00:08:13.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:12 smithi171 ceph-mon[21810]: osdmap e46: 8 total, 7 up, 8 in 2024-08-19T00:08:13.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:12 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-19T00:08:13.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:12 smithi044 ceph-mon[18489]: from='client.? 172.21.15.116:0/1859052061' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "70130d71-d28c-4a58-b603-75610c8d3ea0"}]: dispatch 2024-08-19T00:08:13.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:12 smithi044 ceph-mon[18489]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "70130d71-d28c-4a58-b603-75610c8d3ea0"}]: dispatch 2024-08-19T00:08:13.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:12 smithi044 ceph-mon[18489]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "70130d71-d28c-4a58-b603-75610c8d3ea0"}]': finished 2024-08-19T00:08:13.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:12 smithi044 ceph-mon[18489]: osdmap e46: 8 total, 7 up, 8 in 2024-08-19T00:08:13.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:12 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-19T00:08:14.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:13 smithi171 ceph-mon[21810]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-19T00:08:14.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:13 smithi171 ceph-mon[21810]: from='client.? 172.21.15.116:0/1262825424' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-19T00:08:14.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:13 smithi116 ceph-mon[21873]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-19T00:08:14.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:13 smithi116 ceph-mon[21873]: from='client.? 172.21.15.116:0/1262825424' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-19T00:08:14.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:13 smithi044 ceph-mon[18489]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-19T00:08:14.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:13 smithi044 ceph-mon[18489]: from='client.? 172.21.15.116:0/1262825424' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-19T00:08:16.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:15 smithi171 ceph-mon[21810]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-19T00:08:16.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:15 smithi116 ceph-mon[21873]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-19T00:08:16.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:15 smithi044 ceph-mon[18489]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-19T00:08:18.144 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:17 smithi171 ceph-mon[21810]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-19T00:08:18.157 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:17 smithi116 ceph-mon[21873]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-19T00:08:18.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:17 smithi044 ceph-mon[18489]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-19T00:08:20.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:19 smithi116 ceph-mon[21873]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-19T00:08:20.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:19 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-08-19T00:08:20.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:19 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:08:20.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:19 smithi171 ceph-mon[21810]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-19T00:08:20.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:19 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-08-19T00:08:20.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:19 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:08:20.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:19 smithi044 ceph-mon[18489]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-19T00:08:20.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:19 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-08-19T00:08:20.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:19 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:08:21.237 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:20 smithi116 ceph-mon[21873]: Deploying daemon osd.7 on smithi116 2024-08-19T00:08:21.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:20 smithi171 ceph-mon[21810]: Deploying daemon osd.7 on smithi116 2024-08-19T00:08:21.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:20 smithi044 ceph-mon[18489]: Deploying daemon osd.7 on smithi116 2024-08-19T00:08:22.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:21 smithi044 ceph-mon[18489]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-19T00:08:22.245 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:21 smithi116 ceph-mon[21873]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-19T00:08:22.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:21 smithi171 ceph-mon[21810]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-19T00:08:24.006 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:23 smithi116 ceph-mon[21873]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-19T00:08:24.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:23 smithi171 ceph-mon[21810]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-19T00:08:24.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:23 smithi044 ceph-mon[18489]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-19T00:08:25.237 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:24 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:08:25.237 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:24 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:25.237 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:24 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:25.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:24 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:08:25.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:24 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:25.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:24 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:25.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:24 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:08:25.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:24 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:25.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:24 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:25.984 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:25 smithi116 ceph-mon[21873]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-19T00:08:26.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:25 smithi171 ceph-mon[21810]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-19T00:08:26.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:25 smithi044 ceph-mon[18489]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-19T00:08:28.144 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:08:28.143+0000 7f47c5ffb640 1 -- 172.21.15.116:0/2579586823 <== mgr.14150 v2:172.21.15.44:6800/1330072146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f47c8062360 con 0x7f47b00a2bb0 2024-08-19T00:08:28.145 INFO:teuthology.orchestra.run.smithi116.stdout:Created osd(s) 7 on host 'smithi116' 2024-08-19T00:08:28.146 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:08:28.145+0000 7f47ceed3640 1 -- 172.21.15.116:0/2579586823 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f47b00a2bb0 msgr2=0x7f47b00a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:08:28.147 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:08:28.145+0000 7f47ceed3640 1 --2- 172.21.15.116:0/2579586823 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f47b00a2bb0 0x7f47b00a5070 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f47c8199100 tx=0x7f47bc005d90 comp rx=0 tx=0).stop 2024-08-19T00:08:28.147 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:08:28.145+0000 7f47ceed3640 1 -- 172.21.15.116:0/2579586823 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47c81023f0 msgr2=0x7f47c8197be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:08:28.147 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:08:28.145+0000 7f47ceed3640 1 --2- 172.21.15.116:0/2579586823 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47c81023f0 0x7f47c8197be0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f47b800b4a0 tx=0x7f47b800b960 comp rx=0 tx=0).stop 2024-08-19T00:08:28.147 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:08:28.145+0000 7f47ceed3640 1 -- 172.21.15.116:0/2579586823 shutdown_connections 2024-08-19T00:08:28.147 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:08:28.145+0000 7f47ceed3640 1 --2- 172.21.15.116:0/2579586823 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f47b00a2bb0 0x7f47b00a5070 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:08:28.147 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:08:28.145+0000 7f47ceed3640 1 --2- 172.21.15.116:0/2579586823 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47c8107650 0x7f47c819f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:08:28.147 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:08:28.145+0000 7f47ceed3640 1 --2- 172.21.15.116:0/2579586823 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47c8104d20 0x7f47c8198120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:08:28.147 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:08:28.145+0000 7f47ceed3640 1 --2- 172.21.15.116:0/2579586823 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47c81023f0 0x7f47c8197be0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:08:28.147 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:08:28.145+0000 7f47ceed3640 1 -- 172.21.15.116:0/2579586823 >> 172.21.15.116:0/2579586823 conn(0x7f47c80fbfb0 msgr2=0x7f47c8102cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:08:28.147 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:08:28.145+0000 7f47ceed3640 1 -- 172.21.15.116:0/2579586823 shutdown_connections 2024-08-19T00:08:28.147 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:08:28.145+0000 7f47ceed3640 1 -- 172.21.15.116:0/2579586823 wait complete. 2024-08-19T00:08:28.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:28 smithi171 ceph-mon[21810]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-19T00:08:28.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:28 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:28.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:28 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:28.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:28 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:08:28.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:28 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:08:28.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:28 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:28.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:28 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:08:28.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:28 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:28.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:28 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:28.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:28 smithi116 ceph-mon[21873]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-19T00:08:28.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:28 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:28.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:28 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:28.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:28 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:08:28.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:28 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:08:28.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:28 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:28.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:28 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:08:28.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:28 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:28.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:28 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:28.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:28 smithi044 ceph-mon[18489]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-19T00:08:28.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:28 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:28.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:28 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:28.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:28 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:08:28.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:28 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:08:28.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:28 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:28.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:28 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:08:28.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:28 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:28.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:28 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:28.922 DEBUG:teuthology.orchestra.run.smithi116:osd.7> sudo journalctl -f -n 0 -u ceph-647ded64-5dbe-11ef-bccf-c7b262605968@osd.7.service 2024-08-19T00:08:28.925 INFO:tasks.cephadm:Deploying osd.8 on smithi171 with /dev/vg_nvme/lv_2... 2024-08-19T00:08:28.925 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-08-19T00:08:29.185 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.c/config 2024-08-19T00:08:29.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:29 smithi171 ceph-mon[21810]: from='osd.7 [v2:172.21.15.116:6816/3861873415,v1:172.21.15.116:6817/3861873415]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-08-19T00:08:29.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:29 smithi171 ceph-mon[21810]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-08-19T00:08:29.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:29 smithi116 ceph-mon[21873]: from='osd.7 [v2:172.21.15.116:6816/3861873415,v1:172.21.15.116:6817/3861873415]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-08-19T00:08:29.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:29 smithi116 ceph-mon[21873]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-08-19T00:08:29.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:29 smithi044 ceph-mon[18489]: from='osd.7 [v2:172.21.15.116:6816/3861873415,v1:172.21.15.116:6817/3861873415]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-08-19T00:08:29.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:29 smithi044 ceph-mon[18489]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-08-19T00:08:30.572 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:30 smithi171 ceph-mon[21810]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-19T00:08:30.572 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:30 smithi171 ceph-mon[21810]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-08-19T00:08:30.572 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:30 smithi171 ceph-mon[21810]: osdmap e47: 8 total, 7 up, 8 in 2024-08-19T00:08:30.572 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:30 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-19T00:08:30.572 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:30 smithi171 ceph-mon[21810]: from='osd.7 [v2:172.21.15.116:6816/3861873415,v1:172.21.15.116:6817/3861873415]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-08-19T00:08:30.573 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:30 smithi171 ceph-mon[21810]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-08-19T00:08:30.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:30 smithi116 ceph-mon[21873]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-19T00:08:30.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:30 smithi116 ceph-mon[21873]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-08-19T00:08:30.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:30 smithi116 ceph-mon[21873]: osdmap e47: 8 total, 7 up, 8 in 2024-08-19T00:08:30.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:30 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-19T00:08:30.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:30 smithi116 ceph-mon[21873]: from='osd.7 [v2:172.21.15.116:6816/3861873415,v1:172.21.15.116:6817/3861873415]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-08-19T00:08:30.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:30 smithi116 ceph-mon[21873]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-08-19T00:08:30.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:30 smithi044 ceph-mon[18489]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-19T00:08:30.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:30 smithi044 ceph-mon[18489]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-08-19T00:08:30.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:30 smithi044 ceph-mon[18489]: osdmap e47: 8 total, 7 up, 8 in 2024-08-19T00:08:30.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:30 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-19T00:08:30.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:30 smithi044 ceph-mon[18489]: from='osd.7 [v2:172.21.15.116:6816/3861873415,v1:172.21.15.116:6817/3861873415]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-08-19T00:08:30.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:30 smithi044 ceph-mon[18489]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-08-19T00:08:31.366 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:08:31 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7[39116]: 2024-08-19T00:08:31.080+0000 7f547c1e1640 -1 osd.7 0 waiting for initial osdmap 2024-08-19T00:08:31.366 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:08:31 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7[39116]: 2024-08-19T00:08:31.090+0000 7f5474001640 -1 osd.7 48 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-19T00:08:31.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:31 smithi171 ceph-mon[21810]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-08-19T00:08:31.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:31 smithi171 ceph-mon[21810]: osdmap e48: 8 total, 7 up, 8 in 2024-08-19T00:08:31.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:31 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-19T00:08:31.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:31 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-19T00:08:31.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:31 smithi171 ceph-mon[21810]: from='osd.7 ' entity='osd.7' 2024-08-19T00:08:31.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:31 smithi171 ceph-mon[21810]: osd.7 [v2:172.21.15.116:6816/3861873415,v1:172.21.15.116:6817/3861873415] boot 2024-08-19T00:08:31.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:31 smithi171 ceph-mon[21810]: osdmap e49: 8 total, 8 up, 8 in 2024-08-19T00:08:31.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:31 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-19T00:08:31.816 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-19T00:08:31.844 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi171:vg_nvme/lv_2 2024-08-19T00:08:31.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:31 smithi116 ceph-mon[21873]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-08-19T00:08:31.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:31 smithi116 ceph-mon[21873]: osdmap e48: 8 total, 7 up, 8 in 2024-08-19T00:08:31.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:31 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-19T00:08:31.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:31 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-19T00:08:31.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:31 smithi116 ceph-mon[21873]: from='osd.7 ' entity='osd.7' 2024-08-19T00:08:31.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:31 smithi116 ceph-mon[21873]: osd.7 [v2:172.21.15.116:6816/3861873415,v1:172.21.15.116:6817/3861873415] boot 2024-08-19T00:08:31.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:31 smithi116 ceph-mon[21873]: osdmap e49: 8 total, 8 up, 8 in 2024-08-19T00:08:31.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:31 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-19T00:08:31.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:31 smithi044 ceph-mon[18489]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-08-19T00:08:31.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:31 smithi044 ceph-mon[18489]: osdmap e48: 8 total, 7 up, 8 in 2024-08-19T00:08:31.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:31 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-19T00:08:31.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:31 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-19T00:08:31.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:31 smithi044 ceph-mon[18489]: from='osd.7 ' entity='osd.7' 2024-08-19T00:08:31.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:31 smithi044 ceph-mon[18489]: osd.7 [v2:172.21.15.116:6816/3861873415,v1:172.21.15.116:6817/3861873415] boot 2024-08-19T00:08:31.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:31 smithi044 ceph-mon[18489]: osdmap e49: 8 total, 8 up, 8 in 2024-08-19T00:08:31.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:31 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-19T00:08:32.097 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.c/config 2024-08-19T00:08:32.490 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:32 smithi171 ceph-mon[21810]: purged_snaps scrub starts 2024-08-19T00:08:32.491 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:32 smithi171 ceph-mon[21810]: purged_snaps scrub ok 2024-08-19T00:08:32.491 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:32 smithi171 ceph-mon[21810]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-19T00:08:32.491 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:32 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:32.491 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:32 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:32.491 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:32 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:08:32.491 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:32 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:08:32.491 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:32 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:08:32.491 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:32 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:32.491 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:32 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:08:32.491 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:32 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:08:32.491 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:32 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:32.491 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:32 smithi171 ceph-mon[21810]: osdmap e50: 8 total, 8 up, 8 in 2024-08-19T00:08:32.606 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:08:32.573+0000 7ff673819640 1 -- 172.21.15.171:0/199281641 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff66c101930 msgr2=0x7ff66c101d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:08:32.606 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:08:32.573+0000 7ff673819640 1 --2- 172.21.15.171:0/199281641 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff66c101930 0x7ff66c101d30 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff668009900 tx=0x7ff66802a410 comp rx=0 tx=0).stop 2024-08-19T00:08:32.606 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:08:32.573+0000 7ff673819640 1 -- 172.21.15.171:0/199281641 shutdown_connections 2024-08-19T00:08:32.606 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:08:32.573+0000 7ff673819640 1 --2- 172.21.15.171:0/199281641 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff66c1034f0 0x7ff66c109d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:08:32.606 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:08:32.573+0000 7ff673819640 1 --2- 172.21.15.171:0/199281641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff66c102b30 0x7ff66c102fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:08:32.607 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:08:32.573+0000 7ff673819640 1 --2- 172.21.15.171:0/199281641 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff66c101930 0x7ff66c101d30 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:08:32.607 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:08:32.573+0000 7ff673819640 1 -- 172.21.15.171:0/199281641 >> 172.21.15.171:0/199281641 conn(0x7ff66c0fd0c0 msgr2=0x7ff66c0ff500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:08:32.607 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:08:32.573+0000 7ff673819640 1 -- 172.21.15.171:0/199281641 shutdown_connections 2024-08-19T00:08:32.607 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:08:32.573+0000 7ff673819640 1 -- 172.21.15.171:0/199281641 wait complete. 2024-08-19T00:08:32.607 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:08:32.574+0000 7ff673819640 1 Processor -- start 2024-08-19T00:08:32.607 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:08:32.574+0000 7ff673819640 1 -- start start 2024-08-19T00:08:32.607 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:08:32.574+0000 7ff673819640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff66c101930 0x7ff66c197b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:08:32.607 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:08:32.574+0000 7ff673819640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff66c102b30 0x7ff66c1980c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:08:32.607 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:08:32.574+0000 7ff673819640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff66c1034f0 0x7ff66c19f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:08:32.607 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:08:32.574+0000 7ff673819640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff66c10d590 con 0x7ff66c101930 2024-08-19T00:08:32.607 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:08:32.574+0000 7ff673819640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7ff66c10d410 con 0x7ff66c1034f0 2024-08-19T00:08:32.608 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:08:32.574+0000 7ff673819640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff66c10d710 con 0x7ff66c102b30 2024-08-19T00:08:32.608 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:08:32.574+0000 7ff670db4640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff66c102b30 0x7ff66c1980c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:08:32.608 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:08:32.574+0000 7ff670db4640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff66c102b30 0x7ff66c1980c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:43476/0 (socket says 172.21.15.171:43476) 2024-08-19T00:08:32.608 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:08:32.574+0000 7ff670db4640 1 -- 172.21.15.171:0/3816794279 learned_addr learned my addr 172.21.15.171:0/3816794279 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-08-19T00:08:32.608 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:08:32.574+0000 7ff671db6640 1 --2- 172.21.15.171:0/3816794279 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff66c1034f0 0x7ff66c19f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:08:32.608 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:08:32.574+0000 7ff6715b5640 1 --2- 172.21.15.171:0/3816794279 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff66c101930 0x7ff66c197b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:08:32.608 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:08:32.575+0000 7ff670db4640 1 -- 172.21.15.171:0/3816794279 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff66c1034f0 msgr2=0x7ff66c19f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:08:32.608 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:08:32.575+0000 7ff670db4640 1 --2- 172.21.15.171:0/3816794279 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff66c1034f0 0x7ff66c19f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:08:32.608 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:08:32.575+0000 7ff670db4640 1 -- 172.21.15.171:0/3816794279 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff66c101930 msgr2=0x7ff66c197b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:08:32.609 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:08:32.575+0000 7ff670db4640 1 --2- 172.21.15.171:0/3816794279 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff66c101930 0x7ff66c197b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:08:32.609 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:08:32.575+0000 7ff670db4640 1 -- 172.21.15.171:0/3816794279 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff66c19f7b0 con 0x7ff66c102b30 2024-08-19T00:08:32.609 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:08:32.575+0000 7ff6715b5640 1 --2- 172.21.15.171:0/3816794279 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff66c101930 0x7ff66c197b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:08:32.609 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:08:32.575+0000 7ff670db4640 1 --2- 172.21.15.171:0/3816794279 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff66c102b30 0x7ff66c1980c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff65c00c920 tx=0x7ff65c00cde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:08:32.609 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:08:32.575+0000 7ff6627fc640 1 -- 172.21.15.171:0/3816794279 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff65c007c70 con 0x7ff66c102b30 2024-08-19T00:08:32.609 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:08:32.575+0000 7ff6627fc640 1 -- 172.21.15.171:0/3816794279 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff65c007e10 con 0x7ff66c102b30 2024-08-19T00:08:32.609 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:08:32.575+0000 7ff673819640 1 -- 172.21.15.171:0/3816794279 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff66c19faa0 con 0x7ff66c102b30 2024-08-19T00:08:32.609 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:08:32.575+0000 7ff6627fc640 1 -- 172.21.15.171:0/3816794279 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff65c018890 con 0x7ff66c102b30 2024-08-19T00:08:32.609 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:08:32.575+0000 7ff673819640 1 -- 172.21.15.171:0/3816794279 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff66c1a0030 con 0x7ff66c102b30 2024-08-19T00:08:32.610 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:08:32.576+0000 7ff673819640 1 -- 172.21.15.171:0/3816794279 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff66c108ce0 con 0x7ff66c102b30 2024-08-19T00:08:32.610 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:08:32.577+0000 7ff6627fc640 1 -- 172.21.15.171:0/3816794279 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7ff65c018a30 con 0x7ff66c102b30 2024-08-19T00:08:32.610 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:08:32.578+0000 7ff6627fc640 1 --2- 172.21.15.171:0/3816794279 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7ff6580a2c30 0x7ff6580a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:08:32.610 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:08:32.578+0000 7ff6627fc640 1 -- 172.21.15.171:0/3816794279 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5426+0+0 (secure 0 0 0) 0x7ff65c0ce840 con 0x7ff66c102b30 2024-08-19T00:08:32.610 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:08:32.578+0000 7ff6715b5640 1 --2- 172.21.15.171:0/3816794279 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7ff6580a2c30 0x7ff6580a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:08:32.610 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:08:32.579+0000 7ff6715b5640 1 --2- 172.21.15.171:0/3816794279 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7ff6580a2c30 0x7ff6580a50f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff668006010 tx=0x7ff668032dd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:08:32.610 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:08:32.581+0000 7ff6627fc640 1 -- 172.21.15.171:0/3816794279 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7ff65c014030 con 0x7ff66c102b30 2024-08-19T00:08:32.758 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:08:32.757+0000 7ff673819640 1 -- 172.21.15.171:0/3816794279 --> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7ff66c062360 con 0x7ff6580a2c30 2024-08-19T00:08:32.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:32 smithi116 ceph-mon[21873]: purged_snaps scrub starts 2024-08-19T00:08:32.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:32 smithi116 ceph-mon[21873]: purged_snaps scrub ok 2024-08-19T00:08:32.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:32 smithi116 ceph-mon[21873]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-19T00:08:32.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:32 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:32.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:32 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:32.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:32 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:08:32.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:32 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:08:32.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:32 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:08:32.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:32 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:32.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:32 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:08:32.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:32 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:08:32.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:32 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:32.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:32 smithi116 ceph-mon[21873]: osdmap e50: 8 total, 8 up, 8 in 2024-08-19T00:08:32.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:32 smithi044 ceph-mon[18489]: purged_snaps scrub starts 2024-08-19T00:08:32.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:32 smithi044 ceph-mon[18489]: purged_snaps scrub ok 2024-08-19T00:08:32.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:32 smithi044 ceph-mon[18489]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-08-19T00:08:32.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:32 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:32.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:32 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:32.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:32 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:08:32.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:32 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:08:32.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:32 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:08:32.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:32 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:32.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:32 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:08:32.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:32 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:08:32.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:32 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:32.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:32 smithi044 ceph-mon[18489]: osdmap e50: 8 total, 8 up, 8 in 2024-08-19T00:08:33.486 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:33 smithi171 ceph-mon[21810]: Detected new or changed devices on smithi116 2024-08-19T00:08:33.486 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:33 smithi171 ceph-mon[21810]: Adjusting osd_memory_target on smithi116 to 5696M 2024-08-19T00:08:33.486 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:33 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-19T00:08:33.486 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:33 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-19T00:08:33.486 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:33 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:08:33.486 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:33 smithi171 ceph-mon[21810]: osdmap e51: 8 total, 8 up, 8 in 2024-08-19T00:08:33.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:33 smithi116 ceph-mon[21873]: Detected new or changed devices on smithi116 2024-08-19T00:08:33.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:33 smithi116 ceph-mon[21873]: Adjusting osd_memory_target on smithi116 to 5696M 2024-08-19T00:08:33.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:33 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-19T00:08:33.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:33 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-19T00:08:33.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:33 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:08:33.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:33 smithi116 ceph-mon[21873]: osdmap e51: 8 total, 8 up, 8 in 2024-08-19T00:08:33.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:33 smithi044 ceph-mon[18489]: Detected new or changed devices on smithi116 2024-08-19T00:08:33.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:33 smithi044 ceph-mon[18489]: Adjusting osd_memory_target on smithi116 to 5696M 2024-08-19T00:08:33.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:33 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-19T00:08:33.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:33 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-19T00:08:33.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:33 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:08:33.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:33 smithi044 ceph-mon[18489]: osdmap e51: 8 total, 8 up, 8 in 2024-08-19T00:08:34.484 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:34 smithi171 ceph-mon[21810]: pgmap v157: 1 pgs: 1 unknown; 577 KiB data, 364 MiB used, 715 GiB / 715 GiB avail 2024-08-19T00:08:34.484 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:34 smithi171 ceph-mon[21810]: from='client.24280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:08:34.484 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:34 smithi171 ceph-mon[21810]: osdmap e52: 8 total, 8 up, 8 in 2024-08-19T00:08:34.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:34 smithi116 ceph-mon[21873]: pgmap v157: 1 pgs: 1 unknown; 577 KiB data, 364 MiB used, 715 GiB / 715 GiB avail 2024-08-19T00:08:34.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:34 smithi116 ceph-mon[21873]: from='client.24280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:08:34.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:34 smithi116 ceph-mon[21873]: osdmap e52: 8 total, 8 up, 8 in 2024-08-19T00:08:34.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:34 smithi044 ceph-mon[18489]: pgmap v157: 1 pgs: 1 unknown; 577 KiB data, 364 MiB used, 715 GiB / 715 GiB avail 2024-08-19T00:08:34.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:34 smithi044 ceph-mon[18489]: from='client.24280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:08:34.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:34 smithi044 ceph-mon[18489]: osdmap e52: 8 total, 8 up, 8 in 2024-08-19T00:08:35.766 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:35 smithi171 ceph-mon[21810]: pgmap v160: 1 pgs: 1 unknown; 577 KiB data, 364 MiB used, 715 GiB / 715 GiB avail 2024-08-19T00:08:35.766 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:35 smithi171 ceph-mon[21810]: osdmap e53: 8 total, 8 up, 8 in 2024-08-19T00:08:35.767 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:35 smithi171 ceph-mon[21810]: from='client.? 172.21.15.171:0/3650537022' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c5121f70-e423-4f86-a3c6-90945c9385f0"}]: dispatch 2024-08-19T00:08:35.767 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:35 smithi171 ceph-mon[21810]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c5121f70-e423-4f86-a3c6-90945c9385f0"}]: dispatch 2024-08-19T00:08:35.767 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:35 smithi171 ceph-mon[21810]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c5121f70-e423-4f86-a3c6-90945c9385f0"}]': finished 2024-08-19T00:08:35.767 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:35 smithi171 ceph-mon[21810]: osdmap e54: 9 total, 8 up, 9 in 2024-08-19T00:08:35.767 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:35 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-19T00:08:35.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:35 smithi116 ceph-mon[21873]: pgmap v160: 1 pgs: 1 unknown; 577 KiB data, 364 MiB used, 715 GiB / 715 GiB avail 2024-08-19T00:08:35.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:35 smithi116 ceph-mon[21873]: osdmap e53: 8 total, 8 up, 8 in 2024-08-19T00:08:35.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:35 smithi116 ceph-mon[21873]: from='client.? 172.21.15.171:0/3650537022' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c5121f70-e423-4f86-a3c6-90945c9385f0"}]: dispatch 2024-08-19T00:08:35.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:35 smithi116 ceph-mon[21873]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c5121f70-e423-4f86-a3c6-90945c9385f0"}]: dispatch 2024-08-19T00:08:35.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:35 smithi116 ceph-mon[21873]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c5121f70-e423-4f86-a3c6-90945c9385f0"}]': finished 2024-08-19T00:08:35.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:35 smithi116 ceph-mon[21873]: osdmap e54: 9 total, 8 up, 9 in 2024-08-19T00:08:35.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:35 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-19T00:08:35.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:35 smithi044 ceph-mon[18489]: pgmap v160: 1 pgs: 1 unknown; 577 KiB data, 364 MiB used, 715 GiB / 715 GiB avail 2024-08-19T00:08:35.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:35 smithi044 ceph-mon[18489]: osdmap e53: 8 total, 8 up, 8 in 2024-08-19T00:08:35.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:35 smithi044 ceph-mon[18489]: from='client.? 172.21.15.171:0/3650537022' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c5121f70-e423-4f86-a3c6-90945c9385f0"}]: dispatch 2024-08-19T00:08:35.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:35 smithi044 ceph-mon[18489]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c5121f70-e423-4f86-a3c6-90945c9385f0"}]: dispatch 2024-08-19T00:08:35.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:35 smithi044 ceph-mon[18489]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c5121f70-e423-4f86-a3c6-90945c9385f0"}]': finished 2024-08-19T00:08:35.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:35 smithi044 ceph-mon[18489]: osdmap e54: 9 total, 8 up, 9 in 2024-08-19T00:08:35.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:35 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-19T00:08:36.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:36 smithi171 ceph-mon[21810]: from='client.? 172.21.15.171:0/1664663483' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-19T00:08:37.075 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:36 smithi044 ceph-mon[18489]: from='client.? 172.21.15.171:0/1664663483' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-19T00:08:37.076 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:36 smithi116 ceph-mon[21873]: from='client.? 172.21.15.171:0/1664663483' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-19T00:08:37.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:37 smithi171 ceph-mon[21810]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-08-19T00:08:37.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:37 smithi116 ceph-mon[21873]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-08-19T00:08:37.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:37 smithi044 ceph-mon[18489]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-08-19T00:08:39.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:39 smithi171 ceph-mon[21810]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-08-19T00:08:39.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:39 smithi116 ceph-mon[21873]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-08-19T00:08:39.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:39 smithi044 ceph-mon[18489]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-08-19T00:08:41.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:41 smithi171 ceph-mon[21810]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-08-19T00:08:41.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:41 smithi116 ceph-mon[21873]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-08-19T00:08:41.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:41 smithi044 ceph-mon[18489]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-08-19T00:08:42.586 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:42 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-08-19T00:08:42.586 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:42 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:08:42.586 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:42 smithi171 ceph-mon[21810]: Deploying daemon osd.8 on smithi171 2024-08-19T00:08:42.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:42 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-08-19T00:08:42.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:42 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:08:42.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:42 smithi116 ceph-mon[21873]: Deploying daemon osd.8 on smithi171 2024-08-19T00:08:42.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:42 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-08-19T00:08:42.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:42 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:08:42.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:42 smithi044 ceph-mon[18489]: Deploying daemon osd.8 on smithi171 2024-08-19T00:08:43.590 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:43 smithi171 ceph-mon[21810]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-08-19T00:08:43.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:43 smithi116 ceph-mon[21873]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-08-19T00:08:43.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:43 smithi044 ceph-mon[18489]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-08-19T00:08:45.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:45 smithi171 ceph-mon[21810]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-08-19T00:08:45.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:45 smithi116 ceph-mon[21873]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-08-19T00:08:45.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:45 smithi044 ceph-mon[18489]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-08-19T00:08:47.800 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:47 smithi171 ceph-mon[21810]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-08-19T00:08:47.801 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:47 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:08:47.801 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:47 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:47.801 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:47 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:47.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:47 smithi116 ceph-mon[21873]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-08-19T00:08:47.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:47 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:08:47.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:47 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:47.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:47 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:47.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:47 smithi044 ceph-mon[18489]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-08-19T00:08:47.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:47 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:08:47.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:47 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:47.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:47 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:49.818 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:49 smithi171 ceph-mon[21810]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-08-19T00:08:49.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:49 smithi116 ceph-mon[21873]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-08-19T00:08:49.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:49 smithi044 ceph-mon[18489]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-08-19T00:08:50.832 INFO:teuthology.orchestra.run.smithi171.stdout:Created osd(s) 8 on host 'smithi171' 2024-08-19T00:08:50.833 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:08:50.830+0000 7ff6627fc640 1 -- 172.21.15.171:0/3816794279 <== mgr.14150 v2:172.21.15.44:6800/1330072146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff66c062360 con 0x7ff6580a2c30 2024-08-19T00:08:50.835 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:08:50.833+0000 7ff673819640 1 -- 172.21.15.171:0/3816794279 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7ff6580a2c30 msgr2=0x7ff6580a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:08:50.835 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:08:50.833+0000 7ff673819640 1 --2- 172.21.15.171:0/3816794279 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7ff6580a2c30 0x7ff6580a50f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff668006010 tx=0x7ff668032dd0 comp rx=0 tx=0).stop 2024-08-19T00:08:50.835 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:08:50.833+0000 7ff673819640 1 -- 172.21.15.171:0/3816794279 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff66c102b30 msgr2=0x7ff66c1980c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:08:50.835 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:08:50.833+0000 7ff673819640 1 --2- 172.21.15.171:0/3816794279 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff66c102b30 0x7ff66c1980c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff65c00c920 tx=0x7ff65c00cde0 comp rx=0 tx=0).stop 2024-08-19T00:08:50.835 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:08:50.833+0000 7ff673819640 1 -- 172.21.15.171:0/3816794279 shutdown_connections 2024-08-19T00:08:50.835 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:08:50.833+0000 7ff673819640 1 --2- 172.21.15.171:0/3816794279 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7ff6580a2c30 0x7ff6580a50f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:08:50.835 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:08:50.833+0000 7ff673819640 1 --2- 172.21.15.171:0/3816794279 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff66c102b30 0x7ff66c1980c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:08:50.835 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:08:50.833+0000 7ff673819640 1 --2- 172.21.15.171:0/3816794279 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff66c1034f0 0x7ff66c19f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:08:50.836 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:08:50.833+0000 7ff673819640 1 --2- 172.21.15.171:0/3816794279 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff66c101930 0x7ff66c197b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:08:50.836 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:08:50.833+0000 7ff673819640 1 -- 172.21.15.171:0/3816794279 >> 172.21.15.171:0/3816794279 conn(0x7ff66c0fd0c0 msgr2=0x7ff66c105eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:08:50.836 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:08:50.833+0000 7ff673819640 1 -- 172.21.15.171:0/3816794279 shutdown_connections 2024-08-19T00:08:50.836 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:08:50.833+0000 7ff673819640 1 -- 172.21.15.171:0/3816794279 wait complete. 2024-08-19T00:08:51.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:51 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:51.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:51 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:51.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:51 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:08:51.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:51 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:08:51.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:51 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:51.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:51 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:08:51.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:51 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:51.093 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:51 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:51.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:51 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:51.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:51 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:51.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:51 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:08:51.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:51 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:08:51.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:51 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:51.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:51 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:08:51.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:51 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:51.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:51 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:51.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:51 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:51.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:51 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:51.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:51 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:08:51.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:51 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:08:51.370 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:51 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:51.370 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:51 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:08:51.370 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:51 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:51.370 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:51 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:51.483 DEBUG:teuthology.orchestra.run.smithi171:osd.8> sudo journalctl -f -n 0 -u ceph-647ded64-5dbe-11ef-bccf-c7b262605968@osd.8.service 2024-08-19T00:08:51.486 INFO:tasks.cephadm:Deploying osd.9 on smithi044 with /dev/vg_nvme/lv_1... 2024-08-19T00:08:51.486 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-08-19T00:08:51.757 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:08:52.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:52 smithi171 ceph-mon[21810]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-08-19T00:08:52.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:52 smithi171 ceph-mon[21810]: from='osd.8 [v2:172.21.15.171:6816/843701060,v1:172.21.15.171:6817/843701060]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-08-19T00:08:52.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:52 smithi171 ceph-mon[21810]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-08-19T00:08:52.202 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:52 smithi044 ceph-mon[18489]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-08-19T00:08:52.203 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:52 smithi044 ceph-mon[18489]: from='osd.8 [v2:172.21.15.171:6816/843701060,v1:172.21.15.171:6817/843701060]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-08-19T00:08:52.203 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:52 smithi044 ceph-mon[18489]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-08-19T00:08:52.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:52 smithi116 ceph-mon[21873]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-08-19T00:08:52.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:52 smithi116 ceph-mon[21873]: from='osd.8 [v2:172.21.15.171:6816/843701060,v1:172.21.15.171:6817/843701060]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-08-19T00:08:52.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:52 smithi116 ceph-mon[21873]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-08-19T00:08:53.166 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:53 smithi044 ceph-mon[18489]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-08-19T00:08:53.166 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:53 smithi044 ceph-mon[18489]: osdmap e55: 9 total, 8 up, 9 in 2024-08-19T00:08:53.166 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:53 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-19T00:08:53.167 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:53 smithi044 ceph-mon[18489]: from='osd.8 [v2:172.21.15.171:6816/843701060,v1:172.21.15.171:6817/843701060]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-08-19T00:08:53.167 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:53 smithi044 ceph-mon[18489]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-08-19T00:08:53.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:53 smithi171 ceph-mon[21810]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-08-19T00:08:53.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:53 smithi171 ceph-mon[21810]: osdmap e55: 9 total, 8 up, 9 in 2024-08-19T00:08:53.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:53 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-19T00:08:53.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:53 smithi171 ceph-mon[21810]: from='osd.8 [v2:172.21.15.171:6816/843701060,v1:172.21.15.171:6817/843701060]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-08-19T00:08:53.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:53 smithi171 ceph-mon[21810]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-08-19T00:08:53.343 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:08:53 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:08:53.036+0000 7f8d43e90640 -1 osd.8 0 waiting for initial osdmap 2024-08-19T00:08:53.343 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:08:53 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:08:53.048+0000 7f8d3fcb8640 -1 osd.8 56 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-19T00:08:53.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:53 smithi116 ceph-mon[21873]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-08-19T00:08:53.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:53 smithi116 ceph-mon[21873]: osdmap e55: 9 total, 8 up, 9 in 2024-08-19T00:08:53.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:53 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-19T00:08:53.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:53 smithi116 ceph-mon[21873]: from='osd.8 [v2:172.21.15.171:6816/843701060,v1:172.21.15.171:6817/843701060]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-08-19T00:08:53.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:53 smithi116 ceph-mon[21873]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-08-19T00:08:54.285 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:54 smithi171 ceph-mon[21810]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-08-19T00:08:54.285 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:54 smithi171 ceph-mon[21810]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]': finished 2024-08-19T00:08:54.285 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:54 smithi171 ceph-mon[21810]: osdmap e56: 9 total, 8 up, 9 in 2024-08-19T00:08:54.285 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:54 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-19T00:08:54.285 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:54 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-19T00:08:54.285 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:54 smithi171 ceph-mon[21810]: osd.8 [v2:172.21.15.171:6816/843701060,v1:172.21.15.171:6817/843701060] boot 2024-08-19T00:08:54.285 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:54 smithi171 ceph-mon[21810]: osdmap e57: 9 total, 9 up, 9 in 2024-08-19T00:08:54.285 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:54 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-19T00:08:54.351 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:54 smithi044 ceph-mon[18489]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-08-19T00:08:54.351 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:54 smithi044 ceph-mon[18489]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]': finished 2024-08-19T00:08:54.352 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:54 smithi044 ceph-mon[18489]: osdmap e56: 9 total, 8 up, 9 in 2024-08-19T00:08:54.352 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:54 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-19T00:08:54.352 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:54 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-19T00:08:54.352 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:54 smithi044 ceph-mon[18489]: osd.8 [v2:172.21.15.171:6816/843701060,v1:172.21.15.171:6817/843701060] boot 2024-08-19T00:08:54.352 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:54 smithi044 ceph-mon[18489]: osdmap e57: 9 total, 9 up, 9 in 2024-08-19T00:08:54.352 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:54 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-19T00:08:54.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:54 smithi116 ceph-mon[21873]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-08-19T00:08:54.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:54 smithi116 ceph-mon[21873]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]': finished 2024-08-19T00:08:54.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:54 smithi116 ceph-mon[21873]: osdmap e56: 9 total, 8 up, 9 in 2024-08-19T00:08:54.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:54 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-19T00:08:54.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:54 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-19T00:08:54.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:54 smithi116 ceph-mon[21873]: osd.8 [v2:172.21.15.171:6816/843701060,v1:172.21.15.171:6817/843701060] boot 2024-08-19T00:08:54.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:54 smithi116 ceph-mon[21873]: osdmap e57: 9 total, 9 up, 9 in 2024-08-19T00:08:54.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:54 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-19T00:08:54.519 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:08:54.546 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi044:vg_nvme/lv_1 2024-08-19T00:08:54.815 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:08:55.204 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:55 smithi044 ceph-mon[18489]: purged_snaps scrub starts 2024-08-19T00:08:55.204 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:55 smithi044 ceph-mon[18489]: purged_snaps scrub ok 2024-08-19T00:08:55.204 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:55 smithi044 ceph-mon[18489]: Detected new or changed devices on smithi171 2024-08-19T00:08:55.204 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:55 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:55.204 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:55 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:55.204 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:55 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:08:55.205 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:55 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:08:55.205 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:55 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:08:55.205 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:55 smithi044 ceph-mon[18489]: Adjusting osd_memory_target on smithi171 to 5696M 2024-08-19T00:08:55.205 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:55 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:55.205 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:55 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:08:55.205 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:55 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:08:55.205 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:55 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:55.205 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:55 smithi044 ceph-mon[18489]: osdmap e58: 9 total, 9 up, 9 in 2024-08-19T00:08:55.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:08:55.288+0000 7f0de14ea640 1 -- 172.21.15.44:0/1004142970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ddc1023c0 msgr2=0x7f0ddc108c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:08:55.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:08:55.288+0000 7f0de14ea640 1 --2- 172.21.15.44:0/1004142970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ddc1023c0 0x7f0ddc108c50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0dd4009ca0 tx=0x7f0dd402a8c0 comp rx=0 tx=0).stop 2024-08-19T00:08:55.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:08:55.288+0000 7f0de14ea640 1 -- 172.21.15.44:0/1004142970 shutdown_connections 2024-08-19T00:08:55.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:08:55.288+0000 7f0de14ea640 1 --2- 172.21.15.44:0/1004142970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ddc1023c0 0x7f0ddc108c50 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:08:55.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:08:55.288+0000 7f0de14ea640 1 --2- 172.21.15.44:0/1004142970 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ddc101a00 0x7f0ddc101e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:08:55.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:08:55.288+0000 7f0de14ea640 1 --2- 172.21.15.44:0/1004142970 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ddc100800 0x7f0ddc100c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:08:55.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:08:55.288+0000 7f0de14ea640 1 -- 172.21.15.44:0/1004142970 >> 172.21.15.44:0/1004142970 conn(0x7f0ddc0fbfb0 msgr2=0x7f0ddc0fe3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:08:55.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:08:55.288+0000 7f0de14ea640 1 -- 172.21.15.44:0/1004142970 shutdown_connections 2024-08-19T00:08:55.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:08:55.288+0000 7f0de14ea640 1 -- 172.21.15.44:0/1004142970 wait complete. 2024-08-19T00:08:55.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:08:55.289+0000 7f0de14ea640 1 Processor -- start 2024-08-19T00:08:55.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:08:55.289+0000 7f0de14ea640 1 -- start start 2024-08-19T00:08:55.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:08:55.289+0000 7f0de14ea640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ddc100800 0x7f0ddc197c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:08:55.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:08:55.289+0000 7f0de14ea640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ddc101a00 0x7f0ddc198150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:08:55.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:08:55.289+0000 7f0de14ea640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ddc1023c0 0x7f0ddc19f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:08:55.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:08:55.289+0000 7f0de14ea640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0ddc10c480 con 0x7f0ddc100800 2024-08-19T00:08:55.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:08:55.289+0000 7f0de14ea640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f0ddc10c300 con 0x7f0ddc101a00 2024-08-19T00:08:55.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:08:55.289+0000 7f0de14ea640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0ddc10c600 con 0x7f0ddc1023c0 2024-08-19T00:08:55.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:08:55.289+0000 7f0ddaffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ddc100800 0x7f0ddc197c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:08:55.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:08:55.289+0000 7f0ddaffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ddc100800 0x7f0ddc197c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35150/0 (socket says 172.21.15.44:35150) 2024-08-19T00:08:55.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:08:55.289+0000 7f0ddaffd640 1 -- 172.21.15.44:0/1858683484 learned_addr learned my addr 172.21.15.44:0/1858683484 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:08:55.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:08:55.290+0000 7f0dd3fff640 1 --2- 172.21.15.44:0/1858683484 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ddc101a00 0x7f0ddc198150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:08:55.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:08:55.290+0000 7f0ddaffd640 1 -- 172.21.15.44:0/1858683484 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ddc1023c0 msgr2=0x7f0ddc19f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:08:55.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:08:55.290+0000 7f0ddaffd640 1 --2- 172.21.15.44:0/1858683484 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ddc1023c0 0x7f0ddc19f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:08:55.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:08:55.290+0000 7f0ddaffd640 1 -- 172.21.15.44:0/1858683484 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ddc101a00 msgr2=0x7f0ddc198150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:08:55.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:08:55.290+0000 7f0ddaffd640 1 --2- 172.21.15.44:0/1858683484 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ddc101a00 0x7f0ddc198150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:08:55.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:08:55.290+0000 7f0ddaffd640 1 -- 172.21.15.44:0/1858683484 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ddc19f830 con 0x7f0ddc100800 2024-08-19T00:08:55.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:08:55.290+0000 7f0ddaffd640 1 --2- 172.21.15.44:0/1858683484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ddc100800 0x7f0ddc197c10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc00d950 tx=0x7f0dcc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:08:55.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:08:55.290+0000 7f0dd8ff9640 1 -- 172.21.15.44:0/1858683484 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc017070 con 0x7f0ddc100800 2024-08-19T00:08:55.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:08:55.290+0000 7f0dd8ff9640 1 -- 172.21.15.44:0/1858683484 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0dcc009c30 con 0x7f0ddc100800 2024-08-19T00:08:55.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:08:55.290+0000 7f0dd8ff9640 1 -- 172.21.15.44:0/1858683484 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc00f600 con 0x7f0ddc100800 2024-08-19T00:08:55.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:08:55.290+0000 7f0de14ea640 1 -- 172.21.15.44:0/1858683484 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ddc19fb20 con 0x7f0ddc100800 2024-08-19T00:08:55.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:08:55.290+0000 7f0de14ea640 1 -- 172.21.15.44:0/1858683484 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ddc1a0010 con 0x7f0ddc100800 2024-08-19T00:08:55.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:08:55.292+0000 7f0de14ea640 1 -- 172.21.15.44:0/1858683484 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ddc1a02a0 con 0x7f0ddc100800 2024-08-19T00:08:55.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:08:55.292+0000 7f0dd8ff9640 1 -- 172.21.15.44:0/1858683484 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f0dcc01a070 con 0x7f0ddc100800 2024-08-19T00:08:55.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:08:55.293+0000 7f0dd8ff9640 1 --2- 172.21.15.44:0/1858683484 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f0dc80a2b80 0x7f0dc80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:08:55.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:08:55.293+0000 7f0dd3fff640 1 --2- 172.21.15.44:0/1858683484 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f0dc80a2b80 0x7f0dc80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:08:55.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:08:55.293+0000 7f0dd8ff9640 1 -- 172.21.15.44:0/1858683484 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5858+0+0 (secure 0 0 0) 0x7f0dcc0ce1f0 con 0x7f0ddc100800 2024-08-19T00:08:55.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:08:55.294+0000 7f0dd3fff640 1 --2- 172.21.15.44:0/1858683484 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f0dc80a2b80 0x7f0dc80a5040 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0dc4005fd0 tx=0x7f0dc4005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:08:55.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:08:55.297+0000 7f0dd8ff9640 1 -- 172.21.15.44:0/1858683484 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f0dcc009de0 con 0x7f0ddc100800 2024-08-19T00:08:55.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:55 smithi171 ceph-mon[21810]: purged_snaps scrub starts 2024-08-19T00:08:55.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:55 smithi171 ceph-mon[21810]: purged_snaps scrub ok 2024-08-19T00:08:55.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:55 smithi171 ceph-mon[21810]: Detected new or changed devices on smithi171 2024-08-19T00:08:55.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:55 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:55.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:55 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:55.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:55 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:08:55.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:55 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:08:55.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:55 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:08:55.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:55 smithi171 ceph-mon[21810]: Adjusting osd_memory_target on smithi171 to 5696M 2024-08-19T00:08:55.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:55 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:55.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:55 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:08:55.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:55 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:08:55.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:55 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:55.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:55 smithi171 ceph-mon[21810]: osdmap e58: 9 total, 9 up, 9 in 2024-08-19T00:08:55.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:55 smithi116 ceph-mon[21873]: purged_snaps scrub starts 2024-08-19T00:08:55.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:55 smithi116 ceph-mon[21873]: purged_snaps scrub ok 2024-08-19T00:08:55.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:55 smithi116 ceph-mon[21873]: Detected new or changed devices on smithi171 2024-08-19T00:08:55.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:55 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:55.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:55 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:55.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:55 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:08:55.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:55 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:08:55.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:55 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:08:55.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:55 smithi116 ceph-mon[21873]: Adjusting osd_memory_target on smithi171 to 5696M 2024-08-19T00:08:55.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:55 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:55.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:55 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:08:55.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:55 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:08:55.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:55 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:08:55.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:55 smithi116 ceph-mon[21873]: osdmap e58: 9 total, 9 up, 9 in 2024-08-19T00:08:55.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:08:55.526+0000 7f0de14ea640 1 -- 172.21.15.44:0/1858683484 --> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f0ddc06a400 con 0x7f0dc80a2b80 2024-08-19T00:08:56.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:56 smithi171 ceph-mon[21810]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 804 GiB / 805 GiB avail 2024-08-19T00:08:56.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:56 smithi171 ceph-mon[21810]: osdmap e59: 9 total, 9 up, 9 in 2024-08-19T00:08:56.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:56 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-19T00:08:56.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:56 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-19T00:08:56.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:56 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:08:56.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:56 smithi116 ceph-mon[21873]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 804 GiB / 805 GiB avail 2024-08-19T00:08:56.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:56 smithi116 ceph-mon[21873]: osdmap e59: 9 total, 9 up, 9 in 2024-08-19T00:08:56.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:56 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-19T00:08:56.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:56 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-19T00:08:56.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:56 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:08:56.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:56 smithi044 ceph-mon[18489]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 280 MiB used, 804 GiB / 805 GiB avail 2024-08-19T00:08:56.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:56 smithi044 ceph-mon[18489]: osdmap e59: 9 total, 9 up, 9 in 2024-08-19T00:08:56.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:56 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-19T00:08:56.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:56 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-19T00:08:56.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:56 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:08:57.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:57 smithi171 ceph-mon[21810]: from='client.14412 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:08:57.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:57 smithi171 ceph-mon[21810]: osdmap e60: 9 total, 9 up, 9 in 2024-08-19T00:08:57.598 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:57 smithi044 ceph-mon[18489]: from='client.14412 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:08:57.598 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:57 smithi044 ceph-mon[18489]: osdmap e60: 9 total, 9 up, 9 in 2024-08-19T00:08:57.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:57 smithi116 ceph-mon[21873]: from='client.14412 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:08:57.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:57 smithi116 ceph-mon[21873]: osdmap e60: 9 total, 9 up, 9 in 2024-08-19T00:08:58.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:58 smithi116 ceph-mon[21873]: pgmap v178: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-08-19T00:08:58.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:58 smithi116 ceph-mon[21873]: osdmap e61: 9 total, 9 up, 9 in 2024-08-19T00:08:58.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:58 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/1866163290' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cd13693a-0f25-47cc-b1a5-9c42481935ce"}]: dispatch 2024-08-19T00:08:58.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:58 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/1866163290' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cd13693a-0f25-47cc-b1a5-9c42481935ce"}]': finished 2024-08-19T00:08:58.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:58 smithi116 ceph-mon[21873]: osdmap e62: 10 total, 9 up, 10 in 2024-08-19T00:08:58.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:58 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-19T00:08:58.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:58 smithi044 ceph-mon[18489]: pgmap v178: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-08-19T00:08:58.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:58 smithi044 ceph-mon[18489]: osdmap e61: 9 total, 9 up, 9 in 2024-08-19T00:08:58.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:58 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/1866163290' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cd13693a-0f25-47cc-b1a5-9c42481935ce"}]: dispatch 2024-08-19T00:08:58.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:58 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/1866163290' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cd13693a-0f25-47cc-b1a5-9c42481935ce"}]': finished 2024-08-19T00:08:58.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:58 smithi044 ceph-mon[18489]: osdmap e62: 10 total, 9 up, 10 in 2024-08-19T00:08:58.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:58 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-19T00:08:58.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:58 smithi171 ceph-mon[21810]: pgmap v178: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-08-19T00:08:58.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:58 smithi171 ceph-mon[21810]: osdmap e61: 9 total, 9 up, 9 in 2024-08-19T00:08:58.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:58 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/1866163290' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cd13693a-0f25-47cc-b1a5-9c42481935ce"}]: dispatch 2024-08-19T00:08:58.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:58 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/1866163290' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cd13693a-0f25-47cc-b1a5-9c42481935ce"}]': finished 2024-08-19T00:08:58.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:58 smithi171 ceph-mon[21810]: osdmap e62: 10 total, 9 up, 10 in 2024-08-19T00:08:58.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:58 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-19T00:08:59.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:08:59 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/174282925' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-19T00:08:59.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:08:59 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/174282925' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-19T00:08:59.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:08:59 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/174282925' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-19T00:09:00.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:00 smithi116 ceph-mon[21873]: pgmap v182: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail; 147 KiB/s, 0 objects/s recovering 2024-08-19T00:09:00.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:00 smithi044 ceph-mon[18489]: pgmap v182: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail; 147 KiB/s, 0 objects/s recovering 2024-08-19T00:09:00.731 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:00 smithi171 ceph-mon[21810]: pgmap v182: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail; 147 KiB/s, 0 objects/s recovering 2024-08-19T00:09:02.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:02 smithi116 ceph-mon[21873]: pgmap v183: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 282 MiB used, 804 GiB / 805 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-08-19T00:09:02.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:02 smithi044 ceph-mon[18489]: pgmap v183: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 282 MiB used, 804 GiB / 805 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-08-19T00:09:02.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:02 smithi171 ceph-mon[21810]: pgmap v183: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 282 MiB used, 804 GiB / 805 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-08-19T00:09:04.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:04 smithi116 ceph-mon[21873]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-08-19T00:09:04.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:04 smithi044 ceph-mon[18489]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-08-19T00:09:04.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:04 smithi171 ceph-mon[21810]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-08-19T00:09:05.617 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:05 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-08-19T00:09:05.618 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:05 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:09:05.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:05 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-08-19T00:09:05.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:05 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:09:05.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:05 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-08-19T00:09:05.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:05 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:09:06.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:06 smithi116 ceph-mon[21873]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-08-19T00:09:06.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:06 smithi116 ceph-mon[21873]: Deploying daemon osd.9 on smithi044 2024-08-19T00:09:06.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:06 smithi044 ceph-mon[18489]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-08-19T00:09:06.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:06 smithi044 ceph-mon[18489]: Deploying daemon osd.9 on smithi044 2024-08-19T00:09:06.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:06 smithi171 ceph-mon[21810]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-08-19T00:09:06.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:06 smithi171 ceph-mon[21810]: Deploying daemon osd.9 on smithi044 2024-08-19T00:09:08.604 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:08 smithi044 ceph-mon[18489]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-08-19T00:09:08.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:08 smithi171 ceph-mon[21810]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-08-19T00:09:08.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:08 smithi116 ceph-mon[21873]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-08-19T00:09:10.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:10 smithi044 ceph-mon[18489]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-08-19T00:09:10.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:10 smithi171 ceph-mon[21810]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-08-19T00:09:10.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:10 smithi116 ceph-mon[21873]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-08-19T00:09:11.440 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:11 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:09:11.441 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:11 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:11.441 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:11 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:11.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:11 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:09:11.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:11 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:11.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:11 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:11.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:11 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:09:11.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:11 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:11.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:11 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:12.583 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:12 smithi044 ceph-mon[18489]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-08-19T00:09:12.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:12 smithi171 ceph-mon[21810]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-08-19T00:09:12.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:12 smithi116 ceph-mon[21873]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-08-19T00:09:13.818 INFO:teuthology.orchestra.run.smithi044.stdout:Created osd(s) 9 on host 'smithi044' 2024-08-19T00:09:13.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:13.817+0000 7f0dd8ff9640 1 -- 172.21.15.44:0/1858683484 <== mgr.14150 v2:172.21.15.44:6800/1330072146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f0ddc06a400 con 0x7f0dc80a2b80 2024-08-19T00:09:13.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:13.819+0000 7f0de14ea640 1 -- 172.21.15.44:0/1858683484 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f0dc80a2b80 msgr2=0x7f0dc80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:09:13.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:13.819+0000 7f0de14ea640 1 --2- 172.21.15.44:0/1858683484 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f0dc80a2b80 0x7f0dc80a5040 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0dc4005fd0 tx=0x7f0dc4005850 comp rx=0 tx=0).stop 2024-08-19T00:09:13.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:13.819+0000 7f0de14ea640 1 -- 172.21.15.44:0/1858683484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ddc100800 msgr2=0x7f0ddc197c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:09:13.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:13.819+0000 7f0de14ea640 1 --2- 172.21.15.44:0/1858683484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ddc100800 0x7f0ddc197c10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc00d950 tx=0x7f0dcc00de10 comp rx=0 tx=0).stop 2024-08-19T00:09:13.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:13.819+0000 7f0de14ea640 1 -- 172.21.15.44:0/1858683484 shutdown_connections 2024-08-19T00:09:13.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:13.819+0000 7f0de14ea640 1 --2- 172.21.15.44:0/1858683484 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f0dc80a2b80 0x7f0dc80a5040 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:09:13.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:13.819+0000 7f0de14ea640 1 --2- 172.21.15.44:0/1858683484 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ddc1023c0 0x7f0ddc19f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:09:13.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:13.819+0000 7f0de14ea640 1 --2- 172.21.15.44:0/1858683484 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ddc101a00 0x7f0ddc198150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:09:13.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:13.819+0000 7f0de14ea640 1 --2- 172.21.15.44:0/1858683484 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ddc100800 0x7f0ddc197c10 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:09:13.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:13.819+0000 7f0de14ea640 1 -- 172.21.15.44:0/1858683484 >> 172.21.15.44:0/1858683484 conn(0x7f0ddc0fbfb0 msgr2=0x7f0ddc069cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:09:13.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:13.819+0000 7f0de14ea640 1 -- 172.21.15.44:0/1858683484 shutdown_connections 2024-08-19T00:09:13.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:13.819+0000 7f0de14ea640 1 -- 172.21.15.44:0/1858683484 wait complete. 2024-08-19T00:09:14.468 DEBUG:teuthology.orchestra.run.smithi044:osd.9> sudo journalctl -f -n 0 -u ceph-647ded64-5dbe-11ef-bccf-c7b262605968@osd.9.service 2024-08-19T00:09:14.470 INFO:tasks.cephadm:Deploying osd.10 on smithi116 with /dev/vg_nvme/lv_1... 2024-08-19T00:09:14.470 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-08-19T00:09:14.734 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.b/config 2024-08-19T00:09:14.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:14 smithi171 ceph-mon[21810]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-08-19T00:09:14.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:14 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:14.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:14 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:14.856 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:14 smithi116 ceph-mon[21873]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-08-19T00:09:14.856 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:14 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:14.856 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:14 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:14.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:14 smithi044 ceph-mon[18489]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-08-19T00:09:14.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:14 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:14.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:14 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:15.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:15 smithi116 ceph-mon[21873]: from='osd.9 [v2:172.21.15.44:6826/3206550013,v1:172.21.15.44:6827/3206550013]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-08-19T00:09:15.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:15 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:15.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:15 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:15.792 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:15 smithi044 ceph-mon[18489]: from='osd.9 [v2:172.21.15.44:6826/3206550013,v1:172.21.15.44:6827/3206550013]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-08-19T00:09:15.792 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:15 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:15.792 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:15 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:15.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:15 smithi171 ceph-mon[21810]: from='osd.9 [v2:172.21.15.44:6826/3206550013,v1:172.21.15.44:6827/3206550013]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-08-19T00:09:15.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:15 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:15.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:15 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:16.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:16 smithi116 ceph-mon[21873]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-08-19T00:09:16.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:16 smithi116 ceph-mon[21873]: from='osd.9 [v2:172.21.15.44:6826/3206550013,v1:172.21.15.44:6827/3206550013]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-08-19T00:09:16.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:16 smithi116 ceph-mon[21873]: osdmap e63: 10 total, 9 up, 10 in 2024-08-19T00:09:16.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:16 smithi116 ceph-mon[21873]: from='osd.9 [v2:172.21.15.44:6826/3206550013,v1:172.21.15.44:6827/3206550013]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-08-19T00:09:16.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:16 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-19T00:09:16.799 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:16 smithi044 ceph-mon[18489]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-08-19T00:09:16.799 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:16 smithi044 ceph-mon[18489]: from='osd.9 [v2:172.21.15.44:6826/3206550013,v1:172.21.15.44:6827/3206550013]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-08-19T00:09:16.799 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:16 smithi044 ceph-mon[18489]: osdmap e63: 10 total, 9 up, 10 in 2024-08-19T00:09:16.799 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:16 smithi044 ceph-mon[18489]: from='osd.9 [v2:172.21.15.44:6826/3206550013,v1:172.21.15.44:6827/3206550013]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-08-19T00:09:16.799 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:16 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-19T00:09:16.800 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:09:16 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:09:16.395+0000 7f55a5f7a640 -1 osd.9 0 waiting for initial osdmap 2024-08-19T00:09:16.800 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:09:16 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:09:16.413+0000 7f55a1da2640 -1 osd.9 64 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-19T00:09:16.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:16 smithi171 ceph-mon[21810]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-08-19T00:09:16.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:16 smithi171 ceph-mon[21810]: from='osd.9 [v2:172.21.15.44:6826/3206550013,v1:172.21.15.44:6827/3206550013]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-08-19T00:09:16.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:16 smithi171 ceph-mon[21810]: osdmap e63: 10 total, 9 up, 10 in 2024-08-19T00:09:16.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:16 smithi171 ceph-mon[21810]: from='osd.9 [v2:172.21.15.44:6826/3206550013,v1:172.21.15.44:6827/3206550013]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-08-19T00:09:16.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:16 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-19T00:09:17.107 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-08-19T00:09:17.132 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi116:vg_nvme/lv_1 2024-08-19T00:09:17.393 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.b/config 2024-08-19T00:09:17.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:17 smithi044 ceph-mon[18489]: from='osd.9 [v2:172.21.15.44:6826/3206550013,v1:172.21.15.44:6827/3206550013]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-08-19T00:09:17.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:17 smithi044 ceph-mon[18489]: osdmap e64: 10 total, 9 up, 10 in 2024-08-19T00:09:17.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:17 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-19T00:09:17.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:17 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-19T00:09:17.691 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:17 smithi116 ceph-mon[21873]: from='osd.9 [v2:172.21.15.44:6826/3206550013,v1:172.21.15.44:6827/3206550013]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-08-19T00:09:17.691 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:17 smithi116 ceph-mon[21873]: osdmap e64: 10 total, 9 up, 10 in 2024-08-19T00:09:17.691 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:17 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-19T00:09:17.691 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:17 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-19T00:09:17.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:17 smithi171 ceph-mon[21810]: from='osd.9 [v2:172.21.15.44:6826/3206550013,v1:172.21.15.44:6827/3206550013]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-08-19T00:09:17.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:17 smithi171 ceph-mon[21810]: osdmap e64: 10 total, 9 up, 10 in 2024-08-19T00:09:17.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:17 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-19T00:09:17.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:17 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-19T00:09:17.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:09:17.898+0000 7feb3512d640 1 -- 172.21.15.116:0/1304432023 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feb30102450 msgr2=0x7feb30104840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:09:17.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:09:17.898+0000 7feb3512d640 1 --2- 172.21.15.116:0/1304432023 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feb30102450 0x7feb30104840 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7feb20009900 tx=0x7feb2002a410 comp rx=0 tx=0).stop 2024-08-19T00:09:17.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:09:17.898+0000 7feb3512d640 1 -- 172.21.15.116:0/1304432023 shutdown_connections 2024-08-19T00:09:17.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:09:17.898+0000 7feb3512d640 1 --2- 172.21.15.116:0/1304432023 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feb30104d80 0x7feb30107170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:09:17.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:09:17.898+0000 7feb3512d640 1 --2- 172.21.15.116:0/1304432023 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb301076b0 0x7feb30109aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:09:17.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:09:17.898+0000 7feb3512d640 1 --2- 172.21.15.116:0/1304432023 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feb30102450 0x7feb30104840 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:09:17.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:09:17.898+0000 7feb3512d640 1 -- 172.21.15.116:0/1304432023 >> 172.21.15.116:0/1304432023 conn(0x7feb300fbfb0 msgr2=0x7feb300fe3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:09:17.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:09:17.898+0000 7feb3512d640 1 -- 172.21.15.116:0/1304432023 shutdown_connections 2024-08-19T00:09:17.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:09:17.898+0000 7feb3512d640 1 -- 172.21.15.116:0/1304432023 wait complete. 2024-08-19T00:09:17.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:09:17.899+0000 7feb3512d640 1 Processor -- start 2024-08-19T00:09:17.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:09:17.899+0000 7feb3512d640 1 -- start start 2024-08-19T00:09:17.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:09:17.899+0000 7feb3512d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feb30102450 0x7feb30197ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:09:17.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:09:17.899+0000 7feb3512d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb30104d80 0x7feb301981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:09:17.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:09:17.899+0000 7feb3512d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feb301076b0 0x7feb3019f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:09:17.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:09:17.899+0000 7feb3512d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7feb3010d5c0 con 0x7feb30104d80 2024-08-19T00:09:17.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:09:17.899+0000 7feb3512d640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7feb3010d440 con 0x7feb301076b0 2024-08-19T00:09:17.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:09:17.899+0000 7feb3512d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7feb3010d740 con 0x7feb30102450 2024-08-19T00:09:17.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:09:17.899+0000 7feb27fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb30104d80 0x7feb301981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:09:17.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:09:17.899+0000 7feb2f59e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feb301076b0 0x7feb3019f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:09:17.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:09:17.899+0000 7feb27fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb30104d80 0x7feb301981e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.116:37836/0 (socket says 172.21.15.116:37836) 2024-08-19T00:09:17.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:09:17.899+0000 7feb27fff640 1 -- 172.21.15.116:0/2338768097 learned_addr learned my addr 172.21.15.116:0/2338768097 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-08-19T00:09:17.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:09:17.899+0000 7feb2f59e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feb301076b0 0x7feb3019f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:41980/0 (socket says 172.21.15.116:41980) 2024-08-19T00:09:17.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:09:17.900+0000 7feb2ed9d640 1 --2- 172.21.15.116:0/2338768097 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feb30102450 0x7feb30197ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:09:17.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:09:17.900+0000 7feb2f59e640 1 -- 172.21.15.116:0/2338768097 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feb30102450 msgr2=0x7feb30197ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:09:17.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:09:17.900+0000 7feb2f59e640 1 --2- 172.21.15.116:0/2338768097 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feb30102450 0x7feb30197ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:09:17.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:09:17.900+0000 7feb2f59e640 1 -- 172.21.15.116:0/2338768097 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb30104d80 msgr2=0x7feb301981e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:09:17.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:09:17.900+0000 7feb2f59e640 1 --2- 172.21.15.116:0/2338768097 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb30104d80 0x7feb301981e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:09:17.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:09:17.900+0000 7feb2f59e640 1 -- 172.21.15.116:0/2338768097 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb3019f8c0 con 0x7feb301076b0 2024-08-19T00:09:17.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:09:17.900+0000 7feb27fff640 1 --2- 172.21.15.116:0/2338768097 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb30104d80 0x7feb301981e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:09:17.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:09:17.900+0000 7feb2f59e640 1 --2- 172.21.15.116:0/2338768097 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feb301076b0 0x7feb3019f250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7feb2800da10 tx=0x7feb2800ded0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:09:17.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:09:17.900+0000 7feb2cd99640 1 -- 172.21.15.116:0/2338768097 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb2800bd70 con 0x7feb301076b0 2024-08-19T00:09:17.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:09:17.900+0000 7feb3512d640 1 -- 172.21.15.116:0/2338768097 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb3019fbb0 con 0x7feb301076b0 2024-08-19T00:09:17.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:09:17.900+0000 7feb2cd99640 1 -- 172.21.15.116:0/2338768097 <== mon.2 v2:172.21.15.116:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb28003e50 con 0x7feb301076b0 2024-08-19T00:09:17.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:09:17.900+0000 7feb2cd99640 1 -- 172.21.15.116:0/2338768097 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb280106a0 con 0x7feb301076b0 2024-08-19T00:09:17.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:09:17.900+0000 7feb3512d640 1 -- 172.21.15.116:0/2338768097 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb301a00f0 con 0x7feb301076b0 2024-08-19T00:09:17.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:09:17.901+0000 7feb3512d640 1 -- 172.21.15.116:0/2338768097 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb300fdaa0 con 0x7feb301076b0 2024-08-19T00:09:17.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:09:17.902+0000 7feb2cd99640 1 -- 172.21.15.116:0/2338768097 <== mon.2 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7feb28004b40 con 0x7feb301076b0 2024-08-19T00:09:17.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:09:17.903+0000 7feb2cd99640 1 --2- 172.21.15.116:0/2338768097 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7feb1c0a2b80 0x7feb1c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:09:17.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:09:17.903+0000 7feb2cd99640 1 -- 172.21.15.116:0/2338768097 <== mon.2 v2:172.21.15.116:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6261+0+0 (secure 0 0 0) 0x7feb280ceff0 con 0x7feb301076b0 2024-08-19T00:09:17.912 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:09:17.903+0000 7feb2ed9d640 1 --2- 172.21.15.116:0/2338768097 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7feb1c0a2b80 0x7feb1c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:09:17.912 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:09:17.904+0000 7feb2ed9d640 1 --2- 172.21.15.116:0/2338768097 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7feb1c0a2b80 0x7feb1c0a5040 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7feb20006010 tx=0x7feb200315d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:09:17.912 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:09:17.907+0000 7feb2cd99640 1 -- 172.21.15.116:0/2338768097 <== mon.2 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7feb2809c730 con 0x7feb301076b0 2024-08-19T00:09:18.086 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:09:18.084+0000 7feb3512d640 1 -- 172.21.15.116:0/2338768097 --> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7feb30062360 con 0x7feb1c0a2b80 2024-08-19T00:09:18.607 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:18 smithi116 ceph-mon[21873]: purged_snaps scrub starts 2024-08-19T00:09:18.607 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:18 smithi116 ceph-mon[21873]: purged_snaps scrub ok 2024-08-19T00:09:18.607 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:18 smithi116 ceph-mon[21873]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-08-19T00:09:18.608 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:18 smithi116 ceph-mon[21873]: osd.9 [v2:172.21.15.44:6826/3206550013,v1:172.21.15.44:6827/3206550013] boot 2024-08-19T00:09:18.608 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:18 smithi116 ceph-mon[21873]: osdmap e65: 10 total, 10 up, 10 in 2024-08-19T00:09:18.608 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:18 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-19T00:09:18.608 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:18 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-19T00:09:18.608 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:18 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-19T00:09:18.608 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:18 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:09:18.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:18 smithi044 ceph-mon[18489]: purged_snaps scrub starts 2024-08-19T00:09:18.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:18 smithi044 ceph-mon[18489]: purged_snaps scrub ok 2024-08-19T00:09:18.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:18 smithi044 ceph-mon[18489]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-08-19T00:09:18.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:18 smithi044 ceph-mon[18489]: osd.9 [v2:172.21.15.44:6826/3206550013,v1:172.21.15.44:6827/3206550013] boot 2024-08-19T00:09:18.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:18 smithi044 ceph-mon[18489]: osdmap e65: 10 total, 10 up, 10 in 2024-08-19T00:09:18.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:18 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-19T00:09:18.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:18 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-19T00:09:18.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:18 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-19T00:09:18.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:18 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:09:18.743 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:18 smithi171 ceph-mon[21810]: purged_snaps scrub starts 2024-08-19T00:09:18.744 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:18 smithi171 ceph-mon[21810]: purged_snaps scrub ok 2024-08-19T00:09:18.744 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:18 smithi171 ceph-mon[21810]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 281 MiB used, 804 GiB / 805 GiB avail 2024-08-19T00:09:18.744 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:18 smithi171 ceph-mon[21810]: osd.9 [v2:172.21.15.44:6826/3206550013,v1:172.21.15.44:6827/3206550013] boot 2024-08-19T00:09:18.744 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:18 smithi171 ceph-mon[21810]: osdmap e65: 10 total, 10 up, 10 in 2024-08-19T00:09:18.744 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:18 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-19T00:09:18.744 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:18 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-19T00:09:18.744 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:18 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-19T00:09:18.744 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:18 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:09:19.767 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:19 smithi116 ceph-mon[21873]: from='client.24344 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:09:19.768 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:19 smithi116 ceph-mon[21873]: osdmap e66: 10 total, 10 up, 10 in 2024-08-19T00:09:19.768 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:19 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:19.768 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:19 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:19.768 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:19 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:09:19.768 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:19 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:09:19.768 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:19 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:09:19.768 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:19 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:09:19.768 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:19 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:19.768 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:19 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:09:19.769 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:19 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:09:19.769 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:19 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:19.769 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:19 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:09:19.769 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:19 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:09:19.769 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:19 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:09:19.769 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:19 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:19.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:19 smithi171 ceph-mon[21810]: from='client.24344 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:09:19.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:19 smithi171 ceph-mon[21810]: osdmap e66: 10 total, 10 up, 10 in 2024-08-19T00:09:19.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:19 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:19.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:19 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:19.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:19 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:09:19.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:19 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:09:19.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:19 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:09:19.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:19 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:09:19.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:19 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:19.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:19 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:09:19.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:19 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:09:19.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:19 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:19.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:19 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:09:19.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:19 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:09:19.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:19 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:09:19.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:19 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:19.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:19 smithi044 ceph-mon[18489]: from='client.24344 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:09:19.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:19 smithi044 ceph-mon[18489]: osdmap e66: 10 total, 10 up, 10 in 2024-08-19T00:09:19.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:19 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:19.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:19 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:19.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:19 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:09:19.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:19 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:09:19.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:19 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:09:19.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:19 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:09:19.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:19 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:19.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:19 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:09:19.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:19 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:09:19.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:19 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:19.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:19 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:09:19.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:19 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:09:19.871 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:19 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:09:19.871 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:19 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:20.718 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:20 smithi116 ceph-mon[21873]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-08-19T00:09:20.719 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:20 smithi116 ceph-mon[21873]: Detected new or changed devices on smithi044 2024-08-19T00:09:20.719 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:20 smithi116 ceph-mon[21873]: Adjusting osd_memory_target on smithi044 to 4273M 2024-08-19T00:09:20.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:20 smithi171 ceph-mon[21810]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-08-19T00:09:20.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:20 smithi171 ceph-mon[21810]: Detected new or changed devices on smithi044 2024-08-19T00:09:20.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:20 smithi171 ceph-mon[21810]: Adjusting osd_memory_target on smithi044 to 4273M 2024-08-19T00:09:20.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:20 smithi044 ceph-mon[18489]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-08-19T00:09:20.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:20 smithi044 ceph-mon[18489]: Detected new or changed devices on smithi044 2024-08-19T00:09:20.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:20 smithi044 ceph-mon[18489]: Adjusting osd_memory_target on smithi044 to 4273M 2024-08-19T00:09:21.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:21 smithi171 ceph-mon[21810]: from='client.? 172.21.15.116:0/4142487355' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a36ffeb1-6ecf-4899-bdfa-18515afefb86"}]: dispatch 2024-08-19T00:09:21.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:21 smithi171 ceph-mon[21810]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a36ffeb1-6ecf-4899-bdfa-18515afefb86"}]: dispatch 2024-08-19T00:09:21.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:21 smithi171 ceph-mon[21810]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a36ffeb1-6ecf-4899-bdfa-18515afefb86"}]': finished 2024-08-19T00:09:21.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:21 smithi171 ceph-mon[21810]: osdmap e67: 11 total, 10 up, 11 in 2024-08-19T00:09:21.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:21 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-19T00:09:21.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:21 smithi171 ceph-mon[21810]: from='client.? 172.21.15.116:0/1634913063' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-19T00:09:21.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:21 smithi116 ceph-mon[21873]: from='client.? 172.21.15.116:0/4142487355' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a36ffeb1-6ecf-4899-bdfa-18515afefb86"}]: dispatch 2024-08-19T00:09:21.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:21 smithi116 ceph-mon[21873]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a36ffeb1-6ecf-4899-bdfa-18515afefb86"}]: dispatch 2024-08-19T00:09:21.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:21 smithi116 ceph-mon[21873]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a36ffeb1-6ecf-4899-bdfa-18515afefb86"}]': finished 2024-08-19T00:09:21.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:21 smithi116 ceph-mon[21873]: osdmap e67: 11 total, 10 up, 11 in 2024-08-19T00:09:21.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:21 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-19T00:09:21.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:21 smithi116 ceph-mon[21873]: from='client.? 172.21.15.116:0/1634913063' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-19T00:09:21.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:21 smithi044 ceph-mon[18489]: from='client.? 172.21.15.116:0/4142487355' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a36ffeb1-6ecf-4899-bdfa-18515afefb86"}]: dispatch 2024-08-19T00:09:21.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:21 smithi044 ceph-mon[18489]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a36ffeb1-6ecf-4899-bdfa-18515afefb86"}]: dispatch 2024-08-19T00:09:21.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:21 smithi044 ceph-mon[18489]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a36ffeb1-6ecf-4899-bdfa-18515afefb86"}]': finished 2024-08-19T00:09:21.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:21 smithi044 ceph-mon[18489]: osdmap e67: 11 total, 10 up, 11 in 2024-08-19T00:09:21.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:21 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-19T00:09:21.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:21 smithi044 ceph-mon[18489]: from='client.? 172.21.15.116:0/1634913063' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-19T00:09:22.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:22 smithi171 ceph-mon[21810]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-08-19T00:09:22.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:22 smithi116 ceph-mon[21873]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-08-19T00:09:22.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:22 smithi044 ceph-mon[18489]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-08-19T00:09:24.726 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:24 smithi116 ceph-mon[21873]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-08-19T00:09:24.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:24 smithi171 ceph-mon[21810]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-08-19T00:09:24.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:24 smithi044 ceph-mon[18489]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-08-19T00:09:26.739 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:26 smithi116 ceph-mon[21873]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-08-19T00:09:26.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:26 smithi171 ceph-mon[21810]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-08-19T00:09:26.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:26 smithi044 ceph-mon[18489]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-08-19T00:09:27.832 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:27 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-08-19T00:09:27.832 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:27 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:09:27.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:27 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-08-19T00:09:27.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:27 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:09:27.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:27 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-08-19T00:09:27.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:27 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:09:28.748 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:28 smithi116 ceph-mon[21873]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-08-19T00:09:28.748 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:28 smithi116 ceph-mon[21873]: Deploying daemon osd.10 on smithi116 2024-08-19T00:09:28.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:28 smithi171 ceph-mon[21810]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-08-19T00:09:28.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:28 smithi171 ceph-mon[21810]: Deploying daemon osd.10 on smithi116 2024-08-19T00:09:28.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:28 smithi044 ceph-mon[18489]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-08-19T00:09:28.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:28 smithi044 ceph-mon[18489]: Deploying daemon osd.10 on smithi116 2024-08-19T00:09:29.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:29 smithi116 ceph-mon[21873]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-08-19T00:09:29.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:29 smithi171 ceph-mon[21810]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-08-19T00:09:29.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:29 smithi044 ceph-mon[18489]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-08-19T00:09:31.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:31 smithi171 ceph-mon[21810]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-08-19T00:09:31.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:31 smithi116 ceph-mon[21873]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-08-19T00:09:31.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:31 smithi044 ceph-mon[18489]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-08-19T00:09:32.618 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:32 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:09:32.619 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:32 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:32.619 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:32 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:32.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:32 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:09:32.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:32 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:32.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:32 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:32.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:32 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:09:32.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:32 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:32.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:32 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:34.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:34 smithi171 ceph-mon[21810]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-08-19T00:09:34.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:34 smithi116 ceph-mon[21873]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-08-19T00:09:34.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:34 smithi044 ceph-mon[18489]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-08-19T00:09:35.296 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:09:35.295+0000 7feb2cd99640 1 -- 172.21.15.116:0/2338768097 <== mgr.14150 v2:172.21.15.44:6800/1330072146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7feb30062360 con 0x7feb1c0a2b80 2024-08-19T00:09:35.297 INFO:teuthology.orchestra.run.smithi116.stdout:Created osd(s) 10 on host 'smithi116' 2024-08-19T00:09:35.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:09:35.298+0000 7feb3512d640 1 -- 172.21.15.116:0/2338768097 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7feb1c0a2b80 msgr2=0x7feb1c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:09:35.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:09:35.298+0000 7feb3512d640 1 --2- 172.21.15.116:0/2338768097 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7feb1c0a2b80 0x7feb1c0a5040 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7feb20006010 tx=0x7feb200315d0 comp rx=0 tx=0).stop 2024-08-19T00:09:35.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:09:35.298+0000 7feb3512d640 1 -- 172.21.15.116:0/2338768097 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feb301076b0 msgr2=0x7feb3019f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:09:35.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:09:35.298+0000 7feb3512d640 1 --2- 172.21.15.116:0/2338768097 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feb301076b0 0x7feb3019f250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7feb2800da10 tx=0x7feb2800ded0 comp rx=0 tx=0).stop 2024-08-19T00:09:35.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:09:35.298+0000 7feb3512d640 1 -- 172.21.15.116:0/2338768097 shutdown_connections 2024-08-19T00:09:35.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:09:35.298+0000 7feb3512d640 1 --2- 172.21.15.116:0/2338768097 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7feb1c0a2b80 0x7feb1c0a5040 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:09:35.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:09:35.298+0000 7feb3512d640 1 --2- 172.21.15.116:0/2338768097 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feb301076b0 0x7feb3019f250 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:09:35.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:09:35.298+0000 7feb3512d640 1 --2- 172.21.15.116:0/2338768097 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb30104d80 0x7feb301981e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:09:35.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:09:35.298+0000 7feb3512d640 1 --2- 172.21.15.116:0/2338768097 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feb30102450 0x7feb30197ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:09:35.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:09:35.298+0000 7feb3512d640 1 -- 172.21.15.116:0/2338768097 >> 172.21.15.116:0/2338768097 conn(0x7feb300fbfb0 msgr2=0x7feb30102dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:09:35.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:09:35.298+0000 7feb3512d640 1 -- 172.21.15.116:0/2338768097 shutdown_connections 2024-08-19T00:09:35.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-08-19T00:09:35.298+0000 7feb3512d640 1 -- 172.21.15.116:0/2338768097 wait complete. 2024-08-19T00:09:36.212 DEBUG:teuthology.orchestra.run.smithi116:osd.10> sudo journalctl -f -n 0 -u ceph-647ded64-5dbe-11ef-bccf-c7b262605968@osd.10.service 2024-08-19T00:09:36.215 INFO:tasks.cephadm:Deploying osd.11 on smithi171 with /dev/vg_nvme/lv_1... 2024-08-19T00:09:36.215 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-08-19T00:09:36.477 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.c/config 2024-08-19T00:09:36.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:36 smithi171 ceph-mon[21810]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-08-19T00:09:36.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:36 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:36.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:36 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:36.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:36 smithi116 ceph-mon[21873]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-08-19T00:09:36.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:36 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:36.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:36 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:36.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:09:36 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:09:36.330+0000 7f483e351640 -1 osd.10 0 log_to_monitors true 2024-08-19T00:09:36.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:36 smithi044 ceph-mon[18489]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-08-19T00:09:36.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:36 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:36.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:36 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:37.504 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:37 smithi116 ceph-mon[21873]: from='osd.10 [v2:172.21.15.116:6824/3034738363,v1:172.21.15.116:6825/3034738363]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-08-19T00:09:37.505 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:37 smithi116 ceph-mon[21873]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-08-19T00:09:37.505 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:37 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:37.505 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:37 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:37.585 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:37 smithi171 ceph-mon[21810]: from='osd.10 [v2:172.21.15.116:6824/3034738363,v1:172.21.15.116:6825/3034738363]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-08-19T00:09:37.585 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:37 smithi171 ceph-mon[21810]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-08-19T00:09:37.585 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:37 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:37.585 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:37 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:37.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:37 smithi044 ceph-mon[18489]: from='osd.10 [v2:172.21.15.116:6824/3034738363,v1:172.21.15.116:6825/3034738363]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-08-19T00:09:37.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:37 smithi044 ceph-mon[18489]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-08-19T00:09:37.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:37 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:37.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:37 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:38.462 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:38 smithi116 ceph-mon[21873]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-08-19T00:09:38.462 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:38 smithi116 ceph-mon[21873]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-08-19T00:09:38.463 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:38 smithi116 ceph-mon[21873]: from='osd.10 [v2:172.21.15.116:6824/3034738363,v1:172.21.15.116:6825/3034738363]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-08-19T00:09:38.463 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:38 smithi116 ceph-mon[21873]: osdmap e68: 11 total, 10 up, 11 in 2024-08-19T00:09:38.463 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:38 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-19T00:09:38.463 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:38 smithi116 ceph-mon[21873]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-08-19T00:09:38.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:38 smithi171 ceph-mon[21810]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-08-19T00:09:38.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:38 smithi171 ceph-mon[21810]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-08-19T00:09:38.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:38 smithi171 ceph-mon[21810]: from='osd.10 [v2:172.21.15.116:6824/3034738363,v1:172.21.15.116:6825/3034738363]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-08-19T00:09:38.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:38 smithi171 ceph-mon[21810]: osdmap e68: 11 total, 10 up, 11 in 2024-08-19T00:09:38.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:38 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-19T00:09:38.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:38 smithi171 ceph-mon[21810]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-08-19T00:09:38.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:38 smithi044 ceph-mon[18489]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-08-19T00:09:38.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:38 smithi044 ceph-mon[18489]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-08-19T00:09:38.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:38 smithi044 ceph-mon[18489]: from='osd.10 [v2:172.21.15.116:6824/3034738363,v1:172.21.15.116:6825/3034738363]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-08-19T00:09:38.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:38 smithi044 ceph-mon[18489]: osdmap e68: 11 total, 10 up, 11 in 2024-08-19T00:09:38.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:38 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-19T00:09:38.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:38 smithi044 ceph-mon[18489]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2024-08-19T00:09:38.983 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-19T00:09:39.011 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi171:vg_nvme/lv_1 2024-08-19T00:09:39.272 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.c/config 2024-08-19T00:09:39.309 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:09:39 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:09:38.999+0000 7f483a2d4640 -1 osd.10 0 waiting for initial osdmap 2024-08-19T00:09:39.309 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:09:39 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:09:39.010+0000 7f48320f4640 -1 osd.10 70 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-19T00:09:39.559 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:39 smithi116 ceph-mon[21873]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-08-19T00:09:39.560 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:39 smithi116 ceph-mon[21873]: osdmap e69: 11 total, 10 up, 11 in 2024-08-19T00:09:39.560 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:39 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-19T00:09:39.560 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:39 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-19T00:09:39.560 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:39 smithi116 ceph-mon[21873]: osdmap e70: 11 total, 10 up, 11 in 2024-08-19T00:09:39.560 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:39 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-19T00:09:39.560 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:39 smithi116 ceph-mon[21873]: from='osd.10 ' entity='osd.10' 2024-08-19T00:09:39.560 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:39 smithi171 ceph-mon[21810]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-08-19T00:09:39.560 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:39 smithi171 ceph-mon[21810]: osdmap e69: 11 total, 10 up, 11 in 2024-08-19T00:09:39.560 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:39 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-19T00:09:39.560 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:39 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-19T00:09:39.561 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:39 smithi171 ceph-mon[21810]: osdmap e70: 11 total, 10 up, 11 in 2024-08-19T00:09:39.561 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:39 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-19T00:09:39.561 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:39 smithi171 ceph-mon[21810]: from='osd.10 ' entity='osd.10' 2024-08-19T00:09:39.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:39 smithi044 ceph-mon[18489]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2024-08-19T00:09:39.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:39 smithi044 ceph-mon[18489]: osdmap e69: 11 total, 10 up, 11 in 2024-08-19T00:09:39.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:39 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-19T00:09:39.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:39 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-19T00:09:39.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:39 smithi044 ceph-mon[18489]: osdmap e70: 11 total, 10 up, 11 in 2024-08-19T00:09:39.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:39 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-19T00:09:39.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:39 smithi044 ceph-mon[18489]: from='osd.10 ' entity='osd.10' 2024-08-19T00:09:39.910 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:09:39.877+0000 7f74fe17d640 1 -- 172.21.15.171:0/2631163605 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74f81023c0 msgr2=0x7f74f8108c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:09:39.910 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:09:39.877+0000 7f74fe17d640 1 --2- 172.21.15.171:0/2631163605 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74f81023c0 0x7f74f8108c50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f74f0009ca0 tx=0x7f74f002a8c0 comp rx=0 tx=0).stop 2024-08-19T00:09:39.910 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:09:39.877+0000 7f74fe17d640 1 -- 172.21.15.171:0/2631163605 shutdown_connections 2024-08-19T00:09:39.910 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:09:39.877+0000 7f74fe17d640 1 --2- 172.21.15.171:0/2631163605 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74f81023c0 0x7f74f8108c50 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:09:39.910 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:09:39.877+0000 7f74fe17d640 1 --2- 172.21.15.171:0/2631163605 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f74f8101a00 0x7f74f8101e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:09:39.910 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:09:39.877+0000 7f74fe17d640 1 --2- 172.21.15.171:0/2631163605 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f74f8100800 0x7f74f8100c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:09:39.910 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:09:39.877+0000 7f74fe17d640 1 -- 172.21.15.171:0/2631163605 >> 172.21.15.171:0/2631163605 conn(0x7f74f80fbfb0 msgr2=0x7f74f80fe3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:09:39.910 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:09:39.878+0000 7f74fe17d640 1 -- 172.21.15.171:0/2631163605 shutdown_connections 2024-08-19T00:09:39.910 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:09:39.878+0000 7f74fe17d640 1 -- 172.21.15.171:0/2631163605 wait complete. 2024-08-19T00:09:39.910 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:09:39.878+0000 7f74fe17d640 1 Processor -- start 2024-08-19T00:09:39.911 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:09:39.878+0000 7f74fe17d640 1 -- start start 2024-08-19T00:09:39.911 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:09:39.878+0000 7f74fe17d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f74f8100800 0x7f74f806a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:09:39.911 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:09:39.878+0000 7f74fe17d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74f8101a00 0x7f74f819c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:09:39.911 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:09:39.878+0000 7f74fe17d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f74f81023c0 0x7f74f819ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:09:39.911 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:09:39.878+0000 7f74fe17d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f74f810c480 con 0x7f74f8100800 2024-08-19T00:09:39.911 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:09:39.878+0000 7f74fe17d640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f74f810c300 con 0x7f74f81023c0 2024-08-19T00:09:39.911 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:09:39.878+0000 7f74fe17d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f74f810c600 con 0x7f74f8101a00 2024-08-19T00:09:39.911 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:09:39.879+0000 7f74eeffd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74f8101a00 0x7f74f819c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:09:39.911 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:09:39.879+0000 7f74eeffd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74f8101a00 0x7f74f819c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:55508/0 (socket says 172.21.15.171:55508) 2024-08-19T00:09:39.911 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:09:39.879+0000 7f74f77fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f74f8100800 0x7f74f806a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:09:39.911 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:09:39.879+0000 7f74f7fff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f74f81023c0 0x7f74f819ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:09:39.911 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:09:39.879+0000 7f74eeffd640 1 -- 172.21.15.171:0/985754193 learned_addr learned my addr 172.21.15.171:0/985754193 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-08-19T00:09:39.912 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:09:39.879+0000 7f74f7fff640 1 -- 172.21.15.171:0/985754193 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74f8101a00 msgr2=0x7f74f819c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:09:39.912 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:09:39.879+0000 7f74f7fff640 1 --2- 172.21.15.171:0/985754193 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74f8101a00 0x7f74f819c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:09:39.912 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:09:39.879+0000 7f74f7fff640 1 -- 172.21.15.171:0/985754193 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f74f8100800 msgr2=0x7f74f806a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:09:39.912 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:09:39.879+0000 7f74f7fff640 1 --2- 172.21.15.171:0/985754193 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f74f8100800 0x7f74f806a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:09:39.912 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:09:39.879+0000 7f74f7fff640 1 -- 172.21.15.171:0/985754193 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74f819f830 con 0x7f74f81023c0 2024-08-19T00:09:39.912 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:09:39.879+0000 7f74eeffd640 1 --2- 172.21.15.171:0/985754193 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74f8101a00 0x7f74f819c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:09:39.912 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:09:39.879+0000 7f74f7fff640 1 --2- 172.21.15.171:0/985754193 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f74f81023c0 0x7f74f819ef20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f74f0031ae0 tx=0x7f74f0031ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:09:39.912 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:09:39.879+0000 7f74f57fa640 1 -- 172.21.15.171:0/985754193 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f0003c30 con 0x7f74f81023c0 2024-08-19T00:09:39.912 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:09:39.879+0000 7f74fe17d640 1 -- 172.21.15.171:0/985754193 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74f819fa60 con 0x7f74f81023c0 2024-08-19T00:09:39.912 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:09:39.879+0000 7f74fe17d640 1 -- 172.21.15.171:0/985754193 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74f819ffc0 con 0x7f74f81023c0 2024-08-19T00:09:39.912 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:09:39.880+0000 7f74fe17d640 1 -- 172.21.15.171:0/985754193 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74f8107b50 con 0x7f74f81023c0 2024-08-19T00:09:39.912 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:09:39.881+0000 7f74f57fa640 1 -- 172.21.15.171:0/985754193 <== mon.2 v2:172.21.15.116:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f74f0036020 con 0x7f74f81023c0 2024-08-19T00:09:39.912 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:09:39.881+0000 7f74f57fa640 1 -- 172.21.15.171:0/985754193 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f002f900 con 0x7f74f81023c0 2024-08-19T00:09:39.913 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:09:39.883+0000 7f74f57fa640 1 -- 172.21.15.171:0/985754193 <== mon.2 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f74f0004050 con 0x7f74f81023c0 2024-08-19T00:09:39.913 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:09:39.883+0000 7f74f57fa640 1 --2- 172.21.15.171:0/985754193 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f74e40a2b80 0x7f74e40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:09:39.913 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:09:39.884+0000 7f74f57fa640 1 -- 172.21.15.171:0/985754193 <== mon.2 v2:172.21.15.116:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6727+0+0 (secure 0 0 0) 0x7f74f00efbf0 con 0x7f74f81023c0 2024-08-19T00:09:39.913 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:09:39.884+0000 7f74f77fe640 1 --2- 172.21.15.171:0/985754193 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f74e40a2b80 0x7f74e40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:09:39.913 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:09:39.884+0000 7f74f77fe640 1 --2- 172.21.15.171:0/985754193 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f74e40a2b80 0x7f74e40a5040 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f74f8101860 tx=0x7f74e8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:09:39.913 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:09:39.886+0000 7f74f57fa640 1 -- 172.21.15.171:0/985754193 <== mon.2 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f74f00bd0e0 con 0x7f74f81023c0 2024-08-19T00:09:40.071 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:09:40.069+0000 7f74fe17d640 1 -- 172.21.15.171:0/985754193 --> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f74f8062360 con 0x7f74e40a2b80 2024-08-19T00:09:40.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:40 smithi171 ceph-mon[21810]: purged_snaps scrub starts 2024-08-19T00:09:40.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:40 smithi171 ceph-mon[21810]: purged_snaps scrub ok 2024-08-19T00:09:40.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:40 smithi171 ceph-mon[21810]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-08-19T00:09:40.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:40 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-19T00:09:40.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:40 smithi171 ceph-mon[21810]: osd.10 [v2:172.21.15.116:6824/3034738363,v1:172.21.15.116:6825/3034738363] boot 2024-08-19T00:09:40.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:40 smithi171 ceph-mon[21810]: osdmap e71: 11 total, 11 up, 11 in 2024-08-19T00:09:40.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:40 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-19T00:09:40.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:40 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:40.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:40 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:40.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:40 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:09:40.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:40 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:09:40.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:40 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:09:40.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:40 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:09:40.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:40 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:40.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:40 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:09:40.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:40 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:09:40.594 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:40 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:40.594 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:40 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:09:40.594 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:40 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:09:40.594 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:40 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:09:40.594 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:40 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:40.594 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:40 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-19T00:09:40.594 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:40 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-19T00:09:40.594 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:40 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:09:40.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:40 smithi116 ceph-mon[21873]: purged_snaps scrub starts 2024-08-19T00:09:40.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:40 smithi116 ceph-mon[21873]: purged_snaps scrub ok 2024-08-19T00:09:40.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:40 smithi116 ceph-mon[21873]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-08-19T00:09:40.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:40 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-19T00:09:40.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:40 smithi116 ceph-mon[21873]: osd.10 [v2:172.21.15.116:6824/3034738363,v1:172.21.15.116:6825/3034738363] boot 2024-08-19T00:09:40.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:40 smithi116 ceph-mon[21873]: osdmap e71: 11 total, 11 up, 11 in 2024-08-19T00:09:40.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:40 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-19T00:09:40.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:40 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:40.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:40 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:40.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:40 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:09:40.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:40 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:09:40.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:40 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:09:40.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:40 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:09:40.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:40 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:40.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:40 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:09:40.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:40 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:09:40.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:40 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:40.617 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:40 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:09:40.617 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:40 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:09:40.617 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:40 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:09:40.617 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:40 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:40.617 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:40 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-19T00:09:40.617 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:40 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-19T00:09:40.617 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:40 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:09:40.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:40 smithi044 ceph-mon[18489]: purged_snaps scrub starts 2024-08-19T00:09:40.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:40 smithi044 ceph-mon[18489]: purged_snaps scrub ok 2024-08-19T00:09:40.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:40 smithi044 ceph-mon[18489]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 309 MiB used, 894 GiB / 894 GiB avail 2024-08-19T00:09:40.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:40 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-19T00:09:40.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:40 smithi044 ceph-mon[18489]: osd.10 [v2:172.21.15.116:6824/3034738363,v1:172.21.15.116:6825/3034738363] boot 2024-08-19T00:09:40.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:40 smithi044 ceph-mon[18489]: osdmap e71: 11 total, 11 up, 11 in 2024-08-19T00:09:40.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:40 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-19T00:09:40.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:40 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:40.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:40 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:40.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:40 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:09:40.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:40 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:09:40.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:40 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:09:40.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:40 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:09:40.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:40 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:40.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:40 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:09:40.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:40 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:09:40.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:40 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:40.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:40 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:09:40.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:40 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:09:40.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:40 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:09:40.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:40 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:40.621 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:40 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-19T00:09:40.621 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:40 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-19T00:09:40.621 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:40 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:09:41.429 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:41 smithi171 ceph-mon[21810]: Detected new or changed devices on smithi116 2024-08-19T00:09:41.429 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:41 smithi171 ceph-mon[21810]: Adjusting osd_memory_target on smithi116 to 4272M 2024-08-19T00:09:41.429 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:41 smithi171 ceph-mon[21810]: from='client.24371 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:09:41.429 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:41 smithi171 ceph-mon[21810]: osdmap e72: 11 total, 11 up, 11 in 2024-08-19T00:09:41.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:41 smithi116 ceph-mon[21873]: Detected new or changed devices on smithi116 2024-08-19T00:09:41.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:41 smithi116 ceph-mon[21873]: Adjusting osd_memory_target on smithi116 to 4272M 2024-08-19T00:09:41.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:41 smithi116 ceph-mon[21873]: from='client.24371 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:09:41.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:41 smithi116 ceph-mon[21873]: osdmap e72: 11 total, 11 up, 11 in 2024-08-19T00:09:41.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:41 smithi044 ceph-mon[18489]: Detected new or changed devices on smithi116 2024-08-19T00:09:41.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:41 smithi044 ceph-mon[18489]: Adjusting osd_memory_target on smithi116 to 4272M 2024-08-19T00:09:41.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:41 smithi044 ceph-mon[18489]: from='client.24371 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:09:41.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:41 smithi044 ceph-mon[18489]: osdmap e72: 11 total, 11 up, 11 in 2024-08-19T00:09:42.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:42 smithi171 ceph-mon[21810]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-08-19T00:09:42.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:42 smithi171 ceph-mon[21810]: osdmap e73: 11 total, 11 up, 11 in 2024-08-19T00:09:42.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:42 smithi116 ceph-mon[21873]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-08-19T00:09:42.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:42 smithi116 ceph-mon[21873]: osdmap e73: 11 total, 11 up, 11 in 2024-08-19T00:09:42.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:42 smithi044 ceph-mon[18489]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-08-19T00:09:42.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:42 smithi044 ceph-mon[18489]: osdmap e73: 11 total, 11 up, 11 in 2024-08-19T00:09:43.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:43 smithi171 ceph-mon[21810]: from='client.? 172.21.15.171:0/187661729' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ffcf44a8-3094-4a29-822e-a6ce95da119e"}]: dispatch 2024-08-19T00:09:43.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:43 smithi171 ceph-mon[21810]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ffcf44a8-3094-4a29-822e-a6ce95da119e"}]: dispatch 2024-08-19T00:09:43.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:43 smithi171 ceph-mon[21810]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ffcf44a8-3094-4a29-822e-a6ce95da119e"}]': finished 2024-08-19T00:09:43.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:43 smithi171 ceph-mon[21810]: osdmap e74: 12 total, 11 up, 12 in 2024-08-19T00:09:43.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:43 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-19T00:09:43.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:43 smithi171 ceph-mon[21810]: from='client.? 172.21.15.171:0/3706839904' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-19T00:09:43.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:43 smithi116 ceph-mon[21873]: from='client.? 172.21.15.171:0/187661729' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ffcf44a8-3094-4a29-822e-a6ce95da119e"}]: dispatch 2024-08-19T00:09:43.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:43 smithi116 ceph-mon[21873]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ffcf44a8-3094-4a29-822e-a6ce95da119e"}]: dispatch 2024-08-19T00:09:43.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:43 smithi116 ceph-mon[21873]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ffcf44a8-3094-4a29-822e-a6ce95da119e"}]': finished 2024-08-19T00:09:43.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:43 smithi116 ceph-mon[21873]: osdmap e74: 12 total, 11 up, 12 in 2024-08-19T00:09:43.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:43 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-19T00:09:43.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:43 smithi116 ceph-mon[21873]: from='client.? 172.21.15.171:0/3706839904' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-19T00:09:43.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:43 smithi044 ceph-mon[18489]: from='client.? 172.21.15.171:0/187661729' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ffcf44a8-3094-4a29-822e-a6ce95da119e"}]: dispatch 2024-08-19T00:09:43.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:43 smithi044 ceph-mon[18489]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ffcf44a8-3094-4a29-822e-a6ce95da119e"}]: dispatch 2024-08-19T00:09:43.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:43 smithi044 ceph-mon[18489]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ffcf44a8-3094-4a29-822e-a6ce95da119e"}]': finished 2024-08-19T00:09:43.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:43 smithi044 ceph-mon[18489]: osdmap e74: 12 total, 11 up, 12 in 2024-08-19T00:09:43.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:43 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-19T00:09:43.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:43 smithi044 ceph-mon[18489]: from='client.? 172.21.15.171:0/3706839904' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-19T00:09:44.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:44 smithi171 ceph-mon[21810]: pgmap v216: 1 pgs: 1 remapped+peering; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-08-19T00:09:44.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:44 smithi171 ceph-mon[21810]: osdmap e75: 12 total, 11 up, 12 in 2024-08-19T00:09:44.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:44 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-19T00:09:44.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:44 smithi116 ceph-mon[21873]: pgmap v216: 1 pgs: 1 remapped+peering; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-08-19T00:09:44.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:44 smithi116 ceph-mon[21873]: osdmap e75: 12 total, 11 up, 12 in 2024-08-19T00:09:44.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:44 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-19T00:09:44.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:44 smithi044 ceph-mon[18489]: pgmap v216: 1 pgs: 1 remapped+peering; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-08-19T00:09:44.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:44 smithi044 ceph-mon[18489]: osdmap e75: 12 total, 11 up, 12 in 2024-08-19T00:09:44.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:44 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-19T00:09:46.701 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:46 smithi171 ceph-mon[21810]: pgmap v218: 1 pgs: 1 remapped+peering; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-08-19T00:09:46.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:46 smithi116 ceph-mon[21873]: pgmap v218: 1 pgs: 1 remapped+peering; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-08-19T00:09:46.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:46 smithi044 ceph-mon[18489]: pgmap v218: 1 pgs: 1 remapped+peering; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-08-19T00:09:47.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:47 smithi171 ceph-mon[21810]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-08-19T00:09:47.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:47 smithi116 ceph-mon[21873]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-08-19T00:09:47.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:47 smithi044 ceph-mon[18489]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-08-19T00:09:49.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:49 smithi171 ceph-mon[21810]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 983 GiB / 983 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-08-19T00:09:49.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:49 smithi116 ceph-mon[21873]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 983 GiB / 983 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-08-19T00:09:49.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:49 smithi044 ceph-mon[18489]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 983 GiB / 983 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-08-19T00:09:50.723 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:50 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-08-19T00:09:50.723 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:50 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:09:50.723 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:50 smithi171 ceph-mon[21810]: Deploying daemon osd.11 on smithi171 2024-08-19T00:09:50.862 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:50 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-08-19T00:09:50.862 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:50 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:09:50.862 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:50 smithi116 ceph-mon[21873]: Deploying daemon osd.11 on smithi171 2024-08-19T00:09:50.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:50 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-08-19T00:09:50.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:50 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:09:50.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:50 smithi044 ceph-mon[18489]: Deploying daemon osd.11 on smithi171 2024-08-19T00:09:51.586 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:51 smithi171 ceph-mon[21810]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-19T00:09:51.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:51 smithi116 ceph-mon[21873]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-19T00:09:51.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:51 smithi044 ceph-mon[18489]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-19T00:09:53.536 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:53 smithi171 ceph-mon[21810]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-19T00:09:53.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:53 smithi116 ceph-mon[21873]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-19T00:09:53.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:53 smithi044 ceph-mon[18489]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-19T00:09:55.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:55 smithi171 ceph-mon[21810]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-08-19T00:09:55.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:55 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:09:55.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:55 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:55.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:55 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:55.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:55 smithi116 ceph-mon[21873]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-08-19T00:09:55.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:55 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:09:55.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:55 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:55.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:55 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:55.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:55 smithi044 ceph-mon[18489]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-08-19T00:09:55.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:55 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:09:55.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:55 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:55.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:55 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:57.826 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:57 smithi171 ceph-mon[21810]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-19T00:09:57.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:57 smithi116 ceph-mon[21873]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-19T00:09:57.866 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:09:57.864+0000 7f74f57fa640 1 -- 172.21.15.171:0/985754193 <== mgr.14150 v2:172.21.15.44:6800/1330072146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f74f8062360 con 0x7f74e40a2b80 2024-08-19T00:09:57.866 INFO:teuthology.orchestra.run.smithi171.stdout:Created osd(s) 11 on host 'smithi171' 2024-08-19T00:09:57.868 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:09:57.866+0000 7f74fe17d640 1 -- 172.21.15.171:0/985754193 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f74e40a2b80 msgr2=0x7f74e40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:09:57.868 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:09:57.866+0000 7f74fe17d640 1 --2- 172.21.15.171:0/985754193 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f74e40a2b80 0x7f74e40a5040 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f74f8101860 tx=0x7f74e8005f90 comp rx=0 tx=0).stop 2024-08-19T00:09:57.868 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:09:57.866+0000 7f74fe17d640 1 -- 172.21.15.171:0/985754193 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f74f81023c0 msgr2=0x7f74f819ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:09:57.868 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:09:57.866+0000 7f74fe17d640 1 --2- 172.21.15.171:0/985754193 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f74f81023c0 0x7f74f819ef20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f74f0031ae0 tx=0x7f74f0031ee0 comp rx=0 tx=0).stop 2024-08-19T00:09:57.868 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:09:57.867+0000 7f74fe17d640 1 -- 172.21.15.171:0/985754193 shutdown_connections 2024-08-19T00:09:57.868 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:09:57.867+0000 7f74fe17d640 1 --2- 172.21.15.171:0/985754193 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f74e40a2b80 0x7f74e40a5040 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:09:57.868 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:09:57.867+0000 7f74fe17d640 1 --2- 172.21.15.171:0/985754193 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f74f8101a00 0x7f74f819c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:09:57.868 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:09:57.867+0000 7f74fe17d640 1 --2- 172.21.15.171:0/985754193 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f74f81023c0 0x7f74f819ef20 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:09:57.868 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:09:57.867+0000 7f74fe17d640 1 --2- 172.21.15.171:0/985754193 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f74f8100800 0x7f74f806a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:09:57.868 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:09:57.867+0000 7f74fe17d640 1 -- 172.21.15.171:0/985754193 >> 172.21.15.171:0/985754193 conn(0x7f74f80fbfb0 msgr2=0x7f74f8104d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:09:57.868 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:09:57.867+0000 7f74fe17d640 1 -- 172.21.15.171:0/985754193 shutdown_connections 2024-08-19T00:09:57.869 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:09:57.867+0000 7f74fe17d640 1 -- 172.21.15.171:0/985754193 wait complete. 2024-08-19T00:09:57.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:57 smithi044 ceph-mon[18489]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-19T00:09:58.872 DEBUG:teuthology.orchestra.run.smithi171:osd.11> sudo journalctl -f -n 0 -u ceph-647ded64-5dbe-11ef-bccf-c7b262605968@osd.11.service 2024-08-19T00:09:58.874 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-08-19T00:09:58.874 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph osd stat -f json 2024-08-19T00:09:59.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:58 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:59.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:58 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:59.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:58 smithi116 ceph-mon[21873]: from='osd.11 [v2:172.21.15.171:6824/1500842656,v1:172.21.15.171:6825/1500842656]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-08-19T00:09:59.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:58 smithi116 ceph-mon[21873]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-08-19T00:09:59.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:58 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:59.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:58 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:59.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:58 smithi044 ceph-mon[18489]: from='osd.11 [v2:172.21.15.171:6824/1500842656,v1:172.21.15.171:6825/1500842656]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-08-19T00:09:59.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:58 smithi044 ceph-mon[18489]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-08-19T00:09:59.144 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:09:59.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:58 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:59.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:58 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:59.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:58 smithi171 ceph-mon[21810]: from='osd.11 [v2:172.21.15.171:6824/1500842656,v1:172.21.15.171:6825/1500842656]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-08-19T00:09:59.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:58 smithi171 ceph-mon[21810]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-08-19T00:09:59.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:59.606+0000 7f188d952640 1 -- 172.21.15.44:0/2886083754 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18880ffc00 msgr2=0x7f1888100000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:09:59.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:59.606+0000 7f188d952640 1 --2- 172.21.15.44:0/2886083754 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18880ffc00 0x7f1888100000 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1878009930 tx=0x7f187802a420 comp rx=0 tx=0).stop 2024-08-19T00:09:59.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:59.606+0000 7f188d952640 1 -- 172.21.15.44:0/2886083754 shutdown_connections 2024-08-19T00:09:59.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:59.606+0000 7f188d952640 1 --2- 172.21.15.44:0/2886083754 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f18881035a0 0x7f1888109e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:09:59.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:59.606+0000 7f188d952640 1 --2- 172.21.15.44:0/2886083754 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1888102be0 0x7f1888103060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:09:59.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:59.606+0000 7f188d952640 1 --2- 172.21.15.44:0/2886083754 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18880ffc00 0x7f1888100000 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:09:59.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:59.606+0000 7f188d952640 1 -- 172.21.15.44:0/2886083754 >> 172.21.15.44:0/2886083754 conn(0x7f18880fb770 msgr2=0x7f18880fdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:09:59.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:59.606+0000 7f188d952640 1 -- 172.21.15.44:0/2886083754 shutdown_connections 2024-08-19T00:09:59.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:59.606+0000 7f188d952640 1 -- 172.21.15.44:0/2886083754 wait complete. 2024-08-19T00:09:59.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:59.607+0000 7f188d952640 1 Processor -- start 2024-08-19T00:09:59.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:59.607+0000 7f188d952640 1 -- start start 2024-08-19T00:09:59.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:59.607+0000 7f188d952640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18880ffc00 0x7f1888102540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:09:59.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:59.607+0000 7f188d952640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1888102be0 0x7f1888100b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:09:59.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:59.607+0000 7f188d952640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f18881035a0 0x7f18881010d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:09:59.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:59.607+0000 7f188d952640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f188810d5c0 con 0x7f18880ffc00 2024-08-19T00:09:59.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:59.607+0000 7f188d952640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f188810d440 con 0x7f1888102be0 2024-08-19T00:09:59.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:59.607+0000 7f188d952640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f188810d740 con 0x7f18881035a0 2024-08-19T00:09:59.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:59.607+0000 7f1886ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18880ffc00 0x7f1888102540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:09:59.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:59.607+0000 7f1886ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18880ffc00 0x7f1888102540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49938/0 (socket says 172.21.15.44:49938) 2024-08-19T00:09:59.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:59.607+0000 7f1886ffd640 1 -- 172.21.15.44:0/1098142561 learned_addr learned my addr 172.21.15.44:0/1098142561 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:09:59.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:59.607+0000 7f18867fc640 1 --2- 172.21.15.44:0/1098142561 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1888102be0 0x7f1888100b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:09:59.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:59.608+0000 7f1886ffd640 1 -- 172.21.15.44:0/1098142561 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f18881035a0 msgr2=0x7f18881010d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:09:59.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:59.608+0000 7f1886ffd640 1 --2- 172.21.15.44:0/1098142561 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f18881035a0 0x7f18881010d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:09:59.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:59.608+0000 7f1886ffd640 1 -- 172.21.15.44:0/1098142561 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1888102be0 msgr2=0x7f1888100b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:09:59.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:59.608+0000 7f1886ffd640 1 --2- 172.21.15.44:0/1098142561 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1888102be0 0x7f1888100b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:09:59.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:59.608+0000 7f1886ffd640 1 -- 172.21.15.44:0/1098142561 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1888101990 con 0x7f18880ffc00 2024-08-19T00:09:59.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:59.608+0000 7f1886ffd640 1 --2- 172.21.15.44:0/1098142561 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18880ffc00 0x7f1888102540 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1878009230 tx=0x7f18780042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:09:59.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:59.608+0000 7f188c950640 1 -- 172.21.15.44:0/1098142561 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f187803f030 con 0x7f18880ffc00 2024-08-19T00:09:59.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:59.608+0000 7f188d952640 1 -- 172.21.15.44:0/1098142561 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18881a1db0 con 0x7f18880ffc00 2024-08-19T00:09:59.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:59.608+0000 7f188c950640 1 -- 172.21.15.44:0/1098142561 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1878003ce0 con 0x7f18880ffc00 2024-08-19T00:09:59.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:59.608+0000 7f188c950640 1 -- 172.21.15.44:0/1098142561 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1878035070 con 0x7f18880ffc00 2024-08-19T00:09:59.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:59.608+0000 7f188d952640 1 -- 172.21.15.44:0/1098142561 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18881a21a0 con 0x7f18880ffc00 2024-08-19T00:09:59.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:59.609+0000 7f188d952640 1 -- 172.21.15.44:0/1098142561 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1888108e50 con 0x7f18880ffc00 2024-08-19T00:09:59.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:59.611+0000 7f188c950640 1 -- 172.21.15.44:0/1098142561 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f1878042030 con 0x7f18880ffc00 2024-08-19T00:09:59.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:59.611+0000 7f188c950640 1 --2- 172.21.15.44:0/1098142561 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f18700a2b80 0x7f18700a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:09:59.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:59.612+0000 7f188c950640 1 -- 172.21.15.44:0/1098142561 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6831+0+0 (secure 0 0 0) 0x7f18780ef0b0 con 0x7f18880ffc00 2024-08-19T00:09:59.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:59.612+0000 7f18867fc640 1 --2- 172.21.15.44:0/1098142561 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f18700a2b80 0x7f18700a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:09:59.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:59.612+0000 7f18867fc640 1 --2- 172.21.15.44:0/1098142561 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f18700a2b80 0x7f18700a5040 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f18881022c0 tx=0x7f187c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:09:59.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:59.616+0000 7f188c950640 1 -- 172.21.15.44:0/1098142561 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f18780bc540 con 0x7f18880ffc00 2024-08-19T00:09:59.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:59.793+0000 7f188d952640 1 -- 172.21.15.44:0/1098142561 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f1888062bc0 con 0x7f18880ffc00 2024-08-19T00:09:59.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:59.794+0000 7f188c950640 1 -- 172.21.15.44:0/1098142561 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v76) ==== 74+0+133 (secure 0 0 0) 0x7f18780bbe40 con 0x7f18880ffc00 2024-08-19T00:09:59.796 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:09:59.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:59.796+0000 7f188d952640 1 -- 172.21.15.44:0/1098142561 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f18700a2b80 msgr2=0x7f18700a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:09:59.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:59.796+0000 7f188d952640 1 --2- 172.21.15.44:0/1098142561 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f18700a2b80 0x7f18700a5040 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f18881022c0 tx=0x7f187c00b410 comp rx=0 tx=0).stop 2024-08-19T00:09:59.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:59.796+0000 7f188d952640 1 -- 172.21.15.44:0/1098142561 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18880ffc00 msgr2=0x7f1888102540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:09:59.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:59.796+0000 7f188d952640 1 --2- 172.21.15.44:0/1098142561 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18880ffc00 0x7f1888102540 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1878009230 tx=0x7f18780042f0 comp rx=0 tx=0).stop 2024-08-19T00:09:59.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:59.796+0000 7f188d952640 1 -- 172.21.15.44:0/1098142561 shutdown_connections 2024-08-19T00:09:59.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:59.796+0000 7f188d952640 1 --2- 172.21.15.44:0/1098142561 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f18700a2b80 0x7f18700a5040 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:09:59.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:59.796+0000 7f188d952640 1 --2- 172.21.15.44:0/1098142561 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f18881035a0 0x7f18881010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:09:59.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:59.796+0000 7f188d952640 1 --2- 172.21.15.44:0/1098142561 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1888102be0 0x7f1888100b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:09:59.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:59.796+0000 7f188d952640 1 --2- 172.21.15.44:0/1098142561 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18880ffc00 0x7f1888102540 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:09:59.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:59.796+0000 7f188d952640 1 -- 172.21.15.44:0/1098142561 >> 172.21.15.44:0/1098142561 conn(0x7f18880fb770 msgr2=0x7f1888106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:09:59.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:59.797+0000 7f188d952640 1 -- 172.21.15.44:0/1098142561 shutdown_connections 2024-08-19T00:09:59.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:09:59.797+0000 7f188d952640 1 -- 172.21.15.44:0/1098142561 wait complete. 2024-08-19T00:09:59.931 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:59 smithi171 ceph-mon[21810]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-08-19T00:09:59.931 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:59 smithi171 ceph-mon[21810]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-08-19T00:09:59.931 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:59 smithi171 ceph-mon[21810]: osdmap e76: 12 total, 11 up, 12 in 2024-08-19T00:09:59.931 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:59 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-19T00:09:59.932 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:59 smithi171 ceph-mon[21810]: from='osd.11 [v2:172.21.15.171:6824/1500842656,v1:172.21.15.171:6825/1500842656]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-08-19T00:09:59.932 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:59 smithi171 ceph-mon[21810]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-08-19T00:09:59.932 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:59 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:59.932 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:59 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:09:59.932 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:09:59 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/1098142561' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-08-19T00:10:00.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:59 smithi044 ceph-mon[18489]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-08-19T00:10:00.120 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:59 smithi044 ceph-mon[18489]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-08-19T00:10:00.120 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:59 smithi044 ceph-mon[18489]: osdmap e76: 12 total, 11 up, 12 in 2024-08-19T00:10:00.120 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:59 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-19T00:10:00.120 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:59 smithi044 ceph-mon[18489]: from='osd.11 [v2:172.21.15.171:6824/1500842656,v1:172.21.15.171:6825/1500842656]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-08-19T00:10:00.120 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:59 smithi044 ceph-mon[18489]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-08-19T00:10:00.120 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:59 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:00.120 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:59 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:00.120 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:09:59 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/1098142561' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-08-19T00:10:00.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:59 smithi116 ceph-mon[21873]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-08-19T00:10:00.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:59 smithi116 ceph-mon[21873]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-08-19T00:10:00.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:59 smithi116 ceph-mon[21873]: osdmap e76: 12 total, 11 up, 12 in 2024-08-19T00:10:00.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:59 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-19T00:10:00.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:59 smithi116 ceph-mon[21873]: from='osd.11 [v2:172.21.15.171:6824/1500842656,v1:172.21.15.171:6825/1500842656]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-08-19T00:10:00.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:59 smithi116 ceph-mon[21873]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-08-19T00:10:00.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:59 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:00.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:59 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:00.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:09:59 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/1098142561' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-08-19T00:10:00.679 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":76,"num_osds":12,"num_up_osds":11,"osd_up_since":1724026179,"num_in_osds":12,"osd_in_since":1724026182,"num_remapped_pgs":0} 2024-08-19T00:10:00.791 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:10:00 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:10:00.548+0000 7fdcb4f95640 -1 osd.11 0 waiting for initial osdmap 2024-08-19T00:10:00.791 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:10:00 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:10:00.562+0000 7fdcacdb5640 -1 osd.11 77 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-19T00:10:01.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:00 smithi171 ceph-mon[21810]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]': finished 2024-08-19T00:10:01.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:00 smithi171 ceph-mon[21810]: osdmap e77: 12 total, 11 up, 12 in 2024-08-19T00:10:01.093 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:00 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-19T00:10:01.093 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:00 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-19T00:10:01.093 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:00 smithi171 ceph-mon[21810]: overall HEALTH_OK 2024-08-19T00:10:01.093 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:00 smithi171 ceph-mon[21810]: from='osd.11 ' entity='osd.11' 2024-08-19T00:10:01.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:00 smithi044 ceph-mon[18489]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]': finished 2024-08-19T00:10:01.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:00 smithi044 ceph-mon[18489]: osdmap e77: 12 total, 11 up, 12 in 2024-08-19T00:10:01.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:00 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-19T00:10:01.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:00 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-19T00:10:01.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:00 smithi044 ceph-mon[18489]: overall HEALTH_OK 2024-08-19T00:10:01.120 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:00 smithi044 ceph-mon[18489]: from='osd.11 ' entity='osd.11' 2024-08-19T00:10:01.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:00 smithi116 ceph-mon[21873]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]': finished 2024-08-19T00:10:01.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:00 smithi116 ceph-mon[21873]: osdmap e77: 12 total, 11 up, 12 in 2024-08-19T00:10:01.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:00 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-19T00:10:01.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:00 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-19T00:10:01.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:00 smithi116 ceph-mon[21873]: overall HEALTH_OK 2024-08-19T00:10:01.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:00 smithi116 ceph-mon[21873]: from='osd.11 ' entity='osd.11' 2024-08-19T00:10:01.680 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph osd stat -f json 2024-08-19T00:10:01.948 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:10:02.070 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:01 smithi044 ceph-mon[18489]: purged_snaps scrub starts 2024-08-19T00:10:02.070 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:01 smithi044 ceph-mon[18489]: purged_snaps scrub ok 2024-08-19T00:10:02.071 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:01 smithi044 ceph-mon[18489]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-08-19T00:10:02.071 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:01 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-19T00:10:02.071 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:01 smithi044 ceph-mon[18489]: osd.11 [v2:172.21.15.171:6824/1500842656,v1:172.21.15.171:6825/1500842656] boot 2024-08-19T00:10:02.071 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:01 smithi044 ceph-mon[18489]: osdmap e78: 12 total, 12 up, 12 in 2024-08-19T00:10:02.071 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:01 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-19T00:10:02.194 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:01 smithi171 ceph-mon[21810]: purged_snaps scrub starts 2024-08-19T00:10:02.194 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:01 smithi171 ceph-mon[21810]: purged_snaps scrub ok 2024-08-19T00:10:02.194 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:01 smithi171 ceph-mon[21810]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-08-19T00:10:02.194 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:01 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-19T00:10:02.194 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:01 smithi171 ceph-mon[21810]: osd.11 [v2:172.21.15.171:6824/1500842656,v1:172.21.15.171:6825/1500842656] boot 2024-08-19T00:10:02.194 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:01 smithi171 ceph-mon[21810]: osdmap e78: 12 total, 12 up, 12 in 2024-08-19T00:10:02.194 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:01 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-19T00:10:02.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:01 smithi116 ceph-mon[21873]: purged_snaps scrub starts 2024-08-19T00:10:02.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:01 smithi116 ceph-mon[21873]: purged_snaps scrub ok 2024-08-19T00:10:02.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:01 smithi116 ceph-mon[21873]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-08-19T00:10:02.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:01 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-19T00:10:02.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:01 smithi116 ceph-mon[21873]: osd.11 [v2:172.21.15.171:6824/1500842656,v1:172.21.15.171:6825/1500842656] boot 2024-08-19T00:10:02.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:01 smithi116 ceph-mon[21873]: osdmap e78: 12 total, 12 up, 12 in 2024-08-19T00:10:02.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:01 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-19T00:10:02.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:02.424+0000 7f521e846640 1 -- 172.21.15.44:0/2183770071 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5218101930 msgr2=0x7f5218101d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:02.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:02.424+0000 7f521e846640 1 --2- 172.21.15.44:0/2183770071 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5218101930 0x7f5218101d30 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5208009900 tx=0x7f520802a410 comp rx=0 tx=0).stop 2024-08-19T00:10:02.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:02.424+0000 7f521e846640 1 -- 172.21.15.44:0/2183770071 shutdown_connections 2024-08-19T00:10:02.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:02.424+0000 7f521e846640 1 --2- 172.21.15.44:0/2183770071 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5218102b30 0x7f5218102fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:02.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:02.424+0000 7f521e846640 1 --2- 172.21.15.44:0/2183770071 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f52181034f0 0x7f5218109d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:02.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:02.424+0000 7f521e846640 1 --2- 172.21.15.44:0/2183770071 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5218101930 0x7f5218101d30 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:02.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:02.424+0000 7f521e846640 1 -- 172.21.15.44:0/2183770071 >> 172.21.15.44:0/2183770071 conn(0x7f52180fd0c0 msgr2=0x7f52180ff500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:10:02.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:02.424+0000 7f521e846640 1 -- 172.21.15.44:0/2183770071 shutdown_connections 2024-08-19T00:10:02.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:02.424+0000 7f521e846640 1 -- 172.21.15.44:0/2183770071 wait complete. 2024-08-19T00:10:02.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:02.424+0000 7f521e846640 1 Processor -- start 2024-08-19T00:10:02.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:02.424+0000 7f521e846640 1 -- start start 2024-08-19T00:10:02.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:02.425+0000 7f521e846640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5218101930 0x7f5218075cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:02.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:02.425+0000 7f521e846640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5218102b30 0x7f5218074310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:02.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:02.425+0000 7f521e846640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f52181034f0 0x7f5218074850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:02.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:02.425+0000 7f521e846640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f521810d5b0 con 0x7f5218102b30 2024-08-19T00:10:02.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:02.425+0000 7f521e846640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f521810d430 con 0x7f5218101930 2024-08-19T00:10:02.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:02.425+0000 7f521e846640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f521810d730 con 0x7f52181034f0 2024-08-19T00:10:02.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:02.425+0000 7f52177fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5218102b30 0x7f5218074310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:02.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:02.425+0000 7f52177fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5218102b30 0x7f5218074310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49950/0 (socket says 172.21.15.44:49950) 2024-08-19T00:10:02.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:02.425+0000 7f52177fe640 1 -- 172.21.15.44:0/3932063223 learned_addr learned my addr 172.21.15.44:0/3932063223 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:10:02.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:02.425+0000 7f5217fff640 1 --2- 172.21.15.44:0/3932063223 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5218101930 0x7f5218075cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:02.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:02.425+0000 7f521cde3640 1 --2- 172.21.15.44:0/3932063223 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f52181034f0 0x7f5218074850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:02.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:02.425+0000 7f52177fe640 1 -- 172.21.15.44:0/3932063223 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f52181034f0 msgr2=0x7f5218074850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:02.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:02.425+0000 7f52177fe640 1 --2- 172.21.15.44:0/3932063223 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f52181034f0 0x7f5218074850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:02.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:02.425+0000 7f52177fe640 1 -- 172.21.15.44:0/3932063223 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5218101930 msgr2=0x7f5218075cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:02.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:02.425+0000 7f52177fe640 1 --2- 172.21.15.44:0/3932063223 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5218101930 0x7f5218075cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:02.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:02.425+0000 7f52177fe640 1 -- 172.21.15.44:0/3932063223 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5218075110 con 0x7f5218102b30 2024-08-19T00:10:02.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:02.425+0000 7f52177fe640 1 --2- 172.21.15.44:0/3932063223 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5218102b30 0x7f5218074310 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f520c00d770 tx=0x7f520c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:10:02.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:02.426+0000 7f52157fa640 1 -- 172.21.15.44:0/3932063223 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f520c017070 con 0x7f5218102b30 2024-08-19T00:10:02.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:02.426+0000 7f521e846640 1 -- 172.21.15.44:0/3932063223 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52181a1d90 con 0x7f5218102b30 2024-08-19T00:10:02.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:02.426+0000 7f52157fa640 1 -- 172.21.15.44:0/3932063223 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f520c005500 con 0x7f5218102b30 2024-08-19T00:10:02.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:02.426+0000 7f52157fa640 1 -- 172.21.15.44:0/3932063223 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f520c004e00 con 0x7f5218102b30 2024-08-19T00:10:02.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:02.426+0000 7f521e846640 1 -- 172.21.15.44:0/3932063223 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52181a2240 con 0x7f5218102b30 2024-08-19T00:10:02.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:02.427+0000 7f521e846640 1 -- 172.21.15.44:0/3932063223 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5218108d20 con 0x7f5218102b30 2024-08-19T00:10:02.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:02.428+0000 7f52157fa640 1 -- 172.21.15.44:0/3932063223 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f520c004fa0 con 0x7f5218102b30 2024-08-19T00:10:02.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:02.428+0000 7f52157fa640 1 --2- 172.21.15.44:0/3932063223 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f52000a2b80 0x7f52000a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:02.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:02.429+0000 7f5217fff640 1 --2- 172.21.15.44:0/3932063223 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f52000a2b80 0x7f52000a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:02.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:02.429+0000 7f52157fa640 1 -- 172.21.15.44:0/3932063223 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7127+0+0 (secure 0 0 0) 0x7f520c0ce5c0 con 0x7f5218102b30 2024-08-19T00:10:02.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:02.429+0000 7f5217fff640 1 --2- 172.21.15.44:0/3932063223 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f52000a2b80 0x7f52000a5040 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5208005ab0 tx=0x7f5208000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:10:02.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:02.433+0000 7f52157fa640 1 -- 172.21.15.44:0/3932063223 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f520c09b2d0 con 0x7f5218102b30 2024-08-19T00:10:02.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:02.610+0000 7f521e846640 1 -- 172.21.15.44:0/3932063223 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f5218062b20 con 0x7f5218102b30 2024-08-19T00:10:02.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:02.611+0000 7f52157fa640 1 -- 172.21.15.44:0/3932063223 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v79) ==== 74+0+133 (secure 0 0 0) 0x7f520c09f5d0 con 0x7f5218102b30 2024-08-19T00:10:02.612 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:10:02.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:02.613+0000 7f521e846640 1 -- 172.21.15.44:0/3932063223 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f52000a2b80 msgr2=0x7f52000a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:02.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:02.613+0000 7f521e846640 1 --2- 172.21.15.44:0/3932063223 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f52000a2b80 0x7f52000a5040 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5208005ab0 tx=0x7f5208000bc0 comp rx=0 tx=0).stop 2024-08-19T00:10:02.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:02.613+0000 7f521e846640 1 -- 172.21.15.44:0/3932063223 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5218102b30 msgr2=0x7f5218074310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:02.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:02.613+0000 7f521e846640 1 --2- 172.21.15.44:0/3932063223 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5218102b30 0x7f5218074310 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f520c00d770 tx=0x7f520c00dc30 comp rx=0 tx=0).stop 2024-08-19T00:10:02.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:02.613+0000 7f521e846640 1 -- 172.21.15.44:0/3932063223 shutdown_connections 2024-08-19T00:10:02.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:02.613+0000 7f521e846640 1 --2- 172.21.15.44:0/3932063223 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f52000a2b80 0x7f52000a5040 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:02.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:02.613+0000 7f521e846640 1 --2- 172.21.15.44:0/3932063223 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f52181034f0 0x7f5218074850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:02.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:02.613+0000 7f521e846640 1 --2- 172.21.15.44:0/3932063223 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5218102b30 0x7f5218074310 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:02.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:02.613+0000 7f521e846640 1 --2- 172.21.15.44:0/3932063223 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5218101930 0x7f5218075cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:02.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:02.613+0000 7f521e846640 1 -- 172.21.15.44:0/3932063223 >> 172.21.15.44:0/3932063223 conn(0x7f52180fd0c0 msgr2=0x7f5218105ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:10:02.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:02.613+0000 7f521e846640 1 -- 172.21.15.44:0/3932063223 shutdown_connections 2024-08-19T00:10:02.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:02.613+0000 7f521e846640 1 -- 172.21.15.44:0/3932063223 wait complete. 2024-08-19T00:10:03.354 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:03 smithi044 ceph-mon[18489]: Detected new or changed devices on smithi171 2024-08-19T00:10:03.355 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:03 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:03.355 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:03 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:03.355 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:03 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:10:03.355 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:03 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:10:03.355 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:03 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:10:03.355 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:03 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:10:03.355 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:03 smithi044 ceph-mon[18489]: Adjusting osd_memory_target on smithi171 to 4272M 2024-08-19T00:10:03.355 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:03 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:03.355 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:03 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:10:03.355 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:03 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:10:03.355 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:03 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:03.355 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:03 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:10:03.356 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:03 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:10:03.356 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:03 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:10:03.356 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:03 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:03.356 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:03 smithi044 ceph-mon[18489]: osdmap e79: 12 total, 12 up, 12 in 2024-08-19T00:10:03.356 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:03 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/3932063223' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-08-19T00:10:03.383 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":79,"num_osds":12,"num_up_osds":12,"osd_up_since":1724026201,"num_in_osds":12,"osd_in_since":1724026182,"num_remapped_pgs":0} 2024-08-19T00:10:03.384 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-19T00:10:03.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:03 smithi171 ceph-mon[21810]: Detected new or changed devices on smithi171 2024-08-19T00:10:03.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:03 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:03.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:03 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:03.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:03 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:10:03.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:03 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:10:03.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:03 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:10:03.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:03 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:10:03.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:03 smithi171 ceph-mon[21810]: Adjusting osd_memory_target on smithi171 to 4272M 2024-08-19T00:10:03.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:03 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:03.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:03 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:10:03.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:03 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:10:03.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:03 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:03.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:03 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:10:03.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:03 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:10:03.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:03 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:10:03.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:03 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:03.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:03 smithi171 ceph-mon[21810]: osdmap e79: 12 total, 12 up, 12 in 2024-08-19T00:10:03.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:03 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/3932063223' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-08-19T00:10:03.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:03 smithi116 ceph-mon[21873]: Detected new or changed devices on smithi171 2024-08-19T00:10:03.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:03 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:03.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:03 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:03.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:03 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:10:03.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:03 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:10:03.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:03 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:10:03.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:03 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:10:03.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:03 smithi116 ceph-mon[21873]: Adjusting osd_memory_target on smithi171 to 4272M 2024-08-19T00:10:03.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:03 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:03.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:03 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:10:03.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:03 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:10:03.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:03 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:03.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:03 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:10:03.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:03 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:10:03.617 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:03 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:10:03.617 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:03 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:03.617 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:03 smithi116 ceph-mon[21873]: osdmap e79: 12 total, 12 up, 12 in 2024-08-19T00:10:03.617 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:03 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/3932063223' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-08-19T00:10:03.638 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:10:04.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:04.195+0000 7fac63eaa640 1 -- 172.21.15.44:0/2610452743 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac5c1067b0 msgr2=0x7fac5c106b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:04.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:04.195+0000 7fac63eaa640 1 --2- 172.21.15.44:0/2610452743 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac5c1067b0 0x7fac5c106b90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fac58009930 tx=0x7fac5802a420 comp rx=0 tx=0).stop 2024-08-19T00:10:04.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:04.195+0000 7fac63eaa640 1 -- 172.21.15.44:0/2610452743 shutdown_connections 2024-08-19T00:10:04.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:04.195+0000 7fac63eaa640 1 --2- 172.21.15.44:0/2610452743 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fac5c101150 0x7fac5c10d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:04.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:04.195+0000 7fac63eaa640 1 --2- 172.21.15.44:0/2610452743 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fac5c1007b0 0x7fac5c100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:04.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:04.195+0000 7fac63eaa640 1 --2- 172.21.15.44:0/2610452743 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac5c1067b0 0x7fac5c106b90 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:04.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:04.195+0000 7fac63eaa640 1 -- 172.21.15.44:0/2610452743 >> 172.21.15.44:0/2610452743 conn(0x7fac5c0fc4d0 msgr2=0x7fac5c0fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:10:04.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:04.195+0000 7fac63eaa640 1 -- 172.21.15.44:0/2610452743 shutdown_connections 2024-08-19T00:10:04.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:04.195+0000 7fac63eaa640 1 -- 172.21.15.44:0/2610452743 wait complete. 2024-08-19T00:10:04.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:04.196+0000 7fac63eaa640 1 Processor -- start 2024-08-19T00:10:04.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:04.196+0000 7fac63eaa640 1 -- start start 2024-08-19T00:10:04.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:04.196+0000 7fac63eaa640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fac5c1007b0 0x7fac5c0fcb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:04.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:04.196+0000 7fac63eaa640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac5c101150 0x7fac5c0fd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:04.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:04.196+0000 7fac63eaa640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fac5c1067b0 0x7fac5c0fd600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:04.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:04.196+0000 7fac63eaa640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fac5c110bd0 con 0x7fac5c101150 2024-08-19T00:10:04.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:04.196+0000 7fac63eaa640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fac5c110a50 con 0x7fac5c1007b0 2024-08-19T00:10:04.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:04.196+0000 7fac63eaa640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fac5c110d50 con 0x7fac5c1067b0 2024-08-19T00:10:04.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:04.196+0000 7fac61c46640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fac5c1007b0 0x7fac5c0fcb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:04.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:04.196+0000 7fac61c46640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fac5c1007b0 0x7fac5c0fcb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.44:56150/0 (socket says 172.21.15.44:56150) 2024-08-19T00:10:04.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:04.196+0000 7fac61445640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac5c101150 0x7fac5c0fd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:04.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:04.196+0000 7fac61c46640 1 -- 172.21.15.44:0/3040388743 learned_addr learned my addr 172.21.15.44:0/3040388743 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:10:04.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:04.196+0000 7fac62447640 1 --2- 172.21.15.44:0/3040388743 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fac5c1067b0 0x7fac5c0fd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:04.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:04.197+0000 7fac61445640 1 -- 172.21.15.44:0/3040388743 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fac5c1067b0 msgr2=0x7fac5c0fd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:04.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:04.197+0000 7fac61445640 1 --2- 172.21.15.44:0/3040388743 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fac5c1067b0 0x7fac5c0fd600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:04.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:04.197+0000 7fac61445640 1 -- 172.21.15.44:0/3040388743 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fac5c1007b0 msgr2=0x7fac5c0fcb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:04.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:04.197+0000 7fac61445640 1 --2- 172.21.15.44:0/3040388743 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fac5c1007b0 0x7fac5c0fcb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:04.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:04.197+0000 7fac61445640 1 -- 172.21.15.44:0/3040388743 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac5c1a6680 con 0x7fac5c101150 2024-08-19T00:10:04.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:04.197+0000 7fac61445640 1 --2- 172.21.15.44:0/3040388743 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac5c101150 0x7fac5c0fd0c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fac4c00b3f0 tx=0x7fac4c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:10:04.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:04.197+0000 7fac52ffd640 1 -- 172.21.15.44:0/3040388743 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac4c015020 con 0x7fac5c101150 2024-08-19T00:10:04.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:04.197+0000 7fac52ffd640 1 -- 172.21.15.44:0/3040388743 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac4c011d10 con 0x7fac5c101150 2024-08-19T00:10:04.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:04.197+0000 7fac63eaa640 1 -- 172.21.15.44:0/3040388743 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac5c1a6970 con 0x7fac5c101150 2024-08-19T00:10:04.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:04.197+0000 7fac52ffd640 1 -- 172.21.15.44:0/3040388743 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac4c00f2e0 con 0x7fac5c101150 2024-08-19T00:10:04.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:04.197+0000 7fac63eaa640 1 -- 172.21.15.44:0/3040388743 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac5c1a6eb0 con 0x7fac5c101150 2024-08-19T00:10:04.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:04.198+0000 7fac63eaa640 1 -- 172.21.15.44:0/3040388743 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac5c100c10 con 0x7fac5c101150 2024-08-19T00:10:04.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:04.199+0000 7fac52ffd640 1 -- 172.21.15.44:0/3040388743 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fac4c018020 con 0x7fac5c101150 2024-08-19T00:10:04.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:04.200+0000 7fac52ffd640 1 --2- 172.21.15.44:0/3040388743 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fac480a2b80 0x7fac480a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:04.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:04.200+0000 7fac61c46640 1 --2- 172.21.15.44:0/3040388743 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fac480a2b80 0x7fac480a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:04.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:04.200+0000 7fac52ffd640 1 -- 172.21.15.44:0/3040388743 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7fac4c0ce880 con 0x7fac5c101150 2024-08-19T00:10:04.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:04.200+0000 7fac61c46640 1 --2- 172.21.15.44:0/3040388743 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fac480a2b80 0x7fac480a5040 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fac58000c00 tx=0x7fac58009560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:10:04.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:04.203+0000 7fac52ffd640 1 -- 172.21.15.44:0/3040388743 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fac4c01f020 con 0x7fac5c101150 2024-08-19T00:10:04.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:04.378+0000 7fac63eaa640 1 -- 172.21.15.44:0/3040388743 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fac5c0fe0b0 con 0x7fac5c101150 2024-08-19T00:10:04.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:04.379+0000 7fac52ffd640 1 -- 172.21.15.44:0/3040388743 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) ==== 74+0+18444 (secure 0 0 0) 0x7fac4c09bc80 con 0x7fac5c101150 2024-08-19T00:10:04.380 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:10:04.381 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":79,"fsid":"647ded64-5dbe-11ef-bccf-c7b262605968","created":"2024-08-19T00:03:43.667929+0000","modified":"2024-08-19T00:10:02.559394+0000","last_up_change":"2024-08-19T00:10:01.557590+0000","last_in_change":"2024-08-19T00:09:42.433933+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T00:06:42.706553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b15ad904-d07d-4ecb-be8f-d99323425eed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":600251465},{"type":"v1","addr":"172.21.15.44:6803","nonce":600251465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":600251465},{"type":"v1","addr":"172.21.15.44:6805","nonce":600251465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":600251465},{"type":"v1","addr":"172.21.15.44:6809","nonce":600251465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":600251465},{"type":"v1","addr":"172.21.15.44:6807","nonce":600251465}]},"public_addr":"172.21.15.44:6803/600251465","cluster_addr":"172.21.15.44:6805/600251465","heartbeat_back_addr":"172.21.15.44:6809/600251465","heartbeat_front_addr":"172.21.15.44:6807/600251465","state":["exists","up"]},{"osd":1,"uuid":"8f70512f-21a3-4fec-8278-04b2bc9b2d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":613509556},{"type":"v1","addr":"172.21.15.116:6801","nonce":613509556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":613509556},{"type":"v1","addr":"172.21.15.116:6803","nonce":613509556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":613509556},{"type":"v1","addr":"172.21.15.116:6807","nonce":613509556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":613509556},{"type":"v1","addr":"172.21.15.116:6805","nonce":613509556}]},"public_addr":"172.21.15.116:6801/613509556","cluster_addr":"172.21.15.116:6803/613509556","heartbeat_back_addr":"172.21.15.116:6807/613509556","heartbeat_front_addr":"172.21.15.116:6805/613509556","state":["exists","up"]},{"osd":2,"uuid":"56994dfd-5fcf-4d82-addf-38764239d82a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2130938937},{"type":"v1","addr":"172.21.15.171:6801","nonce":2130938937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2130938937},{"type":"v1","addr":"172.21.15.171:6803","nonce":2130938937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2130938937},{"type":"v1","addr":"172.21.15.171:6807","nonce":2130938937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2130938937},{"type":"v1","addr":"172.21.15.171:6805","nonce":2130938937}]},"public_addr":"172.21.15.171:6801/2130938937","cluster_addr":"172.21.15.171:6803/2130938937","heartbeat_back_addr":"172.21.15.171:6807/2130938937","heartbeat_front_addr":"172.21.15.171:6805/2130938937","state":["exists","up"]},{"osd":3,"uuid":"6d2ddb19-74e0-4e68-b9ea-58b73fd1e9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":3537027669},{"type":"v1","addr":"172.21.15.44:6811","nonce":3537027669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":3537027669},{"type":"v1","addr":"172.21.15.44:6813","nonce":3537027669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3537027669},{"type":"v1","addr":"172.21.15.44:6817","nonce":3537027669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":3537027669},{"type":"v1","addr":"172.21.15.44:6815","nonce":3537027669}]},"public_addr":"172.21.15.44:6811/3537027669","cluster_addr":"172.21.15.44:6813/3537027669","heartbeat_back_addr":"172.21.15.44:6817/3537027669","heartbeat_front_addr":"172.21.15.44:6815/3537027669","state":["exists","up"]},{"osd":4,"uuid":"190d208e-ae54-497d-ad72-d07a5a26991b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":3768627455},{"type":"v1","addr":"172.21.15.116:6809","nonce":3768627455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":3768627455},{"type":"v1","addr":"172.21.15.116:6811","nonce":3768627455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":3768627455},{"type":"v1","addr":"172.21.15.116:6815","nonce":3768627455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":3768627455},{"type":"v1","addr":"172.21.15.116:6813","nonce":3768627455}]},"public_addr":"172.21.15.116:6809/3768627455","cluster_addr":"172.21.15.116:6811/3768627455","heartbeat_back_addr":"172.21.15.116:6815/3768627455","heartbeat_front_addr":"172.21.15.116:6813/3768627455","state":["exists","up"]},{"osd":5,"uuid":"d8afacad-6d3d-4703-9744-8d01ff2a2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":938785018},{"type":"v1","addr":"172.21.15.171:6809","nonce":938785018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":938785018},{"type":"v1","addr":"172.21.15.171:6811","nonce":938785018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":938785018},{"type":"v1","addr":"172.21.15.171:6815","nonce":938785018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":938785018},{"type":"v1","addr":"172.21.15.171:6813","nonce":938785018}]},"public_addr":"172.21.15.171:6809/938785018","cluster_addr":"172.21.15.171:6811/938785018","heartbeat_back_addr":"172.21.15.171:6815/938785018","heartbeat_front_addr":"172.21.15.171:6813/938785018","state":["exists","up"]},{"osd":6,"uuid":"55bf1f89-99e5-409d-99fa-f0124aa042df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":1219334797},{"type":"v1","addr":"172.21.15.44:6819","nonce":1219334797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":1219334797},{"type":"v1","addr":"172.21.15.44:6821","nonce":1219334797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":1219334797},{"type":"v1","addr":"172.21.15.44:6825","nonce":1219334797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":1219334797},{"type":"v1","addr":"172.21.15.44:6823","nonce":1219334797}]},"public_addr":"172.21.15.44:6819/1219334797","cluster_addr":"172.21.15.44:6821/1219334797","heartbeat_back_addr":"172.21.15.44:6825/1219334797","heartbeat_front_addr":"172.21.15.44:6823/1219334797","state":["exists","up"]},{"osd":7,"uuid":"70130d71-d28c-4a58-b603-75610c8d3ea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":3861873415},{"type":"v1","addr":"172.21.15.116:6817","nonce":3861873415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":3861873415},{"type":"v1","addr":"172.21.15.116:6819","nonce":3861873415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":3861873415},{"type":"v1","addr":"172.21.15.116:6823","nonce":3861873415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":3861873415},{"type":"v1","addr":"172.21.15.116:6821","nonce":3861873415}]},"public_addr":"172.21.15.116:6817/3861873415","cluster_addr":"172.21.15.116:6819/3861873415","heartbeat_back_addr":"172.21.15.116:6823/3861873415","heartbeat_front_addr":"172.21.15.116:6821/3861873415","state":["exists","up"]},{"osd":8,"uuid":"c5121f70-e423-4f86-a3c6-90945c9385f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":843701060},{"type":"v1","addr":"172.21.15.171:6817","nonce":843701060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":843701060},{"type":"v1","addr":"172.21.15.171:6819","nonce":843701060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":843701060},{"type":"v1","addr":"172.21.15.171:6823","nonce":843701060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":843701060},{"type":"v1","addr":"172.21.15.171:6821","nonce":843701060}]},"public_addr":"172.21.15.171:6817/843701060","cluster_addr":"172.21.15.171:6819/843701060","heartbeat_back_addr":"172.21.15.171:6823/843701060","heartbeat_front_addr":"172.21.15.171:6821/843701060","state":["exists","up"]},{"osd":9,"uuid":"cd13693a-0f25-47cc-b1a5-9c42481935ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3206550013},{"type":"v1","addr":"172.21.15.44:6827","nonce":3206550013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":3206550013},{"type":"v1","addr":"172.21.15.44:6829","nonce":3206550013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3206550013},{"type":"v1","addr":"172.21.15.44:6833","nonce":3206550013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3206550013},{"type":"v1","addr":"172.21.15.44:6831","nonce":3206550013}]},"public_addr":"172.21.15.44:6827/3206550013","cluster_addr":"172.21.15.44:6829/3206550013","heartbeat_back_addr":"172.21.15.44:6833/3206550013","heartbeat_front_addr":"172.21.15.44:6831/3206550013","state":["exists","up"]},{"osd":10,"uuid":"a36ffeb1-6ecf-4899-bdfa-18515afefb86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3034738363},{"type":"v1","addr":"172.21.15.116:6825","nonce":3034738363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3034738363},{"type":"v1","addr":"172.21.15.116:6827","nonce":3034738363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3034738363},{"type":"v1","addr":"172.21.15.116:6831","nonce":3034738363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3034738363},{"type":"v1","addr":"172.21.15.116:6829","nonce":3034738363}]},"public_addr":"172.21.15.116:6825/3034738363","cluster_addr":"172.21.15.116:6827/3034738363","heartbeat_back_addr":"172.21.15.116:6831/3034738363","heartbeat_front_addr":"172.21.15.116:6829/3034738363","state":["exists","up"]},{"osd":11,"uuid":"ffcf44a8-3094-4a29-822e-a6ce95da119e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1500842656},{"type":"v1","addr":"172.21.15.171:6825","nonce":1500842656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1500842656},{"type":"v1","addr":"172.21.15.171:6827","nonce":1500842656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1500842656},{"type":"v1","addr":"172.21.15.171:6831","nonce":1500842656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1500842656},{"type":"v1","addr":"172.21.15.171:6829","nonce":1500842656}]},"public_addr":"172.21.15.171:6825/1500842656","cluster_addr":"172.21.15.171:6827/1500842656","heartbeat_back_addr":"172.21.15.171:6831/1500842656","heartbeat_front_addr":"172.21.15.171:6829/1500842656","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:05:56.916127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:06:17.603805+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:06:38.642970+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:07:00.667062+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:07:22.542529+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:07:44.732304+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:08:07.050742+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:08:29.451498+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:08:52.222169+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:09:15.422629+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:09:37.295311+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:09:59.716431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6800/1300308907":"2024-08-20T00:04:38.392912+0000","172.21.15.44:0/1001446555":"2024-08-20T00:04:38.392912+0000","172.21.15.44:0/3800526625":"2024-08-20T00:04:38.392912+0000","172.21.15.44:6801/1300308907":"2024-08-20T00:04:38.392912+0000","172.21.15.44:0/3096491642":"2024-08-20T00:04:14.604141+0000","172.21.15.44:0/400419582":"2024-08-20T00:04:38.392912+0000","172.21.15.44:0/1869412718":"2024-08-20T00:04:14.604141+0000","172.21.15.44:6801/1374527587":"2024-08-20T00:04:14.604141+0000","172.21.15.44:0/911382683":"2024-08-20T00:04:14.604141+0000","172.21.15.44:6800/1374527587":"2024-08-20T00:04:14.604141+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:10:04.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:04.381+0000 7fac63eaa640 1 -- 172.21.15.44:0/3040388743 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fac480a2b80 msgr2=0x7fac480a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:04.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:04.381+0000 7fac63eaa640 1 --2- 172.21.15.44:0/3040388743 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fac480a2b80 0x7fac480a5040 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fac58000c00 tx=0x7fac58009560 comp rx=0 tx=0).stop 2024-08-19T00:10:04.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:04.381+0000 7fac63eaa640 1 -- 172.21.15.44:0/3040388743 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac5c101150 msgr2=0x7fac5c0fd0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:04.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:04.381+0000 7fac63eaa640 1 --2- 172.21.15.44:0/3040388743 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac5c101150 0x7fac5c0fd0c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fac4c00b3f0 tx=0x7fac4c00b8b0 comp rx=0 tx=0).stop 2024-08-19T00:10:04.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:04.381+0000 7fac63eaa640 1 -- 172.21.15.44:0/3040388743 shutdown_connections 2024-08-19T00:10:04.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:04.381+0000 7fac63eaa640 1 --2- 172.21.15.44:0/3040388743 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fac480a2b80 0x7fac480a5040 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:04.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:04.381+0000 7fac63eaa640 1 --2- 172.21.15.44:0/3040388743 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fac5c1067b0 0x7fac5c0fd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:04.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:04.381+0000 7fac63eaa640 1 --2- 172.21.15.44:0/3040388743 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac5c101150 0x7fac5c0fd0c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:04.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:04.381+0000 7fac63eaa640 1 --2- 172.21.15.44:0/3040388743 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fac5c1007b0 0x7fac5c0fcb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:04.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:04.381+0000 7fac63eaa640 1 -- 172.21.15.44:0/3040388743 >> 172.21.15.44:0/3040388743 conn(0x7fac5c0fc4d0 msgr2=0x7fac5c06a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:10:04.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:04.381+0000 7fac63eaa640 1 -- 172.21.15.44:0/3040388743 shutdown_connections 2024-08-19T00:10:04.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:04.381+0000 7fac63eaa640 1 -- 172.21.15.44:0/3040388743 wait complete. 2024-08-19T00:10:04.695 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:04 smithi044 ceph-mon[18489]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:04.695 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:04 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/3040388743' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-19T00:10:04.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:04 smithi171 ceph-mon[21810]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:04.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:04 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/3040388743' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-19T00:10:04.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:04 smithi116 ceph-mon[21873]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:04.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:04 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/3040388743' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-19T00:10:05.001 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-19T00:06:42.706553+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-08-19T00:10:05.001 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-08-19T00:10:05.257 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:10:05.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:05.674+0000 7f0e6fcb5640 1 -- 172.21.15.44:0/3472645067 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e681078b0 msgr2=0x7f0e68107c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:05.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:05.674+0000 7f0e6fcb5640 1 --2- 172.21.15.44:0/3472645067 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e681078b0 0x7f0e68107c90 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0e64009930 tx=0x7f0e6402a420 comp rx=0 tx=0).stop 2024-08-19T00:10:05.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:05.674+0000 7f0e6fcb5640 1 -- 172.21.15.44:0/3472645067 shutdown_connections 2024-08-19T00:10:05.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:05.674+0000 7f0e6fcb5640 1 --2- 172.21.15.44:0/3472645067 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0e681018b0 0x7f0e68101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:05.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:05.674+0000 7f0e6fcb5640 1 --2- 172.21.15.44:0/3472645067 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0e68102250 0x7f0e6810e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:05.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:05.674+0000 7f0e6fcb5640 1 --2- 172.21.15.44:0/3472645067 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e681078b0 0x7f0e68107c90 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:05.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:05.674+0000 7f0e6fcb5640 1 -- 172.21.15.44:0/3472645067 >> 172.21.15.44:0/3472645067 conn(0x7f0e680fd5f0 msgr2=0x7f0e680ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:10:05.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:05.674+0000 7f0e6fcb5640 1 -- 172.21.15.44:0/3472645067 shutdown_connections 2024-08-19T00:10:05.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:05.674+0000 7f0e6fcb5640 1 -- 172.21.15.44:0/3472645067 wait complete. 2024-08-19T00:10:05.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:05.675+0000 7f0e6fcb5640 1 Processor -- start 2024-08-19T00:10:05.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:05.675+0000 7f0e6fcb5640 1 -- start start 2024-08-19T00:10:05.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:05.675+0000 7f0e6fcb5640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0e681018b0 0x7f0e681980e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:05.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:05.675+0000 7f0e6fcb5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e68102250 0x7f0e68198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:05.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:05.675+0000 7f0e6fcb5640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0e681078b0 0x7f0e6819c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:05.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:05.675+0000 7f0e6fcb5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0e68111d00 con 0x7f0e68102250 2024-08-19T00:10:05.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:05.675+0000 7f0e6fcb5640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f0e68111b80 con 0x7f0e681078b0 2024-08-19T00:10:05.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:05.675+0000 7f0e6fcb5640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0e68111e80 con 0x7f0e681018b0 2024-08-19T00:10:05.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:05.675+0000 7f0e6d250640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e68102250 0x7f0e68198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:05.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:05.675+0000 7f0e6d250640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e68102250 0x7f0e68198620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49982/0 (socket says 172.21.15.44:49982) 2024-08-19T00:10:05.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:05.675+0000 7f0e6d250640 1 -- 172.21.15.44:0/1497024728 learned_addr learned my addr 172.21.15.44:0/1497024728 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:10:05.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:05.675+0000 7f0e6da51640 1 --2- 172.21.15.44:0/1497024728 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0e681018b0 0x7f0e681980e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:05.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:05.675+0000 7f0e6e252640 1 --2- 172.21.15.44:0/1497024728 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0e681078b0 0x7f0e6819c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:05.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:05.675+0000 7f0e6d250640 1 -- 172.21.15.44:0/1497024728 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0e681018b0 msgr2=0x7f0e681980e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:05.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:05.675+0000 7f0e6d250640 1 --2- 172.21.15.44:0/1497024728 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0e681018b0 0x7f0e681980e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:05.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:05.675+0000 7f0e6d250640 1 -- 172.21.15.44:0/1497024728 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0e681078b0 msgr2=0x7f0e6819c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:05.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:05.675+0000 7f0e6d250640 1 --2- 172.21.15.44:0/1497024728 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0e681078b0 0x7f0e6819c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:05.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:05.675+0000 7f0e6d250640 1 -- 172.21.15.44:0/1497024728 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e6819d090 con 0x7f0e68102250 2024-08-19T00:10:05.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:05.675+0000 7f0e6da51640 1 --2- 172.21.15.44:0/1497024728 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0e681018b0 0x7f0e681980e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:10:05.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:05.675+0000 7f0e6d250640 1 --2- 172.21.15.44:0/1497024728 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e68102250 0x7f0e68198620 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0e5800c920 tx=0x7f0e5800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:10:05.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:05.676+0000 7f0e5effd640 1 -- 172.21.15.44:0/1497024728 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e58007c70 con 0x7f0e68102250 2024-08-19T00:10:05.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:05.676+0000 7f0e6fcb5640 1 -- 172.21.15.44:0/1497024728 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e6819d380 con 0x7f0e68102250 2024-08-19T00:10:05.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:05.676+0000 7f0e5effd640 1 -- 172.21.15.44:0/1497024728 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e58007e10 con 0x7f0e68102250 2024-08-19T00:10:05.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:05.676+0000 7f0e5effd640 1 -- 172.21.15.44:0/1497024728 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e58018890 con 0x7f0e68102250 2024-08-19T00:10:05.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:05.676+0000 7f0e6fcb5640 1 -- 172.21.15.44:0/1497024728 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e681a4c60 con 0x7f0e68102250 2024-08-19T00:10:05.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:05.677+0000 7f0e6fcb5640 1 -- 172.21.15.44:0/1497024728 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e68101d10 con 0x7f0e68102250 2024-08-19T00:10:05.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:05.678+0000 7f0e5effd640 1 -- 172.21.15.44:0/1497024728 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f0e58018a50 con 0x7f0e68102250 2024-08-19T00:10:05.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:05.678+0000 7f0e5effd640 1 --2- 172.21.15.44:0/1497024728 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f0e540a2b80 0x7f0e540a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:05.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:05.679+0000 7f0e6da51640 1 --2- 172.21.15.44:0/1497024728 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f0e540a2b80 0x7f0e540a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:05.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:05.679+0000 7f0e5effd640 1 -- 172.21.15.44:0/1497024728 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7f0e580cf040 con 0x7f0e68102250 2024-08-19T00:10:05.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:05.679+0000 7f0e6da51640 1 --2- 172.21.15.44:0/1497024728 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f0e540a2b80 0x7f0e540a5040 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0e64006010 tx=0x7f0e64005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:10:05.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:05.682+0000 7f0e5effd640 1 -- 172.21.15.44:0/1497024728 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f0e58014030 con 0x7f0e68102250 2024-08-19T00:10:05.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:05.857+0000 7f0e6fcb5640 1 -- 172.21.15.44:0/1497024728 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0e681a4ff0 con 0x7f0e68102250 2024-08-19T00:10:05.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:05.857+0000 7f0e5effd640 1 -- 172.21.15.44:0/1497024728 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) ==== 93+0+10 (secure 0 0 0) 0x7f0e5809c4d0 con 0x7f0e68102250 2024-08-19T00:10:05.859 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-08-19T00:10:05.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:05.859+0000 7f0e6fcb5640 1 -- 172.21.15.44:0/1497024728 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f0e540a2b80 msgr2=0x7f0e540a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:05.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:05.859+0000 7f0e6fcb5640 1 --2- 172.21.15.44:0/1497024728 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f0e540a2b80 0x7f0e540a5040 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0e64006010 tx=0x7f0e64005a20 comp rx=0 tx=0).stop 2024-08-19T00:10:05.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:05.859+0000 7f0e6fcb5640 1 -- 172.21.15.44:0/1497024728 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e68102250 msgr2=0x7f0e68198620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:05.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:05.859+0000 7f0e6fcb5640 1 --2- 172.21.15.44:0/1497024728 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e68102250 0x7f0e68198620 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0e5800c920 tx=0x7f0e5800cde0 comp rx=0 tx=0).stop 2024-08-19T00:10:05.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:05.859+0000 7f0e6fcb5640 1 -- 172.21.15.44:0/1497024728 shutdown_connections 2024-08-19T00:10:05.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:05.859+0000 7f0e6fcb5640 1 --2- 172.21.15.44:0/1497024728 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f0e540a2b80 0x7f0e540a5040 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:05.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:05.859+0000 7f0e6fcb5640 1 --2- 172.21.15.44:0/1497024728 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0e681078b0 0x7f0e6819c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:05.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:05.859+0000 7f0e6fcb5640 1 --2- 172.21.15.44:0/1497024728 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e68102250 0x7f0e68198620 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:05.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:05.859+0000 7f0e6fcb5640 1 --2- 172.21.15.44:0/1497024728 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0e681018b0 0x7f0e681980e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:05.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:05.859+0000 7f0e6fcb5640 1 -- 172.21.15.44:0/1497024728 >> 172.21.15.44:0/1497024728 conn(0x7f0e680fd5f0 msgr2=0x7f0e680fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:10:05.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:05.859+0000 7f0e6fcb5640 1 -- 172.21.15.44:0/1497024728 shutdown_connections 2024-08-19T00:10:05.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:05.860+0000 7f0e6fcb5640 1 -- 172.21.15.44:0/1497024728 wait complete. 2024-08-19T00:10:06.631 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:06 smithi044 ceph-mon[18489]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:06.631 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:06 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/1497024728' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-08-19T00:10:06.665 INFO:tasks.cephadm:Adding mds.a on smithi044 2024-08-19T00:10:06.665 INFO:tasks.cephadm:Adding mds.d on smithi044 2024-08-19T00:10:06.665 INFO:tasks.cephadm:Adding mds.g on smithi044 2024-08-19T00:10:06.665 INFO:tasks.cephadm:Adding mds.j on smithi044 2024-08-19T00:10:06.665 INFO:tasks.cephadm:Adding mds.b on smithi116 2024-08-19T00:10:06.666 INFO:tasks.cephadm:Adding mds.e on smithi116 2024-08-19T00:10:06.666 INFO:tasks.cephadm:Adding mds.h on smithi116 2024-08-19T00:10:06.666 INFO:tasks.cephadm:Adding mds.k on smithi116 2024-08-19T00:10:06.666 INFO:tasks.cephadm:Adding mds.c on smithi171 2024-08-19T00:10:06.666 INFO:tasks.cephadm:Adding mds.f on smithi171 2024-08-19T00:10:06.666 INFO:tasks.cephadm:Adding mds.i on smithi171 2024-08-19T00:10:06.666 INFO:tasks.cephadm:Adding mds.l on smithi171 2024-08-19T00:10:06.667 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph orch apply mds all '12;smithi044=a;smithi044=d;smithi044=g;smithi044=j;smithi116=b;smithi116=e;smithi116=h;smithi116=k;smithi171=c;smithi171=f;smithi171=i;smithi171=l' 2024-08-19T00:10:06.695 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:06 smithi171 ceph-mon[21810]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:06.696 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:06 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/1497024728' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-08-19T00:10:06.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:06 smithi116 ceph-mon[21873]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:06.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:06 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/1497024728' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-08-19T00:10:06.932 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.c/config 2024-08-19T00:10:07.423 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:10:07.405+0000 7f841cab3640 1 -- 172.21.15.171:0/4036680262 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8418107670 msgr2=0x7f8418109a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:07.423 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:10:07.405+0000 7f841cab3640 1 --2- 172.21.15.171:0/4036680262 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8418107670 0x7f8418109a60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8408009ca0 tx=0x7f840802a8c0 comp rx=0 tx=0).stop 2024-08-19T00:10:07.423 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:10:07.405+0000 7f841cab3640 1 -- 172.21.15.171:0/4036680262 shutdown_connections 2024-08-19T00:10:07.423 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:10:07.405+0000 7f841cab3640 1 --2- 172.21.15.171:0/4036680262 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8418107670 0x7f8418109a60 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:07.424 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:10:07.405+0000 7f841cab3640 1 --2- 172.21.15.171:0/4036680262 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8418104d40 0x7f8418107130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:07.424 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:10:07.405+0000 7f841cab3640 1 --2- 172.21.15.171:0/4036680262 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8418102410 0x7f8418104800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:07.424 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:10:07.405+0000 7f841cab3640 1 -- 172.21.15.171:0/4036680262 >> 172.21.15.171:0/4036680262 conn(0x7f84180fbfb0 msgr2=0x7f84180fe3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:10:07.424 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:10:07.405+0000 7f841cab3640 1 -- 172.21.15.171:0/4036680262 shutdown_connections 2024-08-19T00:10:07.424 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:10:07.405+0000 7f841cab3640 1 -- 172.21.15.171:0/4036680262 wait complete. 2024-08-19T00:10:07.424 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:10:07.406+0000 7f841cab3640 1 Processor -- start 2024-08-19T00:10:07.424 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:10:07.406+0000 7f841cab3640 1 -- start start 2024-08-19T00:10:07.424 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:10:07.406+0000 7f841cab3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8418102410 0x7f8418197c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:07.424 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:10:07.406+0000 7f841cab3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8418104d40 0x7f8418198160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:07.424 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:10:07.406+0000 7f841cab3640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8418107670 0x7f841819f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:07.424 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:10:07.406+0000 7f841cab3640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f841810d5b0 con 0x7f8418104d40 2024-08-19T00:10:07.424 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:10:07.406+0000 7f841cab3640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f841810d430 con 0x7f8418107670 2024-08-19T00:10:07.425 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:10:07.406+0000 7f841cab3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f841810d730 con 0x7f8418102410 2024-08-19T00:10:07.425 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:10:07.406+0000 7f841659c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8418102410 0x7f8418197c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:07.425 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:10:07.406+0000 7f841659c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8418102410 0x7f8418197c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:57394/0 (socket says 172.21.15.171:57394) 2024-08-19T00:10:07.425 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:10:07.406+0000 7f841659c640 1 -- 172.21.15.171:0/1931827493 learned_addr learned my addr 172.21.15.171:0/1931827493 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-08-19T00:10:07.425 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:10:07.406+0000 7f8416d9d640 1 --2- 172.21.15.171:0/1931827493 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8418107670 0x7f841819f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:07.425 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:10:07.406+0000 7f841659c640 1 -- 172.21.15.171:0/1931827493 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8418107670 msgr2=0x7f841819f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:07.425 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:10:07.407+0000 7f841659c640 1 --2- 172.21.15.171:0/1931827493 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8418107670 0x7f841819f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:07.425 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:10:07.406+0000 7f8415d9b640 1 --2- 172.21.15.171:0/1931827493 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8418104d40 0x7f8418198160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:07.425 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:10:07.407+0000 7f841659c640 1 -- 172.21.15.171:0/1931827493 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8418104d40 msgr2=0x7f8418198160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:07.425 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:10:07.407+0000 7f841659c640 1 --2- 172.21.15.171:0/1931827493 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8418104d40 0x7f8418198160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:07.425 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:10:07.407+0000 7f841659c640 1 -- 172.21.15.171:0/1931827493 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f841819f840 con 0x7f8418102410 2024-08-19T00:10:07.425 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:10:07.407+0000 7f8415d9b640 1 --2- 172.21.15.171:0/1931827493 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8418104d40 0x7f8418198160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:10:07.425 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:10:07.407+0000 7f841659c640 1 --2- 172.21.15.171:0/1931827493 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8418102410 0x7f8418197c20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f841000d950 tx=0x7f841000de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:10:07.426 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:10:07.407+0000 7f84077fe640 1 -- 172.21.15.171:0/1931827493 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8410017070 con 0x7f8418102410 2024-08-19T00:10:07.426 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:10:07.407+0000 7f841cab3640 1 -- 172.21.15.171:0/1931827493 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f841819fb30 con 0x7f8418102410 2024-08-19T00:10:07.426 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:10:07.407+0000 7f84077fe640 1 -- 172.21.15.171:0/1931827493 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8410009c30 con 0x7f8418102410 2024-08-19T00:10:07.426 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:10:07.407+0000 7f84077fe640 1 -- 172.21.15.171:0/1931827493 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841000f6b0 con 0x7f8418102410 2024-08-19T00:10:07.426 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:10:07.407+0000 7f841cab3640 1 -- 172.21.15.171:0/1931827493 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84181a0070 con 0x7f8418102410 2024-08-19T00:10:07.426 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:10:07.408+0000 7f841cab3640 1 -- 172.21.15.171:0/1931827493 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84180fdaa0 con 0x7f8418102410 2024-08-19T00:10:07.426 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:10:07.409+0000 7f84077fe640 1 -- 172.21.15.171:0/1931827493 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f84100109d0 con 0x7f8418102410 2024-08-19T00:10:07.426 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:10:07.410+0000 7f84077fe640 1 --2- 172.21.15.171:0/1931827493 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f84000a2b80 0x7f84000a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:07.426 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:10:07.410+0000 7f84077fe640 1 -- 172.21.15.171:0/1931827493 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7f84100ce810 con 0x7f8418102410 2024-08-19T00:10:07.426 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:10:07.410+0000 7f8415d9b640 1 --2- 172.21.15.171:0/1931827493 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f84000a2b80 0x7f84000a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:07.426 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:10:07.410+0000 7f8415d9b640 1 --2- 172.21.15.171:0/1931827493 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f84000a2b80 0x7f84000a5040 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f841806a780 tx=0x7f840c005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:10:07.426 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:10:07.414+0000 7f84077fe640 1 -- 172.21.15.171:0/1931827493 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f8410009de0 con 0x7f8418102410 2024-08-19T00:10:07.593 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:10:07.592+0000 7f841cab3640 1 -- 172.21.15.171:0/1931827493 --> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi044=a;smithi044=d;smithi044=g;smithi044=j;smithi116=b;smithi116=e;smithi116=h;smithi116=k;smithi171=c;smithi171=f;smithi171=i;smithi171=l", "target": ["mon-mgr", ""]}) -- 0x7f8418062520 con 0x7f84000a2b80 2024-08-19T00:10:07.600 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:10:07.600+0000 7f84077fe640 1 -- 172.21.15.171:0/1931827493 <== mgr.14150 v2:172.21.15.44:6800/1330072146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f8418062520 con 0x7f84000a2b80 2024-08-19T00:10:07.601 INFO:teuthology.orchestra.run.smithi171.stdout:Scheduled mds.all update... 2024-08-19T00:10:07.603 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:10:07.602+0000 7f841cab3640 1 -- 172.21.15.171:0/1931827493 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f84000a2b80 msgr2=0x7f84000a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:07.603 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:10:07.602+0000 7f841cab3640 1 --2- 172.21.15.171:0/1931827493 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f84000a2b80 0x7f84000a5040 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f841806a780 tx=0x7f840c005e50 comp rx=0 tx=0).stop 2024-08-19T00:10:07.603 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:10:07.602+0000 7f841cab3640 1 -- 172.21.15.171:0/1931827493 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8418102410 msgr2=0x7f8418197c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:07.603 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:10:07.602+0000 7f841cab3640 1 --2- 172.21.15.171:0/1931827493 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8418102410 0x7f8418197c20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f841000d950 tx=0x7f841000de10 comp rx=0 tx=0).stop 2024-08-19T00:10:07.603 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:10:07.602+0000 7f841cab3640 1 -- 172.21.15.171:0/1931827493 shutdown_connections 2024-08-19T00:10:07.603 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:10:07.602+0000 7f841cab3640 1 --2- 172.21.15.171:0/1931827493 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f84000a2b80 0x7f84000a5040 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:07.603 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:10:07.602+0000 7f841cab3640 1 --2- 172.21.15.171:0/1931827493 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8418107670 0x7f841819f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:07.603 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:10:07.602+0000 7f841cab3640 1 --2- 172.21.15.171:0/1931827493 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8418104d40 0x7f8418198160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:07.604 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:10:07.602+0000 7f841cab3640 1 --2- 172.21.15.171:0/1931827493 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8418102410 0x7f8418197c20 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:07.604 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:10:07.602+0000 7f841cab3640 1 -- 172.21.15.171:0/1931827493 >> 172.21.15.171:0/1931827493 conn(0x7f84180fbfb0 msgr2=0x7f8418102cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:10:07.604 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:10:07.602+0000 7f841cab3640 1 -- 172.21.15.171:0/1931827493 shutdown_connections 2024-08-19T00:10:07.604 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-19T00:10:07.602+0000 7f841cab3640 1 -- 172.21.15.171:0/1931827493 wait complete. 2024-08-19T00:10:08.416 DEBUG:teuthology.orchestra.run.smithi044:mds.a> sudo journalctl -f -n 0 -u ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mds.a.service 2024-08-19T00:10:08.420 DEBUG:teuthology.orchestra.run.smithi044:mds.d> sudo journalctl -f -n 0 -u ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mds.d.service 2024-08-19T00:10:08.463 DEBUG:teuthology.orchestra.run.smithi044:mds.g> sudo journalctl -f -n 0 -u ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mds.g.service 2024-08-19T00:10:08.506 DEBUG:teuthology.orchestra.run.smithi044:mds.j> sudo journalctl -f -n 0 -u ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mds.j.service 2024-08-19T00:10:08.549 DEBUG:teuthology.orchestra.run.smithi116:mds.b> sudo journalctl -f -n 0 -u ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mds.b.service 2024-08-19T00:10:08.552 DEBUG:teuthology.orchestra.run.smithi116:mds.e> sudo journalctl -f -n 0 -u ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mds.e.service 2024-08-19T00:10:08.595 DEBUG:teuthology.orchestra.run.smithi116:mds.h> sudo journalctl -f -n 0 -u ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mds.h.service 2024-08-19T00:10:08.638 DEBUG:teuthology.orchestra.run.smithi116:mds.k> sudo journalctl -f -n 0 -u ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mds.k.service 2024-08-19T00:10:08.658 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:08 smithi116 ceph-mon[21873]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:08.659 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:08 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:08.659 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:08 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:10:08.659 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:08 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:10:08.659 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:08 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:10:08.659 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:08 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:08.659 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:08 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-19T00:10:08.659 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:08 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-19T00:10:08.659 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:08 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:10:08.660 DEBUG:teuthology.orchestra.run.smithi171:mds.c> sudo journalctl -f -n 0 -u ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mds.c.service 2024-08-19T00:10:08.662 DEBUG:teuthology.orchestra.run.smithi171:mds.f> sudo journalctl -f -n 0 -u ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mds.f.service 2024-08-19T00:10:08.681 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:08 smithi171 ceph-mon[21810]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:08.681 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:08 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:08.681 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:08 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:10:08.681 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:08 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:10:08.681 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:08 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:10:08.681 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:08 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:08.682 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:08 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-19T00:10:08.682 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:08 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-19T00:10:08.682 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:08 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:10:08.682 DEBUG:teuthology.orchestra.run.smithi171:mds.i> sudo journalctl -f -n 0 -u ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mds.i.service 2024-08-19T00:10:08.726 DEBUG:teuthology.orchestra.run.smithi171:mds.l> sudo journalctl -f -n 0 -u ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mds.l.service 2024-08-19T00:10:08.769 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-08-19T00:10:08.769 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-19T00:10:08.793 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:08 smithi044 ceph-mon[18489]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:08.793 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:08 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:08.793 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:08 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:10:08.793 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:08 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:10:08.794 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:08 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:10:08.794 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:08 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:08.794 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:08 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-19T00:10:08.794 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:08 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-19T00:10:08.794 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:08 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:10:09.027 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:10:09.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:09.562+0000 7f04259c5640 1 -- 172.21.15.44:0/582657320 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f042010bea0 msgr2=0x7f042010e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:09.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:09.562+0000 7f04259c5640 1 --2- 172.21.15.44:0/582657320 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f042010bea0 0x7f042010e330 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0418009900 tx=0x7f041802a480 comp rx=0 tx=0).stop 2024-08-19T00:10:09.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:09.563+0000 7f04259c5640 1 -- 172.21.15.44:0/582657320 shutdown_connections 2024-08-19T00:10:09.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:09.563+0000 7f04259c5640 1 --2- 172.21.15.44:0/582657320 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0420103420 0x7f042010b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:09.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:09.563+0000 7f04259c5640 1 --2- 172.21.15.44:0/582657320 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f042010bea0 0x7f042010e330 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:09.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:09.563+0000 7f04259c5640 1 --2- 172.21.15.44:0/582657320 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0420102b00 0x7f0420102ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:09.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:09.563+0000 7f04259c5640 1 -- 172.21.15.44:0/582657320 >> 172.21.15.44:0/582657320 conn(0x7f04200fc4c0 msgr2=0x7f04200fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:10:09.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:09.563+0000 7f04259c5640 1 -- 172.21.15.44:0/582657320 shutdown_connections 2024-08-19T00:10:09.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:09.563+0000 7f04259c5640 1 -- 172.21.15.44:0/582657320 wait complete. 2024-08-19T00:10:09.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:09.563+0000 7f04259c5640 1 Processor -- start 2024-08-19T00:10:09.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:09.563+0000 7f04259c5640 1 -- start start 2024-08-19T00:10:09.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:09.564+0000 7f04259c5640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0420102b00 0x7f0420100760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:09.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:09.564+0000 7f04259c5640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0420103420 0x7f0420100ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:09.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:09.564+0000 7f04259c5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f042010bea0 0x7f04201011e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:09.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:09.564+0000 7f04259c5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0420111cd0 con 0x7f042010bea0 2024-08-19T00:10:09.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:09.564+0000 7f04259c5640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f0420111b50 con 0x7f0420102b00 2024-08-19T00:10:09.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:09.564+0000 7f04259c5640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0420111e50 con 0x7f0420103420 2024-08-19T00:10:09.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:09.564+0000 7f041f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f042010bea0 0x7f04201011e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:09.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:09.564+0000 7f041f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f042010bea0 0x7f04201011e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60262/0 (socket says 172.21.15.44:60262) 2024-08-19T00:10:09.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:09.564+0000 7f041f7fe640 1 -- 172.21.15.44:0/3020877884 learned_addr learned my addr 172.21.15.44:0/3020877884 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:10:09.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:09.564+0000 7f041effd640 1 --2- 172.21.15.44:0/3020877884 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0420102b00 0x7f0420100760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:09.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:09.564+0000 7f041e7fc640 1 --2- 172.21.15.44:0/3020877884 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0420103420 0x7f0420100ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:09.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:09.564+0000 7f041f7fe640 1 -- 172.21.15.44:0/3020877884 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0420103420 msgr2=0x7f0420100ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:09.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:09.564+0000 7f041f7fe640 1 --2- 172.21.15.44:0/3020877884 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0420103420 0x7f0420100ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:09.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:09.564+0000 7f041f7fe640 1 -- 172.21.15.44:0/3020877884 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0420102b00 msgr2=0x7f0420100760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:09.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:09.564+0000 7f041f7fe640 1 --2- 172.21.15.44:0/3020877884 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0420102b00 0x7f0420100760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:09.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:09.564+0000 7f041f7fe640 1 -- 172.21.15.44:0/3020877884 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04201a6630 con 0x7f042010bea0 2024-08-19T00:10:09.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:09.564+0000 7f041effd640 1 --2- 172.21.15.44:0/3020877884 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0420102b00 0x7f0420100760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:10:09.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:09.564+0000 7f041f7fe640 1 --2- 172.21.15.44:0/3020877884 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f042010bea0 0x7f04201011e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0418005ab0 tx=0x7f04180042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:10:09.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:09.564+0000 7f04249c3640 1 -- 172.21.15.44:0/3020877884 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f041803f030 con 0x7f042010bea0 2024-08-19T00:10:09.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:09.564+0000 7f04259c5640 1 -- 172.21.15.44:0/3020877884 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04201a68c0 con 0x7f042010bea0 2024-08-19T00:10:09.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:09.564+0000 7f04249c3640 1 -- 172.21.15.44:0/3020877884 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0418003ce0 con 0x7f042010bea0 2024-08-19T00:10:09.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:09.564+0000 7f04249c3640 1 -- 172.21.15.44:0/3020877884 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0418035070 con 0x7f042010bea0 2024-08-19T00:10:09.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:09.564+0000 7f04259c5640 1 -- 172.21.15.44:0/3020877884 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04201a6da0 con 0x7f042010bea0 2024-08-19T00:10:09.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:09.565+0000 7f04259c5640 1 -- 172.21.15.44:0/3020877884 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0420102ee0 con 0x7f042010bea0 2024-08-19T00:10:09.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:09.567+0000 7f04249c3640 1 -- 172.21.15.44:0/3020877884 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f0418042030 con 0x7f042010bea0 2024-08-19T00:10:09.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:09.568+0000 7f04249c3640 1 --2- 172.21.15.44:0/3020877884 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f040c0a2b80 0x7f040c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:09.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:09.568+0000 7f04249c3640 1 -- 172.21.15.44:0/3020877884 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7f04180ef390 con 0x7f042010bea0 2024-08-19T00:10:09.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:09.568+0000 7f041effd640 1 --2- 172.21.15.44:0/3020877884 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f040c0a2b80 0x7f040c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:09.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:09.569+0000 7f041effd640 1 --2- 172.21.15.44:0/3020877884 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f040c0a2b80 0x7f040c0a5040 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0410005fd0 tx=0x7f0410009520 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:10:09.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:09.571+0000 7f04249c3640 1 -- 172.21.15.44:0/3020877884 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f04180bc6f0 con 0x7f042010bea0 2024-08-19T00:10:09.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:09.785+0000 7f04259c5640 1 -- 172.21.15.44:0/3020877884 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0420106f60 con 0x7f042010bea0 2024-08-19T00:10:09.844 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:09 smithi044 ceph-mon[18489]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi044=a;smithi044=d;smithi044=g;smithi044=j;smithi116=b;smithi116=e;smithi116=h;smithi116=k;smithi171=c;smithi171=f;smithi171=i;smithi171=l", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:10:09.845 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:09 smithi044 ceph-mon[18489]: Saving service mds.all spec with placement smithi044=a;smithi044=d;smithi044=g;smithi044=j;smithi116=b;smithi116=e;smithi116=h;smithi116=k;smithi171=c;smithi171=f;smithi171=i;smithi171=l;count:12 2024-08-19T00:10:09.845 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:09 smithi044 ceph-mon[18489]: Deploying daemon mds.l on smithi171 2024-08-19T00:10:09.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:09.785+0000 7f04249c3640 1 -- 172.21.15.44:0/3020877884 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f04180bbff0 con 0x7f042010bea0 2024-08-19T00:10:09.845 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:10:09.846 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":1,"btime":"2024-08-19T00:03:43:667716+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-08-19T00:10:09.847 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 1 2024-08-19T00:10:09.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:09.787+0000 7f04259c5640 1 -- 172.21.15.44:0/3020877884 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f040c0a2b80 msgr2=0x7f040c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:09.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:09.787+0000 7f04259c5640 1 --2- 172.21.15.44:0/3020877884 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f040c0a2b80 0x7f040c0a5040 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0410005fd0 tx=0x7f0410009520 comp rx=0 tx=0).stop 2024-08-19T00:10:09.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:09.787+0000 7f04259c5640 1 -- 172.21.15.44:0/3020877884 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f042010bea0 msgr2=0x7f04201011e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:09.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:09.787+0000 7f04259c5640 1 --2- 172.21.15.44:0/3020877884 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f042010bea0 0x7f04201011e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0418005ab0 tx=0x7f04180042f0 comp rx=0 tx=0).stop 2024-08-19T00:10:09.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:09.788+0000 7f04259c5640 1 -- 172.21.15.44:0/3020877884 shutdown_connections 2024-08-19T00:10:09.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:09.788+0000 7f04259c5640 1 --2- 172.21.15.44:0/3020877884 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f040c0a2b80 0x7f040c0a5040 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:09.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:09.788+0000 7f04259c5640 1 --2- 172.21.15.44:0/3020877884 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0420103420 0x7f0420100ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:09.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:09.788+0000 7f04259c5640 1 --2- 172.21.15.44:0/3020877884 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f042010bea0 0x7f04201011e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:09.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:09.788+0000 7f04259c5640 1 --2- 172.21.15.44:0/3020877884 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0420102b00 0x7f0420100760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:09.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:09.788+0000 7f04259c5640 1 -- 172.21.15.44:0/3020877884 >> 172.21.15.44:0/3020877884 conn(0x7f04200fc4c0 msgr2=0x7f04200fdc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:10:09.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:09.788+0000 7f04259c5640 1 -- 172.21.15.44:0/3020877884 shutdown_connections 2024-08-19T00:10:09.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:09.788+0000 7f04259c5640 1 -- 172.21.15.44:0/3020877884 wait complete. 2024-08-19T00:10:09.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:09 smithi171 ceph-mon[21810]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi044=a;smithi044=d;smithi044=g;smithi044=j;smithi116=b;smithi116=e;smithi116=h;smithi116=k;smithi171=c;smithi171=f;smithi171=i;smithi171=l", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:10:09.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:09 smithi171 ceph-mon[21810]: Saving service mds.all spec with placement smithi044=a;smithi044=d;smithi044=g;smithi044=j;smithi116=b;smithi116=e;smithi116=h;smithi116=k;smithi171=c;smithi171=f;smithi171=i;smithi171=l;count:12 2024-08-19T00:10:09.848 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:09 smithi171 ceph-mon[21810]: Deploying daemon mds.l on smithi171 2024-08-19T00:10:09.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:09 smithi116 ceph-mon[21873]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi044=a;smithi044=d;smithi044=g;smithi044=j;smithi116=b;smithi116=e;smithi116=h;smithi116=k;smithi171=c;smithi171=f;smithi171=i;smithi171=l", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:10:09.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:09 smithi116 ceph-mon[21873]: Saving service mds.all spec with placement smithi044=a;smithi044=d;smithi044=g;smithi044=j;smithi116=b;smithi116=e;smithi116=h;smithi116=k;smithi171=c;smithi171=f;smithi171=i;smithi171=l;count:12 2024-08-19T00:10:09.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:09 smithi116 ceph-mon[21873]: Deploying daemon mds.l on smithi171 2024-08-19T00:10:10.410 INFO:journalctl@ceph.mds.l.smithi171.stdout:Aug 19 00:10:10 smithi171 systemd[1]: Starting Ceph mds.l for 647ded64-5dbe-11ef-bccf-c7b262605968... 2024-08-19T00:10:10.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:10 smithi044 ceph-mon[18489]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:10.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:10 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/3020877884' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:10:10.667 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:10 smithi171 ceph-mon[21810]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:10.667 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:10 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/3020877884' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:10:10.667 INFO:journalctl@ceph.mds.l.smithi171.stdout:Aug 19 00:10:10 smithi171 podman[50725]: 2024-08-19 00:10:10.411518574 +0000 UTC m=+0.017103010 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-19T00:10:10.667 INFO:journalctl@ceph.mds.l.smithi171.stdout:Aug 19 00:10:10 smithi171 podman[50725]: 2024-08-19 00:10:10.513049105 +0000 UTC m=+0.118633581 container create 3cdd98142e78c03a8610afb7c88610e8533e9c2aaec0a82f550709964d076a26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-l, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=squid-de09dd0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-08-19T00:10:10.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:10 smithi116 ceph-mon[21873]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:10.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:10 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/3020877884' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:10:11.092 INFO:journalctl@ceph.mds.l.smithi171.stdout:Aug 19 00:10:10 smithi171 podman[50725]: 2024-08-19 00:10:10.774308846 +0000 UTC m=+0.379893297 container init 3cdd98142e78c03a8610afb7c88610e8533e9c2aaec0a82f550709964d076a26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-l, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-de09dd0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.36.0) 2024-08-19T00:10:11.092 INFO:journalctl@ceph.mds.l.smithi171.stdout:Aug 19 00:10:10 smithi171 podman[50725]: 2024-08-19 00:10:10.777255265 +0000 UTC m=+0.382839699 container start 3cdd98142e78c03a8610afb7c88610e8533e9c2aaec0a82f550709964d076a26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-l, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-de09dd0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-08-19T00:10:11.092 INFO:journalctl@ceph.mds.l.smithi171.stdout:Aug 19 00:10:10 smithi171 ceph-mds[50745]: -- 172.21.15.171:0/527045049 <== mon.1 v2:172.21.15.171:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e4f6ec3860 con 0x55e4f6ea0800 2024-08-19T00:10:11.092 INFO:journalctl@ceph.mds.l.smithi171.stdout:Aug 19 00:10:10 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-l[50741]: starting mds.l at 2024-08-19T00:10:11.093 INFO:journalctl@ceph.mds.l.smithi171.stdout:Aug 19 00:10:10 smithi171 bash[50725]: 3cdd98142e78c03a8610afb7c88610e8533e9c2aaec0a82f550709964d076a26 2024-08-19T00:10:11.093 INFO:journalctl@ceph.mds.l.smithi171.stdout:Aug 19 00:10:10 smithi171 systemd[1]: Started Ceph mds.l for 647ded64-5dbe-11ef-bccf-c7b262605968. 2024-08-19T00:10:12.058 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:11 smithi116 ceph-mon[21873]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:12.058 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:11 smithi116 ceph-mon[21873]: mds.? [v2:172.21.15.171:6832/1183022838,v1:172.21.15.171:6833/1183022838] up:boot 2024-08-19T00:10:12.058 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:11 smithi116 ceph-mon[21873]: fsmap 1 up:standby 2024-08-19T00:10:12.059 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:11 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-08-19T00:10:12.059 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:11 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:12.059 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:11 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:12.059 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:11 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:12.059 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:11 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-19T00:10:12.059 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:11 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-19T00:10:12.059 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:11 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:10:12.059 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:11 smithi116 ceph-mon[21873]: Deploying daemon mds.k on smithi116 2024-08-19T00:10:12.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:11 smithi171 ceph-mon[21810]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:12.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:11 smithi171 ceph-mon[21810]: mds.? [v2:172.21.15.171:6832/1183022838,v1:172.21.15.171:6833/1183022838] up:boot 2024-08-19T00:10:12.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:11 smithi171 ceph-mon[21810]: fsmap 1 up:standby 2024-08-19T00:10:12.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:11 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-08-19T00:10:12.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:11 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:12.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:11 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:12.093 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:11 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:12.093 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:11 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-19T00:10:12.093 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:11 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-19T00:10:12.093 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:11 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:10:12.093 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:11 smithi171 ceph-mon[21810]: Deploying daemon mds.k on smithi116 2024-08-19T00:10:12.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:11 smithi044 ceph-mon[18489]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:12.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:11 smithi044 ceph-mon[18489]: mds.? [v2:172.21.15.171:6832/1183022838,v1:172.21.15.171:6833/1183022838] up:boot 2024-08-19T00:10:12.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:11 smithi044 ceph-mon[18489]: fsmap 1 up:standby 2024-08-19T00:10:12.120 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:11 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-08-19T00:10:12.120 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:11 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:12.120 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:11 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:12.120 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:11 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:12.120 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:11 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-19T00:10:12.120 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:11 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-19T00:10:12.120 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:11 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:10:12.120 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:11 smithi044 ceph-mon[18489]: Deploying daemon mds.k on smithi116 2024-08-19T00:10:12.546 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-19T00:10:12.804 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:10:13.115 INFO:journalctl@ceph.mds.k.smithi116.stdout:Aug 19 00:10:12 smithi116 systemd[1]: Starting Ceph mds.k for 647ded64-5dbe-11ef-bccf-c7b262605968... 2024-08-19T00:10:13.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:13.297+0000 7f4adb4e0640 1 -- 172.21.15.44:0/115663160 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ad4102c20 msgr2=0x7f4ad410d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:13.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:13.297+0000 7f4adb4e0640 1 --2- 172.21.15.44:0/115663160 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ad4102c20 0x7f4ad410d770 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4acc009ca0 tx=0x7f4acc02a970 comp rx=0 tx=0).stop 2024-08-19T00:10:13.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:13.297+0000 7f4adb4e0640 1 -- 172.21.15.44:0/115663160 shutdown_connections 2024-08-19T00:10:13.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:13.297+0000 7f4adb4e0640 1 --2- 172.21.15.44:0/115663160 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ad41022a0 0x7f4ad41026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:13.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:13.297+0000 7f4adb4e0640 1 --2- 172.21.15.44:0/115663160 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ad4102c20 0x7f4ad410d770 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:13.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:13.297+0000 7f4adb4e0640 1 --2- 172.21.15.44:0/115663160 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4ad4100b50 0x7f4ad4100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:13.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:13.297+0000 7f4adb4e0640 1 -- 172.21.15.44:0/115663160 >> 172.21.15.44:0/115663160 conn(0x7f4ad40fc500 msgr2=0x7f4ad40fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:10:13.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:13.297+0000 7f4adb4e0640 1 -- 172.21.15.44:0/115663160 shutdown_connections 2024-08-19T00:10:13.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:13.297+0000 7f4adb4e0640 1 -- 172.21.15.44:0/115663160 wait complete. 2024-08-19T00:10:13.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:13.298+0000 7f4adb4e0640 1 Processor -- start 2024-08-19T00:10:13.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:13.298+0000 7f4adb4e0640 1 -- start start 2024-08-19T00:10:13.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:13.298+0000 7f4adb4e0640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4ad4100b50 0x7f4ad41991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:13.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:13.298+0000 7f4adb4e0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ad41022a0 0x7f4ad41996e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:13.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:13.298+0000 7f4adb4e0640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ad4102c20 0x7f4ad41a4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:13.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:13.298+0000 7f4adb4e0640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad4110d70 con 0x7f4ad41022a0 2024-08-19T00:10:13.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:13.298+0000 7f4adb4e0640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad4110bf0 con 0x7f4ad4100b50 2024-08-19T00:10:13.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:13.298+0000 7f4adb4e0640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad4110ef0 con 0x7f4ad4102c20 2024-08-19T00:10:13.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:13.298+0000 7f4ad8a7b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ad41022a0 0x7f4ad41996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:13.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:13.298+0000 7f4ad8a7b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ad41022a0 0x7f4ad41996e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60278/0 (socket says 172.21.15.44:60278) 2024-08-19T00:10:13.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:13.298+0000 7f4ad8a7b640 1 -- 172.21.15.44:0/3789922932 learned_addr learned my addr 172.21.15.44:0/3789922932 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:10:13.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:13.298+0000 7f4ad9a7d640 1 --2- 172.21.15.44:0/3789922932 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ad4102c20 0x7f4ad41a4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:13.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:13.298+0000 7f4ad8a7b640 1 -- 172.21.15.44:0/3789922932 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ad4102c20 msgr2=0x7f4ad41a4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:13.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:13.298+0000 7f4ad8a7b640 1 --2- 172.21.15.44:0/3789922932 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ad4102c20 0x7f4ad41a4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:13.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:13.298+0000 7f4ad8a7b640 1 -- 172.21.15.44:0/3789922932 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4ad4100b50 msgr2=0x7f4ad41991a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-19T00:10:13.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:13.298+0000 7f4ad8a7b640 1 --2- 172.21.15.44:0/3789922932 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4ad4100b50 0x7f4ad41991a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:13.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:13.298+0000 7f4ad8a7b640 1 -- 172.21.15.44:0/3789922932 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ad41a4760 con 0x7f4ad41022a0 2024-08-19T00:10:13.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:13.299+0000 7f4ad8a7b640 1 --2- 172.21.15.44:0/3789922932 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ad41022a0 0x7f4ad41996e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4ad000b4a0 tx=0x7f4ad000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:10:13.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:13.299+0000 7f4ac67fc640 1 -- 172.21.15.44:0/3789922932 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad0014070 con 0x7f4ad41022a0 2024-08-19T00:10:13.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:13.299+0000 7f4ac67fc640 1 -- 172.21.15.44:0/3789922932 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ad0010af0 con 0x7f4ad41022a0 2024-08-19T00:10:13.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:13.299+0000 7f4adb4e0640 1 -- 172.21.15.44:0/3789922932 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ad41a4930 con 0x7f4ad41022a0 2024-08-19T00:10:13.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:13.299+0000 7f4ac67fc640 1 -- 172.21.15.44:0/3789922932 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad0017d10 con 0x7f4ad41022a0 2024-08-19T00:10:13.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:13.299+0000 7f4adb4e0640 1 -- 172.21.15.44:0/3789922932 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ad41a4e40 con 0x7f4ad41022a0 2024-08-19T00:10:13.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:13.300+0000 7f4adb4e0640 1 -- 172.21.15.44:0/3789922932 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ad4100fb0 con 0x7f4ad41022a0 2024-08-19T00:10:13.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:13.301+0000 7f4ac67fc640 1 -- 172.21.15.44:0/3789922932 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f4ad0017070 con 0x7f4ad41022a0 2024-08-19T00:10:13.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:13.302+0000 7f4ac67fc640 1 --2- 172.21.15.44:0/3789922932 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f4ac00a2b80 0x7f4ac00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:13.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:13.302+0000 7f4ad927c640 1 --2- 172.21.15.44:0/3789922932 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f4ac00a2b80 0x7f4ac00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:13.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:13.302+0000 7f4ac67fc640 1 -- 172.21.15.44:0/3789922932 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7f4ad00ce3a0 con 0x7f4ad41022a0 2024-08-19T00:10:13.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:13.302+0000 7f4ad927c640 1 --2- 172.21.15.44:0/3789922932 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f4ac00a2b80 0x7f4ac00a5040 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4ac8009670 tx=0x7f4ac8006bd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:10:13.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:13.305+0000 7f4ac67fc640 1 -- 172.21.15.44:0/3789922932 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f4ad009b700 con 0x7f4ad41022a0 2024-08-19T00:10:13.390 INFO:journalctl@ceph.mds.k.smithi116.stdout:Aug 19 00:10:13 smithi116 podman[50316]: 2024-08-19 00:10:13.119136701 +0000 UTC m=+0.112115849 container create 61d571ed29d810f6e0f665d1142d362144a37c4a1317f900720835f06e19554e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-k, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=squid-de09dd0, org.label-schema.build-date=20240731) 2024-08-19T00:10:13.390 INFO:journalctl@ceph.mds.k.smithi116.stdout:Aug 19 00:10:13 smithi116 podman[50316]: 2024-08-19 00:10:13.024260472 +0000 UTC m=+0.017239582 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-19T00:10:13.391 INFO:journalctl@ceph.mds.k.smithi116.stdout:Aug 19 00:10:13 smithi116 podman[50316]: 2024-08-19 00:10:13.36363682 +0000 UTC m=+0.356615929 container init 61d571ed29d810f6e0f665d1142d362144a37c4a1317f900720835f06e19554e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-k, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , RELEASE=squid-de09dd0) 2024-08-19T00:10:13.391 INFO:journalctl@ceph.mds.k.smithi116.stdout:Aug 19 00:10:13 smithi116 podman[50316]: 2024-08-19 00:10:13.366394719 +0000 UTC m=+0.359373817 container start 61d571ed29d810f6e0f665d1142d362144a37c4a1317f900720835f06e19554e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-k, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-de09dd0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-08-19T00:10:13.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:13.523+0000 7f4adb4e0640 1 -- 172.21.15.44:0/3789922932 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4ad406a290 con 0x7f4ad41022a0 2024-08-19T00:10:13.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:13.524+0000 7f4ac67fc640 1 -- 172.21.15.44:0/3789922932 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1438 (secure 0 0 0) 0x7f4ad406a290 con 0x7f4ad41022a0 2024-08-19T00:10:13.526 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:10:13.526 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":2,"btime":"2024-08-19T00:10:10:805270+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24388,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1183022838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1183022838},{"type":"v1","addr":"172.21.15.171:6833","nonce":1183022838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-08-19T00:10:13.527 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 2 2024-08-19T00:10:13.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:13.526+0000 7f4adb4e0640 1 -- 172.21.15.44:0/3789922932 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f4ac00a2b80 msgr2=0x7f4ac00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:13.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:13.526+0000 7f4adb4e0640 1 --2- 172.21.15.44:0/3789922932 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f4ac00a2b80 0x7f4ac00a5040 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4ac8009670 tx=0x7f4ac8006bd0 comp rx=0 tx=0).stop 2024-08-19T00:10:13.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:13.526+0000 7f4adb4e0640 1 -- 172.21.15.44:0/3789922932 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ad41022a0 msgr2=0x7f4ad41996e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:13.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:13.526+0000 7f4adb4e0640 1 --2- 172.21.15.44:0/3789922932 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ad41022a0 0x7f4ad41996e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4ad000b4a0 tx=0x7f4ad000b960 comp rx=0 tx=0).stop 2024-08-19T00:10:13.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:13.526+0000 7f4adb4e0640 1 -- 172.21.15.44:0/3789922932 shutdown_connections 2024-08-19T00:10:13.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:13.526+0000 7f4adb4e0640 1 --2- 172.21.15.44:0/3789922932 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f4ac00a2b80 0x7f4ac00a5040 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:13.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:13.526+0000 7f4adb4e0640 1 --2- 172.21.15.44:0/3789922932 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ad4102c20 0x7f4ad41a4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:13.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:13.526+0000 7f4adb4e0640 1 --2- 172.21.15.44:0/3789922932 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ad41022a0 0x7f4ad41996e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:13.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:13.526+0000 7f4adb4e0640 1 --2- 172.21.15.44:0/3789922932 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4ad4100b50 0x7f4ad41991a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:13.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:13.526+0000 7f4adb4e0640 1 -- 172.21.15.44:0/3789922932 >> 172.21.15.44:0/3789922932 conn(0x7f4ad40fc500 msgr2=0x7f4ad40fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:10:13.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:13.526+0000 7f4adb4e0640 1 -- 172.21.15.44:0/3789922932 shutdown_connections 2024-08-19T00:10:13.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:13.526+0000 7f4adb4e0640 1 -- 172.21.15.44:0/3789922932 wait complete. 2024-08-19T00:10:13.813 INFO:journalctl@ceph.mds.k.smithi116.stdout:Aug 19 00:10:13 smithi116 ceph-mds[50336]: -- 172.21.15.116:0/454636670 <== mon.2 v2:172.21.15.116:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562d464f5c20 con 0x562d464d2800 2024-08-19T00:10:13.813 INFO:journalctl@ceph.mds.k.smithi116.stdout:Aug 19 00:10:13 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-k[50332]: starting mds.k at 2024-08-19T00:10:13.813 INFO:journalctl@ceph.mds.k.smithi116.stdout:Aug 19 00:10:13 smithi116 bash[50316]: 61d571ed29d810f6e0f665d1142d362144a37c4a1317f900720835f06e19554e 2024-08-19T00:10:13.813 INFO:journalctl@ceph.mds.k.smithi116.stdout:Aug 19 00:10:13 smithi116 systemd[1]: Started Ceph mds.k for 647ded64-5dbe-11ef-bccf-c7b262605968. 2024-08-19T00:10:14.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:13 smithi171 ceph-mon[21810]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:14.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:13 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:14.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:13 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:14.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:13 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:14.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:13 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-19T00:10:14.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:13 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-19T00:10:14.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:13 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:10:14.093 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:13 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/3789922932' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:10:14.115 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:13 smithi044 ceph-mon[18489]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:14.115 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:13 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:14.115 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:13 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:14.115 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:13 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:14.115 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:13 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-19T00:10:14.115 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:13 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-19T00:10:14.115 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:13 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:10:14.115 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:13 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/3789922932' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:10:14.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:13 smithi116 ceph-mon[21873]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:14.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:13 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:14.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:13 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:14.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:13 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:14.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:13 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-19T00:10:14.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:13 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-19T00:10:14.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:13 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:10:14.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:13 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/3789922932' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:10:15.055 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:14 smithi044 ceph-mon[18489]: Deploying daemon mds.j on smithi044 2024-08-19T00:10:15.055 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:14 smithi044 ceph-mon[18489]: mds.? [v2:172.21.15.116:6832/1538841896,v1:172.21.15.116:6833/1538841896] up:boot 2024-08-19T00:10:15.055 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:14 smithi044 ceph-mon[18489]: fsmap 2 up:standby 2024-08-19T00:10:15.055 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:14 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-08-19T00:10:15.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:14 smithi171 ceph-mon[21810]: Deploying daemon mds.j on smithi044 2024-08-19T00:10:15.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:14 smithi171 ceph-mon[21810]: mds.? [v2:172.21.15.116:6832/1538841896,v1:172.21.15.116:6833/1538841896] up:boot 2024-08-19T00:10:15.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:14 smithi171 ceph-mon[21810]: fsmap 2 up:standby 2024-08-19T00:10:15.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:14 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-08-19T00:10:15.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:14 smithi116 ceph-mon[21873]: Deploying daemon mds.j on smithi044 2024-08-19T00:10:15.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:14 smithi116 ceph-mon[21873]: mds.? [v2:172.21.15.116:6832/1538841896,v1:172.21.15.116:6833/1538841896] up:boot 2024-08-19T00:10:15.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:14 smithi116 ceph-mon[21873]: fsmap 2 up:standby 2024-08-19T00:10:15.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:14 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-08-19T00:10:15.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:15 smithi044 ceph-mon[18489]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:16.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:15 smithi171 ceph-mon[21810]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:16.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:15 smithi116 ceph-mon[21873]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:16.144 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-19T00:10:16.443 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:10:16.569 INFO:journalctl@ceph.mds.j.smithi044.stdout:Aug 19 00:10:16 smithi044 systemd[1]: Started Ceph mds.j for 647ded64-5dbe-11ef-bccf-c7b262605968. 2024-08-19T00:10:17.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:16.995+0000 7f1a804f2640 1 -- 172.21.15.44:0/1619375646 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a78100600 msgr2=0x7f1a781009e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:17.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:16.995+0000 7f1a804f2640 1 --2- 172.21.15.44:0/1619375646 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a78100600 0x7f1a781009e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1a74009900 tx=0x7f1a7402a410 comp rx=0 tx=0).stop 2024-08-19T00:10:17.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:16.996+0000 7f1a804f2640 1 -- 172.21.15.44:0/1619375646 shutdown_connections 2024-08-19T00:10:17.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:16.996+0000 7f1a804f2640 1 --2- 172.21.15.44:0/1619375646 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1a78100fb0 0x7f1a7810dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:17.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:16.996+0000 7f1a804f2640 1 --2- 172.21.15.44:0/1619375646 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1a7810e1b0 0x7f1a781105a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:17.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:16.996+0000 7f1a804f2640 1 --2- 172.21.15.44:0/1619375646 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a78100600 0x7f1a781009e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:17.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:16.996+0000 7f1a804f2640 1 -- 172.21.15.44:0/1619375646 >> 172.21.15.44:0/1619375646 conn(0x7f1a780fc4d0 msgr2=0x7f1a780fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:10:17.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:16.996+0000 7f1a804f2640 1 -- 172.21.15.44:0/1619375646 shutdown_connections 2024-08-19T00:10:17.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:16.996+0000 7f1a804f2640 1 -- 172.21.15.44:0/1619375646 wait complete. 2024-08-19T00:10:17.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:16.996+0000 7f1a804f2640 1 Processor -- start 2024-08-19T00:10:17.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:16.996+0000 7f1a804f2640 1 -- start start 2024-08-19T00:10:17.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:16.996+0000 7f1a804f2640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1a78100600 0x7f1a7819a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:17.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:16.996+0000 7f1a804f2640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1a78100fb0 0x7f1a7819a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:17.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:16.996+0000 7f1a804f2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a7810e1b0 0x7f1a7819ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:17.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:16.996+0000 7f1a804f2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1a78113f30 con 0x7f1a7810e1b0 2024-08-19T00:10:17.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:16.996+0000 7f1a804f2640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f1a78113db0 con 0x7f1a78100600 2024-08-19T00:10:17.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:16.996+0000 7f1a804f2640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1a781140b0 con 0x7f1a78100fb0 2024-08-19T00:10:17.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:16.996+0000 7f1a7ea8f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a7810e1b0 0x7f1a7819ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:17.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:16.997+0000 7f1a7ea8f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a7810e1b0 0x7f1a7819ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60314/0 (socket says 172.21.15.44:60314) 2024-08-19T00:10:17.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:16.997+0000 7f1a7ea8f640 1 -- 172.21.15.44:0/417829139 learned_addr learned my addr 172.21.15.44:0/417829139 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:10:17.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:16.997+0000 7f1a7e28e640 1 --2- 172.21.15.44:0/417829139 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1a78100600 0x7f1a7819a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:17.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:16.997+0000 7f1a7da8d640 1 --2- 172.21.15.44:0/417829139 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1a78100fb0 0x7f1a7819a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:17.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:16.997+0000 7f1a7ea8f640 1 -- 172.21.15.44:0/417829139 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1a78100fb0 msgr2=0x7f1a7819a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:17.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:16.997+0000 7f1a7ea8f640 1 --2- 172.21.15.44:0/417829139 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1a78100fb0 0x7f1a7819a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:17.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:16.997+0000 7f1a7ea8f640 1 -- 172.21.15.44:0/417829139 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1a78100600 msgr2=0x7f1a7819a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:17.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:16.997+0000 7f1a7ea8f640 1 --2- 172.21.15.44:0/417829139 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1a78100600 0x7f1a7819a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:17.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:16.997+0000 7f1a7ea8f640 1 -- 172.21.15.44:0/417829139 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a7819f400 con 0x7f1a7810e1b0 2024-08-19T00:10:17.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:16.997+0000 7f1a7ea8f640 1 --2- 172.21.15.44:0/417829139 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a7810e1b0 0x7f1a7819ed20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1a70009fd0 tx=0x7f1a7000ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:10:17.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:16.997+0000 7f1a6f7fe640 1 -- 172.21.15.44:0/417829139 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a70004d20 con 0x7f1a7810e1b0 2024-08-19T00:10:17.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:16.997+0000 7f1a6f7fe640 1 -- 172.21.15.44:0/417829139 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a70005020 con 0x7f1a7810e1b0 2024-08-19T00:10:17.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:16.997+0000 7f1a804f2640 1 -- 172.21.15.44:0/417829139 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a7819f6f0 con 0x7f1a7810e1b0 2024-08-19T00:10:17.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:16.997+0000 7f1a804f2640 1 -- 172.21.15.44:0/417829139 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a781a6fd0 con 0x7f1a7810e1b0 2024-08-19T00:10:17.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:16.997+0000 7f1a6f7fe640 1 -- 172.21.15.44:0/417829139 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a7001f060 con 0x7f1a7810e1b0 2024-08-19T00:10:17.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:16.998+0000 7f1a804f2640 1 -- 172.21.15.44:0/417829139 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a781009e0 con 0x7f1a7810e1b0 2024-08-19T00:10:17.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:17.000+0000 7f1a6f7fe640 1 -- 172.21.15.44:0/417829139 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f1a700051d0 con 0x7f1a7810e1b0 2024-08-19T00:10:17.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:17.000+0000 7f1a6f7fe640 1 --2- 172.21.15.44:0/417829139 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f1a640a2b80 0x7f1a640a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:17.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:17.001+0000 7f1a7e28e640 1 --2- 172.21.15.44:0/417829139 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f1a640a2b80 0x7f1a640a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:17.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:17.001+0000 7f1a6f7fe640 1 -- 172.21.15.44:0/417829139 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7f1a700cf220 con 0x7f1a7810e1b0 2024-08-19T00:10:17.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:17.001+0000 7f1a7e28e640 1 --2- 172.21.15.44:0/417829139 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f1a640a2b80 0x7f1a640a5040 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1a74005ab0 tx=0x7f1a74005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:10:17.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:17.004+0000 7f1a6f7fe640 1 -- 172.21.15.44:0/417829139 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f1a70016030 con 0x7f1a7810e1b0 2024-08-19T00:10:17.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:17.224+0000 7f1a804f2640 1 -- 172.21.15.44:0/417829139 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1a78109340 con 0x7f1a7810e1b0 2024-08-19T00:10:17.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:17.224+0000 7f1a6f7fe640 1 -- 172.21.15.44:0/417829139 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3091 (secure 0 0 0) 0x7f1a7009c650 con 0x7f1a7810e1b0 2024-08-19T00:10:17.226 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:10:17.226 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":4,"btime":"2024-08-19T00:10:16:822568+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14511,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1538841896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1538841896},{"type":"v1","addr":"172.21.15.116:6833","nonce":1538841896}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/4044471606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4044471606},{"type":"v1","addr":"172.21.15.44:6835","nonce":4044471606}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24388,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1183022838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1183022838},{"type":"v1","addr":"172.21.15.171:6833","nonce":1183022838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-08-19T00:10:17.226 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 4 2024-08-19T00:10:17.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:17.226+0000 7f1a804f2640 1 -- 172.21.15.44:0/417829139 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f1a640a2b80 msgr2=0x7f1a640a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:17.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:17.226+0000 7f1a804f2640 1 --2- 172.21.15.44:0/417829139 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f1a640a2b80 0x7f1a640a5040 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1a74005ab0 tx=0x7f1a74005a20 comp rx=0 tx=0).stop 2024-08-19T00:10:17.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:17.226+0000 7f1a804f2640 1 -- 172.21.15.44:0/417829139 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a7810e1b0 msgr2=0x7f1a7819ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:17.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:17.226+0000 7f1a804f2640 1 --2- 172.21.15.44:0/417829139 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a7810e1b0 0x7f1a7819ed20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1a70009fd0 tx=0x7f1a7000ee60 comp rx=0 tx=0).stop 2024-08-19T00:10:17.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:17.226+0000 7f1a804f2640 1 -- 172.21.15.44:0/417829139 shutdown_connections 2024-08-19T00:10:17.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:17.226+0000 7f1a804f2640 1 --2- 172.21.15.44:0/417829139 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f1a640a2b80 0x7f1a640a5040 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:17.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:17.226+0000 7f1a804f2640 1 --2- 172.21.15.44:0/417829139 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1a78100fb0 0x7f1a7819a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:17.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:17.226+0000 7f1a804f2640 1 --2- 172.21.15.44:0/417829139 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a7810e1b0 0x7f1a7819ed20 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:17.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:17.226+0000 7f1a804f2640 1 --2- 172.21.15.44:0/417829139 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1a78100600 0x7f1a7819a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:17.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:17.226+0000 7f1a804f2640 1 -- 172.21.15.44:0/417829139 >> 172.21.15.44:0/417829139 conn(0x7f1a780fc4d0 msgr2=0x7f1a780fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:10:17.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:17.226+0000 7f1a804f2640 1 -- 172.21.15.44:0/417829139 shutdown_connections 2024-08-19T00:10:17.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:17.226+0000 7f1a804f2640 1 -- 172.21.15.44:0/417829139 wait complete. 2024-08-19T00:10:17.574 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:17 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:17.574 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:17 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:17.574 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:17 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:17.574 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:17 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-19T00:10:17.574 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:17 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-19T00:10:17.574 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:17 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:10:17.574 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:17 smithi044 ceph-mon[18489]: Deploying daemon mds.d on smithi044 2024-08-19T00:10:17.574 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:17 smithi044 ceph-mon[18489]: mds.? [v2:172.21.15.44:6834/4044471606,v1:172.21.15.44:6835/4044471606] up:boot 2024-08-19T00:10:17.574 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:17 smithi044 ceph-mon[18489]: fsmap 3 up:standby 2024-08-19T00:10:17.574 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:17 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-08-19T00:10:17.575 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:17 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/417829139' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:10:17.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:17 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:17.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:17 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:17.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:17 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:17.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:17 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-19T00:10:17.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:17 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-19T00:10:17.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:17 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:10:17.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:17 smithi171 ceph-mon[21810]: Deploying daemon mds.d on smithi044 2024-08-19T00:10:17.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:17 smithi171 ceph-mon[21810]: mds.? [v2:172.21.15.44:6834/4044471606,v1:172.21.15.44:6835/4044471606] up:boot 2024-08-19T00:10:17.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:17 smithi171 ceph-mon[21810]: fsmap 3 up:standby 2024-08-19T00:10:17.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:17 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-08-19T00:10:17.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:17 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/417829139' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:10:17.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:17 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:17.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:17 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:17.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:17 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:17.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:17 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-19T00:10:17.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:17 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-19T00:10:17.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:17 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:10:17.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:17 smithi116 ceph-mon[21873]: Deploying daemon mds.d on smithi044 2024-08-19T00:10:17.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:17 smithi116 ceph-mon[21873]: mds.? [v2:172.21.15.44:6834/4044471606,v1:172.21.15.44:6835/4044471606] up:boot 2024-08-19T00:10:17.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:17 smithi116 ceph-mon[21873]: fsmap 3 up:standby 2024-08-19T00:10:17.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:17 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-08-19T00:10:17.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:17 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/417829139' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:10:18.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:18 smithi044 ceph-mon[18489]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:18.744 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:18 smithi171 ceph-mon[21810]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:18.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:18 smithi116 ceph-mon[21873]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:19.369 INFO:journalctl@ceph.mds.d.smithi044.stdout:Aug 19 00:10:19 smithi044 systemd[1]: Starting Ceph mds.d for 647ded64-5dbe-11ef-bccf-c7b262605968... 2024-08-19T00:10:19.693 INFO:journalctl@ceph.mds.d.smithi044.stdout:Aug 19 00:10:19 smithi044 podman[57980]: 2024-08-19 00:10:19.334537136 +0000 UTC m=+0.017745648 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-19T00:10:19.694 INFO:journalctl@ceph.mds.d.smithi044.stdout:Aug 19 00:10:19 smithi044 podman[57980]: 2024-08-19 00:10:19.457389415 +0000 UTC m=+0.140597917 container create 7d720ee478f88c5afbeeb681804a68d49faaabe09987dc40ed7af2c99da2eefe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-d, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-de09dd0) 2024-08-19T00:10:19.694 INFO:journalctl@ceph.mds.d.smithi044.stdout:Aug 19 00:10:19 smithi044 podman[57980]: 2024-08-19 00:10:19.693341068 +0000 UTC m=+0.376549573 container init 7d720ee478f88c5afbeeb681804a68d49faaabe09987dc40ed7af2c99da2eefe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-d, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-de09dd0, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-08-19T00:10:20.119 INFO:journalctl@ceph.mds.d.smithi044.stdout:Aug 19 00:10:19 smithi044 podman[57980]: 2024-08-19 00:10:19.696281434 +0000 UTC m=+0.379489943 container start 7d720ee478f88c5afbeeb681804a68d49faaabe09987dc40ed7af2c99da2eefe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-d, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-de09dd0) 2024-08-19T00:10:20.120 INFO:journalctl@ceph.mds.d.smithi044.stdout:Aug 19 00:10:19 smithi044 ceph-mds[57999]: -- 172.21.15.44:0/2169593604 <== mon.0 v2:172.21.15.44:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5569dc88d860 con 0x5569dc86b000 2024-08-19T00:10:20.120 INFO:journalctl@ceph.mds.d.smithi044.stdout:Aug 19 00:10:19 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-d[57995]: starting mds.d at 2024-08-19T00:10:20.120 INFO:journalctl@ceph.mds.d.smithi044.stdout:Aug 19 00:10:19 smithi044 bash[57980]: 7d720ee478f88c5afbeeb681804a68d49faaabe09987dc40ed7af2c99da2eefe 2024-08-19T00:10:20.120 INFO:journalctl@ceph.mds.d.smithi044.stdout:Aug 19 00:10:19 smithi044 systemd[1]: Started Ceph mds.d for 647ded64-5dbe-11ef-bccf-c7b262605968. 2024-08-19T00:10:20.320 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-19T00:10:20.560 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:20 smithi116 ceph-mon[21873]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:20.560 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:20 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:20.560 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:20 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:20.560 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:20 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:20.560 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:20 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-19T00:10:20.561 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:20 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-19T00:10:20.561 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:20 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:10:20.588 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:10:20.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:20 smithi044 ceph-mon[18489]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:20.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:20 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:20.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:20 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:20.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:20 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:20.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:20 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-19T00:10:20.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:20 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-19T00:10:20.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:20 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:10:20.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:20 smithi171 ceph-mon[21810]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:20.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:20 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:20.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:20 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:20.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:20 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:20.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:20 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-19T00:10:20.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:20 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-19T00:10:20.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:20 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:10:21.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:21.094+0000 7fb7e3f0a640 1 -- 172.21.15.44:0/1200510865 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7dc107fd0 msgr2=0x7fb7dc10e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:21.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:21.094+0000 7fb7e3f0a640 1 --2- 172.21.15.44:0/1200510865 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7dc107fd0 0x7fb7dc10e970 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4009cd0 tx=0x7fb7d402a8e0 comp rx=0 tx=0).stop 2024-08-19T00:10:21.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:21.094+0000 7fb7e3f0a640 1 -- 172.21.15.44:0/1200510865 shutdown_connections 2024-08-19T00:10:21.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:21.094+0000 7fb7e3f0a640 1 --2- 172.21.15.44:0/1200510865 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7dc107fd0 0x7fb7dc10e970 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:21.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:21.094+0000 7fb7e3f0a640 1 --2- 172.21.15.44:0/1200510865 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb7dc103410 0x7fb7dc1078c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:21.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:21.094+0000 7fb7e3f0a640 1 --2- 172.21.15.44:0/1200510865 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7dc102a60 0x7fb7dc102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:21.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:21.094+0000 7fb7e3f0a640 1 -- 172.21.15.44:0/1200510865 >> 172.21.15.44:0/1200510865 conn(0x7fb7dc0fc500 msgr2=0x7fb7dc0fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:10:21.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:21.094+0000 7fb7e3f0a640 1 -- 172.21.15.44:0/1200510865 shutdown_connections 2024-08-19T00:10:21.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:21.094+0000 7fb7e3f0a640 1 -- 172.21.15.44:0/1200510865 wait complete. 2024-08-19T00:10:21.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:21.095+0000 7fb7e3f0a640 1 Processor -- start 2024-08-19T00:10:21.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:21.095+0000 7fb7e3f0a640 1 -- start start 2024-08-19T00:10:21.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:21.095+0000 7fb7e3f0a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7dc102a60 0x7fb7dc1982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:21.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:21.095+0000 7fb7e3f0a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7dc103410 0x7fb7dc1987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:21.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:21.095+0000 7fb7e3f0a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb7dc107fd0 0x7fb7dc19cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:21.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:21.095+0000 7fb7e3f0a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb7dc111dd0 con 0x7fb7dc102a60 2024-08-19T00:10:21.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:21.095+0000 7fb7e3f0a640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fb7dc111c50 con 0x7fb7dc107fd0 2024-08-19T00:10:21.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:21.095+0000 7fb7e3f0a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb7dc111f50 con 0x7fb7dc103410 2024-08-19T00:10:21.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:21.095+0000 7fb7e1ca6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7dc102a60 0x7fb7dc1982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:21.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:21.095+0000 7fb7e1ca6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7dc102a60 0x7fb7dc1982a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58990/0 (socket says 172.21.15.44:58990) 2024-08-19T00:10:21.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:21.095+0000 7fb7e1ca6640 1 -- 172.21.15.44:0/925655489 learned_addr learned my addr 172.21.15.44:0/925655489 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:10:21.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:21.095+0000 7fb7e24a7640 1 --2- 172.21.15.44:0/925655489 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb7dc107fd0 0x7fb7dc19cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:21.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:21.095+0000 7fb7e14a5640 1 --2- 172.21.15.44:0/925655489 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7dc103410 0x7fb7dc1987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:21.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:21.095+0000 7fb7e1ca6640 1 -- 172.21.15.44:0/925655489 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7dc103410 msgr2=0x7fb7dc1987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:21.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:21.095+0000 7fb7e1ca6640 1 --2- 172.21.15.44:0/925655489 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7dc103410 0x7fb7dc1987e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:21.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:21.095+0000 7fb7e1ca6640 1 -- 172.21.15.44:0/925655489 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb7dc107fd0 msgr2=0x7fb7dc19cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:21.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:21.095+0000 7fb7e1ca6640 1 --2- 172.21.15.44:0/925655489 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb7dc107fd0 0x7fb7dc19cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:21.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:21.095+0000 7fb7e1ca6640 1 -- 172.21.15.44:0/925655489 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7dc19d250 con 0x7fb7dc102a60 2024-08-19T00:10:21.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:21.095+0000 7fb7e24a7640 1 --2- 172.21.15.44:0/925655489 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb7dc107fd0 0x7fb7dc19cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:10:21.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:21.095+0000 7fb7e14a5640 1 --2- 172.21.15.44:0/925655489 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7dc103410 0x7fb7dc1987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:10:21.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:21.096+0000 7fb7e1ca6640 1 --2- 172.21.15.44:0/925655489 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7dc102a60 0x7fb7dc1982a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb7d800e9f0 tx=0x7fb7d800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:10:21.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:21.096+0000 7fb7d2ffd640 1 -- 172.21.15.44:0/925655489 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7d800cd80 con 0x7fb7dc102a60 2024-08-19T00:10:21.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:21.096+0000 7fb7e3f0a640 1 -- 172.21.15.44:0/925655489 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7dc19d540 con 0x7fb7dc102a60 2024-08-19T00:10:21.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:21.096+0000 7fb7d2ffd640 1 -- 172.21.15.44:0/925655489 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7d8005500 con 0x7fb7dc102a60 2024-08-19T00:10:21.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:21.096+0000 7fb7d2ffd640 1 -- 172.21.15.44:0/925655489 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7d8010690 con 0x7fb7dc102a60 2024-08-19T00:10:21.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:21.096+0000 7fb7e3f0a640 1 -- 172.21.15.44:0/925655489 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7dc1a4e20 con 0x7fb7dc102a60 2024-08-19T00:10:21.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:21.097+0000 7fb7e3f0a640 1 -- 172.21.15.44:0/925655489 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7dc102e40 con 0x7fb7dc102a60 2024-08-19T00:10:21.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:21.098+0000 7fb7d2ffd640 1 -- 172.21.15.44:0/925655489 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fb7d80046c0 con 0x7fb7dc102a60 2024-08-19T00:10:21.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:21.099+0000 7fb7d2ffd640 1 --2- 172.21.15.44:0/925655489 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fb7c80a2b80 0x7fb7c80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:21.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:21.099+0000 7fb7e14a5640 1 --2- 172.21.15.44:0/925655489 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fb7c80a2b80 0x7fb7c80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:21.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:21.099+0000 7fb7d2ffd640 1 -- 172.21.15.44:0/925655489 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7fb7d80cf350 con 0x7fb7dc102a60 2024-08-19T00:10:21.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:21.099+0000 7fb7e14a5640 1 --2- 172.21.15.44:0/925655489 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fb7c80a2b80 0x7fb7c80a5040 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc0feb10 tx=0x7fb7cc0094b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:10:21.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:21.102+0000 7fb7d2ffd640 1 -- 172.21.15.44:0/925655489 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fb7d8053df0 con 0x7fb7dc102a60 2024-08-19T00:10:21.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:21.311+0000 7fb7e3f0a640 1 -- 172.21.15.44:0/925655489 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb7dc199600 con 0x7fb7dc102a60 2024-08-19T00:10:21.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:21.312+0000 7fb7d2ffd640 1 -- 172.21.15.44:0/925655489 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3916 (secure 0 0 0) 0x7fb7d801f340 con 0x7fb7dc102a60 2024-08-19T00:10:21.314 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:10:21.314 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":5,"btime":"2024-08-19T00:10:20:445513+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14511,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1538841896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1538841896},{"type":"v1","addr":"172.21.15.116:6833","nonce":1538841896}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/4044471606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4044471606},{"type":"v1","addr":"172.21.15.44:6835","nonce":4044471606}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6837/1824829052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1824829052},{"type":"v1","addr":"172.21.15.44:6837","nonce":1824829052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24388,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1183022838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1183022838},{"type":"v1","addr":"172.21.15.171:6833","nonce":1183022838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-08-19T00:10:21.314 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 5 2024-08-19T00:10:21.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:21.314+0000 7fb7e3f0a640 1 -- 172.21.15.44:0/925655489 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fb7c80a2b80 msgr2=0x7fb7c80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:21.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:21.314+0000 7fb7e3f0a640 1 --2- 172.21.15.44:0/925655489 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fb7c80a2b80 0x7fb7c80a5040 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc0feb10 tx=0x7fb7cc0094b0 comp rx=0 tx=0).stop 2024-08-19T00:10:21.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:21.314+0000 7fb7e3f0a640 1 -- 172.21.15.44:0/925655489 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7dc102a60 msgr2=0x7fb7dc1982a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:21.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:21.314+0000 7fb7e3f0a640 1 --2- 172.21.15.44:0/925655489 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7dc102a60 0x7fb7dc1982a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb7d800e9f0 tx=0x7fb7d800edf0 comp rx=0 tx=0).stop 2024-08-19T00:10:21.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:21.314+0000 7fb7e3f0a640 1 -- 172.21.15.44:0/925655489 shutdown_connections 2024-08-19T00:10:21.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:21.314+0000 7fb7e3f0a640 1 --2- 172.21.15.44:0/925655489 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fb7c80a2b80 0x7fb7c80a5040 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:21.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:21.314+0000 7fb7e3f0a640 1 --2- 172.21.15.44:0/925655489 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7dc103410 0x7fb7dc1987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:21.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:21.314+0000 7fb7e3f0a640 1 --2- 172.21.15.44:0/925655489 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb7dc107fd0 0x7fb7dc19cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:21.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:21.314+0000 7fb7e3f0a640 1 --2- 172.21.15.44:0/925655489 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7dc102a60 0x7fb7dc1982a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:21.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:21.314+0000 7fb7e3f0a640 1 -- 172.21.15.44:0/925655489 >> 172.21.15.44:0/925655489 conn(0x7fb7dc0fc500 msgr2=0x7fb7dc105a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:10:21.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:21.314+0000 7fb7e3f0a640 1 -- 172.21.15.44:0/925655489 shutdown_connections 2024-08-19T00:10:21.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:21.314+0000 7fb7e3f0a640 1 -- 172.21.15.44:0/925655489 wait complete. 2024-08-19T00:10:21.532 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:21 smithi116 ceph-mon[21873]: Deploying daemon mds.e on smithi116 2024-08-19T00:10:21.532 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:21 smithi116 ceph-mon[21873]: mds.? [v2:172.21.15.44:6836/1824829052,v1:172.21.15.44:6837/1824829052] up:boot 2024-08-19T00:10:21.532 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:21 smithi116 ceph-mon[21873]: fsmap 4 up:standby 2024-08-19T00:10:21.532 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:21 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-08-19T00:10:21.532 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:21 smithi116 ceph-mon[21873]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:21.532 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:21 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/925655489' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:10:21.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:21 smithi044 ceph-mon[18489]: Deploying daemon mds.e on smithi116 2024-08-19T00:10:21.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:21 smithi044 ceph-mon[18489]: mds.? [v2:172.21.15.44:6836/1824829052,v1:172.21.15.44:6837/1824829052] up:boot 2024-08-19T00:10:21.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:21 smithi044 ceph-mon[18489]: fsmap 4 up:standby 2024-08-19T00:10:21.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:21 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-08-19T00:10:21.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:21 smithi044 ceph-mon[18489]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:21.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:21 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/925655489' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:10:21.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:21 smithi171 ceph-mon[21810]: Deploying daemon mds.e on smithi116 2024-08-19T00:10:21.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:21 smithi171 ceph-mon[21810]: mds.? [v2:172.21.15.44:6836/1824829052,v1:172.21.15.44:6837/1824829052] up:boot 2024-08-19T00:10:21.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:21 smithi171 ceph-mon[21810]: fsmap 4 up:standby 2024-08-19T00:10:21.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:21 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-08-19T00:10:21.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:21 smithi171 ceph-mon[21810]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:21.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:21 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/925655489' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:10:21.866 INFO:journalctl@ceph.mds.e.smithi116.stdout:Aug 19 00:10:21 smithi116 systemd[1]: Starting Ceph mds.e for 647ded64-5dbe-11ef-bccf-c7b262605968... 2024-08-19T00:10:22.188 INFO:journalctl@ceph.mds.e.smithi116.stdout:Aug 19 00:10:21 smithi116 podman[50634]: 2024-08-19 00:10:21.828282144 +0000 UTC m=+0.017469406 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-19T00:10:22.188 INFO:journalctl@ceph.mds.e.smithi116.stdout:Aug 19 00:10:21 smithi116 podman[50634]: 2024-08-19 00:10:21.933248301 +0000 UTC m=+0.122435550 container create 36f3dfd2ee355c9d23e183edd87a3e78f7bb85e125a1f292b8a571e701942ed3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-e, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, RELEASE=squid-de09dd0, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-08-19T00:10:22.188 INFO:journalctl@ceph.mds.e.smithi116.stdout:Aug 19 00:10:22 smithi116 podman[50634]: 2024-08-19 00:10:22.160920587 +0000 UTC m=+0.350107837 container init 36f3dfd2ee355c9d23e183edd87a3e78f7bb85e125a1f292b8a571e701942ed3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-de09dd0, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-19T00:10:22.188 INFO:journalctl@ceph.mds.e.smithi116.stdout:Aug 19 00:10:22 smithi116 podman[50634]: 2024-08-19 00:10:22.163762597 +0000 UTC m=+0.352949849 container start 36f3dfd2ee355c9d23e183edd87a3e78f7bb85e125a1f292b8a571e701942ed3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-e, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-de09dd0, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-19T00:10:22.188 INFO:journalctl@ceph.mds.e.smithi116.stdout:Aug 19 00:10:22 smithi116 ceph-mds[50653]: -- 172.21.15.116:0/3413273806 <== mon.2 v2:172.21.15.116:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5594a5f7d860 con 0x5594a5f5b400 2024-08-19T00:10:22.615 INFO:journalctl@ceph.mds.e.smithi116.stdout:Aug 19 00:10:22 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-e[50649]: starting mds.e at 2024-08-19T00:10:22.615 INFO:journalctl@ceph.mds.e.smithi116.stdout:Aug 19 00:10:22 smithi116 bash[50634]: 36f3dfd2ee355c9d23e183edd87a3e78f7bb85e125a1f292b8a571e701942ed3 2024-08-19T00:10:22.615 INFO:journalctl@ceph.mds.e.smithi116.stdout:Aug 19 00:10:22 smithi116 systemd[1]: Started Ceph mds.e for 647ded64-5dbe-11ef-bccf-c7b262605968. 2024-08-19T00:10:23.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:23 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:23.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:23 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:23.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:23 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:23.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:23 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-19T00:10:23.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:23 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-19T00:10:23.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:23 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:10:23.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:23 smithi171 ceph-mon[21810]: Deploying daemon mds.f on smithi171 2024-08-19T00:10:23.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:23 smithi171 ceph-mon[21810]: mds.? [v2:172.21.15.116:6834/3507399322,v1:172.21.15.116:6835/3507399322] up:boot 2024-08-19T00:10:23.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:23 smithi171 ceph-mon[21810]: fsmap 5 up:standby 2024-08-19T00:10:23.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:23 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-08-19T00:10:23.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:23 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:23.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:23 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:23.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:23 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:23.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:23 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-19T00:10:23.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:23 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-19T00:10:23.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:23 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:10:23.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:23 smithi116 ceph-mon[21873]: Deploying daemon mds.f on smithi171 2024-08-19T00:10:23.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:23 smithi116 ceph-mon[21873]: mds.? [v2:172.21.15.116:6834/3507399322,v1:172.21.15.116:6835/3507399322] up:boot 2024-08-19T00:10:23.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:23 smithi116 ceph-mon[21873]: fsmap 5 up:standby 2024-08-19T00:10:23.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:23 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-08-19T00:10:23.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:23 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:23.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:23 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:23.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:23 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:23.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:23 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-19T00:10:23.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:23 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-19T00:10:23.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:23 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:10:23.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:23 smithi044 ceph-mon[18489]: Deploying daemon mds.f on smithi171 2024-08-19T00:10:23.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:23 smithi044 ceph-mon[18489]: mds.? [v2:172.21.15.116:6834/3507399322,v1:172.21.15.116:6835/3507399322] up:boot 2024-08-19T00:10:23.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:23 smithi044 ceph-mon[18489]: fsmap 5 up:standby 2024-08-19T00:10:23.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:23 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-08-19T00:10:23.990 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-19T00:10:24.258 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:10:24.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:24 smithi171 ceph-mon[21810]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:24.592 INFO:journalctl@ceph.mds.f.smithi171.stdout:Aug 19 00:10:24 smithi171 systemd[1]: Starting Ceph mds.f for 647ded64-5dbe-11ef-bccf-c7b262605968... 2024-08-19T00:10:24.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:24 smithi116 ceph-mon[21873]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:24.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:24 smithi044 ceph-mon[18489]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:24.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:24.728+0000 7f6d05c91640 1 -- 172.21.15.44:0/1525273233 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d00100f50 msgr2=0x7f6d001013b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:24.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:24.728+0000 7f6d05c91640 1 --2- 172.21.15.44:0/1525273233 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d00100f50 0x7f6d001013b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4009900 tx=0x7f6cf402a410 comp rx=0 tx=0).stop 2024-08-19T00:10:24.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:24.728+0000 7f6d05c91640 1 -- 172.21.15.44:0/1525273233 shutdown_connections 2024-08-19T00:10:24.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:24.728+0000 7f6d05c91640 1 --2- 172.21.15.44:0/1525273233 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6d001018f0 0x7f6d0010d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:24.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:24.728+0000 7f6d05c91640 1 --2- 172.21.15.44:0/1525273233 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d00100f50 0x7f6d001013b0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:24.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:24.728+0000 7f6d05c91640 1 --2- 172.21.15.44:0/1525273233 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6d00105780 0x7f6d00105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:24.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:24.728+0000 7f6d05c91640 1 -- 172.21.15.44:0/1525273233 >> 172.21.15.44:0/1525273233 conn(0x7f6d000fbc10 msgr2=0x7f6d000fe030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:10:24.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:24.728+0000 7f6d05c91640 1 -- 172.21.15.44:0/1525273233 shutdown_connections 2024-08-19T00:10:24.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:24.728+0000 7f6d05c91640 1 -- 172.21.15.44:0/1525273233 wait complete. 2024-08-19T00:10:24.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:24.728+0000 7f6d05c91640 1 Processor -- start 2024-08-19T00:10:24.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:24.729+0000 7f6d05c91640 1 -- start start 2024-08-19T00:10:24.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:24.729+0000 7f6d05c91640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d00100f50 0x7f6d00198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:24.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:24.729+0000 7f6d05c91640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6d001018f0 0x7f6d00198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:24.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:24.729+0000 7f6d05c91640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6d00105780 0x7f6d0019cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:24.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:24.729+0000 7f6d05c91640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6d00111d60 con 0x7f6d00100f50 2024-08-19T00:10:24.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:24.729+0000 7f6d05c91640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f6d00111be0 con 0x7f6d00105780 2024-08-19T00:10:24.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:24.729+0000 7f6d05c91640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6d00111ee0 con 0x7f6d001018f0 2024-08-19T00:10:24.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:24.729+0000 7f6cff7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d00100f50 0x7f6d00198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:24.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:24.729+0000 7f6cff7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d00100f50 0x7f6d00198300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59002/0 (socket says 172.21.15.44:59002) 2024-08-19T00:10:24.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:24.729+0000 7f6cff7fe640 1 -- 172.21.15.44:0/2839714600 learned_addr learned my addr 172.21.15.44:0/2839714600 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:10:24.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:24.729+0000 7f6cfeffd640 1 --2- 172.21.15.44:0/2839714600 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6d001018f0 0x7f6d00198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:24.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:24.729+0000 7f6cff7fe640 1 -- 172.21.15.44:0/2839714600 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6d001018f0 msgr2=0x7f6d00198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:24.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:24.729+0000 7f6cff7fe640 1 --2- 172.21.15.44:0/2839714600 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6d001018f0 0x7f6d00198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:24.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:24.729+0000 7f6cff7fe640 1 -- 172.21.15.44:0/2839714600 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6d00105780 msgr2=0x7f6d0019cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:24.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:24.729+0000 7f6cfffff640 1 --2- 172.21.15.44:0/2839714600 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6d00105780 0x7f6d0019cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:24.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:24.729+0000 7f6cff7fe640 1 --2- 172.21.15.44:0/2839714600 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6d00105780 0x7f6d0019cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:24.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:24.729+0000 7f6cff7fe640 1 -- 172.21.15.44:0/2839714600 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d0019d2b0 con 0x7f6d00100f50 2024-08-19T00:10:24.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:24.729+0000 7f6cfeffd640 1 --2- 172.21.15.44:0/2839714600 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6d001018f0 0x7f6d00198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:10:24.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:24.729+0000 7f6cfffff640 1 --2- 172.21.15.44:0/2839714600 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6d00105780 0x7f6d0019cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:10:24.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:24.729+0000 7f6cff7fe640 1 --2- 172.21.15.44:0/2839714600 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d00100f50 0x7f6d00198300 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6cf000b450 tx=0x7f6cf000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:10:24.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:24.730+0000 7f6cfcff9640 1 -- 172.21.15.44:0/2839714600 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf0015020 con 0x7f6d00100f50 2024-08-19T00:10:24.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:24.730+0000 7f6cfcff9640 1 -- 172.21.15.44:0/2839714600 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6cf0011d70 con 0x7f6d00100f50 2024-08-19T00:10:24.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:24.730+0000 7f6cfcff9640 1 -- 172.21.15.44:0/2839714600 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf000f340 con 0x7f6d00100f50 2024-08-19T00:10:24.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:24.730+0000 7f6d05c91640 1 -- 172.21.15.44:0/2839714600 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d0019d5a0 con 0x7f6d00100f50 2024-08-19T00:10:24.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:24.730+0000 7f6d05c91640 1 -- 172.21.15.44:0/2839714600 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d001a4e80 con 0x7f6d00100f50 2024-08-19T00:10:24.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:24.731+0000 7f6d05c91640 1 -- 172.21.15.44:0/2839714600 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d00101430 con 0x7f6d00100f50 2024-08-19T00:10:24.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:24.732+0000 7f6cfcff9640 1 -- 172.21.15.44:0/2839714600 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f6cf0018020 con 0x7f6d00100f50 2024-08-19T00:10:24.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:24.732+0000 7f6cfcff9640 1 --2- 172.21.15.44:0/2839714600 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f6ce80a2c00 0x7f6ce80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:24.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:24.732+0000 7f6cfeffd640 1 --2- 172.21.15.44:0/2839714600 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f6ce80a2c00 0x7f6ce80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:24.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:24.732+0000 7f6cfcff9640 1 -- 172.21.15.44:0/2839714600 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7f6cf00ce700 con 0x7f6d00100f50 2024-08-19T00:10:24.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:24.733+0000 7f6cfeffd640 1 --2- 172.21.15.44:0/2839714600 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f6ce80a2c00 0x7f6ce80a50c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6cf40096c0 tx=0x7f6cf4032d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:10:24.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:24.737+0000 7f6cfcff9640 1 -- 172.21.15.44:0/2839714600 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f6cf001f020 con 0x7f6d00100f50 2024-08-19T00:10:24.854 INFO:journalctl@ceph.mds.f.smithi171.stdout:Aug 19 00:10:24 smithi171 podman[51039]: 2024-08-19 00:10:24.495233816 +0000 UTC m=+0.017389470 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-19T00:10:24.854 INFO:journalctl@ceph.mds.f.smithi171.stdout:Aug 19 00:10:24 smithi171 podman[51039]: 2024-08-19 00:10:24.609157899 +0000 UTC m=+0.131313539 container create b2b25b19b9c7c94a64650830031b6a78ff02babcc52acafc6c6f75bde7208fa9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-f, RELEASE=squid-de09dd0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-19T00:10:24.854 INFO:journalctl@ceph.mds.f.smithi171.stdout:Aug 19 00:10:24 smithi171 podman[51039]: 2024-08-19 00:10:24.853746152 +0000 UTC m=+0.375901802 container init b2b25b19b9c7c94a64650830031b6a78ff02babcc52acafc6c6f75bde7208fa9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-f, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-de09dd0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-19T00:10:24.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:24.947+0000 7f6d05c91640 1 -- 172.21.15.44:0/2839714600 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6d00108cc0 con 0x7f6d00100f50 2024-08-19T00:10:24.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:24.948+0000 7f6cfcff9640 1 -- 172.21.15.44:0/2839714600 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4744 (secure 0 0 0) 0x7f6cf000d040 con 0x7f6d00100f50 2024-08-19T00:10:24.949 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:10:24.950 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":6,"btime":"2024-08-19T00:10:22:457145+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14511,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1538841896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1538841896},{"type":"v1","addr":"172.21.15.116:6833","nonce":1538841896}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/4044471606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4044471606},{"type":"v1","addr":"172.21.15.44:6835","nonce":4044471606}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6837/1824829052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1824829052},{"type":"v1","addr":"172.21.15.44:6837","nonce":1824829052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24388,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1183022838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1183022838},{"type":"v1","addr":"172.21.15.171:6833","nonce":1183022838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3507399322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3507399322},{"type":"v1","addr":"172.21.15.116:6835","nonce":3507399322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-08-19T00:10:24.950 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 6 2024-08-19T00:10:24.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:24.950+0000 7f6d05c91640 1 -- 172.21.15.44:0/2839714600 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f6ce80a2c00 msgr2=0x7f6ce80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:24.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:24.950+0000 7f6d05c91640 1 --2- 172.21.15.44:0/2839714600 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f6ce80a2c00 0x7f6ce80a50c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6cf40096c0 tx=0x7f6cf4032d50 comp rx=0 tx=0).stop 2024-08-19T00:10:24.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:24.950+0000 7f6d05c91640 1 -- 172.21.15.44:0/2839714600 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d00100f50 msgr2=0x7f6d00198300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:24.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:24.950+0000 7f6d05c91640 1 --2- 172.21.15.44:0/2839714600 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d00100f50 0x7f6d00198300 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6cf000b450 tx=0x7f6cf000b910 comp rx=0 tx=0).stop 2024-08-19T00:10:24.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:24.950+0000 7f6d05c91640 1 -- 172.21.15.44:0/2839714600 shutdown_connections 2024-08-19T00:10:24.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:24.950+0000 7f6d05c91640 1 --2- 172.21.15.44:0/2839714600 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f6ce80a2c00 0x7f6ce80a50c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:24.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:24.950+0000 7f6d05c91640 1 --2- 172.21.15.44:0/2839714600 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6d001018f0 0x7f6d00198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:24.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:24.950+0000 7f6d05c91640 1 --2- 172.21.15.44:0/2839714600 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6d00105780 0x7f6d0019cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:24.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:24.950+0000 7f6d05c91640 1 --2- 172.21.15.44:0/2839714600 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d00100f50 0x7f6d00198300 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:24.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:24.950+0000 7f6d05c91640 1 -- 172.21.15.44:0/2839714600 >> 172.21.15.44:0/2839714600 conn(0x7f6d000fbc10 msgr2=0x7f6d000fc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:10:24.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:24.950+0000 7f6d05c91640 1 -- 172.21.15.44:0/2839714600 shutdown_connections 2024-08-19T00:10:24.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:24.950+0000 7f6d05c91640 1 -- 172.21.15.44:0/2839714600 wait complete. 2024-08-19T00:10:25.342 INFO:journalctl@ceph.mds.f.smithi171.stdout:Aug 19 00:10:24 smithi171 podman[51039]: 2024-08-19 00:10:24.856985395 +0000 UTC m=+0.379141041 container start b2b25b19b9c7c94a64650830031b6a78ff02babcc52acafc6c6f75bde7208fa9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-f, ceph=True, RELEASE=squid-de09dd0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-08-19T00:10:25.342 INFO:journalctl@ceph.mds.f.smithi171.stdout:Aug 19 00:10:24 smithi171 ceph-mds[51058]: -- 172.21.15.171:0/3915021523 <== mon.1 v2:172.21.15.171:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5591c1c03860 con 0x5591c1be1000 2024-08-19T00:10:25.342 INFO:journalctl@ceph.mds.f.smithi171.stdout:Aug 19 00:10:24 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-f[51054]: starting mds.f at 2024-08-19T00:10:25.342 INFO:journalctl@ceph.mds.f.smithi171.stdout:Aug 19 00:10:24 smithi171 bash[51039]: b2b25b19b9c7c94a64650830031b6a78ff02babcc52acafc6c6f75bde7208fa9 2024-08-19T00:10:25.342 INFO:journalctl@ceph.mds.f.smithi171.stdout:Aug 19 00:10:24 smithi171 systemd[1]: Started Ceph mds.f for 647ded64-5dbe-11ef-bccf-c7b262605968. 2024-08-19T00:10:25.602 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:25 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/2839714600' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:10:25.603 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:25 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:25.603 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:25 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:25.603 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:25 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:25.603 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:25 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-19T00:10:25.603 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:25 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-19T00:10:25.603 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:25 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:10:25.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:25 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/2839714600' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:10:25.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:25 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:25.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:25 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:25.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:25 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:25.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:25 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-19T00:10:25.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:25 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-19T00:10:25.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:25 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:10:25.691 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:25 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/2839714600' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:10:25.692 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:25 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:25.692 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:25 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:25.692 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:25 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:25.692 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:25 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-19T00:10:25.692 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:25 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-19T00:10:25.692 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:25 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:10:26.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:26 smithi116 ceph-mon[21873]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:26.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:26 smithi116 ceph-mon[21873]: Deploying daemon mds.c on smithi171 2024-08-19T00:10:26.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:26 smithi116 ceph-mon[21873]: mds.? [v2:172.21.15.171:6834/2190623851,v1:172.21.15.171:6835/2190623851] up:boot 2024-08-19T00:10:26.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:26 smithi116 ceph-mon[21873]: fsmap 6 up:standby 2024-08-19T00:10:26.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:26 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-08-19T00:10:26.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:26 smithi044 ceph-mon[18489]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:26.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:26 smithi044 ceph-mon[18489]: Deploying daemon mds.c on smithi171 2024-08-19T00:10:26.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:26 smithi044 ceph-mon[18489]: mds.? [v2:172.21.15.171:6834/2190623851,v1:172.21.15.171:6835/2190623851] up:boot 2024-08-19T00:10:26.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:26 smithi044 ceph-mon[18489]: fsmap 6 up:standby 2024-08-19T00:10:26.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:26 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-08-19T00:10:26.671 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:26 smithi171 ceph-mon[21810]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:26.671 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:26 smithi171 ceph-mon[21810]: Deploying daemon mds.c on smithi171 2024-08-19T00:10:26.671 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:26 smithi171 ceph-mon[21810]: mds.? [v2:172.21.15.171:6834/2190623851,v1:172.21.15.171:6835/2190623851] up:boot 2024-08-19T00:10:26.672 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:26 smithi171 ceph-mon[21810]: fsmap 6 up:standby 2024-08-19T00:10:26.672 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:26 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-08-19T00:10:27.082 INFO:journalctl@ceph.mds.c.smithi171.stdout:Aug 19 00:10:26 smithi171 systemd[1]: Starting Ceph mds.c for 647ded64-5dbe-11ef-bccf-c7b262605968... 2024-08-19T00:10:27.343 INFO:journalctl@ceph.mds.c.smithi171.stdout:Aug 19 00:10:27 smithi171 podman[51343]: 2024-08-19 00:10:26.98349339 +0000 UTC m=+0.017404599 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-19T00:10:27.343 INFO:journalctl@ceph.mds.c.smithi171.stdout:Aug 19 00:10:27 smithi171 podman[51343]: 2024-08-19 00:10:27.097864738 +0000 UTC m=+0.131775979 container create d71015e120d6e680778c47828715354adba6bd03589b120a058b2d992a7d73dd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-c, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-de09dd0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-08-19T00:10:27.343 INFO:journalctl@ceph.mds.c.smithi171.stdout:Aug 19 00:10:27 smithi171 podman[51343]: 2024-08-19 00:10:27.300494883 +0000 UTC m=+0.334406089 container init d71015e120d6e680778c47828715354adba6bd03589b120a058b2d992a7d73dd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-c, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=squid-de09dd0, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-08-19T00:10:27.343 INFO:journalctl@ceph.mds.c.smithi171.stdout:Aug 19 00:10:27 smithi171 podman[51343]: 2024-08-19 00:10:27.303242299 +0000 UTC m=+0.337153494 container start d71015e120d6e680778c47828715354adba6bd03589b120a058b2d992a7d73dd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-c, RELEASE=squid-de09dd0, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-08-19T00:10:27.343 INFO:journalctl@ceph.mds.c.smithi171.stdout:Aug 19 00:10:27 smithi171 ceph-mds[51363]: -- 172.21.15.171:0/3983886428 <== mon.1 v2:172.21.15.171:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555c373b5860 con 0x555c37393400 2024-08-19T00:10:27.343 INFO:journalctl@ceph.mds.c.smithi171.stdout:Aug 19 00:10:27 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-c[51359]: starting mds.c at 2024-08-19T00:10:27.631 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-19T00:10:27.842 INFO:journalctl@ceph.mds.c.smithi171.stdout:Aug 19 00:10:27 smithi171 bash[51343]: d71015e120d6e680778c47828715354adba6bd03589b120a058b2d992a7d73dd 2024-08-19T00:10:27.842 INFO:journalctl@ceph.mds.c.smithi171.stdout:Aug 19 00:10:27 smithi171 systemd[1]: Started Ceph mds.c for 647ded64-5dbe-11ef-bccf-c7b262605968. 2024-08-19T00:10:27.899 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:10:28.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:28.360+0000 7f7e6846f640 1 -- 172.21.15.44:0/1944692276 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e60108030 msgr2=0x7f7e6010e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:28.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:28.360+0000 7f7e6846f640 1 --2- 172.21.15.44:0/1944692276 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e60108030 0x7f7e6010e9a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7e58009cd0 tx=0x7f7e5802a8d0 comp rx=0 tx=0).stop 2024-08-19T00:10:28.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:28.360+0000 7f7e6846f640 1 -- 172.21.15.44:0/1944692276 shutdown_connections 2024-08-19T00:10:28.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:28.360+0000 7f7e6846f640 1 --2- 172.21.15.44:0/1944692276 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7e601034b0 0x7f7e601078f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:28.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:28.360+0000 7f7e6846f640 1 --2- 172.21.15.44:0/1944692276 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e60108030 0x7f7e6010e9a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:28.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:28.360+0000 7f7e6846f640 1 --2- 172.21.15.44:0/1944692276 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7e60102b00 0x7f7e60102ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:28.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:28.360+0000 7f7e6846f640 1 -- 172.21.15.44:0/1944692276 >> 172.21.15.44:0/1944692276 conn(0x7f7e600fc500 msgr2=0x7f7e600fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:10:28.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:28.360+0000 7f7e6846f640 1 -- 172.21.15.44:0/1944692276 shutdown_connections 2024-08-19T00:10:28.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:28.360+0000 7f7e6846f640 1 -- 172.21.15.44:0/1944692276 wait complete. 2024-08-19T00:10:28.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:28.360+0000 7f7e6846f640 1 Processor -- start 2024-08-19T00:10:28.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:28.360+0000 7f7e6846f640 1 -- start start 2024-08-19T00:10:28.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:28.361+0000 7f7e6846f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7e60102b00 0x7f7e60100760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:28.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:28.361+0000 7f7e6846f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e601034b0 0x7f7e60100ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:28.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:28.361+0000 7f7e6846f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7e60108030 0x7f7e601011e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:28.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:28.361+0000 7f7e6846f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7e60111e00 con 0x7f7e601034b0 2024-08-19T00:10:28.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:28.361+0000 7f7e6846f640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f7e60111c80 con 0x7f7e60108030 2024-08-19T00:10:28.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:28.361+0000 7f7e6846f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7e60111f80 con 0x7f7e60102b00 2024-08-19T00:10:28.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:28.361+0000 7f7e65a0a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e601034b0 0x7f7e60100ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:28.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:28.361+0000 7f7e65a0a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e601034b0 0x7f7e60100ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59018/0 (socket says 172.21.15.44:59018) 2024-08-19T00:10:28.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:28.361+0000 7f7e65a0a640 1 -- 172.21.15.44:0/2718632360 learned_addr learned my addr 172.21.15.44:0/2718632360 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:10:28.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:28.361+0000 7f7e66a0c640 1 --2- 172.21.15.44:0/2718632360 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7e60108030 0x7f7e601011e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:28.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:28.361+0000 7f7e6620b640 1 --2- 172.21.15.44:0/2718632360 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7e60102b00 0x7f7e60100760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:28.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:28.361+0000 7f7e65a0a640 1 -- 172.21.15.44:0/2718632360 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7e60102b00 msgr2=0x7f7e60100760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:28.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:28.361+0000 7f7e65a0a640 1 --2- 172.21.15.44:0/2718632360 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7e60102b00 0x7f7e60100760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:28.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:28.361+0000 7f7e65a0a640 1 -- 172.21.15.44:0/2718632360 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7e60108030 msgr2=0x7f7e601011e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:28.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:28.361+0000 7f7e65a0a640 1 --2- 172.21.15.44:0/2718632360 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7e60108030 0x7f7e601011e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:28.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:28.361+0000 7f7e65a0a640 1 -- 172.21.15.44:0/2718632360 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e601a6720 con 0x7f7e601034b0 2024-08-19T00:10:28.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:28.361+0000 7f7e65a0a640 1 --2- 172.21.15.44:0/2718632360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e601034b0 0x7f7e60100ca0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7e5000d740 tx=0x7f7e5000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:10:28.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:28.361+0000 7f7e577fe640 1 -- 172.21.15.44:0/2718632360 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e50017070 con 0x7f7e601034b0 2024-08-19T00:10:28.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:28.361+0000 7f7e577fe640 1 -- 172.21.15.44:0/2718632360 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e5000de50 con 0x7f7e601034b0 2024-08-19T00:10:28.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:28.361+0000 7f7e6846f640 1 -- 172.21.15.44:0/2718632360 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e601a6a10 con 0x7f7e601034b0 2024-08-19T00:10:28.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:28.361+0000 7f7e577fe640 1 -- 172.21.15.44:0/2718632360 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e5000f6b0 con 0x7f7e601034b0 2024-08-19T00:10:28.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:28.362+0000 7f7e6846f640 1 -- 172.21.15.44:0/2718632360 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e601a6fa0 con 0x7f7e601034b0 2024-08-19T00:10:28.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:28.363+0000 7f7e6846f640 1 -- 172.21.15.44:0/2718632360 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e60102ee0 con 0x7f7e601034b0 2024-08-19T00:10:28.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:28.363+0000 7f7e577fe640 1 -- 172.21.15.44:0/2718632360 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f7e5001a070 con 0x7f7e601034b0 2024-08-19T00:10:28.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:28.364+0000 7f7e577fe640 1 --2- 172.21.15.44:0/2718632360 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f7e4c0a2c00 0x7f7e4c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:28.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:28.364+0000 7f7e6620b640 1 --2- 172.21.15.44:0/2718632360 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f7e4c0a2c00 0x7f7e4c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:28.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:28.364+0000 7f7e577fe640 1 -- 172.21.15.44:0/2718632360 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7f7e500ce430 con 0x7f7e601034b0 2024-08-19T00:10:28.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:28.365+0000 7f7e6620b640 1 --2- 172.21.15.44:0/2718632360 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f7e4c0a2c00 0x7f7e4c0a50c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c009bd0 tx=0x7f7e5c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:10:28.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:28.368+0000 7f7e577fe640 1 -- 172.21.15.44:0/2718632360 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f7e5009b1e0 con 0x7f7e601034b0 2024-08-19T00:10:28.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:28.579+0000 7f7e6846f640 1 -- 172.21.15.44:0/2718632360 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7e6010a010 con 0x7f7e601034b0 2024-08-19T00:10:28.581 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:28 smithi044 ceph-mon[18489]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:28.581 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:28 smithi044 ceph-mon[18489]: mds.? [v2:172.21.15.171:6836/316231795,v1:172.21.15.171:6837/316231795] up:boot 2024-08-19T00:10:28.581 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:28 smithi044 ceph-mon[18489]: fsmap 7 up:standby 2024-08-19T00:10:28.582 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:28 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-08-19T00:10:28.582 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:28 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:28.582 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:28 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:28.582 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:28 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:28.582 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:28 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-19T00:10:28.582 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:28 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-19T00:10:28.582 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:28 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:10:28.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:28.580+0000 7f7e577fe640 1 -- 172.21.15.44:0/2718632360 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6397 (secure 0 0 0) 0x7f7e5009f4e0 con 0x7f7e601034b0 2024-08-19T00:10:28.583 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:10:28.583 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":8,"btime":"2024-08-19T00:10:27:345411+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14511,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1538841896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1538841896},{"type":"v1","addr":"172.21.15.116:6833","nonce":1538841896}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/4044471606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4044471606},{"type":"v1","addr":"172.21.15.44:6835","nonce":4044471606}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6837/1824829052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1824829052},{"type":"v1","addr":"172.21.15.44:6837","nonce":1824829052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24388,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1183022838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1183022838},{"type":"v1","addr":"172.21.15.171:6833","nonce":1183022838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24412,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6835/2190623851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":2190623851},{"type":"v1","addr":"172.21.15.171:6835","nonce":2190623851}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24418,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/316231795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":316231795},{"type":"v1","addr":"172.21.15.171:6837","nonce":316231795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24431,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3507399322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3507399322},{"type":"v1","addr":"172.21.15.116:6835","nonce":3507399322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-08-19T00:10:28.584 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 8 2024-08-19T00:10:28.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:28.582+0000 7f7e6846f640 1 -- 172.21.15.44:0/2718632360 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f7e4c0a2c00 msgr2=0x7f7e4c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:28.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:28.582+0000 7f7e6846f640 1 --2- 172.21.15.44:0/2718632360 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f7e4c0a2c00 0x7f7e4c0a50c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c009bd0 tx=0x7f7e5c005f90 comp rx=0 tx=0).stop 2024-08-19T00:10:28.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:28.582+0000 7f7e6846f640 1 -- 172.21.15.44:0/2718632360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e601034b0 msgr2=0x7f7e60100ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:28.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:28.582+0000 7f7e6846f640 1 --2- 172.21.15.44:0/2718632360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e601034b0 0x7f7e60100ca0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7e5000d740 tx=0x7f7e5000dc00 comp rx=0 tx=0).stop 2024-08-19T00:10:28.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:28.582+0000 7f7e6846f640 1 -- 172.21.15.44:0/2718632360 shutdown_connections 2024-08-19T00:10:28.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:28.582+0000 7f7e6846f640 1 --2- 172.21.15.44:0/2718632360 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f7e4c0a2c00 0x7f7e4c0a50c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:28.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:28.582+0000 7f7e6846f640 1 --2- 172.21.15.44:0/2718632360 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7e60108030 0x7f7e601011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:28.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:28.582+0000 7f7e6846f640 1 --2- 172.21.15.44:0/2718632360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e601034b0 0x7f7e60100ca0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:28.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:28.582+0000 7f7e6846f640 1 --2- 172.21.15.44:0/2718632360 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7e60102b00 0x7f7e60100760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:28.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:28.582+0000 7f7e6846f640 1 -- 172.21.15.44:0/2718632360 >> 172.21.15.44:0/2718632360 conn(0x7f7e600fc500 msgr2=0x7f7e601060c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:10:28.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:28.582+0000 7f7e6846f640 1 -- 172.21.15.44:0/2718632360 shutdown_connections 2024-08-19T00:10:28.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:28.582+0000 7f7e6846f640 1 -- 172.21.15.44:0/2718632360 wait complete. 2024-08-19T00:10:28.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:28 smithi116 ceph-mon[21873]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:28.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:28 smithi116 ceph-mon[21873]: mds.? [v2:172.21.15.171:6836/316231795,v1:172.21.15.171:6837/316231795] up:boot 2024-08-19T00:10:28.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:28 smithi116 ceph-mon[21873]: fsmap 7 up:standby 2024-08-19T00:10:28.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:28 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-08-19T00:10:28.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:28 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:28.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:28 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:28.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:28 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:28.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:28 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-19T00:10:28.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:28 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-19T00:10:28.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:28 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:10:28.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:28 smithi171 ceph-mon[21810]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:28.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:28 smithi171 ceph-mon[21810]: mds.? [v2:172.21.15.171:6836/316231795,v1:172.21.15.171:6837/316231795] up:boot 2024-08-19T00:10:28.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:28 smithi171 ceph-mon[21810]: fsmap 7 up:standby 2024-08-19T00:10:28.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:28 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-08-19T00:10:28.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:28 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:28.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:28 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:28.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:28 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:28.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:28 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-19T00:10:28.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:28 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-19T00:10:28.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:28 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:10:29.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:29 smithi116 ceph-mon[21873]: Deploying daemon mds.h on smithi116 2024-08-19T00:10:29.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:29 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/2718632360' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:10:29.616 INFO:journalctl@ceph.mds.h.smithi116.stdout:Aug 19 00:10:29 smithi116 systemd[1]: Starting Ceph mds.h for 647ded64-5dbe-11ef-bccf-c7b262605968... 2024-08-19T00:10:29.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:29 smithi044 ceph-mon[18489]: Deploying daemon mds.h on smithi116 2024-08-19T00:10:29.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:29 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/2718632360' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:10:29.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:29 smithi171 ceph-mon[21810]: Deploying daemon mds.h on smithi116 2024-08-19T00:10:29.794 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:29 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/2718632360' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:10:29.865 INFO:journalctl@ceph.mds.h.smithi116.stdout:Aug 19 00:10:29 smithi116 podman[50934]: 2024-08-19 00:10:29.517239407 +0000 UTC m=+0.017637387 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-19T00:10:29.865 INFO:journalctl@ceph.mds.h.smithi116.stdout:Aug 19 00:10:29 smithi116 podman[50934]: 2024-08-19 00:10:29.646451852 +0000 UTC m=+0.146849825 container create 00e71ad36b71a1869a2c73eca9b9d3ce5bfbe78f8cb7d59cfbf363496d9c0fc0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-h, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-de09dd0, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-08-19T00:10:30.364 INFO:journalctl@ceph.mds.h.smithi116.stdout:Aug 19 00:10:29 smithi116 podman[50934]: 2024-08-19 00:10:29.865836603 +0000 UTC m=+0.366234577 container init 00e71ad36b71a1869a2c73eca9b9d3ce5bfbe78f8cb7d59cfbf363496d9c0fc0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-h, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, RELEASE=squid-de09dd0, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-19T00:10:30.365 INFO:journalctl@ceph.mds.h.smithi116.stdout:Aug 19 00:10:29 smithi116 podman[50934]: 2024-08-19 00:10:29.868538244 +0000 UTC m=+0.368936226 container start 00e71ad36b71a1869a2c73eca9b9d3ce5bfbe78f8cb7d59cfbf363496d9c0fc0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-h, ceph=True, RELEASE=squid-de09dd0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-08-19T00:10:30.365 INFO:journalctl@ceph.mds.h.smithi116.stdout:Aug 19 00:10:29 smithi116 ceph-mds[50953]: -- 172.21.15.116:0/2812661485 <== mon.2 v2:172.21.15.116:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a630263860 con 0x55a630241000 2024-08-19T00:10:30.365 INFO:journalctl@ceph.mds.h.smithi116.stdout:Aug 19 00:10:29 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-h[50949]: starting mds.h at 2024-08-19T00:10:30.365 INFO:journalctl@ceph.mds.h.smithi116.stdout:Aug 19 00:10:29 smithi116 bash[50934]: 00e71ad36b71a1869a2c73eca9b9d3ce5bfbe78f8cb7d59cfbf363496d9c0fc0 2024-08-19T00:10:30.365 INFO:journalctl@ceph.mds.h.smithi116.stdout:Aug 19 00:10:29 smithi116 systemd[1]: Started Ceph mds.h for 647ded64-5dbe-11ef-bccf-c7b262605968. 2024-08-19T00:10:30.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:30 smithi116 ceph-mon[21873]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:30.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:30 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:30.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:30 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:30.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:30 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:30.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:30 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-19T00:10:30.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:30 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-19T00:10:30.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:30 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:10:30.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:30 smithi044 ceph-mon[18489]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:30.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:30 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:30.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:30 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:30.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:30 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:30.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:30 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-19T00:10:30.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:30 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-19T00:10:30.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:30 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:10:30.696 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:30 smithi171 ceph-mon[21810]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:30.696 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:30 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:30.696 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:30 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:30.696 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:30 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:30.696 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:30 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-19T00:10:30.696 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:30 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-19T00:10:30.696 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:30 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:10:31.371 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-19T00:10:31.639 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:10:31.668 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:31 smithi171 ceph-mon[21810]: Deploying daemon mds.i on smithi171 2024-08-19T00:10:31.668 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:31 smithi171 ceph-mon[21810]: mds.? [v2:172.21.15.116:6836/2764513846,v1:172.21.15.116:6837/2764513846] up:boot 2024-08-19T00:10:31.668 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:31 smithi171 ceph-mon[21810]: fsmap 8 up:standby 2024-08-19T00:10:31.668 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:31 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-08-19T00:10:31.761 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:31 smithi044 ceph-mon[18489]: Deploying daemon mds.i on smithi171 2024-08-19T00:10:31.761 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:31 smithi044 ceph-mon[18489]: mds.? [v2:172.21.15.116:6836/2764513846,v1:172.21.15.116:6837/2764513846] up:boot 2024-08-19T00:10:31.761 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:31 smithi044 ceph-mon[18489]: fsmap 8 up:standby 2024-08-19T00:10:31.761 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:31 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-08-19T00:10:31.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:31 smithi116 ceph-mon[21873]: Deploying daemon mds.i on smithi171 2024-08-19T00:10:31.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:31 smithi116 ceph-mon[21873]: mds.? [v2:172.21.15.116:6836/2764513846,v1:172.21.15.116:6837/2764513846] up:boot 2024-08-19T00:10:31.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:31 smithi116 ceph-mon[21873]: fsmap 8 up:standby 2024-08-19T00:10:31.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:31 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-08-19T00:10:32.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:32.137+0000 7fa86f6cd640 1 -- 172.21.15.44:0/3317676460 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8681018c0 msgr2=0x7fa868101d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:32.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:32.137+0000 7fa86f6cd640 1 --2- 172.21.15.44:0/3317676460 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8681018c0 0x7fa868101d20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa858009930 tx=0x7fa85802a420 comp rx=0 tx=0).stop 2024-08-19T00:10:32.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:32.137+0000 7fa86f6cd640 1 -- 172.21.15.44:0/3317676460 shutdown_connections 2024-08-19T00:10:32.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:32.137+0000 7fa86f6cd640 1 --2- 172.21.15.44:0/3317676460 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa868102260 0x7fa86810e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:32.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:32.137+0000 7fa86f6cd640 1 --2- 172.21.15.44:0/3317676460 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8681018c0 0x7fa868101d20 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:32.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:32.137+0000 7fa86f6cd640 1 --2- 172.21.15.44:0/3317676460 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa8681078c0 0x7fa868107ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:32.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:32.137+0000 7fa86f6cd640 1 -- 172.21.15.44:0/3317676460 >> 172.21.15.44:0/3317676460 conn(0x7fa8680fd620 msgr2=0x7fa8680ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:10:32.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:32.137+0000 7fa86f6cd640 1 -- 172.21.15.44:0/3317676460 shutdown_connections 2024-08-19T00:10:32.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:32.137+0000 7fa86f6cd640 1 -- 172.21.15.44:0/3317676460 wait complete. 2024-08-19T00:10:32.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:32.137+0000 7fa86f6cd640 1 Processor -- start 2024-08-19T00:10:32.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:32.137+0000 7fa86f6cd640 1 -- start start 2024-08-19T00:10:32.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:32.138+0000 7fa86f6cd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa8681018c0 0x7fa8681981c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:32.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:32.138+0000 7fa86f6cd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa868102260 0x7fa868198700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:32.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:32.138+0000 7fa86f6cd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa8681078c0 0x7fa86819ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:32.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:32.138+0000 7fa86f6cd640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa868111cc0 con 0x7fa868102260 2024-08-19T00:10:32.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:32.138+0000 7fa86f6cd640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fa868111b40 con 0x7fa8681018c0 2024-08-19T00:10:32.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:32.138+0000 7fa86f6cd640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa868111e40 con 0x7fa8681078c0 2024-08-19T00:10:32.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:32.138+0000 7fa86cc68640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa868102260 0x7fa868198700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:32.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:32.138+0000 7fa86cc68640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa868102260 0x7fa868198700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41342/0 (socket says 172.21.15.44:41342) 2024-08-19T00:10:32.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:32.138+0000 7fa86cc68640 1 -- 172.21.15.44:0/2923037768 learned_addr learned my addr 172.21.15.44:0/2923037768 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:10:32.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:32.138+0000 7fa86dc6a640 1 --2- 172.21.15.44:0/2923037768 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa8681078c0 0x7fa86819ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:32.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:32.138+0000 7fa86d469640 1 --2- 172.21.15.44:0/2923037768 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa8681018c0 0x7fa8681981c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:32.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:32.138+0000 7fa86cc68640 1 -- 172.21.15.44:0/2923037768 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa8681078c0 msgr2=0x7fa86819ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:32.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:32.138+0000 7fa86cc68640 1 --2- 172.21.15.44:0/2923037768 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa8681078c0 0x7fa86819ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:32.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:32.138+0000 7fa86cc68640 1 -- 172.21.15.44:0/2923037768 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa8681018c0 msgr2=0x7fa8681981c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:32.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:32.138+0000 7fa86cc68640 1 --2- 172.21.15.44:0/2923037768 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa8681018c0 0x7fa8681981c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:32.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:32.138+0000 7fa86cc68640 1 -- 172.21.15.44:0/2923037768 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa86819d170 con 0x7fa868102260 2024-08-19T00:10:32.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:32.138+0000 7fa86dc6a640 1 --2- 172.21.15.44:0/2923037768 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa8681078c0 0x7fa86819ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:10:32.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:32.138+0000 7fa86cc68640 1 --2- 172.21.15.44:0/2923037768 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa868102260 0x7fa868198700 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa858009230 tx=0x7fa858004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:10:32.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:32.139+0000 7fa85e7fc640 1 -- 172.21.15.44:0/2923037768 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa85803f030 con 0x7fa868102260 2024-08-19T00:10:32.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:32.139+0000 7fa86f6cd640 1 -- 172.21.15.44:0/2923037768 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa86819d400 con 0x7fa868102260 2024-08-19T00:10:32.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:32.139+0000 7fa85e7fc640 1 -- 172.21.15.44:0/2923037768 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa858003ad0 con 0x7fa868102260 2024-08-19T00:10:32.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:32.139+0000 7fa85e7fc640 1 -- 172.21.15.44:0/2923037768 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa858035070 con 0x7fa868102260 2024-08-19T00:10:32.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:32.139+0000 7fa86f6cd640 1 -- 172.21.15.44:0/2923037768 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8681a4d40 con 0x7fa868102260 2024-08-19T00:10:32.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:32.140+0000 7fa86f6cd640 1 -- 172.21.15.44:0/2923037768 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa868101d20 con 0x7fa868102260 2024-08-19T00:10:32.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:32.141+0000 7fa85e7fc640 1 -- 172.21.15.44:0/2923037768 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fa858042030 con 0x7fa868102260 2024-08-19T00:10:32.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:32.142+0000 7fa85e7fc640 1 --2- 172.21.15.44:0/2923037768 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fa8540a2b80 0x7fa8540a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:32.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:32.142+0000 7fa86d469640 1 --2- 172.21.15.44:0/2923037768 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fa8540a2b80 0x7fa8540a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:32.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:32.142+0000 7fa85e7fc640 1 -- 172.21.15.44:0/2923037768 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7fa8580ef180 con 0x7fa868102260 2024-08-19T00:10:32.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:32.142+0000 7fa86d469640 1 --2- 172.21.15.44:0/2923037768 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fa8540a2b80 0x7fa8540a5040 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa864009b50 tx=0x7fa864005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:10:32.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:32.149+0000 7fa85e7fc640 1 -- 172.21.15.44:0/2923037768 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fa8580bbf30 con 0x7fa868102260 2024-08-19T00:10:32.343 INFO:journalctl@ceph.mds.i.smithi171.stdout:Aug 19 00:10:32 smithi171 systemd[1]: Starting Ceph mds.i for 647ded64-5dbe-11ef-bccf-c7b262605968... 2024-08-19T00:10:32.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:32.362+0000 7fa86f6cd640 1 -- 172.21.15.44:0/2923037768 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa868199520 con 0x7fa868102260 2024-08-19T00:10:32.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:32.363+0000 7fa85e7fc640 1 -- 172.21.15.44:0/2923037768 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7225 (secure 0 0 0) 0x7fa8580bfc50 con 0x7fa868102260 2024-08-19T00:10:32.365 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:10:32.365 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":9,"btime":"2024-08-19T00:10:30:361453+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14511,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1538841896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1538841896},{"type":"v1","addr":"172.21.15.116:6833","nonce":1538841896}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/4044471606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4044471606},{"type":"v1","addr":"172.21.15.44:6835","nonce":4044471606}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6837/1824829052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1824829052},{"type":"v1","addr":"172.21.15.44:6837","nonce":1824829052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24388,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1183022838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1183022838},{"type":"v1","addr":"172.21.15.171:6833","nonce":1183022838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24412,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6835/2190623851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":2190623851},{"type":"v1","addr":"172.21.15.171:6835","nonce":2190623851}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24418,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/316231795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":316231795},{"type":"v1","addr":"172.21.15.171:6837","nonce":316231795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24431,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3507399322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3507399322},{"type":"v1","addr":"172.21.15.116:6835","nonce":3507399322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24446,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/2764513846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":2764513846},{"type":"v1","addr":"172.21.15.116:6837","nonce":2764513846}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-08-19T00:10:32.365 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 9 2024-08-19T00:10:32.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:32.366+0000 7fa86f6cd640 1 -- 172.21.15.44:0/2923037768 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fa8540a2b80 msgr2=0x7fa8540a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:32.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:32.366+0000 7fa86f6cd640 1 --2- 172.21.15.44:0/2923037768 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fa8540a2b80 0x7fa8540a5040 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa864009b50 tx=0x7fa864005f90 comp rx=0 tx=0).stop 2024-08-19T00:10:32.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:32.366+0000 7fa86f6cd640 1 -- 172.21.15.44:0/2923037768 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa868102260 msgr2=0x7fa868198700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:32.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:32.366+0000 7fa86f6cd640 1 --2- 172.21.15.44:0/2923037768 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa868102260 0x7fa868198700 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa858009230 tx=0x7fa858004270 comp rx=0 tx=0).stop 2024-08-19T00:10:32.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:32.366+0000 7fa86f6cd640 1 -- 172.21.15.44:0/2923037768 shutdown_connections 2024-08-19T00:10:32.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:32.366+0000 7fa86f6cd640 1 --2- 172.21.15.44:0/2923037768 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fa8540a2b80 0x7fa8540a5040 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:32.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:32.366+0000 7fa86f6cd640 1 --2- 172.21.15.44:0/2923037768 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa8681078c0 0x7fa86819ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:32.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:32.366+0000 7fa86f6cd640 1 --2- 172.21.15.44:0/2923037768 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa868102260 0x7fa868198700 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:32.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:32.366+0000 7fa86f6cd640 1 --2- 172.21.15.44:0/2923037768 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa8681018c0 0x7fa8681981c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:32.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:32.366+0000 7fa86f6cd640 1 -- 172.21.15.44:0/2923037768 >> 172.21.15.44:0/2923037768 conn(0x7fa8680fd620 msgr2=0x7fa8680fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:10:32.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:32.366+0000 7fa86f6cd640 1 -- 172.21.15.44:0/2923037768 shutdown_connections 2024-08-19T00:10:32.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:32.366+0000 7fa86f6cd640 1 -- 172.21.15.44:0/2923037768 wait complete. 2024-08-19T00:10:32.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:32 smithi044 ceph-mon[18489]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:32.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:32 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/2923037768' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:10:32.665 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:32 smithi171 ceph-mon[21810]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:32.665 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:32 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/2923037768' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:10:32.665 INFO:journalctl@ceph.mds.i.smithi171.stdout:Aug 19 00:10:32 smithi171 podman[51648]: 2024-08-19 00:10:32.268418163 +0000 UTC m=+0.017327851 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-19T00:10:32.665 INFO:journalctl@ceph.mds.i.smithi171.stdout:Aug 19 00:10:32 smithi171 podman[51648]: 2024-08-19 00:10:32.403369433 +0000 UTC m=+0.152279165 container create 6a564a89c48becae528e629f05c1f8861b80281955f4114a3b2cefe951e5872c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-i, RELEASE=squid-de09dd0, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS) 2024-08-19T00:10:32.665 INFO:journalctl@ceph.mds.i.smithi171.stdout:Aug 19 00:10:32 smithi171 podman[51648]: 2024-08-19 00:10:32.664482882 +0000 UTC m=+0.413392584 container init 6a564a89c48becae528e629f05c1f8861b80281955f4114a3b2cefe951e5872c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-i, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, RELEASE=squid-de09dd0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-19T00:10:32.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:32 smithi116 ceph-mon[21873]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:32.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:32 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/2923037768' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:10:33.092 INFO:journalctl@ceph.mds.i.smithi171.stdout:Aug 19 00:10:32 smithi171 podman[51648]: 2024-08-19 00:10:32.667410598 +0000 UTC m=+0.416320292 container start 6a564a89c48becae528e629f05c1f8861b80281955f4114a3b2cefe951e5872c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-i, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-de09dd0, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-08-19T00:10:33.092 INFO:journalctl@ceph.mds.i.smithi171.stdout:Aug 19 00:10:32 smithi171 ceph-mds[51667]: -- 172.21.15.171:0/351104796 <== mon.1 v2:172.21.15.171:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bf2eff7c20 con 0x55bf2efd5000 2024-08-19T00:10:33.092 INFO:journalctl@ceph.mds.i.smithi171.stdout:Aug 19 00:10:32 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-i[51663]: starting mds.i at 2024-08-19T00:10:33.092 INFO:journalctl@ceph.mds.i.smithi171.stdout:Aug 19 00:10:32 smithi171 bash[51648]: 6a564a89c48becae528e629f05c1f8861b80281955f4114a3b2cefe951e5872c 2024-08-19T00:10:33.092 INFO:journalctl@ceph.mds.i.smithi171.stdout:Aug 19 00:10:32 smithi171 systemd[1]: Started Ceph mds.i for 647ded64-5dbe-11ef-bccf-c7b262605968. 2024-08-19T00:10:34.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:33 smithi044 ceph-mon[18489]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:34.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:33 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:34.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:33 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:34.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:33 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:34.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:33 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-19T00:10:34.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:33 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-19T00:10:34.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:33 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:10:34.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:33 smithi044 ceph-mon[18489]: Deploying daemon mds.g on smithi044 2024-08-19T00:10:34.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:33 smithi044 ceph-mon[18489]: mds.? [v2:172.21.15.171:6838/1466585795,v1:172.21.15.171:6839/1466585795] up:boot 2024-08-19T00:10:34.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:33 smithi044 ceph-mon[18489]: fsmap 9 up:standby 2024-08-19T00:10:34.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:33 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-08-19T00:10:34.093 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:33 smithi171 ceph-mon[21810]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:34.093 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:33 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:34.093 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:33 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:34.093 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:33 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:34.093 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:33 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-19T00:10:34.093 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:33 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-19T00:10:34.093 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:33 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:10:34.093 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:33 smithi171 ceph-mon[21810]: Deploying daemon mds.g on smithi044 2024-08-19T00:10:34.093 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:33 smithi171 ceph-mon[21810]: mds.? [v2:172.21.15.171:6838/1466585795,v1:172.21.15.171:6839/1466585795] up:boot 2024-08-19T00:10:34.093 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:33 smithi171 ceph-mon[21810]: fsmap 9 up:standby 2024-08-19T00:10:34.093 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:33 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-08-19T00:10:34.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:33 smithi116 ceph-mon[21873]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:34.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:33 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:34.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:33 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:34.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:33 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:34.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:33 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-19T00:10:34.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:33 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-19T00:10:34.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:33 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:10:34.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:33 smithi116 ceph-mon[21873]: Deploying daemon mds.g on smithi044 2024-08-19T00:10:34.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:33 smithi116 ceph-mon[21873]: mds.? [v2:172.21.15.171:6838/1466585795,v1:172.21.15.171:6839/1466585795] up:boot 2024-08-19T00:10:34.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:33 smithi116 ceph-mon[21873]: fsmap 9 up:standby 2024-08-19T00:10:34.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:33 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-08-19T00:10:35.041 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-19T00:10:35.066 INFO:journalctl@ceph.mds.g.smithi044.stdout:Aug 19 00:10:34 smithi044 systemd[1]: Starting Ceph mds.g for 647ded64-5dbe-11ef-bccf-c7b262605968... 2024-08-19T00:10:35.369 INFO:journalctl@ceph.mds.g.smithi044.stdout:Aug 19 00:10:35 smithi044 podman[58756]: 2024-08-19 00:10:34.992332825 +0000 UTC m=+0.017584176 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-19T00:10:35.369 INFO:journalctl@ceph.mds.g.smithi044.stdout:Aug 19 00:10:35 smithi044 podman[58756]: 2024-08-19 00:10:35.112119685 +0000 UTC m=+0.137371028 container create 4ee6a6cba6cd884f7192bc93d2d13920280a8f07ddd59a133eb56e7d5277f428 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-g, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-de09dd0, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0) 2024-08-19T00:10:35.540 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:10:35.659 INFO:journalctl@ceph.mds.g.smithi044.stdout:Aug 19 00:10:35 smithi044 podman[58756]: 2024-08-19 00:10:35.389943747 +0000 UTC m=+0.415195091 container init 4ee6a6cba6cd884f7192bc93d2d13920280a8f07ddd59a133eb56e7d5277f428 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-g, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-de09dd0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True) 2024-08-19T00:10:35.659 INFO:journalctl@ceph.mds.g.smithi044.stdout:Aug 19 00:10:35 smithi044 podman[58756]: 2024-08-19 00:10:35.39296299 +0000 UTC m=+0.418214340 container start 4ee6a6cba6cd884f7192bc93d2d13920280a8f07ddd59a133eb56e7d5277f428 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-g, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-de09dd0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-08-19T00:10:35.659 INFO:journalctl@ceph.mds.g.smithi044.stdout:Aug 19 00:10:35 smithi044 ceph-mds[58818]: -- 172.21.15.44:0/544588036 <== mon.0 v2:172.21.15.44:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56114ff71860 con 0x56114ff4f400 2024-08-19T00:10:35.659 INFO:journalctl@ceph.mds.g.smithi044.stdout:Aug 19 00:10:35 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-g[58791]: starting mds.g at 2024-08-19T00:10:35.659 INFO:journalctl@ceph.mds.g.smithi044.stdout:Aug 19 00:10:35 smithi044 bash[58756]: 4ee6a6cba6cd884f7192bc93d2d13920280a8f07ddd59a133eb56e7d5277f428 2024-08-19T00:10:35.659 INFO:journalctl@ceph.mds.g.smithi044.stdout:Aug 19 00:10:35 smithi044 systemd[1]: Started Ceph mds.g for 647ded64-5dbe-11ef-bccf-c7b262605968. 2024-08-19T00:10:35.937 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:35 smithi044 ceph-mon[18489]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:35.937 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:35 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:35.937 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:35 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:35.937 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:35 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:35.937 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:35 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-19T00:10:35.937 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:35 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-19T00:10:35.937 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:35 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:10:36.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:36.017+0000 7f200549c640 1 -- 172.21.15.44:0/1202392612 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2000102260 msgr2=0x7f200010e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:36.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:36.017+0000 7f200549c640 1 --2- 172.21.15.44:0/1202392612 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2000102260 0x7f200010e790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1ff8009cd0 tx=0x7f1ff802a8e0 comp rx=0 tx=0).stop 2024-08-19T00:10:36.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:36.017+0000 7f200549c640 1 -- 172.21.15.44:0/1202392612 shutdown_connections 2024-08-19T00:10:36.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:36.017+0000 7f200549c640 1 --2- 172.21.15.44:0/1202392612 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2000102260 0x7f200010e790 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:36.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:36.017+0000 7f200549c640 1 --2- 172.21.15.44:0/1202392612 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f20001018c0 0x7f2000101d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:36.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:36.017+0000 7f200549c640 1 --2- 172.21.15.44:0/1202392612 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20001078c0 0x7f2000107ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:36.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:36.017+0000 7f200549c640 1 -- 172.21.15.44:0/1202392612 >> 172.21.15.44:0/1202392612 conn(0x7f20000fd5e0 msgr2=0x7f20000ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:10:36.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:36.017+0000 7f200549c640 1 -- 172.21.15.44:0/1202392612 shutdown_connections 2024-08-19T00:10:36.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:36.017+0000 7f200549c640 1 -- 172.21.15.44:0/1202392612 wait complete. 2024-08-19T00:10:36.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:36.018+0000 7f200549c640 1 Processor -- start 2024-08-19T00:10:36.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:36.018+0000 7f200549c640 1 -- start start 2024-08-19T00:10:36.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:36.018+0000 7f200549c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f20001018c0 0x7f2000198120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:36.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:36.018+0000 7f200549c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2000102260 0x7f2000198660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:36.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:36.018+0000 7f200549c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20001078c0 0x7f200019c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:36.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:36.018+0000 7f200549c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2000111ce0 con 0x7f2000102260 2024-08-19T00:10:36.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:36.018+0000 7f200549c640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f2000111b60 con 0x7f20001018c0 2024-08-19T00:10:36.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:36.018+0000 7f200549c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2000111e60 con 0x7f20001078c0 2024-08-19T00:10:36.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:36.018+0000 7f1ff7fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2000102260 0x7f2000198660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:36.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:36.018+0000 7f1ff7fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2000102260 0x7f2000198660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41374/0 (socket says 172.21.15.44:41374) 2024-08-19T00:10:36.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:36.018+0000 7f1ff7fff640 1 -- 172.21.15.44:0/3138666843 learned_addr learned my addr 172.21.15.44:0/3138666843 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:10:36.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:36.018+0000 7f1fff7fe640 1 --2- 172.21.15.44:0/3138666843 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20001078c0 0x7f200019c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:36.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:36.018+0000 7f1ffeffd640 1 --2- 172.21.15.44:0/3138666843 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f20001018c0 0x7f2000198120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:36.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:36.019+0000 7f1ff7fff640 1 -- 172.21.15.44:0/3138666843 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20001078c0 msgr2=0x7f200019c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:36.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:36.019+0000 7f1ff7fff640 1 --2- 172.21.15.44:0/3138666843 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20001078c0 0x7f200019c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:36.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:36.019+0000 7f1ff7fff640 1 -- 172.21.15.44:0/3138666843 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f20001018c0 msgr2=0x7f2000198120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:36.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:36.019+0000 7f1ff7fff640 1 --2- 172.21.15.44:0/3138666843 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f20001018c0 0x7f2000198120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:36.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:36.019+0000 7f1ff7fff640 1 -- 172.21.15.44:0/3138666843 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f200019d0d0 con 0x7f2000102260 2024-08-19T00:10:36.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:36.019+0000 7f1ff7fff640 1 --2- 172.21.15.44:0/3138666843 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2000102260 0x7f2000198660 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1fe800c920 tx=0x7f1fe800cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:10:36.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:36.019+0000 7f1ffcff9640 1 -- 172.21.15.44:0/3138666843 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe8007bb0 con 0x7f2000102260 2024-08-19T00:10:36.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:36.019+0000 7f1ffcff9640 1 -- 172.21.15.44:0/3138666843 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1fe8007d50 con 0x7f2000102260 2024-08-19T00:10:36.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:36.019+0000 7f200549c640 1 -- 172.21.15.44:0/3138666843 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f200019d3c0 con 0x7f2000102260 2024-08-19T00:10:36.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:36.019+0000 7f1ffcff9640 1 -- 172.21.15.44:0/3138666843 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe80187d0 con 0x7f2000102260 2024-08-19T00:10:36.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:36.019+0000 7f200549c640 1 -- 172.21.15.44:0/3138666843 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20001a4ca0 con 0x7f2000102260 2024-08-19T00:10:36.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:36.020+0000 7f200549c640 1 -- 172.21.15.44:0/3138666843 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2000101d20 con 0x7f2000102260 2024-08-19T00:10:36.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:36.021+0000 7f1ffcff9640 1 -- 172.21.15.44:0/3138666843 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f1fe800f450 con 0x7f2000102260 2024-08-19T00:10:36.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:36.022+0000 7f1ffcff9640 1 --2- 172.21.15.44:0/3138666843 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f1fec0a2c00 0x7f1fec0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:36.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:36.022+0000 7f1ffcff9640 1 -- 172.21.15.44:0/3138666843 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7f1fe80cec20 con 0x7f2000102260 2024-08-19T00:10:36.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:36.022+0000 7f1ffeffd640 1 --2- 172.21.15.44:0/3138666843 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f1fec0a2c00 0x7f1fec0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:36.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:36.022+0000 7f1ffeffd640 1 --2- 172.21.15.44:0/3138666843 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f1fec0a2c00 0x7f1fec0a50c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1ff0009990 tx=0x7f1ff0009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:10:36.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:36.026+0000 7f1ffcff9640 1 -- 172.21.15.44:0/3138666843 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f1fe8014030 con 0x7f2000102260 2024-08-19T00:10:36.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:35 smithi171 ceph-mon[21810]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:36.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:35 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:36.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:35 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:36.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:35 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:36.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:35 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-19T00:10:36.093 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:35 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-19T00:10:36.093 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:35 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:10:36.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:35 smithi116 ceph-mon[21873]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:36.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:35 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:36.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:35 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:36.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:35 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:36.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:35 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-19T00:10:36.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:35 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-19T00:10:36.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:35 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:10:36.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:36.245+0000 7f200549c640 1 -- 172.21.15.44:0/3138666843 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f20001a5030 con 0x7f2000102260 2024-08-19T00:10:36.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:36.246+0000 7f1ffcff9640 1 -- 172.21.15.44:0/3138666843 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8881 (secure 0 0 0) 0x7f1fe809bf80 con 0x7f2000102260 2024-08-19T00:10:36.247 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:10:36.248 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":11,"btime":"2024-08-19T00:10:35:816626+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14511,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1538841896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1538841896},{"type":"v1","addr":"172.21.15.116:6833","nonce":1538841896}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/4044471606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4044471606},{"type":"v1","addr":"172.21.15.44:6835","nonce":4044471606}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6837/1824829052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1824829052},{"type":"v1","addr":"172.21.15.44:6837","nonce":1824829052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14577,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6839/3591739042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":3591739042},{"type":"v1","addr":"172.21.15.44:6839","nonce":3591739042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24388,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1183022838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1183022838},{"type":"v1","addr":"172.21.15.171:6833","nonce":1183022838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24412,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6835/2190623851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":2190623851},{"type":"v1","addr":"172.21.15.171:6835","nonce":2190623851}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24418,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/316231795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":316231795},{"type":"v1","addr":"172.21.15.171:6837","nonce":316231795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24431,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3507399322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3507399322},{"type":"v1","addr":"172.21.15.116:6835","nonce":3507399322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24439,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6839/1466585795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":1466585795},{"type":"v1","addr":"172.21.15.171:6839","nonce":1466585795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24446,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/2764513846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":2764513846},{"type":"v1","addr":"172.21.15.116:6837","nonce":2764513846}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-08-19T00:10:36.248 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 11 2024-08-19T00:10:36.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:36.248+0000 7f200549c640 1 -- 172.21.15.44:0/3138666843 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f1fec0a2c00 msgr2=0x7f1fec0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:36.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:36.248+0000 7f200549c640 1 --2- 172.21.15.44:0/3138666843 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f1fec0a2c00 0x7f1fec0a50c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1ff0009990 tx=0x7f1ff0009110 comp rx=0 tx=0).stop 2024-08-19T00:10:36.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:36.248+0000 7f200549c640 1 -- 172.21.15.44:0/3138666843 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2000102260 msgr2=0x7f2000198660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:36.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:36.248+0000 7f200549c640 1 --2- 172.21.15.44:0/3138666843 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2000102260 0x7f2000198660 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1fe800c920 tx=0x7f1fe800cd20 comp rx=0 tx=0).stop 2024-08-19T00:10:36.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:36.248+0000 7f200549c640 1 -- 172.21.15.44:0/3138666843 shutdown_connections 2024-08-19T00:10:36.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:36.248+0000 7f200549c640 1 --2- 172.21.15.44:0/3138666843 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f1fec0a2c00 0x7f1fec0a50c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:36.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:36.248+0000 7f200549c640 1 --2- 172.21.15.44:0/3138666843 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20001078c0 0x7f200019c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:36.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:36.248+0000 7f200549c640 1 --2- 172.21.15.44:0/3138666843 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2000102260 0x7f2000198660 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:36.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:36.248+0000 7f200549c640 1 --2- 172.21.15.44:0/3138666843 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f20001018c0 0x7f2000198120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:36.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:36.248+0000 7f200549c640 1 -- 172.21.15.44:0/3138666843 >> 172.21.15.44:0/3138666843 conn(0x7f20000fd5e0 msgr2=0x7f20000fdb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:10:36.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:36.248+0000 7f200549c640 1 -- 172.21.15.44:0/3138666843 shutdown_connections 2024-08-19T00:10:36.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:36.248+0000 7f200549c640 1 -- 172.21.15.44:0/3138666843 wait complete. 2024-08-19T00:10:37.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:36 smithi171 ceph-mon[21810]: Deploying daemon mds.a on smithi044 2024-08-19T00:10:37.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:36 smithi171 ceph-mon[21810]: mds.? [v2:172.21.15.44:6838/3591739042,v1:172.21.15.44:6839/3591739042] up:boot 2024-08-19T00:10:37.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:36 smithi171 ceph-mon[21810]: fsmap 10 up:standby 2024-08-19T00:10:37.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:36 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-08-19T00:10:37.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:36 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/3138666843' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:10:37.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:36 smithi116 ceph-mon[21873]: Deploying daemon mds.a on smithi044 2024-08-19T00:10:37.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:36 smithi116 ceph-mon[21873]: mds.? [v2:172.21.15.44:6838/3591739042,v1:172.21.15.44:6839/3591739042] up:boot 2024-08-19T00:10:37.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:36 smithi116 ceph-mon[21873]: fsmap 10 up:standby 2024-08-19T00:10:37.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:36 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-08-19T00:10:37.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:36 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/3138666843' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:10:37.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:36 smithi044 ceph-mon[18489]: Deploying daemon mds.a on smithi044 2024-08-19T00:10:37.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:36 smithi044 ceph-mon[18489]: mds.? [v2:172.21.15.44:6838/3591739042,v1:172.21.15.44:6839/3591739042] up:boot 2024-08-19T00:10:37.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:36 smithi044 ceph-mon[18489]: fsmap 10 up:standby 2024-08-19T00:10:37.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:36 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-08-19T00:10:37.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:36 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/3138666843' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:10:38.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:37 smithi171 ceph-mon[21810]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:38.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:37 smithi116 ceph-mon[21873]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:38.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:37 smithi044 ceph-mon[18489]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:38.619 INFO:journalctl@ceph.mds.a.smithi044.stdout:Aug 19 00:10:38 smithi044 systemd[1]: Starting Ceph mds.a for 647ded64-5dbe-11ef-bccf-c7b262605968... 2024-08-19T00:10:38.930 INFO:journalctl@ceph.mds.a.smithi044.stdout:Aug 19 00:10:38 smithi044 podman[59172]: 2024-08-19 00:10:38.554200127 +0000 UTC m=+0.017531182 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-19T00:10:38.930 INFO:journalctl@ceph.mds.a.smithi044.stdout:Aug 19 00:10:38 smithi044 podman[59172]: 2024-08-19 00:10:38.65992579 +0000 UTC m=+0.123256831 container create 1469e0dc3da40ee3f10d13e720ffc7cd1e07dc4f44aa5d3aef5bb6255174ce6d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-a, ceph=True, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-de09dd0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-19T00:10:38.930 INFO:journalctl@ceph.mds.a.smithi044.stdout:Aug 19 00:10:38 smithi044 podman[59172]: 2024-08-19 00:10:38.929548729 +0000 UTC m=+0.392879777 container init 1469e0dc3da40ee3f10d13e720ffc7cd1e07dc4f44aa5d3aef5bb6255174ce6d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-a, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-de09dd0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-08-19T00:10:39.369 INFO:journalctl@ceph.mds.a.smithi044.stdout:Aug 19 00:10:38 smithi044 podman[59172]: 2024-08-19 00:10:38.932746095 +0000 UTC m=+0.396077135 container start 1469e0dc3da40ee3f10d13e720ffc7cd1e07dc4f44aa5d3aef5bb6255174ce6d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-a, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-de09dd0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0) 2024-08-19T00:10:39.369 INFO:journalctl@ceph.mds.a.smithi044.stdout:Aug 19 00:10:38 smithi044 ceph-mds[59191]: -- 172.21.15.44:0/2595917860 <== mon.0 v2:172.21.15.44:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561b31dd3860 con 0x561b31db1000 2024-08-19T00:10:39.370 INFO:journalctl@ceph.mds.a.smithi044.stdout:Aug 19 00:10:38 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-a[59187]: starting mds.a at 2024-08-19T00:10:39.370 INFO:journalctl@ceph.mds.a.smithi044.stdout:Aug 19 00:10:39 smithi044 bash[59172]: 1469e0dc3da40ee3f10d13e720ffc7cd1e07dc4f44aa5d3aef5bb6255174ce6d 2024-08-19T00:10:39.370 INFO:journalctl@ceph.mds.a.smithi044.stdout:Aug 19 00:10:39 smithi044 systemd[1]: Started Ceph mds.a for 647ded64-5dbe-11ef-bccf-c7b262605968. 2024-08-19T00:10:39.573 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-19T00:10:39.839 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:10:40.243 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:40 smithi044 ceph-mon[18489]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:40.243 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:40 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:40.243 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:40 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:40.243 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:40 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:40.243 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:40 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-19T00:10:40.243 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:40 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-19T00:10:40.243 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:40 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:10:40.243 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:40 smithi044 ceph-mon[18489]: Deploying daemon mds.b on smithi116 2024-08-19T00:10:40.243 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:40 smithi044 ceph-mon[18489]: mds.? [v2:172.21.15.44:6840/3667695717,v1:172.21.15.44:6841/3667695717] up:boot 2024-08-19T00:10:40.243 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:40 smithi044 ceph-mon[18489]: fsmap 11 up:standby 2024-08-19T00:10:40.244 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:40 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-08-19T00:10:40.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:40 smithi171 ceph-mon[21810]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:40.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:40 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:40.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:40 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:40.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:40 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:40.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:40 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-19T00:10:40.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:40 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-19T00:10:40.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:40 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:10:40.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:40 smithi171 ceph-mon[21810]: Deploying daemon mds.b on smithi116 2024-08-19T00:10:40.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:40 smithi171 ceph-mon[21810]: mds.? [v2:172.21.15.44:6840/3667695717,v1:172.21.15.44:6841/3667695717] up:boot 2024-08-19T00:10:40.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:40 smithi171 ceph-mon[21810]: fsmap 11 up:standby 2024-08-19T00:10:40.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:40 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-08-19T00:10:40.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:40.322+0000 7f15db7ae640 1 -- 172.21.15.44:0/3049673115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15d41018b0 msgr2=0x7f15d4101d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:40.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:40.322+0000 7f15db7ae640 1 --2- 172.21.15.44:0/3049673115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15d41018b0 0x7f15d4101d10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f15c4009930 tx=0x7f15c402a420 comp rx=0 tx=0).stop 2024-08-19T00:10:40.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:40.322+0000 7f15db7ae640 1 -- 172.21.15.44:0/3049673115 shutdown_connections 2024-08-19T00:10:40.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:40.322+0000 7f15db7ae640 1 --2- 172.21.15.44:0/3049673115 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f15d4102250 0x7f15d410e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:40.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:40.322+0000 7f15db7ae640 1 --2- 172.21.15.44:0/3049673115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15d41018b0 0x7f15d4101d10 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:40.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:40.322+0000 7f15db7ae640 1 --2- 172.21.15.44:0/3049673115 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f15d41078b0 0x7f15d4107c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:40.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:40.322+0000 7f15db7ae640 1 -- 172.21.15.44:0/3049673115 >> 172.21.15.44:0/3049673115 conn(0x7f15d40fd5f0 msgr2=0x7f15d40ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:10:40.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:40.322+0000 7f15db7ae640 1 -- 172.21.15.44:0/3049673115 shutdown_connections 2024-08-19T00:10:40.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:40.322+0000 7f15db7ae640 1 -- 172.21.15.44:0/3049673115 wait complete. 2024-08-19T00:10:40.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:40.323+0000 7f15db7ae640 1 Processor -- start 2024-08-19T00:10:40.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:40.323+0000 7f15db7ae640 1 -- start start 2024-08-19T00:10:40.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:40.323+0000 7f15db7ae640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f15d41018b0 0x7f15d4198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:40.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:40.323+0000 7f15db7ae640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f15d4102250 0x7f15d4198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:40.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:40.323+0000 7f15db7ae640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15d41078b0 0x7f15d419cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:40.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:40.323+0000 7f15db7ae640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f15d4111d50 con 0x7f15d41078b0 2024-08-19T00:10:40.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:40.323+0000 7f15db7ae640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f15d4111bd0 con 0x7f15d41018b0 2024-08-19T00:10:40.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:40.323+0000 7f15db7ae640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f15d4111ed0 con 0x7f15d4102250 2024-08-19T00:10:40.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:40.323+0000 7f15d9d4b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15d41078b0 0x7f15d419cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:40.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:40.324+0000 7f15d9d4b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15d41078b0 0x7f15d419cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39236/0 (socket says 172.21.15.44:39236) 2024-08-19T00:10:40.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:40.324+0000 7f15d9d4b640 1 -- 172.21.15.44:0/2493319298 learned_addr learned my addr 172.21.15.44:0/2493319298 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:10:40.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:40.324+0000 7f15d954a640 1 --2- 172.21.15.44:0/2493319298 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f15d41018b0 0x7f15d4198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:40.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:40.324+0000 7f15d8d49640 1 --2- 172.21.15.44:0/2493319298 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f15d4102250 0x7f15d4198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:40.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:40.324+0000 7f15d9d4b640 1 -- 172.21.15.44:0/2493319298 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f15d4102250 msgr2=0x7f15d4198850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:40.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:40.324+0000 7f15d9d4b640 1 --2- 172.21.15.44:0/2493319298 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f15d4102250 0x7f15d4198850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:40.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:40.324+0000 7f15d9d4b640 1 -- 172.21.15.44:0/2493319298 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f15d41018b0 msgr2=0x7f15d4198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:40.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:40.324+0000 7f15d9d4b640 1 --2- 172.21.15.44:0/2493319298 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f15d41018b0 0x7f15d4198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:40.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:40.324+0000 7f15d9d4b640 1 -- 172.21.15.44:0/2493319298 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15d419d2c0 con 0x7f15d41078b0 2024-08-19T00:10:40.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:40.324+0000 7f15d8d49640 1 --2- 172.21.15.44:0/2493319298 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f15d4102250 0x7f15d4198850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:10:40.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:40.324+0000 7f15d9d4b640 1 --2- 172.21.15.44:0/2493319298 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15d41078b0 0x7f15d419cbe0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f15cc009fd0 tx=0x7f15cc00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:10:40.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:40.324+0000 7f15ca7fc640 1 -- 172.21.15.44:0/2493319298 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15cc011830 con 0x7f15d41078b0 2024-08-19T00:10:40.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:40.324+0000 7f15ca7fc640 1 -- 172.21.15.44:0/2493319298 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15cc016070 con 0x7f15d41078b0 2024-08-19T00:10:40.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:40.324+0000 7f15ca7fc640 1 -- 172.21.15.44:0/2493319298 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15cc00f2e0 con 0x7f15d41078b0 2024-08-19T00:10:40.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:40.324+0000 7f15db7ae640 1 -- 172.21.15.44:0/2493319298 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15d419d5b0 con 0x7f15d41078b0 2024-08-19T00:10:40.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:40.324+0000 7f15db7ae640 1 -- 172.21.15.44:0/2493319298 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15d41a4e90 con 0x7f15d41078b0 2024-08-19T00:10:40.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:40.325+0000 7f15db7ae640 1 -- 172.21.15.44:0/2493319298 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15d4101d90 con 0x7f15d41078b0 2024-08-19T00:10:40.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:40.326+0000 7f15ca7fc640 1 -- 172.21.15.44:0/2493319298 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f15cc0119d0 con 0x7f15d41078b0 2024-08-19T00:10:40.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:40.327+0000 7f15ca7fc640 1 --2- 172.21.15.44:0/2493319298 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f15c00a2c00 0x7f15c00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:40.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:40.327+0000 7f15d954a640 1 --2- 172.21.15.44:0/2493319298 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f15c00a2c00 0x7f15c00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:40.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:40.327+0000 7f15ca7fc640 1 -- 172.21.15.44:0/2493319298 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7f15cc0ce1b0 con 0x7f15d41078b0 2024-08-19T00:10:40.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:40.328+0000 7f15d954a640 1 --2- 172.21.15.44:0/2493319298 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f15c00a2c00 0x7f15c00a50c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f15d000a400 tx=0x7f15d000d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:10:40.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:40.332+0000 7f15ca7fc640 1 -- 172.21.15.44:0/2493319298 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f15cc09b5b0 con 0x7f15d41078b0 2024-08-19T00:10:40.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:40 smithi116 ceph-mon[21873]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:40.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:40 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:40.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:40 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:40.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:40 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:40.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:40 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-19T00:10:40.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:40 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-19T00:10:40.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:40 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:10:40.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:40 smithi116 ceph-mon[21873]: Deploying daemon mds.b on smithi116 2024-08-19T00:10:40.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:40 smithi116 ceph-mon[21873]: mds.? [v2:172.21.15.44:6840/3667695717,v1:172.21.15.44:6841/3667695717] up:boot 2024-08-19T00:10:40.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:40 smithi116 ceph-mon[21873]: fsmap 11 up:standby 2024-08-19T00:10:40.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:40 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-08-19T00:10:40.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:40.548+0000 7f15db7ae640 1 -- 172.21.15.44:0/2493319298 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f15d402d5e0 con 0x7f15d41078b0 2024-08-19T00:10:40.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:40.549+0000 7f15ca7fc640 1 -- 172.21.15.44:0/2493319298 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9707 (secure 0 0 0) 0x7f15cc09aeb0 con 0x7f15d41078b0 2024-08-19T00:10:40.610 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:10:40.611 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":12,"btime":"2024-08-19T00:10:39:830842+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14511,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1538841896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1538841896},{"type":"v1","addr":"172.21.15.116:6833","nonce":1538841896}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/4044471606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4044471606},{"type":"v1","addr":"172.21.15.44:6835","nonce":4044471606}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6837/1824829052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1824829052},{"type":"v1","addr":"172.21.15.44:6837","nonce":1824829052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14577,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6839/3591739042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":3591739042},{"type":"v1","addr":"172.21.15.44:6839","nonce":3591739042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6841/3667695717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6840","nonce":3667695717},{"type":"v1","addr":"172.21.15.44:6841","nonce":3667695717}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24388,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1183022838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1183022838},{"type":"v1","addr":"172.21.15.171:6833","nonce":1183022838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24412,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6835/2190623851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":2190623851},{"type":"v1","addr":"172.21.15.171:6835","nonce":2190623851}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24418,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/316231795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":316231795},{"type":"v1","addr":"172.21.15.171:6837","nonce":316231795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24431,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3507399322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3507399322},{"type":"v1","addr":"172.21.15.116:6835","nonce":3507399322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24439,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6839/1466585795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":1466585795},{"type":"v1","addr":"172.21.15.171:6839","nonce":1466585795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24446,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/2764513846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":2764513846},{"type":"v1","addr":"172.21.15.116:6837","nonce":2764513846}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-08-19T00:10:40.612 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 12 2024-08-19T00:10:40.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:40.551+0000 7f15db7ae640 1 -- 172.21.15.44:0/2493319298 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f15c00a2c00 msgr2=0x7f15c00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:40.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:40.551+0000 7f15db7ae640 1 --2- 172.21.15.44:0/2493319298 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f15c00a2c00 0x7f15c00a50c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f15d000a400 tx=0x7f15d000d040 comp rx=0 tx=0).stop 2024-08-19T00:10:40.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:40.551+0000 7f15db7ae640 1 -- 172.21.15.44:0/2493319298 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15d41078b0 msgr2=0x7f15d419cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:40.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:40.551+0000 7f15db7ae640 1 --2- 172.21.15.44:0/2493319298 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15d41078b0 0x7f15d419cbe0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f15cc009fd0 tx=0x7f15cc00b8e0 comp rx=0 tx=0).stop 2024-08-19T00:10:40.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:40.551+0000 7f15db7ae640 1 -- 172.21.15.44:0/2493319298 shutdown_connections 2024-08-19T00:10:40.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:40.551+0000 7f15db7ae640 1 --2- 172.21.15.44:0/2493319298 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f15c00a2c00 0x7f15c00a50c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:40.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:40.551+0000 7f15db7ae640 1 --2- 172.21.15.44:0/2493319298 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f15d4102250 0x7f15d4198850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:40.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:40.551+0000 7f15db7ae640 1 --2- 172.21.15.44:0/2493319298 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15d41078b0 0x7f15d419cbe0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:40.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:40.551+0000 7f15db7ae640 1 --2- 172.21.15.44:0/2493319298 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f15d41018b0 0x7f15d4198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:40.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:40.551+0000 7f15db7ae640 1 -- 172.21.15.44:0/2493319298 >> 172.21.15.44:0/2493319298 conn(0x7f15d40fd5f0 msgr2=0x7f15d40fdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:10:40.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:40.551+0000 7f15db7ae640 1 -- 172.21.15.44:0/2493319298 shutdown_connections 2024-08-19T00:10:40.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:40.551+0000 7f15db7ae640 1 -- 172.21.15.44:0/2493319298 wait complete. 2024-08-19T00:10:41.279 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:41 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/2493319298' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:10:41.322 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:41 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/2493319298' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:10:41.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:41 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/2493319298' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:10:41.865 INFO:journalctl@ceph.mds.b.smithi116.stdout:Aug 19 00:10:41 smithi116 systemd[1]: Started Ceph mds.b for 647ded64-5dbe-11ef-bccf-c7b262605968. 2024-08-19T00:10:42.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:42 smithi116 ceph-mon[21873]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:42.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:42 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:42.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:42 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:42.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:42 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:42.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:42 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:42.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:42 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:42.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:42 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:10:42.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:42 smithi044 ceph-mon[18489]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:42.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:42 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:42.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:42 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:42.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:42 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:42.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:42 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:42.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:42 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:42.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:42 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:10:42.436 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:42 smithi171 ceph-mon[21810]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:42.436 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:42 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:42.437 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:42 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:42.437 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:42 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:42.437 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:42 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:42.437 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:42 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:42.437 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:42 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:10:43.359 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-19T00:10:43.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:43 smithi116 ceph-mon[21873]: mds.? [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] up:boot 2024-08-19T00:10:43.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:43 smithi116 ceph-mon[21873]: fsmap 12 up:standby 2024-08-19T00:10:43.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:43 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-08-19T00:10:43.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:43 smithi044 ceph-mon[18489]: mds.? [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] up:boot 2024-08-19T00:10:43.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:43 smithi044 ceph-mon[18489]: fsmap 12 up:standby 2024-08-19T00:10:43.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:43 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-08-19T00:10:43.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:43 smithi171 ceph-mon[21810]: mds.? [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] up:boot 2024-08-19T00:10:43.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:43 smithi171 ceph-mon[21810]: fsmap 12 up:standby 2024-08-19T00:10:43.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:43 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-08-19T00:10:43.628 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:10:44.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:44.186+0000 7fe8675b2640 1 -- 172.21.15.44:0/4019110129 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe860103410 msgr2=0x7fe8601078c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:44.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:44.186+0000 7fe8675b2640 1 --2- 172.21.15.44:0/4019110129 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe860103410 0x7fe8601078c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe850009930 tx=0x7fe85002a420 comp rx=0 tx=0).stop 2024-08-19T00:10:44.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:44.186+0000 7fe8675b2640 1 -- 172.21.15.44:0/4019110129 shutdown_connections 2024-08-19T00:10:44.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:44.186+0000 7fe8675b2640 1 --2- 172.21.15.44:0/4019110129 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe860107fd0 0x7fe86010e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:44.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:44.186+0000 7fe8675b2640 1 --2- 172.21.15.44:0/4019110129 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe860103410 0x7fe8601078c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:44.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:44.186+0000 7fe8675b2640 1 --2- 172.21.15.44:0/4019110129 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe860102a60 0x7fe860102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:44.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:44.186+0000 7fe8675b2640 1 -- 172.21.15.44:0/4019110129 >> 172.21.15.44:0/4019110129 conn(0x7fe8600fc500 msgr2=0x7fe8600fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:10:44.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:44.186+0000 7fe8675b2640 1 -- 172.21.15.44:0/4019110129 shutdown_connections 2024-08-19T00:10:44.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:44.186+0000 7fe8675b2640 1 -- 172.21.15.44:0/4019110129 wait complete. 2024-08-19T00:10:44.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:44.187+0000 7fe8675b2640 1 Processor -- start 2024-08-19T00:10:44.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:44.187+0000 7fe8675b2640 1 -- start start 2024-08-19T00:10:44.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:44.187+0000 7fe8675b2640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe860102a60 0x7fe8601982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:44.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:44.187+0000 7fe8675b2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe860103410 0x7fe860198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:44.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:44.187+0000 7fe8675b2640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe860107fd0 0x7fe86019cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:44.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:44.187+0000 7fe8675b2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe860111dd0 con 0x7fe860103410 2024-08-19T00:10:44.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:44.187+0000 7fe8675b2640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fe860111c50 con 0x7fe860102a60 2024-08-19T00:10:44.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:44.187+0000 7fe8675b2640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe860111f50 con 0x7fe860107fd0 2024-08-19T00:10:44.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:44.187+0000 7fe864b4d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe860103410 0x7fe860198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:44.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:44.187+0000 7fe864b4d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe860103410 0x7fe860198820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39248/0 (socket says 172.21.15.44:39248) 2024-08-19T00:10:44.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:44.187+0000 7fe864b4d640 1 -- 172.21.15.44:0/1393089859 learned_addr learned my addr 172.21.15.44:0/1393089859 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:10:44.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:44.187+0000 7fe865b4f640 1 --2- 172.21.15.44:0/1393089859 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe860107fd0 0x7fe86019cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:44.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:44.187+0000 7fe86534e640 1 --2- 172.21.15.44:0/1393089859 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe860102a60 0x7fe8601982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:44.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:44.187+0000 7fe864b4d640 1 -- 172.21.15.44:0/1393089859 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe860107fd0 msgr2=0x7fe86019cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:44.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:44.187+0000 7fe864b4d640 1 --2- 172.21.15.44:0/1393089859 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe860107fd0 0x7fe86019cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:44.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:44.187+0000 7fe864b4d640 1 -- 172.21.15.44:0/1393089859 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe860102a60 msgr2=0x7fe8601982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:44.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:44.187+0000 7fe864b4d640 1 --2- 172.21.15.44:0/1393089859 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe860102a60 0x7fe8601982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:44.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:44.187+0000 7fe864b4d640 1 -- 172.21.15.44:0/1393089859 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe86019d290 con 0x7fe860103410 2024-08-19T00:10:44.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:44.188+0000 7fe864b4d640 1 --2- 172.21.15.44:0/1393089859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe860103410 0x7fe860198820 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe850005940 tx=0x7fe850031b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:10:44.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:44.188+0000 7fe8567fc640 1 -- 172.21.15.44:0/1393089859 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe85003f030 con 0x7fe860103410 2024-08-19T00:10:44.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:44.188+0000 7fe8567fc640 1 -- 172.21.15.44:0/1393089859 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8500043d0 con 0x7fe860103410 2024-08-19T00:10:44.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:44.188+0000 7fe8675b2640 1 -- 172.21.15.44:0/1393089859 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe86019d520 con 0x7fe860103410 2024-08-19T00:10:44.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:44.188+0000 7fe8567fc640 1 -- 172.21.15.44:0/1393089859 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe850035070 con 0x7fe860103410 2024-08-19T00:10:44.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:44.188+0000 7fe8675b2640 1 -- 172.21.15.44:0/1393089859 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8601a4e60 con 0x7fe860103410 2024-08-19T00:10:44.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:44.189+0000 7fe8675b2640 1 -- 172.21.15.44:0/1393089859 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe860102e40 con 0x7fe860103410 2024-08-19T00:10:44.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:44.190+0000 7fe8567fc640 1 -- 172.21.15.44:0/1393089859 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fe850042030 con 0x7fe860103410 2024-08-19T00:10:44.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:44.191+0000 7fe8567fc640 1 --2- 172.21.15.44:0/1393089859 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fe84c0a2b80 0x7fe84c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:44.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:44.191+0000 7fe86534e640 1 --2- 172.21.15.44:0/1393089859 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fe84c0a2b80 0x7fe84c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:44.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:44.191+0000 7fe8567fc640 1 -- 172.21.15.44:0/1393089859 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7fe8500eee50 con 0x7fe860103410 2024-08-19T00:10:44.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:44.191+0000 7fe86534e640 1 --2- 172.21.15.44:0/1393089859 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fe84c0a2b80 0x7fe84c0a5040 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe85c009bd0 tx=0x7fe85c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:10:44.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:44.195+0000 7fe8567fc640 1 -- 172.21.15.44:0/1393089859 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fe8500bbc00 con 0x7fe860103410 2024-08-19T00:10:44.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:44.422+0000 7fe8675b2640 1 -- 172.21.15.44:0/1393089859 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe860109fe0 con 0x7fe860103410 2024-08-19T00:10:44.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:44.423+0000 7fe8567fc640 1 -- 172.21.15.44:0/1393089859 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10536 (secure 0 0 0) 0x7fe8500bff00 con 0x7fe860103410 2024-08-19T00:10:44.424 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:10:44.424 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":13,"btime":"2024-08-19T00:10:42:086361+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14511,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1538841896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1538841896},{"type":"v1","addr":"172.21.15.116:6833","nonce":1538841896}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/4044471606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4044471606},{"type":"v1","addr":"172.21.15.44:6835","nonce":4044471606}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6837/1824829052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1824829052},{"type":"v1","addr":"172.21.15.44:6837","nonce":1824829052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14577,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6839/3591739042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":3591739042},{"type":"v1","addr":"172.21.15.44:6839","nonce":3591739042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6841/3667695717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6840","nonce":3667695717},{"type":"v1","addr":"172.21.15.44:6841","nonce":3667695717}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24388,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1183022838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1183022838},{"type":"v1","addr":"172.21.15.171:6833","nonce":1183022838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24412,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6835/2190623851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":2190623851},{"type":"v1","addr":"172.21.15.171:6835","nonce":2190623851}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24418,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/316231795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":316231795},{"type":"v1","addr":"172.21.15.171:6837","nonce":316231795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24431,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3507399322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3507399322},{"type":"v1","addr":"172.21.15.116:6835","nonce":3507399322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24439,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6839/1466585795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":1466585795},{"type":"v1","addr":"172.21.15.171:6839","nonce":1466585795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24446,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/2764513846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":2764513846},{"type":"v1","addr":"172.21.15.116:6837","nonce":2764513846}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24473,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6839/1032741033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":1032741033},{"type":"v1","addr":"172.21.15.116:6839","nonce":1032741033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-08-19T00:10:44.425 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 13 2024-08-19T00:10:44.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:44.425+0000 7fe8675b2640 1 -- 172.21.15.44:0/1393089859 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fe84c0a2b80 msgr2=0x7fe84c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:44.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:44.425+0000 7fe8675b2640 1 --2- 172.21.15.44:0/1393089859 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fe84c0a2b80 0x7fe84c0a5040 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe85c009bd0 tx=0x7fe85c005f90 comp rx=0 tx=0).stop 2024-08-19T00:10:44.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:44.425+0000 7fe8675b2640 1 -- 172.21.15.44:0/1393089859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe860103410 msgr2=0x7fe860198820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:44.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:44.425+0000 7fe8675b2640 1 --2- 172.21.15.44:0/1393089859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe860103410 0x7fe860198820 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe850005940 tx=0x7fe850031b50 comp rx=0 tx=0).stop 2024-08-19T00:10:44.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:44.425+0000 7fe8675b2640 1 -- 172.21.15.44:0/1393089859 shutdown_connections 2024-08-19T00:10:44.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:44.425+0000 7fe8675b2640 1 --2- 172.21.15.44:0/1393089859 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fe84c0a2b80 0x7fe84c0a5040 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:44.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:44.425+0000 7fe8675b2640 1 --2- 172.21.15.44:0/1393089859 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe860107fd0 0x7fe86019cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:44.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:44.425+0000 7fe8675b2640 1 --2- 172.21.15.44:0/1393089859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe860103410 0x7fe860198820 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:44.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:44.425+0000 7fe8675b2640 1 --2- 172.21.15.44:0/1393089859 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe860102a60 0x7fe8601982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:44.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:44.425+0000 7fe8675b2640 1 -- 172.21.15.44:0/1393089859 >> 172.21.15.44:0/1393089859 conn(0x7fe8600fc500 msgr2=0x7fe860105b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:10:44.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:44.425+0000 7fe8675b2640 1 -- 172.21.15.44:0/1393089859 shutdown_connections 2024-08-19T00:10:44.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:44.425+0000 7fe8675b2640 1 -- 172.21.15.44:0/1393089859 wait complete. 2024-08-19T00:10:44.585 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:44 smithi044 ceph-mon[18489]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:44.585 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:44 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:44.585 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:44 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:44.585 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:44 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:44.585 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:44 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:44.585 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:44 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:44.585 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:44 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:44.585 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:44 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:44.586 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:44 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:10:44.586 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:44 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:10:44.586 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:44 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:44.586 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:44 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:10:44.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:44 smithi171 ceph-mon[21810]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:44.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:44 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:44.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:44 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:44.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:44 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:44.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:44 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:44.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:44 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:44.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:44 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:44.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:44 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:44.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:44 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:10:44.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:44 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:10:44.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:44 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:44.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:44 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:10:44.601 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:44 smithi116 ceph-mon[21873]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:44.601 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:44 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:44.601 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:44 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:44.601 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:44 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:44.601 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:44 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:44.601 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:44 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:44.601 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:44 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:44.602 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:44 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:44.602 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:44 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:10:44.602 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:44 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:10:44.602 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:44 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:44.602 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:44 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:10:45.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:45 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/1393089859' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:10:45.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:45 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:45.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:45 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:45.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:45 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/1393089859' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:10:45.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:45 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:45.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:45 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:45.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:45 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/1393089859' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:10:45.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:45 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:45.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:45 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:45.845 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-08-19T00:10:46.161 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:10:46.545 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:46 smithi044 ceph-mon[18489]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:46.545 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:46 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:46.545 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:46 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:46.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:46 smithi171 ceph-mon[21810]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:46.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:46 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:46.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:46 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:46.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:46 smithi116 ceph-mon[21873]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:46.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:46 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:46.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:46 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:46.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:46.623+0000 7f9ed51be640 1 -- 172.21.15.44:0/2504980842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ed01078c0 msgr2=0x7f9ed0107ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:46.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:46.623+0000 7f9ed51be640 1 --2- 172.21.15.44:0/2504980842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ed01078c0 0x7f9ed0107ca0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0009930 tx=0x7f9ec002a420 comp rx=0 tx=0).stop 2024-08-19T00:10:46.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:46.623+0000 7f9ed51be640 1 -- 172.21.15.44:0/2504980842 shutdown_connections 2024-08-19T00:10:46.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:46.623+0000 7f9ed51be640 1 --2- 172.21.15.44:0/2504980842 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9ed0102260 0x7f9ed010e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:46.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:46.623+0000 7f9ed51be640 1 --2- 172.21.15.44:0/2504980842 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9ed01018c0 0x7f9ed0101d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:46.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:46.623+0000 7f9ed51be640 1 --2- 172.21.15.44:0/2504980842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ed01078c0 0x7f9ed0107ca0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:46.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:46.624+0000 7f9ed51be640 1 -- 172.21.15.44:0/2504980842 >> 172.21.15.44:0/2504980842 conn(0x7f9ed00fd620 msgr2=0x7f9ed00ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:10:46.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:46.624+0000 7f9ed51be640 1 -- 172.21.15.44:0/2504980842 shutdown_connections 2024-08-19T00:10:46.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:46.624+0000 7f9ed51be640 1 -- 172.21.15.44:0/2504980842 wait complete. 2024-08-19T00:10:46.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:46.624+0000 7f9ed51be640 1 Processor -- start 2024-08-19T00:10:46.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:46.624+0000 7f9ed51be640 1 -- start start 2024-08-19T00:10:46.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:46.625+0000 7f9ed51be640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9ed01018c0 0x7f9ed0198200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:46.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:46.625+0000 7f9ed51be640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ed0102260 0x7f9ed0198740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:46.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:46.625+0000 7f9ed51be640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9ed01078c0 0x7f9ed019cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:46.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:46.625+0000 7f9ed51be640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed0111c80 con 0x7f9ed0102260 2024-08-19T00:10:46.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:46.625+0000 7f9ed51be640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed0111b00 con 0x7f9ed01018c0 2024-08-19T00:10:46.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:46.625+0000 7f9ed51be640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed0111e00 con 0x7f9ed01078c0 2024-08-19T00:10:46.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:46.625+0000 7f9ece59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ed0102260 0x7f9ed0198740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:46.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:46.625+0000 7f9ece59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ed0102260 0x7f9ed0198740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39264/0 (socket says 172.21.15.44:39264) 2024-08-19T00:10:46.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:46.625+0000 7f9ece59c640 1 -- 172.21.15.44:0/1354763831 learned_addr learned my addr 172.21.15.44:0/1354763831 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:10:46.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:46.625+0000 7f9eced9d640 1 --2- 172.21.15.44:0/1354763831 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9ed01018c0 0x7f9ed0198200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:46.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:46.625+0000 7f9ece59c640 1 -- 172.21.15.44:0/1354763831 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9ed01078c0 msgr2=0x7f9ed019cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:46.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:46.625+0000 7f9ece59c640 1 --2- 172.21.15.44:0/1354763831 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9ed01078c0 0x7f9ed019cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:46.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:46.625+0000 7f9ece59c640 1 -- 172.21.15.44:0/1354763831 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9ed01018c0 msgr2=0x7f9ed0198200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:46.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:46.625+0000 7f9ece59c640 1 --2- 172.21.15.44:0/1354763831 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9ed01018c0 0x7f9ed0198200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:46.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:46.625+0000 7f9ece59c640 1 -- 172.21.15.44:0/1354763831 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ed019d1b0 con 0x7f9ed0102260 2024-08-19T00:10:46.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:46.625+0000 7f9eced9d640 1 --2- 172.21.15.44:0/1354763831 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9ed01018c0 0x7f9ed0198200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:10:46.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:46.625+0000 7f9ece59c640 1 --2- 172.21.15.44:0/1354763831 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ed0102260 0x7f9ed0198740 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9ec400d950 tx=0x7f9ec400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:10:46.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:46.626+0000 7f9eb7fff640 1 -- 172.21.15.44:0/1354763831 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec4017070 con 0x7f9ed0102260 2024-08-19T00:10:46.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:46.626+0000 7f9eb7fff640 1 -- 172.21.15.44:0/1354763831 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ec4009c30 con 0x7f9ed0102260 2024-08-19T00:10:46.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:46.626+0000 7f9ed51be640 1 -- 172.21.15.44:0/1354763831 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ed019d4a0 con 0x7f9ed0102260 2024-08-19T00:10:46.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:46.626+0000 7f9eb7fff640 1 -- 172.21.15.44:0/1354763831 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec400f6b0 con 0x7f9ed0102260 2024-08-19T00:10:46.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:46.626+0000 7f9ed51be640 1 -- 172.21.15.44:0/1354763831 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ed01a4d80 con 0x7f9ed0102260 2024-08-19T00:10:46.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:46.627+0000 7f9ed51be640 1 -- 172.21.15.44:0/1354763831 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ed0101d20 con 0x7f9ed0102260 2024-08-19T00:10:46.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:46.628+0000 7f9eb7fff640 1 -- 172.21.15.44:0/1354763831 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f9ec40109d0 con 0x7f9ed0102260 2024-08-19T00:10:46.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:46.628+0000 7f9eb7fff640 1 --2- 172.21.15.44:0/1354763831 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f9eb80a2c00 0x7f9eb80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:46.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:46.628+0000 7f9eced9d640 1 --2- 172.21.15.44:0/1354763831 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f9eb80a2c00 0x7f9eb80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:46.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:46.628+0000 7f9eb7fff640 1 -- 172.21.15.44:0/1354763831 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7f9ec40ce840 con 0x7f9ed0102260 2024-08-19T00:10:46.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:46.629+0000 7f9eced9d640 1 --2- 172.21.15.44:0/1354763831 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f9eb80a2c00 0x7f9eb80a50c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0000c00 tx=0x7f9ec0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:10:46.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:46.633+0000 7f9eb7fff640 1 -- 172.21.15.44:0/1354763831 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f9ec4009de0 con 0x7f9ed0102260 2024-08-19T00:10:46.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:46.810+0000 7f9ed51be640 1 -- 172.21.15.44:0/1354763831 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f9ed01098a0 con 0x7f9ed0102260 2024-08-19T00:10:46.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:46.811+0000 7f9eb7fff640 1 -- 172.21.15.44:0/1354763831 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v79) ==== 84+0+65 (secure 0 0 0) 0x7f9ec409bc40 con 0x7f9ed0102260 2024-08-19T00:10:46.812 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:10:46.812 INFO:teuthology.orchestra.run.smithi044.stdout:[ 2024-08-19T00:10:46.812 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:10:46.812 INFO:teuthology.orchestra.run.smithi044.stdout: "poolnum": 1, 2024-08-19T00:10:46.813 INFO:teuthology.orchestra.run.smithi044.stdout: "poolname": ".mgr" 2024-08-19T00:10:46.813 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:10:46.813 INFO:teuthology.orchestra.run.smithi044.stdout:] 2024-08-19T00:10:46.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:46.813+0000 7f9ed51be640 1 -- 172.21.15.44:0/1354763831 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f9eb80a2c00 msgr2=0x7f9eb80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:46.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:46.813+0000 7f9ed51be640 1 --2- 172.21.15.44:0/1354763831 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f9eb80a2c00 0x7f9eb80a50c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0000c00 tx=0x7f9ec0005a20 comp rx=0 tx=0).stop 2024-08-19T00:10:46.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:46.813+0000 7f9ed51be640 1 -- 172.21.15.44:0/1354763831 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ed0102260 msgr2=0x7f9ed0198740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:46.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:46.813+0000 7f9ed51be640 1 --2- 172.21.15.44:0/1354763831 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ed0102260 0x7f9ed0198740 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9ec400d950 tx=0x7f9ec400de10 comp rx=0 tx=0).stop 2024-08-19T00:10:46.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:46.813+0000 7f9ed51be640 1 -- 172.21.15.44:0/1354763831 shutdown_connections 2024-08-19T00:10:46.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:46.813+0000 7f9ed51be640 1 --2- 172.21.15.44:0/1354763831 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f9eb80a2c00 0x7f9eb80a50c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:46.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:46.813+0000 7f9ed51be640 1 --2- 172.21.15.44:0/1354763831 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9ed01078c0 0x7f9ed019cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:46.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:46.813+0000 7f9ed51be640 1 --2- 172.21.15.44:0/1354763831 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ed0102260 0x7f9ed0198740 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:46.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:46.813+0000 7f9ed51be640 1 --2- 172.21.15.44:0/1354763831 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9ed01018c0 0x7f9ed0198200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:46.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:46.813+0000 7f9ed51be640 1 -- 172.21.15.44:0/1354763831 >> 172.21.15.44:0/1354763831 conn(0x7f9ed00fd620 msgr2=0x7f9ed00fe030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:10:46.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:46.813+0000 7f9ed51be640 1 -- 172.21.15.44:0/1354763831 shutdown_connections 2024-08-19T00:10:46.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:46.813+0000 7f9ed51be640 1 -- 172.21.15.44:0/1354763831 wait complete. 2024-08-19T00:10:47.557 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-19T00:10:47.558 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-19T00:10:47.582 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:47 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:47.582 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:47 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:47.582 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:47 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:10:47.582 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:47 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:10:47.582 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:47 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:47.582 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:47 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/1354763831' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-08-19T00:10:47.817 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:10:47.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:47 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:47.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:47 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:47.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:47 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:10:47.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:47 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:10:47.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:47 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:47.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:47 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/1354763831' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-08-19T00:10:47.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:47 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:47.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:47 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:47.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:47 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:10:47.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:47 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:10:47.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:47 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:10:47.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:47 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/1354763831' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-08-19T00:10:48.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:48.296+0000 7f9bb6391640 1 -- 172.21.15.44:0/819116997 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9bb0074c10 msgr2=0x7f9bb010dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:48.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:48.296+0000 7f9bb6391640 1 --2- 172.21.15.44:0/819116997 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9bb0074c10 0x7f9bb010dc10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9b98009900 tx=0x7f9b9802a480 comp rx=0 tx=0).stop 2024-08-19T00:10:48.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:48.296+0000 7f9bb6391640 1 -- 172.21.15.44:0/819116997 shutdown_connections 2024-08-19T00:10:48.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:48.296+0000 7f9bb6391640 1 --2- 172.21.15.44:0/819116997 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9bb010e150 0x7f9bb0110540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:48.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:48.296+0000 7f9bb6391640 1 --2- 172.21.15.44:0/819116997 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9bb0074c10 0x7f9bb010dc10 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:48.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:48.296+0000 7f9bb6391640 1 --2- 172.21.15.44:0/819116997 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9bb00742f0 0x7f9bb00746d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:48.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:48.296+0000 7f9bb6391640 1 -- 172.21.15.44:0/819116997 >> 172.21.15.44:0/819116997 conn(0x7f9bb00fd5f0 msgr2=0x7f9bb00ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:10:48.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:48.296+0000 7f9bb6391640 1 -- 172.21.15.44:0/819116997 shutdown_connections 2024-08-19T00:10:48.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:48.296+0000 7f9bb6391640 1 -- 172.21.15.44:0/819116997 wait complete. 2024-08-19T00:10:48.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:48.296+0000 7f9bb6391640 1 Processor -- start 2024-08-19T00:10:48.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:48.297+0000 7f9bb6391640 1 -- start start 2024-08-19T00:10:48.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:48.297+0000 7f9bb6391640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9bb00742f0 0x7f9bb019a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:48.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:48.297+0000 7f9bb6391640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9bb0074c10 0x7f9bb019a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:48.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:48.297+0000 7f9bb6391640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9bb010e150 0x7f9bb019ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:48.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:48.297+0000 7f9bb6391640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9bb0113f00 con 0x7f9bb010e150 2024-08-19T00:10:48.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:48.297+0000 7f9bb6391640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f9bb0113d80 con 0x7f9bb00742f0 2024-08-19T00:10:48.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:48.297+0000 7f9bb6391640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9bb0114080 con 0x7f9bb0074c10 2024-08-19T00:10:48.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:48.297+0000 7f9bb492e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9bb010e150 0x7f9bb019ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:48.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:48.297+0000 7f9bb492e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9bb010e150 0x7f9bb019ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39288/0 (socket says 172.21.15.44:39288) 2024-08-19T00:10:48.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:48.297+0000 7f9bb492e640 1 -- 172.21.15.44:0/4032029072 learned_addr learned my addr 172.21.15.44:0/4032029072 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:10:48.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:48.297+0000 7f9baffff640 1 --2- 172.21.15.44:0/4032029072 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9bb00742f0 0x7f9bb019a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:48.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:48.297+0000 7f9ba7fff640 1 --2- 172.21.15.44:0/4032029072 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9bb0074c10 0x7f9bb019a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:48.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:48.297+0000 7f9bb492e640 1 -- 172.21.15.44:0/4032029072 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9bb0074c10 msgr2=0x7f9bb019a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:48.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:48.297+0000 7f9bb492e640 1 --2- 172.21.15.44:0/4032029072 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9bb0074c10 0x7f9bb019a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:48.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:48.297+0000 7f9bb492e640 1 -- 172.21.15.44:0/4032029072 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9bb00742f0 msgr2=0x7f9bb019a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:48.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:48.297+0000 7f9bb492e640 1 --2- 172.21.15.44:0/4032029072 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9bb00742f0 0x7f9bb019a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:48.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:48.297+0000 7f9bb492e640 1 -- 172.21.15.44:0/4032029072 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bb019f3d0 con 0x7f9bb010e150 2024-08-19T00:10:48.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:48.297+0000 7f9bb492e640 1 --2- 172.21.15.44:0/4032029072 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9bb010e150 0x7f9bb019ecf0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9ba800b9e0 tx=0x7f9ba800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:10:48.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:48.298+0000 7f9badffb640 1 -- 172.21.15.44:0/4032029072 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ba8019070 con 0x7f9bb010e150 2024-08-19T00:10:48.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:48.298+0000 7f9bb6391640 1 -- 172.21.15.44:0/4032029072 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bb019f6c0 con 0x7f9bb010e150 2024-08-19T00:10:48.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:48.298+0000 7f9badffb640 1 -- 172.21.15.44:0/4032029072 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ba8014440 con 0x7f9bb010e150 2024-08-19T00:10:48.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:48.298+0000 7f9badffb640 1 -- 172.21.15.44:0/4032029072 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ba80125e0 con 0x7f9bb010e150 2024-08-19T00:10:48.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:48.298+0000 7f9bb6391640 1 -- 172.21.15.44:0/4032029072 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bb01a6fa0 con 0x7f9bb010e150 2024-08-19T00:10:48.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:48.299+0000 7f9bb6391640 1 -- 172.21.15.44:0/4032029072 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bb00746d0 con 0x7f9bb010e150 2024-08-19T00:10:48.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:48.300+0000 7f9badffb640 1 -- 172.21.15.44:0/4032029072 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f9ba801c070 con 0x7f9bb010e150 2024-08-19T00:10:48.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:48.301+0000 7f9badffb640 1 --2- 172.21.15.44:0/4032029072 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f9b9c0a2b80 0x7f9b9c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:48.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:48.301+0000 7f9baffff640 1 --2- 172.21.15.44:0/4032029072 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f9b9c0a2b80 0x7f9b9c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:48.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:48.301+0000 7f9badffb640 1 -- 172.21.15.44:0/4032029072 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7f9ba80ce760 con 0x7f9bb010e150 2024-08-19T00:10:48.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:48.301+0000 7f9baffff640 1 --2- 172.21.15.44:0/4032029072 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f9b9c0a2b80 0x7f9b9c0a5040 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9ba000bbe0 tx=0x7f9ba000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:10:48.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:48.304+0000 7f9badffb640 1 -- 172.21.15.44:0/4032029072 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f9ba809b510 con 0x7f9bb010e150 2024-08-19T00:10:48.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:48.480+0000 7f9bb6391640 1 -- 172.21.15.44:0/4032029072 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f9bb019b780 con 0x7f9bb010e150 2024-08-19T00:10:48.482 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:48 smithi044 ceph-mon[18489]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:48.743 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:48 smithi171 ceph-mon[21810]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:48.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:48 smithi116 ceph-mon[21873]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:49.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:49.459+0000 7f9badffb640 1 -- 172.21.15.44:0/4032029072 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v80) ==== 138+0+0 (secure 0 0 0) 0x7f9bb019b780 con 0x7f9bb010e150 2024-08-19T00:10:49.461 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_metadata' created 2024-08-19T00:10:49.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:49.462+0000 7f9bb6391640 1 -- 172.21.15.44:0/4032029072 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f9b9c0a2b80 msgr2=0x7f9b9c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:49.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:49.462+0000 7f9bb6391640 1 --2- 172.21.15.44:0/4032029072 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f9b9c0a2b80 0x7f9b9c0a5040 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9ba000bbe0 tx=0x7f9ba000b390 comp rx=0 tx=0).stop 2024-08-19T00:10:49.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:49.462+0000 7f9bb6391640 1 -- 172.21.15.44:0/4032029072 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9bb010e150 msgr2=0x7f9bb019ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:49.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:49.462+0000 7f9bb6391640 1 --2- 172.21.15.44:0/4032029072 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9bb010e150 0x7f9bb019ecf0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9ba800b9e0 tx=0x7f9ba800bea0 comp rx=0 tx=0).stop 2024-08-19T00:10:49.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:49.462+0000 7f9bb6391640 1 -- 172.21.15.44:0/4032029072 shutdown_connections 2024-08-19T00:10:49.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:49.462+0000 7f9bb6391640 1 --2- 172.21.15.44:0/4032029072 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f9b9c0a2b80 0x7f9b9c0a5040 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:49.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:49.462+0000 7f9bb6391640 1 --2- 172.21.15.44:0/4032029072 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9bb0074c10 0x7f9bb019a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:49.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:49.462+0000 7f9bb6391640 1 --2- 172.21.15.44:0/4032029072 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9bb010e150 0x7f9bb019ecf0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:49.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:49.462+0000 7f9bb6391640 1 --2- 172.21.15.44:0/4032029072 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9bb00742f0 0x7f9bb019a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:49.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:49.462+0000 7f9bb6391640 1 -- 172.21.15.44:0/4032029072 >> 172.21.15.44:0/4032029072 conn(0x7f9bb00fd5f0 msgr2=0x7f9bb00fe2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:10:49.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:49.463+0000 7f9bb6391640 1 -- 172.21.15.44:0/4032029072 shutdown_connections 2024-08-19T00:10:49.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:49.463+0000 7f9bb6391640 1 -- 172.21.15.44:0/4032029072 wait complete. 2024-08-19T00:10:49.759 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:49 smithi171 ceph-mon[21810]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:49.759 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:49 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/4032029072' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-08-19T00:10:49.791 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:49 smithi044 ceph-mon[18489]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:49.791 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:49 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/4032029072' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-08-19T00:10:49.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:49 smithi116 ceph-mon[21873]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:49.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:49 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/4032029072' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-08-19T00:10:50.211 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-08-19T00:10:50.468 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:50 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/4032029072' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-08-19T00:10:50.469 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:50 smithi044 ceph-mon[18489]: osdmap e80: 12 total, 12 up, 12 in 2024-08-19T00:10:50.522 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:10:50.767 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:50 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/4032029072' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-08-19T00:10:50.767 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:50 smithi116 ceph-mon[21873]: osdmap e80: 12 total, 12 up, 12 in 2024-08-19T00:10:50.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:50 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/4032029072' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-08-19T00:10:50.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:50 smithi171 ceph-mon[21810]: osdmap e80: 12 total, 12 up, 12 in 2024-08-19T00:10:51.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:51.048+0000 7f0add139640 1 -- 172.21.15.44:0/2658476641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ad81022a0 msgr2=0x7f0ad81026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:51.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:51.048+0000 7f0add139640 1 --2- 172.21.15.44:0/2658476641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ad81022a0 0x7f0ad81026e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0acc009900 tx=0x7f0acc02a480 comp rx=0 tx=0).stop 2024-08-19T00:10:51.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:51.048+0000 7f0add139640 1 -- 172.21.15.44:0/2658476641 shutdown_connections 2024-08-19T00:10:51.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:51.048+0000 7f0add139640 1 --2- 172.21.15.44:0/2658476641 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ad8102c20 0x7f0ad810d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:51.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:51.048+0000 7f0add139640 1 --2- 172.21.15.44:0/2658476641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ad81022a0 0x7f0ad81026e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:51.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:51.048+0000 7f0add139640 1 --2- 172.21.15.44:0/2658476641 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ad8100b50 0x7f0ad8100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:51.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:51.048+0000 7f0add139640 1 -- 172.21.15.44:0/2658476641 >> 172.21.15.44:0/2658476641 conn(0x7f0ad80fc500 msgr2=0x7f0ad80fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:10:51.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:51.048+0000 7f0add139640 1 -- 172.21.15.44:0/2658476641 shutdown_connections 2024-08-19T00:10:51.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:51.048+0000 7f0add139640 1 -- 172.21.15.44:0/2658476641 wait complete. 2024-08-19T00:10:51.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:51.049+0000 7f0add139640 1 Processor -- start 2024-08-19T00:10:51.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:51.049+0000 7f0add139640 1 -- start start 2024-08-19T00:10:51.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:51.049+0000 7f0add139640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ad8100b50 0x7f0ad8198fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:51.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:51.049+0000 7f0add139640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ad81022a0 0x7f0ad8199510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:51.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:51.049+0000 7f0add139640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ad8102c20 0x7f0ad81a4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:51.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:51.049+0000 7f0add139640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad8110cb0 con 0x7f0ad8100b50 2024-08-19T00:10:51.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:51.049+0000 7f0add139640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad8110b30 con 0x7f0ad81022a0 2024-08-19T00:10:51.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:51.049+0000 7f0add139640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad8110e30 con 0x7f0ad8102c20 2024-08-19T00:10:51.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:51.049+0000 7f0ad6d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ad8100b50 0x7f0ad8198fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:51.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:51.049+0000 7f0ad6d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ad8100b50 0x7f0ad8198fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35338/0 (socket says 172.21.15.44:35338) 2024-08-19T00:10:51.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:51.049+0000 7f0ad6d9d640 1 -- 172.21.15.44:0/772157894 learned_addr learned my addr 172.21.15.44:0/772157894 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:10:51.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:51.049+0000 7f0ad659c640 1 --2- 172.21.15.44:0/772157894 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ad81022a0 0x7f0ad8199510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:51.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:51.049+0000 7f0ad759e640 1 --2- 172.21.15.44:0/772157894 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ad8102c20 0x7f0ad81a4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:51.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:51.050+0000 7f0ad6d9d640 1 -- 172.21.15.44:0/772157894 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ad8102c20 msgr2=0x7f0ad81a4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:51.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:51.050+0000 7f0ad6d9d640 1 --2- 172.21.15.44:0/772157894 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ad8102c20 0x7f0ad81a4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:51.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:51.050+0000 7f0ad6d9d640 1 -- 172.21.15.44:0/772157894 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ad81022a0 msgr2=0x7f0ad8199510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:51.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:51.050+0000 7f0ad6d9d640 1 --2- 172.21.15.44:0/772157894 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ad81022a0 0x7f0ad8199510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:51.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:51.050+0000 7f0ad6d9d640 1 -- 172.21.15.44:0/772157894 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ad81a4590 con 0x7f0ad8100b50 2024-08-19T00:10:51.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:51.050+0000 7f0ad6d9d640 1 --2- 172.21.15.44:0/772157894 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ad8100b50 0x7f0ad8198fd0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0ac800d950 tx=0x7f0ac800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:10:51.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:51.050+0000 7f0abffff640 1 -- 172.21.15.44:0/772157894 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ac8017070 con 0x7f0ad8100b50 2024-08-19T00:10:51.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:51.050+0000 7f0abffff640 1 -- 172.21.15.44:0/772157894 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ac8009c30 con 0x7f0ad8100b50 2024-08-19T00:10:51.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:51.050+0000 7f0add139640 1 -- 172.21.15.44:0/772157894 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ad81a4760 con 0x7f0ad8100b50 2024-08-19T00:10:51.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:51.050+0000 7f0abffff640 1 -- 172.21.15.44:0/772157894 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ac800f6b0 con 0x7f0ad8100b50 2024-08-19T00:10:51.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:51.050+0000 7f0add139640 1 -- 172.21.15.44:0/772157894 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ad81a4c20 con 0x7f0ad8100b50 2024-08-19T00:10:51.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:51.051+0000 7f0add139640 1 -- 172.21.15.44:0/772157894 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ad8100f30 con 0x7f0ad8100b50 2024-08-19T00:10:51.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:51.052+0000 7f0abffff640 1 -- 172.21.15.44:0/772157894 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f0ac80109d0 con 0x7f0ad8100b50 2024-08-19T00:10:51.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:51.053+0000 7f0abffff640 1 --2- 172.21.15.44:0/772157894 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f0ac00a2b80 0x7f0ac00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:51.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:51.053+0000 7f0ad659c640 1 --2- 172.21.15.44:0/772157894 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f0ac00a2b80 0x7f0ac00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:51.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:51.053+0000 7f0abffff640 1 -- 172.21.15.44:0/772157894 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7497+0+0 (secure 0 0 0) 0x7f0ac80ce990 con 0x7f0ad8100b50 2024-08-19T00:10:51.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:51.053+0000 7f0ad659c640 1 --2- 172.21.15.44:0/772157894 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f0ac00a2b80 0x7f0ac00a5040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0acc009230 tx=0x7f0acc0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:10:51.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:51.057+0000 7f0abffff640 1 -- 172.21.15.44:0/772157894 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f0ac8009de0 con 0x7f0ad8100b50 2024-08-19T00:10:51.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:51.232+0000 7f0add139640 1 -- 172.21.15.44:0/772157894 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f0ad8108dc0 con 0x7f0ad8100b50 2024-08-19T00:10:51.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:51.488+0000 7f0abffff640 1 -- 172.21.15.44:0/772157894 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v82) ==== 171+0+0 (secure 0 0 0) 0x7f0ac809b530 con 0x7f0ad8100b50 2024-08-19T00:10:51.490 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data' created 2024-08-19T00:10:51.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:51.490+0000 7f0add139640 1 -- 172.21.15.44:0/772157894 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f0ac00a2b80 msgr2=0x7f0ac00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:51.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:51.490+0000 7f0add139640 1 --2- 172.21.15.44:0/772157894 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f0ac00a2b80 0x7f0ac00a5040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0acc009230 tx=0x7f0acc0058d0 comp rx=0 tx=0).stop 2024-08-19T00:10:51.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:51.490+0000 7f0add139640 1 -- 172.21.15.44:0/772157894 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ad8100b50 msgr2=0x7f0ad8198fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:51.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:51.490+0000 7f0add139640 1 --2- 172.21.15.44:0/772157894 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ad8100b50 0x7f0ad8198fd0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0ac800d950 tx=0x7f0ac800de10 comp rx=0 tx=0).stop 2024-08-19T00:10:51.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:51.490+0000 7f0add139640 1 -- 172.21.15.44:0/772157894 shutdown_connections 2024-08-19T00:10:51.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:51.490+0000 7f0add139640 1 --2- 172.21.15.44:0/772157894 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f0ac00a2b80 0x7f0ac00a5040 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:51.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:51.490+0000 7f0add139640 1 --2- 172.21.15.44:0/772157894 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ad8102c20 0x7f0ad81a4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:51.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:51.490+0000 7f0add139640 1 --2- 172.21.15.44:0/772157894 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ad81022a0 0x7f0ad8199510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:51.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:51.490+0000 7f0add139640 1 --2- 172.21.15.44:0/772157894 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ad8100b50 0x7f0ad8198fd0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:51.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:51.490+0000 7f0add139640 1 -- 172.21.15.44:0/772157894 >> 172.21.15.44:0/772157894 conn(0x7f0ad80fc500 msgr2=0x7f0ad8105c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:10:51.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:51.491+0000 7f0add139640 1 -- 172.21.15.44:0/772157894 shutdown_connections 2024-08-19T00:10:51.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:51.491+0000 7f0add139640 1 -- 172.21.15.44:0/772157894 wait complete. 2024-08-19T00:10:51.808 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:51 smithi044 ceph-mon[18489]: osdmap e81: 12 total, 12 up, 12 in 2024-08-19T00:10:51.808 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:51 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/772157894' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-08-19T00:10:51.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:51 smithi171 ceph-mon[21810]: osdmap e81: 12 total, 12 up, 12 in 2024-08-19T00:10:51.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:51 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/772157894' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-08-19T00:10:51.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:51 smithi116 ceph-mon[21873]: osdmap e81: 12 total, 12 up, 12 in 2024-08-19T00:10:51.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:51 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/772157894' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-08-19T00:10:52.205 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-19T00:10:52.462 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:10:52.743 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:52 smithi044 ceph-mon[18489]: pgmap v257: 33 pgs: 10 creating+peering, 22 unknown, 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:52.743 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:52 smithi044 ceph-mon[18489]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-19T00:10:52.744 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:52 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/772157894' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-08-19T00:10:52.744 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:52 smithi044 ceph-mon[18489]: osdmap e82: 12 total, 12 up, 12 in 2024-08-19T00:10:52.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:52 smithi171 ceph-mon[21810]: pgmap v257: 33 pgs: 10 creating+peering, 22 unknown, 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:52.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:52 smithi171 ceph-mon[21810]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-19T00:10:52.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:52 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/772157894' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-08-19T00:10:52.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:52 smithi171 ceph-mon[21810]: osdmap e82: 12 total, 12 up, 12 in 2024-08-19T00:10:52.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:52 smithi116 ceph-mon[21873]: pgmap v257: 33 pgs: 10 creating+peering, 22 unknown, 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:52.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:52 smithi116 ceph-mon[21873]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-19T00:10:52.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:52 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/772157894' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-08-19T00:10:52.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:52 smithi116 ceph-mon[21873]: osdmap e82: 12 total, 12 up, 12 in 2024-08-19T00:10:52.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:52.972+0000 7f0e7099f640 1 -- 172.21.15.44:0/737897859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e6c1007b0 msgr2=0x7f0e6c100c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:52.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:52.972+0000 7f0e7099f640 1 --2- 172.21.15.44:0/737897859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e6c1007b0 0x7f0e6c100c10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0e54009930 tx=0x7f0e5402a440 comp rx=0 tx=0).stop 2024-08-19T00:10:52.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:52.972+0000 7f0e7099f640 1 -- 172.21.15.44:0/737897859 shutdown_connections 2024-08-19T00:10:52.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:52.972+0000 7f0e7099f640 1 --2- 172.21.15.44:0/737897859 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0e6c101150 0x7f0e6c10d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:52.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:52.972+0000 7f0e7099f640 1 --2- 172.21.15.44:0/737897859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e6c1007b0 0x7f0e6c100c10 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:52.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:52.972+0000 7f0e7099f640 1 --2- 172.21.15.44:0/737897859 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0e6c1067b0 0x7f0e6c106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:52.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:52.972+0000 7f0e7099f640 1 -- 172.21.15.44:0/737897859 >> 172.21.15.44:0/737897859 conn(0x7f0e6c0fc4d0 msgr2=0x7f0e6c0fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:10:52.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:52.972+0000 7f0e7099f640 1 -- 172.21.15.44:0/737897859 shutdown_connections 2024-08-19T00:10:52.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:52.973+0000 7f0e7099f640 1 -- 172.21.15.44:0/737897859 wait complete. 2024-08-19T00:10:52.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:52.973+0000 7f0e7099f640 1 Processor -- start 2024-08-19T00:10:52.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:52.973+0000 7f0e7099f640 1 -- start start 2024-08-19T00:10:52.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:52.974+0000 7f0e7099f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e6c1007b0 0x7f0e6c197130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:52.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:52.974+0000 7f0e7099f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0e6c101150 0x7f0e6c197670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:52.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:52.974+0000 7f0e7099f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0e6c1067b0 0x7f0e6c19ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:52.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:52.974+0000 7f0e7099f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0e6c110bf0 con 0x7f0e6c1007b0 2024-08-19T00:10:52.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:52.974+0000 7f0e7099f640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f0e6c110a70 con 0x7f0e6c1067b0 2024-08-19T00:10:52.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:52.974+0000 7f0e7099f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0e6c110d70 con 0x7f0e6c101150 2024-08-19T00:10:52.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:52.974+0000 7f0e6a59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e6c1007b0 0x7f0e6c197130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:52.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:52.974+0000 7f0e6a59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e6c1007b0 0x7f0e6c197130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35356/0 (socket says 172.21.15.44:35356) 2024-08-19T00:10:52.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:52.974+0000 7f0e6a59c640 1 -- 172.21.15.44:0/3739015733 learned_addr learned my addr 172.21.15.44:0/3739015733 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:10:52.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:52.974+0000 7f0e6ad9d640 1 --2- 172.21.15.44:0/3739015733 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0e6c1067b0 0x7f0e6c19ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:52.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:52.974+0000 7f0e6a59c640 1 -- 172.21.15.44:0/3739015733 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0e6c101150 msgr2=0x7f0e6c197670 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-19T00:10:52.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:52.974+0000 7f0e6a59c640 1 --2- 172.21.15.44:0/3739015733 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0e6c101150 0x7f0e6c197670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:52.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:52.974+0000 7f0e6a59c640 1 -- 172.21.15.44:0/3739015733 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0e6c1067b0 msgr2=0x7f0e6c19ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:52.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:52.974+0000 7f0e6a59c640 1 --2- 172.21.15.44:0/3739015733 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0e6c1067b0 0x7f0e6c19ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:52.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:52.974+0000 7f0e6a59c640 1 -- 172.21.15.44:0/3739015733 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e6c19c0e0 con 0x7f0e6c1007b0 2024-08-19T00:10:52.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:52.974+0000 7f0e6a59c640 1 --2- 172.21.15.44:0/3739015733 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e6c1007b0 0x7f0e6c197130 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0e6400b450 tx=0x7f0e6400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:10:52.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:52.974+0000 7f0e637fe640 1 -- 172.21.15.44:0/3739015733 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e64015020 con 0x7f0e6c1007b0 2024-08-19T00:10:52.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:52.974+0000 7f0e7099f640 1 -- 172.21.15.44:0/3739015733 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e6c19c3d0 con 0x7f0e6c1007b0 2024-08-19T00:10:52.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:52.974+0000 7f0e637fe640 1 -- 172.21.15.44:0/3739015733 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e64011d70 con 0x7f0e6c1007b0 2024-08-19T00:10:52.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:52.974+0000 7f0e637fe640 1 -- 172.21.15.44:0/3739015733 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e6400f340 con 0x7f0e6c1007b0 2024-08-19T00:10:52.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:52.974+0000 7f0e7099f640 1 -- 172.21.15.44:0/3739015733 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e6c1a3cb0 con 0x7f0e6c1007b0 2024-08-19T00:10:52.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:52.976+0000 7f0e7099f640 1 -- 172.21.15.44:0/3739015733 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e6c100c10 con 0x7f0e6c1007b0 2024-08-19T00:10:52.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:52.977+0000 7f0e637fe640 1 -- 172.21.15.44:0/3739015733 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f0e64018020 con 0x7f0e6c1007b0 2024-08-19T00:10:52.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:52.977+0000 7f0e637fe640 1 --2- 172.21.15.44:0/3739015733 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f0e580a2b80 0x7f0e580a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:52.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:52.977+0000 7f0e69d9b640 1 --2- 172.21.15.44:0/3739015733 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f0e580a2b80 0x7f0e580a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:52.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:52.977+0000 7f0e637fe640 1 -- 172.21.15.44:0/3739015733 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 7879+0+0 (secure 0 0 0) 0x7f0e640ce990 con 0x7f0e6c1007b0 2024-08-19T00:10:52.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:52.978+0000 7f0e69d9b640 1 --2- 172.21.15.44:0/3739015733 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f0e580a2b80 0x7f0e580a5040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0e5402a960 tx=0x7f0e54000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:10:52.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:52.982+0000 7f0e637fe640 1 -- 172.21.15.44:0/3739015733 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f0e6401f020 con 0x7f0e6c1007b0 2024-08-19T00:10:53.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:53.194+0000 7f0e7099f640 1 -- 172.21.15.44:0/3739015733 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f0e6c108790 con 0x7f0e6c1007b0 2024-08-19T00:10:53.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:53.497+0000 7f0e637fe640 1 -- 172.21.15.44:0/3739015733 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f0e6400d040 con 0x7f0e6c1007b0 2024-08-19T00:10:53.499 INFO:teuthology.orchestra.run.smithi044.stderr:new fs with metadata pool 2 and data pool 3 2024-08-19T00:10:53.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:53.500+0000 7f0e7099f640 1 -- 172.21.15.44:0/3739015733 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f0e580a2b80 msgr2=0x7f0e580a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:53.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:53.500+0000 7f0e7099f640 1 --2- 172.21.15.44:0/3739015733 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f0e580a2b80 0x7f0e580a5040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0e5402a960 tx=0x7f0e54000bc0 comp rx=0 tx=0).stop 2024-08-19T00:10:53.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:53.500+0000 7f0e7099f640 1 -- 172.21.15.44:0/3739015733 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e6c1007b0 msgr2=0x7f0e6c197130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:53.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:53.500+0000 7f0e7099f640 1 --2- 172.21.15.44:0/3739015733 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e6c1007b0 0x7f0e6c197130 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0e6400b450 tx=0x7f0e6400b910 comp rx=0 tx=0).stop 2024-08-19T00:10:53.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:53.500+0000 7f0e7099f640 1 -- 172.21.15.44:0/3739015733 shutdown_connections 2024-08-19T00:10:53.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:53.500+0000 7f0e7099f640 1 --2- 172.21.15.44:0/3739015733 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f0e580a2b80 0x7f0e580a5040 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:53.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:53.500+0000 7f0e7099f640 1 --2- 172.21.15.44:0/3739015733 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0e6c101150 0x7f0e6c197670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:53.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:53.500+0000 7f0e7099f640 1 --2- 172.21.15.44:0/3739015733 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0e6c1067b0 0x7f0e6c19ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:53.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:53.500+0000 7f0e7099f640 1 --2- 172.21.15.44:0/3739015733 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e6c1007b0 0x7f0e6c197130 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:53.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:53.500+0000 7f0e7099f640 1 -- 172.21.15.44:0/3739015733 >> 172.21.15.44:0/3739015733 conn(0x7f0e6c0fc4d0 msgr2=0x7f0e6c0fcc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:10:53.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:53.501+0000 7f0e7099f640 1 -- 172.21.15.44:0/3739015733 shutdown_connections 2024-08-19T00:10:53.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:53.501+0000 7f0e7099f640 1 -- 172.21.15.44:0/3739015733 wait complete. 2024-08-19T00:10:53.825 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:53 smithi044 ceph-mon[18489]: pgmap v259: 97 pgs: 14 active+clean, 29 creating+peering, 54 unknown; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:53.825 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:53 smithi044 ceph-mon[18489]: osdmap e83: 12 total, 12 up, 12 in 2024-08-19T00:10:53.825 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:53 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/3739015733' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-08-19T00:10:53.825 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:53 smithi044 ceph-mon[18489]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-08-19T00:10:53.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:53 smithi171 ceph-mon[21810]: pgmap v259: 97 pgs: 14 active+clean, 29 creating+peering, 54 unknown; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:53.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:53 smithi171 ceph-mon[21810]: osdmap e83: 12 total, 12 up, 12 in 2024-08-19T00:10:53.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:53 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/3739015733' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-08-19T00:10:53.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:53 smithi171 ceph-mon[21810]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-08-19T00:10:53.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:53 smithi116 ceph-mon[21873]: pgmap v259: 97 pgs: 14 active+clean, 29 creating+peering, 54 unknown; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:10:53.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:53 smithi116 ceph-mon[21873]: osdmap e83: 12 total, 12 up, 12 in 2024-08-19T00:10:53.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:53 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/3739015733' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-08-19T00:10:53.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:53 smithi116 ceph-mon[21873]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-08-19T00:10:54.270 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-08-19T00:10:54.270 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-08-19T00:10:54.526 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:10:54.777 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:54 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/3739015733' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-08-19T00:10:54.778 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:54 smithi044 ceph-mon[18489]: osdmap e84: 12 total, 12 up, 12 in 2024-08-19T00:10:54.778 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:54 smithi044 ceph-mon[18489]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-08-19T00:10:54.778 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:54 smithi044 ceph-mon[18489]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-08-19T00:10:54.778 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:54 smithi044 ceph-mon[18489]: mds.? [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] up:active 2024-08-19T00:10:54.778 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:54 smithi044 ceph-mon[18489]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-19T00:10:54.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:54 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/3739015733' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-08-19T00:10:54.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:54 smithi171 ceph-mon[21810]: osdmap e84: 12 total, 12 up, 12 in 2024-08-19T00:10:54.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:54 smithi171 ceph-mon[21810]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-08-19T00:10:54.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:54 smithi171 ceph-mon[21810]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-08-19T00:10:54.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:54 smithi171 ceph-mon[21810]: mds.? [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] up:active 2024-08-19T00:10:54.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:54 smithi171 ceph-mon[21810]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-19T00:10:54.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:54 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/3739015733' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-08-19T00:10:54.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:54 smithi116 ceph-mon[21873]: osdmap e84: 12 total, 12 up, 12 in 2024-08-19T00:10:54.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:54 smithi116 ceph-mon[21873]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-08-19T00:10:54.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:54 smithi116 ceph-mon[21873]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-08-19T00:10:54.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:54 smithi116 ceph-mon[21873]: mds.? [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] up:active 2024-08-19T00:10:54.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:54 smithi116 ceph-mon[21873]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-19T00:10:55.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:55.013+0000 7f7cc7072640 1 -- 172.21.15.44:0/3566540042 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7cc0100fc0 msgr2=0x7f7cc0107780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:55.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:55.013+0000 7f7cc7072640 1 --2- 172.21.15.44:0/3566540042 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7cc0100fc0 0x7f7cc0107780 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7cb4009930 tx=0x7f7cb402a420 comp rx=0 tx=0).stop 2024-08-19T00:10:55.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:55.014+0000 7f7cc7072640 1 -- 172.21.15.44:0/3566540042 shutdown_connections 2024-08-19T00:10:55.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:55.014+0000 7f7cc7072640 1 --2- 172.21.15.44:0/3566540042 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7cc0107e90 0x7f7cc010e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:55.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:55.014+0000 7f7cc7072640 1 --2- 172.21.15.44:0/3566540042 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7cc0100fc0 0x7f7cc0107780 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:55.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:55.014+0000 7f7cc7072640 1 --2- 172.21.15.44:0/3566540042 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7cc0100610 0x7f7cc01009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:55.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:55.014+0000 7f7cc7072640 1 -- 172.21.15.44:0/3566540042 >> 172.21.15.44:0/3566540042 conn(0x7f7cc0076f40 msgr2=0x7f7cc0077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:10:55.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:55.014+0000 7f7cc7072640 1 -- 172.21.15.44:0/3566540042 shutdown_connections 2024-08-19T00:10:55.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:55.014+0000 7f7cc7072640 1 -- 172.21.15.44:0/3566540042 wait complete. 2024-08-19T00:10:55.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:55.014+0000 7f7cc7072640 1 Processor -- start 2024-08-19T00:10:55.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:55.014+0000 7f7cc7072640 1 -- start start 2024-08-19T00:10:55.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:55.014+0000 7f7cc7072640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7cc0100610 0x7f7cc0198240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:55.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:55.014+0000 7f7cc7072640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7cc0100fc0 0x7f7cc0198780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:55.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:55.014+0000 7f7cc7072640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7cc0107e90 0x7f7cc019cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:55.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:55.014+0000 7f7cc7072640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc0111d20 con 0x7f7cc0100fc0 2024-08-19T00:10:55.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:55.014+0000 7f7cc7072640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc0111ba0 con 0x7f7cc0107e90 2024-08-19T00:10:55.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:55.014+0000 7f7cc7072640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc0111ea0 con 0x7f7cc0100610 2024-08-19T00:10:55.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:55.015+0000 7f7cbffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7cc0100fc0 0x7f7cc0198780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:55.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:55.015+0000 7f7cbffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7cc0100fc0 0x7f7cc0198780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35376/0 (socket says 172.21.15.44:35376) 2024-08-19T00:10:55.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:55.015+0000 7f7cbffff640 1 -- 172.21.15.44:0/3805225458 learned_addr learned my addr 172.21.15.44:0/3805225458 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:10:55.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:55.015+0000 7f7cc4e0e640 1 --2- 172.21.15.44:0/3805225458 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7cc0100610 0x7f7cc0198240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:55.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:55.015+0000 7f7cbffff640 1 -- 172.21.15.44:0/3805225458 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7cc0100610 msgr2=0x7f7cc0198240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:55.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:55.015+0000 7f7cbffff640 1 --2- 172.21.15.44:0/3805225458 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7cc0100610 0x7f7cc0198240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:55.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:55.015+0000 7f7cbffff640 1 -- 172.21.15.44:0/3805225458 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7cc0107e90 msgr2=0x7f7cc019cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:55.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:55.015+0000 7f7cbffff640 1 --2- 172.21.15.44:0/3805225458 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7cc0107e90 0x7f7cc019cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:55.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:55.015+0000 7f7cbffff640 1 -- 172.21.15.44:0/3805225458 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cc019d1f0 con 0x7f7cc0100fc0 2024-08-19T00:10:55.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:55.015+0000 7f7cbffff640 1 --2- 172.21.15.44:0/3805225458 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7cc0100fc0 0x7f7cc0198780 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7cb4005940 tx=0x7f7cb40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:10:55.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:55.015+0000 7f7cbdffb640 1 -- 172.21.15.44:0/3805225458 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb403f030 con 0x7f7cc0100fc0 2024-08-19T00:10:55.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:55.015+0000 7f7cc7072640 1 -- 172.21.15.44:0/3805225458 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cc019d480 con 0x7f7cc0100fc0 2024-08-19T00:10:55.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:55.015+0000 7f7cbdffb640 1 -- 172.21.15.44:0/3805225458 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7cb4003ce0 con 0x7f7cc0100fc0 2024-08-19T00:10:55.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:55.015+0000 7f7cbdffb640 1 -- 172.21.15.44:0/3805225458 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb4035070 con 0x7f7cc0100fc0 2024-08-19T00:10:55.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:55.016+0000 7f7cc7072640 1 -- 172.21.15.44:0/3805225458 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cc01a4dc0 con 0x7f7cc0100fc0 2024-08-19T00:10:55.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:55.016+0000 7f7cc7072640 1 -- 172.21.15.44:0/3805225458 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cc0069e40 con 0x7f7cc0100fc0 2024-08-19T00:10:55.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:55.018+0000 7f7cbdffb640 1 -- 172.21.15.44:0/3805225458 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f7cb4042030 con 0x7f7cc0100fc0 2024-08-19T00:10:55.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:55.018+0000 7f7cbdffb640 1 --2- 172.21.15.44:0/3805225458 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f7ca80a2b80 0x7f7ca80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:55.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:55.018+0000 7f7cc4e0e640 1 --2- 172.21.15.44:0/3805225458 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f7ca80a2b80 0x7f7ca80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:55.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:55.018+0000 7f7cbdffb640 1 -- 172.21.15.44:0/3805225458 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7979+0+0 (secure 0 0 0) 0x7f7cb40ef4a0 con 0x7f7cc0100fc0 2024-08-19T00:10:55.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:55.019+0000 7f7cc4e0e640 1 --2- 172.21.15.44:0/3805225458 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f7ca80a2b80 0x7f7ca80a5040 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7cb0009990 tx=0x7f7cb0009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:10:55.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:55.022+0000 7f7cbdffb640 1 -- 172.21.15.44:0/3805225458 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f7cb40bc550 con 0x7f7cc0100fc0 2024-08-19T00:10:55.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:55.208+0000 7f7cc7072640 1 -- 172.21.15.44:0/3805225458 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f7cc01009f0 con 0x7f7cc0100fc0 2024-08-19T00:10:55.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:55.745+0000 7f7cbdffb640 1 -- 172.21.15.44:0/3805225458 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v85) ==== 157+0+0 (secure 0 0 0) 0x7f7cb40bbe50 con 0x7f7cc0100fc0 2024-08-19T00:10:55.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:55.747+0000 7f7cc7072640 1 -- 172.21.15.44:0/3805225458 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f7ca80a2b80 msgr2=0x7f7ca80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:55.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:55.747+0000 7f7cc7072640 1 --2- 172.21.15.44:0/3805225458 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f7ca80a2b80 0x7f7ca80a5040 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7cb0009990 tx=0x7f7cb0009110 comp rx=0 tx=0).stop 2024-08-19T00:10:55.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:55.747+0000 7f7cc7072640 1 -- 172.21.15.44:0/3805225458 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7cc0100fc0 msgr2=0x7f7cc0198780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:55.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:55.747+0000 7f7cc7072640 1 --2- 172.21.15.44:0/3805225458 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7cc0100fc0 0x7f7cc0198780 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7cb4005940 tx=0x7f7cb40042f0 comp rx=0 tx=0).stop 2024-08-19T00:10:55.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:55.747+0000 7f7cc7072640 1 -- 172.21.15.44:0/3805225458 shutdown_connections 2024-08-19T00:10:55.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:55.747+0000 7f7cc7072640 1 --2- 172.21.15.44:0/3805225458 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f7ca80a2b80 0x7f7ca80a5040 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:55.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:55.747+0000 7f7cc7072640 1 --2- 172.21.15.44:0/3805225458 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7cc0107e90 0x7f7cc019cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:55.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:55.747+0000 7f7cc7072640 1 --2- 172.21.15.44:0/3805225458 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7cc0100fc0 0x7f7cc0198780 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:55.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:55.747+0000 7f7cc7072640 1 --2- 172.21.15.44:0/3805225458 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7cc0100610 0x7f7cc0198240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:55.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:55.747+0000 7f7cc7072640 1 -- 172.21.15.44:0/3805225458 >> 172.21.15.44:0/3805225458 conn(0x7f7cc0076f40 msgr2=0x7f7cc0105a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:10:55.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:55.747+0000 7f7cc7072640 1 -- 172.21.15.44:0/3805225458 shutdown_connections 2024-08-19T00:10:55.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:55.747+0000 7f7cc7072640 1 -- 172.21.15.44:0/3805225458 wait complete. 2024-08-19T00:10:55.760 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:55 smithi044 ceph-mon[18489]: pgmap v262: 97 pgs: 37 active+clean, 29 creating+peering, 31 unknown; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 4 op/s 2024-08-19T00:10:55.760 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:55 smithi044 ceph-mon[18489]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-08-19T00:10:55.760 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:55 smithi044 ceph-mon[18489]: Cluster is now healthy 2024-08-19T00:10:55.760 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:55 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/3805225458' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-08-19T00:10:55.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:55 smithi171 ceph-mon[21810]: pgmap v262: 97 pgs: 37 active+clean, 29 creating+peering, 31 unknown; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 4 op/s 2024-08-19T00:10:55.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:55 smithi171 ceph-mon[21810]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-08-19T00:10:55.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:55 smithi171 ceph-mon[21810]: Cluster is now healthy 2024-08-19T00:10:55.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:55 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/3805225458' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-08-19T00:10:55.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:55 smithi116 ceph-mon[21873]: pgmap v262: 97 pgs: 37 active+clean, 29 creating+peering, 31 unknown; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 4 op/s 2024-08-19T00:10:55.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:55 smithi116 ceph-mon[21873]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-08-19T00:10:55.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:55 smithi116 ceph-mon[21873]: Cluster is now healthy 2024-08-19T00:10:55.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:55 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/3805225458' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-08-19T00:10:56.476 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-08-19T00:10:56.736 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:10:57.005 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:56 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/3805225458' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-08-19T00:10:57.005 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:56 smithi044 ceph-mon[18489]: osdmap e85: 12 total, 12 up, 12 in 2024-08-19T00:10:57.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:56 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/3805225458' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-08-19T00:10:57.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:56 smithi171 ceph-mon[21810]: osdmap e85: 12 total, 12 up, 12 in 2024-08-19T00:10:57.098 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:56 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/3805225458' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-08-19T00:10:57.098 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:56 smithi116 ceph-mon[21873]: osdmap e85: 12 total, 12 up, 12 in 2024-08-19T00:10:57.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:57.209+0000 7f3a64019640 1 -- 172.21.15.44:0/52045825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a5c100b50 msgr2=0x7f3a5c100f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:57.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:57.209+0000 7f3a64019640 1 --2- 172.21.15.44:0/52045825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a5c100b50 0x7f3a5c100f30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3a58009900 tx=0x7f3a5802a480 comp rx=0 tx=0).stop 2024-08-19T00:10:57.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:57.209+0000 7f3a64019640 1 -- 172.21.15.44:0/52045825 shutdown_connections 2024-08-19T00:10:57.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:57.209+0000 7f3a64019640 1 --2- 172.21.15.44:0/52045825 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3a5c102c20 0x7f3a5c10d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:57.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:57.209+0000 7f3a64019640 1 --2- 172.21.15.44:0/52045825 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3a5c1022a0 0x7f3a5c1026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:57.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:57.209+0000 7f3a64019640 1 --2- 172.21.15.44:0/52045825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a5c100b50 0x7f3a5c100f30 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:57.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:57.210+0000 7f3a64019640 1 -- 172.21.15.44:0/52045825 >> 172.21.15.44:0/52045825 conn(0x7f3a5c0fc500 msgr2=0x7f3a5c0fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:10:57.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:57.210+0000 7f3a64019640 1 -- 172.21.15.44:0/52045825 shutdown_connections 2024-08-19T00:10:57.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:57.210+0000 7f3a64019640 1 -- 172.21.15.44:0/52045825 wait complete. 2024-08-19T00:10:57.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:57.210+0000 7f3a64019640 1 Processor -- start 2024-08-19T00:10:57.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:57.210+0000 7f3a64019640 1 -- start start 2024-08-19T00:10:57.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:57.210+0000 7f3a64019640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3a5c100b50 0x7f3a5c0fc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:57.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:57.210+0000 7f3a64019640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a5c1022a0 0x7f3a5c0fcef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:57.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:57.210+0000 7f3a64019640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3a5c102c20 0x7f3a5c0fd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:57.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:57.210+0000 7f3a64019640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3a5c110d50 con 0x7f3a5c1022a0 2024-08-19T00:10:57.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:57.210+0000 7f3a64019640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f3a5c110bd0 con 0x7f3a5c102c20 2024-08-19T00:10:57.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:57.210+0000 7f3a64019640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f3a5c110ed0 con 0x7f3a5c100b50 2024-08-19T00:10:57.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:57.211+0000 7f3a615b4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a5c1022a0 0x7f3a5c0fcef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:57.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:57.211+0000 7f3a615b4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a5c1022a0 0x7f3a5c0fcef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35402/0 (socket says 172.21.15.44:35402) 2024-08-19T00:10:57.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:57.211+0000 7f3a615b4640 1 -- 172.21.15.44:0/3366359766 learned_addr learned my addr 172.21.15.44:0/3366359766 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:10:57.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:57.211+0000 7f3a61db5640 1 --2- 172.21.15.44:0/3366359766 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3a5c100b50 0x7f3a5c0fc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:57.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:57.211+0000 7f3a615b4640 1 -- 172.21.15.44:0/3366359766 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3a5c100b50 msgr2=0x7f3a5c0fc9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:57.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:57.211+0000 7f3a615b4640 1 --2- 172.21.15.44:0/3366359766 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3a5c100b50 0x7f3a5c0fc9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:57.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:57.211+0000 7f3a615b4640 1 -- 172.21.15.44:0/3366359766 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3a5c102c20 msgr2=0x7f3a5c0fd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:57.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:57.211+0000 7f3a615b4640 1 --2- 172.21.15.44:0/3366359766 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3a5c102c20 0x7f3a5c0fd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:57.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:57.211+0000 7f3a615b4640 1 -- 172.21.15.44:0/3366359766 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a5c1a6900 con 0x7f3a5c1022a0 2024-08-19T00:10:57.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:57.211+0000 7f3a615b4640 1 --2- 172.21.15.44:0/3366359766 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a5c1022a0 0x7f3a5c0fcef0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c00b4a0 tx=0x7f3a4c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:10:57.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:57.211+0000 7f3a52ffd640 1 -- 172.21.15.44:0/3366359766 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a4c014070 con 0x7f3a5c1022a0 2024-08-19T00:10:57.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:57.211+0000 7f3a52ffd640 1 -- 172.21.15.44:0/3366359766 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a4c010af0 con 0x7f3a5c1022a0 2024-08-19T00:10:57.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:57.211+0000 7f3a64019640 1 -- 172.21.15.44:0/3366359766 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a5c1a6bf0 con 0x7f3a5c1022a0 2024-08-19T00:10:57.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:57.211+0000 7f3a52ffd640 1 -- 172.21.15.44:0/3366359766 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a4c017d10 con 0x7f3a5c1022a0 2024-08-19T00:10:57.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:57.211+0000 7f3a64019640 1 -- 172.21.15.44:0/3366359766 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a5c1a7130 con 0x7f3a5c1022a0 2024-08-19T00:10:57.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:57.212+0000 7f3a64019640 1 -- 172.21.15.44:0/3366359766 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a5c100fb0 con 0x7f3a5c1022a0 2024-08-19T00:10:57.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:57.213+0000 7f3a52ffd640 1 -- 172.21.15.44:0/3366359766 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f3a4c017070 con 0x7f3a5c1022a0 2024-08-19T00:10:57.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:57.214+0000 7f3a52ffd640 1 --2- 172.21.15.44:0/3366359766 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f3a480a2b80 0x7f3a480a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:10:57.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:57.214+0000 7f3a52ffd640 1 -- 172.21.15.44:0/3366359766 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8277+0+0 (secure 0 0 0) 0x7f3a4c0ce4f0 con 0x7f3a5c1022a0 2024-08-19T00:10:57.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:57.214+0000 7f3a61db5640 1 --2- 172.21.15.44:0/3366359766 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f3a480a2b80 0x7f3a480a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:10:57.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:57.214+0000 7f3a61db5640 1 --2- 172.21.15.44:0/3366359766 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f3a480a2b80 0x7f3a480a5040 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3a58005ab0 tx=0x7f3a58005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:10:57.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:57.218+0000 7f3a52ffd640 1 -- 172.21.15.44:0/3366359766 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f3a4c09b3c0 con 0x7f3a5c1022a0 2024-08-19T00:10:57.365 INFO:journalctl@ceph.mds.b.smithi116.stdout:Aug 19 00:10:57 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-b[51250]: 2024-08-19T00:10:57.096+0000 7fcc65f01640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-19T00:10:57.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:57.394+0000 7f3a64019640 1 -- 172.21.15.44:0/3366359766 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f3a5c109dd0 con 0x7f3a5c1022a0 2024-08-19T00:10:58.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:57 smithi171 ceph-mon[21810]: pgmap v264: 97 pgs: 78 active+clean, 19 creating+peering; 578 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 7 op/s 2024-08-19T00:10:58.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:57 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/3366359766' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-08-19T00:10:58.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:57 smithi116 ceph-mon[21873]: pgmap v264: 97 pgs: 78 active+clean, 19 creating+peering; 578 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 7 op/s 2024-08-19T00:10:58.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:57 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/3366359766' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-08-19T00:10:58.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:57 smithi044 ceph-mon[18489]: pgmap v264: 97 pgs: 78 active+clean, 19 creating+peering; 578 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 7 op/s 2024-08-19T00:10:58.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:57 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/3366359766' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-08-19T00:10:58.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:58.762+0000 7f3a52ffd640 1 -- 172.21.15.44:0/3366359766 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v87) ==== 228+0+0 (secure 0 0 0) 0x7f3a4c09acc0 con 0x7f3a5c1022a0 2024-08-19T00:10:58.764 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data_ec' created 2024-08-19T00:10:58.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:58.765+0000 7f3a64019640 1 -- 172.21.15.44:0/3366359766 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f3a480a2b80 msgr2=0x7f3a480a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:58.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:58.765+0000 7f3a64019640 1 --2- 172.21.15.44:0/3366359766 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f3a480a2b80 0x7f3a480a5040 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3a58005ab0 tx=0x7f3a58005a20 comp rx=0 tx=0).stop 2024-08-19T00:10:58.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:58.765+0000 7f3a64019640 1 -- 172.21.15.44:0/3366359766 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a5c1022a0 msgr2=0x7f3a5c0fcef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:10:58.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:58.766+0000 7f3a64019640 1 --2- 172.21.15.44:0/3366359766 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a5c1022a0 0x7f3a5c0fcef0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c00b4a0 tx=0x7f3a4c00b960 comp rx=0 tx=0).stop 2024-08-19T00:10:58.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:58.766+0000 7f3a64019640 1 -- 172.21.15.44:0/3366359766 shutdown_connections 2024-08-19T00:10:58.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:58.766+0000 7f3a64019640 1 --2- 172.21.15.44:0/3366359766 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f3a480a2b80 0x7f3a480a5040 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:58.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:58.766+0000 7f3a64019640 1 --2- 172.21.15.44:0/3366359766 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3a5c102c20 0x7f3a5c0fd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:58.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:58.766+0000 7f3a64019640 1 --2- 172.21.15.44:0/3366359766 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a5c1022a0 0x7f3a5c0fcef0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:58.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:58.766+0000 7f3a64019640 1 --2- 172.21.15.44:0/3366359766 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3a5c100b50 0x7f3a5c0fc9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:10:58.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:58.766+0000 7f3a64019640 1 -- 172.21.15.44:0/3366359766 >> 172.21.15.44:0/3366359766 conn(0x7f3a5c0fc500 msgr2=0x7f3a5c06a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:10:58.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:58.766+0000 7f3a64019640 1 -- 172.21.15.44:0/3366359766 shutdown_connections 2024-08-19T00:10:58.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:10:58.766+0000 7f3a64019640 1 -- 172.21.15.44:0/3366359766 wait complete. 2024-08-19T00:10:59.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:58 smithi171 ceph-mon[21810]: osdmap e86: 12 total, 12 up, 12 in 2024-08-19T00:10:59.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:58 smithi116 ceph-mon[21873]: osdmap e86: 12 total, 12 up, 12 in 2024-08-19T00:10:59.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:58 smithi044 ceph-mon[18489]: osdmap e86: 12 total, 12 up, 12 in 2024-08-19T00:10:59.521 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-08-19T00:10:59.782 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:59 smithi044 ceph-mon[18489]: pgmap v266: 97 pgs: 97 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-08-19T00:10:59.782 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:59 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/3366359766' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-08-19T00:10:59.783 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:59 smithi044 ceph-mon[18489]: osdmap e87: 12 total, 12 up, 12 in 2024-08-19T00:10:59.783 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:10:59 smithi044 ceph-mon[18489]: osdmap e88: 12 total, 12 up, 12 in 2024-08-19T00:10:59.798 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:11:00.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:59 smithi171 ceph-mon[21810]: pgmap v266: 97 pgs: 97 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-08-19T00:11:00.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:59 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/3366359766' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-08-19T00:11:00.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:59 smithi171 ceph-mon[21810]: osdmap e87: 12 total, 12 up, 12 in 2024-08-19T00:11:00.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:10:59 smithi171 ceph-mon[21810]: osdmap e88: 12 total, 12 up, 12 in 2024-08-19T00:11:00.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:59 smithi116 ceph-mon[21873]: pgmap v266: 97 pgs: 97 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-08-19T00:11:00.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:59 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/3366359766' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-08-19T00:11:00.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:59 smithi116 ceph-mon[21873]: osdmap e87: 12 total, 12 up, 12 in 2024-08-19T00:11:00.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:10:59 smithi116 ceph-mon[21873]: osdmap e88: 12 total, 12 up, 12 in 2024-08-19T00:11:00.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:00.263+0000 7f2f5ddd3640 1 -- 172.21.15.44:0/3368529167 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f581067b0 msgr2=0x7f2f58106b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:00.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:00.263+0000 7f2f5ddd3640 1 --2- 172.21.15.44:0/3368529167 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f581067b0 0x7f2f58106b90 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2f48009930 tx=0x7f2f4802a420 comp rx=0 tx=0).stop 2024-08-19T00:11:00.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:00.263+0000 7f2f5ddd3640 1 -- 172.21.15.44:0/3368529167 shutdown_connections 2024-08-19T00:11:00.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:00.263+0000 7f2f5ddd3640 1 --2- 172.21.15.44:0/3368529167 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f58101150 0x7f2f5810d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:00.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:00.263+0000 7f2f5ddd3640 1 --2- 172.21.15.44:0/3368529167 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2f581007b0 0x7f2f58100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:00.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:00.263+0000 7f2f5ddd3640 1 --2- 172.21.15.44:0/3368529167 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f581067b0 0x7f2f58106b90 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:00.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:00.263+0000 7f2f5ddd3640 1 -- 172.21.15.44:0/3368529167 >> 172.21.15.44:0/3368529167 conn(0x7f2f580fc4d0 msgr2=0x7f2f580fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:00.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:00.263+0000 7f2f5ddd3640 1 -- 172.21.15.44:0/3368529167 shutdown_connections 2024-08-19T00:11:00.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:00.263+0000 7f2f5ddd3640 1 -- 172.21.15.44:0/3368529167 wait complete. 2024-08-19T00:11:00.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:00.263+0000 7f2f5ddd3640 1 Processor -- start 2024-08-19T00:11:00.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:00.264+0000 7f2f5ddd3640 1 -- start start 2024-08-19T00:11:00.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:00.264+0000 7f2f5ddd3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f581007b0 0x7f2f58198170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:00.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:00.264+0000 7f2f5ddd3640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2f58101150 0x7f2f581986b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:00.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:00.264+0000 7f2f5ddd3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f581067b0 0x7f2f5819ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:00.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:00.264+0000 7f2f5ddd3640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2f58110bb0 con 0x7f2f581007b0 2024-08-19T00:11:00.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:00.264+0000 7f2f5ddd3640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f2f58110a30 con 0x7f2f58101150 2024-08-19T00:11:00.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:00.264+0000 7f2f5ddd3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2f58110d30 con 0x7f2f581067b0 2024-08-19T00:11:00.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:00.264+0000 7f2f577fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f581007b0 0x7f2f58198170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:00.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:00.264+0000 7f2f577fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f581007b0 0x7f2f58198170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60098/0 (socket says 172.21.15.44:60098) 2024-08-19T00:11:00.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:00.264+0000 7f2f577fe640 1 -- 172.21.15.44:0/521287367 learned_addr learned my addr 172.21.15.44:0/521287367 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:11:00.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:00.264+0000 7f2f57fff640 1 --2- 172.21.15.44:0/521287367 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f581067b0 0x7f2f5819ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:00.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:00.264+0000 7f2f56ffd640 1 --2- 172.21.15.44:0/521287367 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2f58101150 0x7f2f581986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:00.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:00.264+0000 7f2f577fe640 1 -- 172.21.15.44:0/521287367 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f581067b0 msgr2=0x7f2f5819ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:00.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:00.264+0000 7f2f577fe640 1 --2- 172.21.15.44:0/521287367 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f581067b0 0x7f2f5819ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:00.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:00.264+0000 7f2f577fe640 1 -- 172.21.15.44:0/521287367 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2f58101150 msgr2=0x7f2f581986b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:00.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:00.264+0000 7f2f577fe640 1 --2- 172.21.15.44:0/521287367 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2f58101150 0x7f2f581986b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:00.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:00.264+0000 7f2f577fe640 1 -- 172.21.15.44:0/521287367 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f5819d120 con 0x7f2f581007b0 2024-08-19T00:11:00.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:00.264+0000 7f2f56ffd640 1 --2- 172.21.15.44:0/521287367 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2f58101150 0x7f2f581986b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:11:00.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:00.264+0000 7f2f57fff640 1 --2- 172.21.15.44:0/521287367 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f581067b0 0x7f2f5819ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:11:00.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:00.265+0000 7f2f577fe640 1 --2- 172.21.15.44:0/521287367 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f581007b0 0x7f2f58198170 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2f48009230 tx=0x7f2f48004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:00.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:00.265+0000 7f2f54ff9640 1 -- 172.21.15.44:0/521287367 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f4803f030 con 0x7f2f581007b0 2024-08-19T00:11:00.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:00.265+0000 7f2f54ff9640 1 -- 172.21.15.44:0/521287367 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f48003ad0 con 0x7f2f581007b0 2024-08-19T00:11:00.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:00.265+0000 7f2f5ddd3640 1 -- 172.21.15.44:0/521287367 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f5819d3b0 con 0x7f2f581007b0 2024-08-19T00:11:00.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:00.265+0000 7f2f54ff9640 1 -- 172.21.15.44:0/521287367 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f48035070 con 0x7f2f581007b0 2024-08-19T00:11:00.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:00.265+0000 7f2f5ddd3640 1 -- 172.21.15.44:0/521287367 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f581a4cf0 con 0x7f2f581007b0 2024-08-19T00:11:00.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:00.266+0000 7f2f5ddd3640 1 -- 172.21.15.44:0/521287367 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f58101ef0 con 0x7f2f581007b0 2024-08-19T00:11:00.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:00.268+0000 7f2f54ff9640 1 -- 172.21.15.44:0/521287367 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f2f48042030 con 0x7f2f581007b0 2024-08-19T00:11:00.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:00.268+0000 7f2f54ff9640 1 --2- 172.21.15.44:0/521287367 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f2f400a2b80 0x7f2f400a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:00.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:00.268+0000 7f2f56ffd640 1 --2- 172.21.15.44:0/521287367 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f2f400a2b80 0x7f2f400a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:00.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:00.268+0000 7f2f54ff9640 1 -- 172.21.15.44:0/521287367 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8770+0+0 (secure 0 0 0) 0x7f2f480efc20 con 0x7f2f581007b0 2024-08-19T00:11:00.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:00.269+0000 7f2f56ffd640 1 --2- 172.21.15.44:0/521287367 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f2f400a2b80 0x7f2f400a5040 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2f5806b5a0 tx=0x7f2f4c005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:00.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:00.272+0000 7f2f54ff9640 1 -- 172.21.15.44:0/521287367 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f2f480bc960 con 0x7f2f581007b0 2024-08-19T00:11:00.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:00.448+0000 7f2f5ddd3640 1 -- 172.21.15.44:0/521287367 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f2f58100c10 con 0x7f2f581007b0 2024-08-19T00:11:00.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:00.782+0000 7f2f54ff9640 1 -- 172.21.15.44:0/521287367 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v89) ==== 169+0+0 (secure 0 0 0) 0x7f2f480bc260 con 0x7f2f581007b0 2024-08-19T00:11:00.784 INFO:teuthology.orchestra.run.smithi044.stderr:set pool 4 allow_ec_overwrites to true 2024-08-19T00:11:00.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:00.785+0000 7f2f5ddd3640 1 -- 172.21.15.44:0/521287367 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f2f400a2b80 msgr2=0x7f2f400a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:00.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:00.785+0000 7f2f5ddd3640 1 --2- 172.21.15.44:0/521287367 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f2f400a2b80 0x7f2f400a5040 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2f5806b5a0 tx=0x7f2f4c005e50 comp rx=0 tx=0).stop 2024-08-19T00:11:00.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:00.785+0000 7f2f5ddd3640 1 -- 172.21.15.44:0/521287367 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f581007b0 msgr2=0x7f2f58198170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:00.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:00.785+0000 7f2f5ddd3640 1 --2- 172.21.15.44:0/521287367 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f581007b0 0x7f2f58198170 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2f48009230 tx=0x7f2f48004270 comp rx=0 tx=0).stop 2024-08-19T00:11:00.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:00.785+0000 7f2f5ddd3640 1 -- 172.21.15.44:0/521287367 shutdown_connections 2024-08-19T00:11:00.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:00.785+0000 7f2f5ddd3640 1 --2- 172.21.15.44:0/521287367 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f2f400a2b80 0x7f2f400a5040 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:00.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:00.785+0000 7f2f5ddd3640 1 --2- 172.21.15.44:0/521287367 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f581067b0 0x7f2f5819ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:00.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:00.785+0000 7f2f5ddd3640 1 --2- 172.21.15.44:0/521287367 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2f58101150 0x7f2f581986b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:00.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:00.785+0000 7f2f5ddd3640 1 --2- 172.21.15.44:0/521287367 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f581007b0 0x7f2f58198170 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:00.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:00.785+0000 7f2f5ddd3640 1 -- 172.21.15.44:0/521287367 >> 172.21.15.44:0/521287367 conn(0x7f2f580fc4d0 msgr2=0x7f2f58104940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:00.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:00.785+0000 7f2f5ddd3640 1 -- 172.21.15.44:0/521287367 shutdown_connections 2024-08-19T00:11:00.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:00.785+0000 7f2f5ddd3640 1 -- 172.21.15.44:0/521287367 wait complete. 2024-08-19T00:11:01.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:00 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/521287367' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-08-19T00:11:01.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:00 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/521287367' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-08-19T00:11:01.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:00 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/521287367' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-08-19T00:11:01.497 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph fs add_data_pool cephfs cephfs_data_ec 2024-08-19T00:11:01.759 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:11:02.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:01 smithi171 ceph-mon[21810]: pgmap v269: 129 pgs: 3 creating+peering, 18 unknown, 108 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 2 op/s 2024-08-19T00:11:02.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:01 smithi171 ceph-mon[21810]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-19T00:11:02.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:01 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/521287367' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-08-19T00:11:02.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:01 smithi171 ceph-mon[21810]: osdmap e89: 12 total, 12 up, 12 in 2024-08-19T00:11:02.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:01 smithi116 ceph-mon[21873]: pgmap v269: 129 pgs: 3 creating+peering, 18 unknown, 108 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 2 op/s 2024-08-19T00:11:02.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:01 smithi116 ceph-mon[21873]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-19T00:11:02.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:01 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/521287367' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-08-19T00:11:02.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:01 smithi116 ceph-mon[21873]: osdmap e89: 12 total, 12 up, 12 in 2024-08-19T00:11:02.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:01 smithi044 ceph-mon[18489]: pgmap v269: 129 pgs: 3 creating+peering, 18 unknown, 108 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 2 op/s 2024-08-19T00:11:02.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:01 smithi044 ceph-mon[18489]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-19T00:11:02.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:01 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/521287367' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-08-19T00:11:02.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:01 smithi044 ceph-mon[18489]: osdmap e89: 12 total, 12 up, 12 in 2024-08-19T00:11:02.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:02.229+0000 7fdd33ca3640 1 -- 172.21.15.44:0/809301361 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdd2c102c20 msgr2=0x7fdd2c10d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:02.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:02.229+0000 7fdd33ca3640 1 --2- 172.21.15.44:0/809301361 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdd2c102c20 0x7fdd2c10d770 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fdd24009ca0 tx=0x7fdd2402a950 comp rx=0 tx=0).stop 2024-08-19T00:11:02.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:02.229+0000 7fdd33ca3640 1 -- 172.21.15.44:0/809301361 shutdown_connections 2024-08-19T00:11:02.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:02.229+0000 7fdd33ca3640 1 --2- 172.21.15.44:0/809301361 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd2c1022a0 0x7fdd2c1026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:02.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:02.229+0000 7fdd33ca3640 1 --2- 172.21.15.44:0/809301361 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdd2c102c20 0x7fdd2c10d770 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:02.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:02.229+0000 7fdd33ca3640 1 --2- 172.21.15.44:0/809301361 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdd2c100b50 0x7fdd2c100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:02.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:02.229+0000 7fdd33ca3640 1 -- 172.21.15.44:0/809301361 >> 172.21.15.44:0/809301361 conn(0x7fdd2c0fc500 msgr2=0x7fdd2c0fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:02.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:02.229+0000 7fdd33ca3640 1 -- 172.21.15.44:0/809301361 shutdown_connections 2024-08-19T00:11:02.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:02.229+0000 7fdd33ca3640 1 -- 172.21.15.44:0/809301361 wait complete. 2024-08-19T00:11:02.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:02.230+0000 7fdd33ca3640 1 Processor -- start 2024-08-19T00:11:02.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:02.230+0000 7fdd33ca3640 1 -- start start 2024-08-19T00:11:02.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:02.230+0000 7fdd33ca3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd2c100b50 0x7fdd2c198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:02.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:02.230+0000 7fdd33ca3640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdd2c1022a0 0x7fdd2c198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:02.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:02.230+0000 7fdd33ca3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdd2c102c20 0x7fdd2c19cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:02.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:02.230+0000 7fdd33ca3640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdd2c111e50 con 0x7fdd2c102c20 2024-08-19T00:11:02.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:02.230+0000 7fdd33ca3640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fdd2c111cd0 con 0x7fdd2c1022a0 2024-08-19T00:11:02.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:02.230+0000 7fdd33ca3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fdd2c111fd0 con 0x7fdd2c100b50 2024-08-19T00:11:02.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:02.230+0000 7fdd32240640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdd2c102c20 0x7fdd2c19cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:02.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:02.230+0000 7fdd32240640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdd2c102c20 0x7fdd2c19cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60120/0 (socket says 172.21.15.44:60120) 2024-08-19T00:11:02.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:02.230+0000 7fdd32240640 1 -- 172.21.15.44:0/2723748424 learned_addr learned my addr 172.21.15.44:0/2723748424 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:11:02.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:02.230+0000 7fdd31a3f640 1 --2- 172.21.15.44:0/2723748424 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd2c100b50 0x7fdd2c198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:02.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:02.230+0000 7fdd3123e640 1 --2- 172.21.15.44:0/2723748424 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdd2c1022a0 0x7fdd2c198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:02.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:02.230+0000 7fdd32240640 1 -- 172.21.15.44:0/2723748424 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd2c100b50 msgr2=0x7fdd2c198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:02.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:02.230+0000 7fdd32240640 1 --2- 172.21.15.44:0/2723748424 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd2c100b50 0x7fdd2c198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:02.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:02.230+0000 7fdd32240640 1 -- 172.21.15.44:0/2723748424 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdd2c1022a0 msgr2=0x7fdd2c198850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:02.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:02.230+0000 7fdd32240640 1 --2- 172.21.15.44:0/2723748424 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdd2c1022a0 0x7fdd2c198850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:02.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:02.230+0000 7fdd32240640 1 -- 172.21.15.44:0/2723748424 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd2c19d2c0 con 0x7fdd2c102c20 2024-08-19T00:11:02.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:02.230+0000 7fdd3123e640 1 --2- 172.21.15.44:0/2723748424 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdd2c1022a0 0x7fdd2c198850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:11:02.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:02.230+0000 7fdd32240640 1 --2- 172.21.15.44:0/2723748424 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdd2c102c20 0x7fdd2c19cbe0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fdd24006010 tx=0x7fdd2402f6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:02.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:02.231+0000 7fdd22ffd640 1 -- 172.21.15.44:0/2723748424 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd24034040 con 0x7fdd2c102c20 2024-08-19T00:11:02.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:02.231+0000 7fdd33ca3640 1 -- 172.21.15.44:0/2723748424 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd2c19d550 con 0x7fdd2c102c20 2024-08-19T00:11:02.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:02.231+0000 7fdd22ffd640 1 -- 172.21.15.44:0/2723748424 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd24003e00 con 0x7fdd2c102c20 2024-08-19T00:11:02.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:02.231+0000 7fdd22ffd640 1 -- 172.21.15.44:0/2723748424 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd24045480 con 0x7fdd2c102c20 2024-08-19T00:11:02.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:02.231+0000 7fdd33ca3640 1 -- 172.21.15.44:0/2723748424 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd2c1a4e90 con 0x7fdd2c102c20 2024-08-19T00:11:02.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:02.232+0000 7fdd33ca3640 1 -- 172.21.15.44:0/2723748424 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd2c100fb0 con 0x7fdd2c102c20 2024-08-19T00:11:02.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:02.233+0000 7fdd22ffd640 1 -- 172.21.15.44:0/2723748424 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fdd24037020 con 0x7fdd2c102c20 2024-08-19T00:11:02.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:02.233+0000 7fdd22ffd640 1 --2- 172.21.15.44:0/2723748424 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fdd180a2b80 0x7fdd180a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:02.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:02.233+0000 7fdd31a3f640 1 --2- 172.21.15.44:0/2723748424 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fdd180a2b80 0x7fdd180a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:02.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:02.233+0000 7fdd22ffd640 1 -- 172.21.15.44:0/2723748424 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8770+0+0 (secure 0 0 0) 0x7fdd240f0480 con 0x7fdd2c102c20 2024-08-19T00:11:02.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:02.234+0000 7fdd31a3f640 1 --2- 172.21.15.44:0/2723748424 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fdd180a2b80 0x7fdd180a5040 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdd28009890 tx=0x7fdd28008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:02.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:02.237+0000 7fdd22ffd640 1 -- 172.21.15.44:0/2723748424 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fdd240bd1c0 con 0x7fdd2c102c20 2024-08-19T00:11:02.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:02.450+0000 7fdd33ca3640 1 -- 172.21.15.44:0/2723748424 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7fdd2c108dc0 con 0x7fdd2c102c20 2024-08-19T00:11:02.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:02.793+0000 7fdd22ffd640 1 -- 172.21.15.44:0/2723748424 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v16) ==== 137+0+0 (secure 0 0 0) 0x7fdd240bcac0 con 0x7fdd2c102c20 2024-08-19T00:11:02.795 INFO:teuthology.orchestra.run.smithi044.stderr:added data pool 4 to fsmap 2024-08-19T00:11:02.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:02.795+0000 7fdd33ca3640 1 -- 172.21.15.44:0/2723748424 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fdd180a2b80 msgr2=0x7fdd180a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:02.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:02.795+0000 7fdd33ca3640 1 --2- 172.21.15.44:0/2723748424 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fdd180a2b80 0x7fdd180a5040 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdd28009890 tx=0x7fdd28008040 comp rx=0 tx=0).stop 2024-08-19T00:11:02.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:02.795+0000 7fdd33ca3640 1 -- 172.21.15.44:0/2723748424 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdd2c102c20 msgr2=0x7fdd2c19cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:02.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:02.795+0000 7fdd33ca3640 1 --2- 172.21.15.44:0/2723748424 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdd2c102c20 0x7fdd2c19cbe0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fdd24006010 tx=0x7fdd2402f6f0 comp rx=0 tx=0).stop 2024-08-19T00:11:02.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:02.796+0000 7fdd33ca3640 1 -- 172.21.15.44:0/2723748424 shutdown_connections 2024-08-19T00:11:02.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:02.796+0000 7fdd33ca3640 1 --2- 172.21.15.44:0/2723748424 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fdd180a2b80 0x7fdd180a5040 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:02.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:02.796+0000 7fdd33ca3640 1 --2- 172.21.15.44:0/2723748424 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdd2c102c20 0x7fdd2c19cbe0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:02.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:02.796+0000 7fdd33ca3640 1 --2- 172.21.15.44:0/2723748424 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdd2c1022a0 0x7fdd2c198850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:02.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:02.796+0000 7fdd33ca3640 1 --2- 172.21.15.44:0/2723748424 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd2c100b50 0x7fdd2c198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:02.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:02.796+0000 7fdd33ca3640 1 -- 172.21.15.44:0/2723748424 >> 172.21.15.44:0/2723748424 conn(0x7fdd2c0fc500 msgr2=0x7fdd2c0fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:02.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:02.796+0000 7fdd33ca3640 1 -- 172.21.15.44:0/2723748424 shutdown_connections 2024-08-19T00:11:02.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:02.796+0000 7fdd33ca3640 1 -- 172.21.15.44:0/2723748424 wait complete. 2024-08-19T00:11:03.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:02 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/2723748424' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-08-19T00:11:03.094 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:02 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/2723748424' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-08-19T00:11:03.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:02 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/2723748424' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-08-19T00:11:03.448 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-19T00:11:03.710 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:11:04.054 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:03 smithi044 ceph-mon[18489]: pgmap v271: 129 pgs: 3 creating+peering, 4 unknown, 122 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 217 B/s wr, 1 op/s 2024-08-19T00:11:04.055 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:03 smithi044 ceph-mon[18489]: osdmap e90: 12 total, 12 up, 12 in 2024-08-19T00:11:04.055 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:03 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/2723748424' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-08-19T00:11:04.055 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:03 smithi044 ceph-mon[18489]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-19T00:11:04.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:03 smithi171 ceph-mon[21810]: pgmap v271: 129 pgs: 3 creating+peering, 4 unknown, 122 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 217 B/s wr, 1 op/s 2024-08-19T00:11:04.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:03 smithi171 ceph-mon[21810]: osdmap e90: 12 total, 12 up, 12 in 2024-08-19T00:11:04.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:03 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/2723748424' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-08-19T00:11:04.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:03 smithi171 ceph-mon[21810]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-19T00:11:04.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:03 smithi116 ceph-mon[21873]: pgmap v271: 129 pgs: 3 creating+peering, 4 unknown, 122 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 217 B/s wr, 1 op/s 2024-08-19T00:11:04.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:03 smithi116 ceph-mon[21873]: osdmap e90: 12 total, 12 up, 12 in 2024-08-19T00:11:04.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:03 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/2723748424' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-08-19T00:11:04.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:03 smithi116 ceph-mon[21873]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-19T00:11:04.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:04.185+0000 7efeb6244640 1 -- 172.21.15.44:0/3410385022 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efeb0102b10 msgr2=0x7efeb0102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:04.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:04.185+0000 7efeb6244640 1 --2- 172.21.15.44:0/3410385022 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efeb0102b10 0x7efeb0102ef0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7efea0009900 tx=0x7efea002a480 comp rx=0 tx=0).stop 2024-08-19T00:11:04.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:04.185+0000 7efeb6244640 1 -- 172.21.15.44:0/3410385022 shutdown_connections 2024-08-19T00:11:04.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:04.185+0000 7efeb6244640 1 --2- 172.21.15.44:0/3410385022 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efeb0103430 0x7efeb010b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:04.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:04.185+0000 7efeb6244640 1 --2- 172.21.15.44:0/3410385022 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efeb010beb0 0x7efeb010e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:04.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:04.185+0000 7efeb6244640 1 --2- 172.21.15.44:0/3410385022 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efeb0102b10 0x7efeb0102ef0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:04.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:04.185+0000 7efeb6244640 1 -- 172.21.15.44:0/3410385022 >> 172.21.15.44:0/3410385022 conn(0x7efeb00fc4d0 msgr2=0x7efeb00fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:04.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:04.185+0000 7efeb6244640 1 -- 172.21.15.44:0/3410385022 shutdown_connections 2024-08-19T00:11:04.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:04.185+0000 7efeb6244640 1 -- 172.21.15.44:0/3410385022 wait complete. 2024-08-19T00:11:04.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:04.186+0000 7efeb6244640 1 Processor -- start 2024-08-19T00:11:04.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:04.186+0000 7efeb6244640 1 -- start start 2024-08-19T00:11:04.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:04.186+0000 7efeb6244640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efeb0102b10 0x7efeb019a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:04.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:04.186+0000 7efeb6244640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efeb0103430 0x7efeb019a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:04.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:04.186+0000 7efeb6244640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efeb010beb0 0x7efeb019ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:04.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:04.186+0000 7efeb6244640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7efeb01015a0 con 0x7efeb0102b10 2024-08-19T00:11:04.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:04.186+0000 7efeb6244640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7efeb0101420 con 0x7efeb010beb0 2024-08-19T00:11:04.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:04.186+0000 7efeb6244640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7efeb0101720 con 0x7efeb0103430 2024-08-19T00:11:04.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:04.187+0000 7efeaf7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efeb0102b10 0x7efeb019a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:04.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:04.187+0000 7efeaf7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efeb0102b10 0x7efeb019a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60140/0 (socket says 172.21.15.44:60140) 2024-08-19T00:11:04.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:04.187+0000 7efeaf7fe640 1 -- 172.21.15.44:0/146433101 learned_addr learned my addr 172.21.15.44:0/146433101 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:11:04.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:04.187+0000 7efeaffff640 1 --2- 172.21.15.44:0/146433101 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efeb010beb0 0x7efeb019ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:04.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:04.187+0000 7efeaeffd640 1 --2- 172.21.15.44:0/146433101 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efeb0103430 0x7efeb019a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:04.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:04.187+0000 7efeaf7fe640 1 -- 172.21.15.44:0/146433101 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efeb0103430 msgr2=0x7efeb019a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:04.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:04.187+0000 7efeaf7fe640 1 --2- 172.21.15.44:0/146433101 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efeb0103430 0x7efeb019a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:04.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:04.187+0000 7efeaf7fe640 1 -- 172.21.15.44:0/146433101 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efeb010beb0 msgr2=0x7efeb019ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:04.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:04.187+0000 7efeaf7fe640 1 --2- 172.21.15.44:0/146433101 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efeb010beb0 0x7efeb019ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:04.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:04.187+0000 7efeaf7fe640 1 -- 172.21.15.44:0/146433101 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeb019f360 con 0x7efeb0102b10 2024-08-19T00:11:04.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:04.187+0000 7efeaeffd640 1 --2- 172.21.15.44:0/146433101 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efeb0103430 0x7efeb019a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:11:04.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:04.187+0000 7efeaf7fe640 1 --2- 172.21.15.44:0/146433101 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efeb0102b10 0x7efeb019a430 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7efea0006010 tx=0x7efea00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:04.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:04.187+0000 7efeacff9640 1 -- 172.21.15.44:0/146433101 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea003f030 con 0x7efeb0102b10 2024-08-19T00:11:04.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:04.187+0000 7efeb6244640 1 -- 172.21.15.44:0/146433101 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efeb019f5f0 con 0x7efeb0102b10 2024-08-19T00:11:04.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:04.187+0000 7efeacff9640 1 -- 172.21.15.44:0/146433101 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efea0003ce0 con 0x7efeb0102b10 2024-08-19T00:11:04.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:04.187+0000 7efeacff9640 1 -- 172.21.15.44:0/146433101 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea0035070 con 0x7efeb0102b10 2024-08-19T00:11:04.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:04.187+0000 7efeb6244640 1 -- 172.21.15.44:0/146433101 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efeb01a6f30 con 0x7efeb0102b10 2024-08-19T00:11:04.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:04.188+0000 7efeb6244640 1 -- 172.21.15.44:0/146433101 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efeb0102ef0 con 0x7efeb0102b10 2024-08-19T00:11:04.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:04.190+0000 7efeacff9640 1 -- 172.21.15.44:0/146433101 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7efea0042030 con 0x7efeb0102b10 2024-08-19T00:11:04.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:04.190+0000 7efeacff9640 1 --2- 172.21.15.44:0/146433101 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7efe980a2b80 0x7efe980a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:04.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:04.190+0000 7efeaeffd640 1 --2- 172.21.15.44:0/146433101 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7efe980a2b80 0x7efe980a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:04.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:04.190+0000 7efeacff9640 1 -- 172.21.15.44:0/146433101 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7efea00efa80 con 0x7efeb0102b10 2024-08-19T00:11:04.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:04.191+0000 7efeaeffd640 1 --2- 172.21.15.44:0/146433101 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7efe980a2b80 0x7efe980a5040 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7efea4005fd0 tx=0x7efea4005ea0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:04.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:04.193+0000 7efeacff9640 1 -- 172.21.15.44:0/146433101 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7efea00bc7a0 con 0x7efeb0102b10 2024-08-19T00:11:04.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:04.406+0000 7efeb6244640 1 -- 172.21.15.44:0/146433101 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efeb019b710 con 0x7efeb0102b10 2024-08-19T00:11:04.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:04.406+0000 7efeacff9640 1 -- 172.21.15.44:0/146433101 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+11854 (secure 0 0 0) 0x7efea00bc0a0 con 0x7efeb0102b10 2024-08-19T00:11:04.408 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:11:04.408 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":16,"btime":"2024-08-19T00:11:02:785379+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14511,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1538841896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1538841896},{"type":"v1","addr":"172.21.15.116:6833","nonce":1538841896}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/4044471606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4044471606},{"type":"v1","addr":"172.21.15.44:6835","nonce":4044471606}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6837/1824829052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1824829052},{"type":"v1","addr":"172.21.15.44:6837","nonce":1824829052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14577,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6839/3591739042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":3591739042},{"type":"v1","addr":"172.21.15.44:6839","nonce":3591739042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6841/3667695717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6840","nonce":3667695717},{"type":"v1","addr":"172.21.15.44:6841","nonce":3667695717}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24388,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1183022838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1183022838},{"type":"v1","addr":"172.21.15.171:6833","nonce":1183022838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24412,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6835/2190623851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":2190623851},{"type":"v1","addr":"172.21.15.171:6835","nonce":2190623851}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24418,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/316231795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":316231795},{"type":"v1","addr":"172.21.15.171:6837","nonce":316231795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24431,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3507399322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3507399322},{"type":"v1","addr":"172.21.15.116:6835","nonce":3507399322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24439,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6839/1466585795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":1466585795},{"type":"v1","addr":"172.21.15.171:6839","nonce":1466585795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24446,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/2764513846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":2764513846},{"type":"v1","addr":"172.21.15.116:6837","nonce":2764513846}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:10:53.196636+0000","modified":"2024-08-19T00:11:02.452307+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24473},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.116:6839/1032741033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":1032741033},{"type":"v1","addr":"172.21.15.116:6839","nonce":1032741033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24473,"qdb_cluster":[24473]},"id":1}]} 2024-08-19T00:11:04.408 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 16 2024-08-19T00:11:04.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:04.408+0000 7efeb6244640 1 -- 172.21.15.44:0/146433101 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7efe980a2b80 msgr2=0x7efe980a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:04.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:04.408+0000 7efeb6244640 1 --2- 172.21.15.44:0/146433101 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7efe980a2b80 0x7efe980a5040 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7efea4005fd0 tx=0x7efea4005ea0 comp rx=0 tx=0).stop 2024-08-19T00:11:04.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:04.408+0000 7efeb6244640 1 -- 172.21.15.44:0/146433101 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efeb0102b10 msgr2=0x7efeb019a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:04.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:04.408+0000 7efeb6244640 1 --2- 172.21.15.44:0/146433101 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efeb0102b10 0x7efeb019a430 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7efea0006010 tx=0x7efea00042f0 comp rx=0 tx=0).stop 2024-08-19T00:11:04.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:04.408+0000 7efeb6244640 1 -- 172.21.15.44:0/146433101 shutdown_connections 2024-08-19T00:11:04.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:04.408+0000 7efeb6244640 1 --2- 172.21.15.44:0/146433101 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7efe980a2b80 0x7efe980a5040 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:04.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:04.408+0000 7efeb6244640 1 --2- 172.21.15.44:0/146433101 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efeb0103430 0x7efeb019a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:04.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:04.408+0000 7efeb6244640 1 --2- 172.21.15.44:0/146433101 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efeb010beb0 0x7efeb019ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:04.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:04.408+0000 7efeb6244640 1 --2- 172.21.15.44:0/146433101 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efeb0102b10 0x7efeb019a430 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:04.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:04.408+0000 7efeb6244640 1 -- 172.21.15.44:0/146433101 >> 172.21.15.44:0/146433101 conn(0x7efeb00fc4d0 msgr2=0x7efeb010d460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:04.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:04.408+0000 7efeb6244640 1 -- 172.21.15.44:0/146433101 shutdown_connections 2024-08-19T00:11:04.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:04.409+0000 7efeb6244640 1 -- 172.21.15.44:0/146433101 wait complete. 2024-08-19T00:11:05.027 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:04 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/146433101' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:11:05.056 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-19T00:11:05.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:04 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/146433101' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:11:05.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:04 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/146433101' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:11:05.312 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:11:05.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:05.913+0000 7fec8eb57640 1 -- 172.21.15.44:0/2469027561 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec881078b0 msgr2=0x7fec88107c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:05.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:05.913+0000 7fec8eb57640 1 --2- 172.21.15.44:0/2469027561 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec881078b0 0x7fec88107c90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fec78009930 tx=0x7fec7802a420 comp rx=0 tx=0).stop 2024-08-19T00:11:05.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:05.913+0000 7fec8eb57640 1 -- 172.21.15.44:0/2469027561 shutdown_connections 2024-08-19T00:11:05.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:05.913+0000 7fec8eb57640 1 --2- 172.21.15.44:0/2469027561 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fec88102250 0x7fec8810e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:05.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:05.913+0000 7fec8eb57640 1 --2- 172.21.15.44:0/2469027561 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec881018b0 0x7fec88101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:05.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:05.913+0000 7fec8eb57640 1 --2- 172.21.15.44:0/2469027561 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec881078b0 0x7fec88107c90 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:05.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:05.913+0000 7fec8eb57640 1 -- 172.21.15.44:0/2469027561 >> 172.21.15.44:0/2469027561 conn(0x7fec880fd5f0 msgr2=0x7fec880ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:05.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:05.914+0000 7fec8eb57640 1 -- 172.21.15.44:0/2469027561 shutdown_connections 2024-08-19T00:11:05.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:05.914+0000 7fec8eb57640 1 -- 172.21.15.44:0/2469027561 wait complete. 2024-08-19T00:11:05.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:05.914+0000 7fec8eb57640 1 Processor -- start 2024-08-19T00:11:05.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:05.914+0000 7fec8eb57640 1 -- start start 2024-08-19T00:11:05.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:05.914+0000 7fec8eb57640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fec881018b0 0x7fec88198200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:05.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:05.914+0000 7fec8eb57640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec88102250 0x7fec88198740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:05.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:05.914+0000 7fec8eb57640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec881078b0 0x7fec8819cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:05.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:05.914+0000 7fec8eb57640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fec88111d20 con 0x7fec881078b0 2024-08-19T00:11:05.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:05.914+0000 7fec8eb57640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fec88111ba0 con 0x7fec88102250 2024-08-19T00:11:05.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:05.914+0000 7fec8eb57640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fec88111ea0 con 0x7fec881018b0 2024-08-19T00:11:05.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:05.915+0000 7fec8d0f4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec881078b0 0x7fec8819cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:05.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:05.915+0000 7fec8d0f4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec881078b0 0x7fec8819cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60162/0 (socket says 172.21.15.44:60162) 2024-08-19T00:11:05.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:05.915+0000 7fec8d0f4640 1 -- 172.21.15.44:0/3062662825 learned_addr learned my addr 172.21.15.44:0/3062662825 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:11:05.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:05.915+0000 7fec8c8f3640 1 --2- 172.21.15.44:0/3062662825 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fec881018b0 0x7fec88198200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:05.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:05.915+0000 7fec87fff640 1 --2- 172.21.15.44:0/3062662825 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec88102250 0x7fec88198740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:05.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:05.915+0000 7fec8d0f4640 1 -- 172.21.15.44:0/3062662825 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fec881018b0 msgr2=0x7fec88198200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:05.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:05.915+0000 7fec8d0f4640 1 --2- 172.21.15.44:0/3062662825 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fec881018b0 0x7fec88198200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:05.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:05.915+0000 7fec8d0f4640 1 -- 172.21.15.44:0/3062662825 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec88102250 msgr2=0x7fec88198740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:05.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:05.915+0000 7fec8d0f4640 1 --2- 172.21.15.44:0/3062662825 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec88102250 0x7fec88198740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:05.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:05.915+0000 7fec8d0f4640 1 -- 172.21.15.44:0/3062662825 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec8819d1b0 con 0x7fec881078b0 2024-08-19T00:11:05.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:05.915+0000 7fec8d0f4640 1 --2- 172.21.15.44:0/3062662825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec881078b0 0x7fec8819cad0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fec8000b970 tx=0x7fec8000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:05.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:05.915+0000 7fec85ffb640 1 -- 172.21.15.44:0/3062662825 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec80019070 con 0x7fec881078b0 2024-08-19T00:11:05.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:05.915+0000 7fec85ffb640 1 -- 172.21.15.44:0/3062662825 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec8000cb40 con 0x7fec881078b0 2024-08-19T00:11:05.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:05.915+0000 7fec8eb57640 1 -- 172.21.15.44:0/3062662825 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec8819d4a0 con 0x7fec881078b0 2024-08-19T00:11:05.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:05.915+0000 7fec85ffb640 1 -- 172.21.15.44:0/3062662825 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec80007650 con 0x7fec881078b0 2024-08-19T00:11:05.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:05.915+0000 7fec8eb57640 1 -- 172.21.15.44:0/3062662825 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec881a4d80 con 0x7fec881078b0 2024-08-19T00:11:05.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:05.916+0000 7fec8eb57640 1 -- 172.21.15.44:0/3062662825 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec88101d10 con 0x7fec881078b0 2024-08-19T00:11:05.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:05.917+0000 7fec85ffb640 1 -- 172.21.15.44:0/3062662825 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fec8001c070 con 0x7fec881078b0 2024-08-19T00:11:05.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:05.918+0000 7fec85ffb640 1 --2- 172.21.15.44:0/3062662825 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fec700a2c00 0x7fec700a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:05.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:05.918+0000 7fec8c8f3640 1 --2- 172.21.15.44:0/3062662825 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fec700a2c00 0x7fec700a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:05.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:05.918+0000 7fec85ffb640 1 -- 172.21.15.44:0/3062662825 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7fec800ce860 con 0x7fec881078b0 2024-08-19T00:11:05.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:05.918+0000 7fec8c8f3640 1 --2- 172.21.15.44:0/3062662825 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fec700a2c00 0x7fec700a50c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fec78006010 tx=0x7fec78005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:05.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:05.922+0000 7fec85ffb640 1 -- 172.21.15.44:0/3062662825 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fec8009b580 con 0x7fec881078b0 2024-08-19T00:11:06.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:05 smithi171 ceph-mon[21810]: pgmap v273: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:11:06.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:05 smithi171 ceph-mon[21810]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-08-19T00:11:06.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:05 smithi171 ceph-mon[21810]: Cluster is now healthy 2024-08-19T00:11:06.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:06.097+0000 7fec8eb57640 1 -- 172.21.15.44:0/3062662825 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fec88109e80 con 0x7fec881078b0 2024-08-19T00:11:06.099 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:05 smithi044 ceph-mon[18489]: pgmap v273: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:11:06.099 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:05 smithi044 ceph-mon[18489]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-08-19T00:11:06.099 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:05 smithi044 ceph-mon[18489]: Cluster is now healthy 2024-08-19T00:11:06.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:06.099+0000 7fec85ffb640 1 -- 172.21.15.44:0/3062662825 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+24116 (secure 0 0 0) 0x7fec8009ae80 con 0x7fec881078b0 2024-08-19T00:11:06.101 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:11:06.101 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":90,"fsid":"647ded64-5dbe-11ef-bccf-c7b262605968","created":"2024-08-19T00:03:43.667929+0000","modified":"2024-08-19T00:11:02.452177+0000","last_up_change":"2024-08-19T00:10:01.557590+0000","last_in_change":"2024-08-19T00:09:42.433933+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T00:06:42.706553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-19T00:10:48.735065+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-19T00:10:51.481810+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-19T00:10:58.013004+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b15ad904-d07d-4ecb-be8f-d99323425eed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":600251465},{"type":"v1","addr":"172.21.15.44:6803","nonce":600251465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":600251465},{"type":"v1","addr":"172.21.15.44:6805","nonce":600251465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":600251465},{"type":"v1","addr":"172.21.15.44:6809","nonce":600251465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":600251465},{"type":"v1","addr":"172.21.15.44:6807","nonce":600251465}]},"public_addr":"172.21.15.44:6803/600251465","cluster_addr":"172.21.15.44:6805/600251465","heartbeat_back_addr":"172.21.15.44:6809/600251465","heartbeat_front_addr":"172.21.15.44:6807/600251465","state":["exists","up"]},{"osd":1,"uuid":"8f70512f-21a3-4fec-8278-04b2bc9b2d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":613509556},{"type":"v1","addr":"172.21.15.116:6801","nonce":613509556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":613509556},{"type":"v1","addr":"172.21.15.116:6803","nonce":613509556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":613509556},{"type":"v1","addr":"172.21.15.116:6807","nonce":613509556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":613509556},{"type":"v1","addr":"172.21.15.116:6805","nonce":613509556}]},"public_addr":"172.21.15.116:6801/613509556","cluster_addr":"172.21.15.116:6803/613509556","heartbeat_back_addr":"172.21.15.116:6807/613509556","heartbeat_front_addr":"172.21.15.116:6805/613509556","state":["exists","up"]},{"osd":2,"uuid":"56994dfd-5fcf-4d82-addf-38764239d82a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2130938937},{"type":"v1","addr":"172.21.15.171:6801","nonce":2130938937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2130938937},{"type":"v1","addr":"172.21.15.171:6803","nonce":2130938937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2130938937},{"type":"v1","addr":"172.21.15.171:6807","nonce":2130938937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2130938937},{"type":"v1","addr":"172.21.15.171:6805","nonce":2130938937}]},"public_addr":"172.21.15.171:6801/2130938937","cluster_addr":"172.21.15.171:6803/2130938937","heartbeat_back_addr":"172.21.15.171:6807/2130938937","heartbeat_front_addr":"172.21.15.171:6805/2130938937","state":["exists","up"]},{"osd":3,"uuid":"6d2ddb19-74e0-4e68-b9ea-58b73fd1e9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":3537027669},{"type":"v1","addr":"172.21.15.44:6811","nonce":3537027669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":3537027669},{"type":"v1","addr":"172.21.15.44:6813","nonce":3537027669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3537027669},{"type":"v1","addr":"172.21.15.44:6817","nonce":3537027669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":3537027669},{"type":"v1","addr":"172.21.15.44:6815","nonce":3537027669}]},"public_addr":"172.21.15.44:6811/3537027669","cluster_addr":"172.21.15.44:6813/3537027669","heartbeat_back_addr":"172.21.15.44:6817/3537027669","heartbeat_front_addr":"172.21.15.44:6815/3537027669","state":["exists","up"]},{"osd":4,"uuid":"190d208e-ae54-497d-ad72-d07a5a26991b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":3768627455},{"type":"v1","addr":"172.21.15.116:6809","nonce":3768627455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":3768627455},{"type":"v1","addr":"172.21.15.116:6811","nonce":3768627455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":3768627455},{"type":"v1","addr":"172.21.15.116:6815","nonce":3768627455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":3768627455},{"type":"v1","addr":"172.21.15.116:6813","nonce":3768627455}]},"public_addr":"172.21.15.116:6809/3768627455","cluster_addr":"172.21.15.116:6811/3768627455","heartbeat_back_addr":"172.21.15.116:6815/3768627455","heartbeat_front_addr":"172.21.15.116:6813/3768627455","state":["exists","up"]},{"osd":5,"uuid":"d8afacad-6d3d-4703-9744-8d01ff2a2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":938785018},{"type":"v1","addr":"172.21.15.171:6809","nonce":938785018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":938785018},{"type":"v1","addr":"172.21.15.171:6811","nonce":938785018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":938785018},{"type":"v1","addr":"172.21.15.171:6815","nonce":938785018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":938785018},{"type":"v1","addr":"172.21.15.171:6813","nonce":938785018}]},"public_addr":"172.21.15.171:6809/938785018","cluster_addr":"172.21.15.171:6811/938785018","heartbeat_back_addr":"172.21.15.171:6815/938785018","heartbeat_front_addr":"172.21.15.171:6813/938785018","state":["exists","up"]},{"osd":6,"uuid":"55bf1f89-99e5-409d-99fa-f0124aa042df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":1219334797},{"type":"v1","addr":"172.21.15.44:6819","nonce":1219334797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":1219334797},{"type":"v1","addr":"172.21.15.44:6821","nonce":1219334797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":1219334797},{"type":"v1","addr":"172.21.15.44:6825","nonce":1219334797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":1219334797},{"type":"v1","addr":"172.21.15.44:6823","nonce":1219334797}]},"public_addr":"172.21.15.44:6819/1219334797","cluster_addr":"172.21.15.44:6821/1219334797","heartbeat_back_addr":"172.21.15.44:6825/1219334797","heartbeat_front_addr":"172.21.15.44:6823/1219334797","state":["exists","up"]},{"osd":7,"uuid":"70130d71-d28c-4a58-b603-75610c8d3ea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":3861873415},{"type":"v1","addr":"172.21.15.116:6817","nonce":3861873415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":3861873415},{"type":"v1","addr":"172.21.15.116:6819","nonce":3861873415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":3861873415},{"type":"v1","addr":"172.21.15.116:6823","nonce":3861873415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":3861873415},{"type":"v1","addr":"172.21.15.116:6821","nonce":3861873415}]},"public_addr":"172.21.15.116:6817/3861873415","cluster_addr":"172.21.15.116:6819/3861873415","heartbeat_back_addr":"172.21.15.116:6823/3861873415","heartbeat_front_addr":"172.21.15.116:6821/3861873415","state":["exists","up"]},{"osd":8,"uuid":"c5121f70-e423-4f86-a3c6-90945c9385f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":843701060},{"type":"v1","addr":"172.21.15.171:6817","nonce":843701060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":843701060},{"type":"v1","addr":"172.21.15.171:6819","nonce":843701060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":843701060},{"type":"v1","addr":"172.21.15.171:6823","nonce":843701060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":843701060},{"type":"v1","addr":"172.21.15.171:6821","nonce":843701060}]},"public_addr":"172.21.15.171:6817/843701060","cluster_addr":"172.21.15.171:6819/843701060","heartbeat_back_addr":"172.21.15.171:6823/843701060","heartbeat_front_addr":"172.21.15.171:6821/843701060","state":["exists","up"]},{"osd":9,"uuid":"cd13693a-0f25-47cc-b1a5-9c42481935ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3206550013},{"type":"v1","addr":"172.21.15.44:6827","nonce":3206550013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":3206550013},{"type":"v1","addr":"172.21.15.44:6829","nonce":3206550013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3206550013},{"type":"v1","addr":"172.21.15.44:6833","nonce":3206550013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3206550013},{"type":"v1","addr":"172.21.15.44:6831","nonce":3206550013}]},"public_addr":"172.21.15.44:6827/3206550013","cluster_addr":"172.21.15.44:6829/3206550013","heartbeat_back_addr":"172.21.15.44:6833/3206550013","heartbeat_front_addr":"172.21.15.44:6831/3206550013","state":["exists","up"]},{"osd":10,"uuid":"a36ffeb1-6ecf-4899-bdfa-18515afefb86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3034738363},{"type":"v1","addr":"172.21.15.116:6825","nonce":3034738363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3034738363},{"type":"v1","addr":"172.21.15.116:6827","nonce":3034738363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3034738363},{"type":"v1","addr":"172.21.15.116:6831","nonce":3034738363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3034738363},{"type":"v1","addr":"172.21.15.116:6829","nonce":3034738363}]},"public_addr":"172.21.15.116:6825/3034738363","cluster_addr":"172.21.15.116:6827/3034738363","heartbeat_back_addr":"172.21.15.116:6831/3034738363","heartbeat_front_addr":"172.21.15.116:6829/3034738363","state":["exists","up"]},{"osd":11,"uuid":"ffcf44a8-3094-4a29-822e-a6ce95da119e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1500842656},{"type":"v1","addr":"172.21.15.171:6825","nonce":1500842656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1500842656},{"type":"v1","addr":"172.21.15.171:6827","nonce":1500842656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1500842656},{"type":"v1","addr":"172.21.15.171:6831","nonce":1500842656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1500842656},{"type":"v1","addr":"172.21.15.171:6829","nonce":1500842656}]},"public_addr":"172.21.15.171:6825/1500842656","cluster_addr":"172.21.15.171:6827/1500842656","heartbeat_back_addr":"172.21.15.171:6831/1500842656","heartbeat_front_addr":"172.21.15.171:6829/1500842656","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:05:56.916127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:06:17.603805+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:06:38.642970+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:07:00.667062+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:07:22.542529+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:07:44.732304+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:08:07.050742+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:08:29.451498+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:08:52.222169+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:09:15.422629+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:09:37.295311+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:09:59.716431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6800/1300308907":"2024-08-20T00:04:38.392912+0000","172.21.15.44:0/1001446555":"2024-08-20T00:04:38.392912+0000","172.21.15.44:0/3800526625":"2024-08-20T00:04:38.392912+0000","172.21.15.44:6801/1300308907":"2024-08-20T00:04:38.392912+0000","172.21.15.44:0/3096491642":"2024-08-20T00:04:14.604141+0000","172.21.15.44:0/400419582":"2024-08-20T00:04:38.392912+0000","172.21.15.44:0/1869412718":"2024-08-20T00:04:14.604141+0000","172.21.15.44:6801/1374527587":"2024-08-20T00:04:14.604141+0000","172.21.15.44:0/911382683":"2024-08-20T00:04:14.604141+0000","172.21.15.44:6800/1374527587":"2024-08-20T00:04:14.604141+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:11:06.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:06.101+0000 7fec8eb57640 1 -- 172.21.15.44:0/3062662825 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fec700a2c00 msgr2=0x7fec700a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:06.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:06.101+0000 7fec8eb57640 1 --2- 172.21.15.44:0/3062662825 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fec700a2c00 0x7fec700a50c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fec78006010 tx=0x7fec78005a20 comp rx=0 tx=0).stop 2024-08-19T00:11:06.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:06.101+0000 7fec8eb57640 1 -- 172.21.15.44:0/3062662825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec881078b0 msgr2=0x7fec8819cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:06.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:06.101+0000 7fec8eb57640 1 --2- 172.21.15.44:0/3062662825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec881078b0 0x7fec8819cad0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fec8000b970 tx=0x7fec8000be30 comp rx=0 tx=0).stop 2024-08-19T00:11:06.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:06.101+0000 7fec8eb57640 1 -- 172.21.15.44:0/3062662825 shutdown_connections 2024-08-19T00:11:06.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:06.101+0000 7fec8eb57640 1 --2- 172.21.15.44:0/3062662825 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fec700a2c00 0x7fec700a50c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:06.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:06.101+0000 7fec8eb57640 1 --2- 172.21.15.44:0/3062662825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec881078b0 0x7fec8819cad0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:06.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:06.101+0000 7fec8eb57640 1 --2- 172.21.15.44:0/3062662825 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fec88102250 0x7fec88198740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:06.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:06.101+0000 7fec8eb57640 1 --2- 172.21.15.44:0/3062662825 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fec881018b0 0x7fec88198200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:06.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:06.101+0000 7fec8eb57640 1 -- 172.21.15.44:0/3062662825 >> 172.21.15.44:0/3062662825 conn(0x7fec880fd5f0 msgr2=0x7fec880fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:06.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:06.101+0000 7fec8eb57640 1 -- 172.21.15.44:0/3062662825 shutdown_connections 2024-08-19T00:11:06.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:06.101+0000 7fec8eb57640 1 -- 172.21.15.44:0/3062662825 wait complete. 2024-08-19T00:11:06.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:05 smithi116 ceph-mon[21873]: pgmap v273: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:11:06.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:05 smithi116 ceph-mon[21873]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-08-19T00:11:06.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:05 smithi116 ceph-mon[21873]: Cluster is now healthy 2024-08-19T00:11:06.765 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-19T00:11:07.023 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:11:07.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:06 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/3062662825' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-19T00:11:07.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:06 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/3062662825' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-19T00:11:07.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:06 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/3062662825' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-19T00:11:07.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:07.536+0000 7f2683652640 1 -- 172.21.15.44:0/3663606403 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f267c10bed0 msgr2=0x7f267c10e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:07.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:07.536+0000 7f2683652640 1 --2- 172.21.15.44:0/3663606403 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f267c10bed0 0x7f267c10e340 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2674009ca0 tx=0x7f267402a950 comp rx=0 tx=0).stop 2024-08-19T00:11:07.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:07.536+0000 7f2683652640 1 -- 172.21.15.44:0/3663606403 shutdown_connections 2024-08-19T00:11:07.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:07.536+0000 7f2683652640 1 --2- 172.21.15.44:0/3663606403 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f267c103450 0x7f267c10b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:07.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:07.536+0000 7f2683652640 1 --2- 172.21.15.44:0/3663606403 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f267c10bed0 0x7f267c10e340 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:07.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:07.536+0000 7f2683652640 1 --2- 172.21.15.44:0/3663606403 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f267c102b30 0x7f267c102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:07.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:07.536+0000 7f2683652640 1 -- 172.21.15.44:0/3663606403 >> 172.21.15.44:0/3663606403 conn(0x7f267c0fc4d0 msgr2=0x7f267c0fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:07.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:07.536+0000 7f2683652640 1 -- 172.21.15.44:0/3663606403 shutdown_connections 2024-08-19T00:11:07.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:07.536+0000 7f2683652640 1 -- 172.21.15.44:0/3663606403 wait complete. 2024-08-19T00:11:07.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:07.537+0000 7f2683652640 1 Processor -- start 2024-08-19T00:11:07.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:07.537+0000 7f2683652640 1 -- start start 2024-08-19T00:11:07.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:07.537+0000 7f2683652640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f267c102b30 0x7f267c100790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:07.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:07.537+0000 7f2683652640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f267c103450 0x7f267c100cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:07.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:07.537+0000 7f2683652640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f267c10bed0 0x7f267c101210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:07.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:07.537+0000 7f2683652640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f267c111c80 con 0x7f267c103450 2024-08-19T00:11:07.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:07.537+0000 7f2683652640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f267c111b00 con 0x7f267c10bed0 2024-08-19T00:11:07.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:07.537+0000 7f2683652640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f267c111e00 con 0x7f267c102b30 2024-08-19T00:11:07.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:07.537+0000 7f2680bed640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f267c103450 0x7f267c100cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:07.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:07.537+0000 7f2680bed640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f267c103450 0x7f267c100cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60182/0 (socket says 172.21.15.44:60182) 2024-08-19T00:11:07.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:07.537+0000 7f2680bed640 1 -- 172.21.15.44:0/3795824473 learned_addr learned my addr 172.21.15.44:0/3795824473 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:11:07.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:07.537+0000 7f2680bed640 1 -- 172.21.15.44:0/3795824473 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f267c102b30 msgr2=0x7f267c100790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:07.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:07.537+0000 7f2681bef640 1 --2- 172.21.15.44:0/3795824473 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f267c10bed0 0x7f267c101210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:07.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:07.537+0000 7f2680bed640 1 --2- 172.21.15.44:0/3795824473 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f267c102b30 0x7f267c100790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:07.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:07.537+0000 7f2680bed640 1 -- 172.21.15.44:0/3795824473 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f267c10bed0 msgr2=0x7f267c101210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:07.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:07.537+0000 7f2680bed640 1 --2- 172.21.15.44:0/3795824473 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f267c10bed0 0x7f267c101210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:07.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:07.537+0000 7f2680bed640 1 -- 172.21.15.44:0/3795824473 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f267c1a6560 con 0x7f267c103450 2024-08-19T00:11:07.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:07.537+0000 7f2681bef640 1 --2- 172.21.15.44:0/3795824473 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f267c10bed0 0x7f267c101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:11:07.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:07.537+0000 7f2680bed640 1 --2- 172.21.15.44:0/3795824473 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f267c103450 0x7f267c100cd0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f266c00d770 tx=0x7f266c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:07.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:07.538+0000 7f26727fc640 1 -- 172.21.15.44:0/3795824473 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f266c017070 con 0x7f267c103450 2024-08-19T00:11:07.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:07.538+0000 7f26727fc640 1 -- 172.21.15.44:0/3795824473 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f266c005500 con 0x7f267c103450 2024-08-19T00:11:07.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:07.538+0000 7f2683652640 1 -- 172.21.15.44:0/3795824473 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f267c1a6850 con 0x7f267c103450 2024-08-19T00:11:07.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:07.538+0000 7f26727fc640 1 -- 172.21.15.44:0/3795824473 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f266c004e00 con 0x7f267c103450 2024-08-19T00:11:07.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:07.538+0000 7f2683652640 1 -- 172.21.15.44:0/3795824473 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f267c1a6d40 con 0x7f267c103450 2024-08-19T00:11:07.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:07.539+0000 7f2683652640 1 -- 172.21.15.44:0/3795824473 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f267c102f10 con 0x7f267c103450 2024-08-19T00:11:07.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:07.540+0000 7f26727fc640 1 -- 172.21.15.44:0/3795824473 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f266c004fa0 con 0x7f267c103450 2024-08-19T00:11:07.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:07.541+0000 7f26727fc640 1 --2- 172.21.15.44:0/3795824473 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f26680a2b80 0x7f26680a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:07.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:07.541+0000 7f26813ee640 1 --2- 172.21.15.44:0/3795824473 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f26680a2b80 0x7f26680a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:07.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:07.541+0000 7f26727fc640 1 -- 172.21.15.44:0/3795824473 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f266c0cedb0 con 0x7f267c103450 2024-08-19T00:11:07.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:07.541+0000 7f26813ee640 1 --2- 172.21.15.44:0/3795824473 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f26680a2b80 0x7f26680a5040 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f267800a990 tx=0x7f2678005c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:07.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:07.545+0000 7f26727fc640 1 -- 172.21.15.44:0/3795824473 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f266c0d3070 con 0x7f267c103450 2024-08-19T00:11:07.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:07.720+0000 7f2683652640 1 -- 172.21.15.44:0/3795824473 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f267c02d5e0 con 0x7f267c103450 2024-08-19T00:11:07.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:07.722+0000 7f26727fc640 1 -- 172.21.15.44:0/3795824473 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+24116 (secure 0 0 0) 0x7f266c09ba70 con 0x7f267c103450 2024-08-19T00:11:07.723 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:11:07.723 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":90,"fsid":"647ded64-5dbe-11ef-bccf-c7b262605968","created":"2024-08-19T00:03:43.667929+0000","modified":"2024-08-19T00:11:02.452177+0000","last_up_change":"2024-08-19T00:10:01.557590+0000","last_in_change":"2024-08-19T00:09:42.433933+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T00:06:42.706553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-19T00:10:48.735065+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-19T00:10:51.481810+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-19T00:10:58.013004+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b15ad904-d07d-4ecb-be8f-d99323425eed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":600251465},{"type":"v1","addr":"172.21.15.44:6803","nonce":600251465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":600251465},{"type":"v1","addr":"172.21.15.44:6805","nonce":600251465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":600251465},{"type":"v1","addr":"172.21.15.44:6809","nonce":600251465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":600251465},{"type":"v1","addr":"172.21.15.44:6807","nonce":600251465}]},"public_addr":"172.21.15.44:6803/600251465","cluster_addr":"172.21.15.44:6805/600251465","heartbeat_back_addr":"172.21.15.44:6809/600251465","heartbeat_front_addr":"172.21.15.44:6807/600251465","state":["exists","up"]},{"osd":1,"uuid":"8f70512f-21a3-4fec-8278-04b2bc9b2d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":613509556},{"type":"v1","addr":"172.21.15.116:6801","nonce":613509556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":613509556},{"type":"v1","addr":"172.21.15.116:6803","nonce":613509556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":613509556},{"type":"v1","addr":"172.21.15.116:6807","nonce":613509556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":613509556},{"type":"v1","addr":"172.21.15.116:6805","nonce":613509556}]},"public_addr":"172.21.15.116:6801/613509556","cluster_addr":"172.21.15.116:6803/613509556","heartbeat_back_addr":"172.21.15.116:6807/613509556","heartbeat_front_addr":"172.21.15.116:6805/613509556","state":["exists","up"]},{"osd":2,"uuid":"56994dfd-5fcf-4d82-addf-38764239d82a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2130938937},{"type":"v1","addr":"172.21.15.171:6801","nonce":2130938937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2130938937},{"type":"v1","addr":"172.21.15.171:6803","nonce":2130938937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2130938937},{"type":"v1","addr":"172.21.15.171:6807","nonce":2130938937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2130938937},{"type":"v1","addr":"172.21.15.171:6805","nonce":2130938937}]},"public_addr":"172.21.15.171:6801/2130938937","cluster_addr":"172.21.15.171:6803/2130938937","heartbeat_back_addr":"172.21.15.171:6807/2130938937","heartbeat_front_addr":"172.21.15.171:6805/2130938937","state":["exists","up"]},{"osd":3,"uuid":"6d2ddb19-74e0-4e68-b9ea-58b73fd1e9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":3537027669},{"type":"v1","addr":"172.21.15.44:6811","nonce":3537027669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":3537027669},{"type":"v1","addr":"172.21.15.44:6813","nonce":3537027669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3537027669},{"type":"v1","addr":"172.21.15.44:6817","nonce":3537027669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":3537027669},{"type":"v1","addr":"172.21.15.44:6815","nonce":3537027669}]},"public_addr":"172.21.15.44:6811/3537027669","cluster_addr":"172.21.15.44:6813/3537027669","heartbeat_back_addr":"172.21.15.44:6817/3537027669","heartbeat_front_addr":"172.21.15.44:6815/3537027669","state":["exists","up"]},{"osd":4,"uuid":"190d208e-ae54-497d-ad72-d07a5a26991b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":3768627455},{"type":"v1","addr":"172.21.15.116:6809","nonce":3768627455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":3768627455},{"type":"v1","addr":"172.21.15.116:6811","nonce":3768627455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":3768627455},{"type":"v1","addr":"172.21.15.116:6815","nonce":3768627455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":3768627455},{"type":"v1","addr":"172.21.15.116:6813","nonce":3768627455}]},"public_addr":"172.21.15.116:6809/3768627455","cluster_addr":"172.21.15.116:6811/3768627455","heartbeat_back_addr":"172.21.15.116:6815/3768627455","heartbeat_front_addr":"172.21.15.116:6813/3768627455","state":["exists","up"]},{"osd":5,"uuid":"d8afacad-6d3d-4703-9744-8d01ff2a2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":938785018},{"type":"v1","addr":"172.21.15.171:6809","nonce":938785018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":938785018},{"type":"v1","addr":"172.21.15.171:6811","nonce":938785018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":938785018},{"type":"v1","addr":"172.21.15.171:6815","nonce":938785018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":938785018},{"type":"v1","addr":"172.21.15.171:6813","nonce":938785018}]},"public_addr":"172.21.15.171:6809/938785018","cluster_addr":"172.21.15.171:6811/938785018","heartbeat_back_addr":"172.21.15.171:6815/938785018","heartbeat_front_addr":"172.21.15.171:6813/938785018","state":["exists","up"]},{"osd":6,"uuid":"55bf1f89-99e5-409d-99fa-f0124aa042df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":1219334797},{"type":"v1","addr":"172.21.15.44:6819","nonce":1219334797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":1219334797},{"type":"v1","addr":"172.21.15.44:6821","nonce":1219334797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":1219334797},{"type":"v1","addr":"172.21.15.44:6825","nonce":1219334797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":1219334797},{"type":"v1","addr":"172.21.15.44:6823","nonce":1219334797}]},"public_addr":"172.21.15.44:6819/1219334797","cluster_addr":"172.21.15.44:6821/1219334797","heartbeat_back_addr":"172.21.15.44:6825/1219334797","heartbeat_front_addr":"172.21.15.44:6823/1219334797","state":["exists","up"]},{"osd":7,"uuid":"70130d71-d28c-4a58-b603-75610c8d3ea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":3861873415},{"type":"v1","addr":"172.21.15.116:6817","nonce":3861873415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":3861873415},{"type":"v1","addr":"172.21.15.116:6819","nonce":3861873415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":3861873415},{"type":"v1","addr":"172.21.15.116:6823","nonce":3861873415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":3861873415},{"type":"v1","addr":"172.21.15.116:6821","nonce":3861873415}]},"public_addr":"172.21.15.116:6817/3861873415","cluster_addr":"172.21.15.116:6819/3861873415","heartbeat_back_addr":"172.21.15.116:6823/3861873415","heartbeat_front_addr":"172.21.15.116:6821/3861873415","state":["exists","up"]},{"osd":8,"uuid":"c5121f70-e423-4f86-a3c6-90945c9385f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":843701060},{"type":"v1","addr":"172.21.15.171:6817","nonce":843701060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":843701060},{"type":"v1","addr":"172.21.15.171:6819","nonce":843701060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":843701060},{"type":"v1","addr":"172.21.15.171:6823","nonce":843701060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":843701060},{"type":"v1","addr":"172.21.15.171:6821","nonce":843701060}]},"public_addr":"172.21.15.171:6817/843701060","cluster_addr":"172.21.15.171:6819/843701060","heartbeat_back_addr":"172.21.15.171:6823/843701060","heartbeat_front_addr":"172.21.15.171:6821/843701060","state":["exists","up"]},{"osd":9,"uuid":"cd13693a-0f25-47cc-b1a5-9c42481935ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3206550013},{"type":"v1","addr":"172.21.15.44:6827","nonce":3206550013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":3206550013},{"type":"v1","addr":"172.21.15.44:6829","nonce":3206550013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3206550013},{"type":"v1","addr":"172.21.15.44:6833","nonce":3206550013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3206550013},{"type":"v1","addr":"172.21.15.44:6831","nonce":3206550013}]},"public_addr":"172.21.15.44:6827/3206550013","cluster_addr":"172.21.15.44:6829/3206550013","heartbeat_back_addr":"172.21.15.44:6833/3206550013","heartbeat_front_addr":"172.21.15.44:6831/3206550013","state":["exists","up"]},{"osd":10,"uuid":"a36ffeb1-6ecf-4899-bdfa-18515afefb86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3034738363},{"type":"v1","addr":"172.21.15.116:6825","nonce":3034738363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3034738363},{"type":"v1","addr":"172.21.15.116:6827","nonce":3034738363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3034738363},{"type":"v1","addr":"172.21.15.116:6831","nonce":3034738363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3034738363},{"type":"v1","addr":"172.21.15.116:6829","nonce":3034738363}]},"public_addr":"172.21.15.116:6825/3034738363","cluster_addr":"172.21.15.116:6827/3034738363","heartbeat_back_addr":"172.21.15.116:6831/3034738363","heartbeat_front_addr":"172.21.15.116:6829/3034738363","state":["exists","up"]},{"osd":11,"uuid":"ffcf44a8-3094-4a29-822e-a6ce95da119e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1500842656},{"type":"v1","addr":"172.21.15.171:6825","nonce":1500842656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1500842656},{"type":"v1","addr":"172.21.15.171:6827","nonce":1500842656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1500842656},{"type":"v1","addr":"172.21.15.171:6831","nonce":1500842656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1500842656},{"type":"v1","addr":"172.21.15.171:6829","nonce":1500842656}]},"public_addr":"172.21.15.171:6825/1500842656","cluster_addr":"172.21.15.171:6827/1500842656","heartbeat_back_addr":"172.21.15.171:6831/1500842656","heartbeat_front_addr":"172.21.15.171:6829/1500842656","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:05:56.916127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:06:17.603805+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:06:38.642970+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:07:00.667062+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:07:22.542529+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:07:44.732304+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:08:07.050742+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:08:29.451498+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:08:52.222169+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:09:15.422629+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:09:37.295311+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:09:59.716431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6800/1300308907":"2024-08-20T00:04:38.392912+0000","172.21.15.44:0/1001446555":"2024-08-20T00:04:38.392912+0000","172.21.15.44:0/3800526625":"2024-08-20T00:04:38.392912+0000","172.21.15.44:6801/1300308907":"2024-08-20T00:04:38.392912+0000","172.21.15.44:0/3096491642":"2024-08-20T00:04:14.604141+0000","172.21.15.44:0/400419582":"2024-08-20T00:04:38.392912+0000","172.21.15.44:0/1869412718":"2024-08-20T00:04:14.604141+0000","172.21.15.44:6801/1374527587":"2024-08-20T00:04:14.604141+0000","172.21.15.44:0/911382683":"2024-08-20T00:04:14.604141+0000","172.21.15.44:6800/1374527587":"2024-08-20T00:04:14.604141+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:11:07.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:07.723+0000 7f2683652640 1 -- 172.21.15.44:0/3795824473 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f26680a2b80 msgr2=0x7f26680a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:07.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:07.723+0000 7f2683652640 1 --2- 172.21.15.44:0/3795824473 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f26680a2b80 0x7f26680a5040 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f267800a990 tx=0x7f2678005c70 comp rx=0 tx=0).stop 2024-08-19T00:11:07.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:07.723+0000 7f2683652640 1 -- 172.21.15.44:0/3795824473 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f267c103450 msgr2=0x7f267c100cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:07.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:07.723+0000 7f2683652640 1 --2- 172.21.15.44:0/3795824473 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f267c103450 0x7f267c100cd0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f266c00d770 tx=0x7f266c00dc30 comp rx=0 tx=0).stop 2024-08-19T00:11:07.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:07.724+0000 7f2683652640 1 -- 172.21.15.44:0/3795824473 shutdown_connections 2024-08-19T00:11:07.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:07.724+0000 7f2683652640 1 --2- 172.21.15.44:0/3795824473 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f26680a2b80 0x7f26680a5040 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:07.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:07.724+0000 7f2683652640 1 --2- 172.21.15.44:0/3795824473 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f267c10bed0 0x7f267c101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:07.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:07.724+0000 7f2683652640 1 --2- 172.21.15.44:0/3795824473 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f267c103450 0x7f267c100cd0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:07.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:07.724+0000 7f2683652640 1 --2- 172.21.15.44:0/3795824473 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f267c102b30 0x7f267c100790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:07.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:07.724+0000 7f2683652640 1 -- 172.21.15.44:0/3795824473 >> 172.21.15.44:0/3795824473 conn(0x7f267c0fc4d0 msgr2=0x7f267c0fd130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:07.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:07.724+0000 7f2683652640 1 -- 172.21.15.44:0/3795824473 shutdown_connections 2024-08-19T00:11:07.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:07.724+0000 7f2683652640 1 -- 172.21.15.44:0/3795824473 wait complete. 2024-08-19T00:11:08.044 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:07 smithi044 ceph-mon[18489]: pgmap v274: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:11:08.044 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:07 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/3795824473' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-19T00:11:08.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:07 smithi171 ceph-mon[21810]: pgmap v274: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:11:08.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:07 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/3795824473' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-19T00:11:08.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:07 smithi116 ceph-mon[21873]: pgmap v274: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:11:08.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:07 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/3795824473' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-19T00:11:08.377 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-19T00:11:08.636 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:11:09.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:09.128+0000 7ff87d96a640 1 -- 172.21.15.44:0/3951088431 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff878100b50 msgr2=0x7ff878100f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:09.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:09.128+0000 7ff87d96a640 1 --2- 172.21.15.44:0/3951088431 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff878100b50 0x7ff878100f30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff868009900 tx=0x7ff86802a480 comp rx=0 tx=0).stop 2024-08-19T00:11:09.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:09.128+0000 7ff87d96a640 1 -- 172.21.15.44:0/3951088431 shutdown_connections 2024-08-19T00:11:09.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:09.128+0000 7ff87d96a640 1 --2- 172.21.15.44:0/3951088431 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff878102c20 0x7ff87810d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:09.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:09.128+0000 7ff87d96a640 1 --2- 172.21.15.44:0/3951088431 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff8781022a0 0x7ff8781026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:09.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:09.128+0000 7ff87d96a640 1 --2- 172.21.15.44:0/3951088431 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff878100b50 0x7ff878100f30 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:09.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:09.128+0000 7ff87d96a640 1 -- 172.21.15.44:0/3951088431 >> 172.21.15.44:0/3951088431 conn(0x7ff8780fc500 msgr2=0x7ff8780fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:09.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:09.128+0000 7ff87d96a640 1 -- 172.21.15.44:0/3951088431 shutdown_connections 2024-08-19T00:11:09.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:09.128+0000 7ff87d96a640 1 -- 172.21.15.44:0/3951088431 wait complete. 2024-08-19T00:11:09.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:09.128+0000 7ff87d96a640 1 Processor -- start 2024-08-19T00:11:09.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:09.128+0000 7ff87d96a640 1 -- start start 2024-08-19T00:11:09.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:09.129+0000 7ff87d96a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff878100b50 0x7ff878199090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:09.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:09.129+0000 7ff87d96a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff8781022a0 0x7ff8781995d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:09.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:09.129+0000 7ff87d96a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff878102c20 0x7ff8781a4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:09.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:09.129+0000 7ff87d96a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff878110cd0 con 0x7ff878102c20 2024-08-19T00:11:09.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:09.129+0000 7ff87d96a640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7ff878110b50 con 0x7ff8781022a0 2024-08-19T00:11:09.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:09.129+0000 7ff87d96a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff878110e50 con 0x7ff878100b50 2024-08-19T00:11:09.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:09.129+0000 7ff8777fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff878102c20 0x7ff8781a4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:09.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:09.129+0000 7ff8777fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff878102c20 0x7ff8781a4110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39624/0 (socket says 172.21.15.44:39624) 2024-08-19T00:11:09.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:09.129+0000 7ff8777fe640 1 -- 172.21.15.44:0/748073358 learned_addr learned my addr 172.21.15.44:0/748073358 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:11:09.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:09.129+0000 7ff8777fe640 1 -- 172.21.15.44:0/748073358 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff878100b50 msgr2=0x7ff878199090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:09.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:09.129+0000 7ff8777fe640 1 --2- 172.21.15.44:0/748073358 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff878100b50 0x7ff878199090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:09.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:09.129+0000 7ff8777fe640 1 -- 172.21.15.44:0/748073358 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff8781022a0 msgr2=0x7ff8781995d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:09.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:09.129+0000 7ff8777fe640 1 --2- 172.21.15.44:0/748073358 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff8781022a0 0x7ff8781995d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:09.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:09.129+0000 7ff8777fe640 1 -- 172.21.15.44:0/748073358 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8781a4650 con 0x7ff878102c20 2024-08-19T00:11:09.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:09.129+0000 7ff8777fe640 1 --2- 172.21.15.44:0/748073358 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff878102c20 0x7ff8781a4110 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff87000eaa0 tx=0x7ff87000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:09.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:09.129+0000 7ff87c968640 1 -- 172.21.15.44:0/748073358 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff87000cdb0 con 0x7ff878102c20 2024-08-19T00:11:09.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:09.129+0000 7ff87d96a640 1 -- 172.21.15.44:0/748073358 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8781a4820 con 0x7ff878102c20 2024-08-19T00:11:09.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:09.129+0000 7ff87c968640 1 -- 172.21.15.44:0/748073358 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff870005020 con 0x7ff878102c20 2024-08-19T00:11:09.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:09.129+0000 7ff87c968640 1 -- 172.21.15.44:0/748073358 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8700116b0 con 0x7ff878102c20 2024-08-19T00:11:09.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:09.129+0000 7ff87d96a640 1 -- 172.21.15.44:0/748073358 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8781a4d30 con 0x7ff878102c20 2024-08-19T00:11:09.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:09.131+0000 7ff87d96a640 1 -- 172.21.15.44:0/748073358 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff878101ee0 con 0x7ff878102c20 2024-08-19T00:11:09.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:09.132+0000 7ff87c968640 1 -- 172.21.15.44:0/748073358 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7ff870005560 con 0x7ff878102c20 2024-08-19T00:11:09.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:09.132+0000 7ff87c968640 1 --2- 172.21.15.44:0/748073358 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7ff8640a2b80 0x7ff8640a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:09.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:09.132+0000 7ff876ffd640 1 --2- 172.21.15.44:0/748073358 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7ff8640a2b80 0x7ff8640a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:09.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:09.133+0000 7ff87c968640 1 -- 172.21.15.44:0/748073358 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7ff8700cf5f0 con 0x7ff878102c20 2024-08-19T00:11:09.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:09.133+0000 7ff876ffd640 1 --2- 172.21.15.44:0/748073358 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7ff8640a2b80 0x7ff8640a5040 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff8680096c0 tx=0x7ff868000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:09.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:09.136+0000 7ff87c968640 1 -- 172.21.15.44:0/748073358 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7ff870016030 con 0x7ff878102c20 2024-08-19T00:11:09.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:09.348+0000 7ff87d96a640 1 -- 172.21.15.44:0/748073358 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff8781a5050 con 0x7ff878102c20 2024-08-19T00:11:09.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:09.349+0000 7ff87c968640 1 -- 172.21.15.44:0/748073358 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+11854 (secure 0 0 0) 0x7ff87009c2b0 con 0x7ff878102c20 2024-08-19T00:11:09.351 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:11:09.351 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":16,"btime":"2024-08-19T00:11:02:785379+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14511,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1538841896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1538841896},{"type":"v1","addr":"172.21.15.116:6833","nonce":1538841896}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/4044471606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4044471606},{"type":"v1","addr":"172.21.15.44:6835","nonce":4044471606}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14529,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6837/1824829052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1824829052},{"type":"v1","addr":"172.21.15.44:6837","nonce":1824829052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14577,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6839/3591739042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":3591739042},{"type":"v1","addr":"172.21.15.44:6839","nonce":3591739042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6841/3667695717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6840","nonce":3667695717},{"type":"v1","addr":"172.21.15.44:6841","nonce":3667695717}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24388,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1183022838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1183022838},{"type":"v1","addr":"172.21.15.171:6833","nonce":1183022838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24412,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6835/2190623851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":2190623851},{"type":"v1","addr":"172.21.15.171:6835","nonce":2190623851}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24418,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/316231795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":316231795},{"type":"v1","addr":"172.21.15.171:6837","nonce":316231795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24431,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3507399322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3507399322},{"type":"v1","addr":"172.21.15.116:6835","nonce":3507399322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24439,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6839/1466585795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":1466585795},{"type":"v1","addr":"172.21.15.171:6839","nonce":1466585795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24446,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/2764513846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":2764513846},{"type":"v1","addr":"172.21.15.116:6837","nonce":2764513846}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-19T00:10:53.196636+0000","modified":"2024-08-19T00:11:02.452307+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24473},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.116:6839/1032741033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":1032741033},{"type":"v1","addr":"172.21.15.116:6839","nonce":1032741033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24473,"qdb_cluster":[24473]},"id":1}]} 2024-08-19T00:11:09.352 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 16 2024-08-19T00:11:09.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:09.352+0000 7ff87d96a640 1 -- 172.21.15.44:0/748073358 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7ff8640a2b80 msgr2=0x7ff8640a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:09.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:09.352+0000 7ff87d96a640 1 --2- 172.21.15.44:0/748073358 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7ff8640a2b80 0x7ff8640a5040 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff8680096c0 tx=0x7ff868000bc0 comp rx=0 tx=0).stop 2024-08-19T00:11:09.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:09.352+0000 7ff87d96a640 1 -- 172.21.15.44:0/748073358 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff878102c20 msgr2=0x7ff8781a4110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:09.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:09.352+0000 7ff87d96a640 1 --2- 172.21.15.44:0/748073358 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff878102c20 0x7ff8781a4110 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff87000eaa0 tx=0x7ff87000ef60 comp rx=0 tx=0).stop 2024-08-19T00:11:09.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:09.352+0000 7ff87d96a640 1 -- 172.21.15.44:0/748073358 shutdown_connections 2024-08-19T00:11:09.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:09.352+0000 7ff87d96a640 1 --2- 172.21.15.44:0/748073358 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7ff8640a2b80 0x7ff8640a5040 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:09.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:09.352+0000 7ff87d96a640 1 --2- 172.21.15.44:0/748073358 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff878102c20 0x7ff8781a4110 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:09.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:09.352+0000 7ff87d96a640 1 --2- 172.21.15.44:0/748073358 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff8781022a0 0x7ff8781995d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:09.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:09.352+0000 7ff87d96a640 1 --2- 172.21.15.44:0/748073358 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff878100b50 0x7ff878199090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:09.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:09.352+0000 7ff87d96a640 1 -- 172.21.15.44:0/748073358 >> 172.21.15.44:0/748073358 conn(0x7ff8780fc500 msgr2=0x7ff8780fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:09.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:09.352+0000 7ff87d96a640 1 -- 172.21.15.44:0/748073358 shutdown_connections 2024-08-19T00:11:09.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:09.352+0000 7ff87d96a640 1 -- 172.21.15.44:0/748073358 wait complete. 2024-08-19T00:11:09.972 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-19T00:11:10.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:09 smithi171 ceph-mon[21810]: pgmap v275: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:11:10.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:09 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/748073358' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:11:10.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:09 smithi116 ceph-mon[21873]: pgmap v275: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:11:10.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:09 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/748073358' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:11:10.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:09 smithi044 ceph-mon[18489]: pgmap v275: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:11:10.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:09 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/748073358' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:11:10.226 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:11:10.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:10.729+0000 7ffa18797640 1 -- 172.21.15.44:0/2156963478 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa1010beb0 msgr2=0x7ffa1010e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:10.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:10.729+0000 7ffa18797640 1 --2- 172.21.15.44:0/2156963478 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa1010beb0 0x7ffa1010e330 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ffa08009ca0 tx=0x7ffa0802a950 comp rx=0 tx=0).stop 2024-08-19T00:11:10.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:10.729+0000 7ffa18797640 1 -- 172.21.15.44:0/2156963478 shutdown_connections 2024-08-19T00:11:10.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:10.729+0000 7ffa18797640 1 --2- 172.21.15.44:0/2156963478 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa1010beb0 0x7ffa1010e330 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:10.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:10.729+0000 7ffa18797640 1 --2- 172.21.15.44:0/2156963478 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffa101033f0 0x7ffa1010b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:10.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:10.729+0000 7ffa18797640 1 --2- 172.21.15.44:0/2156963478 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa10102ad0 0x7ffa10102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:10.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:10.729+0000 7ffa18797640 1 -- 172.21.15.44:0/2156963478 >> 172.21.15.44:0/2156963478 conn(0x7ffa100fc4d0 msgr2=0x7ffa100fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:10.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:10.729+0000 7ffa18797640 1 -- 172.21.15.44:0/2156963478 shutdown_connections 2024-08-19T00:11:10.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:10.729+0000 7ffa18797640 1 -- 172.21.15.44:0/2156963478 wait complete. 2024-08-19T00:11:10.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:10.730+0000 7ffa18797640 1 Processor -- start 2024-08-19T00:11:10.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:10.730+0000 7ffa18797640 1 -- start start 2024-08-19T00:11:10.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:10.730+0000 7ffa18797640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa10102ad0 0x7ffa101980d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:10.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:10.730+0000 7ffa18797640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffa101033f0 0x7ffa10198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:10.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:10.730+0000 7ffa18797640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa1010beb0 0x7ffa1019c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:10.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:10.730+0000 7ffa18797640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ffa10111c90 con 0x7ffa10102ad0 2024-08-19T00:11:10.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:10.730+0000 7ffa18797640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7ffa10111b10 con 0x7ffa101033f0 2024-08-19T00:11:10.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:10.730+0000 7ffa18797640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ffa10111e10 con 0x7ffa1010beb0 2024-08-19T00:11:10.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:10.730+0000 7ffa16533640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa10102ad0 0x7ffa101980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:10.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:10.730+0000 7ffa16533640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa10102ad0 0x7ffa101980d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39642/0 (socket says 172.21.15.44:39642) 2024-08-19T00:11:10.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:10.730+0000 7ffa16533640 1 -- 172.21.15.44:0/431764998 learned_addr learned my addr 172.21.15.44:0/431764998 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:11:10.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:10.730+0000 7ffa15d32640 1 --2- 172.21.15.44:0/431764998 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffa101033f0 0x7ffa10198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:10.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:10.731+0000 7ffa16533640 1 -- 172.21.15.44:0/431764998 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa1010beb0 msgr2=0x7ffa1019c9a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-19T00:11:10.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:10.731+0000 7ffa16533640 1 --2- 172.21.15.44:0/431764998 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa1010beb0 0x7ffa1019c9a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:10.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:10.731+0000 7ffa16533640 1 -- 172.21.15.44:0/431764998 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffa101033f0 msgr2=0x7ffa10198610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:10.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:10.731+0000 7ffa16533640 1 --2- 172.21.15.44:0/431764998 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffa101033f0 0x7ffa10198610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:10.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:10.731+0000 7ffa16533640 1 -- 172.21.15.44:0/431764998 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa1019d080 con 0x7ffa10102ad0 2024-08-19T00:11:10.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:10.731+0000 7ffa15d32640 1 --2- 172.21.15.44:0/431764998 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffa101033f0 0x7ffa10198610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:11:10.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:10.731+0000 7ffa16533640 1 --2- 172.21.15.44:0/431764998 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa10102ad0 0x7ffa101980d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c00d770 tx=0x7ffa0c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:10.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:10.731+0000 7ffa077fe640 1 -- 172.21.15.44:0/431764998 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c017070 con 0x7ffa10102ad0 2024-08-19T00:11:10.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:10.731+0000 7ffa077fe640 1 -- 172.21.15.44:0/431764998 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa0c005500 con 0x7ffa10102ad0 2024-08-19T00:11:10.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:10.731+0000 7ffa18797640 1 -- 172.21.15.44:0/431764998 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa1019d370 con 0x7ffa10102ad0 2024-08-19T00:11:10.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:10.731+0000 7ffa077fe640 1 -- 172.21.15.44:0/431764998 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c004e00 con 0x7ffa10102ad0 2024-08-19T00:11:10.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:10.731+0000 7ffa18797640 1 -- 172.21.15.44:0/431764998 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa101a4c50 con 0x7ffa10102ad0 2024-08-19T00:11:10.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:10.732+0000 7ffa18797640 1 -- 172.21.15.44:0/431764998 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa10102eb0 con 0x7ffa10102ad0 2024-08-19T00:11:10.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:10.733+0000 7ffa077fe640 1 -- 172.21.15.44:0/431764998 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7ffa0c004fa0 con 0x7ffa10102ad0 2024-08-19T00:11:10.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:10.734+0000 7ffa077fe640 1 --2- 172.21.15.44:0/431764998 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7ff9fc0a2b80 0x7ff9fc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:10.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:10.734+0000 7ffa077fe640 1 -- 172.21.15.44:0/431764998 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7ffa0c0cf1e0 con 0x7ffa10102ad0 2024-08-19T00:11:10.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:10.734+0000 7ffa15d32640 1 --2- 172.21.15.44:0/431764998 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7ff9fc0a2b80 0x7ff9fc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:10.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:10.734+0000 7ffa15d32640 1 --2- 172.21.15.44:0/431764998 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7ff9fc0a2b80 0x7ff9fc0a5040 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ffa100fea80 tx=0x7ffa00005cb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:10.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:10.737+0000 7ffa077fe640 1 -- 172.21.15.44:0/431764998 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7ffa0c09bf00 con 0x7ffa10102ad0 2024-08-19T00:11:10.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:10.915+0000 7ffa18797640 1 -- 172.21.15.44:0/431764998 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffa101a4ef0 con 0x7ffa10102ad0 2024-08-19T00:11:10.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:10.916+0000 7ffa077fe640 1 -- 172.21.15.44:0/431764998 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+24116 (secure 0 0 0) 0x7ffa0c09b800 con 0x7ffa10102ad0 2024-08-19T00:11:10.918 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:11:10.918 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":90,"fsid":"647ded64-5dbe-11ef-bccf-c7b262605968","created":"2024-08-19T00:03:43.667929+0000","modified":"2024-08-19T00:11:02.452177+0000","last_up_change":"2024-08-19T00:10:01.557590+0000","last_in_change":"2024-08-19T00:09:42.433933+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T00:06:42.706553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-19T00:10:48.735065+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-19T00:10:51.481810+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-19T00:10:58.013004+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b15ad904-d07d-4ecb-be8f-d99323425eed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":600251465},{"type":"v1","addr":"172.21.15.44:6803","nonce":600251465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":600251465},{"type":"v1","addr":"172.21.15.44:6805","nonce":600251465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":600251465},{"type":"v1","addr":"172.21.15.44:6809","nonce":600251465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":600251465},{"type":"v1","addr":"172.21.15.44:6807","nonce":600251465}]},"public_addr":"172.21.15.44:6803/600251465","cluster_addr":"172.21.15.44:6805/600251465","heartbeat_back_addr":"172.21.15.44:6809/600251465","heartbeat_front_addr":"172.21.15.44:6807/600251465","state":["exists","up"]},{"osd":1,"uuid":"8f70512f-21a3-4fec-8278-04b2bc9b2d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":613509556},{"type":"v1","addr":"172.21.15.116:6801","nonce":613509556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":613509556},{"type":"v1","addr":"172.21.15.116:6803","nonce":613509556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":613509556},{"type":"v1","addr":"172.21.15.116:6807","nonce":613509556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":613509556},{"type":"v1","addr":"172.21.15.116:6805","nonce":613509556}]},"public_addr":"172.21.15.116:6801/613509556","cluster_addr":"172.21.15.116:6803/613509556","heartbeat_back_addr":"172.21.15.116:6807/613509556","heartbeat_front_addr":"172.21.15.116:6805/613509556","state":["exists","up"]},{"osd":2,"uuid":"56994dfd-5fcf-4d82-addf-38764239d82a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2130938937},{"type":"v1","addr":"172.21.15.171:6801","nonce":2130938937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2130938937},{"type":"v1","addr":"172.21.15.171:6803","nonce":2130938937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2130938937},{"type":"v1","addr":"172.21.15.171:6807","nonce":2130938937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2130938937},{"type":"v1","addr":"172.21.15.171:6805","nonce":2130938937}]},"public_addr":"172.21.15.171:6801/2130938937","cluster_addr":"172.21.15.171:6803/2130938937","heartbeat_back_addr":"172.21.15.171:6807/2130938937","heartbeat_front_addr":"172.21.15.171:6805/2130938937","state":["exists","up"]},{"osd":3,"uuid":"6d2ddb19-74e0-4e68-b9ea-58b73fd1e9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":3537027669},{"type":"v1","addr":"172.21.15.44:6811","nonce":3537027669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":3537027669},{"type":"v1","addr":"172.21.15.44:6813","nonce":3537027669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3537027669},{"type":"v1","addr":"172.21.15.44:6817","nonce":3537027669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":3537027669},{"type":"v1","addr":"172.21.15.44:6815","nonce":3537027669}]},"public_addr":"172.21.15.44:6811/3537027669","cluster_addr":"172.21.15.44:6813/3537027669","heartbeat_back_addr":"172.21.15.44:6817/3537027669","heartbeat_front_addr":"172.21.15.44:6815/3537027669","state":["exists","up"]},{"osd":4,"uuid":"190d208e-ae54-497d-ad72-d07a5a26991b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":3768627455},{"type":"v1","addr":"172.21.15.116:6809","nonce":3768627455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":3768627455},{"type":"v1","addr":"172.21.15.116:6811","nonce":3768627455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":3768627455},{"type":"v1","addr":"172.21.15.116:6815","nonce":3768627455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":3768627455},{"type":"v1","addr":"172.21.15.116:6813","nonce":3768627455}]},"public_addr":"172.21.15.116:6809/3768627455","cluster_addr":"172.21.15.116:6811/3768627455","heartbeat_back_addr":"172.21.15.116:6815/3768627455","heartbeat_front_addr":"172.21.15.116:6813/3768627455","state":["exists","up"]},{"osd":5,"uuid":"d8afacad-6d3d-4703-9744-8d01ff2a2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":938785018},{"type":"v1","addr":"172.21.15.171:6809","nonce":938785018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":938785018},{"type":"v1","addr":"172.21.15.171:6811","nonce":938785018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":938785018},{"type":"v1","addr":"172.21.15.171:6815","nonce":938785018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":938785018},{"type":"v1","addr":"172.21.15.171:6813","nonce":938785018}]},"public_addr":"172.21.15.171:6809/938785018","cluster_addr":"172.21.15.171:6811/938785018","heartbeat_back_addr":"172.21.15.171:6815/938785018","heartbeat_front_addr":"172.21.15.171:6813/938785018","state":["exists","up"]},{"osd":6,"uuid":"55bf1f89-99e5-409d-99fa-f0124aa042df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":1219334797},{"type":"v1","addr":"172.21.15.44:6819","nonce":1219334797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":1219334797},{"type":"v1","addr":"172.21.15.44:6821","nonce":1219334797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":1219334797},{"type":"v1","addr":"172.21.15.44:6825","nonce":1219334797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":1219334797},{"type":"v1","addr":"172.21.15.44:6823","nonce":1219334797}]},"public_addr":"172.21.15.44:6819/1219334797","cluster_addr":"172.21.15.44:6821/1219334797","heartbeat_back_addr":"172.21.15.44:6825/1219334797","heartbeat_front_addr":"172.21.15.44:6823/1219334797","state":["exists","up"]},{"osd":7,"uuid":"70130d71-d28c-4a58-b603-75610c8d3ea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":3861873415},{"type":"v1","addr":"172.21.15.116:6817","nonce":3861873415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":3861873415},{"type":"v1","addr":"172.21.15.116:6819","nonce":3861873415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":3861873415},{"type":"v1","addr":"172.21.15.116:6823","nonce":3861873415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":3861873415},{"type":"v1","addr":"172.21.15.116:6821","nonce":3861873415}]},"public_addr":"172.21.15.116:6817/3861873415","cluster_addr":"172.21.15.116:6819/3861873415","heartbeat_back_addr":"172.21.15.116:6823/3861873415","heartbeat_front_addr":"172.21.15.116:6821/3861873415","state":["exists","up"]},{"osd":8,"uuid":"c5121f70-e423-4f86-a3c6-90945c9385f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":843701060},{"type":"v1","addr":"172.21.15.171:6817","nonce":843701060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":843701060},{"type":"v1","addr":"172.21.15.171:6819","nonce":843701060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":843701060},{"type":"v1","addr":"172.21.15.171:6823","nonce":843701060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":843701060},{"type":"v1","addr":"172.21.15.171:6821","nonce":843701060}]},"public_addr":"172.21.15.171:6817/843701060","cluster_addr":"172.21.15.171:6819/843701060","heartbeat_back_addr":"172.21.15.171:6823/843701060","heartbeat_front_addr":"172.21.15.171:6821/843701060","state":["exists","up"]},{"osd":9,"uuid":"cd13693a-0f25-47cc-b1a5-9c42481935ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3206550013},{"type":"v1","addr":"172.21.15.44:6827","nonce":3206550013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":3206550013},{"type":"v1","addr":"172.21.15.44:6829","nonce":3206550013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3206550013},{"type":"v1","addr":"172.21.15.44:6833","nonce":3206550013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3206550013},{"type":"v1","addr":"172.21.15.44:6831","nonce":3206550013}]},"public_addr":"172.21.15.44:6827/3206550013","cluster_addr":"172.21.15.44:6829/3206550013","heartbeat_back_addr":"172.21.15.44:6833/3206550013","heartbeat_front_addr":"172.21.15.44:6831/3206550013","state":["exists","up"]},{"osd":10,"uuid":"a36ffeb1-6ecf-4899-bdfa-18515afefb86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3034738363},{"type":"v1","addr":"172.21.15.116:6825","nonce":3034738363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3034738363},{"type":"v1","addr":"172.21.15.116:6827","nonce":3034738363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3034738363},{"type":"v1","addr":"172.21.15.116:6831","nonce":3034738363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3034738363},{"type":"v1","addr":"172.21.15.116:6829","nonce":3034738363}]},"public_addr":"172.21.15.116:6825/3034738363","cluster_addr":"172.21.15.116:6827/3034738363","heartbeat_back_addr":"172.21.15.116:6831/3034738363","heartbeat_front_addr":"172.21.15.116:6829/3034738363","state":["exists","up"]},{"osd":11,"uuid":"ffcf44a8-3094-4a29-822e-a6ce95da119e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1500842656},{"type":"v1","addr":"172.21.15.171:6825","nonce":1500842656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1500842656},{"type":"v1","addr":"172.21.15.171:6827","nonce":1500842656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1500842656},{"type":"v1","addr":"172.21.15.171:6831","nonce":1500842656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1500842656},{"type":"v1","addr":"172.21.15.171:6829","nonce":1500842656}]},"public_addr":"172.21.15.171:6825/1500842656","cluster_addr":"172.21.15.171:6827/1500842656","heartbeat_back_addr":"172.21.15.171:6831/1500842656","heartbeat_front_addr":"172.21.15.171:6829/1500842656","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:05:56.916127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:06:17.603805+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:06:38.642970+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:07:00.667062+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:07:22.542529+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:07:44.732304+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:08:07.050742+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:08:29.451498+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:08:52.222169+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:09:15.422629+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:09:37.295311+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:09:59.716431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6800/1300308907":"2024-08-20T00:04:38.392912+0000","172.21.15.44:0/1001446555":"2024-08-20T00:04:38.392912+0000","172.21.15.44:0/3800526625":"2024-08-20T00:04:38.392912+0000","172.21.15.44:6801/1300308907":"2024-08-20T00:04:38.392912+0000","172.21.15.44:0/3096491642":"2024-08-20T00:04:14.604141+0000","172.21.15.44:0/400419582":"2024-08-20T00:04:38.392912+0000","172.21.15.44:0/1869412718":"2024-08-20T00:04:14.604141+0000","172.21.15.44:6801/1374527587":"2024-08-20T00:04:14.604141+0000","172.21.15.44:0/911382683":"2024-08-20T00:04:14.604141+0000","172.21.15.44:6800/1374527587":"2024-08-20T00:04:14.604141+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:11:10.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:10.919+0000 7ffa18797640 1 -- 172.21.15.44:0/431764998 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7ff9fc0a2b80 msgr2=0x7ff9fc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:10.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:10.919+0000 7ffa18797640 1 --2- 172.21.15.44:0/431764998 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7ff9fc0a2b80 0x7ff9fc0a5040 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ffa100fea80 tx=0x7ffa00005cb0 comp rx=0 tx=0).stop 2024-08-19T00:11:10.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:10.919+0000 7ffa18797640 1 -- 172.21.15.44:0/431764998 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa10102ad0 msgr2=0x7ffa101980d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:10.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:10.919+0000 7ffa18797640 1 --2- 172.21.15.44:0/431764998 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa10102ad0 0x7ffa101980d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c00d770 tx=0x7ffa0c00dc30 comp rx=0 tx=0).stop 2024-08-19T00:11:10.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:10.919+0000 7ffa18797640 1 -- 172.21.15.44:0/431764998 shutdown_connections 2024-08-19T00:11:10.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:10.919+0000 7ffa18797640 1 --2- 172.21.15.44:0/431764998 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7ff9fc0a2b80 0x7ff9fc0a5040 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:10.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:10.919+0000 7ffa18797640 1 --2- 172.21.15.44:0/431764998 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa1010beb0 0x7ffa1019c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:10.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:10.919+0000 7ffa18797640 1 --2- 172.21.15.44:0/431764998 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffa101033f0 0x7ffa10198610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:10.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:10.919+0000 7ffa18797640 1 --2- 172.21.15.44:0/431764998 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa10102ad0 0x7ffa101980d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:10.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:10.919+0000 7ffa18797640 1 -- 172.21.15.44:0/431764998 >> 172.21.15.44:0/431764998 conn(0x7ffa100fc4d0 msgr2=0x7ffa100fdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:10.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:10.919+0000 7ffa18797640 1 -- 172.21.15.44:0/431764998 shutdown_connections 2024-08-19T00:11:10.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:10.919+0000 7ffa18797640 1 -- 172.21.15.44:0/431764998 wait complete. 2024-08-19T00:11:11.601 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-19T00:10:53.196636+0000', 'modified': '2024-08-19T00:11:02.452307+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24473}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24473': {'gid': 24473, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.116:6839/1032741033', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6838', 'nonce': 1032741033}, {'type': 'v1', 'addr': '172.21.15.116:6839', 'nonce': 1032741033}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 24473, 'qdb_cluster': [24473]} 2024-08-19T00:11:11.601 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-19T00:11:11.601 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph tell mds.b status 2024-08-19T00:11:11.860 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:11:11.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:11 smithi044 ceph-mon[18489]: pgmap v276: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:11:11.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:11 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/431764998' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-19T00:11:12.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:11 smithi171 ceph-mon[21810]: pgmap v276: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:11:12.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:11 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/431764998' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-19T00:11:12.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:11 smithi116 ceph-mon[21873]: pgmap v276: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:11:12.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:11 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/431764998' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-19T00:11:12.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.329+0000 7f60355d0640 1 -- 172.21.15.44:0/183298789 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f603010e170 msgr2=0x7f6030110560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:12.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.329+0000 7f60355d0640 1 --2- 172.21.15.44:0/183298789 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f603010e170 0x7f6030110560 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6028009ca0 tx=0x7f602802a950 comp rx=0 tx=0).stop 2024-08-19T00:11:12.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.329+0000 7f60355d0640 1 -- 172.21.15.44:0/183298789 shutdown_connections 2024-08-19T00:11:12.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.329+0000 7f60355d0640 1 --2- 172.21.15.44:0/183298789 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6030074b60 0x7f603010dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:12.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.329+0000 7f60355d0640 1 --2- 172.21.15.44:0/183298789 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f603010e170 0x7f6030110560 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:12.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.329+0000 7f60355d0640 1 --2- 172.21.15.44:0/183298789 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6030074240 0x7f6030074620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:12.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.329+0000 7f60355d0640 1 -- 172.21.15.44:0/183298789 >> 172.21.15.44:0/183298789 conn(0x7f60300fd5f0 msgr2=0x7f60300ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:12.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.329+0000 7f60355d0640 1 -- 172.21.15.44:0/183298789 shutdown_connections 2024-08-19T00:11:12.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.329+0000 7f60355d0640 1 -- 172.21.15.44:0/183298789 wait complete. 2024-08-19T00:11:12.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.330+0000 7f60355d0640 1 Processor -- start 2024-08-19T00:11:12.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.330+0000 7f60355d0640 1 -- start start 2024-08-19T00:11:12.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.330+0000 7f60355d0640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6030074240 0x7f603019a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:12.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.330+0000 7f60355d0640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6030074b60 0x7f603019a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:12.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.330+0000 7f60355d0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f603010e170 0x7f603019ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:12.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.330+0000 7f60355d0640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6030113e60 con 0x7f603010e170 2024-08-19T00:11:12.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.330+0000 7f60355d0640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f6030113ce0 con 0x7f6030074240 2024-08-19T00:11:12.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.330+0000 7f60355d0640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6030113fe0 con 0x7f6030074b60 2024-08-19T00:11:12.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.330+0000 7f602f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f603010e170 0x7f603019ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:12.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.330+0000 7f602f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f603010e170 0x7f603019ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39658/0 (socket says 172.21.15.44:39658) 2024-08-19T00:11:12.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.330+0000 7f602f7fe640 1 -- 172.21.15.44:0/2691845953 learned_addr learned my addr 172.21.15.44:0/2691845953 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:11:12.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.330+0000 7f60267fc640 1 --2- 172.21.15.44:0/2691845953 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6030074b60 0x7f603019a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:12.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.330+0000 7f602effd640 1 --2- 172.21.15.44:0/2691845953 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6030074240 0x7f603019a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:12.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.331+0000 7f602f7fe640 1 -- 172.21.15.44:0/2691845953 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6030074b60 msgr2=0x7f603019a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:12.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.331+0000 7f602f7fe640 1 --2- 172.21.15.44:0/2691845953 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6030074b60 0x7f603019a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:12.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.331+0000 7f602f7fe640 1 -- 172.21.15.44:0/2691845953 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6030074240 msgr2=0x7f603019a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:12.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.331+0000 7f602f7fe640 1 --2- 172.21.15.44:0/2691845953 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6030074240 0x7f603019a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:12.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.331+0000 7f602f7fe640 1 -- 172.21.15.44:0/2691845953 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f603019f310 con 0x7f603010e170 2024-08-19T00:11:12.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.331+0000 7f602effd640 1 --2- 172.21.15.44:0/2691845953 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6030074240 0x7f603019a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:11:12.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.331+0000 7f602f7fe640 1 --2- 172.21.15.44:0/2691845953 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f603010e170 0x7f603019ec30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f602802ae70 tx=0x7f602802f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:12.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.331+0000 7f602cff9640 1 -- 172.21.15.44:0/2691845953 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6028034040 con 0x7f603010e170 2024-08-19T00:11:12.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.331+0000 7f60355d0640 1 -- 172.21.15.44:0/2691845953 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f603019f5a0 con 0x7f603010e170 2024-08-19T00:11:12.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.331+0000 7f602cff9640 1 -- 172.21.15.44:0/2691845953 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6028030920 con 0x7f603010e170 2024-08-19T00:11:12.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.331+0000 7f602cff9640 1 -- 172.21.15.44:0/2691845953 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6028045480 con 0x7f603010e170 2024-08-19T00:11:12.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.331+0000 7f60355d0640 1 -- 172.21.15.44:0/2691845953 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60301a6ee0 con 0x7f603010e170 2024-08-19T00:11:12.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.333+0000 7f602cff9640 1 -- 172.21.15.44:0/2691845953 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f6028037020 con 0x7f603010e170 2024-08-19T00:11:12.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.334+0000 7f60379ce740 1 Processor -- start 2024-08-19T00:11:12.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.334+0000 7f60379ce740 1 -- start start 2024-08-19T00:11:12.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.334+0000 7f60379ce740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ddcb235630 0x55ddcb235a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:12.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.334+0000 7f60379ce740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ddcb235f50 0x55ddcb2402d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:12.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.334+0000 7f60379ce740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddcb240810 0x55ddcb242c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:12.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.334+0000 7f60379ce740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ddcb19a710 con 0x55ddcb240810 2024-08-19T00:11:12.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.334+0000 7f60379ce740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55ddcb132770 con 0x55ddcb235f50 2024-08-19T00:11:12.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.334+0000 7f60379ce740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55ddcb1966d0 con 0x55ddcb235630 2024-08-19T00:11:12.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.334+0000 7f602cff9640 1 --2- 172.21.15.44:0/2691845953 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f601c0a2b80 0x7f601c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:12.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.334+0000 7f60267fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddcb240810 0x55ddcb242c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:12.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.334+0000 7f602f7fe640 1 --2- 172.21.15.44:0/2691845953 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f601c0a2b80 0x7f601c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:12.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.334+0000 7f60267fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddcb240810 0x55ddcb242c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39670/0 (socket says 172.21.15.44:39670) 2024-08-19T00:11:12.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.334+0000 7f60267fc640 1 -- 172.21.15.44:0/3087271895 learned_addr learned my addr 172.21.15.44:0/3087271895 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:11:12.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.334+0000 7f60267fc640 1 --2- 172.21.15.44:0/3087271895 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ddcb235630 0x55ddcb235a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:12.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.335+0000 7f602effd640 1 --2- 172.21.15.44:0/3087271895 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ddcb235f50 0x55ddcb2402d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:12.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.335+0000 7f602cff9640 1 -- 172.21.15.44:0/2691845953 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f60280f01e0 con 0x7f603010e170 2024-08-19T00:11:12.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.335+0000 7f60267fc640 1 -- 172.21.15.44:0/3087271895 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ddcb235630 msgr2=0x55ddcb235a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:11:12.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.335+0000 7f60267fc640 1 --2- 172.21.15.44:0/3087271895 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ddcb235630 0x55ddcb235a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:12.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.335+0000 7f60267fc640 1 -- 172.21.15.44:0/3087271895 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ddcb235f50 msgr2=0x55ddcb2402d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:11:12.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.335+0000 7f60267fc640 1 --2- 172.21.15.44:0/3087271895 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ddcb235f50 0x55ddcb2402d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:12.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.335+0000 7f60267fc640 1 -- 172.21.15.44:0/3087271895 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddcb1393e0 con 0x55ddcb240810 2024-08-19T00:11:12.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.335+0000 7f602f7fe640 1 --2- 172.21.15.44:0/2691845953 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f601c0a2b80 0x7f601c0a5040 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f602808f830 tx=0x7f602808f860 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:12.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.335+0000 7f60267fc640 1 --2- 172.21.15.44:0/3087271895 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddcb240810 0x55ddcb242c00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6018012740 tx=0x7f601800b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40b90cdf67151e72 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:12.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.335+0000 7f60257fa640 1 -- 172.21.15.44:0/3087271895 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6018012cc0 con 0x55ddcb240810 2024-08-19T00:11:12.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.335+0000 7f60257fa640 1 -- 172.21.15.44:0/3087271895 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6018010c50 con 0x55ddcb240810 2024-08-19T00:11:12.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.335+0000 7f60257fa640 1 -- 172.21.15.44:0/3087271895 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f601801eaf0 con 0x55ddcb240810 2024-08-19T00:11:12.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.336+0000 7f60379ce740 1 -- 172.21.15.44:0/3087271895 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddcb240810 msgr2=0x55ddcb242c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:12.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.336+0000 7f60379ce740 1 --2- 172.21.15.44:0/3087271895 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddcb240810 0x55ddcb242c00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6018012740 tx=0x7f601800b700 comp rx=0 tx=0).stop 2024-08-19T00:11:12.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.336+0000 7f60379ce740 1 -- 172.21.15.44:0/3087271895 shutdown_connections 2024-08-19T00:11:12.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.336+0000 7f60379ce740 1 --2- 172.21.15.44:0/3087271895 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddcb240810 0x55ddcb242c00 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:12.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.336+0000 7f60379ce740 1 --2- 172.21.15.44:0/3087271895 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ddcb235f50 0x55ddcb2402d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:12.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.336+0000 7f60379ce740 1 --2- 172.21.15.44:0/3087271895 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ddcb235630 0x55ddcb235a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:12.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.336+0000 7f60379ce740 1 -- 172.21.15.44:0/3087271895 >> 172.21.15.44:0/3087271895 conn(0x55ddcb231bc0 msgr2=0x55ddcb231fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:12.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.336+0000 7f60379ce740 1 -- 172.21.15.44:0/3087271895 shutdown_connections 2024-08-19T00:11:12.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.336+0000 7f60379ce740 1 -- 172.21.15.44:0/3087271895 wait complete. 2024-08-19T00:11:12.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.336+0000 7f60379ce740 1 -- start start 2024-08-19T00:11:12.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.337+0000 7f60379ce740 1 Processor -- start 2024-08-19T00:11:12.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.337+0000 7f60379ce740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ddcb235630 0x55ddcb23d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:12.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.337+0000 7f60379ce740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddcb235f50 0x55ddcb23dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:12.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.337+0000 7f60379ce740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ddcb240810 0x55ddcb23e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:12.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.337+0000 7f60379ce740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ddcb2433e0 con 0x55ddcb235f50 2024-08-19T00:11:12.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.337+0000 7f60379ce740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55ddcb155970 con 0x55ddcb235630 2024-08-19T00:11:12.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.337+0000 7f60379ce740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55ddcb243560 con 0x55ddcb240810 2024-08-19T00:11:12.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.337+0000 7f60379ce740 10 client.0 _ll_register_callbacks cb 0x55ddcaea97b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:11:12.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.337+0000 7f602effd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddcb235f50 0x55ddcb23dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:12.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.337+0000 7f602effd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddcb235f50 0x55ddcb23dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39682/0 (socket says 172.21.15.44:39682) 2024-08-19T00:11:12.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.337+0000 7f602effd640 1 -- 172.21.15.44:0/1672767257 learned_addr learned my addr 172.21.15.44:0/1672767257 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:11:12.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.337+0000 7f60267fc640 1 --2- 172.21.15.44:0/1672767257 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ddcb235630 0x55ddcb23d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:12.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.337+0000 7f60267fc640 1 --2- 172.21.15.44:0/1672767257 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ddcb240810 0x55ddcb23e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:12.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.337+0000 7f602effd640 1 -- 172.21.15.44:0/1672767257 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ddcb240810 msgr2=0x55ddcb23e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:11:12.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.337+0000 7f602effd640 1 --2- 172.21.15.44:0/1672767257 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ddcb240810 0x55ddcb23e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:12.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.337+0000 7f602effd640 1 -- 172.21.15.44:0/1672767257 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ddcb235630 msgr2=0x55ddcb23d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:11:12.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.337+0000 7f602effd640 1 --2- 172.21.15.44:0/1672767257 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ddcb235630 0x55ddcb23d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:12.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.337+0000 7f602effd640 1 -- 172.21.15.44:0/1672767257 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ddcaf0c2b0 con 0x55ddcb235f50 2024-08-19T00:11:12.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.337+0000 7f60267fc640 1 --2- 172.21.15.44:0/1672767257 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ddcb240810 0x55ddcb23e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:11:12.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.337+0000 7f602effd640 1 --2- 172.21.15.44:0/1672767257 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddcb235f50 0x55ddcb23dcc0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f602000bb70 tx=0x7f60200039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40a58ee5e7fc07bf server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:12.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.337+0000 7f60167fc640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:11:12.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.337+0000 7f60167fc640 1 -- 172.21.15.44:0/1672767257 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6020005220 con 0x55ddcb235f50 2024-08-19T00:11:12.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.338+0000 7f60167fc640 1 -- 172.21.15.44:0/1672767257 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f60200053c0 con 0x55ddcb235f50 2024-08-19T00:11:12.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.338+0000 7f60379ce740 1 -- 172.21.15.44:0/1672767257 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6018010c50 con 0x55ddcb235f50 2024-08-19T00:11:12.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.338+0000 7f60167fc640 1 -- 172.21.15.44:0/1672767257 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f60200055c0 con 0x55ddcb235f50 2024-08-19T00:11:12.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.338+0000 7f60379ce740 10 client.14697 fetch_fsmap learned FSMap version 16 2024-08-19T00:11:12.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.338+0000 7f60379ce740 1 -- 172.21.15.44:0/1672767257 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=4+}) -- 0x55ddcb24f0d0 con 0x55ddcb235f50 2024-08-19T00:11:12.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.338+0000 7f60167fc640 1 -- 172.21.15.44:0/1672767257 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6018010c50 con 0x55ddcb235f50 2024-08-19T00:11:12.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.338+0000 7f60167fc640 1 -- 172.21.15.44:0/1672767257 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 16) ==== 8350+0+0 (secure 0 0 0) 0x7f6020019030 con 0x55ddcb235f50 2024-08-19T00:11:12.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.338+0000 7f60379ce740 10 client.14697 fetch_fsmap finished waiting for FSMap version 16 2024-08-19T00:11:12.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.338+0000 7f60379ce740 10 client.14697 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-19T00:11:12.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.338+0000 7f60379ce740 20 client.14697 populate_metadata read hostname 'smithi044' 2024-08-19T00:11:12.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.338+0000 7f60379ce740 1 --2- 172.21.15.44:0/1672767257 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55ddcb251710 0x55ddcb252b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:12.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.338+0000 7f60379ce740 4 client.14697 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:11:12.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.338+0000 7f60379ce740 1 -- 172.21.15.44:0/1672767257 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ddcb1a7c80 con 0x55ddcb251710 2024-08-19T00:11:12.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.338+0000 7f60267fc640 1 --2- 172.21.15.44:0/1672767257 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55ddcb251710 0x55ddcb252b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:12.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.339+0000 7f60267fc640 1 --2- 172.21.15.44:0/1672767257 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55ddcb251710 0x55ddcb252b80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af7f5ce6675d8f56 server_cookie=f61e4c1c25b822af in_seq=0 out_seq=0 2024-08-19T00:11:12.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.339+0000 7f60167fc640 10 client.14697 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:11:12.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.339+0000 7f60167fc640 1 -- 172.21.15.44:0/1672767257 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ddcb1a7c80 con 0x55ddcb251710 2024-08-19T00:11:12.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.339+0000 7f60167fc640 10 client.14697 handle_command_reply: tid=0 2024-08-19T00:11:12.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.340+0000 7f60379ce740 1 client.14697 shutdown 2024-08-19T00:11:12.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.340+0000 7f60379ce740 1 -- 172.21.15.44:0/1672767257 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddcb235f50 msgr2=0x55ddcb23dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:12.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.340+0000 7f60379ce740 1 --2- 172.21.15.44:0/1672767257 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddcb235f50 0x55ddcb23dcc0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f602000bb70 tx=0x7f60200039c0 comp rx=0 tx=0).stop 2024-08-19T00:11:12.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.340+0000 7f60379ce740 1 -- 172.21.15.44:0/1672767257 shutdown_connections 2024-08-19T00:11:12.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.340+0000 7f60379ce740 1 --2- 172.21.15.44:0/1672767257 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55ddcb251710 0x55ddcb252b80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:12.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.340+0000 7f60379ce740 1 --2- 172.21.15.44:0/1672767257 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ddcb240810 0x55ddcb23e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:12.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.340+0000 7f60379ce740 1 --2- 172.21.15.44:0/1672767257 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddcb235f50 0x55ddcb23dcc0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:12.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.340+0000 7f60167fc640 0 client.14697 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:11:12.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.340+0000 7f60379ce740 1 --2- 172.21.15.44:0/1672767257 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ddcb235630 0x55ddcb23d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:12.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.340+0000 7f60379ce740 1 -- 172.21.15.44:0/1672767257 >> 172.21.15.44:0/1672767257 conn(0x55ddcb231bc0 msgr2=0x55ddcb2378a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:12.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.340+0000 7f60379ce740 1 -- 172.21.15.44:0/1672767257 shutdown_connections 2024-08-19T00:11:12.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.340+0000 7f60379ce740 1 -- 172.21.15.44:0/1672767257 wait complete. 2024-08-19T00:11:12.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.340+0000 7f60379ce740 20 client.14697 trim_cache size 0 max 16384 2024-08-19T00:11:12.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.358+0000 7f60379ce740 1 Processor -- start 2024-08-19T00:11:12.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.358+0000 7f60379ce740 1 -- start start 2024-08-19T00:11:12.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.358+0000 7f60379ce740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddcb235630 0x55ddcb2524b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:12.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.358+0000 7f60379ce740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ddcb235f50 0x55ddcb238090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:12.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.358+0000 7f60379ce740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ddcb240810 0x55ddcb23e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:12.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.358+0000 7f60379ce740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ddcb250ec0 con 0x55ddcb235630 2024-08-19T00:11:12.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.358+0000 7f60379ce740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55ddcb251590 con 0x55ddcb240810 2024-08-19T00:11:12.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.358+0000 7f60379ce740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55ddcb251c60 con 0x55ddcb235f50 2024-08-19T00:11:12.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.358+0000 7f60267fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddcb235630 0x55ddcb2524b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:12.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.358+0000 7f60267fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddcb235630 0x55ddcb2524b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39686/0 (socket says 172.21.15.44:39686) 2024-08-19T00:11:12.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.358+0000 7f60267fc640 1 -- 172.21.15.44:0/3064849215 learned_addr learned my addr 172.21.15.44:0/3064849215 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:11:12.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.358+0000 7f602effd640 1 --2- 172.21.15.44:0/3064849215 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ddcb235f50 0x55ddcb238090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:12.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.358+0000 7f60267fc640 1 --2- 172.21.15.44:0/3064849215 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ddcb240810 0x55ddcb23e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:12.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.358+0000 7f60267fc640 1 -- 172.21.15.44:0/3064849215 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ddcb235f50 msgr2=0x55ddcb238090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:11:12.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.358+0000 7f60267fc640 1 --2- 172.21.15.44:0/3064849215 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ddcb235f50 0x55ddcb238090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:12.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.358+0000 7f60267fc640 1 -- 172.21.15.44:0/3064849215 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ddcb240810 msgr2=0x55ddcb23e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:11:12.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.358+0000 7f60267fc640 1 --2- 172.21.15.44:0/3064849215 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ddcb240810 0x55ddcb23e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:12.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.359+0000 7f60267fc640 1 -- 172.21.15.44:0/3064849215 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddcb22d130 con 0x55ddcb235630 2024-08-19T00:11:12.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.359+0000 7f60267fc640 1 --2- 172.21.15.44:0/3064849215 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddcb235630 0x55ddcb2524b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f601801e7a0 tx=0x7f601801e7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=768a8925283b972e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:12.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.359+0000 7f6024ff9640 1 -- 172.21.15.44:0/3064849215 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6018024040 con 0x55ddcb235630 2024-08-19T00:11:12.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.359+0000 7f6024ff9640 1 -- 172.21.15.44:0/3064849215 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6018005510 con 0x55ddcb235630 2024-08-19T00:11:12.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.359+0000 7f6024ff9640 1 -- 172.21.15.44:0/3064849215 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f601801edd0 con 0x55ddcb235630 2024-08-19T00:11:12.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.359+0000 7f60379ce740 1 -- 172.21.15.44:0/3064849215 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddcb235630 msgr2=0x55ddcb2524b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:12.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.359+0000 7f60379ce740 1 --2- 172.21.15.44:0/3064849215 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddcb235630 0x55ddcb2524b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f601801e7a0 tx=0x7f601801e7d0 comp rx=0 tx=0).stop 2024-08-19T00:11:12.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.360+0000 7f60379ce740 1 -- 172.21.15.44:0/3064849215 shutdown_connections 2024-08-19T00:11:12.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.360+0000 7f60379ce740 1 --2- 172.21.15.44:0/3064849215 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ddcb235f50 0x55ddcb238090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:12.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.360+0000 7f60379ce740 1 --2- 172.21.15.44:0/3064849215 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ddcb240810 0x55ddcb23e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:12.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.360+0000 7f60379ce740 1 --2- 172.21.15.44:0/3064849215 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddcb235630 0x55ddcb2524b0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:12.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.360+0000 7f60379ce740 1 -- 172.21.15.44:0/3064849215 >> 172.21.15.44:0/3064849215 conn(0x55ddcb231bc0 msgr2=0x55ddcb23eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:12.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.360+0000 7f60379ce740 1 -- 172.21.15.44:0/3064849215 shutdown_connections 2024-08-19T00:11:12.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.360+0000 7f60379ce740 1 -- 172.21.15.44:0/3064849215 wait complete. 2024-08-19T00:11:12.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.360+0000 7f60379ce740 1 -- start start 2024-08-19T00:11:12.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.360+0000 7f60379ce740 1 Processor -- start 2024-08-19T00:11:12.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.360+0000 7f60379ce740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddcb235630 0x55ddcb23a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:12.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.360+0000 7f60379ce740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ddcb235f50 0x55ddcb23ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:12.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.360+0000 7f60379ce740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ddcb240810 0x55ddcb23b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:12.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.360+0000 7f60379ce740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ddcb252a00 con 0x55ddcb235630 2024-08-19T00:11:12.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.360+0000 7f60379ce740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55ddcb252330 con 0x55ddcb235f50 2024-08-19T00:11:12.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.360+0000 7f60379ce740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55ddcb2530d0 con 0x55ddcb240810 2024-08-19T00:11:12.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.360+0000 7f60379ce740 10 client.0 _ll_register_callbacks cb 0x7f60200043f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:11:12.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.360+0000 7f60267fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddcb235630 0x55ddcb23a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:12.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.360+0000 7f60267fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddcb235630 0x55ddcb23a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39688/0 (socket says 172.21.15.44:39688) 2024-08-19T00:11:12.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.360+0000 7f60267fc640 1 -- 172.21.15.44:0/622839859 learned_addr learned my addr 172.21.15.44:0/622839859 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:11:12.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.361+0000 7f602effd640 1 --2- 172.21.15.44:0/622839859 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ddcb235f50 0x55ddcb23ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:12.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.361+0000 7f60267fc640 1 --2- 172.21.15.44:0/622839859 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ddcb240810 0x55ddcb23b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:12.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.361+0000 7f60267fc640 1 -- 172.21.15.44:0/622839859 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ddcb240810 msgr2=0x55ddcb23b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:11:12.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.361+0000 7f60267fc640 1 --2- 172.21.15.44:0/622839859 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ddcb240810 0x55ddcb23b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:12.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.361+0000 7f60267fc640 1 -- 172.21.15.44:0/622839859 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ddcb235f50 msgr2=0x55ddcb23ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:11:12.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.361+0000 7f60267fc640 1 --2- 172.21.15.44:0/622839859 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ddcb235f50 0x55ddcb23ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:12.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.361+0000 7f60267fc640 1 -- 172.21.15.44:0/622839859 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ddcb259340 con 0x55ddcb235630 2024-08-19T00:11:12.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.361+0000 7f60267fc640 1 --2- 172.21.15.44:0/622839859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddcb235630 0x55ddcb23a860 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f601800bad0 tx=0x7f6018017040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6ee885dd0bf028a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:12.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.361+0000 7f60167fc640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:11:12.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.361+0000 7f60167fc640 1 -- 172.21.15.44:0/622839859 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f601801ed50 con 0x55ddcb235630 2024-08-19T00:11:12.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.361+0000 7f60167fc640 1 -- 172.21.15.44:0/622839859 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f6018010800 con 0x55ddcb235630 2024-08-19T00:11:12.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.361+0000 7f60379ce740 1 -- 172.21.15.44:0/622839859 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6018005510 con 0x55ddcb235630 2024-08-19T00:11:12.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.361+0000 7f60167fc640 1 -- 172.21.15.44:0/622839859 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f6018010a00 con 0x55ddcb235630 2024-08-19T00:11:12.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.361+0000 7f60379ce740 10 client.14703 fetch_fsmap learned FSMap version 16 2024-08-19T00:11:12.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.361+0000 7f60379ce740 1 -- 172.21.15.44:0/622839859 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=4+}) -- 0x55ddcb2bc0d0 con 0x55ddcb235630 2024-08-19T00:11:12.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.362+0000 7f60167fc640 1 -- 172.21.15.44:0/622839859 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6018005510 con 0x55ddcb235630 2024-08-19T00:11:12.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.362+0000 7f60167fc640 1 -- 172.21.15.44:0/622839859 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 16) ==== 8350+0+0 (secure 0 0 0) 0x7f601803a4c0 con 0x55ddcb235630 2024-08-19T00:11:12.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.362+0000 7f60379ce740 10 client.14703 fetch_fsmap finished waiting for FSMap version 16 2024-08-19T00:11:12.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.362+0000 7f60379ce740 10 client.14703 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-19T00:11:12.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.362+0000 7f60379ce740 20 client.14703 populate_metadata read hostname 'smithi044' 2024-08-19T00:11:12.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.362+0000 7f60379ce740 1 --2- 172.21.15.44:0/622839859 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55ddcb2c04a0 0x55ddcb2bf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:12.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.362+0000 7f60379ce740 4 client.14703 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-19T00:11:12.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.362+0000 7f60379ce740 1 -- 172.21.15.44:0/622839859 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "status"}) -- 0x55ddcb1a2190 con 0x55ddcb2c04a0 2024-08-19T00:11:12.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.362+0000 7f602effd640 1 --2- 172.21.15.44:0/622839859 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55ddcb2c04a0 0x55ddcb2bf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:12.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.362+0000 7f60167fc640 10 client.14703 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:11:12.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.362+0000 7f602effd640 1 --2- 172.21.15.44:0/622839859 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55ddcb2c04a0 0x55ddcb2bf1b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f69d7558dc9445d4 server_cookie=f0bf6f238d3913d8 in_seq=0 out_seq=0 2024-08-19T00:11:12.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.363+0000 7f60167fc640 1 -- 172.21.15.44:0/622839859 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x55ddcb1a2190 con 0x55ddcb2c04a0 2024-08-19T00:11:12.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.363+0000 7f60167fc640 10 client.14703 handle_command_reply: tid=0 2024-08-19T00:11:12.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.363+0000 7f60379ce740 1 client.14703 shutdown 2024-08-19T00:11:12.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.363+0000 7f60379ce740 1 -- 172.21.15.44:0/622839859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddcb235630 msgr2=0x55ddcb23a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:12.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.363+0000 7f60379ce740 1 --2- 172.21.15.44:0/622839859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddcb235630 0x55ddcb23a860 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f601800bad0 tx=0x7f6018017040 comp rx=0 tx=0).stop 2024-08-19T00:11:12.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.363+0000 7f60379ce740 1 -- 172.21.15.44:0/622839859 shutdown_connections 2024-08-19T00:11:12.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.363+0000 7f60379ce740 1 --2- 172.21.15.44:0/622839859 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55ddcb2c04a0 0x55ddcb2bf1b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:12.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.363+0000 7f60379ce740 1 --2- 172.21.15.44:0/622839859 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ddcb240810 0x55ddcb23b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:12.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.363+0000 7f60379ce740 1 --2- 172.21.15.44:0/622839859 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ddcb235f50 0x55ddcb23ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:12.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.363+0000 7f60379ce740 1 --2- 172.21.15.44:0/622839859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddcb235630 0x55ddcb23a860 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:12.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.363+0000 7f60167fc640 0 client.14703 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:11:12.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.363+0000 7f60379ce740 1 -- 172.21.15.44:0/622839859 >> 172.21.15.44:0/622839859 conn(0x55ddcb231bc0 msgr2=0x55ddcb24b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:12.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.363+0000 7f60379ce740 1 -- 172.21.15.44:0/622839859 shutdown_connections 2024-08-19T00:11:12.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.363+0000 7f60379ce740 1 -- 172.21.15.44:0/622839859 wait complete. 2024-08-19T00:11:12.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.363+0000 7f60379ce740 20 client.14703 trim_cache size 0 max 16384 2024-08-19T00:11:12.371 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-08-19T00:11:12.371 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "647ded64-5dbe-11ef-bccf-c7b262605968", 2024-08-19T00:11:12.371 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 0, 2024-08-19T00:11:12.371 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 24473, 2024-08-19T00:11:12.371 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-08-19T00:11:12.371 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-08-19T00:11:12.371 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-08-19T00:11:12.371 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 18.863316868999998, 2024-08-19T00:11:12.371 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 16, 2024-08-19T00:11:12.371 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 90, 2024-08-19T00:11:12.371 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 90, 2024-08-19T00:11:12.371 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 30.788594305 2024-08-19T00:11:12.372 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-08-19T00:11:12.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.364+0000 7f60355d0640 1 -- 172.21.15.44:0/2691845953 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f601c0a2b80 msgr2=0x7f601c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:12.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.364+0000 7f60355d0640 1 --2- 172.21.15.44:0/2691845953 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f601c0a2b80 0x7f601c0a5040 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f602808f830 tx=0x7f602808f860 comp rx=0 tx=0).stop 2024-08-19T00:11:12.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.364+0000 7f60355d0640 1 -- 172.21.15.44:0/2691845953 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f603010e170 msgr2=0x7f603019ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:12.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.364+0000 7f60355d0640 1 --2- 172.21.15.44:0/2691845953 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f603010e170 0x7f603019ec30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f602802ae70 tx=0x7f602802f5b0 comp rx=0 tx=0).stop 2024-08-19T00:11:12.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.364+0000 7f60355d0640 1 -- 172.21.15.44:0/2691845953 shutdown_connections 2024-08-19T00:11:12.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.364+0000 7f60355d0640 1 --2- 172.21.15.44:0/2691845953 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f601c0a2b80 0x7f601c0a5040 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:12.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.364+0000 7f60355d0640 1 --2- 172.21.15.44:0/2691845953 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6030074b60 0x7f603019a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:12.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.364+0000 7f60355d0640 1 --2- 172.21.15.44:0/2691845953 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f603010e170 0x7f603019ec30 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:12.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.364+0000 7f60355d0640 1 --2- 172.21.15.44:0/2691845953 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6030074240 0x7f603019a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:12.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.364+0000 7f60355d0640 1 -- 172.21.15.44:0/2691845953 >> 172.21.15.44:0/2691845953 conn(0x7f60300fd5f0 msgr2=0x7f60300fe2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:12.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.364+0000 7f60355d0640 1 -- 172.21.15.44:0/2691845953 shutdown_connections 2024-08-19T00:11:12.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:12.364+0000 7f60355d0640 1 -- 172.21.15.44:0/2691845953 wait complete. 2024-08-19T00:11:13.049 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-08-19T00:11:13.049 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-08-19T00:11:13.050 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph fs ls 2024-08-19T00:11:13.304 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:11:13.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:13.804+0000 7f9a773da640 1 -- 172.21.15.44:0/912724552 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a701022a0 msgr2=0x7f9a701026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:13.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:13.804+0000 7f9a773da640 1 --2- 172.21.15.44:0/912724552 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a701022a0 0x7f9a701026e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9a60009900 tx=0x7f9a6002a480 comp rx=0 tx=0).stop 2024-08-19T00:11:13.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:13.804+0000 7f9a773da640 1 -- 172.21.15.44:0/912724552 shutdown_connections 2024-08-19T00:11:13.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:13.804+0000 7f9a773da640 1 --2- 172.21.15.44:0/912724552 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9a70102c20 0x7f9a7010d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:13.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:13.804+0000 7f9a773da640 1 --2- 172.21.15.44:0/912724552 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a701022a0 0x7f9a701026e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:13.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:13.804+0000 7f9a773da640 1 --2- 172.21.15.44:0/912724552 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9a70100b50 0x7f9a70100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:13.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:13.804+0000 7f9a773da640 1 -- 172.21.15.44:0/912724552 >> 172.21.15.44:0/912724552 conn(0x7f9a700fc500 msgr2=0x7f9a700fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:13.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:13.804+0000 7f9a773da640 1 -- 172.21.15.44:0/912724552 shutdown_connections 2024-08-19T00:11:13.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:13.804+0000 7f9a773da640 1 -- 172.21.15.44:0/912724552 wait complete. 2024-08-19T00:11:13.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:13.804+0000 7f9a773da640 1 Processor -- start 2024-08-19T00:11:13.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:13.804+0000 7f9a773da640 1 -- start start 2024-08-19T00:11:13.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:13.805+0000 7f9a773da640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a70100b50 0x7f9a70197270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:13.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:13.805+0000 7f9a773da640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9a701022a0 0x7f9a701977b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:13.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:13.805+0000 7f9a773da640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9a70102c20 0x7f9a7019bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:13.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:13.805+0000 7f9a773da640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9a70110d50 con 0x7f9a70100b50 2024-08-19T00:11:13.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:13.805+0000 7f9a773da640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f9a70110bd0 con 0x7f9a701022a0 2024-08-19T00:11:13.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:13.805+0000 7f9a773da640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9a70110ed0 con 0x7f9a70102c20 2024-08-19T00:11:13.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:13.805+0000 7f9a75176640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a70100b50 0x7f9a70197270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:13.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:13.805+0000 7f9a75176640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a70100b50 0x7f9a70197270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39706/0 (socket says 172.21.15.44:39706) 2024-08-19T00:11:13.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:13.805+0000 7f9a75176640 1 -- 172.21.15.44:0/1311689142 learned_addr learned my addr 172.21.15.44:0/1311689142 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:11:13.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:13.805+0000 7f9a74975640 1 --2- 172.21.15.44:0/1311689142 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9a701022a0 0x7f9a701977b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:13.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:13.805+0000 7f9a75977640 1 --2- 172.21.15.44:0/1311689142 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9a70102c20 0x7f9a7019bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:13.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:13.805+0000 7f9a75176640 1 -- 172.21.15.44:0/1311689142 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9a70102c20 msgr2=0x7f9a7019bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:13.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:13.805+0000 7f9a75176640 1 --2- 172.21.15.44:0/1311689142 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9a70102c20 0x7f9a7019bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:13.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:13.805+0000 7f9a75176640 1 -- 172.21.15.44:0/1311689142 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9a701022a0 msgr2=0x7f9a701977b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:13.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:13.805+0000 7f9a75176640 1 --2- 172.21.15.44:0/1311689142 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9a701022a0 0x7f9a701977b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:13.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:13.805+0000 7f9a75176640 1 -- 172.21.15.44:0/1311689142 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a7019c220 con 0x7f9a70100b50 2024-08-19T00:11:13.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:13.805+0000 7f9a75977640 1 --2- 172.21.15.44:0/1311689142 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9a70102c20 0x7f9a7019bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:11:13.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:13.805+0000 7f9a75176640 1 --2- 172.21.15.44:0/1311689142 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a70100b50 0x7f9a70197270 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c00d990 tx=0x7f9a6c00de50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:13.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:13.805+0000 7f9a667fc640 1 -- 172.21.15.44:0/1311689142 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c01b070 con 0x7f9a70100b50 2024-08-19T00:11:13.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:13.805+0000 7f9a773da640 1 -- 172.21.15.44:0/1311689142 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a7019c510 con 0x7f9a70100b50 2024-08-19T00:11:13.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:13.805+0000 7f9a667fc640 1 -- 172.21.15.44:0/1311689142 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a6c00edf0 con 0x7f9a70100b50 2024-08-19T00:11:13.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:13.805+0000 7f9a667fc640 1 -- 172.21.15.44:0/1311689142 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c014870 con 0x7f9a70100b50 2024-08-19T00:11:13.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:13.805+0000 7f9a773da640 1 -- 172.21.15.44:0/1311689142 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a70069ca0 con 0x7f9a70100b50 2024-08-19T00:11:13.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:13.806+0000 7f9a773da640 1 -- 172.21.15.44:0/1311689142 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a70100fb0 con 0x7f9a70100b50 2024-08-19T00:11:13.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:13.808+0000 7f9a667fc640 1 -- 172.21.15.44:0/1311689142 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f9a6c01e070 con 0x7f9a70100b50 2024-08-19T00:11:13.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:13.808+0000 7f9a667fc640 1 --2- 172.21.15.44:0/1311689142 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f9a5c0a2b80 0x7f9a5c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:13.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:13.808+0000 7f9a74975640 1 --2- 172.21.15.44:0/1311689142 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f9a5c0a2b80 0x7f9a5c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:13.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:13.809+0000 7f9a667fc640 1 -- 172.21.15.44:0/1311689142 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f9a6c0d0ef0 con 0x7f9a70100b50 2024-08-19T00:11:13.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:13.809+0000 7f9a74975640 1 --2- 172.21.15.44:0/1311689142 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f9a5c0a2b80 0x7f9a5c0a5040 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9a700ffba0 tx=0x7f9a60005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:13.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:13.812+0000 7f9a667fc640 1 -- 172.21.15.44:0/1311689142 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f9a6c09dc10 con 0x7f9a70100b50 2024-08-19T00:11:14.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:14.025+0000 7f9a773da640 1 -- 172.21.15.44:0/1311689142 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f9a701985d0 con 0x7f9a70100b50 2024-08-19T00:11:14.026 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:13 smithi044 ceph-mon[18489]: pgmap v277: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:11:14.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:14.025+0000 7f9a667fc640 1 -- 172.21.15.44:0/1311689142 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) ==== 53+0+88 (secure 0 0 0) 0x7f9a701985d0 con 0x7f9a70100b50 2024-08-19T00:11:14.027 INFO:teuthology.orchestra.run.smithi044.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-08-19T00:11:14.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:14.027+0000 7f9a773da640 1 -- 172.21.15.44:0/1311689142 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f9a5c0a2b80 msgr2=0x7f9a5c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:14.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:14.027+0000 7f9a773da640 1 --2- 172.21.15.44:0/1311689142 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f9a5c0a2b80 0x7f9a5c0a5040 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9a700ffba0 tx=0x7f9a60005a20 comp rx=0 tx=0).stop 2024-08-19T00:11:14.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:14.027+0000 7f9a773da640 1 -- 172.21.15.44:0/1311689142 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a70100b50 msgr2=0x7f9a70197270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:14.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:14.027+0000 7f9a773da640 1 --2- 172.21.15.44:0/1311689142 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a70100b50 0x7f9a70197270 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c00d990 tx=0x7f9a6c00de50 comp rx=0 tx=0).stop 2024-08-19T00:11:14.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:14.027+0000 7f9a773da640 1 -- 172.21.15.44:0/1311689142 shutdown_connections 2024-08-19T00:11:14.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:14.027+0000 7f9a773da640 1 --2- 172.21.15.44:0/1311689142 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f9a5c0a2b80 0x7f9a5c0a5040 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:14.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:14.027+0000 7f9a773da640 1 --2- 172.21.15.44:0/1311689142 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9a70102c20 0x7f9a7019bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:14.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:14.027+0000 7f9a773da640 1 --2- 172.21.15.44:0/1311689142 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9a701022a0 0x7f9a701977b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:14.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:14.027+0000 7f9a773da640 1 --2- 172.21.15.44:0/1311689142 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a70100b50 0x7f9a70197270 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:14.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:14.027+0000 7f9a773da640 1 -- 172.21.15.44:0/1311689142 >> 172.21.15.44:0/1311689142 conn(0x7f9a700fc500 msgr2=0x7f9a700fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:14.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:14.027+0000 7f9a773da640 1 -- 172.21.15.44:0/1311689142 shutdown_connections 2024-08-19T00:11:14.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:14.027+0000 7f9a773da640 1 -- 172.21.15.44:0/1311689142 wait complete. 2024-08-19T00:11:14.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:13 smithi171 ceph-mon[21810]: pgmap v277: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:11:14.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:13 smithi116 ceph-mon[21873]: pgmap v277: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:11:14.652 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-19T00:11:14.652 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-19T00:11:14.652 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi044.front.sepia.ceph.com 2024-08-19T00:11:14.652 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-08-19T00:11:14.652 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-08-19T00:11:14.652 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-19T00:11:14.652 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-19T00:11:14.652 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-19T00:11:14.653 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-08-19T00:11:14.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:11:14.653 DEBUG:teuthology.orchestra.run.smithi044:> ip addr 2024-08-19T00:11:14.670 INFO:teuthology.orchestra.run.smithi044.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-19T00:11:14.670 INFO:teuthology.orchestra.run.smithi044.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-19T00:11:14.670 INFO:teuthology.orchestra.run.smithi044.stdout: inet 127.0.0.1/8 scope host lo 2024-08-19T00:11:14.670 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:11:14.670 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 ::1/128 scope host 2024-08-19T00:11:14.670 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:11:14.670 INFO:teuthology.orchestra.run.smithi044.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:11:14.670 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8c brd ff:ff:ff:ff:ff:ff 2024-08-19T00:11:14.670 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f0 2024-08-19T00:11:14.670 INFO:teuthology.orchestra.run.smithi044.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:11:14.670 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8d brd ff:ff:ff:ff:ff:ff 2024-08-19T00:11:14.671 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f1 2024-08-19T00:11:14.671 INFO:teuthology.orchestra.run.smithi044.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-19T00:11:14.671 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:72 brd ff:ff:ff:ff:ff:ff 2024-08-19T00:11:14.671 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f0 2024-08-19T00:11:14.671 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.21.15.44/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-19T00:11:14.671 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft 42394sec preferred_lft 42394sec 2024-08-19T00:11:14.671 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::9c56:c472:40c2:758e/64 scope link noprefixroute 2024-08-19T00:11:14.671 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:11:14.671 INFO:teuthology.orchestra.run.smithi044.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:11:14.671 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:73 brd ff:ff:ff:ff:ff:ff 2024-08-19T00:11:14.671 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f1 2024-08-19T00:11:14.672 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-19T00:11:14.672 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-19T00:11:14.672 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-08-19T00:11:14.672 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link add name ceph-brx type bridge 2024-08-19T00:11:14.673 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip addr flush dev ceph-brx 2024-08-19T00:11:14.673 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set ceph-brx up 2024-08-19T00:11:14.673 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-19T00:11:14.673 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-08-19T00:11:14.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:11:14.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:11:14.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:11:14.871 DEBUG:teuthology.orchestra.run.smithi044:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-19T00:11:14.884 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:14 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/1311689142' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-08-19T00:11:14.897 INFO:teuthology.orchestra.run.smithi044.stdout:1 2024-08-19T00:11:14.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:11:14.898 DEBUG:teuthology.orchestra.run.smithi044:> route 2024-08-19T00:11:14.965 INFO:teuthology.orchestra.run.smithi044.stdout:Kernel IP routing table 2024-08-19T00:11:14.965 INFO:teuthology.orchestra.run.smithi044.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-19T00:11:14.965 INFO:teuthology.orchestra.run.smithi044.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-19T00:11:14.965 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-19T00:11:14.965 INFO:teuthology.orchestra.run.smithi044.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-19T00:11:14.966 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-19T00:11:14.966 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-08-19T00:11:14.966 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-19T00:11:14.966 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-19T00:11:14.966 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-19T00:11:14.966 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-08-19T00:11:15.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:11:15.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:14 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/1311689142' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-08-19T00:11:15.119 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:14 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/1311689142' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-08-19T00:11:15.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:11:15.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:11:15.240 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2024-08-19T00:11:15.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:11:15.256 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list-id 2024-08-19T00:11:15.311 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-19T00:11:15.311 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-08-19T00:11:15.311 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-19T00:11:15.311 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-08-19T00:11:15.312 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-08-19T00:11:15.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:11:15.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:11:15.429 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-08-19T00:11:15.430 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-19T00:11:15.430 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-08-19T00:11:15.430 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-08-19T00:11:15.430 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-19T00:11:15.430 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-08-19T00:11:15.431 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-08-19T00:11:15.431 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-08-19T00:11:15.431 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-08-19T00:11:15.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:11:15.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:11:15.559 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-19T00:11:15.559 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-08-19T00:11:15.559 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set brx.0 up 2024-08-19T00:11:15.559 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set dev brx.0 master ceph-brx 2024-08-19T00:11:15.559 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-08-19T00:11:15.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:11:15.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:11:15.636 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-08-19T00:11:15.636 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-19T00:11:15.636 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-08-19T00:11:15.651 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-08-19T00:11:15.651 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-19T00:11:15.651 DEBUG:teuthology.orchestra.run.smithi044:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-08-19T00:11:15.706 DEBUG:teuthology.orchestra.run.smithi044:> sudo modprobe fuse 2024-08-19T00:11:15.771 DEBUG:teuthology.orchestra.run.smithi044:> cat /proc/self/mounts | awk '{print $2}' 2024-08-19T00:11:15.828 INFO:teuthology.orchestra.run.smithi044.stdout:/proc 2024-08-19T00:11:15.828 INFO:teuthology.orchestra.run.smithi044.stdout:/sys 2024-08-19T00:11:15.828 INFO:teuthology.orchestra.run.smithi044.stdout:/dev 2024-08-19T00:11:15.828 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/security 2024-08-19T00:11:15.828 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/shm 2024-08-19T00:11:15.828 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/pts 2024-08-19T00:11:15.828 INFO:teuthology.orchestra.run.smithi044.stdout:/run 2024-08-19T00:11:15.829 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/cgroup 2024-08-19T00:11:15.829 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/pstore 2024-08-19T00:11:15.829 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/bpf 2024-08-19T00:11:15.829 INFO:teuthology.orchestra.run.smithi044.stdout:/ 2024-08-19T00:11:15.829 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/selinux 2024-08-19T00:11:15.829 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/sys/fs/binfmt_misc 2024-08-19T00:11:15.829 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/hugepages 2024-08-19T00:11:15.829 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/mqueue 2024-08-19T00:11:15.829 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/debug 2024-08-19T00:11:15.829 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/tracing 2024-08-19T00:11:15.829 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-sysusers.service 2024-08-19T00:11:15.829 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/config 2024-08-19T00:11:15.829 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/fuse/connections 2024-08-19T00:11:15.829 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-sysctl.service 2024-08-19T00:11:15.829 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-08-19T00:11:15.829 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-08-19T00:11:15.830 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/nfs/rpc_pipefs 2024-08-19T00:11:15.830 INFO:teuthology.orchestra.run.smithi044.stdout:/run/user/1000 2024-08-19T00:11:15.830 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph 2024-08-19T00:11:15.830 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay 2024-08-19T00:11:15.830 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/d7b27e21c0dea49f1ac7978d90682e3cdce33ec3d5f6cd640ed826d332077ab5/merged 2024-08-19T00:11:15.830 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/54d7ecaf69e6469fbbcf9ac8447291e0efdcb3361ab12bde2c459054c799505e/merged 2024-08-19T00:11:15.830 INFO:teuthology.orchestra.run.smithi044.stdout:/run/user/0 2024-08-19T00:11:15.830 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/sys/fs/binfmt_misc 2024-08-19T00:11:15.830 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/ebb40182fd48b9f93590e04201351974ec4f3abd63a4b001f998cd7e1fe9ff43/merged 2024-08-19T00:11:15.830 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/bf0978af66ea19cdf702c63f09cd908c801e0811456acafa4fdb8b28fd81d37b/merged 2024-08-19T00:11:15.831 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/2a9663ad5d224fae00c1a5b062efe7e9f6b7a68d587dd2c0cdb59d02e10ff2a5/merged 2024-08-19T00:11:15.831 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/c87a84c38f40f0cb4314eaea88168a061d6b8590e831c39235701b7ae28a03b8/merged 2024-08-19T00:11:15.831 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/f583bef339fad5ba9caa2a8889a4448ab3ca0e9fb94f225dcfabe6d4ccd131b1/merged 2024-08-19T00:11:15.831 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/bf232007ebdfa7b25c1e00ec30d75abe3f73c67e96c5078272205c54f6a4c6e1/merged 2024-08-19T00:11:15.831 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/1ab9301038abfd6acf840d468c9ff919a28e87f4d282dea613f3e22663c9379e/merged 2024-08-19T00:11:15.831 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/5a0d4ef161820669e0f0ddd0d86a0daa81ec3b9ec8dec862bdbd82156c1fe1c9/merged 2024-08-19T00:11:15.831 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns 2024-08-19T00:11:15.831 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-19T00:11:15.831 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-19T00:11:15.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:11:15.831 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2024-08-19T00:11:15.883 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-08-19T00:11:15.883 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-08-19T00:11:15.925 DEBUG:teuthology.orchestra.run.smithi044:> sudo modprobe fuse 2024-08-19T00:11:15.950 DEBUG:teuthology.orchestra.run.smithi044:> cat /proc/self/mounts | awk '{print $2}' 2024-08-19T00:11:16.007 INFO:teuthology.orchestra.run.smithi044.stdout:/proc 2024-08-19T00:11:16.007 INFO:teuthology.orchestra.run.smithi044.stdout:/sys 2024-08-19T00:11:16.007 INFO:teuthology.orchestra.run.smithi044.stdout:/dev 2024-08-19T00:11:16.007 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/security 2024-08-19T00:11:16.007 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/shm 2024-08-19T00:11:16.008 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/pts 2024-08-19T00:11:16.008 INFO:teuthology.orchestra.run.smithi044.stdout:/run 2024-08-19T00:11:16.008 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/cgroup 2024-08-19T00:11:16.008 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/pstore 2024-08-19T00:11:16.008 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/bpf 2024-08-19T00:11:16.008 INFO:teuthology.orchestra.run.smithi044.stdout:/ 2024-08-19T00:11:16.008 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/selinux 2024-08-19T00:11:16.008 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/sys/fs/binfmt_misc 2024-08-19T00:11:16.008 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/hugepages 2024-08-19T00:11:16.008 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/mqueue 2024-08-19T00:11:16.008 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/debug 2024-08-19T00:11:16.008 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/tracing 2024-08-19T00:11:16.008 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-sysusers.service 2024-08-19T00:11:16.008 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/config 2024-08-19T00:11:16.009 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/fuse/connections 2024-08-19T00:11:16.009 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-sysctl.service 2024-08-19T00:11:16.009 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-08-19T00:11:16.009 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-08-19T00:11:16.009 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/nfs/rpc_pipefs 2024-08-19T00:11:16.009 INFO:teuthology.orchestra.run.smithi044.stdout:/run/user/1000 2024-08-19T00:11:16.009 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph 2024-08-19T00:11:16.009 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay 2024-08-19T00:11:16.009 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/d7b27e21c0dea49f1ac7978d90682e3cdce33ec3d5f6cd640ed826d332077ab5/merged 2024-08-19T00:11:16.009 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/54d7ecaf69e6469fbbcf9ac8447291e0efdcb3361ab12bde2c459054c799505e/merged 2024-08-19T00:11:16.009 INFO:teuthology.orchestra.run.smithi044.stdout:/run/user/0 2024-08-19T00:11:16.009 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/sys/fs/binfmt_misc 2024-08-19T00:11:16.009 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/ebb40182fd48b9f93590e04201351974ec4f3abd63a4b001f998cd7e1fe9ff43/merged 2024-08-19T00:11:16.010 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/bf0978af66ea19cdf702c63f09cd908c801e0811456acafa4fdb8b28fd81d37b/merged 2024-08-19T00:11:16.010 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/2a9663ad5d224fae00c1a5b062efe7e9f6b7a68d587dd2c0cdb59d02e10ff2a5/merged 2024-08-19T00:11:16.010 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/c87a84c38f40f0cb4314eaea88168a061d6b8590e831c39235701b7ae28a03b8/merged 2024-08-19T00:11:16.010 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/f583bef339fad5ba9caa2a8889a4448ab3ca0e9fb94f225dcfabe6d4ccd131b1/merged 2024-08-19T00:11:16.010 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/bf232007ebdfa7b25c1e00ec30d75abe3f73c67e96c5078272205c54f6a4c6e1/merged 2024-08-19T00:11:16.010 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/1ab9301038abfd6acf840d468c9ff919a28e87f4d282dea613f3e22663c9379e/merged 2024-08-19T00:11:16.010 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/5a0d4ef161820669e0f0ddd0d86a0daa81ec3b9ec8dec862bdbd82156c1fe1c9/merged 2024-08-19T00:11:16.010 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns 2024-08-19T00:11:16.010 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-19T00:11:16.010 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-19T00:11:16.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:11:16.011 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2024-08-19T00:11:16.027 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi044.stderr:2024-08-19T00:11:16.026+0000 7fb230873480 -1 init, newargv = 0x56256b007a10 newargc=15 2024-08-19T00:11:16.027 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi044.stderr:ceph-fuse[62447]: starting ceph client 2024-08-19T00:11:16.033 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi044.stderr:ceph-fuse[62447]: starting fuse 2024-08-19T00:11:16.042 INFO:teuthology.orchestra.run.smithi044.stdout:121 2024-08-19T00:11:16.042 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [121] 2024-08-19T00:11:16.043 DEBUG:teuthology.orchestra.run.smithi044:> sudo stdin-killer -- python3 -c ' 2024-08-19T00:11:16.043 DEBUG:teuthology.orchestra.run.smithi044:> import glob 2024-08-19T00:11:16.043 DEBUG:teuthology.orchestra.run.smithi044:> import re 2024-08-19T00:11:16.043 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-08-19T00:11:16.043 DEBUG:teuthology.orchestra.run.smithi044:> import subprocess 2024-08-19T00:11:16.043 DEBUG:teuthology.orchestra.run.smithi044:> 2024-08-19T00:11:16.043 DEBUG:teuthology.orchestra.run.smithi044:> def _find_admin_socket(client_name): 2024-08-19T00:11:16.043 DEBUG:teuthology.orchestra.run.smithi044:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-08-19T00:11:16.043 DEBUG:teuthology.orchestra.run.smithi044:> files = glob.glob(asok_path) 2024-08-19T00:11:16.043 DEBUG:teuthology.orchestra.run.smithi044:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-08-19T00:11:16.043 DEBUG:teuthology.orchestra.run.smithi044:> 2024-08-19T00:11:16.043 DEBUG:teuthology.orchestra.run.smithi044:> # Given a non-glob path, it better be there 2024-08-19T00:11:16.043 DEBUG:teuthology.orchestra.run.smithi044:> if "*" not in asok_path: 2024-08-19T00:11:16.044 DEBUG:teuthology.orchestra.run.smithi044:> assert(len(files) == 1) 2024-08-19T00:11:16.044 DEBUG:teuthology.orchestra.run.smithi044:> return files[0] 2024-08-19T00:11:16.044 DEBUG:teuthology.orchestra.run.smithi044:> 2024-08-19T00:11:16.044 DEBUG:teuthology.orchestra.run.smithi044:> for f in files: 2024-08-19T00:11:16.044 DEBUG:teuthology.orchestra.run.smithi044:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-19T00:11:16.044 DEBUG:teuthology.orchestra.run.smithi044:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-19T00:11:16.044 DEBUG:teuthology.orchestra.run.smithi044:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-19T00:11:16.044 DEBUG:teuthology.orchestra.run.smithi044:> contents = proc_f.read() 2024-08-19T00:11:16.044 DEBUG:teuthology.orchestra.run.smithi044:> if mountpoint in contents: 2024-08-19T00:11:16.044 DEBUG:teuthology.orchestra.run.smithi044:> return f 2024-08-19T00:11:16.044 DEBUG:teuthology.orchestra.run.smithi044:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-19T00:11:16.044 DEBUG:teuthology.orchestra.run.smithi044:> 2024-08-19T00:11:16.044 DEBUG:teuthology.orchestra.run.smithi044:> print(_find_admin_socket("client.admin")) 2024-08-19T00:11:16.044 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-08-19T00:11:16.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:15 smithi171 ceph-mon[21810]: pgmap v278: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:11:16.103 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:15 smithi044 ceph-mon[18489]: pgmap v278: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:11:16.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:15 smithi116 ceph-mon[21873]: pgmap v278: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:11:16.161 INFO:teuthology.orchestra.run.smithi044.stdout:/var/run/ceph/ceph-client.admin.62447.asok 2024-08-19T00:11:16.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:11:16.171 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.62447.asok 2024-08-19T00:11:16.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:11:16.171 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.62447.asok status 2024-08-19T00:11:16.307 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-08-19T00:11:16.307 INFO:teuthology.orchestra.run.smithi044.stdout: "metadata": { 2024-08-19T00:11:16.307 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_sha1": "de09dd018de4baddfa6ca4d43bc8fb784cf75833", 2024-08-19T00:11:16.307 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_version": "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)", 2024-08-19T00:11:16.307 INFO:teuthology.orchestra.run.smithi044.stdout: "entity_id": "admin", 2024-08-19T00:11:16.308 INFO:teuthology.orchestra.run.smithi044.stdout: "hostname": "smithi044", 2024-08-19T00:11:16.308 INFO:teuthology.orchestra.run.smithi044.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-08-19T00:11:16.308 INFO:teuthology.orchestra.run.smithi044.stdout: "pid": "62447", 2024-08-19T00:11:16.308 INFO:teuthology.orchestra.run.smithi044.stdout: "root": "/" 2024-08-19T00:11:16.308 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:11:16.308 INFO:teuthology.orchestra.run.smithi044.stdout: "dentry_count": 0, 2024-08-19T00:11:16.308 INFO:teuthology.orchestra.run.smithi044.stdout: "dentry_pinned_count": 0, 2024-08-19T00:11:16.308 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 14715, 2024-08-19T00:11:16.308 INFO:teuthology.orchestra.run.smithi044.stdout: "inst": { 2024-08-19T00:11:16.308 INFO:teuthology.orchestra.run.smithi044.stdout: "name": { 2024-08-19T00:11:16.308 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "client", 2024-08-19T00:11:16.308 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 14715 2024-08-19T00:11:16.308 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:11:16.309 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": { 2024-08-19T00:11:16.309 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-08-19T00:11:16.309 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "192.168.0.1:0", 2024-08-19T00:11:16.309 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 3369638239 2024-08-19T00:11:16.309 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:11:16.309 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:11:16.309 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": { 2024-08-19T00:11:16.309 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-08-19T00:11:16.309 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "192.168.0.1:0", 2024-08-19T00:11:16.309 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 3369638239 2024-08-19T00:11:16.309 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:11:16.309 INFO:teuthology.orchestra.run.smithi044.stdout: "inst_str": "client.14715 192.168.0.1:0/3369638239", 2024-08-19T00:11:16.310 INFO:teuthology.orchestra.run.smithi044.stdout: "addr_str": "192.168.0.1:0/3369638239", 2024-08-19T00:11:16.310 INFO:teuthology.orchestra.run.smithi044.stdout: "inode_count": 1, 2024-08-19T00:11:16.310 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_epoch": 16, 2024-08-19T00:11:16.310 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_epoch": 90, 2024-08-19T00:11:16.310 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_epoch_barrier": 0, 2024-08-19T00:11:16.310 INFO:teuthology.orchestra.run.smithi044.stdout: "blocklisted": false, 2024-08-19T00:11:16.310 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs" 2024-08-19T00:11:16.310 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-08-19T00:11:16.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:11:16.316 DEBUG:teuthology.orchestra.run.smithi044:> stat --file-system '--printf=%T 2024-08-19T00:11:16.316 DEBUG:teuthology.orchestra.run.smithi044:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-08-19T00:11:16.332 INFO:teuthology.orchestra.run.smithi044.stdout:fuseblk 2024-08-19T00:11:16.332 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-08-19T00:11:16.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:11:16.332 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-08-19T00:11:16.398 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-08-19T00:11:16.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-19T00:11:16.524 INFO:teuthology.orchestra.run.smithi044.stdout:# file: . 2024-08-19T00:11:16.524 INFO:teuthology.orchestra.run.smithi044.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-08-19T00:11:16.524 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:11:16.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:11:16.530 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-08-19T00:11:16.530 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:11:16.551 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph osd blocklist ls 2024-08-19T00:11:16.848 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:11:17.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:17.325+0000 7fa759d9d640 1 -- 172.21.15.44:0/3721549603 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa754101150 msgr2=0x7fa75410d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:17.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:17.325+0000 7fa759d9d640 1 --2- 172.21.15.44:0/3721549603 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa754101150 0x7fa75410d680 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa74c009cd0 tx=0x7fa74c02a8e0 comp rx=0 tx=0).stop 2024-08-19T00:11:17.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:17.325+0000 7fa759d9d640 1 -- 172.21.15.44:0/3721549603 shutdown_connections 2024-08-19T00:11:17.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:17.325+0000 7fa759d9d640 1 --2- 172.21.15.44:0/3721549603 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa754101150 0x7fa75410d680 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:17.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:17.325+0000 7fa759d9d640 1 --2- 172.21.15.44:0/3721549603 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa7541007b0 0x7fa754100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:17.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:17.325+0000 7fa759d9d640 1 --2- 172.21.15.44:0/3721549603 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa7541067b0 0x7fa754106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:17.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:17.325+0000 7fa759d9d640 1 -- 172.21.15.44:0/3721549603 >> 172.21.15.44:0/3721549603 conn(0x7fa7540fc4d0 msgr2=0x7fa7540fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:17.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:17.325+0000 7fa759d9d640 1 -- 172.21.15.44:0/3721549603 shutdown_connections 2024-08-19T00:11:17.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:17.325+0000 7fa759d9d640 1 -- 172.21.15.44:0/3721549603 wait complete. 2024-08-19T00:11:17.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:17.326+0000 7fa759d9d640 1 Processor -- start 2024-08-19T00:11:17.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:17.326+0000 7fa759d9d640 1 -- start start 2024-08-19T00:11:17.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:17.326+0000 7fa759d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa7541007b0 0x7fa754199040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:17.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:17.326+0000 7fa759d9d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa754101150 0x7fa754199580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:17.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:17.326+0000 7fa759d9d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa7541067b0 0x7fa7541a40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:17.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:17.326+0000 7fa759d9d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa754110bf0 con 0x7fa7541007b0 2024-08-19T00:11:17.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:17.326+0000 7fa759d9d640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fa754110a70 con 0x7fa754101150 2024-08-19T00:11:17.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:17.326+0000 7fa759d9d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa754110d70 con 0x7fa7541067b0 2024-08-19T00:11:17.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:17.327+0000 7fa7537fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa7541007b0 0x7fa754199040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:17.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:17.327+0000 7fa7537fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa7541007b0 0x7fa754199040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39722/0 (socket says 172.21.15.44:39722) 2024-08-19T00:11:17.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:17.327+0000 7fa7537fe640 1 -- 172.21.15.44:0/3761524115 learned_addr learned my addr 172.21.15.44:0/3761524115 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:11:17.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:17.327+0000 7fa752ffd640 1 --2- 172.21.15.44:0/3761524115 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa754101150 0x7fa754199580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:17.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:17.327+0000 7fa7537fe640 1 -- 172.21.15.44:0/3761524115 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa7541067b0 msgr2=0x7fa7541a40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:17.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:17.327+0000 7fa7537fe640 1 --2- 172.21.15.44:0/3761524115 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa7541067b0 0x7fa7541a40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:17.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:17.327+0000 7fa7537fe640 1 -- 172.21.15.44:0/3761524115 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa754101150 msgr2=0x7fa754199580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:17.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:17.327+0000 7fa7537fe640 1 --2- 172.21.15.44:0/3761524115 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa754101150 0x7fa754199580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:17.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:17.327+0000 7fa7537fe640 1 -- 172.21.15.44:0/3761524115 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7541a4600 con 0x7fa7541007b0 2024-08-19T00:11:17.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:17.327+0000 7fa7537fe640 1 --2- 172.21.15.44:0/3761524115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa7541007b0 0x7fa754199040 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa74400c970 tx=0x7fa74400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:17.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:17.327+0000 7fa750ff9640 1 -- 172.21.15.44:0/3761524115 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa744007bb0 con 0x7fa7541007b0 2024-08-19T00:11:17.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:17.327+0000 7fa750ff9640 1 -- 172.21.15.44:0/3761524115 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa744007d50 con 0x7fa7541007b0 2024-08-19T00:11:17.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:17.327+0000 7fa759d9d640 1 -- 172.21.15.44:0/3761524115 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7541a47d0 con 0x7fa7541007b0 2024-08-19T00:11:17.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:17.327+0000 7fa750ff9640 1 -- 172.21.15.44:0/3761524115 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa74400f450 con 0x7fa7541007b0 2024-08-19T00:11:17.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:17.327+0000 7fa759d9d640 1 -- 172.21.15.44:0/3761524115 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7541a4c90 con 0x7fa7541007b0 2024-08-19T00:11:17.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:17.328+0000 7fa759d9d640 1 -- 172.21.15.44:0/3761524115 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa754100c10 con 0x7fa7541007b0 2024-08-19T00:11:17.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:17.329+0000 7fa750ff9640 1 -- 172.21.15.44:0/3761524115 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fa744004fc0 con 0x7fa7541007b0 2024-08-19T00:11:17.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:17.330+0000 7fa750ff9640 1 --2- 172.21.15.44:0/3761524115 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fa73c0a2b80 0x7fa73c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:17.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:17.330+0000 7fa750ff9640 1 -- 172.21.15.44:0/3761524115 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7fa7440cf500 con 0x7fa7541007b0 2024-08-19T00:11:17.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:17.330+0000 7fa752ffd640 1 --2- 172.21.15.44:0/3761524115 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fa73c0a2b80 0x7fa73c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:17.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:17.331+0000 7fa752ffd640 1 --2- 172.21.15.44:0/3761524115 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fa73c0a2b80 0x7fa73c0a5040 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa75406b010 tx=0x7fa748008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:17.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:17.333+0000 7fa750ff9640 1 -- 172.21.15.44:0/3761524115 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fa744014030 con 0x7fa7541007b0 2024-08-19T00:11:17.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:17.520+0000 7fa759d9d640 1 -- 172.21.15.44:0/3761524115 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa75406aab0 con 0x7fa7541007b0 2024-08-19T00:11:17.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:17.521+0000 7fa750ff9640 1 -- 172.21.15.44:0/3761524115 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v90) ==== 81+0+590 (secure 0 0 0) 0x7fa75406aab0 con 0x7fa7541007b0 2024-08-19T00:11:17.522 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6800/1300308907 2024-08-20T00:04:38.392912+0000 2024-08-19T00:11:17.523 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:0/1001446555 2024-08-20T00:04:38.392912+0000 2024-08-19T00:11:17.523 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:0/3800526625 2024-08-20T00:04:38.392912+0000 2024-08-19T00:11:17.523 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6801/1300308907 2024-08-20T00:04:38.392912+0000 2024-08-19T00:11:17.523 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:0/3096491642 2024-08-20T00:04:14.604141+0000 2024-08-19T00:11:17.523 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:0/400419582 2024-08-20T00:04:38.392912+0000 2024-08-19T00:11:17.523 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:0/1869412718 2024-08-20T00:04:14.604141+0000 2024-08-19T00:11:17.523 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6801/1374527587 2024-08-20T00:04:14.604141+0000 2024-08-19T00:11:17.523 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:0/911382683 2024-08-20T00:04:14.604141+0000 2024-08-19T00:11:17.523 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6800/1374527587 2024-08-20T00:04:14.604141+0000 2024-08-19T00:11:17.524 INFO:teuthology.orchestra.run.smithi044.stderr:listed 10 entries 2024-08-19T00:11:17.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:17.523+0000 7fa759d9d640 1 -- 172.21.15.44:0/3761524115 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fa73c0a2b80 msgr2=0x7fa73c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:17.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:17.523+0000 7fa759d9d640 1 --2- 172.21.15.44:0/3761524115 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fa73c0a2b80 0x7fa73c0a5040 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa75406b010 tx=0x7fa748008040 comp rx=0 tx=0).stop 2024-08-19T00:11:17.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:17.523+0000 7fa759d9d640 1 -- 172.21.15.44:0/3761524115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa7541007b0 msgr2=0x7fa754199040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:17.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:17.523+0000 7fa759d9d640 1 --2- 172.21.15.44:0/3761524115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa7541007b0 0x7fa754199040 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa74400c970 tx=0x7fa74400ce30 comp rx=0 tx=0).stop 2024-08-19T00:11:17.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:17.523+0000 7fa759d9d640 1 -- 172.21.15.44:0/3761524115 shutdown_connections 2024-08-19T00:11:17.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:17.523+0000 7fa759d9d640 1 --2- 172.21.15.44:0/3761524115 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fa73c0a2b80 0x7fa73c0a5040 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:17.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:17.523+0000 7fa759d9d640 1 --2- 172.21.15.44:0/3761524115 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa7541067b0 0x7fa7541a40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:17.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:17.523+0000 7fa759d9d640 1 --2- 172.21.15.44:0/3761524115 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa754101150 0x7fa754199580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:17.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:17.523+0000 7fa759d9d640 1 --2- 172.21.15.44:0/3761524115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa7541007b0 0x7fa754199040 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:17.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:17.523+0000 7fa759d9d640 1 -- 172.21.15.44:0/3761524115 >> 172.21.15.44:0/3761524115 conn(0x7fa7540fc4d0 msgr2=0x7fa7540fcbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:17.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:17.523+0000 7fa759d9d640 1 -- 172.21.15.44:0/3761524115 shutdown_connections 2024-08-19T00:11:17.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:17.523+0000 7fa759d9d640 1 -- 172.21.15.44:0/3761524115 wait complete. 2024-08-19T00:11:18.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:17 smithi171 ceph-mon[21810]: pgmap v279: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:11:18.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:17 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/3761524115' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-08-19T00:11:18.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:17 smithi116 ceph-mon[21873]: pgmap v279: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:11:18.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:17 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/3761524115' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-08-19T00:11:18.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:17 smithi044 ceph-mon[18489]: pgmap v279: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:11:18.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:17 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/3761524115' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-08-19T00:11:18.214 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-08-19T00:11:18.214 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:11:18.233 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph osd blocklist ls 2024-08-19T00:11:18.530 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:11:19.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:18.982+0000 7fe709a96640 1 -- 172.21.15.44:0/827402947 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7041018b0 msgr2=0x7fe704101d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:19.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:18.982+0000 7fe709a96640 1 --2- 172.21.15.44:0/827402947 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7041018b0 0x7fe704101d10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe6f8009930 tx=0x7fe6f802a420 comp rx=0 tx=0).stop 2024-08-19T00:11:19.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:18.982+0000 7fe709a96640 1 -- 172.21.15.44:0/827402947 shutdown_connections 2024-08-19T00:11:19.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:18.982+0000 7fe709a96640 1 --2- 172.21.15.44:0/827402947 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe704102250 0x7fe70410e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:19.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:18.982+0000 7fe709a96640 1 --2- 172.21.15.44:0/827402947 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7041018b0 0x7fe704101d10 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:19.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:18.982+0000 7fe709a96640 1 --2- 172.21.15.44:0/827402947 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7041078b0 0x7fe704107c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:19.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:18.982+0000 7fe709a96640 1 -- 172.21.15.44:0/827402947 >> 172.21.15.44:0/827402947 conn(0x7fe7040fd5f0 msgr2=0x7fe7040ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:19.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:18.982+0000 7fe709a96640 1 -- 172.21.15.44:0/827402947 shutdown_connections 2024-08-19T00:11:19.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:18.982+0000 7fe709a96640 1 -- 172.21.15.44:0/827402947 wait complete. 2024-08-19T00:11:19.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:18.983+0000 7fe709a96640 1 Processor -- start 2024-08-19T00:11:19.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:18.983+0000 7fe709a96640 1 -- start start 2024-08-19T00:11:19.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:18.983+0000 7fe709a96640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe7041018b0 0x7fe704198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:19.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:18.983+0000 7fe709a96640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe704102250 0x7fe704198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:19.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:18.983+0000 7fe709a96640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7041078b0 0x7fe70419cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:19.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:18.983+0000 7fe709a96640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe704111d50 con 0x7fe704102250 2024-08-19T00:11:19.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:18.983+0000 7fe709a96640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fe704111bd0 con 0x7fe7041078b0 2024-08-19T00:11:19.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:18.983+0000 7fe709a96640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe704111ed0 con 0x7fe7041018b0 2024-08-19T00:11:19.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:18.983+0000 7fe702ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe704102250 0x7fe704198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:19.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:18.983+0000 7fe702ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe704102250 0x7fe704198850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45314/0 (socket says 172.21.15.44:45314) 2024-08-19T00:11:19.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:18.984+0000 7fe702ffd640 1 -- 172.21.15.44:0/2650731396 learned_addr learned my addr 172.21.15.44:0/2650731396 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:11:19.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:18.984+0000 7fe7037fe640 1 --2- 172.21.15.44:0/2650731396 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe7041018b0 0x7fe704198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:19.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:18.984+0000 7fe703fff640 1 --2- 172.21.15.44:0/2650731396 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7041078b0 0x7fe70419cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:19.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:18.984+0000 7fe702ffd640 1 -- 172.21.15.44:0/2650731396 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe7041018b0 msgr2=0x7fe704198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:19.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:18.984+0000 7fe702ffd640 1 --2- 172.21.15.44:0/2650731396 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe7041018b0 0x7fe704198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:19.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:18.984+0000 7fe702ffd640 1 -- 172.21.15.44:0/2650731396 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7041078b0 msgr2=0x7fe70419cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:19.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:18.984+0000 7fe702ffd640 1 --2- 172.21.15.44:0/2650731396 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7041078b0 0x7fe70419cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:19.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:18.984+0000 7fe702ffd640 1 -- 172.21.15.44:0/2650731396 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe70419d2c0 con 0x7fe704102250 2024-08-19T00:11:19.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:18.984+0000 7fe702ffd640 1 --2- 172.21.15.44:0/2650731396 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe704102250 0x7fe704198850 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe6f8009a50 tx=0x7fe6f8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:19.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:18.984+0000 7fe700ff9640 1 -- 172.21.15.44:0/2650731396 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f803f030 con 0x7fe704102250 2024-08-19T00:11:19.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:18.984+0000 7fe700ff9640 1 -- 172.21.15.44:0/2650731396 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe6f8003ad0 con 0x7fe704102250 2024-08-19T00:11:19.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:18.984+0000 7fe709a96640 1 -- 172.21.15.44:0/2650731396 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe70419d550 con 0x7fe704102250 2024-08-19T00:11:19.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:18.984+0000 7fe709a96640 1 -- 172.21.15.44:0/2650731396 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7041a4e90 con 0x7fe704102250 2024-08-19T00:11:19.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:18.984+0000 7fe700ff9640 1 -- 172.21.15.44:0/2650731396 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f8049060 con 0x7fe704102250 2024-08-19T00:11:19.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:18.985+0000 7fe709a96640 1 -- 172.21.15.44:0/2650731396 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe704101d90 con 0x7fe704102250 2024-08-19T00:11:19.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:18.986+0000 7fe700ff9640 1 -- 172.21.15.44:0/2650731396 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fe6f8042030 con 0x7fe704102250 2024-08-19T00:11:19.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:18.987+0000 7fe700ff9640 1 --2- 172.21.15.44:0/2650731396 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fe6ec0a2b80 0x7fe6ec0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:19.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:18.987+0000 7fe7037fe640 1 --2- 172.21.15.44:0/2650731396 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fe6ec0a2b80 0x7fe6ec0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:19.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:18.987+0000 7fe700ff9640 1 -- 172.21.15.44:0/2650731396 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7fe6f80efd80 con 0x7fe704102250 2024-08-19T00:11:19.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:18.988+0000 7fe7037fe640 1 --2- 172.21.15.44:0/2650731396 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fe6ec0a2b80 0x7fe6ec0a5040 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe6f4009990 tx=0x7fe6f4009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:19.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:18.991+0000 7fe700ff9640 1 -- 172.21.15.44:0/2650731396 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fe6f80bcaa0 con 0x7fe704102250 2024-08-19T00:11:19.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:19.178+0000 7fe709a96640 1 -- 172.21.15.44:0/2650731396 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe704109e70 con 0x7fe704102250 2024-08-19T00:11:19.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:19.179+0000 7fe700ff9640 1 -- 172.21.15.44:0/2650731396 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v90) ==== 81+0+590 (secure 0 0 0) 0x7fe6f80bc3a0 con 0x7fe704102250 2024-08-19T00:11:19.180 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6800/1300308907 2024-08-20T00:04:38.392912+0000 2024-08-19T00:11:19.180 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:0/1001446555 2024-08-20T00:04:38.392912+0000 2024-08-19T00:11:19.181 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:0/3800526625 2024-08-20T00:04:38.392912+0000 2024-08-19T00:11:19.181 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6801/1300308907 2024-08-20T00:04:38.392912+0000 2024-08-19T00:11:19.181 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:0/3096491642 2024-08-20T00:04:14.604141+0000 2024-08-19T00:11:19.181 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:0/400419582 2024-08-20T00:04:38.392912+0000 2024-08-19T00:11:19.181 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:0/1869412718 2024-08-20T00:04:14.604141+0000 2024-08-19T00:11:19.181 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6801/1374527587 2024-08-20T00:04:14.604141+0000 2024-08-19T00:11:19.181 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:0/911382683 2024-08-20T00:04:14.604141+0000 2024-08-19T00:11:19.181 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6800/1374527587 2024-08-20T00:04:14.604141+0000 2024-08-19T00:11:19.181 INFO:teuthology.orchestra.run.smithi044.stderr:listed 10 entries 2024-08-19T00:11:19.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:19.181+0000 7fe709a96640 1 -- 172.21.15.44:0/2650731396 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fe6ec0a2b80 msgr2=0x7fe6ec0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:19.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:19.181+0000 7fe709a96640 1 --2- 172.21.15.44:0/2650731396 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fe6ec0a2b80 0x7fe6ec0a5040 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe6f4009990 tx=0x7fe6f4009110 comp rx=0 tx=0).stop 2024-08-19T00:11:19.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:19.181+0000 7fe709a96640 1 -- 172.21.15.44:0/2650731396 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe704102250 msgr2=0x7fe704198850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:19.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:19.181+0000 7fe709a96640 1 --2- 172.21.15.44:0/2650731396 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe704102250 0x7fe704198850 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe6f8009a50 tx=0x7fe6f8004270 comp rx=0 tx=0).stop 2024-08-19T00:11:19.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:19.181+0000 7fe709a96640 1 -- 172.21.15.44:0/2650731396 shutdown_connections 2024-08-19T00:11:19.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:19.181+0000 7fe709a96640 1 --2- 172.21.15.44:0/2650731396 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fe6ec0a2b80 0x7fe6ec0a5040 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:19.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:19.181+0000 7fe709a96640 1 --2- 172.21.15.44:0/2650731396 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7041078b0 0x7fe70419cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:19.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:19.181+0000 7fe709a96640 1 --2- 172.21.15.44:0/2650731396 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe704102250 0x7fe704198850 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:19.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:19.181+0000 7fe709a96640 1 --2- 172.21.15.44:0/2650731396 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe7041018b0 0x7fe704198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:19.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:19.181+0000 7fe709a96640 1 -- 172.21.15.44:0/2650731396 >> 172.21.15.44:0/2650731396 conn(0x7fe7040fd5f0 msgr2=0x7fe7040fdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:19.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:19.181+0000 7fe709a96640 1 -- 172.21.15.44:0/2650731396 shutdown_connections 2024-08-19T00:11:19.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:19.181+0000 7fe709a96640 1 -- 172.21.15.44:0/2650731396 wait complete. 2024-08-19T00:11:19.816 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi044.front.sepia.ceph.com... 2024-08-19T00:11:19.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:11:19.817 DEBUG:teuthology.orchestra.run.smithi044:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-08-19T00:11:19.843 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi044.stderr:ceph-fuse[62447]: fuse finished with error 0 and tester_r 0 2024-08-19T00:11:19.845 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T00:11:20.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:19 smithi171 ceph-mon[21810]: pgmap v280: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:11:20.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:19 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/2650731396' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-08-19T00:11:20.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:19 smithi116 ceph-mon[21873]: pgmap v280: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:11:20.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:19 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/2650731396' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-08-19T00:11:20.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:19 smithi044 ceph-mon[18489]: pgmap v280: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:11:20.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:19 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/2650731396' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-08-19T00:11:22.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:21 smithi171 ceph-mon[21810]: pgmap v281: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-19T00:11:22.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:21 smithi116 ceph-mon[21873]: pgmap v281: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-19T00:11:22.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:21 smithi044 ceph-mon[18489]: pgmap v281: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-19T00:11:24.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:23 smithi171 ceph-mon[21810]: pgmap v282: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-19T00:11:24.101 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:23 smithi116 ceph-mon[21873]: pgmap v282: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-19T00:11:24.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:23 smithi044 ceph-mon[18489]: pgmap v282: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-19T00:11:25.946 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2024-08-19T00:11:25.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:11:25.947 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-08-19T00:11:25.975 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-19T00:11:26.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:25 smithi171 ceph-mon[21810]: pgmap v283: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-19T00:11:26.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:25 smithi116 ceph-mon[21873]: pgmap v283: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-19T00:11:26.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:25 smithi044 ceph-mon[18489]: pgmap v283: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-19T00:11:26.287 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:11:26.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:26.869+0000 7efd398c3640 1 -- 172.21.15.44:0/2841365790 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd34101150 msgr2=0x7efd3410d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:26.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:26.869+0000 7efd398c3640 1 --2- 172.21.15.44:0/2841365790 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd34101150 0x7efd3410d680 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7efd2c009cd0 tx=0x7efd2c02a8e0 comp rx=0 tx=0).stop 2024-08-19T00:11:26.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:26.869+0000 7efd398c3640 1 -- 172.21.15.44:0/2841365790 shutdown_connections 2024-08-19T00:11:26.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:26.869+0000 7efd398c3640 1 --2- 172.21.15.44:0/2841365790 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd34101150 0x7efd3410d680 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:26.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:26.869+0000 7efd398c3640 1 --2- 172.21.15.44:0/2841365790 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efd341007b0 0x7efd34100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:26.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:26.869+0000 7efd398c3640 1 --2- 172.21.15.44:0/2841365790 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd341067b0 0x7efd34106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:26.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:26.869+0000 7efd398c3640 1 -- 172.21.15.44:0/2841365790 >> 172.21.15.44:0/2841365790 conn(0x7efd340fc4d0 msgr2=0x7efd340fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:26.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:26.869+0000 7efd398c3640 1 -- 172.21.15.44:0/2841365790 shutdown_connections 2024-08-19T00:11:26.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:26.869+0000 7efd398c3640 1 -- 172.21.15.44:0/2841365790 wait complete. 2024-08-19T00:11:26.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:26.870+0000 7efd398c3640 1 Processor -- start 2024-08-19T00:11:26.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:26.870+0000 7efd398c3640 1 -- start start 2024-08-19T00:11:26.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:26.870+0000 7efd398c3640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efd341007b0 0x7efd341970b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:26.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:26.870+0000 7efd398c3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd34101150 0x7efd341975f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:26.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:26.870+0000 7efd398c3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd341067b0 0x7efd3419b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:26.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:26.870+0000 7efd398c3640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7efd34110bd0 con 0x7efd341067b0 2024-08-19T00:11:26.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:26.870+0000 7efd398c3640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7efd34110a50 con 0x7efd341007b0 2024-08-19T00:11:26.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:26.870+0000 7efd398c3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7efd34110d50 con 0x7efd34101150 2024-08-19T00:11:26.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:26.871+0000 7efd337fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd341067b0 0x7efd3419b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:26.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:26.871+0000 7efd337fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd341067b0 0x7efd3419b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45334/0 (socket says 172.21.15.44:45334) 2024-08-19T00:11:26.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:26.871+0000 7efd337fe640 1 -- 172.21.15.44:0/3636255010 learned_addr learned my addr 172.21.15.44:0/3636255010 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:11:26.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:26.871+0000 7efd32ffd640 1 --2- 172.21.15.44:0/3636255010 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efd341007b0 0x7efd341970b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:26.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:26.871+0000 7efd327fc640 1 --2- 172.21.15.44:0/3636255010 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd34101150 0x7efd341975f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:26.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:26.871+0000 7efd337fe640 1 -- 172.21.15.44:0/3636255010 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd34101150 msgr2=0x7efd341975f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:26.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:26.871+0000 7efd337fe640 1 --2- 172.21.15.44:0/3636255010 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd34101150 0x7efd341975f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:26.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:26.871+0000 7efd337fe640 1 -- 172.21.15.44:0/3636255010 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efd341007b0 msgr2=0x7efd341970b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:26.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:26.871+0000 7efd337fe640 1 --2- 172.21.15.44:0/3636255010 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efd341007b0 0x7efd341970b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:26.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:26.871+0000 7efd337fe640 1 -- 172.21.15.44:0/3636255010 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd3419c060 con 0x7efd341067b0 2024-08-19T00:11:26.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:26.871+0000 7efd32ffd640 1 --2- 172.21.15.44:0/3636255010 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efd341007b0 0x7efd341970b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:11:26.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:26.871+0000 7efd327fc640 1 --2- 172.21.15.44:0/3636255010 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd34101150 0x7efd341975f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:11:26.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:26.871+0000 7efd337fe640 1 --2- 172.21.15.44:0/3636255010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd341067b0 0x7efd3419b980 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7efd2c006010 tx=0x7efd2c003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:26.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:26.871+0000 7efd388c1640 1 -- 172.21.15.44:0/3636255010 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd2c04a070 con 0x7efd341067b0 2024-08-19T00:11:26.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:26.871+0000 7efd398c3640 1 -- 172.21.15.44:0/3636255010 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd3419c2f0 con 0x7efd341067b0 2024-08-19T00:11:26.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:26.871+0000 7efd388c1640 1 -- 172.21.15.44:0/3636255010 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd2c003d90 con 0x7efd341067b0 2024-08-19T00:11:26.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:26.871+0000 7efd388c1640 1 -- 172.21.15.44:0/3636255010 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd2c030b90 con 0x7efd341067b0 2024-08-19T00:11:26.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:26.871+0000 7efd398c3640 1 -- 172.21.15.44:0/3636255010 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd3406a4c0 con 0x7efd341067b0 2024-08-19T00:11:26.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:26.872+0000 7efd398c3640 1 -- 172.21.15.44:0/3636255010 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd34101ef0 con 0x7efd341067b0 2024-08-19T00:11:26.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:26.873+0000 7efd388c1640 1 -- 172.21.15.44:0/3636255010 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7efd2c0046b0 con 0x7efd341067b0 2024-08-19T00:11:26.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:26.874+0000 7efd388c1640 1 --2- 172.21.15.44:0/3636255010 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7efd200a2b80 0x7efd200a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:26.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:26.874+0000 7efd388c1640 1 -- 172.21.15.44:0/3636255010 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7efd2c02e020 con 0x7efd341067b0 2024-08-19T00:11:26.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:26.874+0000 7efd32ffd640 1 --2- 172.21.15.44:0/3636255010 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7efd200a2b80 0x7efd200a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:26.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:26.875+0000 7efd32ffd640 1 --2- 172.21.15.44:0/3636255010 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7efd200a2b80 0x7efd200a5040 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7efd24009930 tx=0x7efd24008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:26.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:26.878+0000 7efd388c1640 1 -- 172.21.15.44:0/3636255010 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7efd2c080df0 con 0x7efd341067b0 2024-08-19T00:11:27.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:27.054+0000 7efd398c3640 1 -- 172.21.15.44:0/3636255010 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efd3406a720 con 0x7efd341067b0 2024-08-19T00:11:27.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:27.056+0000 7efd388c1640 1 -- 172.21.15.44:0/3636255010 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+24116 (secure 0 0 0) 0x7efd2c0be610 con 0x7efd341067b0 2024-08-19T00:11:27.057 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:11:27.058 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":90,"fsid":"647ded64-5dbe-11ef-bccf-c7b262605968","created":"2024-08-19T00:03:43.667929+0000","modified":"2024-08-19T00:11:02.452177+0000","last_up_change":"2024-08-19T00:10:01.557590+0000","last_in_change":"2024-08-19T00:09:42.433933+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T00:06:42.706553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-19T00:10:48.735065+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-19T00:10:51.481810+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-19T00:10:58.013004+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b15ad904-d07d-4ecb-be8f-d99323425eed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":600251465},{"type":"v1","addr":"172.21.15.44:6803","nonce":600251465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":600251465},{"type":"v1","addr":"172.21.15.44:6805","nonce":600251465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":600251465},{"type":"v1","addr":"172.21.15.44:6809","nonce":600251465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":600251465},{"type":"v1","addr":"172.21.15.44:6807","nonce":600251465}]},"public_addr":"172.21.15.44:6803/600251465","cluster_addr":"172.21.15.44:6805/600251465","heartbeat_back_addr":"172.21.15.44:6809/600251465","heartbeat_front_addr":"172.21.15.44:6807/600251465","state":["exists","up"]},{"osd":1,"uuid":"8f70512f-21a3-4fec-8278-04b2bc9b2d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":613509556},{"type":"v1","addr":"172.21.15.116:6801","nonce":613509556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":613509556},{"type":"v1","addr":"172.21.15.116:6803","nonce":613509556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":613509556},{"type":"v1","addr":"172.21.15.116:6807","nonce":613509556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":613509556},{"type":"v1","addr":"172.21.15.116:6805","nonce":613509556}]},"public_addr":"172.21.15.116:6801/613509556","cluster_addr":"172.21.15.116:6803/613509556","heartbeat_back_addr":"172.21.15.116:6807/613509556","heartbeat_front_addr":"172.21.15.116:6805/613509556","state":["exists","up"]},{"osd":2,"uuid":"56994dfd-5fcf-4d82-addf-38764239d82a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2130938937},{"type":"v1","addr":"172.21.15.171:6801","nonce":2130938937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2130938937},{"type":"v1","addr":"172.21.15.171:6803","nonce":2130938937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2130938937},{"type":"v1","addr":"172.21.15.171:6807","nonce":2130938937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2130938937},{"type":"v1","addr":"172.21.15.171:6805","nonce":2130938937}]},"public_addr":"172.21.15.171:6801/2130938937","cluster_addr":"172.21.15.171:6803/2130938937","heartbeat_back_addr":"172.21.15.171:6807/2130938937","heartbeat_front_addr":"172.21.15.171:6805/2130938937","state":["exists","up"]},{"osd":3,"uuid":"6d2ddb19-74e0-4e68-b9ea-58b73fd1e9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":3537027669},{"type":"v1","addr":"172.21.15.44:6811","nonce":3537027669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":3537027669},{"type":"v1","addr":"172.21.15.44:6813","nonce":3537027669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3537027669},{"type":"v1","addr":"172.21.15.44:6817","nonce":3537027669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":3537027669},{"type":"v1","addr":"172.21.15.44:6815","nonce":3537027669}]},"public_addr":"172.21.15.44:6811/3537027669","cluster_addr":"172.21.15.44:6813/3537027669","heartbeat_back_addr":"172.21.15.44:6817/3537027669","heartbeat_front_addr":"172.21.15.44:6815/3537027669","state":["exists","up"]},{"osd":4,"uuid":"190d208e-ae54-497d-ad72-d07a5a26991b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":3768627455},{"type":"v1","addr":"172.21.15.116:6809","nonce":3768627455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":3768627455},{"type":"v1","addr":"172.21.15.116:6811","nonce":3768627455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":3768627455},{"type":"v1","addr":"172.21.15.116:6815","nonce":3768627455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":3768627455},{"type":"v1","addr":"172.21.15.116:6813","nonce":3768627455}]},"public_addr":"172.21.15.116:6809/3768627455","cluster_addr":"172.21.15.116:6811/3768627455","heartbeat_back_addr":"172.21.15.116:6815/3768627455","heartbeat_front_addr":"172.21.15.116:6813/3768627455","state":["exists","up"]},{"osd":5,"uuid":"d8afacad-6d3d-4703-9744-8d01ff2a2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":938785018},{"type":"v1","addr":"172.21.15.171:6809","nonce":938785018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":938785018},{"type":"v1","addr":"172.21.15.171:6811","nonce":938785018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":938785018},{"type":"v1","addr":"172.21.15.171:6815","nonce":938785018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":938785018},{"type":"v1","addr":"172.21.15.171:6813","nonce":938785018}]},"public_addr":"172.21.15.171:6809/938785018","cluster_addr":"172.21.15.171:6811/938785018","heartbeat_back_addr":"172.21.15.171:6815/938785018","heartbeat_front_addr":"172.21.15.171:6813/938785018","state":["exists","up"]},{"osd":6,"uuid":"55bf1f89-99e5-409d-99fa-f0124aa042df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":1219334797},{"type":"v1","addr":"172.21.15.44:6819","nonce":1219334797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":1219334797},{"type":"v1","addr":"172.21.15.44:6821","nonce":1219334797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":1219334797},{"type":"v1","addr":"172.21.15.44:6825","nonce":1219334797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":1219334797},{"type":"v1","addr":"172.21.15.44:6823","nonce":1219334797}]},"public_addr":"172.21.15.44:6819/1219334797","cluster_addr":"172.21.15.44:6821/1219334797","heartbeat_back_addr":"172.21.15.44:6825/1219334797","heartbeat_front_addr":"172.21.15.44:6823/1219334797","state":["exists","up"]},{"osd":7,"uuid":"70130d71-d28c-4a58-b603-75610c8d3ea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":3861873415},{"type":"v1","addr":"172.21.15.116:6817","nonce":3861873415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":3861873415},{"type":"v1","addr":"172.21.15.116:6819","nonce":3861873415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":3861873415},{"type":"v1","addr":"172.21.15.116:6823","nonce":3861873415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":3861873415},{"type":"v1","addr":"172.21.15.116:6821","nonce":3861873415}]},"public_addr":"172.21.15.116:6817/3861873415","cluster_addr":"172.21.15.116:6819/3861873415","heartbeat_back_addr":"172.21.15.116:6823/3861873415","heartbeat_front_addr":"172.21.15.116:6821/3861873415","state":["exists","up"]},{"osd":8,"uuid":"c5121f70-e423-4f86-a3c6-90945c9385f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":843701060},{"type":"v1","addr":"172.21.15.171:6817","nonce":843701060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":843701060},{"type":"v1","addr":"172.21.15.171:6819","nonce":843701060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":843701060},{"type":"v1","addr":"172.21.15.171:6823","nonce":843701060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":843701060},{"type":"v1","addr":"172.21.15.171:6821","nonce":843701060}]},"public_addr":"172.21.15.171:6817/843701060","cluster_addr":"172.21.15.171:6819/843701060","heartbeat_back_addr":"172.21.15.171:6823/843701060","heartbeat_front_addr":"172.21.15.171:6821/843701060","state":["exists","up"]},{"osd":9,"uuid":"cd13693a-0f25-47cc-b1a5-9c42481935ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3206550013},{"type":"v1","addr":"172.21.15.44:6827","nonce":3206550013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":3206550013},{"type":"v1","addr":"172.21.15.44:6829","nonce":3206550013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3206550013},{"type":"v1","addr":"172.21.15.44:6833","nonce":3206550013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3206550013},{"type":"v1","addr":"172.21.15.44:6831","nonce":3206550013}]},"public_addr":"172.21.15.44:6827/3206550013","cluster_addr":"172.21.15.44:6829/3206550013","heartbeat_back_addr":"172.21.15.44:6833/3206550013","heartbeat_front_addr":"172.21.15.44:6831/3206550013","state":["exists","up"]},{"osd":10,"uuid":"a36ffeb1-6ecf-4899-bdfa-18515afefb86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3034738363},{"type":"v1","addr":"172.21.15.116:6825","nonce":3034738363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3034738363},{"type":"v1","addr":"172.21.15.116:6827","nonce":3034738363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3034738363},{"type":"v1","addr":"172.21.15.116:6831","nonce":3034738363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3034738363},{"type":"v1","addr":"172.21.15.116:6829","nonce":3034738363}]},"public_addr":"172.21.15.116:6825/3034738363","cluster_addr":"172.21.15.116:6827/3034738363","heartbeat_back_addr":"172.21.15.116:6831/3034738363","heartbeat_front_addr":"172.21.15.116:6829/3034738363","state":["exists","up"]},{"osd":11,"uuid":"ffcf44a8-3094-4a29-822e-a6ce95da119e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1500842656},{"type":"v1","addr":"172.21.15.171:6825","nonce":1500842656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1500842656},{"type":"v1","addr":"172.21.15.171:6827","nonce":1500842656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1500842656},{"type":"v1","addr":"172.21.15.171:6831","nonce":1500842656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1500842656},{"type":"v1","addr":"172.21.15.171:6829","nonce":1500842656}]},"public_addr":"172.21.15.171:6825/1500842656","cluster_addr":"172.21.15.171:6827/1500842656","heartbeat_back_addr":"172.21.15.171:6831/1500842656","heartbeat_front_addr":"172.21.15.171:6829/1500842656","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:05:56.916127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:06:17.603805+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:06:38.642970+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:07:00.667062+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:07:22.542529+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:07:44.732304+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:08:07.050742+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:08:29.451498+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:08:52.222169+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:09:15.422629+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:09:37.295311+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:09:59.716431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6800/1300308907":"2024-08-20T00:04:38.392912+0000","172.21.15.44:0/1001446555":"2024-08-20T00:04:38.392912+0000","172.21.15.44:0/3800526625":"2024-08-20T00:04:38.392912+0000","172.21.15.44:6801/1300308907":"2024-08-20T00:04:38.392912+0000","172.21.15.44:0/3096491642":"2024-08-20T00:04:14.604141+0000","172.21.15.44:0/400419582":"2024-08-20T00:04:38.392912+0000","172.21.15.44:0/1869412718":"2024-08-20T00:04:14.604141+0000","172.21.15.44:6801/1374527587":"2024-08-20T00:04:14.604141+0000","172.21.15.44:0/911382683":"2024-08-20T00:04:14.604141+0000","172.21.15.44:6800/1374527587":"2024-08-20T00:04:14.604141+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:11:27.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:27.058+0000 7efd398c3640 1 -- 172.21.15.44:0/3636255010 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7efd200a2b80 msgr2=0x7efd200a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:27.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:27.058+0000 7efd398c3640 1 --2- 172.21.15.44:0/3636255010 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7efd200a2b80 0x7efd200a5040 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7efd24009930 tx=0x7efd24008040 comp rx=0 tx=0).stop 2024-08-19T00:11:27.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:27.058+0000 7efd398c3640 1 -- 172.21.15.44:0/3636255010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd341067b0 msgr2=0x7efd3419b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:27.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:27.058+0000 7efd398c3640 1 --2- 172.21.15.44:0/3636255010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd341067b0 0x7efd3419b980 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7efd2c006010 tx=0x7efd2c003ba0 comp rx=0 tx=0).stop 2024-08-19T00:11:27.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:27.058+0000 7efd398c3640 1 -- 172.21.15.44:0/3636255010 shutdown_connections 2024-08-19T00:11:27.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:27.058+0000 7efd398c3640 1 --2- 172.21.15.44:0/3636255010 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7efd200a2b80 0x7efd200a5040 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:27.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:27.058+0000 7efd398c3640 1 --2- 172.21.15.44:0/3636255010 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd34101150 0x7efd341975f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:27.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:27.058+0000 7efd398c3640 1 --2- 172.21.15.44:0/3636255010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd341067b0 0x7efd3419b980 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:27.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:27.058+0000 7efd398c3640 1 --2- 172.21.15.44:0/3636255010 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efd341007b0 0x7efd341970b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:27.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:27.058+0000 7efd398c3640 1 -- 172.21.15.44:0/3636255010 >> 172.21.15.44:0/3636255010 conn(0x7efd340fc4d0 msgr2=0x7efd340fcbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:27.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:27.058+0000 7efd398c3640 1 -- 172.21.15.44:0/3636255010 shutdown_connections 2024-08-19T00:11:27.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:27.058+0000 7efd398c3640 1 -- 172.21.15.44:0/3636255010 wait complete. 2024-08-19T00:11:27.708 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-19T00:11:27.969 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:11:28.091 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:27 smithi044 ceph-mon[18489]: pgmap v284: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-19T00:11:28.091 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:27 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/3636255010' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-19T00:11:28.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:27 smithi171 ceph-mon[21810]: pgmap v284: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-19T00:11:28.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:27 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/3636255010' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-19T00:11:28.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:27 smithi116 ceph-mon[21873]: pgmap v284: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-19T00:11:28.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:27 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/3636255010' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-19T00:11:28.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:28.442+0000 7fdb916c7640 1 -- 172.21.15.44:0/612045534 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb8c102250 msgr2=0x7fdb8c10e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:28.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:28.442+0000 7fdb916c7640 1 --2- 172.21.15.44:0/612045534 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb8c102250 0x7fdb8c10e780 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fdb84009cd0 tx=0x7fdb8402a8e0 comp rx=0 tx=0).stop 2024-08-19T00:11:28.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:28.442+0000 7fdb916c7640 1 -- 172.21.15.44:0/612045534 shutdown_connections 2024-08-19T00:11:28.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:28.442+0000 7fdb916c7640 1 --2- 172.21.15.44:0/612045534 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdb8c1018b0 0x7fdb8c101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:28.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:28.442+0000 7fdb916c7640 1 --2- 172.21.15.44:0/612045534 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb8c102250 0x7fdb8c10e780 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:28.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:28.442+0000 7fdb916c7640 1 --2- 172.21.15.44:0/612045534 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdb8c1078b0 0x7fdb8c107c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:28.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:28.442+0000 7fdb916c7640 1 -- 172.21.15.44:0/612045534 >> 172.21.15.44:0/612045534 conn(0x7fdb8c0fd5f0 msgr2=0x7fdb8c0ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:28.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:28.442+0000 7fdb916c7640 1 -- 172.21.15.44:0/612045534 shutdown_connections 2024-08-19T00:11:28.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:28.443+0000 7fdb916c7640 1 -- 172.21.15.44:0/612045534 wait complete. 2024-08-19T00:11:28.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:28.443+0000 7fdb916c7640 1 Processor -- start 2024-08-19T00:11:28.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:28.443+0000 7fdb916c7640 1 -- start start 2024-08-19T00:11:28.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:28.444+0000 7fdb916c7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb8c1018b0 0x7fdb8c19a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:28.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:28.444+0000 7fdb916c7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdb8c102250 0x7fdb8c19a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:28.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:28.444+0000 7fdb916c7640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdb8c1078b0 0x7fdb8c19ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:28.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:28.444+0000 7fdb916c7640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdb8c111cb0 con 0x7fdb8c1018b0 2024-08-19T00:11:28.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:28.444+0000 7fdb916c7640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fdb8c111b30 con 0x7fdb8c102250 2024-08-19T00:11:28.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:28.444+0000 7fdb916c7640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fdb8c111e30 con 0x7fdb8c1078b0 2024-08-19T00:11:28.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:28.444+0000 7fdb8affd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb8c1018b0 0x7fdb8c19a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:28.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:28.444+0000 7fdb8affd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb8c1018b0 0x7fdb8c19a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45344/0 (socket says 172.21.15.44:45344) 2024-08-19T00:11:28.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:28.444+0000 7fdb8affd640 1 -- 172.21.15.44:0/773197069 learned_addr learned my addr 172.21.15.44:0/773197069 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:11:28.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:28.444+0000 7fdb8b7fe640 1 --2- 172.21.15.44:0/773197069 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdb8c1078b0 0x7fdb8c19ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:28.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:28.444+0000 7fdb8a7fc640 1 --2- 172.21.15.44:0/773197069 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdb8c102250 0x7fdb8c19a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:28.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:28.444+0000 7fdb8affd640 1 -- 172.21.15.44:0/773197069 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdb8c1078b0 msgr2=0x7fdb8c19ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:28.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:28.444+0000 7fdb8affd640 1 --2- 172.21.15.44:0/773197069 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdb8c1078b0 0x7fdb8c19ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:28.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:28.444+0000 7fdb8affd640 1 -- 172.21.15.44:0/773197069 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdb8c102250 msgr2=0x7fdb8c19a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:28.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:28.444+0000 7fdb8affd640 1 --2- 172.21.15.44:0/773197069 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdb8c102250 0x7fdb8c19a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:28.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:28.444+0000 7fdb8affd640 1 -- 172.21.15.44:0/773197069 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb8c19f340 con 0x7fdb8c1018b0 2024-08-19T00:11:28.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:28.444+0000 7fdb8affd640 1 --2- 172.21.15.44:0/773197069 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb8c1018b0 0x7fdb8c19a390 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c00d950 tx=0x7fdb7c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:28.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:28.445+0000 7fdb73fff640 1 -- 172.21.15.44:0/773197069 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c017030 con 0x7fdb8c1018b0 2024-08-19T00:11:28.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:28.445+0000 7fdb73fff640 1 -- 172.21.15.44:0/773197069 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb7c004020 con 0x7fdb8c1018b0 2024-08-19T00:11:28.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:28.445+0000 7fdb916c7640 1 -- 172.21.15.44:0/773197069 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb8c19f630 con 0x7fdb8c1018b0 2024-08-19T00:11:28.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:28.445+0000 7fdb73fff640 1 -- 172.21.15.44:0/773197069 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c0047a0 con 0x7fdb8c1018b0 2024-08-19T00:11:28.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:28.445+0000 7fdb916c7640 1 -- 172.21.15.44:0/773197069 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb8c1a6f10 con 0x7fdb8c1018b0 2024-08-19T00:11:28.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:28.446+0000 7fdb916c7640 1 -- 172.21.15.44:0/773197069 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb8c101d10 con 0x7fdb8c1018b0 2024-08-19T00:11:28.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:28.447+0000 7fdb73fff640 1 -- 172.21.15.44:0/773197069 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fdb7c0041d0 con 0x7fdb8c1018b0 2024-08-19T00:11:28.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:28.448+0000 7fdb73fff640 1 --2- 172.21.15.44:0/773197069 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fdb740a2b80 0x7fdb740a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:28.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:28.448+0000 7fdb8a7fc640 1 --2- 172.21.15.44:0/773197069 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fdb740a2b80 0x7fdb740a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:28.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:28.448+0000 7fdb73fff640 1 -- 172.21.15.44:0/773197069 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7fdb7c0cf2d0 con 0x7fdb8c1018b0 2024-08-19T00:11:28.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:28.448+0000 7fdb8a7fc640 1 --2- 172.21.15.44:0/773197069 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fdb740a2b80 0x7fdb740a5040 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdb80005fd0 tx=0x7fdb80005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:28.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:28.451+0000 7fdb73fff640 1 -- 172.21.15.44:0/773197069 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fdb7c09bf90 con 0x7fdb8c1018b0 2024-08-19T00:11:28.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:28.629+0000 7fdb916c7640 1 -- 172.21.15.44:0/773197069 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdb8c1a7170 con 0x7fdb8c1018b0 2024-08-19T00:11:28.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:28.630+0000 7fdb73fff640 1 -- 172.21.15.44:0/773197069 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+24116 (secure 0 0 0) 0x7fdb7c09b890 con 0x7fdb8c1018b0 2024-08-19T00:11:28.632 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:11:28.632 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":90,"fsid":"647ded64-5dbe-11ef-bccf-c7b262605968","created":"2024-08-19T00:03:43.667929+0000","modified":"2024-08-19T00:11:02.452177+0000","last_up_change":"2024-08-19T00:10:01.557590+0000","last_in_change":"2024-08-19T00:09:42.433933+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T00:06:42.706553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-19T00:10:48.735065+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-19T00:10:51.481810+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-19T00:10:58.013004+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b15ad904-d07d-4ecb-be8f-d99323425eed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":600251465},{"type":"v1","addr":"172.21.15.44:6803","nonce":600251465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":600251465},{"type":"v1","addr":"172.21.15.44:6805","nonce":600251465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":600251465},{"type":"v1","addr":"172.21.15.44:6809","nonce":600251465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":600251465},{"type":"v1","addr":"172.21.15.44:6807","nonce":600251465}]},"public_addr":"172.21.15.44:6803/600251465","cluster_addr":"172.21.15.44:6805/600251465","heartbeat_back_addr":"172.21.15.44:6809/600251465","heartbeat_front_addr":"172.21.15.44:6807/600251465","state":["exists","up"]},{"osd":1,"uuid":"8f70512f-21a3-4fec-8278-04b2bc9b2d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":613509556},{"type":"v1","addr":"172.21.15.116:6801","nonce":613509556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":613509556},{"type":"v1","addr":"172.21.15.116:6803","nonce":613509556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":613509556},{"type":"v1","addr":"172.21.15.116:6807","nonce":613509556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":613509556},{"type":"v1","addr":"172.21.15.116:6805","nonce":613509556}]},"public_addr":"172.21.15.116:6801/613509556","cluster_addr":"172.21.15.116:6803/613509556","heartbeat_back_addr":"172.21.15.116:6807/613509556","heartbeat_front_addr":"172.21.15.116:6805/613509556","state":["exists","up"]},{"osd":2,"uuid":"56994dfd-5fcf-4d82-addf-38764239d82a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2130938937},{"type":"v1","addr":"172.21.15.171:6801","nonce":2130938937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2130938937},{"type":"v1","addr":"172.21.15.171:6803","nonce":2130938937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2130938937},{"type":"v1","addr":"172.21.15.171:6807","nonce":2130938937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2130938937},{"type":"v1","addr":"172.21.15.171:6805","nonce":2130938937}]},"public_addr":"172.21.15.171:6801/2130938937","cluster_addr":"172.21.15.171:6803/2130938937","heartbeat_back_addr":"172.21.15.171:6807/2130938937","heartbeat_front_addr":"172.21.15.171:6805/2130938937","state":["exists","up"]},{"osd":3,"uuid":"6d2ddb19-74e0-4e68-b9ea-58b73fd1e9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":3537027669},{"type":"v1","addr":"172.21.15.44:6811","nonce":3537027669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":3537027669},{"type":"v1","addr":"172.21.15.44:6813","nonce":3537027669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3537027669},{"type":"v1","addr":"172.21.15.44:6817","nonce":3537027669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":3537027669},{"type":"v1","addr":"172.21.15.44:6815","nonce":3537027669}]},"public_addr":"172.21.15.44:6811/3537027669","cluster_addr":"172.21.15.44:6813/3537027669","heartbeat_back_addr":"172.21.15.44:6817/3537027669","heartbeat_front_addr":"172.21.15.44:6815/3537027669","state":["exists","up"]},{"osd":4,"uuid":"190d208e-ae54-497d-ad72-d07a5a26991b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":3768627455},{"type":"v1","addr":"172.21.15.116:6809","nonce":3768627455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":3768627455},{"type":"v1","addr":"172.21.15.116:6811","nonce":3768627455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":3768627455},{"type":"v1","addr":"172.21.15.116:6815","nonce":3768627455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":3768627455},{"type":"v1","addr":"172.21.15.116:6813","nonce":3768627455}]},"public_addr":"172.21.15.116:6809/3768627455","cluster_addr":"172.21.15.116:6811/3768627455","heartbeat_back_addr":"172.21.15.116:6815/3768627455","heartbeat_front_addr":"172.21.15.116:6813/3768627455","state":["exists","up"]},{"osd":5,"uuid":"d8afacad-6d3d-4703-9744-8d01ff2a2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":938785018},{"type":"v1","addr":"172.21.15.171:6809","nonce":938785018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":938785018},{"type":"v1","addr":"172.21.15.171:6811","nonce":938785018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":938785018},{"type":"v1","addr":"172.21.15.171:6815","nonce":938785018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":938785018},{"type":"v1","addr":"172.21.15.171:6813","nonce":938785018}]},"public_addr":"172.21.15.171:6809/938785018","cluster_addr":"172.21.15.171:6811/938785018","heartbeat_back_addr":"172.21.15.171:6815/938785018","heartbeat_front_addr":"172.21.15.171:6813/938785018","state":["exists","up"]},{"osd":6,"uuid":"55bf1f89-99e5-409d-99fa-f0124aa042df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":1219334797},{"type":"v1","addr":"172.21.15.44:6819","nonce":1219334797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":1219334797},{"type":"v1","addr":"172.21.15.44:6821","nonce":1219334797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":1219334797},{"type":"v1","addr":"172.21.15.44:6825","nonce":1219334797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":1219334797},{"type":"v1","addr":"172.21.15.44:6823","nonce":1219334797}]},"public_addr":"172.21.15.44:6819/1219334797","cluster_addr":"172.21.15.44:6821/1219334797","heartbeat_back_addr":"172.21.15.44:6825/1219334797","heartbeat_front_addr":"172.21.15.44:6823/1219334797","state":["exists","up"]},{"osd":7,"uuid":"70130d71-d28c-4a58-b603-75610c8d3ea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":3861873415},{"type":"v1","addr":"172.21.15.116:6817","nonce":3861873415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":3861873415},{"type":"v1","addr":"172.21.15.116:6819","nonce":3861873415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":3861873415},{"type":"v1","addr":"172.21.15.116:6823","nonce":3861873415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":3861873415},{"type":"v1","addr":"172.21.15.116:6821","nonce":3861873415}]},"public_addr":"172.21.15.116:6817/3861873415","cluster_addr":"172.21.15.116:6819/3861873415","heartbeat_back_addr":"172.21.15.116:6823/3861873415","heartbeat_front_addr":"172.21.15.116:6821/3861873415","state":["exists","up"]},{"osd":8,"uuid":"c5121f70-e423-4f86-a3c6-90945c9385f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":843701060},{"type":"v1","addr":"172.21.15.171:6817","nonce":843701060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":843701060},{"type":"v1","addr":"172.21.15.171:6819","nonce":843701060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":843701060},{"type":"v1","addr":"172.21.15.171:6823","nonce":843701060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":843701060},{"type":"v1","addr":"172.21.15.171:6821","nonce":843701060}]},"public_addr":"172.21.15.171:6817/843701060","cluster_addr":"172.21.15.171:6819/843701060","heartbeat_back_addr":"172.21.15.171:6823/843701060","heartbeat_front_addr":"172.21.15.171:6821/843701060","state":["exists","up"]},{"osd":9,"uuid":"cd13693a-0f25-47cc-b1a5-9c42481935ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3206550013},{"type":"v1","addr":"172.21.15.44:6827","nonce":3206550013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":3206550013},{"type":"v1","addr":"172.21.15.44:6829","nonce":3206550013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3206550013},{"type":"v1","addr":"172.21.15.44:6833","nonce":3206550013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3206550013},{"type":"v1","addr":"172.21.15.44:6831","nonce":3206550013}]},"public_addr":"172.21.15.44:6827/3206550013","cluster_addr":"172.21.15.44:6829/3206550013","heartbeat_back_addr":"172.21.15.44:6833/3206550013","heartbeat_front_addr":"172.21.15.44:6831/3206550013","state":["exists","up"]},{"osd":10,"uuid":"a36ffeb1-6ecf-4899-bdfa-18515afefb86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3034738363},{"type":"v1","addr":"172.21.15.116:6825","nonce":3034738363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3034738363},{"type":"v1","addr":"172.21.15.116:6827","nonce":3034738363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3034738363},{"type":"v1","addr":"172.21.15.116:6831","nonce":3034738363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3034738363},{"type":"v1","addr":"172.21.15.116:6829","nonce":3034738363}]},"public_addr":"172.21.15.116:6825/3034738363","cluster_addr":"172.21.15.116:6827/3034738363","heartbeat_back_addr":"172.21.15.116:6831/3034738363","heartbeat_front_addr":"172.21.15.116:6829/3034738363","state":["exists","up"]},{"osd":11,"uuid":"ffcf44a8-3094-4a29-822e-a6ce95da119e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1500842656},{"type":"v1","addr":"172.21.15.171:6825","nonce":1500842656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1500842656},{"type":"v1","addr":"172.21.15.171:6827","nonce":1500842656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1500842656},{"type":"v1","addr":"172.21.15.171:6831","nonce":1500842656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1500842656},{"type":"v1","addr":"172.21.15.171:6829","nonce":1500842656}]},"public_addr":"172.21.15.171:6825/1500842656","cluster_addr":"172.21.15.171:6827/1500842656","heartbeat_back_addr":"172.21.15.171:6831/1500842656","heartbeat_front_addr":"172.21.15.171:6829/1500842656","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:05:56.916127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:06:17.603805+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:06:38.642970+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:07:00.667062+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:07:22.542529+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:07:44.732304+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:08:07.050742+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:08:29.451498+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:08:52.222169+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:09:15.422629+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:09:37.295311+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:09:59.716431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6800/1300308907":"2024-08-20T00:04:38.392912+0000","172.21.15.44:0/1001446555":"2024-08-20T00:04:38.392912+0000","172.21.15.44:0/3800526625":"2024-08-20T00:04:38.392912+0000","172.21.15.44:6801/1300308907":"2024-08-20T00:04:38.392912+0000","172.21.15.44:0/3096491642":"2024-08-20T00:04:14.604141+0000","172.21.15.44:0/400419582":"2024-08-20T00:04:38.392912+0000","172.21.15.44:0/1869412718":"2024-08-20T00:04:14.604141+0000","172.21.15.44:6801/1374527587":"2024-08-20T00:04:14.604141+0000","172.21.15.44:0/911382683":"2024-08-20T00:04:14.604141+0000","172.21.15.44:6800/1374527587":"2024-08-20T00:04:14.604141+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:11:28.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:28.632+0000 7fdb916c7640 1 -- 172.21.15.44:0/773197069 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fdb740a2b80 msgr2=0x7fdb740a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:28.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:28.632+0000 7fdb916c7640 1 --2- 172.21.15.44:0/773197069 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fdb740a2b80 0x7fdb740a5040 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdb80005fd0 tx=0x7fdb80005850 comp rx=0 tx=0).stop 2024-08-19T00:11:28.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:28.632+0000 7fdb916c7640 1 -- 172.21.15.44:0/773197069 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb8c1018b0 msgr2=0x7fdb8c19a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:28.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:28.632+0000 7fdb916c7640 1 --2- 172.21.15.44:0/773197069 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb8c1018b0 0x7fdb8c19a390 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c00d950 tx=0x7fdb7c00de10 comp rx=0 tx=0).stop 2024-08-19T00:11:28.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:28.632+0000 7fdb916c7640 1 -- 172.21.15.44:0/773197069 shutdown_connections 2024-08-19T00:11:28.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:28.632+0000 7fdb916c7640 1 --2- 172.21.15.44:0/773197069 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fdb740a2b80 0x7fdb740a5040 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:28.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:28.632+0000 7fdb916c7640 1 --2- 172.21.15.44:0/773197069 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdb8c1078b0 0x7fdb8c19ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:28.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:28.632+0000 7fdb916c7640 1 --2- 172.21.15.44:0/773197069 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdb8c102250 0x7fdb8c19a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:28.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:28.632+0000 7fdb916c7640 1 --2- 172.21.15.44:0/773197069 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb8c1018b0 0x7fdb8c19a390 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:28.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:28.632+0000 7fdb916c7640 1 -- 172.21.15.44:0/773197069 >> 172.21.15.44:0/773197069 conn(0x7fdb8c0fd5f0 msgr2=0x7fdb8c10cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:28.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:28.632+0000 7fdb916c7640 1 -- 172.21.15.44:0/773197069 shutdown_connections 2024-08-19T00:11:28.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:28.632+0000 7fdb916c7640 1 -- 172.21.15.44:0/773197069 wait complete. 2024-08-19T00:11:29.008 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:28 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/773197069' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-19T00:11:29.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:28 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/773197069' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-19T00:11:29.331 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-08-19T00:11:29.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:28 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/773197069' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-19T00:11:29.588 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:11:29.979 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:29 smithi044 ceph-mon[18489]: pgmap v285: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-19T00:11:30.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:30.062+0000 7fd2cc7ef640 1 -- 172.21.15.44:0/1363930238 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd2c41018b0 msgr2=0x7fd2c4101d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:30.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:30.062+0000 7fd2cc7ef640 1 --2- 172.21.15.44:0/1363930238 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd2c41018b0 0x7fd2c4101d10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4009930 tx=0x7fd2b402a420 comp rx=0 tx=0).stop 2024-08-19T00:11:30.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:30.062+0000 7fd2cc7ef640 1 -- 172.21.15.44:0/1363930238 shutdown_connections 2024-08-19T00:11:30.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:30.062+0000 7fd2cc7ef640 1 --2- 172.21.15.44:0/1363930238 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd2c4102250 0x7fd2c410e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:30.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:30.062+0000 7fd2cc7ef640 1 --2- 172.21.15.44:0/1363930238 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd2c41018b0 0x7fd2c4101d10 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:30.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:30.062+0000 7fd2cc7ef640 1 --2- 172.21.15.44:0/1363930238 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd2c41078b0 0x7fd2c4107c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:30.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:30.062+0000 7fd2cc7ef640 1 -- 172.21.15.44:0/1363930238 >> 172.21.15.44:0/1363930238 conn(0x7fd2c40fd5f0 msgr2=0x7fd2c40ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:30.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:30.062+0000 7fd2cc7ef640 1 -- 172.21.15.44:0/1363930238 shutdown_connections 2024-08-19T00:11:30.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:30.062+0000 7fd2cc7ef640 1 -- 172.21.15.44:0/1363930238 wait complete. 2024-08-19T00:11:30.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:30.063+0000 7fd2cc7ef640 1 Processor -- start 2024-08-19T00:11:30.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:30.063+0000 7fd2cc7ef640 1 -- start start 2024-08-19T00:11:30.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:30.063+0000 7fd2cc7ef640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd2c41018b0 0x7fd2c4074220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:30.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:30.063+0000 7fd2cc7ef640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd2c4102250 0x7fd2c4074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:30.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:30.063+0000 7fd2cc7ef640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd2c41078b0 0x7fd2c4074ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:30.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:30.063+0000 7fd2cc7ef640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c4111cd0 con 0x7fd2c4102250 2024-08-19T00:11:30.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:30.063+0000 7fd2cc7ef640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c4111b50 con 0x7fd2c41018b0 2024-08-19T00:11:30.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:30.063+0000 7fd2cc7ef640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c4111e50 con 0x7fd2c41078b0 2024-08-19T00:11:30.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:30.063+0000 7fd2c9d8a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd2c4102250 0x7fd2c4074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:30.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:30.063+0000 7fd2c9d8a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd2c4102250 0x7fd2c4074760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60060/0 (socket says 172.21.15.44:60060) 2024-08-19T00:11:30.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:30.063+0000 7fd2c9d8a640 1 -- 172.21.15.44:0/1998607009 learned_addr learned my addr 172.21.15.44:0/1998607009 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:11:30.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:30.063+0000 7fd2cad8c640 1 --2- 172.21.15.44:0/1998607009 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd2c41078b0 0x7fd2c4074ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:30.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:30.063+0000 7fd2ca58b640 1 --2- 172.21.15.44:0/1998607009 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd2c41018b0 0x7fd2c4074220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:30.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:30.063+0000 7fd2c9d8a640 1 -- 172.21.15.44:0/1998607009 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd2c41078b0 msgr2=0x7fd2c4074ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:30.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:30.063+0000 7fd2c9d8a640 1 --2- 172.21.15.44:0/1998607009 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd2c41078b0 0x7fd2c4074ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:30.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:30.063+0000 7fd2c9d8a640 1 -- 172.21.15.44:0/1998607009 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd2c41018b0 msgr2=0x7fd2c4074220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:30.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:30.063+0000 7fd2c9d8a640 1 --2- 172.21.15.44:0/1998607009 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd2c41018b0 0x7fd2c4074220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:30.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:30.063+0000 7fd2c9d8a640 1 -- 172.21.15.44:0/1998607009 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2c41a6650 con 0x7fd2c4102250 2024-08-19T00:11:30.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:30.063+0000 7fd2cad8c640 1 --2- 172.21.15.44:0/1998607009 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd2c41078b0 0x7fd2c4074ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:11:30.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:30.063+0000 7fd2ca58b640 1 --2- 172.21.15.44:0/1998607009 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd2c41018b0 0x7fd2c4074220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:11:30.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:30.063+0000 7fd2c9d8a640 1 --2- 172.21.15.44:0/1998607009 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd2c4102250 0x7fd2c4074760 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4009a50 tx=0x7fd2b4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:30.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:30.064+0000 7fd2bb7fe640 1 -- 172.21.15.44:0/1998607009 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b403f030 con 0x7fd2c4102250 2024-08-19T00:11:30.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:30.064+0000 7fd2cc7ef640 1 -- 172.21.15.44:0/1998607009 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2c41a68e0 con 0x7fd2c4102250 2024-08-19T00:11:30.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:30.064+0000 7fd2bb7fe640 1 -- 172.21.15.44:0/1998607009 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2b4003ce0 con 0x7fd2c4102250 2024-08-19T00:11:30.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:30.064+0000 7fd2bb7fe640 1 -- 172.21.15.44:0/1998607009 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b4035070 con 0x7fd2c4102250 2024-08-19T00:11:30.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:30.064+0000 7fd2cc7ef640 1 -- 172.21.15.44:0/1998607009 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2c41a6e10 con 0x7fd2c4102250 2024-08-19T00:11:30.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:30.065+0000 7fd2cc7ef640 1 -- 172.21.15.44:0/1998607009 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2c4101d10 con 0x7fd2c4102250 2024-08-19T00:11:30.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:30.066+0000 7fd2bb7fe640 1 -- 172.21.15.44:0/1998607009 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fd2b4042030 con 0x7fd2c4102250 2024-08-19T00:11:30.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:30.067+0000 7fd2bb7fe640 1 --2- 172.21.15.44:0/1998607009 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fd2b00a2b80 0x7fd2b00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:30.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:30.067+0000 7fd2ca58b640 1 --2- 172.21.15.44:0/1998607009 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fd2b00a2b80 0x7fd2b00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:30.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:30.067+0000 7fd2bb7fe640 1 -- 172.21.15.44:0/1998607009 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7fd2b40efdd0 con 0x7fd2c4102250 2024-08-19T00:11:30.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:30.067+0000 7fd2ca58b640 1 --2- 172.21.15.44:0/1998607009 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fd2b00a2b80 0x7fd2b00a5040 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd2c000baa0 tx=0x7fd2c0005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:30.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:30.070+0000 7fd2bb7fe640 1 -- 172.21.15.44:0/1998607009 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fd2b40bca90 con 0x7fd2c4102250 2024-08-19T00:11:30.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:29 smithi116 ceph-mon[21873]: pgmap v285: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-19T00:11:30.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:30.284+0000 7fd2cc7ef640 1 -- 172.21.15.44:0/1998607009 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fd2c41a7040 con 0x7fd2c4102250 2024-08-19T00:11:30.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:29 smithi171 ceph-mon[21810]: pgmap v285: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-19T00:11:30.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:30.848+0000 7fd2bb7fe640 1 -- 172.21.15.44:0/1998607009 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7fd2b40bc390 con 0x7fd2c4102250 2024-08-19T00:11:30.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:30.851+0000 7fd2cc7ef640 1 -- 172.21.15.44:0/1998607009 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fd2b00a2b80 msgr2=0x7fd2b00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:30.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:30.851+0000 7fd2cc7ef640 1 --2- 172.21.15.44:0/1998607009 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fd2b00a2b80 0x7fd2b00a5040 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd2c000baa0 tx=0x7fd2c0005d90 comp rx=0 tx=0).stop 2024-08-19T00:11:30.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:30.851+0000 7fd2cc7ef640 1 -- 172.21.15.44:0/1998607009 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd2c4102250 msgr2=0x7fd2c4074760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:30.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:30.851+0000 7fd2cc7ef640 1 --2- 172.21.15.44:0/1998607009 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd2c4102250 0x7fd2c4074760 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4009a50 tx=0x7fd2b4004270 comp rx=0 tx=0).stop 2024-08-19T00:11:30.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:30.851+0000 7fd2cc7ef640 1 -- 172.21.15.44:0/1998607009 shutdown_connections 2024-08-19T00:11:30.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:30.851+0000 7fd2cc7ef640 1 --2- 172.21.15.44:0/1998607009 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fd2b00a2b80 0x7fd2b00a5040 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:30.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:30.851+0000 7fd2cc7ef640 1 --2- 172.21.15.44:0/1998607009 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd2c41078b0 0x7fd2c4074ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:30.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:30.851+0000 7fd2cc7ef640 1 --2- 172.21.15.44:0/1998607009 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd2c4102250 0x7fd2c4074760 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:30.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:30.851+0000 7fd2cc7ef640 1 --2- 172.21.15.44:0/1998607009 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd2c41018b0 0x7fd2c4074220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:30.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:30.851+0000 7fd2cc7ef640 1 -- 172.21.15.44:0/1998607009 >> 172.21.15.44:0/1998607009 conn(0x7fd2c40fd5f0 msgr2=0x7fd2c40fdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:30.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:30.851+0000 7fd2cc7ef640 1 -- 172.21.15.44:0/1998607009 shutdown_connections 2024-08-19T00:11:30.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:30.851+0000 7fd2cc7ef640 1 -- 172.21.15.44:0/1998607009 wait complete. 2024-08-19T00:11:31.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:30 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/1998607009' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-08-19T00:11:31.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:30 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/1998607009' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-08-19T00:11:31.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:30 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/1998607009' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-08-19T00:11:31.626 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-08-19T00:11:31.626 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph fs set cephfs max_mds 5 2024-08-19T00:11:31.889 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:11:32.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:31 smithi116 ceph-mon[21873]: pgmap v286: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-19T00:11:32.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:31 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/1998607009' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-08-19T00:11:32.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:31 smithi116 ceph-mon[21873]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-19T00:11:32.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:31 smithi044 ceph-mon[18489]: pgmap v286: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-19T00:11:32.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:31 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/1998607009' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-08-19T00:11:32.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:31 smithi044 ceph-mon[18489]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-19T00:11:32.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:31 smithi171 ceph-mon[21810]: pgmap v286: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-19T00:11:32.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:31 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/1998607009' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-08-19T00:11:32.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:31 smithi171 ceph-mon[21810]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-19T00:11:32.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:32.378+0000 7f4548a79640 1 -- 172.21.15.44:0/3764096113 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f45441007b0 msgr2=0x7f4544100c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:32.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:32.378+0000 7f4548a79640 1 --2- 172.21.15.44:0/3764096113 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f45441007b0 0x7f4544100c10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4538009930 tx=0x7f453802a420 comp rx=0 tx=0).stop 2024-08-19T00:11:32.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:32.379+0000 7f4548a79640 1 -- 172.21.15.44:0/3764096113 shutdown_connections 2024-08-19T00:11:32.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:32.379+0000 7f4548a79640 1 --2- 172.21.15.44:0/3764096113 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4544101150 0x7f454410d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:32.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:32.379+0000 7f4548a79640 1 --2- 172.21.15.44:0/3764096113 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f45441007b0 0x7f4544100c10 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:32.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:32.379+0000 7f4548a79640 1 --2- 172.21.15.44:0/3764096113 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f45441067b0 0x7f4544106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:32.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:32.379+0000 7f4548a79640 1 -- 172.21.15.44:0/3764096113 >> 172.21.15.44:0/3764096113 conn(0x7f45440fc4d0 msgr2=0x7f45440fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:32.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:32.379+0000 7f4548a79640 1 -- 172.21.15.44:0/3764096113 shutdown_connections 2024-08-19T00:11:32.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:32.379+0000 7f4548a79640 1 -- 172.21.15.44:0/3764096113 wait complete. 2024-08-19T00:11:32.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:32.379+0000 7f4548a79640 1 Processor -- start 2024-08-19T00:11:32.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:32.379+0000 7f4548a79640 1 -- start start 2024-08-19T00:11:32.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:32.380+0000 7f4548a79640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f45441007b0 0x7f4544198130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:32.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:32.380+0000 7f4548a79640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4544101150 0x7f4544198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:32.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:32.380+0000 7f4548a79640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f45441067b0 0x7f454419ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:32.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:32.380+0000 7f4548a79640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4544110bd0 con 0x7f45441007b0 2024-08-19T00:11:32.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:32.380+0000 7f4548a79640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f4544110a50 con 0x7f4544101150 2024-08-19T00:11:32.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:32.380+0000 7f4548a79640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4544110d50 con 0x7f45441067b0 2024-08-19T00:11:32.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:32.380+0000 7f454259c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f45441007b0 0x7f4544198130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:32.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:32.380+0000 7f454259c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f45441007b0 0x7f4544198130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60072/0 (socket says 172.21.15.44:60072) 2024-08-19T00:11:32.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:32.380+0000 7f454259c640 1 -- 172.21.15.44:0/2558929972 learned_addr learned my addr 172.21.15.44:0/2558929972 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:11:32.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:32.380+0000 7f4541d9b640 1 --2- 172.21.15.44:0/2558929972 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4544101150 0x7f4544198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:32.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:32.380+0000 7f4542d9d640 1 --2- 172.21.15.44:0/2558929972 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f45441067b0 0x7f454419ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:32.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:32.380+0000 7f454259c640 1 -- 172.21.15.44:0/2558929972 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f45441067b0 msgr2=0x7f454419ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:32.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:32.380+0000 7f454259c640 1 --2- 172.21.15.44:0/2558929972 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f45441067b0 0x7f454419ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:32.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:32.380+0000 7f454259c640 1 -- 172.21.15.44:0/2558929972 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4544101150 msgr2=0x7f4544198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:32.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:32.380+0000 7f454259c640 1 --2- 172.21.15.44:0/2558929972 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4544101150 0x7f4544198670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:32.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:32.380+0000 7f454259c640 1 -- 172.21.15.44:0/2558929972 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f454419d0e0 con 0x7f45441007b0 2024-08-19T00:11:32.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:32.380+0000 7f4542d9d640 1 --2- 172.21.15.44:0/2558929972 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f45441067b0 0x7f454419ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:11:32.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:32.380+0000 7f454259c640 1 --2- 172.21.15.44:0/2558929972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f45441007b0 0x7f4544198130 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f453400c920 tx=0x7f453400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:32.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:32.380+0000 7f45337fe640 1 -- 172.21.15.44:0/2558929972 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4534007c70 con 0x7f45441007b0 2024-08-19T00:11:32.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:32.381+0000 7f45337fe640 1 -- 172.21.15.44:0/2558929972 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4534007e10 con 0x7f45441007b0 2024-08-19T00:11:32.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:32.381+0000 7f45337fe640 1 -- 172.21.15.44:0/2558929972 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4534018890 con 0x7f45441007b0 2024-08-19T00:11:32.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:32.381+0000 7f4548a79640 1 -- 172.21.15.44:0/2558929972 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f454419d3d0 con 0x7f45441007b0 2024-08-19T00:11:32.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:32.381+0000 7f4548a79640 1 -- 172.21.15.44:0/2558929972 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45440fc980 con 0x7f45441007b0 2024-08-19T00:11:32.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:32.382+0000 7f4548a79640 1 -- 172.21.15.44:0/2558929972 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4544101ef0 con 0x7f45441007b0 2024-08-19T00:11:32.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:32.383+0000 7f45337fe640 1 -- 172.21.15.44:0/2558929972 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f4534018a70 con 0x7f45441007b0 2024-08-19T00:11:32.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:32.384+0000 7f45337fe640 1 --2- 172.21.15.44:0/2558929972 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f452c0a2b80 0x7f452c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:32.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:32.384+0000 7f4541d9b640 1 --2- 172.21.15.44:0/2558929972 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f452c0a2b80 0x7f452c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:32.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:32.384+0000 7f45337fe640 1 -- 172.21.15.44:0/2558929972 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f45340cf480 con 0x7f45441007b0 2024-08-19T00:11:32.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:32.384+0000 7f4541d9b640 1 --2- 172.21.15.44:0/2558929972 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f452c0a2b80 0x7f452c0a5040 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4538000c00 tx=0x7f4538031490 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:32.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:32.388+0000 7f45337fe640 1 -- 172.21.15.44:0/2558929972 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f4534014030 con 0x7f45441007b0 2024-08-19T00:11:32.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:32.608+0000 7f4548a79640 1 -- 172.21.15.44:0/2558929972 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7f4544109d50 con 0x7f45441007b0 2024-08-19T00:11:32.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:32.855+0000 7f45337fe640 1 -- 172.21.15.44:0/2558929972 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7f453400de20 con 0x7f45441007b0 2024-08-19T00:11:32.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:32.857+0000 7f4548a79640 1 -- 172.21.15.44:0/2558929972 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f452c0a2b80 msgr2=0x7f452c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:32.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:32.857+0000 7f4548a79640 1 --2- 172.21.15.44:0/2558929972 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f452c0a2b80 0x7f452c0a5040 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4538000c00 tx=0x7f4538031490 comp rx=0 tx=0).stop 2024-08-19T00:11:32.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:32.857+0000 7f4548a79640 1 -- 172.21.15.44:0/2558929972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f45441007b0 msgr2=0x7f4544198130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:32.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:32.857+0000 7f4548a79640 1 --2- 172.21.15.44:0/2558929972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f45441007b0 0x7f4544198130 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f453400c920 tx=0x7f453400cde0 comp rx=0 tx=0).stop 2024-08-19T00:11:32.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:32.857+0000 7f4548a79640 1 -- 172.21.15.44:0/2558929972 shutdown_connections 2024-08-19T00:11:32.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:32.857+0000 7f4548a79640 1 --2- 172.21.15.44:0/2558929972 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f452c0a2b80 0x7f452c0a5040 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:32.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:32.857+0000 7f4548a79640 1 --2- 172.21.15.44:0/2558929972 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f45441067b0 0x7f454419ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:32.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:32.857+0000 7f4548a79640 1 --2- 172.21.15.44:0/2558929972 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4544101150 0x7f4544198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:32.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:32.857+0000 7f4548a79640 1 --2- 172.21.15.44:0/2558929972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f45441007b0 0x7f4544198130 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:32.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:32.857+0000 7f4548a79640 1 -- 172.21.15.44:0/2558929972 >> 172.21.15.44:0/2558929972 conn(0x7f45440fc4d0 msgr2=0x7f454406a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:32.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:32.857+0000 7f4548a79640 1 -- 172.21.15.44:0/2558929972 shutdown_connections 2024-08-19T00:11:32.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:32.857+0000 7f4548a79640 1 -- 172.21.15.44:0/2558929972 wait complete. 2024-08-19T00:11:33.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:32 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/2558929972' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-08-19T00:11:33.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:32 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/2558929972' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-08-19T00:11:33.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:32 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/2558929972' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-08-19T00:11:33.521 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-08-19T00:11:33.778 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:11:33.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:33 smithi116 ceph-mon[21873]: pgmap v287: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:11:33.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:33 smithi116 ceph-mon[21873]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-08-19T00:11:33.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:33 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/2558929972' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-08-19T00:11:33.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:33 smithi116 ceph-mon[21873]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-08-19T00:11:33.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:33 smithi116 ceph-mon[21873]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-19T00:11:33.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:33 smithi116 ceph-mon[21873]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-08-19T00:11:33.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:33 smithi116 ceph-mon[21873]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-08-19T00:11:34.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:33 smithi044 ceph-mon[18489]: pgmap v287: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:11:34.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:33 smithi044 ceph-mon[18489]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-08-19T00:11:34.120 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:33 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/2558929972' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-08-19T00:11:34.120 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:33 smithi044 ceph-mon[18489]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-08-19T00:11:34.120 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:33 smithi044 ceph-mon[18489]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-19T00:11:34.120 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:33 smithi044 ceph-mon[18489]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-08-19T00:11:34.120 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:33 smithi044 ceph-mon[18489]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-08-19T00:11:34.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:34.263+0000 7f4e05562640 1 -- 172.21.15.44:0/1780532723 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e00100060 msgr2=0x7f4e00100440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:34.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:34.263+0000 7f4e05562640 1 --2- 172.21.15.44:0/1780532723 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e00100060 0x7f4e00100440 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4df0009930 tx=0x7f4df002a420 comp rx=0 tx=0).stop 2024-08-19T00:11:34.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:34.264+0000 7f4e05562640 1 -- 172.21.15.44:0/1780532723 shutdown_connections 2024-08-19T00:11:34.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:34.264+0000 7f4e05562640 1 --2- 172.21.15.44:0/1780532723 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e00106c60 0x7f4e0010e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:34.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:34.264+0000 7f4e05562640 1 --2- 172.21.15.44:0/1780532723 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4e00100a10 0x7f4e00106550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:34.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:34.264+0000 7f4e05562640 1 --2- 172.21.15.44:0/1780532723 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e00100060 0x7f4e00100440 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:34.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:34.264+0000 7f4e05562640 1 -- 172.21.15.44:0/1780532723 >> 172.21.15.44:0/1780532723 conn(0x7f4e000fbc10 msgr2=0x7f4e000fe030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:34.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:34.264+0000 7f4e05562640 1 -- 172.21.15.44:0/1780532723 shutdown_connections 2024-08-19T00:11:34.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:34.264+0000 7f4e05562640 1 -- 172.21.15.44:0/1780532723 wait complete. 2024-08-19T00:11:34.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:34.264+0000 7f4e05562640 1 Processor -- start 2024-08-19T00:11:34.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:34.264+0000 7f4e05562640 1 -- start start 2024-08-19T00:11:34.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:34.264+0000 7f4e05562640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4e00100060 0x7f4e00100fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:34.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:34.264+0000 7f4e05562640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e00100a10 0x7f4e00101520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:34.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:34.265+0000 7f4e05562640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e00106c60 0x7f4e00101a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:34.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:34.265+0000 7f4e05562640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4e00111cb0 con 0x7f4e00106c60 2024-08-19T00:11:34.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:34.265+0000 7f4e05562640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f4e00111b30 con 0x7f4e00100060 2024-08-19T00:11:34.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:34.265+0000 7f4e05562640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4e00111e30 con 0x7f4e00100a10 2024-08-19T00:11:34.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:34.265+0000 7f4dff7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e00106c60 0x7f4e00101a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:34.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:34.265+0000 7f4dff7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e00106c60 0x7f4e00101a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60086/0 (socket says 172.21.15.44:60086) 2024-08-19T00:11:34.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:34.265+0000 7f4dff7fe640 1 -- 172.21.15.44:0/564230590 learned_addr learned my addr 172.21.15.44:0/564230590 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:11:34.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:34.265+0000 7f4dfeffd640 1 --2- 172.21.15.44:0/564230590 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4e00100060 0x7f4e00100fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:34.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:34.265+0000 7f4dfe7fc640 1 --2- 172.21.15.44:0/564230590 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e00100a10 0x7f4e00101520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:34.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:34.265+0000 7f4dff7fe640 1 -- 172.21.15.44:0/564230590 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e00100a10 msgr2=0x7f4e00101520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:34.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:34.265+0000 7f4dff7fe640 1 --2- 172.21.15.44:0/564230590 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e00100a10 0x7f4e00101520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:34.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:34.265+0000 7f4dff7fe640 1 -- 172.21.15.44:0/564230590 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4e00100060 msgr2=0x7f4e00100fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:34.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:34.265+0000 7f4dff7fe640 1 --2- 172.21.15.44:0/564230590 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4e00100060 0x7f4e00100fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:34.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:34.265+0000 7f4dff7fe640 1 -- 172.21.15.44:0/564230590 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e001a6680 con 0x7f4e00106c60 2024-08-19T00:11:34.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:34.265+0000 7f4dfe7fc640 1 --2- 172.21.15.44:0/564230590 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e00100a10 0x7f4e00101520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:11:34.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:34.265+0000 7f4dff7fe640 1 --2- 172.21.15.44:0/564230590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e00106c60 0x7f4e00101a60 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4df800cce0 tx=0x7f4df800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:34.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:34.265+0000 7f4de7fff640 1 -- 172.21.15.44:0/564230590 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df800f450 con 0x7f4e00106c60 2024-08-19T00:11:34.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:34.265+0000 7f4e05562640 1 -- 172.21.15.44:0/564230590 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e001a6970 con 0x7f4e00106c60 2024-08-19T00:11:34.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:34.265+0000 7f4de7fff640 1 -- 172.21.15.44:0/564230590 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4df800fad0 con 0x7f4e00106c60 2024-08-19T00:11:34.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:34.265+0000 7f4de7fff640 1 -- 172.21.15.44:0/564230590 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df8018c10 con 0x7f4e00106c60 2024-08-19T00:11:34.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:34.265+0000 7f4e05562640 1 -- 172.21.15.44:0/564230590 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e001a6eb0 con 0x7f4e00106c60 2024-08-19T00:11:34.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:34.267+0000 7f4e05562640 1 -- 172.21.15.44:0/564230590 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e00100440 con 0x7f4e00106c60 2024-08-19T00:11:34.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:34.268+0000 7f4de7fff640 1 -- 172.21.15.44:0/564230590 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f4df800f5f0 con 0x7f4e00106c60 2024-08-19T00:11:34.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:34.268+0000 7f4de7fff640 1 --2- 172.21.15.44:0/564230590 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f4de80a2b80 0x7f4de80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:34.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:34.268+0000 7f4dfeffd640 1 --2- 172.21.15.44:0/564230590 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f4de80a2b80 0x7f4de80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:34.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:34.268+0000 7f4de7fff640 1 -- 172.21.15.44:0/564230590 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f4df80cf8b0 con 0x7f4e00106c60 2024-08-19T00:11:34.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:34.269+0000 7f4dfeffd640 1 --2- 172.21.15.44:0/564230590 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f4de80a2b80 0x7f4de80a5040 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4df0009900 tx=0x7f4df00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:34.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:34.273+0000 7f4de7fff640 1 -- 172.21.15.44:0/564230590 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f4df8014030 con 0x7f4e00106c60 2024-08-19T00:11:34.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:33 smithi171 ceph-mon[21810]: pgmap v287: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:11:34.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:33 smithi171 ceph-mon[21810]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-08-19T00:11:34.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:33 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/2558929972' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-08-19T00:11:34.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:33 smithi171 ceph-mon[21810]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-08-19T00:11:34.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:33 smithi171 ceph-mon[21810]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-19T00:11:34.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:33 smithi171 ceph-mon[21810]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-08-19T00:11:34.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:33 smithi171 ceph-mon[21810]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-08-19T00:11:34.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:34.484+0000 7f4e05562640 1 -- 172.21.15.44:0/564230590 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f4e00109e50 con 0x7f4e00106c60 2024-08-19T00:11:34.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:34.876+0000 7f4de7fff640 1 -- 172.21.15.44:0/564230590 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7f4df809c5d0 con 0x7f4e00106c60 2024-08-19T00:11:34.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:34.880+0000 7f4e05562640 1 -- 172.21.15.44:0/564230590 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f4de80a2b80 msgr2=0x7f4de80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:34.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:34.880+0000 7f4e05562640 1 --2- 172.21.15.44:0/564230590 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f4de80a2b80 0x7f4de80a5040 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4df0009900 tx=0x7f4df00058d0 comp rx=0 tx=0).stop 2024-08-19T00:11:34.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:34.880+0000 7f4e05562640 1 -- 172.21.15.44:0/564230590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e00106c60 msgr2=0x7f4e00101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:34.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:34.880+0000 7f4e05562640 1 --2- 172.21.15.44:0/564230590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e00106c60 0x7f4e00101a60 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4df800cce0 tx=0x7f4df800a620 comp rx=0 tx=0).stop 2024-08-19T00:11:34.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:34.880+0000 7f4e05562640 1 -- 172.21.15.44:0/564230590 shutdown_connections 2024-08-19T00:11:34.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:34.880+0000 7f4e05562640 1 --2- 172.21.15.44:0/564230590 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f4de80a2b80 0x7f4de80a5040 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:34.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:34.880+0000 7f4e05562640 1 --2- 172.21.15.44:0/564230590 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e00100a10 0x7f4e00101520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:34.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:34.880+0000 7f4e05562640 1 --2- 172.21.15.44:0/564230590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e00106c60 0x7f4e00101a60 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:34.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:34.880+0000 7f4e05562640 1 --2- 172.21.15.44:0/564230590 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4e00100060 0x7f4e00100fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:34.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:34.880+0000 7f4e05562640 1 -- 172.21.15.44:0/564230590 >> 172.21.15.44:0/564230590 conn(0x7f4e000fbc10 msgr2=0x7f4e000fcf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:34.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:34.880+0000 7f4e05562640 1 -- 172.21.15.44:0/564230590 shutdown_connections 2024-08-19T00:11:34.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:34.880+0000 7f4e05562640 1 -- 172.21.15.44:0/564230590 wait complete. 2024-08-19T00:11:35.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:34 smithi116 ceph-mon[21873]: mds.? [v2:172.21.15.116:6836/2764513846,v1:172.21.15.116:6837/2764513846] up:active 2024-08-19T00:11:35.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:34 smithi116 ceph-mon[21873]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-08-19T00:11:35.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:34 smithi116 ceph-mon[21873]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-08-19T00:11:35.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:34 smithi116 ceph-mon[21873]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-08-19T00:11:35.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:34 smithi116 ceph-mon[21873]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-08-19T00:11:35.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:34 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/564230590' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-08-19T00:11:35.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:34 smithi044 ceph-mon[18489]: mds.? [v2:172.21.15.116:6836/2764513846,v1:172.21.15.116:6837/2764513846] up:active 2024-08-19T00:11:35.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:34 smithi044 ceph-mon[18489]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-08-19T00:11:35.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:34 smithi044 ceph-mon[18489]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-08-19T00:11:35.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:34 smithi044 ceph-mon[18489]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-08-19T00:11:35.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:34 smithi044 ceph-mon[18489]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-08-19T00:11:35.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:34 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/564230590' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-08-19T00:11:35.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:34 smithi171 ceph-mon[21810]: mds.? [v2:172.21.15.116:6836/2764513846,v1:172.21.15.116:6837/2764513846] up:active 2024-08-19T00:11:35.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:34 smithi171 ceph-mon[21810]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-08-19T00:11:35.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:34 smithi171 ceph-mon[21810]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-08-19T00:11:35.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:34 smithi171 ceph-mon[21810]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-08-19T00:11:35.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:34 smithi171 ceph-mon[21810]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-08-19T00:11:35.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:34 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/564230590' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-08-19T00:11:35.546 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-08-19T00:11:35.811 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:11:36.230 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:35 smithi044 ceph-mon[18489]: pgmap v288: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s wr, 1 op/s 2024-08-19T00:11:36.230 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:35 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/564230590' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-08-19T00:11:36.230 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:35 smithi044 ceph-mon[18489]: mds.? [v2:172.21.15.171:6838/1466585795,v1:172.21.15.171:6839/1466585795] up:active 2024-08-19T00:11:36.230 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:35 smithi044 ceph-mon[18489]: daemon mds.e assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-08-19T00:11:36.230 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:35 smithi044 ceph-mon[18489]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-08-19T00:11:36.230 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:35 smithi044 ceph-mon[18489]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:creating} 8 up:standby 2024-08-19T00:11:36.231 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:35 smithi044 ceph-mon[18489]: daemon mds.e is now active in filesystem cephfs as rank 3 2024-08-19T00:11:36.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:36.312+0000 7f92f50c0640 1 -- 172.21.15.44:0/752155883 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92f0102260 msgr2=0x7f92f010e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:36.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:36.312+0000 7f92f50c0640 1 --2- 172.21.15.44:0/752155883 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92f0102260 0x7f92f010e790 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f92e8009cd0 tx=0x7f92e802a8e0 comp rx=0 tx=0).stop 2024-08-19T00:11:36.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:36.312+0000 7f92f50c0640 1 -- 172.21.15.44:0/752155883 shutdown_connections 2024-08-19T00:11:36.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:36.312+0000 7f92f50c0640 1 --2- 172.21.15.44:0/752155883 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92f0102260 0x7f92f010e790 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:36.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:36.312+0000 7f92f50c0640 1 --2- 172.21.15.44:0/752155883 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f92f01018c0 0x7f92f0101d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:36.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:36.312+0000 7f92f50c0640 1 --2- 172.21.15.44:0/752155883 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92f01078c0 0x7f92f0107ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:36.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:36.312+0000 7f92f50c0640 1 -- 172.21.15.44:0/752155883 >> 172.21.15.44:0/752155883 conn(0x7f92f00fd620 msgr2=0x7f92f00ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:36.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:36.312+0000 7f92f50c0640 1 -- 172.21.15.44:0/752155883 shutdown_connections 2024-08-19T00:11:36.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:36.312+0000 7f92f50c0640 1 -- 172.21.15.44:0/752155883 wait complete. 2024-08-19T00:11:36.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:36.312+0000 7f92f50c0640 1 Processor -- start 2024-08-19T00:11:36.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:36.313+0000 7f92f50c0640 1 -- start start 2024-08-19T00:11:36.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:36.313+0000 7f92f50c0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92f01018c0 0x7f92f0074220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:36.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:36.313+0000 7f92f50c0640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92f0102260 0x7f92f0074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:36.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:36.313+0000 7f92f50c0640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f92f01078c0 0x7f92f0074ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:36.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:36.313+0000 7f92f50c0640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f92f0111cc0 con 0x7f92f01018c0 2024-08-19T00:11:36.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:36.313+0000 7f92f50c0640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f92f0111b40 con 0x7f92f01078c0 2024-08-19T00:11:36.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:36.313+0000 7f92f50c0640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f92f0111e40 con 0x7f92f0102260 2024-08-19T00:11:36.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:36.313+0000 7f92eed9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92f01018c0 0x7f92f0074220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:36.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:36.313+0000 7f92eed9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92f01018c0 0x7f92f0074220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60096/0 (socket says 172.21.15.44:60096) 2024-08-19T00:11:36.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:36.313+0000 7f92eed9d640 1 -- 172.21.15.44:0/3825683673 learned_addr learned my addr 172.21.15.44:0/3825683673 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:11:36.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:36.313+0000 7f92e7fff640 1 --2- 172.21.15.44:0/3825683673 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92f0102260 0x7f92f0074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:36.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:36.313+0000 7f92eed9d640 1 -- 172.21.15.44:0/3825683673 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92f0102260 msgr2=0x7f92f0074760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:36.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:36.313+0000 7f92eed9d640 1 --2- 172.21.15.44:0/3825683673 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92f0102260 0x7f92f0074760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:36.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:36.313+0000 7f92ef59e640 1 --2- 172.21.15.44:0/3825683673 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f92f01078c0 0x7f92f0074ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:36.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:36.313+0000 7f92eed9d640 1 -- 172.21.15.44:0/3825683673 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f92f01078c0 msgr2=0x7f92f0074ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:36.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:36.313+0000 7f92eed9d640 1 --2- 172.21.15.44:0/3825683673 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f92f01078c0 0x7f92f0074ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:36.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:36.313+0000 7f92eed9d640 1 -- 172.21.15.44:0/3825683673 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92f01a6600 con 0x7f92f01018c0 2024-08-19T00:11:36.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:36.313+0000 7f92eed9d640 1 --2- 172.21.15.44:0/3825683673 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92f01018c0 0x7f92f0074220 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f92e000c970 tx=0x7f92e000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:36.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:36.313+0000 7f92ecd99640 1 -- 172.21.15.44:0/3825683673 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e0007bb0 con 0x7f92f01018c0 2024-08-19T00:11:36.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:36.314+0000 7f92ecd99640 1 -- 172.21.15.44:0/3825683673 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92e0007d50 con 0x7f92f01018c0 2024-08-19T00:11:36.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:36.314+0000 7f92f50c0640 1 -- 172.21.15.44:0/3825683673 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92f01a68f0 con 0x7f92f01018c0 2024-08-19T00:11:36.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:36.314+0000 7f92ecd99640 1 -- 172.21.15.44:0/3825683673 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e000f450 con 0x7f92f01018c0 2024-08-19T00:11:36.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:36.314+0000 7f92f50c0640 1 -- 172.21.15.44:0/3825683673 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92f01a6e30 con 0x7f92f01018c0 2024-08-19T00:11:36.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:36.314+0000 7f92f50c0640 1 -- 172.21.15.44:0/3825683673 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92f0101d20 con 0x7f92f01018c0 2024-08-19T00:11:36.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:36.316+0000 7f92ecd99640 1 -- 172.21.15.44:0/3825683673 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f92e0004fe0 con 0x7f92f01018c0 2024-08-19T00:11:36.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:36.316+0000 7f92ecd99640 1 --2- 172.21.15.44:0/3825683673 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f92dc0a2c00 0x7f92dc0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:36.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:36.316+0000 7f92e7fff640 1 --2- 172.21.15.44:0/3825683673 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f92dc0a2c00 0x7f92dc0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:36.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:36.316+0000 7f92ecd99640 1 -- 172.21.15.44:0/3825683673 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f92e00cf3c0 con 0x7f92f01018c0 2024-08-19T00:11:36.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:36.317+0000 7f92e7fff640 1 --2- 172.21.15.44:0/3825683673 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f92dc0a2c00 0x7f92dc0a50c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f92f0075cb0 tx=0x7f92d8005c60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:36.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:36.320+0000 7f92ecd99640 1 -- 172.21.15.44:0/3825683673 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f92e0014030 con 0x7f92f01018c0 2024-08-19T00:11:36.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:35 smithi171 ceph-mon[21810]: pgmap v288: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s wr, 1 op/s 2024-08-19T00:11:36.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:35 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/564230590' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-08-19T00:11:36.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:35 smithi171 ceph-mon[21810]: mds.? [v2:172.21.15.171:6838/1466585795,v1:172.21.15.171:6839/1466585795] up:active 2024-08-19T00:11:36.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:35 smithi171 ceph-mon[21810]: daemon mds.e assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-08-19T00:11:36.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:35 smithi171 ceph-mon[21810]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-08-19T00:11:36.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:35 smithi171 ceph-mon[21810]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:creating} 8 up:standby 2024-08-19T00:11:36.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:35 smithi171 ceph-mon[21810]: daemon mds.e is now active in filesystem cephfs as rank 3 2024-08-19T00:11:36.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:35 smithi116 ceph-mon[21873]: pgmap v288: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s wr, 1 op/s 2024-08-19T00:11:36.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:35 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/564230590' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-08-19T00:11:36.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:35 smithi116 ceph-mon[21873]: mds.? [v2:172.21.15.171:6838/1466585795,v1:172.21.15.171:6839/1466585795] up:active 2024-08-19T00:11:36.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:35 smithi116 ceph-mon[21873]: daemon mds.e assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-08-19T00:11:36.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:35 smithi116 ceph-mon[21873]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-08-19T00:11:36.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:35 smithi116 ceph-mon[21873]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:creating} 8 up:standby 2024-08-19T00:11:36.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:35 smithi116 ceph-mon[21873]: daemon mds.e is now active in filesystem cephfs as rank 3 2024-08-19T00:11:36.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:36.534+0000 7f92f50c0640 1 -- 172.21.15.44:0/3825683673 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f92f002d5e0 con 0x7f92f01018c0 2024-08-19T00:11:36.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:36.894+0000 7f92ecd99640 1 -- 172.21.15.44:0/3825683673 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v26) ==== 115+0+0 (secure 0 0 0) 0x7f92e009c160 con 0x7f92f01018c0 2024-08-19T00:11:36.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:36.897+0000 7f92f50c0640 1 -- 172.21.15.44:0/3825683673 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f92dc0a2c00 msgr2=0x7f92dc0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:36.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:36.897+0000 7f92f50c0640 1 --2- 172.21.15.44:0/3825683673 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f92dc0a2c00 0x7f92dc0a50c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f92f0075cb0 tx=0x7f92d8005c60 comp rx=0 tx=0).stop 2024-08-19T00:11:36.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:36.897+0000 7f92f50c0640 1 -- 172.21.15.44:0/3825683673 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92f01018c0 msgr2=0x7f92f0074220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:36.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:36.897+0000 7f92f50c0640 1 --2- 172.21.15.44:0/3825683673 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92f01018c0 0x7f92f0074220 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f92e000c970 tx=0x7f92e000ce30 comp rx=0 tx=0).stop 2024-08-19T00:11:36.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:36.897+0000 7f92f50c0640 1 -- 172.21.15.44:0/3825683673 shutdown_connections 2024-08-19T00:11:36.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:36.897+0000 7f92f50c0640 1 --2- 172.21.15.44:0/3825683673 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f92dc0a2c00 0x7f92dc0a50c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:36.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:36.897+0000 7f92f50c0640 1 --2- 172.21.15.44:0/3825683673 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92f0102260 0x7f92f0074760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:36.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:36.897+0000 7f92f50c0640 1 --2- 172.21.15.44:0/3825683673 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f92f01078c0 0x7f92f0074ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:36.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:36.897+0000 7f92f50c0640 1 --2- 172.21.15.44:0/3825683673 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92f01018c0 0x7f92f0074220 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:36.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:36.897+0000 7f92f50c0640 1 -- 172.21.15.44:0/3825683673 >> 172.21.15.44:0/3825683673 conn(0x7f92f00fd620 msgr2=0x7f92f00fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:36.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:36.897+0000 7f92f50c0640 1 -- 172.21.15.44:0/3825683673 shutdown_connections 2024-08-19T00:11:36.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:36.897+0000 7f92f50c0640 1 -- 172.21.15.44:0/3825683673 wait complete. 2024-08-19T00:11:37.218 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:36 smithi044 ceph-mon[18489]: mds.? [v2:172.21.15.116:6834/3507399322,v1:172.21.15.116:6835/3507399322] up:active 2024-08-19T00:11:37.218 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:36 smithi044 ceph-mon[18489]: daemon mds.c assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-08-19T00:11:37.218 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:36 smithi044 ceph-mon[18489]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-08-19T00:11:37.218 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:36 smithi044 ceph-mon[18489]: Cluster is now healthy 2024-08-19T00:11:37.218 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:36 smithi044 ceph-mon[18489]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:active} 8 up:standby 2024-08-19T00:11:37.218 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:36 smithi044 ceph-mon[18489]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-08-19T00:11:37.218 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:36 smithi044 ceph-mon[18489]: daemon mds.c is now active in filesystem cephfs as rank 4 2024-08-19T00:11:37.218 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:36 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/3825683673' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-08-19T00:11:37.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:36 smithi171 ceph-mon[21810]: mds.? [v2:172.21.15.116:6834/3507399322,v1:172.21.15.116:6835/3507399322] up:active 2024-08-19T00:11:37.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:36 smithi171 ceph-mon[21810]: daemon mds.c assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-08-19T00:11:37.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:36 smithi171 ceph-mon[21810]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-08-19T00:11:37.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:36 smithi171 ceph-mon[21810]: Cluster is now healthy 2024-08-19T00:11:37.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:36 smithi171 ceph-mon[21810]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:active} 8 up:standby 2024-08-19T00:11:37.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:36 smithi171 ceph-mon[21810]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-08-19T00:11:37.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:36 smithi171 ceph-mon[21810]: daemon mds.c is now active in filesystem cephfs as rank 4 2024-08-19T00:11:37.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:36 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/3825683673' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-08-19T00:11:37.365 INFO:journalctl@ceph.mds.b.smithi116.stdout:Aug 19 00:11:37 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-b[51250]: 2024-08-19T00:11:37.098+0000 7fcc65f01640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-08-19T00:11:37.365 INFO:journalctl@ceph.mds.b.smithi116.stdout:Aug 19 00:11:37 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-b[51250]: 2024-08-19T00:11:37.098+0000 7fcc65f01640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-08-19T00:11:37.365 INFO:journalctl@ceph.mds.b.smithi116.stdout:Aug 19 00:11:37 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-b[51250]: 2024-08-19T00:11:37.098+0000 7fcc65f01640 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-08-19T00:11:37.365 INFO:journalctl@ceph.mds.b.smithi116.stdout:Aug 19 00:11:37 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-b[51250]: 2024-08-19T00:11:37.098+0000 7fcc65f01640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-08-19T00:11:37.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:36 smithi116 ceph-mon[21873]: mds.? [v2:172.21.15.116:6834/3507399322,v1:172.21.15.116:6835/3507399322] up:active 2024-08-19T00:11:37.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:36 smithi116 ceph-mon[21873]: daemon mds.c assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-08-19T00:11:37.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:36 smithi116 ceph-mon[21873]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-08-19T00:11:37.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:36 smithi116 ceph-mon[21873]: Cluster is now healthy 2024-08-19T00:11:37.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:36 smithi116 ceph-mon[21873]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:active} 8 up:standby 2024-08-19T00:11:37.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:36 smithi116 ceph-mon[21873]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-08-19T00:11:37.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:36 smithi116 ceph-mon[21873]: daemon mds.c is now active in filesystem cephfs as rank 4 2024-08-19T00:11:37.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:36 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/3825683673' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-08-19T00:11:37.541 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated'} subvols for filesystem 'cephfs' 2024-08-19T00:11:37.542 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-08-19T00:11:37.800 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:11:38.230 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:37 smithi044 ceph-mon[18489]: pgmap v289: 129 pgs: 129 active+clean; 584 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 6 op/s 2024-08-19T00:11:38.230 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:37 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/3825683673' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-08-19T00:11:38.230 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:37 smithi044 ceph-mon[18489]: mds.? [v2:172.21.15.171:6836/316231795,v1:172.21.15.171:6837/316231795] up:active 2024-08-19T00:11:38.230 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:37 smithi044 ceph-mon[18489]: fsmap cephfs:5 7 up:standby 5 up:active 2024-08-19T00:11:38.230 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:37 smithi044 ceph-mon[18489]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-19T00:11:38.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:38.312+0000 7fdf72972640 1 -- 172.21.15.44:0/507037872 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdf6c1067b0 msgr2=0x7fdf6c106b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:38.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:38.312+0000 7fdf72972640 1 --2- 172.21.15.44:0/507037872 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdf6c1067b0 0x7fdf6c106b90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c009930 tx=0x7fdf5c02a420 comp rx=0 tx=0).stop 2024-08-19T00:11:38.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:38.312+0000 7fdf72972640 1 -- 172.21.15.44:0/507037872 shutdown_connections 2024-08-19T00:11:38.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:38.312+0000 7fdf72972640 1 --2- 172.21.15.44:0/507037872 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdf6c101150 0x7fdf6c10d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:38.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:38.312+0000 7fdf72972640 1 --2- 172.21.15.44:0/507037872 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdf6c1007b0 0x7fdf6c100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:38.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:38.312+0000 7fdf72972640 1 --2- 172.21.15.44:0/507037872 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdf6c1067b0 0x7fdf6c106b90 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:38.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:38.312+0000 7fdf72972640 1 -- 172.21.15.44:0/507037872 >> 172.21.15.44:0/507037872 conn(0x7fdf6c0fc4d0 msgr2=0x7fdf6c0fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:38.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:38.312+0000 7fdf72972640 1 -- 172.21.15.44:0/507037872 shutdown_connections 2024-08-19T00:11:38.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:38.312+0000 7fdf72972640 1 -- 172.21.15.44:0/507037872 wait complete. 2024-08-19T00:11:38.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:38.313+0000 7fdf72972640 1 Processor -- start 2024-08-19T00:11:38.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:38.313+0000 7fdf72972640 1 -- start start 2024-08-19T00:11:38.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:38.313+0000 7fdf72972640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdf6c1007b0 0x7fdf6c198130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:38.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:38.313+0000 7fdf72972640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdf6c101150 0x7fdf6c198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:38.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:38.313+0000 7fdf72972640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdf6c1067b0 0x7fdf6c19ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:38.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:38.313+0000 7fdf72972640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdf6c111cd0 con 0x7fdf6c101150 2024-08-19T00:11:38.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:38.313+0000 7fdf72972640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fdf6c111b50 con 0x7fdf6c1067b0 2024-08-19T00:11:38.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:38.313+0000 7fdf72972640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fdf6c111e50 con 0x7fdf6c1007b0 2024-08-19T00:11:38.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:38.313+0000 7fdf6b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdf6c101150 0x7fdf6c198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:38.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:38.313+0000 7fdf6b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdf6c101150 0x7fdf6c198670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60116/0 (socket says 172.21.15.44:60116) 2024-08-19T00:11:38.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:38.313+0000 7fdf6b7fe640 1 -- 172.21.15.44:0/175214898 learned_addr learned my addr 172.21.15.44:0/175214898 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:11:38.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:38.313+0000 7fdf6bfff640 1 --2- 172.21.15.44:0/175214898 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdf6c1007b0 0x7fdf6c198130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:38.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:38.314+0000 7fdf70f0f640 1 --2- 172.21.15.44:0/175214898 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdf6c1067b0 0x7fdf6c19ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:38.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:38.314+0000 7fdf6b7fe640 1 -- 172.21.15.44:0/175214898 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdf6c1007b0 msgr2=0x7fdf6c198130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:38.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:38.314+0000 7fdf6b7fe640 1 --2- 172.21.15.44:0/175214898 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdf6c1007b0 0x7fdf6c198130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:38.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:38.314+0000 7fdf6b7fe640 1 -- 172.21.15.44:0/175214898 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdf6c1067b0 msgr2=0x7fdf6c19ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:38.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:38.314+0000 7fdf6b7fe640 1 --2- 172.21.15.44:0/175214898 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdf6c1067b0 0x7fdf6c19ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:38.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:38.314+0000 7fdf6b7fe640 1 -- 172.21.15.44:0/175214898 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf6c19d0e0 con 0x7fdf6c101150 2024-08-19T00:11:38.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:38.314+0000 7fdf6b7fe640 1 --2- 172.21.15.44:0/175214898 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdf6c101150 0x7fdf6c198670 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fdf6000c920 tx=0x7fdf6000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:38.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:38.314+0000 7fdf697fa640 1 -- 172.21.15.44:0/175214898 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf60007c70 con 0x7fdf6c101150 2024-08-19T00:11:38.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:38.314+0000 7fdf72972640 1 -- 172.21.15.44:0/175214898 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf6c19d3d0 con 0x7fdf6c101150 2024-08-19T00:11:38.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:38.314+0000 7fdf697fa640 1 -- 172.21.15.44:0/175214898 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf60007e10 con 0x7fdf6c101150 2024-08-19T00:11:38.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:38.314+0000 7fdf697fa640 1 -- 172.21.15.44:0/175214898 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf60018890 con 0x7fdf6c101150 2024-08-19T00:11:38.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:38.314+0000 7fdf72972640 1 -- 172.21.15.44:0/175214898 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf6c1a4cb0 con 0x7fdf6c101150 2024-08-19T00:11:38.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:38.315+0000 7fdf72972640 1 -- 172.21.15.44:0/175214898 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf6c100c10 con 0x7fdf6c101150 2024-08-19T00:11:38.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:38.317+0000 7fdf697fa640 1 -- 172.21.15.44:0/175214898 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fdf60018a50 con 0x7fdf6c101150 2024-08-19T00:11:38.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:38.318+0000 7fdf697fa640 1 --2- 172.21.15.44:0/175214898 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fdf540a2b80 0x7fdf540a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:38.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:38.318+0000 7fdf6bfff640 1 --2- 172.21.15.44:0/175214898 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fdf540a2b80 0x7fdf540a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:38.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:38.318+0000 7fdf697fa640 1 -- 172.21.15.44:0/175214898 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7fdf600cf6c0 con 0x7fdf6c101150 2024-08-19T00:11:38.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:38.318+0000 7fdf6bfff640 1 --2- 172.21.15.44:0/175214898 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fdf540a2b80 0x7fdf540a5040 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c009900 tx=0x7fdf5c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:38.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:38.321+0000 7fdf697fa640 1 -- 172.21.15.44:0/175214898 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fdf60014030 con 0x7fdf6c101150 2024-08-19T00:11:38.345 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:37 smithi171 ceph-mon[21810]: pgmap v289: 129 pgs: 129 active+clean; 584 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 6 op/s 2024-08-19T00:11:38.345 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:37 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/3825683673' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-08-19T00:11:38.346 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:37 smithi171 ceph-mon[21810]: mds.? [v2:172.21.15.171:6836/316231795,v1:172.21.15.171:6837/316231795] up:active 2024-08-19T00:11:38.346 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:37 smithi171 ceph-mon[21810]: fsmap cephfs:5 7 up:standby 5 up:active 2024-08-19T00:11:38.346 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:37 smithi171 ceph-mon[21810]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-19T00:11:38.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:37 smithi116 ceph-mon[21873]: pgmap v289: 129 pgs: 129 active+clean; 584 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 6 op/s 2024-08-19T00:11:38.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:37 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/3825683673' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-08-19T00:11:38.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:37 smithi116 ceph-mon[21873]: mds.? [v2:172.21.15.171:6836/316231795,v1:172.21.15.171:6837/316231795] up:active 2024-08-19T00:11:38.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:37 smithi116 ceph-mon[21873]: fsmap cephfs:5 7 up:standby 5 up:active 2024-08-19T00:11:38.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:37 smithi116 ceph-mon[21873]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-19T00:11:38.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:38.525+0000 7fdf72972640 1 -- 172.21.15.44:0/175214898 --> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fdf6c062360 con 0x7fdf540a2b80 2024-08-19T00:11:38.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:38.547+0000 7fdf697fa640 1 -- 172.21.15.44:0/175214898 <== mgr.14150 v2:172.21.15.44:6800/1330072146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fdf6c062360 con 0x7fdf540a2b80 2024-08-19T00:11:38.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:38.549+0000 7fdf72972640 1 -- 172.21.15.44:0/175214898 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fdf540a2b80 msgr2=0x7fdf540a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:38.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:38.549+0000 7fdf72972640 1 --2- 172.21.15.44:0/175214898 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fdf540a2b80 0x7fdf540a5040 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c009900 tx=0x7fdf5c0058d0 comp rx=0 tx=0).stop 2024-08-19T00:11:38.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:38.549+0000 7fdf72972640 1 -- 172.21.15.44:0/175214898 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdf6c101150 msgr2=0x7fdf6c198670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:38.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:38.549+0000 7fdf72972640 1 --2- 172.21.15.44:0/175214898 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdf6c101150 0x7fdf6c198670 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fdf6000c920 tx=0x7fdf6000cde0 comp rx=0 tx=0).stop 2024-08-19T00:11:38.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:38.549+0000 7fdf72972640 1 -- 172.21.15.44:0/175214898 shutdown_connections 2024-08-19T00:11:38.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:38.549+0000 7fdf72972640 1 --2- 172.21.15.44:0/175214898 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fdf540a2b80 0x7fdf540a5040 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:38.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:38.549+0000 7fdf72972640 1 --2- 172.21.15.44:0/175214898 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdf6c1067b0 0x7fdf6c19ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:38.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:38.549+0000 7fdf72972640 1 --2- 172.21.15.44:0/175214898 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdf6c101150 0x7fdf6c198670 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:38.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:38.549+0000 7fdf72972640 1 --2- 172.21.15.44:0/175214898 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdf6c1007b0 0x7fdf6c198130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:38.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:38.549+0000 7fdf72972640 1 -- 172.21.15.44:0/175214898 >> 172.21.15.44:0/175214898 conn(0x7fdf6c0fc4d0 msgr2=0x7fdf6c0fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:38.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:38.550+0000 7fdf72972640 1 -- 172.21.15.44:0/175214898 shutdown_connections 2024-08-19T00:11:38.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:38.550+0000 7fdf72972640 1 -- 172.21.15.44:0/175214898 wait complete. 2024-08-19T00:11:38.869 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:11:38 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:11:38.530+0000 7fca08c5f640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-19T00:11:38.869 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:11:38 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:11:38.530+0000 7fca08c5f640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-19T00:11:38.870 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:11:38 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:11:38.530+0000 7fca08c5f640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-19T00:11:38.870 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:11:38 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:11:38.530+0000 7fca08c5f640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-19T00:11:38.870 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:11:38 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:11:38.530+0000 7fca08c5f640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-19T00:11:39.285 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:38 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2024-08-19T00:11:39.285 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:38 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-08-19T00:11:39.286 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:38 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]: dispatch 2024-08-19T00:11:39.286 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:38 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]: dispatch 2024-08-19T00:11:39.286 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:38 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]: dispatch 2024-08-19T00:11:39.286 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:38 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-08-19T00:11:39.286 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:38 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [9, 8]}]: dispatch 2024-08-19T00:11:39.286 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:38 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]}]: dispatch 2024-08-19T00:11:39.286 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:38 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]: dispatch 2024-08-19T00:11:39.286 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:38 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [5, 8]}]: dispatch 2024-08-19T00:11:39.318 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-08-19T00:11:39.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:38 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2024-08-19T00:11:39.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:38 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-08-19T00:11:39.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:38 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]: dispatch 2024-08-19T00:11:39.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:38 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]: dispatch 2024-08-19T00:11:39.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:38 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]: dispatch 2024-08-19T00:11:39.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:38 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-08-19T00:11:39.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:38 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [9, 8]}]: dispatch 2024-08-19T00:11:39.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:38 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]}]: dispatch 2024-08-19T00:11:39.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:38 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]: dispatch 2024-08-19T00:11:39.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:38 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [5, 8]}]: dispatch 2024-08-19T00:11:39.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:38 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2024-08-19T00:11:39.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:38 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-08-19T00:11:39.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:38 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]: dispatch 2024-08-19T00:11:39.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:38 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]: dispatch 2024-08-19T00:11:39.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:38 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]: dispatch 2024-08-19T00:11:39.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:38 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-08-19T00:11:39.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:38 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [9, 8]}]: dispatch 2024-08-19T00:11:39.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:38 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]}]: dispatch 2024-08-19T00:11:39.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:38 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]: dispatch 2024-08-19T00:11:39.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:38 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [5, 8]}]: dispatch 2024-08-19T00:11:39.580 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:11:39.956 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:39 smithi044 ceph-mon[18489]: pgmap v290: 129 pgs: 129 active+clean; 586 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s rd, 3.2 KiB/s wr, 10 op/s 2024-08-19T00:11:39.957 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:39 smithi044 ceph-mon[18489]: from='client.14769 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:11:39.957 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:39 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-08-19T00:11:39.957 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:39 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-08-19T00:11:39.957 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:39 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2024-08-19T00:11:39.957 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:39 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2024-08-19T00:11:39.957 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:39 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-08-19T00:11:39.957 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:39 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-08-19T00:11:39.957 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:39 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [9, 8]}]': finished 2024-08-19T00:11:39.957 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:39 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]}]': finished 2024-08-19T00:11:39.957 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:39 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]': finished 2024-08-19T00:11:39.957 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:39 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [5, 8]}]': finished 2024-08-19T00:11:39.957 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:39 smithi044 ceph-mon[18489]: osdmap e91: 12 total, 12 up, 12 in 2024-08-19T00:11:40.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:40.041+0000 7f6348c9f640 1 -- 172.21.15.44:0/316671478 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63441018b0 msgr2=0x7f6344101d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:40.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:40.041+0000 7f6348c9f640 1 --2- 172.21.15.44:0/316671478 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63441018b0 0x7f6344101d10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6338009930 tx=0x7f633802a420 comp rx=0 tx=0).stop 2024-08-19T00:11:40.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:40.041+0000 7f6348c9f640 1 -- 172.21.15.44:0/316671478 shutdown_connections 2024-08-19T00:11:40.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:40.041+0000 7f6348c9f640 1 --2- 172.21.15.44:0/316671478 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6344102250 0x7f634410e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:40.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:40.041+0000 7f6348c9f640 1 --2- 172.21.15.44:0/316671478 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63441018b0 0x7f6344101d10 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:40.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:40.041+0000 7f6348c9f640 1 --2- 172.21.15.44:0/316671478 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f63441078b0 0x7f6344107c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:40.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:40.041+0000 7f6348c9f640 1 -- 172.21.15.44:0/316671478 >> 172.21.15.44:0/316671478 conn(0x7f63440fd5f0 msgr2=0x7f63440ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:40.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:40.041+0000 7f6348c9f640 1 -- 172.21.15.44:0/316671478 shutdown_connections 2024-08-19T00:11:40.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:40.041+0000 7f6348c9f640 1 -- 172.21.15.44:0/316671478 wait complete. 2024-08-19T00:11:40.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:40.042+0000 7f6348c9f640 1 Processor -- start 2024-08-19T00:11:40.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:40.042+0000 7f6348c9f640 1 -- start start 2024-08-19T00:11:40.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:40.042+0000 7f6348c9f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f63441018b0 0x7f6344198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:40.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:40.042+0000 7f6348c9f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6344102250 0x7f6344198770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:40.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:40.042+0000 7f6348c9f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63441078b0 0x7f634419cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:40.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:40.042+0000 7f6348c9f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6344111cf0 con 0x7f63441078b0 2024-08-19T00:11:40.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:40.042+0000 7f6348c9f640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f6344111b70 con 0x7f6344102250 2024-08-19T00:11:40.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:40.042+0000 7f6348c9f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6344111e70 con 0x7f63441018b0 2024-08-19T00:11:40.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:40.043+0000 7f6342d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63441078b0 0x7f634419cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:40.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:40.043+0000 7f6342d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63441078b0 0x7f634419cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42338/0 (socket says 172.21.15.44:42338) 2024-08-19T00:11:40.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:40.043+0000 7f6342d9d640 1 -- 172.21.15.44:0/1235478350 learned_addr learned my addr 172.21.15.44:0/1235478350 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:11:40.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:40.043+0000 7f634259c640 1 --2- 172.21.15.44:0/1235478350 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f63441018b0 0x7f6344198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:40.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:40.043+0000 7f6341d9b640 1 --2- 172.21.15.44:0/1235478350 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6344102250 0x7f6344198770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:40.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:40.043+0000 7f6342d9d640 1 -- 172.21.15.44:0/1235478350 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f63441018b0 msgr2=0x7f6344198230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:40.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:40.043+0000 7f6342d9d640 1 --2- 172.21.15.44:0/1235478350 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f63441018b0 0x7f6344198230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:40.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:40.043+0000 7f6342d9d640 1 -- 172.21.15.44:0/1235478350 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6344102250 msgr2=0x7f6344198770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:40.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:40.043+0000 7f6342d9d640 1 --2- 172.21.15.44:0/1235478350 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6344102250 0x7f6344198770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:40.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:40.043+0000 7f6342d9d640 1 -- 172.21.15.44:0/1235478350 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f634419d1e0 con 0x7f63441078b0 2024-08-19T00:11:40.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:40.043+0000 7f634259c640 1 --2- 172.21.15.44:0/1235478350 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f63441018b0 0x7f6344198230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:11:40.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:40.043+0000 7f6342d9d640 1 --2- 172.21.15.44:0/1235478350 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63441078b0 0x7f634419cb00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f633c00d750 tx=0x7f633c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:40.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:40.043+0000 7f63337fe640 1 -- 172.21.15.44:0/1235478350 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633c017070 con 0x7f63441078b0 2024-08-19T00:11:40.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:40.043+0000 7f63337fe640 1 -- 172.21.15.44:0/1235478350 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f633c005500 con 0x7f63441078b0 2024-08-19T00:11:40.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:40.043+0000 7f6348c9f640 1 -- 172.21.15.44:0/1235478350 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f634419d4d0 con 0x7f63441078b0 2024-08-19T00:11:40.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:40.043+0000 7f63337fe640 1 -- 172.21.15.44:0/1235478350 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633c004d90 con 0x7f63441078b0 2024-08-19T00:11:40.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:40.043+0000 7f6348c9f640 1 -- 172.21.15.44:0/1235478350 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63441a4db0 con 0x7f63441078b0 2024-08-19T00:11:40.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:40.044+0000 7f6348c9f640 1 -- 172.21.15.44:0/1235478350 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6344101d10 con 0x7f63441078b0 2024-08-19T00:11:40.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:40.046+0000 7f63337fe640 1 -- 172.21.15.44:0/1235478350 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f633c004f30 con 0x7f63441078b0 2024-08-19T00:11:40.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:40.046+0000 7f63337fe640 1 --2- 172.21.15.44:0/1235478350 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f632c0a2b80 0x7f632c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:40.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:40.046+0000 7f634259c640 1 --2- 172.21.15.44:0/1235478350 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f632c0a2b80 0x7f632c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:40.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:40.046+0000 7f63337fe640 1 -- 172.21.15.44:0/1235478350 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f633c0cf1f0 con 0x7f63441078b0 2024-08-19T00:11:40.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:40.047+0000 7f634259c640 1 --2- 172.21.15.44:0/1235478350 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f632c0a2b80 0x7f632c0a5040 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6334009fa0 tx=0x7f6334009570 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:40.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:40.050+0000 7f63337fe640 1 -- 172.21.15.44:0/1235478350 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f633c09bdf0 con 0x7f63441078b0 2024-08-19T00:11:40.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:40.251+0000 7f6348c9f640 1 -- 172.21.15.44:0/1235478350 --> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f6344062360 con 0x7f632c0a2b80 2024-08-19T00:11:40.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:40.277+0000 7f63337fe640 1 -- 172.21.15.44:0/1235478350 <== mgr.14150 v2:172.21.15.44:6800/1330072146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f6344062360 con 0x7f632c0a2b80 2024-08-19T00:11:40.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:40.279+0000 7f6348c9f640 1 -- 172.21.15.44:0/1235478350 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f632c0a2b80 msgr2=0x7f632c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:40.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:40.279+0000 7f6348c9f640 1 --2- 172.21.15.44:0/1235478350 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f632c0a2b80 0x7f632c0a5040 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6334009fa0 tx=0x7f6334009570 comp rx=0 tx=0).stop 2024-08-19T00:11:40.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:40.279+0000 7f6348c9f640 1 -- 172.21.15.44:0/1235478350 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63441078b0 msgr2=0x7f634419cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:40.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:40.279+0000 7f6348c9f640 1 --2- 172.21.15.44:0/1235478350 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63441078b0 0x7f634419cb00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f633c00d750 tx=0x7f633c00dc10 comp rx=0 tx=0).stop 2024-08-19T00:11:40.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:40.279+0000 7f6348c9f640 1 -- 172.21.15.44:0/1235478350 shutdown_connections 2024-08-19T00:11:40.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:40.279+0000 7f6348c9f640 1 --2- 172.21.15.44:0/1235478350 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f632c0a2b80 0x7f632c0a5040 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:40.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:40.279+0000 7f6348c9f640 1 --2- 172.21.15.44:0/1235478350 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63441078b0 0x7f634419cb00 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:40.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:40.279+0000 7f6348c9f640 1 --2- 172.21.15.44:0/1235478350 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6344102250 0x7f6344198770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:40.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:40.279+0000 7f6348c9f640 1 --2- 172.21.15.44:0/1235478350 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f63441018b0 0x7f6344198230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:40.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:40.279+0000 7f6348c9f640 1 -- 172.21.15.44:0/1235478350 >> 172.21.15.44:0/1235478350 conn(0x7f63440fd5f0 msgr2=0x7f63440fde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:40.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:40.279+0000 7f6348c9f640 1 -- 172.21.15.44:0/1235478350 shutdown_connections 2024-08-19T00:11:40.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:40.279+0000 7f6348c9f640 1 -- 172.21.15.44:0/1235478350 wait complete. 2024-08-19T00:11:40.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:39 smithi171 ceph-mon[21810]: pgmap v290: 129 pgs: 129 active+clean; 586 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s rd, 3.2 KiB/s wr, 10 op/s 2024-08-19T00:11:40.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:39 smithi171 ceph-mon[21810]: from='client.14769 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:11:40.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:39 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-08-19T00:11:40.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:39 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-08-19T00:11:40.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:39 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2024-08-19T00:11:40.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:39 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2024-08-19T00:11:40.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:39 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-08-19T00:11:40.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:39 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-08-19T00:11:40.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:39 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [9, 8]}]': finished 2024-08-19T00:11:40.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:39 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]}]': finished 2024-08-19T00:11:40.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:39 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]': finished 2024-08-19T00:11:40.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:39 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [5, 8]}]': finished 2024-08-19T00:11:40.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:39 smithi171 ceph-mon[21810]: osdmap e91: 12 total, 12 up, 12 in 2024-08-19T00:11:40.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:39 smithi116 ceph-mon[21873]: pgmap v290: 129 pgs: 129 active+clean; 586 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s rd, 3.2 KiB/s wr, 10 op/s 2024-08-19T00:11:40.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:39 smithi116 ceph-mon[21873]: from='client.14769 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:11:40.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:39 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-08-19T00:11:40.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:39 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-08-19T00:11:40.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:39 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2024-08-19T00:11:40.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:39 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2024-08-19T00:11:40.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:39 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-08-19T00:11:40.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:39 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-08-19T00:11:40.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:39 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [9, 8]}]': finished 2024-08-19T00:11:40.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:39 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]}]': finished 2024-08-19T00:11:40.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:39 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]': finished 2024-08-19T00:11:40.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:39 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [5, 8]}]': finished 2024-08-19T00:11:40.367 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:39 smithi116 ceph-mon[21873]: osdmap e91: 12 total, 12 up, 12 in 2024-08-19T00:11:40.951 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-08-19T00:11:40.974 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:40 smithi044 ceph-mon[18489]: osdmap e92: 12 total, 12 up, 12 in 2024-08-19T00:11:40.974 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:40 smithi044 ceph-mon[18489]: from='client.14781 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:11:41.208 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:11:41.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:40 smithi171 ceph-mon[21810]: osdmap e92: 12 total, 12 up, 12 in 2024-08-19T00:11:41.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:40 smithi171 ceph-mon[21810]: from='client.14781 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:11:41.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:40 smithi116 ceph-mon[21873]: osdmap e92: 12 total, 12 up, 12 in 2024-08-19T00:11:41.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:40 smithi116 ceph-mon[21873]: from='client.14781 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:11:41.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:41.672+0000 7f85cd6a0640 1 -- 172.21.15.44:0/3704916797 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85c81078b0 msgr2=0x7f85c8107c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:41.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:41.672+0000 7f85cd6a0640 1 --2- 172.21.15.44:0/3704916797 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85c81078b0 0x7f85c8107c90 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f85b8009cd0 tx=0x7f85b802a8e0 comp rx=0 tx=0).stop 2024-08-19T00:11:41.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:41.672+0000 7f85cd6a0640 1 -- 172.21.15.44:0/3704916797 shutdown_connections 2024-08-19T00:11:41.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:41.672+0000 7f85cd6a0640 1 --2- 172.21.15.44:0/3704916797 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f85c81018b0 0x7f85c8101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:41.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:41.672+0000 7f85cd6a0640 1 --2- 172.21.15.44:0/3704916797 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f85c8102250 0x7f85c810e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:41.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:41.672+0000 7f85cd6a0640 1 --2- 172.21.15.44:0/3704916797 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85c81078b0 0x7f85c8107c90 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:41.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:41.672+0000 7f85cd6a0640 1 -- 172.21.15.44:0/3704916797 >> 172.21.15.44:0/3704916797 conn(0x7f85c80fd5f0 msgr2=0x7f85c80ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:41.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:41.672+0000 7f85cd6a0640 1 -- 172.21.15.44:0/3704916797 shutdown_connections 2024-08-19T00:11:41.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:41.672+0000 7f85cd6a0640 1 -- 172.21.15.44:0/3704916797 wait complete. 2024-08-19T00:11:41.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:41.673+0000 7f85cd6a0640 1 Processor -- start 2024-08-19T00:11:41.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:41.673+0000 7f85cd6a0640 1 -- start start 2024-08-19T00:11:41.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:41.673+0000 7f85cd6a0640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f85c81018b0 0x7f85c81981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:41.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:41.673+0000 7f85cd6a0640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f85c8102250 0x7f85c8198730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:41.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:41.673+0000 7f85cd6a0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85c81078b0 0x7f85c819cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:41.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:41.673+0000 7f85cd6a0640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f85c8111cb0 con 0x7f85c81078b0 2024-08-19T00:11:41.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:41.673+0000 7f85cd6a0640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f85c8111b30 con 0x7f85c8102250 2024-08-19T00:11:41.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:41.673+0000 7f85cd6a0640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f85c8111e30 con 0x7f85c81018b0 2024-08-19T00:11:41.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:41.674+0000 7f85c77fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85c81078b0 0x7f85c819cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:41.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:41.674+0000 7f85c77fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85c81078b0 0x7f85c819cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42352/0 (socket says 172.21.15.44:42352) 2024-08-19T00:11:41.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:41.674+0000 7f85c77fe640 1 -- 172.21.15.44:0/2901297742 learned_addr learned my addr 172.21.15.44:0/2901297742 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:11:41.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:41.674+0000 7f85c6ffd640 1 --2- 172.21.15.44:0/2901297742 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f85c81018b0 0x7f85c81981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:41.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:41.674+0000 7f85c67fc640 1 --2- 172.21.15.44:0/2901297742 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f85c8102250 0x7f85c8198730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:41.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:41.674+0000 7f85c77fe640 1 -- 172.21.15.44:0/2901297742 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f85c81018b0 msgr2=0x7f85c81981f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:41.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:41.674+0000 7f85c77fe640 1 --2- 172.21.15.44:0/2901297742 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f85c81018b0 0x7f85c81981f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:41.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:41.674+0000 7f85c77fe640 1 -- 172.21.15.44:0/2901297742 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f85c8102250 msgr2=0x7f85c8198730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:41.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:41.674+0000 7f85c77fe640 1 --2- 172.21.15.44:0/2901297742 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f85c8102250 0x7f85c8198730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:41.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:41.674+0000 7f85c77fe640 1 -- 172.21.15.44:0/2901297742 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85c819d1a0 con 0x7f85c81078b0 2024-08-19T00:11:41.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:41.674+0000 7f85c67fc640 1 --2- 172.21.15.44:0/2901297742 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f85c8102250 0x7f85c8198730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:11:41.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:41.674+0000 7f85c77fe640 1 --2- 172.21.15.44:0/2901297742 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85c81078b0 0x7f85c819cac0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f85c000d750 tx=0x7f85c000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:41.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:41.674+0000 7f85affff640 1 -- 172.21.15.44:0/2901297742 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c0017070 con 0x7f85c81078b0 2024-08-19T00:11:41.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:41.674+0000 7f85affff640 1 -- 172.21.15.44:0/2901297742 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f85c0005500 con 0x7f85c81078b0 2024-08-19T00:11:41.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:41.674+0000 7f85cd6a0640 1 -- 172.21.15.44:0/2901297742 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85c819d490 con 0x7f85c81078b0 2024-08-19T00:11:41.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:41.674+0000 7f85affff640 1 -- 172.21.15.44:0/2901297742 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c0004d90 con 0x7f85c81078b0 2024-08-19T00:11:41.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:41.674+0000 7f85cd6a0640 1 -- 172.21.15.44:0/2901297742 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85c81a4d70 con 0x7f85c81078b0 2024-08-19T00:11:41.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:41.675+0000 7f85cd6a0640 1 -- 172.21.15.44:0/2901297742 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85c8101d10 con 0x7f85c81078b0 2024-08-19T00:11:41.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:41.676+0000 7f85affff640 1 -- 172.21.15.44:0/2901297742 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f85c0004f30 con 0x7f85c81078b0 2024-08-19T00:11:41.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:41.677+0000 7f85affff640 1 --2- 172.21.15.44:0/2901297742 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f85b00a2c10 0x7f85b00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:41.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:41.677+0000 7f85c6ffd640 1 --2- 172.21.15.44:0/2901297742 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f85b00a2c10 0x7f85b00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:41.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:41.677+0000 7f85affff640 1 -- 172.21.15.44:0/2901297742 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f85c00ceea0 con 0x7f85c81078b0 2024-08-19T00:11:41.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:41.678+0000 7f85c6ffd640 1 --2- 172.21.15.44:0/2901297742 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f85b00a2c10 0x7f85b00a50d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f85b8006010 tx=0x7f85b8009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:41.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:41.682+0000 7f85affff640 1 -- 172.21.15.44:0/2901297742 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f85c009b940 con 0x7f85c81078b0 2024-08-19T00:11:41.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:41.884+0000 7f85cd6a0640 1 -- 172.21.15.44:0/2901297742 --> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f85c8062360 con 0x7f85b00a2c10 2024-08-19T00:11:41.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:41.889+0000 7f85affff640 1 -- 172.21.15.44:0/2901297742 <== mgr.14150 v2:172.21.15.44:6800/1330072146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f85c8062360 con 0x7f85b00a2c10 2024-08-19T00:11:41.890 INFO:teuthology.orchestra.run.smithi044.stdout:/volumes/qa/sv_0/efae2727-06fb-4289-a860-959a241d6cd7 2024-08-19T00:11:41.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:41.891+0000 7f85cd6a0640 1 -- 172.21.15.44:0/2901297742 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f85b00a2c10 msgr2=0x7f85b00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:41.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:41.891+0000 7f85cd6a0640 1 --2- 172.21.15.44:0/2901297742 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f85b00a2c10 0x7f85b00a50d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f85b8006010 tx=0x7f85b8009360 comp rx=0 tx=0).stop 2024-08-19T00:11:41.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:41.891+0000 7f85cd6a0640 1 -- 172.21.15.44:0/2901297742 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85c81078b0 msgr2=0x7f85c819cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:41.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:41.891+0000 7f85cd6a0640 1 --2- 172.21.15.44:0/2901297742 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85c81078b0 0x7f85c819cac0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f85c000d750 tx=0x7f85c000dc10 comp rx=0 tx=0).stop 2024-08-19T00:11:41.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:41.891+0000 7f85cd6a0640 1 -- 172.21.15.44:0/2901297742 shutdown_connections 2024-08-19T00:11:41.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:41.891+0000 7f85cd6a0640 1 --2- 172.21.15.44:0/2901297742 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f85b00a2c10 0x7f85b00a50d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:41.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:41.891+0000 7f85cd6a0640 1 --2- 172.21.15.44:0/2901297742 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85c81078b0 0x7f85c819cac0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:41.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:41.891+0000 7f85cd6a0640 1 --2- 172.21.15.44:0/2901297742 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f85c8102250 0x7f85c8198730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:41.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:41.891+0000 7f85cd6a0640 1 --2- 172.21.15.44:0/2901297742 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f85c81018b0 0x7f85c81981f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:41.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:41.891+0000 7f85cd6a0640 1 -- 172.21.15.44:0/2901297742 >> 172.21.15.44:0/2901297742 conn(0x7f85c80fd5f0 msgr2=0x7f85c80fdee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:41.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:41.891+0000 7f85cd6a0640 1 -- 172.21.15.44:0/2901297742 shutdown_connections 2024-08-19T00:11:41.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:41.891+0000 7f85cd6a0640 1 -- 172.21.15.44:0/2901297742 wait complete. 2024-08-19T00:11:42.244 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:41 smithi044 ceph-mon[18489]: pgmap v293: 129 pgs: 3 peering, 126 active+clean; 607 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 8.9 KiB/s wr, 25 op/s 2024-08-19T00:11:42.244 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:41 smithi044 ceph-mon[18489]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-08-19T00:11:42.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:41 smithi171 ceph-mon[21810]: pgmap v293: 129 pgs: 3 peering, 126 active+clean; 607 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 8.9 KiB/s wr, 25 op/s 2024-08-19T00:11:42.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:41 smithi171 ceph-mon[21810]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-08-19T00:11:42.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:41 smithi116 ceph-mon[21873]: pgmap v293: 129 pgs: 3 peering, 126 active+clean; 607 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 8.9 KiB/s wr, 25 op/s 2024-08-19T00:11:42.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:41 smithi116 ceph-mon[21873]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-08-19T00:11:42.644 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-08-19T00:11:42.945 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:11:43.178 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:42 smithi044 ceph-mon[18489]: from='client.14787 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:11:43.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:42 smithi171 ceph-mon[21810]: from='client.14787 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:11:43.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:42 smithi116 ceph-mon[21873]: from='client.14787 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:11:43.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:43.392+0000 7f1cc5c05640 1 -- 172.21.15.44:0/3532390528 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1cc0102c20 msgr2=0x7f1cc010d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:43.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:43.392+0000 7f1cc5c05640 1 --2- 172.21.15.44:0/3532390528 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1cc0102c20 0x7f1cc010d770 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1cb8009ca0 tx=0x7f1cb802a970 comp rx=0 tx=0).stop 2024-08-19T00:11:43.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:43.392+0000 7f1cc5c05640 1 -- 172.21.15.44:0/3532390528 shutdown_connections 2024-08-19T00:11:43.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:43.392+0000 7f1cc5c05640 1 --2- 172.21.15.44:0/3532390528 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1cc01022a0 0x7f1cc01026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:43.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:43.392+0000 7f1cc5c05640 1 --2- 172.21.15.44:0/3532390528 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1cc0102c20 0x7f1cc010d770 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:43.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:43.392+0000 7f1cc5c05640 1 --2- 172.21.15.44:0/3532390528 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1cc0100b50 0x7f1cc0100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:43.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:43.392+0000 7f1cc5c05640 1 -- 172.21.15.44:0/3532390528 >> 172.21.15.44:0/3532390528 conn(0x7f1cc00fc500 msgr2=0x7f1cc00fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:43.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:43.392+0000 7f1cc5c05640 1 -- 172.21.15.44:0/3532390528 shutdown_connections 2024-08-19T00:11:43.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:43.392+0000 7f1cc5c05640 1 -- 172.21.15.44:0/3532390528 wait complete. 2024-08-19T00:11:43.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:43.392+0000 7f1cc5c05640 1 Processor -- start 2024-08-19T00:11:43.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:43.392+0000 7f1cc5c05640 1 -- start start 2024-08-19T00:11:43.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:43.393+0000 7f1cc5c05640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1cc0100b50 0x7f1cc01991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:43.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:43.393+0000 7f1cc5c05640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1cc01022a0 0x7f1cc01996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:43.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:43.393+0000 7f1cc5c05640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1cc0102c20 0x7f1cc01a4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:43.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:43.393+0000 7f1cc5c05640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc0110dc0 con 0x7f1cc0102c20 2024-08-19T00:11:43.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:43.393+0000 7f1cc5c05640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc0110c40 con 0x7f1cc01022a0 2024-08-19T00:11:43.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:43.393+0000 7f1cc5c05640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc0110f40 con 0x7f1cc0100b50 2024-08-19T00:11:43.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:43.393+0000 7f1cbffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1cc0102c20 0x7f1cc01a4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:43.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:43.393+0000 7f1cbffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1cc0102c20 0x7f1cc01a4230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42368/0 (socket says 172.21.15.44:42368) 2024-08-19T00:11:43.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:43.393+0000 7f1cbffff640 1 -- 172.21.15.44:0/1490447518 learned_addr learned my addr 172.21.15.44:0/1490447518 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:11:43.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:43.393+0000 7f1cbffff640 1 -- 172.21.15.44:0/1490447518 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1cc0100b50 msgr2=0x7f1cc01991b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-19T00:11:43.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:43.393+0000 7f1cbffff640 1 --2- 172.21.15.44:0/1490447518 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1cc0100b50 0x7f1cc01991b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:43.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:43.393+0000 7f1cbffff640 1 -- 172.21.15.44:0/1490447518 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1cc01022a0 msgr2=0x7f1cc01996f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:43.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:43.393+0000 7f1cbffff640 1 --2- 172.21.15.44:0/1490447518 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1cc01022a0 0x7f1cc01996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:43.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:43.393+0000 7f1cbffff640 1 -- 172.21.15.44:0/1490447518 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cc01a4770 con 0x7f1cc0102c20 2024-08-19T00:11:43.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:43.393+0000 7f1cbffff640 1 --2- 172.21.15.44:0/1490447518 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1cc0102c20 0x7f1cc01a4230 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1cb80098d0 tx=0x7f1cb80308a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:43.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:43.393+0000 7f1cbd7fa640 1 -- 172.21.15.44:0/1490447518 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cb8034030 con 0x7f1cc0102c20 2024-08-19T00:11:43.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:43.394+0000 7f1cbd7fa640 1 -- 172.21.15.44:0/1490447518 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1cb8004040 con 0x7f1cc0102c20 2024-08-19T00:11:43.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:43.394+0000 7f1cc5c05640 1 -- 172.21.15.44:0/1490447518 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cc01a4940 con 0x7f1cc0102c20 2024-08-19T00:11:43.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:43.394+0000 7f1cbd7fa640 1 -- 172.21.15.44:0/1490447518 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cb8039680 con 0x7f1cc0102c20 2024-08-19T00:11:43.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:43.394+0000 7f1cc5c05640 1 -- 172.21.15.44:0/1490447518 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cc01a4df0 con 0x7f1cc0102c20 2024-08-19T00:11:43.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:43.394+0000 7f1cc5c05640 1 -- 172.21.15.44:0/1490447518 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cc0100fb0 con 0x7f1cc0102c20 2024-08-19T00:11:43.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:43.396+0000 7f1cbd7fa640 1 -- 172.21.15.44:0/1490447518 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f1cb8037020 con 0x7f1cc0102c20 2024-08-19T00:11:43.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:43.396+0000 7f1cbd7fa640 1 --2- 172.21.15.44:0/1490447518 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f1cac0a2c90 0x7f1cac0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:43.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:43.397+0000 7f1cbf7fe640 1 --2- 172.21.15.44:0/1490447518 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f1cac0a2c90 0x7f1cac0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:43.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:43.397+0000 7f1cbd7fa640 1 -- 172.21.15.44:0/1490447518 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f1cb80f07b0 con 0x7f1cc0102c20 2024-08-19T00:11:43.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:43.397+0000 7f1cbf7fe640 1 --2- 172.21.15.44:0/1490447518 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f1cac0a2c90 0x7f1cac0a5150 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1cb00096b0 tx=0x7f1cb0006c20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:43.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:43.401+0000 7f1cbd7fa640 1 -- 172.21.15.44:0/1490447518 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f1cb80bd250 con 0x7f1cc0102c20 2024-08-19T00:11:43.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:43.603+0000 7f1cc5c05640 1 -- 172.21.15.44:0/1490447518 --> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f1cc0062360 con 0x7f1cac0a2c90 2024-08-19T00:11:43.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:43.627+0000 7f1cbd7fa640 1 -- 172.21.15.44:0/1490447518 <== mgr.14150 v2:172.21.15.44:6800/1330072146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f1cc0062360 con 0x7f1cac0a2c90 2024-08-19T00:11:43.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:43.629+0000 7f1cc5c05640 1 -- 172.21.15.44:0/1490447518 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f1cac0a2c90 msgr2=0x7f1cac0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:43.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:43.629+0000 7f1cc5c05640 1 --2- 172.21.15.44:0/1490447518 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f1cac0a2c90 0x7f1cac0a5150 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1cb00096b0 tx=0x7f1cb0006c20 comp rx=0 tx=0).stop 2024-08-19T00:11:43.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:43.629+0000 7f1cc5c05640 1 -- 172.21.15.44:0/1490447518 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1cc0102c20 msgr2=0x7f1cc01a4230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:43.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:43.629+0000 7f1cc5c05640 1 --2- 172.21.15.44:0/1490447518 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1cc0102c20 0x7f1cc01a4230 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1cb80098d0 tx=0x7f1cb80308a0 comp rx=0 tx=0).stop 2024-08-19T00:11:43.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:43.629+0000 7f1cc5c05640 1 -- 172.21.15.44:0/1490447518 shutdown_connections 2024-08-19T00:11:43.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:43.629+0000 7f1cc5c05640 1 --2- 172.21.15.44:0/1490447518 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f1cac0a2c90 0x7f1cac0a5150 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:43.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:43.629+0000 7f1cc5c05640 1 --2- 172.21.15.44:0/1490447518 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1cc0102c20 0x7f1cc01a4230 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:43.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:43.629+0000 7f1cc5c05640 1 --2- 172.21.15.44:0/1490447518 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1cc01022a0 0x7f1cc01996f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:43.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:43.629+0000 7f1cc5c05640 1 --2- 172.21.15.44:0/1490447518 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1cc0100b50 0x7f1cc01991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:43.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:43.629+0000 7f1cc5c05640 1 -- 172.21.15.44:0/1490447518 >> 172.21.15.44:0/1490447518 conn(0x7f1cc00fc500 msgr2=0x7f1cc00fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:43.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:43.629+0000 7f1cc5c05640 1 -- 172.21.15.44:0/1490447518 shutdown_connections 2024-08-19T00:11:43.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:43.629+0000 7f1cc5c05640 1 -- 172.21.15.44:0/1490447518 wait complete. 2024-08-19T00:11:44.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:43 smithi044 ceph-mon[18489]: pgmap v294: 129 pgs: 3 peering, 126 active+clean; 607 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 8.0 KiB/s wr, 28 op/s; 13 B/s, 0 objects/s recovering 2024-08-19T00:11:44.265 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-08-19T00:11:44.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:43 smithi171 ceph-mon[21810]: pgmap v294: 129 pgs: 3 peering, 126 active+clean; 607 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 8.0 KiB/s wr, 28 op/s; 13 B/s, 0 objects/s recovering 2024-08-19T00:11:44.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:43 smithi116 ceph-mon[21873]: pgmap v294: 129 pgs: 3 peering, 126 active+clean; 607 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 8.0 KiB/s wr, 28 op/s; 13 B/s, 0 objects/s recovering 2024-08-19T00:11:44.523 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:11:45.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:45.000+0000 7f46e9078640 1 -- 172.21.15.44:0/317684630 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46e41007b0 msgr2=0x7f46e4100c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:45.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:45.000+0000 7f46e9078640 1 --2- 172.21.15.44:0/317684630 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46e41007b0 0x7f46e4100c10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f46cc009930 tx=0x7f46cc02a420 comp rx=0 tx=0).stop 2024-08-19T00:11:45.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:45.000+0000 7f46e9078640 1 -- 172.21.15.44:0/317684630 shutdown_connections 2024-08-19T00:11:45.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:45.000+0000 7f46e9078640 1 --2- 172.21.15.44:0/317684630 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f46e4101150 0x7f46e410d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:45.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:45.000+0000 7f46e9078640 1 --2- 172.21.15.44:0/317684630 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46e41007b0 0x7f46e4100c10 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:45.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:45.000+0000 7f46e9078640 1 --2- 172.21.15.44:0/317684630 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f46e41067b0 0x7f46e4106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:45.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:45.000+0000 7f46e9078640 1 -- 172.21.15.44:0/317684630 >> 172.21.15.44:0/317684630 conn(0x7f46e40fc4d0 msgr2=0x7f46e40fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:45.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:45.000+0000 7f46e9078640 1 -- 172.21.15.44:0/317684630 shutdown_connections 2024-08-19T00:11:45.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:45.000+0000 7f46e9078640 1 -- 172.21.15.44:0/317684630 wait complete. 2024-08-19T00:11:45.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:45.001+0000 7f46e9078640 1 Processor -- start 2024-08-19T00:11:45.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:45.001+0000 7f46e9078640 1 -- start start 2024-08-19T00:11:45.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:45.001+0000 7f46e9078640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f46e41007b0 0x7f46e40fca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:45.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:45.001+0000 7f46e9078640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46e4101150 0x7f46e40fcfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:45.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:45.001+0000 7f46e9078640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f46e41067b0 0x7f46e40fd510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:45.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:45.001+0000 7f46e9078640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f46e4110bb0 con 0x7f46e4101150 2024-08-19T00:11:45.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:45.001+0000 7f46e9078640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f46e4110a30 con 0x7f46e41067b0 2024-08-19T00:11:45.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:45.001+0000 7f46e9078640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f46e4110d30 con 0x7f46e41007b0 2024-08-19T00:11:45.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:45.001+0000 7f46dbfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46e4101150 0x7f46e40fcfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:45.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:45.001+0000 7f46dbfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46e4101150 0x7f46e40fcfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42390/0 (socket says 172.21.15.44:42390) 2024-08-19T00:11:45.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:45.001+0000 7f46dbfff640 1 -- 172.21.15.44:0/1399099992 learned_addr learned my addr 172.21.15.44:0/1399099992 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:11:45.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:45.001+0000 7f46e2d9d640 1 --2- 172.21.15.44:0/1399099992 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f46e41007b0 0x7f46e40fca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:45.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:45.001+0000 7f46e359e640 1 --2- 172.21.15.44:0/1399099992 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f46e41067b0 0x7f46e40fd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:45.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:45.002+0000 7f46dbfff640 1 -- 172.21.15.44:0/1399099992 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f46e41007b0 msgr2=0x7f46e40fca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:45.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:45.002+0000 7f46dbfff640 1 --2- 172.21.15.44:0/1399099992 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f46e41007b0 0x7f46e40fca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:45.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:45.002+0000 7f46dbfff640 1 -- 172.21.15.44:0/1399099992 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f46e41067b0 msgr2=0x7f46e40fd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:45.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:45.002+0000 7f46dbfff640 1 --2- 172.21.15.44:0/1399099992 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f46e41067b0 0x7f46e40fd510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:45.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:45.002+0000 7f46dbfff640 1 -- 172.21.15.44:0/1399099992 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46e41a6620 con 0x7f46e4101150 2024-08-19T00:11:45.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:45.002+0000 7f46e359e640 1 --2- 172.21.15.44:0/1399099992 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f46e41067b0 0x7f46e40fd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:11:45.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:45.002+0000 7f46dbfff640 1 --2- 172.21.15.44:0/1399099992 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46e4101150 0x7f46e40fcfd0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f46cc009230 tx=0x7f46cc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:45.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:45.002+0000 7f46e0d99640 1 -- 172.21.15.44:0/1399099992 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46cc03f030 con 0x7f46e4101150 2024-08-19T00:11:45.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:45.002+0000 7f46e0d99640 1 -- 172.21.15.44:0/1399099992 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f46cc003ad0 con 0x7f46e4101150 2024-08-19T00:11:45.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:45.002+0000 7f46e0d99640 1 -- 172.21.15.44:0/1399099992 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46cc035070 con 0x7f46e4101150 2024-08-19T00:11:45.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:45.002+0000 7f46e9078640 1 -- 172.21.15.44:0/1399099992 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46e41a68b0 con 0x7f46e4101150 2024-08-19T00:11:45.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:45.002+0000 7f46e9078640 1 -- 172.21.15.44:0/1399099992 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46e41a6d40 con 0x7f46e4101150 2024-08-19T00:11:45.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:45.003+0000 7f46e9078640 1 -- 172.21.15.44:0/1399099992 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46e4100c10 con 0x7f46e4101150 2024-08-19T00:11:45.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:45.004+0000 7f46e0d99640 1 -- 172.21.15.44:0/1399099992 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f46cc042030 con 0x7f46e4101150 2024-08-19T00:11:45.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:45.005+0000 7f46e0d99640 1 --2- 172.21.15.44:0/1399099992 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f46d00a2c10 0x7f46d00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:45.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:45.005+0000 7f46e2d9d640 1 --2- 172.21.15.44:0/1399099992 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f46d00a2c10 0x7f46d00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:45.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:45.005+0000 7f46e0d99640 1 -- 172.21.15.44:0/1399099992 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f46cc0efa80 con 0x7f46e4101150 2024-08-19T00:11:45.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:45.006+0000 7f46e2d9d640 1 --2- 172.21.15.44:0/1399099992 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f46d00a2c10 0x7f46d00a50d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f46d4005d00 tx=0x7f46d400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:45.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:45.009+0000 7f46e0d99640 1 -- 172.21.15.44:0/1399099992 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f46cc0f1e20 con 0x7f46e4101150 2024-08-19T00:11:45.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:45.214+0000 7f46e9078640 1 -- 172.21.15.44:0/1399099992 --> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f46e4109dc0 con 0x7f46d00a2c10 2024-08-19T00:11:45.215 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:44 smithi044 ceph-mon[18489]: from='client.14793 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:11:45.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:45.219+0000 7f46e0d99640 1 -- 172.21.15.44:0/1399099992 <== mgr.14150 v2:172.21.15.44:6800/1330072146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f46d4010ba0 con 0x7f46d00a2c10 2024-08-19T00:11:45.220 INFO:teuthology.orchestra.run.smithi044.stdout:/volumes/qa/sv_1/6abd1eb0-902d-42d1-a61d-3eb92f1944c4 2024-08-19T00:11:45.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:45.221+0000 7f46e9078640 1 -- 172.21.15.44:0/1399099992 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f46d00a2c10 msgr2=0x7f46d00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:45.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:45.221+0000 7f46e9078640 1 --2- 172.21.15.44:0/1399099992 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f46d00a2c10 0x7f46d00a50d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f46d4005d00 tx=0x7f46d400b410 comp rx=0 tx=0).stop 2024-08-19T00:11:45.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:45.221+0000 7f46e9078640 1 -- 172.21.15.44:0/1399099992 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46e4101150 msgr2=0x7f46e40fcfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:45.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:45.221+0000 7f46e9078640 1 --2- 172.21.15.44:0/1399099992 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46e4101150 0x7f46e40fcfd0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f46cc009230 tx=0x7f46cc004270 comp rx=0 tx=0).stop 2024-08-19T00:11:45.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:45.221+0000 7f46e9078640 1 -- 172.21.15.44:0/1399099992 shutdown_connections 2024-08-19T00:11:45.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:45.221+0000 7f46e9078640 1 --2- 172.21.15.44:0/1399099992 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f46d00a2c10 0x7f46d00a50d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:45.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:45.221+0000 7f46e9078640 1 --2- 172.21.15.44:0/1399099992 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f46e41067b0 0x7f46e40fd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:45.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:45.221+0000 7f46e9078640 1 --2- 172.21.15.44:0/1399099992 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46e4101150 0x7f46e40fcfd0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:45.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:45.221+0000 7f46e9078640 1 --2- 172.21.15.44:0/1399099992 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f46e41007b0 0x7f46e40fca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:45.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:45.221+0000 7f46e9078640 1 -- 172.21.15.44:0/1399099992 >> 172.21.15.44:0/1399099992 conn(0x7f46e40fc4d0 msgr2=0x7f46e406a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:45.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:45.221+0000 7f46e9078640 1 -- 172.21.15.44:0/1399099992 shutdown_connections 2024-08-19T00:11:45.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:45.221+0000 7f46e9078640 1 -- 172.21.15.44:0/1399099992 wait complete. 2024-08-19T00:11:45.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:44 smithi171 ceph-mon[21810]: from='client.14793 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:11:45.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:44 smithi116 ceph-mon[21873]: from='client.14793 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:11:45.885 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-19T00:11:46.147 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:11:46.269 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:45 smithi044 ceph-mon[18489]: pgmap v295: 129 pgs: 1 peering, 128 active+clean; 607 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 5.4 KiB/s wr, 21 op/s; 13 B/s, 0 objects/s recovering 2024-08-19T00:11:46.269 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:45 smithi044 ceph-mon[18489]: from='client.14799 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:11:46.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:45 smithi171 ceph-mon[21810]: pgmap v295: 129 pgs: 1 peering, 128 active+clean; 607 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 5.4 KiB/s wr, 21 op/s; 13 B/s, 0 objects/s recovering 2024-08-19T00:11:46.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:45 smithi171 ceph-mon[21810]: from='client.14799 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:11:46.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:45 smithi116 ceph-mon[21873]: pgmap v295: 129 pgs: 1 peering, 128 active+clean; 607 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 5.4 KiB/s wr, 21 op/s; 13 B/s, 0 objects/s recovering 2024-08-19T00:11:46.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:45 smithi116 ceph-mon[21873]: from='client.14799 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:11:46.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:46.629+0000 7eff12363640 1 -- 172.21.15.44:0/2625495688 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff0c107fd0 msgr2=0x7eff0c10e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:46.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:46.629+0000 7eff12363640 1 --2- 172.21.15.44:0/2625495688 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff0c107fd0 0x7eff0c10e970 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7eff04009cd0 tx=0x7eff0402a8e0 comp rx=0 tx=0).stop 2024-08-19T00:11:46.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:46.629+0000 7eff12363640 1 -- 172.21.15.44:0/2625495688 shutdown_connections 2024-08-19T00:11:46.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:46.629+0000 7eff12363640 1 --2- 172.21.15.44:0/2625495688 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7eff0c103410 0x7eff0c1078c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:46.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:46.629+0000 7eff12363640 1 --2- 172.21.15.44:0/2625495688 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff0c107fd0 0x7eff0c10e970 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:46.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:46.629+0000 7eff12363640 1 --2- 172.21.15.44:0/2625495688 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7eff0c102a60 0x7eff0c102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:46.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:46.629+0000 7eff12363640 1 -- 172.21.15.44:0/2625495688 >> 172.21.15.44:0/2625495688 conn(0x7eff0c0fc500 msgr2=0x7eff0c0fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:46.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:46.629+0000 7eff12363640 1 -- 172.21.15.44:0/2625495688 shutdown_connections 2024-08-19T00:11:46.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:46.629+0000 7eff12363640 1 -- 172.21.15.44:0/2625495688 wait complete. 2024-08-19T00:11:46.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:46.630+0000 7eff12363640 1 Processor -- start 2024-08-19T00:11:46.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:46.630+0000 7eff12363640 1 -- start start 2024-08-19T00:11:46.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:46.631+0000 7eff12363640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff0c102a60 0x7eff0c198150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:46.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:46.631+0000 7eff12363640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7eff0c103410 0x7eff0c198690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:46.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:46.631+0000 7eff12363640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7eff0c107fd0 0x7eff0c19ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:46.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:46.631+0000 7eff12363640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7eff0c111dd0 con 0x7eff0c102a60 2024-08-19T00:11:46.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:46.631+0000 7eff12363640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7eff0c111c50 con 0x7eff0c103410 2024-08-19T00:11:46.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:46.631+0000 7eff12363640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7eff0c111f50 con 0x7eff0c107fd0 2024-08-19T00:11:46.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:46.631+0000 7eff0bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff0c102a60 0x7eff0c198150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:46.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:46.631+0000 7eff0bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff0c102a60 0x7eff0c198150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42422/0 (socket says 172.21.15.44:42422) 2024-08-19T00:11:46.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:46.631+0000 7eff0bfff640 1 -- 172.21.15.44:0/1448340117 learned_addr learned my addr 172.21.15.44:0/1448340117 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:11:46.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:46.631+0000 7eff10900640 1 --2- 172.21.15.44:0/1448340117 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7eff0c107fd0 0x7eff0c19ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:46.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:46.631+0000 7eff0b7fe640 1 --2- 172.21.15.44:0/1448340117 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7eff0c103410 0x7eff0c198690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:46.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:46.631+0000 7eff0bfff640 1 -- 172.21.15.44:0/1448340117 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7eff0c107fd0 msgr2=0x7eff0c19ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:46.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:46.631+0000 7eff0bfff640 1 --2- 172.21.15.44:0/1448340117 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7eff0c107fd0 0x7eff0c19ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:46.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:46.631+0000 7eff0bfff640 1 -- 172.21.15.44:0/1448340117 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7eff0c103410 msgr2=0x7eff0c198690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:46.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:46.631+0000 7eff0bfff640 1 --2- 172.21.15.44:0/1448340117 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7eff0c103410 0x7eff0c198690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:46.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:46.631+0000 7eff0bfff640 1 -- 172.21.15.44:0/1448340117 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff0c19d100 con 0x7eff0c102a60 2024-08-19T00:11:46.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:46.631+0000 7eff10900640 1 --2- 172.21.15.44:0/1448340117 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7eff0c107fd0 0x7eff0c19ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:11:46.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:46.632+0000 7eff0bfff640 1 --2- 172.21.15.44:0/1448340117 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff0c102a60 0x7eff0c198150 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7efefc00c920 tx=0x7efefc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:46.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:46.632+0000 7eff097fa640 1 -- 172.21.15.44:0/1448340117 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efefc007c70 con 0x7eff0c102a60 2024-08-19T00:11:46.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:46.632+0000 7eff097fa640 1 -- 172.21.15.44:0/1448340117 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efefc007e10 con 0x7eff0c102a60 2024-08-19T00:11:46.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:46.632+0000 7eff12363640 1 -- 172.21.15.44:0/1448340117 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff0c19d3f0 con 0x7eff0c102a60 2024-08-19T00:11:46.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:46.632+0000 7eff097fa640 1 -- 172.21.15.44:0/1448340117 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efefc018890 con 0x7eff0c102a60 2024-08-19T00:11:46.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:46.632+0000 7eff12363640 1 -- 172.21.15.44:0/1448340117 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff0c1a4cd0 con 0x7eff0c102a60 2024-08-19T00:11:46.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:46.633+0000 7eff12363640 1 -- 172.21.15.44:0/1448340117 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff0c102e40 con 0x7eff0c102a60 2024-08-19T00:11:46.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:46.634+0000 7eff097fa640 1 -- 172.21.15.44:0/1448340117 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7efefc018b30 con 0x7eff0c102a60 2024-08-19T00:11:46.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:46.635+0000 7eff097fa640 1 --2- 172.21.15.44:0/1448340117 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7efef40a2c90 0x7efef40a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:46.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:46.635+0000 7eff097fa640 1 -- 172.21.15.44:0/1448340117 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7efefc0cf620 con 0x7eff0c102a60 2024-08-19T00:11:46.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:46.635+0000 7eff0b7fe640 1 --2- 172.21.15.44:0/1448340117 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7efef40a2c90 0x7efef40a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:46.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:46.635+0000 7eff0b7fe640 1 --2- 172.21.15.44:0/1448340117 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7efef40a2c90 0x7efef40a5150 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7eff0c0fd890 tx=0x7eff0000c4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:46.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:46.640+0000 7eff097fa640 1 -- 172.21.15.44:0/1448340117 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7efefc014030 con 0x7eff0c102a60 2024-08-19T00:11:46.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:46.868+0000 7eff12363640 1 -- 172.21.15.44:0/1448340117 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7eff0c1a4f60 con 0x7eff0c102a60 2024-08-19T00:11:46.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:46.869+0000 7eff097fa640 1 -- 172.21.15.44:0/1448340117 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11989 (secure 0 0 0) 0x7efefc018e20 con 0x7eff0c102a60 2024-08-19T00:11:46.870 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:11:46.871 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":27,"btime":"2024-08-19T00:11:36:898699+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14511,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1538841896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1538841896},{"type":"v1","addr":"172.21.15.116:6833","nonce":1538841896}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/4044471606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4044471606},{"type":"v1","addr":"172.21.15.44:6835","nonce":4044471606}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-19T00:10:53.196636+0000","modified":"2024-08-19T00:11:36.898676+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24473,"mds_1":24446,"mds_2":24439,"mds_3":24431,"mds_4":24418},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14529":{"gid":14529,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6837/1824829052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1824829052},{"type":"v1","addr":"172.21.15.44:6837","nonce":1824829052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14577":{"gid":14577,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6839/3591739042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":3591739042},{"type":"v1","addr":"172.21.15.44:6839","nonce":3591739042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14589":{"gid":14589,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6841/3667695717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6840","nonce":3667695717},{"type":"v1","addr":"172.21.15.44:6841","nonce":3667695717}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24388":{"gid":24388,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1183022838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1183022838},{"type":"v1","addr":"172.21.15.171:6833","nonce":1183022838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6835/2190623851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":2190623851},{"type":"v1","addr":"172.21.15.171:6835","nonce":2190623851}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.171:6837/316231795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":316231795},{"type":"v1","addr":"172.21.15.171:6837","nonce":316231795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":20,"addr":"172.21.15.116:6835/3507399322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3507399322},{"type":"v1","addr":"172.21.15.116:6835","nonce":3507399322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.171:6839/1466585795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":1466585795},{"type":"v1","addr":"172.21.15.171:6839","nonce":1466585795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":17,"addr":"172.21.15.116:6837/2764513846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":2764513846},{"type":"v1","addr":"172.21.15.116:6837","nonce":2764513846}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.116:6839/1032741033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":1032741033},{"type":"v1","addr":"172.21.15.116:6839","nonce":1032741033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24446,24439,24431,24418]},"id":1}]} 2024-08-19T00:11:46.871 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 27 2024-08-19T00:11:46.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:46.871+0000 7eff12363640 1 -- 172.21.15.44:0/1448340117 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7efef40a2c90 msgr2=0x7efef40a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:46.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:46.871+0000 7eff12363640 1 --2- 172.21.15.44:0/1448340117 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7efef40a2c90 0x7efef40a5150 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7eff0c0fd890 tx=0x7eff0000c4a0 comp rx=0 tx=0).stop 2024-08-19T00:11:46.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:46.871+0000 7eff12363640 1 -- 172.21.15.44:0/1448340117 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff0c102a60 msgr2=0x7eff0c198150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:46.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:46.871+0000 7eff12363640 1 --2- 172.21.15.44:0/1448340117 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff0c102a60 0x7eff0c198150 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7efefc00c920 tx=0x7efefc00cde0 comp rx=0 tx=0).stop 2024-08-19T00:11:46.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:46.871+0000 7eff12363640 1 -- 172.21.15.44:0/1448340117 shutdown_connections 2024-08-19T00:11:46.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:46.871+0000 7eff12363640 1 --2- 172.21.15.44:0/1448340117 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7efef40a2c90 0x7efef40a5150 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:46.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:46.871+0000 7eff12363640 1 --2- 172.21.15.44:0/1448340117 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7eff0c107fd0 0x7eff0c19ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:46.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:46.871+0000 7eff12363640 1 --2- 172.21.15.44:0/1448340117 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7eff0c103410 0x7eff0c198690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:46.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:46.871+0000 7eff12363640 1 --2- 172.21.15.44:0/1448340117 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff0c102a60 0x7eff0c198150 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:46.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:46.871+0000 7eff12363640 1 -- 172.21.15.44:0/1448340117 >> 172.21.15.44:0/1448340117 conn(0x7eff0c0fc500 msgr2=0x7eff0c0fe0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:46.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:46.872+0000 7eff12363640 1 -- 172.21.15.44:0/1448340117 shutdown_connections 2024-08-19T00:11:46.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:46.872+0000 7eff12363640 1 -- 172.21.15.44:0/1448340117 wait complete. 2024-08-19T00:11:47.191 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:46 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:11:47.191 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:46 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/1448340117' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:11:47.194 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:46 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:11:47.195 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:46 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/1448340117' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:11:47.209 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:46 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:11:47.209 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:46 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/1448340117' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:11:47.611 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-19T00:11:48.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:47 smithi171 ceph-mon[21810]: pgmap v296: 129 pgs: 129 active+clean; 625 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.4 KiB/s wr, 21 op/s; 13 B/s, 0 objects/s recovering 2024-08-19T00:11:48.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:47 smithi116 ceph-mon[21873]: pgmap v296: 129 pgs: 129 active+clean; 625 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.4 KiB/s wr, 21 op/s; 13 B/s, 0 objects/s recovering 2024-08-19T00:11:48.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:47 smithi044 ceph-mon[18489]: pgmap v296: 129 pgs: 129 active+clean; 625 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.4 KiB/s wr, 21 op/s; 13 B/s, 0 objects/s recovering 2024-08-19T00:11:48.419 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:11:48.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:48.893+0000 7fcac756f640 1 -- 172.21.15.44:0/3872598391 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcac01128c0 msgr2=0x7fcac0114cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:48.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:48.893+0000 7fcac756f640 1 --2- 172.21.15.44:0/3872598391 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcac01128c0 0x7fcac0114cb0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fcab8009ca0 tx=0x7fcab802a950 comp rx=0 tx=0).stop 2024-08-19T00:11:48.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:48.893+0000 7fcac756f640 1 -- 172.21.15.44:0/3872598391 shutdown_connections 2024-08-19T00:11:48.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:48.893+0000 7fcac756f640 1 --2- 172.21.15.44:0/3872598391 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcac01128c0 0x7fcac0114cb0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:48.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:48.893+0000 7fcac756f640 1 --2- 172.21.15.44:0/3872598391 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcac0074be0 0x7fcac0112380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:48.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:48.893+0000 7fcac756f640 1 --2- 172.21.15.44:0/3872598391 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcac00742c0 0x7fcac00746a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:48.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:48.893+0000 7fcac756f640 1 -- 172.21.15.44:0/3872598391 >> 172.21.15.44:0/3872598391 conn(0x7fcac00fd5f0 msgr2=0x7fcac00ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:48.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:48.893+0000 7fcac756f640 1 -- 172.21.15.44:0/3872598391 shutdown_connections 2024-08-19T00:11:48.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:48.893+0000 7fcac756f640 1 -- 172.21.15.44:0/3872598391 wait complete. 2024-08-19T00:11:48.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:48.893+0000 7fcac756f640 1 Processor -- start 2024-08-19T00:11:48.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:48.893+0000 7fcac756f640 1 -- start start 2024-08-19T00:11:48.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:48.894+0000 7fcac756f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcac00742c0 0x7fcac01a4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:48.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:48.894+0000 7fcac756f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcac0074be0 0x7fcac01a4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:48.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:48.894+0000 7fcac756f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcac01128c0 0x7fcac019e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:48.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:48.894+0000 7fcac756f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fcac0118290 con 0x7fcac0074be0 2024-08-19T00:11:48.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:48.894+0000 7fcac756f640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fcac0118110 con 0x7fcac01128c0 2024-08-19T00:11:48.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:48.894+0000 7fcac756f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fcac0118410 con 0x7fcac00742c0 2024-08-19T00:11:48.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:48.894+0000 7fcac4b0a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcac0074be0 0x7fcac01a4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:48.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:48.894+0000 7fcac4b0a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcac0074be0 0x7fcac01a4940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37266/0 (socket says 172.21.15.44:37266) 2024-08-19T00:11:48.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:48.894+0000 7fcac4b0a640 1 -- 172.21.15.44:0/1448016032 learned_addr learned my addr 172.21.15.44:0/1448016032 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:11:48.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:48.894+0000 7fcac5b0c640 1 --2- 172.21.15.44:0/1448016032 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcac01128c0 0x7fcac019e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:48.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:48.894+0000 7fcac4b0a640 1 -- 172.21.15.44:0/1448016032 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcac00742c0 msgr2=0x7fcac01a4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:48.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:48.894+0000 7fcac4b0a640 1 --2- 172.21.15.44:0/1448016032 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcac00742c0 0x7fcac01a4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:48.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:48.894+0000 7fcac4b0a640 1 -- 172.21.15.44:0/1448016032 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcac01128c0 msgr2=0x7fcac019e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:48.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:48.894+0000 7fcac4b0a640 1 --2- 172.21.15.44:0/1448016032 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcac01128c0 0x7fcac019e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:48.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:48.894+0000 7fcac4b0a640 1 -- 172.21.15.44:0/1448016032 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcac019ecf0 con 0x7fcac0074be0 2024-08-19T00:11:48.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:48.894+0000 7fcac4b0a640 1 --2- 172.21.15.44:0/1448016032 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcac0074be0 0x7fcac01a4940 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fcab000d950 tx=0x7fcab000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:48.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:48.894+0000 7fcab67fc640 1 -- 172.21.15.44:0/1448016032 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab0017030 con 0x7fcac0074be0 2024-08-19T00:11:48.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:48.894+0000 7fcab67fc640 1 -- 172.21.15.44:0/1448016032 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcab0004020 con 0x7fcac0074be0 2024-08-19T00:11:48.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:48.894+0000 7fcac756f640 1 -- 172.21.15.44:0/1448016032 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcac019efe0 con 0x7fcac0074be0 2024-08-19T00:11:48.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:48.894+0000 7fcab67fc640 1 -- 172.21.15.44:0/1448016032 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab00047a0 con 0x7fcac0074be0 2024-08-19T00:11:48.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:48.894+0000 7fcac756f640 1 -- 172.21.15.44:0/1448016032 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcac01ab2d0 con 0x7fcac0074be0 2024-08-19T00:11:48.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:48.895+0000 7fcac756f640 1 -- 172.21.15.44:0/1448016032 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcac00746a0 con 0x7fcac0074be0 2024-08-19T00:11:48.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:48.896+0000 7fcab67fc640 1 -- 172.21.15.44:0/1448016032 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fcab00041d0 con 0x7fcac0074be0 2024-08-19T00:11:48.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:48.897+0000 7fcab67fc640 1 --2- 172.21.15.44:0/1448016032 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fcaac0a2c90 0x7fcaac0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:48.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:48.897+0000 7fcac530b640 1 --2- 172.21.15.44:0/1448016032 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fcaac0a2c90 0x7fcaac0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:48.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:48.897+0000 7fcab67fc640 1 -- 172.21.15.44:0/1448016032 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fcab00ceeb0 con 0x7fcac0074be0 2024-08-19T00:11:48.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:48.898+0000 7fcac530b640 1 --2- 172.21.15.44:0/1448016032 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fcaac0a2c90 0x7fcaac0a5150 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fcabc0058c0 tx=0x7fcabc005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:48.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:48.901+0000 7fcab67fc640 1 -- 172.21.15.44:0/1448016032 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fcab009b950 con 0x7fcac0074be0 2024-08-19T00:11:49.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:49.110+0000 7fcac756f640 1 -- 172.21.15.44:0/1448016032 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcac019faf0 con 0x7fcac0074be0 2024-08-19T00:11:49.112 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:49 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:11:49.112 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:49 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:11:49.112 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:49 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:11:49.112 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:49 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:11:49.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:49.112+0000 7fcab67fc640 1 -- 172.21.15.44:0/1448016032 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+24642 (secure 0 0 0) 0x7fcab009b250 con 0x7fcac0074be0 2024-08-19T00:11:49.114 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:11:49.114 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":92,"fsid":"647ded64-5dbe-11ef-bccf-c7b262605968","created":"2024-08-19T00:03:43.667929+0000","modified":"2024-08-19T00:11:39.902854+0000","last_up_change":"2024-08-19T00:10:01.557590+0000","last_in_change":"2024-08-19T00:09:42.433933+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T00:06:42.706553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-19T00:10:48.735065+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-19T00:10:51.481810+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-19T00:10:58.013004+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b15ad904-d07d-4ecb-be8f-d99323425eed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":600251465},{"type":"v1","addr":"172.21.15.44:6803","nonce":600251465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":600251465},{"type":"v1","addr":"172.21.15.44:6805","nonce":600251465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":600251465},{"type":"v1","addr":"172.21.15.44:6809","nonce":600251465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":600251465},{"type":"v1","addr":"172.21.15.44:6807","nonce":600251465}]},"public_addr":"172.21.15.44:6803/600251465","cluster_addr":"172.21.15.44:6805/600251465","heartbeat_back_addr":"172.21.15.44:6809/600251465","heartbeat_front_addr":"172.21.15.44:6807/600251465","state":["exists","up"]},{"osd":1,"uuid":"8f70512f-21a3-4fec-8278-04b2bc9b2d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":613509556},{"type":"v1","addr":"172.21.15.116:6801","nonce":613509556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":613509556},{"type":"v1","addr":"172.21.15.116:6803","nonce":613509556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":613509556},{"type":"v1","addr":"172.21.15.116:6807","nonce":613509556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":613509556},{"type":"v1","addr":"172.21.15.116:6805","nonce":613509556}]},"public_addr":"172.21.15.116:6801/613509556","cluster_addr":"172.21.15.116:6803/613509556","heartbeat_back_addr":"172.21.15.116:6807/613509556","heartbeat_front_addr":"172.21.15.116:6805/613509556","state":["exists","up"]},{"osd":2,"uuid":"56994dfd-5fcf-4d82-addf-38764239d82a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2130938937},{"type":"v1","addr":"172.21.15.171:6801","nonce":2130938937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2130938937},{"type":"v1","addr":"172.21.15.171:6803","nonce":2130938937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2130938937},{"type":"v1","addr":"172.21.15.171:6807","nonce":2130938937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2130938937},{"type":"v1","addr":"172.21.15.171:6805","nonce":2130938937}]},"public_addr":"172.21.15.171:6801/2130938937","cluster_addr":"172.21.15.171:6803/2130938937","heartbeat_back_addr":"172.21.15.171:6807/2130938937","heartbeat_front_addr":"172.21.15.171:6805/2130938937","state":["exists","up"]},{"osd":3,"uuid":"6d2ddb19-74e0-4e68-b9ea-58b73fd1e9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":3537027669},{"type":"v1","addr":"172.21.15.44:6811","nonce":3537027669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":3537027669},{"type":"v1","addr":"172.21.15.44:6813","nonce":3537027669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3537027669},{"type":"v1","addr":"172.21.15.44:6817","nonce":3537027669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":3537027669},{"type":"v1","addr":"172.21.15.44:6815","nonce":3537027669}]},"public_addr":"172.21.15.44:6811/3537027669","cluster_addr":"172.21.15.44:6813/3537027669","heartbeat_back_addr":"172.21.15.44:6817/3537027669","heartbeat_front_addr":"172.21.15.44:6815/3537027669","state":["exists","up"]},{"osd":4,"uuid":"190d208e-ae54-497d-ad72-d07a5a26991b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":3768627455},{"type":"v1","addr":"172.21.15.116:6809","nonce":3768627455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":3768627455},{"type":"v1","addr":"172.21.15.116:6811","nonce":3768627455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":3768627455},{"type":"v1","addr":"172.21.15.116:6815","nonce":3768627455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":3768627455},{"type":"v1","addr":"172.21.15.116:6813","nonce":3768627455}]},"public_addr":"172.21.15.116:6809/3768627455","cluster_addr":"172.21.15.116:6811/3768627455","heartbeat_back_addr":"172.21.15.116:6815/3768627455","heartbeat_front_addr":"172.21.15.116:6813/3768627455","state":["exists","up"]},{"osd":5,"uuid":"d8afacad-6d3d-4703-9744-8d01ff2a2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":938785018},{"type":"v1","addr":"172.21.15.171:6809","nonce":938785018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":938785018},{"type":"v1","addr":"172.21.15.171:6811","nonce":938785018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":938785018},{"type":"v1","addr":"172.21.15.171:6815","nonce":938785018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":938785018},{"type":"v1","addr":"172.21.15.171:6813","nonce":938785018}]},"public_addr":"172.21.15.171:6809/938785018","cluster_addr":"172.21.15.171:6811/938785018","heartbeat_back_addr":"172.21.15.171:6815/938785018","heartbeat_front_addr":"172.21.15.171:6813/938785018","state":["exists","up"]},{"osd":6,"uuid":"55bf1f89-99e5-409d-99fa-f0124aa042df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":1219334797},{"type":"v1","addr":"172.21.15.44:6819","nonce":1219334797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":1219334797},{"type":"v1","addr":"172.21.15.44:6821","nonce":1219334797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":1219334797},{"type":"v1","addr":"172.21.15.44:6825","nonce":1219334797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":1219334797},{"type":"v1","addr":"172.21.15.44:6823","nonce":1219334797}]},"public_addr":"172.21.15.44:6819/1219334797","cluster_addr":"172.21.15.44:6821/1219334797","heartbeat_back_addr":"172.21.15.44:6825/1219334797","heartbeat_front_addr":"172.21.15.44:6823/1219334797","state":["exists","up"]},{"osd":7,"uuid":"70130d71-d28c-4a58-b603-75610c8d3ea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":3861873415},{"type":"v1","addr":"172.21.15.116:6817","nonce":3861873415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":3861873415},{"type":"v1","addr":"172.21.15.116:6819","nonce":3861873415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":3861873415},{"type":"v1","addr":"172.21.15.116:6823","nonce":3861873415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":3861873415},{"type":"v1","addr":"172.21.15.116:6821","nonce":3861873415}]},"public_addr":"172.21.15.116:6817/3861873415","cluster_addr":"172.21.15.116:6819/3861873415","heartbeat_back_addr":"172.21.15.116:6823/3861873415","heartbeat_front_addr":"172.21.15.116:6821/3861873415","state":["exists","up"]},{"osd":8,"uuid":"c5121f70-e423-4f86-a3c6-90945c9385f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":843701060},{"type":"v1","addr":"172.21.15.171:6817","nonce":843701060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":843701060},{"type":"v1","addr":"172.21.15.171:6819","nonce":843701060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":843701060},{"type":"v1","addr":"172.21.15.171:6823","nonce":843701060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":843701060},{"type":"v1","addr":"172.21.15.171:6821","nonce":843701060}]},"public_addr":"172.21.15.171:6817/843701060","cluster_addr":"172.21.15.171:6819/843701060","heartbeat_back_addr":"172.21.15.171:6823/843701060","heartbeat_front_addr":"172.21.15.171:6821/843701060","state":["exists","up"]},{"osd":9,"uuid":"cd13693a-0f25-47cc-b1a5-9c42481935ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3206550013},{"type":"v1","addr":"172.21.15.44:6827","nonce":3206550013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":3206550013},{"type":"v1","addr":"172.21.15.44:6829","nonce":3206550013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3206550013},{"type":"v1","addr":"172.21.15.44:6833","nonce":3206550013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3206550013},{"type":"v1","addr":"172.21.15.44:6831","nonce":3206550013}]},"public_addr":"172.21.15.44:6827/3206550013","cluster_addr":"172.21.15.44:6829/3206550013","heartbeat_back_addr":"172.21.15.44:6833/3206550013","heartbeat_front_addr":"172.21.15.44:6831/3206550013","state":["exists","up"]},{"osd":10,"uuid":"a36ffeb1-6ecf-4899-bdfa-18515afefb86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3034738363},{"type":"v1","addr":"172.21.15.116:6825","nonce":3034738363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3034738363},{"type":"v1","addr":"172.21.15.116:6827","nonce":3034738363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3034738363},{"type":"v1","addr":"172.21.15.116:6831","nonce":3034738363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3034738363},{"type":"v1","addr":"172.21.15.116:6829","nonce":3034738363}]},"public_addr":"172.21.15.116:6825/3034738363","cluster_addr":"172.21.15.116:6827/3034738363","heartbeat_back_addr":"172.21.15.116:6831/3034738363","heartbeat_front_addr":"172.21.15.116:6829/3034738363","state":["exists","up"]},{"osd":11,"uuid":"ffcf44a8-3094-4a29-822e-a6ce95da119e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1500842656},{"type":"v1","addr":"172.21.15.171:6825","nonce":1500842656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1500842656},{"type":"v1","addr":"172.21.15.171:6827","nonce":1500842656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1500842656},{"type":"v1","addr":"172.21.15.171:6831","nonce":1500842656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1500842656},{"type":"v1","addr":"172.21.15.171:6829","nonce":1500842656}]},"public_addr":"172.21.15.171:6825/1500842656","cluster_addr":"172.21.15.171:6827/1500842656","heartbeat_back_addr":"172.21.15.171:6831/1500842656","heartbeat_front_addr":"172.21.15.171:6829/1500842656","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:05:56.916127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:06:17.603805+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:06:38.642970+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:07:00.667062+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:07:22.542529+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:07:44.732304+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:08:07.050742+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:08:29.451498+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:08:52.222169+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:09:15.422629+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:09:37.295311+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:09:59.716431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6800/1300308907":"2024-08-20T00:04:38.392912+0000","172.21.15.44:0/1001446555":"2024-08-20T00:04:38.392912+0000","172.21.15.44:0/3800526625":"2024-08-20T00:04:38.392912+0000","172.21.15.44:6801/1300308907":"2024-08-20T00:04:38.392912+0000","172.21.15.44:0/3096491642":"2024-08-20T00:04:14.604141+0000","172.21.15.44:0/400419582":"2024-08-20T00:04:38.392912+0000","172.21.15.44:0/1869412718":"2024-08-20T00:04:14.604141+0000","172.21.15.44:6801/1374527587":"2024-08-20T00:04:14.604141+0000","172.21.15.44:0/911382683":"2024-08-20T00:04:14.604141+0000","172.21.15.44:6800/1374527587":"2024-08-20T00:04:14.604141+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:11:49.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:49.114+0000 7fcac756f640 1 -- 172.21.15.44:0/1448016032 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fcaac0a2c90 msgr2=0x7fcaac0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:49.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:49.115+0000 7fcac756f640 1 --2- 172.21.15.44:0/1448016032 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fcaac0a2c90 0x7fcaac0a5150 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fcabc0058c0 tx=0x7fcabc005850 comp rx=0 tx=0).stop 2024-08-19T00:11:49.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:49.115+0000 7fcac756f640 1 -- 172.21.15.44:0/1448016032 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcac0074be0 msgr2=0x7fcac01a4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:49.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:49.115+0000 7fcac756f640 1 --2- 172.21.15.44:0/1448016032 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcac0074be0 0x7fcac01a4940 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fcab000d950 tx=0x7fcab000de10 comp rx=0 tx=0).stop 2024-08-19T00:11:49.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:49.115+0000 7fcac756f640 1 -- 172.21.15.44:0/1448016032 shutdown_connections 2024-08-19T00:11:49.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:49.115+0000 7fcac756f640 1 --2- 172.21.15.44:0/1448016032 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fcaac0a2c90 0x7fcaac0a5150 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:49.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:49.115+0000 7fcac756f640 1 --2- 172.21.15.44:0/1448016032 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcac01128c0 0x7fcac019e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:49.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:49.115+0000 7fcac756f640 1 --2- 172.21.15.44:0/1448016032 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcac0074be0 0x7fcac01a4940 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:49.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:49.115+0000 7fcac756f640 1 --2- 172.21.15.44:0/1448016032 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcac00742c0 0x7fcac01a4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:49.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:49.115+0000 7fcac756f640 1 -- 172.21.15.44:0/1448016032 >> 172.21.15.44:0/1448016032 conn(0x7fcac00fd5f0 msgr2=0x7fcac00fed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:49.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:49.115+0000 7fcac756f640 1 -- 172.21.15.44:0/1448016032 shutdown_connections 2024-08-19T00:11:49.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:49.115+0000 7fcac756f640 1 -- 172.21.15.44:0/1448016032 wait complete. 2024-08-19T00:11:49.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:49 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:11:49.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:49 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:11:49.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:49 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:11:49.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:49 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:11:49.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:49 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:11:49.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:49 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:11:49.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:49 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:11:49.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:49 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:11:49.871 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-08-19T00:11:49.871 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph pg dump --format=json 2024-08-19T00:11:50.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:50 smithi044 ceph-mon[18489]: pgmap v297: 129 pgs: 129 active+clean; 625 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.4 KiB/s wr, 19 op/s; 11 B/s, 0 objects/s recovering 2024-08-19T00:11:50.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:50 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/1448016032' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-19T00:11:50.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:50 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:11:50.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:50 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:11:50.140 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:11:50.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:50 smithi171 ceph-mon[21810]: pgmap v297: 129 pgs: 129 active+clean; 625 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.4 KiB/s wr, 19 op/s; 11 B/s, 0 objects/s recovering 2024-08-19T00:11:50.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:50 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/1448016032' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-19T00:11:50.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:50 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:11:50.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:50 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:11:50.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:50 smithi116 ceph-mon[21873]: pgmap v297: 129 pgs: 129 active+clean; 625 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.4 KiB/s wr, 19 op/s; 11 B/s, 0 objects/s recovering 2024-08-19T00:11:50.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:50 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/1448016032' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-19T00:11:50.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:50 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:11:50.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:50 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:11:50.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:50.679+0000 7fb4aa415640 1 -- 172.21.15.44:0/3330830890 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4a41022a0 msgr2=0x7fb4a41026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:50.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:50.679+0000 7fb4aa415640 1 --2- 172.21.15.44:0/3330830890 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4a41022a0 0x7fb4a41026e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb498009900 tx=0x7fb49802a480 comp rx=0 tx=0).stop 2024-08-19T00:11:50.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:50.679+0000 7fb4aa415640 1 -- 172.21.15.44:0/3330830890 shutdown_connections 2024-08-19T00:11:50.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:50.679+0000 7fb4aa415640 1 --2- 172.21.15.44:0/3330830890 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb4a4102c20 0x7fb4a410d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:50.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:50.679+0000 7fb4aa415640 1 --2- 172.21.15.44:0/3330830890 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4a41022a0 0x7fb4a41026e0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:50.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:50.679+0000 7fb4aa415640 1 --2- 172.21.15.44:0/3330830890 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb4a4100b50 0x7fb4a4100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:50.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:50.679+0000 7fb4aa415640 1 -- 172.21.15.44:0/3330830890 >> 172.21.15.44:0/3330830890 conn(0x7fb4a40fc500 msgr2=0x7fb4a40fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:50.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:50.679+0000 7fb4aa415640 1 -- 172.21.15.44:0/3330830890 shutdown_connections 2024-08-19T00:11:50.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:50.679+0000 7fb4aa415640 1 -- 172.21.15.44:0/3330830890 wait complete. 2024-08-19T00:11:50.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:50.680+0000 7fb4aa415640 1 Processor -- start 2024-08-19T00:11:50.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:50.680+0000 7fb4aa415640 1 -- start start 2024-08-19T00:11:50.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:50.680+0000 7fb4aa415640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb4a4100b50 0x7fb4a410df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:50.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:50.680+0000 7fb4aa415640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4a41022a0 0x7fb4a410e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:50.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:50.680+0000 7fb4aa415640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb4a4102c20 0x7fb4a410e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:50.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:50.680+0000 7fb4aa415640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a4111dc0 con 0x7fb4a41022a0 2024-08-19T00:11:50.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:50.680+0000 7fb4aa415640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a4111c40 con 0x7fb4a4100b50 2024-08-19T00:11:50.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:50.680+0000 7fb4aa415640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a4111f40 con 0x7fb4a4102c20 2024-08-19T00:11:50.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:50.680+0000 7fb4a37fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4a41022a0 0x7fb4a410e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:50.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:50.680+0000 7fb4a37fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4a41022a0 0x7fb4a410e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37274/0 (socket says 172.21.15.44:37274) 2024-08-19T00:11:50.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:50.680+0000 7fb4a3fff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb4a4100b50 0x7fb4a410df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:50.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:50.681+0000 7fb4a37fe640 1 -- 172.21.15.44:0/1082247440 learned_addr learned my addr 172.21.15.44:0/1082247440 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:11:50.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:50.681+0000 7fb4a89b2640 1 --2- 172.21.15.44:0/1082247440 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb4a4102c20 0x7fb4a410e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:50.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:50.681+0000 7fb4a37fe640 1 -- 172.21.15.44:0/1082247440 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb4a4102c20 msgr2=0x7fb4a410e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:50.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:50.681+0000 7fb4a37fe640 1 --2- 172.21.15.44:0/1082247440 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb4a4102c20 0x7fb4a410e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:50.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:50.681+0000 7fb4a37fe640 1 -- 172.21.15.44:0/1082247440 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb4a4100b50 msgr2=0x7fb4a410df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:50.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:50.681+0000 7fb4a37fe640 1 --2- 172.21.15.44:0/1082247440 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb4a4100b50 0x7fb4a410df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:50.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:50.681+0000 7fb4a37fe640 1 -- 172.21.15.44:0/1082247440 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4a41a6690 con 0x7fb4a41022a0 2024-08-19T00:11:50.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:50.681+0000 7fb4a3fff640 1 --2- 172.21.15.44:0/1082247440 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb4a4100b50 0x7fb4a410df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:11:50.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:50.681+0000 7fb4a89b2640 1 --2- 172.21.15.44:0/1082247440 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb4a4102c20 0x7fb4a410e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:11:50.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:50.681+0000 7fb4a37fe640 1 --2- 172.21.15.44:0/1082247440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4a41022a0 0x7fb4a410e440 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb498006010 tx=0x7fb498003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:50.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:50.681+0000 7fb4a17fa640 1 -- 172.21.15.44:0/1082247440 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb49803f070 con 0x7fb4a41022a0 2024-08-19T00:11:50.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:50.681+0000 7fb4aa415640 1 -- 172.21.15.44:0/1082247440 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4a41a6920 con 0x7fb4a41022a0 2024-08-19T00:11:50.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:50.681+0000 7fb4a17fa640 1 -- 172.21.15.44:0/1082247440 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb498031c30 con 0x7fb4a41022a0 2024-08-19T00:11:50.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:50.681+0000 7fb4a17fa640 1 -- 172.21.15.44:0/1082247440 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb498035030 con 0x7fb4a41022a0 2024-08-19T00:11:50.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:50.681+0000 7fb4aa415640 1 -- 172.21.15.44:0/1082247440 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4a41a6e50 con 0x7fb4a41022a0 2024-08-19T00:11:50.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:50.683+0000 7fb4aa415640 1 -- 172.21.15.44:0/1082247440 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4a4100f30 con 0x7fb4a41022a0 2024-08-19T00:11:50.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:50.684+0000 7fb4a17fa640 1 -- 172.21.15.44:0/1082247440 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fb498042070 con 0x7fb4a41022a0 2024-08-19T00:11:50.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:50.685+0000 7fb4a17fa640 1 --2- 172.21.15.44:0/1082247440 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fb48c0a2c10 0x7fb48c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:50.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:50.685+0000 7fb4a3fff640 1 --2- 172.21.15.44:0/1082247440 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fb48c0a2c10 0x7fb48c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:50.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:50.685+0000 7fb4a17fa640 1 -- 172.21.15.44:0/1082247440 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fb4980efb80 con 0x7fb4a41022a0 2024-08-19T00:11:50.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:50.685+0000 7fb4a3fff640 1 --2- 172.21.15.44:0/1082247440 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fb48c0a2c10 0x7fb48c0a50d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb494005d00 tx=0x7fb49400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:50.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:50.689+0000 7fb4a17fa640 1 -- 172.21.15.44:0/1082247440 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fb4980bbfd0 con 0x7fb4a41022a0 2024-08-19T00:11:50.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:50.862+0000 7fb4aa415640 1 -- 172.21.15.44:0/1082247440 --> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb4a4062360 con 0x7fb48c0a2c10 2024-08-19T00:11:50.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:50.871+0000 7fb4a17fa640 1 -- 172.21.15.44:0/1082247440 <== mgr.14150 v2:172.21.15.44:6800/1330072146 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340397 (secure 0 0 0) 0x7fb4a4062360 con 0x7fb48c0a2c10 2024-08-19T00:11:50.876 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:11:50.878 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-08-19T00:11:50.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:50.874+0000 7fb4aa415640 1 -- 172.21.15.44:0/1082247440 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fb48c0a2c10 msgr2=0x7fb48c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:50.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:50.874+0000 7fb4aa415640 1 --2- 172.21.15.44:0/1082247440 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fb48c0a2c10 0x7fb48c0a50d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb494005d00 tx=0x7fb49400b410 comp rx=0 tx=0).stop 2024-08-19T00:11:50.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:50.874+0000 7fb4aa415640 1 -- 172.21.15.44:0/1082247440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4a41022a0 msgr2=0x7fb4a410e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:50.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:50.874+0000 7fb4aa415640 1 --2- 172.21.15.44:0/1082247440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4a41022a0 0x7fb4a410e440 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb498006010 tx=0x7fb498003c10 comp rx=0 tx=0).stop 2024-08-19T00:11:50.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:50.874+0000 7fb4aa415640 1 -- 172.21.15.44:0/1082247440 shutdown_connections 2024-08-19T00:11:50.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:50.874+0000 7fb4aa415640 1 --2- 172.21.15.44:0/1082247440 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fb48c0a2c10 0x7fb48c0a50d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:50.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:50.874+0000 7fb4aa415640 1 --2- 172.21.15.44:0/1082247440 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb4a4102c20 0x7fb4a410e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:50.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:50.874+0000 7fb4aa415640 1 --2- 172.21.15.44:0/1082247440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4a41022a0 0x7fb4a410e440 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:50.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:50.874+0000 7fb4aa415640 1 --2- 172.21.15.44:0/1082247440 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb4a4100b50 0x7fb4a410df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:50.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:50.874+0000 7fb4aa415640 1 -- 172.21.15.44:0/1082247440 >> 172.21.15.44:0/1082247440 conn(0x7fb4a40fc500 msgr2=0x7fb4a40fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:50.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:50.874+0000 7fb4aa415640 1 -- 172.21.15.44:0/1082247440 shutdown_connections 2024-08-19T00:11:50.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:50.874+0000 7fb4aa415640 1 -- 172.21.15.44:0/1082247440 wait complete. 2024-08-19T00:11:51.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:51 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:11:51.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:51 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:11:51.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:51 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:11:51.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:51 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:11:51.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:51 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:11:51.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:51 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:11:51.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:51 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:11:51.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:51 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:11:51.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:51 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:11:51.643 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":298,"stamp":"2024-08-19T00:11:50.477998+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":651414,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":297,"num_read_kb":271,"num_write":422,"num_write_kb":3069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1180848,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":346,"ondisk_log_size":346,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":392784,"kb_used_data":14492,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124549040,"statfs":{"total":1151940427776,"available":1151538216960,"internally_reserved":0,"allocated":14839808,"data_stored":8136309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":387233081},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":50907,"num_objects":8,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":147,"num_read_kb":138,"num_write":44,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.568901"},"pg_stats":[{"pgid":"2.1f","version":"90'13","reported_seq":60,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:46.929534+0000","last_change":"2024-08-19T00:10:50.471635+0000","last_active":"2024-08-19T00:11:46.929534+0000","last_peered":"2024-08-19T00:11:46.929534+0000","last_clean":"2024-08-19T00:11:46.929534+0000","last_became_active":"2024-08-19T00:10:50.471324+0000","last_became_peered":"2024-08-19T00:10:50.471324+0000","last_unstale":"2024-08-19T00:11:46.929534+0000","last_undegraded":"2024-08-19T00:11:46.929534+0000","last_fullsized":"2024-08-19T00:11:46.929534+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:41:02.945782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.923007+0000","last_change":"2024-08-19T00:11:39.922459+0000","last_active":"2024-08-19T00:11:39.923007+0000","last_peered":"2024-08-19T00:11:39.923007+0000","last_clean":"2024-08-19T00:11:39.923007+0000","last_became_active":"2024-08-19T00:11:39.922091+0000","last_became_peered":"2024-08-19T00:11:39.922091+0000","last_unstale":"2024-08-19T00:11:39.923007+0000","last_undegraded":"2024-08-19T00:11:39.923007+0000","last_fullsized":"2024-08-19T00:11:39.923007+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:14:21.785736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915284+0000","last_change":"2024-08-19T00:10:59.789370+0000","last_active":"2024-08-19T00:11:39.915284+0000","last_peered":"2024-08-19T00:11:39.915284+0000","last_clean":"2024-08-19T00:11:39.915284+0000","last_became_active":"2024-08-19T00:10:59.788901+0000","last_became_peered":"2024-08-19T00:10:59.788901+0000","last_unstale":"2024-08-19T00:11:39.915284+0000","last_undegraded":"2024-08-19T00:11:39.915284+0000","last_fullsized":"2024-08-19T00:11:39.915284+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:15:45.247674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"90'2","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916313+0000","last_change":"2024-08-19T00:10:50.618000+0000","last_active":"2024-08-19T00:11:39.916313+0000","last_peered":"2024-08-19T00:11:39.916313+0000","last_clean":"2024-08-19T00:11:39.916313+0000","last_became_active":"2024-08-19T00:10:50.617648+0000","last_became_peered":"2024-08-19T00:10:50.617648+0000","last_unstale":"2024-08-19T00:11:39.916313+0000","last_undegraded":"2024-08-19T00:11:39.916313+0000","last_fullsized":"2024-08-19T00:11:39.916313+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:39:00.310466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915973+0000","last_change":"2024-08-19T00:10:52.518075+0000","last_active":"2024-08-19T00:11:39.915973+0000","last_peered":"2024-08-19T00:11:39.915973+0000","last_clean":"2024-08-19T00:11:39.915973+0000","last_became_active":"2024-08-19T00:10:52.517735+0000","last_became_peered":"2024-08-19T00:10:52.517735+0000","last_unstale":"2024-08-19T00:11:39.915973+0000","last_undegraded":"2024-08-19T00:11:39.915973+0000","last_fullsized":"2024-08-19T00:11:39.915973+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:02:32.657776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916011+0000","last_change":"2024-08-19T00:10:59.787563+0000","last_active":"2024-08-19T00:11:39.916011+0000","last_peered":"2024-08-19T00:11:39.916011+0000","last_clean":"2024-08-19T00:11:39.916011+0000","last_became_active":"2024-08-19T00:10:59.787143+0000","last_became_peered":"2024-08-19T00:10:59.787143+0000","last_unstale":"2024-08-19T00:11:39.916011+0000","last_undegraded":"2024-08-19T00:11:39.916011+0000","last_fullsized":"2024-08-19T00:11:39.916011+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:41:47.101296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"90'12","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913715+0000","last_change":"2024-08-19T00:10:50.475869+0000","last_active":"2024-08-19T00:11:39.913715+0000","last_peered":"2024-08-19T00:11:39.913715+0000","last_clean":"2024-08-19T00:11:39.913715+0000","last_became_active":"2024-08-19T00:10:50.475550+0000","last_became_peered":"2024-08-19T00:10:50.475550+0000","last_unstale":"2024-08-19T00:11:39.913715+0000","last_undegraded":"2024-08-19T00:11:39.913715+0000","last_fullsized":"2024-08-19T00:11:39.913715+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:47:23.724503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913510+0000","last_change":"2024-08-19T00:10:52.511901+0000","last_active":"2024-08-19T00:11:39.913510+0000","last_peered":"2024-08-19T00:11:39.913510+0000","last_clean":"2024-08-19T00:11:39.913510+0000","last_became_active":"2024-08-19T00:10:52.511595+0000","last_became_peered":"2024-08-19T00:10:52.511595+0000","last_unstale":"2024-08-19T00:11:39.913510+0000","last_undegraded":"2024-08-19T00:11:39.913510+0000","last_fullsized":"2024-08-19T00:11:39.913510+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:57:30.613865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916330+0000","last_change":"2024-08-19T00:10:59.785611+0000","last_active":"2024-08-19T00:11:39.916330+0000","last_peered":"2024-08-19T00:11:39.916330+0000","last_clean":"2024-08-19T00:11:39.916330+0000","last_became_active":"2024-08-19T00:10:59.785105+0000","last_became_peered":"2024-08-19T00:10:59.785105+0000","last_unstale":"2024-08-19T00:11:39.916330+0000","last_undegraded":"2024-08-19T00:11:39.916330+0000","last_fullsized":"2024-08-19T00:11:39.916330+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:05:31.007647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"90'5","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.914125+0000","last_change":"2024-08-19T00:10:50.474439+0000","last_active":"2024-08-19T00:11:39.914125+0000","last_peered":"2024-08-19T00:11:39.914125+0000","last_clean":"2024-08-19T00:11:39.914125+0000","last_became_active":"2024-08-19T00:10:50.473984+0000","last_became_peered":"2024-08-19T00:10:50.473984+0000","last_unstale":"2024-08-19T00:11:39.914125+0000","last_undegraded":"2024-08-19T00:11:39.914125+0000","last_fullsized":"2024-08-19T00:11:39.914125+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:16:06.934392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.918999+0000","last_change":"2024-08-19T00:10:52.521664+0000","last_active":"2024-08-19T00:11:39.918999+0000","last_peered":"2024-08-19T00:11:39.918999+0000","last_clean":"2024-08-19T00:11:39.918999+0000","last_became_active":"2024-08-19T00:10:52.520792+0000","last_became_peered":"2024-08-19T00:10:52.520792+0000","last_unstale":"2024-08-19T00:11:39.918999+0000","last_undegraded":"2024-08-19T00:11:39.918999+0000","last_fullsized":"2024-08-19T00:11:39.918999+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:55:27.199456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915652+0000","last_change":"2024-08-19T00:10:59.789736+0000","last_active":"2024-08-19T00:11:39.915652+0000","last_peered":"2024-08-19T00:11:39.915652+0000","last_clean":"2024-08-19T00:11:39.915652+0000","last_became_active":"2024-08-19T00:10:59.786880+0000","last_became_peered":"2024-08-19T00:10:59.786880+0000","last_unstale":"2024-08-19T00:11:39.915652+0000","last_undegraded":"2024-08-19T00:11:39.915652+0000","last_fullsized":"2024-08-19T00:11:39.915652+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:20:53.615561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920522+0000","last_change":"2024-08-19T00:10:52.519887+0000","last_active":"2024-08-19T00:11:39.920522+0000","last_peered":"2024-08-19T00:11:39.920522+0000","last_clean":"2024-08-19T00:11:39.920522+0000","last_became_active":"2024-08-19T00:10:52.519550+0000","last_became_peered":"2024-08-19T00:10:52.519550+0000","last_unstale":"2024-08-19T00:11:39.920522+0000","last_undegraded":"2024-08-19T00:11:39.920522+0000","last_fullsized":"2024-08-19T00:11:39.920522+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:27:43.493012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"90'4","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.912400+0000","last_change":"2024-08-19T00:10:50.478131+0000","last_active":"2024-08-19T00:11:39.912400+0000","last_peered":"2024-08-19T00:11:39.912400+0000","last_clean":"2024-08-19T00:11:39.912400+0000","last_became_active":"2024-08-19T00:10:50.477826+0000","last_became_peered":"2024-08-19T00:10:50.477826+0000","last_unstale":"2024-08-19T00:11:39.912400+0000","last_undegraded":"2024-08-19T00:11:39.912400+0000","last_fullsized":"2024-08-19T00:11:39.912400+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:41:24.066453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915909+0000","last_change":"2024-08-19T00:10:59.787634+0000","last_active":"2024-08-19T00:11:39.915909+0000","last_peered":"2024-08-19T00:11:39.915909+0000","last_clean":"2024-08-19T00:11:39.915909+0000","last_became_active":"2024-08-19T00:10:59.786508+0000","last_became_peered":"2024-08-19T00:10:59.786508+0000","last_unstale":"2024-08-19T00:11:39.915909+0000","last_undegraded":"2024-08-19T00:11:39.915909+0000","last_fullsized":"2024-08-19T00:11:39.915909+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:50:19.071853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915968+0000","last_change":"2024-08-19T00:10:52.512462+0000","last_active":"2024-08-19T00:11:39.915968+0000","last_peered":"2024-08-19T00:11:39.915968+0000","last_clean":"2024-08-19T00:11:39.915968+0000","last_became_active":"2024-08-19T00:10:52.512139+0000","last_became_peered":"2024-08-19T00:10:52.512139+0000","last_unstale":"2024-08-19T00:11:39.915968+0000","last_undegraded":"2024-08-19T00:11:39.915968+0000","last_fullsized":"2024-08-19T00:11:39.915968+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:39:18.677836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"90'3","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.930568+0000","last_change":"2024-08-19T00:11:39.930130+0000","last_active":"2024-08-19T00:11:39.930568+0000","last_peered":"2024-08-19T00:11:39.930568+0000","last_clean":"2024-08-19T00:11:39.930568+0000","last_became_active":"2024-08-19T00:11:39.919566+0000","last_became_peered":"2024-08-19T00:11:39.919566+0000","last_unstale":"2024-08-19T00:11:39.930568+0000","last_undegraded":"2024-08-19T00:11:39.930568+0000","last_fullsized":"2024-08-19T00:11:39.930568+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:50:25.001784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"92'1","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915887+0000","last_change":"2024-08-19T00:10:59.787455+0000","last_active":"2024-08-19T00:11:39.915887+0000","last_peered":"2024-08-19T00:11:39.915887+0000","last_clean":"2024-08-19T00:11:39.915887+0000","last_became_active":"2024-08-19T00:10:59.787054+0000","last_became_peered":"2024-08-19T00:10:59.787054+0000","last_unstale":"2024-08-19T00:11:39.915887+0000","last_undegraded":"2024-08-19T00:11:39.915887+0000","last_fullsized":"2024-08-19T00:11:39.915887+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:13:31.356220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.912686+0000","last_change":"2024-08-19T00:10:52.520993+0000","last_active":"2024-08-19T00:11:39.912686+0000","last_peered":"2024-08-19T00:11:39.912686+0000","last_clean":"2024-08-19T00:11:39.912686+0000","last_became_active":"2024-08-19T00:10:52.520697+0000","last_became_peered":"2024-08-19T00:10:52.520697+0000","last_unstale":"2024-08-19T00:11:39.912686+0000","last_undegraded":"2024-08-19T00:11:39.912686+0000","last_fullsized":"2024-08-19T00:11:39.912686+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:30:15.408193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915912+0000","last_change":"2024-08-19T00:10:50.470746+0000","last_active":"2024-08-19T00:11:39.915912+0000","last_peered":"2024-08-19T00:11:39.915912+0000","last_clean":"2024-08-19T00:11:39.915912+0000","last_became_active":"2024-08-19T00:10:50.470454+0000","last_became_peered":"2024-08-19T00:10:50.470454+0000","last_unstale":"2024-08-19T00:11:39.915912+0000","last_undegraded":"2024-08-19T00:11:39.915912+0000","last_fullsized":"2024-08-19T00:11:39.915912+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:37:34.718543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.924217+0000","last_change":"2024-08-19T00:11:39.924217+0000","last_active":"2024-08-19T00:11:39.924217+0000","last_peered":"2024-08-19T00:11:39.924217+0000","last_clean":"2024-08-19T00:11:39.924217+0000","last_became_active":"2024-08-19T00:11:39.923541+0000","last_became_peered":"2024-08-19T00:11:39.923541+0000","last_unstale":"2024-08-19T00:11:39.924217+0000","last_undegraded":"2024-08-19T00:11:39.924217+0000","last_fullsized":"2024-08-19T00:11:39.924217+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:29:35.040424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,2,5],"acting":[8,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.914173+0000","last_change":"2024-08-19T00:10:52.516838+0000","last_active":"2024-08-19T00:11:39.914173+0000","last_peered":"2024-08-19T00:11:39.914173+0000","last_clean":"2024-08-19T00:11:39.914173+0000","last_became_active":"2024-08-19T00:10:52.516471+0000","last_became_peered":"2024-08-19T00:10:52.516471+0000","last_unstale":"2024-08-19T00:11:39.914173+0000","last_undegraded":"2024-08-19T00:11:39.914173+0000","last_fullsized":"2024-08-19T00:11:39.914173+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:11:26.974655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"90'2","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913384+0000","last_change":"2024-08-19T00:10:50.618745+0000","last_active":"2024-08-19T00:11:39.913384+0000","last_peered":"2024-08-19T00:11:39.913384+0000","last_clean":"2024-08-19T00:11:39.913384+0000","last_became_active":"2024-08-19T00:10:50.618426+0000","last_became_peered":"2024-08-19T00:10:50.618426+0000","last_unstale":"2024-08-19T00:11:39.913384+0000","last_undegraded":"2024-08-19T00:11:39.913384+0000","last_fullsized":"2024-08-19T00:11:39.913384+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:12:57.777142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916210+0000","last_change":"2024-08-19T00:10:59.793740+0000","last_active":"2024-08-19T00:11:39.916210+0000","last_peered":"2024-08-19T00:11:39.916210+0000","last_clean":"2024-08-19T00:11:39.916210+0000","last_became_active":"2024-08-19T00:10:59.793181+0000","last_became_peered":"2024-08-19T00:10:59.793181+0000","last_unstale":"2024-08-19T00:11:39.916210+0000","last_undegraded":"2024-08-19T00:11:39.916210+0000","last_fullsized":"2024-08-19T00:11:39.916210+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:04:15.429505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916583+0000","last_change":"2024-08-19T00:10:52.512200+0000","last_active":"2024-08-19T00:11:39.916583+0000","last_peered":"2024-08-19T00:11:39.916583+0000","last_clean":"2024-08-19T00:11:39.916583+0000","last_became_active":"2024-08-19T00:10:52.511891+0000","last_became_peered":"2024-08-19T00:10:52.511891+0000","last_unstale":"2024-08-19T00:11:39.916583+0000","last_undegraded":"2024-08-19T00:11:39.916583+0000","last_fullsized":"2024-08-19T00:11:39.916583+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:02:08.400026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"90'7","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916624+0000","last_change":"2024-08-19T00:10:50.476209+0000","last_active":"2024-08-19T00:11:39.916624+0000","last_peered":"2024-08-19T00:11:39.916624+0000","last_clean":"2024-08-19T00:11:39.916624+0000","last_became_active":"2024-08-19T00:10:50.475410+0000","last_became_peered":"2024-08-19T00:10:50.475410+0000","last_unstale":"2024-08-19T00:11:39.916624+0000","last_undegraded":"2024-08-19T00:11:39.916624+0000","last_fullsized":"2024-08-19T00:11:39.916624+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:46:25.093738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915425+0000","last_change":"2024-08-19T00:10:59.786550+0000","last_active":"2024-08-19T00:11:39.915425+0000","last_peered":"2024-08-19T00:11:39.915425+0000","last_clean":"2024-08-19T00:11:39.915425+0000","last_became_active":"2024-08-19T00:10:59.785531+0000","last_became_peered":"2024-08-19T00:10:59.785531+0000","last_unstale":"2024-08-19T00:11:39.915425+0000","last_undegraded":"2024-08-19T00:11:39.915425+0000","last_fullsized":"2024-08-19T00:11:39.915425+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:59:53.605678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916210+0000","last_change":"2024-08-19T00:10:52.514936+0000","last_active":"2024-08-19T00:11:39.916210+0000","last_peered":"2024-08-19T00:11:39.916210+0000","last_clean":"2024-08-19T00:11:39.916210+0000","last_became_active":"2024-08-19T00:10:52.514597+0000","last_became_peered":"2024-08-19T00:10:52.514597+0000","last_unstale":"2024-08-19T00:11:39.916210+0000","last_undegraded":"2024-08-19T00:11:39.916210+0000","last_fullsized":"2024-08-19T00:11:39.916210+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:03:42.275705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"92'13","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:46.513854+0000","last_change":"2024-08-19T00:10:50.470637+0000","last_active":"2024-08-19T00:11:46.513854+0000","last_peered":"2024-08-19T00:11:46.513854+0000","last_clean":"2024-08-19T00:11:46.513854+0000","last_became_active":"2024-08-19T00:10:50.470276+0000","last_became_peered":"2024-08-19T00:10:50.470276+0000","last_unstale":"2024-08-19T00:11:46.513854+0000","last_undegraded":"2024-08-19T00:11:46.513854+0000","last_fullsized":"2024-08-19T00:11:46.513854+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:42:16.186669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.914936+0000","last_change":"2024-08-19T00:10:59.784742+0000","last_active":"2024-08-19T00:11:39.914936+0000","last_peered":"2024-08-19T00:11:39.914936+0000","last_clean":"2024-08-19T00:11:39.914936+0000","last_became_active":"2024-08-19T00:10:59.784372+0000","last_became_peered":"2024-08-19T00:10:59.784372+0000","last_unstale":"2024-08-19T00:11:39.914936+0000","last_undegraded":"2024-08-19T00:11:39.914936+0000","last_fullsized":"2024-08-19T00:11:39.914936+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:58:03.216882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913098+0000","last_change":"2024-08-19T00:10:52.511172+0000","last_active":"2024-08-19T00:11:39.913098+0000","last_peered":"2024-08-19T00:11:39.913098+0000","last_clean":"2024-08-19T00:11:39.913098+0000","last_became_active":"2024-08-19T00:10:52.510816+0000","last_became_peered":"2024-08-19T00:10:52.510816+0000","last_unstale":"2024-08-19T00:11:39.913098+0000","last_undegraded":"2024-08-19T00:11:39.913098+0000","last_fullsized":"2024-08-19T00:11:39.913098+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:31:39.889398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"90'4","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.927139+0000","last_change":"2024-08-19T00:11:39.926806+0000","last_active":"2024-08-19T00:11:39.927139+0000","last_peered":"2024-08-19T00:11:39.927139+0000","last_clean":"2024-08-19T00:11:39.927139+0000","last_became_active":"2024-08-19T00:11:39.917115+0000","last_became_peered":"2024-08-19T00:11:39.917115+0000","last_unstale":"2024-08-19T00:11:39.927139+0000","last_undegraded":"2024-08-19T00:11:39.927139+0000","last_fullsized":"2024-08-19T00:11:39.927139+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:58:19.965471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913673+0000","last_change":"2024-08-19T00:10:59.778996+0000","last_active":"2024-08-19T00:11:39.913673+0000","last_peered":"2024-08-19T00:11:39.913673+0000","last_clean":"2024-08-19T00:11:39.913673+0000","last_became_active":"2024-08-19T00:10:59.778589+0000","last_became_peered":"2024-08-19T00:10:59.778589+0000","last_unstale":"2024-08-19T00:11:39.913673+0000","last_undegraded":"2024-08-19T00:11:39.913673+0000","last_fullsized":"2024-08-19T00:11:39.913673+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:40:23.690051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.911105+0000","last_change":"2024-08-19T00:10:52.512796+0000","last_active":"2024-08-19T00:11:39.911105+0000","last_peered":"2024-08-19T00:11:39.911105+0000","last_clean":"2024-08-19T00:11:39.911105+0000","last_became_active":"2024-08-19T00:10:52.512459+0000","last_became_peered":"2024-08-19T00:10:52.512459+0000","last_unstale":"2024-08-19T00:11:39.911105+0000","last_undegraded":"2024-08-19T00:11:39.911105+0000","last_fullsized":"2024-08-19T00:11:39.911105+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:07:47.124129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"90'1","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.910569+0000","last_change":"2024-08-19T00:10:50.618118+0000","last_active":"2024-08-19T00:11:39.910569+0000","last_peered":"2024-08-19T00:11:39.910569+0000","last_clean":"2024-08-19T00:11:39.910569+0000","last_became_active":"2024-08-19T00:10:50.617759+0000","last_became_peered":"2024-08-19T00:10:50.617759+0000","last_unstale":"2024-08-19T00:11:39.910569+0000","last_undegraded":"2024-08-19T00:11:39.910569+0000","last_fullsized":"2024-08-19T00:11:39.910569+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:38:10.830722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913921+0000","last_change":"2024-08-19T00:10:59.783548+0000","last_active":"2024-08-19T00:11:39.913921+0000","last_peered":"2024-08-19T00:11:39.913921+0000","last_clean":"2024-08-19T00:11:39.913921+0000","last_became_active":"2024-08-19T00:10:59.783091+0000","last_became_peered":"2024-08-19T00:10:59.783091+0000","last_unstale":"2024-08-19T00:11:39.913921+0000","last_undegraded":"2024-08-19T00:11:39.913921+0000","last_fullsized":"2024-08-19T00:11:39.913921+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:26:21.191829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.911097+0000","last_change":"2024-08-19T00:10:52.506703+0000","last_active":"2024-08-19T00:11:39.911097+0000","last_peered":"2024-08-19T00:11:39.911097+0000","last_clean":"2024-08-19T00:11:39.911097+0000","last_became_active":"2024-08-19T00:10:52.506350+0000","last_became_peered":"2024-08-19T00:10:52.506350+0000","last_unstale":"2024-08-19T00:11:39.911097+0000","last_undegraded":"2024-08-19T00:11:39.911097+0000","last_fullsized":"2024-08-19T00:11:39.911097+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:27:17.556128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"90'5","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:44.927335+0000","last_change":"2024-08-19T00:10:50.478742+0000","last_active":"2024-08-19T00:11:44.927335+0000","last_peered":"2024-08-19T00:11:44.927335+0000","last_clean":"2024-08-19T00:11:44.927335+0000","last_became_active":"2024-08-19T00:10:50.478139+0000","last_became_peered":"2024-08-19T00:10:50.478139+0000","last_unstale":"2024-08-19T00:11:44.927335+0000","last_undegraded":"2024-08-19T00:11:44.927335+0000","last_fullsized":"2024-08-19T00:11:44.927335+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:23:25.727268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.912795+0000","last_change":"2024-08-19T00:10:59.785350+0000","last_active":"2024-08-19T00:11:39.912795+0000","last_peered":"2024-08-19T00:11:39.912795+0000","last_clean":"2024-08-19T00:11:39.912795+0000","last_became_active":"2024-08-19T00:10:59.784929+0000","last_became_peered":"2024-08-19T00:10:59.784929+0000","last_unstale":"2024-08-19T00:11:39.912795+0000","last_undegraded":"2024-08-19T00:11:39.912795+0000","last_fullsized":"2024-08-19T00:11:39.912795+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:58:49.878253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.924921+0000","last_change":"2024-08-19T00:11:39.924921+0000","last_active":"2024-08-19T00:11:39.924921+0000","last_peered":"2024-08-19T00:11:39.924921+0000","last_clean":"2024-08-19T00:11:39.924921+0000","last_became_active":"2024-08-19T00:11:39.924551+0000","last_became_peered":"2024-08-19T00:11:39.924551+0000","last_unstale":"2024-08-19T00:11:39.924921+0000","last_undegraded":"2024-08-19T00:11:39.924921+0000","last_fullsized":"2024-08-19T00:11:39.924921+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:14:23.042222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"90'5","reported_seq":53,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:47.925734+0000","last_change":"2024-08-19T00:10:50.618159+0000","last_active":"2024-08-19T00:11:47.925734+0000","last_peered":"2024-08-19T00:11:47.925734+0000","last_clean":"2024-08-19T00:11:47.925734+0000","last_became_active":"2024-08-19T00:10:50.617828+0000","last_became_peered":"2024-08-19T00:10:50.617828+0000","last_unstale":"2024-08-19T00:11:47.925734+0000","last_undegraded":"2024-08-19T00:11:47.925734+0000","last_fullsized":"2024-08-19T00:11:47.925734+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:36:40.702592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913006+0000","last_change":"2024-08-19T00:10:59.787615+0000","last_active":"2024-08-19T00:11:39.913006+0000","last_peered":"2024-08-19T00:11:39.913006+0000","last_clean":"2024-08-19T00:11:39.913006+0000","last_became_active":"2024-08-19T00:10:59.787184+0000","last_became_peered":"2024-08-19T00:10:59.787184+0000","last_unstale":"2024-08-19T00:11:39.913006+0000","last_undegraded":"2024-08-19T00:11:39.913006+0000","last_fullsized":"2024-08-19T00:11:39.913006+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:20:42.174337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.912608+0000","last_change":"2024-08-19T00:10:52.509235+0000","last_active":"2024-08-19T00:11:39.912608+0000","last_peered":"2024-08-19T00:11:39.912608+0000","last_clean":"2024-08-19T00:11:39.912608+0000","last_became_active":"2024-08-19T00:10:52.508934+0000","last_became_peered":"2024-08-19T00:10:52.508934+0000","last_unstale":"2024-08-19T00:11:39.912608+0000","last_undegraded":"2024-08-19T00:11:39.912608+0000","last_fullsized":"2024-08-19T00:11:39.912608+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:12:59.654711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"90'4","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920451+0000","last_change":"2024-08-19T00:10:50.477180+0000","last_active":"2024-08-19T00:11:39.920451+0000","last_peered":"2024-08-19T00:11:39.920451+0000","last_clean":"2024-08-19T00:11:39.920451+0000","last_became_active":"2024-08-19T00:10:50.476875+0000","last_became_peered":"2024-08-19T00:10:50.476875+0000","last_unstale":"2024-08-19T00:11:39.920451+0000","last_undegraded":"2024-08-19T00:11:39.920451+0000","last_fullsized":"2024-08-19T00:11:39.920451+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:15:57.383599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.919963+0000","last_change":"2024-08-19T00:10:59.783389+0000","last_active":"2024-08-19T00:11:39.919963+0000","last_peered":"2024-08-19T00:11:39.919963+0000","last_clean":"2024-08-19T00:11:39.919963+0000","last_became_active":"2024-08-19T00:10:59.782983+0000","last_became_peered":"2024-08-19T00:10:59.782983+0000","last_unstale":"2024-08-19T00:11:39.919963+0000","last_undegraded":"2024-08-19T00:11:39.919963+0000","last_fullsized":"2024-08-19T00:11:39.919963+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:55:47.419588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916143+0000","last_change":"2024-08-19T00:10:52.517477+0000","last_active":"2024-08-19T00:11:39.916143+0000","last_peered":"2024-08-19T00:11:39.916143+0000","last_clean":"2024-08-19T00:11:39.916143+0000","last_became_active":"2024-08-19T00:10:52.517192+0000","last_became_peered":"2024-08-19T00:10:52.517192+0000","last_unstale":"2024-08-19T00:11:39.916143+0000","last_undegraded":"2024-08-19T00:11:39.916143+0000","last_fullsized":"2024-08-19T00:11:39.916143+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:31:01.125780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"90'6","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916486+0000","last_change":"2024-08-19T00:10:50.476296+0000","last_active":"2024-08-19T00:11:39.916486+0000","last_peered":"2024-08-19T00:11:39.916486+0000","last_clean":"2024-08-19T00:11:39.916486+0000","last_became_active":"2024-08-19T00:10:50.475835+0000","last_became_peered":"2024-08-19T00:10:50.475835+0000","last_unstale":"2024-08-19T00:11:39.916486+0000","last_undegraded":"2024-08-19T00:11:39.916486+0000","last_fullsized":"2024-08-19T00:11:39.916486+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:23:27.585779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":362,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920604+0000","last_change":"2024-08-19T00:09:43.445224+0000","last_active":"2024-08-19T00:11:39.920604+0000","last_peered":"2024-08-19T00:11:39.920604+0000","last_clean":"2024-08-19T00:11:39.920604+0000","last_became_active":"2024-08-19T00:09:43.444826+0000","last_became_peered":"2024-08-19T00:09:43.444826+0000","last_unstale":"2024-08-19T00:11:39.920604+0000","last_undegraded":"2024-08-19T00:11:39.920604+0000","last_fullsized":"2024-08-19T00:11:39.920604+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:06:42.707047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:06:42.707047+0000","last_clean_scrub_stamp":"2024-08-19T00:06:42.707047+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:37:10.588547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"92'1","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920770+0000","last_change":"2024-08-19T00:10:59.783987+0000","last_active":"2024-08-19T00:11:39.920770+0000","last_peered":"2024-08-19T00:11:39.920770+0000","last_clean":"2024-08-19T00:11:39.920770+0000","last_became_active":"2024-08-19T00:10:59.783569+0000","last_became_peered":"2024-08-19T00:10:59.783569+0000","last_unstale":"2024-08-19T00:11:39.920770+0000","last_undegraded":"2024-08-19T00:11:39.920770+0000","last_fullsized":"2024-08-19T00:11:39.920770+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:04:01.744644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920907+0000","last_change":"2024-08-19T00:10:52.516201+0000","last_active":"2024-08-19T00:11:39.920907+0000","last_peered":"2024-08-19T00:11:39.920907+0000","last_clean":"2024-08-19T00:11:39.920907+0000","last_became_active":"2024-08-19T00:10:52.515871+0000","last_became_peered":"2024-08-19T00:10:52.515871+0000","last_unstale":"2024-08-19T00:11:39.920907+0000","last_undegraded":"2024-08-19T00:11:39.920907+0000","last_fullsized":"2024-08-19T00:11:39.920907+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:54:49.528215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"90'5","reported_seq":51,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:44.925127+0000","last_change":"2024-08-19T00:10:50.620185+0000","last_active":"2024-08-19T00:11:44.925127+0000","last_peered":"2024-08-19T00:11:44.925127+0000","last_clean":"2024-08-19T00:11:44.925127+0000","last_became_active":"2024-08-19T00:10:50.619858+0000","last_became_peered":"2024-08-19T00:10:50.619858+0000","last_unstale":"2024-08-19T00:11:44.925127+0000","last_undegraded":"2024-08-19T00:11:44.925127+0000","last_fullsized":"2024-08-19T00:11:44.925127+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:30:21.893859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913286+0000","last_change":"2024-08-19T00:10:59.782056+0000","last_active":"2024-08-19T00:11:39.913286+0000","last_peered":"2024-08-19T00:11:39.913286+0000","last_clean":"2024-08-19T00:11:39.913286+0000","last_became_active":"2024-08-19T00:10:59.781666+0000","last_became_peered":"2024-08-19T00:10:59.781666+0000","last_unstale":"2024-08-19T00:11:39.913286+0000","last_undegraded":"2024-08-19T00:11:39.913286+0000","last_fullsized":"2024-08-19T00:11:39.913286+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:06:15.614372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920745+0000","last_change":"2024-08-19T00:10:52.523346+0000","last_active":"2024-08-19T00:11:39.920745+0000","last_peered":"2024-08-19T00:11:39.920745+0000","last_clean":"2024-08-19T00:11:39.920745+0000","last_became_active":"2024-08-19T00:10:52.523020+0000","last_became_peered":"2024-08-19T00:10:52.523020+0000","last_unstale":"2024-08-19T00:11:39.920745+0000","last_undegraded":"2024-08-19T00:11:39.920745+0000","last_fullsized":"2024-08-19T00:11:39.920745+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:09:58.259666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"90'3","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.919270+0000","last_change":"2024-08-19T00:10:50.471739+0000","last_active":"2024-08-19T00:11:39.919270+0000","last_peered":"2024-08-19T00:11:39.919270+0000","last_clean":"2024-08-19T00:11:39.919270+0000","last_became_active":"2024-08-19T00:10:50.471425+0000","last_became_peered":"2024-08-19T00:10:50.471425+0000","last_unstale":"2024-08-19T00:11:39.919270+0000","last_undegraded":"2024-08-19T00:11:39.919270+0000","last_fullsized":"2024-08-19T00:11:39.919270+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:55:26.332380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916291+0000","last_change":"2024-08-19T00:10:59.788685+0000","last_active":"2024-08-19T00:11:39.916291+0000","last_peered":"2024-08-19T00:11:39.916291+0000","last_clean":"2024-08-19T00:11:39.916291+0000","last_became_active":"2024-08-19T00:10:59.788343+0000","last_became_peered":"2024-08-19T00:10:59.788343+0000","last_unstale":"2024-08-19T00:11:39.916291+0000","last_undegraded":"2024-08-19T00:11:39.916291+0000","last_fullsized":"2024-08-19T00:11:39.916291+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:20:59.595494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920867+0000","last_change":"2024-08-19T00:10:52.516469+0000","last_active":"2024-08-19T00:11:39.920867+0000","last_peered":"2024-08-19T00:11:39.920867+0000","last_clean":"2024-08-19T00:11:39.920867+0000","last_became_active":"2024-08-19T00:10:52.516093+0000","last_became_peered":"2024-08-19T00:10:52.516093+0000","last_unstale":"2024-08-19T00:11:39.920867+0000","last_undegraded":"2024-08-19T00:11:39.920867+0000","last_fullsized":"2024-08-19T00:11:39.920867+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:18:29.327336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"90'5","reported_seq":51,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.921825+0000","last_change":"2024-08-19T00:11:39.921825+0000","last_active":"2024-08-19T00:11:39.921825+0000","last_peered":"2024-08-19T00:11:39.921825+0000","last_clean":"2024-08-19T00:11:39.921825+0000","last_became_active":"2024-08-19T00:11:39.917689+0000","last_became_peered":"2024-08-19T00:11:39.917689+0000","last_unstale":"2024-08-19T00:11:39.921825+0000","last_undegraded":"2024-08-19T00:11:39.921825+0000","last_fullsized":"2024-08-19T00:11:39.921825+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:37:47.940707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.918104+0000","last_change":"2024-08-19T00:10:59.785347+0000","last_active":"2024-08-19T00:11:39.918104+0000","last_peered":"2024-08-19T00:11:39.918104+0000","last_clean":"2024-08-19T00:11:39.918104+0000","last_became_active":"2024-08-19T00:10:59.784927+0000","last_became_peered":"2024-08-19T00:10:59.784927+0000","last_unstale":"2024-08-19T00:11:39.918104+0000","last_undegraded":"2024-08-19T00:11:39.918104+0000","last_fullsized":"2024-08-19T00:11:39.918104+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:39:41.919021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.912923+0000","last_change":"2024-08-19T00:10:52.524460+0000","last_active":"2024-08-19T00:11:39.912923+0000","last_peered":"2024-08-19T00:11:39.912923+0000","last_clean":"2024-08-19T00:11:39.912923+0000","last_became_active":"2024-08-19T00:10:52.523139+0000","last_became_peered":"2024-08-19T00:10:52.523139+0000","last_unstale":"2024-08-19T00:11:39.912923+0000","last_undegraded":"2024-08-19T00:11:39.912923+0000","last_fullsized":"2024-08-19T00:11:39.912923+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:50:55.142569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"90'2","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.912963+0000","last_change":"2024-08-19T00:10:50.474977+0000","last_active":"2024-08-19T00:11:39.912963+0000","last_peered":"2024-08-19T00:11:39.912963+0000","last_clean":"2024-08-19T00:11:39.912963+0000","last_became_active":"2024-08-19T00:10:50.474653+0000","last_became_peered":"2024-08-19T00:10:50.474653+0000","last_unstale":"2024-08-19T00:11:39.912963+0000","last_undegraded":"2024-08-19T00:11:39.912963+0000","last_fullsized":"2024-08-19T00:11:39.912963+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:20:31.565098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920595+0000","last_change":"2024-08-19T00:10:59.789912+0000","last_active":"2024-08-19T00:11:39.920595+0000","last_peered":"2024-08-19T00:11:39.920595+0000","last_clean":"2024-08-19T00:11:39.920595+0000","last_became_active":"2024-08-19T00:10:59.789143+0000","last_became_peered":"2024-08-19T00:10:59.789143+0000","last_unstale":"2024-08-19T00:11:39.920595+0000","last_undegraded":"2024-08-19T00:11:39.920595+0000","last_fullsized":"2024-08-19T00:11:39.920595+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:06:53.447173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920777+0000","last_change":"2024-08-19T00:10:52.525061+0000","last_active":"2024-08-19T00:11:39.920777+0000","last_peered":"2024-08-19T00:11:39.920777+0000","last_clean":"2024-08-19T00:11:39.920777+0000","last_became_active":"2024-08-19T00:10:52.524752+0000","last_became_peered":"2024-08-19T00:10:52.524752+0000","last_unstale":"2024-08-19T00:11:39.920777+0000","last_undegraded":"2024-08-19T00:11:39.920777+0000","last_fullsized":"2024-08-19T00:11:39.920777+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:50:47.817220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"90'17","reported_seq":52,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913283+0000","last_change":"2024-08-19T00:10:50.618923+0000","last_active":"2024-08-19T00:11:39.913283+0000","last_peered":"2024-08-19T00:11:39.913283+0000","last_clean":"2024-08-19T00:11:39.913283+0000","last_became_active":"2024-08-19T00:10:50.618586+0000","last_became_peered":"2024-08-19T00:10:50.618586+0000","last_unstale":"2024-08-19T00:11:39.913283+0000","last_undegraded":"2024-08-19T00:11:39.913283+0000","last_fullsized":"2024-08-19T00:11:39.913283+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:07:45.186059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913068+0000","last_change":"2024-08-19T00:10:59.785681+0000","last_active":"2024-08-19T00:11:39.913068+0000","last_peered":"2024-08-19T00:11:39.913068+0000","last_clean":"2024-08-19T00:11:39.913068+0000","last_became_active":"2024-08-19T00:10:59.785299+0000","last_became_peered":"2024-08-19T00:10:59.785299+0000","last_unstale":"2024-08-19T00:11:39.913068+0000","last_undegraded":"2024-08-19T00:11:39.913068+0000","last_fullsized":"2024-08-19T00:11:39.913068+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:36:08.151180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920368+0000","last_change":"2024-08-19T00:10:52.523398+0000","last_active":"2024-08-19T00:11:39.920368+0000","last_peered":"2024-08-19T00:11:39.920368+0000","last_clean":"2024-08-19T00:11:39.920368+0000","last_became_active":"2024-08-19T00:10:52.523066+0000","last_became_peered":"2024-08-19T00:10:52.523066+0000","last_unstale":"2024-08-19T00:11:39.920368+0000","last_undegraded":"2024-08-19T00:11:39.920368+0000","last_fullsized":"2024-08-19T00:11:39.920368+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:47:25.137487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"90'5","reported_seq":55,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:48.927436+0000","last_change":"2024-08-19T00:10:50.475827+0000","last_active":"2024-08-19T00:11:48.927436+0000","last_peered":"2024-08-19T00:11:48.927436+0000","last_clean":"2024-08-19T00:11:48.927436+0000","last_became_active":"2024-08-19T00:10:50.475470+0000","last_became_peered":"2024-08-19T00:10:50.475470+0000","last_unstale":"2024-08-19T00:11:48.927436+0000","last_undegraded":"2024-08-19T00:11:48.927436+0000","last_fullsized":"2024-08-19T00:11:48.927436+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:25:14.200317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.910632+0000","last_change":"2024-08-19T00:10:59.789047+0000","last_active":"2024-08-19T00:11:39.910632+0000","last_peered":"2024-08-19T00:11:39.910632+0000","last_clean":"2024-08-19T00:11:39.910632+0000","last_became_active":"2024-08-19T00:10:59.788694+0000","last_became_peered":"2024-08-19T00:10:59.788694+0000","last_unstale":"2024-08-19T00:11:39.910632+0000","last_undegraded":"2024-08-19T00:11:39.910632+0000","last_fullsized":"2024-08-19T00:11:39.910632+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:00:22.463593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920596+0000","last_change":"2024-08-19T00:10:52.511480+0000","last_active":"2024-08-19T00:11:39.920596+0000","last_peered":"2024-08-19T00:11:39.920596+0000","last_clean":"2024-08-19T00:11:39.920596+0000","last_became_active":"2024-08-19T00:10:52.511159+0000","last_became_peered":"2024-08-19T00:10:52.511159+0000","last_unstale":"2024-08-19T00:11:39.920596+0000","last_undegraded":"2024-08-19T00:11:39.920596+0000","last_fullsized":"2024-08-19T00:11:39.920596+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:28:31.136900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"90'5","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.919763+0000","last_change":"2024-08-19T00:10:50.476761+0000","last_active":"2024-08-19T00:11:39.919763+0000","last_peered":"2024-08-19T00:11:39.919763+0000","last_clean":"2024-08-19T00:11:39.919763+0000","last_became_active":"2024-08-19T00:10:50.476455+0000","last_became_peered":"2024-08-19T00:10:50.476455+0000","last_unstale":"2024-08-19T00:11:39.919763+0000","last_undegraded":"2024-08-19T00:11:39.919763+0000","last_fullsized":"2024-08-19T00:11:39.919763+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:34:52.158438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.912580+0000","last_change":"2024-08-19T00:10:59.778313+0000","last_active":"2024-08-19T00:11:39.912580+0000","last_peered":"2024-08-19T00:11:39.912580+0000","last_clean":"2024-08-19T00:11:39.912580+0000","last_became_active":"2024-08-19T00:10:59.777831+0000","last_became_peered":"2024-08-19T00:10:59.777831+0000","last_unstale":"2024-08-19T00:11:39.912580+0000","last_undegraded":"2024-08-19T00:11:39.912580+0000","last_fullsized":"2024-08-19T00:11:39.912580+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:34:05.474277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.912741+0000","last_change":"2024-08-19T00:10:52.513719+0000","last_active":"2024-08-19T00:11:39.912741+0000","last_peered":"2024-08-19T00:11:39.912741+0000","last_clean":"2024-08-19T00:11:39.912741+0000","last_became_active":"2024-08-19T00:10:52.513345+0000","last_became_peered":"2024-08-19T00:10:52.513345+0000","last_unstale":"2024-08-19T00:11:39.912741+0000","last_undegraded":"2024-08-19T00:11:39.912741+0000","last_fullsized":"2024-08-19T00:11:39.912741+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:50:28.862870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"90'9","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916408+0000","last_change":"2024-08-19T00:10:50.475529+0000","last_active":"2024-08-19T00:11:39.916408+0000","last_peered":"2024-08-19T00:11:39.916408+0000","last_clean":"2024-08-19T00:11:39.916408+0000","last_became_active":"2024-08-19T00:10:50.473544+0000","last_became_peered":"2024-08-19T00:10:50.473544+0000","last_unstale":"2024-08-19T00:11:39.916408+0000","last_undegraded":"2024-08-19T00:11:39.916408+0000","last_fullsized":"2024-08-19T00:11:39.916408+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:49:42.663650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.918895+0000","last_change":"2024-08-19T00:10:59.789028+0000","last_active":"2024-08-19T00:11:39.918895+0000","last_peered":"2024-08-19T00:11:39.918895+0000","last_clean":"2024-08-19T00:11:39.918895+0000","last_became_active":"2024-08-19T00:10:59.788606+0000","last_became_peered":"2024-08-19T00:10:59.788606+0000","last_unstale":"2024-08-19T00:11:39.918895+0000","last_undegraded":"2024-08-19T00:11:39.918895+0000","last_fullsized":"2024-08-19T00:11:39.918895+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:59:06.617755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913196+0000","last_change":"2024-08-19T00:10:52.520826+0000","last_active":"2024-08-19T00:11:39.913196+0000","last_peered":"2024-08-19T00:11:39.913196+0000","last_clean":"2024-08-19T00:11:39.913196+0000","last_became_active":"2024-08-19T00:10:52.520437+0000","last_became_peered":"2024-08-19T00:10:52.520437+0000","last_unstale":"2024-08-19T00:11:39.913196+0000","last_undegraded":"2024-08-19T00:11:39.913196+0000","last_fullsized":"2024-08-19T00:11:39.913196+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:30:06.843697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"92'32","reported_seq":101,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:49.943965+0000","last_change":"2024-08-19T00:10:50.473195+0000","last_active":"2024-08-19T00:11:49.943965+0000","last_peered":"2024-08-19T00:11:49.943965+0000","last_clean":"2024-08-19T00:11:49.943965+0000","last_became_active":"2024-08-19T00:10:50.472863+0000","last_became_peered":"2024-08-19T00:10:50.472863+0000","last_unstale":"2024-08-19T00:11:49.943965+0000","last_undegraded":"2024-08-19T00:11:49.943965+0000","last_fullsized":"2024-08-19T00:11:49.943965+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:09:04.859829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54390,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":70,"num_write":34,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.922789+0000","last_change":"2024-08-19T00:11:39.922405+0000","last_active":"2024-08-19T00:11:39.922789+0000","last_peered":"2024-08-19T00:11:39.922789+0000","last_clean":"2024-08-19T00:11:39.922789+0000","last_became_active":"2024-08-19T00:11:39.922054+0000","last_became_peered":"2024-08-19T00:11:39.922054+0000","last_unstale":"2024-08-19T00:11:39.922789+0000","last_undegraded":"2024-08-19T00:11:39.922789+0000","last_fullsized":"2024-08-19T00:11:39.922789+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:47:01.990229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.918080+0000","last_change":"2024-08-19T00:11:39.918080+0000","last_active":"2024-08-19T00:11:39.918080+0000","last_peered":"2024-08-19T00:11:39.918080+0000","last_clean":"2024-08-19T00:11:39.918080+0000","last_became_active":"2024-08-19T00:11:39.917742+0000","last_became_peered":"2024-08-19T00:11:39.917742+0000","last_unstale":"2024-08-19T00:11:39.918080+0000","last_undegraded":"2024-08-19T00:11:39.918080+0000","last_fullsized":"2024-08-19T00:11:39.918080+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:57:19.983148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"90'5","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.919164+0000","last_change":"2024-08-19T00:10:50.618094+0000","last_active":"2024-08-19T00:11:39.919164+0000","last_peered":"2024-08-19T00:11:39.919164+0000","last_clean":"2024-08-19T00:11:39.919164+0000","last_became_active":"2024-08-19T00:10:50.617786+0000","last_became_peered":"2024-08-19T00:10:50.617786+0000","last_unstale":"2024-08-19T00:11:39.919164+0000","last_undegraded":"2024-08-19T00:11:39.919164+0000","last_fullsized":"2024-08-19T00:11:39.919164+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:05:46.231214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915705+0000","last_change":"2024-08-19T00:10:59.780786+0000","last_active":"2024-08-19T00:11:39.915705+0000","last_peered":"2024-08-19T00:11:39.915705+0000","last_clean":"2024-08-19T00:11:39.915705+0000","last_became_active":"2024-08-19T00:10:59.780364+0000","last_became_peered":"2024-08-19T00:10:59.780364+0000","last_unstale":"2024-08-19T00:11:39.915705+0000","last_undegraded":"2024-08-19T00:11:39.915705+0000","last_fullsized":"2024-08-19T00:11:39.915705+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:39:45.113590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916082+0000","last_change":"2024-08-19T00:10:52.520623+0000","last_active":"2024-08-19T00:11:39.916082+0000","last_peered":"2024-08-19T00:11:39.916082+0000","last_clean":"2024-08-19T00:11:39.916082+0000","last_became_active":"2024-08-19T00:10:52.520321+0000","last_became_peered":"2024-08-19T00:10:52.520321+0000","last_unstale":"2024-08-19T00:11:39.916082+0000","last_undegraded":"2024-08-19T00:11:39.916082+0000","last_fullsized":"2024-08-19T00:11:39.916082+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:56:42.526199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"90'4","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920887+0000","last_change":"2024-08-19T00:10:50.474925+0000","last_active":"2024-08-19T00:11:39.920887+0000","last_peered":"2024-08-19T00:11:39.920887+0000","last_clean":"2024-08-19T00:11:39.920887+0000","last_became_active":"2024-08-19T00:10:50.474573+0000","last_became_peered":"2024-08-19T00:10:50.474573+0000","last_unstale":"2024-08-19T00:11:39.920887+0000","last_undegraded":"2024-08-19T00:11:39.920887+0000","last_fullsized":"2024-08-19T00:11:39.920887+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:10:32.136867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920527+0000","last_change":"2024-08-19T00:11:39.920527+0000","last_active":"2024-08-19T00:11:39.920527+0000","last_peered":"2024-08-19T00:11:39.920527+0000","last_clean":"2024-08-19T00:11:39.920527+0000","last_became_active":"2024-08-19T00:11:39.919490+0000","last_became_peered":"2024-08-19T00:11:39.919490+0000","last_unstale":"2024-08-19T00:11:39.920527+0000","last_undegraded":"2024-08-19T00:11:39.920527+0000","last_fullsized":"2024-08-19T00:11:39.920527+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:33:09.191177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913768+0000","last_change":"2024-08-19T00:10:52.510783+0000","last_active":"2024-08-19T00:11:39.913768+0000","last_peered":"2024-08-19T00:11:39.913768+0000","last_clean":"2024-08-19T00:11:39.913768+0000","last_became_active":"2024-08-19T00:10:52.510359+0000","last_became_peered":"2024-08-19T00:10:52.510359+0000","last_unstale":"2024-08-19T00:11:39.913768+0000","last_undegraded":"2024-08-19T00:11:39.913768+0000","last_fullsized":"2024-08-19T00:11:39.913768+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:20:03.682633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"90'4","reported_seq":66,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:49.931185+0000","last_change":"2024-08-19T00:10:50.470887+0000","last_active":"2024-08-19T00:11:49.931185+0000","last_peered":"2024-08-19T00:11:49.931185+0000","last_clean":"2024-08-19T00:11:49.931185+0000","last_became_active":"2024-08-19T00:10:50.470517+0000","last_became_peered":"2024-08-19T00:10:50.470517+0000","last_unstale":"2024-08-19T00:11:49.931185+0000","last_undegraded":"2024-08-19T00:11:49.931185+0000","last_fullsized":"2024-08-19T00:11:49.931185+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:52:33.864552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915676+0000","last_change":"2024-08-19T00:10:59.787686+0000","last_active":"2024-08-19T00:11:39.915676+0000","last_peered":"2024-08-19T00:11:39.915676+0000","last_clean":"2024-08-19T00:11:39.915676+0000","last_became_active":"2024-08-19T00:10:59.787236+0000","last_became_peered":"2024-08-19T00:10:59.787236+0000","last_unstale":"2024-08-19T00:11:39.915676+0000","last_undegraded":"2024-08-19T00:11:39.915676+0000","last_fullsized":"2024-08-19T00:11:39.915676+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:57:11.012865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916402+0000","last_change":"2024-08-19T00:10:59.782541+0000","last_active":"2024-08-19T00:11:39.916402+0000","last_peered":"2024-08-19T00:11:39.916402+0000","last_clean":"2024-08-19T00:11:39.916402+0000","last_became_active":"2024-08-19T00:10:59.782136+0000","last_became_peered":"2024-08-19T00:10:59.782136+0000","last_unstale":"2024-08-19T00:11:39.916402+0000","last_undegraded":"2024-08-19T00:11:39.916402+0000","last_fullsized":"2024-08-19T00:11:39.916402+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:44:39.501168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.910189+0000","last_change":"2024-08-19T00:10:52.509396+0000","last_active":"2024-08-19T00:11:39.910189+0000","last_peered":"2024-08-19T00:11:39.910189+0000","last_clean":"2024-08-19T00:11:39.910189+0000","last_became_active":"2024-08-19T00:10:52.509075+0000","last_became_peered":"2024-08-19T00:10:52.509075+0000","last_unstale":"2024-08-19T00:11:39.910189+0000","last_undegraded":"2024-08-19T00:11:39.910189+0000","last_fullsized":"2024-08-19T00:11:39.910189+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:40:53.611213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"90'3","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920355+0000","last_change":"2024-08-19T00:10:50.476723+0000","last_active":"2024-08-19T00:11:39.920355+0000","last_peered":"2024-08-19T00:11:39.920355+0000","last_clean":"2024-08-19T00:11:39.920355+0000","last_became_active":"2024-08-19T00:10:50.476399+0000","last_became_peered":"2024-08-19T00:10:50.476399+0000","last_unstale":"2024-08-19T00:11:39.920355+0000","last_undegraded":"2024-08-19T00:11:39.920355+0000","last_fullsized":"2024-08-19T00:11:39.920355+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:04:01.951387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913044+0000","last_change":"2024-08-19T00:10:59.781481+0000","last_active":"2024-08-19T00:11:39.913044+0000","last_peered":"2024-08-19T00:11:39.913044+0000","last_clean":"2024-08-19T00:11:39.913044+0000","last_became_active":"2024-08-19T00:10:59.780160+0000","last_became_peered":"2024-08-19T00:10:59.780160+0000","last_unstale":"2024-08-19T00:11:39.913044+0000","last_undegraded":"2024-08-19T00:11:39.913044+0000","last_fullsized":"2024-08-19T00:11:39.913044+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:14:46.340158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915284+0000","last_change":"2024-08-19T00:10:52.516780+0000","last_active":"2024-08-19T00:11:39.915284+0000","last_peered":"2024-08-19T00:11:39.915284+0000","last_clean":"2024-08-19T00:11:39.915284+0000","last_became_active":"2024-08-19T00:10:52.513264+0000","last_became_peered":"2024-08-19T00:10:52.513264+0000","last_unstale":"2024-08-19T00:11:39.915284+0000","last_undegraded":"2024-08-19T00:11:39.915284+0000","last_fullsized":"2024-08-19T00:11:39.915284+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:36:49.238267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"90'3","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.912619+0000","last_change":"2024-08-19T00:10:50.472840+0000","last_active":"2024-08-19T00:11:39.912619+0000","last_peered":"2024-08-19T00:11:39.912619+0000","last_clean":"2024-08-19T00:11:39.912619+0000","last_became_active":"2024-08-19T00:10:50.472534+0000","last_became_peered":"2024-08-19T00:10:50.472534+0000","last_unstale":"2024-08-19T00:11:39.912619+0000","last_undegraded":"2024-08-19T00:11:39.912619+0000","last_fullsized":"2024-08-19T00:11:39.912619+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:41:53.505360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.911662+0000","last_change":"2024-08-19T00:10:50.469342+0000","last_active":"2024-08-19T00:11:39.911662+0000","last_peered":"2024-08-19T00:11:39.911662+0000","last_clean":"2024-08-19T00:11:39.911662+0000","last_became_active":"2024-08-19T00:10:50.468800+0000","last_became_peered":"2024-08-19T00:10:50.468800+0000","last_unstale":"2024-08-19T00:11:39.911662+0000","last_undegraded":"2024-08-19T00:11:39.911662+0000","last_fullsized":"2024-08-19T00:11:39.911662+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:58:28.804117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920904+0000","last_change":"2024-08-19T00:10:52.523634+0000","last_active":"2024-08-19T00:11:39.920904+0000","last_peered":"2024-08-19T00:11:39.920904+0000","last_clean":"2024-08-19T00:11:39.920904+0000","last_became_active":"2024-08-19T00:10:52.523336+0000","last_became_peered":"2024-08-19T00:10:52.523336+0000","last_unstale":"2024-08-19T00:11:39.920904+0000","last_undegraded":"2024-08-19T00:11:39.920904+0000","last_fullsized":"2024-08-19T00:11:39.920904+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:55:08.994124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.922401+0000","last_change":"2024-08-19T00:11:39.922401+0000","last_active":"2024-08-19T00:11:39.922401+0000","last_peered":"2024-08-19T00:11:39.922401+0000","last_clean":"2024-08-19T00:11:39.922401+0000","last_became_active":"2024-08-19T00:11:39.921979+0000","last_became_peered":"2024-08-19T00:11:39.921979+0000","last_unstale":"2024-08-19T00:11:39.922401+0000","last_undegraded":"2024-08-19T00:11:39.922401+0000","last_fullsized":"2024-08-19T00:11:39.922401+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:58:57.453222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,8],"acting":[2,6,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"90'5","reported_seq":51,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:44.930294+0000","last_change":"2024-08-19T00:10:50.476035+0000","last_active":"2024-08-19T00:11:44.930294+0000","last_peered":"2024-08-19T00:11:44.930294+0000","last_clean":"2024-08-19T00:11:44.930294+0000","last_became_active":"2024-08-19T00:10:50.475733+0000","last_became_peered":"2024-08-19T00:10:50.475733+0000","last_unstale":"2024-08-19T00:11:44.930294+0000","last_undegraded":"2024-08-19T00:11:44.930294+0000","last_fullsized":"2024-08-19T00:11:44.930294+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:27:59.026582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.914126+0000","last_change":"2024-08-19T00:10:52.522185+0000","last_active":"2024-08-19T00:11:39.914126+0000","last_peered":"2024-08-19T00:11:39.914126+0000","last_clean":"2024-08-19T00:11:39.914126+0000","last_became_active":"2024-08-19T00:10:52.521747+0000","last_became_peered":"2024-08-19T00:10:52.521747+0000","last_unstale":"2024-08-19T00:11:39.914126+0000","last_undegraded":"2024-08-19T00:11:39.914126+0000","last_fullsized":"2024-08-19T00:11:39.914126+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:14:23.631484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915843+0000","last_change":"2024-08-19T00:10:59.783512+0000","last_active":"2024-08-19T00:11:39.915843+0000","last_peered":"2024-08-19T00:11:39.915843+0000","last_clean":"2024-08-19T00:11:39.915843+0000","last_became_active":"2024-08-19T00:10:59.783099+0000","last_became_peered":"2024-08-19T00:10:59.783099+0000","last_unstale":"2024-08-19T00:11:39.915843+0000","last_undegraded":"2024-08-19T00:11:39.915843+0000","last_fullsized":"2024-08-19T00:11:39.915843+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:02:27.977608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.912816+0000","last_change":"2024-08-19T00:10:52.524213+0000","last_active":"2024-08-19T00:11:39.912816+0000","last_peered":"2024-08-19T00:11:39.912816+0000","last_clean":"2024-08-19T00:11:39.912816+0000","last_became_active":"2024-08-19T00:10:52.523185+0000","last_became_peered":"2024-08-19T00:10:52.523185+0000","last_unstale":"2024-08-19T00:11:39.912816+0000","last_undegraded":"2024-08-19T00:11:39.912816+0000","last_fullsized":"2024-08-19T00:11:39.912816+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:23:48.569312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915774+0000","last_change":"2024-08-19T00:10:52.521436+0000","last_active":"2024-08-19T00:11:39.915774+0000","last_peered":"2024-08-19T00:11:39.915774+0000","last_clean":"2024-08-19T00:11:39.915774+0000","last_became_active":"2024-08-19T00:10:52.520842+0000","last_became_peered":"2024-08-19T00:10:52.520842+0000","last_unstale":"2024-08-19T00:11:39.915774+0000","last_undegraded":"2024-08-19T00:11:39.915774+0000","last_fullsized":"2024-08-19T00:11:39.915774+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:22:31.568680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915897+0000","last_change":"2024-08-19T00:10:52.514170+0000","last_active":"2024-08-19T00:11:39.915897+0000","last_peered":"2024-08-19T00:11:39.915897+0000","last_clean":"2024-08-19T00:11:39.915897+0000","last_became_active":"2024-08-19T00:10:52.513870+0000","last_became_peered":"2024-08-19T00:10:52.513870+0000","last_unstale":"2024-08-19T00:11:39.915897+0000","last_undegraded":"2024-08-19T00:11:39.915897+0000","last_fullsized":"2024-08-19T00:11:39.915897+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:29:04.125347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916321+0000","last_change":"2024-08-19T00:10:52.512320+0000","last_active":"2024-08-19T00:11:39.916321+0000","last_peered":"2024-08-19T00:11:39.916321+0000","last_clean":"2024-08-19T00:11:39.916321+0000","last_became_active":"2024-08-19T00:10:52.512003+0000","last_became_peered":"2024-08-19T00:10:52.512003+0000","last_unstale":"2024-08-19T00:11:39.916321+0000","last_undegraded":"2024-08-19T00:11:39.916321+0000","last_fullsized":"2024-08-19T00:11:39.916321+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:28:52.261457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913084+0000","last_change":"2024-08-19T00:10:52.511454+0000","last_active":"2024-08-19T00:11:39.913084+0000","last_peered":"2024-08-19T00:11:39.913084+0000","last_clean":"2024-08-19T00:11:39.913084+0000","last_became_active":"2024-08-19T00:10:52.511036+0000","last_became_peered":"2024-08-19T00:10:52.511036+0000","last_unstale":"2024-08-19T00:11:39.913084+0000","last_undegraded":"2024-08-19T00:11:39.913084+0000","last_fullsized":"2024-08-19T00:11:39.913084+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:14:04.749222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913672+0000","last_change":"2024-08-19T00:10:52.526393+0000","last_active":"2024-08-19T00:11:39.913672+0000","last_peered":"2024-08-19T00:11:39.913672+0000","last_clean":"2024-08-19T00:11:39.913672+0000","last_became_active":"2024-08-19T00:10:52.526043+0000","last_became_peered":"2024-08-19T00:10:52.526043+0000","last_unstale":"2024-08-19T00:11:39.913672+0000","last_undegraded":"2024-08-19T00:11:39.913672+0000","last_fullsized":"2024-08-19T00:11:39.913672+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:18:48.505255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.918255+0000","last_change":"2024-08-19T00:10:52.516028+0000","last_active":"2024-08-19T00:11:39.918255+0000","last_peered":"2024-08-19T00:11:39.918255+0000","last_clean":"2024-08-19T00:11:39.918255+0000","last_became_active":"2024-08-19T00:10:52.515659+0000","last_became_peered":"2024-08-19T00:10:52.515659+0000","last_unstale":"2024-08-19T00:11:39.918255+0000","last_undegraded":"2024-08-19T00:11:39.918255+0000","last_fullsized":"2024-08-19T00:11:39.918255+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:31:14.995175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916120+0000","last_change":"2024-08-19T00:10:52.516196+0000","last_active":"2024-08-19T00:11:39.916120+0000","last_peered":"2024-08-19T00:11:39.916120+0000","last_clean":"2024-08-19T00:11:39.916120+0000","last_became_active":"2024-08-19T00:10:52.515533+0000","last_became_peered":"2024-08-19T00:10:52.515533+0000","last_unstale":"2024-08-19T00:11:39.916120+0000","last_undegraded":"2024-08-19T00:11:39.916120+0000","last_fullsized":"2024-08-19T00:11:39.916120+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:32:25.207184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.918369+0000","last_change":"2024-08-19T00:10:52.527433+0000","last_active":"2024-08-19T00:11:39.918369+0000","last_peered":"2024-08-19T00:11:39.918369+0000","last_clean":"2024-08-19T00:11:39.918369+0000","last_became_active":"2024-08-19T00:10:52.525490+0000","last_became_peered":"2024-08-19T00:10:52.525490+0000","last_unstale":"2024-08-19T00:11:39.918369+0000","last_undegraded":"2024-08-19T00:11:39.918369+0000","last_fullsized":"2024-08-19T00:11:39.918369+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:21:14.545808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915814+0000","last_change":"2024-08-19T00:10:52.515503+0000","last_active":"2024-08-19T00:11:39.915814+0000","last_peered":"2024-08-19T00:11:39.915814+0000","last_clean":"2024-08-19T00:11:39.915814+0000","last_became_active":"2024-08-19T00:10:52.515178+0000","last_became_peered":"2024-08-19T00:10:52.515178+0000","last_unstale":"2024-08-19T00:11:39.915814+0000","last_undegraded":"2024-08-19T00:11:39.915814+0000","last_fullsized":"2024-08-19T00:11:39.915814+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:30:27.825463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913615+0000","last_change":"2024-08-19T00:10:52.515133+0000","last_active":"2024-08-19T00:11:39.913615+0000","last_peered":"2024-08-19T00:11:39.913615+0000","last_clean":"2024-08-19T00:11:39.913615+0000","last_became_active":"2024-08-19T00:10:52.514851+0000","last_became_peered":"2024-08-19T00:10:52.514851+0000","last_unstale":"2024-08-19T00:11:39.913615+0000","last_undegraded":"2024-08-19T00:11:39.913615+0000","last_fullsized":"2024-08-19T00:11:39.913615+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:38:53.593993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913028+0000","last_change":"2024-08-19T00:10:52.512127+0000","last_active":"2024-08-19T00:11:39.913028+0000","last_peered":"2024-08-19T00:11:39.913028+0000","last_clean":"2024-08-19T00:11:39.913028+0000","last_became_active":"2024-08-19T00:10:52.511840+0000","last_became_peered":"2024-08-19T00:10:52.511840+0000","last_unstale":"2024-08-19T00:11:39.913028+0000","last_undegraded":"2024-08-19T00:11:39.913028+0000","last_fullsized":"2024-08-19T00:11:39.913028+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:36:32.878531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913944+0000","last_change":"2024-08-19T00:10:52.519470+0000","last_active":"2024-08-19T00:11:39.913944+0000","last_peered":"2024-08-19T00:11:39.913944+0000","last_clean":"2024-08-19T00:11:39.913944+0000","last_became_active":"2024-08-19T00:10:52.519131+0000","last_became_peered":"2024-08-19T00:10:52.519131+0000","last_unstale":"2024-08-19T00:11:39.913944+0000","last_undegraded":"2024-08-19T00:11:39.913944+0000","last_fullsized":"2024-08-19T00:11:39.913944+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:56:53.628868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915974+0000","last_change":"2024-08-19T00:10:52.511114+0000","last_active":"2024-08-19T00:11:39.915974+0000","last_peered":"2024-08-19T00:11:39.915974+0000","last_clean":"2024-08-19T00:11:39.915974+0000","last_became_active":"2024-08-19T00:10:52.510759+0000","last_became_peered":"2024-08-19T00:10:52.510759+0000","last_unstale":"2024-08-19T00:11:39.915974+0000","last_undegraded":"2024-08-19T00:11:39.915974+0000","last_fullsized":"2024-08-19T00:11:39.915974+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:54:10.590297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.910810+0000","last_change":"2024-08-19T00:10:52.507998+0000","last_active":"2024-08-19T00:11:39.910810+0000","last_peered":"2024-08-19T00:11:39.910810+0000","last_clean":"2024-08-19T00:11:39.910810+0000","last_became_active":"2024-08-19T00:10:52.507679+0000","last_became_peered":"2024-08-19T00:10:52.507679+0000","last_unstale":"2024-08-19T00:11:39.910810+0000","last_undegraded":"2024-08-19T00:11:39.910810+0000","last_fullsized":"2024-08-19T00:11:39.910810+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:59:48.098911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913458+0000","last_change":"2024-08-19T00:10:52.524171+0000","last_active":"2024-08-19T00:11:39.913458+0000","last_peered":"2024-08-19T00:11:39.913458+0000","last_clean":"2024-08-19T00:11:39.913458+0000","last_became_active":"2024-08-19T00:10:52.523028+0000","last_became_peered":"2024-08-19T00:10:52.523028+0000","last_unstale":"2024-08-19T00:11:39.913458+0000","last_undegraded":"2024-08-19T00:11:39.913458+0000","last_fullsized":"2024-08-19T00:11:39.913458+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:51:24.567971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913253+0000","last_change":"2024-08-19T00:10:52.514309+0000","last_active":"2024-08-19T00:11:39.913253+0000","last_peered":"2024-08-19T00:11:39.913253+0000","last_clean":"2024-08-19T00:11:39.913253+0000","last_became_active":"2024-08-19T00:10:52.513992+0000","last_became_peered":"2024-08-19T00:10:52.513992+0000","last_unstale":"2024-08-19T00:11:39.913253+0000","last_undegraded":"2024-08-19T00:11:39.913253+0000","last_fullsized":"2024-08-19T00:11:39.913253+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:34:14.014490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915278+0000","last_change":"2024-08-19T00:10:52.516033+0000","last_active":"2024-08-19T00:11:39.915278+0000","last_peered":"2024-08-19T00:11:39.915278+0000","last_clean":"2024-08-19T00:11:39.915278+0000","last_became_active":"2024-08-19T00:10:52.515713+0000","last_became_peered":"2024-08-19T00:10:52.515713+0000","last_unstale":"2024-08-19T00:11:39.915278+0000","last_undegraded":"2024-08-19T00:11:39.915278+0000","last_fullsized":"2024-08-19T00:11:39.915278+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:06:40.832460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915258+0000","last_change":"2024-08-19T00:10:52.518521+0000","last_active":"2024-08-19T00:11:39.915258+0000","last_peered":"2024-08-19T00:11:39.915258+0000","last_clean":"2024-08-19T00:11:39.915258+0000","last_became_active":"2024-08-19T00:10:52.518237+0000","last_became_peered":"2024-08-19T00:10:52.518237+0000","last_unstale":"2024-08-19T00:11:39.915258+0000","last_undegraded":"2024-08-19T00:11:39.915258+0000","last_fullsized":"2024-08-19T00:11:39.915258+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:17:20.569044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.912988+0000","last_change":"2024-08-19T00:10:52.519774+0000","last_active":"2024-08-19T00:11:39.912988+0000","last_peered":"2024-08-19T00:11:39.912988+0000","last_clean":"2024-08-19T00:11:39.912988+0000","last_became_active":"2024-08-19T00:10:52.519456+0000","last_became_peered":"2024-08-19T00:10:52.519456+0000","last_unstale":"2024-08-19T00:11:39.912988+0000","last_undegraded":"2024-08-19T00:11:39.912988+0000","last_fullsized":"2024-08-19T00:11:39.912988+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:47:52.675650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916215+0000","last_change":"2024-08-19T00:10:52.514200+0000","last_active":"2024-08-19T00:11:39.916215+0000","last_peered":"2024-08-19T00:11:39.916215+0000","last_clean":"2024-08-19T00:11:39.916215+0000","last_became_active":"2024-08-19T00:10:52.513821+0000","last_became_peered":"2024-08-19T00:10:52.513821+0000","last_unstale":"2024-08-19T00:11:39.916215+0000","last_undegraded":"2024-08-19T00:11:39.916215+0000","last_fullsized":"2024-08-19T00:11:39.916215+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:15:30.084873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920854+0000","last_change":"2024-08-19T00:10:52.519781+0000","last_active":"2024-08-19T00:11:39.920854+0000","last_peered":"2024-08-19T00:11:39.920854+0000","last_clean":"2024-08-19T00:11:39.920854+0000","last_became_active":"2024-08-19T00:10:52.519395+0000","last_became_peered":"2024-08-19T00:10:52.519395+0000","last_unstale":"2024-08-19T00:11:39.920854+0000","last_undegraded":"2024-08-19T00:11:39.920854+0000","last_fullsized":"2024-08-19T00:11:39.920854+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:10:15.160535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.911435+0000","last_change":"2024-08-19T00:10:52.510293+0000","last_active":"2024-08-19T00:11:39.911435+0000","last_peered":"2024-08-19T00:11:39.911435+0000","last_clean":"2024-08-19T00:11:39.911435+0000","last_became_active":"2024-08-19T00:10:52.509983+0000","last_became_peered":"2024-08-19T00:10:52.509983+0000","last_unstale":"2024-08-19T00:11:39.911435+0000","last_undegraded":"2024-08-19T00:11:39.911435+0000","last_fullsized":"2024-08-19T00:11:39.911435+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:59:11.488742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913928+0000","last_change":"2024-08-19T00:10:52.518778+0000","last_active":"2024-08-19T00:11:39.913928+0000","last_peered":"2024-08-19T00:11:39.913928+0000","last_clean":"2024-08-19T00:11:39.913928+0000","last_became_active":"2024-08-19T00:10:52.518209+0000","last_became_peered":"2024-08-19T00:10:52.518209+0000","last_unstale":"2024-08-19T00:11:39.913928+0000","last_undegraded":"2024-08-19T00:11:39.913928+0000","last_fullsized":"2024-08-19T00:11:39.913928+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:23:19.255833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915073+0000","last_change":"2024-08-19T00:10:52.523824+0000","last_active":"2024-08-19T00:11:39.915073+0000","last_peered":"2024-08-19T00:11:39.915073+0000","last_clean":"2024-08-19T00:11:39.915073+0000","last_became_active":"2024-08-19T00:10:52.523075+0000","last_became_peered":"2024-08-19T00:10:52.523075+0000","last_unstale":"2024-08-19T00:11:39.915073+0000","last_undegraded":"2024-08-19T00:11:39.915073+0000","last_fullsized":"2024-08-19T00:11:39.915073+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:23:58.618712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920442+0000","last_change":"2024-08-19T00:10:52.523508+0000","last_active":"2024-08-19T00:11:39.920442+0000","last_peered":"2024-08-19T00:11:39.920442+0000","last_clean":"2024-08-19T00:11:39.920442+0000","last_became_active":"2024-08-19T00:10:52.523104+0000","last_became_peered":"2024-08-19T00:10:52.523104+0000","last_unstale":"2024-08-19T00:11:39.920442+0000","last_undegraded":"2024-08-19T00:11:39.920442+0000","last_fullsized":"2024-08-19T00:11:39.920442+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:04:06.932548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.911625+0000","last_change":"2024-08-19T00:10:52.510147+0000","last_active":"2024-08-19T00:11:39.911625+0000","last_peered":"2024-08-19T00:11:39.911625+0000","last_clean":"2024-08-19T00:11:39.911625+0000","last_became_active":"2024-08-19T00:10:52.509807+0000","last_became_peered":"2024-08-19T00:10:52.509807+0000","last_unstale":"2024-08-19T00:11:39.911625+0000","last_undegraded":"2024-08-19T00:11:39.911625+0000","last_fullsized":"2024-08-19T00:11:39.911625+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:09:55.965318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.912168+0000","last_change":"2024-08-19T00:10:52.512997+0000","last_active":"2024-08-19T00:11:39.912168+0000","last_peered":"2024-08-19T00:11:39.912168+0000","last_clean":"2024-08-19T00:11:39.912168+0000","last_became_active":"2024-08-19T00:10:52.512688+0000","last_became_peered":"2024-08-19T00:10:52.512688+0000","last_unstale":"2024-08-19T00:11:39.912168+0000","last_undegraded":"2024-08-19T00:11:39.912168+0000","last_fullsized":"2024-08-19T00:11:39.912168+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:57:33.607060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916036+0000","last_change":"2024-08-19T00:10:52.517492+0000","last_active":"2024-08-19T00:11:39.916036+0000","last_peered":"2024-08-19T00:11:39.916036+0000","last_clean":"2024-08-19T00:11:39.916036+0000","last_became_active":"2024-08-19T00:10:52.517153+0000","last_became_peered":"2024-08-19T00:10:52.517153+0000","last_unstale":"2024-08-19T00:11:39.916036+0000","last_undegraded":"2024-08-19T00:11:39.916036+0000","last_fullsized":"2024-08-19T00:11:39.916036+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:07:07.244331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915536+0000","last_change":"2024-08-19T00:10:52.517396+0000","last_active":"2024-08-19T00:11:39.915536+0000","last_peered":"2024-08-19T00:11:39.915536+0000","last_clean":"2024-08-19T00:11:39.915536+0000","last_became_active":"2024-08-19T00:10:52.517108+0000","last_became_peered":"2024-08-19T00:10:52.517108+0000","last_unstale":"2024-08-19T00:11:39.915536+0000","last_undegraded":"2024-08-19T00:11:39.915536+0000","last_fullsized":"2024-08-19T00:11:39.915536+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:10:41.477770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916498+0000","last_change":"2024-08-19T00:10:52.515841+0000","last_active":"2024-08-19T00:11:39.916498+0000","last_peered":"2024-08-19T00:11:39.916498+0000","last_clean":"2024-08-19T00:11:39.916498+0000","last_became_active":"2024-08-19T00:10:52.515524+0000","last_became_peered":"2024-08-19T00:10:52.515524+0000","last_unstale":"2024-08-19T00:11:39.916498+0000","last_undegraded":"2024-08-19T00:11:39.916498+0000","last_fullsized":"2024-08-19T00:11:39.916498+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:18:51.991468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913341+0000","last_change":"2024-08-19T00:10:52.522670+0000","last_active":"2024-08-19T00:11:39.913341+0000","last_peered":"2024-08-19T00:11:39.913341+0000","last_clean":"2024-08-19T00:11:39.913341+0000","last_became_active":"2024-08-19T00:10:52.522275+0000","last_became_peered":"2024-08-19T00:10:52.522275+0000","last_unstale":"2024-08-19T00:11:39.913341+0000","last_undegraded":"2024-08-19T00:11:39.913341+0000","last_fullsized":"2024-08-19T00:11:39.913341+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:55:48.756230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":60812,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":161,"num_read_kb":152,"num_write":239,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":540672,"data_stored":171385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":207,"ondisk_log_size":207,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449112,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32216,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712936,"statfs":{"total":95995035648,"available":95962046464,"internally_reserved":0,"allocated":1064960,"data_stored":518821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":71,"seq":304942678044,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32880,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712272,"statfs":{"total":95995035648,"available":95961366528,"internally_reserved":0,"allocated":1744896,"data_stored":1159915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":65,"seq":279172874273,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28076,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717076,"statfs":{"total":95995035648,"available":95966285824,"internally_reserved":0,"allocated":1085440,"data_stored":522735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135909,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1069056,"data_stored":518905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397545,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36972,"kb_used_data":1636,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708180,"statfs":{"total":95995035648,"available":95957176320,"internally_reserved":0,"allocated":1675264,"data_stored":1115123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561071,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1056768,"data_stored":514143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822706,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32828,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712324,"statfs":{"total":95995035648,"available":95961419776,"internally_reserved":0,"allocated":1683456,"data_stored":1110705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986232,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36376,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708776,"statfs":{"total":95995035648,"available":95957786624,"internally_reserved":0,"allocated":1064960,"data_stored":518217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215163,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36380,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708772,"statfs":{"total":95995035648,"available":95957782528,"internally_reserved":0,"allocated":1069056,"data_stored":513851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411391,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36436,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708716,"statfs":{"total":95995035648,"available":95957725184,"internally_reserved":0,"allocated":1126400,"data_stored":558732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28108,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717044,"statfs":{"total":95995035648,"available":95966253056,"internally_reserved":0,"allocated":1118208,"data_stored":569563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738441,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36400,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708752,"statfs":{"total":95995035648,"available":95957762048,"internally_reserved":0,"allocated":1081344,"data_stored":515599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":56142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":45311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":56126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-19T00:11:51.649 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph pg dump --format=json 2024-08-19T00:11:51.909 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:11:52.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:52 smithi171 ceph-mon[21810]: pgmap v298: 129 pgs: 129 active+clean; 636 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.2 KiB/s wr, 18 op/s; 10 B/s, 0 objects/s recovering 2024-08-19T00:11:52.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:52 smithi171 ceph-mon[21810]: from='client.14817 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-19T00:11:52.347 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:52 smithi044 ceph-mon[18489]: pgmap v298: 129 pgs: 129 active+clean; 636 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.2 KiB/s wr, 18 op/s; 10 B/s, 0 objects/s recovering 2024-08-19T00:11:52.347 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:52 smithi044 ceph-mon[18489]: from='client.14817 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-19T00:11:52.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:52 smithi116 ceph-mon[21873]: pgmap v298: 129 pgs: 129 active+clean; 636 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.2 KiB/s wr, 18 op/s; 10 B/s, 0 objects/s recovering 2024-08-19T00:11:52.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:52 smithi116 ceph-mon[21873]: from='client.14817 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-19T00:11:52.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:52.427+0000 7f17482a9640 1 -- 172.21.15.44:0/89532249 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1740100b50 msgr2=0x7f1740100f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:52.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:52.427+0000 7f17482a9640 1 --2- 172.21.15.44:0/89532249 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1740100b50 0x7f1740100f30 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f173c009900 tx=0x7f173c02a480 comp rx=0 tx=0).stop 2024-08-19T00:11:52.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:52.427+0000 7f17482a9640 1 -- 172.21.15.44:0/89532249 shutdown_connections 2024-08-19T00:11:52.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:52.427+0000 7f17482a9640 1 --2- 172.21.15.44:0/89532249 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17401022a0 0x7f17401026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:52.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:52.427+0000 7f17482a9640 1 --2- 172.21.15.44:0/89532249 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1740102c20 0x7f174010d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:52.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:52.427+0000 7f17482a9640 1 --2- 172.21.15.44:0/89532249 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1740100b50 0x7f1740100f30 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:52.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:52.427+0000 7f17482a9640 1 -- 172.21.15.44:0/89532249 >> 172.21.15.44:0/89532249 conn(0x7f17400fc500 msgr2=0x7f17400fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:52.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:52.427+0000 7f17482a9640 1 -- 172.21.15.44:0/89532249 shutdown_connections 2024-08-19T00:11:52.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:52.427+0000 7f17482a9640 1 -- 172.21.15.44:0/89532249 wait complete. 2024-08-19T00:11:52.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:52.427+0000 7f17482a9640 1 Processor -- start 2024-08-19T00:11:52.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:52.427+0000 7f17482a9640 1 -- start start 2024-08-19T00:11:52.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:52.428+0000 7f17482a9640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1740100b50 0x7f17401981b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:52.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:52.428+0000 7f17482a9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f17401022a0 0x7f17401986f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:52.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:52.428+0000 7f17482a9640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1740102c20 0x7f174019ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:52.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:52.428+0000 7f17482a9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1740111dd0 con 0x7f17401022a0 2024-08-19T00:11:52.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:52.428+0000 7f17482a9640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f1740111c50 con 0x7f1740100b50 2024-08-19T00:11:52.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:52.428+0000 7f17482a9640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1740111f50 con 0x7f1740102c20 2024-08-19T00:11:52.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:52.428+0000 7f1745844640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f17401022a0 0x7f17401986f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:52.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:52.428+0000 7f1745844640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f17401022a0 0x7f17401986f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37300/0 (socket says 172.21.15.44:37300) 2024-08-19T00:11:52.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:52.428+0000 7f1745844640 1 -- 172.21.15.44:0/588445805 learned_addr learned my addr 172.21.15.44:0/588445805 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:11:52.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:52.428+0000 7f1746045640 1 --2- 172.21.15.44:0/588445805 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1740100b50 0x7f17401981b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:52.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:52.428+0000 7f1745844640 1 -- 172.21.15.44:0/588445805 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1740102c20 msgr2=0x7f174019ca80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-19T00:11:52.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:52.428+0000 7f1745844640 1 --2- 172.21.15.44:0/588445805 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1740102c20 0x7f174019ca80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:52.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:52.428+0000 7f1745844640 1 -- 172.21.15.44:0/588445805 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1740100b50 msgr2=0x7f17401981b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:52.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:52.428+0000 7f1745844640 1 --2- 172.21.15.44:0/588445805 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1740100b50 0x7f17401981b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:52.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:52.428+0000 7f1745844640 1 -- 172.21.15.44:0/588445805 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f174019d160 con 0x7f17401022a0 2024-08-19T00:11:52.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:52.428+0000 7f1745844640 1 --2- 172.21.15.44:0/588445805 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f17401022a0 0x7f17401986f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f173000c920 tx=0x7f173000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:52.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:52.428+0000 7f17377fe640 1 -- 172.21.15.44:0/588445805 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1730007c70 con 0x7f17401022a0 2024-08-19T00:11:52.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:52.428+0000 7f17482a9640 1 -- 172.21.15.44:0/588445805 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f174019d450 con 0x7f17401022a0 2024-08-19T00:11:52.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:52.428+0000 7f17377fe640 1 -- 172.21.15.44:0/588445805 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1730007e10 con 0x7f17401022a0 2024-08-19T00:11:52.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:52.428+0000 7f17377fe640 1 -- 172.21.15.44:0/588445805 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1730018890 con 0x7f17401022a0 2024-08-19T00:11:52.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:52.429+0000 7f17482a9640 1 -- 172.21.15.44:0/588445805 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17401a4d30 con 0x7f17401022a0 2024-08-19T00:11:52.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:52.430+0000 7f17482a9640 1 -- 172.21.15.44:0/588445805 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1740100f30 con 0x7f17401022a0 2024-08-19T00:11:52.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:52.431+0000 7f17377fe640 1 -- 172.21.15.44:0/588445805 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f1730018a70 con 0x7f17401022a0 2024-08-19T00:11:52.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:52.431+0000 7f17377fe640 1 --2- 172.21.15.44:0/588445805 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f172c0a2c10 0x7f172c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:52.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:52.431+0000 7f1746045640 1 --2- 172.21.15.44:0/588445805 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f172c0a2c10 0x7f172c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:52.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:52.431+0000 7f17377fe640 1 -- 172.21.15.44:0/588445805 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f17300cf680 con 0x7f17401022a0 2024-08-19T00:11:52.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:52.432+0000 7f1746045640 1 --2- 172.21.15.44:0/588445805 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f172c0a2c10 0x7f172c0a50d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f173c009230 tx=0x7f173c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:52.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:52.435+0000 7f17377fe640 1 -- 172.21.15.44:0/588445805 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f1730014030 con 0x7f17401022a0 2024-08-19T00:11:52.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:52.607+0000 7f17482a9640 1 -- 172.21.15.44:0/588445805 --> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f17400fe4a0 con 0x7f172c0a2c10 2024-08-19T00:11:52.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:52.615+0000 7f17377fe640 1 -- 172.21.15.44:0/588445805 <== mgr.14150 v2:172.21.15.44:6800/1330072146 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340397 (secure 0 0 0) 0x7f17400fe4a0 con 0x7f172c0a2c10 2024-08-19T00:11:52.619 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:11:52.621 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-08-19T00:11:52.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:52.619+0000 7f17482a9640 1 -- 172.21.15.44:0/588445805 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f172c0a2c10 msgr2=0x7f172c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:52.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:52.619+0000 7f17482a9640 1 --2- 172.21.15.44:0/588445805 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f172c0a2c10 0x7f172c0a50d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f173c009230 tx=0x7f173c0058d0 comp rx=0 tx=0).stop 2024-08-19T00:11:52.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:52.619+0000 7f17482a9640 1 -- 172.21.15.44:0/588445805 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f17401022a0 msgr2=0x7f17401986f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:52.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:52.619+0000 7f17482a9640 1 --2- 172.21.15.44:0/588445805 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f17401022a0 0x7f17401986f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f173000c920 tx=0x7f173000cde0 comp rx=0 tx=0).stop 2024-08-19T00:11:52.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:52.619+0000 7f17482a9640 1 -- 172.21.15.44:0/588445805 shutdown_connections 2024-08-19T00:11:52.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:52.619+0000 7f17482a9640 1 --2- 172.21.15.44:0/588445805 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f172c0a2c10 0x7f172c0a50d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:52.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:52.619+0000 7f17482a9640 1 --2- 172.21.15.44:0/588445805 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1740102c20 0x7f174019ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:52.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:52.619+0000 7f17482a9640 1 --2- 172.21.15.44:0/588445805 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f17401022a0 0x7f17401986f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:52.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:52.619+0000 7f17482a9640 1 --2- 172.21.15.44:0/588445805 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1740100b50 0x7f17401981b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:52.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:52.619+0000 7f17482a9640 1 -- 172.21.15.44:0/588445805 >> 172.21.15.44:0/588445805 conn(0x7f17400fc500 msgr2=0x7f17400fdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:52.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:52.619+0000 7f17482a9640 1 -- 172.21.15.44:0/588445805 shutdown_connections 2024-08-19T00:11:52.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:52.619+0000 7f17482a9640 1 -- 172.21.15.44:0/588445805 wait complete. 2024-08-19T00:11:53.401 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":299,"stamp":"2024-08-19T00:11:52.478576+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":651414,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":312,"num_read_kb":271,"num_write":422,"num_write_kb":3069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1180848,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":346,"ondisk_log_size":346,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":392796,"kb_used_data":14504,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124549028,"statfs":{"total":1151940427776,"available":1151538204672,"internally_reserved":0,"allocated":14852096,"data_stored":8147360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":387233081},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":30140,"num_objects":5,"num_object_clones":0,"num_object_copies":17,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":131,"num_read_kb":106,"num_write":29,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003397"},"pg_stats":[{"pgid":"2.1f","version":"90'13","reported_seq":60,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:46.929534+0000","last_change":"2024-08-19T00:10:50.471635+0000","last_active":"2024-08-19T00:11:46.929534+0000","last_peered":"2024-08-19T00:11:46.929534+0000","last_clean":"2024-08-19T00:11:46.929534+0000","last_became_active":"2024-08-19T00:10:50.471324+0000","last_became_peered":"2024-08-19T00:10:50.471324+0000","last_unstale":"2024-08-19T00:11:46.929534+0000","last_undegraded":"2024-08-19T00:11:46.929534+0000","last_fullsized":"2024-08-19T00:11:46.929534+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:41:02.945782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.923007+0000","last_change":"2024-08-19T00:11:39.922459+0000","last_active":"2024-08-19T00:11:39.923007+0000","last_peered":"2024-08-19T00:11:39.923007+0000","last_clean":"2024-08-19T00:11:39.923007+0000","last_became_active":"2024-08-19T00:11:39.922091+0000","last_became_peered":"2024-08-19T00:11:39.922091+0000","last_unstale":"2024-08-19T00:11:39.923007+0000","last_undegraded":"2024-08-19T00:11:39.923007+0000","last_fullsized":"2024-08-19T00:11:39.923007+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:14:21.785736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915284+0000","last_change":"2024-08-19T00:10:59.789370+0000","last_active":"2024-08-19T00:11:39.915284+0000","last_peered":"2024-08-19T00:11:39.915284+0000","last_clean":"2024-08-19T00:11:39.915284+0000","last_became_active":"2024-08-19T00:10:59.788901+0000","last_became_peered":"2024-08-19T00:10:59.788901+0000","last_unstale":"2024-08-19T00:11:39.915284+0000","last_undegraded":"2024-08-19T00:11:39.915284+0000","last_fullsized":"2024-08-19T00:11:39.915284+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:15:45.247674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"90'2","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916313+0000","last_change":"2024-08-19T00:10:50.618000+0000","last_active":"2024-08-19T00:11:39.916313+0000","last_peered":"2024-08-19T00:11:39.916313+0000","last_clean":"2024-08-19T00:11:39.916313+0000","last_became_active":"2024-08-19T00:10:50.617648+0000","last_became_peered":"2024-08-19T00:10:50.617648+0000","last_unstale":"2024-08-19T00:11:39.916313+0000","last_undegraded":"2024-08-19T00:11:39.916313+0000","last_fullsized":"2024-08-19T00:11:39.916313+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:39:00.310466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915973+0000","last_change":"2024-08-19T00:10:52.518075+0000","last_active":"2024-08-19T00:11:39.915973+0000","last_peered":"2024-08-19T00:11:39.915973+0000","last_clean":"2024-08-19T00:11:39.915973+0000","last_became_active":"2024-08-19T00:10:52.517735+0000","last_became_peered":"2024-08-19T00:10:52.517735+0000","last_unstale":"2024-08-19T00:11:39.915973+0000","last_undegraded":"2024-08-19T00:11:39.915973+0000","last_fullsized":"2024-08-19T00:11:39.915973+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:02:32.657776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916011+0000","last_change":"2024-08-19T00:10:59.787563+0000","last_active":"2024-08-19T00:11:39.916011+0000","last_peered":"2024-08-19T00:11:39.916011+0000","last_clean":"2024-08-19T00:11:39.916011+0000","last_became_active":"2024-08-19T00:10:59.787143+0000","last_became_peered":"2024-08-19T00:10:59.787143+0000","last_unstale":"2024-08-19T00:11:39.916011+0000","last_undegraded":"2024-08-19T00:11:39.916011+0000","last_fullsized":"2024-08-19T00:11:39.916011+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:41:47.101296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"90'12","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913715+0000","last_change":"2024-08-19T00:10:50.475869+0000","last_active":"2024-08-19T00:11:39.913715+0000","last_peered":"2024-08-19T00:11:39.913715+0000","last_clean":"2024-08-19T00:11:39.913715+0000","last_became_active":"2024-08-19T00:10:50.475550+0000","last_became_peered":"2024-08-19T00:10:50.475550+0000","last_unstale":"2024-08-19T00:11:39.913715+0000","last_undegraded":"2024-08-19T00:11:39.913715+0000","last_fullsized":"2024-08-19T00:11:39.913715+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:47:23.724503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913510+0000","last_change":"2024-08-19T00:10:52.511901+0000","last_active":"2024-08-19T00:11:39.913510+0000","last_peered":"2024-08-19T00:11:39.913510+0000","last_clean":"2024-08-19T00:11:39.913510+0000","last_became_active":"2024-08-19T00:10:52.511595+0000","last_became_peered":"2024-08-19T00:10:52.511595+0000","last_unstale":"2024-08-19T00:11:39.913510+0000","last_undegraded":"2024-08-19T00:11:39.913510+0000","last_fullsized":"2024-08-19T00:11:39.913510+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:57:30.613865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916330+0000","last_change":"2024-08-19T00:10:59.785611+0000","last_active":"2024-08-19T00:11:39.916330+0000","last_peered":"2024-08-19T00:11:39.916330+0000","last_clean":"2024-08-19T00:11:39.916330+0000","last_became_active":"2024-08-19T00:10:59.785105+0000","last_became_peered":"2024-08-19T00:10:59.785105+0000","last_unstale":"2024-08-19T00:11:39.916330+0000","last_undegraded":"2024-08-19T00:11:39.916330+0000","last_fullsized":"2024-08-19T00:11:39.916330+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:05:31.007647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"90'5","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.914125+0000","last_change":"2024-08-19T00:10:50.474439+0000","last_active":"2024-08-19T00:11:39.914125+0000","last_peered":"2024-08-19T00:11:39.914125+0000","last_clean":"2024-08-19T00:11:39.914125+0000","last_became_active":"2024-08-19T00:10:50.473984+0000","last_became_peered":"2024-08-19T00:10:50.473984+0000","last_unstale":"2024-08-19T00:11:39.914125+0000","last_undegraded":"2024-08-19T00:11:39.914125+0000","last_fullsized":"2024-08-19T00:11:39.914125+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:16:06.934392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.918999+0000","last_change":"2024-08-19T00:10:52.521664+0000","last_active":"2024-08-19T00:11:39.918999+0000","last_peered":"2024-08-19T00:11:39.918999+0000","last_clean":"2024-08-19T00:11:39.918999+0000","last_became_active":"2024-08-19T00:10:52.520792+0000","last_became_peered":"2024-08-19T00:10:52.520792+0000","last_unstale":"2024-08-19T00:11:39.918999+0000","last_undegraded":"2024-08-19T00:11:39.918999+0000","last_fullsized":"2024-08-19T00:11:39.918999+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:55:27.199456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915652+0000","last_change":"2024-08-19T00:10:59.789736+0000","last_active":"2024-08-19T00:11:39.915652+0000","last_peered":"2024-08-19T00:11:39.915652+0000","last_clean":"2024-08-19T00:11:39.915652+0000","last_became_active":"2024-08-19T00:10:59.786880+0000","last_became_peered":"2024-08-19T00:10:59.786880+0000","last_unstale":"2024-08-19T00:11:39.915652+0000","last_undegraded":"2024-08-19T00:11:39.915652+0000","last_fullsized":"2024-08-19T00:11:39.915652+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:20:53.615561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920522+0000","last_change":"2024-08-19T00:10:52.519887+0000","last_active":"2024-08-19T00:11:39.920522+0000","last_peered":"2024-08-19T00:11:39.920522+0000","last_clean":"2024-08-19T00:11:39.920522+0000","last_became_active":"2024-08-19T00:10:52.519550+0000","last_became_peered":"2024-08-19T00:10:52.519550+0000","last_unstale":"2024-08-19T00:11:39.920522+0000","last_undegraded":"2024-08-19T00:11:39.920522+0000","last_fullsized":"2024-08-19T00:11:39.920522+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:27:43.493012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"90'4","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.912400+0000","last_change":"2024-08-19T00:10:50.478131+0000","last_active":"2024-08-19T00:11:39.912400+0000","last_peered":"2024-08-19T00:11:39.912400+0000","last_clean":"2024-08-19T00:11:39.912400+0000","last_became_active":"2024-08-19T00:10:50.477826+0000","last_became_peered":"2024-08-19T00:10:50.477826+0000","last_unstale":"2024-08-19T00:11:39.912400+0000","last_undegraded":"2024-08-19T00:11:39.912400+0000","last_fullsized":"2024-08-19T00:11:39.912400+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:41:24.066453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915909+0000","last_change":"2024-08-19T00:10:59.787634+0000","last_active":"2024-08-19T00:11:39.915909+0000","last_peered":"2024-08-19T00:11:39.915909+0000","last_clean":"2024-08-19T00:11:39.915909+0000","last_became_active":"2024-08-19T00:10:59.786508+0000","last_became_peered":"2024-08-19T00:10:59.786508+0000","last_unstale":"2024-08-19T00:11:39.915909+0000","last_undegraded":"2024-08-19T00:11:39.915909+0000","last_fullsized":"2024-08-19T00:11:39.915909+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:50:19.071853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915968+0000","last_change":"2024-08-19T00:10:52.512462+0000","last_active":"2024-08-19T00:11:39.915968+0000","last_peered":"2024-08-19T00:11:39.915968+0000","last_clean":"2024-08-19T00:11:39.915968+0000","last_became_active":"2024-08-19T00:10:52.512139+0000","last_became_peered":"2024-08-19T00:10:52.512139+0000","last_unstale":"2024-08-19T00:11:39.915968+0000","last_undegraded":"2024-08-19T00:11:39.915968+0000","last_fullsized":"2024-08-19T00:11:39.915968+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:39:18.677836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"90'3","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.930568+0000","last_change":"2024-08-19T00:11:39.930130+0000","last_active":"2024-08-19T00:11:39.930568+0000","last_peered":"2024-08-19T00:11:39.930568+0000","last_clean":"2024-08-19T00:11:39.930568+0000","last_became_active":"2024-08-19T00:11:39.919566+0000","last_became_peered":"2024-08-19T00:11:39.919566+0000","last_unstale":"2024-08-19T00:11:39.930568+0000","last_undegraded":"2024-08-19T00:11:39.930568+0000","last_fullsized":"2024-08-19T00:11:39.930568+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:50:25.001784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"92'1","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915887+0000","last_change":"2024-08-19T00:10:59.787455+0000","last_active":"2024-08-19T00:11:39.915887+0000","last_peered":"2024-08-19T00:11:39.915887+0000","last_clean":"2024-08-19T00:11:39.915887+0000","last_became_active":"2024-08-19T00:10:59.787054+0000","last_became_peered":"2024-08-19T00:10:59.787054+0000","last_unstale":"2024-08-19T00:11:39.915887+0000","last_undegraded":"2024-08-19T00:11:39.915887+0000","last_fullsized":"2024-08-19T00:11:39.915887+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:13:31.356220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.912686+0000","last_change":"2024-08-19T00:10:52.520993+0000","last_active":"2024-08-19T00:11:39.912686+0000","last_peered":"2024-08-19T00:11:39.912686+0000","last_clean":"2024-08-19T00:11:39.912686+0000","last_became_active":"2024-08-19T00:10:52.520697+0000","last_became_peered":"2024-08-19T00:10:52.520697+0000","last_unstale":"2024-08-19T00:11:39.912686+0000","last_undegraded":"2024-08-19T00:11:39.912686+0000","last_fullsized":"2024-08-19T00:11:39.912686+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:30:15.408193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915912+0000","last_change":"2024-08-19T00:10:50.470746+0000","last_active":"2024-08-19T00:11:39.915912+0000","last_peered":"2024-08-19T00:11:39.915912+0000","last_clean":"2024-08-19T00:11:39.915912+0000","last_became_active":"2024-08-19T00:10:50.470454+0000","last_became_peered":"2024-08-19T00:10:50.470454+0000","last_unstale":"2024-08-19T00:11:39.915912+0000","last_undegraded":"2024-08-19T00:11:39.915912+0000","last_fullsized":"2024-08-19T00:11:39.915912+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:37:34.718543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.924217+0000","last_change":"2024-08-19T00:11:39.924217+0000","last_active":"2024-08-19T00:11:39.924217+0000","last_peered":"2024-08-19T00:11:39.924217+0000","last_clean":"2024-08-19T00:11:39.924217+0000","last_became_active":"2024-08-19T00:11:39.923541+0000","last_became_peered":"2024-08-19T00:11:39.923541+0000","last_unstale":"2024-08-19T00:11:39.924217+0000","last_undegraded":"2024-08-19T00:11:39.924217+0000","last_fullsized":"2024-08-19T00:11:39.924217+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:29:35.040424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,2,5],"acting":[8,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.914173+0000","last_change":"2024-08-19T00:10:52.516838+0000","last_active":"2024-08-19T00:11:39.914173+0000","last_peered":"2024-08-19T00:11:39.914173+0000","last_clean":"2024-08-19T00:11:39.914173+0000","last_became_active":"2024-08-19T00:10:52.516471+0000","last_became_peered":"2024-08-19T00:10:52.516471+0000","last_unstale":"2024-08-19T00:11:39.914173+0000","last_undegraded":"2024-08-19T00:11:39.914173+0000","last_fullsized":"2024-08-19T00:11:39.914173+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:11:26.974655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"90'2","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913384+0000","last_change":"2024-08-19T00:10:50.618745+0000","last_active":"2024-08-19T00:11:39.913384+0000","last_peered":"2024-08-19T00:11:39.913384+0000","last_clean":"2024-08-19T00:11:39.913384+0000","last_became_active":"2024-08-19T00:10:50.618426+0000","last_became_peered":"2024-08-19T00:10:50.618426+0000","last_unstale":"2024-08-19T00:11:39.913384+0000","last_undegraded":"2024-08-19T00:11:39.913384+0000","last_fullsized":"2024-08-19T00:11:39.913384+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:12:57.777142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916210+0000","last_change":"2024-08-19T00:10:59.793740+0000","last_active":"2024-08-19T00:11:39.916210+0000","last_peered":"2024-08-19T00:11:39.916210+0000","last_clean":"2024-08-19T00:11:39.916210+0000","last_became_active":"2024-08-19T00:10:59.793181+0000","last_became_peered":"2024-08-19T00:10:59.793181+0000","last_unstale":"2024-08-19T00:11:39.916210+0000","last_undegraded":"2024-08-19T00:11:39.916210+0000","last_fullsized":"2024-08-19T00:11:39.916210+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:04:15.429505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916583+0000","last_change":"2024-08-19T00:10:52.512200+0000","last_active":"2024-08-19T00:11:39.916583+0000","last_peered":"2024-08-19T00:11:39.916583+0000","last_clean":"2024-08-19T00:11:39.916583+0000","last_became_active":"2024-08-19T00:10:52.511891+0000","last_became_peered":"2024-08-19T00:10:52.511891+0000","last_unstale":"2024-08-19T00:11:39.916583+0000","last_undegraded":"2024-08-19T00:11:39.916583+0000","last_fullsized":"2024-08-19T00:11:39.916583+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:02:08.400026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"90'7","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916624+0000","last_change":"2024-08-19T00:10:50.476209+0000","last_active":"2024-08-19T00:11:39.916624+0000","last_peered":"2024-08-19T00:11:39.916624+0000","last_clean":"2024-08-19T00:11:39.916624+0000","last_became_active":"2024-08-19T00:10:50.475410+0000","last_became_peered":"2024-08-19T00:10:50.475410+0000","last_unstale":"2024-08-19T00:11:39.916624+0000","last_undegraded":"2024-08-19T00:11:39.916624+0000","last_fullsized":"2024-08-19T00:11:39.916624+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:46:25.093738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915425+0000","last_change":"2024-08-19T00:10:59.786550+0000","last_active":"2024-08-19T00:11:39.915425+0000","last_peered":"2024-08-19T00:11:39.915425+0000","last_clean":"2024-08-19T00:11:39.915425+0000","last_became_active":"2024-08-19T00:10:59.785531+0000","last_became_peered":"2024-08-19T00:10:59.785531+0000","last_unstale":"2024-08-19T00:11:39.915425+0000","last_undegraded":"2024-08-19T00:11:39.915425+0000","last_fullsized":"2024-08-19T00:11:39.915425+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:59:53.605678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916210+0000","last_change":"2024-08-19T00:10:52.514936+0000","last_active":"2024-08-19T00:11:39.916210+0000","last_peered":"2024-08-19T00:11:39.916210+0000","last_clean":"2024-08-19T00:11:39.916210+0000","last_became_active":"2024-08-19T00:10:52.514597+0000","last_became_peered":"2024-08-19T00:10:52.514597+0000","last_unstale":"2024-08-19T00:11:39.916210+0000","last_undegraded":"2024-08-19T00:11:39.916210+0000","last_fullsized":"2024-08-19T00:11:39.916210+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:03:42.275705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"92'13","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:46.513854+0000","last_change":"2024-08-19T00:10:50.470637+0000","last_active":"2024-08-19T00:11:46.513854+0000","last_peered":"2024-08-19T00:11:46.513854+0000","last_clean":"2024-08-19T00:11:46.513854+0000","last_became_active":"2024-08-19T00:10:50.470276+0000","last_became_peered":"2024-08-19T00:10:50.470276+0000","last_unstale":"2024-08-19T00:11:46.513854+0000","last_undegraded":"2024-08-19T00:11:46.513854+0000","last_fullsized":"2024-08-19T00:11:46.513854+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:42:16.186669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.914936+0000","last_change":"2024-08-19T00:10:59.784742+0000","last_active":"2024-08-19T00:11:39.914936+0000","last_peered":"2024-08-19T00:11:39.914936+0000","last_clean":"2024-08-19T00:11:39.914936+0000","last_became_active":"2024-08-19T00:10:59.784372+0000","last_became_peered":"2024-08-19T00:10:59.784372+0000","last_unstale":"2024-08-19T00:11:39.914936+0000","last_undegraded":"2024-08-19T00:11:39.914936+0000","last_fullsized":"2024-08-19T00:11:39.914936+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:58:03.216882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913098+0000","last_change":"2024-08-19T00:10:52.511172+0000","last_active":"2024-08-19T00:11:39.913098+0000","last_peered":"2024-08-19T00:11:39.913098+0000","last_clean":"2024-08-19T00:11:39.913098+0000","last_became_active":"2024-08-19T00:10:52.510816+0000","last_became_peered":"2024-08-19T00:10:52.510816+0000","last_unstale":"2024-08-19T00:11:39.913098+0000","last_undegraded":"2024-08-19T00:11:39.913098+0000","last_fullsized":"2024-08-19T00:11:39.913098+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:31:39.889398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"90'4","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.927139+0000","last_change":"2024-08-19T00:11:39.926806+0000","last_active":"2024-08-19T00:11:39.927139+0000","last_peered":"2024-08-19T00:11:39.927139+0000","last_clean":"2024-08-19T00:11:39.927139+0000","last_became_active":"2024-08-19T00:11:39.917115+0000","last_became_peered":"2024-08-19T00:11:39.917115+0000","last_unstale":"2024-08-19T00:11:39.927139+0000","last_undegraded":"2024-08-19T00:11:39.927139+0000","last_fullsized":"2024-08-19T00:11:39.927139+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:58:19.965471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913673+0000","last_change":"2024-08-19T00:10:59.778996+0000","last_active":"2024-08-19T00:11:39.913673+0000","last_peered":"2024-08-19T00:11:39.913673+0000","last_clean":"2024-08-19T00:11:39.913673+0000","last_became_active":"2024-08-19T00:10:59.778589+0000","last_became_peered":"2024-08-19T00:10:59.778589+0000","last_unstale":"2024-08-19T00:11:39.913673+0000","last_undegraded":"2024-08-19T00:11:39.913673+0000","last_fullsized":"2024-08-19T00:11:39.913673+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:40:23.690051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.911105+0000","last_change":"2024-08-19T00:10:52.512796+0000","last_active":"2024-08-19T00:11:39.911105+0000","last_peered":"2024-08-19T00:11:39.911105+0000","last_clean":"2024-08-19T00:11:39.911105+0000","last_became_active":"2024-08-19T00:10:52.512459+0000","last_became_peered":"2024-08-19T00:10:52.512459+0000","last_unstale":"2024-08-19T00:11:39.911105+0000","last_undegraded":"2024-08-19T00:11:39.911105+0000","last_fullsized":"2024-08-19T00:11:39.911105+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:07:47.124129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"90'1","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.910569+0000","last_change":"2024-08-19T00:10:50.618118+0000","last_active":"2024-08-19T00:11:39.910569+0000","last_peered":"2024-08-19T00:11:39.910569+0000","last_clean":"2024-08-19T00:11:39.910569+0000","last_became_active":"2024-08-19T00:10:50.617759+0000","last_became_peered":"2024-08-19T00:10:50.617759+0000","last_unstale":"2024-08-19T00:11:39.910569+0000","last_undegraded":"2024-08-19T00:11:39.910569+0000","last_fullsized":"2024-08-19T00:11:39.910569+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:38:10.830722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913921+0000","last_change":"2024-08-19T00:10:59.783548+0000","last_active":"2024-08-19T00:11:39.913921+0000","last_peered":"2024-08-19T00:11:39.913921+0000","last_clean":"2024-08-19T00:11:39.913921+0000","last_became_active":"2024-08-19T00:10:59.783091+0000","last_became_peered":"2024-08-19T00:10:59.783091+0000","last_unstale":"2024-08-19T00:11:39.913921+0000","last_undegraded":"2024-08-19T00:11:39.913921+0000","last_fullsized":"2024-08-19T00:11:39.913921+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:26:21.191829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.911097+0000","last_change":"2024-08-19T00:10:52.506703+0000","last_active":"2024-08-19T00:11:39.911097+0000","last_peered":"2024-08-19T00:11:39.911097+0000","last_clean":"2024-08-19T00:11:39.911097+0000","last_became_active":"2024-08-19T00:10:52.506350+0000","last_became_peered":"2024-08-19T00:10:52.506350+0000","last_unstale":"2024-08-19T00:11:39.911097+0000","last_undegraded":"2024-08-19T00:11:39.911097+0000","last_fullsized":"2024-08-19T00:11:39.911097+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:27:17.556128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"90'5","reported_seq":55,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:49.933300+0000","last_change":"2024-08-19T00:10:50.478742+0000","last_active":"2024-08-19T00:11:49.933300+0000","last_peered":"2024-08-19T00:11:49.933300+0000","last_clean":"2024-08-19T00:11:49.933300+0000","last_became_active":"2024-08-19T00:10:50.478139+0000","last_became_peered":"2024-08-19T00:10:50.478139+0000","last_unstale":"2024-08-19T00:11:49.933300+0000","last_undegraded":"2024-08-19T00:11:49.933300+0000","last_fullsized":"2024-08-19T00:11:49.933300+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:23:25.727268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.912795+0000","last_change":"2024-08-19T00:10:59.785350+0000","last_active":"2024-08-19T00:11:39.912795+0000","last_peered":"2024-08-19T00:11:39.912795+0000","last_clean":"2024-08-19T00:11:39.912795+0000","last_became_active":"2024-08-19T00:10:59.784929+0000","last_became_peered":"2024-08-19T00:10:59.784929+0000","last_unstale":"2024-08-19T00:11:39.912795+0000","last_undegraded":"2024-08-19T00:11:39.912795+0000","last_fullsized":"2024-08-19T00:11:39.912795+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:58:49.878253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.924921+0000","last_change":"2024-08-19T00:11:39.924921+0000","last_active":"2024-08-19T00:11:39.924921+0000","last_peered":"2024-08-19T00:11:39.924921+0000","last_clean":"2024-08-19T00:11:39.924921+0000","last_became_active":"2024-08-19T00:11:39.924551+0000","last_became_peered":"2024-08-19T00:11:39.924551+0000","last_unstale":"2024-08-19T00:11:39.924921+0000","last_undegraded":"2024-08-19T00:11:39.924921+0000","last_fullsized":"2024-08-19T00:11:39.924921+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:14:23.042222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"90'5","reported_seq":53,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:47.925734+0000","last_change":"2024-08-19T00:10:50.618159+0000","last_active":"2024-08-19T00:11:47.925734+0000","last_peered":"2024-08-19T00:11:47.925734+0000","last_clean":"2024-08-19T00:11:47.925734+0000","last_became_active":"2024-08-19T00:10:50.617828+0000","last_became_peered":"2024-08-19T00:10:50.617828+0000","last_unstale":"2024-08-19T00:11:47.925734+0000","last_undegraded":"2024-08-19T00:11:47.925734+0000","last_fullsized":"2024-08-19T00:11:47.925734+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:36:40.702592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913006+0000","last_change":"2024-08-19T00:10:59.787615+0000","last_active":"2024-08-19T00:11:39.913006+0000","last_peered":"2024-08-19T00:11:39.913006+0000","last_clean":"2024-08-19T00:11:39.913006+0000","last_became_active":"2024-08-19T00:10:59.787184+0000","last_became_peered":"2024-08-19T00:10:59.787184+0000","last_unstale":"2024-08-19T00:11:39.913006+0000","last_undegraded":"2024-08-19T00:11:39.913006+0000","last_fullsized":"2024-08-19T00:11:39.913006+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:20:42.174337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.912608+0000","last_change":"2024-08-19T00:10:52.509235+0000","last_active":"2024-08-19T00:11:39.912608+0000","last_peered":"2024-08-19T00:11:39.912608+0000","last_clean":"2024-08-19T00:11:39.912608+0000","last_became_active":"2024-08-19T00:10:52.508934+0000","last_became_peered":"2024-08-19T00:10:52.508934+0000","last_unstale":"2024-08-19T00:11:39.912608+0000","last_undegraded":"2024-08-19T00:11:39.912608+0000","last_fullsized":"2024-08-19T00:11:39.912608+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:12:59.654711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"90'4","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920451+0000","last_change":"2024-08-19T00:10:50.477180+0000","last_active":"2024-08-19T00:11:39.920451+0000","last_peered":"2024-08-19T00:11:39.920451+0000","last_clean":"2024-08-19T00:11:39.920451+0000","last_became_active":"2024-08-19T00:10:50.476875+0000","last_became_peered":"2024-08-19T00:10:50.476875+0000","last_unstale":"2024-08-19T00:11:39.920451+0000","last_undegraded":"2024-08-19T00:11:39.920451+0000","last_fullsized":"2024-08-19T00:11:39.920451+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:15:57.383599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.919963+0000","last_change":"2024-08-19T00:10:59.783389+0000","last_active":"2024-08-19T00:11:39.919963+0000","last_peered":"2024-08-19T00:11:39.919963+0000","last_clean":"2024-08-19T00:11:39.919963+0000","last_became_active":"2024-08-19T00:10:59.782983+0000","last_became_peered":"2024-08-19T00:10:59.782983+0000","last_unstale":"2024-08-19T00:11:39.919963+0000","last_undegraded":"2024-08-19T00:11:39.919963+0000","last_fullsized":"2024-08-19T00:11:39.919963+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:55:47.419588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916143+0000","last_change":"2024-08-19T00:10:52.517477+0000","last_active":"2024-08-19T00:11:39.916143+0000","last_peered":"2024-08-19T00:11:39.916143+0000","last_clean":"2024-08-19T00:11:39.916143+0000","last_became_active":"2024-08-19T00:10:52.517192+0000","last_became_peered":"2024-08-19T00:10:52.517192+0000","last_unstale":"2024-08-19T00:11:39.916143+0000","last_undegraded":"2024-08-19T00:11:39.916143+0000","last_fullsized":"2024-08-19T00:11:39.916143+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:31:01.125780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"90'6","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916486+0000","last_change":"2024-08-19T00:10:50.476296+0000","last_active":"2024-08-19T00:11:39.916486+0000","last_peered":"2024-08-19T00:11:39.916486+0000","last_clean":"2024-08-19T00:11:39.916486+0000","last_became_active":"2024-08-19T00:10:50.475835+0000","last_became_peered":"2024-08-19T00:10:50.475835+0000","last_unstale":"2024-08-19T00:11:39.916486+0000","last_undegraded":"2024-08-19T00:11:39.916486+0000","last_fullsized":"2024-08-19T00:11:39.916486+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:23:27.585779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":362,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920604+0000","last_change":"2024-08-19T00:09:43.445224+0000","last_active":"2024-08-19T00:11:39.920604+0000","last_peered":"2024-08-19T00:11:39.920604+0000","last_clean":"2024-08-19T00:11:39.920604+0000","last_became_active":"2024-08-19T00:09:43.444826+0000","last_became_peered":"2024-08-19T00:09:43.444826+0000","last_unstale":"2024-08-19T00:11:39.920604+0000","last_undegraded":"2024-08-19T00:11:39.920604+0000","last_fullsized":"2024-08-19T00:11:39.920604+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:06:42.707047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:06:42.707047+0000","last_clean_scrub_stamp":"2024-08-19T00:06:42.707047+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:37:10.588547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"92'1","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920770+0000","last_change":"2024-08-19T00:10:59.783987+0000","last_active":"2024-08-19T00:11:39.920770+0000","last_peered":"2024-08-19T00:11:39.920770+0000","last_clean":"2024-08-19T00:11:39.920770+0000","last_became_active":"2024-08-19T00:10:59.783569+0000","last_became_peered":"2024-08-19T00:10:59.783569+0000","last_unstale":"2024-08-19T00:11:39.920770+0000","last_undegraded":"2024-08-19T00:11:39.920770+0000","last_fullsized":"2024-08-19T00:11:39.920770+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:04:01.744644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920907+0000","last_change":"2024-08-19T00:10:52.516201+0000","last_active":"2024-08-19T00:11:39.920907+0000","last_peered":"2024-08-19T00:11:39.920907+0000","last_clean":"2024-08-19T00:11:39.920907+0000","last_became_active":"2024-08-19T00:10:52.515871+0000","last_became_peered":"2024-08-19T00:10:52.515871+0000","last_unstale":"2024-08-19T00:11:39.920907+0000","last_undegraded":"2024-08-19T00:11:39.920907+0000","last_fullsized":"2024-08-19T00:11:39.920907+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:54:49.528215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"90'5","reported_seq":56,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:49.932021+0000","last_change":"2024-08-19T00:10:50.620185+0000","last_active":"2024-08-19T00:11:49.932021+0000","last_peered":"2024-08-19T00:11:49.932021+0000","last_clean":"2024-08-19T00:11:49.932021+0000","last_became_active":"2024-08-19T00:10:50.619858+0000","last_became_peered":"2024-08-19T00:10:50.619858+0000","last_unstale":"2024-08-19T00:11:49.932021+0000","last_undegraded":"2024-08-19T00:11:49.932021+0000","last_fullsized":"2024-08-19T00:11:49.932021+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:30:21.893859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913286+0000","last_change":"2024-08-19T00:10:59.782056+0000","last_active":"2024-08-19T00:11:39.913286+0000","last_peered":"2024-08-19T00:11:39.913286+0000","last_clean":"2024-08-19T00:11:39.913286+0000","last_became_active":"2024-08-19T00:10:59.781666+0000","last_became_peered":"2024-08-19T00:10:59.781666+0000","last_unstale":"2024-08-19T00:11:39.913286+0000","last_undegraded":"2024-08-19T00:11:39.913286+0000","last_fullsized":"2024-08-19T00:11:39.913286+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:06:15.614372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920745+0000","last_change":"2024-08-19T00:10:52.523346+0000","last_active":"2024-08-19T00:11:39.920745+0000","last_peered":"2024-08-19T00:11:39.920745+0000","last_clean":"2024-08-19T00:11:39.920745+0000","last_became_active":"2024-08-19T00:10:52.523020+0000","last_became_peered":"2024-08-19T00:10:52.523020+0000","last_unstale":"2024-08-19T00:11:39.920745+0000","last_undegraded":"2024-08-19T00:11:39.920745+0000","last_fullsized":"2024-08-19T00:11:39.920745+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:09:58.259666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"90'3","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.919270+0000","last_change":"2024-08-19T00:10:50.471739+0000","last_active":"2024-08-19T00:11:39.919270+0000","last_peered":"2024-08-19T00:11:39.919270+0000","last_clean":"2024-08-19T00:11:39.919270+0000","last_became_active":"2024-08-19T00:10:50.471425+0000","last_became_peered":"2024-08-19T00:10:50.471425+0000","last_unstale":"2024-08-19T00:11:39.919270+0000","last_undegraded":"2024-08-19T00:11:39.919270+0000","last_fullsized":"2024-08-19T00:11:39.919270+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:55:26.332380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916291+0000","last_change":"2024-08-19T00:10:59.788685+0000","last_active":"2024-08-19T00:11:39.916291+0000","last_peered":"2024-08-19T00:11:39.916291+0000","last_clean":"2024-08-19T00:11:39.916291+0000","last_became_active":"2024-08-19T00:10:59.788343+0000","last_became_peered":"2024-08-19T00:10:59.788343+0000","last_unstale":"2024-08-19T00:11:39.916291+0000","last_undegraded":"2024-08-19T00:11:39.916291+0000","last_fullsized":"2024-08-19T00:11:39.916291+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:20:59.595494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920867+0000","last_change":"2024-08-19T00:10:52.516469+0000","last_active":"2024-08-19T00:11:39.920867+0000","last_peered":"2024-08-19T00:11:39.920867+0000","last_clean":"2024-08-19T00:11:39.920867+0000","last_became_active":"2024-08-19T00:10:52.516093+0000","last_became_peered":"2024-08-19T00:10:52.516093+0000","last_unstale":"2024-08-19T00:11:39.920867+0000","last_undegraded":"2024-08-19T00:11:39.920867+0000","last_fullsized":"2024-08-19T00:11:39.920867+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:18:29.327336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"90'5","reported_seq":51,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.921825+0000","last_change":"2024-08-19T00:11:39.921825+0000","last_active":"2024-08-19T00:11:39.921825+0000","last_peered":"2024-08-19T00:11:39.921825+0000","last_clean":"2024-08-19T00:11:39.921825+0000","last_became_active":"2024-08-19T00:11:39.917689+0000","last_became_peered":"2024-08-19T00:11:39.917689+0000","last_unstale":"2024-08-19T00:11:39.921825+0000","last_undegraded":"2024-08-19T00:11:39.921825+0000","last_fullsized":"2024-08-19T00:11:39.921825+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:37:47.940707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.918104+0000","last_change":"2024-08-19T00:10:59.785347+0000","last_active":"2024-08-19T00:11:39.918104+0000","last_peered":"2024-08-19T00:11:39.918104+0000","last_clean":"2024-08-19T00:11:39.918104+0000","last_became_active":"2024-08-19T00:10:59.784927+0000","last_became_peered":"2024-08-19T00:10:59.784927+0000","last_unstale":"2024-08-19T00:11:39.918104+0000","last_undegraded":"2024-08-19T00:11:39.918104+0000","last_fullsized":"2024-08-19T00:11:39.918104+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:39:41.919021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.912923+0000","last_change":"2024-08-19T00:10:52.524460+0000","last_active":"2024-08-19T00:11:39.912923+0000","last_peered":"2024-08-19T00:11:39.912923+0000","last_clean":"2024-08-19T00:11:39.912923+0000","last_became_active":"2024-08-19T00:10:52.523139+0000","last_became_peered":"2024-08-19T00:10:52.523139+0000","last_unstale":"2024-08-19T00:11:39.912923+0000","last_undegraded":"2024-08-19T00:11:39.912923+0000","last_fullsized":"2024-08-19T00:11:39.912923+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:50:55.142569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"90'2","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.912963+0000","last_change":"2024-08-19T00:10:50.474977+0000","last_active":"2024-08-19T00:11:39.912963+0000","last_peered":"2024-08-19T00:11:39.912963+0000","last_clean":"2024-08-19T00:11:39.912963+0000","last_became_active":"2024-08-19T00:10:50.474653+0000","last_became_peered":"2024-08-19T00:10:50.474653+0000","last_unstale":"2024-08-19T00:11:39.912963+0000","last_undegraded":"2024-08-19T00:11:39.912963+0000","last_fullsized":"2024-08-19T00:11:39.912963+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:20:31.565098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920595+0000","last_change":"2024-08-19T00:10:59.789912+0000","last_active":"2024-08-19T00:11:39.920595+0000","last_peered":"2024-08-19T00:11:39.920595+0000","last_clean":"2024-08-19T00:11:39.920595+0000","last_became_active":"2024-08-19T00:10:59.789143+0000","last_became_peered":"2024-08-19T00:10:59.789143+0000","last_unstale":"2024-08-19T00:11:39.920595+0000","last_undegraded":"2024-08-19T00:11:39.920595+0000","last_fullsized":"2024-08-19T00:11:39.920595+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:06:53.447173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920777+0000","last_change":"2024-08-19T00:10:52.525061+0000","last_active":"2024-08-19T00:11:39.920777+0000","last_peered":"2024-08-19T00:11:39.920777+0000","last_clean":"2024-08-19T00:11:39.920777+0000","last_became_active":"2024-08-19T00:10:52.524752+0000","last_became_peered":"2024-08-19T00:10:52.524752+0000","last_unstale":"2024-08-19T00:11:39.920777+0000","last_undegraded":"2024-08-19T00:11:39.920777+0000","last_fullsized":"2024-08-19T00:11:39.920777+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:50:47.817220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"90'17","reported_seq":52,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913283+0000","last_change":"2024-08-19T00:10:50.618923+0000","last_active":"2024-08-19T00:11:39.913283+0000","last_peered":"2024-08-19T00:11:39.913283+0000","last_clean":"2024-08-19T00:11:39.913283+0000","last_became_active":"2024-08-19T00:10:50.618586+0000","last_became_peered":"2024-08-19T00:10:50.618586+0000","last_unstale":"2024-08-19T00:11:39.913283+0000","last_undegraded":"2024-08-19T00:11:39.913283+0000","last_fullsized":"2024-08-19T00:11:39.913283+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:07:45.186059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913068+0000","last_change":"2024-08-19T00:10:59.785681+0000","last_active":"2024-08-19T00:11:39.913068+0000","last_peered":"2024-08-19T00:11:39.913068+0000","last_clean":"2024-08-19T00:11:39.913068+0000","last_became_active":"2024-08-19T00:10:59.785299+0000","last_became_peered":"2024-08-19T00:10:59.785299+0000","last_unstale":"2024-08-19T00:11:39.913068+0000","last_undegraded":"2024-08-19T00:11:39.913068+0000","last_fullsized":"2024-08-19T00:11:39.913068+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:36:08.151180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920368+0000","last_change":"2024-08-19T00:10:52.523398+0000","last_active":"2024-08-19T00:11:39.920368+0000","last_peered":"2024-08-19T00:11:39.920368+0000","last_clean":"2024-08-19T00:11:39.920368+0000","last_became_active":"2024-08-19T00:10:52.523066+0000","last_became_peered":"2024-08-19T00:10:52.523066+0000","last_unstale":"2024-08-19T00:11:39.920368+0000","last_undegraded":"2024-08-19T00:11:39.920368+0000","last_fullsized":"2024-08-19T00:11:39.920368+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:47:25.137487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"90'5","reported_seq":55,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:48.927436+0000","last_change":"2024-08-19T00:10:50.475827+0000","last_active":"2024-08-19T00:11:48.927436+0000","last_peered":"2024-08-19T00:11:48.927436+0000","last_clean":"2024-08-19T00:11:48.927436+0000","last_became_active":"2024-08-19T00:10:50.475470+0000","last_became_peered":"2024-08-19T00:10:50.475470+0000","last_unstale":"2024-08-19T00:11:48.927436+0000","last_undegraded":"2024-08-19T00:11:48.927436+0000","last_fullsized":"2024-08-19T00:11:48.927436+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:25:14.200317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.910632+0000","last_change":"2024-08-19T00:10:59.789047+0000","last_active":"2024-08-19T00:11:39.910632+0000","last_peered":"2024-08-19T00:11:39.910632+0000","last_clean":"2024-08-19T00:11:39.910632+0000","last_became_active":"2024-08-19T00:10:59.788694+0000","last_became_peered":"2024-08-19T00:10:59.788694+0000","last_unstale":"2024-08-19T00:11:39.910632+0000","last_undegraded":"2024-08-19T00:11:39.910632+0000","last_fullsized":"2024-08-19T00:11:39.910632+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:00:22.463593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920596+0000","last_change":"2024-08-19T00:10:52.511480+0000","last_active":"2024-08-19T00:11:39.920596+0000","last_peered":"2024-08-19T00:11:39.920596+0000","last_clean":"2024-08-19T00:11:39.920596+0000","last_became_active":"2024-08-19T00:10:52.511159+0000","last_became_peered":"2024-08-19T00:10:52.511159+0000","last_unstale":"2024-08-19T00:11:39.920596+0000","last_undegraded":"2024-08-19T00:11:39.920596+0000","last_fullsized":"2024-08-19T00:11:39.920596+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:28:31.136900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"90'5","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.919763+0000","last_change":"2024-08-19T00:10:50.476761+0000","last_active":"2024-08-19T00:11:39.919763+0000","last_peered":"2024-08-19T00:11:39.919763+0000","last_clean":"2024-08-19T00:11:39.919763+0000","last_became_active":"2024-08-19T00:10:50.476455+0000","last_became_peered":"2024-08-19T00:10:50.476455+0000","last_unstale":"2024-08-19T00:11:39.919763+0000","last_undegraded":"2024-08-19T00:11:39.919763+0000","last_fullsized":"2024-08-19T00:11:39.919763+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:34:52.158438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.912580+0000","last_change":"2024-08-19T00:10:59.778313+0000","last_active":"2024-08-19T00:11:39.912580+0000","last_peered":"2024-08-19T00:11:39.912580+0000","last_clean":"2024-08-19T00:11:39.912580+0000","last_became_active":"2024-08-19T00:10:59.777831+0000","last_became_peered":"2024-08-19T00:10:59.777831+0000","last_unstale":"2024-08-19T00:11:39.912580+0000","last_undegraded":"2024-08-19T00:11:39.912580+0000","last_fullsized":"2024-08-19T00:11:39.912580+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:34:05.474277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.912741+0000","last_change":"2024-08-19T00:10:52.513719+0000","last_active":"2024-08-19T00:11:39.912741+0000","last_peered":"2024-08-19T00:11:39.912741+0000","last_clean":"2024-08-19T00:11:39.912741+0000","last_became_active":"2024-08-19T00:10:52.513345+0000","last_became_peered":"2024-08-19T00:10:52.513345+0000","last_unstale":"2024-08-19T00:11:39.912741+0000","last_undegraded":"2024-08-19T00:11:39.912741+0000","last_fullsized":"2024-08-19T00:11:39.912741+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:50:28.862870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"90'9","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916408+0000","last_change":"2024-08-19T00:10:50.475529+0000","last_active":"2024-08-19T00:11:39.916408+0000","last_peered":"2024-08-19T00:11:39.916408+0000","last_clean":"2024-08-19T00:11:39.916408+0000","last_became_active":"2024-08-19T00:10:50.473544+0000","last_became_peered":"2024-08-19T00:10:50.473544+0000","last_unstale":"2024-08-19T00:11:39.916408+0000","last_undegraded":"2024-08-19T00:11:39.916408+0000","last_fullsized":"2024-08-19T00:11:39.916408+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:49:42.663650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.918895+0000","last_change":"2024-08-19T00:10:59.789028+0000","last_active":"2024-08-19T00:11:39.918895+0000","last_peered":"2024-08-19T00:11:39.918895+0000","last_clean":"2024-08-19T00:11:39.918895+0000","last_became_active":"2024-08-19T00:10:59.788606+0000","last_became_peered":"2024-08-19T00:10:59.788606+0000","last_unstale":"2024-08-19T00:11:39.918895+0000","last_undegraded":"2024-08-19T00:11:39.918895+0000","last_fullsized":"2024-08-19T00:11:39.918895+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:59:06.617755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913196+0000","last_change":"2024-08-19T00:10:52.520826+0000","last_active":"2024-08-19T00:11:39.913196+0000","last_peered":"2024-08-19T00:11:39.913196+0000","last_clean":"2024-08-19T00:11:39.913196+0000","last_became_active":"2024-08-19T00:10:52.520437+0000","last_became_peered":"2024-08-19T00:10:52.520437+0000","last_unstale":"2024-08-19T00:11:39.913196+0000","last_undegraded":"2024-08-19T00:11:39.913196+0000","last_fullsized":"2024-08-19T00:11:39.913196+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:30:06.843697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"92'32","reported_seq":101,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:49.943965+0000","last_change":"2024-08-19T00:10:50.473195+0000","last_active":"2024-08-19T00:11:49.943965+0000","last_peered":"2024-08-19T00:11:49.943965+0000","last_clean":"2024-08-19T00:11:49.943965+0000","last_became_active":"2024-08-19T00:10:50.472863+0000","last_became_peered":"2024-08-19T00:10:50.472863+0000","last_unstale":"2024-08-19T00:11:49.943965+0000","last_undegraded":"2024-08-19T00:11:49.943965+0000","last_fullsized":"2024-08-19T00:11:49.943965+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:09:04.859829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54390,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":70,"num_write":34,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.922789+0000","last_change":"2024-08-19T00:11:39.922405+0000","last_active":"2024-08-19T00:11:39.922789+0000","last_peered":"2024-08-19T00:11:39.922789+0000","last_clean":"2024-08-19T00:11:39.922789+0000","last_became_active":"2024-08-19T00:11:39.922054+0000","last_became_peered":"2024-08-19T00:11:39.922054+0000","last_unstale":"2024-08-19T00:11:39.922789+0000","last_undegraded":"2024-08-19T00:11:39.922789+0000","last_fullsized":"2024-08-19T00:11:39.922789+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:47:01.990229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.918080+0000","last_change":"2024-08-19T00:11:39.918080+0000","last_active":"2024-08-19T00:11:39.918080+0000","last_peered":"2024-08-19T00:11:39.918080+0000","last_clean":"2024-08-19T00:11:39.918080+0000","last_became_active":"2024-08-19T00:11:39.917742+0000","last_became_peered":"2024-08-19T00:11:39.917742+0000","last_unstale":"2024-08-19T00:11:39.918080+0000","last_undegraded":"2024-08-19T00:11:39.918080+0000","last_fullsized":"2024-08-19T00:11:39.918080+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:57:19.983148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"90'5","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.919164+0000","last_change":"2024-08-19T00:10:50.618094+0000","last_active":"2024-08-19T00:11:39.919164+0000","last_peered":"2024-08-19T00:11:39.919164+0000","last_clean":"2024-08-19T00:11:39.919164+0000","last_became_active":"2024-08-19T00:10:50.617786+0000","last_became_peered":"2024-08-19T00:10:50.617786+0000","last_unstale":"2024-08-19T00:11:39.919164+0000","last_undegraded":"2024-08-19T00:11:39.919164+0000","last_fullsized":"2024-08-19T00:11:39.919164+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:05:46.231214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915705+0000","last_change":"2024-08-19T00:10:59.780786+0000","last_active":"2024-08-19T00:11:39.915705+0000","last_peered":"2024-08-19T00:11:39.915705+0000","last_clean":"2024-08-19T00:11:39.915705+0000","last_became_active":"2024-08-19T00:10:59.780364+0000","last_became_peered":"2024-08-19T00:10:59.780364+0000","last_unstale":"2024-08-19T00:11:39.915705+0000","last_undegraded":"2024-08-19T00:11:39.915705+0000","last_fullsized":"2024-08-19T00:11:39.915705+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:39:45.113590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916082+0000","last_change":"2024-08-19T00:10:52.520623+0000","last_active":"2024-08-19T00:11:39.916082+0000","last_peered":"2024-08-19T00:11:39.916082+0000","last_clean":"2024-08-19T00:11:39.916082+0000","last_became_active":"2024-08-19T00:10:52.520321+0000","last_became_peered":"2024-08-19T00:10:52.520321+0000","last_unstale":"2024-08-19T00:11:39.916082+0000","last_undegraded":"2024-08-19T00:11:39.916082+0000","last_fullsized":"2024-08-19T00:11:39.916082+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:56:42.526199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"90'4","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920887+0000","last_change":"2024-08-19T00:10:50.474925+0000","last_active":"2024-08-19T00:11:39.920887+0000","last_peered":"2024-08-19T00:11:39.920887+0000","last_clean":"2024-08-19T00:11:39.920887+0000","last_became_active":"2024-08-19T00:10:50.474573+0000","last_became_peered":"2024-08-19T00:10:50.474573+0000","last_unstale":"2024-08-19T00:11:39.920887+0000","last_undegraded":"2024-08-19T00:11:39.920887+0000","last_fullsized":"2024-08-19T00:11:39.920887+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:10:32.136867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920527+0000","last_change":"2024-08-19T00:11:39.920527+0000","last_active":"2024-08-19T00:11:39.920527+0000","last_peered":"2024-08-19T00:11:39.920527+0000","last_clean":"2024-08-19T00:11:39.920527+0000","last_became_active":"2024-08-19T00:11:39.919490+0000","last_became_peered":"2024-08-19T00:11:39.919490+0000","last_unstale":"2024-08-19T00:11:39.920527+0000","last_undegraded":"2024-08-19T00:11:39.920527+0000","last_fullsized":"2024-08-19T00:11:39.920527+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:33:09.191177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913768+0000","last_change":"2024-08-19T00:10:52.510783+0000","last_active":"2024-08-19T00:11:39.913768+0000","last_peered":"2024-08-19T00:11:39.913768+0000","last_clean":"2024-08-19T00:11:39.913768+0000","last_became_active":"2024-08-19T00:10:52.510359+0000","last_became_peered":"2024-08-19T00:10:52.510359+0000","last_unstale":"2024-08-19T00:11:39.913768+0000","last_undegraded":"2024-08-19T00:11:39.913768+0000","last_fullsized":"2024-08-19T00:11:39.913768+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:20:03.682633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"90'4","reported_seq":66,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:49.931185+0000","last_change":"2024-08-19T00:10:50.470887+0000","last_active":"2024-08-19T00:11:49.931185+0000","last_peered":"2024-08-19T00:11:49.931185+0000","last_clean":"2024-08-19T00:11:49.931185+0000","last_became_active":"2024-08-19T00:10:50.470517+0000","last_became_peered":"2024-08-19T00:10:50.470517+0000","last_unstale":"2024-08-19T00:11:49.931185+0000","last_undegraded":"2024-08-19T00:11:49.931185+0000","last_fullsized":"2024-08-19T00:11:49.931185+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:52:33.864552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915676+0000","last_change":"2024-08-19T00:10:59.787686+0000","last_active":"2024-08-19T00:11:39.915676+0000","last_peered":"2024-08-19T00:11:39.915676+0000","last_clean":"2024-08-19T00:11:39.915676+0000","last_became_active":"2024-08-19T00:10:59.787236+0000","last_became_peered":"2024-08-19T00:10:59.787236+0000","last_unstale":"2024-08-19T00:11:39.915676+0000","last_undegraded":"2024-08-19T00:11:39.915676+0000","last_fullsized":"2024-08-19T00:11:39.915676+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:57:11.012865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916402+0000","last_change":"2024-08-19T00:10:59.782541+0000","last_active":"2024-08-19T00:11:39.916402+0000","last_peered":"2024-08-19T00:11:39.916402+0000","last_clean":"2024-08-19T00:11:39.916402+0000","last_became_active":"2024-08-19T00:10:59.782136+0000","last_became_peered":"2024-08-19T00:10:59.782136+0000","last_unstale":"2024-08-19T00:11:39.916402+0000","last_undegraded":"2024-08-19T00:11:39.916402+0000","last_fullsized":"2024-08-19T00:11:39.916402+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:44:39.501168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.910189+0000","last_change":"2024-08-19T00:10:52.509396+0000","last_active":"2024-08-19T00:11:39.910189+0000","last_peered":"2024-08-19T00:11:39.910189+0000","last_clean":"2024-08-19T00:11:39.910189+0000","last_became_active":"2024-08-19T00:10:52.509075+0000","last_became_peered":"2024-08-19T00:10:52.509075+0000","last_unstale":"2024-08-19T00:11:39.910189+0000","last_undegraded":"2024-08-19T00:11:39.910189+0000","last_fullsized":"2024-08-19T00:11:39.910189+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:40:53.611213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"90'3","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920355+0000","last_change":"2024-08-19T00:10:50.476723+0000","last_active":"2024-08-19T00:11:39.920355+0000","last_peered":"2024-08-19T00:11:39.920355+0000","last_clean":"2024-08-19T00:11:39.920355+0000","last_became_active":"2024-08-19T00:10:50.476399+0000","last_became_peered":"2024-08-19T00:10:50.476399+0000","last_unstale":"2024-08-19T00:11:39.920355+0000","last_undegraded":"2024-08-19T00:11:39.920355+0000","last_fullsized":"2024-08-19T00:11:39.920355+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:04:01.951387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913044+0000","last_change":"2024-08-19T00:10:59.781481+0000","last_active":"2024-08-19T00:11:39.913044+0000","last_peered":"2024-08-19T00:11:39.913044+0000","last_clean":"2024-08-19T00:11:39.913044+0000","last_became_active":"2024-08-19T00:10:59.780160+0000","last_became_peered":"2024-08-19T00:10:59.780160+0000","last_unstale":"2024-08-19T00:11:39.913044+0000","last_undegraded":"2024-08-19T00:11:39.913044+0000","last_fullsized":"2024-08-19T00:11:39.913044+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:14:46.340158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915284+0000","last_change":"2024-08-19T00:10:52.516780+0000","last_active":"2024-08-19T00:11:39.915284+0000","last_peered":"2024-08-19T00:11:39.915284+0000","last_clean":"2024-08-19T00:11:39.915284+0000","last_became_active":"2024-08-19T00:10:52.513264+0000","last_became_peered":"2024-08-19T00:10:52.513264+0000","last_unstale":"2024-08-19T00:11:39.915284+0000","last_undegraded":"2024-08-19T00:11:39.915284+0000","last_fullsized":"2024-08-19T00:11:39.915284+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:36:49.238267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"90'3","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.912619+0000","last_change":"2024-08-19T00:10:50.472840+0000","last_active":"2024-08-19T00:11:39.912619+0000","last_peered":"2024-08-19T00:11:39.912619+0000","last_clean":"2024-08-19T00:11:39.912619+0000","last_became_active":"2024-08-19T00:10:50.472534+0000","last_became_peered":"2024-08-19T00:10:50.472534+0000","last_unstale":"2024-08-19T00:11:39.912619+0000","last_undegraded":"2024-08-19T00:11:39.912619+0000","last_fullsized":"2024-08-19T00:11:39.912619+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:41:53.505360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.911662+0000","last_change":"2024-08-19T00:10:50.469342+0000","last_active":"2024-08-19T00:11:39.911662+0000","last_peered":"2024-08-19T00:11:39.911662+0000","last_clean":"2024-08-19T00:11:39.911662+0000","last_became_active":"2024-08-19T00:10:50.468800+0000","last_became_peered":"2024-08-19T00:10:50.468800+0000","last_unstale":"2024-08-19T00:11:39.911662+0000","last_undegraded":"2024-08-19T00:11:39.911662+0000","last_fullsized":"2024-08-19T00:11:39.911662+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:58:28.804117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920904+0000","last_change":"2024-08-19T00:10:52.523634+0000","last_active":"2024-08-19T00:11:39.920904+0000","last_peered":"2024-08-19T00:11:39.920904+0000","last_clean":"2024-08-19T00:11:39.920904+0000","last_became_active":"2024-08-19T00:10:52.523336+0000","last_became_peered":"2024-08-19T00:10:52.523336+0000","last_unstale":"2024-08-19T00:11:39.920904+0000","last_undegraded":"2024-08-19T00:11:39.920904+0000","last_fullsized":"2024-08-19T00:11:39.920904+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:55:08.994124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.922401+0000","last_change":"2024-08-19T00:11:39.922401+0000","last_active":"2024-08-19T00:11:39.922401+0000","last_peered":"2024-08-19T00:11:39.922401+0000","last_clean":"2024-08-19T00:11:39.922401+0000","last_became_active":"2024-08-19T00:11:39.921979+0000","last_became_peered":"2024-08-19T00:11:39.921979+0000","last_unstale":"2024-08-19T00:11:39.922401+0000","last_undegraded":"2024-08-19T00:11:39.922401+0000","last_fullsized":"2024-08-19T00:11:39.922401+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:58:57.453222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,8],"acting":[2,6,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"90'5","reported_seq":56,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:49.936234+0000","last_change":"2024-08-19T00:10:50.476035+0000","last_active":"2024-08-19T00:11:49.936234+0000","last_peered":"2024-08-19T00:11:49.936234+0000","last_clean":"2024-08-19T00:11:49.936234+0000","last_became_active":"2024-08-19T00:10:50.475733+0000","last_became_peered":"2024-08-19T00:10:50.475733+0000","last_unstale":"2024-08-19T00:11:49.936234+0000","last_undegraded":"2024-08-19T00:11:49.936234+0000","last_fullsized":"2024-08-19T00:11:49.936234+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:27:59.026582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.914126+0000","last_change":"2024-08-19T00:10:52.522185+0000","last_active":"2024-08-19T00:11:39.914126+0000","last_peered":"2024-08-19T00:11:39.914126+0000","last_clean":"2024-08-19T00:11:39.914126+0000","last_became_active":"2024-08-19T00:10:52.521747+0000","last_became_peered":"2024-08-19T00:10:52.521747+0000","last_unstale":"2024-08-19T00:11:39.914126+0000","last_undegraded":"2024-08-19T00:11:39.914126+0000","last_fullsized":"2024-08-19T00:11:39.914126+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:14:23.631484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915843+0000","last_change":"2024-08-19T00:10:59.783512+0000","last_active":"2024-08-19T00:11:39.915843+0000","last_peered":"2024-08-19T00:11:39.915843+0000","last_clean":"2024-08-19T00:11:39.915843+0000","last_became_active":"2024-08-19T00:10:59.783099+0000","last_became_peered":"2024-08-19T00:10:59.783099+0000","last_unstale":"2024-08-19T00:11:39.915843+0000","last_undegraded":"2024-08-19T00:11:39.915843+0000","last_fullsized":"2024-08-19T00:11:39.915843+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:02:27.977608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.912816+0000","last_change":"2024-08-19T00:10:52.524213+0000","last_active":"2024-08-19T00:11:39.912816+0000","last_peered":"2024-08-19T00:11:39.912816+0000","last_clean":"2024-08-19T00:11:39.912816+0000","last_became_active":"2024-08-19T00:10:52.523185+0000","last_became_peered":"2024-08-19T00:10:52.523185+0000","last_unstale":"2024-08-19T00:11:39.912816+0000","last_undegraded":"2024-08-19T00:11:39.912816+0000","last_fullsized":"2024-08-19T00:11:39.912816+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:23:48.569312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915774+0000","last_change":"2024-08-19T00:10:52.521436+0000","last_active":"2024-08-19T00:11:39.915774+0000","last_peered":"2024-08-19T00:11:39.915774+0000","last_clean":"2024-08-19T00:11:39.915774+0000","last_became_active":"2024-08-19T00:10:52.520842+0000","last_became_peered":"2024-08-19T00:10:52.520842+0000","last_unstale":"2024-08-19T00:11:39.915774+0000","last_undegraded":"2024-08-19T00:11:39.915774+0000","last_fullsized":"2024-08-19T00:11:39.915774+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:22:31.568680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915897+0000","last_change":"2024-08-19T00:10:52.514170+0000","last_active":"2024-08-19T00:11:39.915897+0000","last_peered":"2024-08-19T00:11:39.915897+0000","last_clean":"2024-08-19T00:11:39.915897+0000","last_became_active":"2024-08-19T00:10:52.513870+0000","last_became_peered":"2024-08-19T00:10:52.513870+0000","last_unstale":"2024-08-19T00:11:39.915897+0000","last_undegraded":"2024-08-19T00:11:39.915897+0000","last_fullsized":"2024-08-19T00:11:39.915897+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:29:04.125347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916321+0000","last_change":"2024-08-19T00:10:52.512320+0000","last_active":"2024-08-19T00:11:39.916321+0000","last_peered":"2024-08-19T00:11:39.916321+0000","last_clean":"2024-08-19T00:11:39.916321+0000","last_became_active":"2024-08-19T00:10:52.512003+0000","last_became_peered":"2024-08-19T00:10:52.512003+0000","last_unstale":"2024-08-19T00:11:39.916321+0000","last_undegraded":"2024-08-19T00:11:39.916321+0000","last_fullsized":"2024-08-19T00:11:39.916321+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:28:52.261457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913084+0000","last_change":"2024-08-19T00:10:52.511454+0000","last_active":"2024-08-19T00:11:39.913084+0000","last_peered":"2024-08-19T00:11:39.913084+0000","last_clean":"2024-08-19T00:11:39.913084+0000","last_became_active":"2024-08-19T00:10:52.511036+0000","last_became_peered":"2024-08-19T00:10:52.511036+0000","last_unstale":"2024-08-19T00:11:39.913084+0000","last_undegraded":"2024-08-19T00:11:39.913084+0000","last_fullsized":"2024-08-19T00:11:39.913084+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:14:04.749222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913672+0000","last_change":"2024-08-19T00:10:52.526393+0000","last_active":"2024-08-19T00:11:39.913672+0000","last_peered":"2024-08-19T00:11:39.913672+0000","last_clean":"2024-08-19T00:11:39.913672+0000","last_became_active":"2024-08-19T00:10:52.526043+0000","last_became_peered":"2024-08-19T00:10:52.526043+0000","last_unstale":"2024-08-19T00:11:39.913672+0000","last_undegraded":"2024-08-19T00:11:39.913672+0000","last_fullsized":"2024-08-19T00:11:39.913672+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:18:48.505255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.918255+0000","last_change":"2024-08-19T00:10:52.516028+0000","last_active":"2024-08-19T00:11:39.918255+0000","last_peered":"2024-08-19T00:11:39.918255+0000","last_clean":"2024-08-19T00:11:39.918255+0000","last_became_active":"2024-08-19T00:10:52.515659+0000","last_became_peered":"2024-08-19T00:10:52.515659+0000","last_unstale":"2024-08-19T00:11:39.918255+0000","last_undegraded":"2024-08-19T00:11:39.918255+0000","last_fullsized":"2024-08-19T00:11:39.918255+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:31:14.995175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916120+0000","last_change":"2024-08-19T00:10:52.516196+0000","last_active":"2024-08-19T00:11:39.916120+0000","last_peered":"2024-08-19T00:11:39.916120+0000","last_clean":"2024-08-19T00:11:39.916120+0000","last_became_active":"2024-08-19T00:10:52.515533+0000","last_became_peered":"2024-08-19T00:10:52.515533+0000","last_unstale":"2024-08-19T00:11:39.916120+0000","last_undegraded":"2024-08-19T00:11:39.916120+0000","last_fullsized":"2024-08-19T00:11:39.916120+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:32:25.207184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.918369+0000","last_change":"2024-08-19T00:10:52.527433+0000","last_active":"2024-08-19T00:11:39.918369+0000","last_peered":"2024-08-19T00:11:39.918369+0000","last_clean":"2024-08-19T00:11:39.918369+0000","last_became_active":"2024-08-19T00:10:52.525490+0000","last_became_peered":"2024-08-19T00:10:52.525490+0000","last_unstale":"2024-08-19T00:11:39.918369+0000","last_undegraded":"2024-08-19T00:11:39.918369+0000","last_fullsized":"2024-08-19T00:11:39.918369+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:21:14.545808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915814+0000","last_change":"2024-08-19T00:10:52.515503+0000","last_active":"2024-08-19T00:11:39.915814+0000","last_peered":"2024-08-19T00:11:39.915814+0000","last_clean":"2024-08-19T00:11:39.915814+0000","last_became_active":"2024-08-19T00:10:52.515178+0000","last_became_peered":"2024-08-19T00:10:52.515178+0000","last_unstale":"2024-08-19T00:11:39.915814+0000","last_undegraded":"2024-08-19T00:11:39.915814+0000","last_fullsized":"2024-08-19T00:11:39.915814+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:30:27.825463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913615+0000","last_change":"2024-08-19T00:10:52.515133+0000","last_active":"2024-08-19T00:11:39.913615+0000","last_peered":"2024-08-19T00:11:39.913615+0000","last_clean":"2024-08-19T00:11:39.913615+0000","last_became_active":"2024-08-19T00:10:52.514851+0000","last_became_peered":"2024-08-19T00:10:52.514851+0000","last_unstale":"2024-08-19T00:11:39.913615+0000","last_undegraded":"2024-08-19T00:11:39.913615+0000","last_fullsized":"2024-08-19T00:11:39.913615+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:38:53.593993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913028+0000","last_change":"2024-08-19T00:10:52.512127+0000","last_active":"2024-08-19T00:11:39.913028+0000","last_peered":"2024-08-19T00:11:39.913028+0000","last_clean":"2024-08-19T00:11:39.913028+0000","last_became_active":"2024-08-19T00:10:52.511840+0000","last_became_peered":"2024-08-19T00:10:52.511840+0000","last_unstale":"2024-08-19T00:11:39.913028+0000","last_undegraded":"2024-08-19T00:11:39.913028+0000","last_fullsized":"2024-08-19T00:11:39.913028+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:36:32.878531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913944+0000","last_change":"2024-08-19T00:10:52.519470+0000","last_active":"2024-08-19T00:11:39.913944+0000","last_peered":"2024-08-19T00:11:39.913944+0000","last_clean":"2024-08-19T00:11:39.913944+0000","last_became_active":"2024-08-19T00:10:52.519131+0000","last_became_peered":"2024-08-19T00:10:52.519131+0000","last_unstale":"2024-08-19T00:11:39.913944+0000","last_undegraded":"2024-08-19T00:11:39.913944+0000","last_fullsized":"2024-08-19T00:11:39.913944+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:56:53.628868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915974+0000","last_change":"2024-08-19T00:10:52.511114+0000","last_active":"2024-08-19T00:11:39.915974+0000","last_peered":"2024-08-19T00:11:39.915974+0000","last_clean":"2024-08-19T00:11:39.915974+0000","last_became_active":"2024-08-19T00:10:52.510759+0000","last_became_peered":"2024-08-19T00:10:52.510759+0000","last_unstale":"2024-08-19T00:11:39.915974+0000","last_undegraded":"2024-08-19T00:11:39.915974+0000","last_fullsized":"2024-08-19T00:11:39.915974+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:54:10.590297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.910810+0000","last_change":"2024-08-19T00:10:52.507998+0000","last_active":"2024-08-19T00:11:39.910810+0000","last_peered":"2024-08-19T00:11:39.910810+0000","last_clean":"2024-08-19T00:11:39.910810+0000","last_became_active":"2024-08-19T00:10:52.507679+0000","last_became_peered":"2024-08-19T00:10:52.507679+0000","last_unstale":"2024-08-19T00:11:39.910810+0000","last_undegraded":"2024-08-19T00:11:39.910810+0000","last_fullsized":"2024-08-19T00:11:39.910810+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:59:48.098911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913458+0000","last_change":"2024-08-19T00:10:52.524171+0000","last_active":"2024-08-19T00:11:39.913458+0000","last_peered":"2024-08-19T00:11:39.913458+0000","last_clean":"2024-08-19T00:11:39.913458+0000","last_became_active":"2024-08-19T00:10:52.523028+0000","last_became_peered":"2024-08-19T00:10:52.523028+0000","last_unstale":"2024-08-19T00:11:39.913458+0000","last_undegraded":"2024-08-19T00:11:39.913458+0000","last_fullsized":"2024-08-19T00:11:39.913458+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:51:24.567971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913253+0000","last_change":"2024-08-19T00:10:52.514309+0000","last_active":"2024-08-19T00:11:39.913253+0000","last_peered":"2024-08-19T00:11:39.913253+0000","last_clean":"2024-08-19T00:11:39.913253+0000","last_became_active":"2024-08-19T00:10:52.513992+0000","last_became_peered":"2024-08-19T00:10:52.513992+0000","last_unstale":"2024-08-19T00:11:39.913253+0000","last_undegraded":"2024-08-19T00:11:39.913253+0000","last_fullsized":"2024-08-19T00:11:39.913253+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:34:14.014490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915278+0000","last_change":"2024-08-19T00:10:52.516033+0000","last_active":"2024-08-19T00:11:39.915278+0000","last_peered":"2024-08-19T00:11:39.915278+0000","last_clean":"2024-08-19T00:11:39.915278+0000","last_became_active":"2024-08-19T00:10:52.515713+0000","last_became_peered":"2024-08-19T00:10:52.515713+0000","last_unstale":"2024-08-19T00:11:39.915278+0000","last_undegraded":"2024-08-19T00:11:39.915278+0000","last_fullsized":"2024-08-19T00:11:39.915278+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:06:40.832460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915258+0000","last_change":"2024-08-19T00:10:52.518521+0000","last_active":"2024-08-19T00:11:39.915258+0000","last_peered":"2024-08-19T00:11:39.915258+0000","last_clean":"2024-08-19T00:11:39.915258+0000","last_became_active":"2024-08-19T00:10:52.518237+0000","last_became_peered":"2024-08-19T00:10:52.518237+0000","last_unstale":"2024-08-19T00:11:39.915258+0000","last_undegraded":"2024-08-19T00:11:39.915258+0000","last_fullsized":"2024-08-19T00:11:39.915258+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:17:20.569044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.912988+0000","last_change":"2024-08-19T00:10:52.519774+0000","last_active":"2024-08-19T00:11:39.912988+0000","last_peered":"2024-08-19T00:11:39.912988+0000","last_clean":"2024-08-19T00:11:39.912988+0000","last_became_active":"2024-08-19T00:10:52.519456+0000","last_became_peered":"2024-08-19T00:10:52.519456+0000","last_unstale":"2024-08-19T00:11:39.912988+0000","last_undegraded":"2024-08-19T00:11:39.912988+0000","last_fullsized":"2024-08-19T00:11:39.912988+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:47:52.675650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916215+0000","last_change":"2024-08-19T00:10:52.514200+0000","last_active":"2024-08-19T00:11:39.916215+0000","last_peered":"2024-08-19T00:11:39.916215+0000","last_clean":"2024-08-19T00:11:39.916215+0000","last_became_active":"2024-08-19T00:10:52.513821+0000","last_became_peered":"2024-08-19T00:10:52.513821+0000","last_unstale":"2024-08-19T00:11:39.916215+0000","last_undegraded":"2024-08-19T00:11:39.916215+0000","last_fullsized":"2024-08-19T00:11:39.916215+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:15:30.084873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920854+0000","last_change":"2024-08-19T00:10:52.519781+0000","last_active":"2024-08-19T00:11:39.920854+0000","last_peered":"2024-08-19T00:11:39.920854+0000","last_clean":"2024-08-19T00:11:39.920854+0000","last_became_active":"2024-08-19T00:10:52.519395+0000","last_became_peered":"2024-08-19T00:10:52.519395+0000","last_unstale":"2024-08-19T00:11:39.920854+0000","last_undegraded":"2024-08-19T00:11:39.920854+0000","last_fullsized":"2024-08-19T00:11:39.920854+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:10:15.160535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.911435+0000","last_change":"2024-08-19T00:10:52.510293+0000","last_active":"2024-08-19T00:11:39.911435+0000","last_peered":"2024-08-19T00:11:39.911435+0000","last_clean":"2024-08-19T00:11:39.911435+0000","last_became_active":"2024-08-19T00:10:52.509983+0000","last_became_peered":"2024-08-19T00:10:52.509983+0000","last_unstale":"2024-08-19T00:11:39.911435+0000","last_undegraded":"2024-08-19T00:11:39.911435+0000","last_fullsized":"2024-08-19T00:11:39.911435+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:59:11.488742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913928+0000","last_change":"2024-08-19T00:10:52.518778+0000","last_active":"2024-08-19T00:11:39.913928+0000","last_peered":"2024-08-19T00:11:39.913928+0000","last_clean":"2024-08-19T00:11:39.913928+0000","last_became_active":"2024-08-19T00:10:52.518209+0000","last_became_peered":"2024-08-19T00:10:52.518209+0000","last_unstale":"2024-08-19T00:11:39.913928+0000","last_undegraded":"2024-08-19T00:11:39.913928+0000","last_fullsized":"2024-08-19T00:11:39.913928+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:23:19.255833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915073+0000","last_change":"2024-08-19T00:10:52.523824+0000","last_active":"2024-08-19T00:11:39.915073+0000","last_peered":"2024-08-19T00:11:39.915073+0000","last_clean":"2024-08-19T00:11:39.915073+0000","last_became_active":"2024-08-19T00:10:52.523075+0000","last_became_peered":"2024-08-19T00:10:52.523075+0000","last_unstale":"2024-08-19T00:11:39.915073+0000","last_undegraded":"2024-08-19T00:11:39.915073+0000","last_fullsized":"2024-08-19T00:11:39.915073+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:23:58.618712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920442+0000","last_change":"2024-08-19T00:10:52.523508+0000","last_active":"2024-08-19T00:11:39.920442+0000","last_peered":"2024-08-19T00:11:39.920442+0000","last_clean":"2024-08-19T00:11:39.920442+0000","last_became_active":"2024-08-19T00:10:52.523104+0000","last_became_peered":"2024-08-19T00:10:52.523104+0000","last_unstale":"2024-08-19T00:11:39.920442+0000","last_undegraded":"2024-08-19T00:11:39.920442+0000","last_fullsized":"2024-08-19T00:11:39.920442+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:04:06.932548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.911625+0000","last_change":"2024-08-19T00:10:52.510147+0000","last_active":"2024-08-19T00:11:39.911625+0000","last_peered":"2024-08-19T00:11:39.911625+0000","last_clean":"2024-08-19T00:11:39.911625+0000","last_became_active":"2024-08-19T00:10:52.509807+0000","last_became_peered":"2024-08-19T00:10:52.509807+0000","last_unstale":"2024-08-19T00:11:39.911625+0000","last_undegraded":"2024-08-19T00:11:39.911625+0000","last_fullsized":"2024-08-19T00:11:39.911625+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:09:55.965318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.912168+0000","last_change":"2024-08-19T00:10:52.512997+0000","last_active":"2024-08-19T00:11:39.912168+0000","last_peered":"2024-08-19T00:11:39.912168+0000","last_clean":"2024-08-19T00:11:39.912168+0000","last_became_active":"2024-08-19T00:10:52.512688+0000","last_became_peered":"2024-08-19T00:10:52.512688+0000","last_unstale":"2024-08-19T00:11:39.912168+0000","last_undegraded":"2024-08-19T00:11:39.912168+0000","last_fullsized":"2024-08-19T00:11:39.912168+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:57:33.607060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916036+0000","last_change":"2024-08-19T00:10:52.517492+0000","last_active":"2024-08-19T00:11:39.916036+0000","last_peered":"2024-08-19T00:11:39.916036+0000","last_clean":"2024-08-19T00:11:39.916036+0000","last_became_active":"2024-08-19T00:10:52.517153+0000","last_became_peered":"2024-08-19T00:10:52.517153+0000","last_unstale":"2024-08-19T00:11:39.916036+0000","last_undegraded":"2024-08-19T00:11:39.916036+0000","last_fullsized":"2024-08-19T00:11:39.916036+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:07:07.244331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915536+0000","last_change":"2024-08-19T00:10:52.517396+0000","last_active":"2024-08-19T00:11:39.915536+0000","last_peered":"2024-08-19T00:11:39.915536+0000","last_clean":"2024-08-19T00:11:39.915536+0000","last_became_active":"2024-08-19T00:10:52.517108+0000","last_became_peered":"2024-08-19T00:10:52.517108+0000","last_unstale":"2024-08-19T00:11:39.915536+0000","last_undegraded":"2024-08-19T00:11:39.915536+0000","last_fullsized":"2024-08-19T00:11:39.915536+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:10:41.477770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916498+0000","last_change":"2024-08-19T00:10:52.515841+0000","last_active":"2024-08-19T00:11:39.916498+0000","last_peered":"2024-08-19T00:11:39.916498+0000","last_clean":"2024-08-19T00:11:39.916498+0000","last_became_active":"2024-08-19T00:10:52.515524+0000","last_became_peered":"2024-08-19T00:10:52.515524+0000","last_unstale":"2024-08-19T00:11:39.916498+0000","last_undegraded":"2024-08-19T00:11:39.916498+0000","last_fullsized":"2024-08-19T00:11:39.916498+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:18:51.991468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913341+0000","last_change":"2024-08-19T00:10:52.522670+0000","last_active":"2024-08-19T00:11:39.913341+0000","last_peered":"2024-08-19T00:11:39.913341+0000","last_clean":"2024-08-19T00:11:39.913341+0000","last_became_active":"2024-08-19T00:10:52.522275+0000","last_became_peered":"2024-08-19T00:10:52.522275+0000","last_unstale":"2024-08-19T00:11:39.913341+0000","last_undegraded":"2024-08-19T00:11:39.913341+0000","last_fullsized":"2024-08-19T00:11:39.913341+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:55:48.756230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":60812,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":176,"num_read_kb":152,"num_write":239,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":552960,"data_stored":182436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":207,"ondisk_log_size":207,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449113,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32216,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712936,"statfs":{"total":95995035648,"available":95962046464,"internally_reserved":0,"allocated":1064960,"data_stored":518821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":71,"seq":304942678044,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32880,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712272,"statfs":{"total":95995035648,"available":95961366528,"internally_reserved":0,"allocated":1744896,"data_stored":1159915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":65,"seq":279172874273,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28076,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717076,"statfs":{"total":95995035648,"available":95966285824,"internally_reserved":0,"allocated":1085440,"data_stored":522735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135909,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1069056,"data_stored":518905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397546,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36972,"kb_used_data":1636,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708180,"statfs":{"total":95995035648,"available":95957176320,"internally_reserved":0,"allocated":1675264,"data_stored":1115123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561071,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1056768,"data_stored":514143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822707,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32828,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712324,"statfs":{"total":95995035648,"available":95961419776,"internally_reserved":0,"allocated":1683456,"data_stored":1110705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986232,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36376,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708776,"statfs":{"total":95995035648,"available":95957786624,"internally_reserved":0,"allocated":1064960,"data_stored":518217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215164,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36380,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708772,"statfs":{"total":95995035648,"available":95957782528,"internally_reserved":0,"allocated":1069056,"data_stored":513851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411392,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36448,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708704,"statfs":{"total":95995035648,"available":95957712896,"internally_reserved":0,"allocated":1138688,"data_stored":569783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28108,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717044,"statfs":{"total":95995035648,"available":95966253056,"internally_reserved":0,"allocated":1118208,"data_stored":569563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738441,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36400,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708752,"statfs":{"total":95995035648,"available":95957762048,"internally_reserved":0,"allocated":1081344,"data_stored":515599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":56142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":56362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":56126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-19T00:11:53.408 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-08-19T00:11:53.408 INFO:tasks.cephadm:Setting up client nodes... 2024-08-19T00:11:53.409 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-08-19T00:11:53.668 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:11:54.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:54.132+0000 7f7b04290640 1 -- 172.21.15.44:0/1049945781 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7afc1034f0 msgr2=0x7f7afc109d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:54.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:54.132+0000 7f7b04290640 1 --2- 172.21.15.44:0/1049945781 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7afc1034f0 0x7f7afc109d80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7af4009ca0 tx=0x7f7af402a8c0 comp rx=0 tx=0).stop 2024-08-19T00:11:54.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:54.132+0000 7f7b04290640 1 -- 172.21.15.44:0/1049945781 shutdown_connections 2024-08-19T00:11:54.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:54.132+0000 7f7b04290640 1 --2- 172.21.15.44:0/1049945781 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7afc102b30 0x7f7afc102fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:54.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:54.132+0000 7f7b04290640 1 --2- 172.21.15.44:0/1049945781 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7afc1034f0 0x7f7afc109d80 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:54.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:54.132+0000 7f7b04290640 1 --2- 172.21.15.44:0/1049945781 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7afc101930 0x7f7afc101d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:54.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:54.132+0000 7f7b04290640 1 -- 172.21.15.44:0/1049945781 >> 172.21.15.44:0/1049945781 conn(0x7f7afc0fd0c0 msgr2=0x7f7afc0ff500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:54.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:54.132+0000 7f7b04290640 1 -- 172.21.15.44:0/1049945781 shutdown_connections 2024-08-19T00:11:54.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:54.132+0000 7f7b04290640 1 -- 172.21.15.44:0/1049945781 wait complete. 2024-08-19T00:11:54.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:54.133+0000 7f7b04290640 1 Processor -- start 2024-08-19T00:11:54.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:54.133+0000 7f7b04290640 1 -- start start 2024-08-19T00:11:54.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:54.133+0000 7f7b04290640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7afc101930 0x7f7afc075cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:54.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:54.133+0000 7f7b04290640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7afc102b30 0x7f7afc074310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:54.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:54.133+0000 7f7b04290640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7afc1034f0 0x7f7afc074850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:54.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:54.133+0000 7f7b04290640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7afc10d590 con 0x7f7afc1034f0 2024-08-19T00:11:54.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:54.133+0000 7f7b04290640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f7afc10d410 con 0x7f7afc101930 2024-08-19T00:11:54.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:54.133+0000 7f7b04290640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7afc10d710 con 0x7f7afc102b30 2024-08-19T00:11:54.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:54.133+0000 7f7b0282d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7afc1034f0 0x7f7afc074850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:54.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:54.133+0000 7f7b0282d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7afc1034f0 0x7f7afc074850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37330/0 (socket says 172.21.15.44:37330) 2024-08-19T00:11:54.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:54.133+0000 7f7b0282d640 1 -- 172.21.15.44:0/1301780672 learned_addr learned my addr 172.21.15.44:0/1301780672 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:11:54.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:54.133+0000 7f7b0202c640 1 --2- 172.21.15.44:0/1301780672 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7afc101930 0x7f7afc075cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:54.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:54.133+0000 7f7b0282d640 1 -- 172.21.15.44:0/1301780672 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7afc102b30 msgr2=0x7f7afc074310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:54.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:54.133+0000 7f7b0282d640 1 --2- 172.21.15.44:0/1301780672 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7afc102b30 0x7f7afc074310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:54.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:54.133+0000 7f7b0282d640 1 -- 172.21.15.44:0/1301780672 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7afc101930 msgr2=0x7f7afc075cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:54.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:54.133+0000 7f7b0282d640 1 --2- 172.21.15.44:0/1301780672 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7afc101930 0x7f7afc075cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:54.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:54.133+0000 7f7b0282d640 1 -- 172.21.15.44:0/1301780672 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7afc075110 con 0x7f7afc1034f0 2024-08-19T00:11:54.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:54.133+0000 7f7b0202c640 1 --2- 172.21.15.44:0/1301780672 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7afc101930 0x7f7afc075cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:11:54.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:54.134+0000 7f7b0282d640 1 --2- 172.21.15.44:0/1301780672 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7afc1034f0 0x7f7afc074850 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7af4005e30 tx=0x7f7af4031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:54.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:54.134+0000 7f7af37fe640 1 -- 172.21.15.44:0/1301780672 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7af4003c30 con 0x7f7afc1034f0 2024-08-19T00:11:54.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:54.134+0000 7f7b04290640 1 -- 172.21.15.44:0/1301780672 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7afc1a1ce0 con 0x7f7afc1034f0 2024-08-19T00:11:54.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:54.134+0000 7f7af37fe640 1 -- 172.21.15.44:0/1301780672 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7af4003dd0 con 0x7f7afc1034f0 2024-08-19T00:11:54.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:54.134+0000 7f7af37fe640 1 -- 172.21.15.44:0/1301780672 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7af402fde0 con 0x7f7afc1034f0 2024-08-19T00:11:54.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:54.134+0000 7f7b04290640 1 -- 172.21.15.44:0/1301780672 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7afc1a21f0 con 0x7f7afc1034f0 2024-08-19T00:11:54.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:54.135+0000 7f7b04290640 1 -- 172.21.15.44:0/1301780672 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7afc108d30 con 0x7f7afc1034f0 2024-08-19T00:11:54.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:54.136+0000 7f7af37fe640 1 -- 172.21.15.44:0/1301780672 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f7af4004050 con 0x7f7afc1034f0 2024-08-19T00:11:54.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:54.136+0000 7f7af37fe640 1 --2- 172.21.15.44:0/1301780672 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f7ae80a2c10 0x7f7ae80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:54.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:54.137+0000 7f7b0202c640 1 --2- 172.21.15.44:0/1301780672 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f7ae80a2c10 0x7f7ae80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:54.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:54.137+0000 7f7af37fe640 1 -- 172.21.15.44:0/1301780672 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f7af40f09c0 con 0x7f7afc1034f0 2024-08-19T00:11:54.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:54.137+0000 7f7b0202c640 1 --2- 172.21.15.44:0/1301780672 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f7ae80a2c10 0x7f7ae80a50d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7af8005d00 tx=0x7f7af8005ef0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:54.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:54.140+0000 7f7af37fe640 1 -- 172.21.15.44:0/1301780672 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f7af40bd570 con 0x7f7afc1034f0 2024-08-19T00:11:54.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:54 smithi171 ceph-mon[21810]: pgmap v299: 129 pgs: 129 active+clean; 636 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 3.4 KiB/s wr, 13 op/s; 9 B/s, 0 objects/s recovering 2024-08-19T00:11:54.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:54 smithi171 ceph-mon[21810]: from='client.14823 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-19T00:11:54.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:54 smithi116 ceph-mon[21873]: pgmap v299: 129 pgs: 129 active+clean; 636 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 3.4 KiB/s wr, 13 op/s; 9 B/s, 0 objects/s recovering 2024-08-19T00:11:54.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:54 smithi116 ceph-mon[21873]: from='client.14823 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-19T00:11:54.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:54 smithi044 ceph-mon[18489]: pgmap v299: 129 pgs: 129 active+clean; 636 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 3.4 KiB/s wr, 13 op/s; 9 B/s, 0 objects/s recovering 2024-08-19T00:11:54.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:54 smithi044 ceph-mon[18489]: from='client.14823 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-19T00:11:54.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:54.382+0000 7f7b04290640 1 -- 172.21.15.44:0/1301780672 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f7afc02d5e0 con 0x7f7afc1034f0 2024-08-19T00:11:54.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:54.385+0000 7f7af37fe640 1 -- 172.21.15.44:0/1301780672 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f7af40bce70 con 0x7f7afc1034f0 2024-08-19T00:11:54.386 INFO:teuthology.orchestra.run.smithi044.stdout:[client.0] 2024-08-19T00:11:54.386 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQDKjcJmyCvoFhAA9/0enHBotHpCQn2qy7eYkQ== 2024-08-19T00:11:54.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:54.387+0000 7f7b04290640 1 -- 172.21.15.44:0/1301780672 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f7ae80a2c10 msgr2=0x7f7ae80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:54.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:54.387+0000 7f7b04290640 1 --2- 172.21.15.44:0/1301780672 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f7ae80a2c10 0x7f7ae80a50d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7af8005d00 tx=0x7f7af8005ef0 comp rx=0 tx=0).stop 2024-08-19T00:11:54.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:54.387+0000 7f7b04290640 1 -- 172.21.15.44:0/1301780672 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7afc1034f0 msgr2=0x7f7afc074850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:54.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:54.387+0000 7f7b04290640 1 --2- 172.21.15.44:0/1301780672 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7afc1034f0 0x7f7afc074850 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7af4005e30 tx=0x7f7af4031ee0 comp rx=0 tx=0).stop 2024-08-19T00:11:54.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:54.387+0000 7f7b04290640 1 -- 172.21.15.44:0/1301780672 shutdown_connections 2024-08-19T00:11:54.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:54.387+0000 7f7b04290640 1 --2- 172.21.15.44:0/1301780672 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f7ae80a2c10 0x7f7ae80a50d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:54.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:54.387+0000 7f7b04290640 1 --2- 172.21.15.44:0/1301780672 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7afc102b30 0x7f7afc074310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:54.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:54.387+0000 7f7b04290640 1 --2- 172.21.15.44:0/1301780672 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7afc1034f0 0x7f7afc074850 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:54.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:54.387+0000 7f7b04290640 1 --2- 172.21.15.44:0/1301780672 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7afc101930 0x7f7afc075cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:54.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:54.387+0000 7f7b04290640 1 -- 172.21.15.44:0/1301780672 >> 172.21.15.44:0/1301780672 conn(0x7f7afc0fd0c0 msgr2=0x7f7afc105f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:54.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:54.387+0000 7f7b04290640 1 -- 172.21.15.44:0/1301780672 shutdown_connections 2024-08-19T00:11:54.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:54.387+0000 7f7b04290640 1 -- 172.21.15.44:0/1301780672 wait complete. 2024-08-19T00:11:55.145 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-08-19T00:11:55.145 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-08-19T00:11:55.145 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-08-19T00:11:55.184 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-08-19T00:11:55.184 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-08-19T00:11:55.184 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph mgr dump --format=json 2024-08-19T00:11:55.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:55 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/1301780672' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-08-19T00:11:55.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:55 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/1301780672' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-08-19T00:11:55.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:55 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/1301780672' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-08-19T00:11:55.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:55 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/1301780672' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-08-19T00:11:55.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:55 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/1301780672' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-08-19T00:11:55.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:55 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/1301780672' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-08-19T00:11:55.482 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:11:56.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:56.006+0000 7fc72b518640 1 -- 172.21.15.44:0/2676180415 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7241022a0 msgr2=0x7fc7241026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:56.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:56.006+0000 7fc72b518640 1 --2- 172.21.15.44:0/2676180415 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7241022a0 0x7fc7241026e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc714009900 tx=0x7fc71402a480 comp rx=0 tx=0).stop 2024-08-19T00:11:56.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:56.006+0000 7fc72b518640 1 -- 172.21.15.44:0/2676180415 shutdown_connections 2024-08-19T00:11:56.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:56.006+0000 7fc72b518640 1 --2- 172.21.15.44:0/2676180415 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc724102c20 0x7fc72410d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:56.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:56.006+0000 7fc72b518640 1 --2- 172.21.15.44:0/2676180415 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7241022a0 0x7fc7241026e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:56.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:56.006+0000 7fc72b518640 1 --2- 172.21.15.44:0/2676180415 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc724100b50 0x7fc724100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:56.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:56.006+0000 7fc72b518640 1 -- 172.21.15.44:0/2676180415 >> 172.21.15.44:0/2676180415 conn(0x7fc7240fc500 msgr2=0x7fc7240fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:56.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:56.006+0000 7fc72b518640 1 -- 172.21.15.44:0/2676180415 shutdown_connections 2024-08-19T00:11:56.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:56.006+0000 7fc72b518640 1 -- 172.21.15.44:0/2676180415 wait complete. 2024-08-19T00:11:56.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:56.007+0000 7fc72b518640 1 Processor -- start 2024-08-19T00:11:56.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:56.007+0000 7fc72b518640 1 -- start start 2024-08-19T00:11:56.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:56.007+0000 7fc72b518640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc724100b50 0x7fc724199020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:56.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:56.007+0000 7fc72b518640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7241022a0 0x7fc724199560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:56.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:56.007+0000 7fc72b518640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc724102c20 0x7fc7241a40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:56.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:56.007+0000 7fc72b518640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc724110cb0 con 0x7fc7241022a0 2024-08-19T00:11:56.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:56.007+0000 7fc72b518640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fc724110b30 con 0x7fc724100b50 2024-08-19T00:11:56.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:56.007+0000 7fc72b518640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc724110e30 con 0x7fc724102c20 2024-08-19T00:11:56.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:56.007+0000 7fc728ab3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7241022a0 0x7fc724199560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:56.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:56.007+0000 7fc728ab3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7241022a0 0x7fc724199560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37346/0 (socket says 172.21.15.44:37346) 2024-08-19T00:11:56.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:56.007+0000 7fc728ab3640 1 -- 172.21.15.44:0/2912461874 learned_addr learned my addr 172.21.15.44:0/2912461874 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:11:56.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:56.007+0000 7fc7292b4640 1 --2- 172.21.15.44:0/2912461874 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc724100b50 0x7fc724199020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:56.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:56.007+0000 7fc729ab5640 1 --2- 172.21.15.44:0/2912461874 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc724102c20 0x7fc7241a40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:56.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:56.007+0000 7fc728ab3640 1 -- 172.21.15.44:0/2912461874 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc724102c20 msgr2=0x7fc7241a40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:56.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:56.007+0000 7fc728ab3640 1 --2- 172.21.15.44:0/2912461874 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc724102c20 0x7fc7241a40a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:56.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:56.007+0000 7fc728ab3640 1 -- 172.21.15.44:0/2912461874 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc724100b50 msgr2=0x7fc724199020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:56.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:56.007+0000 7fc728ab3640 1 --2- 172.21.15.44:0/2912461874 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc724100b50 0x7fc724199020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:56.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:56.007+0000 7fc728ab3640 1 -- 172.21.15.44:0/2912461874 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7241a45e0 con 0x7fc7241022a0 2024-08-19T00:11:56.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:56.008+0000 7fc728ab3640 1 --2- 172.21.15.44:0/2912461874 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7241022a0 0x7fc724199560 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc714006010 tx=0x7fc714003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:56.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:56.008+0000 7fc71a7fc640 1 -- 172.21.15.44:0/2912461874 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc71403f070 con 0x7fc7241022a0 2024-08-19T00:11:56.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:56.008+0000 7fc71a7fc640 1 -- 172.21.15.44:0/2912461874 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc714031c30 con 0x7fc7241022a0 2024-08-19T00:11:56.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:56.008+0000 7fc72b518640 1 -- 172.21.15.44:0/2912461874 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7241a47b0 con 0x7fc7241022a0 2024-08-19T00:11:56.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:56.008+0000 7fc71a7fc640 1 -- 172.21.15.44:0/2912461874 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc714035030 con 0x7fc7241022a0 2024-08-19T00:11:56.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:56.008+0000 7fc72b518640 1 -- 172.21.15.44:0/2912461874 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7241a4c60 con 0x7fc7241022a0 2024-08-19T00:11:56.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:56.009+0000 7fc72b518640 1 -- 172.21.15.44:0/2912461874 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc724100f30 con 0x7fc7241022a0 2024-08-19T00:11:56.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:56.010+0000 7fc71a7fc640 1 -- 172.21.15.44:0/2912461874 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fc714042070 con 0x7fc7241022a0 2024-08-19T00:11:56.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:56.011+0000 7fc71a7fc640 1 --2- 172.21.15.44:0/2912461874 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fc7100a2c90 0x7fc7100a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:56.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:56.011+0000 7fc7292b4640 1 --2- 172.21.15.44:0/2912461874 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fc7100a2c90 0x7fc7100a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:56.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:56.011+0000 7fc71a7fc640 1 -- 172.21.15.44:0/2912461874 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fc7140efcd0 con 0x7fc7241022a0 2024-08-19T00:11:56.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:56.011+0000 7fc7292b4640 1 --2- 172.21.15.44:0/2912461874 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fc7100a2c90 0x7fc7100a5150 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc72000abe0 tx=0x7fc72000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:56.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:56.015+0000 7fc71a7fc640 1 -- 172.21.15.44:0/2912461874 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fc7140bc710 con 0x7fc7241022a0 2024-08-19T00:11:56.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:56.241+0000 7fc72b518640 1 -- 172.21.15.44:0/2912461874 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fc7241a4e90 con 0x7fc7241022a0 2024-08-19T00:11:56.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:56.246+0000 7fc71a7fc640 1 -- 172.21.15.44:0/2912461874 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+263201 (secure 0 0 0) 0x7fc714031de0 con 0x7fc7241022a0 2024-08-19T00:11:56.251 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:11:56.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:56.249+0000 7fc72b518640 1 -- 172.21.15.44:0/2912461874 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fc7100a2c90 msgr2=0x7fc7100a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:56.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:56.249+0000 7fc72b518640 1 --2- 172.21.15.44:0/2912461874 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fc7100a2c90 0x7fc7100a5150 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc72000abe0 tx=0x7fc72000a2d0 comp rx=0 tx=0).stop 2024-08-19T00:11:56.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:56.249+0000 7fc72b518640 1 -- 172.21.15.44:0/2912461874 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7241022a0 msgr2=0x7fc724199560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:56.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:56.249+0000 7fc72b518640 1 --2- 172.21.15.44:0/2912461874 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7241022a0 0x7fc724199560 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc714006010 tx=0x7fc714003c10 comp rx=0 tx=0).stop 2024-08-19T00:11:56.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:56.250+0000 7fc72b518640 1 -- 172.21.15.44:0/2912461874 shutdown_connections 2024-08-19T00:11:56.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:56.250+0000 7fc72b518640 1 --2- 172.21.15.44:0/2912461874 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fc7100a2c90 0x7fc7100a5150 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:56.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:56.250+0000 7fc72b518640 1 --2- 172.21.15.44:0/2912461874 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc724102c20 0x7fc7241a40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:56.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:56.250+0000 7fc72b518640 1 --2- 172.21.15.44:0/2912461874 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7241022a0 0x7fc724199560 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:56.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:56.250+0000 7fc72b518640 1 --2- 172.21.15.44:0/2912461874 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc724100b50 0x7fc724199020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:56.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:56.250+0000 7fc72b518640 1 -- 172.21.15.44:0/2912461874 >> 172.21.15.44:0/2912461874 conn(0x7fc7240fc500 msgr2=0x7fc7241065a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:56.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:56.250+0000 7fc72b518640 1 -- 172.21.15.44:0/2912461874 shutdown_connections 2024-08-19T00:11:56.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:56.250+0000 7fc72b518640 1 -- 172.21.15.44:0/2912461874 wait complete. 2024-08-19T00:11:56.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:56 smithi044 ceph-mon[18489]: pgmap v300: 129 pgs: 129 active+clean; 636 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 3.2 KiB/s wr, 11 op/s; 0 B/s, 0 objects/s recovering 2024-08-19T00:11:56.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:56 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/2912461874' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-08-19T00:11:56.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:56 smithi171 ceph-mon[21810]: pgmap v300: 129 pgs: 129 active+clean; 636 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 3.2 KiB/s wr, 11 op/s; 0 B/s, 0 objects/s recovering 2024-08-19T00:11:56.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:56 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/2912461874' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-08-19T00:11:56.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:56 smithi116 ceph-mon[21873]: pgmap v300: 129 pgs: 129 active+clean; 636 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 3.2 KiB/s wr, 11 op/s; 0 B/s, 0 objects/s recovering 2024-08-19T00:11:56.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:56 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/2912461874' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-08-19T00:11:56.988 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1330072146},{"type":"v1","addr":"172.21.15.44:6801","nonce":1330072146}]},"active_addr":"172.21.15.44:6801/1330072146","active_change":"2024-08-19T00:04:38.393072+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24110,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.44:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.44:0","nonce":1732405694}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.44:0","nonce":3023439260}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.44:0","nonce":3489931602}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.44:0","nonce":2504116080}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.44:0","nonce":4222950596}]}]} 2024-08-19T00:11:56.993 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-08-19T00:11:56.993 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-08-19T00:11:56.994 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-19T00:11:57.251 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:11:57.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:57.740+0000 7efdca3e7640 1 -- 172.21.15.44:0/2752095601 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efdc4102240 msgr2=0x7efdc410e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:57.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:57.740+0000 7efdca3e7640 1 --2- 172.21.15.44:0/2752095601 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efdc4102240 0x7efdc410e770 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7efdbc009cd0 tx=0x7efdbc02a8e0 comp rx=0 tx=0).stop 2024-08-19T00:11:57.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:57.740+0000 7efdca3e7640 1 -- 172.21.15.44:0/2752095601 shutdown_connections 2024-08-19T00:11:57.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:57.740+0000 7efdca3e7640 1 --2- 172.21.15.44:0/2752095601 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efdc41018a0 0x7efdc4101d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:57.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:57.740+0000 7efdca3e7640 1 --2- 172.21.15.44:0/2752095601 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efdc4102240 0x7efdc410e770 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:57.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:57.740+0000 7efdca3e7640 1 --2- 172.21.15.44:0/2752095601 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efdc41078a0 0x7efdc4107c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:57.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:57.740+0000 7efdca3e7640 1 -- 172.21.15.44:0/2752095601 >> 172.21.15.44:0/2752095601 conn(0x7efdc40fd5e0 msgr2=0x7efdc40ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:57.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:57.740+0000 7efdca3e7640 1 -- 172.21.15.44:0/2752095601 shutdown_connections 2024-08-19T00:11:57.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:57.740+0000 7efdca3e7640 1 -- 172.21.15.44:0/2752095601 wait complete. 2024-08-19T00:11:57.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:57.740+0000 7efdca3e7640 1 Processor -- start 2024-08-19T00:11:57.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:57.740+0000 7efdca3e7640 1 -- start start 2024-08-19T00:11:57.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:57.741+0000 7efdca3e7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efdc41018a0 0x7efdc4074220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:57.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:57.741+0000 7efdca3e7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efdc4102240 0x7efdc4074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:57.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:57.741+0000 7efdca3e7640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efdc41078a0 0x7efdc4074ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:57.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:57.741+0000 7efdca3e7640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7efdc4111cc0 con 0x7efdc4102240 2024-08-19T00:11:57.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:57.741+0000 7efdca3e7640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7efdc4111b40 con 0x7efdc41018a0 2024-08-19T00:11:57.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:57.741+0000 7efdca3e7640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7efdc4111e40 con 0x7efdc41078a0 2024-08-19T00:11:57.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:57.741+0000 7efdc37fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efdc4102240 0x7efdc4074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:57.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:57.741+0000 7efdc37fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efdc4102240 0x7efdc4074760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37358/0 (socket says 172.21.15.44:37358) 2024-08-19T00:11:57.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:57.741+0000 7efdc37fe640 1 -- 172.21.15.44:0/82297257 learned_addr learned my addr 172.21.15.44:0/82297257 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:11:57.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:57.741+0000 7efdc3fff640 1 --2- 172.21.15.44:0/82297257 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efdc41018a0 0x7efdc4074220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:57.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:57.741+0000 7efdc37fe640 1 -- 172.21.15.44:0/82297257 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efdc41078a0 msgr2=0x7efdc4074ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:57.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:57.741+0000 7efdc37fe640 1 --2- 172.21.15.44:0/82297257 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efdc41078a0 0x7efdc4074ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:57.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:57.741+0000 7efdc37fe640 1 -- 172.21.15.44:0/82297257 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efdc41018a0 msgr2=0x7efdc4074220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:57.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:57.741+0000 7efdc37fe640 1 --2- 172.21.15.44:0/82297257 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efdc41018a0 0x7efdc4074220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:57.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:57.741+0000 7efdc37fe640 1 -- 172.21.15.44:0/82297257 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdc41a6640 con 0x7efdc4102240 2024-08-19T00:11:57.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:57.741+0000 7efdc3fff640 1 --2- 172.21.15.44:0/82297257 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efdc41018a0 0x7efdc4074220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:11:57.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:57.741+0000 7efdc37fe640 1 --2- 172.21.15.44:0/82297257 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efdc4102240 0x7efdc4074760 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7efdb800b4a0 tx=0x7efdb800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:57.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:57.741+0000 7efdc17fa640 1 -- 172.21.15.44:0/82297257 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb8014070 con 0x7efdc4102240 2024-08-19T00:11:57.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:57.741+0000 7efdc17fa640 1 -- 172.21.15.44:0/82297257 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efdb8010af0 con 0x7efdc4102240 2024-08-19T00:11:57.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:57.741+0000 7efdc17fa640 1 -- 172.21.15.44:0/82297257 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb8017d10 con 0x7efdc4102240 2024-08-19T00:11:57.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:57.741+0000 7efdca3e7640 1 -- 172.21.15.44:0/82297257 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdc41a6930 con 0x7efdc4102240 2024-08-19T00:11:57.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:57.741+0000 7efdca3e7640 1 -- 172.21.15.44:0/82297257 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdc41a6e20 con 0x7efdc4102240 2024-08-19T00:11:57.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:57.743+0000 7efdca3e7640 1 -- 172.21.15.44:0/82297257 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdc4101d00 con 0x7efdc4102240 2024-08-19T00:11:57.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:57.744+0000 7efdc17fa640 1 -- 172.21.15.44:0/82297257 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7efdb8017070 con 0x7efdc4102240 2024-08-19T00:11:57.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:57.744+0000 7efdc17fa640 1 --2- 172.21.15.44:0/82297257 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7efdac0a2c90 0x7efdac0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:57.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:57.744+0000 7efdc3fff640 1 --2- 172.21.15.44:0/82297257 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7efdac0a2c90 0x7efdac0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:57.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:57.744+0000 7efdc17fa640 1 -- 172.21.15.44:0/82297257 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7efdb80ce7c0 con 0x7efdc4102240 2024-08-19T00:11:57.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:57.745+0000 7efdc3fff640 1 --2- 172.21.15.44:0/82297257 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7efdac0a2c90 0x7efdac0a5150 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7efdb400abe0 tx=0x7efdb400a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:57.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:57.748+0000 7efdc17fa640 1 -- 172.21.15.44:0/82297257 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7efdb809b370 con 0x7efdc4102240 2024-08-19T00:11:57.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:57.925+0000 7efdca3e7640 1 -- 172.21.15.44:0/82297257 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efdc41a71c0 con 0x7efdc4102240 2024-08-19T00:11:57.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:57.927+0000 7efdc17fa640 1 -- 172.21.15.44:0/82297257 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+24642 (secure 0 0 0) 0x7efdb809ac70 con 0x7efdc4102240 2024-08-19T00:11:57.929 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:11:57.929 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":92,"fsid":"647ded64-5dbe-11ef-bccf-c7b262605968","created":"2024-08-19T00:03:43.667929+0000","modified":"2024-08-19T00:11:39.902854+0000","last_up_change":"2024-08-19T00:10:01.557590+0000","last_in_change":"2024-08-19T00:09:42.433933+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T00:06:42.706553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-19T00:10:48.735065+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-19T00:10:51.481810+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-19T00:10:58.013004+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b15ad904-d07d-4ecb-be8f-d99323425eed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":600251465},{"type":"v1","addr":"172.21.15.44:6803","nonce":600251465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":600251465},{"type":"v1","addr":"172.21.15.44:6805","nonce":600251465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":600251465},{"type":"v1","addr":"172.21.15.44:6809","nonce":600251465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":600251465},{"type":"v1","addr":"172.21.15.44:6807","nonce":600251465}]},"public_addr":"172.21.15.44:6803/600251465","cluster_addr":"172.21.15.44:6805/600251465","heartbeat_back_addr":"172.21.15.44:6809/600251465","heartbeat_front_addr":"172.21.15.44:6807/600251465","state":["exists","up"]},{"osd":1,"uuid":"8f70512f-21a3-4fec-8278-04b2bc9b2d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":613509556},{"type":"v1","addr":"172.21.15.116:6801","nonce":613509556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":613509556},{"type":"v1","addr":"172.21.15.116:6803","nonce":613509556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":613509556},{"type":"v1","addr":"172.21.15.116:6807","nonce":613509556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":613509556},{"type":"v1","addr":"172.21.15.116:6805","nonce":613509556}]},"public_addr":"172.21.15.116:6801/613509556","cluster_addr":"172.21.15.116:6803/613509556","heartbeat_back_addr":"172.21.15.116:6807/613509556","heartbeat_front_addr":"172.21.15.116:6805/613509556","state":["exists","up"]},{"osd":2,"uuid":"56994dfd-5fcf-4d82-addf-38764239d82a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2130938937},{"type":"v1","addr":"172.21.15.171:6801","nonce":2130938937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2130938937},{"type":"v1","addr":"172.21.15.171:6803","nonce":2130938937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2130938937},{"type":"v1","addr":"172.21.15.171:6807","nonce":2130938937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2130938937},{"type":"v1","addr":"172.21.15.171:6805","nonce":2130938937}]},"public_addr":"172.21.15.171:6801/2130938937","cluster_addr":"172.21.15.171:6803/2130938937","heartbeat_back_addr":"172.21.15.171:6807/2130938937","heartbeat_front_addr":"172.21.15.171:6805/2130938937","state":["exists","up"]},{"osd":3,"uuid":"6d2ddb19-74e0-4e68-b9ea-58b73fd1e9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":3537027669},{"type":"v1","addr":"172.21.15.44:6811","nonce":3537027669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":3537027669},{"type":"v1","addr":"172.21.15.44:6813","nonce":3537027669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3537027669},{"type":"v1","addr":"172.21.15.44:6817","nonce":3537027669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":3537027669},{"type":"v1","addr":"172.21.15.44:6815","nonce":3537027669}]},"public_addr":"172.21.15.44:6811/3537027669","cluster_addr":"172.21.15.44:6813/3537027669","heartbeat_back_addr":"172.21.15.44:6817/3537027669","heartbeat_front_addr":"172.21.15.44:6815/3537027669","state":["exists","up"]},{"osd":4,"uuid":"190d208e-ae54-497d-ad72-d07a5a26991b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":3768627455},{"type":"v1","addr":"172.21.15.116:6809","nonce":3768627455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":3768627455},{"type":"v1","addr":"172.21.15.116:6811","nonce":3768627455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":3768627455},{"type":"v1","addr":"172.21.15.116:6815","nonce":3768627455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":3768627455},{"type":"v1","addr":"172.21.15.116:6813","nonce":3768627455}]},"public_addr":"172.21.15.116:6809/3768627455","cluster_addr":"172.21.15.116:6811/3768627455","heartbeat_back_addr":"172.21.15.116:6815/3768627455","heartbeat_front_addr":"172.21.15.116:6813/3768627455","state":["exists","up"]},{"osd":5,"uuid":"d8afacad-6d3d-4703-9744-8d01ff2a2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":938785018},{"type":"v1","addr":"172.21.15.171:6809","nonce":938785018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":938785018},{"type":"v1","addr":"172.21.15.171:6811","nonce":938785018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":938785018},{"type":"v1","addr":"172.21.15.171:6815","nonce":938785018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":938785018},{"type":"v1","addr":"172.21.15.171:6813","nonce":938785018}]},"public_addr":"172.21.15.171:6809/938785018","cluster_addr":"172.21.15.171:6811/938785018","heartbeat_back_addr":"172.21.15.171:6815/938785018","heartbeat_front_addr":"172.21.15.171:6813/938785018","state":["exists","up"]},{"osd":6,"uuid":"55bf1f89-99e5-409d-99fa-f0124aa042df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":1219334797},{"type":"v1","addr":"172.21.15.44:6819","nonce":1219334797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":1219334797},{"type":"v1","addr":"172.21.15.44:6821","nonce":1219334797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":1219334797},{"type":"v1","addr":"172.21.15.44:6825","nonce":1219334797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":1219334797},{"type":"v1","addr":"172.21.15.44:6823","nonce":1219334797}]},"public_addr":"172.21.15.44:6819/1219334797","cluster_addr":"172.21.15.44:6821/1219334797","heartbeat_back_addr":"172.21.15.44:6825/1219334797","heartbeat_front_addr":"172.21.15.44:6823/1219334797","state":["exists","up"]},{"osd":7,"uuid":"70130d71-d28c-4a58-b603-75610c8d3ea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":3861873415},{"type":"v1","addr":"172.21.15.116:6817","nonce":3861873415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":3861873415},{"type":"v1","addr":"172.21.15.116:6819","nonce":3861873415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":3861873415},{"type":"v1","addr":"172.21.15.116:6823","nonce":3861873415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":3861873415},{"type":"v1","addr":"172.21.15.116:6821","nonce":3861873415}]},"public_addr":"172.21.15.116:6817/3861873415","cluster_addr":"172.21.15.116:6819/3861873415","heartbeat_back_addr":"172.21.15.116:6823/3861873415","heartbeat_front_addr":"172.21.15.116:6821/3861873415","state":["exists","up"]},{"osd":8,"uuid":"c5121f70-e423-4f86-a3c6-90945c9385f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":843701060},{"type":"v1","addr":"172.21.15.171:6817","nonce":843701060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":843701060},{"type":"v1","addr":"172.21.15.171:6819","nonce":843701060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":843701060},{"type":"v1","addr":"172.21.15.171:6823","nonce":843701060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":843701060},{"type":"v1","addr":"172.21.15.171:6821","nonce":843701060}]},"public_addr":"172.21.15.171:6817/843701060","cluster_addr":"172.21.15.171:6819/843701060","heartbeat_back_addr":"172.21.15.171:6823/843701060","heartbeat_front_addr":"172.21.15.171:6821/843701060","state":["exists","up"]},{"osd":9,"uuid":"cd13693a-0f25-47cc-b1a5-9c42481935ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3206550013},{"type":"v1","addr":"172.21.15.44:6827","nonce":3206550013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":3206550013},{"type":"v1","addr":"172.21.15.44:6829","nonce":3206550013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3206550013},{"type":"v1","addr":"172.21.15.44:6833","nonce":3206550013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3206550013},{"type":"v1","addr":"172.21.15.44:6831","nonce":3206550013}]},"public_addr":"172.21.15.44:6827/3206550013","cluster_addr":"172.21.15.44:6829/3206550013","heartbeat_back_addr":"172.21.15.44:6833/3206550013","heartbeat_front_addr":"172.21.15.44:6831/3206550013","state":["exists","up"]},{"osd":10,"uuid":"a36ffeb1-6ecf-4899-bdfa-18515afefb86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3034738363},{"type":"v1","addr":"172.21.15.116:6825","nonce":3034738363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3034738363},{"type":"v1","addr":"172.21.15.116:6827","nonce":3034738363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3034738363},{"type":"v1","addr":"172.21.15.116:6831","nonce":3034738363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3034738363},{"type":"v1","addr":"172.21.15.116:6829","nonce":3034738363}]},"public_addr":"172.21.15.116:6825/3034738363","cluster_addr":"172.21.15.116:6827/3034738363","heartbeat_back_addr":"172.21.15.116:6831/3034738363","heartbeat_front_addr":"172.21.15.116:6829/3034738363","state":["exists","up"]},{"osd":11,"uuid":"ffcf44a8-3094-4a29-822e-a6ce95da119e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1500842656},{"type":"v1","addr":"172.21.15.171:6825","nonce":1500842656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1500842656},{"type":"v1","addr":"172.21.15.171:6827","nonce":1500842656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1500842656},{"type":"v1","addr":"172.21.15.171:6831","nonce":1500842656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1500842656},{"type":"v1","addr":"172.21.15.171:6829","nonce":1500842656}]},"public_addr":"172.21.15.171:6825/1500842656","cluster_addr":"172.21.15.171:6827/1500842656","heartbeat_back_addr":"172.21.15.171:6831/1500842656","heartbeat_front_addr":"172.21.15.171:6829/1500842656","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:05:56.916127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:06:17.603805+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:06:38.642970+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:07:00.667062+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:07:22.542529+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:07:44.732304+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:08:07.050742+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:08:29.451498+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:08:52.222169+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:09:15.422629+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:09:37.295311+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:09:59.716431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6800/1300308907":"2024-08-20T00:04:38.392912+0000","172.21.15.44:0/1001446555":"2024-08-20T00:04:38.392912+0000","172.21.15.44:0/3800526625":"2024-08-20T00:04:38.392912+0000","172.21.15.44:6801/1300308907":"2024-08-20T00:04:38.392912+0000","172.21.15.44:0/3096491642":"2024-08-20T00:04:14.604141+0000","172.21.15.44:0/400419582":"2024-08-20T00:04:38.392912+0000","172.21.15.44:0/1869412718":"2024-08-20T00:04:14.604141+0000","172.21.15.44:6801/1374527587":"2024-08-20T00:04:14.604141+0000","172.21.15.44:0/911382683":"2024-08-20T00:04:14.604141+0000","172.21.15.44:6800/1374527587":"2024-08-20T00:04:14.604141+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:11:57.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:57.930+0000 7efdca3e7640 1 -- 172.21.15.44:0/82297257 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7efdac0a2c90 msgr2=0x7efdac0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:57.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:57.930+0000 7efdca3e7640 1 --2- 172.21.15.44:0/82297257 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7efdac0a2c90 0x7efdac0a5150 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7efdb400abe0 tx=0x7efdb400a5c0 comp rx=0 tx=0).stop 2024-08-19T00:11:57.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:57.930+0000 7efdca3e7640 1 -- 172.21.15.44:0/82297257 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efdc4102240 msgr2=0x7efdc4074760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:57.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:57.930+0000 7efdca3e7640 1 --2- 172.21.15.44:0/82297257 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efdc4102240 0x7efdc4074760 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7efdb800b4a0 tx=0x7efdb800b960 comp rx=0 tx=0).stop 2024-08-19T00:11:57.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:57.930+0000 7efdca3e7640 1 -- 172.21.15.44:0/82297257 shutdown_connections 2024-08-19T00:11:57.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:57.930+0000 7efdca3e7640 1 --2- 172.21.15.44:0/82297257 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7efdac0a2c90 0x7efdac0a5150 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:57.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:57.930+0000 7efdca3e7640 1 --2- 172.21.15.44:0/82297257 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efdc41078a0 0x7efdc4074ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:57.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:57.930+0000 7efdca3e7640 1 --2- 172.21.15.44:0/82297257 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efdc4102240 0x7efdc4074760 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:57.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:57.930+0000 7efdca3e7640 1 --2- 172.21.15.44:0/82297257 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efdc41018a0 0x7efdc4074220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:57.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:57.930+0000 7efdca3e7640 1 -- 172.21.15.44:0/82297257 >> 172.21.15.44:0/82297257 conn(0x7efdc40fd5e0 msgr2=0x7efdc40fdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:57.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:57.930+0000 7efdca3e7640 1 -- 172.21.15.44:0/82297257 shutdown_connections 2024-08-19T00:11:57.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:57.930+0000 7efdca3e7640 1 -- 172.21.15.44:0/82297257 wait complete. 2024-08-19T00:11:58.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:58 smithi044 ceph-mon[18489]: pgmap v301: 129 pgs: 129 active+clean; 644 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.7 KiB/s wr, 14 op/s; 0 B/s, 0 objects/s recovering 2024-08-19T00:11:58.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:11:58 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/82297257' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-19T00:11:58.670 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-08-19T00:11:58.670 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-19T00:11:58.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:58 smithi171 ceph-mon[21810]: pgmap v301: 129 pgs: 129 active+clean; 644 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.7 KiB/s wr, 14 op/s; 0 B/s, 0 objects/s recovering 2024-08-19T00:11:58.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:11:58 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/82297257' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-19T00:11:58.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:58 smithi116 ceph-mon[21873]: pgmap v301: 129 pgs: 129 active+clean; 644 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.7 KiB/s wr, 14 op/s; 0 B/s, 0 objects/s recovering 2024-08-19T00:11:58.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:11:58 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/82297257' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-19T00:11:58.925 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:11:59.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:59.399+0000 7f584e44e640 1 -- 172.21.15.44:0/2195107530 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5848100b50 msgr2=0x7f5848100f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:59.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:59.399+0000 7f584e44e640 1 --2- 172.21.15.44:0/2195107530 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5848100b50 0x7f5848100f30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5838009900 tx=0x7f583802a480 comp rx=0 tx=0).stop 2024-08-19T00:11:59.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:59.399+0000 7f584e44e640 1 -- 172.21.15.44:0/2195107530 shutdown_connections 2024-08-19T00:11:59.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:59.399+0000 7f584e44e640 1 --2- 172.21.15.44:0/2195107530 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5848102c20 0x7f584810d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:59.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:59.399+0000 7f584e44e640 1 --2- 172.21.15.44:0/2195107530 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f58481022a0 0x7f58481026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:59.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:59.399+0000 7f584e44e640 1 --2- 172.21.15.44:0/2195107530 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5848100b50 0x7f5848100f30 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:59.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:59.399+0000 7f584e44e640 1 -- 172.21.15.44:0/2195107530 >> 172.21.15.44:0/2195107530 conn(0x7f58480fc500 msgr2=0x7f58480fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:59.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:59.399+0000 7f584e44e640 1 -- 172.21.15.44:0/2195107530 shutdown_connections 2024-08-19T00:11:59.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:59.399+0000 7f584e44e640 1 -- 172.21.15.44:0/2195107530 wait complete. 2024-08-19T00:11:59.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:59.400+0000 7f584e44e640 1 Processor -- start 2024-08-19T00:11:59.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:59.400+0000 7f584e44e640 1 -- start start 2024-08-19T00:11:59.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:59.400+0000 7f584e44e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5848100b50 0x7f5848199060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:59.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:59.400+0000 7f584e44e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f58481022a0 0x7f58481995a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:59.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:59.400+0000 7f584e44e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5848102c20 0x7f58481a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:59.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:59.400+0000 7f584e44e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5848110cb0 con 0x7f5848102c20 2024-08-19T00:11:59.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:59.400+0000 7f584e44e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f5848110b30 con 0x7f58481022a0 2024-08-19T00:11:59.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:59.400+0000 7f584e44e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5848110e30 con 0x7f5848100b50 2024-08-19T00:11:59.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:59.400+0000 7f584c9eb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5848102c20 0x7f58481a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:59.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:59.400+0000 7f584c9eb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5848102c20 0x7f58481a40e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45476/0 (socket says 172.21.15.44:45476) 2024-08-19T00:11:59.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:59.400+0000 7f584c9eb640 1 -- 172.21.15.44:0/2510744067 learned_addr learned my addr 172.21.15.44:0/2510744067 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:11:59.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:59.400+0000 7f583ffff640 1 --2- 172.21.15.44:0/2510744067 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f58481022a0 0x7f58481995a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:59.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:59.400+0000 7f5847fff640 1 --2- 172.21.15.44:0/2510744067 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5848100b50 0x7f5848199060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:59.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:59.400+0000 7f584c9eb640 1 -- 172.21.15.44:0/2510744067 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5848100b50 msgr2=0x7f5848199060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:59.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:59.400+0000 7f584c9eb640 1 --2- 172.21.15.44:0/2510744067 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5848100b50 0x7f5848199060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:59.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:59.400+0000 7f584c9eb640 1 -- 172.21.15.44:0/2510744067 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f58481022a0 msgr2=0x7f58481995a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:59.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:59.400+0000 7f584c9eb640 1 --2- 172.21.15.44:0/2510744067 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f58481022a0 0x7f58481995a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:59.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:59.400+0000 7f584c9eb640 1 -- 172.21.15.44:0/2510744067 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58481a4620 con 0x7f5848102c20 2024-08-19T00:11:59.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:59.400+0000 7f5847fff640 1 --2- 172.21.15.44:0/2510744067 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5848100b50 0x7f5848199060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:11:59.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:59.401+0000 7f584c9eb640 1 --2- 172.21.15.44:0/2510744067 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5848102c20 0x7f58481a40e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f584000eb10 tx=0x7f584000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:59.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:59.401+0000 7f5845ffb640 1 -- 172.21.15.44:0/2510744067 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5840004b20 con 0x7f5848102c20 2024-08-19T00:11:59.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:59.401+0000 7f5845ffb640 1 -- 172.21.15.44:0/2510744067 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5840004cc0 con 0x7f5848102c20 2024-08-19T00:11:59.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:59.401+0000 7f584e44e640 1 -- 172.21.15.44:0/2510744067 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58481a47f0 con 0x7f5848102c20 2024-08-19T00:11:59.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:59.401+0000 7f5845ffb640 1 -- 172.21.15.44:0/2510744067 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5840010760 con 0x7f5848102c20 2024-08-19T00:11:59.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:59.401+0000 7f584e44e640 1 -- 172.21.15.44:0/2510744067 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58481a4d30 con 0x7f5848102c20 2024-08-19T00:11:59.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:59.402+0000 7f584e44e640 1 -- 172.21.15.44:0/2510744067 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5848100f30 con 0x7f5848102c20 2024-08-19T00:11:59.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:59.403+0000 7f5845ffb640 1 -- 172.21.15.44:0/2510744067 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f5840005020 con 0x7f5848102c20 2024-08-19T00:11:59.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:59.403+0000 7f5845ffb640 1 --2- 172.21.15.44:0/2510744067 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f58340a2c90 0x7f58340a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:11:59.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:59.404+0000 7f5847fff640 1 --2- 172.21.15.44:0/2510744067 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f58340a2c90 0x7f58340a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:11:59.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:59.404+0000 7f5845ffb640 1 -- 172.21.15.44:0/2510744067 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f58400cfb90 con 0x7f5848102c20 2024-08-19T00:11:59.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:59.404+0000 7f5847fff640 1 --2- 172.21.15.44:0/2510744067 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f58340a2c90 0x7f58340a5150 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5838005ab0 tx=0x7f5838005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:11:59.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:59.408+0000 7f5845ffb640 1 -- 172.21.15.44:0/2510744067 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f584009c630 con 0x7f5848102c20 2024-08-19T00:11:59.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:59.586+0000 7f584e44e640 1 -- 172.21.15.44:0/2510744067 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5848108dc0 con 0x7f5848102c20 2024-08-19T00:11:59.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:59.588+0000 7f5845ffb640 1 -- 172.21.15.44:0/2510744067 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+24642 (secure 0 0 0) 0x7f584009bf30 con 0x7f5848102c20 2024-08-19T00:11:59.589 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:11:59.589 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":92,"fsid":"647ded64-5dbe-11ef-bccf-c7b262605968","created":"2024-08-19T00:03:43.667929+0000","modified":"2024-08-19T00:11:39.902854+0000","last_up_change":"2024-08-19T00:10:01.557590+0000","last_in_change":"2024-08-19T00:09:42.433933+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T00:06:42.706553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-19T00:10:48.735065+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-19T00:10:51.481810+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-19T00:10:58.013004+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b15ad904-d07d-4ecb-be8f-d99323425eed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":600251465},{"type":"v1","addr":"172.21.15.44:6803","nonce":600251465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":600251465},{"type":"v1","addr":"172.21.15.44:6805","nonce":600251465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":600251465},{"type":"v1","addr":"172.21.15.44:6809","nonce":600251465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":600251465},{"type":"v1","addr":"172.21.15.44:6807","nonce":600251465}]},"public_addr":"172.21.15.44:6803/600251465","cluster_addr":"172.21.15.44:6805/600251465","heartbeat_back_addr":"172.21.15.44:6809/600251465","heartbeat_front_addr":"172.21.15.44:6807/600251465","state":["exists","up"]},{"osd":1,"uuid":"8f70512f-21a3-4fec-8278-04b2bc9b2d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":613509556},{"type":"v1","addr":"172.21.15.116:6801","nonce":613509556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":613509556},{"type":"v1","addr":"172.21.15.116:6803","nonce":613509556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":613509556},{"type":"v1","addr":"172.21.15.116:6807","nonce":613509556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":613509556},{"type":"v1","addr":"172.21.15.116:6805","nonce":613509556}]},"public_addr":"172.21.15.116:6801/613509556","cluster_addr":"172.21.15.116:6803/613509556","heartbeat_back_addr":"172.21.15.116:6807/613509556","heartbeat_front_addr":"172.21.15.116:6805/613509556","state":["exists","up"]},{"osd":2,"uuid":"56994dfd-5fcf-4d82-addf-38764239d82a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2130938937},{"type":"v1","addr":"172.21.15.171:6801","nonce":2130938937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2130938937},{"type":"v1","addr":"172.21.15.171:6803","nonce":2130938937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2130938937},{"type":"v1","addr":"172.21.15.171:6807","nonce":2130938937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2130938937},{"type":"v1","addr":"172.21.15.171:6805","nonce":2130938937}]},"public_addr":"172.21.15.171:6801/2130938937","cluster_addr":"172.21.15.171:6803/2130938937","heartbeat_back_addr":"172.21.15.171:6807/2130938937","heartbeat_front_addr":"172.21.15.171:6805/2130938937","state":["exists","up"]},{"osd":3,"uuid":"6d2ddb19-74e0-4e68-b9ea-58b73fd1e9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":3537027669},{"type":"v1","addr":"172.21.15.44:6811","nonce":3537027669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":3537027669},{"type":"v1","addr":"172.21.15.44:6813","nonce":3537027669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3537027669},{"type":"v1","addr":"172.21.15.44:6817","nonce":3537027669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":3537027669},{"type":"v1","addr":"172.21.15.44:6815","nonce":3537027669}]},"public_addr":"172.21.15.44:6811/3537027669","cluster_addr":"172.21.15.44:6813/3537027669","heartbeat_back_addr":"172.21.15.44:6817/3537027669","heartbeat_front_addr":"172.21.15.44:6815/3537027669","state":["exists","up"]},{"osd":4,"uuid":"190d208e-ae54-497d-ad72-d07a5a26991b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":3768627455},{"type":"v1","addr":"172.21.15.116:6809","nonce":3768627455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":3768627455},{"type":"v1","addr":"172.21.15.116:6811","nonce":3768627455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":3768627455},{"type":"v1","addr":"172.21.15.116:6815","nonce":3768627455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":3768627455},{"type":"v1","addr":"172.21.15.116:6813","nonce":3768627455}]},"public_addr":"172.21.15.116:6809/3768627455","cluster_addr":"172.21.15.116:6811/3768627455","heartbeat_back_addr":"172.21.15.116:6815/3768627455","heartbeat_front_addr":"172.21.15.116:6813/3768627455","state":["exists","up"]},{"osd":5,"uuid":"d8afacad-6d3d-4703-9744-8d01ff2a2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":938785018},{"type":"v1","addr":"172.21.15.171:6809","nonce":938785018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":938785018},{"type":"v1","addr":"172.21.15.171:6811","nonce":938785018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":938785018},{"type":"v1","addr":"172.21.15.171:6815","nonce":938785018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":938785018},{"type":"v1","addr":"172.21.15.171:6813","nonce":938785018}]},"public_addr":"172.21.15.171:6809/938785018","cluster_addr":"172.21.15.171:6811/938785018","heartbeat_back_addr":"172.21.15.171:6815/938785018","heartbeat_front_addr":"172.21.15.171:6813/938785018","state":["exists","up"]},{"osd":6,"uuid":"55bf1f89-99e5-409d-99fa-f0124aa042df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":1219334797},{"type":"v1","addr":"172.21.15.44:6819","nonce":1219334797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":1219334797},{"type":"v1","addr":"172.21.15.44:6821","nonce":1219334797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":1219334797},{"type":"v1","addr":"172.21.15.44:6825","nonce":1219334797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":1219334797},{"type":"v1","addr":"172.21.15.44:6823","nonce":1219334797}]},"public_addr":"172.21.15.44:6819/1219334797","cluster_addr":"172.21.15.44:6821/1219334797","heartbeat_back_addr":"172.21.15.44:6825/1219334797","heartbeat_front_addr":"172.21.15.44:6823/1219334797","state":["exists","up"]},{"osd":7,"uuid":"70130d71-d28c-4a58-b603-75610c8d3ea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":3861873415},{"type":"v1","addr":"172.21.15.116:6817","nonce":3861873415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":3861873415},{"type":"v1","addr":"172.21.15.116:6819","nonce":3861873415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":3861873415},{"type":"v1","addr":"172.21.15.116:6823","nonce":3861873415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":3861873415},{"type":"v1","addr":"172.21.15.116:6821","nonce":3861873415}]},"public_addr":"172.21.15.116:6817/3861873415","cluster_addr":"172.21.15.116:6819/3861873415","heartbeat_back_addr":"172.21.15.116:6823/3861873415","heartbeat_front_addr":"172.21.15.116:6821/3861873415","state":["exists","up"]},{"osd":8,"uuid":"c5121f70-e423-4f86-a3c6-90945c9385f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":843701060},{"type":"v1","addr":"172.21.15.171:6817","nonce":843701060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":843701060},{"type":"v1","addr":"172.21.15.171:6819","nonce":843701060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":843701060},{"type":"v1","addr":"172.21.15.171:6823","nonce":843701060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":843701060},{"type":"v1","addr":"172.21.15.171:6821","nonce":843701060}]},"public_addr":"172.21.15.171:6817/843701060","cluster_addr":"172.21.15.171:6819/843701060","heartbeat_back_addr":"172.21.15.171:6823/843701060","heartbeat_front_addr":"172.21.15.171:6821/843701060","state":["exists","up"]},{"osd":9,"uuid":"cd13693a-0f25-47cc-b1a5-9c42481935ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3206550013},{"type":"v1","addr":"172.21.15.44:6827","nonce":3206550013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":3206550013},{"type":"v1","addr":"172.21.15.44:6829","nonce":3206550013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3206550013},{"type":"v1","addr":"172.21.15.44:6833","nonce":3206550013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3206550013},{"type":"v1","addr":"172.21.15.44:6831","nonce":3206550013}]},"public_addr":"172.21.15.44:6827/3206550013","cluster_addr":"172.21.15.44:6829/3206550013","heartbeat_back_addr":"172.21.15.44:6833/3206550013","heartbeat_front_addr":"172.21.15.44:6831/3206550013","state":["exists","up"]},{"osd":10,"uuid":"a36ffeb1-6ecf-4899-bdfa-18515afefb86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3034738363},{"type":"v1","addr":"172.21.15.116:6825","nonce":3034738363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3034738363},{"type":"v1","addr":"172.21.15.116:6827","nonce":3034738363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3034738363},{"type":"v1","addr":"172.21.15.116:6831","nonce":3034738363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3034738363},{"type":"v1","addr":"172.21.15.116:6829","nonce":3034738363}]},"public_addr":"172.21.15.116:6825/3034738363","cluster_addr":"172.21.15.116:6827/3034738363","heartbeat_back_addr":"172.21.15.116:6831/3034738363","heartbeat_front_addr":"172.21.15.116:6829/3034738363","state":["exists","up"]},{"osd":11,"uuid":"ffcf44a8-3094-4a29-822e-a6ce95da119e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1500842656},{"type":"v1","addr":"172.21.15.171:6825","nonce":1500842656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1500842656},{"type":"v1","addr":"172.21.15.171:6827","nonce":1500842656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1500842656},{"type":"v1","addr":"172.21.15.171:6831","nonce":1500842656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1500842656},{"type":"v1","addr":"172.21.15.171:6829","nonce":1500842656}]},"public_addr":"172.21.15.171:6825/1500842656","cluster_addr":"172.21.15.171:6827/1500842656","heartbeat_back_addr":"172.21.15.171:6831/1500842656","heartbeat_front_addr":"172.21.15.171:6829/1500842656","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:05:56.916127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:06:17.603805+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:06:38.642970+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:07:00.667062+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:07:22.542529+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:07:44.732304+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:08:07.050742+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:08:29.451498+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:08:52.222169+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:09:15.422629+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:09:37.295311+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:09:59.716431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6800/1300308907":"2024-08-20T00:04:38.392912+0000","172.21.15.44:0/1001446555":"2024-08-20T00:04:38.392912+0000","172.21.15.44:0/3800526625":"2024-08-20T00:04:38.392912+0000","172.21.15.44:6801/1300308907":"2024-08-20T00:04:38.392912+0000","172.21.15.44:0/3096491642":"2024-08-20T00:04:14.604141+0000","172.21.15.44:0/400419582":"2024-08-20T00:04:38.392912+0000","172.21.15.44:0/1869412718":"2024-08-20T00:04:14.604141+0000","172.21.15.44:6801/1374527587":"2024-08-20T00:04:14.604141+0000","172.21.15.44:0/911382683":"2024-08-20T00:04:14.604141+0000","172.21.15.44:6800/1374527587":"2024-08-20T00:04:14.604141+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:11:59.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:59.590+0000 7f584e44e640 1 -- 172.21.15.44:0/2510744067 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f58340a2c90 msgr2=0x7f58340a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:59.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:59.590+0000 7f584e44e640 1 --2- 172.21.15.44:0/2510744067 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f58340a2c90 0x7f58340a5150 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5838005ab0 tx=0x7f5838005a20 comp rx=0 tx=0).stop 2024-08-19T00:11:59.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:59.590+0000 7f584e44e640 1 -- 172.21.15.44:0/2510744067 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5848102c20 msgr2=0x7f58481a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:11:59.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:59.590+0000 7f584e44e640 1 --2- 172.21.15.44:0/2510744067 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5848102c20 0x7f58481a40e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f584000eb10 tx=0x7f584000c2d0 comp rx=0 tx=0).stop 2024-08-19T00:11:59.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:59.590+0000 7f584e44e640 1 -- 172.21.15.44:0/2510744067 shutdown_connections 2024-08-19T00:11:59.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:59.590+0000 7f584e44e640 1 --2- 172.21.15.44:0/2510744067 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f58340a2c90 0x7f58340a5150 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:59.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:59.590+0000 7f584e44e640 1 --2- 172.21.15.44:0/2510744067 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5848102c20 0x7f58481a40e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:59.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:59.590+0000 7f584e44e640 1 --2- 172.21.15.44:0/2510744067 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f58481022a0 0x7f58481995a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:59.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:59.590+0000 7f584e44e640 1 --2- 172.21.15.44:0/2510744067 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5848100b50 0x7f5848199060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:11:59.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:59.590+0000 7f584e44e640 1 -- 172.21.15.44:0/2510744067 >> 172.21.15.44:0/2510744067 conn(0x7f58480fc500 msgr2=0x7f58480fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:11:59.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:59.590+0000 7f584e44e640 1 -- 172.21.15.44:0/2510744067 shutdown_connections 2024-08-19T00:11:59.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:11:59.590+0000 7f584e44e640 1 -- 172.21.15.44:0/2510744067 wait complete. 2024-08-19T00:12:00.296 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-08-19T00:12:00.297 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-08-19T00:12:00.297 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-08-19T00:12:00.298 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-08-19T00:12:00.298 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-08-19T00:12:00.299 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-08-19T00:12:00.299 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-08-19T00:12:00.300 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-08-19T00:12:00.300 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-08-19T00:12:00.301 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-08-19T00:12:00.301 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-08-19T00:12:00.302 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-08-19T00:12:00.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:00 smithi044 ceph-mon[18489]: pgmap v302: 129 pgs: 129 active+clean; 644 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.9 KiB/s wr, 10 op/s 2024-08-19T00:12:00.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:00 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/2510744067' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-19T00:12:00.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:00 smithi171 ceph-mon[21810]: pgmap v302: 129 pgs: 129 active+clean; 644 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.9 KiB/s wr, 10 op/s 2024-08-19T00:12:00.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:00 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/2510744067' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-19T00:12:00.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:00 smithi116 ceph-mon[21873]: pgmap v302: 129 pgs: 129 active+clean; 644 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.9 KiB/s wr, 10 op/s 2024-08-19T00:12:00.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:00 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/2510744067' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-19T00:12:00.968 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:12:01.041 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:12:01.042 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:12:01.044 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:12:02.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.111+0000 7f5d8d74a640 1 -- 172.21.15.44:0/3491809520 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d88102250 msgr2=0x7f5d8810e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:02.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.111+0000 7f5d8d74a640 1 --2- 172.21.15.44:0/3491809520 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d88102250 0x7f5d8810e780 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5d78009930 tx=0x7f5d7802a420 comp rx=0 tx=0).stop 2024-08-19T00:12:02.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.111+0000 7f5d8d74a640 1 -- 172.21.15.44:0/3491809520 shutdown_connections 2024-08-19T00:12:02.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.111+0000 7f5d8d74a640 1 --2- 172.21.15.44:0/3491809520 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5d881018b0 0x7f5d88101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:02.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.111+0000 7f5d8d74a640 1 --2- 172.21.15.44:0/3491809520 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d88102250 0x7f5d8810e780 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:02.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.111+0000 7f5d8d74a640 1 --2- 172.21.15.44:0/3491809520 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d881078b0 0x7f5d88107c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:02.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.111+0000 7f5d8d74a640 1 -- 172.21.15.44:0/3491809520 >> 172.21.15.44:0/3491809520 conn(0x7f5d880fd5f0 msgr2=0x7f5d880ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:02.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.111+0000 7f5d8d74a640 1 -- 172.21.15.44:0/3491809520 shutdown_connections 2024-08-19T00:12:02.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.111+0000 7f5d8d74a640 1 -- 172.21.15.44:0/3491809520 wait complete. 2024-08-19T00:12:02.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.112+0000 7f5d8d74a640 1 Processor -- start 2024-08-19T00:12:02.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.112+0000 7f5d8d74a640 1 -- start start 2024-08-19T00:12:02.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.112+0000 7f5d8d74a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d881018b0 0x7f5d88198190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:02.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.112+0000 7f5d8d74a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5d88102250 0x7f5d881986d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:02.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.112+0000 7f5d8d74a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d881078b0 0x7f5d8819ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:02.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.112+0000 7f5d8d74a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5d88111cb0 con 0x7f5d881078b0 2024-08-19T00:12:02.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.112+0000 7f5d8d74a640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f5d88111b30 con 0x7f5d881018b0 2024-08-19T00:12:02.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.112+0000 7f5d8d74a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5d88111e30 con 0x7f5d88102250 2024-08-19T00:12:02.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.112+0000 7f5d877fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d881078b0 0x7f5d8819ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:02.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.112+0000 7f5d877fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d881078b0 0x7f5d8819ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45520/0 (socket says 172.21.15.44:45520) 2024-08-19T00:12:02.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.112+0000 7f5d877fe640 1 -- 172.21.15.44:0/196764863 learned_addr learned my addr 172.21.15.44:0/196764863 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:12:02.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.113+0000 7f5d86ffd640 1 --2- 172.21.15.44:0/196764863 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d881018b0 0x7f5d88198190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:02.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.113+0000 7f5d867fc640 1 --2- 172.21.15.44:0/196764863 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5d88102250 0x7f5d881986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:02.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.113+0000 7f5d877fe640 1 -- 172.21.15.44:0/196764863 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5d88102250 msgr2=0x7f5d881986d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:02.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.113+0000 7f5d877fe640 1 --2- 172.21.15.44:0/196764863 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5d88102250 0x7f5d881986d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:02.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.113+0000 7f5d877fe640 1 -- 172.21.15.44:0/196764863 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d881018b0 msgr2=0x7f5d88198190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:02.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.113+0000 7f5d877fe640 1 --2- 172.21.15.44:0/196764863 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d881018b0 0x7f5d88198190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:02.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.113+0000 7f5d877fe640 1 -- 172.21.15.44:0/196764863 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d8819d140 con 0x7f5d881078b0 2024-08-19T00:12:02.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.113+0000 7f5d877fe640 1 --2- 172.21.15.44:0/196764863 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d881078b0 0x7f5d8819ca60 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5d78005ab0 tx=0x7f5d780040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:02.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.113+0000 7f5d7ffff640 1 -- 172.21.15.44:0/196764863 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d7803f030 con 0x7f5d881078b0 2024-08-19T00:12:02.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.113+0000 7f5d8d74a640 1 -- 172.21.15.44:0/196764863 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d8819d3d0 con 0x7f5d881078b0 2024-08-19T00:12:02.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.113+0000 7f5d7ffff640 1 -- 172.21.15.44:0/196764863 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d780044c0 con 0x7f5d881078b0 2024-08-19T00:12:02.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.113+0000 7f5d7ffff640 1 -- 172.21.15.44:0/196764863 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d78035070 con 0x7f5d881078b0 2024-08-19T00:12:02.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.113+0000 7f5d8d74a640 1 -- 172.21.15.44:0/196764863 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d881a4d10 con 0x7f5d881078b0 2024-08-19T00:12:02.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.114+0000 7f5d8d74a640 1 -- 172.21.15.44:0/196764863 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5d880626b0 con 0x7f5d881078b0 2024-08-19T00:12:02.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.115+0000 7f5d7ffff640 1 -- 172.21.15.44:0/196764863 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f5d78042030 con 0x7f5d881078b0 2024-08-19T00:12:02.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.116+0000 7f5d7ffff640 1 --2- 172.21.15.44:0/196764863 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f5d740a2c10 0x7f5d740a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:02.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.116+0000 7f5d86ffd640 1 --2- 172.21.15.44:0/196764863 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f5d740a2c10 0x7f5d740a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:02.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.116+0000 7f5d7ffff640 1 -- 172.21.15.44:0/196764863 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f5d780ef930 con 0x7f5d881078b0 2024-08-19T00:12:02.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.116+0000 7f5d7ffff640 1 --2- 172.21.15.44:0/196764863 >> [v2:172.21.15.44:6826/3206550013,v1:172.21.15.44:6827/3206550013] conn(0x7f5d740adde0 0x7f5d740b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:02.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.116+0000 7f5d7ffff640 1 -- 172.21.15.44:0/196764863 --> [v2:172.21.15.44:6826/3206550013,v1:172.21.15.44:6827/3206550013] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5d78030e80 con 0x7f5d740adde0 2024-08-19T00:12:02.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.116+0000 7f5d7ffff640 1 -- 172.21.15.44:0/196764863 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7f5d780f42c0 con 0x7f5d881078b0 2024-08-19T00:12:02.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.116+0000 7f5d867fc640 1 --2- 172.21.15.44:0/196764863 >> [v2:172.21.15.44:6826/3206550013,v1:172.21.15.44:6827/3206550013] conn(0x7f5d740adde0 0x7f5d740b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:02.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.116+0000 7f5d86ffd640 1 --2- 172.21.15.44:0/196764863 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f5d740a2c10 0x7f5d740a50d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5d80005fd0 tx=0x7f5d80009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:02.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.117+0000 7f5d867fc640 1 --2- 172.21.15.44:0/196764863 >> [v2:172.21.15.44:6826/3206550013,v1:172.21.15.44:6827/3206550013] conn(0x7f5d740adde0 0x7f5d740b0280 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:02.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.117+0000 7f5d7ffff640 1 -- 172.21.15.44:0/196764863 <== osd.9 v2:172.21.15.44:6826/3206550013 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5d78030e80 con 0x7f5d740adde0 2024-08-19T00:12:02.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.131+0000 7f5d8d74a640 1 -- 172.21.15.44:0/196764863 --> [v2:172.21.15.44:6826/3206550013,v1:172.21.15.44:6827/3206550013] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5d88062ae0 con 0x7f5d740adde0 2024-08-19T00:12:02.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.131+0000 7f5d7ffff640 1 -- 172.21.15.44:0/196764863 <== osd.9 v2:172.21.15.44:6826/3206550013 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5d88062ae0 con 0x7f5d740adde0 2024-08-19T00:12:02.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.131+0000 7f5d8d74a640 1 -- 172.21.15.44:0/196764863 >> [v2:172.21.15.44:6826/3206550013,v1:172.21.15.44:6827/3206550013] conn(0x7f5d740adde0 msgr2=0x7f5d740b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:02.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.131+0000 7f5d8d74a640 1 --2- 172.21.15.44:0/196764863 >> [v2:172.21.15.44:6826/3206550013,v1:172.21.15.44:6827/3206550013] conn(0x7f5d740adde0 0x7f5d740b0280 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:02.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.132+0000 7f5d8d74a640 1 -- 172.21.15.44:0/196764863 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f5d740a2c10 msgr2=0x7f5d740a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:02.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.132+0000 7f5d8d74a640 1 --2- 172.21.15.44:0/196764863 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f5d740a2c10 0x7f5d740a50d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5d80005fd0 tx=0x7f5d80009500 comp rx=0 tx=0).stop 2024-08-19T00:12:02.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.132+0000 7f5d8d74a640 1 -- 172.21.15.44:0/196764863 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d881078b0 msgr2=0x7f5d8819ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:02.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.132+0000 7f5d8d74a640 1 --2- 172.21.15.44:0/196764863 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d881078b0 0x7f5d8819ca60 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5d78005ab0 tx=0x7f5d780040c0 comp rx=0 tx=0).stop 2024-08-19T00:12:02.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.132+0000 7f5d877fe640 1 -- 172.21.15.44:0/196764863 reap_dead start 2024-08-19T00:12:02.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.132+0000 7f5d8d74a640 1 -- 172.21.15.44:0/196764863 shutdown_connections 2024-08-19T00:12:02.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.132+0000 7f5d8d74a640 1 -- 172.21.15.44:0/196764863 >> 172.21.15.44:0/196764863 conn(0x7f5d880fd5f0 msgr2=0x7f5d880fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:02.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.132+0000 7f5d8d74a640 1 -- 172.21.15.44:0/196764863 shutdown_connections 2024-08-19T00:12:02.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.132+0000 7f5d8d74a640 1 -- 172.21.15.44:0/196764863 wait complete. 2024-08-19T00:12:02.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.994+0000 7f9647de1640 1 -- 172.21.15.44:0/120887251 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f964010e1b0 msgr2=0x7f96401105a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:02.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.994+0000 7f9647de1640 1 --2- 172.21.15.44:0/120887251 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f964010e1b0 0x7f96401105a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9638009ca0 tx=0x7f963802a8c0 comp rx=0 tx=0).stop 2024-08-19T00:12:02.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.994+0000 7f9647de1640 1 -- 172.21.15.44:0/120887251 shutdown_connections 2024-08-19T00:12:02.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.994+0000 7f9647de1640 1 --2- 172.21.15.44:0/120887251 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f964010e1b0 0x7f96401105a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:02.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.994+0000 7f9647de1640 1 --2- 172.21.15.44:0/120887251 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9640100fb0 0x7f964010dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:02.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.994+0000 7f9647de1640 1 --2- 172.21.15.44:0/120887251 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9640100600 0x7f96401009e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:02.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.994+0000 7f9647de1640 1 -- 172.21.15.44:0/120887251 >> 172.21.15.44:0/120887251 conn(0x7f96400fc4d0 msgr2=0x7f96400fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:02.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.994+0000 7f9647de1640 1 -- 172.21.15.44:0/120887251 shutdown_connections 2024-08-19T00:12:02.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.994+0000 7f9647de1640 1 -- 172.21.15.44:0/120887251 wait complete. 2024-08-19T00:12:02.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.995+0000 7f9647de1640 1 Processor -- start 2024-08-19T00:12:02.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.995+0000 7f9647de1640 1 -- start start 2024-08-19T00:12:02.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.995+0000 7f9647de1640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9640100600 0x7f964019a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:02.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.995+0000 7f9647de1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9640100fb0 0x7f964019a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:02.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.995+0000 7f9647de1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f964010e1b0 0x7f964019ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:02.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.995+0000 7f9647de1640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9640113eb0 con 0x7f9640100fb0 2024-08-19T00:12:02.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.995+0000 7f9647de1640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f9640113d30 con 0x7f964010e1b0 2024-08-19T00:12:02.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.995+0000 7f9647de1640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9640114030 con 0x7f9640100600 2024-08-19T00:12:02.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.995+0000 7f964537c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9640100fb0 0x7f964019a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:02.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.995+0000 7f964537c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9640100fb0 0x7f964019a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45508/0 (socket says 172.21.15.44:45508) 2024-08-19T00:12:02.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.995+0000 7f964537c640 1 -- 172.21.15.44:0/604462192 learned_addr learned my addr 172.21.15.44:0/604462192 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:12:02.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.996+0000 7f9645b7d640 1 --2- 172.21.15.44:0/604462192 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9640100600 0x7f964019a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:02.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.996+0000 7f964637e640 1 --2- 172.21.15.44:0/604462192 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f964010e1b0 0x7f964019ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:02.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.996+0000 7f964537c640 1 -- 172.21.15.44:0/604462192 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9640100600 msgr2=0x7f964019a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:02.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.996+0000 7f964537c640 1 --2- 172.21.15.44:0/604462192 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9640100600 0x7f964019a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:02.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.996+0000 7f964537c640 1 -- 172.21.15.44:0/604462192 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f964010e1b0 msgr2=0x7f964019ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:02.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.996+0000 7f964537c640 1 --2- 172.21.15.44:0/604462192 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f964010e1b0 0x7f964019ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:02.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.996+0000 7f964537c640 1 -- 172.21.15.44:0/604462192 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f964019f360 con 0x7f9640100fb0 2024-08-19T00:12:02.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.996+0000 7f9645b7d640 1 --2- 172.21.15.44:0/604462192 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9640100600 0x7f964019a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:12:02.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.996+0000 7f964537c640 1 --2- 172.21.15.44:0/604462192 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9640100fb0 0x7f964019a8f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f963000d950 tx=0x7f963000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:02.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.996+0000 7f9636ffd640 1 -- 172.21.15.44:0/604462192 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9630017070 con 0x7f9640100fb0 2024-08-19T00:12:02.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.996+0000 7f9647de1640 1 -- 172.21.15.44:0/604462192 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f964019f650 con 0x7f9640100fb0 2024-08-19T00:12:02.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.996+0000 7f9636ffd640 1 -- 172.21.15.44:0/604462192 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9630009c30 con 0x7f9640100fb0 2024-08-19T00:12:02.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.996+0000 7f9636ffd640 1 -- 172.21.15.44:0/604462192 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f963000f6b0 con 0x7f9640100fb0 2024-08-19T00:12:02.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.996+0000 7f9647de1640 1 -- 172.21.15.44:0/604462192 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96401a6f30 con 0x7f9640100fb0 2024-08-19T00:12:02.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.997+0000 7f9647de1640 1 -- 172.21.15.44:0/604462192 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9640062670 con 0x7f9640100fb0 2024-08-19T00:12:02.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.998+0000 7f9636ffd640 1 -- 172.21.15.44:0/604462192 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f96300109d0 con 0x7f9640100fb0 2024-08-19T00:12:02.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.999+0000 7f9636ffd640 1 --2- 172.21.15.44:0/604462192 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f962c0a2c10 0x7f962c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:02.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.999+0000 7f9645b7d640 1 --2- 172.21.15.44:0/604462192 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f962c0a2c10 0x7f962c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:02.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.999+0000 7f9636ffd640 1 -- 172.21.15.44:0/604462192 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f96300cf5c0 con 0x7f9640100fb0 2024-08-19T00:12:02.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.999+0000 7f9636ffd640 1 --2- 172.21.15.44:0/604462192 >> [v2:172.21.15.44:6810/3537027669,v1:172.21.15.44:6811/3537027669] conn(0x7f962c0adde0 0x7f962c0b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:02.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.999+0000 7f9636ffd640 1 -- 172.21.15.44:0/604462192 --> [v2:172.21.15.44:6810/3537027669,v1:172.21.15.44:6811/3537027669] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f962c0b0950 con 0x7f962c0adde0 2024-08-19T00:12:02.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.999+0000 7f9636ffd640 1 -- 172.21.15.44:0/604462192 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7f96300cf970 con 0x7f9640100fb0 2024-08-19T00:12:02.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.999+0000 7f964637e640 1 --2- 172.21.15.44:0/604462192 >> [v2:172.21.15.44:6810/3537027669,v1:172.21.15.44:6811/3537027669] conn(0x7f962c0adde0 0x7f962c0b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:02.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.999+0000 7f9645b7d640 1 --2- 172.21.15.44:0/604462192 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f962c0a2c10 0x7f962c0a50d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f963c0058c0 tx=0x7f963c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:02.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.999+0000 7f964637e640 1 --2- 172.21.15.44:0/604462192 >> [v2:172.21.15.44:6810/3537027669,v1:172.21.15.44:6811/3537027669] conn(0x7f962c0adde0 0x7f962c0b0280 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:02.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.000+0000 7f9636ffd640 1 -- 172.21.15.44:0/604462192 <== osd.3 v2:172.21.15.44:6810/3537027669 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f962c0b0950 con 0x7f962c0adde0 2024-08-19T00:12:02.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.014+0000 7f9647de1640 1 -- 172.21.15.44:0/604462192 --> [v2:172.21.15.44:6810/3537027669,v1:172.21.15.44:6811/3537027669] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9640062a70 con 0x7f962c0adde0 2024-08-19T00:12:02.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.014+0000 7f9636ffd640 1 -- 172.21.15.44:0/604462192 <== osd.3 v2:172.21.15.44:6810/3537027669 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9640062a70 con 0x7f962c0adde0 2024-08-19T00:12:02.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.014+0000 7f9647de1640 1 -- 172.21.15.44:0/604462192 >> [v2:172.21.15.44:6810/3537027669,v1:172.21.15.44:6811/3537027669] conn(0x7f962c0adde0 msgr2=0x7f962c0b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:02.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.014+0000 7f9647de1640 1 --2- 172.21.15.44:0/604462192 >> [v2:172.21.15.44:6810/3537027669,v1:172.21.15.44:6811/3537027669] conn(0x7f962c0adde0 0x7f962c0b0280 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:02.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.014+0000 7f9647de1640 1 -- 172.21.15.44:0/604462192 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f962c0a2c10 msgr2=0x7f962c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:02.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.014+0000 7f9647de1640 1 --2- 172.21.15.44:0/604462192 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f962c0a2c10 0x7f962c0a50d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f963c0058c0 tx=0x7f963c005850 comp rx=0 tx=0).stop 2024-08-19T00:12:02.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.014+0000 7f9647de1640 1 -- 172.21.15.44:0/604462192 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9640100fb0 msgr2=0x7f964019a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:02.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.014+0000 7f9647de1640 1 --2- 172.21.15.44:0/604462192 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9640100fb0 0x7f964019a8f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f963000d950 tx=0x7f963000de10 comp rx=0 tx=0).stop 2024-08-19T00:12:02.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.014+0000 7f964637e640 1 -- 172.21.15.44:0/604462192 reap_dead start 2024-08-19T00:12:02.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.014+0000 7f9647de1640 1 -- 172.21.15.44:0/604462192 shutdown_connections 2024-08-19T00:12:02.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.014+0000 7f9647de1640 1 -- 172.21.15.44:0/604462192 >> 172.21.15.44:0/604462192 conn(0x7f96400fc4d0 msgr2=0x7f96400fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:02.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.015+0000 7f9647de1640 1 -- 172.21.15.44:0/604462192 shutdown_connections 2024-08-19T00:12:02.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:02.015+0000 7f9647de1640 1 -- 172.21.15.44:0/604462192 wait complete. 2024-08-19T00:12:02.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:02 smithi171 ceph-mon[21810]: pgmap v303: 129 pgs: 129 active+clean; 645 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 2.0 KiB/s wr, 12 op/s 2024-08-19T00:12:02.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:02 smithi116 ceph-mon[21873]: pgmap v303: 129 pgs: 129 active+clean; 645 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 2.0 KiB/s wr, 12 op/s 2024-08-19T00:12:02.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:02 smithi044 ceph-mon[18489]: pgmap v303: 129 pgs: 129 active+clean; 645 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 2.0 KiB/s wr, 12 op/s 2024-08-19T00:12:03.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.897+0000 7fbd464b3640 1 -- 172.21.15.44:0/2020346037 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd401018b0 msgr2=0x7fbd40101d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:03.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.897+0000 7fbd464b3640 1 --2- 172.21.15.44:0/2020346037 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd401018b0 0x7fbd40101d10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fbd34009930 tx=0x7fbd3402a420 comp rx=0 tx=0).stop 2024-08-19T00:12:03.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.897+0000 7fbd464b3640 1 -- 172.21.15.44:0/2020346037 shutdown_connections 2024-08-19T00:12:03.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.897+0000 7fbd464b3640 1 --2- 172.21.15.44:0/2020346037 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd40102250 0x7fbd4010e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:03.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.897+0000 7fbd464b3640 1 --2- 172.21.15.44:0/2020346037 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd401018b0 0x7fbd40101d10 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:03.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.897+0000 7fbd464b3640 1 --2- 172.21.15.44:0/2020346037 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbd401078b0 0x7fbd40107c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:03.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.897+0000 7fbd464b3640 1 -- 172.21.15.44:0/2020346037 >> 172.21.15.44:0/2020346037 conn(0x7fbd400fd5f0 msgr2=0x7fbd400ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:03.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.897+0000 7fbd464b3640 1 -- 172.21.15.44:0/2020346037 shutdown_connections 2024-08-19T00:12:03.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.897+0000 7fbd464b3640 1 -- 172.21.15.44:0/2020346037 wait complete. 2024-08-19T00:12:03.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.898+0000 7fbd464b3640 1 Processor -- start 2024-08-19T00:12:03.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.898+0000 7fbd464b3640 1 -- start start 2024-08-19T00:12:03.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.898+0000 7fbd464b3640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd401018b0 0x7fbd40074220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:03.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.898+0000 7fbd464b3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd40102250 0x7fbd40074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:03.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.898+0000 7fbd464b3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbd401078b0 0x7fbd40074ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:03.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.898+0000 7fbd464b3640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbd40111cb0 con 0x7fbd40102250 2024-08-19T00:12:03.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.898+0000 7fbd464b3640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fbd40111b30 con 0x7fbd401018b0 2024-08-19T00:12:03.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.898+0000 7fbd464b3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbd40111e30 con 0x7fbd401078b0 2024-08-19T00:12:03.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.898+0000 7fbd3f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd40102250 0x7fbd40074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:03.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.898+0000 7fbd3f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd40102250 0x7fbd40074760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45492/0 (socket says 172.21.15.44:45492) 2024-08-19T00:12:03.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.898+0000 7fbd3f7fe640 1 -- 172.21.15.44:0/905039476 learned_addr learned my addr 172.21.15.44:0/905039476 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:12:03.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.898+0000 7fbd3ffff640 1 --2- 172.21.15.44:0/905039476 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd401018b0 0x7fbd40074220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:03.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.898+0000 7fbd44a50640 1 --2- 172.21.15.44:0/905039476 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbd401078b0 0x7fbd40074ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:03.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.899+0000 7fbd3f7fe640 1 -- 172.21.15.44:0/905039476 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbd401078b0 msgr2=0x7fbd40074ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:03.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.899+0000 7fbd3f7fe640 1 --2- 172.21.15.44:0/905039476 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbd401078b0 0x7fbd40074ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:03.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.899+0000 7fbd3f7fe640 1 -- 172.21.15.44:0/905039476 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd401018b0 msgr2=0x7fbd40074220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:03.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.899+0000 7fbd3f7fe640 1 --2- 172.21.15.44:0/905039476 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd401018b0 0x7fbd40074220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:03.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.899+0000 7fbd3f7fe640 1 -- 172.21.15.44:0/905039476 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd401a66f0 con 0x7fbd40102250 2024-08-19T00:12:03.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.899+0000 7fbd3f7fe640 1 --2- 172.21.15.44:0/905039476 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd40102250 0x7fbd40074760 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fbd34009230 tx=0x7fbd34004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:03.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.899+0000 7fbd3d7fa640 1 -- 172.21.15.44:0/905039476 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd3403f030 con 0x7fbd40102250 2024-08-19T00:12:03.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.899+0000 7fbd3d7fa640 1 -- 172.21.15.44:0/905039476 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd34003ad0 con 0x7fbd40102250 2024-08-19T00:12:03.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.899+0000 7fbd464b3640 1 -- 172.21.15.44:0/905039476 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd401a6980 con 0x7fbd40102250 2024-08-19T00:12:03.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.899+0000 7fbd3d7fa640 1 -- 172.21.15.44:0/905039476 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd34035070 con 0x7fbd40102250 2024-08-19T00:12:03.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.899+0000 7fbd464b3640 1 -- 172.21.15.44:0/905039476 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd401a6eb0 con 0x7fbd40102250 2024-08-19T00:12:03.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.900+0000 7fbd464b3640 1 -- 172.21.15.44:0/905039476 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbd40062630 con 0x7fbd40102250 2024-08-19T00:12:03.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.901+0000 7fbd3d7fa640 1 -- 172.21.15.44:0/905039476 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fbd34042030 con 0x7fbd40102250 2024-08-19T00:12:03.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.902+0000 7fbd3d7fa640 1 --2- 172.21.15.44:0/905039476 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fbd280a2c90 0x7fbd280a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:03.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.902+0000 7fbd3ffff640 1 --2- 172.21.15.44:0/905039476 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fbd280a2c90 0x7fbd280a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:03.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.902+0000 7fbd3d7fa640 1 -- 172.21.15.44:0/905039476 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fbd340efe30 con 0x7fbd40102250 2024-08-19T00:12:03.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.902+0000 7fbd3d7fa640 1 --2- 172.21.15.44:0/905039476 >> [v2:172.21.15.116:6808/3768627455,v1:172.21.15.116:6809/3768627455] conn(0x7fbd280ade60 0x7fbd280b0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:03.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.902+0000 7fbd3d7fa640 1 -- 172.21.15.44:0/905039476 --> [v2:172.21.15.116:6808/3768627455,v1:172.21.15.116:6809/3768627455] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbd280b09d0 con 0x7fbd280ade60 2024-08-19T00:12:03.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.902+0000 7fbd3d7fa640 1 -- 172.21.15.44:0/905039476 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7fbd340f01e0 con 0x7fbd40102250 2024-08-19T00:12:03.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.902+0000 7fbd3ffff640 1 --2- 172.21.15.44:0/905039476 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fbd280a2c90 0x7fbd280a5150 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbd30005fd0 tx=0x7fbd3000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:03.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.902+0000 7fbd44a50640 1 --2- 172.21.15.44:0/905039476 >> [v2:172.21.15.116:6808/3768627455,v1:172.21.15.116:6809/3768627455] conn(0x7fbd280ade60 0x7fbd280b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:03.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.903+0000 7fbd44a50640 1 --2- 172.21.15.44:0/905039476 >> [v2:172.21.15.116:6808/3768627455,v1:172.21.15.116:6809/3768627455] conn(0x7fbd280ade60 0x7fbd280b0300 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:03.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.903+0000 7fbd3d7fa640 1 -- 172.21.15.44:0/905039476 <== osd.4 v2:172.21.15.116:6808/3768627455 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbd280b09d0 con 0x7fbd280ade60 2024-08-19T00:12:03.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.918+0000 7fbd464b3640 1 -- 172.21.15.44:0/905039476 --> [v2:172.21.15.116:6808/3768627455,v1:172.21.15.116:6809/3768627455] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbd40062a30 con 0x7fbd280ade60 2024-08-19T00:12:03.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.918+0000 7fbd3d7fa640 1 -- 172.21.15.44:0/905039476 <== osd.4 v2:172.21.15.116:6808/3768627455 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fbd40062a30 con 0x7fbd280ade60 2024-08-19T00:12:03.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.919+0000 7fbd464b3640 1 -- 172.21.15.44:0/905039476 >> [v2:172.21.15.116:6808/3768627455,v1:172.21.15.116:6809/3768627455] conn(0x7fbd280ade60 msgr2=0x7fbd280b0300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:03.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.919+0000 7fbd464b3640 1 --2- 172.21.15.44:0/905039476 >> [v2:172.21.15.116:6808/3768627455,v1:172.21.15.116:6809/3768627455] conn(0x7fbd280ade60 0x7fbd280b0300 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:03.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.919+0000 7fbd464b3640 1 -- 172.21.15.44:0/905039476 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fbd280a2c90 msgr2=0x7fbd280a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:03.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.919+0000 7fbd464b3640 1 --2- 172.21.15.44:0/905039476 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fbd280a2c90 0x7fbd280a5150 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbd30005fd0 tx=0x7fbd3000b390 comp rx=0 tx=0).stop 2024-08-19T00:12:03.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.919+0000 7fbd464b3640 1 -- 172.21.15.44:0/905039476 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd40102250 msgr2=0x7fbd40074760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:03.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.919+0000 7fbd464b3640 1 --2- 172.21.15.44:0/905039476 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd40102250 0x7fbd40074760 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fbd34009230 tx=0x7fbd34004270 comp rx=0 tx=0).stop 2024-08-19T00:12:03.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.919+0000 7fbd44a50640 1 -- 172.21.15.44:0/905039476 reap_dead start 2024-08-19T00:12:03.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.919+0000 7fbd464b3640 1 -- 172.21.15.44:0/905039476 shutdown_connections 2024-08-19T00:12:03.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.919+0000 7fbd464b3640 1 -- 172.21.15.44:0/905039476 >> 172.21.15.44:0/905039476 conn(0x7fbd400fd5f0 msgr2=0x7fbd400fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:03.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.919+0000 7fbd464b3640 1 -- 172.21.15.44:0/905039476 shutdown_connections 2024-08-19T00:12:03.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:01.919+0000 7fbd464b3640 1 -- 172.21.15.44:0/905039476 wait complete. 2024-08-19T00:12:03.916 INFO:teuthology.orchestra.run.smithi044.stdout:133143986235 2024-08-19T00:12:03.917 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-08-19T00:12:04.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:04.088+0000 7fd9f0225640 1 -- 172.21.15.44:0/3961891326 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9e8102240 msgr2=0x7fd9e810e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:04.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:04.088+0000 7fd9f0225640 1 --2- 172.21.15.44:0/3961891326 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9e8102240 0x7fd9e810e770 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0009cd0 tx=0x7fd9e002a8e0 comp rx=0 tx=0).stop 2024-08-19T00:12:04.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:04.088+0000 7fd9f0225640 1 -- 172.21.15.44:0/3961891326 shutdown_connections 2024-08-19T00:12:04.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:04.088+0000 7fd9f0225640 1 --2- 172.21.15.44:0/3961891326 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd9e81018a0 0x7fd9e8101d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:04.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:04.088+0000 7fd9f0225640 1 --2- 172.21.15.44:0/3961891326 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9e8102240 0x7fd9e810e770 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:04.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:04.088+0000 7fd9f0225640 1 --2- 172.21.15.44:0/3961891326 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd9e81078a0 0x7fd9e8107c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:04.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:04.088+0000 7fd9f0225640 1 -- 172.21.15.44:0/3961891326 >> 172.21.15.44:0/3961891326 conn(0x7fd9e80fd5e0 msgr2=0x7fd9e80ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:04.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:04.088+0000 7fd9f0225640 1 -- 172.21.15.44:0/3961891326 shutdown_connections 2024-08-19T00:12:04.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:04.088+0000 7fd9f0225640 1 -- 172.21.15.44:0/3961891326 wait complete. 2024-08-19T00:12:04.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:04.089+0000 7fd9f0225640 1 Processor -- start 2024-08-19T00:12:04.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:04.089+0000 7fd9f0225640 1 -- start start 2024-08-19T00:12:04.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:04.089+0000 7fd9f0225640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd9e81018a0 0x7fd9e81981c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:04.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:04.089+0000 7fd9f0225640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd9e8102240 0x7fd9e8198700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:04.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:04.089+0000 7fd9f0225640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9e81078a0 0x7fd9e819ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:04.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:04.089+0000 7fd9f0225640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e8111ca0 con 0x7fd9e81078a0 2024-08-19T00:12:04.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:04.089+0000 7fd9f0225640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e8111b20 con 0x7fd9e81018a0 2024-08-19T00:12:04.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:04.089+0000 7fd9f0225640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e8111e20 con 0x7fd9e8102240 2024-08-19T00:12:04.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:04.089+0000 7fd9ee7c2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9e81078a0 0x7fd9e819ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:04.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:04.089+0000 7fd9ee7c2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9e81078a0 0x7fd9e819ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45542/0 (socket says 172.21.15.44:45542) 2024-08-19T00:12:04.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:04.089+0000 7fd9ee7c2640 1 -- 172.21.15.44:0/3949426113 learned_addr learned my addr 172.21.15.44:0/3949426113 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:12:04.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:04.089+0000 7fd9edfc1640 1 --2- 172.21.15.44:0/3949426113 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd9e81018a0 0x7fd9e81981c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:04.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:04.089+0000 7fd9ed7c0640 1 --2- 172.21.15.44:0/3949426113 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd9e8102240 0x7fd9e8198700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:04.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:04.089+0000 7fd9ee7c2640 1 -- 172.21.15.44:0/3949426113 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd9e8102240 msgr2=0x7fd9e8198700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:04.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:04.089+0000 7fd9ee7c2640 1 --2- 172.21.15.44:0/3949426113 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd9e8102240 0x7fd9e8198700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:04.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:04.089+0000 7fd9ee7c2640 1 -- 172.21.15.44:0/3949426113 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd9e81018a0 msgr2=0x7fd9e81981c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:04.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:04.089+0000 7fd9ee7c2640 1 --2- 172.21.15.44:0/3949426113 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd9e81018a0 0x7fd9e81981c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:04.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:04.089+0000 7fd9ee7c2640 1 -- 172.21.15.44:0/3949426113 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9e819d170 con 0x7fd9e81078a0 2024-08-19T00:12:04.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:04.089+0000 7fd9ed7c0640 1 --2- 172.21.15.44:0/3949426113 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd9e8102240 0x7fd9e8198700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:12:04.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:04.089+0000 7fd9edfc1640 1 --2- 172.21.15.44:0/3949426113 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd9e81018a0 0x7fd9e81981c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:12:04.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:04.090+0000 7fd9ee7c2640 1 --2- 172.21.15.44:0/3949426113 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9e81078a0 0x7fd9e819ca90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0005cc0 tx=0x7fd9e0003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:04.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:04.090+0000 7fd9daffd640 1 -- 172.21.15.44:0/3949426113 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e0004040 con 0x7fd9e81078a0 2024-08-19T00:12:04.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:04.090+0000 7fd9daffd640 1 -- 172.21.15.44:0/3949426113 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9e00046c0 con 0x7fd9e81078a0 2024-08-19T00:12:04.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:04.090+0000 7fd9f0225640 1 -- 172.21.15.44:0/3949426113 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9e819d400 con 0x7fd9e81078a0 2024-08-19T00:12:04.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:04.090+0000 7fd9daffd640 1 -- 172.21.15.44:0/3949426113 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e0046480 con 0x7fd9e81078a0 2024-08-19T00:12:04.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:04.090+0000 7fd9f0225640 1 -- 172.21.15.44:0/3949426113 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9e81a4d40 con 0x7fd9e81078a0 2024-08-19T00:12:04.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:04.091+0000 7fd9f0225640 1 -- 172.21.15.44:0/3949426113 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd9e80626b0 con 0x7fd9e81078a0 2024-08-19T00:12:04.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:04.093+0000 7fd9daffd640 1 -- 172.21.15.44:0/3949426113 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fd9e00305a0 con 0x7fd9e81078a0 2024-08-19T00:12:04.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:04.093+0000 7fd9daffd640 1 --2- 172.21.15.44:0/3949426113 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fd9d40a2c10 0x7fd9d40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:04.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:04.094+0000 7fd9edfc1640 1 --2- 172.21.15.44:0/3949426113 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fd9d40a2c10 0x7fd9d40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:04.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:04.094+0000 7fd9daffd640 1 -- 172.21.15.44:0/3949426113 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fd9e002e030 con 0x7fd9e81078a0 2024-08-19T00:12:04.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:04.094+0000 7fd9daffd640 1 --2- 172.21.15.44:0/3949426113 >> [v2:172.21.15.44:6802/600251465,v1:172.21.15.44:6803/600251465] conn(0x7fd9d40adde0 0x7fd9d40b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:04.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:04.094+0000 7fd9daffd640 1 -- 172.21.15.44:0/3949426113 --> [v2:172.21.15.44:6802/600251465,v1:172.21.15.44:6803/600251465] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd9e004fe50 con 0x7fd9d40adde0 2024-08-19T00:12:04.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:04.094+0000 7fd9daffd640 1 -- 172.21.15.44:0/3949426113 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7fd9e00f11d0 con 0x7fd9e81078a0 2024-08-19T00:12:04.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:04.094+0000 7fd9ed7c0640 1 --2- 172.21.15.44:0/3949426113 >> [v2:172.21.15.44:6802/600251465,v1:172.21.15.44:6803/600251465] conn(0x7fd9d40adde0 0x7fd9d40b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:04.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:04.094+0000 7fd9edfc1640 1 --2- 172.21.15.44:0/3949426113 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fd9d40a2c10 0x7fd9d40a50d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc00bf50 tx=0x7fd9dc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:04.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:04.094+0000 7fd9ed7c0640 1 --2- 172.21.15.44:0/3949426113 >> [v2:172.21.15.44:6802/600251465,v1:172.21.15.44:6803/600251465] conn(0x7fd9d40adde0 0x7fd9d40b0280 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:04.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:04.095+0000 7fd9daffd640 1 -- 172.21.15.44:0/3949426113 <== osd.0 v2:172.21.15.44:6802/600251465 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd9e004fe50 con 0x7fd9d40adde0 2024-08-19T00:12:04.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:04.109+0000 7fd9f0225640 1 -- 172.21.15.44:0/3949426113 --> [v2:172.21.15.44:6802/600251465,v1:172.21.15.44:6803/600251465] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd9e8062b30 con 0x7fd9d40adde0 2024-08-19T00:12:04.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:04.110+0000 7fd9daffd640 1 -- 172.21.15.44:0/3949426113 <== osd.0 v2:172.21.15.44:6802/600251465 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd9e8062b30 con 0x7fd9d40adde0 2024-08-19T00:12:04.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:04.110+0000 7fd9f0225640 1 -- 172.21.15.44:0/3949426113 >> [v2:172.21.15.44:6802/600251465,v1:172.21.15.44:6803/600251465] conn(0x7fd9d40adde0 msgr2=0x7fd9d40b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:04.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:04.110+0000 7fd9f0225640 1 --2- 172.21.15.44:0/3949426113 >> [v2:172.21.15.44:6802/600251465,v1:172.21.15.44:6803/600251465] conn(0x7fd9d40adde0 0x7fd9d40b0280 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:04.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:04.110+0000 7fd9f0225640 1 -- 172.21.15.44:0/3949426113 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fd9d40a2c10 msgr2=0x7fd9d40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:04.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:04.110+0000 7fd9f0225640 1 --2- 172.21.15.44:0/3949426113 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fd9d40a2c10 0x7fd9d40a50d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc00bf50 tx=0x7fd9dc00b390 comp rx=0 tx=0).stop 2024-08-19T00:12:04.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:04.110+0000 7fd9f0225640 1 -- 172.21.15.44:0/3949426113 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9e81078a0 msgr2=0x7fd9e819ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:04.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:04.110+0000 7fd9f0225640 1 --2- 172.21.15.44:0/3949426113 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9e81078a0 0x7fd9e819ca90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0005cc0 tx=0x7fd9e0003970 comp rx=0 tx=0).stop 2024-08-19T00:12:04.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:04.110+0000 7fd9ee7c2640 1 -- 172.21.15.44:0/3949426113 reap_dead start 2024-08-19T00:12:04.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:04.110+0000 7fd9f0225640 1 -- 172.21.15.44:0/3949426113 shutdown_connections 2024-08-19T00:12:04.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:04.110+0000 7fd9f0225640 1 -- 172.21.15.44:0/3949426113 >> 172.21.15.44:0/3949426113 conn(0x7fd9e80fd5e0 msgr2=0x7fd9e80fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:04.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:04.110+0000 7fd9f0225640 1 -- 172.21.15.44:0/3949426113 shutdown_connections 2024-08-19T00:12:04.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:04.110+0000 7fd9f0225640 1 -- 172.21.15.44:0/3949426113 wait complete. 2024-08-19T00:12:04.744 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:04 smithi044 ceph-mon[18489]: pgmap v304: 129 pgs: 129 active+clean; 645 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 938 B/s wr, 10 op/s 2024-08-19T00:12:04.782 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:12:04.783 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:12:04.783 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:12:04.797 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:12:04.798 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:12:04.798 INFO:teuthology.orchestra.run.smithi044.stdout:279172874276 2024-08-19T00:12:04.798 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:12:04.799 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:12:04.799 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-08-19T00:12:04.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:04 smithi171 ceph-mon[21810]: pgmap v304: 129 pgs: 129 active+clean; 645 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 938 B/s wr, 10 op/s 2024-08-19T00:12:04.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:04 smithi116 ceph-mon[21873]: pgmap v304: 129 pgs: 129 active+clean; 645 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 938 B/s wr, 10 op/s 2024-08-19T00:12:05.235 INFO:teuthology.orchestra.run.smithi044.stdout:34359738444 2024-08-19T00:12:05.235 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-08-19T00:12:05.755 INFO:teuthology.orchestra.run.smithi044.stdout:103079215166 2024-08-19T00:12:05.755 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-08-19T00:12:05.972 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:12:06.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:06.492+0000 7f196bd5a640 1 -- 172.21.15.44:0/652507666 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1964100b50 msgr2=0x7f1964100f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:06.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:06.492+0000 7f196bd5a640 1 --2- 172.21.15.44:0/652507666 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1964100b50 0x7f1964100f30 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1960009ca0 tx=0x7f196002a950 comp rx=0 tx=0).stop 2024-08-19T00:12:06.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:06.492+0000 7f196bd5a640 1 -- 172.21.15.44:0/652507666 shutdown_connections 2024-08-19T00:12:06.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:06.492+0000 7f196bd5a640 1 --2- 172.21.15.44:0/652507666 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1964102c20 0x7f196410d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:06.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:06.492+0000 7f196bd5a640 1 --2- 172.21.15.44:0/652507666 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f19641022a0 0x7f19641026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:06.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:06.492+0000 7f196bd5a640 1 --2- 172.21.15.44:0/652507666 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1964100b50 0x7f1964100f30 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:06.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:06.492+0000 7f196bd5a640 1 -- 172.21.15.44:0/652507666 >> 172.21.15.44:0/652507666 conn(0x7f19640fc500 msgr2=0x7f19640fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:06.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:06.492+0000 7f196bd5a640 1 -- 172.21.15.44:0/652507666 shutdown_connections 2024-08-19T00:12:06.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:06.492+0000 7f196bd5a640 1 -- 172.21.15.44:0/652507666 wait complete. 2024-08-19T00:12:06.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:06.493+0000 7f196bd5a640 1 Processor -- start 2024-08-19T00:12:06.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:06.493+0000 7f196bd5a640 1 -- start start 2024-08-19T00:12:06.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:06.493+0000 7f196bd5a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1964100b50 0x7f19640fc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:06.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:06.493+0000 7f196bd5a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f19641022a0 0x7f19640fcef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:06.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:06.493+0000 7f196bd5a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1964102c20 0x7f19640fd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:06.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:06.493+0000 7f196bd5a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1964110da0 con 0x7f1964102c20 2024-08-19T00:12:06.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:06.493+0000 7f196bd5a640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f1964110c20 con 0x7f1964100b50 2024-08-19T00:12:06.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:06.493+0000 7f196bd5a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1964110f20 con 0x7f19641022a0 2024-08-19T00:12:06.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:06.493+0000 7f196a2f7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1964102c20 0x7f19640fd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:06.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:06.493+0000 7f196a2f7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1964102c20 0x7f19640fd430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45556/0 (socket says 172.21.15.44:45556) 2024-08-19T00:12:06.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:06.493+0000 7f196a2f7640 1 -- 172.21.15.44:0/3107524396 learned_addr learned my addr 172.21.15.44:0/3107524396 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:12:06.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:06.493+0000 7f1969af6640 1 --2- 172.21.15.44:0/3107524396 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1964100b50 0x7f19640fc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:06.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:06.493+0000 7f19692f5640 1 --2- 172.21.15.44:0/3107524396 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f19641022a0 0x7f19640fcef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:06.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:06.493+0000 7f196a2f7640 1 -- 172.21.15.44:0/3107524396 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f19641022a0 msgr2=0x7f19640fcef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:06.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:06.493+0000 7f196a2f7640 1 --2- 172.21.15.44:0/3107524396 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f19641022a0 0x7f19640fcef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:06.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:06.493+0000 7f196a2f7640 1 -- 172.21.15.44:0/3107524396 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1964100b50 msgr2=0x7f19640fc9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:06.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:06.493+0000 7f196a2f7640 1 --2- 172.21.15.44:0/3107524396 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1964100b50 0x7f19640fc9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:06.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:06.493+0000 7f196a2f7640 1 -- 172.21.15.44:0/3107524396 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19641a68e0 con 0x7f1964102c20 2024-08-19T00:12:06.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:06.493+0000 7f19692f5640 1 --2- 172.21.15.44:0/3107524396 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f19641022a0 0x7f19640fcef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:12:06.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:06.494+0000 7f196a2f7640 1 --2- 172.21.15.44:0/3107524396 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1964102c20 0x7f19640fd430 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f195c009fd0 tx=0x7f195c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:06.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:06.494+0000 7f195affd640 1 -- 172.21.15.44:0/3107524396 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f195c011830 con 0x7f1964102c20 2024-08-19T00:12:06.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:06.494+0000 7f195affd640 1 -- 172.21.15.44:0/3107524396 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f195c016070 con 0x7f1964102c20 2024-08-19T00:12:06.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:06.494+0000 7f196bd5a640 1 -- 172.21.15.44:0/3107524396 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19641a6bd0 con 0x7f1964102c20 2024-08-19T00:12:06.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:06.494+0000 7f195affd640 1 -- 172.21.15.44:0/3107524396 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f195c00f2e0 con 0x7f1964102c20 2024-08-19T00:12:06.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:06.494+0000 7f196bd5a640 1 -- 172.21.15.44:0/3107524396 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19641a7110 con 0x7f1964102c20 2024-08-19T00:12:06.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:06.495+0000 7f196bd5a640 1 -- 172.21.15.44:0/3107524396 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1964106e90 con 0x7f1964102c20 2024-08-19T00:12:06.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:06.496+0000 7f195affd640 1 -- 172.21.15.44:0/3107524396 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f195c0119d0 con 0x7f1964102c20 2024-08-19T00:12:06.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:06.497+0000 7f195affd640 1 --2- 172.21.15.44:0/3107524396 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f19500a2c10 0x7f19500a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:06.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:06.497+0000 7f1969af6640 1 --2- 172.21.15.44:0/3107524396 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f19500a2c10 0x7f19500a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:06.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:06.497+0000 7f195affd640 1 -- 172.21.15.44:0/3107524396 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f195c0cf520 con 0x7f1964102c20 2024-08-19T00:12:06.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:06.497+0000 7f195affd640 1 --2- 172.21.15.44:0/3107524396 >> [v2:172.21.15.44:6818/1219334797,v1:172.21.15.44:6819/1219334797] conn(0x7f19500adde0 0x7f19500b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:06.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:06.497+0000 7f195affd640 1 -- 172.21.15.44:0/3107524396 --> [v2:172.21.15.44:6818/1219334797,v1:172.21.15.44:6819/1219334797] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f195c01ee50 con 0x7f19500adde0 2024-08-19T00:12:06.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:06.497+0000 7f195affd640 1 -- 172.21.15.44:0/3107524396 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7f195c0cf8d0 con 0x7f1964102c20 2024-08-19T00:12:06.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:06.497+0000 7f19692f5640 1 --2- 172.21.15.44:0/3107524396 >> [v2:172.21.15.44:6818/1219334797,v1:172.21.15.44:6819/1219334797] conn(0x7f19500adde0 0x7f19500b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:06.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:06.497+0000 7f1969af6640 1 --2- 172.21.15.44:0/3107524396 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f19500a2c10 0x7f19500a50d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1960000f80 tx=0x7f1960009800 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:06.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:06.498+0000 7f19692f5640 1 --2- 172.21.15.44:0/3107524396 >> [v2:172.21.15.44:6818/1219334797,v1:172.21.15.44:6819/1219334797] conn(0x7f19500adde0 0x7f19500b0280 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:06.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:06.498+0000 7f195affd640 1 -- 172.21.15.44:0/3107524396 <== osd.6 v2:172.21.15.44:6818/1219334797 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f195c01ee50 con 0x7f19500adde0 2024-08-19T00:12:06.511 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:06 smithi044 ceph-mon[18489]: pgmap v305: 129 pgs: 129 active+clean; 645 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 938 B/s wr, 9 op/s 2024-08-19T00:12:06.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:06.518+0000 7f196bd5a640 1 -- 172.21.15.44:0/3107524396 --> [v2:172.21.15.44:6818/1219334797,v1:172.21.15.44:6819/1219334797] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1964101ee0 con 0x7f19500adde0 2024-08-19T00:12:06.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:06.518+0000 7f195affd640 1 -- 172.21.15.44:0/3107524396 <== osd.6 v2:172.21.15.44:6818/1219334797 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f1964101ee0 con 0x7f19500adde0 2024-08-19T00:12:06.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:06.518+0000 7f196bd5a640 1 -- 172.21.15.44:0/3107524396 >> [v2:172.21.15.44:6818/1219334797,v1:172.21.15.44:6819/1219334797] conn(0x7f19500adde0 msgr2=0x7f19500b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:06.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:06.518+0000 7f196bd5a640 1 --2- 172.21.15.44:0/3107524396 >> [v2:172.21.15.44:6818/1219334797,v1:172.21.15.44:6819/1219334797] conn(0x7f19500adde0 0x7f19500b0280 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:06.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:06.519+0000 7f196bd5a640 1 -- 172.21.15.44:0/3107524396 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f19500a2c10 msgr2=0x7f19500a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:06.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:06.519+0000 7f196bd5a640 1 --2- 172.21.15.44:0/3107524396 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f19500a2c10 0x7f19500a50d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1960000f80 tx=0x7f1960009800 comp rx=0 tx=0).stop 2024-08-19T00:12:06.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:06.519+0000 7f196bd5a640 1 -- 172.21.15.44:0/3107524396 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1964102c20 msgr2=0x7f19640fd430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:06.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:06.519+0000 7f196bd5a640 1 --2- 172.21.15.44:0/3107524396 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1964102c20 0x7f19640fd430 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f195c009fd0 tx=0x7f195c00b8e0 comp rx=0 tx=0).stop 2024-08-19T00:12:06.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:06.519+0000 7f196a2f7640 1 -- 172.21.15.44:0/3107524396 reap_dead start 2024-08-19T00:12:06.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:06.519+0000 7f196bd5a640 1 -- 172.21.15.44:0/3107524396 shutdown_connections 2024-08-19T00:12:06.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:06.519+0000 7f196bd5a640 1 -- 172.21.15.44:0/3107524396 >> 172.21.15.44:0/3107524396 conn(0x7f19640fc500 msgr2=0x7f1964069ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:06.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:06.519+0000 7f196bd5a640 1 -- 172.21.15.44:0/3107524396 shutdown_connections 2024-08-19T00:12:06.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:06.519+0000 7f196bd5a640 1 -- 172.21.15.44:0/3107524396 wait complete. 2024-08-19T00:12:06.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:06 smithi171 ceph-mon[21810]: pgmap v305: 129 pgs: 129 active+clean; 645 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 938 B/s wr, 9 op/s 2024-08-19T00:12:06.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:06 smithi116 ceph-mon[21873]: pgmap v305: 129 pgs: 129 active+clean; 645 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 938 B/s wr, 9 op/s 2024-08-19T00:12:07.212 INFO:teuthology.orchestra.run.smithi044.stdout:188978561075 2024-08-19T00:12:07.212 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-08-19T00:12:07.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:07.510+0000 7ff6e4327640 1 -- 172.21.15.44:0/3301786990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6dc1078b0 msgr2=0x7ff6dc107c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:07.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:07.510+0000 7ff6e4327640 1 --2- 172.21.15.44:0/3301786990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6dc1078b0 0x7ff6dc107c90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff6d8009930 tx=0x7ff6d802a440 comp rx=0 tx=0).stop 2024-08-19T00:12:07.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:07.510+0000 7ff6e4327640 1 -- 172.21.15.44:0/3301786990 shutdown_connections 2024-08-19T00:12:07.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:07.510+0000 7ff6e4327640 1 --2- 172.21.15.44:0/3301786990 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff6dc102250 0x7ff6dc10e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:07.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:07.510+0000 7ff6e4327640 1 --2- 172.21.15.44:0/3301786990 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff6dc1018b0 0x7ff6dc101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:07.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:07.510+0000 7ff6e4327640 1 --2- 172.21.15.44:0/3301786990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6dc1078b0 0x7ff6dc107c90 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:07.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:07.510+0000 7ff6e4327640 1 -- 172.21.15.44:0/3301786990 >> 172.21.15.44:0/3301786990 conn(0x7ff6dc0fd5f0 msgr2=0x7ff6dc0ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:07.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:07.510+0000 7ff6e4327640 1 -- 172.21.15.44:0/3301786990 shutdown_connections 2024-08-19T00:12:07.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:07.510+0000 7ff6e4327640 1 -- 172.21.15.44:0/3301786990 wait complete. 2024-08-19T00:12:07.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:07.511+0000 7ff6e4327640 1 Processor -- start 2024-08-19T00:12:07.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:07.511+0000 7ff6e4327640 1 -- start start 2024-08-19T00:12:07.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:07.511+0000 7ff6e4327640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff6dc1018b0 0x7ff6dc074220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:07.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:07.511+0000 7ff6e4327640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6dc102250 0x7ff6dc074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:07.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:07.511+0000 7ff6e4327640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff6dc1078b0 0x7ff6dc074ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:07.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:07.511+0000 7ff6e4327640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff6dc111cf0 con 0x7ff6dc102250 2024-08-19T00:12:07.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:07.511+0000 7ff6e4327640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7ff6dc111b70 con 0x7ff6dc1018b0 2024-08-19T00:12:07.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:07.511+0000 7ff6e4327640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff6dc111e70 con 0x7ff6dc1078b0 2024-08-19T00:12:07.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:07.511+0000 7ff6e18c2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6dc102250 0x7ff6dc074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:07.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:07.511+0000 7ff6e18c2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6dc102250 0x7ff6dc074760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45562/0 (socket says 172.21.15.44:45562) 2024-08-19T00:12:07.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:07.511+0000 7ff6e18c2640 1 -- 172.21.15.44:0/4052534234 learned_addr learned my addr 172.21.15.44:0/4052534234 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:12:07.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:07.511+0000 7ff6e20c3640 1 --2- 172.21.15.44:0/4052534234 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff6dc1018b0 0x7ff6dc074220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:07.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:07.511+0000 7ff6e18c2640 1 -- 172.21.15.44:0/4052534234 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff6dc1078b0 msgr2=0x7ff6dc074ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:07.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:07.511+0000 7ff6e28c4640 1 --2- 172.21.15.44:0/4052534234 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff6dc1078b0 0x7ff6dc074ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:07.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:07.511+0000 7ff6e18c2640 1 --2- 172.21.15.44:0/4052534234 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff6dc1078b0 0x7ff6dc074ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:07.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:07.511+0000 7ff6e18c2640 1 -- 172.21.15.44:0/4052534234 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff6dc1018b0 msgr2=0x7ff6dc074220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:07.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:07.511+0000 7ff6e18c2640 1 --2- 172.21.15.44:0/4052534234 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff6dc1018b0 0x7ff6dc074220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:07.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:07.511+0000 7ff6e18c2640 1 -- 172.21.15.44:0/4052534234 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6dc1a6710 con 0x7ff6dc102250 2024-08-19T00:12:07.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:07.511+0000 7ff6e20c3640 1 --2- 172.21.15.44:0/4052534234 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff6dc1018b0 0x7ff6dc074220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:12:07.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:07.512+0000 7ff6e18c2640 1 --2- 172.21.15.44:0/4052534234 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6dc102250 0x7ff6dc074760 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc00c890 tx=0x7ff6cc00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:07.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:07.512+0000 7ff6d37fe640 1 -- 172.21.15.44:0/4052534234 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc004220 con 0x7ff6dc102250 2024-08-19T00:12:07.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:07.512+0000 7ff6d37fe640 1 -- 172.21.15.44:0/4052534234 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff6cc0043c0 con 0x7ff6dc102250 2024-08-19T00:12:07.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:07.512+0000 7ff6e4327640 1 -- 172.21.15.44:0/4052534234 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6dc1a6a00 con 0x7ff6dc102250 2024-08-19T00:12:07.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:07.512+0000 7ff6d37fe640 1 -- 172.21.15.44:0/4052534234 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc0049e0 con 0x7ff6dc102250 2024-08-19T00:12:07.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:07.512+0000 7ff6e4327640 1 -- 172.21.15.44:0/4052534234 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6dc1a6f40 con 0x7ff6dc102250 2024-08-19T00:12:07.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:07.513+0000 7ff6e4327640 1 -- 172.21.15.44:0/4052534234 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff6dc062630 con 0x7ff6dc102250 2024-08-19T00:12:07.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:07.514+0000 7ff6d37fe640 1 -- 172.21.15.44:0/4052534234 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7ff6cc0079b0 con 0x7ff6dc102250 2024-08-19T00:12:07.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:07.514+0000 7ff6d37fe640 1 --2- 172.21.15.44:0/4052534234 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7ff6c80a2c10 0x7ff6c80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:07.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:07.515+0000 7ff6e20c3640 1 --2- 172.21.15.44:0/4052534234 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7ff6c80a2c10 0x7ff6c80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:07.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:07.515+0000 7ff6d37fe640 1 -- 172.21.15.44:0/4052534234 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7ff6cc0cf820 con 0x7ff6dc102250 2024-08-19T00:12:07.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:07.515+0000 7ff6d37fe640 1 --2- 172.21.15.44:0/4052534234 >> [v2:172.21.15.171:6824/1500842656,v1:172.21.15.171:6825/1500842656] conn(0x7ff6c80adde0 0x7ff6c80b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:07.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:07.515+0000 7ff6d37fe640 1 -- 172.21.15.44:0/4052534234 --> [v2:172.21.15.171:6824/1500842656,v1:172.21.15.171:6825/1500842656] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff6c80b0950 con 0x7ff6c80adde0 2024-08-19T00:12:07.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:07.515+0000 7ff6d37fe640 1 -- 172.21.15.44:0/4052534234 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7ff6cc0cfc70 con 0x7ff6dc102250 2024-08-19T00:12:07.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:07.515+0000 7ff6e20c3640 1 --2- 172.21.15.44:0/4052534234 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7ff6c80a2c10 0x7ff6c80a50d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff6d80096c0 tx=0x7ff6d8032d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:07.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:07.515+0000 7ff6e28c4640 1 --2- 172.21.15.44:0/4052534234 >> [v2:172.21.15.171:6824/1500842656,v1:172.21.15.171:6825/1500842656] conn(0x7ff6c80adde0 0x7ff6c80b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:07.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:07.516+0000 7ff6e28c4640 1 --2- 172.21.15.44:0/4052534234 >> [v2:172.21.15.171:6824/1500842656,v1:172.21.15.171:6825/1500842656] conn(0x7ff6c80adde0 0x7ff6c80b0280 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:07.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:07.516+0000 7ff6d37fe640 1 -- 172.21.15.44:0/4052534234 <== osd.11 v2:172.21.15.171:6824/1500842656 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff6c80b0950 con 0x7ff6c80adde0 2024-08-19T00:12:07.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:07.530+0000 7ff6e4327640 1 -- 172.21.15.44:0/4052534234 --> [v2:172.21.15.171:6824/1500842656,v1:172.21.15.171:6825/1500842656] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff6dc062ab0 con 0x7ff6c80adde0 2024-08-19T00:12:07.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:07.531+0000 7ff6d37fe640 1 -- 172.21.15.44:0/4052534234 <== osd.11 v2:172.21.15.171:6824/1500842656 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ff6dc062ab0 con 0x7ff6c80adde0 2024-08-19T00:12:07.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:07.531+0000 7ff6e4327640 1 -- 172.21.15.44:0/4052534234 >> [v2:172.21.15.171:6824/1500842656,v1:172.21.15.171:6825/1500842656] conn(0x7ff6c80adde0 msgr2=0x7ff6c80b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:07.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:07.531+0000 7ff6e4327640 1 --2- 172.21.15.44:0/4052534234 >> [v2:172.21.15.171:6824/1500842656,v1:172.21.15.171:6825/1500842656] conn(0x7ff6c80adde0 0x7ff6c80b0280 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:07.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:07.531+0000 7ff6e4327640 1 -- 172.21.15.44:0/4052534234 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7ff6c80a2c10 msgr2=0x7ff6c80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:07.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:07.531+0000 7ff6e4327640 1 --2- 172.21.15.44:0/4052534234 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7ff6c80a2c10 0x7ff6c80a50d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff6d80096c0 tx=0x7ff6d8032d50 comp rx=0 tx=0).stop 2024-08-19T00:12:07.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:07.531+0000 7ff6e4327640 1 -- 172.21.15.44:0/4052534234 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6dc102250 msgr2=0x7ff6dc074760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:07.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:07.531+0000 7ff6e4327640 1 --2- 172.21.15.44:0/4052534234 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6dc102250 0x7ff6dc074760 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc00c890 tx=0x7ff6cc00cd50 comp rx=0 tx=0).stop 2024-08-19T00:12:07.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:07.531+0000 7ff6e28c4640 1 -- 172.21.15.44:0/4052534234 reap_dead start 2024-08-19T00:12:07.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:07.531+0000 7ff6e4327640 1 -- 172.21.15.44:0/4052534234 shutdown_connections 2024-08-19T00:12:07.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:07.531+0000 7ff6e4327640 1 -- 172.21.15.44:0/4052534234 >> 172.21.15.44:0/4052534234 conn(0x7ff6dc0fd5f0 msgr2=0x7ff6dc0fef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:07.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:07.531+0000 7ff6e4327640 1 -- 172.21.15.44:0/4052534234 shutdown_connections 2024-08-19T00:12:07.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:07.531+0000 7ff6e4327640 1 -- 172.21.15.44:0/4052534234 wait complete. 2024-08-19T00:12:08.773 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:08 smithi044 ceph-mon[18489]: pgmap v306: 129 pgs: 129 active+clean; 645 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 938 B/s wr, 12 op/s 2024-08-19T00:12:08.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:08 smithi171 ceph-mon[21810]: pgmap v306: 129 pgs: 129 active+clean; 645 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 938 B/s wr, 12 op/s 2024-08-19T00:12:08.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:08 smithi116 ceph-mon[21873]: pgmap v306: 129 pgs: 129 active+clean; 645 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 938 B/s wr, 12 op/s 2024-08-19T00:12:09.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:09.377+0000 7f97681e2640 1 -- 172.21.15.44:0/2229999548 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97601018e0 msgr2=0x7f9760101d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:09.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:09.377+0000 7f97681e2640 1 --2- 172.21.15.44:0/2229999548 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97601018e0 0x7f9760101d40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9750009930 tx=0x7f975002a420 comp rx=0 tx=0).stop 2024-08-19T00:12:09.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:09.377+0000 7f97681e2640 1 -- 172.21.15.44:0/2229999548 shutdown_connections 2024-08-19T00:12:09.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:09.377+0000 7f97681e2640 1 --2- 172.21.15.44:0/2229999548 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9760102280 0x7f976010e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:09.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:09.377+0000 7f97681e2640 1 --2- 172.21.15.44:0/2229999548 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97601018e0 0x7f9760101d40 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:09.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:09.377+0000 7f97681e2640 1 --2- 172.21.15.44:0/2229999548 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97601078e0 0x7f9760107cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:09.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:09.377+0000 7f97681e2640 1 -- 172.21.15.44:0/2229999548 >> 172.21.15.44:0/2229999548 conn(0x7f97600fd600 msgr2=0x7f97600ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:09.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:09.378+0000 7f97681e2640 1 -- 172.21.15.44:0/2229999548 shutdown_connections 2024-08-19T00:12:09.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:09.378+0000 7f97681e2640 1 -- 172.21.15.44:0/2229999548 wait complete. 2024-08-19T00:12:09.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:09.378+0000 7f97681e2640 1 Processor -- start 2024-08-19T00:12:09.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:09.378+0000 7f97681e2640 1 -- start start 2024-08-19T00:12:09.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:09.378+0000 7f97681e2640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f97601018e0 0x7f9760198190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:09.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:09.378+0000 7f97681e2640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9760102280 0x7f97601986d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:09.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:09.378+0000 7f97681e2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97601078e0 0x7f976019ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:09.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:09.378+0000 7f97681e2640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9760111ce0 con 0x7f97601078e0 2024-08-19T00:12:09.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:09.378+0000 7f97681e2640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f9760111b60 con 0x7f9760102280 2024-08-19T00:12:09.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:09.378+0000 7f97681e2640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9760111e60 con 0x7f97601018e0 2024-08-19T00:12:09.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:09.378+0000 7f976677f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97601078e0 0x7f976019ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:09.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:09.379+0000 7f976677f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97601078e0 0x7f976019ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43676/0 (socket says 172.21.15.44:43676) 2024-08-19T00:12:09.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:09.379+0000 7f976677f640 1 -- 172.21.15.44:0/870300492 learned_addr learned my addr 172.21.15.44:0/870300492 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:12:09.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:09.379+0000 7f9765f7e640 1 --2- 172.21.15.44:0/870300492 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f97601018e0 0x7f9760198190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:09.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:09.379+0000 7f976577d640 1 --2- 172.21.15.44:0/870300492 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9760102280 0x7f97601986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:09.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:09.379+0000 7f976677f640 1 -- 172.21.15.44:0/870300492 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f97601018e0 msgr2=0x7f9760198190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:09.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:09.379+0000 7f976677f640 1 --2- 172.21.15.44:0/870300492 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f97601018e0 0x7f9760198190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:09.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:09.379+0000 7f976677f640 1 -- 172.21.15.44:0/870300492 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9760102280 msgr2=0x7f97601986d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:09.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:09.379+0000 7f976677f640 1 --2- 172.21.15.44:0/870300492 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9760102280 0x7f97601986d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:09.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:09.379+0000 7f976677f640 1 -- 172.21.15.44:0/870300492 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f976019d140 con 0x7f97601078e0 2024-08-19T00:12:09.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:09.379+0000 7f9765f7e640 1 --2- 172.21.15.44:0/870300492 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f97601018e0 0x7f9760198190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:12:09.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:09.379+0000 7f976577d640 1 --2- 172.21.15.44:0/870300492 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9760102280 0x7f97601986d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:12:09.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:09.379+0000 7f976677f640 1 --2- 172.21.15.44:0/870300492 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97601078e0 0x7f976019ca60 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f975800cce0 tx=0x7f975800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:09.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:09.379+0000 7f9756ffd640 1 -- 172.21.15.44:0/870300492 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f975800f450 con 0x7f97601078e0 2024-08-19T00:12:09.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:09.379+0000 7f97681e2640 1 -- 172.21.15.44:0/870300492 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f976019d430 con 0x7f97601078e0 2024-08-19T00:12:09.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:09.379+0000 7f9756ffd640 1 -- 172.21.15.44:0/870300492 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f975800fad0 con 0x7f97601078e0 2024-08-19T00:12:09.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:09.379+0000 7f9756ffd640 1 -- 172.21.15.44:0/870300492 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9758018c10 con 0x7f97601078e0 2024-08-19T00:12:09.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:09.379+0000 7f97681e2640 1 -- 172.21.15.44:0/870300492 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97601a4d10 con 0x7f97601078e0 2024-08-19T00:12:09.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:09.380+0000 7f97681e2640 1 -- 172.21.15.44:0/870300492 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9760062670 con 0x7f97601078e0 2024-08-19T00:12:09.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:09.381+0000 7f9756ffd640 1 -- 172.21.15.44:0/870300492 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f975800f5f0 con 0x7f97601078e0 2024-08-19T00:12:09.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:09.382+0000 7f9756ffd640 1 --2- 172.21.15.44:0/870300492 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f974c0a2c10 0x7f974c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:09.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:09.382+0000 7f9765f7e640 1 --2- 172.21.15.44:0/870300492 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f974c0a2c10 0x7f974c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:09.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:09.382+0000 7f9756ffd640 1 -- 172.21.15.44:0/870300492 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f97580cff80 con 0x7f97601078e0 2024-08-19T00:12:09.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:09.382+0000 7f9756ffd640 1 --2- 172.21.15.44:0/870300492 >> [v2:172.21.15.171:6816/843701060,v1:172.21.15.171:6817/843701060] conn(0x7f974c0adde0 0x7f974c0b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:09.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:09.382+0000 7f9756ffd640 1 -- 172.21.15.44:0/870300492 --> [v2:172.21.15.171:6816/843701060,v1:172.21.15.171:6817/843701060] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f974c0b0950 con 0x7f974c0adde0 2024-08-19T00:12:09.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:09.382+0000 7f9756ffd640 1 -- 172.21.15.44:0/870300492 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7f97580d0330 con 0x7f97601078e0 2024-08-19T00:12:09.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:09.382+0000 7f9765f7e640 1 --2- 172.21.15.44:0/870300492 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f974c0a2c10 0x7f974c0a50d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f975c005d90 tx=0x7f975c005d20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:09.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:09.384+0000 7f976577d640 1 --2- 172.21.15.44:0/870300492 >> [v2:172.21.15.171:6816/843701060,v1:172.21.15.171:6817/843701060] conn(0x7f974c0adde0 0x7f974c0b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:09.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:09.386+0000 7f976577d640 1 --2- 172.21.15.44:0/870300492 >> [v2:172.21.15.171:6816/843701060,v1:172.21.15.171:6817/843701060] conn(0x7f974c0adde0 0x7f974c0b0280 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:09.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:09.388+0000 7f9756ffd640 1 -- 172.21.15.44:0/870300492 <== osd.8 v2:172.21.15.171:6816/843701060 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f974c0b0950 con 0x7f974c0adde0 2024-08-19T00:12:09.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:09.401+0000 7f97681e2640 1 -- 172.21.15.44:0/870300492 --> [v2:172.21.15.171:6816/843701060,v1:172.21.15.171:6817/843701060] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9760062af0 con 0x7f974c0adde0 2024-08-19T00:12:09.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:09.402+0000 7f9756ffd640 1 -- 172.21.15.44:0/870300492 <== osd.8 v2:172.21.15.171:6816/843701060 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9760062af0 con 0x7f974c0adde0 2024-08-19T00:12:09.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:09.402+0000 7f97681e2640 1 -- 172.21.15.44:0/870300492 >> [v2:172.21.15.171:6816/843701060,v1:172.21.15.171:6817/843701060] conn(0x7f974c0adde0 msgr2=0x7f974c0b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:09.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:09.402+0000 7f97681e2640 1 --2- 172.21.15.44:0/870300492 >> [v2:172.21.15.171:6816/843701060,v1:172.21.15.171:6817/843701060] conn(0x7f974c0adde0 0x7f974c0b0280 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:09.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:09.402+0000 7f97681e2640 1 -- 172.21.15.44:0/870300492 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f974c0a2c10 msgr2=0x7f974c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:09.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:09.402+0000 7f97681e2640 1 --2- 172.21.15.44:0/870300492 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f974c0a2c10 0x7f974c0a50d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f975c005d90 tx=0x7f975c005d20 comp rx=0 tx=0).stop 2024-08-19T00:12:09.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:09.402+0000 7f97681e2640 1 -- 172.21.15.44:0/870300492 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97601078e0 msgr2=0x7f976019ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:09.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:09.402+0000 7f97681e2640 1 --2- 172.21.15.44:0/870300492 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97601078e0 0x7f976019ca60 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f975800cce0 tx=0x7f975800a620 comp rx=0 tx=0).stop 2024-08-19T00:12:09.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:09.402+0000 7f976677f640 1 -- 172.21.15.44:0/870300492 reap_dead start 2024-08-19T00:12:09.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:09.402+0000 7f97681e2640 1 -- 172.21.15.44:0/870300492 shutdown_connections 2024-08-19T00:12:09.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:09.403+0000 7f97681e2640 1 -- 172.21.15.44:0/870300492 >> 172.21.15.44:0/870300492 conn(0x7f97600fd600 msgr2=0x7f97600fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:09.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:09.403+0000 7f97681e2640 1 -- 172.21.15.44:0/870300492 shutdown_connections 2024-08-19T00:12:09.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:09.403+0000 7f97681e2640 1 -- 172.21.15.44:0/870300492 wait complete. 2024-08-19T00:12:10.058 INFO:teuthology.orchestra.run.smithi044.stdout:244813135914 2024-08-19T00:12:10.059 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-08-19T00:12:10.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:10.220+0000 7f9ddd018640 1 -- 172.21.15.44:0/1788274670 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9dd8102c20 msgr2=0x7f9dd810d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:10.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:10.220+0000 7f9ddd018640 1 --2- 172.21.15.44:0/1788274670 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9dd8102c20 0x7f9dd810d770 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9dd0009ca0 tx=0x7f9dd002a950 comp rx=0 tx=0).stop 2024-08-19T00:12:10.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:10.220+0000 7f9ddd018640 1 -- 172.21.15.44:0/1788274670 shutdown_connections 2024-08-19T00:12:10.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:10.220+0000 7f9ddd018640 1 --2- 172.21.15.44:0/1788274670 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9dd81022a0 0x7f9dd81026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:10.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:10.220+0000 7f9ddd018640 1 --2- 172.21.15.44:0/1788274670 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9dd8102c20 0x7f9dd810d770 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:10.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:10.220+0000 7f9ddd018640 1 --2- 172.21.15.44:0/1788274670 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9dd8100b50 0x7f9dd8100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:10.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:10.220+0000 7f9ddd018640 1 -- 172.21.15.44:0/1788274670 >> 172.21.15.44:0/1788274670 conn(0x7f9dd80fc500 msgr2=0x7f9dd80fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:10.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:10.220+0000 7f9ddd018640 1 -- 172.21.15.44:0/1788274670 shutdown_connections 2024-08-19T00:12:10.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:10.220+0000 7f9ddd018640 1 -- 172.21.15.44:0/1788274670 wait complete. 2024-08-19T00:12:10.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:10.221+0000 7f9ddd018640 1 Processor -- start 2024-08-19T00:12:10.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:10.221+0000 7f9ddd018640 1 -- start start 2024-08-19T00:12:10.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:10.221+0000 7f9ddd018640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9dd8100b50 0x7f9dd80fc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:10.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:10.221+0000 7f9ddd018640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9dd81022a0 0x7f9dd80fcef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:10.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:10.221+0000 7f9ddd018640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9dd8102c20 0x7f9dd80fd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:10.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:10.221+0000 7f9ddd018640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd8110cb0 con 0x7f9dd8100b50 2024-08-19T00:12:10.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:10.221+0000 7f9ddd018640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd8110b30 con 0x7f9dd81022a0 2024-08-19T00:12:10.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:10.221+0000 7f9ddd018640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd8110e30 con 0x7f9dd8102c20 2024-08-19T00:12:10.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:10.221+0000 7f9dd6d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9dd8100b50 0x7f9dd80fc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:10.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:10.222+0000 7f9dd6d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9dd8100b50 0x7f9dd80fc9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43692/0 (socket says 172.21.15.44:43692) 2024-08-19T00:12:10.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:10.222+0000 7f9dd6d9d640 1 -- 172.21.15.44:0/1427936587 learned_addr learned my addr 172.21.15.44:0/1427936587 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:12:10.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:10.222+0000 7f9dd759e640 1 --2- 172.21.15.44:0/1427936587 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9dd8102c20 0x7f9dd80fd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:10.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:10.222+0000 7f9dd659c640 1 --2- 172.21.15.44:0/1427936587 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9dd81022a0 0x7f9dd80fcef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:10.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:10.222+0000 7f9dd6d9d640 1 -- 172.21.15.44:0/1427936587 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9dd8102c20 msgr2=0x7f9dd80fd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:10.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:10.222+0000 7f9dd6d9d640 1 --2- 172.21.15.44:0/1427936587 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9dd8102c20 0x7f9dd80fd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:10.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:10.222+0000 7f9dd6d9d640 1 -- 172.21.15.44:0/1427936587 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9dd81022a0 msgr2=0x7f9dd80fcef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:10.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:10.222+0000 7f9dd6d9d640 1 --2- 172.21.15.44:0/1427936587 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9dd81022a0 0x7f9dd80fcef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:10.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:10.222+0000 7f9dd6d9d640 1 -- 172.21.15.44:0/1427936587 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dd81a6720 con 0x7f9dd8100b50 2024-08-19T00:12:10.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:10.222+0000 7f9dd759e640 1 --2- 172.21.15.44:0/1427936587 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9dd8102c20 0x7f9dd80fd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:12:10.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:10.222+0000 7f9dd6d9d640 1 --2- 172.21.15.44:0/1427936587 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9dd8100b50 0x7f9dd80fc9b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9dc800d950 tx=0x7f9dc800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:10.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:10.222+0000 7f9dbffff640 1 -- 172.21.15.44:0/1427936587 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc8017070 con 0x7f9dd8100b50 2024-08-19T00:12:10.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:10.222+0000 7f9ddd018640 1 -- 172.21.15.44:0/1427936587 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dd81a6a10 con 0x7f9dd8100b50 2024-08-19T00:12:10.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:10.222+0000 7f9dbffff640 1 -- 172.21.15.44:0/1427936587 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9dc8009c30 con 0x7f9dd8100b50 2024-08-19T00:12:10.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:10.222+0000 7f9dbffff640 1 -- 172.21.15.44:0/1427936587 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc800f6b0 con 0x7f9dd8100b50 2024-08-19T00:12:10.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:10.222+0000 7f9ddd018640 1 -- 172.21.15.44:0/1427936587 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dd81a6fa0 con 0x7f9dd8100b50 2024-08-19T00:12:10.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:10.224+0000 7f9ddd018640 1 -- 172.21.15.44:0/1427936587 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9dd8062630 con 0x7f9dd8100b50 2024-08-19T00:12:10.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:10.225+0000 7f9dbffff640 1 -- 172.21.15.44:0/1427936587 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f9dc80109d0 con 0x7f9dd8100b50 2024-08-19T00:12:10.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:10.225+0000 7f9dbffff640 1 --2- 172.21.15.44:0/1427936587 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f9dc00a2c10 0x7f9dc00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:10.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:10.226+0000 7f9dbffff640 1 -- 172.21.15.44:0/1427936587 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f9dc80cf290 con 0x7f9dd8100b50 2024-08-19T00:12:10.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:10.226+0000 7f9dd659c640 1 --2- 172.21.15.44:0/1427936587 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f9dc00a2c10 0x7f9dc00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:10.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:10.226+0000 7f9dbffff640 1 --2- 172.21.15.44:0/1427936587 >> [v2:172.21.15.171:6808/938785018,v1:172.21.15.171:6809/938785018] conn(0x7f9dc00adde0 0x7f9dc00b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:10.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:10.226+0000 7f9dbffff640 1 -- 172.21.15.44:0/1427936587 --> [v2:172.21.15.171:6808/938785018,v1:172.21.15.171:6809/938785018] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9dc8004470 con 0x7f9dc00adde0 2024-08-19T00:12:10.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:10.226+0000 7f9dbffff640 1 -- 172.21.15.44:0/1427936587 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7f9dc80d6050 con 0x7f9dd8100b50 2024-08-19T00:12:10.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:10.226+0000 7f9dd659c640 1 --2- 172.21.15.44:0/1427936587 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f9dc00a2c10 0x7f9dc00a50d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc005fd0 tx=0x7f9dcc00b510 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:10.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:10.226+0000 7f9dd759e640 1 --2- 172.21.15.44:0/1427936587 >> [v2:172.21.15.171:6808/938785018,v1:172.21.15.171:6809/938785018] conn(0x7f9dc00adde0 0x7f9dc00b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:10.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:10.227+0000 7f9dd759e640 1 --2- 172.21.15.44:0/1427936587 >> [v2:172.21.15.171:6808/938785018,v1:172.21.15.171:6809/938785018] conn(0x7f9dc00adde0 0x7f9dc00b0280 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:10.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:10.229+0000 7f9dbffff640 1 -- 172.21.15.44:0/1427936587 <== osd.5 v2:172.21.15.171:6808/938785018 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9dc8004470 con 0x7f9dc00adde0 2024-08-19T00:12:10.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:10.243+0000 7f9ddd018640 1 -- 172.21.15.44:0/1427936587 --> [v2:172.21.15.171:6808/938785018,v1:172.21.15.171:6809/938785018] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9dd8062a60 con 0x7f9dc00adde0 2024-08-19T00:12:10.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:10.243+0000 7f9dbffff640 1 -- 172.21.15.44:0/1427936587 <== osd.5 v2:172.21.15.171:6808/938785018 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9dd8062a60 con 0x7f9dc00adde0 2024-08-19T00:12:10.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:10.244+0000 7f9ddd018640 1 -- 172.21.15.44:0/1427936587 >> [v2:172.21.15.171:6808/938785018,v1:172.21.15.171:6809/938785018] conn(0x7f9dc00adde0 msgr2=0x7f9dc00b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:10.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:10.244+0000 7f9ddd018640 1 --2- 172.21.15.44:0/1427936587 >> [v2:172.21.15.171:6808/938785018,v1:172.21.15.171:6809/938785018] conn(0x7f9dc00adde0 0x7f9dc00b0280 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:10.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:10.244+0000 7f9ddd018640 1 -- 172.21.15.44:0/1427936587 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f9dc00a2c10 msgr2=0x7f9dc00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:10.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:10.244+0000 7f9ddd018640 1 --2- 172.21.15.44:0/1427936587 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f9dc00a2c10 0x7f9dc00a50d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc005fd0 tx=0x7f9dcc00b510 comp rx=0 tx=0).stop 2024-08-19T00:12:10.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:10.244+0000 7f9ddd018640 1 -- 172.21.15.44:0/1427936587 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9dd8100b50 msgr2=0x7f9dd80fc9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:10.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:10.244+0000 7f9ddd018640 1 --2- 172.21.15.44:0/1427936587 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9dd8100b50 0x7f9dd80fc9b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9dc800d950 tx=0x7f9dc800de10 comp rx=0 tx=0).stop 2024-08-19T00:12:10.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:10.244+0000 7f9dd759e640 1 -- 172.21.15.44:0/1427936587 reap_dead start 2024-08-19T00:12:10.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:10.244+0000 7f9ddd018640 1 -- 172.21.15.44:0/1427936587 shutdown_connections 2024-08-19T00:12:10.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:10.244+0000 7f9ddd018640 1 -- 172.21.15.44:0/1427936587 >> 172.21.15.44:0/1427936587 conn(0x7f9dd80fc500 msgr2=0x7f9dd8069f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:10.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:10.244+0000 7f9ddd018640 1 -- 172.21.15.44:0/1427936587 shutdown_connections 2024-08-19T00:12:10.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:10.244+0000 7f9ddd018640 1 -- 172.21.15.44:0/1427936587 wait complete. 2024-08-19T00:12:10.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:10 smithi044 ceph-mon[18489]: pgmap v307: 129 pgs: 129 active+clean; 645 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 255 B/s wr, 9 op/s 2024-08-19T00:12:10.722 INFO:teuthology.orchestra.run.smithi044.stdout:335007449117 2024-08-19T00:12:10.723 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-08-19T00:12:10.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:08.974+0000 7f98d5b78640 1 -- 172.21.15.44:0/751306242 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98d01078b0 msgr2=0x7f98d0107c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:10.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:08.974+0000 7f98d5b78640 1 --2- 172.21.15.44:0/751306242 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98d01078b0 0x7f98d0107c90 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f98c0009930 tx=0x7f98c002a420 comp rx=0 tx=0).stop 2024-08-19T00:12:10.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:08.974+0000 7f98d5b78640 1 -- 172.21.15.44:0/751306242 shutdown_connections 2024-08-19T00:12:10.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:08.974+0000 7f98d5b78640 1 --2- 172.21.15.44:0/751306242 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f98d0102250 0x7f98d010e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:10.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:08.975+0000 7f98d5b78640 1 --2- 172.21.15.44:0/751306242 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f98d01018b0 0x7f98d0101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:10.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:08.975+0000 7f98d5b78640 1 --2- 172.21.15.44:0/751306242 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98d01078b0 0x7f98d0107c90 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:10.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:08.975+0000 7f98d5b78640 1 -- 172.21.15.44:0/751306242 >> 172.21.15.44:0/751306242 conn(0x7f98d00fd5f0 msgr2=0x7f98d00ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:10.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:08.975+0000 7f98d5b78640 1 -- 172.21.15.44:0/751306242 shutdown_connections 2024-08-19T00:12:10.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:08.975+0000 7f98d5b78640 1 -- 172.21.15.44:0/751306242 wait complete. 2024-08-19T00:12:10.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:08.975+0000 7f98d5b78640 1 Processor -- start 2024-08-19T00:12:10.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:08.975+0000 7f98d5b78640 1 -- start start 2024-08-19T00:12:10.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:08.975+0000 7f98d5b78640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f98d01018b0 0x7f98d0198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:10.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:08.975+0000 7f98d5b78640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98d0102250 0x7f98d0198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:10.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:08.976+0000 7f98d5b78640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f98d01078b0 0x7f98d019cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:10.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:08.976+0000 7f98d5b78640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f98d0111d50 con 0x7f98d0102250 2024-08-19T00:12:10.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:08.976+0000 7f98d5b78640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f98d0111bd0 con 0x7f98d01078b0 2024-08-19T00:12:10.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:08.976+0000 7f98d5b78640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f98d0111ed0 con 0x7f98d01018b0 2024-08-19T00:12:10.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:08.976+0000 7f98ceffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98d0102250 0x7f98d0198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:10.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:08.976+0000 7f98ceffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98d0102250 0x7f98d0198890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43658/0 (socket says 172.21.15.44:43658) 2024-08-19T00:12:10.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:08.976+0000 7f98ceffd640 1 -- 172.21.15.44:0/3263998360 learned_addr learned my addr 172.21.15.44:0/3263998360 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:12:10.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:08.976+0000 7f98cf7fe640 1 --2- 172.21.15.44:0/3263998360 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f98d01018b0 0x7f98d0198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:10.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:08.976+0000 7f98cffff640 1 --2- 172.21.15.44:0/3263998360 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f98d01078b0 0x7f98d019cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:10.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:08.976+0000 7f98ceffd640 1 -- 172.21.15.44:0/3263998360 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f98d01018b0 msgr2=0x7f98d0198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:10.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:08.976+0000 7f98ceffd640 1 --2- 172.21.15.44:0/3263998360 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f98d01018b0 0x7f98d0198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:10.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:08.976+0000 7f98ceffd640 1 -- 172.21.15.44:0/3263998360 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f98d01078b0 msgr2=0x7f98d019cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:10.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:08.976+0000 7f98ceffd640 1 --2- 172.21.15.44:0/3263998360 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f98d01078b0 0x7f98d019cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:10.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:08.976+0000 7f98ceffd640 1 -- 172.21.15.44:0/3263998360 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98d019d300 con 0x7f98d0102250 2024-08-19T00:12:10.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:08.976+0000 7f98ceffd640 1 --2- 172.21.15.44:0/3263998360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98d0102250 0x7f98d0198890 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f98c400b4a0 tx=0x7f98c400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:10.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:08.976+0000 7f98ccff9640 1 -- 172.21.15.44:0/3263998360 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98c4014070 con 0x7f98d0102250 2024-08-19T00:12:10.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:08.976+0000 7f98d5b78640 1 -- 172.21.15.44:0/3263998360 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98d019d5f0 con 0x7f98d0102250 2024-08-19T00:12:10.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:08.976+0000 7f98ccff9640 1 -- 172.21.15.44:0/3263998360 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98c4010af0 con 0x7f98d0102250 2024-08-19T00:12:10.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:08.976+0000 7f98ccff9640 1 -- 172.21.15.44:0/3263998360 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98c4017d10 con 0x7f98d0102250 2024-08-19T00:12:10.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:08.976+0000 7f98d5b78640 1 -- 172.21.15.44:0/3263998360 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98d01a4ed0 con 0x7f98d0102250 2024-08-19T00:12:10.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:08.977+0000 7f98d5b78640 1 -- 172.21.15.44:0/3263998360 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f98d00626b0 con 0x7f98d0102250 2024-08-19T00:12:10.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:08.978+0000 7f98ccff9640 1 -- 172.21.15.44:0/3263998360 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f98c4017070 con 0x7f98d0102250 2024-08-19T00:12:10.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:08.979+0000 7f98ccff9640 1 --2- 172.21.15.44:0/3263998360 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f98b80a2c10 0x7f98b80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:10.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:08.979+0000 7f98cf7fe640 1 --2- 172.21.15.44:0/3263998360 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f98b80a2c10 0x7f98b80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:10.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:08.979+0000 7f98ccff9640 1 -- 172.21.15.44:0/3263998360 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f98c40cebf0 con 0x7f98d0102250 2024-08-19T00:12:10.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:08.979+0000 7f98ccff9640 1 --2- 172.21.15.44:0/3263998360 >> [v2:172.21.15.171:6800/2130938937,v1:172.21.15.171:6801/2130938937] conn(0x7f98b80adde0 0x7f98b80b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:10.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:08.979+0000 7f98ccff9640 1 -- 172.21.15.44:0/3263998360 --> [v2:172.21.15.171:6800/2130938937,v1:172.21.15.171:6801/2130938937] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f98c400dec0 con 0x7f98b80adde0 2024-08-19T00:12:10.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:08.979+0000 7f98ccff9640 1 -- 172.21.15.44:0/3263998360 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7f98c40cefa0 con 0x7f98d0102250 2024-08-19T00:12:10.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:08.980+0000 7f98cf7fe640 1 --2- 172.21.15.44:0/3263998360 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f98b80a2c10 0x7f98b80a50d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f98c0009900 tx=0x7f98c00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:10.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:08.980+0000 7f98cffff640 1 --2- 172.21.15.44:0/3263998360 >> [v2:172.21.15.171:6800/2130938937,v1:172.21.15.171:6801/2130938937] conn(0x7f98b80adde0 0x7f98b80b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:10.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:08.980+0000 7f98cffff640 1 --2- 172.21.15.44:0/3263998360 >> [v2:172.21.15.171:6800/2130938937,v1:172.21.15.171:6801/2130938937] conn(0x7f98b80adde0 0x7f98b80b0280 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:10.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:08.981+0000 7f98ccff9640 1 -- 172.21.15.44:0/3263998360 <== osd.2 v2:172.21.15.171:6800/2130938937 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f98c400dec0 con 0x7f98b80adde0 2024-08-19T00:12:10.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:08.995+0000 7f98d5b78640 1 -- 172.21.15.44:0/3263998360 --> [v2:172.21.15.171:6800/2130938937,v1:172.21.15.171:6801/2130938937] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f98d0062ab0 con 0x7f98b80adde0 2024-08-19T00:12:10.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:08.996+0000 7f98ccff9640 1 -- 172.21.15.44:0/3263998360 <== osd.2 v2:172.21.15.171:6800/2130938937 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f98d0062ab0 con 0x7f98b80adde0 2024-08-19T00:12:10.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:08.996+0000 7f98d5b78640 1 -- 172.21.15.44:0/3263998360 >> [v2:172.21.15.171:6800/2130938937,v1:172.21.15.171:6801/2130938937] conn(0x7f98b80adde0 msgr2=0x7f98b80b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:10.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:08.996+0000 7f98d5b78640 1 --2- 172.21.15.44:0/3263998360 >> [v2:172.21.15.171:6800/2130938937,v1:172.21.15.171:6801/2130938937] conn(0x7f98b80adde0 0x7f98b80b0280 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:10.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:08.996+0000 7f98d5b78640 1 -- 172.21.15.44:0/3263998360 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f98b80a2c10 msgr2=0x7f98b80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:10.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:08.996+0000 7f98d5b78640 1 --2- 172.21.15.44:0/3263998360 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f98b80a2c10 0x7f98b80a50d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f98c0009900 tx=0x7f98c00058d0 comp rx=0 tx=0).stop 2024-08-19T00:12:10.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:08.996+0000 7f98d5b78640 1 -- 172.21.15.44:0/3263998360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98d0102250 msgr2=0x7f98d0198890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:10.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:08.996+0000 7f98d5b78640 1 --2- 172.21.15.44:0/3263998360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98d0102250 0x7f98d0198890 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f98c400b4a0 tx=0x7f98c400b960 comp rx=0 tx=0).stop 2024-08-19T00:12:10.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:08.996+0000 7f98cffff640 1 -- 172.21.15.44:0/3263998360 reap_dead start 2024-08-19T00:12:10.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:08.996+0000 7f98d5b78640 1 -- 172.21.15.44:0/3263998360 shutdown_connections 2024-08-19T00:12:10.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:08.996+0000 7f98d5b78640 1 -- 172.21.15.44:0/3263998360 >> 172.21.15.44:0/3263998360 conn(0x7f98d00fd5f0 msgr2=0x7f98d00fdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:10.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:08.997+0000 7f98d5b78640 1 -- 172.21.15.44:0/3263998360 shutdown_connections 2024-08-19T00:12:10.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:08.997+0000 7f98d5b78640 1 -- 172.21.15.44:0/3263998360 wait complete. 2024-08-19T00:12:10.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:10 smithi171 ceph-mon[21810]: pgmap v307: 129 pgs: 129 active+clean; 645 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 255 B/s wr, 9 op/s 2024-08-19T00:12:10.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:10 smithi116 ceph-mon[21873]: pgmap v307: 129 pgs: 129 active+clean; 645 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 255 B/s wr, 9 op/s 2024-08-19T00:12:11.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:11.235+0000 7eff22521640 1 -- 172.21.15.44:0/3714608063 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff1c102250 msgr2=0x7eff1c10e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:11.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:11.235+0000 7eff22521640 1 --2- 172.21.15.44:0/3714608063 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff1c102250 0x7eff1c10e780 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7eff14009cd0 tx=0x7eff1402a8e0 comp rx=0 tx=0).stop 2024-08-19T00:12:11.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:11.236+0000 7eff22521640 1 -- 172.21.15.44:0/3714608063 shutdown_connections 2024-08-19T00:12:11.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:11.236+0000 7eff22521640 1 --2- 172.21.15.44:0/3714608063 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff1c102250 0x7eff1c10e780 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:11.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:11.236+0000 7eff22521640 1 --2- 172.21.15.44:0/3714608063 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7eff1c1018b0 0x7eff1c101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:11.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:11.236+0000 7eff22521640 1 --2- 172.21.15.44:0/3714608063 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7eff1c1078b0 0x7eff1c107c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:11.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:11.236+0000 7eff22521640 1 -- 172.21.15.44:0/3714608063 >> 172.21.15.44:0/3714608063 conn(0x7eff1c0fd5f0 msgr2=0x7eff1c0ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:11.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:11.236+0000 7eff22521640 1 -- 172.21.15.44:0/3714608063 shutdown_connections 2024-08-19T00:12:11.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:11.236+0000 7eff22521640 1 -- 172.21.15.44:0/3714608063 wait complete. 2024-08-19T00:12:11.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:11.236+0000 7eff22521640 1 Processor -- start 2024-08-19T00:12:11.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:11.236+0000 7eff22521640 1 -- start start 2024-08-19T00:12:11.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:11.237+0000 7eff22521640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7eff1c1018b0 0x7eff1c1981d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:11.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:11.237+0000 7eff22521640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff1c102250 0x7eff1c198710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:11.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:11.237+0000 7eff22521640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7eff1c1078b0 0x7eff1c19caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:11.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:11.237+0000 7eff22521640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7eff1c111cd0 con 0x7eff1c102250 2024-08-19T00:12:11.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:11.237+0000 7eff22521640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7eff1c111b50 con 0x7eff1c1018b0 2024-08-19T00:12:11.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:11.237+0000 7eff22521640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7eff1c111e50 con 0x7eff1c1078b0 2024-08-19T00:12:11.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:11.237+0000 7eff1b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff1c102250 0x7eff1c198710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:11.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:11.237+0000 7eff1b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff1c102250 0x7eff1c198710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43704/0 (socket says 172.21.15.44:43704) 2024-08-19T00:12:11.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:11.237+0000 7eff1b7fe640 1 -- 172.21.15.44:0/2157291902 learned_addr learned my addr 172.21.15.44:0/2157291902 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:12:11.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:11.237+0000 7eff1b7fe640 1 -- 172.21.15.44:0/2157291902 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7eff1c1078b0 msgr2=0x7eff1c19caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:11.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:11.237+0000 7eff1bfff640 1 --2- 172.21.15.44:0/2157291902 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7eff1c1018b0 0x7eff1c1981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:11.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:11.237+0000 7eff20abe640 1 --2- 172.21.15.44:0/2157291902 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7eff1c1078b0 0x7eff1c19caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:11.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:11.237+0000 7eff1b7fe640 1 --2- 172.21.15.44:0/2157291902 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7eff1c1078b0 0x7eff1c19caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:11.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:11.237+0000 7eff1b7fe640 1 -- 172.21.15.44:0/2157291902 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7eff1c1018b0 msgr2=0x7eff1c1981d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:11.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:11.237+0000 7eff1b7fe640 1 --2- 172.21.15.44:0/2157291902 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7eff1c1018b0 0x7eff1c1981d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:11.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:11.237+0000 7eff1b7fe640 1 -- 172.21.15.44:0/2157291902 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff1c19d180 con 0x7eff1c102250 2024-08-19T00:12:11.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:11.237+0000 7eff1bfff640 1 --2- 172.21.15.44:0/2157291902 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7eff1c1018b0 0x7eff1c1981d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:12:11.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:11.237+0000 7eff1b7fe640 1 --2- 172.21.15.44:0/2157291902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff1c102250 0x7eff1c198710 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7eff1000d950 tx=0x7eff1000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:11.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:11.237+0000 7eff197fa640 1 -- 172.21.15.44:0/2157291902 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff10017030 con 0x7eff1c102250 2024-08-19T00:12:11.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:11.237+0000 7eff197fa640 1 -- 172.21.15.44:0/2157291902 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff10004020 con 0x7eff1c102250 2024-08-19T00:12:11.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:11.237+0000 7eff22521640 1 -- 172.21.15.44:0/2157291902 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff1c19d470 con 0x7eff1c102250 2024-08-19T00:12:11.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:11.237+0000 7eff197fa640 1 -- 172.21.15.44:0/2157291902 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff100047a0 con 0x7eff1c102250 2024-08-19T00:12:11.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:11.238+0000 7eff22521640 1 -- 172.21.15.44:0/2157291902 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff1c1a4d50 con 0x7eff1c102250 2024-08-19T00:12:11.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:11.238+0000 7eff22521640 1 -- 172.21.15.44:0/2157291902 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7eff1c0626b0 con 0x7eff1c102250 2024-08-19T00:12:11.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:11.240+0000 7eff197fa640 1 -- 172.21.15.44:0/2157291902 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7eff100041d0 con 0x7eff1c102250 2024-08-19T00:12:11.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:11.240+0000 7eff197fa640 1 --2- 172.21.15.44:0/2157291902 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7eff040a2c10 0x7eff040a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:11.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:11.240+0000 7eff197fa640 1 -- 172.21.15.44:0/2157291902 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7eff100cf6a0 con 0x7eff1c102250 2024-08-19T00:12:11.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:11.240+0000 7eff1bfff640 1 --2- 172.21.15.44:0/2157291902 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7eff040a2c10 0x7eff040a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:11.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:11.240+0000 7eff197fa640 1 --2- 172.21.15.44:0/2157291902 >> [v2:172.21.15.116:6800/613509556,v1:172.21.15.116:6801/613509556] conn(0x7eff040adde0 0x7eff040b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:11.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:11.240+0000 7eff197fa640 1 -- 172.21.15.44:0/2157291902 --> [v2:172.21.15.116:6800/613509556,v1:172.21.15.116:6801/613509556] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7eff040b0950 con 0x7eff040adde0 2024-08-19T00:12:11.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:11.240+0000 7eff197fa640 1 -- 172.21.15.44:0/2157291902 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7eff100cfaf0 con 0x7eff1c102250 2024-08-19T00:12:11.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:11.241+0000 7eff1bfff640 1 --2- 172.21.15.44:0/2157291902 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7eff040a2c10 0x7eff040a50d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7eff0c006fd0 tx=0x7eff0c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:11.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:11.241+0000 7eff20abe640 1 --2- 172.21.15.44:0/2157291902 >> [v2:172.21.15.116:6800/613509556,v1:172.21.15.116:6801/613509556] conn(0x7eff040adde0 0x7eff040b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:11.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:11.241+0000 7eff20abe640 1 --2- 172.21.15.44:0/2157291902 >> [v2:172.21.15.116:6800/613509556,v1:172.21.15.116:6801/613509556] conn(0x7eff040adde0 0x7eff040b0280 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:11.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:11.242+0000 7eff197fa640 1 -- 172.21.15.44:0/2157291902 <== osd.1 v2:172.21.15.116:6800/613509556 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7eff040b0950 con 0x7eff040adde0 2024-08-19T00:12:11.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:11.255+0000 7eff22521640 1 -- 172.21.15.44:0/2157291902 --> [v2:172.21.15.116:6800/613509556,v1:172.21.15.116:6801/613509556] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7eff1c062b30 con 0x7eff040adde0 2024-08-19T00:12:11.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:11.256+0000 7eff197fa640 1 -- 172.21.15.44:0/2157291902 <== osd.1 v2:172.21.15.116:6800/613509556 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7eff1c062b30 con 0x7eff040adde0 2024-08-19T00:12:11.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:11.256+0000 7eff22521640 1 -- 172.21.15.44:0/2157291902 >> [v2:172.21.15.116:6800/613509556,v1:172.21.15.116:6801/613509556] conn(0x7eff040adde0 msgr2=0x7eff040b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:11.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:11.256+0000 7eff22521640 1 --2- 172.21.15.44:0/2157291902 >> [v2:172.21.15.116:6800/613509556,v1:172.21.15.116:6801/613509556] conn(0x7eff040adde0 0x7eff040b0280 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:11.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:11.256+0000 7eff22521640 1 -- 172.21.15.44:0/2157291902 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7eff040a2c10 msgr2=0x7eff040a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:11.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:11.256+0000 7eff22521640 1 --2- 172.21.15.44:0/2157291902 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7eff040a2c10 0x7eff040a50d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7eff0c006fd0 tx=0x7eff0c008040 comp rx=0 tx=0).stop 2024-08-19T00:12:11.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:11.256+0000 7eff22521640 1 -- 172.21.15.44:0/2157291902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff1c102250 msgr2=0x7eff1c198710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:11.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:11.256+0000 7eff22521640 1 --2- 172.21.15.44:0/2157291902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff1c102250 0x7eff1c198710 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7eff1000d950 tx=0x7eff1000de10 comp rx=0 tx=0).stop 2024-08-19T00:12:11.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:11.256+0000 7eff20abe640 1 -- 172.21.15.44:0/2157291902 reap_dead start 2024-08-19T00:12:11.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:11.257+0000 7eff22521640 1 -- 172.21.15.44:0/2157291902 shutdown_connections 2024-08-19T00:12:11.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:11.257+0000 7eff22521640 1 -- 172.21.15.44:0/2157291902 >> 172.21.15.44:0/2157291902 conn(0x7eff1c0fd5f0 msgr2=0x7eff1c0fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:11.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:11.257+0000 7eff22521640 1 -- 172.21.15.44:0/2157291902 shutdown_connections 2024-08-19T00:12:11.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:11.257+0000 7eff22521640 1 -- 172.21.15.44:0/2157291902 wait complete. 2024-08-19T00:12:12.127 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:12:12.165 INFO:teuthology.orchestra.run.smithi044.stdout:154618822711 2024-08-19T00:12:12.165 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-08-19T00:12:12.631 INFO:teuthology.orchestra.run.smithi044.stdout:55834574922 2024-08-19T00:12:12.631 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-08-19T00:12:12.715 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:12 smithi044 ceph-mon[18489]: pgmap v308: 129 pgs: 129 active+clean; 645 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 11 op/s 2024-08-19T00:12:12.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:12 smithi171 ceph-mon[21810]: pgmap v308: 129 pgs: 129 active+clean; 645 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 11 op/s 2024-08-19T00:12:12.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:12 smithi116 ceph-mon[21873]: pgmap v308: 129 pgs: 129 active+clean; 645 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 11 op/s 2024-08-19T00:12:13.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:13.082+0000 7f2392391640 1 -- 172.21.15.44:0/3761088412 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f238c1067b0 msgr2=0x7f238c106b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:13.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:13.082+0000 7f2392391640 1 --2- 172.21.15.44:0/3761088412 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f238c1067b0 0x7f238c106b90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f237c009930 tx=0x7f237c02a420 comp rx=0 tx=0).stop 2024-08-19T00:12:13.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:13.082+0000 7f2392391640 1 -- 172.21.15.44:0/3761088412 shutdown_connections 2024-08-19T00:12:13.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:13.082+0000 7f2392391640 1 --2- 172.21.15.44:0/3761088412 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f238c101150 0x7f238c10d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:13.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:13.082+0000 7f2392391640 1 --2- 172.21.15.44:0/3761088412 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f238c1007b0 0x7f238c100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:13.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:13.082+0000 7f2392391640 1 --2- 172.21.15.44:0/3761088412 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f238c1067b0 0x7f238c106b90 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:13.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:13.082+0000 7f2392391640 1 -- 172.21.15.44:0/3761088412 >> 172.21.15.44:0/3761088412 conn(0x7f238c0fc4d0 msgr2=0x7f238c0fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:13.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:13.082+0000 7f2392391640 1 -- 172.21.15.44:0/3761088412 shutdown_connections 2024-08-19T00:12:13.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:13.082+0000 7f2392391640 1 -- 172.21.15.44:0/3761088412 wait complete. 2024-08-19T00:12:13.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:13.083+0000 7f2392391640 1 Processor -- start 2024-08-19T00:12:13.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:13.083+0000 7f2392391640 1 -- start start 2024-08-19T00:12:13.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:13.083+0000 7f2392391640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f238c1007b0 0x7f238c0fcb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:13.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:13.083+0000 7f2392391640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f238c101150 0x7f238c0fd090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:13.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:13.083+0000 7f2392391640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f238c1067b0 0x7f238c0fd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:13.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:13.083+0000 7f2392391640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f238c110b70 con 0x7f238c1067b0 2024-08-19T00:12:13.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:13.083+0000 7f2392391640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f238c1109f0 con 0x7f238c1007b0 2024-08-19T00:12:13.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:13.083+0000 7f2392391640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f238c110cf0 con 0x7f238c101150 2024-08-19T00:12:13.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:13.084+0000 7f239092e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f238c1067b0 0x7f238c0fd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:13.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:13.084+0000 7f239092e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f238c1067b0 0x7f238c0fd5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43716/0 (socket says 172.21.15.44:43716) 2024-08-19T00:12:13.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:13.084+0000 7f239092e640 1 -- 172.21.15.44:0/662333990 learned_addr learned my addr 172.21.15.44:0/662333990 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:12:13.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:13.084+0000 7f238b7fe640 1 --2- 172.21.15.44:0/662333990 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f238c101150 0x7f238c0fd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:13.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:13.084+0000 7f238bfff640 1 --2- 172.21.15.44:0/662333990 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f238c1007b0 0x7f238c0fcb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:13.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:13.084+0000 7f239092e640 1 -- 172.21.15.44:0/662333990 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f238c101150 msgr2=0x7f238c0fd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:13.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:13.084+0000 7f239092e640 1 --2- 172.21.15.44:0/662333990 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f238c101150 0x7f238c0fd090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:13.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:13.084+0000 7f239092e640 1 -- 172.21.15.44:0/662333990 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f238c1007b0 msgr2=0x7f238c0fcb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:13.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:13.084+0000 7f239092e640 1 --2- 172.21.15.44:0/662333990 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f238c1007b0 0x7f238c0fcb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:13.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:13.084+0000 7f239092e640 1 -- 172.21.15.44:0/662333990 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f238c1a6630 con 0x7f238c1067b0 2024-08-19T00:12:13.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:13.084+0000 7f238bfff640 1 --2- 172.21.15.44:0/662333990 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f238c1007b0 0x7f238c0fcb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:12:13.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:13.084+0000 7f239092e640 1 --2- 172.21.15.44:0/662333990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f238c1067b0 0x7f238c0fd5d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f238400eaa0 tx=0x7f238400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:13.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:13.084+0000 7f23897fa640 1 -- 172.21.15.44:0/662333990 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f238400cdb0 con 0x7f238c1067b0 2024-08-19T00:12:13.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:13.084+0000 7f23897fa640 1 -- 172.21.15.44:0/662333990 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2384005020 con 0x7f238c1067b0 2024-08-19T00:12:13.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:13.084+0000 7f2392391640 1 -- 172.21.15.44:0/662333990 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f238c1a6920 con 0x7f238c1067b0 2024-08-19T00:12:13.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:13.084+0000 7f23897fa640 1 -- 172.21.15.44:0/662333990 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23840116b0 con 0x7f238c1067b0 2024-08-19T00:12:13.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:13.084+0000 7f2392391640 1 -- 172.21.15.44:0/662333990 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f238c1a6e10 con 0x7f238c1067b0 2024-08-19T00:12:13.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:13.085+0000 7f2392391640 1 -- 172.21.15.44:0/662333990 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f238c100c10 con 0x7f238c1067b0 2024-08-19T00:12:13.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:13.086+0000 7f23897fa640 1 -- 172.21.15.44:0/662333990 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f2384005560 con 0x7f238c1067b0 2024-08-19T00:12:13.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:13.087+0000 7f23897fa640 1 --2- 172.21.15.44:0/662333990 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f23740a2c10 0x7f23740a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:13.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:13.087+0000 7f238bfff640 1 --2- 172.21.15.44:0/662333990 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f23740a2c10 0x7f23740a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:13.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:13.087+0000 7f23897fa640 1 -- 172.21.15.44:0/662333990 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f23840cf850 con 0x7f238c1067b0 2024-08-19T00:12:13.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:13.088+0000 7f238bfff640 1 --2- 172.21.15.44:0/662333990 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f23740a2c10 0x7f23740a50d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f237c000c00 tx=0x7f237c032c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:13.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:13.091+0000 7f23897fa640 1 -- 172.21.15.44:0/662333990 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f2384016030 con 0x7f238c1067b0 2024-08-19T00:12:13.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:13.273+0000 7f2392391640 1 -- 172.21.15.44:0/662333990 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f238c1097a0 con 0x7f238c1067b0 2024-08-19T00:12:13.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:13.273+0000 7f23897fa640 1 -- 172.21.15.44:0/662333990 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f238409c290 con 0x7f238c1067b0 2024-08-19T00:12:13.275 INFO:teuthology.orchestra.run.smithi044.stdout:133143986237 2024-08-19T00:12:13.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:13.275+0000 7f2392391640 1 -- 172.21.15.44:0/662333990 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f23740a2c10 msgr2=0x7f23740a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:13.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:13.275+0000 7f2392391640 1 --2- 172.21.15.44:0/662333990 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f23740a2c10 0x7f23740a50d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f237c000c00 tx=0x7f237c032c70 comp rx=0 tx=0).stop 2024-08-19T00:12:13.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:13.275+0000 7f2392391640 1 -- 172.21.15.44:0/662333990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f238c1067b0 msgr2=0x7f238c0fd5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:13.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:13.275+0000 7f2392391640 1 --2- 172.21.15.44:0/662333990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f238c1067b0 0x7f238c0fd5d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f238400eaa0 tx=0x7f238400ef60 comp rx=0 tx=0).stop 2024-08-19T00:12:13.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:13.275+0000 7f2392391640 1 -- 172.21.15.44:0/662333990 shutdown_connections 2024-08-19T00:12:13.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:13.275+0000 7f2392391640 1 --2- 172.21.15.44:0/662333990 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f23740a2c10 0x7f23740a50d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:13.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:13.275+0000 7f2392391640 1 --2- 172.21.15.44:0/662333990 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f238c101150 0x7f238c0fd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:13.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:13.275+0000 7f2392391640 1 --2- 172.21.15.44:0/662333990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f238c1067b0 0x7f238c0fd5d0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:13.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:13.275+0000 7f2392391640 1 --2- 172.21.15.44:0/662333990 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f238c1007b0 0x7f238c0fcb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:13.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:13.275+0000 7f2392391640 1 -- 172.21.15.44:0/662333990 >> 172.21.15.44:0/662333990 conn(0x7f238c0fc4d0 msgr2=0x7f238c06a760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:13.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:13.275+0000 7f2392391640 1 -- 172.21.15.44:0/662333990 shutdown_connections 2024-08-19T00:12:13.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:13.275+0000 7f2392391640 1 -- 172.21.15.44:0/662333990 wait complete. 2024-08-19T00:12:13.532 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:13 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/662333990' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-08-19T00:12:13.533 INFO:teuthology.orchestra.run.smithi044.stdout:77309411396 2024-08-19T00:12:13.533 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-08-19T00:12:13.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:13 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/662333990' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-08-19T00:12:13.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:13 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/662333990' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-08-19T00:12:14.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:14.182+0000 7fd12f31c640 1 -- 172.21.15.44:0/4057205986 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd1281007b0 msgr2=0x7fd128100c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:14.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:14.182+0000 7fd12f31c640 1 --2- 172.21.15.44:0/4057205986 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd1281007b0 0x7fd128100c10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd118009930 tx=0x7fd11802a420 comp rx=0 tx=0).stop 2024-08-19T00:12:14.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:14.182+0000 7fd12f31c640 1 -- 172.21.15.44:0/4057205986 shutdown_connections 2024-08-19T00:12:14.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:14.182+0000 7fd12f31c640 1 --2- 172.21.15.44:0/4057205986 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd128101150 0x7fd12810d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:14.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:14.182+0000 7fd12f31c640 1 --2- 172.21.15.44:0/4057205986 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd1281007b0 0x7fd128100c10 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:14.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:14.182+0000 7fd12f31c640 1 --2- 172.21.15.44:0/4057205986 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd1281067b0 0x7fd128106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:14.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:14.182+0000 7fd12f31c640 1 -- 172.21.15.44:0/4057205986 >> 172.21.15.44:0/4057205986 conn(0x7fd1280fc4d0 msgr2=0x7fd1280fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:14.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:14.182+0000 7fd12f31c640 1 -- 172.21.15.44:0/4057205986 shutdown_connections 2024-08-19T00:12:14.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:14.182+0000 7fd12f31c640 1 -- 172.21.15.44:0/4057205986 wait complete. 2024-08-19T00:12:14.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:14.183+0000 7fd12f31c640 1 Processor -- start 2024-08-19T00:12:14.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:14.183+0000 7fd12f31c640 1 -- start start 2024-08-19T00:12:14.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:14.183+0000 7fd12f31c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd1281007b0 0x7fd128199150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:14.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:14.183+0000 7fd12f31c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd128101150 0x7fd128199690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:14.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:14.183+0000 7fd12f31c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd1281067b0 0x7fd1281a41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:14.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:14.183+0000 7fd12f31c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd128110ca0 con 0x7fd1281067b0 2024-08-19T00:12:14.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:14.183+0000 7fd12f31c640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fd128110b20 con 0x7fd128101150 2024-08-19T00:12:14.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:14.183+0000 7fd12f31c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd128110e20 con 0x7fd1281007b0 2024-08-19T00:12:14.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:14.183+0000 7fd12d8b9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd1281067b0 0x7fd1281a41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:14.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:14.183+0000 7fd12d8b9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd1281067b0 0x7fd1281a41d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43738/0 (socket says 172.21.15.44:43738) 2024-08-19T00:12:14.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:14.183+0000 7fd12d8b9640 1 -- 172.21.15.44:0/1470323984 learned_addr learned my addr 172.21.15.44:0/1470323984 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:12:14.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:14.184+0000 7fd12c8b7640 1 --2- 172.21.15.44:0/1470323984 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd128101150 0x7fd128199690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:14.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:14.184+0000 7fd12d8b9640 1 -- 172.21.15.44:0/1470323984 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd1281007b0 msgr2=0x7fd128199150 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-19T00:12:14.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:14.184+0000 7fd12d8b9640 1 --2- 172.21.15.44:0/1470323984 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd1281007b0 0x7fd128199150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:14.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:14.184+0000 7fd12d8b9640 1 -- 172.21.15.44:0/1470323984 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd128101150 msgr2=0x7fd128199690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:14.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:14.184+0000 7fd12d8b9640 1 --2- 172.21.15.44:0/1470323984 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd128101150 0x7fd128199690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:14.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:14.184+0000 7fd12d8b9640 1 -- 172.21.15.44:0/1470323984 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1281a4710 con 0x7fd1281067b0 2024-08-19T00:12:14.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:14.184+0000 7fd12d8b9640 1 --2- 172.21.15.44:0/1470323984 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd1281067b0 0x7fd1281a41d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd12000b970 tx=0x7fd12000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:14.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:14.184+0000 7fd11e7fc640 1 -- 172.21.15.44:0/1470323984 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd120019070 con 0x7fd1281067b0 2024-08-19T00:12:14.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:14.184+0000 7fd11e7fc640 1 -- 172.21.15.44:0/1470323984 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd12000cb40 con 0x7fd1281067b0 2024-08-19T00:12:14.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:14.184+0000 7fd12f31c640 1 -- 172.21.15.44:0/1470323984 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1281a48e0 con 0x7fd1281067b0 2024-08-19T00:12:14.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:14.184+0000 7fd11e7fc640 1 -- 172.21.15.44:0/1470323984 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd120007650 con 0x7fd1281067b0 2024-08-19T00:12:14.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:14.184+0000 7fd12f31c640 1 -- 172.21.15.44:0/1470323984 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1281a4da0 con 0x7fd1281067b0 2024-08-19T00:12:14.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:14.185+0000 7fd12f31c640 1 -- 172.21.15.44:0/1470323984 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd128062630 con 0x7fd1281067b0 2024-08-19T00:12:14.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:14.186+0000 7fd11e7fc640 1 -- 172.21.15.44:0/1470323984 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fd12001c070 con 0x7fd1281067b0 2024-08-19T00:12:14.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:14.187+0000 7fd11e7fc640 1 --2- 172.21.15.44:0/1470323984 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fd1140a2c10 0x7fd1140a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:14.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:14.187+0000 7fd12d0b8640 1 --2- 172.21.15.44:0/1470323984 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fd1140a2c10 0x7fd1140a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:14.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:14.187+0000 7fd11e7fc640 1 -- 172.21.15.44:0/1470323984 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fd1200cf210 con 0x7fd1281067b0 2024-08-19T00:12:14.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:14.187+0000 7fd11e7fc640 1 --2- 172.21.15.44:0/1470323984 >> [v2:172.21.15.116:6824/3034738363,v1:172.21.15.116:6825/3034738363] conn(0x7fd1140adde0 0x7fd1140b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:14.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:14.187+0000 7fd11e7fc640 1 -- 172.21.15.44:0/1470323984 --> [v2:172.21.15.116:6824/3034738363,v1:172.21.15.116:6825/3034738363] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd1200047d0 con 0x7fd1140adde0 2024-08-19T00:12:14.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:14.187+0000 7fd11e7fc640 1 -- 172.21.15.44:0/1470323984 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7fd1200cf660 con 0x7fd1281067b0 2024-08-19T00:12:14.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:14.187+0000 7fd12c8b7640 1 --2- 172.21.15.44:0/1470323984 >> [v2:172.21.15.116:6824/3034738363,v1:172.21.15.116:6825/3034738363] conn(0x7fd1140adde0 0x7fd1140b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:14.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:14.187+0000 7fd12d0b8640 1 --2- 172.21.15.44:0/1470323984 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fd1140a2c10 0x7fd1140a50d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd1240096b0 tx=0x7fd124006c20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:14.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:14.188+0000 7fd12c8b7640 1 --2- 172.21.15.44:0/1470323984 >> [v2:172.21.15.116:6824/3034738363,v1:172.21.15.116:6825/3034738363] conn(0x7fd1140adde0 0x7fd1140b0280 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:14.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:14.189+0000 7fd11e7fc640 1 -- 172.21.15.44:0/1470323984 <== osd.10 v2:172.21.15.116:6824/3034738363 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd1200047d0 con 0x7fd1140adde0 2024-08-19T00:12:14.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:14.203+0000 7fd12f31c640 1 -- 172.21.15.44:0/1470323984 --> [v2:172.21.15.116:6824/3034738363,v1:172.21.15.116:6825/3034738363] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd128062ab0 con 0x7fd1140adde0 2024-08-19T00:12:14.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:14.204+0000 7fd11e7fc640 1 -- 172.21.15.44:0/1470323984 <== osd.10 v2:172.21.15.116:6824/3034738363 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd128062ab0 con 0x7fd1140adde0 2024-08-19T00:12:14.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:14.204+0000 7fd12f31c640 1 -- 172.21.15.44:0/1470323984 >> [v2:172.21.15.116:6824/3034738363,v1:172.21.15.116:6825/3034738363] conn(0x7fd1140adde0 msgr2=0x7fd1140b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:14.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:14.204+0000 7fd12f31c640 1 --2- 172.21.15.44:0/1470323984 >> [v2:172.21.15.116:6824/3034738363,v1:172.21.15.116:6825/3034738363] conn(0x7fd1140adde0 0x7fd1140b0280 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:14.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:14.204+0000 7fd12f31c640 1 -- 172.21.15.44:0/1470323984 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fd1140a2c10 msgr2=0x7fd1140a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:14.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:14.204+0000 7fd12f31c640 1 --2- 172.21.15.44:0/1470323984 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fd1140a2c10 0x7fd1140a50d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd1240096b0 tx=0x7fd124006c20 comp rx=0 tx=0).stop 2024-08-19T00:12:14.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:14.204+0000 7fd12f31c640 1 -- 172.21.15.44:0/1470323984 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd1281067b0 msgr2=0x7fd1281a41d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:14.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:14.204+0000 7fd12f31c640 1 --2- 172.21.15.44:0/1470323984 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd1281067b0 0x7fd1281a41d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd12000b970 tx=0x7fd12000be30 comp rx=0 tx=0).stop 2024-08-19T00:12:14.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:14.204+0000 7fd12d8b9640 1 -- 172.21.15.44:0/1470323984 reap_dead start 2024-08-19T00:12:14.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:14.204+0000 7fd12f31c640 1 -- 172.21.15.44:0/1470323984 shutdown_connections 2024-08-19T00:12:14.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:14.204+0000 7fd12f31c640 1 -- 172.21.15.44:0/1470323984 >> 172.21.15.44:0/1470323984 conn(0x7fd1280fc4d0 msgr2=0x7fd1280fcc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:14.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:14.204+0000 7fd12f31c640 1 -- 172.21.15.44:0/1470323984 shutdown_connections 2024-08-19T00:12:14.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:14.205+0000 7fd12f31c640 1 -- 172.21.15.44:0/1470323984 wait complete. 2024-08-19T00:12:14.212 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:12:14.212 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:12:14.212 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:12:14.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:14 smithi171 ceph-mon[21810]: pgmap v309: 129 pgs: 129 active+clean; 645 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-19T00:12:14.853 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:14 smithi044 ceph-mon[18489]: pgmap v309: 129 pgs: 129 active+clean; 645 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-19T00:12:14.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:14 smithi116 ceph-mon[21873]: pgmap v309: 129 pgs: 129 active+clean; 645 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-19T00:12:14.902 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986235 got 133143986237 for osd.4 2024-08-19T00:12:14.902 DEBUG:teuthology.parallel:result is None 2024-08-19T00:12:15.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:15.545+0000 7f42c361f640 1 -- 172.21.15.44:0/1090036439 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42bc1018b0 msgr2=0x7f42bc101d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:15.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:15.545+0000 7f42c361f640 1 --2- 172.21.15.44:0/1090036439 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42bc1018b0 0x7f42bc101d10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f42ac009930 tx=0x7f42ac02a420 comp rx=0 tx=0).stop 2024-08-19T00:12:15.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:15.545+0000 7f42c361f640 1 -- 172.21.15.44:0/1090036439 shutdown_connections 2024-08-19T00:12:15.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:15.545+0000 7f42c361f640 1 --2- 172.21.15.44:0/1090036439 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42bc102250 0x7f42bc10e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:15.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:15.545+0000 7f42c361f640 1 --2- 172.21.15.44:0/1090036439 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42bc1018b0 0x7f42bc101d10 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:15.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:15.545+0000 7f42c361f640 1 --2- 172.21.15.44:0/1090036439 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f42bc1078b0 0x7f42bc107c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:15.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:15.545+0000 7f42c361f640 1 -- 172.21.15.44:0/1090036439 >> 172.21.15.44:0/1090036439 conn(0x7f42bc0fd5f0 msgr2=0x7f42bc0ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:15.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:15.545+0000 7f42c361f640 1 -- 172.21.15.44:0/1090036439 shutdown_connections 2024-08-19T00:12:15.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:15.545+0000 7f42c361f640 1 -- 172.21.15.44:0/1090036439 wait complete. 2024-08-19T00:12:15.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:15.546+0000 7f42c361f640 1 Processor -- start 2024-08-19T00:12:15.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:15.546+0000 7f42c361f640 1 -- start start 2024-08-19T00:12:15.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:15.546+0000 7f42c361f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42bc1018b0 0x7f42bc198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:15.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:15.546+0000 7f42c361f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f42bc102250 0x7f42bc198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:15.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:15.546+0000 7f42c361f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42bc1078b0 0x7f42bc19cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:15.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:15.546+0000 7f42c361f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f42bc111d50 con 0x7f42bc1018b0 2024-08-19T00:12:15.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:15.546+0000 7f42c361f640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f42bc111bd0 con 0x7f42bc1078b0 2024-08-19T00:12:15.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:15.546+0000 7f42c361f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f42bc111ed0 con 0x7f42bc102250 2024-08-19T00:12:15.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:15.546+0000 7f42c13bb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42bc1018b0 0x7f42bc198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:15.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:15.546+0000 7f42c13bb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42bc1018b0 0x7f42bc198330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43760/0 (socket says 172.21.15.44:43760) 2024-08-19T00:12:15.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:15.546+0000 7f42c13bb640 1 -- 172.21.15.44:0/2017166532 learned_addr learned my addr 172.21.15.44:0/2017166532 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:12:15.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:15.546+0000 7f42c0bba640 1 --2- 172.21.15.44:0/2017166532 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f42bc102250 0x7f42bc198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:15.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:15.546+0000 7f42c1bbc640 1 --2- 172.21.15.44:0/2017166532 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42bc1078b0 0x7f42bc19cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:15.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:15.546+0000 7f42c13bb640 1 -- 172.21.15.44:0/2017166532 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f42bc102250 msgr2=0x7f42bc198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:15.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:15.546+0000 7f42c13bb640 1 --2- 172.21.15.44:0/2017166532 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f42bc102250 0x7f42bc198870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:15.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:15.546+0000 7f42c13bb640 1 -- 172.21.15.44:0/2017166532 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42bc1078b0 msgr2=0x7f42bc19cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:15.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:15.546+0000 7f42c13bb640 1 --2- 172.21.15.44:0/2017166532 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42bc1078b0 0x7f42bc19cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:15.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:15.547+0000 7f42c13bb640 1 -- 172.21.15.44:0/2017166532 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42bc19d2e0 con 0x7f42bc1018b0 2024-08-19T00:12:15.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:15.547+0000 7f42c1bbc640 1 --2- 172.21.15.44:0/2017166532 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42bc1078b0 0x7f42bc19cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:12:15.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:15.547+0000 7f42c13bb640 1 --2- 172.21.15.44:0/2017166532 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42bc1018b0 0x7f42bc198330 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f42b800b4a0 tx=0x7f42b800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:15.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:15.547+0000 7f42b27fc640 1 -- 172.21.15.44:0/2017166532 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b8014070 con 0x7f42bc1018b0 2024-08-19T00:12:15.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:15.547+0000 7f42c361f640 1 -- 172.21.15.44:0/2017166532 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42bc19d5d0 con 0x7f42bc1018b0 2024-08-19T00:12:15.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:15.547+0000 7f42b27fc640 1 -- 172.21.15.44:0/2017166532 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f42b8010af0 con 0x7f42bc1018b0 2024-08-19T00:12:15.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:15.547+0000 7f42b27fc640 1 -- 172.21.15.44:0/2017166532 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b8017d10 con 0x7f42bc1018b0 2024-08-19T00:12:15.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:15.547+0000 7f42c361f640 1 -- 172.21.15.44:0/2017166532 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42bc1a4eb0 con 0x7f42bc1018b0 2024-08-19T00:12:15.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:15.548+0000 7f42c361f640 1 -- 172.21.15.44:0/2017166532 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f42bc062670 con 0x7f42bc1018b0 2024-08-19T00:12:15.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:15.549+0000 7f42b27fc640 1 -- 172.21.15.44:0/2017166532 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f42b8017070 con 0x7f42bc1018b0 2024-08-19T00:12:15.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:15.550+0000 7f42b27fc640 1 --2- 172.21.15.44:0/2017166532 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f42a80a2c10 0x7f42a80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:15.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:15.550+0000 7f42b27fc640 1 -- 172.21.15.44:0/2017166532 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f42b80cebc0 con 0x7f42bc1018b0 2024-08-19T00:12:15.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:15.550+0000 7f42c0bba640 1 --2- 172.21.15.44:0/2017166532 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f42a80a2c10 0x7f42a80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:15.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:15.550+0000 7f42b27fc640 1 --2- 172.21.15.44:0/2017166532 >> [v2:172.21.15.116:6816/3861873415,v1:172.21.15.116:6817/3861873415] conn(0x7f42a80adde0 0x7f42a80b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:15.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:15.550+0000 7f42b27fc640 1 -- 172.21.15.44:0/2017166532 --> [v2:172.21.15.116:6816/3861873415,v1:172.21.15.116:6817/3861873415] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f42a80b0950 con 0x7f42a80adde0 2024-08-19T00:12:15.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:15.550+0000 7f42b27fc640 1 -- 172.21.15.44:0/2017166532 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7f42b80cf010 con 0x7f42bc1018b0 2024-08-19T00:12:15.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:15.550+0000 7f42c0bba640 1 --2- 172.21.15.44:0/2017166532 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f42a80a2c10 0x7f42a80a50d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f42ac009900 tx=0x7f42ac0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:15.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:15.550+0000 7f42c1bbc640 1 --2- 172.21.15.44:0/2017166532 >> [v2:172.21.15.116:6816/3861873415,v1:172.21.15.116:6817/3861873415] conn(0x7f42a80adde0 0x7f42a80b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:15.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:15.551+0000 7f42c1bbc640 1 --2- 172.21.15.44:0/2017166532 >> [v2:172.21.15.116:6816/3861873415,v1:172.21.15.116:6817/3861873415] conn(0x7f42a80adde0 0x7f42a80b0280 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:15.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:15.551+0000 7f42b27fc640 1 -- 172.21.15.44:0/2017166532 <== osd.7 v2:172.21.15.116:6816/3861873415 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f42a80b0950 con 0x7f42a80adde0 2024-08-19T00:12:15.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:15.565+0000 7f42c361f640 1 -- 172.21.15.44:0/2017166532 --> [v2:172.21.15.116:6816/3861873415,v1:172.21.15.116:6817/3861873415] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f42bc062af0 con 0x7f42a80adde0 2024-08-19T00:12:15.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:15.566+0000 7f42b27fc640 1 -- 172.21.15.44:0/2017166532 <== osd.7 v2:172.21.15.116:6816/3861873415 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f42bc062af0 con 0x7f42a80adde0 2024-08-19T00:12:15.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:15.566+0000 7f42c361f640 1 -- 172.21.15.44:0/2017166532 >> [v2:172.21.15.116:6816/3861873415,v1:172.21.15.116:6817/3861873415] conn(0x7f42a80adde0 msgr2=0x7f42a80b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:15.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:15.566+0000 7f42c361f640 1 --2- 172.21.15.44:0/2017166532 >> [v2:172.21.15.116:6816/3861873415,v1:172.21.15.116:6817/3861873415] conn(0x7f42a80adde0 0x7f42a80b0280 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:15.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:15.566+0000 7f42c361f640 1 -- 172.21.15.44:0/2017166532 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f42a80a2c10 msgr2=0x7f42a80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:15.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:15.566+0000 7f42c361f640 1 --2- 172.21.15.44:0/2017166532 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f42a80a2c10 0x7f42a80a50d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f42ac009900 tx=0x7f42ac0058d0 comp rx=0 tx=0).stop 2024-08-19T00:12:15.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:15.566+0000 7f42c361f640 1 -- 172.21.15.44:0/2017166532 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42bc1018b0 msgr2=0x7f42bc198330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:15.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:15.566+0000 7f42c361f640 1 --2- 172.21.15.44:0/2017166532 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42bc1018b0 0x7f42bc198330 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f42b800b4a0 tx=0x7f42b800b960 comp rx=0 tx=0).stop 2024-08-19T00:12:15.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:15.566+0000 7f42c1bbc640 1 -- 172.21.15.44:0/2017166532 reap_dead start 2024-08-19T00:12:15.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:15.566+0000 7f42c361f640 1 -- 172.21.15.44:0/2017166532 shutdown_connections 2024-08-19T00:12:15.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:15.566+0000 7f42c361f640 1 -- 172.21.15.44:0/2017166532 >> 172.21.15.44:0/2017166532 conn(0x7f42bc0fd5f0 msgr2=0x7f42bc0fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:15.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:15.566+0000 7f42c361f640 1 -- 172.21.15.44:0/2017166532 shutdown_connections 2024-08-19T00:12:15.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:15.566+0000 7f42c361f640 1 -- 172.21.15.44:0/2017166532 wait complete. 2024-08-19T00:12:16.198 INFO:teuthology.orchestra.run.smithi044.stdout:210453397551 2024-08-19T00:12:16.198 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-08-19T00:12:16.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.369+0000 7f94d2011640 1 -- 172.21.15.44:0/1440515854 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94cc107fc0 msgr2=0x7f94cc10e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:16.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.369+0000 7f94d2011640 1 --2- 172.21.15.44:0/1440515854 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94cc107fc0 0x7f94cc10e960 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f94c4009cd0 tx=0x7f94c402a8e0 comp rx=0 tx=0).stop 2024-08-19T00:12:16.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.369+0000 7f94d2011640 1 -- 172.21.15.44:0/1440515854 shutdown_connections 2024-08-19T00:12:16.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.369+0000 7f94d2011640 1 --2- 172.21.15.44:0/1440515854 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94cc107fc0 0x7f94cc10e960 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:16.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.369+0000 7f94d2011640 1 --2- 172.21.15.44:0/1440515854 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94cc103470 0x7f94cc1078b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:16.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.369+0000 7f94d2011640 1 --2- 172.21.15.44:0/1440515854 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f94cc102ac0 0x7f94cc102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:16.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.369+0000 7f94d2011640 1 -- 172.21.15.44:0/1440515854 >> 172.21.15.44:0/1440515854 conn(0x7f94cc0fc500 msgr2=0x7f94cc0fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:16.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.369+0000 7f94d2011640 1 -- 172.21.15.44:0/1440515854 shutdown_connections 2024-08-19T00:12:16.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.369+0000 7f94d2011640 1 -- 172.21.15.44:0/1440515854 wait complete. 2024-08-19T00:12:16.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.369+0000 7f94d2011640 1 Processor -- start 2024-08-19T00:12:16.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.370+0000 7f94d2011640 1 -- start start 2024-08-19T00:12:16.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.370+0000 7f94d2011640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f94cc102ac0 0x7f94cc1982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:16.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.370+0000 7f94d2011640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94cc103470 0x7f94cc1987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:16.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.370+0000 7f94d2011640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94cc107fc0 0x7f94cc19cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:16.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.370+0000 7f94d2011640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f94cc111e10 con 0x7f94cc107fc0 2024-08-19T00:12:16.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.370+0000 7f94d2011640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f94cc111c90 con 0x7f94cc103470 2024-08-19T00:12:16.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.370+0000 7f94d2011640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f94cc111f90 con 0x7f94cc102ac0 2024-08-19T00:12:16.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.370+0000 7f94cbfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94cc107fc0 0x7f94cc19cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:16.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.370+0000 7f94cbfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94cc107fc0 0x7f94cc19cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43776/0 (socket says 172.21.15.44:43776) 2024-08-19T00:12:16.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.370+0000 7f94cbfff640 1 -- 172.21.15.44:0/3076635875 learned_addr learned my addr 172.21.15.44:0/3076635875 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:12:16.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.370+0000 7f94caffd640 1 --2- 172.21.15.44:0/3076635875 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94cc103470 0x7f94cc1987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:16.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.370+0000 7f94cb7fe640 1 --2- 172.21.15.44:0/3076635875 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f94cc102ac0 0x7f94cc1982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:16.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.370+0000 7f94cbfff640 1 -- 172.21.15.44:0/3076635875 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f94cc102ac0 msgr2=0x7f94cc1982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:16.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.370+0000 7f94cbfff640 1 --2- 172.21.15.44:0/3076635875 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f94cc102ac0 0x7f94cc1982b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:16.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.370+0000 7f94cbfff640 1 -- 172.21.15.44:0/3076635875 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94cc103470 msgr2=0x7f94cc1987f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:16.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.370+0000 7f94cbfff640 1 --2- 172.21.15.44:0/3076635875 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94cc103470 0x7f94cc1987f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:16.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.370+0000 7f94cbfff640 1 -- 172.21.15.44:0/3076635875 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94cc19d260 con 0x7f94cc107fc0 2024-08-19T00:12:16.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.370+0000 7f94caffd640 1 --2- 172.21.15.44:0/3076635875 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94cc103470 0x7f94cc1987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:12:16.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.371+0000 7f94cbfff640 1 --2- 172.21.15.44:0/3076635875 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94cc107fc0 0x7f94cc19cb80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f94c4033040 tx=0x7f94c4003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:16.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.371+0000 7f94c8ff9640 1 -- 172.21.15.44:0/3076635875 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94c4004040 con 0x7f94cc107fc0 2024-08-19T00:12:16.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.371+0000 7f94d2011640 1 -- 172.21.15.44:0/3076635875 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94cc19d4f0 con 0x7f94cc107fc0 2024-08-19T00:12:16.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.371+0000 7f94c8ff9640 1 -- 172.21.15.44:0/3076635875 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94c40046c0 con 0x7f94cc107fc0 2024-08-19T00:12:16.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.371+0000 7f94c8ff9640 1 -- 172.21.15.44:0/3076635875 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94c4046480 con 0x7f94cc107fc0 2024-08-19T00:12:16.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.371+0000 7f94d2011640 1 -- 172.21.15.44:0/3076635875 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94cc1a4e30 con 0x7f94cc107fc0 2024-08-19T00:12:16.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.372+0000 7f94d2011640 1 -- 172.21.15.44:0/3076635875 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94cc06a520 con 0x7f94cc107fc0 2024-08-19T00:12:16.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.373+0000 7f94c8ff9640 1 -- 172.21.15.44:0/3076635875 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f94c40305a0 con 0x7f94cc107fc0 2024-08-19T00:12:16.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.374+0000 7f94c8ff9640 1 --2- 172.21.15.44:0/3076635875 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f94b40a2c10 0x7f94b40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:16.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.374+0000 7f94cb7fe640 1 --2- 172.21.15.44:0/3076635875 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f94b40a2c10 0x7f94b40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:16.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.374+0000 7f94c8ff9640 1 -- 172.21.15.44:0/3076635875 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f94c402e030 con 0x7f94cc107fc0 2024-08-19T00:12:16.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.375+0000 7f94cb7fe640 1 --2- 172.21.15.44:0/3076635875 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f94b40a2c10 0x7f94b40a50d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f94bc005fd0 tx=0x7f94bc005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:16.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.379+0000 7f94c8ff9640 1 -- 172.21.15.44:0/3076635875 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f94c40f2e20 con 0x7f94cc107fc0 2024-08-19T00:12:16.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.567+0000 7f94d2011640 1 -- 172.21.15.44:0/3076635875 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f94cc109fd0 con 0x7f94cc107fc0 2024-08-19T00:12:16.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.567+0000 7f94c8ff9640 1 -- 172.21.15.44:0/3076635875 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f94c404b060 con 0x7f94cc107fc0 2024-08-19T00:12:16.569 INFO:teuthology.orchestra.run.smithi044.stdout:188978561076 2024-08-19T00:12:16.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.569+0000 7f94d2011640 1 -- 172.21.15.44:0/3076635875 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f94b40a2c10 msgr2=0x7f94b40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:16.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.569+0000 7f94d2011640 1 --2- 172.21.15.44:0/3076635875 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f94b40a2c10 0x7f94b40a50d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f94bc005fd0 tx=0x7f94bc005850 comp rx=0 tx=0).stop 2024-08-19T00:12:16.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.569+0000 7f94d2011640 1 -- 172.21.15.44:0/3076635875 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94cc107fc0 msgr2=0x7f94cc19cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:16.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.569+0000 7f94d2011640 1 --2- 172.21.15.44:0/3076635875 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94cc107fc0 0x7f94cc19cb80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f94c4033040 tx=0x7f94c4003970 comp rx=0 tx=0).stop 2024-08-19T00:12:16.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.569+0000 7f94d2011640 1 -- 172.21.15.44:0/3076635875 shutdown_connections 2024-08-19T00:12:16.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.569+0000 7f94d2011640 1 --2- 172.21.15.44:0/3076635875 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f94b40a2c10 0x7f94b40a50d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:16.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.569+0000 7f94d2011640 1 --2- 172.21.15.44:0/3076635875 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94cc107fc0 0x7f94cc19cb80 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:16.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.569+0000 7f94d2011640 1 --2- 172.21.15.44:0/3076635875 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94cc103470 0x7f94cc1987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:16.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.569+0000 7f94d2011640 1 --2- 172.21.15.44:0/3076635875 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f94cc102ac0 0x7f94cc1982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:16.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.569+0000 7f94d2011640 1 -- 172.21.15.44:0/3076635875 >> 172.21.15.44:0/3076635875 conn(0x7f94cc0fc500 msgr2=0x7f94cc1060a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:16.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.570+0000 7f94d2011640 1 -- 172.21.15.44:0/3076635875 shutdown_connections 2024-08-19T00:12:16.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.570+0000 7f94d2011640 1 -- 172.21.15.44:0/3076635875 wait complete. 2024-08-19T00:12:16.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.629+0000 7f62d403a640 1 -- 172.21.15.44:0/3455799224 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62cc1022a0 msgr2=0x7f62cc1026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:16.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.629+0000 7f62d403a640 1 --2- 172.21.15.44:0/3455799224 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62cc1022a0 0x7f62cc1026e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f62c8009900 tx=0x7f62c802a480 comp rx=0 tx=0).stop 2024-08-19T00:12:16.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.630+0000 7f62d403a640 1 -- 172.21.15.44:0/3455799224 shutdown_connections 2024-08-19T00:12:16.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.630+0000 7f62d403a640 1 --2- 172.21.15.44:0/3455799224 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f62cc102c20 0x7f62cc10d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:16.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.630+0000 7f62d403a640 1 --2- 172.21.15.44:0/3455799224 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62cc1022a0 0x7f62cc1026e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:16.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.630+0000 7f62d403a640 1 --2- 172.21.15.44:0/3455799224 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f62cc100b50 0x7f62cc100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:16.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.630+0000 7f62d403a640 1 -- 172.21.15.44:0/3455799224 >> 172.21.15.44:0/3455799224 conn(0x7f62cc0fc500 msgr2=0x7f62cc0fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:16.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.630+0000 7f62d403a640 1 -- 172.21.15.44:0/3455799224 shutdown_connections 2024-08-19T00:12:16.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.630+0000 7f62d403a640 1 -- 172.21.15.44:0/3455799224 wait complete. 2024-08-19T00:12:16.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.630+0000 7f62d403a640 1 Processor -- start 2024-08-19T00:12:16.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.630+0000 7f62d403a640 1 -- start start 2024-08-19T00:12:16.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.630+0000 7f62d403a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62cc100b50 0x7f62cc1971e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:16.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.630+0000 7f62d403a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f62cc1022a0 0x7f62cc197720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:16.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.630+0000 7f62d403a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f62cc102c20 0x7f62cc19bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:16.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.630+0000 7f62d403a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f62cc110d00 con 0x7f62cc100b50 2024-08-19T00:12:16.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.630+0000 7f62d403a640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f62cc110b80 con 0x7f62cc1022a0 2024-08-19T00:12:16.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.630+0000 7f62d403a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f62cc110e80 con 0x7f62cc102c20 2024-08-19T00:12:16.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.631+0000 7f62d1dd6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62cc100b50 0x7f62cc1971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:16.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.631+0000 7f62d1dd6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62cc100b50 0x7f62cc1971e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43792/0 (socket says 172.21.15.44:43792) 2024-08-19T00:12:16.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.631+0000 7f62d1dd6640 1 -- 172.21.15.44:0/1675482333 learned_addr learned my addr 172.21.15.44:0/1675482333 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:12:16.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.631+0000 7f62d25d7640 1 --2- 172.21.15.44:0/1675482333 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f62cc102c20 0x7f62cc19bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:16.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.631+0000 7f62d15d5640 1 --2- 172.21.15.44:0/1675482333 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f62cc1022a0 0x7f62cc197720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:16.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.631+0000 7f62d1dd6640 1 -- 172.21.15.44:0/1675482333 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f62cc102c20 msgr2=0x7f62cc19bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:16.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.631+0000 7f62d1dd6640 1 --2- 172.21.15.44:0/1675482333 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f62cc102c20 0x7f62cc19bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:16.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.631+0000 7f62d1dd6640 1 -- 172.21.15.44:0/1675482333 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f62cc1022a0 msgr2=0x7f62cc197720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:16.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.631+0000 7f62d1dd6640 1 --2- 172.21.15.44:0/1675482333 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f62cc1022a0 0x7f62cc197720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:16.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.631+0000 7f62d1dd6640 1 -- 172.21.15.44:0/1675482333 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62cc19c190 con 0x7f62cc100b50 2024-08-19T00:12:16.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.631+0000 7f62d15d5640 1 --2- 172.21.15.44:0/1675482333 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f62cc1022a0 0x7f62cc197720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:12:16.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.631+0000 7f62d1dd6640 1 --2- 172.21.15.44:0/1675482333 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62cc100b50 0x7f62cc1971e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f62c000cce0 tx=0x7f62c000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:16.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.631+0000 7f62beffd640 1 -- 172.21.15.44:0/1675482333 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c0004b20 con 0x7f62cc100b50 2024-08-19T00:12:16.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.631+0000 7f62beffd640 1 -- 172.21.15.44:0/1675482333 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62c0004cc0 con 0x7f62cc100b50 2024-08-19T00:12:16.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.631+0000 7f62d403a640 1 -- 172.21.15.44:0/1675482333 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62cc19c480 con 0x7f62cc100b50 2024-08-19T00:12:16.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.631+0000 7f62beffd640 1 -- 172.21.15.44:0/1675482333 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c000f8c0 con 0x7f62cc100b50 2024-08-19T00:12:16.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.631+0000 7f62d403a640 1 -- 172.21.15.44:0/1675482333 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62cc1a3d60 con 0x7f62cc100b50 2024-08-19T00:12:16.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.632+0000 7f62d403a640 1 -- 172.21.15.44:0/1675482333 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62cc100f30 con 0x7f62cc100b50 2024-08-19T00:12:16.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.634+0000 7f62beffd640 1 -- 172.21.15.44:0/1675482333 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f62c000fa60 con 0x7f62cc100b50 2024-08-19T00:12:16.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.634+0000 7f62beffd640 1 --2- 172.21.15.44:0/1675482333 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f62b80a2c90 0x7f62b80a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:16.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.635+0000 7f62d15d5640 1 --2- 172.21.15.44:0/1675482333 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f62b80a2c90 0x7f62b80a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:16.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.635+0000 7f62beffd640 1 -- 172.21.15.44:0/1675482333 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f62c00cf610 con 0x7f62cc100b50 2024-08-19T00:12:16.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.635+0000 7f62d15d5640 1 --2- 172.21.15.44:0/1675482333 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f62b80a2c90 0x7f62b80a5150 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f62c8005ab0 tx=0x7f62c8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:16.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.639+0000 7f62beffd640 1 -- 172.21.15.44:0/1675482333 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f62c0014030 con 0x7f62cc100b50 2024-08-19T00:12:16.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.821+0000 7f62d403a640 1 -- 172.21.15.44:0/1675482333 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f62cc198540 con 0x7f62cc100b50 2024-08-19T00:12:16.822 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:16 smithi044 ceph-mon[18489]: pgmap v310: 129 pgs: 129 active+clean; 645 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-08-19T00:12:16.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.821+0000 7f62beffd640 1 -- 172.21.15.44:0/1675482333 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f62c009c0b0 con 0x7f62cc100b50 2024-08-19T00:12:16.823 INFO:teuthology.orchestra.run.smithi044.stdout:103079215169 2024-08-19T00:12:16.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.823+0000 7f62d403a640 1 -- 172.21.15.44:0/1675482333 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f62b80a2c90 msgr2=0x7f62b80a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:16.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.823+0000 7f62d403a640 1 --2- 172.21.15.44:0/1675482333 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f62b80a2c90 0x7f62b80a5150 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f62c8005ab0 tx=0x7f62c8000bc0 comp rx=0 tx=0).stop 2024-08-19T00:12:16.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.823+0000 7f62d403a640 1 -- 172.21.15.44:0/1675482333 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62cc100b50 msgr2=0x7f62cc1971e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:16.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.823+0000 7f62d403a640 1 --2- 172.21.15.44:0/1675482333 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62cc100b50 0x7f62cc1971e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f62c000cce0 tx=0x7f62c000a620 comp rx=0 tx=0).stop 2024-08-19T00:12:16.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.823+0000 7f62d403a640 1 -- 172.21.15.44:0/1675482333 shutdown_connections 2024-08-19T00:12:16.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.823+0000 7f62d403a640 1 --2- 172.21.15.44:0/1675482333 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f62b80a2c90 0x7f62b80a5150 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:16.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.823+0000 7f62d403a640 1 --2- 172.21.15.44:0/1675482333 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f62cc102c20 0x7f62cc19bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:16.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.823+0000 7f62d403a640 1 --2- 172.21.15.44:0/1675482333 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f62cc1022a0 0x7f62cc197720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:16.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.823+0000 7f62d403a640 1 --2- 172.21.15.44:0/1675482333 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62cc100b50 0x7f62cc1971e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:16.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.823+0000 7f62d403a640 1 -- 172.21.15.44:0/1675482333 >> 172.21.15.44:0/1675482333 conn(0x7f62cc0fc500 msgr2=0x7f62cc0fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:16.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.823+0000 7f62d403a640 1 -- 172.21.15.44:0/1675482333 shutdown_connections 2024-08-19T00:12:16.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:16.823+0000 7f62d403a640 1 -- 172.21.15.44:0/1675482333 wait complete. 2024-08-19T00:12:16.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:16 smithi171 ceph-mon[21810]: pgmap v310: 129 pgs: 129 active+clean; 645 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-08-19T00:12:16.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:16 smithi116 ceph-mon[21873]: pgmap v310: 129 pgs: 129 active+clean; 645 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-08-19T00:12:17.289 INFO:tasks.cephadm.ceph_manager.ceph:need seq 188978561075 got 188978561076 for osd.6 2024-08-19T00:12:17.290 DEBUG:teuthology.parallel:result is None 2024-08-19T00:12:17.557 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:17 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/3076635875' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-08-19T00:12:17.557 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:17 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/1675482333' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-08-19T00:12:17.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:17 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/3076635875' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-08-19T00:12:17.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:17 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/1675482333' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-08-19T00:12:17.863 INFO:tasks.cephadm.ceph_manager.ceph:need seq 103079215166 got 103079215169 for osd.3 2024-08-19T00:12:17.863 DEBUG:teuthology.parallel:result is None 2024-08-19T00:12:17.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:17 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/3076635875' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-08-19T00:12:17.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:17 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/1675482333' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-08-19T00:12:17.931 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:12:18.341 INFO:teuthology.orchestra.run.smithi044.stdout:304942678049 2024-08-19T00:12:18.342 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-08-19T00:12:18.614 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:18 smithi044 ceph-mon[18489]: pgmap v311: 129 pgs: 129 active+clean; 645 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-08-19T00:12:18.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:18 smithi171 ceph-mon[21810]: pgmap v311: 129 pgs: 129 active+clean; 645 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-08-19T00:12:18.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:18.827+0000 7f9431a1d640 1 -- 172.21.15.44:0/1332058231 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f942c10beb0 msgr2=0x7f942c10e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:18.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:18.827+0000 7f9431a1d640 1 --2- 172.21.15.44:0/1332058231 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f942c10beb0 0x7f942c10e330 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9424009ca0 tx=0x7f942402a950 comp rx=0 tx=0).stop 2024-08-19T00:12:18.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:18.827+0000 7f9431a1d640 1 -- 172.21.15.44:0/1332058231 shutdown_connections 2024-08-19T00:12:18.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:18.827+0000 7f9431a1d640 1 --2- 172.21.15.44:0/1332058231 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f942c1033f0 0x7f942c10b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:18.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:18.827+0000 7f9431a1d640 1 --2- 172.21.15.44:0/1332058231 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f942c10beb0 0x7f942c10e330 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:18.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:18.827+0000 7f9431a1d640 1 --2- 172.21.15.44:0/1332058231 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f942c102ad0 0x7f942c102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:18.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:18.827+0000 7f9431a1d640 1 -- 172.21.15.44:0/1332058231 >> 172.21.15.44:0/1332058231 conn(0x7f942c0fc4d0 msgr2=0x7f942c0fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:18.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:18.827+0000 7f9431a1d640 1 -- 172.21.15.44:0/1332058231 shutdown_connections 2024-08-19T00:12:18.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:18.827+0000 7f9431a1d640 1 -- 172.21.15.44:0/1332058231 wait complete. 2024-08-19T00:12:18.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:18.828+0000 7f9431a1d640 1 Processor -- start 2024-08-19T00:12:18.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:18.828+0000 7f9431a1d640 1 -- start start 2024-08-19T00:12:18.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:18.828+0000 7f9431a1d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f942c102ad0 0x7f942c100730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:18.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:18.828+0000 7f9431a1d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f942c1033f0 0x7f942c100c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:18.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:18.828+0000 7f9431a1d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f942c10beb0 0x7f942c1011b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:18.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:18.828+0000 7f9431a1d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f942c111d50 con 0x7f942c102ad0 2024-08-19T00:12:18.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:18.828+0000 7f9431a1d640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f942c111bd0 con 0x7f942c10beb0 2024-08-19T00:12:18.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:18.828+0000 7f9431a1d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f942c111ed0 con 0x7f942c1033f0 2024-08-19T00:12:18.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:18.829+0000 7f942affd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f942c102ad0 0x7f942c100730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:18.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:18.829+0000 7f942affd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f942c102ad0 0x7f942c100730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44548/0 (socket says 172.21.15.44:44548) 2024-08-19T00:12:18.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:18.829+0000 7f942affd640 1 -- 172.21.15.44:0/2708508987 learned_addr learned my addr 172.21.15.44:0/2708508987 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:12:18.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:18.829+0000 7f942a7fc640 1 --2- 172.21.15.44:0/2708508987 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f942c1033f0 0x7f942c100c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:18.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:18.829+0000 7f942b7fe640 1 --2- 172.21.15.44:0/2708508987 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f942c10beb0 0x7f942c1011b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:18.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:18.829+0000 7f942affd640 1 -- 172.21.15.44:0/2708508987 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f942c1033f0 msgr2=0x7f942c100c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:18.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:18.829+0000 7f942affd640 1 --2- 172.21.15.44:0/2708508987 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f942c1033f0 0x7f942c100c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:18.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:18.829+0000 7f942affd640 1 -- 172.21.15.44:0/2708508987 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f942c10beb0 msgr2=0x7f942c1011b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:18.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:18.829+0000 7f942affd640 1 --2- 172.21.15.44:0/2708508987 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f942c10beb0 0x7f942c1011b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:18.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:18.829+0000 7f942affd640 1 -- 172.21.15.44:0/2708508987 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f942c1a6710 con 0x7f942c102ad0 2024-08-19T00:12:18.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:18.829+0000 7f942b7fe640 1 --2- 172.21.15.44:0/2708508987 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f942c10beb0 0x7f942c1011b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:12:18.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:18.829+0000 7f942affd640 1 --2- 172.21.15.44:0/2708508987 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f942c102ad0 0x7f942c100730 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f941c00b4a0 tx=0x7f941c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:18.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:18.829+0000 7f9430a1b640 1 -- 172.21.15.44:0/2708508987 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f941c014070 con 0x7f942c102ad0 2024-08-19T00:12:18.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:18.829+0000 7f9430a1b640 1 -- 172.21.15.44:0/2708508987 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f941c010af0 con 0x7f942c102ad0 2024-08-19T00:12:18.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:18.829+0000 7f9431a1d640 1 -- 172.21.15.44:0/2708508987 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f942c1a6a00 con 0x7f942c102ad0 2024-08-19T00:12:18.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:18.829+0000 7f9430a1b640 1 -- 172.21.15.44:0/2708508987 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f941c017d10 con 0x7f942c102ad0 2024-08-19T00:12:18.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:18.829+0000 7f9431a1d640 1 -- 172.21.15.44:0/2708508987 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f942c1a6f40 con 0x7f942c102ad0 2024-08-19T00:12:18.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:18.830+0000 7f9431a1d640 1 -- 172.21.15.44:0/2708508987 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f942c102f30 con 0x7f942c102ad0 2024-08-19T00:12:18.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:18.831+0000 7f9430a1b640 1 -- 172.21.15.44:0/2708508987 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f941c017070 con 0x7f942c102ad0 2024-08-19T00:12:18.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:18.832+0000 7f9430a1b640 1 --2- 172.21.15.44:0/2708508987 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f94140a2c10 0x7f94140a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:18.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:18.832+0000 7f942a7fc640 1 --2- 172.21.15.44:0/2708508987 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f94140a2c10 0x7f94140a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:18.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:18.832+0000 7f9430a1b640 1 -- 172.21.15.44:0/2708508987 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f941c0ce8a0 con 0x7f942c102ad0 2024-08-19T00:12:18.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:18.832+0000 7f942a7fc640 1 --2- 172.21.15.44:0/2708508987 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f94140a2c10 0x7f94140a50d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f942c1021c0 tx=0x7f9420008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:18.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:18.836+0000 7f9430a1b640 1 -- 172.21.15.44:0/2708508987 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f941c09b3f0 con 0x7f942c102ad0 2024-08-19T00:12:18.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:18 smithi116 ceph-mon[21873]: pgmap v311: 129 pgs: 129 active+clean; 645 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-08-19T00:12:18.882 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:12:18.883 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:12:18.916 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:12:19.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.035+0000 7f9431a1d640 1 -- 172.21.15.44:0/2708508987 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f942c106f30 con 0x7f942c102ad0 2024-08-19T00:12:19.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.035+0000 7f9430a1b640 1 -- 172.21.15.44:0/2708508987 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f941c09acf0 con 0x7f942c102ad0 2024-08-19T00:12:19.037 INFO:teuthology.orchestra.run.smithi044.stdout:34359738447 2024-08-19T00:12:19.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.038+0000 7f9431a1d640 1 -- 172.21.15.44:0/2708508987 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f94140a2c10 msgr2=0x7f94140a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:19.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.038+0000 7f9431a1d640 1 --2- 172.21.15.44:0/2708508987 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f94140a2c10 0x7f94140a50d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f942c1021c0 tx=0x7f9420008040 comp rx=0 tx=0).stop 2024-08-19T00:12:19.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.038+0000 7f9431a1d640 1 -- 172.21.15.44:0/2708508987 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f942c102ad0 msgr2=0x7f942c100730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:19.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.038+0000 7f9431a1d640 1 --2- 172.21.15.44:0/2708508987 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f942c102ad0 0x7f942c100730 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f941c00b4a0 tx=0x7f941c00b960 comp rx=0 tx=0).stop 2024-08-19T00:12:19.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.038+0000 7f9431a1d640 1 -- 172.21.15.44:0/2708508987 shutdown_connections 2024-08-19T00:12:19.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.038+0000 7f9431a1d640 1 --2- 172.21.15.44:0/2708508987 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f94140a2c10 0x7f94140a50d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:19.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.038+0000 7f9431a1d640 1 --2- 172.21.15.44:0/2708508987 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f942c1033f0 0x7f942c100c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:19.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.038+0000 7f9431a1d640 1 --2- 172.21.15.44:0/2708508987 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f942c10beb0 0x7f942c1011b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:19.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.038+0000 7f9431a1d640 1 --2- 172.21.15.44:0/2708508987 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f942c102ad0 0x7f942c100730 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:19.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.038+0000 7f9431a1d640 1 -- 172.21.15.44:0/2708508987 >> 172.21.15.44:0/2708508987 conn(0x7f942c0fc4d0 msgr2=0x7f942c0fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:19.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.038+0000 7f9431a1d640 1 -- 172.21.15.44:0/2708508987 shutdown_connections 2024-08-19T00:12:19.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.038+0000 7f9431a1d640 1 -- 172.21.15.44:0/2708508987 wait complete. 2024-08-19T00:12:19.356 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:12:19.357 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:12:19.551 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:19 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/2708508987' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-08-19T00:12:19.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.549+0000 7f518913c640 1 -- 172.21.15.44:0/1020766778 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51841067b0 msgr2=0x7f5184106b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:19.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.549+0000 7f518913c640 1 --2- 172.21.15.44:0/1020766778 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51841067b0 0x7f5184106b90 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f5174009930 tx=0x7f517402a420 comp rx=0 tx=0).stop 2024-08-19T00:12:19.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.549+0000 7f518913c640 1 -- 172.21.15.44:0/1020766778 shutdown_connections 2024-08-19T00:12:19.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.549+0000 7f518913c640 1 --2- 172.21.15.44:0/1020766778 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5184101150 0x7f518410d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:19.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.549+0000 7f518913c640 1 --2- 172.21.15.44:0/1020766778 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f51841007b0 0x7f5184100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:19.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.549+0000 7f518913c640 1 --2- 172.21.15.44:0/1020766778 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51841067b0 0x7f5184106b90 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:19.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.549+0000 7f518913c640 1 -- 172.21.15.44:0/1020766778 >> 172.21.15.44:0/1020766778 conn(0x7f51840fc4d0 msgr2=0x7f51840fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:19.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.549+0000 7f518913c640 1 -- 172.21.15.44:0/1020766778 shutdown_connections 2024-08-19T00:12:19.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.549+0000 7f518913c640 1 -- 172.21.15.44:0/1020766778 wait complete. 2024-08-19T00:12:19.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.550+0000 7f518913c640 1 Processor -- start 2024-08-19T00:12:19.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.550+0000 7f518913c640 1 -- start start 2024-08-19T00:12:19.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.550+0000 7f518913c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f51841007b0 0x7f51841980b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:19.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.550+0000 7f518913c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5184101150 0x7f51841985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:19.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.550+0000 7f518913c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51841067b0 0x7f518419c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:19.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.550+0000 7f518913c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5184110bb0 con 0x7f51841067b0 2024-08-19T00:12:19.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.550+0000 7f518913c640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f5184110a30 con 0x7f5184101150 2024-08-19T00:12:19.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.550+0000 7f518913c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5184110d30 con 0x7f51841007b0 2024-08-19T00:12:19.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.550+0000 7f518359e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51841067b0 0x7f518419c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:19.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.550+0000 7f518359e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51841067b0 0x7f518419c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44558/0 (socket says 172.21.15.44:44558) 2024-08-19T00:12:19.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.550+0000 7f518359e640 1 -- 172.21.15.44:0/344837794 learned_addr learned my addr 172.21.15.44:0/344837794 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:12:19.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.551+0000 7f5182d9d640 1 --2- 172.21.15.44:0/344837794 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f51841007b0 0x7f51841980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:19.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.551+0000 7f517bfff640 1 --2- 172.21.15.44:0/344837794 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5184101150 0x7f51841985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:19.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.551+0000 7f518359e640 1 -- 172.21.15.44:0/344837794 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f51841007b0 msgr2=0x7f51841980b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:19.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.551+0000 7f518359e640 1 --2- 172.21.15.44:0/344837794 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f51841007b0 0x7f51841980b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:19.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.551+0000 7f518359e640 1 -- 172.21.15.44:0/344837794 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5184101150 msgr2=0x7f51841985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:19.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.551+0000 7f518359e640 1 --2- 172.21.15.44:0/344837794 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5184101150 0x7f51841985f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:19.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.551+0000 7f518359e640 1 -- 172.21.15.44:0/344837794 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f518419d060 con 0x7f51841067b0 2024-08-19T00:12:19.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.551+0000 7f5182d9d640 1 --2- 172.21.15.44:0/344837794 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f51841007b0 0x7f51841980b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:12:19.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.551+0000 7f518359e640 1 --2- 172.21.15.44:0/344837794 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51841067b0 0x7f518419c980 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f517c00cce0 tx=0x7f517c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:19.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.551+0000 7f5180d99640 1 -- 172.21.15.44:0/344837794 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517c00f450 con 0x7f51841067b0 2024-08-19T00:12:19.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.551+0000 7f5180d99640 1 -- 172.21.15.44:0/344837794 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f517c00fad0 con 0x7f51841067b0 2024-08-19T00:12:19.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.551+0000 7f518913c640 1 -- 172.21.15.44:0/344837794 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f518419d350 con 0x7f51841067b0 2024-08-19T00:12:19.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.551+0000 7f5180d99640 1 -- 172.21.15.44:0/344837794 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517c018c10 con 0x7f51841067b0 2024-08-19T00:12:19.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.551+0000 7f518913c640 1 -- 172.21.15.44:0/344837794 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51841a4c30 con 0x7f51841067b0 2024-08-19T00:12:19.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.552+0000 7f518913c640 1 -- 172.21.15.44:0/344837794 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5184100c10 con 0x7f51841067b0 2024-08-19T00:12:19.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.553+0000 7f5180d99640 1 -- 172.21.15.44:0/344837794 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f517c00f5f0 con 0x7f51841067b0 2024-08-19T00:12:19.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.554+0000 7f5180d99640 1 --2- 172.21.15.44:0/344837794 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f51700a2c10 0x7f51700a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:19.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.554+0000 7f5182d9d640 1 --2- 172.21.15.44:0/344837794 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f51700a2c10 0x7f51700a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:19.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.554+0000 7f5180d99640 1 -- 172.21.15.44:0/344837794 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f517c0cfb60 con 0x7f51841067b0 2024-08-19T00:12:19.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.554+0000 7f5182d9d640 1 --2- 172.21.15.44:0/344837794 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f51700a2c10 0x7f51700a50d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5174000c00 tx=0x7f5174005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:19.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.558+0000 7f5180d99640 1 -- 172.21.15.44:0/344837794 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f517c014030 con 0x7f51841067b0 2024-08-19T00:12:19.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.740+0000 7f518913c640 1 -- 172.21.15.44:0/344837794 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f51841a4e60 con 0x7f51841067b0 2024-08-19T00:12:19.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.740+0000 7f5180d99640 1 -- 172.21.15.44:0/344837794 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f517c09c600 con 0x7f51841067b0 2024-08-19T00:12:19.742 INFO:teuthology.orchestra.run.smithi044.stdout:279172874280 2024-08-19T00:12:19.743 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:19 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/2708508987' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-08-19T00:12:19.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.742+0000 7f518913c640 1 -- 172.21.15.44:0/344837794 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f51700a2c10 msgr2=0x7f51700a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:19.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.742+0000 7f518913c640 1 --2- 172.21.15.44:0/344837794 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f51700a2c10 0x7f51700a50d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5174000c00 tx=0x7f5174005a20 comp rx=0 tx=0).stop 2024-08-19T00:12:19.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.742+0000 7f518913c640 1 -- 172.21.15.44:0/344837794 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51841067b0 msgr2=0x7f518419c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:19.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.742+0000 7f518913c640 1 --2- 172.21.15.44:0/344837794 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51841067b0 0x7f518419c980 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f517c00cce0 tx=0x7f517c00a620 comp rx=0 tx=0).stop 2024-08-19T00:12:19.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.742+0000 7f518913c640 1 -- 172.21.15.44:0/344837794 shutdown_connections 2024-08-19T00:12:19.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.742+0000 7f518913c640 1 --2- 172.21.15.44:0/344837794 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f51700a2c10 0x7f51700a50d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:19.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.742+0000 7f518913c640 1 --2- 172.21.15.44:0/344837794 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51841067b0 0x7f518419c980 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:19.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.742+0000 7f518913c640 1 --2- 172.21.15.44:0/344837794 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5184101150 0x7f51841985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:19.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.742+0000 7f518913c640 1 --2- 172.21.15.44:0/344837794 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f51841007b0 0x7f51841980b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:19.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.742+0000 7f518913c640 1 -- 172.21.15.44:0/344837794 >> 172.21.15.44:0/344837794 conn(0x7f51840fc4d0 msgr2=0x7f518406a560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:19.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.742+0000 7f518913c640 1 -- 172.21.15.44:0/344837794 shutdown_connections 2024-08-19T00:12:19.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:19.742+0000 7f518913c640 1 -- 172.21.15.44:0/344837794 wait complete. 2024-08-19T00:12:19.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:19 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/2708508987' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-08-19T00:12:20.018 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738444 got 34359738447 for osd.0 2024-08-19T00:12:20.018 DEBUG:teuthology.parallel:result is None 2024-08-19T00:12:20.513 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:20 smithi044 ceph-mon[18489]: pgmap v312: 129 pgs: 129 active+clean; 645 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-19T00:12:20.513 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:20 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/344837794' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-08-19T00:12:20.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:20 smithi171 ceph-mon[21810]: pgmap v312: 129 pgs: 129 active+clean; 645 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-19T00:12:20.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:20 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/344837794' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-08-19T00:12:20.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:20 smithi116 ceph-mon[21873]: pgmap v312: 129 pgs: 129 active+clean; 645 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-19T00:12:20.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:20 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/344837794' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-08-19T00:12:20.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:20.922+0000 7fa67097d640 1 -- 172.21.15.44:0/68378810 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa66c10e230 msgr2=0x7fa66c110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:20.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:20.922+0000 7fa67097d640 1 --2- 172.21.15.44:0/68378810 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa66c10e230 0x7fa66c110640 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa664009900 tx=0x7fa66402a410 comp rx=0 tx=0).stop 2024-08-19T00:12:20.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:20.922+0000 7fa67097d640 1 -- 172.21.15.44:0/68378810 shutdown_connections 2024-08-19T00:12:20.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:20.922+0000 7fa67097d640 1 --2- 172.21.15.44:0/68378810 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa66c101170 0x7fa66c10dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:20.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:20.922+0000 7fa67097d640 1 --2- 172.21.15.44:0/68378810 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa66c10e230 0x7fa66c110640 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:20.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:20.922+0000 7fa67097d640 1 --2- 172.21.15.44:0/68378810 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa66c100850 0x7fa66c100c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:20.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:20.922+0000 7fa67097d640 1 -- 172.21.15.44:0/68378810 >> 172.21.15.44:0/68378810 conn(0x7fa66c0fc500 msgr2=0x7fa66c0fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:20.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:20.922+0000 7fa67097d640 1 -- 172.21.15.44:0/68378810 shutdown_connections 2024-08-19T00:12:20.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:20.922+0000 7fa67097d640 1 -- 172.21.15.44:0/68378810 wait complete. 2024-08-19T00:12:20.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:20.923+0000 7fa67097d640 1 Processor -- start 2024-08-19T00:12:20.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:20.923+0000 7fa67097d640 1 -- start start 2024-08-19T00:12:20.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:20.923+0000 7fa67097d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa66c100850 0x7fa66c19a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:20.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:20.923+0000 7fa67097d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa66c101170 0x7fa66c19aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:20.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:20.923+0000 7fa67097d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa66c10e230 0x7fa66c19edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:20.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:20.923+0000 7fa67097d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa66c114000 con 0x7fa66c100850 2024-08-19T00:12:20.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:20.923+0000 7fa67097d640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fa66c113e80 con 0x7fa66c10e230 2024-08-19T00:12:20.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:20.923+0000 7fa67097d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa66c114180 con 0x7fa66c101170 2024-08-19T00:12:20.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:20.923+0000 7fa66a59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa66c100850 0x7fa66c19a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:20.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:20.923+0000 7fa66a59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa66c100850 0x7fa66c19a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44584/0 (socket says 172.21.15.44:44584) 2024-08-19T00:12:20.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:20.923+0000 7fa66a59c640 1 -- 172.21.15.44:0/392749964 learned_addr learned my addr 172.21.15.44:0/392749964 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:12:20.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:20.923+0000 7fa66ad9d640 1 --2- 172.21.15.44:0/392749964 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa66c10e230 0x7fa66c19edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:20.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:20.923+0000 7fa669d9b640 1 --2- 172.21.15.44:0/392749964 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa66c101170 0x7fa66c19aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:20.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:20.923+0000 7fa66a59c640 1 -- 172.21.15.44:0/392749964 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa66c101170 msgr2=0x7fa66c19aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:20.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:20.923+0000 7fa66a59c640 1 --2- 172.21.15.44:0/392749964 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa66c101170 0x7fa66c19aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:20.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:20.923+0000 7fa66a59c640 1 -- 172.21.15.44:0/392749964 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa66c10e230 msgr2=0x7fa66c19edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:20.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:20.923+0000 7fa66a59c640 1 --2- 172.21.15.44:0/392749964 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa66c10e230 0x7fa66c19edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:20.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:20.923+0000 7fa66a59c640 1 -- 172.21.15.44:0/392749964 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa66c19f4a0 con 0x7fa66c100850 2024-08-19T00:12:20.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:20.923+0000 7fa669d9b640 1 --2- 172.21.15.44:0/392749964 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa66c101170 0x7fa66c19aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:12:20.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:20.924+0000 7fa66a59c640 1 --2- 172.21.15.44:0/392749964 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa66c100850 0x7fa66c19a4f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa65c00cce0 tx=0x7fa65c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:20.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:20.924+0000 7fa65b7fe640 1 -- 172.21.15.44:0/392749964 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa65c004b20 con 0x7fa66c100850 2024-08-19T00:12:20.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:20.924+0000 7fa67097d640 1 -- 172.21.15.44:0/392749964 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa66c19f790 con 0x7fa66c100850 2024-08-19T00:12:20.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:20.924+0000 7fa65b7fe640 1 -- 172.21.15.44:0/392749964 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa65c004cc0 con 0x7fa66c100850 2024-08-19T00:12:20.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:20.924+0000 7fa65b7fe640 1 -- 172.21.15.44:0/392749964 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa65c00f7d0 con 0x7fa66c100850 2024-08-19T00:12:20.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:20.924+0000 7fa67097d640 1 -- 172.21.15.44:0/392749964 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa66c1a7070 con 0x7fa66c100850 2024-08-19T00:12:20.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:20.925+0000 7fa67097d640 1 -- 172.21.15.44:0/392749964 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa66c100c30 con 0x7fa66c100850 2024-08-19T00:12:20.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:20.926+0000 7fa65b7fe640 1 -- 172.21.15.44:0/392749964 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa65c00f970 con 0x7fa66c100850 2024-08-19T00:12:20.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:20.927+0000 7fa65b7fe640 1 --2- 172.21.15.44:0/392749964 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fa6540a2c10 0x7fa6540a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:20.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:20.927+0000 7fa669d9b640 1 --2- 172.21.15.44:0/392749964 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fa6540a2c10 0x7fa6540a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:20.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:20.927+0000 7fa65b7fe640 1 -- 172.21.15.44:0/392749964 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fa65c0cf600 con 0x7fa66c100850 2024-08-19T00:12:20.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:20.927+0000 7fa669d9b640 1 --2- 172.21.15.44:0/392749964 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fa6540a2c10 0x7fa6540a50d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa660006fd0 tx=0x7fa660008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:20.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:20.931+0000 7fa65b7fe640 1 -- 172.21.15.44:0/392749964 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fa65c014030 con 0x7fa66c100850 2024-08-19T00:12:21.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:21.110+0000 7fa67097d640 1 -- 172.21.15.44:0/392749964 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7fa66c109330 con 0x7fa66c100850 2024-08-19T00:12:21.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:21.111+0000 7fa65b7fe640 1 -- 172.21.15.44:0/392749964 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fa65c09c0a0 con 0x7fa66c100850 2024-08-19T00:12:21.112 INFO:teuthology.orchestra.run.smithi044.stdout:244813135915 2024-08-19T00:12:21.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:21.113+0000 7fa67097d640 1 -- 172.21.15.44:0/392749964 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fa6540a2c10 msgr2=0x7fa6540a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:21.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:21.113+0000 7fa67097d640 1 --2- 172.21.15.44:0/392749964 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fa6540a2c10 0x7fa6540a50d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa660006fd0 tx=0x7fa660008040 comp rx=0 tx=0).stop 2024-08-19T00:12:21.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:21.113+0000 7fa67097d640 1 -- 172.21.15.44:0/392749964 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa66c100850 msgr2=0x7fa66c19a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:21.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:21.113+0000 7fa67097d640 1 --2- 172.21.15.44:0/392749964 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa66c100850 0x7fa66c19a4f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa65c00cce0 tx=0x7fa65c00a620 comp rx=0 tx=0).stop 2024-08-19T00:12:21.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:21.113+0000 7fa67097d640 1 -- 172.21.15.44:0/392749964 shutdown_connections 2024-08-19T00:12:21.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:21.113+0000 7fa67097d640 1 --2- 172.21.15.44:0/392749964 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fa6540a2c10 0x7fa6540a50d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:21.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:21.113+0000 7fa67097d640 1 --2- 172.21.15.44:0/392749964 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa66c101170 0x7fa66c19aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:21.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:21.113+0000 7fa67097d640 1 --2- 172.21.15.44:0/392749964 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa66c10e230 0x7fa66c19edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:21.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:21.113+0000 7fa67097d640 1 --2- 172.21.15.44:0/392749964 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa66c100850 0x7fa66c19a4f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:21.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:21.113+0000 7fa67097d640 1 -- 172.21.15.44:0/392749964 >> 172.21.15.44:0/392749964 conn(0x7fa66c0fc500 msgr2=0x7fa66c0fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:21.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:21.113+0000 7fa67097d640 1 -- 172.21.15.44:0/392749964 shutdown_connections 2024-08-19T00:12:21.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:21.113+0000 7fa67097d640 1 -- 172.21.15.44:0/392749964 wait complete. 2024-08-19T00:12:21.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:21 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/392749964' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-08-19T00:12:21.767 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:21 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/392749964' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-08-19T00:12:21.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:21 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/392749964' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-08-19T00:12:21.972 INFO:tasks.cephadm.ceph_manager.ceph:need seq 244813135914 got 244813135915 for osd.8 2024-08-19T00:12:21.972 DEBUG:teuthology.parallel:result is None 2024-08-19T00:12:22.463 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:22 smithi044 ceph-mon[18489]: pgmap v313: 129 pgs: 129 active+clean; 645 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-08-19T00:12:22.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.461+0000 7fe1c3c4e640 1 -- 172.21.15.44:0/297869529 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1bc102a70 msgr2=0x7fe1bc102e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:22.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.461+0000 7fe1c3c4e640 1 --2- 172.21.15.44:0/297869529 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1bc102a70 0x7fe1bc102e50 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe1b8009900 tx=0x7fe1b802a480 comp rx=0 tx=0).stop 2024-08-19T00:12:22.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.461+0000 7fe1c3c4e640 1 -- 172.21.15.44:0/297869529 shutdown_connections 2024-08-19T00:12:22.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.461+0000 7fe1c3c4e640 1 --2- 172.21.15.44:0/297869529 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe1bc10bea0 0x7fe1bc10e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:22.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.461+0000 7fe1c3c4e640 1 --2- 172.21.15.44:0/297869529 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe1bc103390 0x7fe1bc10b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:22.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.461+0000 7fe1c3c4e640 1 --2- 172.21.15.44:0/297869529 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1bc102a70 0x7fe1bc102e50 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:22.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.461+0000 7fe1c3c4e640 1 -- 172.21.15.44:0/297869529 >> 172.21.15.44:0/297869529 conn(0x7fe1bc0fc4d0 msgr2=0x7fe1bc0fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:22.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.462+0000 7fe1c3c4e640 1 -- 172.21.15.44:0/297869529 shutdown_connections 2024-08-19T00:12:22.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.462+0000 7fe1c3c4e640 1 -- 172.21.15.44:0/297869529 wait complete. 2024-08-19T00:12:22.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.462+0000 7fe1c3c4e640 1 Processor -- start 2024-08-19T00:12:22.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.462+0000 7fe1c3c4e640 1 -- start start 2024-08-19T00:12:22.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.463+0000 7fe1c3c4e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe1bc102a70 0x7fe1bc198160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:22.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.463+0000 7fe1c3c4e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1bc103390 0x7fe1bc1986a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:22.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.463+0000 7fe1c3c4e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe1bc10bea0 0x7fe1bc19ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:22.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.463+0000 7fe1c3c4e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe1bc111ca0 con 0x7fe1bc103390 2024-08-19T00:12:22.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.463+0000 7fe1c3c4e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fe1bc111b20 con 0x7fe1bc102a70 2024-08-19T00:12:22.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.463+0000 7fe1c3c4e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe1bc111e20 con 0x7fe1bc10bea0 2024-08-19T00:12:22.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.463+0000 7fe1c11e9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1bc103390 0x7fe1bc1986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:22.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.463+0000 7fe1c11e9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1bc103390 0x7fe1bc1986a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44604/0 (socket says 172.21.15.44:44604) 2024-08-19T00:12:22.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.463+0000 7fe1c11e9640 1 -- 172.21.15.44:0/1881355827 learned_addr learned my addr 172.21.15.44:0/1881355827 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:12:22.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.463+0000 7fe1c21eb640 1 --2- 172.21.15.44:0/1881355827 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe1bc10bea0 0x7fe1bc19ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:22.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.463+0000 7fe1c19ea640 1 --2- 172.21.15.44:0/1881355827 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe1bc102a70 0x7fe1bc198160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:22.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.463+0000 7fe1c11e9640 1 -- 172.21.15.44:0/1881355827 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe1bc10bea0 msgr2=0x7fe1bc19ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:22.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.463+0000 7fe1c11e9640 1 --2- 172.21.15.44:0/1881355827 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe1bc10bea0 0x7fe1bc19ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:22.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.463+0000 7fe1c11e9640 1 -- 172.21.15.44:0/1881355827 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe1bc102a70 msgr2=0x7fe1bc198160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:22.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.463+0000 7fe1c11e9640 1 --2- 172.21.15.44:0/1881355827 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe1bc102a70 0x7fe1bc198160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:22.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.463+0000 7fe1c11e9640 1 -- 172.21.15.44:0/1881355827 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1bc19d110 con 0x7fe1bc103390 2024-08-19T00:12:22.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.463+0000 7fe1c11e9640 1 --2- 172.21.15.44:0/1881355827 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1bc103390 0x7fe1bc1986a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac00e9f0 tx=0x7fe1ac00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:22.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.463+0000 7fe1b2ffd640 1 -- 172.21.15.44:0/1881355827 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1ac00ccc0 con 0x7fe1bc103390 2024-08-19T00:12:22.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.464+0000 7fe1b2ffd640 1 -- 172.21.15.44:0/1881355827 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe1ac010910 con 0x7fe1bc103390 2024-08-19T00:12:22.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.464+0000 7fe1b2ffd640 1 -- 172.21.15.44:0/1881355827 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1ac018920 con 0x7fe1bc103390 2024-08-19T00:12:22.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.464+0000 7fe1c3c4e640 1 -- 172.21.15.44:0/1881355827 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1bc19d400 con 0x7fe1bc103390 2024-08-19T00:12:22.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.464+0000 7fe1c3c4e640 1 -- 172.21.15.44:0/1881355827 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1bc1a4ce0 con 0x7fe1bc103390 2024-08-19T00:12:22.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.465+0000 7fe1c3c4e640 1 -- 172.21.15.44:0/1881355827 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1bc102e50 con 0x7fe1bc103390 2024-08-19T00:12:22.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.466+0000 7fe1b2ffd640 1 -- 172.21.15.44:0/1881355827 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fe1ac010430 con 0x7fe1bc103390 2024-08-19T00:12:22.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.466+0000 7fe1b2ffd640 1 --2- 172.21.15.44:0/1881355827 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fe1a80a2c10 0x7fe1a80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:22.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.467+0000 7fe1c19ea640 1 --2- 172.21.15.44:0/1881355827 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fe1a80a2c10 0x7fe1a80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:22.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.467+0000 7fe1b2ffd640 1 -- 172.21.15.44:0/1881355827 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fe1ac0cfc60 con 0x7fe1bc103390 2024-08-19T00:12:22.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.467+0000 7fe1c19ea640 1 --2- 172.21.15.44:0/1881355827 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fe1a80a2c10 0x7fe1a80a50d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe1b8009230 tx=0x7fe1b80058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:22.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.470+0000 7fe1b2ffd640 1 -- 172.21.15.44:0/1881355827 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fe1ac09c0b0 con 0x7fe1bc103390 2024-08-19T00:12:22.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.649+0000 7fe1c3c4e640 1 -- 172.21.15.44:0/1881355827 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7fe1bc02d5e0 con 0x7fe1bc103390 2024-08-19T00:12:22.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.649+0000 7fe1b2ffd640 1 -- 172.21.15.44:0/1881355827 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fe1ac0a03b0 con 0x7fe1bc103390 2024-08-19T00:12:22.651 INFO:teuthology.orchestra.run.smithi044.stdout:335007449119 2024-08-19T00:12:22.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.651+0000 7fe1c3c4e640 1 -- 172.21.15.44:0/1881355827 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fe1a80a2c10 msgr2=0x7fe1a80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:22.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.651+0000 7fe1c3c4e640 1 --2- 172.21.15.44:0/1881355827 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fe1a80a2c10 0x7fe1a80a50d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe1b8009230 tx=0x7fe1b80058d0 comp rx=0 tx=0).stop 2024-08-19T00:12:22.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.651+0000 7fe1c3c4e640 1 -- 172.21.15.44:0/1881355827 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1bc103390 msgr2=0x7fe1bc1986a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:22.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.651+0000 7fe1c3c4e640 1 --2- 172.21.15.44:0/1881355827 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1bc103390 0x7fe1bc1986a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac00e9f0 tx=0x7fe1ac00eeb0 comp rx=0 tx=0).stop 2024-08-19T00:12:22.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.651+0000 7fe1c3c4e640 1 -- 172.21.15.44:0/1881355827 shutdown_connections 2024-08-19T00:12:22.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.651+0000 7fe1c3c4e640 1 --2- 172.21.15.44:0/1881355827 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fe1a80a2c10 0x7fe1a80a50d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:22.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.651+0000 7fe1c3c4e640 1 --2- 172.21.15.44:0/1881355827 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe1bc10bea0 0x7fe1bc19ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:22.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.651+0000 7fe1c3c4e640 1 --2- 172.21.15.44:0/1881355827 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1bc103390 0x7fe1bc1986a0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:22.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.651+0000 7fe1c3c4e640 1 --2- 172.21.15.44:0/1881355827 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe1bc102a70 0x7fe1bc198160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:22.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.651+0000 7fe1c3c4e640 1 -- 172.21.15.44:0/1881355827 >> 172.21.15.44:0/1881355827 conn(0x7fe1bc0fc4d0 msgr2=0x7fe1bc0fdbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:22.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.652+0000 7fe1c3c4e640 1 -- 172.21.15.44:0/1881355827 shutdown_connections 2024-08-19T00:12:22.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.652+0000 7fe1c3c4e640 1 -- 172.21.15.44:0/1881355827 wait complete. 2024-08-19T00:12:22.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.697+0000 7f6dd22f5640 1 -- 172.21.15.44:0/1661217329 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6dcc1009f0 msgr2=0x7f6dcc106530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:22.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.697+0000 7f6dd22f5640 1 --2- 172.21.15.44:0/1661217329 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6dcc1009f0 0x7f6dcc106530 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6dc0009900 tx=0x7f6dc002a410 comp rx=0 tx=0).stop 2024-08-19T00:12:22.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.697+0000 7f6dd22f5640 1 -- 172.21.15.44:0/1661217329 shutdown_connections 2024-08-19T00:12:22.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.697+0000 7f6dd22f5640 1 --2- 172.21.15.44:0/1661217329 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6dcc106c60 0x7f6dcc10e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:22.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.697+0000 7f6dd22f5640 1 --2- 172.21.15.44:0/1661217329 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6dcc1009f0 0x7f6dcc106530 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:22.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.697+0000 7f6dd22f5640 1 --2- 172.21.15.44:0/1661217329 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6dcc100040 0x7f6dcc100420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:22.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.697+0000 7f6dd22f5640 1 -- 172.21.15.44:0/1661217329 >> 172.21.15.44:0/1661217329 conn(0x7f6dcc076f40 msgr2=0x7f6dcc0fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:22.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.697+0000 7f6dd22f5640 1 -- 172.21.15.44:0/1661217329 shutdown_connections 2024-08-19T00:12:22.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.697+0000 7f6dd22f5640 1 -- 172.21.15.44:0/1661217329 wait complete. 2024-08-19T00:12:22.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.698+0000 7f6dd22f5640 1 Processor -- start 2024-08-19T00:12:22.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.698+0000 7f6dd22f5640 1 -- start start 2024-08-19T00:12:22.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.698+0000 7f6dd22f5640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6dcc100040 0x7f6dcc198120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:22.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.698+0000 7f6dd22f5640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6dcc1009f0 0x7f6dcc198660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:22.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.698+0000 7f6dd22f5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6dcc106c60 0x7f6dcc19c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:22.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.698+0000 7f6dd22f5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6dcc111cc0 con 0x7f6dcc106c60 2024-08-19T00:12:22.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.698+0000 7f6dd22f5640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f6dcc111b40 con 0x7f6dcc1009f0 2024-08-19T00:12:22.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.698+0000 7f6dd22f5640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6dcc111e40 con 0x7f6dcc100040 2024-08-19T00:12:22.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.698+0000 7f6dd0892640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6dcc106c60 0x7f6dcc19c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:22.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.698+0000 7f6dd0892640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6dcc106c60 0x7f6dcc19c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44620/0 (socket says 172.21.15.44:44620) 2024-08-19T00:12:22.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.698+0000 7f6dd0892640 1 -- 172.21.15.44:0/3395999686 learned_addr learned my addr 172.21.15.44:0/3395999686 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:12:22.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.698+0000 7f6dcb7fe640 1 --2- 172.21.15.44:0/3395999686 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6dcc1009f0 0x7f6dcc198660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:22.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.698+0000 7f6dcbfff640 1 --2- 172.21.15.44:0/3395999686 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6dcc100040 0x7f6dcc198120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:22.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.699+0000 7f6dd0892640 1 -- 172.21.15.44:0/3395999686 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6dcc100040 msgr2=0x7f6dcc198120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:22.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.699+0000 7f6dd0892640 1 --2- 172.21.15.44:0/3395999686 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6dcc100040 0x7f6dcc198120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:22.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.699+0000 7f6dd0892640 1 -- 172.21.15.44:0/3395999686 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6dcc1009f0 msgr2=0x7f6dcc198660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:22.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.699+0000 7f6dd0892640 1 --2- 172.21.15.44:0/3395999686 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6dcc1009f0 0x7f6dcc198660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:22.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.699+0000 7f6dd0892640 1 -- 172.21.15.44:0/3395999686 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dcc19d0d0 con 0x7f6dcc106c60 2024-08-19T00:12:22.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.699+0000 7f6dd0892640 1 --2- 172.21.15.44:0/3395999686 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6dcc106c60 0x7f6dcc19c9f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6dc400cce0 tx=0x7f6dc400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:22.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.699+0000 7f6dc97fa640 1 -- 172.21.15.44:0/3395999686 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc400f450 con 0x7f6dcc106c60 2024-08-19T00:12:22.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.699+0000 7f6dd22f5640 1 -- 172.21.15.44:0/3395999686 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dcc19d3c0 con 0x7f6dcc106c60 2024-08-19T00:12:22.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.699+0000 7f6dc97fa640 1 -- 172.21.15.44:0/3395999686 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6dc400fad0 con 0x7f6dcc106c60 2024-08-19T00:12:22.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.699+0000 7f6dc97fa640 1 -- 172.21.15.44:0/3395999686 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc4018c10 con 0x7f6dcc106c60 2024-08-19T00:12:22.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.699+0000 7f6dd22f5640 1 -- 172.21.15.44:0/3395999686 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dcc1a4ca0 con 0x7f6dcc106c60 2024-08-19T00:12:22.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.700+0000 7f6dd22f5640 1 -- 172.21.15.44:0/3395999686 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dcc100420 con 0x7f6dcc106c60 2024-08-19T00:12:22.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.701+0000 7f6dc97fa640 1 -- 172.21.15.44:0/3395999686 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f6dc400f5f0 con 0x7f6dcc106c60 2024-08-19T00:12:22.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.702+0000 7f6dc97fa640 1 --2- 172.21.15.44:0/3395999686 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f6db40a2c10 0x7f6db40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:22.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.702+0000 7f6dcbfff640 1 --2- 172.21.15.44:0/3395999686 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f6db40a2c10 0x7f6db40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:22.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.702+0000 7f6dc97fa640 1 -- 172.21.15.44:0/3395999686 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f6dc40cfbe0 con 0x7f6dcc106c60 2024-08-19T00:12:22.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.702+0000 7f6dcbfff640 1 --2- 172.21.15.44:0/3395999686 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f6db40a2c10 0x7f6db40a50d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc005fd0 tx=0x7f6dbc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:22.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.705+0000 7f6dc97fa640 1 -- 172.21.15.44:0/3395999686 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f6dc4014030 con 0x7f6dcc106c60 2024-08-19T00:12:22.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:22 smithi171 ceph-mon[21810]: pgmap v313: 129 pgs: 129 active+clean; 645 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-08-19T00:12:22.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:22 smithi116 ceph-mon[21873]: pgmap v313: 129 pgs: 129 active+clean; 645 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-08-19T00:12:22.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.884+0000 7f6dd22f5640 1 -- 172.21.15.44:0/3395999686 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f6dcc109910 con 0x7f6dcc106c60 2024-08-19T00:12:22.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.885+0000 7f6dc97fa640 1 -- 172.21.15.44:0/3395999686 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6dc409c6b0 con 0x7f6dcc106c60 2024-08-19T00:12:22.886 INFO:teuthology.orchestra.run.smithi044.stdout:55834574924 2024-08-19T00:12:22.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.887+0000 7f6dd22f5640 1 -- 172.21.15.44:0/3395999686 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f6db40a2c10 msgr2=0x7f6db40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:22.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.887+0000 7f6dd22f5640 1 --2- 172.21.15.44:0/3395999686 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f6db40a2c10 0x7f6db40a50d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc005fd0 tx=0x7f6dbc00b390 comp rx=0 tx=0).stop 2024-08-19T00:12:22.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.887+0000 7f6dd22f5640 1 -- 172.21.15.44:0/3395999686 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6dcc106c60 msgr2=0x7f6dcc19c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:22.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.887+0000 7f6dd22f5640 1 --2- 172.21.15.44:0/3395999686 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6dcc106c60 0x7f6dcc19c9f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6dc400cce0 tx=0x7f6dc400a620 comp rx=0 tx=0).stop 2024-08-19T00:12:22.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.887+0000 7f6dd22f5640 1 -- 172.21.15.44:0/3395999686 shutdown_connections 2024-08-19T00:12:22.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.887+0000 7f6dd22f5640 1 --2- 172.21.15.44:0/3395999686 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f6db40a2c10 0x7f6db40a50d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:22.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.887+0000 7f6dd22f5640 1 --2- 172.21.15.44:0/3395999686 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6dcc106c60 0x7f6dcc19c9f0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:22.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.887+0000 7f6dd22f5640 1 --2- 172.21.15.44:0/3395999686 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6dcc1009f0 0x7f6dcc198660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:22.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.887+0000 7f6dd22f5640 1 --2- 172.21.15.44:0/3395999686 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6dcc100040 0x7f6dcc198120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:22.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.887+0000 7f6dd22f5640 1 -- 172.21.15.44:0/3395999686 >> 172.21.15.44:0/3395999686 conn(0x7f6dcc076f40 msgr2=0x7f6dcc105470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:22.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.887+0000 7f6dd22f5640 1 -- 172.21.15.44:0/3395999686 shutdown_connections 2024-08-19T00:12:22.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:22.887+0000 7f6dd22f5640 1 -- 172.21.15.44:0/3395999686 wait complete. 2024-08-19T00:12:23.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:23.316+0000 7f1d0db9d640 1 -- 172.21.15.44:0/768977498 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d08100b50 msgr2=0x7f1d08100f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:23.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:23.316+0000 7f1d0db9d640 1 --2- 172.21.15.44:0/768977498 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d08100b50 0x7f1d08100f30 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1cf8009900 tx=0x7f1cf802a480 comp rx=0 tx=0).stop 2024-08-19T00:12:23.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:23.316+0000 7f1d0db9d640 1 -- 172.21.15.44:0/768977498 shutdown_connections 2024-08-19T00:12:23.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:23.316+0000 7f1d0db9d640 1 --2- 172.21.15.44:0/768977498 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1d08102c20 0x7f1d0810d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:23.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:23.316+0000 7f1d0db9d640 1 --2- 172.21.15.44:0/768977498 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1d081022a0 0x7f1d081026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:23.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:23.316+0000 7f1d0db9d640 1 --2- 172.21.15.44:0/768977498 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d08100b50 0x7f1d08100f30 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:23.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:23.316+0000 7f1d0db9d640 1 -- 172.21.15.44:0/768977498 >> 172.21.15.44:0/768977498 conn(0x7f1d080fc500 msgr2=0x7f1d080fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:23.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:23.316+0000 7f1d0db9d640 1 -- 172.21.15.44:0/768977498 shutdown_connections 2024-08-19T00:12:23.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:23.316+0000 7f1d0db9d640 1 -- 172.21.15.44:0/768977498 wait complete. 2024-08-19T00:12:23.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:23.316+0000 7f1d0db9d640 1 Processor -- start 2024-08-19T00:12:23.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:23.317+0000 7f1d0db9d640 1 -- start start 2024-08-19T00:12:23.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:23.317+0000 7f1d0db9d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1d08100b50 0x7f1d0819a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:23.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:23.317+0000 7f1d0db9d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1d081022a0 0x7f1d0819a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:23.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:23.317+0000 7f1d0db9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d08102c20 0x7f1d0819ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:23.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:23.317+0000 7f1d0db9d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1d08110c70 con 0x7f1d08102c20 2024-08-19T00:12:23.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:23.317+0000 7f1d0db9d640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f1d08110af0 con 0x7f1d081022a0 2024-08-19T00:12:23.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:23.317+0000 7f1d0db9d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1d08110df0 con 0x7f1d08100b50 2024-08-19T00:12:23.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:23.317+0000 7f1d07fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d08102c20 0x7f1d0819ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:23.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:23.317+0000 7f1d07fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d08102c20 0x7f1d0819ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44626/0 (socket says 172.21.15.44:44626) 2024-08-19T00:12:23.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:23.317+0000 7f1d07fff640 1 -- 172.21.15.44:0/3871785651 learned_addr learned my addr 172.21.15.44:0/3871785651 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:12:23.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:23.317+0000 7f1d077fe640 1 --2- 172.21.15.44:0/3871785651 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1d08100b50 0x7f1d0819a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:23.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:23.317+0000 7f1d06ffd640 1 --2- 172.21.15.44:0/3871785651 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1d081022a0 0x7f1d0819a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:23.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:23.317+0000 7f1d07fff640 1 -- 172.21.15.44:0/3871785651 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1d08100b50 msgr2=0x7f1d0819a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:23.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:23.317+0000 7f1d07fff640 1 --2- 172.21.15.44:0/3871785651 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1d08100b50 0x7f1d0819a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:23.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:23.317+0000 7f1d07fff640 1 -- 172.21.15.44:0/3871785651 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1d081022a0 msgr2=0x7f1d0819a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:23.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:23.317+0000 7f1d07fff640 1 --2- 172.21.15.44:0/3871785651 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1d081022a0 0x7f1d0819a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:23.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:23.317+0000 7f1d07fff640 1 -- 172.21.15.44:0/3871785651 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d0819f370 con 0x7f1d08102c20 2024-08-19T00:12:23.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:23.317+0000 7f1d077fe640 1 --2- 172.21.15.44:0/3871785651 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1d08100b50 0x7f1d0819a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:12:23.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:23.317+0000 7f1d07fff640 1 --2- 172.21.15.44:0/3871785651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d08102c20 0x7f1d0819ec90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1d0000eaa0 tx=0x7f1d0000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:23.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:23.318+0000 7f1d04ff9640 1 -- 172.21.15.44:0/3871785651 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d0000cdb0 con 0x7f1d08102c20 2024-08-19T00:12:23.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:23.318+0000 7f1d04ff9640 1 -- 172.21.15.44:0/3871785651 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d00005020 con 0x7f1d08102c20 2024-08-19T00:12:23.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:23.318+0000 7f1d0db9d640 1 -- 172.21.15.44:0/3871785651 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d0819f660 con 0x7f1d08102c20 2024-08-19T00:12:23.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:23.318+0000 7f1d04ff9640 1 -- 172.21.15.44:0/3871785651 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d000116b0 con 0x7f1d08102c20 2024-08-19T00:12:23.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:23.318+0000 7f1d0db9d640 1 -- 172.21.15.44:0/3871785651 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d081a6f40 con 0x7f1d08102c20 2024-08-19T00:12:23.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:23.319+0000 7f1d0db9d640 1 -- 172.21.15.44:0/3871785651 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d08100f30 con 0x7f1d08102c20 2024-08-19T00:12:23.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:23.320+0000 7f1d04ff9640 1 -- 172.21.15.44:0/3871785651 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f1d00005560 con 0x7f1d08102c20 2024-08-19T00:12:23.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:23.321+0000 7f1d04ff9640 1 --2- 172.21.15.44:0/3871785651 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f1cf00a2c10 0x7f1cf00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:23.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:23.321+0000 7f1d077fe640 1 --2- 172.21.15.44:0/3871785651 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f1cf00a2c10 0x7f1cf00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:23.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:23.321+0000 7f1d04ff9640 1 -- 172.21.15.44:0/3871785651 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f1d000cfbd0 con 0x7f1d08102c20 2024-08-19T00:12:23.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:23.321+0000 7f1d077fe640 1 --2- 172.21.15.44:0/3871785651 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f1cf00a2c10 0x7f1cf00a50d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1cf8005ab0 tx=0x7f1cf8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:23.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:23.324+0000 7f1d04ff9640 1 -- 172.21.15.44:0/3871785651 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f1d00016030 con 0x7f1d08102c20 2024-08-19T00:12:23.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:23.502+0000 7f1d0db9d640 1 -- 172.21.15.44:0/3871785651 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f1d0819b720 con 0x7f1d08102c20 2024-08-19T00:12:23.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:23.502+0000 7f1d04ff9640 1 -- 172.21.15.44:0/3871785651 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f1d0819b720 con 0x7f1d08102c20 2024-08-19T00:12:23.504 INFO:teuthology.orchestra.run.smithi044.stdout:304942678051 2024-08-19T00:12:23.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:23.505+0000 7f1d0db9d640 1 -- 172.21.15.44:0/3871785651 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f1cf00a2c10 msgr2=0x7f1cf00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:23.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:23.505+0000 7f1d0db9d640 1 --2- 172.21.15.44:0/3871785651 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f1cf00a2c10 0x7f1cf00a50d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1cf8005ab0 tx=0x7f1cf8005a20 comp rx=0 tx=0).stop 2024-08-19T00:12:23.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:23.505+0000 7f1d0db9d640 1 -- 172.21.15.44:0/3871785651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d08102c20 msgr2=0x7f1d0819ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:23.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:23.505+0000 7f1d0db9d640 1 --2- 172.21.15.44:0/3871785651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d08102c20 0x7f1d0819ec90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1d0000eaa0 tx=0x7f1d0000ef60 comp rx=0 tx=0).stop 2024-08-19T00:12:23.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:23.505+0000 7f1d0db9d640 1 -- 172.21.15.44:0/3871785651 shutdown_connections 2024-08-19T00:12:23.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:23.505+0000 7f1d0db9d640 1 --2- 172.21.15.44:0/3871785651 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f1cf00a2c10 0x7f1cf00a50d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:23.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:23.505+0000 7f1d0db9d640 1 --2- 172.21.15.44:0/3871785651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d08102c20 0x7f1d0819ec90 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:23.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:23.505+0000 7f1d0db9d640 1 --2- 172.21.15.44:0/3871785651 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1d081022a0 0x7f1d0819a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:23.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:23.505+0000 7f1d0db9d640 1 --2- 172.21.15.44:0/3871785651 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1d08100b50 0x7f1d0819a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:23.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:23.505+0000 7f1d0db9d640 1 -- 172.21.15.44:0/3871785651 >> 172.21.15.44:0/3871785651 conn(0x7f1d080fc500 msgr2=0x7f1d0806a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:23.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:23.505+0000 7f1d0db9d640 1 -- 172.21.15.44:0/3871785651 shutdown_connections 2024-08-19T00:12:23.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:23.505+0000 7f1d0db9d640 1 -- 172.21.15.44:0/3871785651 wait complete. 2024-08-19T00:12:23.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:23 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/1881355827' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-08-19T00:12:23.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:23 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/3395999686' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-08-19T00:12:23.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:23 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/1881355827' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-08-19T00:12:23.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:23 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/3395999686' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-08-19T00:12:23.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:23 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/1881355827' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-08-19T00:12:23.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:23 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/3395999686' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-08-19T00:12:24.231 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574922 got 55834574924 for osd.1 2024-08-19T00:12:24.232 DEBUG:teuthology.parallel:result is None 2024-08-19T00:12:24.603 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:24 smithi044 ceph-mon[18489]: pgmap v314: 129 pgs: 129 active+clean; 645 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-19T00:12:24.604 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:24 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/3871785651' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-08-19T00:12:24.636 INFO:tasks.cephadm.ceph_manager.ceph:need seq 335007449117 got 335007449119 for osd.11 2024-08-19T00:12:24.636 DEBUG:teuthology.parallel:result is None 2024-08-19T00:12:24.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:24 smithi171 ceph-mon[21810]: pgmap v314: 129 pgs: 129 active+clean; 645 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-19T00:12:24.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:24 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/3871785651' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-08-19T00:12:24.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:24.848+0000 7fdff2e6d640 1 -- 172.21.15.44:0/2766054796 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfec1018b0 msgr2=0x7fdfec101d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:24.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:24.848+0000 7fdff2e6d640 1 --2- 172.21.15.44:0/2766054796 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfec1018b0 0x7fdfec101d10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc009cd0 tx=0x7fdfdc02a8e0 comp rx=0 tx=0).stop 2024-08-19T00:12:24.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:24.848+0000 7fdff2e6d640 1 -- 172.21.15.44:0/2766054796 shutdown_connections 2024-08-19T00:12:24.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:24.848+0000 7fdff2e6d640 1 --2- 172.21.15.44:0/2766054796 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdfec102250 0x7fdfec10e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:24.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:24.848+0000 7fdff2e6d640 1 --2- 172.21.15.44:0/2766054796 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfec1018b0 0x7fdfec101d10 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:24.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:24.848+0000 7fdff2e6d640 1 --2- 172.21.15.44:0/2766054796 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdfec1078b0 0x7fdfec107c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:24.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:24.848+0000 7fdff2e6d640 1 -- 172.21.15.44:0/2766054796 >> 172.21.15.44:0/2766054796 conn(0x7fdfec0fd5f0 msgr2=0x7fdfec0ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:24.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:24.848+0000 7fdff2e6d640 1 -- 172.21.15.44:0/2766054796 shutdown_connections 2024-08-19T00:12:24.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:24.848+0000 7fdff2e6d640 1 -- 172.21.15.44:0/2766054796 wait complete. 2024-08-19T00:12:24.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:24.848+0000 7fdff2e6d640 1 Processor -- start 2024-08-19T00:12:24.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:24.848+0000 7fdff2e6d640 1 -- start start 2024-08-19T00:12:24.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:24.849+0000 7fdff2e6d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfec1018b0 0x7fdfec074220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:24.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:24.849+0000 7fdff2e6d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdfec102250 0x7fdfec074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:24.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:24.849+0000 7fdff2e6d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdfec1078b0 0x7fdfec074ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:24.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:24.849+0000 7fdff2e6d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdfec111cb0 con 0x7fdfec1018b0 2024-08-19T00:12:24.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:24.849+0000 7fdff2e6d640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fdfec111b30 con 0x7fdfec1078b0 2024-08-19T00:12:24.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:24.849+0000 7fdff2e6d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fdfec111e30 con 0x7fdfec102250 2024-08-19T00:12:24.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:24.849+0000 7fdff0c09640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfec1018b0 0x7fdfec074220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:24.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:24.849+0000 7fdff0c09640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfec1018b0 0x7fdfec074220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44642/0 (socket says 172.21.15.44:44642) 2024-08-19T00:12:24.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:24.849+0000 7fdff0c09640 1 -- 172.21.15.44:0/158658110 learned_addr learned my addr 172.21.15.44:0/158658110 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:12:24.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:24.849+0000 7fdff140a640 1 --2- 172.21.15.44:0/158658110 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdfec1078b0 0x7fdfec074ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:24.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:24.849+0000 7fdfebfff640 1 --2- 172.21.15.44:0/158658110 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdfec102250 0x7fdfec074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:24.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:24.849+0000 7fdff0c09640 1 -- 172.21.15.44:0/158658110 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdfec102250 msgr2=0x7fdfec074760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:24.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:24.849+0000 7fdff0c09640 1 --2- 172.21.15.44:0/158658110 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdfec102250 0x7fdfec074760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:24.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:24.849+0000 7fdff0c09640 1 -- 172.21.15.44:0/158658110 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdfec1078b0 msgr2=0x7fdfec074ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:24.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:24.849+0000 7fdff0c09640 1 --2- 172.21.15.44:0/158658110 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdfec1078b0 0x7fdfec074ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:24.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:24.849+0000 7fdff0c09640 1 -- 172.21.15.44:0/158658110 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfec1a6670 con 0x7fdfec1018b0 2024-08-19T00:12:24.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:24.849+0000 7fdff0c09640 1 --2- 172.21.15.44:0/158658110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfec1018b0 0x7fdfec074220 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fdfe400d950 tx=0x7fdfe400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:24.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:24.849+0000 7fdfe9ffb640 1 -- 172.21.15.44:0/158658110 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe4017030 con 0x7fdfec1018b0 2024-08-19T00:12:24.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:24.850+0000 7fdfe9ffb640 1 -- 172.21.15.44:0/158658110 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdfe4004020 con 0x7fdfec1018b0 2024-08-19T00:12:24.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:24.850+0000 7fdff2e6d640 1 -- 172.21.15.44:0/158658110 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfec1a6960 con 0x7fdfec1018b0 2024-08-19T00:12:24.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:24.850+0000 7fdfe9ffb640 1 -- 172.21.15.44:0/158658110 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe40047a0 con 0x7fdfec1018b0 2024-08-19T00:12:24.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:24.850+0000 7fdff2e6d640 1 -- 172.21.15.44:0/158658110 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfec1a6ea0 con 0x7fdfec1018b0 2024-08-19T00:12:24.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:24.851+0000 7fdff2e6d640 1 -- 172.21.15.44:0/158658110 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfec101d10 con 0x7fdfec1018b0 2024-08-19T00:12:24.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:24.852+0000 7fdfe9ffb640 1 -- 172.21.15.44:0/158658110 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fdfe40041d0 con 0x7fdfec1018b0 2024-08-19T00:12:24.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:24.852+0000 7fdfe9ffb640 1 --2- 172.21.15.44:0/158658110 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fdfd80a2c10 0x7fdfd80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:24.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:24.853+0000 7fdfebfff640 1 --2- 172.21.15.44:0/158658110 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fdfd80a2c10 0x7fdfd80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:24.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:24.853+0000 7fdfe9ffb640 1 -- 172.21.15.44:0/158658110 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fdfe40cef60 con 0x7fdfec1018b0 2024-08-19T00:12:24.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:24.853+0000 7fdfebfff640 1 --2- 172.21.15.44:0/158658110 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fdfd80a2c10 0x7fdfd80a50d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc006010 tx=0x7fdfdc000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:24.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:24.857+0000 7fdfe9ffb640 1 -- 172.21.15.44:0/158658110 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fdfe409ba00 con 0x7fdfec1018b0 2024-08-19T00:12:24.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:24 smithi116 ceph-mon[21873]: pgmap v314: 129 pgs: 129 active+clean; 645 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-19T00:12:24.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:24 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/3871785651' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-08-19T00:12:25.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:25.034+0000 7fdff2e6d640 1 -- 172.21.15.44:0/158658110 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fdfec075750 con 0x7fdfec1018b0 2024-08-19T00:12:25.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:25.035+0000 7fdfe9ffb640 1 -- 172.21.15.44:0/158658110 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fdfe409b300 con 0x7fdfec1018b0 2024-08-19T00:12:25.036 INFO:teuthology.orchestra.run.smithi044.stdout:77309411399 2024-08-19T00:12:25.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:25.037+0000 7fdff2e6d640 1 -- 172.21.15.44:0/158658110 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fdfd80a2c10 msgr2=0x7fdfd80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:25.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:25.037+0000 7fdff2e6d640 1 --2- 172.21.15.44:0/158658110 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fdfd80a2c10 0x7fdfd80a50d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc006010 tx=0x7fdfdc000f40 comp rx=0 tx=0).stop 2024-08-19T00:12:25.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:25.037+0000 7fdff2e6d640 1 -- 172.21.15.44:0/158658110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfec1018b0 msgr2=0x7fdfec074220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:25.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:25.037+0000 7fdff2e6d640 1 --2- 172.21.15.44:0/158658110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfec1018b0 0x7fdfec074220 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fdfe400d950 tx=0x7fdfe400de10 comp rx=0 tx=0).stop 2024-08-19T00:12:25.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:25.037+0000 7fdff2e6d640 1 -- 172.21.15.44:0/158658110 shutdown_connections 2024-08-19T00:12:25.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:25.037+0000 7fdff2e6d640 1 --2- 172.21.15.44:0/158658110 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fdfd80a2c10 0x7fdfd80a50d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:25.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:25.037+0000 7fdff2e6d640 1 --2- 172.21.15.44:0/158658110 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdfec102250 0x7fdfec074760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:25.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:25.037+0000 7fdff2e6d640 1 --2- 172.21.15.44:0/158658110 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdfec1078b0 0x7fdfec074ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:25.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:25.037+0000 7fdff2e6d640 1 --2- 172.21.15.44:0/158658110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfec1018b0 0x7fdfec074220 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:25.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:25.037+0000 7fdff2e6d640 1 -- 172.21.15.44:0/158658110 >> 172.21.15.44:0/158658110 conn(0x7fdfec0fd5f0 msgr2=0x7fdfec0fde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:25.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:25.037+0000 7fdff2e6d640 1 -- 172.21.15.44:0/158658110 shutdown_connections 2024-08-19T00:12:25.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:25.037+0000 7fdff2e6d640 1 -- 172.21.15.44:0/158658110 wait complete. 2024-08-19T00:12:25.200 INFO:tasks.cephadm.ceph_manager.ceph:need seq 279172874276 got 279172874280 for osd.9 2024-08-19T00:12:25.200 DEBUG:teuthology.parallel:result is None 2024-08-19T00:12:25.787 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:25 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/158658110' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-08-19T00:12:25.811 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:12:25.811 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:12:25.818 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411396 got 77309411399 for osd.2 2024-08-19T00:12:25.818 DEBUG:teuthology.parallel:result is None 2024-08-19T00:12:25.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:25 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/158658110' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-08-19T00:12:25.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:25 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/158658110' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-08-19T00:12:26.303 INFO:tasks.cephadm.ceph_manager.ceph:need seq 304942678049 got 304942678051 for osd.10 2024-08-19T00:12:26.304 DEBUG:teuthology.parallel:result is None 2024-08-19T00:12:26.519 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:26 smithi044 ceph-mon[18489]: pgmap v315: 129 pgs: 129 active+clean; 645 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-08-19T00:12:26.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:26 smithi171 ceph-mon[21810]: pgmap v315: 129 pgs: 129 active+clean; 645 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-08-19T00:12:26.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:26 smithi116 ceph-mon[21873]: pgmap v315: 129 pgs: 129 active+clean; 645 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-08-19T00:12:27.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.034+0000 7f85b3db4640 1 -- 172.21.15.44:0/1740084658 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85ac101150 msgr2=0x7f85ac10d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:27.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.034+0000 7f85b3db4640 1 --2- 172.21.15.44:0/1740084658 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85ac101150 0x7f85ac10d680 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f85a4009cd0 tx=0x7f85a402a8e0 comp rx=0 tx=0).stop 2024-08-19T00:12:27.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.034+0000 7f85b3db4640 1 -- 172.21.15.44:0/1740084658 shutdown_connections 2024-08-19T00:12:27.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.034+0000 7f85b3db4640 1 --2- 172.21.15.44:0/1740084658 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85ac101150 0x7f85ac10d680 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:27.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.034+0000 7f85b3db4640 1 --2- 172.21.15.44:0/1740084658 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f85ac1007b0 0x7f85ac100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:27.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.034+0000 7f85b3db4640 1 --2- 172.21.15.44:0/1740084658 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f85ac1067b0 0x7f85ac106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:27.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.034+0000 7f85b3db4640 1 -- 172.21.15.44:0/1740084658 >> 172.21.15.44:0/1740084658 conn(0x7f85ac0fc4d0 msgr2=0x7f85ac0fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:27.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.034+0000 7f85b3db4640 1 -- 172.21.15.44:0/1740084658 shutdown_connections 2024-08-19T00:12:27.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.034+0000 7f85b3db4640 1 -- 172.21.15.44:0/1740084658 wait complete. 2024-08-19T00:12:27.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.035+0000 7f85b3db4640 1 Processor -- start 2024-08-19T00:12:27.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.035+0000 7f85b3db4640 1 -- start start 2024-08-19T00:12:27.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.035+0000 7f85b3db4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85ac1007b0 0x7f85ac1982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:27.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.035+0000 7f85b3db4640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f85ac101150 0x7f85ac1987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:27.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.035+0000 7f85b3db4640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f85ac1067b0 0x7f85ac19cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:27.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.035+0000 7f85b3db4640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f85ac110c50 con 0x7f85ac1007b0 2024-08-19T00:12:27.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.035+0000 7f85b3db4640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f85ac110ad0 con 0x7f85ac101150 2024-08-19T00:12:27.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.035+0000 7f85b3db4640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f85ac110dd0 con 0x7f85ac1067b0 2024-08-19T00:12:27.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.035+0000 7f85b1b50640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85ac1007b0 0x7f85ac1982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:27.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.035+0000 7f85b1b50640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85ac1007b0 0x7f85ac1982b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44662/0 (socket says 172.21.15.44:44662) 2024-08-19T00:12:27.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.035+0000 7f85b1b50640 1 -- 172.21.15.44:0/688578549 learned_addr learned my addr 172.21.15.44:0/688578549 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:12:27.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.036+0000 7f85b2351640 1 --2- 172.21.15.44:0/688578549 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f85ac1067b0 0x7f85ac19cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:27.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.036+0000 7f85b134f640 1 --2- 172.21.15.44:0/688578549 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f85ac101150 0x7f85ac1987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:27.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.036+0000 7f85b1b50640 1 -- 172.21.15.44:0/688578549 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f85ac1067b0 msgr2=0x7f85ac19cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:27.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.036+0000 7f85b1b50640 1 --2- 172.21.15.44:0/688578549 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f85ac1067b0 0x7f85ac19cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:27.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.036+0000 7f85b1b50640 1 -- 172.21.15.44:0/688578549 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f85ac101150 msgr2=0x7f85ac1987f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:27.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.036+0000 7f85b1b50640 1 --2- 172.21.15.44:0/688578549 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f85ac101150 0x7f85ac1987f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:27.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.036+0000 7f85b1b50640 1 -- 172.21.15.44:0/688578549 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85ac19d260 con 0x7f85ac1007b0 2024-08-19T00:12:27.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.036+0000 7f85b134f640 1 --2- 172.21.15.44:0/688578549 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f85ac101150 0x7f85ac1987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:12:27.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.036+0000 7f85b1b50640 1 --2- 172.21.15.44:0/688578549 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85ac1007b0 0x7f85ac1982b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f85a800b4a0 tx=0x7f85a800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:27.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.036+0000 7f85a2ffd640 1 -- 172.21.15.44:0/688578549 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a8014070 con 0x7f85ac1007b0 2024-08-19T00:12:27.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.036+0000 7f85a2ffd640 1 -- 172.21.15.44:0/688578549 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f85a8010af0 con 0x7f85ac1007b0 2024-08-19T00:12:27.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.036+0000 7f85b3db4640 1 -- 172.21.15.44:0/688578549 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85ac19d550 con 0x7f85ac1007b0 2024-08-19T00:12:27.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.036+0000 7f85a2ffd640 1 -- 172.21.15.44:0/688578549 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a8017d10 con 0x7f85ac1007b0 2024-08-19T00:12:27.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.036+0000 7f85b3db4640 1 -- 172.21.15.44:0/688578549 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85ac1a4e30 con 0x7f85ac1007b0 2024-08-19T00:12:27.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.037+0000 7f85b3db4640 1 -- 172.21.15.44:0/688578549 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85ac100c90 con 0x7f85ac1007b0 2024-08-19T00:12:27.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.038+0000 7f85a2ffd640 1 -- 172.21.15.44:0/688578549 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f85a8017070 con 0x7f85ac1007b0 2024-08-19T00:12:27.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.039+0000 7f85a2ffd640 1 --2- 172.21.15.44:0/688578549 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f85980a2c10 0x7f85980a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:27.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.039+0000 7f85a2ffd640 1 -- 172.21.15.44:0/688578549 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f85a80cec30 con 0x7f85ac1007b0 2024-08-19T00:12:27.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.039+0000 7f85b134f640 1 --2- 172.21.15.44:0/688578549 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f85980a2c10 0x7f85980a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:27.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.039+0000 7f85b134f640 1 --2- 172.21.15.44:0/688578549 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f85980a2c10 0x7f85980a50d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f859c006fd0 tx=0x7f859c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:27.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.042+0000 7f85a2ffd640 1 -- 172.21.15.44:0/688578549 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f85a809b7e0 con 0x7f85ac1007b0 2024-08-19T00:12:27.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.219+0000 7f85b3db4640 1 -- 172.21.15.44:0/688578549 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f85ac1097c0 con 0x7f85ac1007b0 2024-08-19T00:12:27.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.220+0000 7f85a2ffd640 1 -- 172.21.15.44:0/688578549 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f85a809b0e0 con 0x7f85ac1007b0 2024-08-19T00:12:27.221 INFO:teuthology.orchestra.run.smithi044.stdout:210453397553 2024-08-19T00:12:27.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.221+0000 7f85b3db4640 1 -- 172.21.15.44:0/688578549 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f85980a2c10 msgr2=0x7f85980a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:27.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.221+0000 7f85b3db4640 1 --2- 172.21.15.44:0/688578549 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f85980a2c10 0x7f85980a50d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f859c006fd0 tx=0x7f859c008040 comp rx=0 tx=0).stop 2024-08-19T00:12:27.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.221+0000 7f85b3db4640 1 -- 172.21.15.44:0/688578549 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85ac1007b0 msgr2=0x7f85ac1982b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:27.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.221+0000 7f85b3db4640 1 --2- 172.21.15.44:0/688578549 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85ac1007b0 0x7f85ac1982b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f85a800b4a0 tx=0x7f85a800b960 comp rx=0 tx=0).stop 2024-08-19T00:12:27.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.222+0000 7f85b3db4640 1 -- 172.21.15.44:0/688578549 shutdown_connections 2024-08-19T00:12:27.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.222+0000 7f85b3db4640 1 --2- 172.21.15.44:0/688578549 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f85980a2c10 0x7f85980a50d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:27.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.222+0000 7f85b3db4640 1 --2- 172.21.15.44:0/688578549 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f85ac1067b0 0x7f85ac19cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:27.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.222+0000 7f85b3db4640 1 --2- 172.21.15.44:0/688578549 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f85ac101150 0x7f85ac1987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:27.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.222+0000 7f85b3db4640 1 --2- 172.21.15.44:0/688578549 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85ac1007b0 0x7f85ac1982b0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:27.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.222+0000 7f85b3db4640 1 -- 172.21.15.44:0/688578549 >> 172.21.15.44:0/688578549 conn(0x7f85ac0fc4d0 msgr2=0x7f85ac06a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:27.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.222+0000 7f85b3db4640 1 -- 172.21.15.44:0/688578549 shutdown_connections 2024-08-19T00:12:27.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.222+0000 7f85b3db4640 1 -- 172.21.15.44:0/688578549 wait complete. 2024-08-19T00:12:27.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.288+0000 7f23f137d640 1 -- 172.21.15.44:0/415294461 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23ec103410 msgr2=0x7f23ec1078c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:27.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.288+0000 7f23f137d640 1 --2- 172.21.15.44:0/415294461 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23ec103410 0x7f23ec1078c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f23e0009930 tx=0x7f23e002a420 comp rx=0 tx=0).stop 2024-08-19T00:12:27.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.289+0000 7f23f137d640 1 -- 172.21.15.44:0/415294461 shutdown_connections 2024-08-19T00:12:27.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.289+0000 7f23f137d640 1 --2- 172.21.15.44:0/415294461 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f23ec107fd0 0x7f23ec10e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:27.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.289+0000 7f23f137d640 1 --2- 172.21.15.44:0/415294461 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23ec103410 0x7f23ec1078c0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:27.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.289+0000 7f23f137d640 1 --2- 172.21.15.44:0/415294461 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23ec102a60 0x7f23ec102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:27.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.289+0000 7f23f137d640 1 -- 172.21.15.44:0/415294461 >> 172.21.15.44:0/415294461 conn(0x7f23ec0fc500 msgr2=0x7f23ec0fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:27.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.289+0000 7f23f137d640 1 -- 172.21.15.44:0/415294461 shutdown_connections 2024-08-19T00:12:27.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.289+0000 7f23f137d640 1 -- 172.21.15.44:0/415294461 wait complete. 2024-08-19T00:12:27.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.289+0000 7f23f137d640 1 Processor -- start 2024-08-19T00:12:27.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.289+0000 7f23f137d640 1 -- start start 2024-08-19T00:12:27.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.290+0000 7f23f137d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f23ec102a60 0x7f23ec198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:27.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.290+0000 7f23f137d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23ec103410 0x7f23ec198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:27.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.290+0000 7f23f137d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23ec107fd0 0x7f23ec19cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:27.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.290+0000 7f23f137d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f23ec111e70 con 0x7f23ec107fd0 2024-08-19T00:12:27.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.290+0000 7f23f137d640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f23ec111cf0 con 0x7f23ec102a60 2024-08-19T00:12:27.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.290+0000 7f23f137d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f23ec111ff0 con 0x7f23ec103410 2024-08-19T00:12:27.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.290+0000 7f23eb7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23ec107fd0 0x7f23ec19cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:27.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.290+0000 7f23eb7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23ec107fd0 0x7f23ec19cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44680/0 (socket says 172.21.15.44:44680) 2024-08-19T00:12:27.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.290+0000 7f23eb7fe640 1 -- 172.21.15.44:0/3218019319 learned_addr learned my addr 172.21.15.44:0/3218019319 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:12:27.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.290+0000 7f23eaffd640 1 --2- 172.21.15.44:0/3218019319 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f23ec102a60 0x7f23ec198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:27.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.290+0000 7f23ea7fc640 1 --2- 172.21.15.44:0/3218019319 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23ec103410 0x7f23ec198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:27.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.290+0000 7f23eb7fe640 1 -- 172.21.15.44:0/3218019319 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23ec103410 msgr2=0x7f23ec198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:27.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.290+0000 7f23eb7fe640 1 --2- 172.21.15.44:0/3218019319 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23ec103410 0x7f23ec198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:27.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.290+0000 7f23eb7fe640 1 -- 172.21.15.44:0/3218019319 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f23ec102a60 msgr2=0x7f23ec198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:27.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.290+0000 7f23eb7fe640 1 --2- 172.21.15.44:0/3218019319 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f23ec102a60 0x7f23ec198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:27.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.290+0000 7f23eb7fe640 1 -- 172.21.15.44:0/3218019319 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23ec19d3e0 con 0x7f23ec107fd0 2024-08-19T00:12:27.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.290+0000 7f23eaffd640 1 --2- 172.21.15.44:0/3218019319 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f23ec102a60 0x7f23ec198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:12:27.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.290+0000 7f23eb7fe640 1 --2- 172.21.15.44:0/3218019319 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23ec107fd0 0x7f23ec19cd00 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f23e400b970 tx=0x7f23e400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:27.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.290+0000 7f23d3fff640 1 -- 172.21.15.44:0/3218019319 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e4019070 con 0x7f23ec107fd0 2024-08-19T00:12:27.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.290+0000 7f23f137d640 1 -- 172.21.15.44:0/3218019319 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23ec19d6d0 con 0x7f23ec107fd0 2024-08-19T00:12:27.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.290+0000 7f23d3fff640 1 -- 172.21.15.44:0/3218019319 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23e400cb40 con 0x7f23ec107fd0 2024-08-19T00:12:27.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.290+0000 7f23d3fff640 1 -- 172.21.15.44:0/3218019319 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e4007650 con 0x7f23ec107fd0 2024-08-19T00:12:27.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.290+0000 7f23f137d640 1 -- 172.21.15.44:0/3218019319 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23ec1a4fb0 con 0x7f23ec107fd0 2024-08-19T00:12:27.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.291+0000 7f23f137d640 1 -- 172.21.15.44:0/3218019319 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23ec102ec0 con 0x7f23ec107fd0 2024-08-19T00:12:27.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.292+0000 7f23d3fff640 1 -- 172.21.15.44:0/3218019319 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f23e401c070 con 0x7f23ec107fd0 2024-08-19T00:12:27.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.293+0000 7f23d3fff640 1 --2- 172.21.15.44:0/3218019319 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f23d40a2c10 0x7f23d40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:27.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.294+0000 7f23eaffd640 1 --2- 172.21.15.44:0/3218019319 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f23d40a2c10 0x7f23d40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:27.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.294+0000 7f23d3fff640 1 -- 172.21.15.44:0/3218019319 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f23e40cea70 con 0x7f23ec107fd0 2024-08-19T00:12:27.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.294+0000 7f23eaffd640 1 --2- 172.21.15.44:0/3218019319 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f23d40a2c10 0x7f23d40a50d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f23dc006fd0 tx=0x7f23dc008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:27.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.298+0000 7f23d3fff640 1 -- 172.21.15.44:0/3218019319 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f23e409b620 con 0x7f23ec107fd0 2024-08-19T00:12:27.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.478+0000 7f23f137d640 1 -- 172.21.15.44:0/3218019319 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f23ec109fe0 con 0x7f23ec107fd0 2024-08-19T00:12:27.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.478+0000 7f23d3fff640 1 -- 172.21.15.44:0/3218019319 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f23e409af20 con 0x7f23ec107fd0 2024-08-19T00:12:27.480 INFO:teuthology.orchestra.run.smithi044.stdout:154618822715 2024-08-19T00:12:27.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.480+0000 7f23f137d640 1 -- 172.21.15.44:0/3218019319 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f23d40a2c10 msgr2=0x7f23d40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:27.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.480+0000 7f23f137d640 1 --2- 172.21.15.44:0/3218019319 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f23d40a2c10 0x7f23d40a50d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f23dc006fd0 tx=0x7f23dc008040 comp rx=0 tx=0).stop 2024-08-19T00:12:27.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.480+0000 7f23f137d640 1 -- 172.21.15.44:0/3218019319 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23ec107fd0 msgr2=0x7f23ec19cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:27.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.480+0000 7f23f137d640 1 --2- 172.21.15.44:0/3218019319 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23ec107fd0 0x7f23ec19cd00 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f23e400b970 tx=0x7f23e400be30 comp rx=0 tx=0).stop 2024-08-19T00:12:27.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.480+0000 7f23f137d640 1 -- 172.21.15.44:0/3218019319 shutdown_connections 2024-08-19T00:12:27.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.480+0000 7f23f137d640 1 --2- 172.21.15.44:0/3218019319 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f23d40a2c10 0x7f23d40a50d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:27.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.480+0000 7f23f137d640 1 --2- 172.21.15.44:0/3218019319 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23ec103410 0x7f23ec198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:27.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.480+0000 7f23f137d640 1 --2- 172.21.15.44:0/3218019319 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23ec107fd0 0x7f23ec19cd00 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:27.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.480+0000 7f23f137d640 1 --2- 172.21.15.44:0/3218019319 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f23ec102a60 0x7f23ec198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:27.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.480+0000 7f23f137d640 1 -- 172.21.15.44:0/3218019319 >> 172.21.15.44:0/3218019319 conn(0x7f23ec0fc500 msgr2=0x7f23ec105b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:27.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.480+0000 7f23f137d640 1 -- 172.21.15.44:0/3218019319 shutdown_connections 2024-08-19T00:12:27.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:27.480+0000 7f23f137d640 1 -- 172.21.15.44:0/3218019319 wait complete. 2024-08-19T00:12:27.788 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:27 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/688578549' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-08-19T00:12:27.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:27 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/688578549' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-08-19T00:12:27.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:27 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/688578549' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-08-19T00:12:28.101 INFO:tasks.cephadm.ceph_manager.ceph:need seq 210453397551 got 210453397553 for osd.7 2024-08-19T00:12:28.101 DEBUG:teuthology.parallel:result is None 2024-08-19T00:12:28.599 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822711 got 154618822715 for osd.5 2024-08-19T00:12:28.599 DEBUG:teuthology.parallel:result is None 2024-08-19T00:12:28.599 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-08-19T00:12:28.599 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph pg dump --format=json 2024-08-19T00:12:28.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:28 smithi171 ceph-mon[21810]: pgmap v316: 129 pgs: 129 active+clean; 645 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 10 op/s 2024-08-19T00:12:28.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:28 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/3218019319' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-08-19T00:12:28.863 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:12:28.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:28 smithi116 ceph-mon[21873]: pgmap v316: 129 pgs: 129 active+clean; 645 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 10 op/s 2024-08-19T00:12:28.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:28 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/3218019319' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-08-19T00:12:28.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:28 smithi044 ceph-mon[18489]: pgmap v316: 129 pgs: 129 active+clean; 645 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 10 op/s 2024-08-19T00:12:28.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:28 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/3218019319' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-08-19T00:12:29.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:29.357+0000 7f63a29d7640 1 -- 172.21.15.44:0/453861055 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f639c100b50 msgr2=0x7f639c100f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:29.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:29.357+0000 7f63a29d7640 1 --2- 172.21.15.44:0/453861055 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f639c100b50 0x7f639c100f30 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f638c009900 tx=0x7f638c02a480 comp rx=0 tx=0).stop 2024-08-19T00:12:29.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:29.357+0000 7f63a29d7640 1 -- 172.21.15.44:0/453861055 shutdown_connections 2024-08-19T00:12:29.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:29.357+0000 7f63a29d7640 1 --2- 172.21.15.44:0/453861055 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f639c1022a0 0x7f639c1026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:29.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:29.357+0000 7f63a29d7640 1 --2- 172.21.15.44:0/453861055 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f639c102c20 0x7f639c10d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:29.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:29.357+0000 7f63a29d7640 1 --2- 172.21.15.44:0/453861055 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f639c100b50 0x7f639c100f30 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:29.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:29.357+0000 7f63a29d7640 1 -- 172.21.15.44:0/453861055 >> 172.21.15.44:0/453861055 conn(0x7f639c0fc500 msgr2=0x7f639c0fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:29.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:29.357+0000 7f63a29d7640 1 -- 172.21.15.44:0/453861055 shutdown_connections 2024-08-19T00:12:29.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:29.357+0000 7f63a29d7640 1 -- 172.21.15.44:0/453861055 wait complete. 2024-08-19T00:12:29.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:29.357+0000 7f63a29d7640 1 Processor -- start 2024-08-19T00:12:29.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:29.357+0000 7f63a29d7640 1 -- start start 2024-08-19T00:12:29.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:29.358+0000 7f63a29d7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f639c100b50 0x7f639c199160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:29.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:29.358+0000 7f63a29d7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f639c1022a0 0x7f639c1996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:29.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:29.358+0000 7f63a29d7640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f639c102c20 0x7f639c1a41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:29.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:29.358+0000 7f63a29d7640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f639c110cd0 con 0x7f639c100b50 2024-08-19T00:12:29.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:29.358+0000 7f63a29d7640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f639c110b50 con 0x7f639c1022a0 2024-08-19T00:12:29.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:29.358+0000 7f63a29d7640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f639c110e50 con 0x7f639c102c20 2024-08-19T00:12:29.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:29.358+0000 7f639bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f639c100b50 0x7f639c199160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:29.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:29.358+0000 7f639bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f639c100b50 0x7f639c199160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50888/0 (socket says 172.21.15.44:50888) 2024-08-19T00:12:29.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:29.358+0000 7f639bfff640 1 -- 172.21.15.44:0/4020483483 learned_addr learned my addr 172.21.15.44:0/4020483483 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:12:29.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:29.358+0000 7f639b7fe640 1 --2- 172.21.15.44:0/4020483483 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f639c1022a0 0x7f639c1996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:29.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:29.358+0000 7f63a0f74640 1 --2- 172.21.15.44:0/4020483483 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f639c102c20 0x7f639c1a41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:29.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:29.358+0000 7f639bfff640 1 -- 172.21.15.44:0/4020483483 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f639c102c20 msgr2=0x7f639c1a41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:29.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:29.358+0000 7f639bfff640 1 --2- 172.21.15.44:0/4020483483 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f639c102c20 0x7f639c1a41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:29.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:29.358+0000 7f639bfff640 1 -- 172.21.15.44:0/4020483483 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f639c1022a0 msgr2=0x7f639c1996a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:29.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:29.358+0000 7f639bfff640 1 --2- 172.21.15.44:0/4020483483 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f639c1022a0 0x7f639c1996a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:29.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:29.358+0000 7f639bfff640 1 -- 172.21.15.44:0/4020483483 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f639c1a4720 con 0x7f639c100b50 2024-08-19T00:12:29.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:29.358+0000 7f639b7fe640 1 --2- 172.21.15.44:0/4020483483 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f639c1022a0 0x7f639c1996a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:12:29.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:29.358+0000 7f639bfff640 1 --2- 172.21.15.44:0/4020483483 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f639c100b50 0x7f639c199160 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f638c006010 tx=0x7f638c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:29.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:29.358+0000 7f63997fa640 1 -- 172.21.15.44:0/4020483483 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f638c03f070 con 0x7f639c100b50 2024-08-19T00:12:29.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:29.358+0000 7f63a29d7640 1 -- 172.21.15.44:0/4020483483 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f639c1a48f0 con 0x7f639c100b50 2024-08-19T00:12:29.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:29.358+0000 7f63997fa640 1 -- 172.21.15.44:0/4020483483 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f638c031c30 con 0x7f639c100b50 2024-08-19T00:12:29.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:29.358+0000 7f63997fa640 1 -- 172.21.15.44:0/4020483483 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f638c035030 con 0x7f639c100b50 2024-08-19T00:12:29.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:29.359+0000 7f63a29d7640 1 -- 172.21.15.44:0/4020483483 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f639c1a4da0 con 0x7f639c100b50 2024-08-19T00:12:29.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:29.359+0000 7f63a29d7640 1 -- 172.21.15.44:0/4020483483 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f639c100f30 con 0x7f639c100b50 2024-08-19T00:12:29.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:29.361+0000 7f63997fa640 1 -- 172.21.15.44:0/4020483483 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f638c042070 con 0x7f639c100b50 2024-08-19T00:12:29.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:29.361+0000 7f63997fa640 1 --2- 172.21.15.44:0/4020483483 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f63840a2c10 0x7f63840a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:29.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:29.361+0000 7f639b7fe640 1 --2- 172.21.15.44:0/4020483483 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f63840a2c10 0x7f63840a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:29.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:29.361+0000 7f63997fa640 1 -- 172.21.15.44:0/4020483483 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f638c0f02a0 con 0x7f639c100b50 2024-08-19T00:12:29.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:29.362+0000 7f639b7fe640 1 --2- 172.21.15.44:0/4020483483 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f63840a2c10 0x7f63840a50d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f639c06a7f0 tx=0x7f6390008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:29.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:29.365+0000 7f63997fa640 1 -- 172.21.15.44:0/4020483483 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f638c031de0 con 0x7f639c100b50 2024-08-19T00:12:29.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:29.536+0000 7f63a29d7640 1 -- 172.21.15.44:0/4020483483 --> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f639c062360 con 0x7f63840a2c10 2024-08-19T00:12:29.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:29.545+0000 7f63997fa640 1 -- 172.21.15.44:0/4020483483 <== mgr.14150 v2:172.21.15.44:6800/1330072146 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340392 (secure 0 0 0) 0x7f639c062360 con 0x7f63840a2c10 2024-08-19T00:12:29.551 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:12:29.552 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-08-19T00:12:29.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:29.548+0000 7f63a29d7640 1 -- 172.21.15.44:0/4020483483 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f63840a2c10 msgr2=0x7f63840a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:29.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:29.548+0000 7f63a29d7640 1 --2- 172.21.15.44:0/4020483483 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f63840a2c10 0x7f63840a50d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f639c06a7f0 tx=0x7f6390008040 comp rx=0 tx=0).stop 2024-08-19T00:12:29.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:29.548+0000 7f63a29d7640 1 -- 172.21.15.44:0/4020483483 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f639c100b50 msgr2=0x7f639c199160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:29.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:29.548+0000 7f63a29d7640 1 --2- 172.21.15.44:0/4020483483 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f639c100b50 0x7f639c199160 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f638c006010 tx=0x7f638c003c10 comp rx=0 tx=0).stop 2024-08-19T00:12:29.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:29.548+0000 7f63a29d7640 1 -- 172.21.15.44:0/4020483483 shutdown_connections 2024-08-19T00:12:29.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:29.548+0000 7f63a29d7640 1 --2- 172.21.15.44:0/4020483483 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f63840a2c10 0x7f63840a50d0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:29.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:29.548+0000 7f63a29d7640 1 --2- 172.21.15.44:0/4020483483 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f639c102c20 0x7f639c1a41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:29.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:29.548+0000 7f63a29d7640 1 --2- 172.21.15.44:0/4020483483 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f639c1022a0 0x7f639c1996a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:29.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:29.548+0000 7f63a29d7640 1 --2- 172.21.15.44:0/4020483483 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f639c100b50 0x7f639c199160 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:29.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:29.548+0000 7f63a29d7640 1 -- 172.21.15.44:0/4020483483 >> 172.21.15.44:0/4020483483 conn(0x7f639c0fc500 msgr2=0x7f639c0fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:29.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:29.548+0000 7f63a29d7640 1 -- 172.21.15.44:0/4020483483 shutdown_connections 2024-08-19T00:12:29.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:29.548+0000 7f63a29d7640 1 -- 172.21.15.44:0/4020483483 wait complete. 2024-08-19T00:12:30.252 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":317,"stamp":"2024-08-19T00:12:28.488167+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660497,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":669,"num_read_kb":461,"num_write":431,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1180848,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":352,"ondisk_log_size":352,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":392820,"kb_used_data":14528,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124549004,"statfs":{"total":1151940427776,"available":1151538180096,"internally_reserved":0,"allocated":14876672,"data_stored":8174609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":387233081},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":55,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003330"},"pg_stats":[{"pgid":"2.1f","version":"90'13","reported_seq":100,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:12:26.979303+0000","last_change":"2024-08-19T00:10:50.471635+0000","last_active":"2024-08-19T00:12:26.979303+0000","last_peered":"2024-08-19T00:12:26.979303+0000","last_clean":"2024-08-19T00:12:26.979303+0000","last_became_active":"2024-08-19T00:10:50.471324+0000","last_became_peered":"2024-08-19T00:10:50.471324+0000","last_unstale":"2024-08-19T00:12:26.979303+0000","last_undegraded":"2024-08-19T00:12:26.979303+0000","last_fullsized":"2024-08-19T00:12:26.979303+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:41:02.945782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.923007+0000","last_change":"2024-08-19T00:11:39.922459+0000","last_active":"2024-08-19T00:11:39.923007+0000","last_peered":"2024-08-19T00:11:39.923007+0000","last_clean":"2024-08-19T00:11:39.923007+0000","last_became_active":"2024-08-19T00:11:39.922091+0000","last_became_peered":"2024-08-19T00:11:39.922091+0000","last_unstale":"2024-08-19T00:11:39.923007+0000","last_undegraded":"2024-08-19T00:11:39.923007+0000","last_fullsized":"2024-08-19T00:11:39.923007+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:14:21.785736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915284+0000","last_change":"2024-08-19T00:10:59.789370+0000","last_active":"2024-08-19T00:11:39.915284+0000","last_peered":"2024-08-19T00:11:39.915284+0000","last_clean":"2024-08-19T00:11:39.915284+0000","last_became_active":"2024-08-19T00:10:59.788901+0000","last_became_peered":"2024-08-19T00:10:59.788901+0000","last_unstale":"2024-08-19T00:11:39.915284+0000","last_undegraded":"2024-08-19T00:11:39.915284+0000","last_fullsized":"2024-08-19T00:11:39.915284+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:15:45.247674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"90'2","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916313+0000","last_change":"2024-08-19T00:10:50.618000+0000","last_active":"2024-08-19T00:11:39.916313+0000","last_peered":"2024-08-19T00:11:39.916313+0000","last_clean":"2024-08-19T00:11:39.916313+0000","last_became_active":"2024-08-19T00:10:50.617648+0000","last_became_peered":"2024-08-19T00:10:50.617648+0000","last_unstale":"2024-08-19T00:11:39.916313+0000","last_undegraded":"2024-08-19T00:11:39.916313+0000","last_fullsized":"2024-08-19T00:11:39.916313+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:39:00.310466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915973+0000","last_change":"2024-08-19T00:10:52.518075+0000","last_active":"2024-08-19T00:11:39.915973+0000","last_peered":"2024-08-19T00:11:39.915973+0000","last_clean":"2024-08-19T00:11:39.915973+0000","last_became_active":"2024-08-19T00:10:52.517735+0000","last_became_peered":"2024-08-19T00:10:52.517735+0000","last_unstale":"2024-08-19T00:11:39.915973+0000","last_undegraded":"2024-08-19T00:11:39.915973+0000","last_fullsized":"2024-08-19T00:11:39.915973+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:02:32.657776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916011+0000","last_change":"2024-08-19T00:10:59.787563+0000","last_active":"2024-08-19T00:11:39.916011+0000","last_peered":"2024-08-19T00:11:39.916011+0000","last_clean":"2024-08-19T00:11:39.916011+0000","last_became_active":"2024-08-19T00:10:59.787143+0000","last_became_peered":"2024-08-19T00:10:59.787143+0000","last_unstale":"2024-08-19T00:11:39.916011+0000","last_undegraded":"2024-08-19T00:11:39.916011+0000","last_fullsized":"2024-08-19T00:11:39.916011+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:41:47.101296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"90'12","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913715+0000","last_change":"2024-08-19T00:10:50.475869+0000","last_active":"2024-08-19T00:11:39.913715+0000","last_peered":"2024-08-19T00:11:39.913715+0000","last_clean":"2024-08-19T00:11:39.913715+0000","last_became_active":"2024-08-19T00:10:50.475550+0000","last_became_peered":"2024-08-19T00:10:50.475550+0000","last_unstale":"2024-08-19T00:11:39.913715+0000","last_undegraded":"2024-08-19T00:11:39.913715+0000","last_fullsized":"2024-08-19T00:11:39.913715+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:47:23.724503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913510+0000","last_change":"2024-08-19T00:10:52.511901+0000","last_active":"2024-08-19T00:11:39.913510+0000","last_peered":"2024-08-19T00:11:39.913510+0000","last_clean":"2024-08-19T00:11:39.913510+0000","last_became_active":"2024-08-19T00:10:52.511595+0000","last_became_peered":"2024-08-19T00:10:52.511595+0000","last_unstale":"2024-08-19T00:11:39.913510+0000","last_undegraded":"2024-08-19T00:11:39.913510+0000","last_fullsized":"2024-08-19T00:11:39.913510+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:57:30.613865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916330+0000","last_change":"2024-08-19T00:10:59.785611+0000","last_active":"2024-08-19T00:11:39.916330+0000","last_peered":"2024-08-19T00:11:39.916330+0000","last_clean":"2024-08-19T00:11:39.916330+0000","last_became_active":"2024-08-19T00:10:59.785105+0000","last_became_peered":"2024-08-19T00:10:59.785105+0000","last_unstale":"2024-08-19T00:11:39.916330+0000","last_undegraded":"2024-08-19T00:11:39.916330+0000","last_fullsized":"2024-08-19T00:11:39.916330+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:05:31.007647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"90'5","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.914125+0000","last_change":"2024-08-19T00:10:50.474439+0000","last_active":"2024-08-19T00:11:39.914125+0000","last_peered":"2024-08-19T00:11:39.914125+0000","last_clean":"2024-08-19T00:11:39.914125+0000","last_became_active":"2024-08-19T00:10:50.473984+0000","last_became_peered":"2024-08-19T00:10:50.473984+0000","last_unstale":"2024-08-19T00:11:39.914125+0000","last_undegraded":"2024-08-19T00:11:39.914125+0000","last_fullsized":"2024-08-19T00:11:39.914125+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:16:06.934392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.918999+0000","last_change":"2024-08-19T00:10:52.521664+0000","last_active":"2024-08-19T00:11:39.918999+0000","last_peered":"2024-08-19T00:11:39.918999+0000","last_clean":"2024-08-19T00:11:39.918999+0000","last_became_active":"2024-08-19T00:10:52.520792+0000","last_became_peered":"2024-08-19T00:10:52.520792+0000","last_unstale":"2024-08-19T00:11:39.918999+0000","last_undegraded":"2024-08-19T00:11:39.918999+0000","last_fullsized":"2024-08-19T00:11:39.918999+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:55:27.199456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915652+0000","last_change":"2024-08-19T00:10:59.789736+0000","last_active":"2024-08-19T00:11:39.915652+0000","last_peered":"2024-08-19T00:11:39.915652+0000","last_clean":"2024-08-19T00:11:39.915652+0000","last_became_active":"2024-08-19T00:10:59.786880+0000","last_became_peered":"2024-08-19T00:10:59.786880+0000","last_unstale":"2024-08-19T00:11:39.915652+0000","last_undegraded":"2024-08-19T00:11:39.915652+0000","last_fullsized":"2024-08-19T00:11:39.915652+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:20:53.615561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920522+0000","last_change":"2024-08-19T00:10:52.519887+0000","last_active":"2024-08-19T00:11:39.920522+0000","last_peered":"2024-08-19T00:11:39.920522+0000","last_clean":"2024-08-19T00:11:39.920522+0000","last_became_active":"2024-08-19T00:10:52.519550+0000","last_became_peered":"2024-08-19T00:10:52.519550+0000","last_unstale":"2024-08-19T00:11:39.920522+0000","last_undegraded":"2024-08-19T00:11:39.920522+0000","last_fullsized":"2024-08-19T00:11:39.920522+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:27:43.493012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"90'4","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.912400+0000","last_change":"2024-08-19T00:10:50.478131+0000","last_active":"2024-08-19T00:11:39.912400+0000","last_peered":"2024-08-19T00:11:39.912400+0000","last_clean":"2024-08-19T00:11:39.912400+0000","last_became_active":"2024-08-19T00:10:50.477826+0000","last_became_peered":"2024-08-19T00:10:50.477826+0000","last_unstale":"2024-08-19T00:11:39.912400+0000","last_undegraded":"2024-08-19T00:11:39.912400+0000","last_fullsized":"2024-08-19T00:11:39.912400+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:41:24.066453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915909+0000","last_change":"2024-08-19T00:10:59.787634+0000","last_active":"2024-08-19T00:11:39.915909+0000","last_peered":"2024-08-19T00:11:39.915909+0000","last_clean":"2024-08-19T00:11:39.915909+0000","last_became_active":"2024-08-19T00:10:59.786508+0000","last_became_peered":"2024-08-19T00:10:59.786508+0000","last_unstale":"2024-08-19T00:11:39.915909+0000","last_undegraded":"2024-08-19T00:11:39.915909+0000","last_fullsized":"2024-08-19T00:11:39.915909+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:50:19.071853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915968+0000","last_change":"2024-08-19T00:10:52.512462+0000","last_active":"2024-08-19T00:11:39.915968+0000","last_peered":"2024-08-19T00:11:39.915968+0000","last_clean":"2024-08-19T00:11:39.915968+0000","last_became_active":"2024-08-19T00:10:52.512139+0000","last_became_peered":"2024-08-19T00:10:52.512139+0000","last_unstale":"2024-08-19T00:11:39.915968+0000","last_undegraded":"2024-08-19T00:11:39.915968+0000","last_fullsized":"2024-08-19T00:11:39.915968+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:39:18.677836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"90'3","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.930568+0000","last_change":"2024-08-19T00:11:39.930130+0000","last_active":"2024-08-19T00:11:39.930568+0000","last_peered":"2024-08-19T00:11:39.930568+0000","last_clean":"2024-08-19T00:11:39.930568+0000","last_became_active":"2024-08-19T00:11:39.919566+0000","last_became_peered":"2024-08-19T00:11:39.919566+0000","last_unstale":"2024-08-19T00:11:39.930568+0000","last_undegraded":"2024-08-19T00:11:39.930568+0000","last_fullsized":"2024-08-19T00:11:39.930568+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:50:25.001784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"92'1","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915887+0000","last_change":"2024-08-19T00:10:59.787455+0000","last_active":"2024-08-19T00:11:39.915887+0000","last_peered":"2024-08-19T00:11:39.915887+0000","last_clean":"2024-08-19T00:11:39.915887+0000","last_became_active":"2024-08-19T00:10:59.787054+0000","last_became_peered":"2024-08-19T00:10:59.787054+0000","last_unstale":"2024-08-19T00:11:39.915887+0000","last_undegraded":"2024-08-19T00:11:39.915887+0000","last_fullsized":"2024-08-19T00:11:39.915887+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:13:31.356220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.912686+0000","last_change":"2024-08-19T00:10:52.520993+0000","last_active":"2024-08-19T00:11:39.912686+0000","last_peered":"2024-08-19T00:11:39.912686+0000","last_clean":"2024-08-19T00:11:39.912686+0000","last_became_active":"2024-08-19T00:10:52.520697+0000","last_became_peered":"2024-08-19T00:10:52.520697+0000","last_unstale":"2024-08-19T00:11:39.912686+0000","last_undegraded":"2024-08-19T00:11:39.912686+0000","last_fullsized":"2024-08-19T00:11:39.912686+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:30:15.408193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915912+0000","last_change":"2024-08-19T00:10:50.470746+0000","last_active":"2024-08-19T00:11:39.915912+0000","last_peered":"2024-08-19T00:11:39.915912+0000","last_clean":"2024-08-19T00:11:39.915912+0000","last_became_active":"2024-08-19T00:10:50.470454+0000","last_became_peered":"2024-08-19T00:10:50.470454+0000","last_unstale":"2024-08-19T00:11:39.915912+0000","last_undegraded":"2024-08-19T00:11:39.915912+0000","last_fullsized":"2024-08-19T00:11:39.915912+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:37:34.718543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.924217+0000","last_change":"2024-08-19T00:11:39.924217+0000","last_active":"2024-08-19T00:11:39.924217+0000","last_peered":"2024-08-19T00:11:39.924217+0000","last_clean":"2024-08-19T00:11:39.924217+0000","last_became_active":"2024-08-19T00:11:39.923541+0000","last_became_peered":"2024-08-19T00:11:39.923541+0000","last_unstale":"2024-08-19T00:11:39.924217+0000","last_undegraded":"2024-08-19T00:11:39.924217+0000","last_fullsized":"2024-08-19T00:11:39.924217+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:29:35.040424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,2,5],"acting":[8,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.914173+0000","last_change":"2024-08-19T00:10:52.516838+0000","last_active":"2024-08-19T00:11:39.914173+0000","last_peered":"2024-08-19T00:11:39.914173+0000","last_clean":"2024-08-19T00:11:39.914173+0000","last_became_active":"2024-08-19T00:10:52.516471+0000","last_became_peered":"2024-08-19T00:10:52.516471+0000","last_unstale":"2024-08-19T00:11:39.914173+0000","last_undegraded":"2024-08-19T00:11:39.914173+0000","last_fullsized":"2024-08-19T00:11:39.914173+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:11:26.974655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"90'2","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913384+0000","last_change":"2024-08-19T00:10:50.618745+0000","last_active":"2024-08-19T00:11:39.913384+0000","last_peered":"2024-08-19T00:11:39.913384+0000","last_clean":"2024-08-19T00:11:39.913384+0000","last_became_active":"2024-08-19T00:10:50.618426+0000","last_became_peered":"2024-08-19T00:10:50.618426+0000","last_unstale":"2024-08-19T00:11:39.913384+0000","last_undegraded":"2024-08-19T00:11:39.913384+0000","last_fullsized":"2024-08-19T00:11:39.913384+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:12:57.777142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916210+0000","last_change":"2024-08-19T00:10:59.793740+0000","last_active":"2024-08-19T00:11:39.916210+0000","last_peered":"2024-08-19T00:11:39.916210+0000","last_clean":"2024-08-19T00:11:39.916210+0000","last_became_active":"2024-08-19T00:10:59.793181+0000","last_became_peered":"2024-08-19T00:10:59.793181+0000","last_unstale":"2024-08-19T00:11:39.916210+0000","last_undegraded":"2024-08-19T00:11:39.916210+0000","last_fullsized":"2024-08-19T00:11:39.916210+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:04:15.429505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916583+0000","last_change":"2024-08-19T00:10:52.512200+0000","last_active":"2024-08-19T00:11:39.916583+0000","last_peered":"2024-08-19T00:11:39.916583+0000","last_clean":"2024-08-19T00:11:39.916583+0000","last_became_active":"2024-08-19T00:10:52.511891+0000","last_became_peered":"2024-08-19T00:10:52.511891+0000","last_unstale":"2024-08-19T00:11:39.916583+0000","last_undegraded":"2024-08-19T00:11:39.916583+0000","last_fullsized":"2024-08-19T00:11:39.916583+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:02:08.400026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"90'7","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916624+0000","last_change":"2024-08-19T00:10:50.476209+0000","last_active":"2024-08-19T00:11:39.916624+0000","last_peered":"2024-08-19T00:11:39.916624+0000","last_clean":"2024-08-19T00:11:39.916624+0000","last_became_active":"2024-08-19T00:10:50.475410+0000","last_became_peered":"2024-08-19T00:10:50.475410+0000","last_unstale":"2024-08-19T00:11:39.916624+0000","last_undegraded":"2024-08-19T00:11:39.916624+0000","last_fullsized":"2024-08-19T00:11:39.916624+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:46:25.093738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915425+0000","last_change":"2024-08-19T00:10:59.786550+0000","last_active":"2024-08-19T00:11:39.915425+0000","last_peered":"2024-08-19T00:11:39.915425+0000","last_clean":"2024-08-19T00:11:39.915425+0000","last_became_active":"2024-08-19T00:10:59.785531+0000","last_became_peered":"2024-08-19T00:10:59.785531+0000","last_unstale":"2024-08-19T00:11:39.915425+0000","last_undegraded":"2024-08-19T00:11:39.915425+0000","last_fullsized":"2024-08-19T00:11:39.915425+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:59:53.605678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916210+0000","last_change":"2024-08-19T00:10:52.514936+0000","last_active":"2024-08-19T00:11:39.916210+0000","last_peered":"2024-08-19T00:11:39.916210+0000","last_clean":"2024-08-19T00:11:39.916210+0000","last_became_active":"2024-08-19T00:10:52.514597+0000","last_became_peered":"2024-08-19T00:10:52.514597+0000","last_unstale":"2024-08-19T00:11:39.916210+0000","last_undegraded":"2024-08-19T00:11:39.916210+0000","last_fullsized":"2024-08-19T00:11:39.916210+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:03:42.275705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"92'16","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:50.514720+0000","last_change":"2024-08-19T00:10:50.470637+0000","last_active":"2024-08-19T00:11:50.514720+0000","last_peered":"2024-08-19T00:11:50.514720+0000","last_clean":"2024-08-19T00:11:50.514720+0000","last_became_active":"2024-08-19T00:10:50.470276+0000","last_became_peered":"2024-08-19T00:10:50.470276+0000","last_unstale":"2024-08-19T00:11:50.514720+0000","last_undegraded":"2024-08-19T00:11:50.514720+0000","last_fullsized":"2024-08-19T00:11:50.514720+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:42:16.186669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.914936+0000","last_change":"2024-08-19T00:10:59.784742+0000","last_active":"2024-08-19T00:11:39.914936+0000","last_peered":"2024-08-19T00:11:39.914936+0000","last_clean":"2024-08-19T00:11:39.914936+0000","last_became_active":"2024-08-19T00:10:59.784372+0000","last_became_peered":"2024-08-19T00:10:59.784372+0000","last_unstale":"2024-08-19T00:11:39.914936+0000","last_undegraded":"2024-08-19T00:11:39.914936+0000","last_fullsized":"2024-08-19T00:11:39.914936+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:58:03.216882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913098+0000","last_change":"2024-08-19T00:10:52.511172+0000","last_active":"2024-08-19T00:11:39.913098+0000","last_peered":"2024-08-19T00:11:39.913098+0000","last_clean":"2024-08-19T00:11:39.913098+0000","last_became_active":"2024-08-19T00:10:52.510816+0000","last_became_peered":"2024-08-19T00:10:52.510816+0000","last_unstale":"2024-08-19T00:11:39.913098+0000","last_undegraded":"2024-08-19T00:11:39.913098+0000","last_fullsized":"2024-08-19T00:11:39.913098+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:31:39.889398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"90'4","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.927139+0000","last_change":"2024-08-19T00:11:39.926806+0000","last_active":"2024-08-19T00:11:39.927139+0000","last_peered":"2024-08-19T00:11:39.927139+0000","last_clean":"2024-08-19T00:11:39.927139+0000","last_became_active":"2024-08-19T00:11:39.917115+0000","last_became_peered":"2024-08-19T00:11:39.917115+0000","last_unstale":"2024-08-19T00:11:39.927139+0000","last_undegraded":"2024-08-19T00:11:39.927139+0000","last_fullsized":"2024-08-19T00:11:39.927139+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:58:19.965471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913673+0000","last_change":"2024-08-19T00:10:59.778996+0000","last_active":"2024-08-19T00:11:39.913673+0000","last_peered":"2024-08-19T00:11:39.913673+0000","last_clean":"2024-08-19T00:11:39.913673+0000","last_became_active":"2024-08-19T00:10:59.778589+0000","last_became_peered":"2024-08-19T00:10:59.778589+0000","last_unstale":"2024-08-19T00:11:39.913673+0000","last_undegraded":"2024-08-19T00:11:39.913673+0000","last_fullsized":"2024-08-19T00:11:39.913673+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:40:23.690051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.911105+0000","last_change":"2024-08-19T00:10:52.512796+0000","last_active":"2024-08-19T00:11:39.911105+0000","last_peered":"2024-08-19T00:11:39.911105+0000","last_clean":"2024-08-19T00:11:39.911105+0000","last_became_active":"2024-08-19T00:10:52.512459+0000","last_became_peered":"2024-08-19T00:10:52.512459+0000","last_unstale":"2024-08-19T00:11:39.911105+0000","last_undegraded":"2024-08-19T00:11:39.911105+0000","last_fullsized":"2024-08-19T00:11:39.911105+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:07:47.124129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"90'1","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.910569+0000","last_change":"2024-08-19T00:10:50.618118+0000","last_active":"2024-08-19T00:11:39.910569+0000","last_peered":"2024-08-19T00:11:39.910569+0000","last_clean":"2024-08-19T00:11:39.910569+0000","last_became_active":"2024-08-19T00:10:50.617759+0000","last_became_peered":"2024-08-19T00:10:50.617759+0000","last_unstale":"2024-08-19T00:11:39.910569+0000","last_undegraded":"2024-08-19T00:11:39.910569+0000","last_fullsized":"2024-08-19T00:11:39.910569+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:38:10.830722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913921+0000","last_change":"2024-08-19T00:10:59.783548+0000","last_active":"2024-08-19T00:11:39.913921+0000","last_peered":"2024-08-19T00:11:39.913921+0000","last_clean":"2024-08-19T00:11:39.913921+0000","last_became_active":"2024-08-19T00:10:59.783091+0000","last_became_peered":"2024-08-19T00:10:59.783091+0000","last_unstale":"2024-08-19T00:11:39.913921+0000","last_undegraded":"2024-08-19T00:11:39.913921+0000","last_fullsized":"2024-08-19T00:11:39.913921+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:26:21.191829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.911097+0000","last_change":"2024-08-19T00:10:52.506703+0000","last_active":"2024-08-19T00:11:39.911097+0000","last_peered":"2024-08-19T00:11:39.911097+0000","last_clean":"2024-08-19T00:11:39.911097+0000","last_became_active":"2024-08-19T00:10:52.506350+0000","last_became_peered":"2024-08-19T00:10:52.506350+0000","last_unstale":"2024-08-19T00:11:39.911097+0000","last_undegraded":"2024-08-19T00:11:39.911097+0000","last_fullsized":"2024-08-19T00:11:39.911097+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:27:17.556128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"90'5","reported_seq":90,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:12:24.976969+0000","last_change":"2024-08-19T00:10:50.478742+0000","last_active":"2024-08-19T00:12:24.976969+0000","last_peered":"2024-08-19T00:12:24.976969+0000","last_clean":"2024-08-19T00:12:24.976969+0000","last_became_active":"2024-08-19T00:10:50.478139+0000","last_became_peered":"2024-08-19T00:10:50.478139+0000","last_unstale":"2024-08-19T00:12:24.976969+0000","last_undegraded":"2024-08-19T00:12:24.976969+0000","last_fullsized":"2024-08-19T00:12:24.976969+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:23:25.727268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":51,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.912795+0000","last_change":"2024-08-19T00:10:59.785350+0000","last_active":"2024-08-19T00:11:39.912795+0000","last_peered":"2024-08-19T00:11:39.912795+0000","last_clean":"2024-08-19T00:11:39.912795+0000","last_became_active":"2024-08-19T00:10:59.784929+0000","last_became_peered":"2024-08-19T00:10:59.784929+0000","last_unstale":"2024-08-19T00:11:39.912795+0000","last_undegraded":"2024-08-19T00:11:39.912795+0000","last_fullsized":"2024-08-19T00:11:39.912795+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:58:49.878253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.924921+0000","last_change":"2024-08-19T00:11:39.924921+0000","last_active":"2024-08-19T00:11:39.924921+0000","last_peered":"2024-08-19T00:11:39.924921+0000","last_clean":"2024-08-19T00:11:39.924921+0000","last_became_active":"2024-08-19T00:11:39.924551+0000","last_became_peered":"2024-08-19T00:11:39.924551+0000","last_unstale":"2024-08-19T00:11:39.924921+0000","last_undegraded":"2024-08-19T00:11:39.924921+0000","last_fullsized":"2024-08-19T00:11:39.924921+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:14:23.042222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"90'5","reported_seq":88,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:12:22.973359+0000","last_change":"2024-08-19T00:10:50.618159+0000","last_active":"2024-08-19T00:12:22.973359+0000","last_peered":"2024-08-19T00:12:22.973359+0000","last_clean":"2024-08-19T00:12:22.973359+0000","last_became_active":"2024-08-19T00:10:50.617828+0000","last_became_peered":"2024-08-19T00:10:50.617828+0000","last_unstale":"2024-08-19T00:12:22.973359+0000","last_undegraded":"2024-08-19T00:12:22.973359+0000","last_fullsized":"2024-08-19T00:12:22.973359+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:36:40.702592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":49,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913006+0000","last_change":"2024-08-19T00:10:59.787615+0000","last_active":"2024-08-19T00:11:39.913006+0000","last_peered":"2024-08-19T00:11:39.913006+0000","last_clean":"2024-08-19T00:11:39.913006+0000","last_became_active":"2024-08-19T00:10:59.787184+0000","last_became_peered":"2024-08-19T00:10:59.787184+0000","last_unstale":"2024-08-19T00:11:39.913006+0000","last_undegraded":"2024-08-19T00:11:39.913006+0000","last_fullsized":"2024-08-19T00:11:39.913006+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:20:42.174337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.912608+0000","last_change":"2024-08-19T00:10:52.509235+0000","last_active":"2024-08-19T00:11:39.912608+0000","last_peered":"2024-08-19T00:11:39.912608+0000","last_clean":"2024-08-19T00:11:39.912608+0000","last_became_active":"2024-08-19T00:10:52.508934+0000","last_became_peered":"2024-08-19T00:10:52.508934+0000","last_unstale":"2024-08-19T00:11:39.912608+0000","last_undegraded":"2024-08-19T00:11:39.912608+0000","last_fullsized":"2024-08-19T00:11:39.912608+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:12:59.654711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"90'4","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920451+0000","last_change":"2024-08-19T00:10:50.477180+0000","last_active":"2024-08-19T00:11:39.920451+0000","last_peered":"2024-08-19T00:11:39.920451+0000","last_clean":"2024-08-19T00:11:39.920451+0000","last_became_active":"2024-08-19T00:10:50.476875+0000","last_became_peered":"2024-08-19T00:10:50.476875+0000","last_unstale":"2024-08-19T00:11:39.920451+0000","last_undegraded":"2024-08-19T00:11:39.920451+0000","last_fullsized":"2024-08-19T00:11:39.920451+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:15:57.383599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.919963+0000","last_change":"2024-08-19T00:10:59.783389+0000","last_active":"2024-08-19T00:11:39.919963+0000","last_peered":"2024-08-19T00:11:39.919963+0000","last_clean":"2024-08-19T00:11:39.919963+0000","last_became_active":"2024-08-19T00:10:59.782983+0000","last_became_peered":"2024-08-19T00:10:59.782983+0000","last_unstale":"2024-08-19T00:11:39.919963+0000","last_undegraded":"2024-08-19T00:11:39.919963+0000","last_fullsized":"2024-08-19T00:11:39.919963+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:55:47.419588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916143+0000","last_change":"2024-08-19T00:10:52.517477+0000","last_active":"2024-08-19T00:11:39.916143+0000","last_peered":"2024-08-19T00:11:39.916143+0000","last_clean":"2024-08-19T00:11:39.916143+0000","last_became_active":"2024-08-19T00:10:52.517192+0000","last_became_peered":"2024-08-19T00:10:52.517192+0000","last_unstale":"2024-08-19T00:11:39.916143+0000","last_undegraded":"2024-08-19T00:11:39.916143+0000","last_fullsized":"2024-08-19T00:11:39.916143+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:31:01.125780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"90'6","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916486+0000","last_change":"2024-08-19T00:10:50.476296+0000","last_active":"2024-08-19T00:11:39.916486+0000","last_peered":"2024-08-19T00:11:39.916486+0000","last_clean":"2024-08-19T00:11:39.916486+0000","last_became_active":"2024-08-19T00:10:50.475835+0000","last_became_peered":"2024-08-19T00:10:50.475835+0000","last_unstale":"2024-08-19T00:11:39.916486+0000","last_undegraded":"2024-08-19T00:11:39.916486+0000","last_fullsized":"2024-08-19T00:11:39.916486+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:23:27.585779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":362,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920604+0000","last_change":"2024-08-19T00:09:43.445224+0000","last_active":"2024-08-19T00:11:39.920604+0000","last_peered":"2024-08-19T00:11:39.920604+0000","last_clean":"2024-08-19T00:11:39.920604+0000","last_became_active":"2024-08-19T00:09:43.444826+0000","last_became_peered":"2024-08-19T00:09:43.444826+0000","last_unstale":"2024-08-19T00:11:39.920604+0000","last_undegraded":"2024-08-19T00:11:39.920604+0000","last_fullsized":"2024-08-19T00:11:39.920604+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:06:42.707047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:06:42.707047+0000","last_clean_scrub_stamp":"2024-08-19T00:06:42.707047+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:37:10.588547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"92'1","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920770+0000","last_change":"2024-08-19T00:10:59.783987+0000","last_active":"2024-08-19T00:11:39.920770+0000","last_peered":"2024-08-19T00:11:39.920770+0000","last_clean":"2024-08-19T00:11:39.920770+0000","last_became_active":"2024-08-19T00:10:59.783569+0000","last_became_peered":"2024-08-19T00:10:59.783569+0000","last_unstale":"2024-08-19T00:11:39.920770+0000","last_undegraded":"2024-08-19T00:11:39.920770+0000","last_fullsized":"2024-08-19T00:11:39.920770+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:04:01.744644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920907+0000","last_change":"2024-08-19T00:10:52.516201+0000","last_active":"2024-08-19T00:11:39.920907+0000","last_peered":"2024-08-19T00:11:39.920907+0000","last_clean":"2024-08-19T00:11:39.920907+0000","last_became_active":"2024-08-19T00:10:52.515871+0000","last_became_peered":"2024-08-19T00:10:52.515871+0000","last_unstale":"2024-08-19T00:11:39.920907+0000","last_undegraded":"2024-08-19T00:11:39.920907+0000","last_fullsized":"2024-08-19T00:11:39.920907+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:54:49.528215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"90'5","reported_seq":91,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:12:24.984271+0000","last_change":"2024-08-19T00:10:50.620185+0000","last_active":"2024-08-19T00:12:24.984271+0000","last_peered":"2024-08-19T00:12:24.984271+0000","last_clean":"2024-08-19T00:12:24.984271+0000","last_became_active":"2024-08-19T00:10:50.619858+0000","last_became_peered":"2024-08-19T00:10:50.619858+0000","last_unstale":"2024-08-19T00:12:24.984271+0000","last_undegraded":"2024-08-19T00:12:24.984271+0000","last_fullsized":"2024-08-19T00:12:24.984271+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:30:21.893859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":52,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913286+0000","last_change":"2024-08-19T00:10:59.782056+0000","last_active":"2024-08-19T00:11:39.913286+0000","last_peered":"2024-08-19T00:11:39.913286+0000","last_clean":"2024-08-19T00:11:39.913286+0000","last_became_active":"2024-08-19T00:10:59.781666+0000","last_became_peered":"2024-08-19T00:10:59.781666+0000","last_unstale":"2024-08-19T00:11:39.913286+0000","last_undegraded":"2024-08-19T00:11:39.913286+0000","last_fullsized":"2024-08-19T00:11:39.913286+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:06:15.614372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920745+0000","last_change":"2024-08-19T00:10:52.523346+0000","last_active":"2024-08-19T00:11:39.920745+0000","last_peered":"2024-08-19T00:11:39.920745+0000","last_clean":"2024-08-19T00:11:39.920745+0000","last_became_active":"2024-08-19T00:10:52.523020+0000","last_became_peered":"2024-08-19T00:10:52.523020+0000","last_unstale":"2024-08-19T00:11:39.920745+0000","last_undegraded":"2024-08-19T00:11:39.920745+0000","last_fullsized":"2024-08-19T00:11:39.920745+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:09:58.259666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"90'3","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.919270+0000","last_change":"2024-08-19T00:10:50.471739+0000","last_active":"2024-08-19T00:11:39.919270+0000","last_peered":"2024-08-19T00:11:39.919270+0000","last_clean":"2024-08-19T00:11:39.919270+0000","last_became_active":"2024-08-19T00:10:50.471425+0000","last_became_peered":"2024-08-19T00:10:50.471425+0000","last_unstale":"2024-08-19T00:11:39.919270+0000","last_undegraded":"2024-08-19T00:11:39.919270+0000","last_fullsized":"2024-08-19T00:11:39.919270+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:55:26.332380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916291+0000","last_change":"2024-08-19T00:10:59.788685+0000","last_active":"2024-08-19T00:11:39.916291+0000","last_peered":"2024-08-19T00:11:39.916291+0000","last_clean":"2024-08-19T00:11:39.916291+0000","last_became_active":"2024-08-19T00:10:59.788343+0000","last_became_peered":"2024-08-19T00:10:59.788343+0000","last_unstale":"2024-08-19T00:11:39.916291+0000","last_undegraded":"2024-08-19T00:11:39.916291+0000","last_fullsized":"2024-08-19T00:11:39.916291+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:20:59.595494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920867+0000","last_change":"2024-08-19T00:10:52.516469+0000","last_active":"2024-08-19T00:11:39.920867+0000","last_peered":"2024-08-19T00:11:39.920867+0000","last_clean":"2024-08-19T00:11:39.920867+0000","last_became_active":"2024-08-19T00:10:52.516093+0000","last_became_peered":"2024-08-19T00:10:52.516093+0000","last_unstale":"2024-08-19T00:11:39.920867+0000","last_undegraded":"2024-08-19T00:11:39.920867+0000","last_fullsized":"2024-08-19T00:11:39.920867+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:18:29.327336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"90'5","reported_seq":51,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.921825+0000","last_change":"2024-08-19T00:11:39.921825+0000","last_active":"2024-08-19T00:11:39.921825+0000","last_peered":"2024-08-19T00:11:39.921825+0000","last_clean":"2024-08-19T00:11:39.921825+0000","last_became_active":"2024-08-19T00:11:39.917689+0000","last_became_peered":"2024-08-19T00:11:39.917689+0000","last_unstale":"2024-08-19T00:11:39.921825+0000","last_undegraded":"2024-08-19T00:11:39.921825+0000","last_fullsized":"2024-08-19T00:11:39.921825+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:37:47.940707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.918104+0000","last_change":"2024-08-19T00:10:59.785347+0000","last_active":"2024-08-19T00:11:39.918104+0000","last_peered":"2024-08-19T00:11:39.918104+0000","last_clean":"2024-08-19T00:11:39.918104+0000","last_became_active":"2024-08-19T00:10:59.784927+0000","last_became_peered":"2024-08-19T00:10:59.784927+0000","last_unstale":"2024-08-19T00:11:39.918104+0000","last_undegraded":"2024-08-19T00:11:39.918104+0000","last_fullsized":"2024-08-19T00:11:39.918104+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:39:41.919021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.912923+0000","last_change":"2024-08-19T00:10:52.524460+0000","last_active":"2024-08-19T00:11:39.912923+0000","last_peered":"2024-08-19T00:11:39.912923+0000","last_clean":"2024-08-19T00:11:39.912923+0000","last_became_active":"2024-08-19T00:10:52.523139+0000","last_became_peered":"2024-08-19T00:10:52.523139+0000","last_unstale":"2024-08-19T00:11:39.912923+0000","last_undegraded":"2024-08-19T00:11:39.912923+0000","last_fullsized":"2024-08-19T00:11:39.912923+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:50:55.142569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"90'2","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.912963+0000","last_change":"2024-08-19T00:10:50.474977+0000","last_active":"2024-08-19T00:11:39.912963+0000","last_peered":"2024-08-19T00:11:39.912963+0000","last_clean":"2024-08-19T00:11:39.912963+0000","last_became_active":"2024-08-19T00:10:50.474653+0000","last_became_peered":"2024-08-19T00:10:50.474653+0000","last_unstale":"2024-08-19T00:11:39.912963+0000","last_undegraded":"2024-08-19T00:11:39.912963+0000","last_fullsized":"2024-08-19T00:11:39.912963+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:20:31.565098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920595+0000","last_change":"2024-08-19T00:10:59.789912+0000","last_active":"2024-08-19T00:11:39.920595+0000","last_peered":"2024-08-19T00:11:39.920595+0000","last_clean":"2024-08-19T00:11:39.920595+0000","last_became_active":"2024-08-19T00:10:59.789143+0000","last_became_peered":"2024-08-19T00:10:59.789143+0000","last_unstale":"2024-08-19T00:11:39.920595+0000","last_undegraded":"2024-08-19T00:11:39.920595+0000","last_fullsized":"2024-08-19T00:11:39.920595+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:06:53.447173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920777+0000","last_change":"2024-08-19T00:10:52.525061+0000","last_active":"2024-08-19T00:11:39.920777+0000","last_peered":"2024-08-19T00:11:39.920777+0000","last_clean":"2024-08-19T00:11:39.920777+0000","last_became_active":"2024-08-19T00:10:52.524752+0000","last_became_peered":"2024-08-19T00:10:52.524752+0000","last_unstale":"2024-08-19T00:11:39.920777+0000","last_undegraded":"2024-08-19T00:11:39.920777+0000","last_fullsized":"2024-08-19T00:11:39.920777+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:50:47.817220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"90'17","reported_seq":52,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913283+0000","last_change":"2024-08-19T00:10:50.618923+0000","last_active":"2024-08-19T00:11:39.913283+0000","last_peered":"2024-08-19T00:11:39.913283+0000","last_clean":"2024-08-19T00:11:39.913283+0000","last_became_active":"2024-08-19T00:10:50.618586+0000","last_became_peered":"2024-08-19T00:10:50.618586+0000","last_unstale":"2024-08-19T00:11:39.913283+0000","last_undegraded":"2024-08-19T00:11:39.913283+0000","last_fullsized":"2024-08-19T00:11:39.913283+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:07:45.186059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913068+0000","last_change":"2024-08-19T00:10:59.785681+0000","last_active":"2024-08-19T00:11:39.913068+0000","last_peered":"2024-08-19T00:11:39.913068+0000","last_clean":"2024-08-19T00:11:39.913068+0000","last_became_active":"2024-08-19T00:10:59.785299+0000","last_became_peered":"2024-08-19T00:10:59.785299+0000","last_unstale":"2024-08-19T00:11:39.913068+0000","last_undegraded":"2024-08-19T00:11:39.913068+0000","last_fullsized":"2024-08-19T00:11:39.913068+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:36:08.151180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920368+0000","last_change":"2024-08-19T00:10:52.523398+0000","last_active":"2024-08-19T00:11:39.920368+0000","last_peered":"2024-08-19T00:11:39.920368+0000","last_clean":"2024-08-19T00:11:39.920368+0000","last_became_active":"2024-08-19T00:10:52.523066+0000","last_became_peered":"2024-08-19T00:10:52.523066+0000","last_unstale":"2024-08-19T00:11:39.920368+0000","last_undegraded":"2024-08-19T00:11:39.920368+0000","last_fullsized":"2024-08-19T00:11:39.920368+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:47:25.137487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"90'5","reported_seq":90,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:12:23.975802+0000","last_change":"2024-08-19T00:10:50.475827+0000","last_active":"2024-08-19T00:12:23.975802+0000","last_peered":"2024-08-19T00:12:23.975802+0000","last_clean":"2024-08-19T00:12:23.975802+0000","last_became_active":"2024-08-19T00:10:50.475470+0000","last_became_peered":"2024-08-19T00:10:50.475470+0000","last_unstale":"2024-08-19T00:12:23.975802+0000","last_undegraded":"2024-08-19T00:12:23.975802+0000","last_fullsized":"2024-08-19T00:12:23.975802+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:25:14.200317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":52,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.910632+0000","last_change":"2024-08-19T00:10:59.789047+0000","last_active":"2024-08-19T00:11:39.910632+0000","last_peered":"2024-08-19T00:11:39.910632+0000","last_clean":"2024-08-19T00:11:39.910632+0000","last_became_active":"2024-08-19T00:10:59.788694+0000","last_became_peered":"2024-08-19T00:10:59.788694+0000","last_unstale":"2024-08-19T00:11:39.910632+0000","last_undegraded":"2024-08-19T00:11:39.910632+0000","last_fullsized":"2024-08-19T00:11:39.910632+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:00:22.463593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920596+0000","last_change":"2024-08-19T00:10:52.511480+0000","last_active":"2024-08-19T00:11:39.920596+0000","last_peered":"2024-08-19T00:11:39.920596+0000","last_clean":"2024-08-19T00:11:39.920596+0000","last_became_active":"2024-08-19T00:10:52.511159+0000","last_became_peered":"2024-08-19T00:10:52.511159+0000","last_unstale":"2024-08-19T00:11:39.920596+0000","last_undegraded":"2024-08-19T00:11:39.920596+0000","last_fullsized":"2024-08-19T00:11:39.920596+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:28:31.136900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"90'5","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.919763+0000","last_change":"2024-08-19T00:10:50.476761+0000","last_active":"2024-08-19T00:11:39.919763+0000","last_peered":"2024-08-19T00:11:39.919763+0000","last_clean":"2024-08-19T00:11:39.919763+0000","last_became_active":"2024-08-19T00:10:50.476455+0000","last_became_peered":"2024-08-19T00:10:50.476455+0000","last_unstale":"2024-08-19T00:11:39.919763+0000","last_undegraded":"2024-08-19T00:11:39.919763+0000","last_fullsized":"2024-08-19T00:11:39.919763+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:34:52.158438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.912580+0000","last_change":"2024-08-19T00:10:59.778313+0000","last_active":"2024-08-19T00:11:39.912580+0000","last_peered":"2024-08-19T00:11:39.912580+0000","last_clean":"2024-08-19T00:11:39.912580+0000","last_became_active":"2024-08-19T00:10:59.777831+0000","last_became_peered":"2024-08-19T00:10:59.777831+0000","last_unstale":"2024-08-19T00:11:39.912580+0000","last_undegraded":"2024-08-19T00:11:39.912580+0000","last_fullsized":"2024-08-19T00:11:39.912580+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:34:05.474277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.912741+0000","last_change":"2024-08-19T00:10:52.513719+0000","last_active":"2024-08-19T00:11:39.912741+0000","last_peered":"2024-08-19T00:11:39.912741+0000","last_clean":"2024-08-19T00:11:39.912741+0000","last_became_active":"2024-08-19T00:10:52.513345+0000","last_became_peered":"2024-08-19T00:10:52.513345+0000","last_unstale":"2024-08-19T00:11:39.912741+0000","last_undegraded":"2024-08-19T00:11:39.912741+0000","last_fullsized":"2024-08-19T00:11:39.912741+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:50:28.862870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"90'9","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916408+0000","last_change":"2024-08-19T00:10:50.475529+0000","last_active":"2024-08-19T00:11:39.916408+0000","last_peered":"2024-08-19T00:11:39.916408+0000","last_clean":"2024-08-19T00:11:39.916408+0000","last_became_active":"2024-08-19T00:10:50.473544+0000","last_became_peered":"2024-08-19T00:10:50.473544+0000","last_unstale":"2024-08-19T00:11:39.916408+0000","last_undegraded":"2024-08-19T00:11:39.916408+0000","last_fullsized":"2024-08-19T00:11:39.916408+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:49:42.663650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.918895+0000","last_change":"2024-08-19T00:10:59.789028+0000","last_active":"2024-08-19T00:11:39.918895+0000","last_peered":"2024-08-19T00:11:39.918895+0000","last_clean":"2024-08-19T00:11:39.918895+0000","last_became_active":"2024-08-19T00:10:59.788606+0000","last_became_peered":"2024-08-19T00:10:59.788606+0000","last_unstale":"2024-08-19T00:11:39.918895+0000","last_undegraded":"2024-08-19T00:11:39.918895+0000","last_fullsized":"2024-08-19T00:11:39.918895+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:59:06.617755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913196+0000","last_change":"2024-08-19T00:10:52.520826+0000","last_active":"2024-08-19T00:11:39.913196+0000","last_peered":"2024-08-19T00:11:39.913196+0000","last_clean":"2024-08-19T00:11:39.913196+0000","last_became_active":"2024-08-19T00:10:52.520437+0000","last_became_peered":"2024-08-19T00:10:52.520437+0000","last_unstale":"2024-08-19T00:11:39.913196+0000","last_undegraded":"2024-08-19T00:11:39.913196+0000","last_fullsized":"2024-08-19T00:11:39.913196+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:30:06.843697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"92'35","reported_seq":176,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:12:25.001718+0000","last_change":"2024-08-19T00:10:50.473195+0000","last_active":"2024-08-19T00:12:25.001718+0000","last_peered":"2024-08-19T00:12:25.001718+0000","last_clean":"2024-08-19T00:12:25.001718+0000","last_became_active":"2024-08-19T00:10:50.472863+0000","last_became_peered":"2024-08-19T00:10:50.472863+0000","last_unstale":"2024-08-19T00:12:25.001718+0000","last_undegraded":"2024-08-19T00:12:25.001718+0000","last_fullsized":"2024-08-19T00:12:25.001718+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:09:04.859829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63473,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":107,"num_read_kb":115,"num_write":37,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.922789+0000","last_change":"2024-08-19T00:11:39.922405+0000","last_active":"2024-08-19T00:11:39.922789+0000","last_peered":"2024-08-19T00:11:39.922789+0000","last_clean":"2024-08-19T00:11:39.922789+0000","last_became_active":"2024-08-19T00:11:39.922054+0000","last_became_peered":"2024-08-19T00:11:39.922054+0000","last_unstale":"2024-08-19T00:11:39.922789+0000","last_undegraded":"2024-08-19T00:11:39.922789+0000","last_fullsized":"2024-08-19T00:11:39.922789+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:47:01.990229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.918080+0000","last_change":"2024-08-19T00:11:39.918080+0000","last_active":"2024-08-19T00:11:39.918080+0000","last_peered":"2024-08-19T00:11:39.918080+0000","last_clean":"2024-08-19T00:11:39.918080+0000","last_became_active":"2024-08-19T00:11:39.917742+0000","last_became_peered":"2024-08-19T00:11:39.917742+0000","last_unstale":"2024-08-19T00:11:39.918080+0000","last_undegraded":"2024-08-19T00:11:39.918080+0000","last_fullsized":"2024-08-19T00:11:39.918080+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:57:19.983148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"90'5","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.919164+0000","last_change":"2024-08-19T00:10:50.618094+0000","last_active":"2024-08-19T00:11:39.919164+0000","last_peered":"2024-08-19T00:11:39.919164+0000","last_clean":"2024-08-19T00:11:39.919164+0000","last_became_active":"2024-08-19T00:10:50.617786+0000","last_became_peered":"2024-08-19T00:10:50.617786+0000","last_unstale":"2024-08-19T00:11:39.919164+0000","last_undegraded":"2024-08-19T00:11:39.919164+0000","last_fullsized":"2024-08-19T00:11:39.919164+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:05:46.231214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915705+0000","last_change":"2024-08-19T00:10:59.780786+0000","last_active":"2024-08-19T00:11:39.915705+0000","last_peered":"2024-08-19T00:11:39.915705+0000","last_clean":"2024-08-19T00:11:39.915705+0000","last_became_active":"2024-08-19T00:10:59.780364+0000","last_became_peered":"2024-08-19T00:10:59.780364+0000","last_unstale":"2024-08-19T00:11:39.915705+0000","last_undegraded":"2024-08-19T00:11:39.915705+0000","last_fullsized":"2024-08-19T00:11:39.915705+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:39:45.113590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916082+0000","last_change":"2024-08-19T00:10:52.520623+0000","last_active":"2024-08-19T00:11:39.916082+0000","last_peered":"2024-08-19T00:11:39.916082+0000","last_clean":"2024-08-19T00:11:39.916082+0000","last_became_active":"2024-08-19T00:10:52.520321+0000","last_became_peered":"2024-08-19T00:10:52.520321+0000","last_unstale":"2024-08-19T00:11:39.916082+0000","last_undegraded":"2024-08-19T00:11:39.916082+0000","last_fullsized":"2024-08-19T00:11:39.916082+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:56:42.526199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"90'4","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920887+0000","last_change":"2024-08-19T00:10:50.474925+0000","last_active":"2024-08-19T00:11:39.920887+0000","last_peered":"2024-08-19T00:11:39.920887+0000","last_clean":"2024-08-19T00:11:39.920887+0000","last_became_active":"2024-08-19T00:10:50.474573+0000","last_became_peered":"2024-08-19T00:10:50.474573+0000","last_unstale":"2024-08-19T00:11:39.920887+0000","last_undegraded":"2024-08-19T00:11:39.920887+0000","last_fullsized":"2024-08-19T00:11:39.920887+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:10:32.136867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920527+0000","last_change":"2024-08-19T00:11:39.920527+0000","last_active":"2024-08-19T00:11:39.920527+0000","last_peered":"2024-08-19T00:11:39.920527+0000","last_clean":"2024-08-19T00:11:39.920527+0000","last_became_active":"2024-08-19T00:11:39.919490+0000","last_became_peered":"2024-08-19T00:11:39.919490+0000","last_unstale":"2024-08-19T00:11:39.920527+0000","last_undegraded":"2024-08-19T00:11:39.920527+0000","last_fullsized":"2024-08-19T00:11:39.920527+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:33:09.191177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913768+0000","last_change":"2024-08-19T00:10:52.510783+0000","last_active":"2024-08-19T00:11:39.913768+0000","last_peered":"2024-08-19T00:11:39.913768+0000","last_clean":"2024-08-19T00:11:39.913768+0000","last_became_active":"2024-08-19T00:10:52.510359+0000","last_became_peered":"2024-08-19T00:10:52.510359+0000","last_unstale":"2024-08-19T00:11:39.913768+0000","last_undegraded":"2024-08-19T00:11:39.913768+0000","last_fullsized":"2024-08-19T00:11:39.913768+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:20:03.682633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"90'4","reported_seq":136,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:12:24.983352+0000","last_change":"2024-08-19T00:10:50.470887+0000","last_active":"2024-08-19T00:12:24.983352+0000","last_peered":"2024-08-19T00:12:24.983352+0000","last_clean":"2024-08-19T00:12:24.983352+0000","last_became_active":"2024-08-19T00:10:50.470517+0000","last_became_peered":"2024-08-19T00:10:50.470517+0000","last_unstale":"2024-08-19T00:12:24.983352+0000","last_undegraded":"2024-08-19T00:12:24.983352+0000","last_fullsized":"2024-08-19T00:12:24.983352+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:52:33.864552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915676+0000","last_change":"2024-08-19T00:10:59.787686+0000","last_active":"2024-08-19T00:11:39.915676+0000","last_peered":"2024-08-19T00:11:39.915676+0000","last_clean":"2024-08-19T00:11:39.915676+0000","last_became_active":"2024-08-19T00:10:59.787236+0000","last_became_peered":"2024-08-19T00:10:59.787236+0000","last_unstale":"2024-08-19T00:11:39.915676+0000","last_undegraded":"2024-08-19T00:11:39.915676+0000","last_fullsized":"2024-08-19T00:11:39.915676+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:57:11.012865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916402+0000","last_change":"2024-08-19T00:10:59.782541+0000","last_active":"2024-08-19T00:11:39.916402+0000","last_peered":"2024-08-19T00:11:39.916402+0000","last_clean":"2024-08-19T00:11:39.916402+0000","last_became_active":"2024-08-19T00:10:59.782136+0000","last_became_peered":"2024-08-19T00:10:59.782136+0000","last_unstale":"2024-08-19T00:11:39.916402+0000","last_undegraded":"2024-08-19T00:11:39.916402+0000","last_fullsized":"2024-08-19T00:11:39.916402+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:44:39.501168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.910189+0000","last_change":"2024-08-19T00:10:52.509396+0000","last_active":"2024-08-19T00:11:39.910189+0000","last_peered":"2024-08-19T00:11:39.910189+0000","last_clean":"2024-08-19T00:11:39.910189+0000","last_became_active":"2024-08-19T00:10:52.509075+0000","last_became_peered":"2024-08-19T00:10:52.509075+0000","last_unstale":"2024-08-19T00:11:39.910189+0000","last_undegraded":"2024-08-19T00:11:39.910189+0000","last_fullsized":"2024-08-19T00:11:39.910189+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:40:53.611213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"90'3","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920355+0000","last_change":"2024-08-19T00:10:50.476723+0000","last_active":"2024-08-19T00:11:39.920355+0000","last_peered":"2024-08-19T00:11:39.920355+0000","last_clean":"2024-08-19T00:11:39.920355+0000","last_became_active":"2024-08-19T00:10:50.476399+0000","last_became_peered":"2024-08-19T00:10:50.476399+0000","last_unstale":"2024-08-19T00:11:39.920355+0000","last_undegraded":"2024-08-19T00:11:39.920355+0000","last_fullsized":"2024-08-19T00:11:39.920355+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:04:01.951387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913044+0000","last_change":"2024-08-19T00:10:59.781481+0000","last_active":"2024-08-19T00:11:39.913044+0000","last_peered":"2024-08-19T00:11:39.913044+0000","last_clean":"2024-08-19T00:11:39.913044+0000","last_became_active":"2024-08-19T00:10:59.780160+0000","last_became_peered":"2024-08-19T00:10:59.780160+0000","last_unstale":"2024-08-19T00:11:39.913044+0000","last_undegraded":"2024-08-19T00:11:39.913044+0000","last_fullsized":"2024-08-19T00:11:39.913044+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:14:46.340158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915284+0000","last_change":"2024-08-19T00:10:52.516780+0000","last_active":"2024-08-19T00:11:39.915284+0000","last_peered":"2024-08-19T00:11:39.915284+0000","last_clean":"2024-08-19T00:11:39.915284+0000","last_became_active":"2024-08-19T00:10:52.513264+0000","last_became_peered":"2024-08-19T00:10:52.513264+0000","last_unstale":"2024-08-19T00:11:39.915284+0000","last_undegraded":"2024-08-19T00:11:39.915284+0000","last_fullsized":"2024-08-19T00:11:39.915284+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:36:49.238267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"90'3","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.912619+0000","last_change":"2024-08-19T00:10:50.472840+0000","last_active":"2024-08-19T00:11:39.912619+0000","last_peered":"2024-08-19T00:11:39.912619+0000","last_clean":"2024-08-19T00:11:39.912619+0000","last_became_active":"2024-08-19T00:10:50.472534+0000","last_became_peered":"2024-08-19T00:10:50.472534+0000","last_unstale":"2024-08-19T00:11:39.912619+0000","last_undegraded":"2024-08-19T00:11:39.912619+0000","last_fullsized":"2024-08-19T00:11:39.912619+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:41:53.505360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.911662+0000","last_change":"2024-08-19T00:10:50.469342+0000","last_active":"2024-08-19T00:11:39.911662+0000","last_peered":"2024-08-19T00:11:39.911662+0000","last_clean":"2024-08-19T00:11:39.911662+0000","last_became_active":"2024-08-19T00:10:50.468800+0000","last_became_peered":"2024-08-19T00:10:50.468800+0000","last_unstale":"2024-08-19T00:11:39.911662+0000","last_undegraded":"2024-08-19T00:11:39.911662+0000","last_fullsized":"2024-08-19T00:11:39.911662+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:58:28.804117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920904+0000","last_change":"2024-08-19T00:10:52.523634+0000","last_active":"2024-08-19T00:11:39.920904+0000","last_peered":"2024-08-19T00:11:39.920904+0000","last_clean":"2024-08-19T00:11:39.920904+0000","last_became_active":"2024-08-19T00:10:52.523336+0000","last_became_peered":"2024-08-19T00:10:52.523336+0000","last_unstale":"2024-08-19T00:11:39.920904+0000","last_undegraded":"2024-08-19T00:11:39.920904+0000","last_fullsized":"2024-08-19T00:11:39.920904+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:55:08.994124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.922401+0000","last_change":"2024-08-19T00:11:39.922401+0000","last_active":"2024-08-19T00:11:39.922401+0000","last_peered":"2024-08-19T00:11:39.922401+0000","last_clean":"2024-08-19T00:11:39.922401+0000","last_became_active":"2024-08-19T00:11:39.921979+0000","last_became_peered":"2024-08-19T00:11:39.921979+0000","last_unstale":"2024-08-19T00:11:39.922401+0000","last_undegraded":"2024-08-19T00:11:39.922401+0000","last_fullsized":"2024-08-19T00:11:39.922401+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:58:57.453222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,8],"acting":[2,6,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"90'5","reported_seq":91,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:12:24.984318+0000","last_change":"2024-08-19T00:10:50.476035+0000","last_active":"2024-08-19T00:12:24.984318+0000","last_peered":"2024-08-19T00:12:24.984318+0000","last_clean":"2024-08-19T00:12:24.984318+0000","last_became_active":"2024-08-19T00:10:50.475733+0000","last_became_peered":"2024-08-19T00:10:50.475733+0000","last_unstale":"2024-08-19T00:12:24.984318+0000","last_undegraded":"2024-08-19T00:12:24.984318+0000","last_fullsized":"2024-08-19T00:12:24.984318+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:27:59.026582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.914126+0000","last_change":"2024-08-19T00:10:52.522185+0000","last_active":"2024-08-19T00:11:39.914126+0000","last_peered":"2024-08-19T00:11:39.914126+0000","last_clean":"2024-08-19T00:11:39.914126+0000","last_became_active":"2024-08-19T00:10:52.521747+0000","last_became_peered":"2024-08-19T00:10:52.521747+0000","last_unstale":"2024-08-19T00:11:39.914126+0000","last_undegraded":"2024-08-19T00:11:39.914126+0000","last_fullsized":"2024-08-19T00:11:39.914126+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:14:23.631484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915843+0000","last_change":"2024-08-19T00:10:59.783512+0000","last_active":"2024-08-19T00:11:39.915843+0000","last_peered":"2024-08-19T00:11:39.915843+0000","last_clean":"2024-08-19T00:11:39.915843+0000","last_became_active":"2024-08-19T00:10:59.783099+0000","last_became_peered":"2024-08-19T00:10:59.783099+0000","last_unstale":"2024-08-19T00:11:39.915843+0000","last_undegraded":"2024-08-19T00:11:39.915843+0000","last_fullsized":"2024-08-19T00:11:39.915843+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:02:27.977608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.912816+0000","last_change":"2024-08-19T00:10:52.524213+0000","last_active":"2024-08-19T00:11:39.912816+0000","last_peered":"2024-08-19T00:11:39.912816+0000","last_clean":"2024-08-19T00:11:39.912816+0000","last_became_active":"2024-08-19T00:10:52.523185+0000","last_became_peered":"2024-08-19T00:10:52.523185+0000","last_unstale":"2024-08-19T00:11:39.912816+0000","last_undegraded":"2024-08-19T00:11:39.912816+0000","last_fullsized":"2024-08-19T00:11:39.912816+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:23:48.569312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915774+0000","last_change":"2024-08-19T00:10:52.521436+0000","last_active":"2024-08-19T00:11:39.915774+0000","last_peered":"2024-08-19T00:11:39.915774+0000","last_clean":"2024-08-19T00:11:39.915774+0000","last_became_active":"2024-08-19T00:10:52.520842+0000","last_became_peered":"2024-08-19T00:10:52.520842+0000","last_unstale":"2024-08-19T00:11:39.915774+0000","last_undegraded":"2024-08-19T00:11:39.915774+0000","last_fullsized":"2024-08-19T00:11:39.915774+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:22:31.568680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915897+0000","last_change":"2024-08-19T00:10:52.514170+0000","last_active":"2024-08-19T00:11:39.915897+0000","last_peered":"2024-08-19T00:11:39.915897+0000","last_clean":"2024-08-19T00:11:39.915897+0000","last_became_active":"2024-08-19T00:10:52.513870+0000","last_became_peered":"2024-08-19T00:10:52.513870+0000","last_unstale":"2024-08-19T00:11:39.915897+0000","last_undegraded":"2024-08-19T00:11:39.915897+0000","last_fullsized":"2024-08-19T00:11:39.915897+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:29:04.125347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916321+0000","last_change":"2024-08-19T00:10:52.512320+0000","last_active":"2024-08-19T00:11:39.916321+0000","last_peered":"2024-08-19T00:11:39.916321+0000","last_clean":"2024-08-19T00:11:39.916321+0000","last_became_active":"2024-08-19T00:10:52.512003+0000","last_became_peered":"2024-08-19T00:10:52.512003+0000","last_unstale":"2024-08-19T00:11:39.916321+0000","last_undegraded":"2024-08-19T00:11:39.916321+0000","last_fullsized":"2024-08-19T00:11:39.916321+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:28:52.261457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913084+0000","last_change":"2024-08-19T00:10:52.511454+0000","last_active":"2024-08-19T00:11:39.913084+0000","last_peered":"2024-08-19T00:11:39.913084+0000","last_clean":"2024-08-19T00:11:39.913084+0000","last_became_active":"2024-08-19T00:10:52.511036+0000","last_became_peered":"2024-08-19T00:10:52.511036+0000","last_unstale":"2024-08-19T00:11:39.913084+0000","last_undegraded":"2024-08-19T00:11:39.913084+0000","last_fullsized":"2024-08-19T00:11:39.913084+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:14:04.749222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913672+0000","last_change":"2024-08-19T00:10:52.526393+0000","last_active":"2024-08-19T00:11:39.913672+0000","last_peered":"2024-08-19T00:11:39.913672+0000","last_clean":"2024-08-19T00:11:39.913672+0000","last_became_active":"2024-08-19T00:10:52.526043+0000","last_became_peered":"2024-08-19T00:10:52.526043+0000","last_unstale":"2024-08-19T00:11:39.913672+0000","last_undegraded":"2024-08-19T00:11:39.913672+0000","last_fullsized":"2024-08-19T00:11:39.913672+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:18:48.505255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.918255+0000","last_change":"2024-08-19T00:10:52.516028+0000","last_active":"2024-08-19T00:11:39.918255+0000","last_peered":"2024-08-19T00:11:39.918255+0000","last_clean":"2024-08-19T00:11:39.918255+0000","last_became_active":"2024-08-19T00:10:52.515659+0000","last_became_peered":"2024-08-19T00:10:52.515659+0000","last_unstale":"2024-08-19T00:11:39.918255+0000","last_undegraded":"2024-08-19T00:11:39.918255+0000","last_fullsized":"2024-08-19T00:11:39.918255+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:31:14.995175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916120+0000","last_change":"2024-08-19T00:10:52.516196+0000","last_active":"2024-08-19T00:11:39.916120+0000","last_peered":"2024-08-19T00:11:39.916120+0000","last_clean":"2024-08-19T00:11:39.916120+0000","last_became_active":"2024-08-19T00:10:52.515533+0000","last_became_peered":"2024-08-19T00:10:52.515533+0000","last_unstale":"2024-08-19T00:11:39.916120+0000","last_undegraded":"2024-08-19T00:11:39.916120+0000","last_fullsized":"2024-08-19T00:11:39.916120+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:32:25.207184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.918369+0000","last_change":"2024-08-19T00:10:52.527433+0000","last_active":"2024-08-19T00:11:39.918369+0000","last_peered":"2024-08-19T00:11:39.918369+0000","last_clean":"2024-08-19T00:11:39.918369+0000","last_became_active":"2024-08-19T00:10:52.525490+0000","last_became_peered":"2024-08-19T00:10:52.525490+0000","last_unstale":"2024-08-19T00:11:39.918369+0000","last_undegraded":"2024-08-19T00:11:39.918369+0000","last_fullsized":"2024-08-19T00:11:39.918369+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:21:14.545808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915814+0000","last_change":"2024-08-19T00:10:52.515503+0000","last_active":"2024-08-19T00:11:39.915814+0000","last_peered":"2024-08-19T00:11:39.915814+0000","last_clean":"2024-08-19T00:11:39.915814+0000","last_became_active":"2024-08-19T00:10:52.515178+0000","last_became_peered":"2024-08-19T00:10:52.515178+0000","last_unstale":"2024-08-19T00:11:39.915814+0000","last_undegraded":"2024-08-19T00:11:39.915814+0000","last_fullsized":"2024-08-19T00:11:39.915814+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:30:27.825463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913615+0000","last_change":"2024-08-19T00:10:52.515133+0000","last_active":"2024-08-19T00:11:39.913615+0000","last_peered":"2024-08-19T00:11:39.913615+0000","last_clean":"2024-08-19T00:11:39.913615+0000","last_became_active":"2024-08-19T00:10:52.514851+0000","last_became_peered":"2024-08-19T00:10:52.514851+0000","last_unstale":"2024-08-19T00:11:39.913615+0000","last_undegraded":"2024-08-19T00:11:39.913615+0000","last_fullsized":"2024-08-19T00:11:39.913615+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:38:53.593993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913028+0000","last_change":"2024-08-19T00:10:52.512127+0000","last_active":"2024-08-19T00:11:39.913028+0000","last_peered":"2024-08-19T00:11:39.913028+0000","last_clean":"2024-08-19T00:11:39.913028+0000","last_became_active":"2024-08-19T00:10:52.511840+0000","last_became_peered":"2024-08-19T00:10:52.511840+0000","last_unstale":"2024-08-19T00:11:39.913028+0000","last_undegraded":"2024-08-19T00:11:39.913028+0000","last_fullsized":"2024-08-19T00:11:39.913028+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:36:32.878531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913944+0000","last_change":"2024-08-19T00:10:52.519470+0000","last_active":"2024-08-19T00:11:39.913944+0000","last_peered":"2024-08-19T00:11:39.913944+0000","last_clean":"2024-08-19T00:11:39.913944+0000","last_became_active":"2024-08-19T00:10:52.519131+0000","last_became_peered":"2024-08-19T00:10:52.519131+0000","last_unstale":"2024-08-19T00:11:39.913944+0000","last_undegraded":"2024-08-19T00:11:39.913944+0000","last_fullsized":"2024-08-19T00:11:39.913944+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:56:53.628868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915974+0000","last_change":"2024-08-19T00:10:52.511114+0000","last_active":"2024-08-19T00:11:39.915974+0000","last_peered":"2024-08-19T00:11:39.915974+0000","last_clean":"2024-08-19T00:11:39.915974+0000","last_became_active":"2024-08-19T00:10:52.510759+0000","last_became_peered":"2024-08-19T00:10:52.510759+0000","last_unstale":"2024-08-19T00:11:39.915974+0000","last_undegraded":"2024-08-19T00:11:39.915974+0000","last_fullsized":"2024-08-19T00:11:39.915974+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:54:10.590297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.910810+0000","last_change":"2024-08-19T00:10:52.507998+0000","last_active":"2024-08-19T00:11:39.910810+0000","last_peered":"2024-08-19T00:11:39.910810+0000","last_clean":"2024-08-19T00:11:39.910810+0000","last_became_active":"2024-08-19T00:10:52.507679+0000","last_became_peered":"2024-08-19T00:10:52.507679+0000","last_unstale":"2024-08-19T00:11:39.910810+0000","last_undegraded":"2024-08-19T00:11:39.910810+0000","last_fullsized":"2024-08-19T00:11:39.910810+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:59:48.098911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913458+0000","last_change":"2024-08-19T00:10:52.524171+0000","last_active":"2024-08-19T00:11:39.913458+0000","last_peered":"2024-08-19T00:11:39.913458+0000","last_clean":"2024-08-19T00:11:39.913458+0000","last_became_active":"2024-08-19T00:10:52.523028+0000","last_became_peered":"2024-08-19T00:10:52.523028+0000","last_unstale":"2024-08-19T00:11:39.913458+0000","last_undegraded":"2024-08-19T00:11:39.913458+0000","last_fullsized":"2024-08-19T00:11:39.913458+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:51:24.567971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913253+0000","last_change":"2024-08-19T00:10:52.514309+0000","last_active":"2024-08-19T00:11:39.913253+0000","last_peered":"2024-08-19T00:11:39.913253+0000","last_clean":"2024-08-19T00:11:39.913253+0000","last_became_active":"2024-08-19T00:10:52.513992+0000","last_became_peered":"2024-08-19T00:10:52.513992+0000","last_unstale":"2024-08-19T00:11:39.913253+0000","last_undegraded":"2024-08-19T00:11:39.913253+0000","last_fullsized":"2024-08-19T00:11:39.913253+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:34:14.014490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915278+0000","last_change":"2024-08-19T00:10:52.516033+0000","last_active":"2024-08-19T00:11:39.915278+0000","last_peered":"2024-08-19T00:11:39.915278+0000","last_clean":"2024-08-19T00:11:39.915278+0000","last_became_active":"2024-08-19T00:10:52.515713+0000","last_became_peered":"2024-08-19T00:10:52.515713+0000","last_unstale":"2024-08-19T00:11:39.915278+0000","last_undegraded":"2024-08-19T00:11:39.915278+0000","last_fullsized":"2024-08-19T00:11:39.915278+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:06:40.832460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915258+0000","last_change":"2024-08-19T00:10:52.518521+0000","last_active":"2024-08-19T00:11:39.915258+0000","last_peered":"2024-08-19T00:11:39.915258+0000","last_clean":"2024-08-19T00:11:39.915258+0000","last_became_active":"2024-08-19T00:10:52.518237+0000","last_became_peered":"2024-08-19T00:10:52.518237+0000","last_unstale":"2024-08-19T00:11:39.915258+0000","last_undegraded":"2024-08-19T00:11:39.915258+0000","last_fullsized":"2024-08-19T00:11:39.915258+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:17:20.569044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.912988+0000","last_change":"2024-08-19T00:10:52.519774+0000","last_active":"2024-08-19T00:11:39.912988+0000","last_peered":"2024-08-19T00:11:39.912988+0000","last_clean":"2024-08-19T00:11:39.912988+0000","last_became_active":"2024-08-19T00:10:52.519456+0000","last_became_peered":"2024-08-19T00:10:52.519456+0000","last_unstale":"2024-08-19T00:11:39.912988+0000","last_undegraded":"2024-08-19T00:11:39.912988+0000","last_fullsized":"2024-08-19T00:11:39.912988+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:47:52.675650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916215+0000","last_change":"2024-08-19T00:10:52.514200+0000","last_active":"2024-08-19T00:11:39.916215+0000","last_peered":"2024-08-19T00:11:39.916215+0000","last_clean":"2024-08-19T00:11:39.916215+0000","last_became_active":"2024-08-19T00:10:52.513821+0000","last_became_peered":"2024-08-19T00:10:52.513821+0000","last_unstale":"2024-08-19T00:11:39.916215+0000","last_undegraded":"2024-08-19T00:11:39.916215+0000","last_fullsized":"2024-08-19T00:11:39.916215+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:15:30.084873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920854+0000","last_change":"2024-08-19T00:10:52.519781+0000","last_active":"2024-08-19T00:11:39.920854+0000","last_peered":"2024-08-19T00:11:39.920854+0000","last_clean":"2024-08-19T00:11:39.920854+0000","last_became_active":"2024-08-19T00:10:52.519395+0000","last_became_peered":"2024-08-19T00:10:52.519395+0000","last_unstale":"2024-08-19T00:11:39.920854+0000","last_undegraded":"2024-08-19T00:11:39.920854+0000","last_fullsized":"2024-08-19T00:11:39.920854+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:10:15.160535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.911435+0000","last_change":"2024-08-19T00:10:52.510293+0000","last_active":"2024-08-19T00:11:39.911435+0000","last_peered":"2024-08-19T00:11:39.911435+0000","last_clean":"2024-08-19T00:11:39.911435+0000","last_became_active":"2024-08-19T00:10:52.509983+0000","last_became_peered":"2024-08-19T00:10:52.509983+0000","last_unstale":"2024-08-19T00:11:39.911435+0000","last_undegraded":"2024-08-19T00:11:39.911435+0000","last_fullsized":"2024-08-19T00:11:39.911435+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:59:11.488742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913928+0000","last_change":"2024-08-19T00:10:52.518778+0000","last_active":"2024-08-19T00:11:39.913928+0000","last_peered":"2024-08-19T00:11:39.913928+0000","last_clean":"2024-08-19T00:11:39.913928+0000","last_became_active":"2024-08-19T00:10:52.518209+0000","last_became_peered":"2024-08-19T00:10:52.518209+0000","last_unstale":"2024-08-19T00:11:39.913928+0000","last_undegraded":"2024-08-19T00:11:39.913928+0000","last_fullsized":"2024-08-19T00:11:39.913928+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:23:19.255833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915073+0000","last_change":"2024-08-19T00:10:52.523824+0000","last_active":"2024-08-19T00:11:39.915073+0000","last_peered":"2024-08-19T00:11:39.915073+0000","last_clean":"2024-08-19T00:11:39.915073+0000","last_became_active":"2024-08-19T00:10:52.523075+0000","last_became_peered":"2024-08-19T00:10:52.523075+0000","last_unstale":"2024-08-19T00:11:39.915073+0000","last_undegraded":"2024-08-19T00:11:39.915073+0000","last_fullsized":"2024-08-19T00:11:39.915073+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:23:58.618712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920442+0000","last_change":"2024-08-19T00:10:52.523508+0000","last_active":"2024-08-19T00:11:39.920442+0000","last_peered":"2024-08-19T00:11:39.920442+0000","last_clean":"2024-08-19T00:11:39.920442+0000","last_became_active":"2024-08-19T00:10:52.523104+0000","last_became_peered":"2024-08-19T00:10:52.523104+0000","last_unstale":"2024-08-19T00:11:39.920442+0000","last_undegraded":"2024-08-19T00:11:39.920442+0000","last_fullsized":"2024-08-19T00:11:39.920442+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:04:06.932548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.911625+0000","last_change":"2024-08-19T00:10:52.510147+0000","last_active":"2024-08-19T00:11:39.911625+0000","last_peered":"2024-08-19T00:11:39.911625+0000","last_clean":"2024-08-19T00:11:39.911625+0000","last_became_active":"2024-08-19T00:10:52.509807+0000","last_became_peered":"2024-08-19T00:10:52.509807+0000","last_unstale":"2024-08-19T00:11:39.911625+0000","last_undegraded":"2024-08-19T00:11:39.911625+0000","last_fullsized":"2024-08-19T00:11:39.911625+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:09:55.965318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.912168+0000","last_change":"2024-08-19T00:10:52.512997+0000","last_active":"2024-08-19T00:11:39.912168+0000","last_peered":"2024-08-19T00:11:39.912168+0000","last_clean":"2024-08-19T00:11:39.912168+0000","last_became_active":"2024-08-19T00:10:52.512688+0000","last_became_peered":"2024-08-19T00:10:52.512688+0000","last_unstale":"2024-08-19T00:11:39.912168+0000","last_undegraded":"2024-08-19T00:11:39.912168+0000","last_fullsized":"2024-08-19T00:11:39.912168+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:57:33.607060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916036+0000","last_change":"2024-08-19T00:10:52.517492+0000","last_active":"2024-08-19T00:11:39.916036+0000","last_peered":"2024-08-19T00:11:39.916036+0000","last_clean":"2024-08-19T00:11:39.916036+0000","last_became_active":"2024-08-19T00:10:52.517153+0000","last_became_peered":"2024-08-19T00:10:52.517153+0000","last_unstale":"2024-08-19T00:11:39.916036+0000","last_undegraded":"2024-08-19T00:11:39.916036+0000","last_fullsized":"2024-08-19T00:11:39.916036+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:07:07.244331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915536+0000","last_change":"2024-08-19T00:10:52.517396+0000","last_active":"2024-08-19T00:11:39.915536+0000","last_peered":"2024-08-19T00:11:39.915536+0000","last_clean":"2024-08-19T00:11:39.915536+0000","last_became_active":"2024-08-19T00:10:52.517108+0000","last_became_peered":"2024-08-19T00:10:52.517108+0000","last_unstale":"2024-08-19T00:11:39.915536+0000","last_undegraded":"2024-08-19T00:11:39.915536+0000","last_fullsized":"2024-08-19T00:11:39.915536+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:10:41.477770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916498+0000","last_change":"2024-08-19T00:10:52.515841+0000","last_active":"2024-08-19T00:11:39.916498+0000","last_peered":"2024-08-19T00:11:39.916498+0000","last_clean":"2024-08-19T00:11:39.916498+0000","last_became_active":"2024-08-19T00:10:52.515524+0000","last_became_peered":"2024-08-19T00:10:52.515524+0000","last_unstale":"2024-08-19T00:11:39.916498+0000","last_undegraded":"2024-08-19T00:11:39.916498+0000","last_fullsized":"2024-08-19T00:11:39.916498+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:18:51.991468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913341+0000","last_change":"2024-08-19T00:10:52.522670+0000","last_active":"2024-08-19T00:11:39.913341+0000","last_peered":"2024-08-19T00:11:39.913341+0000","last_clean":"2024-08-19T00:11:39.913341+0000","last_became_active":"2024-08-19T00:10:52.522275+0000","last_became_peered":"2024-08-19T00:10:52.522275+0000","last_unstale":"2024-08-19T00:11:39.913341+0000","last_undegraded":"2024-08-19T00:11:39.913341+0000","last_fullsized":"2024-08-19T00:11:39.913341+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:55:48.756230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69895,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":533,"num_read_kb":342,"num_write":248,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":209685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":213,"ondisk_log_size":213,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449121,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32216,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712936,"statfs":{"total":95995035648,"available":95962046464,"internally_reserved":0,"allocated":1064960,"data_stored":518821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":71,"seq":304942678052,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32888,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712264,"statfs":{"total":95995035648,"available":95961358336,"internally_reserved":0,"allocated":1753088,"data_stored":1168998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":65,"seq":279172874282,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28076,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717076,"statfs":{"total":95995035648,"available":95966285824,"internally_reserved":0,"allocated":1085440,"data_stored":522735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135917,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1069056,"data_stored":518905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397554,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36972,"kb_used_data":1636,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708180,"statfs":{"total":95995035648,"available":95957176320,"internally_reserved":0,"allocated":1675264,"data_stored":1115123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561079,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1056768,"data_stored":514143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822715,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32828,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712324,"statfs":{"total":95995035648,"available":95961419776,"internally_reserved":0,"allocated":1683456,"data_stored":1110705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986240,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36376,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708776,"statfs":{"total":95995035648,"available":95957786624,"internally_reserved":0,"allocated":1064960,"data_stored":518217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215172,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36380,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708772,"statfs":{"total":95995035648,"available":95957782528,"internally_reserved":0,"allocated":1069056,"data_stored":513851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411400,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36456,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708696,"statfs":{"total":95995035648,"available":95957704704,"internally_reserved":0,"allocated":1146880,"data_stored":578866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574925,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28116,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717036,"statfs":{"total":95995035648,"available":95966244864,"internally_reserved":0,"allocated":1126400,"data_stored":578646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738449,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36400,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708752,"statfs":{"total":95995035648,"available":95957762048,"internally_reserved":0,"allocated":1081344,"data_stored":515599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":65225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":65445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":65209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-19T00:12:30.258 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph pg dump --format=json 2024-08-19T00:12:30.515 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:12:30.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:30 smithi044 ceph-mon[18489]: pgmap v317: 129 pgs: 129 active+clean; 645 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-19T00:12:30.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:30 smithi171 ceph-mon[21810]: pgmap v317: 129 pgs: 129 active+clean; 645 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-19T00:12:30.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:30 smithi116 ceph-mon[21873]: pgmap v317: 129 pgs: 129 active+clean; 645 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-19T00:12:31.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:31.008+0000 7f71e5dfa640 1 -- 172.21.15.44:0/3389154786 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71e01078c0 msgr2=0x7f71e0107ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:31.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:31.008+0000 7f71e5dfa640 1 --2- 172.21.15.44:0/3389154786 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71e01078c0 0x7f71e0107ca0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f71d0009cd0 tx=0x7f71d002a8e0 comp rx=0 tx=0).stop 2024-08-19T00:12:31.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:31.008+0000 7f71e5dfa640 1 -- 172.21.15.44:0/3389154786 shutdown_connections 2024-08-19T00:12:31.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:31.008+0000 7f71e5dfa640 1 --2- 172.21.15.44:0/3389154786 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f71e01018c0 0x7f71e0101d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:31.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:31.008+0000 7f71e5dfa640 1 --2- 172.21.15.44:0/3389154786 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f71e0102260 0x7f71e010e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:31.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:31.008+0000 7f71e5dfa640 1 --2- 172.21.15.44:0/3389154786 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71e01078c0 0x7f71e0107ca0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:31.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:31.008+0000 7f71e5dfa640 1 -- 172.21.15.44:0/3389154786 >> 172.21.15.44:0/3389154786 conn(0x7f71e00fd620 msgr2=0x7f71e00ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:31.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:31.008+0000 7f71e5dfa640 1 -- 172.21.15.44:0/3389154786 shutdown_connections 2024-08-19T00:12:31.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:31.008+0000 7f71e5dfa640 1 -- 172.21.15.44:0/3389154786 wait complete. 2024-08-19T00:12:31.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:31.009+0000 7f71e5dfa640 1 Processor -- start 2024-08-19T00:12:31.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:31.009+0000 7f71e5dfa640 1 -- start start 2024-08-19T00:12:31.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:31.009+0000 7f71e5dfa640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71e01018c0 0x7f71e01981c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:31.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:31.009+0000 7f71e5dfa640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f71e0102260 0x7f71e0198700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:31.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:31.009+0000 7f71e5dfa640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f71e01078c0 0x7f71e019ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:31.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:31.009+0000 7f71e5dfa640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f71e0111ce0 con 0x7f71e01018c0 2024-08-19T00:12:31.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:31.009+0000 7f71e5dfa640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f71e0111b60 con 0x7f71e01078c0 2024-08-19T00:12:31.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:31.009+0000 7f71e5dfa640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f71e0111e60 con 0x7f71e0102260 2024-08-19T00:12:31.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:31.010+0000 7f71df7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71e01018c0 0x7f71e01981c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:31.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:31.010+0000 7f71df7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71e01018c0 0x7f71e01981c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50896/0 (socket says 172.21.15.44:50896) 2024-08-19T00:12:31.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:31.010+0000 7f71df7fe640 1 -- 172.21.15.44:0/3769116489 learned_addr learned my addr 172.21.15.44:0/3769116489 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:12:31.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:31.010+0000 7f71deffd640 1 --2- 172.21.15.44:0/3769116489 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f71e0102260 0x7f71e0198700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:31.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:31.010+0000 7f71dffff640 1 --2- 172.21.15.44:0/3769116489 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f71e01078c0 0x7f71e019ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:31.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:31.010+0000 7f71df7fe640 1 -- 172.21.15.44:0/3769116489 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f71e0102260 msgr2=0x7f71e0198700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:31.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:31.010+0000 7f71df7fe640 1 --2- 172.21.15.44:0/3769116489 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f71e0102260 0x7f71e0198700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:31.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:31.010+0000 7f71df7fe640 1 -- 172.21.15.44:0/3769116489 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f71e01078c0 msgr2=0x7f71e019ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:31.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:31.010+0000 7f71df7fe640 1 --2- 172.21.15.44:0/3769116489 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f71e01078c0 0x7f71e019ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:31.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:31.010+0000 7f71df7fe640 1 -- 172.21.15.44:0/3769116489 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71e019d170 con 0x7f71e01018c0 2024-08-19T00:12:31.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:31.010+0000 7f71df7fe640 1 --2- 172.21.15.44:0/3769116489 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71e01018c0 0x7f71e01981c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f71d002ae00 tx=0x7f71d0003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:31.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:31.010+0000 7f71dcff9640 1 -- 172.21.15.44:0/3769116489 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d0004240 con 0x7f71e01018c0 2024-08-19T00:12:31.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:31.010+0000 7f71dcff9640 1 -- 172.21.15.44:0/3769116489 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71d00305a0 con 0x7f71e01018c0 2024-08-19T00:12:31.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:31.010+0000 7f71e5dfa640 1 -- 172.21.15.44:0/3769116489 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71e019d400 con 0x7f71e01018c0 2024-08-19T00:12:31.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:31.010+0000 7f71dcff9640 1 -- 172.21.15.44:0/3769116489 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d003a660 con 0x7f71e01018c0 2024-08-19T00:12:31.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:31.010+0000 7f71e5dfa640 1 -- 172.21.15.44:0/3769116489 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71e01a4d40 con 0x7f71e01018c0 2024-08-19T00:12:31.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:31.011+0000 7f71e5dfa640 1 -- 172.21.15.44:0/3769116489 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71e0101d20 con 0x7f71e01018c0 2024-08-19T00:12:31.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:31.013+0000 7f71dcff9640 1 -- 172.21.15.44:0/3769116489 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f71d0030ac0 con 0x7f71e01018c0 2024-08-19T00:12:31.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:31.013+0000 7f71dcff9640 1 --2- 172.21.15.44:0/3769116489 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f71c80a2c90 0x7f71c80a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:31.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:31.013+0000 7f71dcff9640 1 -- 172.21.15.44:0/3769116489 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f71d002e030 con 0x7f71e01018c0 2024-08-19T00:12:31.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:31.013+0000 7f71deffd640 1 --2- 172.21.15.44:0/3769116489 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f71c80a2c90 0x7f71c80a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:31.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:31.014+0000 7f71deffd640 1 --2- 172.21.15.44:0/3769116489 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f71c80a2c90 0x7f71c80a5150 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f71e00ffba0 tx=0x7f71d400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:31.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:31.017+0000 7f71dcff9640 1 -- 172.21.15.44:0/3769116489 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f71d00098b0 con 0x7f71e01018c0 2024-08-19T00:12:31.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:31.189+0000 7f71e5dfa640 1 -- 172.21.15.44:0/3769116489 --> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f71e0109eb0 con 0x7f71c80a2c90 2024-08-19T00:12:31.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:31.198+0000 7f71dcff9640 1 -- 172.21.15.44:0/3769116489 <== mgr.14150 v2:172.21.15.44:6800/1330072146 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340394 (secure 0 0 0) 0x7f71e0109eb0 con 0x7f71c80a2c90 2024-08-19T00:12:31.202 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:12:31.204 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-08-19T00:12:31.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:31.201+0000 7f71e5dfa640 1 -- 172.21.15.44:0/3769116489 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f71c80a2c90 msgr2=0x7f71c80a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:31.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:31.201+0000 7f71e5dfa640 1 --2- 172.21.15.44:0/3769116489 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f71c80a2c90 0x7f71c80a5150 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f71e00ffba0 tx=0x7f71d400a2d0 comp rx=0 tx=0).stop 2024-08-19T00:12:31.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:31.201+0000 7f71e5dfa640 1 -- 172.21.15.44:0/3769116489 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71e01018c0 msgr2=0x7f71e01981c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:31.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:31.201+0000 7f71e5dfa640 1 --2- 172.21.15.44:0/3769116489 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71e01018c0 0x7f71e01981c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f71d002ae00 tx=0x7f71d0003ba0 comp rx=0 tx=0).stop 2024-08-19T00:12:31.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:31.201+0000 7f71e5dfa640 1 -- 172.21.15.44:0/3769116489 shutdown_connections 2024-08-19T00:12:31.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:31.201+0000 7f71e5dfa640 1 --2- 172.21.15.44:0/3769116489 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f71c80a2c90 0x7f71c80a5150 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:31.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:31.201+0000 7f71e5dfa640 1 --2- 172.21.15.44:0/3769116489 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f71e0102260 0x7f71e0198700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:31.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:31.201+0000 7f71e5dfa640 1 --2- 172.21.15.44:0/3769116489 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f71e01078c0 0x7f71e019ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:31.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:31.201+0000 7f71e5dfa640 1 --2- 172.21.15.44:0/3769116489 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71e01018c0 0x7f71e01981c0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:31.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:31.201+0000 7f71e5dfa640 1 -- 172.21.15.44:0/3769116489 >> 172.21.15.44:0/3769116489 conn(0x7f71e00fd620 msgr2=0x7f71e00fde20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:31.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:31.201+0000 7f71e5dfa640 1 -- 172.21.15.44:0/3769116489 shutdown_connections 2024-08-19T00:12:31.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:31.201+0000 7f71e5dfa640 1 -- 172.21.15.44:0/3769116489 wait complete. 2024-08-19T00:12:31.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:31 smithi171 ceph-mon[21810]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-19T00:12:31.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:31 smithi116 ceph-mon[21873]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-19T00:12:31.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:31 smithi044 ceph-mon[18489]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-19T00:12:31.967 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":318,"stamp":"2024-08-19T00:12:30.488698+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660497,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":699,"num_read_kb":481,"num_write":431,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1180848,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":352,"ondisk_log_size":352,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":392820,"kb_used_data":14528,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124549004,"statfs":{"total":1151940427776,"available":1151538180096,"internally_reserved":0,"allocated":14876672,"data_stored":8174609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":387233081},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":70,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003344"},"pg_stats":[{"pgid":"2.1f","version":"90'13","reported_seq":100,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:12:26.979303+0000","last_change":"2024-08-19T00:10:50.471635+0000","last_active":"2024-08-19T00:12:26.979303+0000","last_peered":"2024-08-19T00:12:26.979303+0000","last_clean":"2024-08-19T00:12:26.979303+0000","last_became_active":"2024-08-19T00:10:50.471324+0000","last_became_peered":"2024-08-19T00:10:50.471324+0000","last_unstale":"2024-08-19T00:12:26.979303+0000","last_undegraded":"2024-08-19T00:12:26.979303+0000","last_fullsized":"2024-08-19T00:12:26.979303+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:41:02.945782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.923007+0000","last_change":"2024-08-19T00:11:39.922459+0000","last_active":"2024-08-19T00:11:39.923007+0000","last_peered":"2024-08-19T00:11:39.923007+0000","last_clean":"2024-08-19T00:11:39.923007+0000","last_became_active":"2024-08-19T00:11:39.922091+0000","last_became_peered":"2024-08-19T00:11:39.922091+0000","last_unstale":"2024-08-19T00:11:39.923007+0000","last_undegraded":"2024-08-19T00:11:39.923007+0000","last_fullsized":"2024-08-19T00:11:39.923007+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:14:21.785736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915284+0000","last_change":"2024-08-19T00:10:59.789370+0000","last_active":"2024-08-19T00:11:39.915284+0000","last_peered":"2024-08-19T00:11:39.915284+0000","last_clean":"2024-08-19T00:11:39.915284+0000","last_became_active":"2024-08-19T00:10:59.788901+0000","last_became_peered":"2024-08-19T00:10:59.788901+0000","last_unstale":"2024-08-19T00:11:39.915284+0000","last_undegraded":"2024-08-19T00:11:39.915284+0000","last_fullsized":"2024-08-19T00:11:39.915284+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:15:45.247674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"90'2","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916313+0000","last_change":"2024-08-19T00:10:50.618000+0000","last_active":"2024-08-19T00:11:39.916313+0000","last_peered":"2024-08-19T00:11:39.916313+0000","last_clean":"2024-08-19T00:11:39.916313+0000","last_became_active":"2024-08-19T00:10:50.617648+0000","last_became_peered":"2024-08-19T00:10:50.617648+0000","last_unstale":"2024-08-19T00:11:39.916313+0000","last_undegraded":"2024-08-19T00:11:39.916313+0000","last_fullsized":"2024-08-19T00:11:39.916313+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:39:00.310466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915973+0000","last_change":"2024-08-19T00:10:52.518075+0000","last_active":"2024-08-19T00:11:39.915973+0000","last_peered":"2024-08-19T00:11:39.915973+0000","last_clean":"2024-08-19T00:11:39.915973+0000","last_became_active":"2024-08-19T00:10:52.517735+0000","last_became_peered":"2024-08-19T00:10:52.517735+0000","last_unstale":"2024-08-19T00:11:39.915973+0000","last_undegraded":"2024-08-19T00:11:39.915973+0000","last_fullsized":"2024-08-19T00:11:39.915973+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:02:32.657776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916011+0000","last_change":"2024-08-19T00:10:59.787563+0000","last_active":"2024-08-19T00:11:39.916011+0000","last_peered":"2024-08-19T00:11:39.916011+0000","last_clean":"2024-08-19T00:11:39.916011+0000","last_became_active":"2024-08-19T00:10:59.787143+0000","last_became_peered":"2024-08-19T00:10:59.787143+0000","last_unstale":"2024-08-19T00:11:39.916011+0000","last_undegraded":"2024-08-19T00:11:39.916011+0000","last_fullsized":"2024-08-19T00:11:39.916011+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:41:47.101296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"90'12","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913715+0000","last_change":"2024-08-19T00:10:50.475869+0000","last_active":"2024-08-19T00:11:39.913715+0000","last_peered":"2024-08-19T00:11:39.913715+0000","last_clean":"2024-08-19T00:11:39.913715+0000","last_became_active":"2024-08-19T00:10:50.475550+0000","last_became_peered":"2024-08-19T00:10:50.475550+0000","last_unstale":"2024-08-19T00:11:39.913715+0000","last_undegraded":"2024-08-19T00:11:39.913715+0000","last_fullsized":"2024-08-19T00:11:39.913715+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:47:23.724503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913510+0000","last_change":"2024-08-19T00:10:52.511901+0000","last_active":"2024-08-19T00:11:39.913510+0000","last_peered":"2024-08-19T00:11:39.913510+0000","last_clean":"2024-08-19T00:11:39.913510+0000","last_became_active":"2024-08-19T00:10:52.511595+0000","last_became_peered":"2024-08-19T00:10:52.511595+0000","last_unstale":"2024-08-19T00:11:39.913510+0000","last_undegraded":"2024-08-19T00:11:39.913510+0000","last_fullsized":"2024-08-19T00:11:39.913510+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:57:30.613865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916330+0000","last_change":"2024-08-19T00:10:59.785611+0000","last_active":"2024-08-19T00:11:39.916330+0000","last_peered":"2024-08-19T00:11:39.916330+0000","last_clean":"2024-08-19T00:11:39.916330+0000","last_became_active":"2024-08-19T00:10:59.785105+0000","last_became_peered":"2024-08-19T00:10:59.785105+0000","last_unstale":"2024-08-19T00:11:39.916330+0000","last_undegraded":"2024-08-19T00:11:39.916330+0000","last_fullsized":"2024-08-19T00:11:39.916330+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:05:31.007647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"90'5","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.914125+0000","last_change":"2024-08-19T00:10:50.474439+0000","last_active":"2024-08-19T00:11:39.914125+0000","last_peered":"2024-08-19T00:11:39.914125+0000","last_clean":"2024-08-19T00:11:39.914125+0000","last_became_active":"2024-08-19T00:10:50.473984+0000","last_became_peered":"2024-08-19T00:10:50.473984+0000","last_unstale":"2024-08-19T00:11:39.914125+0000","last_undegraded":"2024-08-19T00:11:39.914125+0000","last_fullsized":"2024-08-19T00:11:39.914125+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:16:06.934392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.918999+0000","last_change":"2024-08-19T00:10:52.521664+0000","last_active":"2024-08-19T00:11:39.918999+0000","last_peered":"2024-08-19T00:11:39.918999+0000","last_clean":"2024-08-19T00:11:39.918999+0000","last_became_active":"2024-08-19T00:10:52.520792+0000","last_became_peered":"2024-08-19T00:10:52.520792+0000","last_unstale":"2024-08-19T00:11:39.918999+0000","last_undegraded":"2024-08-19T00:11:39.918999+0000","last_fullsized":"2024-08-19T00:11:39.918999+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:55:27.199456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915652+0000","last_change":"2024-08-19T00:10:59.789736+0000","last_active":"2024-08-19T00:11:39.915652+0000","last_peered":"2024-08-19T00:11:39.915652+0000","last_clean":"2024-08-19T00:11:39.915652+0000","last_became_active":"2024-08-19T00:10:59.786880+0000","last_became_peered":"2024-08-19T00:10:59.786880+0000","last_unstale":"2024-08-19T00:11:39.915652+0000","last_undegraded":"2024-08-19T00:11:39.915652+0000","last_fullsized":"2024-08-19T00:11:39.915652+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:20:53.615561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920522+0000","last_change":"2024-08-19T00:10:52.519887+0000","last_active":"2024-08-19T00:11:39.920522+0000","last_peered":"2024-08-19T00:11:39.920522+0000","last_clean":"2024-08-19T00:11:39.920522+0000","last_became_active":"2024-08-19T00:10:52.519550+0000","last_became_peered":"2024-08-19T00:10:52.519550+0000","last_unstale":"2024-08-19T00:11:39.920522+0000","last_undegraded":"2024-08-19T00:11:39.920522+0000","last_fullsized":"2024-08-19T00:11:39.920522+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:27:43.493012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"90'4","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.912400+0000","last_change":"2024-08-19T00:10:50.478131+0000","last_active":"2024-08-19T00:11:39.912400+0000","last_peered":"2024-08-19T00:11:39.912400+0000","last_clean":"2024-08-19T00:11:39.912400+0000","last_became_active":"2024-08-19T00:10:50.477826+0000","last_became_peered":"2024-08-19T00:10:50.477826+0000","last_unstale":"2024-08-19T00:11:39.912400+0000","last_undegraded":"2024-08-19T00:11:39.912400+0000","last_fullsized":"2024-08-19T00:11:39.912400+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:41:24.066453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915909+0000","last_change":"2024-08-19T00:10:59.787634+0000","last_active":"2024-08-19T00:11:39.915909+0000","last_peered":"2024-08-19T00:11:39.915909+0000","last_clean":"2024-08-19T00:11:39.915909+0000","last_became_active":"2024-08-19T00:10:59.786508+0000","last_became_peered":"2024-08-19T00:10:59.786508+0000","last_unstale":"2024-08-19T00:11:39.915909+0000","last_undegraded":"2024-08-19T00:11:39.915909+0000","last_fullsized":"2024-08-19T00:11:39.915909+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:50:19.071853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915968+0000","last_change":"2024-08-19T00:10:52.512462+0000","last_active":"2024-08-19T00:11:39.915968+0000","last_peered":"2024-08-19T00:11:39.915968+0000","last_clean":"2024-08-19T00:11:39.915968+0000","last_became_active":"2024-08-19T00:10:52.512139+0000","last_became_peered":"2024-08-19T00:10:52.512139+0000","last_unstale":"2024-08-19T00:11:39.915968+0000","last_undegraded":"2024-08-19T00:11:39.915968+0000","last_fullsized":"2024-08-19T00:11:39.915968+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:39:18.677836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"90'3","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.930568+0000","last_change":"2024-08-19T00:11:39.930130+0000","last_active":"2024-08-19T00:11:39.930568+0000","last_peered":"2024-08-19T00:11:39.930568+0000","last_clean":"2024-08-19T00:11:39.930568+0000","last_became_active":"2024-08-19T00:11:39.919566+0000","last_became_peered":"2024-08-19T00:11:39.919566+0000","last_unstale":"2024-08-19T00:11:39.930568+0000","last_undegraded":"2024-08-19T00:11:39.930568+0000","last_fullsized":"2024-08-19T00:11:39.930568+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:50:25.001784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"92'1","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915887+0000","last_change":"2024-08-19T00:10:59.787455+0000","last_active":"2024-08-19T00:11:39.915887+0000","last_peered":"2024-08-19T00:11:39.915887+0000","last_clean":"2024-08-19T00:11:39.915887+0000","last_became_active":"2024-08-19T00:10:59.787054+0000","last_became_peered":"2024-08-19T00:10:59.787054+0000","last_unstale":"2024-08-19T00:11:39.915887+0000","last_undegraded":"2024-08-19T00:11:39.915887+0000","last_fullsized":"2024-08-19T00:11:39.915887+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:13:31.356220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.912686+0000","last_change":"2024-08-19T00:10:52.520993+0000","last_active":"2024-08-19T00:11:39.912686+0000","last_peered":"2024-08-19T00:11:39.912686+0000","last_clean":"2024-08-19T00:11:39.912686+0000","last_became_active":"2024-08-19T00:10:52.520697+0000","last_became_peered":"2024-08-19T00:10:52.520697+0000","last_unstale":"2024-08-19T00:11:39.912686+0000","last_undegraded":"2024-08-19T00:11:39.912686+0000","last_fullsized":"2024-08-19T00:11:39.912686+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:30:15.408193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915912+0000","last_change":"2024-08-19T00:10:50.470746+0000","last_active":"2024-08-19T00:11:39.915912+0000","last_peered":"2024-08-19T00:11:39.915912+0000","last_clean":"2024-08-19T00:11:39.915912+0000","last_became_active":"2024-08-19T00:10:50.470454+0000","last_became_peered":"2024-08-19T00:10:50.470454+0000","last_unstale":"2024-08-19T00:11:39.915912+0000","last_undegraded":"2024-08-19T00:11:39.915912+0000","last_fullsized":"2024-08-19T00:11:39.915912+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:37:34.718543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.924217+0000","last_change":"2024-08-19T00:11:39.924217+0000","last_active":"2024-08-19T00:11:39.924217+0000","last_peered":"2024-08-19T00:11:39.924217+0000","last_clean":"2024-08-19T00:11:39.924217+0000","last_became_active":"2024-08-19T00:11:39.923541+0000","last_became_peered":"2024-08-19T00:11:39.923541+0000","last_unstale":"2024-08-19T00:11:39.924217+0000","last_undegraded":"2024-08-19T00:11:39.924217+0000","last_fullsized":"2024-08-19T00:11:39.924217+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:29:35.040424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,2,5],"acting":[8,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.914173+0000","last_change":"2024-08-19T00:10:52.516838+0000","last_active":"2024-08-19T00:11:39.914173+0000","last_peered":"2024-08-19T00:11:39.914173+0000","last_clean":"2024-08-19T00:11:39.914173+0000","last_became_active":"2024-08-19T00:10:52.516471+0000","last_became_peered":"2024-08-19T00:10:52.516471+0000","last_unstale":"2024-08-19T00:11:39.914173+0000","last_undegraded":"2024-08-19T00:11:39.914173+0000","last_fullsized":"2024-08-19T00:11:39.914173+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:11:26.974655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"90'2","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913384+0000","last_change":"2024-08-19T00:10:50.618745+0000","last_active":"2024-08-19T00:11:39.913384+0000","last_peered":"2024-08-19T00:11:39.913384+0000","last_clean":"2024-08-19T00:11:39.913384+0000","last_became_active":"2024-08-19T00:10:50.618426+0000","last_became_peered":"2024-08-19T00:10:50.618426+0000","last_unstale":"2024-08-19T00:11:39.913384+0000","last_undegraded":"2024-08-19T00:11:39.913384+0000","last_fullsized":"2024-08-19T00:11:39.913384+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:12:57.777142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916210+0000","last_change":"2024-08-19T00:10:59.793740+0000","last_active":"2024-08-19T00:11:39.916210+0000","last_peered":"2024-08-19T00:11:39.916210+0000","last_clean":"2024-08-19T00:11:39.916210+0000","last_became_active":"2024-08-19T00:10:59.793181+0000","last_became_peered":"2024-08-19T00:10:59.793181+0000","last_unstale":"2024-08-19T00:11:39.916210+0000","last_undegraded":"2024-08-19T00:11:39.916210+0000","last_fullsized":"2024-08-19T00:11:39.916210+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:04:15.429505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916583+0000","last_change":"2024-08-19T00:10:52.512200+0000","last_active":"2024-08-19T00:11:39.916583+0000","last_peered":"2024-08-19T00:11:39.916583+0000","last_clean":"2024-08-19T00:11:39.916583+0000","last_became_active":"2024-08-19T00:10:52.511891+0000","last_became_peered":"2024-08-19T00:10:52.511891+0000","last_unstale":"2024-08-19T00:11:39.916583+0000","last_undegraded":"2024-08-19T00:11:39.916583+0000","last_fullsized":"2024-08-19T00:11:39.916583+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:02:08.400026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"90'7","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916624+0000","last_change":"2024-08-19T00:10:50.476209+0000","last_active":"2024-08-19T00:11:39.916624+0000","last_peered":"2024-08-19T00:11:39.916624+0000","last_clean":"2024-08-19T00:11:39.916624+0000","last_became_active":"2024-08-19T00:10:50.475410+0000","last_became_peered":"2024-08-19T00:10:50.475410+0000","last_unstale":"2024-08-19T00:11:39.916624+0000","last_undegraded":"2024-08-19T00:11:39.916624+0000","last_fullsized":"2024-08-19T00:11:39.916624+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:46:25.093738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915425+0000","last_change":"2024-08-19T00:10:59.786550+0000","last_active":"2024-08-19T00:11:39.915425+0000","last_peered":"2024-08-19T00:11:39.915425+0000","last_clean":"2024-08-19T00:11:39.915425+0000","last_became_active":"2024-08-19T00:10:59.785531+0000","last_became_peered":"2024-08-19T00:10:59.785531+0000","last_unstale":"2024-08-19T00:11:39.915425+0000","last_undegraded":"2024-08-19T00:11:39.915425+0000","last_fullsized":"2024-08-19T00:11:39.915425+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:59:53.605678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916210+0000","last_change":"2024-08-19T00:10:52.514936+0000","last_active":"2024-08-19T00:11:39.916210+0000","last_peered":"2024-08-19T00:11:39.916210+0000","last_clean":"2024-08-19T00:11:39.916210+0000","last_became_active":"2024-08-19T00:10:52.514597+0000","last_became_peered":"2024-08-19T00:10:52.514597+0000","last_unstale":"2024-08-19T00:11:39.916210+0000","last_undegraded":"2024-08-19T00:11:39.916210+0000","last_fullsized":"2024-08-19T00:11:39.916210+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:03:42.275705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"92'16","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:50.514720+0000","last_change":"2024-08-19T00:10:50.470637+0000","last_active":"2024-08-19T00:11:50.514720+0000","last_peered":"2024-08-19T00:11:50.514720+0000","last_clean":"2024-08-19T00:11:50.514720+0000","last_became_active":"2024-08-19T00:10:50.470276+0000","last_became_peered":"2024-08-19T00:10:50.470276+0000","last_unstale":"2024-08-19T00:11:50.514720+0000","last_undegraded":"2024-08-19T00:11:50.514720+0000","last_fullsized":"2024-08-19T00:11:50.514720+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:42:16.186669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.914936+0000","last_change":"2024-08-19T00:10:59.784742+0000","last_active":"2024-08-19T00:11:39.914936+0000","last_peered":"2024-08-19T00:11:39.914936+0000","last_clean":"2024-08-19T00:11:39.914936+0000","last_became_active":"2024-08-19T00:10:59.784372+0000","last_became_peered":"2024-08-19T00:10:59.784372+0000","last_unstale":"2024-08-19T00:11:39.914936+0000","last_undegraded":"2024-08-19T00:11:39.914936+0000","last_fullsized":"2024-08-19T00:11:39.914936+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:58:03.216882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913098+0000","last_change":"2024-08-19T00:10:52.511172+0000","last_active":"2024-08-19T00:11:39.913098+0000","last_peered":"2024-08-19T00:11:39.913098+0000","last_clean":"2024-08-19T00:11:39.913098+0000","last_became_active":"2024-08-19T00:10:52.510816+0000","last_became_peered":"2024-08-19T00:10:52.510816+0000","last_unstale":"2024-08-19T00:11:39.913098+0000","last_undegraded":"2024-08-19T00:11:39.913098+0000","last_fullsized":"2024-08-19T00:11:39.913098+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:31:39.889398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"90'4","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.927139+0000","last_change":"2024-08-19T00:11:39.926806+0000","last_active":"2024-08-19T00:11:39.927139+0000","last_peered":"2024-08-19T00:11:39.927139+0000","last_clean":"2024-08-19T00:11:39.927139+0000","last_became_active":"2024-08-19T00:11:39.917115+0000","last_became_peered":"2024-08-19T00:11:39.917115+0000","last_unstale":"2024-08-19T00:11:39.927139+0000","last_undegraded":"2024-08-19T00:11:39.927139+0000","last_fullsized":"2024-08-19T00:11:39.927139+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:58:19.965471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913673+0000","last_change":"2024-08-19T00:10:59.778996+0000","last_active":"2024-08-19T00:11:39.913673+0000","last_peered":"2024-08-19T00:11:39.913673+0000","last_clean":"2024-08-19T00:11:39.913673+0000","last_became_active":"2024-08-19T00:10:59.778589+0000","last_became_peered":"2024-08-19T00:10:59.778589+0000","last_unstale":"2024-08-19T00:11:39.913673+0000","last_undegraded":"2024-08-19T00:11:39.913673+0000","last_fullsized":"2024-08-19T00:11:39.913673+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:40:23.690051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.911105+0000","last_change":"2024-08-19T00:10:52.512796+0000","last_active":"2024-08-19T00:11:39.911105+0000","last_peered":"2024-08-19T00:11:39.911105+0000","last_clean":"2024-08-19T00:11:39.911105+0000","last_became_active":"2024-08-19T00:10:52.512459+0000","last_became_peered":"2024-08-19T00:10:52.512459+0000","last_unstale":"2024-08-19T00:11:39.911105+0000","last_undegraded":"2024-08-19T00:11:39.911105+0000","last_fullsized":"2024-08-19T00:11:39.911105+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:07:47.124129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"90'1","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.910569+0000","last_change":"2024-08-19T00:10:50.618118+0000","last_active":"2024-08-19T00:11:39.910569+0000","last_peered":"2024-08-19T00:11:39.910569+0000","last_clean":"2024-08-19T00:11:39.910569+0000","last_became_active":"2024-08-19T00:10:50.617759+0000","last_became_peered":"2024-08-19T00:10:50.617759+0000","last_unstale":"2024-08-19T00:11:39.910569+0000","last_undegraded":"2024-08-19T00:11:39.910569+0000","last_fullsized":"2024-08-19T00:11:39.910569+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:38:10.830722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913921+0000","last_change":"2024-08-19T00:10:59.783548+0000","last_active":"2024-08-19T00:11:39.913921+0000","last_peered":"2024-08-19T00:11:39.913921+0000","last_clean":"2024-08-19T00:11:39.913921+0000","last_became_active":"2024-08-19T00:10:59.783091+0000","last_became_peered":"2024-08-19T00:10:59.783091+0000","last_unstale":"2024-08-19T00:11:39.913921+0000","last_undegraded":"2024-08-19T00:11:39.913921+0000","last_fullsized":"2024-08-19T00:11:39.913921+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:26:21.191829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.911097+0000","last_change":"2024-08-19T00:10:52.506703+0000","last_active":"2024-08-19T00:11:39.911097+0000","last_peered":"2024-08-19T00:11:39.911097+0000","last_clean":"2024-08-19T00:11:39.911097+0000","last_became_active":"2024-08-19T00:10:52.506350+0000","last_became_peered":"2024-08-19T00:10:52.506350+0000","last_unstale":"2024-08-19T00:11:39.911097+0000","last_undegraded":"2024-08-19T00:11:39.911097+0000","last_fullsized":"2024-08-19T00:11:39.911097+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:27:17.556128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"90'5","reported_seq":90,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:12:24.976969+0000","last_change":"2024-08-19T00:10:50.478742+0000","last_active":"2024-08-19T00:12:24.976969+0000","last_peered":"2024-08-19T00:12:24.976969+0000","last_clean":"2024-08-19T00:12:24.976969+0000","last_became_active":"2024-08-19T00:10:50.478139+0000","last_became_peered":"2024-08-19T00:10:50.478139+0000","last_unstale":"2024-08-19T00:12:24.976969+0000","last_undegraded":"2024-08-19T00:12:24.976969+0000","last_fullsized":"2024-08-19T00:12:24.976969+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:23:25.727268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":51,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.912795+0000","last_change":"2024-08-19T00:10:59.785350+0000","last_active":"2024-08-19T00:11:39.912795+0000","last_peered":"2024-08-19T00:11:39.912795+0000","last_clean":"2024-08-19T00:11:39.912795+0000","last_became_active":"2024-08-19T00:10:59.784929+0000","last_became_peered":"2024-08-19T00:10:59.784929+0000","last_unstale":"2024-08-19T00:11:39.912795+0000","last_undegraded":"2024-08-19T00:11:39.912795+0000","last_fullsized":"2024-08-19T00:11:39.912795+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:58:49.878253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.924921+0000","last_change":"2024-08-19T00:11:39.924921+0000","last_active":"2024-08-19T00:11:39.924921+0000","last_peered":"2024-08-19T00:11:39.924921+0000","last_clean":"2024-08-19T00:11:39.924921+0000","last_became_active":"2024-08-19T00:11:39.924551+0000","last_became_peered":"2024-08-19T00:11:39.924551+0000","last_unstale":"2024-08-19T00:11:39.924921+0000","last_undegraded":"2024-08-19T00:11:39.924921+0000","last_fullsized":"2024-08-19T00:11:39.924921+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:14:23.042222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"90'5","reported_seq":93,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:12:27.980665+0000","last_change":"2024-08-19T00:10:50.618159+0000","last_active":"2024-08-19T00:12:27.980665+0000","last_peered":"2024-08-19T00:12:27.980665+0000","last_clean":"2024-08-19T00:12:27.980665+0000","last_became_active":"2024-08-19T00:10:50.617828+0000","last_became_peered":"2024-08-19T00:10:50.617828+0000","last_unstale":"2024-08-19T00:12:27.980665+0000","last_undegraded":"2024-08-19T00:12:27.980665+0000","last_fullsized":"2024-08-19T00:12:27.980665+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:36:40.702592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913006+0000","last_change":"2024-08-19T00:10:59.787615+0000","last_active":"2024-08-19T00:11:39.913006+0000","last_peered":"2024-08-19T00:11:39.913006+0000","last_clean":"2024-08-19T00:11:39.913006+0000","last_became_active":"2024-08-19T00:10:59.787184+0000","last_became_peered":"2024-08-19T00:10:59.787184+0000","last_unstale":"2024-08-19T00:11:39.913006+0000","last_undegraded":"2024-08-19T00:11:39.913006+0000","last_fullsized":"2024-08-19T00:11:39.913006+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:20:42.174337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.912608+0000","last_change":"2024-08-19T00:10:52.509235+0000","last_active":"2024-08-19T00:11:39.912608+0000","last_peered":"2024-08-19T00:11:39.912608+0000","last_clean":"2024-08-19T00:11:39.912608+0000","last_became_active":"2024-08-19T00:10:52.508934+0000","last_became_peered":"2024-08-19T00:10:52.508934+0000","last_unstale":"2024-08-19T00:11:39.912608+0000","last_undegraded":"2024-08-19T00:11:39.912608+0000","last_fullsized":"2024-08-19T00:11:39.912608+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:12:59.654711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"90'4","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920451+0000","last_change":"2024-08-19T00:10:50.477180+0000","last_active":"2024-08-19T00:11:39.920451+0000","last_peered":"2024-08-19T00:11:39.920451+0000","last_clean":"2024-08-19T00:11:39.920451+0000","last_became_active":"2024-08-19T00:10:50.476875+0000","last_became_peered":"2024-08-19T00:10:50.476875+0000","last_unstale":"2024-08-19T00:11:39.920451+0000","last_undegraded":"2024-08-19T00:11:39.920451+0000","last_fullsized":"2024-08-19T00:11:39.920451+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:15:57.383599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.919963+0000","last_change":"2024-08-19T00:10:59.783389+0000","last_active":"2024-08-19T00:11:39.919963+0000","last_peered":"2024-08-19T00:11:39.919963+0000","last_clean":"2024-08-19T00:11:39.919963+0000","last_became_active":"2024-08-19T00:10:59.782983+0000","last_became_peered":"2024-08-19T00:10:59.782983+0000","last_unstale":"2024-08-19T00:11:39.919963+0000","last_undegraded":"2024-08-19T00:11:39.919963+0000","last_fullsized":"2024-08-19T00:11:39.919963+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:55:47.419588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916143+0000","last_change":"2024-08-19T00:10:52.517477+0000","last_active":"2024-08-19T00:11:39.916143+0000","last_peered":"2024-08-19T00:11:39.916143+0000","last_clean":"2024-08-19T00:11:39.916143+0000","last_became_active":"2024-08-19T00:10:52.517192+0000","last_became_peered":"2024-08-19T00:10:52.517192+0000","last_unstale":"2024-08-19T00:11:39.916143+0000","last_undegraded":"2024-08-19T00:11:39.916143+0000","last_fullsized":"2024-08-19T00:11:39.916143+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:31:01.125780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"90'6","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916486+0000","last_change":"2024-08-19T00:10:50.476296+0000","last_active":"2024-08-19T00:11:39.916486+0000","last_peered":"2024-08-19T00:11:39.916486+0000","last_clean":"2024-08-19T00:11:39.916486+0000","last_became_active":"2024-08-19T00:10:50.475835+0000","last_became_peered":"2024-08-19T00:10:50.475835+0000","last_unstale":"2024-08-19T00:11:39.916486+0000","last_undegraded":"2024-08-19T00:11:39.916486+0000","last_fullsized":"2024-08-19T00:11:39.916486+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:23:27.585779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":362,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920604+0000","last_change":"2024-08-19T00:09:43.445224+0000","last_active":"2024-08-19T00:11:39.920604+0000","last_peered":"2024-08-19T00:11:39.920604+0000","last_clean":"2024-08-19T00:11:39.920604+0000","last_became_active":"2024-08-19T00:09:43.444826+0000","last_became_peered":"2024-08-19T00:09:43.444826+0000","last_unstale":"2024-08-19T00:11:39.920604+0000","last_undegraded":"2024-08-19T00:11:39.920604+0000","last_fullsized":"2024-08-19T00:11:39.920604+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:06:42.707047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:06:42.707047+0000","last_clean_scrub_stamp":"2024-08-19T00:06:42.707047+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:37:10.588547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"92'1","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920770+0000","last_change":"2024-08-19T00:10:59.783987+0000","last_active":"2024-08-19T00:11:39.920770+0000","last_peered":"2024-08-19T00:11:39.920770+0000","last_clean":"2024-08-19T00:11:39.920770+0000","last_became_active":"2024-08-19T00:10:59.783569+0000","last_became_peered":"2024-08-19T00:10:59.783569+0000","last_unstale":"2024-08-19T00:11:39.920770+0000","last_undegraded":"2024-08-19T00:11:39.920770+0000","last_fullsized":"2024-08-19T00:11:39.920770+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:04:01.744644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920907+0000","last_change":"2024-08-19T00:10:52.516201+0000","last_active":"2024-08-19T00:11:39.920907+0000","last_peered":"2024-08-19T00:11:39.920907+0000","last_clean":"2024-08-19T00:11:39.920907+0000","last_became_active":"2024-08-19T00:10:52.515871+0000","last_became_peered":"2024-08-19T00:10:52.515871+0000","last_unstale":"2024-08-19T00:11:39.920907+0000","last_undegraded":"2024-08-19T00:11:39.920907+0000","last_fullsized":"2024-08-19T00:11:39.920907+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:54:49.528215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"90'5","reported_seq":91,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:12:24.984271+0000","last_change":"2024-08-19T00:10:50.620185+0000","last_active":"2024-08-19T00:12:24.984271+0000","last_peered":"2024-08-19T00:12:24.984271+0000","last_clean":"2024-08-19T00:12:24.984271+0000","last_became_active":"2024-08-19T00:10:50.619858+0000","last_became_peered":"2024-08-19T00:10:50.619858+0000","last_unstale":"2024-08-19T00:12:24.984271+0000","last_undegraded":"2024-08-19T00:12:24.984271+0000","last_fullsized":"2024-08-19T00:12:24.984271+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:30:21.893859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":52,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913286+0000","last_change":"2024-08-19T00:10:59.782056+0000","last_active":"2024-08-19T00:11:39.913286+0000","last_peered":"2024-08-19T00:11:39.913286+0000","last_clean":"2024-08-19T00:11:39.913286+0000","last_became_active":"2024-08-19T00:10:59.781666+0000","last_became_peered":"2024-08-19T00:10:59.781666+0000","last_unstale":"2024-08-19T00:11:39.913286+0000","last_undegraded":"2024-08-19T00:11:39.913286+0000","last_fullsized":"2024-08-19T00:11:39.913286+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:06:15.614372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920745+0000","last_change":"2024-08-19T00:10:52.523346+0000","last_active":"2024-08-19T00:11:39.920745+0000","last_peered":"2024-08-19T00:11:39.920745+0000","last_clean":"2024-08-19T00:11:39.920745+0000","last_became_active":"2024-08-19T00:10:52.523020+0000","last_became_peered":"2024-08-19T00:10:52.523020+0000","last_unstale":"2024-08-19T00:11:39.920745+0000","last_undegraded":"2024-08-19T00:11:39.920745+0000","last_fullsized":"2024-08-19T00:11:39.920745+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:09:58.259666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"90'3","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.919270+0000","last_change":"2024-08-19T00:10:50.471739+0000","last_active":"2024-08-19T00:11:39.919270+0000","last_peered":"2024-08-19T00:11:39.919270+0000","last_clean":"2024-08-19T00:11:39.919270+0000","last_became_active":"2024-08-19T00:10:50.471425+0000","last_became_peered":"2024-08-19T00:10:50.471425+0000","last_unstale":"2024-08-19T00:11:39.919270+0000","last_undegraded":"2024-08-19T00:11:39.919270+0000","last_fullsized":"2024-08-19T00:11:39.919270+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:55:26.332380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916291+0000","last_change":"2024-08-19T00:10:59.788685+0000","last_active":"2024-08-19T00:11:39.916291+0000","last_peered":"2024-08-19T00:11:39.916291+0000","last_clean":"2024-08-19T00:11:39.916291+0000","last_became_active":"2024-08-19T00:10:59.788343+0000","last_became_peered":"2024-08-19T00:10:59.788343+0000","last_unstale":"2024-08-19T00:11:39.916291+0000","last_undegraded":"2024-08-19T00:11:39.916291+0000","last_fullsized":"2024-08-19T00:11:39.916291+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:20:59.595494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920867+0000","last_change":"2024-08-19T00:10:52.516469+0000","last_active":"2024-08-19T00:11:39.920867+0000","last_peered":"2024-08-19T00:11:39.920867+0000","last_clean":"2024-08-19T00:11:39.920867+0000","last_became_active":"2024-08-19T00:10:52.516093+0000","last_became_peered":"2024-08-19T00:10:52.516093+0000","last_unstale":"2024-08-19T00:11:39.920867+0000","last_undegraded":"2024-08-19T00:11:39.920867+0000","last_fullsized":"2024-08-19T00:11:39.920867+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:18:29.327336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"90'5","reported_seq":51,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.921825+0000","last_change":"2024-08-19T00:11:39.921825+0000","last_active":"2024-08-19T00:11:39.921825+0000","last_peered":"2024-08-19T00:11:39.921825+0000","last_clean":"2024-08-19T00:11:39.921825+0000","last_became_active":"2024-08-19T00:11:39.917689+0000","last_became_peered":"2024-08-19T00:11:39.917689+0000","last_unstale":"2024-08-19T00:11:39.921825+0000","last_undegraded":"2024-08-19T00:11:39.921825+0000","last_fullsized":"2024-08-19T00:11:39.921825+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:37:47.940707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.918104+0000","last_change":"2024-08-19T00:10:59.785347+0000","last_active":"2024-08-19T00:11:39.918104+0000","last_peered":"2024-08-19T00:11:39.918104+0000","last_clean":"2024-08-19T00:11:39.918104+0000","last_became_active":"2024-08-19T00:10:59.784927+0000","last_became_peered":"2024-08-19T00:10:59.784927+0000","last_unstale":"2024-08-19T00:11:39.918104+0000","last_undegraded":"2024-08-19T00:11:39.918104+0000","last_fullsized":"2024-08-19T00:11:39.918104+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:39:41.919021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.912923+0000","last_change":"2024-08-19T00:10:52.524460+0000","last_active":"2024-08-19T00:11:39.912923+0000","last_peered":"2024-08-19T00:11:39.912923+0000","last_clean":"2024-08-19T00:11:39.912923+0000","last_became_active":"2024-08-19T00:10:52.523139+0000","last_became_peered":"2024-08-19T00:10:52.523139+0000","last_unstale":"2024-08-19T00:11:39.912923+0000","last_undegraded":"2024-08-19T00:11:39.912923+0000","last_fullsized":"2024-08-19T00:11:39.912923+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:50:55.142569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"90'2","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.912963+0000","last_change":"2024-08-19T00:10:50.474977+0000","last_active":"2024-08-19T00:11:39.912963+0000","last_peered":"2024-08-19T00:11:39.912963+0000","last_clean":"2024-08-19T00:11:39.912963+0000","last_became_active":"2024-08-19T00:10:50.474653+0000","last_became_peered":"2024-08-19T00:10:50.474653+0000","last_unstale":"2024-08-19T00:11:39.912963+0000","last_undegraded":"2024-08-19T00:11:39.912963+0000","last_fullsized":"2024-08-19T00:11:39.912963+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:20:31.565098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920595+0000","last_change":"2024-08-19T00:10:59.789912+0000","last_active":"2024-08-19T00:11:39.920595+0000","last_peered":"2024-08-19T00:11:39.920595+0000","last_clean":"2024-08-19T00:11:39.920595+0000","last_became_active":"2024-08-19T00:10:59.789143+0000","last_became_peered":"2024-08-19T00:10:59.789143+0000","last_unstale":"2024-08-19T00:11:39.920595+0000","last_undegraded":"2024-08-19T00:11:39.920595+0000","last_fullsized":"2024-08-19T00:11:39.920595+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:06:53.447173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920777+0000","last_change":"2024-08-19T00:10:52.525061+0000","last_active":"2024-08-19T00:11:39.920777+0000","last_peered":"2024-08-19T00:11:39.920777+0000","last_clean":"2024-08-19T00:11:39.920777+0000","last_became_active":"2024-08-19T00:10:52.524752+0000","last_became_peered":"2024-08-19T00:10:52.524752+0000","last_unstale":"2024-08-19T00:11:39.920777+0000","last_undegraded":"2024-08-19T00:11:39.920777+0000","last_fullsized":"2024-08-19T00:11:39.920777+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:50:47.817220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"90'17","reported_seq":52,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913283+0000","last_change":"2024-08-19T00:10:50.618923+0000","last_active":"2024-08-19T00:11:39.913283+0000","last_peered":"2024-08-19T00:11:39.913283+0000","last_clean":"2024-08-19T00:11:39.913283+0000","last_became_active":"2024-08-19T00:10:50.618586+0000","last_became_peered":"2024-08-19T00:10:50.618586+0000","last_unstale":"2024-08-19T00:11:39.913283+0000","last_undegraded":"2024-08-19T00:11:39.913283+0000","last_fullsized":"2024-08-19T00:11:39.913283+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:07:45.186059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913068+0000","last_change":"2024-08-19T00:10:59.785681+0000","last_active":"2024-08-19T00:11:39.913068+0000","last_peered":"2024-08-19T00:11:39.913068+0000","last_clean":"2024-08-19T00:11:39.913068+0000","last_became_active":"2024-08-19T00:10:59.785299+0000","last_became_peered":"2024-08-19T00:10:59.785299+0000","last_unstale":"2024-08-19T00:11:39.913068+0000","last_undegraded":"2024-08-19T00:11:39.913068+0000","last_fullsized":"2024-08-19T00:11:39.913068+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:36:08.151180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920368+0000","last_change":"2024-08-19T00:10:52.523398+0000","last_active":"2024-08-19T00:11:39.920368+0000","last_peered":"2024-08-19T00:11:39.920368+0000","last_clean":"2024-08-19T00:11:39.920368+0000","last_became_active":"2024-08-19T00:10:52.523066+0000","last_became_peered":"2024-08-19T00:10:52.523066+0000","last_unstale":"2024-08-19T00:11:39.920368+0000","last_undegraded":"2024-08-19T00:11:39.920368+0000","last_fullsized":"2024-08-19T00:11:39.920368+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:47:25.137487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"90'5","reported_seq":95,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:12:28.982732+0000","last_change":"2024-08-19T00:10:50.475827+0000","last_active":"2024-08-19T00:12:28.982732+0000","last_peered":"2024-08-19T00:12:28.982732+0000","last_clean":"2024-08-19T00:12:28.982732+0000","last_became_active":"2024-08-19T00:10:50.475470+0000","last_became_peered":"2024-08-19T00:10:50.475470+0000","last_unstale":"2024-08-19T00:12:28.982732+0000","last_undegraded":"2024-08-19T00:12:28.982732+0000","last_fullsized":"2024-08-19T00:12:28.982732+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:25:14.200317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":57,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.910632+0000","last_change":"2024-08-19T00:10:59.789047+0000","last_active":"2024-08-19T00:11:39.910632+0000","last_peered":"2024-08-19T00:11:39.910632+0000","last_clean":"2024-08-19T00:11:39.910632+0000","last_became_active":"2024-08-19T00:10:59.788694+0000","last_became_peered":"2024-08-19T00:10:59.788694+0000","last_unstale":"2024-08-19T00:11:39.910632+0000","last_undegraded":"2024-08-19T00:11:39.910632+0000","last_fullsized":"2024-08-19T00:11:39.910632+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:00:22.463593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920596+0000","last_change":"2024-08-19T00:10:52.511480+0000","last_active":"2024-08-19T00:11:39.920596+0000","last_peered":"2024-08-19T00:11:39.920596+0000","last_clean":"2024-08-19T00:11:39.920596+0000","last_became_active":"2024-08-19T00:10:52.511159+0000","last_became_peered":"2024-08-19T00:10:52.511159+0000","last_unstale":"2024-08-19T00:11:39.920596+0000","last_undegraded":"2024-08-19T00:11:39.920596+0000","last_fullsized":"2024-08-19T00:11:39.920596+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:28:31.136900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"90'5","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.919763+0000","last_change":"2024-08-19T00:10:50.476761+0000","last_active":"2024-08-19T00:11:39.919763+0000","last_peered":"2024-08-19T00:11:39.919763+0000","last_clean":"2024-08-19T00:11:39.919763+0000","last_became_active":"2024-08-19T00:10:50.476455+0000","last_became_peered":"2024-08-19T00:10:50.476455+0000","last_unstale":"2024-08-19T00:11:39.919763+0000","last_undegraded":"2024-08-19T00:11:39.919763+0000","last_fullsized":"2024-08-19T00:11:39.919763+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:34:52.158438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.912580+0000","last_change":"2024-08-19T00:10:59.778313+0000","last_active":"2024-08-19T00:11:39.912580+0000","last_peered":"2024-08-19T00:11:39.912580+0000","last_clean":"2024-08-19T00:11:39.912580+0000","last_became_active":"2024-08-19T00:10:59.777831+0000","last_became_peered":"2024-08-19T00:10:59.777831+0000","last_unstale":"2024-08-19T00:11:39.912580+0000","last_undegraded":"2024-08-19T00:11:39.912580+0000","last_fullsized":"2024-08-19T00:11:39.912580+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:34:05.474277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.912741+0000","last_change":"2024-08-19T00:10:52.513719+0000","last_active":"2024-08-19T00:11:39.912741+0000","last_peered":"2024-08-19T00:11:39.912741+0000","last_clean":"2024-08-19T00:11:39.912741+0000","last_became_active":"2024-08-19T00:10:52.513345+0000","last_became_peered":"2024-08-19T00:10:52.513345+0000","last_unstale":"2024-08-19T00:11:39.912741+0000","last_undegraded":"2024-08-19T00:11:39.912741+0000","last_fullsized":"2024-08-19T00:11:39.912741+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:50:28.862870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"90'9","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916408+0000","last_change":"2024-08-19T00:10:50.475529+0000","last_active":"2024-08-19T00:11:39.916408+0000","last_peered":"2024-08-19T00:11:39.916408+0000","last_clean":"2024-08-19T00:11:39.916408+0000","last_became_active":"2024-08-19T00:10:50.473544+0000","last_became_peered":"2024-08-19T00:10:50.473544+0000","last_unstale":"2024-08-19T00:11:39.916408+0000","last_undegraded":"2024-08-19T00:11:39.916408+0000","last_fullsized":"2024-08-19T00:11:39.916408+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:49:42.663650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.918895+0000","last_change":"2024-08-19T00:10:59.789028+0000","last_active":"2024-08-19T00:11:39.918895+0000","last_peered":"2024-08-19T00:11:39.918895+0000","last_clean":"2024-08-19T00:11:39.918895+0000","last_became_active":"2024-08-19T00:10:59.788606+0000","last_became_peered":"2024-08-19T00:10:59.788606+0000","last_unstale":"2024-08-19T00:11:39.918895+0000","last_undegraded":"2024-08-19T00:11:39.918895+0000","last_fullsized":"2024-08-19T00:11:39.918895+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:59:06.617755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913196+0000","last_change":"2024-08-19T00:10:52.520826+0000","last_active":"2024-08-19T00:11:39.913196+0000","last_peered":"2024-08-19T00:11:39.913196+0000","last_clean":"2024-08-19T00:11:39.913196+0000","last_became_active":"2024-08-19T00:10:52.520437+0000","last_became_peered":"2024-08-19T00:10:52.520437+0000","last_unstale":"2024-08-19T00:11:39.913196+0000","last_undegraded":"2024-08-19T00:11:39.913196+0000","last_fullsized":"2024-08-19T00:11:39.913196+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:30:06.843697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"92'35","reported_seq":186,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:12:30.009999+0000","last_change":"2024-08-19T00:10:50.473195+0000","last_active":"2024-08-19T00:12:30.009999+0000","last_peered":"2024-08-19T00:12:30.009999+0000","last_clean":"2024-08-19T00:12:30.009999+0000","last_became_active":"2024-08-19T00:10:50.472863+0000","last_became_peered":"2024-08-19T00:10:50.472863+0000","last_unstale":"2024-08-19T00:12:30.009999+0000","last_undegraded":"2024-08-19T00:12:30.009999+0000","last_fullsized":"2024-08-19T00:12:30.009999+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:09:04.859829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63473,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":117,"num_read_kb":120,"num_write":37,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.922789+0000","last_change":"2024-08-19T00:11:39.922405+0000","last_active":"2024-08-19T00:11:39.922789+0000","last_peered":"2024-08-19T00:11:39.922789+0000","last_clean":"2024-08-19T00:11:39.922789+0000","last_became_active":"2024-08-19T00:11:39.922054+0000","last_became_peered":"2024-08-19T00:11:39.922054+0000","last_unstale":"2024-08-19T00:11:39.922789+0000","last_undegraded":"2024-08-19T00:11:39.922789+0000","last_fullsized":"2024-08-19T00:11:39.922789+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:47:01.990229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.918080+0000","last_change":"2024-08-19T00:11:39.918080+0000","last_active":"2024-08-19T00:11:39.918080+0000","last_peered":"2024-08-19T00:11:39.918080+0000","last_clean":"2024-08-19T00:11:39.918080+0000","last_became_active":"2024-08-19T00:11:39.917742+0000","last_became_peered":"2024-08-19T00:11:39.917742+0000","last_unstale":"2024-08-19T00:11:39.918080+0000","last_undegraded":"2024-08-19T00:11:39.918080+0000","last_fullsized":"2024-08-19T00:11:39.918080+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:57:19.983148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"90'5","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.919164+0000","last_change":"2024-08-19T00:10:50.618094+0000","last_active":"2024-08-19T00:11:39.919164+0000","last_peered":"2024-08-19T00:11:39.919164+0000","last_clean":"2024-08-19T00:11:39.919164+0000","last_became_active":"2024-08-19T00:10:50.617786+0000","last_became_peered":"2024-08-19T00:10:50.617786+0000","last_unstale":"2024-08-19T00:11:39.919164+0000","last_undegraded":"2024-08-19T00:11:39.919164+0000","last_fullsized":"2024-08-19T00:11:39.919164+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:05:46.231214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915705+0000","last_change":"2024-08-19T00:10:59.780786+0000","last_active":"2024-08-19T00:11:39.915705+0000","last_peered":"2024-08-19T00:11:39.915705+0000","last_clean":"2024-08-19T00:11:39.915705+0000","last_became_active":"2024-08-19T00:10:59.780364+0000","last_became_peered":"2024-08-19T00:10:59.780364+0000","last_unstale":"2024-08-19T00:11:39.915705+0000","last_undegraded":"2024-08-19T00:11:39.915705+0000","last_fullsized":"2024-08-19T00:11:39.915705+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:39:45.113590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916082+0000","last_change":"2024-08-19T00:10:52.520623+0000","last_active":"2024-08-19T00:11:39.916082+0000","last_peered":"2024-08-19T00:11:39.916082+0000","last_clean":"2024-08-19T00:11:39.916082+0000","last_became_active":"2024-08-19T00:10:52.520321+0000","last_became_peered":"2024-08-19T00:10:52.520321+0000","last_unstale":"2024-08-19T00:11:39.916082+0000","last_undegraded":"2024-08-19T00:11:39.916082+0000","last_fullsized":"2024-08-19T00:11:39.916082+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:56:42.526199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"90'4","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920887+0000","last_change":"2024-08-19T00:10:50.474925+0000","last_active":"2024-08-19T00:11:39.920887+0000","last_peered":"2024-08-19T00:11:39.920887+0000","last_clean":"2024-08-19T00:11:39.920887+0000","last_became_active":"2024-08-19T00:10:50.474573+0000","last_became_peered":"2024-08-19T00:10:50.474573+0000","last_unstale":"2024-08-19T00:11:39.920887+0000","last_undegraded":"2024-08-19T00:11:39.920887+0000","last_fullsized":"2024-08-19T00:11:39.920887+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:10:32.136867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920527+0000","last_change":"2024-08-19T00:11:39.920527+0000","last_active":"2024-08-19T00:11:39.920527+0000","last_peered":"2024-08-19T00:11:39.920527+0000","last_clean":"2024-08-19T00:11:39.920527+0000","last_became_active":"2024-08-19T00:11:39.919490+0000","last_became_peered":"2024-08-19T00:11:39.919490+0000","last_unstale":"2024-08-19T00:11:39.920527+0000","last_undegraded":"2024-08-19T00:11:39.920527+0000","last_fullsized":"2024-08-19T00:11:39.920527+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:33:09.191177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913768+0000","last_change":"2024-08-19T00:10:52.510783+0000","last_active":"2024-08-19T00:11:39.913768+0000","last_peered":"2024-08-19T00:11:39.913768+0000","last_clean":"2024-08-19T00:11:39.913768+0000","last_became_active":"2024-08-19T00:10:52.510359+0000","last_became_peered":"2024-08-19T00:10:52.510359+0000","last_unstale":"2024-08-19T00:11:39.913768+0000","last_undegraded":"2024-08-19T00:11:39.913768+0000","last_fullsized":"2024-08-19T00:11:39.913768+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:20:03.682633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"90'4","reported_seq":146,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:12:29.991698+0000","last_change":"2024-08-19T00:10:50.470887+0000","last_active":"2024-08-19T00:12:29.991698+0000","last_peered":"2024-08-19T00:12:29.991698+0000","last_clean":"2024-08-19T00:12:29.991698+0000","last_became_active":"2024-08-19T00:10:50.470517+0000","last_became_peered":"2024-08-19T00:10:50.470517+0000","last_unstale":"2024-08-19T00:12:29.991698+0000","last_undegraded":"2024-08-19T00:12:29.991698+0000","last_fullsized":"2024-08-19T00:12:29.991698+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:52:33.864552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":108,"num_read_kb":108,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915676+0000","last_change":"2024-08-19T00:10:59.787686+0000","last_active":"2024-08-19T00:11:39.915676+0000","last_peered":"2024-08-19T00:11:39.915676+0000","last_clean":"2024-08-19T00:11:39.915676+0000","last_became_active":"2024-08-19T00:10:59.787236+0000","last_became_peered":"2024-08-19T00:10:59.787236+0000","last_unstale":"2024-08-19T00:11:39.915676+0000","last_undegraded":"2024-08-19T00:11:39.915676+0000","last_fullsized":"2024-08-19T00:11:39.915676+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:57:11.012865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916402+0000","last_change":"2024-08-19T00:10:59.782541+0000","last_active":"2024-08-19T00:11:39.916402+0000","last_peered":"2024-08-19T00:11:39.916402+0000","last_clean":"2024-08-19T00:11:39.916402+0000","last_became_active":"2024-08-19T00:10:59.782136+0000","last_became_peered":"2024-08-19T00:10:59.782136+0000","last_unstale":"2024-08-19T00:11:39.916402+0000","last_undegraded":"2024-08-19T00:11:39.916402+0000","last_fullsized":"2024-08-19T00:11:39.916402+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:44:39.501168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.910189+0000","last_change":"2024-08-19T00:10:52.509396+0000","last_active":"2024-08-19T00:11:39.910189+0000","last_peered":"2024-08-19T00:11:39.910189+0000","last_clean":"2024-08-19T00:11:39.910189+0000","last_became_active":"2024-08-19T00:10:52.509075+0000","last_became_peered":"2024-08-19T00:10:52.509075+0000","last_unstale":"2024-08-19T00:11:39.910189+0000","last_undegraded":"2024-08-19T00:11:39.910189+0000","last_fullsized":"2024-08-19T00:11:39.910189+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:40:53.611213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"90'3","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920355+0000","last_change":"2024-08-19T00:10:50.476723+0000","last_active":"2024-08-19T00:11:39.920355+0000","last_peered":"2024-08-19T00:11:39.920355+0000","last_clean":"2024-08-19T00:11:39.920355+0000","last_became_active":"2024-08-19T00:10:50.476399+0000","last_became_peered":"2024-08-19T00:10:50.476399+0000","last_unstale":"2024-08-19T00:11:39.920355+0000","last_undegraded":"2024-08-19T00:11:39.920355+0000","last_fullsized":"2024-08-19T00:11:39.920355+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:04:01.951387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913044+0000","last_change":"2024-08-19T00:10:59.781481+0000","last_active":"2024-08-19T00:11:39.913044+0000","last_peered":"2024-08-19T00:11:39.913044+0000","last_clean":"2024-08-19T00:11:39.913044+0000","last_became_active":"2024-08-19T00:10:59.780160+0000","last_became_peered":"2024-08-19T00:10:59.780160+0000","last_unstale":"2024-08-19T00:11:39.913044+0000","last_undegraded":"2024-08-19T00:11:39.913044+0000","last_fullsized":"2024-08-19T00:11:39.913044+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:14:46.340158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915284+0000","last_change":"2024-08-19T00:10:52.516780+0000","last_active":"2024-08-19T00:11:39.915284+0000","last_peered":"2024-08-19T00:11:39.915284+0000","last_clean":"2024-08-19T00:11:39.915284+0000","last_became_active":"2024-08-19T00:10:52.513264+0000","last_became_peered":"2024-08-19T00:10:52.513264+0000","last_unstale":"2024-08-19T00:11:39.915284+0000","last_undegraded":"2024-08-19T00:11:39.915284+0000","last_fullsized":"2024-08-19T00:11:39.915284+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:36:49.238267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"90'3","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.912619+0000","last_change":"2024-08-19T00:10:50.472840+0000","last_active":"2024-08-19T00:11:39.912619+0000","last_peered":"2024-08-19T00:11:39.912619+0000","last_clean":"2024-08-19T00:11:39.912619+0000","last_became_active":"2024-08-19T00:10:50.472534+0000","last_became_peered":"2024-08-19T00:10:50.472534+0000","last_unstale":"2024-08-19T00:11:39.912619+0000","last_undegraded":"2024-08-19T00:11:39.912619+0000","last_fullsized":"2024-08-19T00:11:39.912619+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:41:53.505360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"90'7","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.911662+0000","last_change":"2024-08-19T00:10:50.469342+0000","last_active":"2024-08-19T00:11:39.911662+0000","last_peered":"2024-08-19T00:11:39.911662+0000","last_clean":"2024-08-19T00:11:39.911662+0000","last_became_active":"2024-08-19T00:10:50.468800+0000","last_became_peered":"2024-08-19T00:10:50.468800+0000","last_unstale":"2024-08-19T00:11:39.911662+0000","last_undegraded":"2024-08-19T00:11:39.911662+0000","last_fullsized":"2024-08-19T00:11:39.911662+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:58:28.804117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920904+0000","last_change":"2024-08-19T00:10:52.523634+0000","last_active":"2024-08-19T00:11:39.920904+0000","last_peered":"2024-08-19T00:11:39.920904+0000","last_clean":"2024-08-19T00:11:39.920904+0000","last_became_active":"2024-08-19T00:10:52.523336+0000","last_became_peered":"2024-08-19T00:10:52.523336+0000","last_unstale":"2024-08-19T00:11:39.920904+0000","last_undegraded":"2024-08-19T00:11:39.920904+0000","last_fullsized":"2024-08-19T00:11:39.920904+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:55:08.994124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.922401+0000","last_change":"2024-08-19T00:11:39.922401+0000","last_active":"2024-08-19T00:11:39.922401+0000","last_peered":"2024-08-19T00:11:39.922401+0000","last_clean":"2024-08-19T00:11:39.922401+0000","last_became_active":"2024-08-19T00:11:39.921979+0000","last_became_peered":"2024-08-19T00:11:39.921979+0000","last_unstale":"2024-08-19T00:11:39.922401+0000","last_undegraded":"2024-08-19T00:11:39.922401+0000","last_fullsized":"2024-08-19T00:11:39.922401+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:58:57.453222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,8],"acting":[2,6,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"90'5","reported_seq":91,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:12:24.984318+0000","last_change":"2024-08-19T00:10:50.476035+0000","last_active":"2024-08-19T00:12:24.984318+0000","last_peered":"2024-08-19T00:12:24.984318+0000","last_clean":"2024-08-19T00:12:24.984318+0000","last_became_active":"2024-08-19T00:10:50.475733+0000","last_became_peered":"2024-08-19T00:10:50.475733+0000","last_unstale":"2024-08-19T00:12:24.984318+0000","last_undegraded":"2024-08-19T00:12:24.984318+0000","last_fullsized":"2024-08-19T00:12:24.984318+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:27:59.026582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.914126+0000","last_change":"2024-08-19T00:10:52.522185+0000","last_active":"2024-08-19T00:11:39.914126+0000","last_peered":"2024-08-19T00:11:39.914126+0000","last_clean":"2024-08-19T00:11:39.914126+0000","last_became_active":"2024-08-19T00:10:52.521747+0000","last_became_peered":"2024-08-19T00:10:52.521747+0000","last_unstale":"2024-08-19T00:11:39.914126+0000","last_undegraded":"2024-08-19T00:11:39.914126+0000","last_fullsized":"2024-08-19T00:11:39.914126+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:14:23.631484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915843+0000","last_change":"2024-08-19T00:10:59.783512+0000","last_active":"2024-08-19T00:11:39.915843+0000","last_peered":"2024-08-19T00:11:39.915843+0000","last_clean":"2024-08-19T00:11:39.915843+0000","last_became_active":"2024-08-19T00:10:59.783099+0000","last_became_peered":"2024-08-19T00:10:59.783099+0000","last_unstale":"2024-08-19T00:11:39.915843+0000","last_undegraded":"2024-08-19T00:11:39.915843+0000","last_fullsized":"2024-08-19T00:11:39.915843+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:02:27.977608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.912816+0000","last_change":"2024-08-19T00:10:52.524213+0000","last_active":"2024-08-19T00:11:39.912816+0000","last_peered":"2024-08-19T00:11:39.912816+0000","last_clean":"2024-08-19T00:11:39.912816+0000","last_became_active":"2024-08-19T00:10:52.523185+0000","last_became_peered":"2024-08-19T00:10:52.523185+0000","last_unstale":"2024-08-19T00:11:39.912816+0000","last_undegraded":"2024-08-19T00:11:39.912816+0000","last_fullsized":"2024-08-19T00:11:39.912816+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:23:48.569312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915774+0000","last_change":"2024-08-19T00:10:52.521436+0000","last_active":"2024-08-19T00:11:39.915774+0000","last_peered":"2024-08-19T00:11:39.915774+0000","last_clean":"2024-08-19T00:11:39.915774+0000","last_became_active":"2024-08-19T00:10:52.520842+0000","last_became_peered":"2024-08-19T00:10:52.520842+0000","last_unstale":"2024-08-19T00:11:39.915774+0000","last_undegraded":"2024-08-19T00:11:39.915774+0000","last_fullsized":"2024-08-19T00:11:39.915774+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:22:31.568680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915897+0000","last_change":"2024-08-19T00:10:52.514170+0000","last_active":"2024-08-19T00:11:39.915897+0000","last_peered":"2024-08-19T00:11:39.915897+0000","last_clean":"2024-08-19T00:11:39.915897+0000","last_became_active":"2024-08-19T00:10:52.513870+0000","last_became_peered":"2024-08-19T00:10:52.513870+0000","last_unstale":"2024-08-19T00:11:39.915897+0000","last_undegraded":"2024-08-19T00:11:39.915897+0000","last_fullsized":"2024-08-19T00:11:39.915897+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:29:04.125347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916321+0000","last_change":"2024-08-19T00:10:52.512320+0000","last_active":"2024-08-19T00:11:39.916321+0000","last_peered":"2024-08-19T00:11:39.916321+0000","last_clean":"2024-08-19T00:11:39.916321+0000","last_became_active":"2024-08-19T00:10:52.512003+0000","last_became_peered":"2024-08-19T00:10:52.512003+0000","last_unstale":"2024-08-19T00:11:39.916321+0000","last_undegraded":"2024-08-19T00:11:39.916321+0000","last_fullsized":"2024-08-19T00:11:39.916321+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:28:52.261457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913084+0000","last_change":"2024-08-19T00:10:52.511454+0000","last_active":"2024-08-19T00:11:39.913084+0000","last_peered":"2024-08-19T00:11:39.913084+0000","last_clean":"2024-08-19T00:11:39.913084+0000","last_became_active":"2024-08-19T00:10:52.511036+0000","last_became_peered":"2024-08-19T00:10:52.511036+0000","last_unstale":"2024-08-19T00:11:39.913084+0000","last_undegraded":"2024-08-19T00:11:39.913084+0000","last_fullsized":"2024-08-19T00:11:39.913084+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:14:04.749222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913672+0000","last_change":"2024-08-19T00:10:52.526393+0000","last_active":"2024-08-19T00:11:39.913672+0000","last_peered":"2024-08-19T00:11:39.913672+0000","last_clean":"2024-08-19T00:11:39.913672+0000","last_became_active":"2024-08-19T00:10:52.526043+0000","last_became_peered":"2024-08-19T00:10:52.526043+0000","last_unstale":"2024-08-19T00:11:39.913672+0000","last_undegraded":"2024-08-19T00:11:39.913672+0000","last_fullsized":"2024-08-19T00:11:39.913672+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:18:48.505255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.918255+0000","last_change":"2024-08-19T00:10:52.516028+0000","last_active":"2024-08-19T00:11:39.918255+0000","last_peered":"2024-08-19T00:11:39.918255+0000","last_clean":"2024-08-19T00:11:39.918255+0000","last_became_active":"2024-08-19T00:10:52.515659+0000","last_became_peered":"2024-08-19T00:10:52.515659+0000","last_unstale":"2024-08-19T00:11:39.918255+0000","last_undegraded":"2024-08-19T00:11:39.918255+0000","last_fullsized":"2024-08-19T00:11:39.918255+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:31:14.995175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916120+0000","last_change":"2024-08-19T00:10:52.516196+0000","last_active":"2024-08-19T00:11:39.916120+0000","last_peered":"2024-08-19T00:11:39.916120+0000","last_clean":"2024-08-19T00:11:39.916120+0000","last_became_active":"2024-08-19T00:10:52.515533+0000","last_became_peered":"2024-08-19T00:10:52.515533+0000","last_unstale":"2024-08-19T00:11:39.916120+0000","last_undegraded":"2024-08-19T00:11:39.916120+0000","last_fullsized":"2024-08-19T00:11:39.916120+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:32:25.207184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.918369+0000","last_change":"2024-08-19T00:10:52.527433+0000","last_active":"2024-08-19T00:11:39.918369+0000","last_peered":"2024-08-19T00:11:39.918369+0000","last_clean":"2024-08-19T00:11:39.918369+0000","last_became_active":"2024-08-19T00:10:52.525490+0000","last_became_peered":"2024-08-19T00:10:52.525490+0000","last_unstale":"2024-08-19T00:11:39.918369+0000","last_undegraded":"2024-08-19T00:11:39.918369+0000","last_fullsized":"2024-08-19T00:11:39.918369+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:21:14.545808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915814+0000","last_change":"2024-08-19T00:10:52.515503+0000","last_active":"2024-08-19T00:11:39.915814+0000","last_peered":"2024-08-19T00:11:39.915814+0000","last_clean":"2024-08-19T00:11:39.915814+0000","last_became_active":"2024-08-19T00:10:52.515178+0000","last_became_peered":"2024-08-19T00:10:52.515178+0000","last_unstale":"2024-08-19T00:11:39.915814+0000","last_undegraded":"2024-08-19T00:11:39.915814+0000","last_fullsized":"2024-08-19T00:11:39.915814+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:30:27.825463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913615+0000","last_change":"2024-08-19T00:10:52.515133+0000","last_active":"2024-08-19T00:11:39.913615+0000","last_peered":"2024-08-19T00:11:39.913615+0000","last_clean":"2024-08-19T00:11:39.913615+0000","last_became_active":"2024-08-19T00:10:52.514851+0000","last_became_peered":"2024-08-19T00:10:52.514851+0000","last_unstale":"2024-08-19T00:11:39.913615+0000","last_undegraded":"2024-08-19T00:11:39.913615+0000","last_fullsized":"2024-08-19T00:11:39.913615+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:38:53.593993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913028+0000","last_change":"2024-08-19T00:10:52.512127+0000","last_active":"2024-08-19T00:11:39.913028+0000","last_peered":"2024-08-19T00:11:39.913028+0000","last_clean":"2024-08-19T00:11:39.913028+0000","last_became_active":"2024-08-19T00:10:52.511840+0000","last_became_peered":"2024-08-19T00:10:52.511840+0000","last_unstale":"2024-08-19T00:11:39.913028+0000","last_undegraded":"2024-08-19T00:11:39.913028+0000","last_fullsized":"2024-08-19T00:11:39.913028+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:36:32.878531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913944+0000","last_change":"2024-08-19T00:10:52.519470+0000","last_active":"2024-08-19T00:11:39.913944+0000","last_peered":"2024-08-19T00:11:39.913944+0000","last_clean":"2024-08-19T00:11:39.913944+0000","last_became_active":"2024-08-19T00:10:52.519131+0000","last_became_peered":"2024-08-19T00:10:52.519131+0000","last_unstale":"2024-08-19T00:11:39.913944+0000","last_undegraded":"2024-08-19T00:11:39.913944+0000","last_fullsized":"2024-08-19T00:11:39.913944+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:56:53.628868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915974+0000","last_change":"2024-08-19T00:10:52.511114+0000","last_active":"2024-08-19T00:11:39.915974+0000","last_peered":"2024-08-19T00:11:39.915974+0000","last_clean":"2024-08-19T00:11:39.915974+0000","last_became_active":"2024-08-19T00:10:52.510759+0000","last_became_peered":"2024-08-19T00:10:52.510759+0000","last_unstale":"2024-08-19T00:11:39.915974+0000","last_undegraded":"2024-08-19T00:11:39.915974+0000","last_fullsized":"2024-08-19T00:11:39.915974+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:54:10.590297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.910810+0000","last_change":"2024-08-19T00:10:52.507998+0000","last_active":"2024-08-19T00:11:39.910810+0000","last_peered":"2024-08-19T00:11:39.910810+0000","last_clean":"2024-08-19T00:11:39.910810+0000","last_became_active":"2024-08-19T00:10:52.507679+0000","last_became_peered":"2024-08-19T00:10:52.507679+0000","last_unstale":"2024-08-19T00:11:39.910810+0000","last_undegraded":"2024-08-19T00:11:39.910810+0000","last_fullsized":"2024-08-19T00:11:39.910810+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:59:48.098911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913458+0000","last_change":"2024-08-19T00:10:52.524171+0000","last_active":"2024-08-19T00:11:39.913458+0000","last_peered":"2024-08-19T00:11:39.913458+0000","last_clean":"2024-08-19T00:11:39.913458+0000","last_became_active":"2024-08-19T00:10:52.523028+0000","last_became_peered":"2024-08-19T00:10:52.523028+0000","last_unstale":"2024-08-19T00:11:39.913458+0000","last_undegraded":"2024-08-19T00:11:39.913458+0000","last_fullsized":"2024-08-19T00:11:39.913458+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:51:24.567971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913253+0000","last_change":"2024-08-19T00:10:52.514309+0000","last_active":"2024-08-19T00:11:39.913253+0000","last_peered":"2024-08-19T00:11:39.913253+0000","last_clean":"2024-08-19T00:11:39.913253+0000","last_became_active":"2024-08-19T00:10:52.513992+0000","last_became_peered":"2024-08-19T00:10:52.513992+0000","last_unstale":"2024-08-19T00:11:39.913253+0000","last_undegraded":"2024-08-19T00:11:39.913253+0000","last_fullsized":"2024-08-19T00:11:39.913253+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:34:14.014490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915278+0000","last_change":"2024-08-19T00:10:52.516033+0000","last_active":"2024-08-19T00:11:39.915278+0000","last_peered":"2024-08-19T00:11:39.915278+0000","last_clean":"2024-08-19T00:11:39.915278+0000","last_became_active":"2024-08-19T00:10:52.515713+0000","last_became_peered":"2024-08-19T00:10:52.515713+0000","last_unstale":"2024-08-19T00:11:39.915278+0000","last_undegraded":"2024-08-19T00:11:39.915278+0000","last_fullsized":"2024-08-19T00:11:39.915278+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:06:40.832460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915258+0000","last_change":"2024-08-19T00:10:52.518521+0000","last_active":"2024-08-19T00:11:39.915258+0000","last_peered":"2024-08-19T00:11:39.915258+0000","last_clean":"2024-08-19T00:11:39.915258+0000","last_became_active":"2024-08-19T00:10:52.518237+0000","last_became_peered":"2024-08-19T00:10:52.518237+0000","last_unstale":"2024-08-19T00:11:39.915258+0000","last_undegraded":"2024-08-19T00:11:39.915258+0000","last_fullsized":"2024-08-19T00:11:39.915258+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:17:20.569044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.912988+0000","last_change":"2024-08-19T00:10:52.519774+0000","last_active":"2024-08-19T00:11:39.912988+0000","last_peered":"2024-08-19T00:11:39.912988+0000","last_clean":"2024-08-19T00:11:39.912988+0000","last_became_active":"2024-08-19T00:10:52.519456+0000","last_became_peered":"2024-08-19T00:10:52.519456+0000","last_unstale":"2024-08-19T00:11:39.912988+0000","last_undegraded":"2024-08-19T00:11:39.912988+0000","last_fullsized":"2024-08-19T00:11:39.912988+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:47:52.675650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916215+0000","last_change":"2024-08-19T00:10:52.514200+0000","last_active":"2024-08-19T00:11:39.916215+0000","last_peered":"2024-08-19T00:11:39.916215+0000","last_clean":"2024-08-19T00:11:39.916215+0000","last_became_active":"2024-08-19T00:10:52.513821+0000","last_became_peered":"2024-08-19T00:10:52.513821+0000","last_unstale":"2024-08-19T00:11:39.916215+0000","last_undegraded":"2024-08-19T00:11:39.916215+0000","last_fullsized":"2024-08-19T00:11:39.916215+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:15:30.084873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920854+0000","last_change":"2024-08-19T00:10:52.519781+0000","last_active":"2024-08-19T00:11:39.920854+0000","last_peered":"2024-08-19T00:11:39.920854+0000","last_clean":"2024-08-19T00:11:39.920854+0000","last_became_active":"2024-08-19T00:10:52.519395+0000","last_became_peered":"2024-08-19T00:10:52.519395+0000","last_unstale":"2024-08-19T00:11:39.920854+0000","last_undegraded":"2024-08-19T00:11:39.920854+0000","last_fullsized":"2024-08-19T00:11:39.920854+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:10:15.160535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.911435+0000","last_change":"2024-08-19T00:10:52.510293+0000","last_active":"2024-08-19T00:11:39.911435+0000","last_peered":"2024-08-19T00:11:39.911435+0000","last_clean":"2024-08-19T00:11:39.911435+0000","last_became_active":"2024-08-19T00:10:52.509983+0000","last_became_peered":"2024-08-19T00:10:52.509983+0000","last_unstale":"2024-08-19T00:11:39.911435+0000","last_undegraded":"2024-08-19T00:11:39.911435+0000","last_fullsized":"2024-08-19T00:11:39.911435+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:59:11.488742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913928+0000","last_change":"2024-08-19T00:10:52.518778+0000","last_active":"2024-08-19T00:11:39.913928+0000","last_peered":"2024-08-19T00:11:39.913928+0000","last_clean":"2024-08-19T00:11:39.913928+0000","last_became_active":"2024-08-19T00:10:52.518209+0000","last_became_peered":"2024-08-19T00:10:52.518209+0000","last_unstale":"2024-08-19T00:11:39.913928+0000","last_undegraded":"2024-08-19T00:11:39.913928+0000","last_fullsized":"2024-08-19T00:11:39.913928+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:23:19.255833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915073+0000","last_change":"2024-08-19T00:10:52.523824+0000","last_active":"2024-08-19T00:11:39.915073+0000","last_peered":"2024-08-19T00:11:39.915073+0000","last_clean":"2024-08-19T00:11:39.915073+0000","last_became_active":"2024-08-19T00:10:52.523075+0000","last_became_peered":"2024-08-19T00:10:52.523075+0000","last_unstale":"2024-08-19T00:11:39.915073+0000","last_undegraded":"2024-08-19T00:11:39.915073+0000","last_fullsized":"2024-08-19T00:11:39.915073+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:23:58.618712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.920442+0000","last_change":"2024-08-19T00:10:52.523508+0000","last_active":"2024-08-19T00:11:39.920442+0000","last_peered":"2024-08-19T00:11:39.920442+0000","last_clean":"2024-08-19T00:11:39.920442+0000","last_became_active":"2024-08-19T00:10:52.523104+0000","last_became_peered":"2024-08-19T00:10:52.523104+0000","last_unstale":"2024-08-19T00:11:39.920442+0000","last_undegraded":"2024-08-19T00:11:39.920442+0000","last_fullsized":"2024-08-19T00:11:39.920442+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:04:06.932548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.911625+0000","last_change":"2024-08-19T00:10:52.510147+0000","last_active":"2024-08-19T00:11:39.911625+0000","last_peered":"2024-08-19T00:11:39.911625+0000","last_clean":"2024-08-19T00:11:39.911625+0000","last_became_active":"2024-08-19T00:10:52.509807+0000","last_became_peered":"2024-08-19T00:10:52.509807+0000","last_unstale":"2024-08-19T00:11:39.911625+0000","last_undegraded":"2024-08-19T00:11:39.911625+0000","last_fullsized":"2024-08-19T00:11:39.911625+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:09:55.965318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.912168+0000","last_change":"2024-08-19T00:10:52.512997+0000","last_active":"2024-08-19T00:11:39.912168+0000","last_peered":"2024-08-19T00:11:39.912168+0000","last_clean":"2024-08-19T00:11:39.912168+0000","last_became_active":"2024-08-19T00:10:52.512688+0000","last_became_peered":"2024-08-19T00:10:52.512688+0000","last_unstale":"2024-08-19T00:11:39.912168+0000","last_undegraded":"2024-08-19T00:11:39.912168+0000","last_fullsized":"2024-08-19T00:11:39.912168+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:57:33.607060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916036+0000","last_change":"2024-08-19T00:10:52.517492+0000","last_active":"2024-08-19T00:11:39.916036+0000","last_peered":"2024-08-19T00:11:39.916036+0000","last_clean":"2024-08-19T00:11:39.916036+0000","last_became_active":"2024-08-19T00:10:52.517153+0000","last_became_peered":"2024-08-19T00:10:52.517153+0000","last_unstale":"2024-08-19T00:11:39.916036+0000","last_undegraded":"2024-08-19T00:11:39.916036+0000","last_fullsized":"2024-08-19T00:11:39.916036+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:07:07.244331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.915536+0000","last_change":"2024-08-19T00:10:52.517396+0000","last_active":"2024-08-19T00:11:39.915536+0000","last_peered":"2024-08-19T00:11:39.915536+0000","last_clean":"2024-08-19T00:11:39.915536+0000","last_became_active":"2024-08-19T00:10:52.517108+0000","last_became_peered":"2024-08-19T00:10:52.517108+0000","last_unstale":"2024-08-19T00:11:39.915536+0000","last_undegraded":"2024-08-19T00:11:39.915536+0000","last_fullsized":"2024-08-19T00:11:39.915536+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:10:41.477770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.916498+0000","last_change":"2024-08-19T00:10:52.515841+0000","last_active":"2024-08-19T00:11:39.916498+0000","last_peered":"2024-08-19T00:11:39.916498+0000","last_clean":"2024-08-19T00:11:39.916498+0000","last_became_active":"2024-08-19T00:10:52.515524+0000","last_became_peered":"2024-08-19T00:10:52.515524+0000","last_unstale":"2024-08-19T00:11:39.916498+0000","last_undegraded":"2024-08-19T00:11:39.916498+0000","last_fullsized":"2024-08-19T00:11:39.916498+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:18:51.991468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-08-19T00:11:39.913341+0000","last_change":"2024-08-19T00:10:52.522670+0000","last_active":"2024-08-19T00:11:39.913341+0000","last_peered":"2024-08-19T00:11:39.913341+0000","last_clean":"2024-08-19T00:11:39.913341+0000","last_became_active":"2024-08-19T00:10:52.522275+0000","last_became_peered":"2024-08-19T00:10:52.522275+0000","last_unstale":"2024-08-19T00:11:39.913341+0000","last_undegraded":"2024-08-19T00:11:39.913341+0000","last_fullsized":"2024-08-19T00:11:39.913341+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:55:48.756230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69895,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":563,"num_read_kb":362,"num_write":248,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":209685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":213,"ondisk_log_size":213,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449121,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32216,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712936,"statfs":{"total":95995035648,"available":95962046464,"internally_reserved":0,"allocated":1064960,"data_stored":518821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":71,"seq":304942678053,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32888,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712264,"statfs":{"total":95995035648,"available":95961358336,"internally_reserved":0,"allocated":1753088,"data_stored":1168998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":65,"seq":279172874282,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28076,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717076,"statfs":{"total":95995035648,"available":95966285824,"internally_reserved":0,"allocated":1085440,"data_stored":522735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135918,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1069056,"data_stored":518905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397554,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36972,"kb_used_data":1636,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708180,"statfs":{"total":95995035648,"available":95957176320,"internally_reserved":0,"allocated":1675264,"data_stored":1115123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561080,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1056768,"data_stored":514143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822715,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32828,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712324,"statfs":{"total":95995035648,"available":95961419776,"internally_reserved":0,"allocated":1683456,"data_stored":1110705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986241,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36376,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708776,"statfs":{"total":95995035648,"available":95957786624,"internally_reserved":0,"allocated":1064960,"data_stored":518217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215172,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36380,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708772,"statfs":{"total":95995035648,"available":95957782528,"internally_reserved":0,"allocated":1069056,"data_stored":513851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411400,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36456,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708696,"statfs":{"total":95995035648,"available":95957704704,"internally_reserved":0,"allocated":1146880,"data_stored":578866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28116,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717036,"statfs":{"total":95995035648,"available":95966244864,"internally_reserved":0,"allocated":1126400,"data_stored":578646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738450,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36400,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708752,"statfs":{"total":95995035648,"available":95957762048,"internally_reserved":0,"allocated":1081344,"data_stored":515599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":65225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":65445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":65209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-19T00:12:31.972 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-08-19T00:12:31.972 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-08-19T00:12:31.972 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-08-19T00:12:31.972 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph health --format=json 2024-08-19T00:12:32.232 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:12:32.615 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:32 smithi044 ceph-mon[18489]: pgmap v318: 129 pgs: 129 active+clean; 645 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-19T00:12:32.615 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:32 smithi044 ceph-mon[18489]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-19T00:12:32.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:32.692+0000 7ffaa8499640 1 -- 172.21.15.44:0/349880684 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffaa01018b0 msgr2=0x7ffaa0101d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:32.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:32.692+0000 7ffaa8499640 1 --2- 172.21.15.44:0/349880684 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffaa01018b0 0x7ffaa0101d10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ffa94009930 tx=0x7ffa9402a420 comp rx=0 tx=0).stop 2024-08-19T00:12:32.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:32.692+0000 7ffaa8499640 1 -- 172.21.15.44:0/349880684 shutdown_connections 2024-08-19T00:12:32.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:32.692+0000 7ffaa8499640 1 --2- 172.21.15.44:0/349880684 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffaa0102250 0x7ffaa010e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:32.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:32.692+0000 7ffaa8499640 1 --2- 172.21.15.44:0/349880684 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffaa01018b0 0x7ffaa0101d10 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:32.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:32.692+0000 7ffaa8499640 1 --2- 172.21.15.44:0/349880684 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffaa01078b0 0x7ffaa0107c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:32.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:32.692+0000 7ffaa8499640 1 -- 172.21.15.44:0/349880684 >> 172.21.15.44:0/349880684 conn(0x7ffaa00fd5f0 msgr2=0x7ffaa00ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:32.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:32.692+0000 7ffaa8499640 1 -- 172.21.15.44:0/349880684 shutdown_connections 2024-08-19T00:12:32.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:32.692+0000 7ffaa8499640 1 -- 172.21.15.44:0/349880684 wait complete. 2024-08-19T00:12:32.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:32.693+0000 7ffaa8499640 1 Processor -- start 2024-08-19T00:12:32.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:32.693+0000 7ffaa8499640 1 -- start start 2024-08-19T00:12:32.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:32.693+0000 7ffaa8499640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffaa01018b0 0x7ffaa01981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:32.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:32.693+0000 7ffaa8499640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffaa0102250 0x7ffaa0198730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:32.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:32.693+0000 7ffaa8499640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffaa01078b0 0x7ffaa019cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:32.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:32.693+0000 7ffaa8499640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa0111cb0 con 0x7ffaa01018b0 2024-08-19T00:12:32.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:32.693+0000 7ffaa8499640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa0111b30 con 0x7ffaa01078b0 2024-08-19T00:12:32.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:32.693+0000 7ffaa8499640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa0111e30 con 0x7ffaa0102250 2024-08-19T00:12:32.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:32.693+0000 7ffaa6235640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffaa01018b0 0x7ffaa01981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:32.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:32.693+0000 7ffaa6235640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffaa01018b0 0x7ffaa01981f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50906/0 (socket says 172.21.15.44:50906) 2024-08-19T00:12:32.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:32.693+0000 7ffaa6235640 1 -- 172.21.15.44:0/3119065308 learned_addr learned my addr 172.21.15.44:0/3119065308 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:12:32.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:32.693+0000 7ffaa6a36640 1 --2- 172.21.15.44:0/3119065308 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffaa01078b0 0x7ffaa019cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:32.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:32.693+0000 7ffaa5a34640 1 --2- 172.21.15.44:0/3119065308 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffaa0102250 0x7ffaa0198730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:32.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:32.693+0000 7ffaa6235640 1 -- 172.21.15.44:0/3119065308 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffaa0102250 msgr2=0x7ffaa0198730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:32.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:32.693+0000 7ffaa6235640 1 --2- 172.21.15.44:0/3119065308 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffaa0102250 0x7ffaa0198730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:32.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:32.693+0000 7ffaa6235640 1 -- 172.21.15.44:0/3119065308 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffaa01078b0 msgr2=0x7ffaa019cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:32.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:32.693+0000 7ffaa6235640 1 --2- 172.21.15.44:0/3119065308 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffaa01078b0 0x7ffaa019cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:32.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:32.693+0000 7ffaa6235640 1 -- 172.21.15.44:0/3119065308 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaa019d1a0 con 0x7ffaa01018b0 2024-08-19T00:12:32.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:32.693+0000 7ffaa5a34640 1 --2- 172.21.15.44:0/3119065308 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffaa0102250 0x7ffaa0198730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:12:32.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:32.694+0000 7ffaa6235640 1 --2- 172.21.15.44:0/3119065308 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffaa01018b0 0x7ffaa01981f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c00eb90 tx=0x7ffa9c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:32.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:32.694+0000 7ffa937fe640 1 -- 172.21.15.44:0/3119065308 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c004d20 con 0x7ffaa01018b0 2024-08-19T00:12:32.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:32.694+0000 7ffaa8499640 1 -- 172.21.15.44:0/3119065308 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaa019d490 con 0x7ffaa01018b0 2024-08-19T00:12:32.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:32.694+0000 7ffa937fe640 1 -- 172.21.15.44:0/3119065308 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa9c00ee90 con 0x7ffaa01018b0 2024-08-19T00:12:32.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:32.694+0000 7ffa937fe640 1 -- 172.21.15.44:0/3119065308 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c010830 con 0x7ffaa01018b0 2024-08-19T00:12:32.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:32.694+0000 7ffaa8499640 1 -- 172.21.15.44:0/3119065308 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaa01a4d70 con 0x7ffaa01018b0 2024-08-19T00:12:32.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:32.695+0000 7ffaa8499640 1 -- 172.21.15.44:0/3119065308 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffaa0101d10 con 0x7ffaa01018b0 2024-08-19T00:12:32.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:32.696+0000 7ffa937fe640 1 -- 172.21.15.44:0/3119065308 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7ffa9c005020 con 0x7ffaa01018b0 2024-08-19T00:12:32.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:32.697+0000 7ffa937fe640 1 --2- 172.21.15.44:0/3119065308 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7ffa8c0a2c10 0x7ffa8c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:32.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:32.697+0000 7ffaa5a34640 1 --2- 172.21.15.44:0/3119065308 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7ffa8c0a2c10 0x7ffa8c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:32.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:32.697+0000 7ffa937fe640 1 -- 172.21.15.44:0/3119065308 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7ffa9c0cfc00 con 0x7ffaa01018b0 2024-08-19T00:12:32.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:32.697+0000 7ffaa5a34640 1 --2- 172.21.15.44:0/3119065308 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7ffa8c0a2c10 0x7ffa8c0a50d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ffa94000c00 tx=0x7ffa94005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:32.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:32.701+0000 7ffa937fe640 1 -- 172.21.15.44:0/3119065308 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7ffa9c09c640 con 0x7ffaa01018b0 2024-08-19T00:12:32.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:32 smithi171 ceph-mon[21810]: pgmap v318: 129 pgs: 129 active+clean; 645 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-19T00:12:32.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:32 smithi171 ceph-mon[21810]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-19T00:12:32.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:32 smithi116 ceph-mon[21873]: pgmap v318: 129 pgs: 129 active+clean; 645 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-19T00:12:32.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:32 smithi116 ceph-mon[21873]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-19T00:12:32.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:32.915+0000 7ffaa8499640 1 -- 172.21.15.44:0/3119065308 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ffaa0109e20 con 0x7ffaa01018b0 2024-08-19T00:12:32.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:32.915+0000 7ffa937fe640 1 -- 172.21.15.44:0/3119065308 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7ffa9c09bf40 con 0x7ffaa01018b0 2024-08-19T00:12:32.917 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:12:32.917 INFO:teuthology.orchestra.run.smithi044.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-08-19T00:12:32.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:32.918+0000 7ffaa8499640 1 -- 172.21.15.44:0/3119065308 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7ffa8c0a2c10 msgr2=0x7ffa8c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:32.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:32.918+0000 7ffaa8499640 1 --2- 172.21.15.44:0/3119065308 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7ffa8c0a2c10 0x7ffa8c0a50d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ffa94000c00 tx=0x7ffa94005a20 comp rx=0 tx=0).stop 2024-08-19T00:12:32.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:32.918+0000 7ffaa8499640 1 -- 172.21.15.44:0/3119065308 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffaa01018b0 msgr2=0x7ffaa01981f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:32.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:32.918+0000 7ffaa8499640 1 --2- 172.21.15.44:0/3119065308 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffaa01018b0 0x7ffaa01981f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c00eb90 tx=0x7ffa9c00c6a0 comp rx=0 tx=0).stop 2024-08-19T00:12:32.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:32.918+0000 7ffaa8499640 1 -- 172.21.15.44:0/3119065308 shutdown_connections 2024-08-19T00:12:32.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:32.918+0000 7ffaa8499640 1 --2- 172.21.15.44:0/3119065308 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7ffa8c0a2c10 0x7ffa8c0a50d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:32.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:32.918+0000 7ffaa8499640 1 --2- 172.21.15.44:0/3119065308 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffaa0102250 0x7ffaa0198730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:32.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:32.918+0000 7ffaa8499640 1 --2- 172.21.15.44:0/3119065308 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffaa01078b0 0x7ffaa019cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:32.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:32.918+0000 7ffaa8499640 1 --2- 172.21.15.44:0/3119065308 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffaa01018b0 0x7ffaa01981f0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:32.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:32.918+0000 7ffaa8499640 1 -- 172.21.15.44:0/3119065308 >> 172.21.15.44:0/3119065308 conn(0x7ffaa00fd5f0 msgr2=0x7ffaa00fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:32.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:32.918+0000 7ffaa8499640 1 -- 172.21.15.44:0/3119065308 shutdown_connections 2024-08-19T00:12:32.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:32.918+0000 7ffaa8499640 1 -- 172.21.15.44:0/3119065308 wait complete. 2024-08-19T00:12:33.541 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-08-19T00:12:33.541 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-19T00:12:33.797 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:12:33.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:33 smithi171 ceph-mon[21810]: pgmap v319: 129 pgs: 129 active+clean; 645 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-19T00:12:33.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:33 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/3119065308' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-08-19T00:12:33.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:33 smithi116 ceph-mon[21873]: pgmap v319: 129 pgs: 129 active+clean; 645 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-19T00:12:33.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:33 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/3119065308' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-08-19T00:12:33.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:33 smithi044 ceph-mon[18489]: pgmap v319: 129 pgs: 129 active+clean; 645 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-19T00:12:33.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:33 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/3119065308' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-08-19T00:12:34.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:34.295+0000 7f3016318640 1 -- 172.21.15.44:0/4002969710 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3010102a60 msgr2=0x7f3010102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:34.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:34.295+0000 7f3016318640 1 --2- 172.21.15.44:0/4002969710 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3010102a60 0x7f3010102e40 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3000009930 tx=0x7f300002a440 comp rx=0 tx=0).stop 2024-08-19T00:12:34.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:34.295+0000 7f3016318640 1 -- 172.21.15.44:0/4002969710 shutdown_connections 2024-08-19T00:12:34.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:34.295+0000 7f3016318640 1 --2- 172.21.15.44:0/4002969710 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3010107fd0 0x7f301010e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:34.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:34.295+0000 7f3016318640 1 --2- 172.21.15.44:0/4002969710 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3010103410 0x7f30101078c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:34.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:34.295+0000 7f3016318640 1 --2- 172.21.15.44:0/4002969710 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3010102a60 0x7f3010102e40 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:34.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:34.295+0000 7f3016318640 1 -- 172.21.15.44:0/4002969710 >> 172.21.15.44:0/4002969710 conn(0x7f30100fc500 msgr2=0x7f30100fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:34.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:34.295+0000 7f3016318640 1 -- 172.21.15.44:0/4002969710 shutdown_connections 2024-08-19T00:12:34.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:34.295+0000 7f3016318640 1 -- 172.21.15.44:0/4002969710 wait complete. 2024-08-19T00:12:34.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:34.295+0000 7f3016318640 1 Processor -- start 2024-08-19T00:12:34.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:34.296+0000 7f3016318640 1 -- start start 2024-08-19T00:12:34.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:34.296+0000 7f3016318640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3010102a60 0x7f3010198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:34.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:34.296+0000 7f3016318640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3010103410 0x7f3010198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:34.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:34.296+0000 7f3016318640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3010107fd0 0x7f301019cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:34.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:34.296+0000 7f3016318640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3010111e90 con 0x7f3010103410 2024-08-19T00:12:34.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:34.296+0000 7f3016318640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f3010111d10 con 0x7f3010102a60 2024-08-19T00:12:34.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:34.296+0000 7f3016318640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f3010112010 con 0x7f3010107fd0 2024-08-19T00:12:34.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:34.296+0000 7f3007fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3010103410 0x7f3010198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:34.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:34.296+0000 7f3007fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3010103410 0x7f3010198990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50926/0 (socket says 172.21.15.44:50926) 2024-08-19T00:12:34.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:34.296+0000 7f3007fff640 1 -- 172.21.15.44:0/2945968677 learned_addr learned my addr 172.21.15.44:0/2945968677 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:12:34.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:34.296+0000 7f300ffff640 1 --2- 172.21.15.44:0/2945968677 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3010102a60 0x7f3010198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:34.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:34.296+0000 7f30148b5640 1 --2- 172.21.15.44:0/2945968677 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3010107fd0 0x7f301019cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:34.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:34.296+0000 7f3007fff640 1 -- 172.21.15.44:0/2945968677 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3010107fd0 msgr2=0x7f301019cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:34.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:34.296+0000 7f3007fff640 1 --2- 172.21.15.44:0/2945968677 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3010107fd0 0x7f301019cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:34.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:34.296+0000 7f3007fff640 1 -- 172.21.15.44:0/2945968677 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3010102a60 msgr2=0x7f3010198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:34.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:34.296+0000 7f3007fff640 1 --2- 172.21.15.44:0/2945968677 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3010102a60 0x7f3010198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:34.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:34.296+0000 7f3007fff640 1 -- 172.21.15.44:0/2945968677 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f301019d400 con 0x7f3010103410 2024-08-19T00:12:34.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:34.296+0000 7f3007fff640 1 --2- 172.21.15.44:0/2945968677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3010103410 0x7f3010198990 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2ff8006fd0 tx=0x7f2ff800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:34.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:34.297+0000 7f300dffb640 1 -- 172.21.15.44:0/2945968677 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff8011830 con 0x7f3010103410 2024-08-19T00:12:34.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:34.297+0000 7f300dffb640 1 -- 172.21.15.44:0/2945968677 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ff8016070 con 0x7f3010103410 2024-08-19T00:12:34.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:34.297+0000 7f3016318640 1 -- 172.21.15.44:0/2945968677 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f301019d6f0 con 0x7f3010103410 2024-08-19T00:12:34.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:34.297+0000 7f300dffb640 1 -- 172.21.15.44:0/2945968677 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff800f2e0 con 0x7f3010103410 2024-08-19T00:12:34.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:34.297+0000 7f3016318640 1 -- 172.21.15.44:0/2945968677 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30101a4fd0 con 0x7f3010103410 2024-08-19T00:12:34.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:34.298+0000 7f3016318640 1 -- 172.21.15.44:0/2945968677 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f301006a580 con 0x7f3010103410 2024-08-19T00:12:34.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:34.299+0000 7f300dffb640 1 -- 172.21.15.44:0/2945968677 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f2ff801b460 con 0x7f3010103410 2024-08-19T00:12:34.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:34.299+0000 7f300dffb640 1 --2- 172.21.15.44:0/2945968677 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f2ffc0a2c90 0x7f2ffc0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:34.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:34.300+0000 7f300ffff640 1 --2- 172.21.15.44:0/2945968677 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f2ffc0a2c90 0x7f2ffc0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:34.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:34.300+0000 7f300dffb640 1 -- 172.21.15.44:0/2945968677 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f2ff80cea00 con 0x7f3010103410 2024-08-19T00:12:34.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:34.300+0000 7f300ffff640 1 --2- 172.21.15.44:0/2945968677 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f2ffc0a2c90 0x7f2ffc0a5150 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3000009900 tx=0x7f30000058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:34.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:34.304+0000 7f300dffb640 1 -- 172.21.15.44:0/2945968677 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f2ff80d0e20 con 0x7f3010103410 2024-08-19T00:12:34.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:34.520+0000 7f3016318640 1 -- 172.21.15.44:0/2945968677 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3010109fe0 con 0x7f3010103410 2024-08-19T00:12:34.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:34.521+0000 7f300dffb640 1 -- 172.21.15.44:0/2945968677 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11989 (secure 0 0 0) 0x7f2ff809b5b0 con 0x7f3010103410 2024-08-19T00:12:34.523 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:12:34.523 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":27,"btime":"2024-08-19T00:11:36:898699+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14511,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1538841896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1538841896},{"type":"v1","addr":"172.21.15.116:6833","nonce":1538841896}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/4044471606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4044471606},{"type":"v1","addr":"172.21.15.44:6835","nonce":4044471606}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-19T00:10:53.196636+0000","modified":"2024-08-19T00:11:36.898676+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24473,"mds_1":24446,"mds_2":24439,"mds_3":24431,"mds_4":24418},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14529":{"gid":14529,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6837/1824829052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1824829052},{"type":"v1","addr":"172.21.15.44:6837","nonce":1824829052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14577":{"gid":14577,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6839/3591739042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":3591739042},{"type":"v1","addr":"172.21.15.44:6839","nonce":3591739042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14589":{"gid":14589,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6841/3667695717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6840","nonce":3667695717},{"type":"v1","addr":"172.21.15.44:6841","nonce":3667695717}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24388":{"gid":24388,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1183022838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1183022838},{"type":"v1","addr":"172.21.15.171:6833","nonce":1183022838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6835/2190623851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":2190623851},{"type":"v1","addr":"172.21.15.171:6835","nonce":2190623851}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.171:6837/316231795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":316231795},{"type":"v1","addr":"172.21.15.171:6837","nonce":316231795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":20,"addr":"172.21.15.116:6835/3507399322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3507399322},{"type":"v1","addr":"172.21.15.116:6835","nonce":3507399322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.171:6839/1466585795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":1466585795},{"type":"v1","addr":"172.21.15.171:6839","nonce":1466585795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":17,"addr":"172.21.15.116:6837/2764513846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":2764513846},{"type":"v1","addr":"172.21.15.116:6837","nonce":2764513846}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.116:6839/1032741033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":1032741033},{"type":"v1","addr":"172.21.15.116:6839","nonce":1032741033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24446,24439,24431,24418]},"id":1}]} 2024-08-19T00:12:34.523 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 27 2024-08-19T00:12:34.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:34.523+0000 7f3016318640 1 -- 172.21.15.44:0/2945968677 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f2ffc0a2c90 msgr2=0x7f2ffc0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:34.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:34.523+0000 7f3016318640 1 --2- 172.21.15.44:0/2945968677 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f2ffc0a2c90 0x7f2ffc0a5150 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3000009900 tx=0x7f30000058d0 comp rx=0 tx=0).stop 2024-08-19T00:12:34.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:34.523+0000 7f3016318640 1 -- 172.21.15.44:0/2945968677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3010103410 msgr2=0x7f3010198990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:34.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:34.523+0000 7f3016318640 1 --2- 172.21.15.44:0/2945968677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3010103410 0x7f3010198990 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2ff8006fd0 tx=0x7f2ff800b8e0 comp rx=0 tx=0).stop 2024-08-19T00:12:34.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:34.524+0000 7f3016318640 1 -- 172.21.15.44:0/2945968677 shutdown_connections 2024-08-19T00:12:34.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:34.524+0000 7f3016318640 1 --2- 172.21.15.44:0/2945968677 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f2ffc0a2c90 0x7f2ffc0a5150 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:34.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:34.524+0000 7f3016318640 1 --2- 172.21.15.44:0/2945968677 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3010107fd0 0x7f301019cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:34.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:34.524+0000 7f3016318640 1 --2- 172.21.15.44:0/2945968677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3010103410 0x7f3010198990 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:34.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:34.524+0000 7f3016318640 1 --2- 172.21.15.44:0/2945968677 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3010102a60 0x7f3010198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:34.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:34.524+0000 7f3016318640 1 -- 172.21.15.44:0/2945968677 >> 172.21.15.44:0/2945968677 conn(0x7f30100fc500 msgr2=0x7f3010105b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:34.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:34.524+0000 7f3016318640 1 -- 172.21.15.44:0/2945968677 shutdown_connections 2024-08-19T00:12:34.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:34.524+0000 7f3016318640 1 -- 172.21.15.44:0/2945968677 wait complete. 2024-08-19T00:12:34.814 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:34 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/2945968677' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:12:34.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:34 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/2945968677' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:12:34.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:34 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/2945968677' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:12:35.173 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-19T00:12:35.435 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:12:35.824 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:35 smithi044 ceph-mon[18489]: pgmap v320: 129 pgs: 129 active+clean; 645 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-08-19T00:12:35.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:35 smithi171 ceph-mon[21810]: pgmap v320: 129 pgs: 129 active+clean; 645 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-08-19T00:12:35.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:35 smithi116 ceph-mon[21873]: pgmap v320: 129 pgs: 129 active+clean; 645 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-08-19T00:12:35.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:35.904+0000 7fd67b5c9640 1 -- 172.21.15.44:0/1465204618 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6741078b0 msgr2=0x7fd674107c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:35.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:35.904+0000 7fd67b5c9640 1 --2- 172.21.15.44:0/1465204618 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6741078b0 0x7fd674107c90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd670009930 tx=0x7fd67002a420 comp rx=0 tx=0).stop 2024-08-19T00:12:35.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:35.904+0000 7fd67b5c9640 1 -- 172.21.15.44:0/1465204618 shutdown_connections 2024-08-19T00:12:35.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:35.904+0000 7fd67b5c9640 1 --2- 172.21.15.44:0/1465204618 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd674102250 0x7fd67410e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:35.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:35.904+0000 7fd67b5c9640 1 --2- 172.21.15.44:0/1465204618 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd6741018b0 0x7fd674101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:35.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:35.904+0000 7fd67b5c9640 1 --2- 172.21.15.44:0/1465204618 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6741078b0 0x7fd674107c90 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:35.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:35.904+0000 7fd67b5c9640 1 -- 172.21.15.44:0/1465204618 >> 172.21.15.44:0/1465204618 conn(0x7fd6740fd5f0 msgr2=0x7fd6740ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:35.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:35.904+0000 7fd67b5c9640 1 -- 172.21.15.44:0/1465204618 shutdown_connections 2024-08-19T00:12:35.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:35.904+0000 7fd67b5c9640 1 -- 172.21.15.44:0/1465204618 wait complete. 2024-08-19T00:12:35.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:35.905+0000 7fd67b5c9640 1 Processor -- start 2024-08-19T00:12:35.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:35.905+0000 7fd67b5c9640 1 -- start start 2024-08-19T00:12:35.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:35.905+0000 7fd67b5c9640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd6741018b0 0x7fd674074220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:35.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:35.905+0000 7fd67b5c9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd674102250 0x7fd674074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:35.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:35.905+0000 7fd67b5c9640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd6741078b0 0x7fd674074ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:35.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:35.905+0000 7fd67b5c9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd674111c70 con 0x7fd674102250 2024-08-19T00:12:35.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:35.905+0000 7fd67b5c9640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fd674111af0 con 0x7fd6741018b0 2024-08-19T00:12:35.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:35.905+0000 7fd67b5c9640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd674111df0 con 0x7fd6741078b0 2024-08-19T00:12:35.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:35.905+0000 7fd678b64640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd674102250 0x7fd674074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:35.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:35.905+0000 7fd678b64640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd674102250 0x7fd674074760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50944/0 (socket says 172.21.15.44:50944) 2024-08-19T00:12:35.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:35.905+0000 7fd678b64640 1 -- 172.21.15.44:0/378608514 learned_addr learned my addr 172.21.15.44:0/378608514 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:12:35.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:35.905+0000 7fd679365640 1 --2- 172.21.15.44:0/378608514 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd6741018b0 0x7fd674074220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:35.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:35.905+0000 7fd678b64640 1 -- 172.21.15.44:0/378608514 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd6741078b0 msgr2=0x7fd674074ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:35.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:35.905+0000 7fd679b66640 1 --2- 172.21.15.44:0/378608514 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd6741078b0 0x7fd674074ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:35.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:35.905+0000 7fd678b64640 1 --2- 172.21.15.44:0/378608514 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd6741078b0 0x7fd674074ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:35.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:35.905+0000 7fd678b64640 1 -- 172.21.15.44:0/378608514 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd6741018b0 msgr2=0x7fd674074220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:35.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:35.905+0000 7fd678b64640 1 --2- 172.21.15.44:0/378608514 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd6741018b0 0x7fd674074220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:35.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:35.905+0000 7fd678b64640 1 -- 172.21.15.44:0/378608514 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6741a6630 con 0x7fd674102250 2024-08-19T00:12:35.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:35.905+0000 7fd679365640 1 --2- 172.21.15.44:0/378608514 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd6741018b0 0x7fd674074220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:12:35.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:35.906+0000 7fd678b64640 1 --2- 172.21.15.44:0/378608514 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd674102250 0x7fd674074760 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd66400c920 tx=0x7fd66400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:35.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:35.906+0000 7fd66a7fc640 1 -- 172.21.15.44:0/378608514 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd664007c70 con 0x7fd674102250 2024-08-19T00:12:35.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:35.906+0000 7fd66a7fc640 1 -- 172.21.15.44:0/378608514 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd664007e10 con 0x7fd674102250 2024-08-19T00:12:35.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:35.906+0000 7fd67b5c9640 1 -- 172.21.15.44:0/378608514 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6741a6920 con 0x7fd674102250 2024-08-19T00:12:35.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:35.906+0000 7fd66a7fc640 1 -- 172.21.15.44:0/378608514 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd664018890 con 0x7fd674102250 2024-08-19T00:12:35.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:35.906+0000 7fd67b5c9640 1 -- 172.21.15.44:0/378608514 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6741a6eb0 con 0x7fd674102250 2024-08-19T00:12:35.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:35.907+0000 7fd67b5c9640 1 -- 172.21.15.44:0/378608514 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd674101d10 con 0x7fd674102250 2024-08-19T00:12:35.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:35.908+0000 7fd66a7fc640 1 -- 172.21.15.44:0/378608514 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fd664018a70 con 0x7fd674102250 2024-08-19T00:12:35.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:35.909+0000 7fd66a7fc640 1 --2- 172.21.15.44:0/378608514 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fd6600a2c90 0x7fd6600a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:35.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:35.909+0000 7fd679365640 1 --2- 172.21.15.44:0/378608514 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fd6600a2c90 0x7fd6600a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:35.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:35.909+0000 7fd66a7fc640 1 -- 172.21.15.44:0/378608514 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7fd6640cf700 con 0x7fd674102250 2024-08-19T00:12:35.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:35.909+0000 7fd679365640 1 --2- 172.21.15.44:0/378608514 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fd6600a2c90 0x7fd6600a5150 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd670000c00 tx=0x7fd670032c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:35.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:35.913+0000 7fd66a7fc640 1 -- 172.21.15.44:0/378608514 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fd664014030 con 0x7fd674102250 2024-08-19T00:12:36.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:36.124+0000 7fd67b5c9640 1 -- 172.21.15.44:0/378608514 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd67402d5e0 con 0x7fd674102250 2024-08-19T00:12:36.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:36.125+0000 7fd66a7fc640 1 -- 172.21.15.44:0/378608514 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11989 (secure 0 0 0) 0x7fd66409c1a0 con 0x7fd674102250 2024-08-19T00:12:36.127 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:12:36.127 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":27,"btime":"2024-08-19T00:11:36:898699+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14511,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1538841896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1538841896},{"type":"v1","addr":"172.21.15.116:6833","nonce":1538841896}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/4044471606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4044471606},{"type":"v1","addr":"172.21.15.44:6835","nonce":4044471606}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-19T00:10:53.196636+0000","modified":"2024-08-19T00:11:36.898676+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24473,"mds_1":24446,"mds_2":24439,"mds_3":24431,"mds_4":24418},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14529":{"gid":14529,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6837/1824829052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1824829052},{"type":"v1","addr":"172.21.15.44:6837","nonce":1824829052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14577":{"gid":14577,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6839/3591739042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":3591739042},{"type":"v1","addr":"172.21.15.44:6839","nonce":3591739042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14589":{"gid":14589,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6841/3667695717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6840","nonce":3667695717},{"type":"v1","addr":"172.21.15.44:6841","nonce":3667695717}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24388":{"gid":24388,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1183022838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1183022838},{"type":"v1","addr":"172.21.15.171:6833","nonce":1183022838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6835/2190623851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":2190623851},{"type":"v1","addr":"172.21.15.171:6835","nonce":2190623851}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.171:6837/316231795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":316231795},{"type":"v1","addr":"172.21.15.171:6837","nonce":316231795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":20,"addr":"172.21.15.116:6835/3507399322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3507399322},{"type":"v1","addr":"172.21.15.116:6835","nonce":3507399322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.171:6839/1466585795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":1466585795},{"type":"v1","addr":"172.21.15.171:6839","nonce":1466585795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":17,"addr":"172.21.15.116:6837/2764513846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":2764513846},{"type":"v1","addr":"172.21.15.116:6837","nonce":2764513846}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.116:6839/1032741033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":1032741033},{"type":"v1","addr":"172.21.15.116:6839","nonce":1032741033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24446,24439,24431,24418]},"id":1}]} 2024-08-19T00:12:36.127 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 27 2024-08-19T00:12:36.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:36.127+0000 7fd67b5c9640 1 -- 172.21.15.44:0/378608514 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fd6600a2c90 msgr2=0x7fd6600a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:36.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:36.127+0000 7fd67b5c9640 1 --2- 172.21.15.44:0/378608514 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fd6600a2c90 0x7fd6600a5150 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd670000c00 tx=0x7fd670032c70 comp rx=0 tx=0).stop 2024-08-19T00:12:36.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:36.127+0000 7fd67b5c9640 1 -- 172.21.15.44:0/378608514 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd674102250 msgr2=0x7fd674074760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:36.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:36.127+0000 7fd67b5c9640 1 --2- 172.21.15.44:0/378608514 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd674102250 0x7fd674074760 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd66400c920 tx=0x7fd66400cde0 comp rx=0 tx=0).stop 2024-08-19T00:12:36.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:36.127+0000 7fd67b5c9640 1 -- 172.21.15.44:0/378608514 shutdown_connections 2024-08-19T00:12:36.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:36.127+0000 7fd67b5c9640 1 --2- 172.21.15.44:0/378608514 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fd6600a2c90 0x7fd6600a5150 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:36.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:36.127+0000 7fd67b5c9640 1 --2- 172.21.15.44:0/378608514 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd6741078b0 0x7fd674074ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:36.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:36.127+0000 7fd67b5c9640 1 --2- 172.21.15.44:0/378608514 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd674102250 0x7fd674074760 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:36.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:36.127+0000 7fd67b5c9640 1 --2- 172.21.15.44:0/378608514 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd6741018b0 0x7fd674074220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:36.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:36.127+0000 7fd67b5c9640 1 -- 172.21.15.44:0/378608514 >> 172.21.15.44:0/378608514 conn(0x7fd6740fd5f0 msgr2=0x7fd6740fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:36.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:36.127+0000 7fd67b5c9640 1 -- 172.21.15.44:0/378608514 shutdown_connections 2024-08-19T00:12:36.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:36.127+0000 7fd67b5c9640 1 -- 172.21.15.44:0/378608514 wait complete. 2024-08-19T00:12:36.766 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-19T00:12:36.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:36 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/378608514' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:12:36.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:36 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/378608514' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:12:36.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:36 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/378608514' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:12:37.025 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:12:37.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:37.512+0000 7f4c9a435640 1 -- 172.21.15.44:0/914375699 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c941078c0 msgr2=0x7f4c94107ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:37.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:37.512+0000 7f4c9a435640 1 --2- 172.21.15.44:0/914375699 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c941078c0 0x7f4c94107ca0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4c84009930 tx=0x7f4c8402a420 comp rx=0 tx=0).stop 2024-08-19T00:12:37.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:37.512+0000 7f4c9a435640 1 -- 172.21.15.44:0/914375699 shutdown_connections 2024-08-19T00:12:37.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:37.512+0000 7f4c9a435640 1 --2- 172.21.15.44:0/914375699 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4c94102260 0x7f4c9410e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:37.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:37.512+0000 7f4c9a435640 1 --2- 172.21.15.44:0/914375699 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c941018c0 0x7f4c94101d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:37.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:37.512+0000 7f4c9a435640 1 --2- 172.21.15.44:0/914375699 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c941078c0 0x7f4c94107ca0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:37.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:37.512+0000 7f4c9a435640 1 -- 172.21.15.44:0/914375699 >> 172.21.15.44:0/914375699 conn(0x7f4c940fd5e0 msgr2=0x7f4c940ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:37.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:37.512+0000 7f4c9a435640 1 -- 172.21.15.44:0/914375699 shutdown_connections 2024-08-19T00:12:37.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:37.512+0000 7f4c9a435640 1 -- 172.21.15.44:0/914375699 wait complete. 2024-08-19T00:12:37.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:37.513+0000 7f4c9a435640 1 Processor -- start 2024-08-19T00:12:37.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:37.513+0000 7f4c9a435640 1 -- start start 2024-08-19T00:12:37.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:37.513+0000 7f4c9a435640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c941018c0 0x7f4c94198080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:37.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:37.513+0000 7f4c9a435640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4c94102260 0x7f4c941985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:37.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:37.513+0000 7f4c9a435640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c941078c0 0x7f4c9419c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:37.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:37.513+0000 7f4c9a435640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4c94111c80 con 0x7f4c941078c0 2024-08-19T00:12:37.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:37.513+0000 7f4c9a435640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f4c94111b00 con 0x7f4c941018c0 2024-08-19T00:12:37.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:37.513+0000 7f4c9a435640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4c94111e00 con 0x7f4c94102260 2024-08-19T00:12:37.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:37.513+0000 7f4c989d2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c941078c0 0x7f4c9419c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:37.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:37.513+0000 7f4c989d2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c941078c0 0x7f4c9419c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50964/0 (socket says 172.21.15.44:50964) 2024-08-19T00:12:37.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:37.513+0000 7f4c93fff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c941018c0 0x7f4c94198080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:37.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:37.513+0000 7f4c989d2640 1 -- 172.21.15.44:0/3924171030 learned_addr learned my addr 172.21.15.44:0/3924171030 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:12:37.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:37.514+0000 7f4c937fe640 1 --2- 172.21.15.44:0/3924171030 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4c94102260 0x7f4c941985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:37.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:37.514+0000 7f4c989d2640 1 -- 172.21.15.44:0/3924171030 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4c94102260 msgr2=0x7f4c941985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:37.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:37.514+0000 7f4c989d2640 1 --2- 172.21.15.44:0/3924171030 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4c94102260 0x7f4c941985c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:37.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:37.514+0000 7f4c989d2640 1 -- 172.21.15.44:0/3924171030 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c941018c0 msgr2=0x7f4c94198080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:37.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:37.514+0000 7f4c989d2640 1 --2- 172.21.15.44:0/3924171030 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c941018c0 0x7f4c94198080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:37.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:37.514+0000 7f4c989d2640 1 -- 172.21.15.44:0/3924171030 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c9419d030 con 0x7f4c941078c0 2024-08-19T00:12:37.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:37.514+0000 7f4c989d2640 1 --2- 172.21.15.44:0/3924171030 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c941078c0 0x7f4c9419c950 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c00cce0 tx=0x7f4c8c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:37.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:37.514+0000 7f4c917fa640 1 -- 172.21.15.44:0/3924171030 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c00f450 con 0x7f4c941078c0 2024-08-19T00:12:37.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:37.514+0000 7f4c917fa640 1 -- 172.21.15.44:0/3924171030 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c8c00fad0 con 0x7f4c941078c0 2024-08-19T00:12:37.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:37.514+0000 7f4c9a435640 1 -- 172.21.15.44:0/3924171030 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c9419d320 con 0x7f4c941078c0 2024-08-19T00:12:37.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:37.514+0000 7f4c917fa640 1 -- 172.21.15.44:0/3924171030 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c018c10 con 0x7f4c941078c0 2024-08-19T00:12:37.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:37.514+0000 7f4c9a435640 1 -- 172.21.15.44:0/3924171030 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c941a4c00 con 0x7f4c941078c0 2024-08-19T00:12:37.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:37.515+0000 7f4c9a435640 1 -- 172.21.15.44:0/3924171030 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c94101d20 con 0x7f4c941078c0 2024-08-19T00:12:37.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:37.516+0000 7f4c917fa640 1 -- 172.21.15.44:0/3924171030 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f4c8c00f5f0 con 0x7f4c941078c0 2024-08-19T00:12:37.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:37.517+0000 7f4c917fa640 1 --2- 172.21.15.44:0/3924171030 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f4c7c0a2c10 0x7f4c7c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:37.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:37.517+0000 7f4c93fff640 1 --2- 172.21.15.44:0/3924171030 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f4c7c0a2c10 0x7f4c7c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:37.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:37.517+0000 7f4c917fa640 1 -- 172.21.15.44:0/3924171030 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f4c8c0cfbc0 con 0x7f4c941078c0 2024-08-19T00:12:37.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:37.518+0000 7f4c93fff640 1 --2- 172.21.15.44:0/3924171030 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f4c7c0a2c10 0x7f4c7c0a50d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4c84009900 tx=0x7f4c840058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:37.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:37.522+0000 7f4c917fa640 1 -- 172.21.15.44:0/3924171030 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f4c8c014030 con 0x7f4c941078c0 2024-08-19T00:12:37.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:37.696+0000 7f4c9a435640 1 -- 172.21.15.44:0/3924171030 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4c941a4ee0 con 0x7f4c941078c0 2024-08-19T00:12:37.699 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:37 smithi044 ceph-mon[18489]: pgmap v321: 129 pgs: 129 active+clean; 645 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-08-19T00:12:37.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:37.698+0000 7f4c917fa640 1 -- 172.21.15.44:0/3924171030 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+24642 (secure 0 0 0) 0x7f4c8c09c600 con 0x7f4c941078c0 2024-08-19T00:12:37.700 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:12:37.700 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":92,"fsid":"647ded64-5dbe-11ef-bccf-c7b262605968","created":"2024-08-19T00:03:43.667929+0000","modified":"2024-08-19T00:11:39.902854+0000","last_up_change":"2024-08-19T00:10:01.557590+0000","last_in_change":"2024-08-19T00:09:42.433933+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T00:06:42.706553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-19T00:10:48.735065+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-19T00:10:51.481810+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-19T00:10:58.013004+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b15ad904-d07d-4ecb-be8f-d99323425eed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":600251465},{"type":"v1","addr":"172.21.15.44:6803","nonce":600251465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":600251465},{"type":"v1","addr":"172.21.15.44:6805","nonce":600251465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":600251465},{"type":"v1","addr":"172.21.15.44:6809","nonce":600251465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":600251465},{"type":"v1","addr":"172.21.15.44:6807","nonce":600251465}]},"public_addr":"172.21.15.44:6803/600251465","cluster_addr":"172.21.15.44:6805/600251465","heartbeat_back_addr":"172.21.15.44:6809/600251465","heartbeat_front_addr":"172.21.15.44:6807/600251465","state":["exists","up"]},{"osd":1,"uuid":"8f70512f-21a3-4fec-8278-04b2bc9b2d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":613509556},{"type":"v1","addr":"172.21.15.116:6801","nonce":613509556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":613509556},{"type":"v1","addr":"172.21.15.116:6803","nonce":613509556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":613509556},{"type":"v1","addr":"172.21.15.116:6807","nonce":613509556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":613509556},{"type":"v1","addr":"172.21.15.116:6805","nonce":613509556}]},"public_addr":"172.21.15.116:6801/613509556","cluster_addr":"172.21.15.116:6803/613509556","heartbeat_back_addr":"172.21.15.116:6807/613509556","heartbeat_front_addr":"172.21.15.116:6805/613509556","state":["exists","up"]},{"osd":2,"uuid":"56994dfd-5fcf-4d82-addf-38764239d82a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2130938937},{"type":"v1","addr":"172.21.15.171:6801","nonce":2130938937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2130938937},{"type":"v1","addr":"172.21.15.171:6803","nonce":2130938937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2130938937},{"type":"v1","addr":"172.21.15.171:6807","nonce":2130938937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2130938937},{"type":"v1","addr":"172.21.15.171:6805","nonce":2130938937}]},"public_addr":"172.21.15.171:6801/2130938937","cluster_addr":"172.21.15.171:6803/2130938937","heartbeat_back_addr":"172.21.15.171:6807/2130938937","heartbeat_front_addr":"172.21.15.171:6805/2130938937","state":["exists","up"]},{"osd":3,"uuid":"6d2ddb19-74e0-4e68-b9ea-58b73fd1e9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":3537027669},{"type":"v1","addr":"172.21.15.44:6811","nonce":3537027669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":3537027669},{"type":"v1","addr":"172.21.15.44:6813","nonce":3537027669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3537027669},{"type":"v1","addr":"172.21.15.44:6817","nonce":3537027669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":3537027669},{"type":"v1","addr":"172.21.15.44:6815","nonce":3537027669}]},"public_addr":"172.21.15.44:6811/3537027669","cluster_addr":"172.21.15.44:6813/3537027669","heartbeat_back_addr":"172.21.15.44:6817/3537027669","heartbeat_front_addr":"172.21.15.44:6815/3537027669","state":["exists","up"]},{"osd":4,"uuid":"190d208e-ae54-497d-ad72-d07a5a26991b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":3768627455},{"type":"v1","addr":"172.21.15.116:6809","nonce":3768627455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":3768627455},{"type":"v1","addr":"172.21.15.116:6811","nonce":3768627455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":3768627455},{"type":"v1","addr":"172.21.15.116:6815","nonce":3768627455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":3768627455},{"type":"v1","addr":"172.21.15.116:6813","nonce":3768627455}]},"public_addr":"172.21.15.116:6809/3768627455","cluster_addr":"172.21.15.116:6811/3768627455","heartbeat_back_addr":"172.21.15.116:6815/3768627455","heartbeat_front_addr":"172.21.15.116:6813/3768627455","state":["exists","up"]},{"osd":5,"uuid":"d8afacad-6d3d-4703-9744-8d01ff2a2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":938785018},{"type":"v1","addr":"172.21.15.171:6809","nonce":938785018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":938785018},{"type":"v1","addr":"172.21.15.171:6811","nonce":938785018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":938785018},{"type":"v1","addr":"172.21.15.171:6815","nonce":938785018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":938785018},{"type":"v1","addr":"172.21.15.171:6813","nonce":938785018}]},"public_addr":"172.21.15.171:6809/938785018","cluster_addr":"172.21.15.171:6811/938785018","heartbeat_back_addr":"172.21.15.171:6815/938785018","heartbeat_front_addr":"172.21.15.171:6813/938785018","state":["exists","up"]},{"osd":6,"uuid":"55bf1f89-99e5-409d-99fa-f0124aa042df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":1219334797},{"type":"v1","addr":"172.21.15.44:6819","nonce":1219334797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":1219334797},{"type":"v1","addr":"172.21.15.44:6821","nonce":1219334797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":1219334797},{"type":"v1","addr":"172.21.15.44:6825","nonce":1219334797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":1219334797},{"type":"v1","addr":"172.21.15.44:6823","nonce":1219334797}]},"public_addr":"172.21.15.44:6819/1219334797","cluster_addr":"172.21.15.44:6821/1219334797","heartbeat_back_addr":"172.21.15.44:6825/1219334797","heartbeat_front_addr":"172.21.15.44:6823/1219334797","state":["exists","up"]},{"osd":7,"uuid":"70130d71-d28c-4a58-b603-75610c8d3ea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":3861873415},{"type":"v1","addr":"172.21.15.116:6817","nonce":3861873415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":3861873415},{"type":"v1","addr":"172.21.15.116:6819","nonce":3861873415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":3861873415},{"type":"v1","addr":"172.21.15.116:6823","nonce":3861873415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":3861873415},{"type":"v1","addr":"172.21.15.116:6821","nonce":3861873415}]},"public_addr":"172.21.15.116:6817/3861873415","cluster_addr":"172.21.15.116:6819/3861873415","heartbeat_back_addr":"172.21.15.116:6823/3861873415","heartbeat_front_addr":"172.21.15.116:6821/3861873415","state":["exists","up"]},{"osd":8,"uuid":"c5121f70-e423-4f86-a3c6-90945c9385f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":843701060},{"type":"v1","addr":"172.21.15.171:6817","nonce":843701060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":843701060},{"type":"v1","addr":"172.21.15.171:6819","nonce":843701060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":843701060},{"type":"v1","addr":"172.21.15.171:6823","nonce":843701060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":843701060},{"type":"v1","addr":"172.21.15.171:6821","nonce":843701060}]},"public_addr":"172.21.15.171:6817/843701060","cluster_addr":"172.21.15.171:6819/843701060","heartbeat_back_addr":"172.21.15.171:6823/843701060","heartbeat_front_addr":"172.21.15.171:6821/843701060","state":["exists","up"]},{"osd":9,"uuid":"cd13693a-0f25-47cc-b1a5-9c42481935ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3206550013},{"type":"v1","addr":"172.21.15.44:6827","nonce":3206550013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":3206550013},{"type":"v1","addr":"172.21.15.44:6829","nonce":3206550013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3206550013},{"type":"v1","addr":"172.21.15.44:6833","nonce":3206550013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3206550013},{"type":"v1","addr":"172.21.15.44:6831","nonce":3206550013}]},"public_addr":"172.21.15.44:6827/3206550013","cluster_addr":"172.21.15.44:6829/3206550013","heartbeat_back_addr":"172.21.15.44:6833/3206550013","heartbeat_front_addr":"172.21.15.44:6831/3206550013","state":["exists","up"]},{"osd":10,"uuid":"a36ffeb1-6ecf-4899-bdfa-18515afefb86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3034738363},{"type":"v1","addr":"172.21.15.116:6825","nonce":3034738363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3034738363},{"type":"v1","addr":"172.21.15.116:6827","nonce":3034738363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3034738363},{"type":"v1","addr":"172.21.15.116:6831","nonce":3034738363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3034738363},{"type":"v1","addr":"172.21.15.116:6829","nonce":3034738363}]},"public_addr":"172.21.15.116:6825/3034738363","cluster_addr":"172.21.15.116:6827/3034738363","heartbeat_back_addr":"172.21.15.116:6831/3034738363","heartbeat_front_addr":"172.21.15.116:6829/3034738363","state":["exists","up"]},{"osd":11,"uuid":"ffcf44a8-3094-4a29-822e-a6ce95da119e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1500842656},{"type":"v1","addr":"172.21.15.171:6825","nonce":1500842656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1500842656},{"type":"v1","addr":"172.21.15.171:6827","nonce":1500842656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1500842656},{"type":"v1","addr":"172.21.15.171:6831","nonce":1500842656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1500842656},{"type":"v1","addr":"172.21.15.171:6829","nonce":1500842656}]},"public_addr":"172.21.15.171:6825/1500842656","cluster_addr":"172.21.15.171:6827/1500842656","heartbeat_back_addr":"172.21.15.171:6831/1500842656","heartbeat_front_addr":"172.21.15.171:6829/1500842656","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:05:56.916127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:06:17.603805+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:06:38.642970+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:07:00.667062+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:07:22.542529+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:07:44.732304+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:08:07.050742+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:08:29.451498+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:08:52.222169+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:09:15.422629+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:09:37.295311+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:09:59.716431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6800/1300308907":"2024-08-20T00:04:38.392912+0000","172.21.15.44:0/1001446555":"2024-08-20T00:04:38.392912+0000","172.21.15.44:0/3800526625":"2024-08-20T00:04:38.392912+0000","172.21.15.44:6801/1300308907":"2024-08-20T00:04:38.392912+0000","172.21.15.44:0/3096491642":"2024-08-20T00:04:14.604141+0000","172.21.15.44:0/400419582":"2024-08-20T00:04:38.392912+0000","172.21.15.44:0/1869412718":"2024-08-20T00:04:14.604141+0000","172.21.15.44:6801/1374527587":"2024-08-20T00:04:14.604141+0000","172.21.15.44:0/911382683":"2024-08-20T00:04:14.604141+0000","172.21.15.44:6800/1374527587":"2024-08-20T00:04:14.604141+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:12:37.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:37.701+0000 7f4c9a435640 1 -- 172.21.15.44:0/3924171030 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f4c7c0a2c10 msgr2=0x7f4c7c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:37.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:37.701+0000 7f4c9a435640 1 --2- 172.21.15.44:0/3924171030 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f4c7c0a2c10 0x7f4c7c0a50d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4c84009900 tx=0x7f4c840058d0 comp rx=0 tx=0).stop 2024-08-19T00:12:37.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:37.701+0000 7f4c9a435640 1 -- 172.21.15.44:0/3924171030 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c941078c0 msgr2=0x7f4c9419c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:37.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:37.701+0000 7f4c9a435640 1 --2- 172.21.15.44:0/3924171030 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c941078c0 0x7f4c9419c950 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c00cce0 tx=0x7f4c8c00a620 comp rx=0 tx=0).stop 2024-08-19T00:12:37.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:37.701+0000 7f4c9a435640 1 -- 172.21.15.44:0/3924171030 shutdown_connections 2024-08-19T00:12:37.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:37.701+0000 7f4c9a435640 1 --2- 172.21.15.44:0/3924171030 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f4c7c0a2c10 0x7f4c7c0a50d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:37.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:37.701+0000 7f4c9a435640 1 --2- 172.21.15.44:0/3924171030 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4c94102260 0x7f4c941985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:37.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:37.701+0000 7f4c9a435640 1 --2- 172.21.15.44:0/3924171030 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c941078c0 0x7f4c9419c950 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:37.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:37.701+0000 7f4c9a435640 1 --2- 172.21.15.44:0/3924171030 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c941018c0 0x7f4c94198080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:37.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:37.701+0000 7f4c9a435640 1 -- 172.21.15.44:0/3924171030 >> 172.21.15.44:0/3924171030 conn(0x7f4c940fd5e0 msgr2=0x7f4c940fdb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:37.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:37.701+0000 7f4c9a435640 1 -- 172.21.15.44:0/3924171030 shutdown_connections 2024-08-19T00:12:37.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:37.701+0000 7f4c9a435640 1 -- 172.21.15.44:0/3924171030 wait complete. 2024-08-19T00:12:37.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:37 smithi171 ceph-mon[21810]: pgmap v321: 129 pgs: 129 active+clean; 645 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-08-19T00:12:37.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:37 smithi116 ceph-mon[21873]: pgmap v321: 129 pgs: 129 active+clean; 645 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-08-19T00:12:38.327 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-19T00:12:38.586 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:12:38.838 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:38 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/3924171030' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-19T00:12:38.841 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:38 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/3924171030' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-19T00:12:38.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:38 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/3924171030' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-19T00:12:39.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:39.037+0000 7f152bf38640 1 -- 172.21.15.44:0/199909357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1524103390 msgr2=0x7f152410b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:39.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:39.037+0000 7f152bf38640 1 --2- 172.21.15.44:0/199909357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1524103390 0x7f152410b880 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1514009900 tx=0x7f151402a480 comp rx=0 tx=0).stop 2024-08-19T00:12:39.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:39.037+0000 7f152bf38640 1 -- 172.21.15.44:0/199909357 shutdown_connections 2024-08-19T00:12:39.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:39.037+0000 7f152bf38640 1 --2- 172.21.15.44:0/199909357 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f152410bea0 0x7f152410e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:39.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:39.037+0000 7f152bf38640 1 --2- 172.21.15.44:0/199909357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1524103390 0x7f152410b880 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:39.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:39.037+0000 7f152bf38640 1 --2- 172.21.15.44:0/199909357 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1524102a70 0x7f1524102e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:39.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:39.037+0000 7f152bf38640 1 -- 172.21.15.44:0/199909357 >> 172.21.15.44:0/199909357 conn(0x7f15240fc4d0 msgr2=0x7f15240fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:39.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:39.037+0000 7f152bf38640 1 -- 172.21.15.44:0/199909357 shutdown_connections 2024-08-19T00:12:39.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:39.037+0000 7f152bf38640 1 -- 172.21.15.44:0/199909357 wait complete. 2024-08-19T00:12:39.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:39.038+0000 7f152bf38640 1 Processor -- start 2024-08-19T00:12:39.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:39.038+0000 7f152bf38640 1 -- start start 2024-08-19T00:12:39.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:39.038+0000 7f152bf38640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1524102a70 0x7f1524198180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:39.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:39.038+0000 7f152bf38640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1524103390 0x7f15241986c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:39.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:39.038+0000 7f152bf38640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f152410bea0 0x7f152419ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:39.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:39.038+0000 7f152bf38640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1524111ca0 con 0x7f1524102a70 2024-08-19T00:12:39.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:39.038+0000 7f152bf38640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f1524111b20 con 0x7f1524103390 2024-08-19T00:12:39.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:39.038+0000 7f152bf38640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1524111e20 con 0x7f152410bea0 2024-08-19T00:12:39.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:39.038+0000 7f1529cd4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1524102a70 0x7f1524198180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:39.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:39.038+0000 7f1529cd4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1524102a70 0x7f1524198180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39788/0 (socket says 172.21.15.44:39788) 2024-08-19T00:12:39.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:39.038+0000 7f1529cd4640 1 -- 172.21.15.44:0/607561218 learned_addr learned my addr 172.21.15.44:0/607561218 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:12:39.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:39.038+0000 7f15294d3640 1 --2- 172.21.15.44:0/607561218 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1524103390 0x7f15241986c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:39.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:39.038+0000 7f152a4d5640 1 --2- 172.21.15.44:0/607561218 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f152410bea0 0x7f152419ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:39.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:39.039+0000 7f1529cd4640 1 -- 172.21.15.44:0/607561218 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f152410bea0 msgr2=0x7f152419ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:39.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:39.039+0000 7f1529cd4640 1 --2- 172.21.15.44:0/607561218 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f152410bea0 0x7f152419ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:39.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:39.039+0000 7f1529cd4640 1 -- 172.21.15.44:0/607561218 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1524103390 msgr2=0x7f15241986c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:39.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:39.039+0000 7f1529cd4640 1 --2- 172.21.15.44:0/607561218 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1524103390 0x7f15241986c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:39.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:39.039+0000 7f1529cd4640 1 -- 172.21.15.44:0/607561218 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f152419d130 con 0x7f1524102a70 2024-08-19T00:12:39.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:39.039+0000 7f1529cd4640 1 --2- 172.21.15.44:0/607561218 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1524102a70 0x7f1524198180 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f152000d950 tx=0x7f152000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:39.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:39.039+0000 7f151affd640 1 -- 172.21.15.44:0/607561218 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1520017070 con 0x7f1524102a70 2024-08-19T00:12:39.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:39.039+0000 7f151affd640 1 -- 172.21.15.44:0/607561218 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1520009c30 con 0x7f1524102a70 2024-08-19T00:12:39.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:39.039+0000 7f152bf38640 1 -- 172.21.15.44:0/607561218 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f152419d420 con 0x7f1524102a70 2024-08-19T00:12:39.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:39.039+0000 7f151affd640 1 -- 172.21.15.44:0/607561218 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f152000f6b0 con 0x7f1524102a70 2024-08-19T00:12:39.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:39.039+0000 7f152bf38640 1 -- 172.21.15.44:0/607561218 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15241a4d00 con 0x7f1524102a70 2024-08-19T00:12:39.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:39.040+0000 7f152bf38640 1 -- 172.21.15.44:0/607561218 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1524102e50 con 0x7f1524102a70 2024-08-19T00:12:39.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:39.041+0000 7f151affd640 1 -- 172.21.15.44:0/607561218 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f15200109d0 con 0x7f1524102a70 2024-08-19T00:12:39.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:39.042+0000 7f151affd640 1 --2- 172.21.15.44:0/607561218 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f15100a2c10 0x7f15100a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:39.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:39.042+0000 7f15294d3640 1 --2- 172.21.15.44:0/607561218 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f15100a2c10 0x7f15100a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:39.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:39.042+0000 7f151affd640 1 -- 172.21.15.44:0/607561218 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f15200cf170 con 0x7f1524102a70 2024-08-19T00:12:39.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:39.042+0000 7f15294d3640 1 --2- 172.21.15.44:0/607561218 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f15100a2c10 0x7f15100a50d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1514009230 tx=0x7f15140058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:39.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:39.046+0000 7f151affd640 1 -- 172.21.15.44:0/607561218 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f1520009de0 con 0x7f1524102a70 2024-08-19T00:12:39.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:39.261+0000 7f152bf38640 1 -- 172.21.15.44:0/607561218 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1524106f10 con 0x7f1524102a70 2024-08-19T00:12:39.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:39.262+0000 7f151affd640 1 -- 172.21.15.44:0/607561218 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11989 (secure 0 0 0) 0x7f152009b560 con 0x7f1524102a70 2024-08-19T00:12:39.263 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:12:39.264 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":27,"btime":"2024-08-19T00:11:36:898699+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14511,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1538841896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1538841896},{"type":"v1","addr":"172.21.15.116:6833","nonce":1538841896}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/4044471606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4044471606},{"type":"v1","addr":"172.21.15.44:6835","nonce":4044471606}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-19T00:10:53.196636+0000","modified":"2024-08-19T00:11:36.898676+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24473,"mds_1":24446,"mds_2":24439,"mds_3":24431,"mds_4":24418},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14529":{"gid":14529,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6837/1824829052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1824829052},{"type":"v1","addr":"172.21.15.44:6837","nonce":1824829052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14577":{"gid":14577,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6839/3591739042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":3591739042},{"type":"v1","addr":"172.21.15.44:6839","nonce":3591739042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14589":{"gid":14589,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6841/3667695717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6840","nonce":3667695717},{"type":"v1","addr":"172.21.15.44:6841","nonce":3667695717}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24388":{"gid":24388,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1183022838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1183022838},{"type":"v1","addr":"172.21.15.171:6833","nonce":1183022838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6835/2190623851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":2190623851},{"type":"v1","addr":"172.21.15.171:6835","nonce":2190623851}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.171:6837/316231795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":316231795},{"type":"v1","addr":"172.21.15.171:6837","nonce":316231795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":20,"addr":"172.21.15.116:6835/3507399322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3507399322},{"type":"v1","addr":"172.21.15.116:6835","nonce":3507399322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.171:6839/1466585795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":1466585795},{"type":"v1","addr":"172.21.15.171:6839","nonce":1466585795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":17,"addr":"172.21.15.116:6837/2764513846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":2764513846},{"type":"v1","addr":"172.21.15.116:6837","nonce":2764513846}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.116:6839/1032741033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":1032741033},{"type":"v1","addr":"172.21.15.116:6839","nonce":1032741033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24446,24439,24431,24418]},"id":1}]} 2024-08-19T00:12:39.264 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 27 2024-08-19T00:12:39.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:39.264+0000 7f152bf38640 1 -- 172.21.15.44:0/607561218 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f15100a2c10 msgr2=0x7f15100a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:39.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:39.264+0000 7f152bf38640 1 --2- 172.21.15.44:0/607561218 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f15100a2c10 0x7f15100a50d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1514009230 tx=0x7f15140058d0 comp rx=0 tx=0).stop 2024-08-19T00:12:39.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:39.264+0000 7f152bf38640 1 -- 172.21.15.44:0/607561218 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1524102a70 msgr2=0x7f1524198180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:39.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:39.264+0000 7f152bf38640 1 --2- 172.21.15.44:0/607561218 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1524102a70 0x7f1524198180 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f152000d950 tx=0x7f152000de10 comp rx=0 tx=0).stop 2024-08-19T00:12:39.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:39.264+0000 7f152bf38640 1 -- 172.21.15.44:0/607561218 shutdown_connections 2024-08-19T00:12:39.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:39.264+0000 7f152bf38640 1 --2- 172.21.15.44:0/607561218 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f15100a2c10 0x7f15100a50d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:39.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:39.264+0000 7f152bf38640 1 --2- 172.21.15.44:0/607561218 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f152410bea0 0x7f152419ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:39.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:39.264+0000 7f152bf38640 1 --2- 172.21.15.44:0/607561218 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1524103390 0x7f15241986c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:39.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:39.264+0000 7f152bf38640 1 --2- 172.21.15.44:0/607561218 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1524102a70 0x7f1524198180 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:39.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:39.264+0000 7f152bf38640 1 -- 172.21.15.44:0/607561218 >> 172.21.15.44:0/607561218 conn(0x7f15240fc4d0 msgr2=0x7f15240fd1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:39.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:39.264+0000 7f152bf38640 1 -- 172.21.15.44:0/607561218 shutdown_connections 2024-08-19T00:12:39.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:39.264+0000 7f152bf38640 1 -- 172.21.15.44:0/607561218 wait complete. 2024-08-19T00:12:39.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:39 smithi171 ceph-mon[21810]: pgmap v322: 129 pgs: 129 active+clean; 645 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-19T00:12:39.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:39 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-08-19T00:12:39.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:39 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]: dispatch 2024-08-19T00:12:39.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:39 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 7]}]: dispatch 2024-08-19T00:12:39.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:39 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9, 5, 8]}]: dispatch 2024-08-19T00:12:39.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:39 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/607561218' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:12:39.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:39 smithi116 ceph-mon[21873]: pgmap v322: 129 pgs: 129 active+clean; 645 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-19T00:12:39.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:39 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-08-19T00:12:39.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:39 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]: dispatch 2024-08-19T00:12:39.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:39 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 7]}]: dispatch 2024-08-19T00:12:39.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:39 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9, 5, 8]}]: dispatch 2024-08-19T00:12:39.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:39 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/607561218' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:12:39.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:39 smithi044 ceph-mon[18489]: pgmap v322: 129 pgs: 129 active+clean; 645 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-19T00:12:39.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:39 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-08-19T00:12:39.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:39 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]: dispatch 2024-08-19T00:12:39.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:39 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 7]}]: dispatch 2024-08-19T00:12:39.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:39 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9, 5, 8]}]: dispatch 2024-08-19T00:12:39.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:39 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/607561218' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:12:39.951 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-08-19T00:10:53.196636+0000', 'modified': '2024-08-19T00:11:36.898676+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24473, 'mds_1': 24446, 'mds_2': 24439, 'mds_3': 24431, 'mds_4': 24418}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14529': {'gid': 14529, 'name': 'd', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.44:6837/1824829052', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6836', 'nonce': 1824829052}, {'type': 'v1', 'addr': '172.21.15.44:6837', 'nonce': 1824829052}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14577': {'gid': 14577, 'name': 'g', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.44:6839/3591739042', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6838', 'nonce': 3591739042}, {'type': 'v1', 'addr': '172.21.15.44:6839', 'nonce': 3591739042}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14589': {'gid': 14589, 'name': 'a', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.44:6841/3667695717', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6840', 'nonce': 3667695717}, {'type': 'v1', 'addr': '172.21.15.44:6841', 'nonce': 3667695717}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24388': {'gid': 24388, 'name': 'l', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.171:6833/1183022838', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6832', 'nonce': 1183022838}, {'type': 'v1', 'addr': '172.21.15.171:6833', 'nonce': 1183022838}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24412': {'gid': 24412, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.171:6835/2190623851', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6834', 'nonce': 2190623851}, {'type': 'v1', 'addr': '172.21.15.171:6835', 'nonce': 2190623851}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24418': {'gid': 24418, 'name': 'c', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 19, 'addr': '172.21.15.171:6837/316231795', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6836', 'nonce': 316231795}, {'type': 'v1', 'addr': '172.21.15.171:6837', 'nonce': 316231795}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24431': {'gid': 24431, 'name': 'e', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 20, 'addr': '172.21.15.116:6835/3507399322', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6834', 'nonce': 3507399322}, {'type': 'v1', 'addr': '172.21.15.116:6835', 'nonce': 3507399322}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24439': {'gid': 24439, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.171:6839/1466585795', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6838', 'nonce': 1466585795}, {'type': 'v1', 'addr': '172.21.15.171:6839', 'nonce': 1466585795}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24446': {'gid': 24446, 'name': 'h', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.116:6837/2764513846', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6836', 'nonce': 2764513846}, {'type': 'v1', 'addr': '172.21.15.116:6837', 'nonce': 2764513846}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24473': {'gid': 24473, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.116:6839/1032741033', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6838', 'nonce': 1032741033}, {'type': 'v1', 'addr': '172.21.15.116:6839', 'nonce': 1032741033}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24473, 'qdb_cluster': [24473, 24446, 24439, 24431, 24418]} 2024-08-19T00:12:39.951 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-08-19T00:12:39.951 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph tell mds.c status 2024-08-19T00:12:40.207 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:12:40.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.658+0000 7fb8d9710640 1 -- 172.21.15.44:0/4088386538 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8d4108010 msgr2=0x7fb8d410e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:40.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.658+0000 7fb8d9710640 1 --2- 172.21.15.44:0/4088386538 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8d4108010 0x7fb8d410e980 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc009cd0 tx=0x7fb8cc02a910 comp rx=0 tx=0).stop 2024-08-19T00:12:40.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.658+0000 7fb8d9710640 1 -- 172.21.15.44:0/4088386538 shutdown_connections 2024-08-19T00:12:40.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.658+0000 7fb8d9710640 1 --2- 172.21.15.44:0/4088386538 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8d4108010 0x7fb8d410e980 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:40.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.658+0000 7fb8d9710640 1 --2- 172.21.15.44:0/4088386538 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb8d4103490 0x7fb8d41078d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:40.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.658+0000 7fb8d9710640 1 --2- 172.21.15.44:0/4088386538 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb8d4102ae0 0x7fb8d4102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:40.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.658+0000 7fb8d9710640 1 -- 172.21.15.44:0/4088386538 >> 172.21.15.44:0/4088386538 conn(0x7fb8d40fc500 msgr2=0x7fb8d40fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:40.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.658+0000 7fb8d9710640 1 -- 172.21.15.44:0/4088386538 shutdown_connections 2024-08-19T00:12:40.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.658+0000 7fb8d9710640 1 -- 172.21.15.44:0/4088386538 wait complete. 2024-08-19T00:12:40.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.659+0000 7fb8d9710640 1 Processor -- start 2024-08-19T00:12:40.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.660+0000 7fb8d9710640 1 -- start start 2024-08-19T00:12:40.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.660+0000 7fb8d9710640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8d4102ae0 0x7fb8d4198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:40.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.660+0000 7fb8d9710640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb8d4103490 0x7fb8d4198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:40.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.660+0000 7fb8d9710640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb8d4108010 0x7fb8d419cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:40.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.660+0000 7fb8d9710640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d4111e60 con 0x7fb8d4102ae0 2024-08-19T00:12:40.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.660+0000 7fb8d9710640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d4111ce0 con 0x7fb8d4108010 2024-08-19T00:12:40.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.660+0000 7fb8d9710640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d4111fe0 con 0x7fb8d4103490 2024-08-19T00:12:40.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.660+0000 7fb8d2ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8d4102ae0 0x7fb8d4198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:40.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.660+0000 7fb8d2ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8d4102ae0 0x7fb8d4198330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39802/0 (socket says 172.21.15.44:39802) 2024-08-19T00:12:40.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.660+0000 7fb8d2ffd640 1 -- 172.21.15.44:0/2702573557 learned_addr learned my addr 172.21.15.44:0/2702573557 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:12:40.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.660+0000 7fb8d37fe640 1 --2- 172.21.15.44:0/2702573557 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb8d4108010 0x7fb8d419cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:40.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.660+0000 7fb8d2ffd640 1 -- 172.21.15.44:0/2702573557 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb8d4103490 msgr2=0x7fb8d4198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:40.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.660+0000 7fb8d2ffd640 1 --2- 172.21.15.44:0/2702573557 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb8d4103490 0x7fb8d4198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:40.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.660+0000 7fb8d2ffd640 1 -- 172.21.15.44:0/2702573557 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb8d4108010 msgr2=0x7fb8d419cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:40.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.660+0000 7fb8d2ffd640 1 --2- 172.21.15.44:0/2702573557 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb8d4108010 0x7fb8d419cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:40.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.660+0000 7fb8d2ffd640 1 -- 172.21.15.44:0/2702573557 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8d419d2e0 con 0x7fb8d4102ae0 2024-08-19T00:12:40.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.660+0000 7fb8d37fe640 1 --2- 172.21.15.44:0/2702573557 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb8d4108010 0x7fb8d419cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:12:40.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.661+0000 7fb8d2ffd640 1 --2- 172.21.15.44:0/2702573557 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8d4102ae0 0x7fb8d4198330 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb8c400b450 tx=0x7fb8c400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:40.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.661+0000 7fb8cbfff640 1 -- 172.21.15.44:0/2702573557 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c4015020 con 0x7fb8d4102ae0 2024-08-19T00:12:40.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.661+0000 7fb8d9710640 1 -- 172.21.15.44:0/2702573557 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8d419d5d0 con 0x7fb8d4102ae0 2024-08-19T00:12:40.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.661+0000 7fb8cbfff640 1 -- 172.21.15.44:0/2702573557 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb8c4011d70 con 0x7fb8d4102ae0 2024-08-19T00:12:40.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.661+0000 7fb8cbfff640 1 -- 172.21.15.44:0/2702573557 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c400f340 con 0x7fb8d4102ae0 2024-08-19T00:12:40.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.661+0000 7fb8d9710640 1 -- 172.21.15.44:0/2702573557 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8d41a4eb0 con 0x7fb8d4102ae0 2024-08-19T00:12:40.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.663+0000 7fb8cbfff640 1 -- 172.21.15.44:0/2702573557 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fb8c4018020 con 0x7fb8d4102ae0 2024-08-19T00:12:40.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.664+0000 7fb8dbb0e740 1 Processor -- start 2024-08-19T00:12:40.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.664+0000 7fb8dbb0e740 1 -- start start 2024-08-19T00:12:40.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.664+0000 7fb8cbfff640 1 --2- 172.21.15.44:0/2702573557 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fb8c00a2c10 0x7fb8c00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:40.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.664+0000 7fb8cbfff640 1 -- 172.21.15.44:0/2702573557 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9187+0+0 (secure 0 0 0) 0x7fb8c40cefe0 con 0x7fb8d4102ae0 2024-08-19T00:12:40.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.664+0000 7fb8d37fe640 1 --2- 172.21.15.44:0/2702573557 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fb8c00a2c10 0x7fb8c00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:40.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.664+0000 7fb8dbb0e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c9870be630 0x55c9870bea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:40.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.664+0000 7fb8dbb0e740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c9870bef50 0x55c9870c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:40.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.664+0000 7fb8dbb0e740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c9870c9810 0x55c9870cbc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:40.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.664+0000 7fb8dbb0e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55c987023710 con 0x55c9870be630 2024-08-19T00:12:40.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.664+0000 7fb8dbb0e740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55c986fbb770 con 0x55c9870bef50 2024-08-19T00:12:40.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.664+0000 7fb8dbb0e740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55c98701f6d0 con 0x55c9870c9810 2024-08-19T00:12:40.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.664+0000 7fb8d2ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c9870be630 0x55c9870bea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:40.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.664+0000 7fb8d2ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c9870be630 0x55c9870bea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39810/0 (socket says 172.21.15.44:39810) 2024-08-19T00:12:40.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.664+0000 7fb8d2ffd640 1 -- 172.21.15.44:0/3729546563 learned_addr learned my addr 172.21.15.44:0/3729546563 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:12:40.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.664+0000 7fb8d27fc640 1 --2- 172.21.15.44:0/3729546563 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c9870bef50 0x55c9870c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:40.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.665+0000 7fb8d2ffd640 1 -- 172.21.15.44:0/3729546563 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c9870c9810 msgr2=0x55c9870cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:12:40.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.665+0000 7fb8d2ffd640 1 --2- 172.21.15.44:0/3729546563 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c9870c9810 0x55c9870cbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:40.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.665+0000 7fb8d2ffd640 1 -- 172.21.15.44:0/3729546563 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c9870bef50 msgr2=0x55c9870c92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:12:40.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.665+0000 7fb8d2ffd640 1 --2- 172.21.15.44:0/3729546563 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c9870bef50 0x55c9870c92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:40.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.665+0000 7fb8d2ffd640 1 -- 172.21.15.44:0/3729546563 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c986fc23e0 con 0x55c9870be630 2024-08-19T00:12:40.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.665+0000 7fb8d37fe640 1 --2- 172.21.15.44:0/2702573557 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fb8c00a2c10 0x7fb8c00a50d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc006010 tx=0x7fb8cc02f440 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:40.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.665+0000 7fb8d2ffd640 1 --2- 172.21.15.44:0/3729546563 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c9870be630 0x55c9870bea10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb8c40a3b70 tx=0x7fb8c409aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab7a02af80a75250 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:40.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.665+0000 7fb8c97fa640 1 -- 172.21.15.44:0/3729546563 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c409f7e0 con 0x55c9870be630 2024-08-19T00:12:40.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.665+0000 7fb8c97fa640 1 -- 172.21.15.44:0/3729546563 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb8c40a40a0 con 0x55c9870be630 2024-08-19T00:12:40.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.665+0000 7fb8c97fa640 1 -- 172.21.15.44:0/3729546563 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c40ccbe0 con 0x55c9870be630 2024-08-19T00:12:40.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.666+0000 7fb8dbb0e740 1 -- 172.21.15.44:0/3729546563 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c9870be630 msgr2=0x55c9870bea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:40.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.666+0000 7fb8dbb0e740 1 --2- 172.21.15.44:0/3729546563 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c9870be630 0x55c9870bea10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb8c40a3b70 tx=0x7fb8c409aec0 comp rx=0 tx=0).stop 2024-08-19T00:12:40.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.666+0000 7fb8dbb0e740 1 -- 172.21.15.44:0/3729546563 shutdown_connections 2024-08-19T00:12:40.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.666+0000 7fb8dbb0e740 1 --2- 172.21.15.44:0/3729546563 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c9870c9810 0x55c9870cbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:40.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.666+0000 7fb8dbb0e740 1 --2- 172.21.15.44:0/3729546563 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c9870bef50 0x55c9870c92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:40.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.666+0000 7fb8dbb0e740 1 --2- 172.21.15.44:0/3729546563 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c9870be630 0x55c9870bea10 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:40.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.666+0000 7fb8dbb0e740 1 -- 172.21.15.44:0/3729546563 >> 172.21.15.44:0/3729546563 conn(0x55c9870babc0 msgr2=0x55c9870bafa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:40.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.666+0000 7fb8dbb0e740 1 -- 172.21.15.44:0/3729546563 shutdown_connections 2024-08-19T00:12:40.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.666+0000 7fb8dbb0e740 1 -- 172.21.15.44:0/3729546563 wait complete. 2024-08-19T00:12:40.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.666+0000 7fb8dbb0e740 1 -- start start 2024-08-19T00:12:40.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.666+0000 7fb8dbb0e740 1 Processor -- start 2024-08-19T00:12:40.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.667+0000 7fb8dbb0e740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c9870be630 0x55c9870c6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:40.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.667+0000 7fb8dbb0e740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c9870bef50 0x55c9870c6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:40.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.667+0000 7fb8dbb0e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c9870c9810 0x55c9870c7100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:40.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.667+0000 7fb8dbb0e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55c9870cc3e0 con 0x55c9870c9810 2024-08-19T00:12:40.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.667+0000 7fb8dbb0e740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55c986fde970 con 0x55c9870be630 2024-08-19T00:12:40.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.667+0000 7fb8dbb0e740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55c9870cc560 con 0x55c9870bef50 2024-08-19T00:12:40.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.667+0000 7fb8dbb0e740 10 client.0 _ll_register_callbacks cb 0x55c986d327b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:12:40.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.667+0000 7fb8d37fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c9870c9810 0x55c9870c7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:40.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.667+0000 7fb8d37fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c9870c9810 0x55c9870c7100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39826/0 (socket says 172.21.15.44:39826) 2024-08-19T00:12:40.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.667+0000 7fb8d37fe640 1 -- 172.21.15.44:0/616990596 learned_addr learned my addr 172.21.15.44:0/616990596 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:12:40.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.667+0000 7fb8d2ffd640 1 --2- 172.21.15.44:0/616990596 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c9870be630 0x55c9870c6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:40.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.667+0000 7fb8d27fc640 1 --2- 172.21.15.44:0/616990596 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c9870bef50 0x55c9870c6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:40.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.667+0000 7fb8d37fe640 1 -- 172.21.15.44:0/616990596 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c9870bef50 msgr2=0x55c9870c6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:12:40.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.667+0000 7fb8d37fe640 1 --2- 172.21.15.44:0/616990596 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c9870bef50 0x55c9870c6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:40.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.667+0000 7fb8d37fe640 1 -- 172.21.15.44:0/616990596 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c9870be630 msgr2=0x55c9870c6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:12:40.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.667+0000 7fb8d37fe640 1 --2- 172.21.15.44:0/616990596 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c9870be630 0x55c9870c6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:40.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.667+0000 7fb8d37fe640 1 -- 172.21.15.44:0/616990596 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c986d952b0 con 0x55c9870c9810 2024-08-19T00:12:40.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.667+0000 7fb8d2ffd640 1 --2- 172.21.15.44:0/616990596 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c9870be630 0x55c9870c6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:12:40.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.667+0000 7fb8d37fe640 1 --2- 172.21.15.44:0/616990596 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c9870c9810 0x55c9870c7100 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc003ba0 tx=0x7fb8cc02a910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=977e89640ae449d8 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:40.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.667+0000 7fb8ba7fc640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:12:40.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.667+0000 7fb8ba7fc640 1 -- 172.21.15.44:0/616990596 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc0045d0 con 0x55c9870c9810 2024-08-19T00:12:40.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.667+0000 7fb8ba7fc640 1 -- 172.21.15.44:0/616990596 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9187+0+0 (secure 0 0 0) 0x7fb8cc004770 con 0x55c9870c9810 2024-08-19T00:12:40.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.667+0000 7fb8dbb0e740 1 -- 172.21.15.44:0/616990596 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb8c40a40a0 con 0x55c9870c9810 2024-08-19T00:12:40.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.668+0000 7fb8ba7fc640 1 -- 172.21.15.44:0/616990596 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb8cc057050 con 0x55c9870c9810 2024-08-19T00:12:40.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.668+0000 7fb8dbb0e740 10 client.15045 fetch_fsmap learned FSMap version 27 2024-08-19T00:12:40.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.668+0000 7fb8dbb0e740 1 -- 172.21.15.44:0/616990596 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c9870d7fa0 con 0x55c9870c9810 2024-08-19T00:12:40.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.668+0000 7fb8ba7fc640 1 -- 172.21.15.44:0/616990596 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb8c40a40a0 con 0x55c9870c9810 2024-08-19T00:12:40.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.668+0000 7fb8ba7fc640 1 -- 172.21.15.44:0/616990596 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7fb8cc030930 con 0x55c9870c9810 2024-08-19T00:12:40.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.668+0000 7fb8dbb0e740 10 client.15045 fetch_fsmap finished waiting for FSMap version 27 2024-08-19T00:12:40.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.668+0000 7fb8dbb0e740 10 client.15045 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-19T00:12:40.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.668+0000 7fb8dbb0e740 20 client.15045 populate_metadata read hostname 'smithi044' 2024-08-19T00:12:40.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.668+0000 7fb8dbb0e740 1 --2- 172.21.15.44:0/616990596 >> [v2:172.21.15.171:6836/316231795,v1:172.21.15.171:6837/316231795] conn(0x55c9870da630 0x55c9870dbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:40.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.668+0000 7fb8dbb0e740 4 client.15045 mds_command: new command op to 24418 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:12:40.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.668+0000 7fb8dbb0e740 1 -- 172.21.15.44:0/616990596 --> [v2:172.21.15.171:6836/316231795,v1:172.21.15.171:6837/316231795] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c987030c80 con 0x55c9870da630 2024-08-19T00:12:40.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.668+0000 7fb8d2ffd640 1 --2- 172.21.15.44:0/616990596 >> [v2:172.21.15.171:6836/316231795,v1:172.21.15.171:6837/316231795] conn(0x55c9870da630 0x55c9870dbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:40.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.669+0000 7fb8d2ffd640 1 --2- 172.21.15.44:0/616990596 >> [v2:172.21.15.171:6836/316231795,v1:172.21.15.171:6837/316231795] conn(0x55c9870da630 0x55c9870dbaa0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=941ef62928ec8654 server_cookie=7ce94808fb4d35f9 in_seq=0 out_seq=0 2024-08-19T00:12:40.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.669+0000 7fb8ba7fc640 10 client.15045 ms_handle_connect on v2:172.21.15.171:6836/316231795 2024-08-19T00:12:40.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.670+0000 7fb8ba7fc640 1 -- 172.21.15.44:0/616990596 <== mds.4 v2:172.21.15.171:6836/316231795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c987030c80 con 0x55c9870da630 2024-08-19T00:12:40.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.670+0000 7fb8ba7fc640 10 client.15045 handle_command_reply: tid=0 2024-08-19T00:12:40.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.670+0000 7fb8dbb0e740 1 client.15045 shutdown 2024-08-19T00:12:40.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.670+0000 7fb8dbb0e740 1 -- 172.21.15.44:0/616990596 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c9870c9810 msgr2=0x55c9870c7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:40.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.670+0000 7fb8dbb0e740 1 --2- 172.21.15.44:0/616990596 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c9870c9810 0x55c9870c7100 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc003ba0 tx=0x7fb8cc02a910 comp rx=0 tx=0).stop 2024-08-19T00:12:40.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.670+0000 7fb8dbb0e740 1 -- 172.21.15.44:0/616990596 shutdown_connections 2024-08-19T00:12:40.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.670+0000 7fb8dbb0e740 1 --2- 172.21.15.44:0/616990596 >> [v2:172.21.15.171:6836/316231795,v1:172.21.15.171:6837/316231795] conn(0x55c9870da630 0x55c9870dbaa0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:40.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.670+0000 7fb8dbb0e740 1 --2- 172.21.15.44:0/616990596 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c9870bef50 0x55c9870c6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:40.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.670+0000 7fb8dbb0e740 1 --2- 172.21.15.44:0/616990596 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c9870c9810 0x55c9870c7100 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:40.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.670+0000 7fb8dbb0e740 1 --2- 172.21.15.44:0/616990596 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c9870be630 0x55c9870c6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:40.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.670+0000 7fb8dbb0e740 1 -- 172.21.15.44:0/616990596 >> 172.21.15.44:0/616990596 conn(0x55c9870babc0 msgr2=0x55c9870b9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:40.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.670+0000 7fb8ba7fc640 0 client.15045 ms_handle_reset on v2:172.21.15.171:6836/316231795 2024-08-19T00:12:40.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.670+0000 7fb8dbb0e740 1 -- 172.21.15.44:0/616990596 shutdown_connections 2024-08-19T00:12:40.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.670+0000 7fb8dbb0e740 1 -- 172.21.15.44:0/616990596 wait complete. 2024-08-19T00:12:40.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.670+0000 7fb8dbb0e740 20 client.15045 trim_cache size 0 max 16384 2024-08-19T00:12:40.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.688+0000 7fb8dbb0e740 1 Processor -- start 2024-08-19T00:12:40.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.688+0000 7fb8dbb0e740 1 -- start start 2024-08-19T00:12:40.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.689+0000 7fb8dbb0e740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c9870be630 0x55c9870d5920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:40.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.689+0000 7fb8dbb0e740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c9870bef50 0x55c9870c1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:40.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.689+0000 7fb8dbb0e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c9870c9810 0x55c9870e4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:40.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.689+0000 7fb8dbb0e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55c9870d9de0 con 0x55c9870c9810 2024-08-19T00:12:40.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.689+0000 7fb8dbb0e740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55c9870da4b0 con 0x55c9870be630 2024-08-19T00:12:40.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.689+0000 7fb8dbb0e740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55c9870dab80 con 0x55c9870bef50 2024-08-19T00:12:40.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.689+0000 7fb8d37fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c9870c9810 0x55c9870e4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:40.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.689+0000 7fb8d37fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c9870c9810 0x55c9870e4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39834/0 (socket says 172.21.15.44:39834) 2024-08-19T00:12:40.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.689+0000 7fb8d37fe640 1 -- 172.21.15.44:0/1452496955 learned_addr learned my addr 172.21.15.44:0/1452496955 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:12:40.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.689+0000 7fb8d2ffd640 1 --2- 172.21.15.44:0/1452496955 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c9870be630 0x55c9870d5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:40.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.689+0000 7fb8d37fe640 1 -- 172.21.15.44:0/1452496955 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c9870bef50 msgr2=0x55c9870c1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:12:40.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.689+0000 7fb8d27fc640 1 --2- 172.21.15.44:0/1452496955 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c9870bef50 0x55c9870c1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:40.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.689+0000 7fb8d37fe640 1 --2- 172.21.15.44:0/1452496955 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c9870bef50 0x55c9870c1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:40.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.689+0000 7fb8d37fe640 1 -- 172.21.15.44:0/1452496955 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c9870be630 msgr2=0x55c9870d5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:12:40.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.689+0000 7fb8d37fe640 1 --2- 172.21.15.44:0/1452496955 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c9870be630 0x55c9870d5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:40.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.689+0000 7fb8d37fe640 1 -- 172.21.15.44:0/1452496955 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9870b6130 con 0x55c9870c9810 2024-08-19T00:12:40.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.689+0000 7fb8d37fe640 1 --2- 172.21.15.44:0/1452496955 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c9870c9810 0x55c9870e4170 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc004010 tx=0x7fb8cc005c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97ce90b415c4574a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:40.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.690+0000 7fb8c8ff9640 1 -- 172.21.15.44:0/1452496955 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc0043d0 con 0x55c9870c9810 2024-08-19T00:12:40.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.690+0000 7fb8c8ff9640 1 -- 172.21.15.44:0/1452496955 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb8cc036050 con 0x55c9870c9810 2024-08-19T00:12:40.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.690+0000 7fb8c8ff9640 1 -- 172.21.15.44:0/1452496955 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc02f9d0 con 0x55c9870c9810 2024-08-19T00:12:40.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.690+0000 7fb8dbb0e740 1 -- 172.21.15.44:0/1452496955 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c9870c9810 msgr2=0x55c9870e4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:40.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.690+0000 7fb8dbb0e740 1 --2- 172.21.15.44:0/1452496955 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c9870c9810 0x55c9870e4170 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc004010 tx=0x7fb8cc005c70 comp rx=0 tx=0).stop 2024-08-19T00:12:40.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.690+0000 7fb8dbb0e740 1 -- 172.21.15.44:0/1452496955 shutdown_connections 2024-08-19T00:12:40.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.690+0000 7fb8dbb0e740 1 --2- 172.21.15.44:0/1452496955 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c9870bef50 0x55c9870c1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:40.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.690+0000 7fb8dbb0e740 1 --2- 172.21.15.44:0/1452496955 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c9870c9810 0x55c9870e4170 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:40.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.690+0000 7fb8dbb0e740 1 --2- 172.21.15.44:0/1452496955 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c9870be630 0x55c9870d5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:40.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.690+0000 7fb8dbb0e740 1 -- 172.21.15.44:0/1452496955 >> 172.21.15.44:0/1452496955 conn(0x55c9870babc0 msgr2=0x55c9870c19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:40.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.690+0000 7fb8dbb0e740 1 -- 172.21.15.44:0/1452496955 shutdown_connections 2024-08-19T00:12:40.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.690+0000 7fb8dbb0e740 1 -- 172.21.15.44:0/1452496955 wait complete. 2024-08-19T00:12:40.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.691+0000 7fb8dbb0e740 1 -- start start 2024-08-19T00:12:40.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.691+0000 7fb8dbb0e740 1 Processor -- start 2024-08-19T00:12:40.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.691+0000 7fb8dbb0e740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c9870be630 0x55c9870e4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:40.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.691+0000 7fb8dbb0e740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c9870bef50 0x55c9870e4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:40.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.691+0000 7fb8dbb0e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c9870c9810 0x55c9870e1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:40.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.691+0000 7fb8dbb0e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55c9870db920 con 0x55c9870c9810 2024-08-19T00:12:40.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.691+0000 7fb8dbb0e740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55c9870db250 con 0x55c9870bef50 2024-08-19T00:12:40.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.691+0000 7fb8dbb0e740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55c9870dbff0 con 0x55c9870be630 2024-08-19T00:12:40.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.691+0000 7fb8dbb0e740 10 client.0 _ll_register_callbacks cb 0x7fb8cc009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:12:40.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.691+0000 7fb8d37fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c9870c9810 0x55c9870e1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:40.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.691+0000 7fb8d37fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c9870c9810 0x55c9870e1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39836/0 (socket says 172.21.15.44:39836) 2024-08-19T00:12:40.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.691+0000 7fb8d37fe640 1 -- 172.21.15.44:0/1867520034 learned_addr learned my addr 172.21.15.44:0/1867520034 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:12:40.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.691+0000 7fb8d27fc640 1 --2- 172.21.15.44:0/1867520034 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c9870bef50 0x55c9870e4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:40.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.692+0000 7fb8d37fe640 1 -- 172.21.15.44:0/1867520034 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c9870be630 msgr2=0x55c9870e4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:12:40.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.692+0000 7fb8d2ffd640 1 --2- 172.21.15.44:0/1867520034 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c9870be630 0x55c9870e4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:40.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.692+0000 7fb8d37fe640 1 --2- 172.21.15.44:0/1867520034 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c9870be630 0x55c9870e4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:40.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.692+0000 7fb8d37fe640 1 -- 172.21.15.44:0/1867520034 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c9870bef50 msgr2=0x55c9870e4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:12:40.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.692+0000 7fb8d37fe640 1 --2- 172.21.15.44:0/1867520034 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c9870bef50 0x55c9870e4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:40.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.692+0000 7fb8d37fe640 1 -- 172.21.15.44:0/1867520034 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9870e2150 con 0x55c9870c9810 2024-08-19T00:12:40.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.692+0000 7fb8d2ffd640 1 --2- 172.21.15.44:0/1867520034 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c9870be630 0x55c9870e4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:12:40.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.692+0000 7fb8d27fc640 1 --2- 172.21.15.44:0/1867520034 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c9870bef50 0x55c9870e4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:12:40.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.692+0000 7fb8ba7fc640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:12:40.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.692+0000 7fb8d37fe640 1 --2- 172.21.15.44:0/1867520034 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c9870c9810 0x55c9870e1920 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc009bf0 tx=0x7fb8cc004700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=623df6329ae6af1d server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:40.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.692+0000 7fb8ba7fc640 1 -- 172.21.15.44:0/1867520034 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc004d50 con 0x55c9870c9810 2024-08-19T00:12:40.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.692+0000 7fb8ba7fc640 1 -- 172.21.15.44:0/1867520034 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9187+0+0 (secure 0 0 0) 0x7fb8cc0305d0 con 0x55c9870c9810 2024-08-19T00:12:40.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.692+0000 7fb8dbb0e740 1 -- 172.21.15.44:0/1867520034 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb8cc036050 con 0x55c9870c9810 2024-08-19T00:12:40.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.692+0000 7fb8ba7fc640 1 -- 172.21.15.44:0/1867520034 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb8cc074050 con 0x55c9870c9810 2024-08-19T00:12:40.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.692+0000 7fb8dbb0e740 10 client.15051 fetch_fsmap learned FSMap version 27 2024-08-19T00:12:40.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.692+0000 7fb8dbb0e740 1 -- 172.21.15.44:0/1867520034 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c987148a00 con 0x55c9870c9810 2024-08-19T00:12:40.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.692+0000 7fb8ba7fc640 1 -- 172.21.15.44:0/1867520034 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb8cc036050 con 0x55c9870c9810 2024-08-19T00:12:40.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.693+0000 7fb8ba7fc640 1 -- 172.21.15.44:0/1867520034 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7fb8cc005050 con 0x55c9870c9810 2024-08-19T00:12:40.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.693+0000 7fb8dbb0e740 10 client.15051 fetch_fsmap finished waiting for FSMap version 27 2024-08-19T00:12:40.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.693+0000 7fb8dbb0e740 10 client.15051 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-19T00:12:40.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.693+0000 7fb8dbb0e740 20 client.15051 populate_metadata read hostname 'smithi044' 2024-08-19T00:12:40.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.693+0000 7fb8dbb0e740 1 --2- 172.21.15.44:0/1867520034 >> [v2:172.21.15.171:6836/316231795,v1:172.21.15.171:6837/316231795] conn(0x55c98714d110 0x55c98714be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:40.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.693+0000 7fb8dbb0e740 4 client.15051 mds_command: new command op to 24418 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-19T00:12:40.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.693+0000 7fb8dbb0e740 1 -- 172.21.15.44:0/1867520034 --> [v2:172.21.15.171:6836/316231795,v1:172.21.15.171:6837/316231795] -- command(tid 0: {"prefix": "status"}) -- 0x55c98702b190 con 0x55c98714d110 2024-08-19T00:12:40.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.694+0000 7fb8d2ffd640 1 --2- 172.21.15.44:0/1867520034 >> [v2:172.21.15.171:6836/316231795,v1:172.21.15.171:6837/316231795] conn(0x55c98714d110 0x55c98714be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:40.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.695+0000 7fb8d2ffd640 1 --2- 172.21.15.44:0/1867520034 >> [v2:172.21.15.171:6836/316231795,v1:172.21.15.171:6837/316231795] conn(0x55c98714d110 0x55c98714be20 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b55fd69df889aae8 server_cookie=cbb6c0f8e796946d in_seq=0 out_seq=0 2024-08-19T00:12:40.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.695+0000 7fb8ba7fc640 10 client.15051 ms_handle_connect on v2:172.21.15.171:6836/316231795 2024-08-19T00:12:40.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.695+0000 7fb8ba7fc640 1 -- 172.21.15.44:0/1867520034 <== mds.4 v2:172.21.15.171:6836/316231795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55c98702b190 con 0x55c98714d110 2024-08-19T00:12:40.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.695+0000 7fb8ba7fc640 10 client.15051 handle_command_reply: tid=0 2024-08-19T00:12:40.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.695+0000 7fb8dbb0e740 1 client.15051 shutdown 2024-08-19T00:12:40.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.696+0000 7fb8dbb0e740 1 -- 172.21.15.44:0/1867520034 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c9870c9810 msgr2=0x55c9870e1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:40.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.696+0000 7fb8dbb0e740 1 --2- 172.21.15.44:0/1867520034 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c9870c9810 0x55c9870e1920 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc009bf0 tx=0x7fb8cc004700 comp rx=0 tx=0).stop 2024-08-19T00:12:40.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.696+0000 7fb8dbb0e740 1 -- 172.21.15.44:0/1867520034 shutdown_connections 2024-08-19T00:12:40.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.696+0000 7fb8dbb0e740 1 --2- 172.21.15.44:0/1867520034 >> [v2:172.21.15.171:6836/316231795,v1:172.21.15.171:6837/316231795] conn(0x55c98714d110 0x55c98714be20 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:40.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.696+0000 7fb8dbb0e740 1 --2- 172.21.15.44:0/1867520034 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c9870c9810 0x55c9870e1920 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:40.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.696+0000 7fb8dbb0e740 1 --2- 172.21.15.44:0/1867520034 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c9870bef50 0x55c9870e4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:40.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.696+0000 7fb8dbb0e740 1 --2- 172.21.15.44:0/1867520034 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c9870be630 0x55c9870e4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:40.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.696+0000 7fb8dbb0e740 1 -- 172.21.15.44:0/1867520034 >> 172.21.15.44:0/1867520034 conn(0x55c9870babc0 msgr2=0x55c9870c4f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:40.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.696+0000 7fb8ba7fc640 0 client.15051 ms_handle_reset on v2:172.21.15.171:6836/316231795 2024-08-19T00:12:40.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.696+0000 7fb8dbb0e740 1 -- 172.21.15.44:0/1867520034 shutdown_connections 2024-08-19T00:12:40.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.696+0000 7fb8dbb0e740 1 -- 172.21.15.44:0/1867520034 wait complete. 2024-08-19T00:12:40.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.696+0000 7fb8dbb0e740 20 client.15051 trim_cache size 0 max 16384 2024-08-19T00:12:40.702 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-08-19T00:12:40.702 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "647ded64-5dbe-11ef-bccf-c7b262605968", 2024-08-19T00:12:40.702 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 4, 2024-08-19T00:12:40.702 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 24418, 2024-08-19T00:12:40.702 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-08-19T00:12:40.702 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-08-19T00:12:40.702 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-08-19T00:12:40.702 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 64.803950857000004, 2024-08-19T00:12:40.702 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 27, 2024-08-19T00:12:40.702 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 94, 2024-08-19T00:12:40.703 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 90, 2024-08-19T00:12:40.703 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 133.36744987700001 2024-08-19T00:12:40.703 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-08-19T00:12:40.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.696+0000 7fb8d9710640 1 -- 172.21.15.44:0/2702573557 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fb8c00a2c10 msgr2=0x7fb8c00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:40.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.696+0000 7fb8d9710640 1 --2- 172.21.15.44:0/2702573557 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fb8c00a2c10 0x7fb8c00a50d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc006010 tx=0x7fb8cc02f440 comp rx=0 tx=0).stop 2024-08-19T00:12:40.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.696+0000 7fb8d9710640 1 -- 172.21.15.44:0/2702573557 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8d4102ae0 msgr2=0x7fb8d4198330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:40.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.696+0000 7fb8d9710640 1 --2- 172.21.15.44:0/2702573557 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8d4102ae0 0x7fb8d4198330 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb8c400b450 tx=0x7fb8c400b910 comp rx=0 tx=0).stop 2024-08-19T00:12:40.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.696+0000 7fb8d9710640 1 -- 172.21.15.44:0/2702573557 shutdown_connections 2024-08-19T00:12:40.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.696+0000 7fb8d9710640 1 --2- 172.21.15.44:0/2702573557 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fb8c00a2c10 0x7fb8c00a50d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:40.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.696+0000 7fb8d9710640 1 --2- 172.21.15.44:0/2702573557 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb8d4103490 0x7fb8d4198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:40.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.696+0000 7fb8d9710640 1 --2- 172.21.15.44:0/2702573557 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb8d4108010 0x7fb8d419cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:40.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.696+0000 7fb8d9710640 1 --2- 172.21.15.44:0/2702573557 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8d4102ae0 0x7fb8d4198330 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:40.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.696+0000 7fb8d9710640 1 -- 172.21.15.44:0/2702573557 >> 172.21.15.44:0/2702573557 conn(0x7fb8d40fc500 msgr2=0x7fb8d4105a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:40.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.697+0000 7fb8d9710640 1 -- 172.21.15.44:0/2702573557 shutdown_connections 2024-08-19T00:12:40.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:40.697+0000 7fb8d9710640 1 -- 172.21.15.44:0/2702573557 wait complete. 2024-08-19T00:12:40.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:40 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-08-19T00:12:40.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:40 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-08-19T00:12:40.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:40 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 7]}]': finished 2024-08-19T00:12:40.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:40 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9, 5, 8]}]': finished 2024-08-19T00:12:40.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:40 smithi116 ceph-mon[21873]: osdmap e93: 12 total, 12 up, 12 in 2024-08-19T00:12:40.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:40 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-08-19T00:12:40.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:40 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-08-19T00:12:40.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:40 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 7]}]': finished 2024-08-19T00:12:40.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:40 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9, 5, 8]}]': finished 2024-08-19T00:12:40.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:40 smithi044 ceph-mon[18489]: osdmap e93: 12 total, 12 up, 12 in 2024-08-19T00:12:41.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:40 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-08-19T00:12:41.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:40 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-08-19T00:12:41.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:40 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 7]}]': finished 2024-08-19T00:12:41.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:40 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9, 5, 8]}]': finished 2024-08-19T00:12:41.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:40 smithi171 ceph-mon[21810]: osdmap e93: 12 total, 12 up, 12 in 2024-08-19T00:12:41.359 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph tell mds.e status 2024-08-19T00:12:41.616 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:12:41.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:41 smithi116 ceph-mon[21873]: pgmap v324: 129 pgs: 1 peering, 128 active+clean; 645 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-08-19T00:12:41.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:41 smithi116 ceph-mon[21873]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-08-19T00:12:41.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:41 smithi116 ceph-mon[21873]: osdmap e94: 12 total, 12 up, 12 in 2024-08-19T00:12:41.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:41 smithi044 ceph-mon[18489]: pgmap v324: 129 pgs: 1 peering, 128 active+clean; 645 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-08-19T00:12:41.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:41 smithi044 ceph-mon[18489]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-08-19T00:12:41.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:41 smithi044 ceph-mon[18489]: osdmap e94: 12 total, 12 up, 12 in 2024-08-19T00:12:42.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:41 smithi171 ceph-mon[21810]: pgmap v324: 129 pgs: 1 peering, 128 active+clean; 645 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-08-19T00:12:42.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:41 smithi171 ceph-mon[21810]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-08-19T00:12:42.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:41 smithi171 ceph-mon[21810]: osdmap e94: 12 total, 12 up, 12 in 2024-08-19T00:12:42.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.131+0000 7fd2142dd640 1 -- 172.21.15.44:0/541942439 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd20c102260 msgr2=0x7fd20c10e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:42.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.131+0000 7fd2142dd640 1 --2- 172.21.15.44:0/541942439 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd20c102260 0x7fd20c10e790 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd204009cd0 tx=0x7fd20402a8e0 comp rx=0 tx=0).stop 2024-08-19T00:12:42.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.131+0000 7fd2142dd640 1 -- 172.21.15.44:0/541942439 shutdown_connections 2024-08-19T00:12:42.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.131+0000 7fd2142dd640 1 --2- 172.21.15.44:0/541942439 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd20c1018c0 0x7fd20c101d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:42.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.131+0000 7fd2142dd640 1 --2- 172.21.15.44:0/541942439 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd20c102260 0x7fd20c10e790 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:42.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.131+0000 7fd2142dd640 1 --2- 172.21.15.44:0/541942439 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd20c1078c0 0x7fd20c107ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:42.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.131+0000 7fd2142dd640 1 -- 172.21.15.44:0/541942439 >> 172.21.15.44:0/541942439 conn(0x7fd20c0fd620 msgr2=0x7fd20c0ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:42.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.131+0000 7fd2142dd640 1 -- 172.21.15.44:0/541942439 shutdown_connections 2024-08-19T00:12:42.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.131+0000 7fd2142dd640 1 -- 172.21.15.44:0/541942439 wait complete. 2024-08-19T00:12:42.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.131+0000 7fd2142dd640 1 Processor -- start 2024-08-19T00:12:42.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.132+0000 7fd2142dd640 1 -- start start 2024-08-19T00:12:42.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.132+0000 7fd2142dd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd20c1018c0 0x7fd20c074220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:42.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.132+0000 7fd2142dd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd20c102260 0x7fd20c074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:42.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.132+0000 7fd2142dd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd20c1078c0 0x7fd20c074ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:42.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.132+0000 7fd2142dd640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd20c111ce0 con 0x7fd20c1078c0 2024-08-19T00:12:42.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.132+0000 7fd2142dd640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fd20c111b60 con 0x7fd20c102260 2024-08-19T00:12:42.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.132+0000 7fd2142dd640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd20c111e60 con 0x7fd20c1018c0 2024-08-19T00:12:42.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.132+0000 7fd21287a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd20c1078c0 0x7fd20c074ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:42.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.132+0000 7fd21287a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd20c1078c0 0x7fd20c074ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39868/0 (socket says 172.21.15.44:39868) 2024-08-19T00:12:42.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.132+0000 7fd21287a640 1 -- 172.21.15.44:0/1547361823 learned_addr learned my addr 172.21.15.44:0/1547361823 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:12:42.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.132+0000 7fd211878640 1 --2- 172.21.15.44:0/1547361823 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd20c102260 0x7fd20c074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:42.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.132+0000 7fd212079640 1 --2- 172.21.15.44:0/1547361823 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd20c1018c0 0x7fd20c074220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:42.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.132+0000 7fd21287a640 1 -- 172.21.15.44:0/1547361823 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd20c1018c0 msgr2=0x7fd20c074220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:42.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.132+0000 7fd21287a640 1 --2- 172.21.15.44:0/1547361823 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd20c1018c0 0x7fd20c074220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:42.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.132+0000 7fd21287a640 1 -- 172.21.15.44:0/1547361823 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd20c102260 msgr2=0x7fd20c074760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:42.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.132+0000 7fd21287a640 1 --2- 172.21.15.44:0/1547361823 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd20c102260 0x7fd20c074760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:42.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.132+0000 7fd21287a640 1 -- 172.21.15.44:0/1547361823 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd20c1a66b0 con 0x7fd20c1078c0 2024-08-19T00:12:42.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.133+0000 7fd21287a640 1 --2- 172.21.15.44:0/1547361823 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd20c1078c0 0x7fd20c074ca0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fd204005cc0 tx=0x7fd204003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:42.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.133+0000 7fd2037fe640 1 -- 172.21.15.44:0/1547361823 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd204004040 con 0x7fd20c1078c0 2024-08-19T00:12:42.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.133+0000 7fd2142dd640 1 -- 172.21.15.44:0/1547361823 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd20c1a6940 con 0x7fd20c1078c0 2024-08-19T00:12:42.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.133+0000 7fd2037fe640 1 -- 172.21.15.44:0/1547361823 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2040046c0 con 0x7fd20c1078c0 2024-08-19T00:12:42.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.133+0000 7fd2037fe640 1 -- 172.21.15.44:0/1547361823 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd204030e70 con 0x7fd20c1078c0 2024-08-19T00:12:42.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.133+0000 7fd2142dd640 1 -- 172.21.15.44:0/1547361823 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd20c1a6e80 con 0x7fd20c1078c0 2024-08-19T00:12:42.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.135+0000 7fd2037fe640 1 -- 172.21.15.44:0/1547361823 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fd2040305a0 con 0x7fd20c1078c0 2024-08-19T00:12:42.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.136+0000 7fd2037fe640 1 --2- 172.21.15.44:0/1547361823 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fd1f80a2c10 0x7fd1f80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:42.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.136+0000 7fd212079640 1 --2- 172.21.15.44:0/1547361823 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fd1f80a2c10 0x7fd1f80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:42.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.136+0000 7fd2037fe640 1 -- 172.21.15.44:0/1547361823 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9187+0+0 (secure 0 0 0) 0x7fd20402e030 con 0x7fd20c1078c0 2024-08-19T00:12:42.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.136+0000 7fd212079640 1 --2- 172.21.15.44:0/1547361823 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fd1f80a2c10 0x7fd1f80a50d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd208005fd0 tx=0x7fd208005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:42.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.136+0000 7fd2166db740 1 Processor -- start 2024-08-19T00:12:42.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.137+0000 7fd2166db740 1 -- start start 2024-08-19T00:12:42.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.137+0000 7fd2166db740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56020ca28630 0x56020ca28a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:42.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.137+0000 7fd2166db740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56020ca28f50 0x56020ca332d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:42.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.137+0000 7fd2166db740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56020ca33810 0x56020ca35c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:42.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.137+0000 7fd2166db740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56020c98d710 con 0x56020ca28f50 2024-08-19T00:12:42.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.137+0000 7fd2166db740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x56020c925770 con 0x56020ca33810 2024-08-19T00:12:42.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.137+0000 7fd2166db740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x56020c9896d0 con 0x56020ca28630 2024-08-19T00:12:42.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.137+0000 7fd211878640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56020ca28f50 0x56020ca332d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:42.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.137+0000 7fd211878640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56020ca28f50 0x56020ca332d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39884/0 (socket says 172.21.15.44:39884) 2024-08-19T00:12:42.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.137+0000 7fd211878640 1 -- 172.21.15.44:0/3430211675 learned_addr learned my addr 172.21.15.44:0/3430211675 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:12:42.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.137+0000 7fd212079640 1 --2- 172.21.15.44:0/3430211675 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56020ca28630 0x56020ca28a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:42.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.137+0000 7fd21287a640 1 --2- 172.21.15.44:0/3430211675 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56020ca33810 0x56020ca35c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:42.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.138+0000 7fd211878640 1 -- 172.21.15.44:0/3430211675 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56020ca28630 msgr2=0x56020ca28a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:12:42.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.138+0000 7fd211878640 1 --2- 172.21.15.44:0/3430211675 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56020ca28630 0x56020ca28a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:42.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.138+0000 7fd211878640 1 -- 172.21.15.44:0/3430211675 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56020ca33810 msgr2=0x56020ca35c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:12:42.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.138+0000 7fd211878640 1 --2- 172.21.15.44:0/3430211675 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56020ca33810 0x56020ca35c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:42.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.138+0000 7fd211878640 1 -- 172.21.15.44:0/3430211675 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56020c92c3e0 con 0x56020ca28f50 2024-08-19T00:12:42.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.138+0000 7fd21287a640 1 --2- 172.21.15.44:0/3430211675 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56020ca33810 0x56020ca35c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:12:42.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.138+0000 7fd211878640 1 --2- 172.21.15.44:0/3430211675 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56020ca28f50 0x56020ca332d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc009a40 tx=0x7fd1fc009f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=469942fdd59664ca server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:42.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.138+0000 7fd200dea640 1 -- 172.21.15.44:0/3430211675 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc017070 con 0x56020ca28f50 2024-08-19T00:12:42.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.138+0000 7fd200dea640 1 -- 172.21.15.44:0/3430211675 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd1fc013470 con 0x56020ca28f50 2024-08-19T00:12:42.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.138+0000 7fd200dea640 1 -- 172.21.15.44:0/3430211675 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc012630 con 0x56020ca28f50 2024-08-19T00:12:42.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.139+0000 7fd2166db740 1 -- 172.21.15.44:0/3430211675 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56020ca28f50 msgr2=0x56020ca332d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:42.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.139+0000 7fd2166db740 1 --2- 172.21.15.44:0/3430211675 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56020ca28f50 0x56020ca332d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc009a40 tx=0x7fd1fc009f00 comp rx=0 tx=0).stop 2024-08-19T00:12:42.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.139+0000 7fd2166db740 1 -- 172.21.15.44:0/3430211675 shutdown_connections 2024-08-19T00:12:42.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.139+0000 7fd2166db740 1 --2- 172.21.15.44:0/3430211675 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56020ca33810 0x56020ca35c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:42.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.139+0000 7fd2166db740 1 --2- 172.21.15.44:0/3430211675 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56020ca28f50 0x56020ca332d0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:42.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.139+0000 7fd2166db740 1 --2- 172.21.15.44:0/3430211675 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56020ca28630 0x56020ca28a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:42.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.139+0000 7fd2166db740 1 -- 172.21.15.44:0/3430211675 >> 172.21.15.44:0/3430211675 conn(0x56020ca24bc0 msgr2=0x56020ca24fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:42.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.139+0000 7fd2166db740 1 -- 172.21.15.44:0/3430211675 shutdown_connections 2024-08-19T00:12:42.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.139+0000 7fd2166db740 1 -- 172.21.15.44:0/3430211675 wait complete. 2024-08-19T00:12:42.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.139+0000 7fd2166db740 1 -- start start 2024-08-19T00:12:42.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.139+0000 7fd2166db740 1 Processor -- start 2024-08-19T00:12:42.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.140+0000 7fd2166db740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56020ca28630 0x56020ca306b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:42.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.140+0000 7fd2166db740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56020ca28f50 0x56020ca30bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:42.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.140+0000 7fd2166db740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56020ca33810 0x56020ca31130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:42.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.140+0000 7fd2166db740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56020ca363e0 con 0x56020ca28f50 2024-08-19T00:12:42.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.140+0000 7fd2166db740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x56020c948970 con 0x56020ca28630 2024-08-19T00:12:42.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.140+0000 7fd2166db740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x56020ca36560 con 0x56020ca33810 2024-08-19T00:12:42.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.140+0000 7fd2166db740 10 client.0 _ll_register_callbacks cb 0x56020c69c7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:12:42.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.140+0000 7fd211878640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56020ca28f50 0x56020ca30bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:42.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.140+0000 7fd211878640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56020ca28f50 0x56020ca30bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39888/0 (socket says 172.21.15.44:39888) 2024-08-19T00:12:42.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.140+0000 7fd211878640 1 -- 172.21.15.44:0/3331734496 learned_addr learned my addr 172.21.15.44:0/3331734496 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:12:42.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.140+0000 7fd21287a640 1 --2- 172.21.15.44:0/3331734496 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56020ca33810 0x56020ca31130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:42.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.140+0000 7fd212079640 1 --2- 172.21.15.44:0/3331734496 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56020ca28630 0x56020ca306b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:42.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.140+0000 7fd211878640 1 -- 172.21.15.44:0/3331734496 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56020ca33810 msgr2=0x56020ca31130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:12:42.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.140+0000 7fd211878640 1 --2- 172.21.15.44:0/3331734496 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56020ca33810 0x56020ca31130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:42.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.140+0000 7fd211878640 1 -- 172.21.15.44:0/3331734496 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56020ca28630 msgr2=0x56020ca306b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:12:42.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.140+0000 7fd211878640 1 --2- 172.21.15.44:0/3331734496 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56020ca28630 0x56020ca306b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:42.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.140+0000 7fd211878640 1 -- 172.21.15.44:0/3331734496 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56020c6ff2b0 con 0x56020ca28f50 2024-08-19T00:12:42.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.140+0000 7fd212079640 1 --2- 172.21.15.44:0/3331734496 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56020ca28630 0x56020ca306b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:12:42.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.140+0000 7fd211878640 1 --2- 172.21.15.44:0/3331734496 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56020ca28f50 0x56020ca30bf0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc00efd0 tx=0x7fd1fc013cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2e641b4ea310ff5 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:42.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.140+0000 7fd1f5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:12:42.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.141+0000 7fd1f5ffb640 1 -- 172.21.15.44:0/3331734496 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc017050 con 0x56020ca28f50 2024-08-19T00:12:42.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.141+0000 7fd1f5ffb640 1 -- 172.21.15.44:0/3331734496 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9187+0+0 (secure 0 0 0) 0x7fd1fc01c450 con 0x56020ca28f50 2024-08-19T00:12:42.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.141+0000 7fd2166db740 1 -- 172.21.15.44:0/3331734496 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd1fc013470 con 0x56020ca28f50 2024-08-19T00:12:42.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.141+0000 7fd1f5ffb640 1 -- 172.21.15.44:0/3331734496 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd1fc02f050 con 0x56020ca28f50 2024-08-19T00:12:42.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.141+0000 7fd2166db740 10 client.15063 fetch_fsmap learned FSMap version 27 2024-08-19T00:12:42.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.141+0000 7fd2166db740 1 -- 172.21.15.44:0/3331734496 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56020ca41fb0 con 0x56020ca28f50 2024-08-19T00:12:42.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.141+0000 7fd1f5ffb640 1 -- 172.21.15.44:0/3331734496 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd1fc013470 con 0x56020ca28f50 2024-08-19T00:12:42.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.141+0000 7fd1f5ffb640 1 -- 172.21.15.44:0/3331734496 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7fd1fc0267c0 con 0x56020ca28f50 2024-08-19T00:12:42.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.141+0000 7fd2166db740 10 client.15063 fetch_fsmap finished waiting for FSMap version 27 2024-08-19T00:12:42.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.141+0000 7fd2166db740 10 client.15063 resolve_mds: resolved name 'e' to daemon mds.e 2024-08-19T00:12:42.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.141+0000 7fd2166db740 20 client.15063 populate_metadata read hostname 'smithi044' 2024-08-19T00:12:42.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.141+0000 7fd2166db740 1 --2- 172.21.15.44:0/3331734496 >> [v2:172.21.15.116:6834/3507399322,v1:172.21.15.116:6835/3507399322] conn(0x56020ca44240 0x56020ca456b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:42.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.141+0000 7fd2166db740 4 client.15063 mds_command: new command op to 24431 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:12:42.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.141+0000 7fd2166db740 1 -- 172.21.15.44:0/3331734496 --> [v2:172.21.15.116:6834/3507399322,v1:172.21.15.116:6835/3507399322] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56020c99ac80 con 0x56020ca44240 2024-08-19T00:12:42.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.142+0000 7fd212079640 1 --2- 172.21.15.44:0/3331734496 >> [v2:172.21.15.116:6834/3507399322,v1:172.21.15.116:6835/3507399322] conn(0x56020ca44240 0x56020ca456b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:42.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.142+0000 7fd212079640 1 --2- 172.21.15.44:0/3331734496 >> [v2:172.21.15.116:6834/3507399322,v1:172.21.15.116:6835/3507399322] conn(0x56020ca44240 0x56020ca456b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e9a1295b00c34716 server_cookie=906cafd15d6566bf in_seq=0 out_seq=0 2024-08-19T00:12:42.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.142+0000 7fd1f5ffb640 10 client.15063 ms_handle_connect on v2:172.21.15.116:6834/3507399322 2024-08-19T00:12:42.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.143+0000 7fd1f5ffb640 1 -- 172.21.15.44:0/3331734496 <== mds.3 v2:172.21.15.116:6834/3507399322 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56020c99ac80 con 0x56020ca44240 2024-08-19T00:12:42.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.143+0000 7fd1f5ffb640 10 client.15063 handle_command_reply: tid=0 2024-08-19T00:12:42.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.143+0000 7fd2166db740 1 client.15063 shutdown 2024-08-19T00:12:42.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.143+0000 7fd2166db740 1 -- 172.21.15.44:0/3331734496 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56020ca28f50 msgr2=0x56020ca30bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:42.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.143+0000 7fd2166db740 1 --2- 172.21.15.44:0/3331734496 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56020ca28f50 0x56020ca30bf0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc00efd0 tx=0x7fd1fc013cd0 comp rx=0 tx=0).stop 2024-08-19T00:12:42.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.143+0000 7fd2166db740 1 -- 172.21.15.44:0/3331734496 shutdown_connections 2024-08-19T00:12:42.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.143+0000 7fd2166db740 1 --2- 172.21.15.44:0/3331734496 >> [v2:172.21.15.116:6834/3507399322,v1:172.21.15.116:6835/3507399322] conn(0x56020ca44240 0x56020ca456b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:42.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.143+0000 7fd2166db740 1 --2- 172.21.15.44:0/3331734496 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56020ca33810 0x56020ca31130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:42.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.143+0000 7fd2166db740 1 --2- 172.21.15.44:0/3331734496 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56020ca28f50 0x56020ca30bf0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:42.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.143+0000 7fd2166db740 1 --2- 172.21.15.44:0/3331734496 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56020ca28630 0x56020ca306b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:42.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.143+0000 7fd2166db740 1 -- 172.21.15.44:0/3331734496 >> 172.21.15.44:0/3331734496 conn(0x56020ca24bc0 msgr2=0x56020ca23d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:42.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.143+0000 7fd1f5ffb640 0 client.15063 ms_handle_reset on v2:172.21.15.116:6834/3507399322 2024-08-19T00:12:42.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.143+0000 7fd2166db740 1 -- 172.21.15.44:0/3331734496 shutdown_connections 2024-08-19T00:12:42.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.143+0000 7fd2166db740 1 -- 172.21.15.44:0/3331734496 wait complete. 2024-08-19T00:12:42.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.143+0000 7fd2166db740 20 client.15063 trim_cache size 0 max 16384 2024-08-19T00:12:42.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.161+0000 7fd2166db740 1 Processor -- start 2024-08-19T00:12:42.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.161+0000 7fd2166db740 1 -- start start 2024-08-19T00:12:42.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.161+0000 7fd2166db740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56020ca28630 0x56020ca44fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:42.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.161+0000 7fd2166db740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56020ca28f50 0x56020ca43420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:42.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.161+0000 7fd2166db740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56020ca33810 0x56020ca2f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:42.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.161+0000 7fd2166db740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56020ca439f0 con 0x56020ca33810 2024-08-19T00:12:42.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.161+0000 7fd2166db740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x56020ca440c0 con 0x56020ca28f50 2024-08-19T00:12:42.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.161+0000 7fd2166db740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x56020ca44790 con 0x56020ca28630 2024-08-19T00:12:42.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.161+0000 7fd21287a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56020ca33810 0x56020ca2f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:42.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.162+0000 7fd21287a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56020ca33810 0x56020ca2f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39900/0 (socket says 172.21.15.44:39900) 2024-08-19T00:12:42.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.162+0000 7fd21287a640 1 -- 172.21.15.44:0/2161932135 learned_addr learned my addr 172.21.15.44:0/2161932135 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:12:42.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.162+0000 7fd21287a640 1 -- 172.21.15.44:0/2161932135 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56020ca28630 msgr2=0x56020ca44fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:12:42.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.162+0000 7fd21287a640 1 --2- 172.21.15.44:0/2161932135 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56020ca28630 0x56020ca44fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:42.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.162+0000 7fd21287a640 1 -- 172.21.15.44:0/2161932135 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56020ca28f50 msgr2=0x56020ca43420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:12:42.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.162+0000 7fd211878640 1 --2- 172.21.15.44:0/2161932135 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56020ca28f50 0x56020ca43420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:42.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.162+0000 7fd21287a640 1 --2- 172.21.15.44:0/2161932135 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56020ca28f50 0x56020ca43420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:42.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.162+0000 7fd21287a640 1 -- 172.21.15.44:0/2161932135 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56020ca20130 con 0x56020ca33810 2024-08-19T00:12:42.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.162+0000 7fd211878640 1 --2- 172.21.15.44:0/2161932135 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56020ca28f50 0x56020ca43420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:12:42.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.162+0000 7fd21287a640 1 --2- 172.21.15.44:0/2161932135 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56020ca33810 0x56020ca2f7c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd2040bc9c0 tx=0x7fd20402a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33f8657621b96eb7 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:42.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.162+0000 7fd1f7fff640 1 -- 172.21.15.44:0/2161932135 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2040d5070 con 0x56020ca33810 2024-08-19T00:12:42.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.162+0000 7fd1f7fff640 1 -- 172.21.15.44:0/2161932135 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd204036040 con 0x56020ca33810 2024-08-19T00:12:42.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.162+0000 7fd1f7fff640 1 -- 172.21.15.44:0/2161932135 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd204031e60 con 0x56020ca33810 2024-08-19T00:12:42.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.163+0000 7fd2166db740 1 -- 172.21.15.44:0/2161932135 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56020ca33810 msgr2=0x56020ca2f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:42.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.163+0000 7fd2166db740 1 --2- 172.21.15.44:0/2161932135 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56020ca33810 0x56020ca2f7c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd2040bc9c0 tx=0x7fd20402a8e0 comp rx=0 tx=0).stop 2024-08-19T00:12:42.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.163+0000 7fd2166db740 1 -- 172.21.15.44:0/2161932135 shutdown_connections 2024-08-19T00:12:42.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.163+0000 7fd2166db740 1 --2- 172.21.15.44:0/2161932135 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56020ca33810 0x56020ca2f7c0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:42.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.163+0000 7fd2166db740 1 --2- 172.21.15.44:0/2161932135 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56020ca28f50 0x56020ca43420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:42.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.163+0000 7fd2166db740 1 --2- 172.21.15.44:0/2161932135 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56020ca28630 0x56020ca44fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:42.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.163+0000 7fd2166db740 1 -- 172.21.15.44:0/2161932135 >> 172.21.15.44:0/2161932135 conn(0x56020ca24bc0 msgr2=0x56020ca24fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:42.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.163+0000 7fd2166db740 1 -- 172.21.15.44:0/2161932135 shutdown_connections 2024-08-19T00:12:42.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.163+0000 7fd2166db740 1 -- 172.21.15.44:0/2161932135 wait complete. 2024-08-19T00:12:42.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.163+0000 7fd2166db740 1 -- start start 2024-08-19T00:12:42.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.163+0000 7fd2166db740 1 Processor -- start 2024-08-19T00:12:42.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.163+0000 7fd2166db740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56020ca28630 0x56020ca2cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:42.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.163+0000 7fd2166db740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56020ca28f50 0x56020ca2d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:42.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.163+0000 7fd2166db740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56020ca33810 0x56020ca2d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:42.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.163+0000 7fd2166db740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56020ca45530 con 0x56020ca28630 2024-08-19T00:12:42.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.163+0000 7fd2166db740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x56020ca44e60 con 0x56020ca33810 2024-08-19T00:12:42.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.163+0000 7fd2166db740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x56020ca45c00 con 0x56020ca28f50 2024-08-19T00:12:42.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.163+0000 7fd2166db740 10 client.0 _ll_register_callbacks cb 0x7fd1fc009890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:12:42.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.164+0000 7fd212079640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56020ca28630 0x56020ca2cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:42.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.164+0000 7fd212079640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56020ca28630 0x56020ca2cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39912/0 (socket says 172.21.15.44:39912) 2024-08-19T00:12:42.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.164+0000 7fd212079640 1 -- 172.21.15.44:0/4073431033 learned_addr learned my addr 172.21.15.44:0/4073431033 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:12:42.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.164+0000 7fd21287a640 1 --2- 172.21.15.44:0/4073431033 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56020ca33810 0x56020ca2d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:42.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.164+0000 7fd211878640 1 --2- 172.21.15.44:0/4073431033 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56020ca28f50 0x56020ca2d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:42.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.164+0000 7fd212079640 1 -- 172.21.15.44:0/4073431033 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56020ca28f50 msgr2=0x56020ca2d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:12:42.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.164+0000 7fd212079640 1 --2- 172.21.15.44:0/4073431033 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56020ca28f50 0x56020ca2d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:42.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.164+0000 7fd212079640 1 -- 172.21.15.44:0/4073431033 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56020ca33810 msgr2=0x56020ca2d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:12:42.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.164+0000 7fd212079640 1 --2- 172.21.15.44:0/4073431033 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56020ca33810 0x56020ca2d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:42.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.164+0000 7fd212079640 1 -- 172.21.15.44:0/4073431033 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56020ca4cc60 con 0x56020ca28630 2024-08-19T00:12:42.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.164+0000 7fd211878640 1 --2- 172.21.15.44:0/4073431033 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56020ca28f50 0x56020ca2d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:12:42.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.164+0000 7fd212079640 1 --2- 172.21.15.44:0/4073431033 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56020ca28630 0x56020ca2cb00 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd20800b4d0 tx=0x7fd2080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc8f444d51603582 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:42.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.164+0000 7fd1f5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:12:42.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.164+0000 7fd1f5ffb640 1 -- 172.21.15.44:0/4073431033 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd208011650 con 0x56020ca28630 2024-08-19T00:12:42.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.164+0000 7fd1f5ffb640 1 -- 172.21.15.44:0/4073431033 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9187+0+0 (secure 0 0 0) 0x7fd2080117f0 con 0x56020ca28630 2024-08-19T00:12:42.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.164+0000 7fd2166db740 1 -- 172.21.15.44:0/4073431033 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd204036040 con 0x56020ca28630 2024-08-19T00:12:42.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.164+0000 7fd1f5ffb640 1 -- 172.21.15.44:0/4073431033 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd208037050 con 0x56020ca28630 2024-08-19T00:12:42.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.164+0000 7fd2166db740 10 client.15069 fetch_fsmap learned FSMap version 27 2024-08-19T00:12:42.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.164+0000 7fd2166db740 1 -- 172.21.15.44:0/4073431033 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56020ca4df30 con 0x56020ca28630 2024-08-19T00:12:42.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.165+0000 7fd1f5ffb640 1 -- 172.21.15.44:0/4073431033 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd204036040 con 0x56020ca28630 2024-08-19T00:12:42.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.165+0000 7fd1f5ffb640 1 -- 172.21.15.44:0/4073431033 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7fd208027980 con 0x56020ca28630 2024-08-19T00:12:42.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.165+0000 7fd2166db740 10 client.15069 fetch_fsmap finished waiting for FSMap version 27 2024-08-19T00:12:42.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.165+0000 7fd2166db740 10 client.15069 resolve_mds: resolved name 'e' to daemon mds.e 2024-08-19T00:12:42.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.165+0000 7fd2166db740 20 client.15069 populate_metadata read hostname 'smithi044' 2024-08-19T00:12:42.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.165+0000 7fd2166db740 1 --2- 172.21.15.44:0/4073431033 >> [v2:172.21.15.116:6834/3507399322,v1:172.21.15.116:6835/3507399322] conn(0x56020cab2c40 0x56020cab1950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:42.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.165+0000 7fd2166db740 4 client.15069 mds_command: new command op to 24431 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-19T00:12:42.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.165+0000 7fd2166db740 1 -- 172.21.15.44:0/4073431033 --> [v2:172.21.15.116:6834/3507399322,v1:172.21.15.116:6835/3507399322] -- command(tid 0: {"prefix": "status"}) -- 0x56020c995190 con 0x56020cab2c40 2024-08-19T00:12:42.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.165+0000 7fd211878640 1 --2- 172.21.15.44:0/4073431033 >> [v2:172.21.15.116:6834/3507399322,v1:172.21.15.116:6835/3507399322] conn(0x56020cab2c40 0x56020cab1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:42.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.166+0000 7fd1f5ffb640 10 client.15069 ms_handle_connect on v2:172.21.15.116:6834/3507399322 2024-08-19T00:12:42.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.166+0000 7fd211878640 1 --2- 172.21.15.44:0/4073431033 >> [v2:172.21.15.116:6834/3507399322,v1:172.21.15.116:6835/3507399322] conn(0x56020cab2c40 0x56020cab1950 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=6f4f9dd7eacae2dc server_cookie=91996338941ef8b9 in_seq=0 out_seq=0 2024-08-19T00:12:42.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.166+0000 7fd1f5ffb640 1 -- 172.21.15.44:0/4073431033 <== mds.3 v2:172.21.15.116:6834/3507399322 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x56020c995190 con 0x56020cab2c40 2024-08-19T00:12:42.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.166+0000 7fd1f5ffb640 10 client.15069 handle_command_reply: tid=0 2024-08-19T00:12:42.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.166+0000 7fd2166db740 1 client.15069 shutdown 2024-08-19T00:12:42.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.166+0000 7fd2166db740 1 -- 172.21.15.44:0/4073431033 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56020ca28630 msgr2=0x56020ca2cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:42.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.166+0000 7fd2166db740 1 --2- 172.21.15.44:0/4073431033 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56020ca28630 0x56020ca2cb00 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd20800b4d0 tx=0x7fd2080046c0 comp rx=0 tx=0).stop 2024-08-19T00:12:42.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.166+0000 7fd2166db740 1 -- 172.21.15.44:0/4073431033 shutdown_connections 2024-08-19T00:12:42.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.166+0000 7fd2166db740 1 --2- 172.21.15.44:0/4073431033 >> [v2:172.21.15.116:6834/3507399322,v1:172.21.15.116:6835/3507399322] conn(0x56020cab2c40 0x56020cab1950 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:42.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.166+0000 7fd2166db740 1 --2- 172.21.15.44:0/4073431033 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56020ca28f50 0x56020ca2d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:42.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.166+0000 7fd2166db740 1 --2- 172.21.15.44:0/4073431033 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56020ca33810 0x56020ca2d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:42.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.166+0000 7fd1f5ffb640 0 client.15069 ms_handle_reset on v2:172.21.15.116:6834/3507399322 2024-08-19T00:12:42.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.166+0000 7fd2166db740 1 --2- 172.21.15.44:0/4073431033 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56020ca28630 0x56020ca2cb00 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:42.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.166+0000 7fd2166db740 1 -- 172.21.15.44:0/4073431033 >> 172.21.15.44:0/4073431033 conn(0x56020ca24bc0 msgr2=0x56020ca2f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:42.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.166+0000 7fd2166db740 1 -- 172.21.15.44:0/4073431033 shutdown_connections 2024-08-19T00:12:42.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.166+0000 7fd2166db740 1 -- 172.21.15.44:0/4073431033 wait complete. 2024-08-19T00:12:42.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.166+0000 7fd2166db740 20 client.15069 trim_cache size 0 max 16384 2024-08-19T00:12:42.175 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-08-19T00:12:42.175 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "647ded64-5dbe-11ef-bccf-c7b262605968", 2024-08-19T00:12:42.175 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 3, 2024-08-19T00:12:42.175 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 24431, 2024-08-19T00:12:42.175 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-08-19T00:12:42.175 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-08-19T00:12:42.175 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-08-19T00:12:42.175 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 67.283246160000004, 2024-08-19T00:12:42.175 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 27, 2024-08-19T00:12:42.175 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 94, 2024-08-19T00:12:42.175 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 90, 2024-08-19T00:12:42.175 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 139.97747486899999 2024-08-19T00:12:42.176 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-08-19T00:12:42.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.167+0000 7fd2142dd640 1 -- 172.21.15.44:0/1547361823 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fd1f80a2c10 msgr2=0x7fd1f80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:42.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.167+0000 7fd2142dd640 1 --2- 172.21.15.44:0/1547361823 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fd1f80a2c10 0x7fd1f80a50d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd208005fd0 tx=0x7fd208005850 comp rx=0 tx=0).stop 2024-08-19T00:12:42.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.167+0000 7fd2142dd640 1 -- 172.21.15.44:0/1547361823 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd20c1078c0 msgr2=0x7fd20c074ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:42.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.167+0000 7fd2142dd640 1 --2- 172.21.15.44:0/1547361823 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd20c1078c0 0x7fd20c074ca0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fd204005cc0 tx=0x7fd204003970 comp rx=0 tx=0).stop 2024-08-19T00:12:42.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.167+0000 7fd2142dd640 1 -- 172.21.15.44:0/1547361823 shutdown_connections 2024-08-19T00:12:42.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.167+0000 7fd2142dd640 1 --2- 172.21.15.44:0/1547361823 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fd1f80a2c10 0x7fd1f80a50d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:42.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.167+0000 7fd2142dd640 1 --2- 172.21.15.44:0/1547361823 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd20c1078c0 0x7fd20c074ca0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:42.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.167+0000 7fd2142dd640 1 --2- 172.21.15.44:0/1547361823 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd20c102260 0x7fd20c074760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:42.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.167+0000 7fd2142dd640 1 --2- 172.21.15.44:0/1547361823 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd20c1018c0 0x7fd20c074220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:42.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.167+0000 7fd2142dd640 1 -- 172.21.15.44:0/1547361823 >> 172.21.15.44:0/1547361823 conn(0x7fd20c0fd620 msgr2=0x7fd20c0fdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:42.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.167+0000 7fd2142dd640 1 -- 172.21.15.44:0/1547361823 shutdown_connections 2024-08-19T00:12:42.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:42.167+0000 7fd2142dd640 1 -- 172.21.15.44:0/1547361823 wait complete. 2024-08-19T00:12:42.844 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph tell mds.i status 2024-08-19T00:12:43.099 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:12:43.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.575+0000 7fb78b289640 1 -- 172.21.15.44:0/3109004984 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7841007c0 msgr2=0x7fb784100c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:43.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.575+0000 7fb78b289640 1 --2- 172.21.15.44:0/3109004984 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7841007c0 0x7fb784100c20 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb774009930 tx=0x7fb77402a420 comp rx=0 tx=0).stop 2024-08-19T00:12:43.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.575+0000 7fb78b289640 1 -- 172.21.15.44:0/3109004984 shutdown_connections 2024-08-19T00:12:43.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.575+0000 7fb78b289640 1 --2- 172.21.15.44:0/3109004984 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb784101160 0x7fb78410d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:43.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.575+0000 7fb78b289640 1 --2- 172.21.15.44:0/3109004984 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7841007c0 0x7fb784100c20 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:43.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.575+0000 7fb78b289640 1 --2- 172.21.15.44:0/3109004984 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb7841067c0 0x7fb784106ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:43.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.575+0000 7fb78b289640 1 -- 172.21.15.44:0/3109004984 >> 172.21.15.44:0/3109004984 conn(0x7fb7840fc500 msgr2=0x7fb7840fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:43.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.575+0000 7fb78b289640 1 -- 172.21.15.44:0/3109004984 shutdown_connections 2024-08-19T00:12:43.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.575+0000 7fb78b289640 1 -- 172.21.15.44:0/3109004984 wait complete. 2024-08-19T00:12:43.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.575+0000 7fb78b289640 1 Processor -- start 2024-08-19T00:12:43.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.576+0000 7fb78b289640 1 -- start start 2024-08-19T00:12:43.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.576+0000 7fb78b289640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7841007c0 0x7fb784199030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:43.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.576+0000 7fb78b289640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb784101160 0x7fb784199570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:43.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.576+0000 7fb78b289640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb7841067c0 0x7fb7841a40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:43.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.576+0000 7fb78b289640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb784110bc0 con 0x7fb7841007c0 2024-08-19T00:12:43.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.576+0000 7fb78b289640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fb784110a40 con 0x7fb7841067c0 2024-08-19T00:12:43.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.576+0000 7fb78b289640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb784110d40 con 0x7fb784101160 2024-08-19T00:12:43.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.576+0000 7fb789025640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7841007c0 0x7fb784199030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:43.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.576+0000 7fb789025640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7841007c0 0x7fb784199030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39934/0 (socket says 172.21.15.44:39934) 2024-08-19T00:12:43.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.576+0000 7fb789025640 1 -- 172.21.15.44:0/2807199839 learned_addr learned my addr 172.21.15.44:0/2807199839 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:12:43.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.576+0000 7fb788824640 1 --2- 172.21.15.44:0/2807199839 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb784101160 0x7fb784199570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:43.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.576+0000 7fb789025640 1 -- 172.21.15.44:0/2807199839 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb784101160 msgr2=0x7fb784199570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:43.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.576+0000 7fb789025640 1 --2- 172.21.15.44:0/2807199839 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb784101160 0x7fb784199570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:43.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.576+0000 7fb789826640 1 --2- 172.21.15.44:0/2807199839 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb7841067c0 0x7fb7841a40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:43.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.576+0000 7fb789025640 1 -- 172.21.15.44:0/2807199839 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb7841067c0 msgr2=0x7fb7841a40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:43.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.576+0000 7fb789025640 1 --2- 172.21.15.44:0/2807199839 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb7841067c0 0x7fb7841a40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:43.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.576+0000 7fb789025640 1 -- 172.21.15.44:0/2807199839 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb784196e20 con 0x7fb7841007c0 2024-08-19T00:12:43.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.576+0000 7fb789826640 1 --2- 172.21.15.44:0/2807199839 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb7841067c0 0x7fb7841a40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:12:43.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.576+0000 7fb789025640 1 --2- 172.21.15.44:0/2807199839 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7841007c0 0x7fb784199030 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb78000d950 tx=0x7fb78000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:43.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.577+0000 7fb77a7fc640 1 -- 172.21.15.44:0/2807199839 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb780017070 con 0x7fb7841007c0 2024-08-19T00:12:43.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.577+0000 7fb77a7fc640 1 -- 172.21.15.44:0/2807199839 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb780009c30 con 0x7fb7841007c0 2024-08-19T00:12:43.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.577+0000 7fb78b289640 1 -- 172.21.15.44:0/2807199839 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb784197110 con 0x7fb7841007c0 2024-08-19T00:12:43.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.577+0000 7fb77a7fc640 1 -- 172.21.15.44:0/2807199839 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb78000f6b0 con 0x7fb7841007c0 2024-08-19T00:12:43.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.577+0000 7fb78b289640 1 -- 172.21.15.44:0/2807199839 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb784197620 con 0x7fb7841007c0 2024-08-19T00:12:43.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.579+0000 7fb77a7fc640 1 -- 172.21.15.44:0/2807199839 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fb7800109d0 con 0x7fb7841007c0 2024-08-19T00:12:43.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.579+0000 7fb78d687740 1 Processor -- start 2024-08-19T00:12:43.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.579+0000 7fb78d687740 1 -- start start 2024-08-19T00:12:43.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.579+0000 7fb78d687740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a386cb9630 0x55a386cb9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:43.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.580+0000 7fb78d687740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a386cb9f50 0x55a386cc42d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:43.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.580+0000 7fb78d687740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a386cc4810 0x55a386cc6c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:43.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.580+0000 7fb78d687740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a386c1e710 con 0x55a386cc4810 2024-08-19T00:12:43.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.580+0000 7fb78d687740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55a386bb6770 con 0x55a386cb9630 2024-08-19T00:12:43.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.580+0000 7fb78d687740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55a386c1a6d0 con 0x55a386cb9f50 2024-08-19T00:12:43.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.580+0000 7fb788824640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a386cc4810 0x55a386cc6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:43.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.580+0000 7fb788824640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a386cc4810 0x55a386cc6c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39940/0 (socket says 172.21.15.44:39940) 2024-08-19T00:12:43.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.580+0000 7fb788824640 1 -- 172.21.15.44:0/495763351 learned_addr learned my addr 172.21.15.44:0/495763351 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:12:43.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.580+0000 7fb789025640 1 --2- 172.21.15.44:0/495763351 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a386cb9f50 0x55a386cc42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:43.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.580+0000 7fb789826640 1 --2- 172.21.15.44:0/495763351 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a386cb9630 0x55a386cb9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:43.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.580+0000 7fb77a7fc640 1 --2- 172.21.15.44:0/2807199839 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fb7700a2c10 0x7fb7700a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:43.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.580+0000 7fb788824640 1 -- 172.21.15.44:0/495763351 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a386cb9f50 msgr2=0x55a386cc42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:12:43.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.580+0000 7fb788824640 1 --2- 172.21.15.44:0/495763351 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a386cb9f50 0x55a386cc42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:43.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.580+0000 7fb788824640 1 -- 172.21.15.44:0/495763351 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a386cb9630 msgr2=0x55a386cb9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:12:43.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.580+0000 7fb788824640 1 --2- 172.21.15.44:0/495763351 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a386cb9630 0x55a386cb9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:43.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.580+0000 7fb788824640 1 -- 172.21.15.44:0/495763351 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a386bbd3e0 con 0x55a386cc4810 2024-08-19T00:12:43.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.580+0000 7fb77a7fc640 1 -- 172.21.15.44:0/2807199839 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9187+0+0 (secure 0 0 0) 0x7fb7800cf1d0 con 0x7fb7841007c0 2024-08-19T00:12:43.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.580+0000 7fb789826640 1 --2- 172.21.15.44:0/2807199839 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fb7700a2c10 0x7fb7700a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:43.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.580+0000 7fb788824640 1 --2- 172.21.15.44:0/495763351 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a386cc4810 0x55a386cc6c00 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb774009930 tx=0x7fb774032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7cbba12e11f52ce server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:43.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.581+0000 7fb76f7fe640 1 -- 172.21.15.44:0/495763351 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb77403f070 con 0x55a386cc4810 2024-08-19T00:12:43.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.581+0000 7fb76f7fe640 1 -- 172.21.15.44:0/495763351 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7740317b0 con 0x55a386cc4810 2024-08-19T00:12:43.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.581+0000 7fb76f7fe640 1 -- 172.21.15.44:0/495763351 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb774035070 con 0x55a386cc4810 2024-08-19T00:12:43.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.581+0000 7fb78d687740 1 -- 172.21.15.44:0/495763351 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a386cc4810 msgr2=0x55a386cc6c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:43.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.581+0000 7fb789826640 1 --2- 172.21.15.44:0/2807199839 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fb7700a2c10 0x7fb7700a50d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb77c005fd0 tx=0x7fb77c004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:43.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.581+0000 7fb78d687740 1 --2- 172.21.15.44:0/495763351 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a386cc4810 0x55a386cc6c00 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb774009930 tx=0x7fb774032ce0 comp rx=0 tx=0).stop 2024-08-19T00:12:43.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.581+0000 7fb78d687740 1 -- 172.21.15.44:0/495763351 shutdown_connections 2024-08-19T00:12:43.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.581+0000 7fb78d687740 1 --2- 172.21.15.44:0/495763351 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a386cb9f50 0x55a386cc42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:43.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.581+0000 7fb78d687740 1 --2- 172.21.15.44:0/495763351 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a386cc4810 0x55a386cc6c00 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:43.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.581+0000 7fb78d687740 1 --2- 172.21.15.44:0/495763351 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a386cb9630 0x55a386cb9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:43.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.581+0000 7fb78d687740 1 -- 172.21.15.44:0/495763351 >> 172.21.15.44:0/495763351 conn(0x55a386cb5bc0 msgr2=0x55a386cb5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:43.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.581+0000 7fb78d687740 1 -- 172.21.15.44:0/495763351 shutdown_connections 2024-08-19T00:12:43.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.581+0000 7fb78d687740 1 -- 172.21.15.44:0/495763351 wait complete. 2024-08-19T00:12:43.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.582+0000 7fb78d687740 1 -- start start 2024-08-19T00:12:43.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.582+0000 7fb78d687740 1 Processor -- start 2024-08-19T00:12:43.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.582+0000 7fb78d687740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a386cb9630 0x55a386cc1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:43.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.582+0000 7fb78d687740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a386cb9f50 0x55a386cc1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:43.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.582+0000 7fb78d687740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a386cc4810 0x55a386cc20f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:43.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.582+0000 7fb78d687740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a386cc73e0 con 0x55a386cb9f50 2024-08-19T00:12:43.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.582+0000 7fb78d687740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55a386bd9970 con 0x55a386cc4810 2024-08-19T00:12:43.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.582+0000 7fb78d687740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55a386cc7560 con 0x55a386cb9630 2024-08-19T00:12:43.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.583+0000 7fb788824640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a386cb9f50 0x55a386cc1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:43.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.583+0000 7fb78d687740 10 client.0 _ll_register_callbacks cb 0x55a38692d7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:12:43.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.583+0000 7fb788824640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a386cb9f50 0x55a386cc1bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39944/0 (socket says 172.21.15.44:39944) 2024-08-19T00:12:43.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.583+0000 7fb788824640 1 -- 172.21.15.44:0/2262661155 learned_addr learned my addr 172.21.15.44:0/2262661155 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:12:43.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.583+0000 7fb789025640 1 --2- 172.21.15.44:0/2262661155 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a386cb9630 0x55a386cc1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:43.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.583+0000 7fb789826640 1 --2- 172.21.15.44:0/2262661155 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a386cc4810 0x55a386cc20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:43.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.583+0000 7fb788824640 1 -- 172.21.15.44:0/2262661155 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a386cb9630 msgr2=0x55a386cc1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:12:43.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.583+0000 7fb788824640 1 --2- 172.21.15.44:0/2262661155 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a386cb9630 0x55a386cc1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:43.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.583+0000 7fb788824640 1 -- 172.21.15.44:0/2262661155 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a386cc4810 msgr2=0x55a386cc20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:12:43.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.583+0000 7fb788824640 1 --2- 172.21.15.44:0/2262661155 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a386cc4810 0x55a386cc20f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:43.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.583+0000 7fb788824640 1 -- 172.21.15.44:0/2262661155 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3869902b0 con 0x55a386cb9f50 2024-08-19T00:12:43.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.583+0000 7fb789826640 1 --2- 172.21.15.44:0/2262661155 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a386cc4810 0x55a386cc20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:12:43.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.583+0000 7fb788824640 1 --2- 172.21.15.44:0/2262661155 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a386cb9f50 0x55a386cc1bb0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb774009900 tx=0x7fb774004560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=947715ebdaa67e0d server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:43.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.583+0000 7fb76cff9640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:12:43.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.583+0000 7fb76cff9640 1 -- 172.21.15.44:0/2262661155 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb77403f070 con 0x55a386cb9f50 2024-08-19T00:12:43.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.583+0000 7fb76cff9640 1 -- 172.21.15.44:0/2262661155 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9187+0+0 (secure 0 0 0) 0x7fb7740035f0 con 0x55a386cb9f50 2024-08-19T00:12:43.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.583+0000 7fb78d687740 1 -- 172.21.15.44:0/2262661155 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb7740317b0 con 0x55a386cb9f50 2024-08-19T00:12:43.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.583+0000 7fb76cff9640 1 -- 172.21.15.44:0/2262661155 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb774035040 con 0x55a386cb9f50 2024-08-19T00:12:43.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.584+0000 7fb78d687740 10 client.15081 fetch_fsmap learned FSMap version 27 2024-08-19T00:12:43.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.584+0000 7fb78d687740 1 -- 172.21.15.44:0/2262661155 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a386cd2f70 con 0x55a386cb9f50 2024-08-19T00:12:43.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.584+0000 7fb76cff9640 1 -- 172.21.15.44:0/2262661155 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7740317b0 con 0x55a386cb9f50 2024-08-19T00:12:43.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.584+0000 7fb76cff9640 1 -- 172.21.15.44:0/2262661155 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7fb774004990 con 0x55a386cb9f50 2024-08-19T00:12:43.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.584+0000 7fb78d687740 10 client.15081 fetch_fsmap finished waiting for FSMap version 27 2024-08-19T00:12:43.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.584+0000 7fb78d687740 10 client.15081 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-19T00:12:43.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.584+0000 7fb78d687740 20 client.15081 populate_metadata read hostname 'smithi044' 2024-08-19T00:12:43.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.584+0000 7fb78d687740 1 --2- 172.21.15.44:0/2262661155 >> [v2:172.21.15.171:6838/1466585795,v1:172.21.15.171:6839/1466585795] conn(0x55a386cd50d0 0x55a386cd6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:43.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.584+0000 7fb78d687740 4 client.15081 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:12:43.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.584+0000 7fb78d687740 1 -- 172.21.15.44:0/2262661155 --> [v2:172.21.15.171:6838/1466585795,v1:172.21.15.171:6839/1466585795] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a386c2bc80 con 0x55a386cd50d0 2024-08-19T00:12:43.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.584+0000 7fb789025640 1 --2- 172.21.15.44:0/2262661155 >> [v2:172.21.15.171:6838/1466585795,v1:172.21.15.171:6839/1466585795] conn(0x55a386cd50d0 0x55a386cd6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:43.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.586+0000 7fb789025640 1 --2- 172.21.15.44:0/2262661155 >> [v2:172.21.15.171:6838/1466585795,v1:172.21.15.171:6839/1466585795] conn(0x55a386cd50d0 0x55a386cd6540 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b2fe1322c13f35e9 server_cookie=b70e193720fd37db in_seq=0 out_seq=0 2024-08-19T00:12:43.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.586+0000 7fb76cff9640 10 client.15081 ms_handle_connect on v2:172.21.15.171:6838/1466585795 2024-08-19T00:12:43.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.587+0000 7fb76cff9640 1 -- 172.21.15.44:0/2262661155 <== mds.2 v2:172.21.15.171:6838/1466585795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a386c2bc80 con 0x55a386cd50d0 2024-08-19T00:12:43.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.587+0000 7fb76cff9640 10 client.15081 handle_command_reply: tid=0 2024-08-19T00:12:43.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.587+0000 7fb78d687740 1 client.15081 shutdown 2024-08-19T00:12:43.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.587+0000 7fb78d687740 1 -- 172.21.15.44:0/2262661155 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a386cb9f50 msgr2=0x55a386cc1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:43.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.587+0000 7fb78d687740 1 --2- 172.21.15.44:0/2262661155 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a386cb9f50 0x55a386cc1bb0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb774009900 tx=0x7fb774004560 comp rx=0 tx=0).stop 2024-08-19T00:12:43.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.587+0000 7fb78d687740 1 -- 172.21.15.44:0/2262661155 shutdown_connections 2024-08-19T00:12:43.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.587+0000 7fb78d687740 1 --2- 172.21.15.44:0/2262661155 >> [v2:172.21.15.171:6838/1466585795,v1:172.21.15.171:6839/1466585795] conn(0x55a386cd50d0 0x55a386cd6540 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:43.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.587+0000 7fb78d687740 1 --2- 172.21.15.44:0/2262661155 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a386cc4810 0x55a386cc20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:43.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.587+0000 7fb78d687740 1 --2- 172.21.15.44:0/2262661155 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a386cb9f50 0x55a386cc1bb0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:43.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.587+0000 7fb78d687740 1 --2- 172.21.15.44:0/2262661155 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a386cb9630 0x55a386cc1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:43.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.587+0000 7fb78d687740 1 -- 172.21.15.44:0/2262661155 >> 172.21.15.44:0/2262661155 conn(0x55a386cb5bc0 msgr2=0x55a386cbb8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:43.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.587+0000 7fb76cff9640 0 client.15081 ms_handle_reset on v2:172.21.15.171:6838/1466585795 2024-08-19T00:12:43.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.587+0000 7fb78d687740 1 -- 172.21.15.44:0/2262661155 shutdown_connections 2024-08-19T00:12:43.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.587+0000 7fb78d687740 1 -- 172.21.15.44:0/2262661155 wait complete. 2024-08-19T00:12:43.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.587+0000 7fb78d687740 20 client.15081 trim_cache size 0 max 16384 2024-08-19T00:12:43.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.608+0000 7fb78d687740 1 Processor -- start 2024-08-19T00:12:43.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.608+0000 7fb78d687740 1 -- start start 2024-08-19T00:12:43.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.608+0000 7fb78d687740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a386cb9630 0x55a386cd4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:43.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.608+0000 7fb78d687740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a386cb9f50 0x55a386cc0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:43.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.608+0000 7fb78d687740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a386cc4810 0x55a386cc1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:43.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.608+0000 7fb78d687740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a386cd4880 con 0x55a386cb9630 2024-08-19T00:12:43.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.608+0000 7fb78d687740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55a386cd4f50 con 0x55a386cb9f50 2024-08-19T00:12:43.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.608+0000 7fb78d687740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55a386cd5620 con 0x55a386cc4810 2024-08-19T00:12:43.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.608+0000 7fb789025640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a386cb9630 0x55a386cd4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:43.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.608+0000 7fb789025640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a386cb9630 0x55a386cd4a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39958/0 (socket says 172.21.15.44:39958) 2024-08-19T00:12:43.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.608+0000 7fb789025640 1 -- 172.21.15.44:0/304597394 learned_addr learned my addr 172.21.15.44:0/304597394 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:12:43.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.608+0000 7fb789826640 1 --2- 172.21.15.44:0/304597394 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a386cc4810 0x55a386cc1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:43.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.608+0000 7fb788824640 1 --2- 172.21.15.44:0/304597394 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a386cb9f50 0x55a386cc0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:43.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.608+0000 7fb789025640 1 -- 172.21.15.44:0/304597394 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a386cc4810 msgr2=0x55a386cc1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:12:43.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.608+0000 7fb789025640 1 --2- 172.21.15.44:0/304597394 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a386cc4810 0x55a386cc1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:43.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.608+0000 7fb789025640 1 -- 172.21.15.44:0/304597394 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a386cb9f50 msgr2=0x55a386cc0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:12:43.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.608+0000 7fb789025640 1 --2- 172.21.15.44:0/304597394 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a386cb9f50 0x55a386cc0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:43.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.608+0000 7fb789025640 1 -- 172.21.15.44:0/304597394 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a386cb9d80 con 0x55a386cb9630 2024-08-19T00:12:43.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.608+0000 7fb788824640 1 --2- 172.21.15.44:0/304597394 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a386cb9f50 0x55a386cc0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:12:43.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.608+0000 7fb789025640 1 --2- 172.21.15.44:0/304597394 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a386cb9630 0x55a386cd4a00 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb7800cc7f0 tx=0x7fb780005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0e9567b4ab798fb server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:43.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.609+0000 7fb76effd640 1 -- 172.21.15.44:0/304597394 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb780020040 con 0x55a386cb9630 2024-08-19T00:12:43.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.609+0000 7fb76effd640 1 -- 172.21.15.44:0/304597394 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb78009f8c0 con 0x55a386cb9630 2024-08-19T00:12:43.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.609+0000 7fb76effd640 1 -- 172.21.15.44:0/304597394 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb78009a960 con 0x55a386cb9630 2024-08-19T00:12:43.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.609+0000 7fb78d687740 1 -- 172.21.15.44:0/304597394 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a386cb9630 msgr2=0x55a386cd4a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:43.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.609+0000 7fb78d687740 1 --2- 172.21.15.44:0/304597394 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a386cb9630 0x55a386cd4a00 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb7800cc7f0 tx=0x7fb780005f90 comp rx=0 tx=0).stop 2024-08-19T00:12:43.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.609+0000 7fb78d687740 1 -- 172.21.15.44:0/304597394 shutdown_connections 2024-08-19T00:12:43.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.609+0000 7fb78d687740 1 --2- 172.21.15.44:0/304597394 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a386cc4810 0x55a386cc1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:43.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.609+0000 7fb78d687740 1 --2- 172.21.15.44:0/304597394 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a386cb9f50 0x55a386cc0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:43.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.609+0000 7fb78d687740 1 --2- 172.21.15.44:0/304597394 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a386cb9630 0x55a386cd4a00 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:43.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.609+0000 7fb78d687740 1 -- 172.21.15.44:0/304597394 >> 172.21.15.44:0/304597394 conn(0x55a386cb5bc0 msgr2=0x55a386cbfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:43.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.610+0000 7fb78d687740 1 -- 172.21.15.44:0/304597394 shutdown_connections 2024-08-19T00:12:43.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.610+0000 7fb78d687740 1 -- 172.21.15.44:0/304597394 wait complete. 2024-08-19T00:12:43.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.610+0000 7fb78d687740 1 -- start start 2024-08-19T00:12:43.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.610+0000 7fb78d687740 1 Processor -- start 2024-08-19T00:12:43.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.610+0000 7fb78d687740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a386cb9630 0x55a386cdece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:43.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.610+0000 7fb78d687740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a386cb9f50 0x55a386cc5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:43.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.610+0000 7fb78d687740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a386cc4810 0x55a386cc59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:43.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.610+0000 7fb78d687740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a386cd63c0 con 0x55a386cb9f50 2024-08-19T00:12:43.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.610+0000 7fb78d687740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55a386cd5cf0 con 0x55a386cb9630 2024-08-19T00:12:43.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.610+0000 7fb78d687740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55a386cd6a90 con 0x55a386cc4810 2024-08-19T00:12:43.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.610+0000 7fb78d687740 10 client.0 _ll_register_callbacks cb 0x7fb774032c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:12:43.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.610+0000 7fb788824640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a386cb9f50 0x55a386cc5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:43.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.610+0000 7fb789826640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a386cc4810 0x55a386cc59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:43.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.610+0000 7fb788824640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a386cb9f50 0x55a386cc5490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39968/0 (socket says 172.21.15.44:39968) 2024-08-19T00:12:43.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.610+0000 7fb788824640 1 -- 172.21.15.44:0/499697084 learned_addr learned my addr 172.21.15.44:0/499697084 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:12:43.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.611+0000 7fb789025640 1 --2- 172.21.15.44:0/499697084 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a386cb9630 0x55a386cdece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:43.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.611+0000 7fb788824640 1 -- 172.21.15.44:0/499697084 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a386cc4810 msgr2=0x55a386cc59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:12:43.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.611+0000 7fb788824640 1 --2- 172.21.15.44:0/499697084 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a386cc4810 0x55a386cc59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:43.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.611+0000 7fb788824640 1 -- 172.21.15.44:0/499697084 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a386cb9630 msgr2=0x55a386cdece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:12:43.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.611+0000 7fb788824640 1 --2- 172.21.15.44:0/499697084 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a386cb9630 0x55a386cdece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:43.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.611+0000 7fb788824640 1 -- 172.21.15.44:0/499697084 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a386cc5fc0 con 0x55a386cb9f50 2024-08-19T00:12:43.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.611+0000 7fb788824640 1 --2- 172.21.15.44:0/499697084 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a386cb9f50 0x55a386cc5490 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb774004eb0 tx=0x7fb774009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbd6163ad9456beb server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:43.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.611+0000 7fb76cff9640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:12:43.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.611+0000 7fb76cff9640 1 -- 172.21.15.44:0/499697084 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb77403f040 con 0x55a386cb9f50 2024-08-19T00:12:43.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.611+0000 7fb76cff9640 1 -- 172.21.15.44:0/499697084 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9187+0+0 (secure 0 0 0) 0x7fb7740046c0 con 0x55a386cb9f50 2024-08-19T00:12:43.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.611+0000 7fb78d687740 1 -- 172.21.15.44:0/499697084 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb78009f8c0 con 0x55a386cb9f50 2024-08-19T00:12:43.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.611+0000 7fb76cff9640 1 -- 172.21.15.44:0/499697084 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb774005370 con 0x55a386cb9f50 2024-08-19T00:12:43.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.611+0000 7fb78d687740 10 client.15087 fetch_fsmap learned FSMap version 27 2024-08-19T00:12:43.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.611+0000 7fb78d687740 1 -- 172.21.15.44:0/499697084 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a386cdb5b0 con 0x55a386cb9f50 2024-08-19T00:12:43.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.612+0000 7fb76cff9640 1 -- 172.21.15.44:0/499697084 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb78009f8c0 con 0x55a386cb9f50 2024-08-19T00:12:43.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.612+0000 7fb76cff9640 1 -- 172.21.15.44:0/499697084 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7fb774003ad0 con 0x55a386cb9f50 2024-08-19T00:12:43.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.612+0000 7fb78d687740 10 client.15087 fetch_fsmap finished waiting for FSMap version 27 2024-08-19T00:12:43.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.612+0000 7fb78d687740 10 client.15087 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-19T00:12:43.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.612+0000 7fb78d687740 20 client.15087 populate_metadata read hostname 'smithi044' 2024-08-19T00:12:43.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.612+0000 7fb78d687740 1 --2- 172.21.15.44:0/499697084 >> [v2:172.21.15.171:6838/1466585795,v1:172.21.15.171:6839/1466585795] conn(0x55a386d43fa0 0x55a386d42cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:43.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.612+0000 7fb78d687740 4 client.15087 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-19T00:12:43.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.612+0000 7fb78d687740 1 -- 172.21.15.44:0/499697084 --> [v2:172.21.15.171:6838/1466585795,v1:172.21.15.171:6839/1466585795] -- command(tid 0: {"prefix": "status"}) -- 0x55a386c26190 con 0x55a386d43fa0 2024-08-19T00:12:43.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.612+0000 7fb789025640 1 --2- 172.21.15.44:0/499697084 >> [v2:172.21.15.171:6838/1466585795,v1:172.21.15.171:6839/1466585795] conn(0x55a386d43fa0 0x55a386d42cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:43.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.612+0000 7fb789025640 1 --2- 172.21.15.44:0/499697084 >> [v2:172.21.15.171:6838/1466585795,v1:172.21.15.171:6839/1466585795] conn(0x55a386d43fa0 0x55a386d42cb0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=83396386cc86ea86 server_cookie=9765474516c14fc8 in_seq=0 out_seq=0 2024-08-19T00:12:43.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.612+0000 7fb76cff9640 10 client.15087 ms_handle_connect on v2:172.21.15.171:6838/1466585795 2024-08-19T00:12:43.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.613+0000 7fb76cff9640 1 -- 172.21.15.44:0/499697084 <== mds.2 v2:172.21.15.171:6838/1466585795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55a386c26190 con 0x55a386d43fa0 2024-08-19T00:12:43.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.613+0000 7fb76cff9640 10 client.15087 handle_command_reply: tid=0 2024-08-19T00:12:43.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.613+0000 7fb78d687740 1 client.15087 shutdown 2024-08-19T00:12:43.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.613+0000 7fb78d687740 1 -- 172.21.15.44:0/499697084 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a386cb9f50 msgr2=0x55a386cc5490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:43.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.613+0000 7fb78d687740 1 --2- 172.21.15.44:0/499697084 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a386cb9f50 0x55a386cc5490 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb774004eb0 tx=0x7fb774009800 comp rx=0 tx=0).stop 2024-08-19T00:12:43.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.613+0000 7fb78d687740 1 -- 172.21.15.44:0/499697084 shutdown_connections 2024-08-19T00:12:43.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.613+0000 7fb78d687740 1 --2- 172.21.15.44:0/499697084 >> [v2:172.21.15.171:6838/1466585795,v1:172.21.15.171:6839/1466585795] conn(0x55a386d43fa0 0x55a386d42cb0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:43.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.613+0000 7fb78d687740 1 --2- 172.21.15.44:0/499697084 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a386cc4810 0x55a386cc59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:43.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.613+0000 7fb78d687740 1 --2- 172.21.15.44:0/499697084 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a386cb9f50 0x55a386cc5490 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:43.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.613+0000 7fb76cff9640 0 client.15087 ms_handle_reset on v2:172.21.15.171:6838/1466585795 2024-08-19T00:12:43.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.613+0000 7fb78d687740 1 --2- 172.21.15.44:0/499697084 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a386cb9630 0x55a386cdece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:43.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.613+0000 7fb78d687740 1 -- 172.21.15.44:0/499697084 >> 172.21.15.44:0/499697084 conn(0x55a386cb5bc0 msgr2=0x55a386cb4d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:43.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.613+0000 7fb78d687740 1 -- 172.21.15.44:0/499697084 shutdown_connections 2024-08-19T00:12:43.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.613+0000 7fb78d687740 1 -- 172.21.15.44:0/499697084 wait complete. 2024-08-19T00:12:43.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.613+0000 7fb78d687740 20 client.15087 trim_cache size 0 max 16384 2024-08-19T00:12:43.652 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-08-19T00:12:43.652 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "647ded64-5dbe-11ef-bccf-c7b262605968", 2024-08-19T00:12:43.652 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 2, 2024-08-19T00:12:43.652 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 24439, 2024-08-19T00:12:43.652 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-08-19T00:12:43.652 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-08-19T00:12:43.653 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-08-19T00:12:43.653 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 69.743465495999999, 2024-08-19T00:12:43.653 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 27, 2024-08-19T00:12:43.653 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 94, 2024-08-19T00:12:43.653 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 90, 2024-08-19T00:12:43.653 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 130.92029473299999 2024-08-19T00:12:43.653 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-08-19T00:12:43.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.614+0000 7fb78b289640 1 -- 172.21.15.44:0/2807199839 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fb7700a2c10 msgr2=0x7fb7700a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:43.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.614+0000 7fb78b289640 1 --2- 172.21.15.44:0/2807199839 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fb7700a2c10 0x7fb7700a50d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb77c005fd0 tx=0x7fb77c004a40 comp rx=0 tx=0).stop 2024-08-19T00:12:43.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.614+0000 7fb78b289640 1 -- 172.21.15.44:0/2807199839 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7841007c0 msgr2=0x7fb784199030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:43.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.614+0000 7fb78b289640 1 --2- 172.21.15.44:0/2807199839 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7841007c0 0x7fb784199030 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb78000d950 tx=0x7fb78000de10 comp rx=0 tx=0).stop 2024-08-19T00:12:43.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.614+0000 7fb78b289640 1 -- 172.21.15.44:0/2807199839 shutdown_connections 2024-08-19T00:12:43.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.614+0000 7fb78b289640 1 --2- 172.21.15.44:0/2807199839 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fb7700a2c10 0x7fb7700a50d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:43.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.614+0000 7fb78b289640 1 --2- 172.21.15.44:0/2807199839 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb784101160 0x7fb784199570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:43.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.614+0000 7fb78b289640 1 --2- 172.21.15.44:0/2807199839 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb7841067c0 0x7fb7841a40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:43.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.614+0000 7fb78b289640 1 --2- 172.21.15.44:0/2807199839 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7841007c0 0x7fb784199030 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:43.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.614+0000 7fb78b289640 1 -- 172.21.15.44:0/2807199839 >> 172.21.15.44:0/2807199839 conn(0x7fb7840fc500 msgr2=0x7fb7840fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:43.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.614+0000 7fb78b289640 1 -- 172.21.15.44:0/2807199839 shutdown_connections 2024-08-19T00:12:43.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:43.614+0000 7fb78b289640 1 -- 172.21.15.44:0/2807199839 wait complete. 2024-08-19T00:12:43.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:43 smithi116 ceph-mon[21873]: pgmap v326: 129 pgs: 1 peering, 128 active+clean; 645 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2024-08-19T00:12:43.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:43 smithi044 ceph-mon[18489]: pgmap v326: 129 pgs: 1 peering, 128 active+clean; 645 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2024-08-19T00:12:44.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:43 smithi171 ceph-mon[21810]: pgmap v326: 129 pgs: 1 peering, 128 active+clean; 645 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2024-08-19T00:12:44.395 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph tell mds.h status 2024-08-19T00:12:44.656 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:12:45.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.126+0000 7f2324284640 1 -- 172.21.15.44:0/1990595026 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f231c1067b0 msgr2=0x7f231c106b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:45.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.126+0000 7f2324284640 1 --2- 172.21.15.44:0/1990595026 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f231c1067b0 0x7f231c106b90 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2318009930 tx=0x7f231802a420 comp rx=0 tx=0).stop 2024-08-19T00:12:45.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.126+0000 7f2324284640 1 -- 172.21.15.44:0/1990595026 shutdown_connections 2024-08-19T00:12:45.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.126+0000 7f2324284640 1 --2- 172.21.15.44:0/1990595026 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f231c101150 0x7f231c10d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:45.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.126+0000 7f2324284640 1 --2- 172.21.15.44:0/1990595026 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f231c1007b0 0x7f231c100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:45.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.126+0000 7f2324284640 1 --2- 172.21.15.44:0/1990595026 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f231c1067b0 0x7f231c106b90 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:45.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.126+0000 7f2324284640 1 -- 172.21.15.44:0/1990595026 >> 172.21.15.44:0/1990595026 conn(0x7f231c0fc4d0 msgr2=0x7f231c0fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:45.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.126+0000 7f2324284640 1 -- 172.21.15.44:0/1990595026 shutdown_connections 2024-08-19T00:12:45.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.126+0000 7f2324284640 1 -- 172.21.15.44:0/1990595026 wait complete. 2024-08-19T00:12:45.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.126+0000 7f2324284640 1 Processor -- start 2024-08-19T00:12:45.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.126+0000 7f2324284640 1 -- start start 2024-08-19T00:12:45.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.127+0000 7f2324284640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f231c1007b0 0x7f231c199070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:45.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.127+0000 7f2324284640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f231c101150 0x7f231c1995b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:45.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.127+0000 7f2324284640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f231c1067b0 0x7f231c1a40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:45.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.127+0000 7f2324284640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f231c110c20 con 0x7f231c1007b0 2024-08-19T00:12:45.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.127+0000 7f2324284640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f231c110aa0 con 0x7f231c1067b0 2024-08-19T00:12:45.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.127+0000 7f2324284640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f231c110da0 con 0x7f231c101150 2024-08-19T00:12:45.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.127+0000 7f2322020640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f231c1007b0 0x7f231c199070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:45.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.127+0000 7f2322020640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f231c1007b0 0x7f231c199070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39974/0 (socket says 172.21.15.44:39974) 2024-08-19T00:12:45.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.127+0000 7f2322020640 1 -- 172.21.15.44:0/3059106195 learned_addr learned my addr 172.21.15.44:0/3059106195 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:12:45.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.127+0000 7f232181f640 1 --2- 172.21.15.44:0/3059106195 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f231c101150 0x7f231c1995b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:45.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.127+0000 7f2322821640 1 --2- 172.21.15.44:0/3059106195 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f231c1067b0 0x7f231c1a40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:45.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.127+0000 7f2322020640 1 -- 172.21.15.44:0/3059106195 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f231c101150 msgr2=0x7f231c1995b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:45.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.127+0000 7f2322020640 1 --2- 172.21.15.44:0/3059106195 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f231c101150 0x7f231c1995b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:45.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.127+0000 7f2322020640 1 -- 172.21.15.44:0/3059106195 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f231c1067b0 msgr2=0x7f231c1a40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:45.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.127+0000 7f2322020640 1 --2- 172.21.15.44:0/3059106195 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f231c1067b0 0x7f231c1a40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:45.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.127+0000 7f2322020640 1 -- 172.21.15.44:0/3059106195 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f231c1a4630 con 0x7f231c1007b0 2024-08-19T00:12:45.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.127+0000 7f2322020640 1 --2- 172.21.15.44:0/3059106195 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f231c1007b0 0x7f231c199070 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f231802a940 tx=0x7f2318003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:45.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.128+0000 7f23137fe640 1 -- 172.21.15.44:0/3059106195 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f231803f070 con 0x7f231c1007b0 2024-08-19T00:12:45.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.128+0000 7f2324284640 1 -- 172.21.15.44:0/3059106195 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f231c1a4800 con 0x7f231c1007b0 2024-08-19T00:12:45.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.128+0000 7f23137fe640 1 -- 172.21.15.44:0/3059106195 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f231803b460 con 0x7f231c1007b0 2024-08-19T00:12:45.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.128+0000 7f23137fe640 1 -- 172.21.15.44:0/3059106195 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2318035030 con 0x7f231c1007b0 2024-08-19T00:12:45.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.128+0000 7f2324284640 1 -- 172.21.15.44:0/3059106195 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f231c1a4cb0 con 0x7f231c1007b0 2024-08-19T00:12:45.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.130+0000 7f23137fe640 1 -- 172.21.15.44:0/3059106195 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f2318042070 con 0x7f231c1007b0 2024-08-19T00:12:45.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.130+0000 7f2326682740 1 Processor -- start 2024-08-19T00:12:45.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.130+0000 7f2326682740 1 -- start start 2024-08-19T00:12:45.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.131+0000 7f2326682740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56368083b630 0x56368083ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:45.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.131+0000 7f2326682740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56368083bf50 0x5636808462d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:45.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.131+0000 7f2326682740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563680846810 0x563680848c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:45.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.131+0000 7f2326682740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5636807a0710 con 0x56368083b630 2024-08-19T00:12:45.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.131+0000 7f2326682740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x563680738770 con 0x56368083bf50 2024-08-19T00:12:45.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.131+0000 7f2326682740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x56368079c6d0 con 0x563680846810 2024-08-19T00:12:45.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.131+0000 7f2322821640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56368083b630 0x56368083ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:45.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.131+0000 7f2322821640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56368083b630 0x56368083ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39988/0 (socket says 172.21.15.44:39988) 2024-08-19T00:12:45.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.131+0000 7f2322821640 1 -- 172.21.15.44:0/1553688447 learned_addr learned my addr 172.21.15.44:0/1553688447 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:12:45.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.131+0000 7f23137fe640 1 --2- 172.21.15.44:0/3059106195 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f23080a2c10 0x7f23080a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:45.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.131+0000 7f2322020640 1 --2- 172.21.15.44:0/1553688447 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56368083bf50 0x5636808462d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:45.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.131+0000 7f2322821640 1 --2- 172.21.15.44:0/3059106195 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f23080a2c10 0x7f23080a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:45.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.131+0000 7f23137fe640 1 -- 172.21.15.44:0/3059106195 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9187+0+0 (secure 0 0 0) 0x7f23180efea0 con 0x7f231c1007b0 2024-08-19T00:12:45.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.131+0000 7f232181f640 1 --2- 172.21.15.44:0/1553688447 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563680846810 0x563680848c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:45.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.131+0000 7f2322821640 1 -- 172.21.15.44:0/1553688447 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563680846810 msgr2=0x563680848c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:12:45.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.131+0000 7f2322821640 1 --2- 172.21.15.44:0/1553688447 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563680846810 0x563680848c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:45.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.131+0000 7f2322821640 1 -- 172.21.15.44:0/1553688447 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56368083bf50 msgr2=0x5636808462d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:12:45.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.131+0000 7f2322821640 1 --2- 172.21.15.44:0/1553688447 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56368083bf50 0x5636808462d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:45.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.131+0000 7f2322821640 1 -- 172.21.15.44:0/1553688447 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56368073f3e0 con 0x56368083b630 2024-08-19T00:12:45.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.131+0000 7f2322020640 1 --2- 172.21.15.44:0/1553688447 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56368083bf50 0x5636808462d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:12:45.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.131+0000 7f232181f640 1 --2- 172.21.15.44:0/1553688447 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563680846810 0x563680848c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:12:45.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.131+0000 7f2322821640 1 --2- 172.21.15.44:0/1553688447 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56368083b630 0x56368083ba10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f231400ceb0 tx=0x7f2314007680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb7180b263adec45 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:45.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.131+0000 7f2322821640 1 --2- 172.21.15.44:0/3059106195 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f23080a2c10 0x7f23080a50d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2314007b80 tx=0x7f231401b000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:45.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.132+0000 7f2310dea640 1 -- 172.21.15.44:0/1553688447 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2314015050 con 0x56368083b630 2024-08-19T00:12:45.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.132+0000 7f2310dea640 1 -- 172.21.15.44:0/1553688447 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2314016040 con 0x56368083b630 2024-08-19T00:12:45.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.132+0000 7f2310dea640 1 -- 172.21.15.44:0/1553688447 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f231401bb60 con 0x56368083b630 2024-08-19T00:12:45.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.132+0000 7f2326682740 1 -- 172.21.15.44:0/1553688447 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56368083b630 msgr2=0x56368083ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:45.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.132+0000 7f2326682740 1 --2- 172.21.15.44:0/1553688447 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56368083b630 0x56368083ba10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f231400ceb0 tx=0x7f2314007680 comp rx=0 tx=0).stop 2024-08-19T00:12:45.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.132+0000 7f2326682740 1 -- 172.21.15.44:0/1553688447 shutdown_connections 2024-08-19T00:12:45.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.132+0000 7f2326682740 1 --2- 172.21.15.44:0/1553688447 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563680846810 0x563680848c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:45.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.132+0000 7f2326682740 1 --2- 172.21.15.44:0/1553688447 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56368083bf50 0x5636808462d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:45.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.132+0000 7f2326682740 1 --2- 172.21.15.44:0/1553688447 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56368083b630 0x56368083ba10 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:45.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.132+0000 7f2326682740 1 -- 172.21.15.44:0/1553688447 >> 172.21.15.44:0/1553688447 conn(0x563680837bc0 msgr2=0x563680837fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:45.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.132+0000 7f2326682740 1 -- 172.21.15.44:0/1553688447 shutdown_connections 2024-08-19T00:12:45.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.132+0000 7f2326682740 1 -- 172.21.15.44:0/1553688447 wait complete. 2024-08-19T00:12:45.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.133+0000 7f2326682740 1 -- start start 2024-08-19T00:12:45.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.133+0000 7f2326682740 1 Processor -- start 2024-08-19T00:12:45.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.133+0000 7f2326682740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56368083b630 0x5636808436b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:45.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.133+0000 7f2326682740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56368083bf50 0x563680843bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:45.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.133+0000 7f2326682740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563680846810 0x563680844130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:45.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.133+0000 7f2326682740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5636808493e0 con 0x56368083bf50 2024-08-19T00:12:45.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.133+0000 7f2326682740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x56368075b970 con 0x563680846810 2024-08-19T00:12:45.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.133+0000 7f2326682740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x563680849560 con 0x56368083b630 2024-08-19T00:12:45.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.133+0000 7f2326682740 10 client.0 _ll_register_callbacks cb 0x5636804af7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:12:45.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.133+0000 7f232181f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56368083bf50 0x563680843bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:45.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.133+0000 7f232181f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56368083bf50 0x563680843bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39990/0 (socket says 172.21.15.44:39990) 2024-08-19T00:12:45.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.133+0000 7f232181f640 1 -- 172.21.15.44:0/2163936160 learned_addr learned my addr 172.21.15.44:0/2163936160 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:12:45.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.133+0000 7f2322821640 1 --2- 172.21.15.44:0/2163936160 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563680846810 0x563680844130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:45.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.133+0000 7f2322020640 1 --2- 172.21.15.44:0/2163936160 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56368083b630 0x5636808436b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:45.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.133+0000 7f232181f640 1 -- 172.21.15.44:0/2163936160 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56368083b630 msgr2=0x5636808436b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:12:45.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.133+0000 7f232181f640 1 --2- 172.21.15.44:0/2163936160 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56368083b630 0x5636808436b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:45.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.133+0000 7f232181f640 1 -- 172.21.15.44:0/2163936160 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563680846810 msgr2=0x563680844130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:12:45.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.133+0000 7f232181f640 1 --2- 172.21.15.44:0/2163936160 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563680846810 0x563680844130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:45.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.133+0000 7f232181f640 1 -- 172.21.15.44:0/2163936160 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636805122b0 con 0x56368083bf50 2024-08-19T00:12:45.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.133+0000 7f2322821640 1 --2- 172.21.15.44:0/2163936160 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563680846810 0x563680844130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:12:45.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.134+0000 7f232181f640 1 --2- 172.21.15.44:0/2163936160 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56368083bf50 0x563680843bf0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f230c0116c0 tx=0x7f230c011b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4d3350879340857 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:45.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.134+0000 7f2305ffb640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:12:45.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.134+0000 7f2305ffb640 1 -- 172.21.15.44:0/2163936160 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f230c00fb40 con 0x56368083bf50 2024-08-19T00:12:45.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.134+0000 7f2305ffb640 1 -- 172.21.15.44:0/2163936160 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9187+0+0 (secure 0 0 0) 0x7f230c00fce0 con 0x56368083bf50 2024-08-19T00:12:45.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.134+0000 7f2326682740 1 -- 172.21.15.44:0/2163936160 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2314016040 con 0x56368083bf50 2024-08-19T00:12:45.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.134+0000 7f2305ffb640 1 -- 172.21.15.44:0/2163936160 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f230c025050 con 0x56368083bf50 2024-08-19T00:12:45.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.134+0000 7f2326682740 10 client.15099 fetch_fsmap learned FSMap version 27 2024-08-19T00:12:45.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.134+0000 7f2326682740 1 -- 172.21.15.44:0/2163936160 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563680855000 con 0x56368083bf50 2024-08-19T00:12:45.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.134+0000 7f2305ffb640 1 -- 172.21.15.44:0/2163936160 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2314016040 con 0x56368083bf50 2024-08-19T00:12:45.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.134+0000 7f2305ffb640 1 -- 172.21.15.44:0/2163936160 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f230c01a600 con 0x56368083bf50 2024-08-19T00:12:45.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.134+0000 7f2326682740 10 client.15099 fetch_fsmap finished waiting for FSMap version 27 2024-08-19T00:12:45.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.134+0000 7f2326682740 10 client.15099 resolve_mds: resolved name 'h' to daemon mds.h 2024-08-19T00:12:45.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.134+0000 7f2326682740 20 client.15099 populate_metadata read hostname 'smithi044' 2024-08-19T00:12:45.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.134+0000 7f2326682740 1 --2- 172.21.15.44:0/2163936160 >> [v2:172.21.15.116:6836/2764513846,v1:172.21.15.116:6837/2764513846] conn(0x5636808576d0 0x563680858b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:45.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.134+0000 7f2326682740 4 client.15099 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:12:45.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.134+0000 7f2326682740 1 -- 172.21.15.44:0/2163936160 --> [v2:172.21.15.116:6836/2764513846,v1:172.21.15.116:6837/2764513846] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5636807adc80 con 0x5636808576d0 2024-08-19T00:12:45.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.135+0000 7f2322020640 1 --2- 172.21.15.44:0/2163936160 >> [v2:172.21.15.116:6836/2764513846,v1:172.21.15.116:6837/2764513846] conn(0x5636808576d0 0x563680858b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:45.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.135+0000 7f2322020640 1 --2- 172.21.15.44:0/2163936160 >> [v2:172.21.15.116:6836/2764513846,v1:172.21.15.116:6837/2764513846] conn(0x5636808576d0 0x563680858b40 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=524ae88c1ea8377a server_cookie=afd10a22caa01c0 in_seq=0 out_seq=0 2024-08-19T00:12:45.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.135+0000 7f2305ffb640 10 client.15099 ms_handle_connect on v2:172.21.15.116:6836/2764513846 2024-08-19T00:12:45.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.136+0000 7f2305ffb640 1 -- 172.21.15.44:0/2163936160 <== mds.1 v2:172.21.15.116:6836/2764513846 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5636807adc80 con 0x5636808576d0 2024-08-19T00:12:45.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.136+0000 7f2305ffb640 10 client.15099 handle_command_reply: tid=0 2024-08-19T00:12:45.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.136+0000 7f2326682740 1 client.15099 shutdown 2024-08-19T00:12:45.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.136+0000 7f2326682740 1 -- 172.21.15.44:0/2163936160 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56368083bf50 msgr2=0x563680843bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:45.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.136+0000 7f2326682740 1 --2- 172.21.15.44:0/2163936160 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56368083bf50 0x563680843bf0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f230c0116c0 tx=0x7f230c011b80 comp rx=0 tx=0).stop 2024-08-19T00:12:45.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.136+0000 7f2326682740 1 -- 172.21.15.44:0/2163936160 shutdown_connections 2024-08-19T00:12:45.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.136+0000 7f2326682740 1 --2- 172.21.15.44:0/2163936160 >> [v2:172.21.15.116:6836/2764513846,v1:172.21.15.116:6837/2764513846] conn(0x5636808576d0 0x563680858b40 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:45.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.136+0000 7f2305ffb640 0 client.15099 ms_handle_reset on v2:172.21.15.116:6836/2764513846 2024-08-19T00:12:45.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.136+0000 7f2326682740 1 --2- 172.21.15.44:0/2163936160 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563680846810 0x563680844130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:45.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.136+0000 7f2326682740 1 --2- 172.21.15.44:0/2163936160 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56368083bf50 0x563680843bf0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:45.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.136+0000 7f2326682740 1 --2- 172.21.15.44:0/2163936160 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56368083b630 0x5636808436b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:45.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.136+0000 7f2326682740 1 -- 172.21.15.44:0/2163936160 >> 172.21.15.44:0/2163936160 conn(0x563680837bc0 msgr2=0x563680836d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:45.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.136+0000 7f2326682740 1 -- 172.21.15.44:0/2163936160 shutdown_connections 2024-08-19T00:12:45.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.136+0000 7f2326682740 1 -- 172.21.15.44:0/2163936160 wait complete. 2024-08-19T00:12:45.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.136+0000 7f2326682740 20 client.15099 trim_cache size 0 max 16384 2024-08-19T00:12:45.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.154+0000 7f2326682740 1 Processor -- start 2024-08-19T00:12:45.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.154+0000 7f2326682740 1 -- start start 2024-08-19T00:12:45.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.154+0000 7f2326682740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56368083b630 0x56368083e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:45.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.154+0000 7f2326682740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56368083bf50 0x563680843f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:45.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.154+0000 7f2326682740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563680846810 0x563680861210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:45.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.154+0000 7f2326682740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x563680856e80 con 0x56368083bf50 2024-08-19T00:12:45.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.154+0000 7f2326682740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x563680857550 con 0x563680846810 2024-08-19T00:12:45.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.154+0000 7f2326682740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x563680857c20 con 0x56368083b630 2024-08-19T00:12:45.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.155+0000 7f232181f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56368083bf50 0x563680843f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:45.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.155+0000 7f232181f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56368083bf50 0x563680843f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40002/0 (socket says 172.21.15.44:40002) 2024-08-19T00:12:45.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.155+0000 7f232181f640 1 -- 172.21.15.44:0/2355887740 learned_addr learned my addr 172.21.15.44:0/2355887740 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:12:45.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.155+0000 7f2322020640 1 --2- 172.21.15.44:0/2355887740 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56368083b630 0x56368083e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:45.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.155+0000 7f232181f640 1 -- 172.21.15.44:0/2355887740 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56368083b630 msgr2=0x56368083e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:12:45.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.155+0000 7f232181f640 1 --2- 172.21.15.44:0/2355887740 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56368083b630 0x56368083e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:45.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.155+0000 7f2322821640 1 --2- 172.21.15.44:0/2355887740 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563680846810 0x563680861210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:45.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.155+0000 7f232181f640 1 -- 172.21.15.44:0/2355887740 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563680846810 msgr2=0x563680861210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:12:45.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.155+0000 7f232181f640 1 --2- 172.21.15.44:0/2355887740 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563680846810 0x563680861210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:45.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.155+0000 7f232181f640 1 -- 172.21.15.44:0/2355887740 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563680833130 con 0x56368083bf50 2024-08-19T00:12:45.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.155+0000 7f2322020640 1 --2- 172.21.15.44:0/2355887740 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56368083b630 0x56368083e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:12:45.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.155+0000 7f232181f640 1 --2- 172.21.15.44:0/2355887740 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56368083bf50 0x563680843f80 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f230c000c00 tx=0x7f230c00f860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4398af76abeda7b0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:45.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.155+0000 7f2307fff640 1 -- 172.21.15.44:0/2355887740 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f230c02d020 con 0x56368083bf50 2024-08-19T00:12:45.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.155+0000 7f2307fff640 1 -- 172.21.15.44:0/2355887740 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f230c00fe20 con 0x56368083bf50 2024-08-19T00:12:45.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.155+0000 7f2307fff640 1 -- 172.21.15.44:0/2355887740 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f230c004660 con 0x56368083bf50 2024-08-19T00:12:45.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.156+0000 7f2326682740 1 -- 172.21.15.44:0/2355887740 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56368083bf50 msgr2=0x563680843f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:45.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.156+0000 7f2326682740 1 --2- 172.21.15.44:0/2355887740 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56368083bf50 0x563680843f80 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f230c000c00 tx=0x7f230c00f860 comp rx=0 tx=0).stop 2024-08-19T00:12:45.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.156+0000 7f2326682740 1 -- 172.21.15.44:0/2355887740 shutdown_connections 2024-08-19T00:12:45.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.156+0000 7f2326682740 1 --2- 172.21.15.44:0/2355887740 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563680846810 0x563680861210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:45.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.156+0000 7f2326682740 1 --2- 172.21.15.44:0/2355887740 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56368083bf50 0x563680843f80 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:45.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.156+0000 7f2326682740 1 --2- 172.21.15.44:0/2355887740 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56368083b630 0x56368083e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:45.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.156+0000 7f2326682740 1 -- 172.21.15.44:0/2355887740 >> 172.21.15.44:0/2355887740 conn(0x563680837bc0 msgr2=0x563680841f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:45.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.156+0000 7f2326682740 1 -- 172.21.15.44:0/2355887740 shutdown_connections 2024-08-19T00:12:45.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.156+0000 7f2326682740 1 -- 172.21.15.44:0/2355887740 wait complete. 2024-08-19T00:12:45.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.156+0000 7f2326682740 1 -- start start 2024-08-19T00:12:45.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.156+0000 7f2326682740 1 Processor -- start 2024-08-19T00:12:45.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.157+0000 7f2326682740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56368083b630 0x56368085f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:45.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.157+0000 7f2326682740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56368083bf50 0x56368085f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:45.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.157+0000 7f2326682740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563680846810 0x5636808bede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:45.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.157+0000 7f2326682740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5636808589c0 con 0x56368083bf50 2024-08-19T00:12:45.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.157+0000 7f2326682740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5636808582f0 con 0x563680846810 2024-08-19T00:12:45.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.157+0000 7f2326682740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x563680859090 con 0x56368083b630 2024-08-19T00:12:45.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.157+0000 7f2326682740 10 client.0 _ll_register_callbacks cb 0x7f230c00a590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:12:45.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.157+0000 7f232181f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56368083bf50 0x56368085f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:45.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.157+0000 7f232181f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56368083bf50 0x56368085f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40018/0 (socket says 172.21.15.44:40018) 2024-08-19T00:12:45.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.157+0000 7f232181f640 1 -- 172.21.15.44:0/701836369 learned_addr learned my addr 172.21.15.44:0/701836369 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:12:45.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.157+0000 7f2322821640 1 --2- 172.21.15.44:0/701836369 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563680846810 0x5636808bede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:45.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.157+0000 7f232181f640 1 -- 172.21.15.44:0/701836369 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56368083b630 msgr2=0x56368085f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:12:45.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.157+0000 7f232181f640 1 --2- 172.21.15.44:0/701836369 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56368083b630 0x56368085f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:45.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.157+0000 7f232181f640 1 -- 172.21.15.44:0/701836369 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563680846810 msgr2=0x5636808bede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:12:45.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.157+0000 7f232181f640 1 --2- 172.21.15.44:0/701836369 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563680846810 0x5636808bede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:45.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.157+0000 7f232181f640 1 -- 172.21.15.44:0/701836369 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636808bf420 con 0x56368083bf50 2024-08-19T00:12:45.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.157+0000 7f232181f640 1 --2- 172.21.15.44:0/701836369 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56368083bf50 0x56368085f950 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f230c01ac60 tx=0x7f230c00a2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e38b3a400511520a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:45.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.157+0000 7f2305ffb640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:12:45.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.157+0000 7f2305ffb640 1 -- 172.21.15.44:0/701836369 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f230c02d030 con 0x56368083bf50 2024-08-19T00:12:45.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.157+0000 7f2305ffb640 1 -- 172.21.15.44:0/701836369 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9187+0+0 (secure 0 0 0) 0x7f230c01a440 con 0x56368083bf50 2024-08-19T00:12:45.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.157+0000 7f2326682740 1 -- 172.21.15.44:0/701836369 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5636807a8190 con 0x56368083bf50 2024-08-19T00:12:45.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.158+0000 7f2305ffb640 1 -- 172.21.15.44:0/701836369 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f230c043050 con 0x56368083bf50 2024-08-19T00:12:45.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.158+0000 7f2326682740 10 client.15105 fetch_fsmap learned FSMap version 27 2024-08-19T00:12:45.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.158+0000 7f2326682740 1 -- 172.21.15.44:0/701836369 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5636808c6720 con 0x56368083bf50 2024-08-19T00:12:45.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.158+0000 7f2305ffb640 1 -- 172.21.15.44:0/701836369 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5636807a8190 con 0x56368083bf50 2024-08-19T00:12:45.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.158+0000 7f2305ffb640 1 -- 172.21.15.44:0/701836369 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f230c029430 con 0x56368083bf50 2024-08-19T00:12:45.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.158+0000 7f2326682740 10 client.15105 fetch_fsmap finished waiting for FSMap version 27 2024-08-19T00:12:45.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.158+0000 7f2326682740 10 client.15105 resolve_mds: resolved name 'h' to daemon mds.h 2024-08-19T00:12:45.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.158+0000 7f2326682740 20 client.15105 populate_metadata read hostname 'smithi044' 2024-08-19T00:12:45.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.158+0000 7f2326682740 1 --2- 172.21.15.44:0/701836369 >> [v2:172.21.15.116:6836/2764513846,v1:172.21.15.116:6837/2764513846] conn(0x5636808576d0 0x5636808c9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:45.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.158+0000 7f2326682740 4 client.15105 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-19T00:12:45.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.158+0000 7f2326682740 1 -- 172.21.15.44:0/701836369 --> [v2:172.21.15.116:6836/2764513846,v1:172.21.15.116:6837/2764513846] -- command(tid 0: {"prefix": "status"}) -- 0x5636807250e0 con 0x5636808576d0 2024-08-19T00:12:45.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.158+0000 7f2322020640 1 --2- 172.21.15.44:0/701836369 >> [v2:172.21.15.116:6836/2764513846,v1:172.21.15.116:6837/2764513846] conn(0x5636808576d0 0x5636808c9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:45.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.159+0000 7f2322020640 1 --2- 172.21.15.44:0/701836369 >> [v2:172.21.15.116:6836/2764513846,v1:172.21.15.116:6837/2764513846] conn(0x5636808576d0 0x5636808c9c50 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=116ecd00bcef18d3 server_cookie=1a5bd17b9abd5e89 in_seq=0 out_seq=0 2024-08-19T00:12:45.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.159+0000 7f2305ffb640 10 client.15105 ms_handle_connect on v2:172.21.15.116:6836/2764513846 2024-08-19T00:12:45.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.159+0000 7f2305ffb640 1 -- 172.21.15.44:0/701836369 <== mds.1 v2:172.21.15.116:6836/2764513846 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5636807250e0 con 0x5636808576d0 2024-08-19T00:12:45.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.159+0000 7f2305ffb640 10 client.15105 handle_command_reply: tid=0 2024-08-19T00:12:45.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.159+0000 7f2326682740 1 client.15105 shutdown 2024-08-19T00:12:45.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.159+0000 7f2326682740 1 -- 172.21.15.44:0/701836369 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56368083bf50 msgr2=0x56368085f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:45.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.159+0000 7f2326682740 1 --2- 172.21.15.44:0/701836369 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56368083bf50 0x56368085f950 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f230c01ac60 tx=0x7f230c00a2d0 comp rx=0 tx=0).stop 2024-08-19T00:12:45.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.159+0000 7f2326682740 1 -- 172.21.15.44:0/701836369 shutdown_connections 2024-08-19T00:12:45.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.159+0000 7f2326682740 1 --2- 172.21.15.44:0/701836369 >> [v2:172.21.15.116:6836/2764513846,v1:172.21.15.116:6837/2764513846] conn(0x5636808576d0 0x5636808c9c50 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:45.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.159+0000 7f2326682740 1 --2- 172.21.15.44:0/701836369 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563680846810 0x5636808bede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:45.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.159+0000 7f2326682740 1 --2- 172.21.15.44:0/701836369 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56368083bf50 0x56368085f950 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:45.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.159+0000 7f2326682740 1 --2- 172.21.15.44:0/701836369 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56368083b630 0x56368085f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:45.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.159+0000 7f2326682740 1 -- 172.21.15.44:0/701836369 >> 172.21.15.44:0/701836369 conn(0x563680837bc0 msgr2=0x5636808517e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:45.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.159+0000 7f2305ffb640 0 client.15105 ms_handle_reset on v2:172.21.15.116:6836/2764513846 2024-08-19T00:12:45.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.159+0000 7f2326682740 1 -- 172.21.15.44:0/701836369 shutdown_connections 2024-08-19T00:12:45.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.159+0000 7f2326682740 1 -- 172.21.15.44:0/701836369 wait complete. 2024-08-19T00:12:45.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.159+0000 7f2326682740 20 client.15105 trim_cache size 0 max 16384 2024-08-19T00:12:45.167 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-08-19T00:12:45.168 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "647ded64-5dbe-11ef-bccf-c7b262605968", 2024-08-19T00:12:45.168 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 1, 2024-08-19T00:12:45.168 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 24446, 2024-08-19T00:12:45.168 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-08-19T00:12:45.168 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-08-19T00:12:45.168 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-08-19T00:12:45.168 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 72.297427992999999, 2024-08-19T00:12:45.168 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 27, 2024-08-19T00:12:45.168 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 94, 2024-08-19T00:12:45.168 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 90, 2024-08-19T00:12:45.168 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 135.26600754899999 2024-08-19T00:12:45.168 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-08-19T00:12:45.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.160+0000 7f2324284640 1 -- 172.21.15.44:0/3059106195 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f23080a2c10 msgr2=0x7f23080a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:45.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.160+0000 7f2324284640 1 --2- 172.21.15.44:0/3059106195 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f23080a2c10 0x7f23080a50d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2314007b80 tx=0x7f231401b000 comp rx=0 tx=0).stop 2024-08-19T00:12:45.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.160+0000 7f2324284640 1 -- 172.21.15.44:0/3059106195 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f231c1007b0 msgr2=0x7f231c199070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:45.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.160+0000 7f2324284640 1 --2- 172.21.15.44:0/3059106195 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f231c1007b0 0x7f231c199070 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f231802a940 tx=0x7f2318003c00 comp rx=0 tx=0).stop 2024-08-19T00:12:45.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.160+0000 7f2324284640 1 -- 172.21.15.44:0/3059106195 shutdown_connections 2024-08-19T00:12:45.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.160+0000 7f2324284640 1 --2- 172.21.15.44:0/3059106195 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f23080a2c10 0x7f23080a50d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:45.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.160+0000 7f2324284640 1 --2- 172.21.15.44:0/3059106195 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f231c101150 0x7f231c1995b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:45.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.160+0000 7f2324284640 1 --2- 172.21.15.44:0/3059106195 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f231c1067b0 0x7f231c1a40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:45.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.160+0000 7f2324284640 1 --2- 172.21.15.44:0/3059106195 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f231c1007b0 0x7f231c199070 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:45.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.160+0000 7f2324284640 1 -- 172.21.15.44:0/3059106195 >> 172.21.15.44:0/3059106195 conn(0x7f231c0fc4d0 msgr2=0x7f231c0fcba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:45.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.160+0000 7f2324284640 1 -- 172.21.15.44:0/3059106195 shutdown_connections 2024-08-19T00:12:45.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:45.160+0000 7f2324284640 1 -- 172.21.15.44:0/3059106195 wait complete. 2024-08-19T00:12:45.861 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:45 smithi044 ceph-mon[18489]: pgmap v327: 129 pgs: 1 peering, 128 active+clean; 645 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-19T00:12:45.863 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph tell mds.b status 2024-08-19T00:12:45.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:45 smithi116 ceph-mon[21873]: pgmap v327: 129 pgs: 1 peering, 128 active+clean; 645 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-19T00:12:46.094 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:45 smithi171 ceph-mon[21810]: pgmap v327: 129 pgs: 1 peering, 128 active+clean; 645 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-19T00:12:46.119 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:12:46.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.582+0000 7fdfd213c640 1 -- 172.21.15.44:0/3759192365 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfcc1018b0 msgr2=0x7fdfcc101d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:46.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.582+0000 7fdfd213c640 1 --2- 172.21.15.44:0/3759192365 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfcc1018b0 0x7fdfcc101d10 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0009930 tx=0x7fdfc002a420 comp rx=0 tx=0).stop 2024-08-19T00:12:46.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.582+0000 7fdfd213c640 1 -- 172.21.15.44:0/3759192365 shutdown_connections 2024-08-19T00:12:46.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.582+0000 7fdfd213c640 1 --2- 172.21.15.44:0/3759192365 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdfcc102250 0x7fdfcc10e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:46.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.582+0000 7fdfd213c640 1 --2- 172.21.15.44:0/3759192365 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfcc1018b0 0x7fdfcc101d10 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:46.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.582+0000 7fdfd213c640 1 --2- 172.21.15.44:0/3759192365 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdfcc1078b0 0x7fdfcc107c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:46.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.582+0000 7fdfd213c640 1 -- 172.21.15.44:0/3759192365 >> 172.21.15.44:0/3759192365 conn(0x7fdfcc0fd5f0 msgr2=0x7fdfcc0ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:46.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.582+0000 7fdfd213c640 1 -- 172.21.15.44:0/3759192365 shutdown_connections 2024-08-19T00:12:46.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.582+0000 7fdfd213c640 1 -- 172.21.15.44:0/3759192365 wait complete. 2024-08-19T00:12:46.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.583+0000 7fdfd213c640 1 Processor -- start 2024-08-19T00:12:46.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.583+0000 7fdfd213c640 1 -- start start 2024-08-19T00:12:46.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.583+0000 7fdfd213c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfcc1018b0 0x7fdfcc198130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:46.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.583+0000 7fdfd213c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdfcc102250 0x7fdfcc198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:46.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.583+0000 7fdfd213c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdfcc1078b0 0x7fdfcc19ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:46.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.583+0000 7fdfd213c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdfcc111c70 con 0x7fdfcc1018b0 2024-08-19T00:12:46.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.583+0000 7fdfd213c640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fdfcc111af0 con 0x7fdfcc102250 2024-08-19T00:12:46.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.583+0000 7fdfd213c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fdfcc111df0 con 0x7fdfcc1078b0 2024-08-19T00:12:46.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.583+0000 7fdfcb7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfcc1018b0 0x7fdfcc198130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:46.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.583+0000 7fdfcb7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfcc1018b0 0x7fdfcc198130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40032/0 (socket says 172.21.15.44:40032) 2024-08-19T00:12:46.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.583+0000 7fdfcb7fe640 1 -- 172.21.15.44:0/3884286913 learned_addr learned my addr 172.21.15.44:0/3884286913 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:12:46.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.584+0000 7fdfcaffd640 1 --2- 172.21.15.44:0/3884286913 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdfcc102250 0x7fdfcc198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:46.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.584+0000 7fdfcb7fe640 1 -- 172.21.15.44:0/3884286913 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdfcc1078b0 msgr2=0x7fdfcc19ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:46.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.584+0000 7fdfcbfff640 1 --2- 172.21.15.44:0/3884286913 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdfcc1078b0 0x7fdfcc19ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:46.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.584+0000 7fdfcb7fe640 1 --2- 172.21.15.44:0/3884286913 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdfcc1078b0 0x7fdfcc19ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:46.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.584+0000 7fdfcb7fe640 1 -- 172.21.15.44:0/3884286913 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdfcc102250 msgr2=0x7fdfcc198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:46.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.584+0000 7fdfcb7fe640 1 --2- 172.21.15.44:0/3884286913 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdfcc102250 0x7fdfcc198670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:46.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.584+0000 7fdfcb7fe640 1 -- 172.21.15.44:0/3884286913 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfcc19d0e0 con 0x7fdfcc1018b0 2024-08-19T00:12:46.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.584+0000 7fdfcb7fe640 1 --2- 172.21.15.44:0/3884286913 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfcc1018b0 0x7fdfcc198130 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc00c920 tx=0x7fdfbc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:46.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.584+0000 7fdfc8ff9640 1 -- 172.21.15.44:0/3884286913 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc007c70 con 0x7fdfcc1018b0 2024-08-19T00:12:46.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.584+0000 7fdfc8ff9640 1 -- 172.21.15.44:0/3884286913 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdfbc007e10 con 0x7fdfcc1018b0 2024-08-19T00:12:46.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.584+0000 7fdfd213c640 1 -- 172.21.15.44:0/3884286913 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfcc19d3d0 con 0x7fdfcc1018b0 2024-08-19T00:12:46.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.584+0000 7fdfc8ff9640 1 -- 172.21.15.44:0/3884286913 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc018890 con 0x7fdfcc1018b0 2024-08-19T00:12:46.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.584+0000 7fdfd213c640 1 -- 172.21.15.44:0/3884286913 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfcc1a4cb0 con 0x7fdfcc1018b0 2024-08-19T00:12:46.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.586+0000 7fdfc8ff9640 1 -- 172.21.15.44:0/3884286913 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fdfbc018a70 con 0x7fdfcc1018b0 2024-08-19T00:12:46.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.587+0000 7fdfd453a740 1 Processor -- start 2024-08-19T00:12:46.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.587+0000 7fdfd453a740 1 -- start start 2024-08-19T00:12:46.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.587+0000 7fdfd453a740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ec98d24f0 0x564ec98d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:46.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.587+0000 7fdfd453a740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ec98d2e10 0x564ec98e16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:46.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.587+0000 7fdfd453a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ec98e1c20 0x564ec98e4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:46.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.587+0000 7fdfd453a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564ec9837710 con 0x564ec98e1c20 2024-08-19T00:12:46.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.587+0000 7fdfd453a740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x564ec97cf770 con 0x564ec98d24f0 2024-08-19T00:12:46.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.587+0000 7fdfd453a740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x564ec98336d0 con 0x564ec98d2e10 2024-08-19T00:12:46.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.587+0000 7fdfcaffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ec98e1c20 0x564ec98e4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:46.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.587+0000 7fdfc8ff9640 1 --2- 172.21.15.44:0/3884286913 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fdfb40a2c90 0x7fdfb40a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:46.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.587+0000 7fdfcaffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ec98e1c20 0x564ec98e4010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40044/0 (socket says 172.21.15.44:40044) 2024-08-19T00:12:46.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.587+0000 7fdfcaffd640 1 -- 172.21.15.44:0/1715759860 learned_addr learned my addr 172.21.15.44:0/1715759860 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:12:46.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.587+0000 7fdfcb7fe640 1 --2- 172.21.15.44:0/1715759860 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ec98d2e10 0x564ec98e16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:46.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.587+0000 7fdfcbfff640 1 --2- 172.21.15.44:0/1715759860 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ec98d24f0 0x564ec98d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:46.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.587+0000 7fdfcbfff640 1 --2- 172.21.15.44:0/3884286913 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fdfb40a2c90 0x7fdfb40a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:46.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.587+0000 7fdfc8ff9640 1 -- 172.21.15.44:0/3884286913 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9187+0+0 (secure 0 0 0) 0x7fdfbc0cf650 con 0x7fdfcc1018b0 2024-08-19T00:12:46.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.587+0000 7fdfcaffd640 1 -- 172.21.15.44:0/1715759860 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ec98d2e10 msgr2=0x564ec98e16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:12:46.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.588+0000 7fdfcaffd640 1 --2- 172.21.15.44:0/1715759860 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ec98d2e10 0x564ec98e16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:46.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.588+0000 7fdfcaffd640 1 -- 172.21.15.44:0/1715759860 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ec98d24f0 msgr2=0x564ec98d28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:12:46.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.588+0000 7fdfcaffd640 1 --2- 172.21.15.44:0/1715759860 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ec98d24f0 0x564ec98d28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:46.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.588+0000 7fdfcaffd640 1 -- 172.21.15.44:0/1715759860 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ec97d63e0 con 0x564ec98e1c20 2024-08-19T00:12:46.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.588+0000 7fdfcaffd640 1 --2- 172.21.15.44:0/1715759860 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ec98e1c20 0x564ec98e4010 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0009930 tx=0x7fdfc0031630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf8639638c2d948e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:46.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.588+0000 7fdfcbfff640 1 --2- 172.21.15.44:0/3884286913 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fdfb40a2c90 0x7fdfb40a5150 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdfc4009fd0 tx=0x7fdfc4004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:46.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.588+0000 7fdfb1ffb640 1 -- 172.21.15.44:0/1715759860 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc0040070 con 0x564ec98e1c20 2024-08-19T00:12:46.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.588+0000 7fdfb1ffb640 1 -- 172.21.15.44:0/1715759860 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdfc0005020 con 0x564ec98e1c20 2024-08-19T00:12:46.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.588+0000 7fdfb1ffb640 1 -- 172.21.15.44:0/1715759860 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc0035040 con 0x564ec98e1c20 2024-08-19T00:12:46.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.589+0000 7fdfd453a740 1 -- 172.21.15.44:0/1715759860 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ec98e1c20 msgr2=0x564ec98e4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:46.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.589+0000 7fdfd453a740 1 --2- 172.21.15.44:0/1715759860 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ec98e1c20 0x564ec98e4010 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0009930 tx=0x7fdfc0031630 comp rx=0 tx=0).stop 2024-08-19T00:12:46.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.589+0000 7fdfd453a740 1 -- 172.21.15.44:0/1715759860 shutdown_connections 2024-08-19T00:12:46.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.589+0000 7fdfd453a740 1 --2- 172.21.15.44:0/1715759860 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ec98d2e10 0x564ec98e16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:46.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.589+0000 7fdfd453a740 1 --2- 172.21.15.44:0/1715759860 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ec98e1c20 0x564ec98e4010 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:46.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.589+0000 7fdfd453a740 1 --2- 172.21.15.44:0/1715759860 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ec98d24f0 0x564ec98d28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:46.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.589+0000 7fdfd453a740 1 -- 172.21.15.44:0/1715759860 >> 172.21.15.44:0/1715759860 conn(0x564ec98cebc0 msgr2=0x564ec98cefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:46.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.589+0000 7fdfd453a740 1 -- 172.21.15.44:0/1715759860 shutdown_connections 2024-08-19T00:12:46.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.589+0000 7fdfd453a740 1 -- 172.21.15.44:0/1715759860 wait complete. 2024-08-19T00:12:46.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.589+0000 7fdfd453a740 1 -- start start 2024-08-19T00:12:46.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.589+0000 7fdfd453a740 1 Processor -- start 2024-08-19T00:12:46.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.589+0000 7fdfd453a740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ec98d24f0 0x564ec98dea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:46.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.589+0000 7fdfd453a740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ec98d2e10 0x564ec98defc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:46.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.589+0000 7fdfd453a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ec98e1c20 0x564ec98df500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:46.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.590+0000 7fdfd453a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564ec98e4790 con 0x564ec98e1c20 2024-08-19T00:12:46.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.590+0000 7fdfd453a740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x564ec97f2970 con 0x564ec98d2e10 2024-08-19T00:12:46.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.590+0000 7fdfd453a740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x564ec98e4910 con 0x564ec98d24f0 2024-08-19T00:12:46.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.590+0000 7fdfd453a740 10 client.0 _ll_register_callbacks cb 0x564ec95467b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:12:46.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.590+0000 7fdfcbfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ec98e1c20 0x564ec98df500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:46.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.590+0000 7fdfcbfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ec98e1c20 0x564ec98df500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40060/0 (socket says 172.21.15.44:40060) 2024-08-19T00:12:46.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.590+0000 7fdfcbfff640 1 -- 172.21.15.44:0/1053395001 learned_addr learned my addr 172.21.15.44:0/1053395001 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:12:46.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.590+0000 7fdfcb7fe640 1 --2- 172.21.15.44:0/1053395001 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ec98d24f0 0x564ec98dea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:46.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.590+0000 7fdfcaffd640 1 --2- 172.21.15.44:0/1053395001 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ec98d2e10 0x564ec98defc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:46.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.590+0000 7fdfcbfff640 1 -- 172.21.15.44:0/1053395001 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ec98d24f0 msgr2=0x564ec98dea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:12:46.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.590+0000 7fdfcbfff640 1 --2- 172.21.15.44:0/1053395001 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ec98d24f0 0x564ec98dea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:46.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.590+0000 7fdfcbfff640 1 -- 172.21.15.44:0/1053395001 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ec98d2e10 msgr2=0x564ec98defc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:12:46.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.590+0000 7fdfcbfff640 1 --2- 172.21.15.44:0/1053395001 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ec98d2e10 0x564ec98defc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:46.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.590+0000 7fdfcbfff640 1 -- 172.21.15.44:0/1053395001 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ec95a92b0 con 0x564ec98e1c20 2024-08-19T00:12:46.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.590+0000 7fdfcbfff640 1 --2- 172.21.15.44:0/1053395001 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ec98e1c20 0x564ec98df500 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fdfc40142f0 tx=0x7fdfc4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a0d19d31c02c924 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:46.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.590+0000 7fdfaaffd640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:12:46.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.590+0000 7fdfaaffd640 1 -- 172.21.15.44:0/1053395001 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc4024030 con 0x564ec98e1c20 2024-08-19T00:12:46.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.590+0000 7fdfaaffd640 1 -- 172.21.15.44:0/1053395001 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9187+0+0 (secure 0 0 0) 0x7fdfc4011e00 con 0x564ec98e1c20 2024-08-19T00:12:46.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.590+0000 7fdfd453a740 1 -- 172.21.15.44:0/1053395001 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdfc0005020 con 0x564ec98e1c20 2024-08-19T00:12:46.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.590+0000 7fdfaaffd640 1 -- 172.21.15.44:0/1053395001 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fdfc4031050 con 0x564ec98e1c20 2024-08-19T00:12:46.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.591+0000 7fdfd453a740 10 client.15117 fetch_fsmap learned FSMap version 27 2024-08-19T00:12:46.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.591+0000 7fdfd453a740 1 -- 172.21.15.44:0/1053395001 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564ec98f0360 con 0x564ec98e1c20 2024-08-19T00:12:46.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.591+0000 7fdfaaffd640 1 -- 172.21.15.44:0/1053395001 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdfc0005020 con 0x564ec98e1c20 2024-08-19T00:12:46.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.591+0000 7fdfaaffd640 1 -- 172.21.15.44:0/1053395001 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7fdfc40138f0 con 0x564ec98e1c20 2024-08-19T00:12:46.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.591+0000 7fdfd453a740 10 client.15117 fetch_fsmap finished waiting for FSMap version 27 2024-08-19T00:12:46.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.591+0000 7fdfd453a740 10 client.15117 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-19T00:12:46.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.591+0000 7fdfd453a740 20 client.15117 populate_metadata read hostname 'smithi044' 2024-08-19T00:12:46.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.591+0000 7fdfd453a740 1 --2- 172.21.15.44:0/1053395001 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x564ec98f2a50 0x564ec98f3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:46.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.591+0000 7fdfd453a740 4 client.15117 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:12:46.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.591+0000 7fdfd453a740 1 -- 172.21.15.44:0/1053395001 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564ec9844c80 con 0x564ec98f2a50 2024-08-19T00:12:46.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.591+0000 7fdfcb7fe640 1 --2- 172.21.15.44:0/1053395001 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x564ec98f2a50 0x564ec98f3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:46.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.592+0000 7fdfcb7fe640 1 --2- 172.21.15.44:0/1053395001 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x564ec98f2a50 0x564ec98f3ec0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bcef6d15a20a995a server_cookie=cbc3c4849429fd4d in_seq=0 out_seq=0 2024-08-19T00:12:46.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.592+0000 7fdfaaffd640 10 client.15117 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:12:46.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.592+0000 7fdfaaffd640 1 -- 172.21.15.44:0/1053395001 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564ec9844c80 con 0x564ec98f2a50 2024-08-19T00:12:46.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.592+0000 7fdfaaffd640 10 client.15117 handle_command_reply: tid=0 2024-08-19T00:12:46.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.593+0000 7fdfd453a740 1 client.15117 shutdown 2024-08-19T00:12:46.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.593+0000 7fdfd453a740 1 -- 172.21.15.44:0/1053395001 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ec98e1c20 msgr2=0x564ec98df500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:46.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.593+0000 7fdfd453a740 1 --2- 172.21.15.44:0/1053395001 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ec98e1c20 0x564ec98df500 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fdfc40142f0 tx=0x7fdfc4004ab0 comp rx=0 tx=0).stop 2024-08-19T00:12:46.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.593+0000 7fdfd453a740 1 -- 172.21.15.44:0/1053395001 shutdown_connections 2024-08-19T00:12:46.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.593+0000 7fdfd453a740 1 --2- 172.21.15.44:0/1053395001 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x564ec98f2a50 0x564ec98f3ec0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:46.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.593+0000 7fdfd453a740 1 --2- 172.21.15.44:0/1053395001 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ec98e1c20 0x564ec98df500 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:46.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.593+0000 7fdfd453a740 1 --2- 172.21.15.44:0/1053395001 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ec98d2e10 0x564ec98defc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:46.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.593+0000 7fdfd453a740 1 --2- 172.21.15.44:0/1053395001 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ec98d24f0 0x564ec98dea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:46.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.593+0000 7fdfaaffd640 0 client.15117 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:12:46.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.593+0000 7fdfd453a740 1 -- 172.21.15.44:0/1053395001 >> 172.21.15.44:0/1053395001 conn(0x564ec98cebc0 msgr2=0x564ec98d4920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:46.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.593+0000 7fdfd453a740 1 -- 172.21.15.44:0/1053395001 shutdown_connections 2024-08-19T00:12:46.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.593+0000 7fdfd453a740 1 -- 172.21.15.44:0/1053395001 wait complete. 2024-08-19T00:12:46.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.593+0000 7fdfd453a740 20 client.15117 trim_cache size 0 max 16384 2024-08-19T00:12:46.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.612+0000 7fdfd453a740 1 Processor -- start 2024-08-19T00:12:46.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.612+0000 7fdfd453a740 1 -- start start 2024-08-19T00:12:46.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.612+0000 7fdfd453a740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ec98d24f0 0x564ec98e11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:46.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.612+0000 7fdfd453a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ec98d2e10 0x564ec98f3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:46.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.612+0000 7fdfd453a740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ec98e1c20 0x564ec98dda60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:46.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.612+0000 7fdfd453a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564ec98f2200 con 0x564ec98d2e10 2024-08-19T00:12:46.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.612+0000 7fdfd453a740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x564ec98f28d0 con 0x564ec98d24f0 2024-08-19T00:12:46.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.612+0000 7fdfd453a740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x564ec98f2fa0 con 0x564ec98e1c20 2024-08-19T00:12:46.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.612+0000 7fdfcaffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ec98d2e10 0x564ec98f3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:46.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.612+0000 7fdfcaffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ec98d2e10 0x564ec98f3120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40062/0 (socket says 172.21.15.44:40062) 2024-08-19T00:12:46.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.612+0000 7fdfcaffd640 1 -- 172.21.15.44:0/3426547278 learned_addr learned my addr 172.21.15.44:0/3426547278 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:12:46.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.612+0000 7fdfcb7fe640 1 --2- 172.21.15.44:0/3426547278 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ec98d24f0 0x564ec98e11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:46.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.612+0000 7fdfcbfff640 1 --2- 172.21.15.44:0/3426547278 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ec98e1c20 0x564ec98dda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:46.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.612+0000 7fdfcaffd640 1 -- 172.21.15.44:0/3426547278 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ec98e1c20 msgr2=0x564ec98dda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:12:46.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.612+0000 7fdfcaffd640 1 --2- 172.21.15.44:0/3426547278 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ec98e1c20 0x564ec98dda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:46.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.612+0000 7fdfcaffd640 1 -- 172.21.15.44:0/3426547278 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ec98d24f0 msgr2=0x564ec98e11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:12:46.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.612+0000 7fdfcaffd640 1 --2- 172.21.15.44:0/3426547278 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ec98d24f0 0x564ec98e11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:46.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.612+0000 7fdfcaffd640 1 -- 172.21.15.44:0/3426547278 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ec98d98b0 con 0x564ec98d2e10 2024-08-19T00:12:46.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.612+0000 7fdfcb7fe640 1 --2- 172.21.15.44:0/3426547278 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ec98d24f0 0x564ec98e11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:12:46.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.612+0000 7fdfcbfff640 1 --2- 172.21.15.44:0/3426547278 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ec98e1c20 0x564ec98dda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:12:46.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.612+0000 7fdfcaffd640 1 --2- 172.21.15.44:0/3426547278 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ec98d2e10 0x564ec98f3120 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x564ec98cfcb0 tx=0x7fdfc0005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b3e80d4bc00554c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:46.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.613+0000 7fdfb17fa640 1 -- 172.21.15.44:0/3426547278 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc004b070 con 0x564ec98d2e10 2024-08-19T00:12:46.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.613+0000 7fdfb17fa640 1 -- 172.21.15.44:0/3426547278 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdfc00035f0 con 0x564ec98d2e10 2024-08-19T00:12:46.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.613+0000 7fdfb17fa640 1 -- 172.21.15.44:0/3426547278 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc0040070 con 0x564ec98d2e10 2024-08-19T00:12:46.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.613+0000 7fdfd453a740 1 -- 172.21.15.44:0/3426547278 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ec98d2e10 msgr2=0x564ec98f3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:46.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.613+0000 7fdfd453a740 1 --2- 172.21.15.44:0/3426547278 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ec98d2e10 0x564ec98f3120 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x564ec98cfcb0 tx=0x7fdfc0005fd0 comp rx=0 tx=0).stop 2024-08-19T00:12:46.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.613+0000 7fdfd453a740 1 -- 172.21.15.44:0/3426547278 shutdown_connections 2024-08-19T00:12:46.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.613+0000 7fdfd453a740 1 --2- 172.21.15.44:0/3426547278 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ec98e1c20 0x564ec98dda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:46.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.613+0000 7fdfd453a740 1 --2- 172.21.15.44:0/3426547278 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ec98d2e10 0x564ec98f3120 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:46.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.613+0000 7fdfd453a740 1 --2- 172.21.15.44:0/3426547278 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ec98d24f0 0x564ec98e11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:46.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.613+0000 7fdfd453a740 1 -- 172.21.15.44:0/3426547278 >> 172.21.15.44:0/3426547278 conn(0x564ec98cebc0 msgr2=0x564ec98dd350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:46.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.613+0000 7fdfd453a740 1 -- 172.21.15.44:0/3426547278 shutdown_connections 2024-08-19T00:12:46.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.613+0000 7fdfd453a740 1 -- 172.21.15.44:0/3426547278 wait complete. 2024-08-19T00:12:46.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.614+0000 7fdfd453a740 1 -- start start 2024-08-19T00:12:46.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.614+0000 7fdfd453a740 1 Processor -- start 2024-08-19T00:12:46.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.614+0000 7fdfd453a740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ec98d24f0 0x564ec98fc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:46.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.614+0000 7fdfd453a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ec98d2e10 0x564ec98fc970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:46.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.614+0000 7fdfd453a740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ec98e1c20 0x564ec98db590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:46.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.614+0000 7fdfd453a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564ec98f3d40 con 0x564ec98d2e10 2024-08-19T00:12:46.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.614+0000 7fdfd453a740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x564ec98f3670 con 0x564ec98e1c20 2024-08-19T00:12:46.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.614+0000 7fdfd453a740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x564ec98f4410 con 0x564ec98d24f0 2024-08-19T00:12:46.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.614+0000 7fdfd453a740 10 client.0 _ll_register_callbacks cb 0x7fdfc4014780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:12:46.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.614+0000 7fdfcaffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ec98d2e10 0x564ec98fc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:46.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.614+0000 7fdfcaffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ec98d2e10 0x564ec98fc970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40078/0 (socket says 172.21.15.44:40078) 2024-08-19T00:12:46.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.614+0000 7fdfcaffd640 1 -- 172.21.15.44:0/2120173676 learned_addr learned my addr 172.21.15.44:0/2120173676 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:12:46.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.614+0000 7fdfcb7fe640 1 --2- 172.21.15.44:0/2120173676 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ec98d24f0 0x564ec98fc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:46.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.615+0000 7fdfcbfff640 1 --2- 172.21.15.44:0/2120173676 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ec98e1c20 0x564ec98db590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:46.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.615+0000 7fdfcaffd640 1 -- 172.21.15.44:0/2120173676 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ec98d24f0 msgr2=0x564ec98fc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:12:46.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.615+0000 7fdfcaffd640 1 --2- 172.21.15.44:0/2120173676 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ec98d24f0 0x564ec98fc430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:46.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.615+0000 7fdfcaffd640 1 -- 172.21.15.44:0/2120173676 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ec98e1c20 msgr2=0x564ec98db590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:12:46.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.615+0000 7fdfcaffd640 1 --2- 172.21.15.44:0/2120173676 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ec98e1c20 0x564ec98db590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:46.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.615+0000 7fdfcaffd640 1 -- 172.21.15.44:0/2120173676 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ec98dbd30 con 0x564ec98d2e10 2024-08-19T00:12:46.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.615+0000 7fdfcaffd640 1 --2- 172.21.15.44:0/2120173676 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ec98d2e10 0x564ec98fc970 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0000c00 tx=0x7fdfc0004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4a9592a419800e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:46.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.615+0000 7fdfaaffd640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:12:46.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.615+0000 7fdfaaffd640 1 -- 172.21.15.44:0/2120173676 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc0040040 con 0x564ec98d2e10 2024-08-19T00:12:46.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.615+0000 7fdfd453a740 1 -- 172.21.15.44:0/2120173676 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdfc00035f0 con 0x564ec98d2e10 2024-08-19T00:12:46.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.615+0000 7fdfaaffd640 1 -- 172.21.15.44:0/2120173676 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9187+0+0 (secure 0 0 0) 0x7fdfc0004480 con 0x564ec98d2e10 2024-08-19T00:12:46.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.615+0000 7fdfaaffd640 1 -- 172.21.15.44:0/2120173676 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fdfc004b040 con 0x564ec98d2e10 2024-08-19T00:12:46.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.615+0000 7fdfd453a740 10 client.15123 fetch_fsmap learned FSMap version 27 2024-08-19T00:12:46.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.615+0000 7fdfd453a740 1 -- 172.21.15.44:0/2120173676 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564ec98fbc80 con 0x564ec98d2e10 2024-08-19T00:12:46.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.615+0000 7fdfaaffd640 1 -- 172.21.15.44:0/2120173676 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdfc00035f0 con 0x564ec98d2e10 2024-08-19T00:12:46.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.616+0000 7fdfaaffd640 1 -- 172.21.15.44:0/2120173676 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7fdfc00509e0 con 0x564ec98d2e10 2024-08-19T00:12:46.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.616+0000 7fdfd453a740 10 client.15123 fetch_fsmap finished waiting for FSMap version 27 2024-08-19T00:12:46.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.616+0000 7fdfd453a740 10 client.15123 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-19T00:12:46.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.616+0000 7fdfd453a740 20 client.15123 populate_metadata read hostname 'smithi044' 2024-08-19T00:12:46.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.616+0000 7fdfd453a740 1 --2- 172.21.15.44:0/2120173676 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x564ec9961150 0x564ec995fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:46.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.616+0000 7fdfd453a740 4 client.15123 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-19T00:12:46.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.616+0000 7fdfd453a740 1 -- 172.21.15.44:0/2120173676 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "status"}) -- 0x564ec983f190 con 0x564ec9961150 2024-08-19T00:12:46.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.616+0000 7fdfcb7fe640 1 --2- 172.21.15.44:0/2120173676 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x564ec9961150 0x564ec995fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:46.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.616+0000 7fdfcb7fe640 1 --2- 172.21.15.44:0/2120173676 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x564ec9961150 0x564ec995fe60 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=defde55c61c5529 server_cookie=e93fb2fa05036ba8 in_seq=0 out_seq=0 2024-08-19T00:12:46.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.616+0000 7fdfaaffd640 10 client.15123 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:12:46.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.617+0000 7fdfaaffd640 1 -- 172.21.15.44:0/2120173676 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x564ec983f190 con 0x564ec9961150 2024-08-19T00:12:46.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.617+0000 7fdfaaffd640 10 client.15123 handle_command_reply: tid=0 2024-08-19T00:12:46.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.617+0000 7fdfd453a740 1 client.15123 shutdown 2024-08-19T00:12:46.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.617+0000 7fdfd453a740 1 -- 172.21.15.44:0/2120173676 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ec98d2e10 msgr2=0x564ec98fc970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:46.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.617+0000 7fdfd453a740 1 --2- 172.21.15.44:0/2120173676 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ec98d2e10 0x564ec98fc970 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0000c00 tx=0x7fdfc0004290 comp rx=0 tx=0).stop 2024-08-19T00:12:46.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.617+0000 7fdfd453a740 1 -- 172.21.15.44:0/2120173676 shutdown_connections 2024-08-19T00:12:46.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.617+0000 7fdfd453a740 1 --2- 172.21.15.44:0/2120173676 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x564ec9961150 0x564ec995fe60 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:46.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.617+0000 7fdfd453a740 1 --2- 172.21.15.44:0/2120173676 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ec98e1c20 0x564ec98db590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:46.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.617+0000 7fdfd453a740 1 --2- 172.21.15.44:0/2120173676 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ec98d2e10 0x564ec98fc970 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:46.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.617+0000 7fdfd453a740 1 --2- 172.21.15.44:0/2120173676 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ec98d24f0 0x564ec98fc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:46.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.617+0000 7fdfaaffd640 0 client.15123 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:12:46.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.617+0000 7fdfd453a740 1 -- 172.21.15.44:0/2120173676 >> 172.21.15.44:0/2120173676 conn(0x564ec98cebc0 msgr2=0x564ec98ddb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:46.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.617+0000 7fdfd453a740 1 -- 172.21.15.44:0/2120173676 shutdown_connections 2024-08-19T00:12:46.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.617+0000 7fdfd453a740 1 -- 172.21.15.44:0/2120173676 wait complete. 2024-08-19T00:12:46.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.617+0000 7fdfd453a740 20 client.15123 trim_cache size 0 max 16384 2024-08-19T00:12:46.635 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-08-19T00:12:46.635 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "647ded64-5dbe-11ef-bccf-c7b262605968", 2024-08-19T00:12:46.635 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 0, 2024-08-19T00:12:46.635 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 24473, 2024-08-19T00:12:46.635 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-08-19T00:12:46.636 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-08-19T00:12:46.636 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-08-19T00:12:46.636 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 113.117248141, 2024-08-19T00:12:46.636 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 27, 2024-08-19T00:12:46.636 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 94, 2024-08-19T00:12:46.636 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 90, 2024-08-19T00:12:46.636 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 125.042525551 2024-08-19T00:12:46.636 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-08-19T00:12:46.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.618+0000 7fdfd213c640 1 -- 172.21.15.44:0/3884286913 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fdfb40a2c90 msgr2=0x7fdfb40a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:46.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.618+0000 7fdfd213c640 1 --2- 172.21.15.44:0/3884286913 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fdfb40a2c90 0x7fdfb40a5150 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdfc4009fd0 tx=0x7fdfc4004a40 comp rx=0 tx=0).stop 2024-08-19T00:12:46.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.618+0000 7fdfd213c640 1 -- 172.21.15.44:0/3884286913 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfcc1018b0 msgr2=0x7fdfcc198130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:46.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.618+0000 7fdfd213c640 1 --2- 172.21.15.44:0/3884286913 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfcc1018b0 0x7fdfcc198130 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc00c920 tx=0x7fdfbc00cde0 comp rx=0 tx=0).stop 2024-08-19T00:12:46.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.618+0000 7fdfd213c640 1 -- 172.21.15.44:0/3884286913 shutdown_connections 2024-08-19T00:12:46.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.618+0000 7fdfd213c640 1 --2- 172.21.15.44:0/3884286913 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fdfb40a2c90 0x7fdfb40a5150 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:46.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.618+0000 7fdfd213c640 1 --2- 172.21.15.44:0/3884286913 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdfcc1078b0 0x7fdfcc19ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:46.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.618+0000 7fdfd213c640 1 --2- 172.21.15.44:0/3884286913 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdfcc102250 0x7fdfcc198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:46.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.618+0000 7fdfd213c640 1 --2- 172.21.15.44:0/3884286913 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfcc1018b0 0x7fdfcc198130 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:46.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.618+0000 7fdfd213c640 1 -- 172.21.15.44:0/3884286913 >> 172.21.15.44:0/3884286913 conn(0x7fdfcc0fd5f0 msgr2=0x7fdfcc0fdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:46.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.618+0000 7fdfd213c640 1 -- 172.21.15.44:0/3884286913 shutdown_connections 2024-08-19T00:12:46.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:46.618+0000 7fdfd213c640 1 -- 172.21.15.44:0/3884286913 wait complete. 2024-08-19T00:12:46.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:46 smithi044 ceph-mon[18489]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-08-19T00:12:46.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:46 smithi044 ceph-mon[18489]: Cluster is now healthy 2024-08-19T00:12:47.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:46 smithi171 ceph-mon[21810]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-08-19T00:12:47.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:46 smithi171 ceph-mon[21810]: Cluster is now healthy 2024-08-19T00:12:47.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:46 smithi116 ceph-mon[21873]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-08-19T00:12:47.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:46 smithi116 ceph-mon[21873]: Cluster is now healthy 2024-08-19T00:12:47.458 INFO:tasks.cephadm:Setup complete, yielding 2024-08-19T00:12:47.458 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-19T00:12:47.471 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi044.front.sepia.ceph.com 2024-08-19T00:12:47.471 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- bash -c 'ceph orch status' 2024-08-19T00:12:47.735 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:12:47.857 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:47 smithi044 ceph-mon[18489]: pgmap v328: 129 pgs: 129 active+clean; 645 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2024-08-19T00:12:48.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:47 smithi171 ceph-mon[21810]: pgmap v328: 129 pgs: 129 active+clean; 645 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2024-08-19T00:12:48.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:47 smithi116 ceph-mon[21873]: pgmap v328: 129 pgs: 129 active+clean; 645 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2024-08-19T00:12:48.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:48.208+0000 7f4c71fe9640 1 -- 172.21.15.44:0/45062208 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c6c100840 msgr2=0x7f4c6c100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:48.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:48.208+0000 7f4c71fe9640 1 --2- 172.21.15.44:0/45062208 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c6c100840 0x7f4c6c100c40 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c009900 tx=0x7f4c5c02a410 comp rx=0 tx=0).stop 2024-08-19T00:12:48.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:48.209+0000 7f4c71fe9640 1 -- 172.21.15.44:0/45062208 shutdown_connections 2024-08-19T00:12:48.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:48.209+0000 7f4c71fe9640 1 --2- 172.21.15.44:0/45062208 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4c6c102400 0x7f4c6c108c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:48.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:48.209+0000 7f4c71fe9640 1 --2- 172.21.15.44:0/45062208 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c6c101a40 0x7f4c6c101ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:48.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:48.209+0000 7f4c71fe9640 1 --2- 172.21.15.44:0/45062208 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c6c100840 0x7f4c6c100c40 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:48.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:48.209+0000 7f4c71fe9640 1 -- 172.21.15.44:0/45062208 >> 172.21.15.44:0/45062208 conn(0x7f4c6c0fbfd0 msgr2=0x7f4c6c0fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:48.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:48.209+0000 7f4c71fe9640 1 -- 172.21.15.44:0/45062208 shutdown_connections 2024-08-19T00:12:48.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:48.209+0000 7f4c71fe9640 1 -- 172.21.15.44:0/45062208 wait complete. 2024-08-19T00:12:48.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:48.209+0000 7f4c71fe9640 1 Processor -- start 2024-08-19T00:12:48.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:48.209+0000 7f4c71fe9640 1 -- start start 2024-08-19T00:12:48.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:48.209+0000 7f4c71fe9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c6c100840 0x7f4c6c196ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:48.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:48.209+0000 7f4c71fe9640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4c6c101a40 0x7f4c6c1970e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:48.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:48.210+0000 7f4c71fe9640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c6c102400 0x7f4c6c19e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:48.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:48.210+0000 7f4c71fe9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4c6c10c520 con 0x7f4c6c100840 2024-08-19T00:12:48.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:48.210+0000 7f4c71fe9640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f4c6c10c3a0 con 0x7f4c6c102400 2024-08-19T00:12:48.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:48.210+0000 7f4c71fe9640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4c6c10c6a0 con 0x7f4c6c101a40 2024-08-19T00:12:48.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:48.210+0000 7f4c6b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c6c100840 0x7f4c6c196ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:48.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:48.210+0000 7f4c6b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c6c100840 0x7f4c6c196ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40086/0 (socket says 172.21.15.44:40086) 2024-08-19T00:12:48.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:48.210+0000 7f4c6b7fe640 1 -- 172.21.15.44:0/846563189 learned_addr learned my addr 172.21.15.44:0/846563189 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:12:48.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:48.210+0000 7f4c6b7fe640 1 -- 172.21.15.44:0/846563189 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4c6c101a40 msgr2=0x7f4c6c1970e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:48.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:48.210+0000 7f4c6b7fe640 1 --2- 172.21.15.44:0/846563189 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4c6c101a40 0x7f4c6c1970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:48.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:48.210+0000 7f4c6b7fe640 1 -- 172.21.15.44:0/846563189 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c6c102400 msgr2=0x7f4c6c19e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:48.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:48.210+0000 7f4c6bfff640 1 --2- 172.21.15.44:0/846563189 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c6c102400 0x7f4c6c19e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:48.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:48.210+0000 7f4c6b7fe640 1 --2- 172.21.15.44:0/846563189 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c6c102400 0x7f4c6c19e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:48.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:48.210+0000 7f4c6b7fe640 1 -- 172.21.15.44:0/846563189 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c6c19e7d0 con 0x7f4c6c100840 2024-08-19T00:12:48.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:48.210+0000 7f4c6b7fe640 1 --2- 172.21.15.44:0/846563189 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c6c100840 0x7f4c6c196ba0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c031610 tx=0x7f4c5c0043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:48.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:48.210+0000 7f4c68ff9640 1 -- 172.21.15.44:0/846563189 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c5c03f030 con 0x7f4c6c100840 2024-08-19T00:12:48.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:48.210+0000 7f4c68ff9640 1 -- 172.21.15.44:0/846563189 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c5c003ce0 con 0x7f4c6c100840 2024-08-19T00:12:48.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:48.210+0000 7f4c71fe9640 1 -- 172.21.15.44:0/846563189 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c6c19ea60 con 0x7f4c6c100840 2024-08-19T00:12:48.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:48.210+0000 7f4c68ff9640 1 -- 172.21.15.44:0/846563189 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c5c035070 con 0x7f4c6c100840 2024-08-19T00:12:48.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:48.210+0000 7f4c71fe9640 1 -- 172.21.15.44:0/846563189 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c6c19ef40 con 0x7f4c6c100840 2024-08-19T00:12:48.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:48.211+0000 7f4c71fe9640 1 -- 172.21.15.44:0/846563189 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c6c107cb0 con 0x7f4c6c100840 2024-08-19T00:12:48.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:48.212+0000 7f4c68ff9640 1 -- 172.21.15.44:0/846563189 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f4c5c042030 con 0x7f4c6c100840 2024-08-19T00:12:48.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:48.213+0000 7f4c68ff9640 1 --2- 172.21.15.44:0/846563189 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f4c540a2c40 0x7f4c540a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:48.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:48.213+0000 7f4c6affd640 1 --2- 172.21.15.44:0/846563189 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f4c540a2c40 0x7f4c540a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:48.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:48.213+0000 7f4c68ff9640 1 -- 172.21.15.44:0/846563189 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9187+0+0 (secure 0 0 0) 0x7f4c5c0efb90 con 0x7f4c6c100840 2024-08-19T00:12:48.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:48.214+0000 7f4c6affd640 1 --2- 172.21.15.44:0/846563189 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f4c540a2c40 0x7f4c540a5100 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c1980c0 tx=0x7f4c60005ed0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:48.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:48.218+0000 7f4c68ff9640 1 -- 172.21.15.44:0/846563189 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f4c5c0bc5d0 con 0x7f4c6c100840 2024-08-19T00:12:48.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:48.409+0000 7f4c71fe9640 1 -- 172.21.15.44:0/846563189 --> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f4c6c062360 con 0x7f4c540a2c40 2024-08-19T00:12:48.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:48.410+0000 7f4c68ff9640 1 -- 172.21.15.44:0/846563189 <== mgr.14150 v2:172.21.15.44:6800/1330072146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f4c6c062360 con 0x7f4c540a2c40 2024-08-19T00:12:48.411 INFO:teuthology.orchestra.run.smithi044.stdout:Backend: cephadm 2024-08-19T00:12:48.411 INFO:teuthology.orchestra.run.smithi044.stdout:Available: Yes 2024-08-19T00:12:48.411 INFO:teuthology.orchestra.run.smithi044.stdout:Paused: No 2024-08-19T00:12:48.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:48.412+0000 7f4c71fe9640 1 -- 172.21.15.44:0/846563189 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f4c540a2c40 msgr2=0x7f4c540a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:48.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:48.412+0000 7f4c71fe9640 1 --2- 172.21.15.44:0/846563189 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f4c540a2c40 0x7f4c540a5100 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c1980c0 tx=0x7f4c60005ed0 comp rx=0 tx=0).stop 2024-08-19T00:12:48.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:48.412+0000 7f4c71fe9640 1 -- 172.21.15.44:0/846563189 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c6c100840 msgr2=0x7f4c6c196ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:48.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:48.412+0000 7f4c71fe9640 1 --2- 172.21.15.44:0/846563189 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c6c100840 0x7f4c6c196ba0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c031610 tx=0x7f4c5c0043b0 comp rx=0 tx=0).stop 2024-08-19T00:12:48.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:48.412+0000 7f4c71fe9640 1 -- 172.21.15.44:0/846563189 shutdown_connections 2024-08-19T00:12:48.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:48.412+0000 7f4c71fe9640 1 --2- 172.21.15.44:0/846563189 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f4c540a2c40 0x7f4c540a5100 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:48.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:48.412+0000 7f4c71fe9640 1 --2- 172.21.15.44:0/846563189 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4c6c101a40 0x7f4c6c1970e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:48.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:48.412+0000 7f4c71fe9640 1 --2- 172.21.15.44:0/846563189 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c6c102400 0x7f4c6c19e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:48.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:48.412+0000 7f4c71fe9640 1 --2- 172.21.15.44:0/846563189 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4c6c100840 0x7f4c6c196ba0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:48.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:48.412+0000 7f4c71fe9640 1 -- 172.21.15.44:0/846563189 >> 172.21.15.44:0/846563189 conn(0x7f4c6c0fbfd0 msgr2=0x7f4c6c104e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:48.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:48.412+0000 7f4c71fe9640 1 -- 172.21.15.44:0/846563189 shutdown_connections 2024-08-19T00:12:48.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:48.412+0000 7f4c71fe9640 1 -- 172.21.15.44:0/846563189 wait complete. 2024-08-19T00:12:49.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:48 smithi171 ceph-mon[21810]: from='client.15129 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:12:49.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:48 smithi116 ceph-mon[21873]: from='client.15129 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:12:49.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:48 smithi044 ceph-mon[18489]: from='client.15129 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:12:49.155 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- bash -c 'ceph orch ps' 2024-08-19T00:12:49.411 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:12:49.789 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:49 smithi044 ceph-mon[18489]: pgmap v329: 129 pgs: 129 active+clean; 645 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2024-08-19T00:12:49.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:49.868+0000 7f980c816640 1 -- 172.21.15.44:0/849226580 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9808104da0 msgr2=0x7f9808107190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:49.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:49.868+0000 7f980c816640 1 --2- 172.21.15.44:0/849226580 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9808104da0 0x7f9808107190 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f97fc009900 tx=0x7f97fc02a410 comp rx=0 tx=0).stop 2024-08-19T00:12:49.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:49.868+0000 7f980c816640 1 -- 172.21.15.44:0/849226580 shutdown_connections 2024-08-19T00:12:49.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:49.868+0000 7f980c816640 1 --2- 172.21.15.44:0/849226580 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f98081076d0 0x7f9808109ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:49.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:49.868+0000 7f980c816640 1 --2- 172.21.15.44:0/849226580 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9808104da0 0x7f9808107190 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:49.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:49.868+0000 7f980c816640 1 --2- 172.21.15.44:0/849226580 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9808102470 0x7f9808104860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:49.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:49.868+0000 7f980c816640 1 -- 172.21.15.44:0/849226580 >> 172.21.15.44:0/849226580 conn(0x7f98080fbfd0 msgr2=0x7f98080fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:49.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:49.868+0000 7f980c816640 1 -- 172.21.15.44:0/849226580 shutdown_connections 2024-08-19T00:12:49.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:49.868+0000 7f980c816640 1 -- 172.21.15.44:0/849226580 wait complete. 2024-08-19T00:12:49.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:49.869+0000 7f980c816640 1 Processor -- start 2024-08-19T00:12:49.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:49.869+0000 7f980c816640 1 -- start start 2024-08-19T00:12:49.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:49.869+0000 7f980c816640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9808102470 0x7f9808197c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:49.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:49.869+0000 7f980c816640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9808104da0 0x7f9808198190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:49.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:49.869+0000 7f980c816640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98081076d0 0x7f980819f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:49.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:49.869+0000 7f980c816640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f980810d620 con 0x7f98081076d0 2024-08-19T00:12:49.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:49.869+0000 7f980c816640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f980810d4a0 con 0x7f9808102470 2024-08-19T00:12:49.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:49.869+0000 7f980c816640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f980810d7a0 con 0x7f9808104da0 2024-08-19T00:12:49.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:49.869+0000 7f9806d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98081076d0 0x7f980819f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:49.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:49.870+0000 7f9806d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98081076d0 0x7f980819f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46054/0 (socket says 172.21.15.44:46054) 2024-08-19T00:12:49.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:49.870+0000 7f9806d9d640 1 -- 172.21.15.44:0/2236460216 learned_addr learned my addr 172.21.15.44:0/2236460216 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:12:49.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:49.870+0000 7f980659c640 1 --2- 172.21.15.44:0/2236460216 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9808102470 0x7f9808197c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:49.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:49.870+0000 7f9805d9b640 1 --2- 172.21.15.44:0/2236460216 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9808104da0 0x7f9808198190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:49.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:49.870+0000 7f9806d9d640 1 -- 172.21.15.44:0/2236460216 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9808104da0 msgr2=0x7f9808198190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:49.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:49.870+0000 7f9806d9d640 1 --2- 172.21.15.44:0/2236460216 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9808104da0 0x7f9808198190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:49.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:49.870+0000 7f9806d9d640 1 -- 172.21.15.44:0/2236460216 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9808102470 msgr2=0x7f9808197c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:49.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:49.870+0000 7f9806d9d640 1 --2- 172.21.15.44:0/2236460216 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9808102470 0x7f9808197c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:49.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:49.870+0000 7f9806d9d640 1 -- 172.21.15.44:0/2236460216 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f980819f870 con 0x7f98081076d0 2024-08-19T00:12:49.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:49.870+0000 7f9806d9d640 1 --2- 172.21.15.44:0/2236460216 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98081076d0 0x7f980819f1d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f97f8009fd0 tx=0x7f97f800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:49.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:49.870+0000 7f97f77fe640 1 -- 172.21.15.44:0/2236460216 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f8011830 con 0x7f98081076d0 2024-08-19T00:12:49.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:49.870+0000 7f980c816640 1 -- 172.21.15.44:0/2236460216 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f980819fb60 con 0x7f98081076d0 2024-08-19T00:12:49.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:49.870+0000 7f97f77fe640 1 -- 172.21.15.44:0/2236460216 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f97f8016070 con 0x7f98081076d0 2024-08-19T00:12:49.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:49.870+0000 7f97f77fe640 1 -- 172.21.15.44:0/2236460216 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f800f2e0 con 0x7f98081076d0 2024-08-19T00:12:49.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:49.870+0000 7f980c816640 1 -- 172.21.15.44:0/2236460216 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98081a0050 con 0x7f98081076d0 2024-08-19T00:12:49.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:49.871+0000 7f980c816640 1 -- 172.21.15.44:0/2236460216 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98080fdac0 con 0x7f98081076d0 2024-08-19T00:12:49.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:49.873+0000 7f97f77fe640 1 -- 172.21.15.44:0/2236460216 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f97f80119d0 con 0x7f98081076d0 2024-08-19T00:12:49.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:49.873+0000 7f97f77fe640 1 --2- 172.21.15.44:0/2236460216 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f97f00a2c10 0x7f97f00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:49.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:49.873+0000 7f980659c640 1 --2- 172.21.15.44:0/2236460216 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f97f00a2c10 0x7f97f00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:49.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:49.874+0000 7f97f77fe640 1 -- 172.21.15.44:0/2236460216 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9187+0+0 (secure 0 0 0) 0x7f97f80cea40 con 0x7f98081076d0 2024-08-19T00:12:49.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:49.874+0000 7f980659c640 1 --2- 172.21.15.44:0/2236460216 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f97f00a2c10 0x7f97f00a50d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9808199130 tx=0x7f98000075b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:49.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:49.878+0000 7f97f77fe640 1 -- 172.21.15.44:0/2236460216 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f97f809b590 con 0x7f98081076d0 2024-08-19T00:12:49.993 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:49 smithi171 ceph-mon[21810]: pgmap v329: 129 pgs: 129 active+clean; 645 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2024-08-19T00:12:50.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:50.062+0000 7f980c816640 1 -- 172.21.15.44:0/2236460216 --> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f9808062360 con 0x7f97f00a2c10 2024-08-19T00:12:50.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:50.075+0000 7f97f77fe640 1 -- 172.21.15.44:0/2236460216 <== mgr.14150 v2:172.21.15.44:6800/1330072146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4092 (secure 0 0 0) 0x7f9808062360 con 0x7f97f00a2c10 2024-08-19T00:12:50.077 INFO:teuthology.orchestra.run.smithi044.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T00:12:50.077 INFO:teuthology.orchestra.run.smithi044.stdout:mds.a smithi044 running (2m) 60s ago 2m 17.5M - 19.1.0-1382-gde09dd01 ea7a5189f30b 1469e0dc3da4 2024-08-19T00:12:50.077 INFO:teuthology.orchestra.run.smithi044.stdout:mds.b smithi116 running (2m) 62s ago 2m 26.2M - 19.1.0-1382-gde09dd01 ea7a5189f30b a7459e3925f6 2024-08-19T00:12:50.077 INFO:teuthology.orchestra.run.smithi044.stdout:mds.c smithi171 running (2m) 62s ago 2m 16.9M - 19.1.0-1382-gde09dd01 ea7a5189f30b d71015e120d6 2024-08-19T00:12:50.077 INFO:teuthology.orchestra.run.smithi044.stdout:mds.d smithi044 running (2m) 60s ago 2m 17.0M - 19.1.0-1382-gde09dd01 ea7a5189f30b 7d720ee478f8 2024-08-19T00:12:50.077 INFO:teuthology.orchestra.run.smithi044.stdout:mds.e smithi116 running (2m) 62s ago 2m 16.9M - 19.1.0-1382-gde09dd01 ea7a5189f30b 36f3dfd2ee35 2024-08-19T00:12:50.077 INFO:teuthology.orchestra.run.smithi044.stdout:mds.f smithi171 running (2m) 62s ago 2m 18.5M - 19.1.0-1382-gde09dd01 ea7a5189f30b b2b25b19b9c7 2024-08-19T00:12:50.078 INFO:teuthology.orchestra.run.smithi044.stdout:mds.g smithi044 running (2m) 60s ago 2m 15.4M - 19.1.0-1382-gde09dd01 ea7a5189f30b 4ee6a6cba6cd 2024-08-19T00:12:50.078 INFO:teuthology.orchestra.run.smithi044.stdout:mds.h smithi116 running (2m) 62s ago 2m 16.9M - 19.1.0-1382-gde09dd01 ea7a5189f30b 00e71ad36b71 2024-08-19T00:12:50.078 INFO:teuthology.orchestra.run.smithi044.stdout:mds.i smithi171 running (2m) 62s ago 2m 19.2M - 19.1.0-1382-gde09dd01 ea7a5189f30b 6a564a89c48b 2024-08-19T00:12:50.078 INFO:teuthology.orchestra.run.smithi044.stdout:mds.j smithi044 running (2m) 60s ago 2m 16.5M - 19.1.0-1382-gde09dd01 ea7a5189f30b 1d9a797ed8df 2024-08-19T00:12:50.078 INFO:teuthology.orchestra.run.smithi044.stdout:mds.k smithi116 running (2m) 62s ago 2m 13.5M - 19.1.0-1382-gde09dd01 ea7a5189f30b 61d571ed29d8 2024-08-19T00:12:50.078 INFO:teuthology.orchestra.run.smithi044.stdout:mds.l smithi171 running (2m) 62s ago 2m 17.0M - 19.1.0-1382-gde09dd01 ea7a5189f30b 3cdd98142e78 2024-08-19T00:12:50.078 INFO:teuthology.orchestra.run.smithi044.stdout:mgr.x smithi044 *:9283,8765 running (8m) 60s ago 8m 508M - 19.1.0-1382-gde09dd01 ea7a5189f30b 1173df5df0ba 2024-08-19T00:12:50.078 INFO:teuthology.orchestra.run.smithi044.stdout:mgr.y smithi116 *:8443,8765 running (7m) 62s ago 7m 444M - 19.1.0-1382-gde09dd01 ea7a5189f30b c21caa90bb76 2024-08-19T00:12:50.078 INFO:teuthology.orchestra.run.smithi044.stdout:mgr.z smithi171 *:8443,8765 running (7m) 62s ago 7m 445M - 19.1.0-1382-gde09dd01 ea7a5189f30b b3b6a174db6e 2024-08-19T00:12:50.078 INFO:teuthology.orchestra.run.smithi044.stdout:mon.a smithi044 running (9m) 60s ago 9m 53.2M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b c88c8e2b95d4 2024-08-19T00:12:50.078 INFO:teuthology.orchestra.run.smithi044.stdout:mon.b smithi116 running (7m) 62s ago 7m 41.2M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1bd427db0f97 2024-08-19T00:12:50.078 INFO:teuthology.orchestra.run.smithi044.stdout:mon.c smithi171 running (7m) 62s ago 7m 40.9M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 24d8e69f1631 2024-08-19T00:12:50.078 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0 smithi044 running (6m) 60s ago 6m 53.2M 4273M 19.1.0-1382-gde09dd01 ea7a5189f30b 1e50a86be5ae 2024-08-19T00:12:50.079 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1 smithi116 running (6m) 62s ago 6m 48.6M 4272M 19.1.0-1382-gde09dd01 ea7a5189f30b 63a67a7756a1 2024-08-19T00:12:50.079 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2 smithi171 running (6m) 62s ago 6m 55.8M 4272M 19.1.0-1382-gde09dd01 ea7a5189f30b 43e1c2a6724d 2024-08-19T00:12:50.079 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3 smithi044 running (5m) 60s ago 5m 53.0M 4273M 19.1.0-1382-gde09dd01 ea7a5189f30b 713366b1a244 2024-08-19T00:12:50.079 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4 smithi116 running (5m) 62s ago 5m 49.8M 4272M 19.1.0-1382-gde09dd01 ea7a5189f30b 725c0b53f22d 2024-08-19T00:12:50.079 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5 smithi171 running (5m) 62s ago 5m 53.4M 4272M 19.1.0-1382-gde09dd01 ea7a5189f30b dfe579d0888c 2024-08-19T00:12:50.079 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6 smithi044 running (4m) 60s ago 4m 42.8M 4273M 19.1.0-1382-gde09dd01 ea7a5189f30b 8283c028cf63 2024-08-19T00:12:50.079 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7 smithi116 running (4m) 62s ago 4m 52.3M 4272M 19.1.0-1382-gde09dd01 ea7a5189f30b 37bf43710640 2024-08-19T00:12:50.079 INFO:teuthology.orchestra.run.smithi044.stdout:osd.8 smithi171 running (4m) 62s ago 4m 45.3M 4272M 19.1.0-1382-gde09dd01 ea7a5189f30b 6d1d7cc2da6d 2024-08-19T00:12:50.079 INFO:teuthology.orchestra.run.smithi044.stdout:osd.9 smithi044 running (3m) 60s ago 3m 40.8M 4273M 19.1.0-1382-gde09dd01 ea7a5189f30b b9d3f496c074 2024-08-19T00:12:50.079 INFO:teuthology.orchestra.run.smithi044.stdout:osd.10 smithi116 running (3m) 62s ago 3m 54.3M 4272M 19.1.0-1382-gde09dd01 ea7a5189f30b 6528b456b8a3 2024-08-19T00:12:50.079 INFO:teuthology.orchestra.run.smithi044.stdout:osd.11 smithi171 running (2m) 62s ago 2m 50.5M 4272M 19.1.0-1382-gde09dd01 ea7a5189f30b 80a64a354eea 2024-08-19T00:12:50.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:50.078+0000 7f980c816640 1 -- 172.21.15.44:0/2236460216 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f97f00a2c10 msgr2=0x7f97f00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:50.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:50.078+0000 7f980c816640 1 --2- 172.21.15.44:0/2236460216 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f97f00a2c10 0x7f97f00a50d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9808199130 tx=0x7f98000075b0 comp rx=0 tx=0).stop 2024-08-19T00:12:50.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:50.078+0000 7f980c816640 1 -- 172.21.15.44:0/2236460216 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98081076d0 msgr2=0x7f980819f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:50.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:50.078+0000 7f980c816640 1 --2- 172.21.15.44:0/2236460216 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98081076d0 0x7f980819f1d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f97f8009fd0 tx=0x7f97f800b8e0 comp rx=0 tx=0).stop 2024-08-19T00:12:50.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:50.078+0000 7f980c816640 1 -- 172.21.15.44:0/2236460216 shutdown_connections 2024-08-19T00:12:50.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:50.078+0000 7f980c816640 1 --2- 172.21.15.44:0/2236460216 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f97f00a2c10 0x7f97f00a50d0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:50.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:50.078+0000 7f980c816640 1 --2- 172.21.15.44:0/2236460216 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9808104da0 0x7f9808198190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:50.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:50.078+0000 7f980c816640 1 --2- 172.21.15.44:0/2236460216 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98081076d0 0x7f980819f1d0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:50.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:50.078+0000 7f980c816640 1 --2- 172.21.15.44:0/2236460216 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9808102470 0x7f9808197c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:50.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:50.078+0000 7f980c816640 1 -- 172.21.15.44:0/2236460216 >> 172.21.15.44:0/2236460216 conn(0x7f98080fbfd0 msgr2=0x7f9808102d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:50.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:50.078+0000 7f980c816640 1 -- 172.21.15.44:0/2236460216 shutdown_connections 2024-08-19T00:12:50.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:50.078+0000 7f980c816640 1 -- 172.21.15.44:0/2236460216 wait complete. 2024-08-19T00:12:50.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:49 smithi116 ceph-mon[21873]: pgmap v329: 129 pgs: 129 active+clean; 645 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2024-08-19T00:12:50.771 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:50 smithi044 ceph-mon[18489]: from='client.15135 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:12:50.804 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- bash -c 'ceph orch ls' 2024-08-19T00:12:51.016 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:50 smithi116 ceph-mon[21873]: from='client.15135 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:12:51.066 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:12:51.074 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:50 smithi171 ceph-mon[21810]: from='client.15135 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:12:51.669 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:51 smithi171 ceph-mon[21810]: pgmap v330: 129 pgs: 129 active+clean; 645 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-08-19T00:12:51.669 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:51 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:12:51.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:51 smithi044 ceph-mon[18489]: pgmap v330: 129 pgs: 129 active+clean; 645 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-08-19T00:12:51.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:51 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:12:52.030 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:51 smithi116 ceph-mon[21873]: pgmap v330: 129 pgs: 129 active+clean; 645 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-08-19T00:12:52.030 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:51 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:12:52.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:52.150+0000 7fca63a86640 1 -- 172.21.15.44:0/1670770634 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca5c102b40 msgr2=0x7fca5c102fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:52.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:52.150+0000 7fca63a86640 1 --2- 172.21.15.44:0/1670770634 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca5c102b40 0x7fca5c102fc0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fca4c009900 tx=0x7fca4c02a410 comp rx=0 tx=0).stop 2024-08-19T00:12:52.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:52.151+0000 7fca63a86640 1 -- 172.21.15.44:0/1670770634 shutdown_connections 2024-08-19T00:12:52.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:52.151+0000 7fca63a86640 1 --2- 172.21.15.44:0/1670770634 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fca5c103500 0x7fca5c109d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:52.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:52.151+0000 7fca63a86640 1 --2- 172.21.15.44:0/1670770634 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca5c102b40 0x7fca5c102fc0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:52.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:52.151+0000 7fca63a86640 1 --2- 172.21.15.44:0/1670770634 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fca5c101940 0x7fca5c101d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:52.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:52.151+0000 7fca63a86640 1 -- 172.21.15.44:0/1670770634 >> 172.21.15.44:0/1670770634 conn(0x7fca5c0fd0f0 msgr2=0x7fca5c0ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:52.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:52.151+0000 7fca63a86640 1 -- 172.21.15.44:0/1670770634 shutdown_connections 2024-08-19T00:12:52.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:52.151+0000 7fca63a86640 1 -- 172.21.15.44:0/1670770634 wait complete. 2024-08-19T00:12:52.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:52.151+0000 7fca63a86640 1 Processor -- start 2024-08-19T00:12:52.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:52.151+0000 7fca63a86640 1 -- start start 2024-08-19T00:12:52.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:52.151+0000 7fca63a86640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fca5c101940 0x7fca5c199e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:52.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:52.151+0000 7fca63a86640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca5c102b40 0x7fca5c19a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:52.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:52.151+0000 7fca63a86640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fca5c103500 0x7fca5c1a1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:52.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:52.151+0000 7fca63a86640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fca5c10d5c0 con 0x7fca5c102b40 2024-08-19T00:12:52.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:52.151+0000 7fca63a86640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fca5c10d440 con 0x7fca5c103500 2024-08-19T00:12:52.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:52.151+0000 7fca63a86640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fca5c10d740 con 0x7fca5c101940 2024-08-19T00:12:52.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:52.152+0000 7fca61021640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca5c102b40 0x7fca5c19a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:52.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:52.152+0000 7fca61021640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca5c102b40 0x7fca5c19a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46068/0 (socket says 172.21.15.44:46068) 2024-08-19T00:12:52.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:52.152+0000 7fca61021640 1 -- 172.21.15.44:0/3927651097 learned_addr learned my addr 172.21.15.44:0/3927651097 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:12:52.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:52.152+0000 7fca61822640 1 --2- 172.21.15.44:0/3927651097 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fca5c101940 0x7fca5c199e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:52.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:52.152+0000 7fca62023640 1 --2- 172.21.15.44:0/3927651097 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fca5c103500 0x7fca5c1a1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:52.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:52.152+0000 7fca61021640 1 -- 172.21.15.44:0/3927651097 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fca5c101940 msgr2=0x7fca5c199e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:52.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:52.152+0000 7fca61021640 1 --2- 172.21.15.44:0/3927651097 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fca5c101940 0x7fca5c199e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:52.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:52.152+0000 7fca61021640 1 -- 172.21.15.44:0/3927651097 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fca5c103500 msgr2=0x7fca5c1a1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:52.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:52.152+0000 7fca61021640 1 --2- 172.21.15.44:0/3927651097 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fca5c103500 0x7fca5c1a1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:52.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:52.152+0000 7fca61021640 1 -- 172.21.15.44:0/3927651097 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca5c1a1aa0 con 0x7fca5c102b40 2024-08-19T00:12:52.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:52.152+0000 7fca61021640 1 --2- 172.21.15.44:0/3927651097 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca5c102b40 0x7fca5c19a3b0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fca4c009230 tx=0x7fca4c004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:52.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:52.152+0000 7fca52ffd640 1 -- 172.21.15.44:0/3927651097 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca4c03f030 con 0x7fca5c102b40 2024-08-19T00:12:52.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:52.152+0000 7fca52ffd640 1 -- 172.21.15.44:0/3927651097 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca4c003ce0 con 0x7fca5c102b40 2024-08-19T00:12:52.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:52.152+0000 7fca63a86640 1 -- 172.21.15.44:0/3927651097 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca5c1a1d30 con 0x7fca5c102b40 2024-08-19T00:12:52.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:52.152+0000 7fca52ffd640 1 -- 172.21.15.44:0/3927651097 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca4c035070 con 0x7fca5c102b40 2024-08-19T00:12:52.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:52.152+0000 7fca63a86640 1 -- 172.21.15.44:0/3927651097 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca5c1a21c0 con 0x7fca5c102b40 2024-08-19T00:12:52.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:52.153+0000 7fca63a86640 1 -- 172.21.15.44:0/3927651097 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca5c1a23f0 con 0x7fca5c102b40 2024-08-19T00:12:52.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:52.155+0000 7fca52ffd640 1 -- 172.21.15.44:0/3927651097 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fca4c042030 con 0x7fca5c102b40 2024-08-19T00:12:52.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:52.155+0000 7fca52ffd640 1 --2- 172.21.15.44:0/3927651097 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fca480a2c40 0x7fca480a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:52.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:52.155+0000 7fca61822640 1 --2- 172.21.15.44:0/3927651097 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fca480a2c40 0x7fca480a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:52.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:52.155+0000 7fca52ffd640 1 -- 172.21.15.44:0/3927651097 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9187+0+0 (secure 0 0 0) 0x7fca4c0effa0 con 0x7fca5c102b40 2024-08-19T00:12:52.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:52.156+0000 7fca61822640 1 --2- 172.21.15.44:0/3927651097 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fca480a2c40 0x7fca480a5100 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fca58005fd0 tx=0x7fca5800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:52.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:52.158+0000 7fca52ffd640 1 -- 172.21.15.44:0/3927651097 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fca4c0bc390 con 0x7fca5c102b40 2024-08-19T00:12:52.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:52.389+0000 7fca63a86640 1 -- 172.21.15.44:0/3927651097 --> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7fca5c109a30 con 0x7fca480a2c40 2024-08-19T00:12:52.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:52.395+0000 7fca52ffd640 1 -- 172.21.15.44:0/3927651097 <== mgr.14150 v2:172.21.15.44:6800/1330072146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7fca5c109a30 con 0x7fca480a2c40 2024-08-19T00:12:52.396 INFO:teuthology.orchestra.run.smithi044.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-08-19T00:12:52.396 INFO:teuthology.orchestra.run.smithi044.stdout:mds.all 12/12 62s ago 2m smithi044=a;smithi044=d;smithi044=g;smithi044=j;smithi116=b;smithi116=e;smithi116=h;smithi116=k;smithi171=c;smithi171=f;smithi171=i;smithi171=l;count:12 2024-08-19T00:12:52.396 INFO:teuthology.orchestra.run.smithi044.stdout:mgr 3/3 62s ago 7m smithi044=x;smithi116=y;smithi171=z;count:3 2024-08-19T00:12:52.396 INFO:teuthology.orchestra.run.smithi044.stdout:mon 3/3 62s ago 7m smithi044:172.21.15.44=a;smithi116:172.21.15.116=b;smithi171:172.21.15.171=c;count:3 2024-08-19T00:12:52.397 INFO:teuthology.orchestra.run.smithi044.stdout:osd 12 62s ago - 2024-08-19T00:12:52.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:52.397+0000 7fca63a86640 1 -- 172.21.15.44:0/3927651097 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fca480a2c40 msgr2=0x7fca480a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:52.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:52.397+0000 7fca63a86640 1 --2- 172.21.15.44:0/3927651097 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fca480a2c40 0x7fca480a5100 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fca58005fd0 tx=0x7fca5800b390 comp rx=0 tx=0).stop 2024-08-19T00:12:52.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:52.397+0000 7fca63a86640 1 -- 172.21.15.44:0/3927651097 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca5c102b40 msgr2=0x7fca5c19a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:52.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:52.397+0000 7fca63a86640 1 --2- 172.21.15.44:0/3927651097 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca5c102b40 0x7fca5c19a3b0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fca4c009230 tx=0x7fca4c004360 comp rx=0 tx=0).stop 2024-08-19T00:12:52.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:52.397+0000 7fca63a86640 1 -- 172.21.15.44:0/3927651097 shutdown_connections 2024-08-19T00:12:52.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:52.397+0000 7fca63a86640 1 --2- 172.21.15.44:0/3927651097 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fca480a2c40 0x7fca480a5100 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:52.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:52.397+0000 7fca63a86640 1 --2- 172.21.15.44:0/3927651097 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fca5c103500 0x7fca5c1a1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:52.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:52.397+0000 7fca63a86640 1 --2- 172.21.15.44:0/3927651097 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca5c102b40 0x7fca5c19a3b0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:52.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:52.397+0000 7fca63a86640 1 --2- 172.21.15.44:0/3927651097 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fca5c101940 0x7fca5c199e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:52.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:52.397+0000 7fca63a86640 1 -- 172.21.15.44:0/3927651097 >> 172.21.15.44:0/3927651097 conn(0x7fca5c0fd0f0 msgr2=0x7fca5c108310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:52.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:52.397+0000 7fca63a86640 1 -- 172.21.15.44:0/3927651097 shutdown_connections 2024-08-19T00:12:52.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:52.397+0000 7fca63a86640 1 -- 172.21.15.44:0/3927651097 wait complete. 2024-08-19T00:12:53.045 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- bash -c 'ceph orch host ls' 2024-08-19T00:12:53.330 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:12:53.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:53 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:12:53.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:53 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:12:53.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:53 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:12:53.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:53 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:12:53.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:53 smithi044 ceph-mon[18489]: from='client.15141 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:12:53.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:53 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:12:53.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:53 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:12:53.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:53 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:12:53.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:53 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:12:53.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:53 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:12:53.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:53 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:12:53.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:53 smithi171 ceph-mon[21810]: from='client.15141 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:12:53.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:53 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:12:53.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:53 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:12:53.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:53 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:12:53.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:53 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:12:53.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:53 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:12:53.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:53 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:12:53.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:53 smithi116 ceph-mon[21873]: from='client.15141 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:12:53.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:53 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:12:53.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:53 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:12:53.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:53.769+0000 7f153978f640 1 -- 172.21.15.44:0/1216319649 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1534101930 msgr2=0x7f1534101d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:53.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:53.769+0000 7f153978f640 1 --2- 172.21.15.44:0/1216319649 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1534101930 0x7f1534101d30 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1524009900 tx=0x7f152402a410 comp rx=0 tx=0).stop 2024-08-19T00:12:53.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:53.769+0000 7f153978f640 1 -- 172.21.15.44:0/1216319649 shutdown_connections 2024-08-19T00:12:53.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:53.769+0000 7f153978f640 1 --2- 172.21.15.44:0/1216319649 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f15341034f0 0x7f1534109d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:53.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:53.769+0000 7f153978f640 1 --2- 172.21.15.44:0/1216319649 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1534102b30 0x7f1534102fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:53.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:53.769+0000 7f153978f640 1 --2- 172.21.15.44:0/1216319649 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1534101930 0x7f1534101d30 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:53.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:53.769+0000 7f153978f640 1 -- 172.21.15.44:0/1216319649 >> 172.21.15.44:0/1216319649 conn(0x7f15340fd0c0 msgr2=0x7f15340ff500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:53.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:53.769+0000 7f153978f640 1 -- 172.21.15.44:0/1216319649 shutdown_connections 2024-08-19T00:12:53.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:53.769+0000 7f153978f640 1 -- 172.21.15.44:0/1216319649 wait complete. 2024-08-19T00:12:53.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:53.770+0000 7f153978f640 1 Processor -- start 2024-08-19T00:12:53.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:53.770+0000 7f153978f640 1 -- start start 2024-08-19T00:12:53.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:53.770+0000 7f153978f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1534101930 0x7f1534075cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:53.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:53.770+0000 7f153978f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1534102b30 0x7f1534074310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:53.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:53.770+0000 7f153978f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15341034f0 0x7f1534074850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:53.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:53.770+0000 7f153978f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f153410d660 con 0x7f15341034f0 2024-08-19T00:12:53.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:53.770+0000 7f153978f640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f153410d4e0 con 0x7f1534101930 2024-08-19T00:12:53.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:53.770+0000 7f153978f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f153410d7e0 con 0x7f1534102b30 2024-08-19T00:12:53.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:53.770+0000 7f15337fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15341034f0 0x7f1534074850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:53.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:53.771+0000 7f15337fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15341034f0 0x7f1534074850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46082/0 (socket says 172.21.15.44:46082) 2024-08-19T00:12:53.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:53.771+0000 7f15337fe640 1 -- 172.21.15.44:0/4167653500 learned_addr learned my addr 172.21.15.44:0/4167653500 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:12:53.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:53.771+0000 7f152bfff640 1 --2- 172.21.15.44:0/4167653500 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1534102b30 0x7f1534074310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:53.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:53.771+0000 7f1532ffd640 1 --2- 172.21.15.44:0/4167653500 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1534101930 0x7f1534075cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:53.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:53.771+0000 7f15337fe640 1 -- 172.21.15.44:0/4167653500 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1534102b30 msgr2=0x7f1534074310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:53.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:53.771+0000 7f15337fe640 1 --2- 172.21.15.44:0/4167653500 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1534102b30 0x7f1534074310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:53.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:53.771+0000 7f15337fe640 1 -- 172.21.15.44:0/4167653500 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1534101930 msgr2=0x7f1534075cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:53.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:53.771+0000 7f15337fe640 1 --2- 172.21.15.44:0/4167653500 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1534101930 0x7f1534075cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:53.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:53.771+0000 7f15337fe640 1 -- 172.21.15.44:0/4167653500 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1534075110 con 0x7f15341034f0 2024-08-19T00:12:53.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:53.771+0000 7f15337fe640 1 --2- 172.21.15.44:0/4167653500 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15341034f0 0x7f1534074850 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f152c00b970 tx=0x7f152c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:53.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:53.771+0000 7f1530ff9640 1 -- 172.21.15.44:0/4167653500 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f152c019070 con 0x7f15341034f0 2024-08-19T00:12:53.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:53.771+0000 7f1530ff9640 1 -- 172.21.15.44:0/4167653500 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f152c00cb40 con 0x7f15341034f0 2024-08-19T00:12:53.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:53.771+0000 7f153978f640 1 -- 172.21.15.44:0/4167653500 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15341a1e40 con 0x7f15341034f0 2024-08-19T00:12:53.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:53.771+0000 7f1530ff9640 1 -- 172.21.15.44:0/4167653500 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f152c007650 con 0x7f15341034f0 2024-08-19T00:12:53.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:53.771+0000 7f153978f640 1 -- 172.21.15.44:0/4167653500 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15341a2370 con 0x7f15341034f0 2024-08-19T00:12:53.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:53.772+0000 7f153978f640 1 -- 172.21.15.44:0/4167653500 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1534108d30 con 0x7f15341034f0 2024-08-19T00:12:53.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:53.774+0000 7f1530ff9640 1 -- 172.21.15.44:0/4167653500 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f152c01c070 con 0x7f15341034f0 2024-08-19T00:12:53.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:53.774+0000 7f1530ff9640 1 --2- 172.21.15.44:0/4167653500 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f15200a2c10 0x7f15200a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:53.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:53.774+0000 7f1532ffd640 1 --2- 172.21.15.44:0/4167653500 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f15200a2c10 0x7f15200a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:53.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:53.774+0000 7f1530ff9640 1 -- 172.21.15.44:0/4167653500 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9187+0+0 (secure 0 0 0) 0x7f152c0cee70 con 0x7f15341034f0 2024-08-19T00:12:53.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:53.775+0000 7f1532ffd640 1 --2- 172.21.15.44:0/4167653500 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f15200a2c10 0x7f15200a50d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f152402aa00 tx=0x7f15240315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:53.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:53.778+0000 7f1530ff9640 1 -- 172.21.15.44:0/4167653500 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f152c09b370 con 0x7f15341034f0 2024-08-19T00:12:53.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:53.961+0000 7f153978f640 1 -- 172.21.15.44:0/4167653500 --> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f1534062360 con 0x7f15200a2c10 2024-08-19T00:12:53.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:53.963+0000 7f1530ff9640 1 -- 172.21.15.44:0/4167653500 <== mgr.14150 v2:172.21.15.44:6800/1330072146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f1534062360 con 0x7f15200a2c10 2024-08-19T00:12:53.965 INFO:teuthology.orchestra.run.smithi044.stdout:HOST ADDR LABELS STATUS 2024-08-19T00:12:53.965 INFO:teuthology.orchestra.run.smithi044.stdout:smithi044 172.21.15.44 2024-08-19T00:12:53.965 INFO:teuthology.orchestra.run.smithi044.stdout:smithi116 172.21.15.116 2024-08-19T00:12:53.965 INFO:teuthology.orchestra.run.smithi044.stdout:smithi171 172.21.15.171 2024-08-19T00:12:53.965 INFO:teuthology.orchestra.run.smithi044.stdout:3 hosts in cluster 2024-08-19T00:12:53.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:53.966+0000 7f153978f640 1 -- 172.21.15.44:0/4167653500 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f15200a2c10 msgr2=0x7f15200a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:53.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:53.966+0000 7f153978f640 1 --2- 172.21.15.44:0/4167653500 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f15200a2c10 0x7f15200a50d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f152402aa00 tx=0x7f15240315b0 comp rx=0 tx=0).stop 2024-08-19T00:12:53.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:53.966+0000 7f153978f640 1 -- 172.21.15.44:0/4167653500 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15341034f0 msgr2=0x7f1534074850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:53.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:53.966+0000 7f153978f640 1 --2- 172.21.15.44:0/4167653500 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15341034f0 0x7f1534074850 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f152c00b970 tx=0x7f152c00be30 comp rx=0 tx=0).stop 2024-08-19T00:12:53.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:53.966+0000 7f153978f640 1 -- 172.21.15.44:0/4167653500 shutdown_connections 2024-08-19T00:12:53.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:53.966+0000 7f153978f640 1 --2- 172.21.15.44:0/4167653500 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f15200a2c10 0x7f15200a50d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:53.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:53.966+0000 7f153978f640 1 --2- 172.21.15.44:0/4167653500 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1534102b30 0x7f1534074310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:53.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:53.966+0000 7f153978f640 1 --2- 172.21.15.44:0/4167653500 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15341034f0 0x7f1534074850 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:53.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:53.966+0000 7f153978f640 1 --2- 172.21.15.44:0/4167653500 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1534101930 0x7f1534075cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:53.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:53.966+0000 7f153978f640 1 -- 172.21.15.44:0/4167653500 >> 172.21.15.44:0/4167653500 conn(0x7f15340fd0c0 msgr2=0x7f1534105f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:53.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:53.967+0000 7f153978f640 1 -- 172.21.15.44:0/4167653500 shutdown_connections 2024-08-19T00:12:53.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:53.967+0000 7f153978f640 1 -- 172.21.15.44:0/4167653500 wait complete. 2024-08-19T00:12:54.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:54 smithi171 ceph-mon[21810]: pgmap v331: 129 pgs: 129 active+clean; 645 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-19T00:12:54.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:54 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:12:54.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:54 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:12:54.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:54 smithi171 ceph-mon[21810]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:12:54.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:54 smithi116 ceph-mon[21873]: pgmap v331: 129 pgs: 129 active+clean; 645 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-19T00:12:54.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:54 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:12:54.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:54 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:12:54.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:54 smithi116 ceph-mon[21873]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:12:54.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:54 smithi044 ceph-mon[18489]: pgmap v331: 129 pgs: 129 active+clean; 645 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-19T00:12:54.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:54 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:12:54.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:54 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:12:54.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:54 smithi044 ceph-mon[18489]: from='mgr.14150 172.21.15.44:0/3168065080' entity='mgr.x' 2024-08-19T00:12:54.696 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- bash -c 'ceph orch device ls' 2024-08-19T00:12:54.951 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:12:55.327 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:55 smithi044 ceph-mon[18489]: from='client.15147 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:12:55.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:55.404+0000 7fcd19095640 1 -- 172.21.15.44:0/2279958102 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcd14101930 msgr2=0x7fcd14101d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:55.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:55.404+0000 7fcd19095640 1 --2- 172.21.15.44:0/2279958102 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcd14101930 0x7fcd14101d30 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fcd04009900 tx=0x7fcd0402a410 comp rx=0 tx=0).stop 2024-08-19T00:12:55.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:55.404+0000 7fcd19095640 1 -- 172.21.15.44:0/2279958102 shutdown_connections 2024-08-19T00:12:55.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:55.404+0000 7fcd19095640 1 --2- 172.21.15.44:0/2279958102 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcd141034f0 0x7fcd14109d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:55.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:55.404+0000 7fcd19095640 1 --2- 172.21.15.44:0/2279958102 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcd14102b30 0x7fcd14102fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:55.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:55.404+0000 7fcd19095640 1 --2- 172.21.15.44:0/2279958102 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcd14101930 0x7fcd14101d30 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:55.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:55.404+0000 7fcd19095640 1 -- 172.21.15.44:0/2279958102 >> 172.21.15.44:0/2279958102 conn(0x7fcd140fd0c0 msgr2=0x7fcd140ff500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:55.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:55.404+0000 7fcd19095640 1 -- 172.21.15.44:0/2279958102 shutdown_connections 2024-08-19T00:12:55.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:55.404+0000 7fcd19095640 1 -- 172.21.15.44:0/2279958102 wait complete. 2024-08-19T00:12:55.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:55.404+0000 7fcd19095640 1 Processor -- start 2024-08-19T00:12:55.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:55.405+0000 7fcd19095640 1 -- start start 2024-08-19T00:12:55.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:55.405+0000 7fcd19095640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcd14101930 0x7fcd14075cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:55.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:55.405+0000 7fcd19095640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcd14102b30 0x7fcd14074310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:55.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:55.405+0000 7fcd19095640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcd141034f0 0x7fcd14074850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:55.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:55.405+0000 7fcd19095640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fcd1410d590 con 0x7fcd14102b30 2024-08-19T00:12:55.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:55.405+0000 7fcd19095640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fcd1410d410 con 0x7fcd141034f0 2024-08-19T00:12:55.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:55.405+0000 7fcd19095640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fcd1410d710 con 0x7fcd14101930 2024-08-19T00:12:55.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:55.405+0000 7fcd1259c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcd14102b30 0x7fcd14074310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:55.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:55.405+0000 7fcd1259c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcd14102b30 0x7fcd14074310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46108/0 (socket says 172.21.15.44:46108) 2024-08-19T00:12:55.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:55.405+0000 7fcd1259c640 1 -- 172.21.15.44:0/4120605797 learned_addr learned my addr 172.21.15.44:0/4120605797 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:12:55.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:55.405+0000 7fcd1359e640 1 --2- 172.21.15.44:0/4120605797 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcd141034f0 0x7fcd14074850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:55.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:55.405+0000 7fcd12d9d640 1 --2- 172.21.15.44:0/4120605797 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcd14101930 0x7fcd14075cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:55.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:55.405+0000 7fcd1259c640 1 -- 172.21.15.44:0/4120605797 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcd14101930 msgr2=0x7fcd14075cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:55.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:55.405+0000 7fcd1259c640 1 --2- 172.21.15.44:0/4120605797 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcd14101930 0x7fcd14075cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:55.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:55.405+0000 7fcd1259c640 1 -- 172.21.15.44:0/4120605797 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcd141034f0 msgr2=0x7fcd14074850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:55.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:55.405+0000 7fcd1259c640 1 --2- 172.21.15.44:0/4120605797 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcd141034f0 0x7fcd14074850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:55.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:55.405+0000 7fcd1259c640 1 -- 172.21.15.44:0/4120605797 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd14075110 con 0x7fcd14102b30 2024-08-19T00:12:55.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:55.405+0000 7fcd12d9d640 1 --2- 172.21.15.44:0/4120605797 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcd14101930 0x7fcd14075cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:12:55.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:55.406+0000 7fcd1259c640 1 --2- 172.21.15.44:0/4120605797 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcd14102b30 0x7fcd14074310 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fcd0800d950 tx=0x7fcd0800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:55.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:55.406+0000 7fccfbfff640 1 -- 172.21.15.44:0/4120605797 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd08017070 con 0x7fcd14102b30 2024-08-19T00:12:55.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:55.406+0000 7fccfbfff640 1 -- 172.21.15.44:0/4120605797 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd08009c30 con 0x7fcd14102b30 2024-08-19T00:12:55.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:55.406+0000 7fcd19095640 1 -- 172.21.15.44:0/4120605797 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd141a1d70 con 0x7fcd14102b30 2024-08-19T00:12:55.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:55.406+0000 7fccfbfff640 1 -- 172.21.15.44:0/4120605797 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd0800f6b0 con 0x7fcd14102b30 2024-08-19T00:12:55.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:55.406+0000 7fcd19095640 1 -- 172.21.15.44:0/4120605797 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd141a2220 con 0x7fcd14102b30 2024-08-19T00:12:55.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:55.407+0000 7fcd19095640 1 -- 172.21.15.44:0/4120605797 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd14108cd0 con 0x7fcd14102b30 2024-08-19T00:12:55.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:55.409+0000 7fccfbfff640 1 -- 172.21.15.44:0/4120605797 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fcd080109d0 con 0x7fcd14102b30 2024-08-19T00:12:55.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:55.409+0000 7fccfbfff640 1 --2- 172.21.15.44:0/4120605797 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fccfc0a2c10 0x7fccfc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:55.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:55.410+0000 7fccfbfff640 1 -- 172.21.15.44:0/4120605797 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9187+0+0 (secure 0 0 0) 0x7fcd080cf160 con 0x7fcd14102b30 2024-08-19T00:12:55.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:55.410+0000 7fcd12d9d640 1 --2- 172.21.15.44:0/4120605797 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fccfc0a2c10 0x7fccfc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:55.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:55.410+0000 7fcd12d9d640 1 --2- 172.21.15.44:0/4120605797 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fccfc0a2c10 0x7fccfc0a50d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fcd04000c00 tx=0x7fcd04031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:55.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:55.413+0000 7fccfbfff640 1 -- 172.21.15.44:0/4120605797 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fcd08009de0 con 0x7fcd14102b30 2024-08-19T00:12:55.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:55 smithi171 ceph-mon[21810]: from='client.15147 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:12:55.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:55.595+0000 7fcd19095640 1 -- 172.21.15.44:0/4120605797 --> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7fcd14062360 con 0x7fccfc0a2c10 2024-08-19T00:12:55.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:55.597+0000 7fccfbfff640 1 -- 172.21.15.44:0/4120605797 <== mgr.14150 v2:172.21.15.44:6800/1330072146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7fcd14062360 con 0x7fccfc0a2c10 2024-08-19T00:12:55.598 INFO:teuthology.orchestra.run.smithi044.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-08-19T00:12:55.598 INFO:teuthology.orchestra.run.smithi044.stdout:smithi044 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT5331001K400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-08-19T00:12:55.598 INFO:teuthology.orchestra.run.smithi044.stdout:smithi116 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400VJ400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-08-19T00:12:55.598 INFO:teuthology.orchestra.run.smithi044.stdout:smithi171 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6233001S400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-08-19T00:12:55.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:55.598+0000 7fcd19095640 1 -- 172.21.15.44:0/4120605797 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fccfc0a2c10 msgr2=0x7fccfc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:55.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:55.598+0000 7fcd19095640 1 --2- 172.21.15.44:0/4120605797 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fccfc0a2c10 0x7fccfc0a50d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fcd04000c00 tx=0x7fcd04031400 comp rx=0 tx=0).stop 2024-08-19T00:12:55.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:55.598+0000 7fcd19095640 1 -- 172.21.15.44:0/4120605797 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcd14102b30 msgr2=0x7fcd14074310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:55.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:55.598+0000 7fcd19095640 1 --2- 172.21.15.44:0/4120605797 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcd14102b30 0x7fcd14074310 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fcd0800d950 tx=0x7fcd0800de10 comp rx=0 tx=0).stop 2024-08-19T00:12:55.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:55.599+0000 7fcd19095640 1 -- 172.21.15.44:0/4120605797 shutdown_connections 2024-08-19T00:12:55.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:55.599+0000 7fcd19095640 1 --2- 172.21.15.44:0/4120605797 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fccfc0a2c10 0x7fccfc0a50d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:55.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:55.599+0000 7fcd19095640 1 --2- 172.21.15.44:0/4120605797 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcd141034f0 0x7fcd14074850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:55.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:55.599+0000 7fcd19095640 1 --2- 172.21.15.44:0/4120605797 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcd14102b30 0x7fcd14074310 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:55.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:55.599+0000 7fcd19095640 1 --2- 172.21.15.44:0/4120605797 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcd14101930 0x7fcd14075cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:55.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:55.599+0000 7fcd19095640 1 -- 172.21.15.44:0/4120605797 >> 172.21.15.44:0/4120605797 conn(0x7fcd140fd0c0 msgr2=0x7fcd14105ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:55.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:55.599+0000 7fcd19095640 1 -- 172.21.15.44:0/4120605797 shutdown_connections 2024-08-19T00:12:55.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:55.599+0000 7fcd19095640 1 -- 172.21.15.44:0/4120605797 wait complete. 2024-08-19T00:12:55.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:55 smithi116 ceph-mon[21873]: from='client.15147 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:12:56.362 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-19T00:12:56.372 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi044.front.sepia.ceph.com 2024-08-19T00:12:56.372 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- bash -c 'ceph fs dump' 2024-08-19T00:12:56.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:56 smithi171 ceph-mon[21810]: pgmap v332: 129 pgs: 129 active+clean; 645 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-08-19T00:12:56.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:56 smithi116 ceph-mon[21873]: pgmap v332: 129 pgs: 129 active+clean; 645 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-08-19T00:12:56.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:56 smithi044 ceph-mon[18489]: pgmap v332: 129 pgs: 129 active+clean; 645 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-08-19T00:12:56.637 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:12:57.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:57.095+0000 7f96c9789640 1 -- 172.21.15.44:0/1720147193 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96c4102400 msgr2=0x7f96c4108c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:57.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:57.095+0000 7f96c9789640 1 --2- 172.21.15.44:0/1720147193 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96c4102400 0x7f96c4108c90 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f96bc009ca0 tx=0x7f96bc02a8e0 comp rx=0 tx=0).stop 2024-08-19T00:12:57.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:57.095+0000 7f96c9789640 1 -- 172.21.15.44:0/1720147193 shutdown_connections 2024-08-19T00:12:57.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:57.095+0000 7f96c9789640 1 --2- 172.21.15.44:0/1720147193 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96c4102400 0x7f96c4108c90 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:57.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:57.095+0000 7f96c9789640 1 --2- 172.21.15.44:0/1720147193 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f96c4101a40 0x7f96c4101ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:57.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:57.095+0000 7f96c9789640 1 --2- 172.21.15.44:0/1720147193 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f96c4100840 0x7f96c4100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:57.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:57.095+0000 7f96c9789640 1 -- 172.21.15.44:0/1720147193 >> 172.21.15.44:0/1720147193 conn(0x7f96c40fbfd0 msgr2=0x7f96c40fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:57.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:57.095+0000 7f96c9789640 1 -- 172.21.15.44:0/1720147193 shutdown_connections 2024-08-19T00:12:57.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:57.095+0000 7f96c9789640 1 -- 172.21.15.44:0/1720147193 wait complete. 2024-08-19T00:12:57.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:57.095+0000 7f96c9789640 1 Processor -- start 2024-08-19T00:12:57.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:57.095+0000 7f96c9789640 1 -- start start 2024-08-19T00:12:57.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:57.096+0000 7f96c9789640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f96c4100840 0x7f96c41047d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:57.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:57.096+0000 7f96c9789640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96c4101a40 0x7f96c4102e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:57.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:57.096+0000 7f96c9789640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f96c4102400 0x7f96c4103360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:57.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:57.096+0000 7f96c9789640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f96c410c5c0 con 0x7f96c4101a40 2024-08-19T00:12:57.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:57.096+0000 7f96c9789640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f96c410c440 con 0x7f96c4100840 2024-08-19T00:12:57.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:57.096+0000 7f96c9789640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f96c410c740 con 0x7f96c4102400 2024-08-19T00:12:57.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:57.096+0000 7f96bbfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96c4101a40 0x7f96c4102e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:57.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:57.096+0000 7f96bbfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96c4101a40 0x7f96c4102e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46120/0 (socket says 172.21.15.44:46120) 2024-08-19T00:12:57.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:57.096+0000 7f96bbfff640 1 -- 172.21.15.44:0/979284915 learned_addr learned my addr 172.21.15.44:0/979284915 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:12:57.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:57.096+0000 7f96c2ffd640 1 --2- 172.21.15.44:0/979284915 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f96c4100840 0x7f96c41047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:57.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:57.096+0000 7f96c37fe640 1 --2- 172.21.15.44:0/979284915 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f96c4102400 0x7f96c4103360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:57.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:57.096+0000 7f96bbfff640 1 -- 172.21.15.44:0/979284915 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f96c4102400 msgr2=0x7f96c4103360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:57.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:57.096+0000 7f96bbfff640 1 --2- 172.21.15.44:0/979284915 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f96c4102400 0x7f96c4103360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:57.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:57.096+0000 7f96bbfff640 1 -- 172.21.15.44:0/979284915 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f96c4100840 msgr2=0x7f96c41047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:57.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:57.096+0000 7f96bbfff640 1 --2- 172.21.15.44:0/979284915 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f96c4100840 0x7f96c41047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:57.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:57.096+0000 7f96bbfff640 1 -- 172.21.15.44:0/979284915 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96c4103c20 con 0x7f96c4101a40 2024-08-19T00:12:57.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:57.096+0000 7f96bbfff640 1 --2- 172.21.15.44:0/979284915 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96c4101a40 0x7f96c4102e20 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f96ac00b4a0 tx=0x7f96ac00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:57.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:57.097+0000 7f96c0ff9640 1 -- 172.21.15.44:0/979284915 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96ac014070 con 0x7f96c4101a40 2024-08-19T00:12:57.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:57.097+0000 7f96c9789640 1 -- 172.21.15.44:0/979284915 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96c41a1f10 con 0x7f96c4101a40 2024-08-19T00:12:57.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:57.097+0000 7f96c0ff9640 1 -- 172.21.15.44:0/979284915 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f96ac010af0 con 0x7f96c4101a40 2024-08-19T00:12:57.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:57.097+0000 7f96c0ff9640 1 -- 172.21.15.44:0/979284915 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96ac017d10 con 0x7f96c4101a40 2024-08-19T00:12:57.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:57.097+0000 7f96c9789640 1 -- 172.21.15.44:0/979284915 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96c41a23f0 con 0x7f96c4101a40 2024-08-19T00:12:57.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:57.098+0000 7f96c9789640 1 -- 172.21.15.44:0/979284915 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96c41a2680 con 0x7f96c4101a40 2024-08-19T00:12:57.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:57.099+0000 7f96c0ff9640 1 -- 172.21.15.44:0/979284915 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f96ac017070 con 0x7f96c4101a40 2024-08-19T00:12:57.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:57.100+0000 7f96c0ff9640 1 --2- 172.21.15.44:0/979284915 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f96b00a2c10 0x7f96b00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:57.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:57.100+0000 7f96c2ffd640 1 --2- 172.21.15.44:0/979284915 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f96b00a2c10 0x7f96b00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:57.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:57.100+0000 7f96c0ff9640 1 -- 172.21.15.44:0/979284915 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9187+0+0 (secure 0 0 0) 0x7f96ac0ce7f0 con 0x7f96c4101a40 2024-08-19T00:12:57.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:57.100+0000 7f96c2ffd640 1 --2- 172.21.15.44:0/979284915 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f96b00a2c10 0x7f96b00a50d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f96c41018a0 tx=0x7f96b40090e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:57.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:57.104+0000 7f96c0ff9640 1 -- 172.21.15.44:0/979284915 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f96ac09b340 con 0x7f96c4101a40 2024-08-19T00:12:57.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:57.317+0000 7f96c9789640 1 -- 172.21.15.44:0/979284915 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f96c41a2850 con 0x7f96c4101a40 2024-08-19T00:12:57.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:57.318+0000 7f96c0ff9640 1 -- 172.21.15.44:0/979284915 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 27 v27) ==== 76+0+3140 (secure 0 0 0) 0x7f96ac09ac40 con 0x7f96c4101a40 2024-08-19T00:12:57.319 INFO:teuthology.orchestra.run.smithi044.stdout:e27 2024-08-19T00:12:57.320 INFO:teuthology.orchestra.run.smithi044.stdout:btime 2024-08-19T00:11:36:898699+0000 2024-08-19T00:12:57.320 INFO:teuthology.orchestra.run.smithi044.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T00:12:57.320 INFO:teuthology.orchestra.run.smithi044.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-19T00:12:57.320 INFO:teuthology.orchestra.run.smithi044.stdout:legacy client fscid: 1 2024-08-19T00:12:57.320 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:12:57.320 INFO:teuthology.orchestra.run.smithi044.stdout:Filesystem 'cephfs' (1) 2024-08-19T00:12:57.320 INFO:teuthology.orchestra.run.smithi044.stdout:fs_name cephfs 2024-08-19T00:12:57.320 INFO:teuthology.orchestra.run.smithi044.stdout:epoch 27 2024-08-19T00:12:57.320 INFO:teuthology.orchestra.run.smithi044.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-19T00:12:57.320 INFO:teuthology.orchestra.run.smithi044.stdout:created 2024-08-19T00:10:53.196636+0000 2024-08-19T00:12:57.320 INFO:teuthology.orchestra.run.smithi044.stdout:modified 2024-08-19T00:11:36.898676+0000 2024-08-19T00:12:57.320 INFO:teuthology.orchestra.run.smithi044.stdout:tableserver 0 2024-08-19T00:12:57.320 INFO:teuthology.orchestra.run.smithi044.stdout:root 0 2024-08-19T00:12:57.321 INFO:teuthology.orchestra.run.smithi044.stdout:session_timeout 300 2024-08-19T00:12:57.321 INFO:teuthology.orchestra.run.smithi044.stdout:session_autoclose 300 2024-08-19T00:12:57.321 INFO:teuthology.orchestra.run.smithi044.stdout:max_file_size 1099511627776 2024-08-19T00:12:57.321 INFO:teuthology.orchestra.run.smithi044.stdout:max_xattr_size 65536 2024-08-19T00:12:57.321 INFO:teuthology.orchestra.run.smithi044.stdout:required_client_features {} 2024-08-19T00:12:57.321 INFO:teuthology.orchestra.run.smithi044.stdout:last_failure 0 2024-08-19T00:12:57.321 INFO:teuthology.orchestra.run.smithi044.stdout:last_failure_osd_epoch 0 2024-08-19T00:12:57.321 INFO:teuthology.orchestra.run.smithi044.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-19T00:12:57.321 INFO:teuthology.orchestra.run.smithi044.stdout:max_mds 5 2024-08-19T00:12:57.321 INFO:teuthology.orchestra.run.smithi044.stdout:in 0,1,2,3,4 2024-08-19T00:12:57.321 INFO:teuthology.orchestra.run.smithi044.stdout:up {0=24473,1=24446,2=24439,3=24431,4=24418} 2024-08-19T00:12:57.321 INFO:teuthology.orchestra.run.smithi044.stdout:failed 2024-08-19T00:12:57.321 INFO:teuthology.orchestra.run.smithi044.stdout:damaged 2024-08-19T00:12:57.321 INFO:teuthology.orchestra.run.smithi044.stdout:stopped 2024-08-19T00:12:57.322 INFO:teuthology.orchestra.run.smithi044.stdout:data_pools [3,4] 2024-08-19T00:12:57.322 INFO:teuthology.orchestra.run.smithi044.stdout:metadata_pool 2 2024-08-19T00:12:57.322 INFO:teuthology.orchestra.run.smithi044.stdout:inline_data disabled 2024-08-19T00:12:57.322 INFO:teuthology.orchestra.run.smithi044.stdout:balancer 2024-08-19T00:12:57.322 INFO:teuthology.orchestra.run.smithi044.stdout:bal_rank_mask -1 2024-08-19T00:12:57.322 INFO:teuthology.orchestra.run.smithi044.stdout:standby_count_wanted 0 2024-08-19T00:12:57.322 INFO:teuthology.orchestra.run.smithi044.stdout:qdb_cluster leader: 24473 members: 24473,24446,24439,24431,24418 2024-08-19T00:12:57.322 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.b{0:24473} state up:active seq 4 addr [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T00:12:57.322 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.f{0:24412} state up:standby-replay seq 1 addr [v2:172.21.15.171:6834/2190623851,v1:172.21.15.171:6835/2190623851] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T00:12:57.322 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.h{1:24446} state up:active seq 17 addr [v2:172.21.15.116:6836/2764513846,v1:172.21.15.116:6837/2764513846] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T00:12:57.322 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.l{1:24388} state up:standby-replay seq 1 addr [v2:172.21.15.171:6832/1183022838,v1:172.21.15.171:6833/1183022838] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T00:12:57.322 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.i{2:24439} state up:active seq 17 addr [v2:172.21.15.171:6838/1466585795,v1:172.21.15.171:6839/1466585795] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T00:12:57.322 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.a{2:14589} state up:standby-replay seq 1 addr [v2:172.21.15.44:6840/3667695717,v1:172.21.15.44:6841/3667695717] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T00:12:57.323 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.e{3:24431} state up:active seq 20 addr [v2:172.21.15.116:6834/3507399322,v1:172.21.15.116:6835/3507399322] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T00:12:57.323 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.g{3:14577} state up:standby-replay seq 1 addr [v2:172.21.15.44:6838/3591739042,v1:172.21.15.44:6839/3591739042] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T00:12:57.323 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.c{4:24418} state up:active seq 19 addr [v2:172.21.15.171:6836/316231795,v1:172.21.15.171:6837/316231795] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T00:12:57.323 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.d{4:14529} state up:standby-replay seq 1 addr [v2:172.21.15.44:6836/1824829052,v1:172.21.15.44:6837/1824829052] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T00:12:57.323 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:12:57.323 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:12:57.323 INFO:teuthology.orchestra.run.smithi044.stdout:Standby daemons: 2024-08-19T00:12:57.323 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:12:57.323 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.k{-1:14511} state up:standby seq 1 addr [v2:172.21.15.116:6832/1538841896,v1:172.21.15.116:6833/1538841896] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T00:12:57.323 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.j{-1:14517} state up:standby seq 1 addr [v2:172.21.15.44:6834/4044471606,v1:172.21.15.44:6835/4044471606] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T00:12:57.324 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 27 2024-08-19T00:12:57.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:57.320+0000 7f96c9789640 1 -- 172.21.15.44:0/979284915 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f96b00a2c10 msgr2=0x7f96b00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:57.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:57.320+0000 7f96c9789640 1 --2- 172.21.15.44:0/979284915 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f96b00a2c10 0x7f96b00a50d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f96c41018a0 tx=0x7f96b40090e0 comp rx=0 tx=0).stop 2024-08-19T00:12:57.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:57.320+0000 7f96c9789640 1 -- 172.21.15.44:0/979284915 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96c4101a40 msgr2=0x7f96c4102e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:57.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:57.320+0000 7f96c9789640 1 --2- 172.21.15.44:0/979284915 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96c4101a40 0x7f96c4102e20 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f96ac00b4a0 tx=0x7f96ac00b960 comp rx=0 tx=0).stop 2024-08-19T00:12:57.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:57.320+0000 7f96c9789640 1 -- 172.21.15.44:0/979284915 shutdown_connections 2024-08-19T00:12:57.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:57.320+0000 7f96c9789640 1 --2- 172.21.15.44:0/979284915 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f96b00a2c10 0x7f96b00a50d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:57.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:57.320+0000 7f96c9789640 1 --2- 172.21.15.44:0/979284915 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f96c4102400 0x7f96c4103360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:57.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:57.320+0000 7f96c9789640 1 --2- 172.21.15.44:0/979284915 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96c4101a40 0x7f96c4102e20 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:57.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:57.320+0000 7f96c9789640 1 --2- 172.21.15.44:0/979284915 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f96c4100840 0x7f96c41047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:57.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:57.320+0000 7f96c9789640 1 -- 172.21.15.44:0/979284915 >> 172.21.15.44:0/979284915 conn(0x7f96c40fbfd0 msgr2=0x7f96c406a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:57.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:57.320+0000 7f96c9789640 1 -- 172.21.15.44:0/979284915 shutdown_connections 2024-08-19T00:12:57.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:57.320+0000 7f96c9789640 1 -- 172.21.15.44:0/979284915 wait complete. 2024-08-19T00:12:57.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:57 smithi171 ceph-mon[21810]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:12:57.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:57 smithi116 ceph-mon[21873]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:12:57.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:57 smithi044 ceph-mon[18489]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:12:58.086 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- bash -c 'ceph osd dump' 2024-08-19T00:12:58.347 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:12:58.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:58 smithi044 ceph-mon[18489]: pgmap v333: 129 pgs: 129 active+clean; 645 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-08-19T00:12:58.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:58 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/979284915' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T00:12:58.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:58 smithi171 ceph-mon[21810]: pgmap v333: 129 pgs: 129 active+clean; 645 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-08-19T00:12:58.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:58 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/979284915' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T00:12:58.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:58 smithi116 ceph-mon[21873]: pgmap v333: 129 pgs: 129 active+clean; 645 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-08-19T00:12:58.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:58 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/979284915' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T00:12:58.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:58.802+0000 7f0e18614640 1 -- 172.21.15.44:0/1021814207 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e10101ec0 msgr2=0x7f0e101022c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:58.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:58.802+0000 7f0e18614640 1 --2- 172.21.15.44:0/1021814207 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e10101ec0 0x7f0e101022c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c009900 tx=0x7f0e0c02a3e0 comp rx=0 tx=0).stop 2024-08-19T00:12:58.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:58.802+0000 7f0e18614640 1 -- 172.21.15.44:0/1021814207 shutdown_connections 2024-08-19T00:12:58.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:58.802+0000 7f0e18614640 1 --2- 172.21.15.44:0/1021814207 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0e10101450 0x7f0e10108cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:58.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:58.802+0000 7f0e18614640 1 --2- 172.21.15.44:0/1021814207 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0e10100a90 0x7f0e10100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:58.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:58.802+0000 7f0e18614640 1 --2- 172.21.15.44:0/1021814207 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e10101ec0 0x7f0e101022c0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:58.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:58.802+0000 7f0e18614640 1 -- 172.21.15.44:0/1021814207 >> 172.21.15.44:0/1021814207 conn(0x7f0e100fb770 msgr2=0x7f0e100fdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:58.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:58.802+0000 7f0e18614640 1 -- 172.21.15.44:0/1021814207 shutdown_connections 2024-08-19T00:12:58.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:58.802+0000 7f0e18614640 1 -- 172.21.15.44:0/1021814207 wait complete. 2024-08-19T00:12:58.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:58.803+0000 7f0e18614640 1 Processor -- start 2024-08-19T00:12:58.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:58.803+0000 7f0e18614640 1 -- start start 2024-08-19T00:12:58.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:58.803+0000 7f0e18614640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0e10100a90 0x7f0e101004e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:58.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:58.803+0000 7f0e18614640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e10101450 0x7f0e1019c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:58.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:58.803+0000 7f0e18614640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0e10101ec0 0x7f0e1019efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:58.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:58.803+0000 7f0e18614640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0e1010c4c0 con 0x7f0e10101450 2024-08-19T00:12:58.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:58.803+0000 7f0e18614640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f0e1010c340 con 0x7f0e10100a90 2024-08-19T00:12:58.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:58.803+0000 7f0e18614640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0e1010c640 con 0x7f0e10101ec0 2024-08-19T00:12:58.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:58.803+0000 7f0e15baf640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e10101450 0x7f0e1019c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:58.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:58.803+0000 7f0e15baf640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e10101450 0x7f0e1019c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34948/0 (socket says 172.21.15.44:34948) 2024-08-19T00:12:58.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:58.803+0000 7f0e15baf640 1 -- 172.21.15.44:0/1797189157 learned_addr learned my addr 172.21.15.44:0/1797189157 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:12:58.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:58.803+0000 7f0e163b0640 1 --2- 172.21.15.44:0/1797189157 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0e10100a90 0x7f0e101004e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:58.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:58.803+0000 7f0e16bb1640 1 --2- 172.21.15.44:0/1797189157 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0e10101ec0 0x7f0e1019efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:58.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:58.804+0000 7f0e15baf640 1 -- 172.21.15.44:0/1797189157 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0e10101ec0 msgr2=0x7f0e1019efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:58.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:58.804+0000 7f0e15baf640 1 --2- 172.21.15.44:0/1797189157 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0e10101ec0 0x7f0e1019efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:58.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:58.804+0000 7f0e15baf640 1 -- 172.21.15.44:0/1797189157 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0e10100a90 msgr2=0x7f0e101004e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:58.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:58.804+0000 7f0e15baf640 1 --2- 172.21.15.44:0/1797189157 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0e10100a90 0x7f0e101004e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:58.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:58.804+0000 7f0e15baf640 1 -- 172.21.15.44:0/1797189157 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e1019f8e0 con 0x7f0e10101450 2024-08-19T00:12:58.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:58.804+0000 7f0e163b0640 1 --2- 172.21.15.44:0/1797189157 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0e10100a90 0x7f0e101004e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:12:58.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:58.804+0000 7f0e15baf640 1 --2- 172.21.15.44:0/1797189157 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e10101450 0x7f0e1019c9b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0e0400d950 tx=0x7f0e0400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:58.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:58.804+0000 7f0e037fe640 1 -- 172.21.15.44:0/1797189157 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e04017020 con 0x7f0e10101450 2024-08-19T00:12:58.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:58.804+0000 7f0e18614640 1 -- 172.21.15.44:0/1797189157 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e1019fb70 con 0x7f0e10101450 2024-08-19T00:12:58.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:58.804+0000 7f0e037fe640 1 -- 172.21.15.44:0/1797189157 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e04009c30 con 0x7f0e10101450 2024-08-19T00:12:58.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:58.804+0000 7f0e037fe640 1 -- 172.21.15.44:0/1797189157 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e0400f6b0 con 0x7f0e10101450 2024-08-19T00:12:58.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:58.804+0000 7f0e18614640 1 -- 172.21.15.44:0/1797189157 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e101a00b0 con 0x7f0e10101450 2024-08-19T00:12:58.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:58.805+0000 7f0e18614640 1 -- 172.21.15.44:0/1797189157 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e10107cf0 con 0x7f0e10101450 2024-08-19T00:12:58.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:58.806+0000 7f0e037fe640 1 -- 172.21.15.44:0/1797189157 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f0e0401a020 con 0x7f0e10101450 2024-08-19T00:12:58.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:58.807+0000 7f0e037fe640 1 --2- 172.21.15.44:0/1797189157 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f0dfc0a2c10 0x7f0dfc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:12:58.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:58.807+0000 7f0e163b0640 1 --2- 172.21.15.44:0/1797189157 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f0dfc0a2c10 0x7f0dfc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:12:58.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:58.807+0000 7f0e037fe640 1 -- 172.21.15.44:0/1797189157 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9187+0+0 (secure 0 0 0) 0x7f0e040cfa00 con 0x7f0e10101450 2024-08-19T00:12:58.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:58.808+0000 7f0e163b0640 1 --2- 172.21.15.44:0/1797189157 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f0dfc0a2c10 0x7f0dfc0a50d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c000c00 tx=0x7f0e0c0315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:12:58.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:58.811+0000 7f0e037fe640 1 -- 172.21.15.44:0/1797189157 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f0e04021020 con 0x7f0e10101450 2024-08-19T00:12:58.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:58.987+0000 7f0e18614640 1 -- 172.21.15.44:0/1797189157 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f0e1002d800 con 0x7f0e10101450 2024-08-19T00:12:59.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:58.988+0000 7f0e037fe640 1 -- 172.21.15.44:0/1797189157 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v94) ==== 56+0+5677 (secure 0 0 0) 0x7f0e0409c3e0 con 0x7f0e10101450 2024-08-19T00:12:59.036 INFO:teuthology.orchestra.run.smithi044.stdout:epoch 94 2024-08-19T00:12:59.036 INFO:teuthology.orchestra.run.smithi044.stdout:fsid 647ded64-5dbe-11ef-bccf-c7b262605968 2024-08-19T00:12:59.036 INFO:teuthology.orchestra.run.smithi044.stdout:created 2024-08-19T00:03:43.667929+0000 2024-08-19T00:12:59.036 INFO:teuthology.orchestra.run.smithi044.stdout:modified 2024-08-19T00:12:40.593724+0000 2024-08-19T00:12:59.036 INFO:teuthology.orchestra.run.smithi044.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-08-19T00:12:59.036 INFO:teuthology.orchestra.run.smithi044.stdout:crush_version 27 2024-08-19T00:12:59.036 INFO:teuthology.orchestra.run.smithi044.stdout:full_ratio 0.95 2024-08-19T00:12:59.036 INFO:teuthology.orchestra.run.smithi044.stdout:backfillfull_ratio 0.9 2024-08-19T00:12:59.036 INFO:teuthology.orchestra.run.smithi044.stdout:nearfull_ratio 0.85 2024-08-19T00:12:59.036 INFO:teuthology.orchestra.run.smithi044.stdout:require_min_compat_client luminous 2024-08-19T00:12:59.036 INFO:teuthology.orchestra.run.smithi044.stdout:min_compat_client luminous 2024-08-19T00:12:59.037 INFO:teuthology.orchestra.run.smithi044.stdout:require_osd_release squid 2024-08-19T00:12:59.037 INFO:teuthology.orchestra.run.smithi044.stdout:stretch_mode_enabled false 2024-08-19T00:12:59.037 INFO:teuthology.orchestra.run.smithi044.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-08-19T00:12:59.037 INFO:teuthology.orchestra.run.smithi044.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 84 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-08-19T00:12:59.037 INFO:teuthology.orchestra.run.smithi044.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 84 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-08-19T00:12:59.037 INFO:teuthology.orchestra.run.smithi044.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 90 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-08-19T00:12:59.037 INFO:teuthology.orchestra.run.smithi044.stdout:max_osd 12 2024-08-19T00:12:59.037 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0 up in weight 1 up_from 8 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.44:6802/600251465,v1:172.21.15.44:6803/600251465] [v2:172.21.15.44:6804/600251465,v1:172.21.15.44:6805/600251465] exists,up b15ad904-d07d-4ecb-be8f-d99323425eed 2024-08-19T00:12:59.037 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1 up in weight 1 up_from 13 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.116:6800/613509556,v1:172.21.15.116:6801/613509556] [v2:172.21.15.116:6802/613509556,v1:172.21.15.116:6803/613509556] exists,up 8f70512f-21a3-4fec-8278-04b2bc9b2d4e 2024-08-19T00:12:59.037 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2 up in weight 1 up_from 18 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.171:6800/2130938937,v1:172.21.15.171:6801/2130938937] [v2:172.21.15.171:6802/2130938937,v1:172.21.15.171:6803/2130938937] exists,up 56994dfd-5fcf-4d82-addf-38764239d82a 2024-08-19T00:12:59.037 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3 up in weight 1 up_from 24 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.44:6810/3537027669,v1:172.21.15.44:6811/3537027669] [v2:172.21.15.44:6812/3537027669,v1:172.21.15.44:6813/3537027669] exists,up 6d2ddb19-74e0-4e68-b9ea-58b73fd1e9fe 2024-08-19T00:12:59.037 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4 up in weight 1 up_from 31 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.116:6808/3768627455,v1:172.21.15.116:6809/3768627455] [v2:172.21.15.116:6810/3768627455,v1:172.21.15.116:6811/3768627455] exists,up 190d208e-ae54-497d-ad72-d07a5a26991b 2024-08-19T00:12:59.037 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5 up in weight 1 up_from 36 up_thru 93 down_at 0 last_clean_interval [0,0) [v2:172.21.15.171:6808/938785018,v1:172.21.15.171:6809/938785018] [v2:172.21.15.171:6810/938785018,v1:172.21.15.171:6811/938785018] exists,up d8afacad-6d3d-4703-9744-8d01ff2a2047 2024-08-19T00:12:59.038 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6 up in weight 1 up_from 44 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.44:6818/1219334797,v1:172.21.15.44:6819/1219334797] [v2:172.21.15.44:6820/1219334797,v1:172.21.15.44:6821/1219334797] exists,up 55bf1f89-99e5-409d-99fa-f0124aa042df 2024-08-19T00:12:59.038 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7 up in weight 1 up_from 49 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.116:6816/3861873415,v1:172.21.15.116:6817/3861873415] [v2:172.21.15.116:6818/3861873415,v1:172.21.15.116:6819/3861873415] exists,up 70130d71-d28c-4a58-b603-75610c8d3ea0 2024-08-19T00:12:59.038 INFO:teuthology.orchestra.run.smithi044.stdout:osd.8 up in weight 1 up_from 57 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.171:6816/843701060,v1:172.21.15.171:6817/843701060] [v2:172.21.15.171:6818/843701060,v1:172.21.15.171:6819/843701060] exists,up c5121f70-e423-4f86-a3c6-90945c9385f0 2024-08-19T00:12:59.038 INFO:teuthology.orchestra.run.smithi044.stdout:osd.9 up in weight 1 up_from 65 up_thru 93 down_at 0 last_clean_interval [0,0) [v2:172.21.15.44:6826/3206550013,v1:172.21.15.44:6827/3206550013] [v2:172.21.15.44:6828/3206550013,v1:172.21.15.44:6829/3206550013] exists,up cd13693a-0f25-47cc-b1a5-9c42481935ce 2024-08-19T00:12:59.038 INFO:teuthology.orchestra.run.smithi044.stdout:osd.10 up in weight 1 up_from 71 up_thru 93 down_at 0 last_clean_interval [0,0) [v2:172.21.15.116:6824/3034738363,v1:172.21.15.116:6825/3034738363] [v2:172.21.15.116:6826/3034738363,v1:172.21.15.116:6827/3034738363] exists,up a36ffeb1-6ecf-4899-bdfa-18515afefb86 2024-08-19T00:12:59.038 INFO:teuthology.orchestra.run.smithi044.stdout:osd.11 up in weight 1 up_from 78 up_thru 93 down_at 0 last_clean_interval [0,0) [v2:172.21.15.171:6824/1500842656,v1:172.21.15.171:6825/1500842656] [v2:172.21.15.171:6826/1500842656,v1:172.21.15.171:6827/1500842656] exists,up ffcf44a8-3094-4a29-822e-a6ce95da119e 2024-08-19T00:12:59.038 INFO:teuthology.orchestra.run.smithi044.stdout:pg_upmap_items 2.5 [8,11] 2024-08-19T00:12:59.038 INFO:teuthology.orchestra.run.smithi044.stdout:pg_upmap_items 2.a [2,11] 2024-08-19T00:12:59.038 INFO:teuthology.orchestra.run.smithi044.stdout:pg_upmap_items 2.e [2,4] 2024-08-19T00:12:59.038 INFO:teuthology.orchestra.run.smithi044.stdout:pg_upmap_items 3.0 [4,8] 2024-08-19T00:12:59.038 INFO:teuthology.orchestra.run.smithi044.stdout:pg_upmap_items 3.3 [4,9] 2024-08-19T00:12:59.038 INFO:teuthology.orchestra.run.smithi044.stdout:pg_upmap_items 3.e [5,9] 2024-08-19T00:12:59.039 INFO:teuthology.orchestra.run.smithi044.stdout:pg_upmap_items 3.14 [4,6] 2024-08-19T00:12:59.039 INFO:teuthology.orchestra.run.smithi044.stdout:pg_upmap_items 3.1b [4,7] 2024-08-19T00:12:59.039 INFO:teuthology.orchestra.run.smithi044.stdout:pg_upmap_items 3.1e [3,9,5,8] 2024-08-19T00:12:59.039 INFO:teuthology.orchestra.run.smithi044.stdout:pg_upmap_items 4.f [9,8] 2024-08-19T00:12:59.039 INFO:teuthology.orchestra.run.smithi044.stdout:pg_upmap_items 4.10 [9,8] 2024-08-19T00:12:59.039 INFO:teuthology.orchestra.run.smithi044.stdout:pg_upmap_items 4.12 [9,10] 2024-08-19T00:12:59.039 INFO:teuthology.orchestra.run.smithi044.stdout:pg_upmap_items 4.1c [5,8] 2024-08-19T00:12:59.039 INFO:teuthology.orchestra.run.smithi044.stdout:blocklist 172.21.15.44:6800/1300308907 expires 2024-08-20T00:04:38.392912+0000 2024-08-19T00:12:59.039 INFO:teuthology.orchestra.run.smithi044.stdout:blocklist 172.21.15.44:0/1001446555 expires 2024-08-20T00:04:38.392912+0000 2024-08-19T00:12:59.039 INFO:teuthology.orchestra.run.smithi044.stdout:blocklist 172.21.15.44:0/3800526625 expires 2024-08-20T00:04:38.392912+0000 2024-08-19T00:12:59.039 INFO:teuthology.orchestra.run.smithi044.stdout:blocklist 172.21.15.44:6801/1300308907 expires 2024-08-20T00:04:38.392912+0000 2024-08-19T00:12:59.039 INFO:teuthology.orchestra.run.smithi044.stdout:blocklist 172.21.15.44:0/3096491642 expires 2024-08-20T00:04:14.604141+0000 2024-08-19T00:12:59.039 INFO:teuthology.orchestra.run.smithi044.stdout:blocklist 172.21.15.44:0/400419582 expires 2024-08-20T00:04:38.392912+0000 2024-08-19T00:12:59.039 INFO:teuthology.orchestra.run.smithi044.stdout:blocklist 172.21.15.44:0/1869412718 expires 2024-08-20T00:04:14.604141+0000 2024-08-19T00:12:59.040 INFO:teuthology.orchestra.run.smithi044.stdout:blocklist 172.21.15.44:6801/1374527587 expires 2024-08-20T00:04:14.604141+0000 2024-08-19T00:12:59.040 INFO:teuthology.orchestra.run.smithi044.stdout:blocklist 172.21.15.44:0/911382683 expires 2024-08-20T00:04:14.604141+0000 2024-08-19T00:12:59.040 INFO:teuthology.orchestra.run.smithi044.stdout:blocklist 172.21.15.44:6800/1374527587 expires 2024-08-20T00:04:14.604141+0000 2024-08-19T00:12:59.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:58.991+0000 7f0e18614640 1 -- 172.21.15.44:0/1797189157 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f0dfc0a2c10 msgr2=0x7f0dfc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:59.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:58.991+0000 7f0e18614640 1 --2- 172.21.15.44:0/1797189157 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f0dfc0a2c10 0x7f0dfc0a50d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c000c00 tx=0x7f0e0c0315b0 comp rx=0 tx=0).stop 2024-08-19T00:12:59.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:58.991+0000 7f0e18614640 1 -- 172.21.15.44:0/1797189157 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e10101450 msgr2=0x7f0e1019c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:12:59.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:58.991+0000 7f0e18614640 1 --2- 172.21.15.44:0/1797189157 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e10101450 0x7f0e1019c9b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0e0400d950 tx=0x7f0e0400de10 comp rx=0 tx=0).stop 2024-08-19T00:12:59.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:58.991+0000 7f0e18614640 1 -- 172.21.15.44:0/1797189157 shutdown_connections 2024-08-19T00:12:59.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:58.991+0000 7f0e18614640 1 --2- 172.21.15.44:0/1797189157 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f0dfc0a2c10 0x7f0dfc0a50d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:59.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:58.991+0000 7f0e18614640 1 --2- 172.21.15.44:0/1797189157 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0e10101ec0 0x7f0e1019efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:59.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:58.991+0000 7f0e18614640 1 --2- 172.21.15.44:0/1797189157 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e10101450 0x7f0e1019c9b0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:59.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:58.991+0000 7f0e18614640 1 --2- 172.21.15.44:0/1797189157 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0e10100a90 0x7f0e101004e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:12:59.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:58.991+0000 7f0e18614640 1 -- 172.21.15.44:0/1797189157 >> 172.21.15.44:0/1797189157 conn(0x7f0e100fb770 msgr2=0x7f0e10104ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:12:59.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:58.991+0000 7f0e18614640 1 -- 172.21.15.44:0/1797189157 shutdown_connections 2024-08-19T00:12:59.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:12:58.991+0000 7f0e18614640 1 -- 172.21.15.44:0/1797189157 wait complete. 2024-08-19T00:12:59.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:12:59 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/1797189157' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-08-19T00:12:59.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:12:59 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/1797189157' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-08-19T00:12:59.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:12:59 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/1797189157' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-08-19T00:12:59.760 INFO:teuthology.run_tasks:Running task fs.ready... 2024-08-19T00:12:59.773 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-19T00:13:00.038 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:13:00.414 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:00 smithi044 ceph-mon[18489]: pgmap v334: 129 pgs: 129 active+clean; 645 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-19T00:13:00.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:00.494+0000 7f5ca7aed640 1 -- 172.21.15.44:0/1030747668 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ca0100860 msgr2=0x7f5ca0100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:00.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:00.494+0000 7f5ca7aed640 1 --2- 172.21.15.44:0/1030747668 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ca0100860 0x7f5ca0100c40 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c009900 tx=0x7f5c9c02a490 comp rx=0 tx=0).stop 2024-08-19T00:13:00.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:00.494+0000 7f5ca7aed640 1 -- 172.21.15.44:0/1030747668 shutdown_connections 2024-08-19T00:13:00.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:00.494+0000 7f5ca7aed640 1 --2- 172.21.15.44:0/1030747668 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5ca0101180 0x7f5ca0105650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:00.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:00.494+0000 7f5ca7aed640 1 --2- 172.21.15.44:0/1030747668 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5ca0105c70 0x7f5ca0106100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:00.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:00.494+0000 7f5ca7aed640 1 --2- 172.21.15.44:0/1030747668 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ca0100860 0x7f5ca0100c40 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:00.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:00.494+0000 7f5ca7aed640 1 -- 172.21.15.44:0/1030747668 >> 172.21.15.44:0/1030747668 conn(0x7f5ca00fc4d0 msgr2=0x7f5ca00fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:00.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:00.494+0000 7f5ca7aed640 1 -- 172.21.15.44:0/1030747668 shutdown_connections 2024-08-19T00:13:00.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:00.494+0000 7f5ca7aed640 1 -- 172.21.15.44:0/1030747668 wait complete. 2024-08-19T00:13:00.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:00.495+0000 7f5ca7aed640 1 Processor -- start 2024-08-19T00:13:00.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:00.495+0000 7f5ca7aed640 1 -- start start 2024-08-19T00:13:00.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:00.495+0000 7f5ca7aed640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ca0100860 0x7f5ca01a45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:00.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:00.495+0000 7f5ca7aed640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5ca0101180 0x7f5ca01a4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:00.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:00.496+0000 7f5ca7aed640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5ca0105c70 0x7f5ca019e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:00.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:00.496+0000 7f5ca7aed640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca0118310 con 0x7f5ca0100860 2024-08-19T00:13:00.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:00.496+0000 7f5ca7aed640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca0118190 con 0x7f5ca0105c70 2024-08-19T00:13:00.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:00.496+0000 7f5ca7aed640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca0118490 con 0x7f5ca0101180 2024-08-19T00:13:00.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:00.496+0000 7f5ca608a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5ca0105c70 0x7f5ca019e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:00.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:00.496+0000 7f5ca608a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5ca0105c70 0x7f5ca019e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.44:51704/0 (socket says 172.21.15.44:51704) 2024-08-19T00:13:00.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:00.496+0000 7f5ca608a640 1 -- 172.21.15.44:0/1104028172 learned_addr learned my addr 172.21.15.44:0/1104028172 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:00.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:00.496+0000 7f5ca5889640 1 --2- 172.21.15.44:0/1104028172 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ca0100860 0x7f5ca01a45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:00.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:00.496+0000 7f5ca5088640 1 --2- 172.21.15.44:0/1104028172 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5ca0101180 0x7f5ca01a4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:00.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:00.496+0000 7f5ca608a640 1 -- 172.21.15.44:0/1104028172 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5ca0101180 msgr2=0x7f5ca01a4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:00.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:00.496+0000 7f5ca608a640 1 --2- 172.21.15.44:0/1104028172 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5ca0101180 0x7f5ca01a4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:00.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:00.496+0000 7f5ca608a640 1 -- 172.21.15.44:0/1104028172 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ca0100860 msgr2=0x7f5ca01a45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:00.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:00.496+0000 7f5ca608a640 1 --2- 172.21.15.44:0/1104028172 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ca0100860 0x7f5ca01a45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:00.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:00.496+0000 7f5ca608a640 1 -- 172.21.15.44:0/1104028172 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ca019ef30 con 0x7f5ca0105c70 2024-08-19T00:13:00.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:00.497+0000 7f5ca608a640 1 --2- 172.21.15.44:0/1104028172 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5ca0105c70 0x7f5ca019e6c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5c9800eaa0 tx=0x7f5c9800ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:00.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:00.497+0000 7f5c96ffd640 1 -- 172.21.15.44:0/1104028172 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c9800cdb0 con 0x7f5ca0105c70 2024-08-19T00:13:00.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:00.497+0000 7f5ca7aed640 1 -- 172.21.15.44:0/1104028172 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ca019f220 con 0x7f5ca0105c70 2024-08-19T00:13:00.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:00.497+0000 7f5ca7aed640 1 -- 172.21.15.44:0/1104028172 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ca01ab570 con 0x7f5ca0105c70 2024-08-19T00:13:00.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:00.497+0000 7f5c96ffd640 1 -- 172.21.15.44:0/1104028172 <== mon.2 v2:172.21.15.116:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5c98005020 con 0x7f5ca0105c70 2024-08-19T00:13:00.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:00.497+0000 7f5c96ffd640 1 -- 172.21.15.44:0/1104028172 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c9801f060 con 0x7f5ca0105c70 2024-08-19T00:13:00.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:00.498+0000 7f5ca7aed640 1 -- 172.21.15.44:0/1104028172 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c84005290 con 0x7f5ca0105c70 2024-08-19T00:13:00.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:00.499+0000 7f5c96ffd640 1 -- 172.21.15.44:0/1104028172 <== mon.2 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f5c98004a40 con 0x7f5ca0105c70 2024-08-19T00:13:00.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:00.500+0000 7f5c96ffd640 1 --2- 172.21.15.44:0/1104028172 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f5c8c0a2c10 0x7f5c8c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:00.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:00.500+0000 7f5ca5889640 1 --2- 172.21.15.44:0/1104028172 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f5c8c0a2c10 0x7f5c8c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:00.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:00.500+0000 7f5c96ffd640 1 -- 172.21.15.44:0/1104028172 <== mon.2 v2:172.21.15.116:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9187+0+0 (secure 0 0 0) 0x7f5c980cf750 con 0x7f5ca0105c70 2024-08-19T00:13:00.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:00.500+0000 7f5ca5889640 1 --2- 172.21.15.44:0/1104028172 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f5c8c0a2c10 0x7f5c8c0a50d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c009230 tx=0x7f5c9c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:00.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:00.503+0000 7f5c96ffd640 1 -- 172.21.15.44:0/1104028172 <== mon.2 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f5c98016030 con 0x7f5ca0105c70 2024-08-19T00:13:00.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:00 smithi171 ceph-mon[21810]: pgmap v334: 129 pgs: 129 active+clean; 645 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-19T00:13:00.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:00 smithi116 ceph-mon[21873]: pgmap v334: 129 pgs: 129 active+clean; 645 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-19T00:13:00.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:00.721+0000 7f5ca7aed640 1 -- 172.21.15.44:0/1104028172 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5c84005580 con 0x7f5ca0105c70 2024-08-19T00:13:00.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:00.722+0000 7f5c96ffd640 1 -- 172.21.15.44:0/1104028172 <== mon.2 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11989 (secure 0 0 0) 0x7f5c9809bb40 con 0x7f5ca0105c70 2024-08-19T00:13:00.724 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:13:00.724 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":27,"btime":"2024-08-19T00:11:36:898699+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14511,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1538841896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1538841896},{"type":"v1","addr":"172.21.15.116:6833","nonce":1538841896}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/4044471606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4044471606},{"type":"v1","addr":"172.21.15.44:6835","nonce":4044471606}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-19T00:10:53.196636+0000","modified":"2024-08-19T00:11:36.898676+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24473,"mds_1":24446,"mds_2":24439,"mds_3":24431,"mds_4":24418},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14529":{"gid":14529,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6837/1824829052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1824829052},{"type":"v1","addr":"172.21.15.44:6837","nonce":1824829052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14577":{"gid":14577,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6839/3591739042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":3591739042},{"type":"v1","addr":"172.21.15.44:6839","nonce":3591739042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14589":{"gid":14589,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6841/3667695717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6840","nonce":3667695717},{"type":"v1","addr":"172.21.15.44:6841","nonce":3667695717}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24388":{"gid":24388,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1183022838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1183022838},{"type":"v1","addr":"172.21.15.171:6833","nonce":1183022838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6835/2190623851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":2190623851},{"type":"v1","addr":"172.21.15.171:6835","nonce":2190623851}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.171:6837/316231795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":316231795},{"type":"v1","addr":"172.21.15.171:6837","nonce":316231795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":20,"addr":"172.21.15.116:6835/3507399322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3507399322},{"type":"v1","addr":"172.21.15.116:6835","nonce":3507399322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.171:6839/1466585795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":1466585795},{"type":"v1","addr":"172.21.15.171:6839","nonce":1466585795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":17,"addr":"172.21.15.116:6837/2764513846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":2764513846},{"type":"v1","addr":"172.21.15.116:6837","nonce":2764513846}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.116:6839/1032741033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":1032741033},{"type":"v1","addr":"172.21.15.116:6839","nonce":1032741033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24446,24439,24431,24418]},"id":1}]} 2024-08-19T00:13:00.724 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 27 2024-08-19T00:13:00.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:00.724+0000 7f5ca7aed640 1 -- 172.21.15.44:0/1104028172 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f5c8c0a2c10 msgr2=0x7f5c8c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:00.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:00.724+0000 7f5ca7aed640 1 --2- 172.21.15.44:0/1104028172 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f5c8c0a2c10 0x7f5c8c0a50d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c009230 tx=0x7f5c9c0058d0 comp rx=0 tx=0).stop 2024-08-19T00:13:00.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:00.725+0000 7f5ca7aed640 1 -- 172.21.15.44:0/1104028172 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5ca0105c70 msgr2=0x7f5ca019e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:00.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:00.725+0000 7f5ca7aed640 1 --2- 172.21.15.44:0/1104028172 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5ca0105c70 0x7f5ca019e6c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5c9800eaa0 tx=0x7f5c9800ef60 comp rx=0 tx=0).stop 2024-08-19T00:13:00.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:00.725+0000 7f5ca7aed640 1 -- 172.21.15.44:0/1104028172 shutdown_connections 2024-08-19T00:13:00.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:00.725+0000 7f5ca7aed640 1 --2- 172.21.15.44:0/1104028172 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f5c8c0a2c10 0x7f5c8c0a50d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:00.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:00.725+0000 7f5ca7aed640 1 --2- 172.21.15.44:0/1104028172 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5ca0101180 0x7f5ca01a4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:00.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:00.725+0000 7f5ca7aed640 1 --2- 172.21.15.44:0/1104028172 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5ca0105c70 0x7f5ca019e6c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:00.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:00.725+0000 7f5ca7aed640 1 --2- 172.21.15.44:0/1104028172 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ca0100860 0x7f5ca01a45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:00.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:00.725+0000 7f5ca7aed640 1 -- 172.21.15.44:0/1104028172 >> 172.21.15.44:0/1104028172 conn(0x7f5ca00fc4d0 msgr2=0x7f5ca00fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:00.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:00.725+0000 7f5ca7aed640 1 -- 172.21.15.44:0/1104028172 shutdown_connections 2024-08-19T00:13:00.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:00.725+0000 7f5ca7aed640 1 -- 172.21.15.44:0/1104028172 wait complete. 2024-08-19T00:13:01.457 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-19T00:13:01.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:01 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/1104028172' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:13:01.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:01 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/1104028172' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:13:01.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:01 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/1104028172' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:13:01.714 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:13:02.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:02.151+0000 7f637d2c9640 1 -- 172.21.15.44:0/3000145360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63781078b0 msgr2=0x7f6378107c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:02.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:02.151+0000 7f637d2c9640 1 --2- 172.21.15.44:0/3000145360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63781078b0 0x7f6378107c90 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f6370009cd0 tx=0x7f637002a8e0 comp rx=0 tx=0).stop 2024-08-19T00:13:02.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:02.151+0000 7f637d2c9640 1 -- 172.21.15.44:0/3000145360 shutdown_connections 2024-08-19T00:13:02.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:02.151+0000 7f637d2c9640 1 --2- 172.21.15.44:0/3000145360 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f63781018b0 0x7f6378101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:02.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:02.151+0000 7f637d2c9640 1 --2- 172.21.15.44:0/3000145360 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6378102250 0x7f637810e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:02.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:02.151+0000 7f637d2c9640 1 --2- 172.21.15.44:0/3000145360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63781078b0 0x7f6378107c90 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:02.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:02.151+0000 7f637d2c9640 1 -- 172.21.15.44:0/3000145360 >> 172.21.15.44:0/3000145360 conn(0x7f63780fd5f0 msgr2=0x7f63780ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:02.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:02.151+0000 7f637d2c9640 1 -- 172.21.15.44:0/3000145360 shutdown_connections 2024-08-19T00:13:02.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:02.151+0000 7f637d2c9640 1 -- 172.21.15.44:0/3000145360 wait complete. 2024-08-19T00:13:02.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:02.151+0000 7f637d2c9640 1 Processor -- start 2024-08-19T00:13:02.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:02.152+0000 7f637d2c9640 1 -- start start 2024-08-19T00:13:02.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:02.152+0000 7f637d2c9640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f63781018b0 0x7f637819a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:02.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:02.152+0000 7f637d2c9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6378102250 0x7f637819a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:02.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:02.152+0000 7f637d2c9640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f63781078b0 0x7f637819ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:02.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:02.152+0000 7f637d2c9640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6378111cb0 con 0x7f6378102250 2024-08-19T00:13:02.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:02.152+0000 7f637d2c9640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f6378111b30 con 0x7f63781018b0 2024-08-19T00:13:02.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:02.152+0000 7f637d2c9640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6378111e30 con 0x7f63781078b0 2024-08-19T00:13:02.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:02.152+0000 7f63767fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6378102250 0x7f637819a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:02.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:02.152+0000 7f63767fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6378102250 0x7f637819a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35000/0 (socket says 172.21.15.44:35000) 2024-08-19T00:13:02.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:02.152+0000 7f63767fc640 1 -- 172.21.15.44:0/2234787705 learned_addr learned my addr 172.21.15.44:0/2234787705 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:02.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:02.152+0000 7f63777fe640 1 --2- 172.21.15.44:0/2234787705 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f63781078b0 0x7f637819ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:02.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:02.152+0000 7f6376ffd640 1 --2- 172.21.15.44:0/2234787705 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f63781018b0 0x7f637819a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:02.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:02.152+0000 7f63767fc640 1 -- 172.21.15.44:0/2234787705 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f63781078b0 msgr2=0x7f637819ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:02.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:02.152+0000 7f63767fc640 1 --2- 172.21.15.44:0/2234787705 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f63781078b0 0x7f637819ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:02.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:02.152+0000 7f63767fc640 1 -- 172.21.15.44:0/2234787705 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f63781018b0 msgr2=0x7f637819a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:02.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:02.152+0000 7f63767fc640 1 --2- 172.21.15.44:0/2234787705 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f63781018b0 0x7f637819a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:02.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:02.152+0000 7f63767fc640 1 -- 172.21.15.44:0/2234787705 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f637819f3e0 con 0x7f6378102250 2024-08-19T00:13:02.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:02.153+0000 7f63767fc640 1 --2- 172.21.15.44:0/2234787705 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6378102250 0x7f637819a970 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f636000d770 tx=0x7f636000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:02.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:02.153+0000 7f636ffff640 1 -- 172.21.15.44:0/2234787705 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6360017070 con 0x7f6378102250 2024-08-19T00:13:02.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:02.153+0000 7f637d2c9640 1 -- 172.21.15.44:0/2234787705 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f637819f6d0 con 0x7f6378102250 2024-08-19T00:13:02.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:02.153+0000 7f636ffff640 1 -- 172.21.15.44:0/2234787705 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6360005500 con 0x7f6378102250 2024-08-19T00:13:02.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:02.153+0000 7f636ffff640 1 -- 172.21.15.44:0/2234787705 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6360004e00 con 0x7f6378102250 2024-08-19T00:13:02.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:02.153+0000 7f637d2c9640 1 -- 172.21.15.44:0/2234787705 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63781a6fb0 con 0x7f6378102250 2024-08-19T00:13:02.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:02.154+0000 7f637d2c9640 1 -- 172.21.15.44:0/2234787705 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6378101d10 con 0x7f6378102250 2024-08-19T00:13:02.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:02.155+0000 7f636ffff640 1 -- 172.21.15.44:0/2234787705 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f6360004fa0 con 0x7f6378102250 2024-08-19T00:13:02.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:02.156+0000 7f636ffff640 1 --2- 172.21.15.44:0/2234787705 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f63640a2c10 0x7f63640a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:02.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:02.156+0000 7f6376ffd640 1 --2- 172.21.15.44:0/2234787705 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f63640a2c10 0x7f63640a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:02.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:02.156+0000 7f636ffff640 1 -- 172.21.15.44:0/2234787705 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9187+0+0 (secure 0 0 0) 0x7f63600cef70 con 0x7f6378102250 2024-08-19T00:13:02.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:02.156+0000 7f6376ffd640 1 --2- 172.21.15.44:0/2234787705 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f63640a2c10 0x7f63640a50d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6370006010 tx=0x7f6370009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:02.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:02.160+0000 7f636ffff640 1 -- 172.21.15.44:0/2234787705 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f636009b300 con 0x7f6378102250 2024-08-19T00:13:02.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:02.372+0000 7f637d2c9640 1 -- 172.21.15.44:0/2234787705 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f63781a71e0 con 0x7f6378102250 2024-08-19T00:13:02.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:02.373+0000 7f636ffff640 1 -- 172.21.15.44:0/2234787705 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11989 (secure 0 0 0) 0x7f636009f600 con 0x7f6378102250 2024-08-19T00:13:02.374 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:13:02.374 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":27,"btime":"2024-08-19T00:11:36:898699+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14511,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1538841896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1538841896},{"type":"v1","addr":"172.21.15.116:6833","nonce":1538841896}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/4044471606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4044471606},{"type":"v1","addr":"172.21.15.44:6835","nonce":4044471606}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-19T00:10:53.196636+0000","modified":"2024-08-19T00:11:36.898676+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24473,"mds_1":24446,"mds_2":24439,"mds_3":24431,"mds_4":24418},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14529":{"gid":14529,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6837/1824829052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1824829052},{"type":"v1","addr":"172.21.15.44:6837","nonce":1824829052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14577":{"gid":14577,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6839/3591739042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":3591739042},{"type":"v1","addr":"172.21.15.44:6839","nonce":3591739042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14589":{"gid":14589,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6841/3667695717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6840","nonce":3667695717},{"type":"v1","addr":"172.21.15.44:6841","nonce":3667695717}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24388":{"gid":24388,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1183022838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1183022838},{"type":"v1","addr":"172.21.15.171:6833","nonce":1183022838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6835/2190623851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":2190623851},{"type":"v1","addr":"172.21.15.171:6835","nonce":2190623851}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.171:6837/316231795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":316231795},{"type":"v1","addr":"172.21.15.171:6837","nonce":316231795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":20,"addr":"172.21.15.116:6835/3507399322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3507399322},{"type":"v1","addr":"172.21.15.116:6835","nonce":3507399322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.171:6839/1466585795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":1466585795},{"type":"v1","addr":"172.21.15.171:6839","nonce":1466585795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":17,"addr":"172.21.15.116:6837/2764513846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":2764513846},{"type":"v1","addr":"172.21.15.116:6837","nonce":2764513846}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.116:6839/1032741033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":1032741033},{"type":"v1","addr":"172.21.15.116:6839","nonce":1032741033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24446,24439,24431,24418]},"id":1}]} 2024-08-19T00:13:02.375 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 27 2024-08-19T00:13:02.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:02.375+0000 7f637d2c9640 1 -- 172.21.15.44:0/2234787705 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f63640a2c10 msgr2=0x7f63640a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:02.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:02.375+0000 7f637d2c9640 1 --2- 172.21.15.44:0/2234787705 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f63640a2c10 0x7f63640a50d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6370006010 tx=0x7f6370009360 comp rx=0 tx=0).stop 2024-08-19T00:13:02.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:02.375+0000 7f637d2c9640 1 -- 172.21.15.44:0/2234787705 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6378102250 msgr2=0x7f637819a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:02.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:02.375+0000 7f637d2c9640 1 --2- 172.21.15.44:0/2234787705 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6378102250 0x7f637819a970 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f636000d770 tx=0x7f636000dc30 comp rx=0 tx=0).stop 2024-08-19T00:13:02.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:02.375+0000 7f637d2c9640 1 -- 172.21.15.44:0/2234787705 shutdown_connections 2024-08-19T00:13:02.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:02.375+0000 7f637d2c9640 1 --2- 172.21.15.44:0/2234787705 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f63640a2c10 0x7f63640a50d0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:02.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:02.375+0000 7f637d2c9640 1 --2- 172.21.15.44:0/2234787705 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f63781078b0 0x7f637819ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:02.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:02.375+0000 7f637d2c9640 1 --2- 172.21.15.44:0/2234787705 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6378102250 0x7f637819a970 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:02.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:02.375+0000 7f637d2c9640 1 --2- 172.21.15.44:0/2234787705 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f63781018b0 0x7f637819a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:02.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:02.375+0000 7f637d2c9640 1 -- 172.21.15.44:0/2234787705 >> 172.21.15.44:0/2234787705 conn(0x7f63780fd5f0 msgr2=0x7f637810cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:02.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:02.375+0000 7f637d2c9640 1 -- 172.21.15.44:0/2234787705 shutdown_connections 2024-08-19T00:13:02.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:02.375+0000 7f637d2c9640 1 -- 172.21.15.44:0/2234787705 wait complete. 2024-08-19T00:13:02.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:02 smithi171 ceph-mon[21810]: pgmap v335: 129 pgs: 129 active+clean; 645 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-19T00:13:02.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:02 smithi116 ceph-mon[21873]: pgmap v335: 129 pgs: 129 active+clean; 645 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-19T00:13:02.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:02 smithi044 ceph-mon[18489]: pgmap v335: 129 pgs: 129 active+clean; 645 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-19T00:13:03.121 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-19T00:13:03.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:03 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/2234787705' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:13:03.383 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:13:03.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:03 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/2234787705' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:13:03.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:03 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/2234787705' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:13:03.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:03.826+0000 7f95f3c88640 1 -- 172.21.15.44:0/2014829641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95ec102250 msgr2=0x7f95ec10e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:03.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:03.826+0000 7f95f3c88640 1 --2- 172.21.15.44:0/2014829641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95ec102250 0x7f95ec10e780 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f95e4009cd0 tx=0x7f95e402a8e0 comp rx=0 tx=0).stop 2024-08-19T00:13:03.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:03.826+0000 7f95f3c88640 1 -- 172.21.15.44:0/2014829641 shutdown_connections 2024-08-19T00:13:03.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:03.826+0000 7f95f3c88640 1 --2- 172.21.15.44:0/2014829641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95ec102250 0x7f95ec10e780 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:03.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:03.826+0000 7f95f3c88640 1 --2- 172.21.15.44:0/2014829641 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f95ec1018b0 0x7f95ec101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:03.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:03.826+0000 7f95f3c88640 1 --2- 172.21.15.44:0/2014829641 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f95ec1078b0 0x7f95ec107c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:03.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:03.826+0000 7f95f3c88640 1 -- 172.21.15.44:0/2014829641 >> 172.21.15.44:0/2014829641 conn(0x7f95ec0fd5f0 msgr2=0x7f95ec0ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:03.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:03.826+0000 7f95f3c88640 1 -- 172.21.15.44:0/2014829641 shutdown_connections 2024-08-19T00:13:03.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:03.826+0000 7f95f3c88640 1 -- 172.21.15.44:0/2014829641 wait complete. 2024-08-19T00:13:03.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:03.827+0000 7f95f3c88640 1 Processor -- start 2024-08-19T00:13:03.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:03.827+0000 7f95f3c88640 1 -- start start 2024-08-19T00:13:03.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:03.827+0000 7f95f3c88640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f95ec1018b0 0x7f95ec10da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:03.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:03.827+0000 7f95f3c88640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95ec102250 0x7f95ec10dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:03.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:03.827+0000 7f95f3c88640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f95ec1078b0 0x7f95ec1a3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:03.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:03.827+0000 7f95f3c88640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f95ec111d00 con 0x7f95ec102250 2024-08-19T00:13:03.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:03.827+0000 7f95f3c88640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f95ec111b80 con 0x7f95ec1078b0 2024-08-19T00:13:03.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:03.827+0000 7f95f3c88640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f95ec111e80 con 0x7f95ec1018b0 2024-08-19T00:13:03.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:03.827+0000 7f95f1223640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95ec102250 0x7f95ec10dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:03.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:03.827+0000 7f95f1223640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95ec102250 0x7f95ec10dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35012/0 (socket says 172.21.15.44:35012) 2024-08-19T00:13:03.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:03.827+0000 7f95f1223640 1 -- 172.21.15.44:0/3697598116 learned_addr learned my addr 172.21.15.44:0/3697598116 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:03.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:03.828+0000 7f95f1a24640 1 --2- 172.21.15.44:0/3697598116 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f95ec1018b0 0x7f95ec10da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:03.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:03.828+0000 7f95f2225640 1 --2- 172.21.15.44:0/3697598116 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f95ec1078b0 0x7f95ec1a3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:03.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:03.828+0000 7f95f1223640 1 -- 172.21.15.44:0/3697598116 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f95ec1018b0 msgr2=0x7f95ec10da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:03.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:03.828+0000 7f95f1223640 1 --2- 172.21.15.44:0/3697598116 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f95ec1018b0 0x7f95ec10da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:03.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:03.828+0000 7f95f1223640 1 -- 172.21.15.44:0/3697598116 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f95ec1078b0 msgr2=0x7f95ec1a3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:03.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:03.828+0000 7f95f1223640 1 --2- 172.21.15.44:0/3697598116 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f95ec1078b0 0x7f95ec1a3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:03.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:03.828+0000 7f95f1223640 1 -- 172.21.15.44:0/3697598116 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95ec1a3700 con 0x7f95ec102250 2024-08-19T00:13:03.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:03.828+0000 7f95f1223640 1 --2- 172.21.15.44:0/3697598116 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95ec102250 0x7f95ec10dfb0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f95dc00c890 tx=0x7f95dc00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:03.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:03.828+0000 7f95e2ffd640 1 -- 172.21.15.44:0/3697598116 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95dc004220 con 0x7f95ec102250 2024-08-19T00:13:03.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:03.828+0000 7f95e2ffd640 1 -- 172.21.15.44:0/3697598116 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f95dc0043c0 con 0x7f95ec102250 2024-08-19T00:13:03.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:03.828+0000 7f95f3c88640 1 -- 172.21.15.44:0/3697598116 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95ec1a39f0 con 0x7f95ec102250 2024-08-19T00:13:03.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:03.828+0000 7f95e2ffd640 1 -- 172.21.15.44:0/3697598116 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95dc0049e0 con 0x7f95ec102250 2024-08-19T00:13:03.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:03.828+0000 7f95f3c88640 1 -- 172.21.15.44:0/3697598116 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95ec1ab2d0 con 0x7f95ec102250 2024-08-19T00:13:03.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:03.829+0000 7f95f3c88640 1 -- 172.21.15.44:0/3697598116 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95ec101d10 con 0x7f95ec102250 2024-08-19T00:13:03.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:03.830+0000 7f95e2ffd640 1 -- 172.21.15.44:0/3697598116 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f95dc0079b0 con 0x7f95ec102250 2024-08-19T00:13:03.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:03.831+0000 7f95e2ffd640 1 --2- 172.21.15.44:0/3697598116 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f95d80a2c10 0x7f95d80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:03.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:03.831+0000 7f95f1a24640 1 --2- 172.21.15.44:0/3697598116 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f95d80a2c10 0x7f95d80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:03.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:03.831+0000 7f95e2ffd640 1 -- 172.21.15.44:0/3697598116 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9187+0+0 (secure 0 0 0) 0x7f95dc0cf540 con 0x7f95ec102250 2024-08-19T00:13:03.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:03.831+0000 7f95f1a24640 1 --2- 172.21.15.44:0/3697598116 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f95d80a2c10 0x7f95d80a50d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f95e8005fd0 tx=0x7f95e800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:03.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:03.835+0000 7f95e2ffd640 1 -- 172.21.15.44:0/3697598116 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f95dc014030 con 0x7f95ec102250 2024-08-19T00:13:04.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:04.010+0000 7f95f3c88640 1 -- 172.21.15.44:0/3697598116 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f95ec1ab600 con 0x7f95ec102250 2024-08-19T00:13:04.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:04.012+0000 7f95e2ffd640 1 -- 172.21.15.44:0/3697598116 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) ==== 74+0+24799 (secure 0 0 0) 0x7f95dc09b930 con 0x7f95ec102250 2024-08-19T00:13:04.014 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:13:04.014 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":94,"fsid":"647ded64-5dbe-11ef-bccf-c7b262605968","created":"2024-08-19T00:03:43.667929+0000","modified":"2024-08-19T00:12:40.593724+0000","last_up_change":"2024-08-19T00:10:01.557590+0000","last_in_change":"2024-08-19T00:09:42.433933+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T00:06:42.706553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-19T00:10:48.735065+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-19T00:10:51.481810+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-19T00:10:58.013004+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b15ad904-d07d-4ecb-be8f-d99323425eed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":600251465},{"type":"v1","addr":"172.21.15.44:6803","nonce":600251465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":600251465},{"type":"v1","addr":"172.21.15.44:6805","nonce":600251465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":600251465},{"type":"v1","addr":"172.21.15.44:6809","nonce":600251465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":600251465},{"type":"v1","addr":"172.21.15.44:6807","nonce":600251465}]},"public_addr":"172.21.15.44:6803/600251465","cluster_addr":"172.21.15.44:6805/600251465","heartbeat_back_addr":"172.21.15.44:6809/600251465","heartbeat_front_addr":"172.21.15.44:6807/600251465","state":["exists","up"]},{"osd":1,"uuid":"8f70512f-21a3-4fec-8278-04b2bc9b2d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":613509556},{"type":"v1","addr":"172.21.15.116:6801","nonce":613509556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":613509556},{"type":"v1","addr":"172.21.15.116:6803","nonce":613509556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":613509556},{"type":"v1","addr":"172.21.15.116:6807","nonce":613509556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":613509556},{"type":"v1","addr":"172.21.15.116:6805","nonce":613509556}]},"public_addr":"172.21.15.116:6801/613509556","cluster_addr":"172.21.15.116:6803/613509556","heartbeat_back_addr":"172.21.15.116:6807/613509556","heartbeat_front_addr":"172.21.15.116:6805/613509556","state":["exists","up"]},{"osd":2,"uuid":"56994dfd-5fcf-4d82-addf-38764239d82a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2130938937},{"type":"v1","addr":"172.21.15.171:6801","nonce":2130938937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2130938937},{"type":"v1","addr":"172.21.15.171:6803","nonce":2130938937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2130938937},{"type":"v1","addr":"172.21.15.171:6807","nonce":2130938937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2130938937},{"type":"v1","addr":"172.21.15.171:6805","nonce":2130938937}]},"public_addr":"172.21.15.171:6801/2130938937","cluster_addr":"172.21.15.171:6803/2130938937","heartbeat_back_addr":"172.21.15.171:6807/2130938937","heartbeat_front_addr":"172.21.15.171:6805/2130938937","state":["exists","up"]},{"osd":3,"uuid":"6d2ddb19-74e0-4e68-b9ea-58b73fd1e9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":3537027669},{"type":"v1","addr":"172.21.15.44:6811","nonce":3537027669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":3537027669},{"type":"v1","addr":"172.21.15.44:6813","nonce":3537027669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3537027669},{"type":"v1","addr":"172.21.15.44:6817","nonce":3537027669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":3537027669},{"type":"v1","addr":"172.21.15.44:6815","nonce":3537027669}]},"public_addr":"172.21.15.44:6811/3537027669","cluster_addr":"172.21.15.44:6813/3537027669","heartbeat_back_addr":"172.21.15.44:6817/3537027669","heartbeat_front_addr":"172.21.15.44:6815/3537027669","state":["exists","up"]},{"osd":4,"uuid":"190d208e-ae54-497d-ad72-d07a5a26991b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":3768627455},{"type":"v1","addr":"172.21.15.116:6809","nonce":3768627455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":3768627455},{"type":"v1","addr":"172.21.15.116:6811","nonce":3768627455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":3768627455},{"type":"v1","addr":"172.21.15.116:6815","nonce":3768627455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":3768627455},{"type":"v1","addr":"172.21.15.116:6813","nonce":3768627455}]},"public_addr":"172.21.15.116:6809/3768627455","cluster_addr":"172.21.15.116:6811/3768627455","heartbeat_back_addr":"172.21.15.116:6815/3768627455","heartbeat_front_addr":"172.21.15.116:6813/3768627455","state":["exists","up"]},{"osd":5,"uuid":"d8afacad-6d3d-4703-9744-8d01ff2a2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":938785018},{"type":"v1","addr":"172.21.15.171:6809","nonce":938785018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":938785018},{"type":"v1","addr":"172.21.15.171:6811","nonce":938785018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":938785018},{"type":"v1","addr":"172.21.15.171:6815","nonce":938785018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":938785018},{"type":"v1","addr":"172.21.15.171:6813","nonce":938785018}]},"public_addr":"172.21.15.171:6809/938785018","cluster_addr":"172.21.15.171:6811/938785018","heartbeat_back_addr":"172.21.15.171:6815/938785018","heartbeat_front_addr":"172.21.15.171:6813/938785018","state":["exists","up"]},{"osd":6,"uuid":"55bf1f89-99e5-409d-99fa-f0124aa042df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":1219334797},{"type":"v1","addr":"172.21.15.44:6819","nonce":1219334797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":1219334797},{"type":"v1","addr":"172.21.15.44:6821","nonce":1219334797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":1219334797},{"type":"v1","addr":"172.21.15.44:6825","nonce":1219334797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":1219334797},{"type":"v1","addr":"172.21.15.44:6823","nonce":1219334797}]},"public_addr":"172.21.15.44:6819/1219334797","cluster_addr":"172.21.15.44:6821/1219334797","heartbeat_back_addr":"172.21.15.44:6825/1219334797","heartbeat_front_addr":"172.21.15.44:6823/1219334797","state":["exists","up"]},{"osd":7,"uuid":"70130d71-d28c-4a58-b603-75610c8d3ea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":3861873415},{"type":"v1","addr":"172.21.15.116:6817","nonce":3861873415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":3861873415},{"type":"v1","addr":"172.21.15.116:6819","nonce":3861873415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":3861873415},{"type":"v1","addr":"172.21.15.116:6823","nonce":3861873415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":3861873415},{"type":"v1","addr":"172.21.15.116:6821","nonce":3861873415}]},"public_addr":"172.21.15.116:6817/3861873415","cluster_addr":"172.21.15.116:6819/3861873415","heartbeat_back_addr":"172.21.15.116:6823/3861873415","heartbeat_front_addr":"172.21.15.116:6821/3861873415","state":["exists","up"]},{"osd":8,"uuid":"c5121f70-e423-4f86-a3c6-90945c9385f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":843701060},{"type":"v1","addr":"172.21.15.171:6817","nonce":843701060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":843701060},{"type":"v1","addr":"172.21.15.171:6819","nonce":843701060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":843701060},{"type":"v1","addr":"172.21.15.171:6823","nonce":843701060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":843701060},{"type":"v1","addr":"172.21.15.171:6821","nonce":843701060}]},"public_addr":"172.21.15.171:6817/843701060","cluster_addr":"172.21.15.171:6819/843701060","heartbeat_back_addr":"172.21.15.171:6823/843701060","heartbeat_front_addr":"172.21.15.171:6821/843701060","state":["exists","up"]},{"osd":9,"uuid":"cd13693a-0f25-47cc-b1a5-9c42481935ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3206550013},{"type":"v1","addr":"172.21.15.44:6827","nonce":3206550013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":3206550013},{"type":"v1","addr":"172.21.15.44:6829","nonce":3206550013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3206550013},{"type":"v1","addr":"172.21.15.44:6833","nonce":3206550013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3206550013},{"type":"v1","addr":"172.21.15.44:6831","nonce":3206550013}]},"public_addr":"172.21.15.44:6827/3206550013","cluster_addr":"172.21.15.44:6829/3206550013","heartbeat_back_addr":"172.21.15.44:6833/3206550013","heartbeat_front_addr":"172.21.15.44:6831/3206550013","state":["exists","up"]},{"osd":10,"uuid":"a36ffeb1-6ecf-4899-bdfa-18515afefb86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3034738363},{"type":"v1","addr":"172.21.15.116:6825","nonce":3034738363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3034738363},{"type":"v1","addr":"172.21.15.116:6827","nonce":3034738363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3034738363},{"type":"v1","addr":"172.21.15.116:6831","nonce":3034738363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3034738363},{"type":"v1","addr":"172.21.15.116:6829","nonce":3034738363}]},"public_addr":"172.21.15.116:6825/3034738363","cluster_addr":"172.21.15.116:6827/3034738363","heartbeat_back_addr":"172.21.15.116:6831/3034738363","heartbeat_front_addr":"172.21.15.116:6829/3034738363","state":["exists","up"]},{"osd":11,"uuid":"ffcf44a8-3094-4a29-822e-a6ce95da119e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1500842656},{"type":"v1","addr":"172.21.15.171:6825","nonce":1500842656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1500842656},{"type":"v1","addr":"172.21.15.171:6827","nonce":1500842656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1500842656},{"type":"v1","addr":"172.21.15.171:6831","nonce":1500842656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1500842656},{"type":"v1","addr":"172.21.15.171:6829","nonce":1500842656}]},"public_addr":"172.21.15.171:6825/1500842656","cluster_addr":"172.21.15.171:6827/1500842656","heartbeat_back_addr":"172.21.15.171:6831/1500842656","heartbeat_front_addr":"172.21.15.171:6829/1500842656","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:05:56.916127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:06:17.603805+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:06:38.642970+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:07:00.667062+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:07:22.542529+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:07:44.732304+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:08:07.050742+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:08:29.451498+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:08:52.222169+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:09:15.422629+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:09:37.295311+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:09:59.716431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":7}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9},{"from":5,"to":8}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6800/1300308907":"2024-08-20T00:04:38.392912+0000","172.21.15.44:0/1001446555":"2024-08-20T00:04:38.392912+0000","172.21.15.44:0/3800526625":"2024-08-20T00:04:38.392912+0000","172.21.15.44:6801/1300308907":"2024-08-20T00:04:38.392912+0000","172.21.15.44:0/3096491642":"2024-08-20T00:04:14.604141+0000","172.21.15.44:0/400419582":"2024-08-20T00:04:38.392912+0000","172.21.15.44:0/1869412718":"2024-08-20T00:04:14.604141+0000","172.21.15.44:6801/1374527587":"2024-08-20T00:04:14.604141+0000","172.21.15.44:0/911382683":"2024-08-20T00:04:14.604141+0000","172.21.15.44:6800/1374527587":"2024-08-20T00:04:14.604141+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:13:04.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:04.014+0000 7f95f3c88640 1 -- 172.21.15.44:0/3697598116 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f95d80a2c10 msgr2=0x7f95d80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:04.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:04.014+0000 7f95f3c88640 1 --2- 172.21.15.44:0/3697598116 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f95d80a2c10 0x7f95d80a50d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f95e8005fd0 tx=0x7f95e800b390 comp rx=0 tx=0).stop 2024-08-19T00:13:04.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:04.014+0000 7f95f3c88640 1 -- 172.21.15.44:0/3697598116 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95ec102250 msgr2=0x7f95ec10dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:04.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:04.014+0000 7f95f3c88640 1 --2- 172.21.15.44:0/3697598116 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95ec102250 0x7f95ec10dfb0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f95dc00c890 tx=0x7f95dc00cd50 comp rx=0 tx=0).stop 2024-08-19T00:13:04.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:04.014+0000 7f95f3c88640 1 -- 172.21.15.44:0/3697598116 shutdown_connections 2024-08-19T00:13:04.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:04.014+0000 7f95f3c88640 1 --2- 172.21.15.44:0/3697598116 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f95d80a2c10 0x7f95d80a50d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:04.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:04.014+0000 7f95f3c88640 1 --2- 172.21.15.44:0/3697598116 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f95ec1078b0 0x7f95ec1a3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:04.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:04.014+0000 7f95f3c88640 1 --2- 172.21.15.44:0/3697598116 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95ec102250 0x7f95ec10dfb0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:04.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:04.014+0000 7f95f3c88640 1 --2- 172.21.15.44:0/3697598116 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f95ec1018b0 0x7f95ec10da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:04.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:04.014+0000 7f95f3c88640 1 -- 172.21.15.44:0/3697598116 >> 172.21.15.44:0/3697598116 conn(0x7f95ec0fd5f0 msgr2=0x7f95ec0fdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:04.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:04.014+0000 7f95f3c88640 1 -- 172.21.15.44:0/3697598116 shutdown_connections 2024-08-19T00:13:04.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:04.014+0000 7f95f3c88640 1 -- 172.21.15.44:0/3697598116 wait complete. 2024-08-19T00:13:04.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:04 smithi171 ceph-mon[21810]: pgmap v336: 129 pgs: 129 active+clean; 645 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-19T00:13:04.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:04 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/3697598116' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-19T00:13:04.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:04 smithi116 ceph-mon[21873]: pgmap v336: 129 pgs: 129 active+clean; 645 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-19T00:13:04.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:04 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/3697598116' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-19T00:13:04.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:04 smithi044 ceph-mon[18489]: pgmap v336: 129 pgs: 129 active+clean; 645 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-19T00:13:04.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:04 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/3697598116' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-19T00:13:04.859 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-08-19T00:10:53.196636+0000', 'modified': '2024-08-19T00:11:36.898676+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24473, 'mds_1': 24446, 'mds_2': 24439, 'mds_3': 24431, 'mds_4': 24418}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14529': {'gid': 14529, 'name': 'd', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.44:6837/1824829052', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6836', 'nonce': 1824829052}, {'type': 'v1', 'addr': '172.21.15.44:6837', 'nonce': 1824829052}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14577': {'gid': 14577, 'name': 'g', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.44:6839/3591739042', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6838', 'nonce': 3591739042}, {'type': 'v1', 'addr': '172.21.15.44:6839', 'nonce': 3591739042}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14589': {'gid': 14589, 'name': 'a', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.44:6841/3667695717', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6840', 'nonce': 3667695717}, {'type': 'v1', 'addr': '172.21.15.44:6841', 'nonce': 3667695717}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24388': {'gid': 24388, 'name': 'l', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.171:6833/1183022838', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6832', 'nonce': 1183022838}, {'type': 'v1', 'addr': '172.21.15.171:6833', 'nonce': 1183022838}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24412': {'gid': 24412, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.171:6835/2190623851', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6834', 'nonce': 2190623851}, {'type': 'v1', 'addr': '172.21.15.171:6835', 'nonce': 2190623851}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24418': {'gid': 24418, 'name': 'c', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 19, 'addr': '172.21.15.171:6837/316231795', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6836', 'nonce': 316231795}, {'type': 'v1', 'addr': '172.21.15.171:6837', 'nonce': 316231795}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24431': {'gid': 24431, 'name': 'e', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 20, 'addr': '172.21.15.116:6835/3507399322', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6834', 'nonce': 3507399322}, {'type': 'v1', 'addr': '172.21.15.116:6835', 'nonce': 3507399322}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24439': {'gid': 24439, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.171:6839/1466585795', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6838', 'nonce': 1466585795}, {'type': 'v1', 'addr': '172.21.15.171:6839', 'nonce': 1466585795}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24446': {'gid': 24446, 'name': 'h', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.116:6837/2764513846', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6836', 'nonce': 2764513846}, {'type': 'v1', 'addr': '172.21.15.116:6837', 'nonce': 2764513846}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24473': {'gid': 24473, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.116:6839/1032741033', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6838', 'nonce': 1032741033}, {'type': 'v1', 'addr': '172.21.15.116:6839', 'nonce': 1032741033}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24473, 'qdb_cluster': [24473, 24446, 24439, 24431, 24418]} 2024-08-19T00:13:04.859 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-08-19T00:13:04.860 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph tell mds.c status 2024-08-19T00:13:05.118 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:13:05.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.545+0000 7f3708a77640 1 -- 172.21.15.44:0/1130463814 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37041018b0 msgr2=0x7f3704101d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:05.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.545+0000 7f3708a77640 1 --2- 172.21.15.44:0/1130463814 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37041018b0 0x7f3704101d10 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f36f8009930 tx=0x7f36f802a420 comp rx=0 tx=0).stop 2024-08-19T00:13:05.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.545+0000 7f3708a77640 1 -- 172.21.15.44:0/1130463814 shutdown_connections 2024-08-19T00:13:05.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.545+0000 7f3708a77640 1 --2- 172.21.15.44:0/1130463814 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3704102250 0x7f370410e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:05.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.545+0000 7f3708a77640 1 --2- 172.21.15.44:0/1130463814 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37041018b0 0x7f3704101d10 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:05.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.545+0000 7f3708a77640 1 --2- 172.21.15.44:0/1130463814 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f37041078b0 0x7f3704107c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:05.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.545+0000 7f3708a77640 1 -- 172.21.15.44:0/1130463814 >> 172.21.15.44:0/1130463814 conn(0x7f37040fd5f0 msgr2=0x7f37040ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:05.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.545+0000 7f3708a77640 1 -- 172.21.15.44:0/1130463814 shutdown_connections 2024-08-19T00:13:05.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.545+0000 7f3708a77640 1 -- 172.21.15.44:0/1130463814 wait complete. 2024-08-19T00:13:05.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.546+0000 7f3708a77640 1 Processor -- start 2024-08-19T00:13:05.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.546+0000 7f3708a77640 1 -- start start 2024-08-19T00:13:05.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.546+0000 7f3708a77640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f37041018b0 0x7f3704074220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:05.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.546+0000 7f3708a77640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3704102250 0x7f3704074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:05.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.546+0000 7f3708a77640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37041078b0 0x7f3704074ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:05.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.546+0000 7f3708a77640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3704111d20 con 0x7f37041078b0 2024-08-19T00:13:05.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.546+0000 7f3708a77640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f3704111ba0 con 0x7f37041018b0 2024-08-19T00:13:05.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.546+0000 7f3708a77640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f3704111ea0 con 0x7f3704102250 2024-08-19T00:13:05.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.546+0000 7f3702d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37041078b0 0x7f3704074ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:05.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.546+0000 7f3702d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37041078b0 0x7f3704074ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35042/0 (socket says 172.21.15.44:35042) 2024-08-19T00:13:05.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.546+0000 7f3702d9d640 1 -- 172.21.15.44:0/1924328902 learned_addr learned my addr 172.21.15.44:0/1924328902 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:05.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.546+0000 7f370259c640 1 --2- 172.21.15.44:0/1924328902 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f37041018b0 0x7f3704074220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:05.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.547+0000 7f3701d9b640 1 --2- 172.21.15.44:0/1924328902 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3704102250 0x7f3704074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:05.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.547+0000 7f3702d9d640 1 -- 172.21.15.44:0/1924328902 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3704102250 msgr2=0x7f3704074760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:05.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.547+0000 7f3702d9d640 1 --2- 172.21.15.44:0/1924328902 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3704102250 0x7f3704074760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:05.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.547+0000 7f3702d9d640 1 -- 172.21.15.44:0/1924328902 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f37041018b0 msgr2=0x7f3704074220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:05.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.547+0000 7f3702d9d640 1 --2- 172.21.15.44:0/1924328902 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f37041018b0 0x7f3704074220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:05.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.547+0000 7f3702d9d640 1 -- 172.21.15.44:0/1924328902 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37041a6680 con 0x7f37041078b0 2024-08-19T00:13:05.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.547+0000 7f3702d9d640 1 --2- 172.21.15.44:0/1924328902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37041078b0 0x7f3704074ca0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f36fc00c970 tx=0x7f36fc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:05.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.547+0000 7f36f37fe640 1 -- 172.21.15.44:0/1924328902 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36fc007bb0 con 0x7f37041078b0 2024-08-19T00:13:05.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.547+0000 7f36f37fe640 1 -- 172.21.15.44:0/1924328902 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f36fc007d50 con 0x7f37041078b0 2024-08-19T00:13:05.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.547+0000 7f3708a77640 1 -- 172.21.15.44:0/1924328902 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37041a6970 con 0x7f37041078b0 2024-08-19T00:13:05.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.547+0000 7f36f37fe640 1 -- 172.21.15.44:0/1924328902 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36fc018800 con 0x7f37041078b0 2024-08-19T00:13:05.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.547+0000 7f3708a77640 1 -- 172.21.15.44:0/1924328902 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37041a6e30 con 0x7f37041078b0 2024-08-19T00:13:05.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.550+0000 7f370ae75740 1 Processor -- start 2024-08-19T00:13:05.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.550+0000 7f36f37fe640 1 -- 172.21.15.44:0/1924328902 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f36fc00fa50 con 0x7f37041078b0 2024-08-19T00:13:05.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.550+0000 7f370ae75740 1 -- start start 2024-08-19T00:13:05.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.550+0000 7f370ae75740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5583744ad630 0x5583744ada10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:05.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.550+0000 7f370ae75740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583744adf50 0x5583744b82d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:05.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.550+0000 7f370ae75740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5583744b8810 0x5583744bac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:05.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.550+0000 7f370ae75740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x558374412710 con 0x5583744adf50 2024-08-19T00:13:05.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.550+0000 7f370ae75740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5583743aa770 con 0x5583744ad630 2024-08-19T00:13:05.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.550+0000 7f370ae75740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55837440e6d0 con 0x5583744b8810 2024-08-19T00:13:05.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.550+0000 7f370259c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583744adf50 0x5583744b82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:05.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.550+0000 7f370259c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583744adf50 0x5583744b82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35046/0 (socket says 172.21.15.44:35046) 2024-08-19T00:13:05.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.550+0000 7f370259c640 1 -- 172.21.15.44:0/1645856326 learned_addr learned my addr 172.21.15.44:0/1645856326 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:05.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.550+0000 7f36f37fe640 1 --2- 172.21.15.44:0/1924328902 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f36ec0a2c10 0x7f36ec0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:05.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.550+0000 7f3701d9b640 1 --2- 172.21.15.44:0/1645856326 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5583744ad630 0x5583744ada10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:05.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.551+0000 7f3702d9d640 1 --2- 172.21.15.44:0/1924328902 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f36ec0a2c10 0x7f36ec0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:05.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.551+0000 7f370259c640 1 -- 172.21.15.44:0/1645856326 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5583744b8810 msgr2=0x5583744bac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:05.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.551+0000 7f370259c640 1 --2- 172.21.15.44:0/1645856326 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5583744b8810 0x5583744bac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:05.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.551+0000 7f370259c640 1 -- 172.21.15.44:0/1645856326 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5583744ad630 msgr2=0x5583744ada10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:05.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.551+0000 7f370259c640 1 --2- 172.21.15.44:0/1645856326 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5583744ad630 0x5583744ada10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:05.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.551+0000 7f370259c640 1 -- 172.21.15.44:0/1645856326 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583743b13e0 con 0x5583744adf50 2024-08-19T00:13:05.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.551+0000 7f36f37fe640 1 -- 172.21.15.44:0/1924328902 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9187+0+0 (secure 0 0 0) 0x7f36fc0cf520 con 0x7f37041078b0 2024-08-19T00:13:05.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.551+0000 7f370259c640 1 --2- 172.21.15.44:0/1645856326 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583744adf50 0x5583744b82d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f36f400a4b0 tx=0x7f36f40096d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5df3dff9f41d133c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:05.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.551+0000 7f3702d9d640 1 --2- 172.21.15.44:0/1924328902 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f36ec0a2c10 0x7f36ec0a50d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f36fc09b7f0 tx=0x7f36fc0973e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:05.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.551+0000 7f36f0ff9640 1 -- 172.21.15.44:0/1645856326 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f4018020 con 0x5583744adf50 2024-08-19T00:13:05.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.551+0000 7f36f0ff9640 1 -- 172.21.15.44:0/1645856326 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f36f4014cf0 con 0x5583744adf50 2024-08-19T00:13:05.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.551+0000 7f36f0ff9640 1 -- 172.21.15.44:0/1645856326 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f4013db0 con 0x5583744adf50 2024-08-19T00:13:05.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.552+0000 7f370ae75740 1 -- 172.21.15.44:0/1645856326 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583744adf50 msgr2=0x5583744b82d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:05.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.552+0000 7f370ae75740 1 --2- 172.21.15.44:0/1645856326 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583744adf50 0x5583744b82d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f36f400a4b0 tx=0x7f36f40096d0 comp rx=0 tx=0).stop 2024-08-19T00:13:05.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.552+0000 7f370ae75740 1 -- 172.21.15.44:0/1645856326 shutdown_connections 2024-08-19T00:13:05.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.552+0000 7f370ae75740 1 --2- 172.21.15.44:0/1645856326 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5583744b8810 0x5583744bac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:05.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.552+0000 7f370ae75740 1 --2- 172.21.15.44:0/1645856326 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583744adf50 0x5583744b82d0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:05.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.552+0000 7f370ae75740 1 --2- 172.21.15.44:0/1645856326 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5583744ad630 0x5583744ada10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:05.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.552+0000 7f370ae75740 1 -- 172.21.15.44:0/1645856326 >> 172.21.15.44:0/1645856326 conn(0x5583744a9bc0 msgr2=0x5583744a9fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:05.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.552+0000 7f370ae75740 1 -- 172.21.15.44:0/1645856326 shutdown_connections 2024-08-19T00:13:05.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.552+0000 7f370ae75740 1 -- 172.21.15.44:0/1645856326 wait complete. 2024-08-19T00:13:05.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.552+0000 7f370ae75740 1 -- start start 2024-08-19T00:13:05.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.553+0000 7f370ae75740 1 Processor -- start 2024-08-19T00:13:05.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.553+0000 7f370ae75740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583744ad630 0x5583744b5720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:05.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.553+0000 7f370ae75740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5583744adf50 0x5583744b5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:05.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.553+0000 7f370ae75740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5583744b8810 0x5583744b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:05.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.553+0000 7f370ae75740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5583744bb3e0 con 0x5583744ad630 2024-08-19T00:13:05.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.553+0000 7f370ae75740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5583743cd970 con 0x5583744b8810 2024-08-19T00:13:05.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.553+0000 7f370ae75740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5583744bb560 con 0x5583744adf50 2024-08-19T00:13:05.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.553+0000 7f370ae75740 10 client.0 _ll_register_callbacks cb 0x5583741217b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:13:05.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.553+0000 7f3701d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583744ad630 0x5583744b5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:05.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.553+0000 7f3701d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583744ad630 0x5583744b5720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35060/0 (socket says 172.21.15.44:35060) 2024-08-19T00:13:05.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.553+0000 7f3701d9b640 1 -- 172.21.15.44:0/4161630950 learned_addr learned my addr 172.21.15.44:0/4161630950 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:05.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.553+0000 7f370259c640 1 --2- 172.21.15.44:0/4161630950 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5583744adf50 0x5583744b5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:05.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.553+0000 7f3701d9b640 1 -- 172.21.15.44:0/4161630950 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5583744adf50 msgr2=0x5583744b5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:05.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.553+0000 7f3701d9b640 1 --2- 172.21.15.44:0/4161630950 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5583744adf50 0x5583744b5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:05.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.553+0000 7f3701d9b640 1 -- 172.21.15.44:0/4161630950 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5583744b8810 msgr2=0x5583744b61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:05.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.553+0000 7f3701d9b640 1 --2- 172.21.15.44:0/4161630950 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5583744b8810 0x5583744b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:05.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.553+0000 7f3701d9b640 1 -- 172.21.15.44:0/4161630950 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583741842b0 con 0x5583744ad630 2024-08-19T00:13:05.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.553+0000 7f3701d9b640 1 --2- 172.21.15.44:0/4161630950 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583744ad630 0x5583744b5720 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f36f8009930 tx=0x7f36f80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f95d64addf87f638 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:05.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.553+0000 7f36e9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:13:05.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.553+0000 7f36e9ffb640 1 -- 172.21.15.44:0/4161630950 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f8035040 con 0x5583744ad630 2024-08-19T00:13:05.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.554+0000 7f370ae75740 1 -- 172.21.15.44:0/4161630950 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36f4014cf0 con 0x5583744ad630 2024-08-19T00:13:05.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.554+0000 7f36e9ffb640 1 -- 172.21.15.44:0/4161630950 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9187+0+0 (secure 0 0 0) 0x7f36f8003b40 con 0x5583744ad630 2024-08-19T00:13:05.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.554+0000 7f36e9ffb640 1 -- 172.21.15.44:0/4161630950 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f36f804e050 con 0x5583744ad630 2024-08-19T00:13:05.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.554+0000 7f370ae75740 10 client.15195 fetch_fsmap learned FSMap version 27 2024-08-19T00:13:05.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.554+0000 7f370ae75740 1 -- 172.21.15.44:0/4161630950 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5583744c7010 con 0x5583744ad630 2024-08-19T00:13:05.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.554+0000 7f36e9ffb640 1 -- 172.21.15.44:0/4161630950 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f36f4014cf0 con 0x5583744ad630 2024-08-19T00:13:05.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.554+0000 7f36e9ffb640 1 -- 172.21.15.44:0/4161630950 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f36f803b550 con 0x5583744ad630 2024-08-19T00:13:05.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.554+0000 7f370ae75740 10 client.15195 fetch_fsmap finished waiting for FSMap version 27 2024-08-19T00:13:05.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.554+0000 7f370ae75740 10 client.15195 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-19T00:13:05.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.554+0000 7f370ae75740 20 client.15195 populate_metadata read hostname 'smithi044' 2024-08-19T00:13:05.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.554+0000 7f370ae75740 1 --2- 172.21.15.44:0/4161630950 >> [v2:172.21.15.171:6836/316231795,v1:172.21.15.171:6837/316231795] conn(0x5583744c9630 0x5583744caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:05.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.554+0000 7f370ae75740 4 client.15195 mds_command: new command op to 24418 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:13:05.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.554+0000 7f370ae75740 1 -- 172.21.15.44:0/4161630950 --> [v2:172.21.15.171:6836/316231795,v1:172.21.15.171:6837/316231795] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55837441fc80 con 0x5583744c9630 2024-08-19T00:13:05.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.554+0000 7f370259c640 1 --2- 172.21.15.44:0/4161630950 >> [v2:172.21.15.171:6836/316231795,v1:172.21.15.171:6837/316231795] conn(0x5583744c9630 0x5583744caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:05.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.555+0000 7f370259c640 1 --2- 172.21.15.44:0/4161630950 >> [v2:172.21.15.171:6836/316231795,v1:172.21.15.171:6837/316231795] conn(0x5583744c9630 0x5583744caaa0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=60f93d1a9251e4e0 server_cookie=abe9c98253b4c4c1 in_seq=0 out_seq=0 2024-08-19T00:13:05.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.555+0000 7f36e9ffb640 10 client.15195 ms_handle_connect on v2:172.21.15.171:6836/316231795 2024-08-19T00:13:05.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.556+0000 7f36e9ffb640 1 -- 172.21.15.44:0/4161630950 <== mds.4 v2:172.21.15.171:6836/316231795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55837441fc80 con 0x5583744c9630 2024-08-19T00:13:05.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.556+0000 7f36e9ffb640 10 client.15195 handle_command_reply: tid=0 2024-08-19T00:13:05.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.556+0000 7f370ae75740 1 client.15195 shutdown 2024-08-19T00:13:05.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.556+0000 7f370ae75740 1 -- 172.21.15.44:0/4161630950 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583744ad630 msgr2=0x5583744b5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:05.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.556+0000 7f370ae75740 1 --2- 172.21.15.44:0/4161630950 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583744ad630 0x5583744b5720 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f36f8009930 tx=0x7f36f80045e0 comp rx=0 tx=0).stop 2024-08-19T00:13:05.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.556+0000 7f370ae75740 1 -- 172.21.15.44:0/4161630950 shutdown_connections 2024-08-19T00:13:05.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.556+0000 7f370ae75740 1 --2- 172.21.15.44:0/4161630950 >> [v2:172.21.15.171:6836/316231795,v1:172.21.15.171:6837/316231795] conn(0x5583744c9630 0x5583744caaa0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:05.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.556+0000 7f370ae75740 1 --2- 172.21.15.44:0/4161630950 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5583744adf50 0x5583744b5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:05.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.556+0000 7f370ae75740 1 --2- 172.21.15.44:0/4161630950 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5583744b8810 0x5583744b61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:05.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.556+0000 7f36e9ffb640 0 client.15195 ms_handle_reset on v2:172.21.15.171:6836/316231795 2024-08-19T00:13:05.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.556+0000 7f370ae75740 1 --2- 172.21.15.44:0/4161630950 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583744ad630 0x5583744b5720 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:05.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.556+0000 7f370ae75740 1 -- 172.21.15.44:0/4161630950 >> 172.21.15.44:0/4161630950 conn(0x5583744a9bc0 msgr2=0x5583744a8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:05.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.556+0000 7f370ae75740 1 -- 172.21.15.44:0/4161630950 shutdown_connections 2024-08-19T00:13:05.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.556+0000 7f370ae75740 1 -- 172.21.15.44:0/4161630950 wait complete. 2024-08-19T00:13:05.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.556+0000 7f370ae75740 20 client.15195 trim_cache size 0 max 16384 2024-08-19T00:13:05.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.574+0000 7f370ae75740 1 Processor -- start 2024-08-19T00:13:05.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.574+0000 7f370ae75740 1 -- start start 2024-08-19T00:13:05.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.575+0000 7f370ae75740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5583744ad630 0x5583744b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:05.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.575+0000 7f370ae75740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5583744adf50 0x5583744b2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:05.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.575+0000 7f370ae75740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583744b8810 0x5583744b2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:05.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.575+0000 7f370ae75740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5583744c8de0 con 0x5583744b8810 2024-08-19T00:13:05.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.575+0000 7f370ae75740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5583744c94b0 con 0x5583744ad630 2024-08-19T00:13:05.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.575+0000 7f370ae75740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5583744c9b80 con 0x5583744adf50 2024-08-19T00:13:05.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.575+0000 7f3701d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583744b8810 0x5583744b2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:05.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.575+0000 7f3701d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583744b8810 0x5583744b2ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35068/0 (socket says 172.21.15.44:35068) 2024-08-19T00:13:05.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.575+0000 7f3701d9b640 1 -- 172.21.15.44:0/1641339690 learned_addr learned my addr 172.21.15.44:0/1641339690 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:05.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.575+0000 7f3701d9b640 1 --2- 172.21.15.44:0/1641339690 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5583744ad630 0x5583744b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:05.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.575+0000 7f3701d9b640 1 -- 172.21.15.44:0/1641339690 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5583744adf50 msgr2=0x5583744b2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:05.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.575+0000 7f3701d9b640 1 --2- 172.21.15.44:0/1641339690 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5583744adf50 0x5583744b2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:05.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.575+0000 7f3701d9b640 1 -- 172.21.15.44:0/1641339690 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5583744ad630 msgr2=0x5583744b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:05.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.575+0000 7f3701d9b640 1 --2- 172.21.15.44:0/1641339690 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5583744ad630 0x5583744b00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:05.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.575+0000 7f3701d9b640 1 -- 172.21.15.44:0/1641339690 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583744ad460 con 0x5583744b8810 2024-08-19T00:13:05.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.575+0000 7f3701d9b640 1 --2- 172.21.15.44:0/1641339690 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583744b8810 0x5583744b2ec0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f36f8009900 tx=0x7f36f8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65cd2472e6f4d143 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:05.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.575+0000 7f36ebfff640 1 -- 172.21.15.44:0/1641339690 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f8035070 con 0x5583744b8810 2024-08-19T00:13:05.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.575+0000 7f36ebfff640 1 -- 172.21.15.44:0/1641339690 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f36f8003e20 con 0x5583744b8810 2024-08-19T00:13:05.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.575+0000 7f36ebfff640 1 -- 172.21.15.44:0/1641339690 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f80047a0 con 0x5583744b8810 2024-08-19T00:13:05.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.576+0000 7f370ae75740 1 -- 172.21.15.44:0/1641339690 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583744b8810 msgr2=0x5583744b2ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:05.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.576+0000 7f370ae75740 1 --2- 172.21.15.44:0/1641339690 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583744b8810 0x5583744b2ec0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f36f8009900 tx=0x7f36f8000bc0 comp rx=0 tx=0).stop 2024-08-19T00:13:05.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.576+0000 7f370ae75740 1 -- 172.21.15.44:0/1641339690 shutdown_connections 2024-08-19T00:13:05.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.576+0000 7f370ae75740 1 --2- 172.21.15.44:0/1641339690 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5583744adf50 0x5583744b2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:05.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.576+0000 7f370ae75740 1 --2- 172.21.15.44:0/1641339690 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583744b8810 0x5583744b2ec0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:05.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.576+0000 7f370ae75740 1 --2- 172.21.15.44:0/1641339690 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5583744ad630 0x5583744b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:05.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.576+0000 7f370ae75740 1 -- 172.21.15.44:0/1641339690 >> 172.21.15.44:0/1641339690 conn(0x5583744a9bc0 msgr2=0x5583744b3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:05.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.576+0000 7f370ae75740 1 -- 172.21.15.44:0/1641339690 shutdown_connections 2024-08-19T00:13:05.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.576+0000 7f370ae75740 1 -- 172.21.15.44:0/1641339690 wait complete. 2024-08-19T00:13:05.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.576+0000 7f370ae75740 1 -- start start 2024-08-19T00:13:05.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.576+0000 7f370ae75740 1 Processor -- start 2024-08-19T00:13:05.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.577+0000 7f370ae75740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5583744ad630 0x5583744d3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:05.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.577+0000 7f370ae75740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5583744adf50 0x5583744cc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:05.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.577+0000 7f370ae75740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583744b8810 0x5583744cd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:05.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.577+0000 7f370ae75740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5583744ca920 con 0x5583744b8810 2024-08-19T00:13:05.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.577+0000 7f370ae75740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5583744ca250 con 0x5583744ad630 2024-08-19T00:13:05.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.577+0000 7f370ae75740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5583744caff0 con 0x5583744adf50 2024-08-19T00:13:05.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.577+0000 7f370ae75740 10 client.0 _ll_register_callbacks cb 0x7f36f8009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:13:05.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.577+0000 7f3701d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583744b8810 0x5583744cd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:05.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.577+0000 7f3701d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583744b8810 0x5583744cd090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35084/0 (socket says 172.21.15.44:35084) 2024-08-19T00:13:05.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.577+0000 7f3701d9b640 1 -- 172.21.15.44:0/2109446161 learned_addr learned my addr 172.21.15.44:0/2109446161 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:05.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.577+0000 7f3701d9b640 1 --2- 172.21.15.44:0/2109446161 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5583744ad630 0x5583744d3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:05.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.577+0000 7f370259c640 1 --2- 172.21.15.44:0/2109446161 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5583744adf50 0x5583744cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:05.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.577+0000 7f3701d9b640 1 -- 172.21.15.44:0/2109446161 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5583744adf50 msgr2=0x5583744cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:05.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.577+0000 7f3701d9b640 1 --2- 172.21.15.44:0/2109446161 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5583744adf50 0x5583744cc950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:05.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.577+0000 7f3701d9b640 1 -- 172.21.15.44:0/2109446161 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5583744ad630 msgr2=0x5583744d3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:05.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.577+0000 7f3701d9b640 1 --2- 172.21.15.44:0/2109446161 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5583744ad630 0x5583744d3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:05.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.577+0000 7f3701d9b640 1 -- 172.21.15.44:0/2109446161 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583744a5130 con 0x5583744b8810 2024-08-19T00:13:05.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.577+0000 7f3701d9b640 1 --2- 172.21.15.44:0/2109446161 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583744b8810 0x5583744cd090 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f36f802a940 tx=0x7f36f802ab60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc9843206e60de21 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:05.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.577+0000 7f36e9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:13:05.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.577+0000 7f36e9ffb640 1 -- 172.21.15.44:0/2109446161 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f8035070 con 0x5583744b8810 2024-08-19T00:13:05.621 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-08-19T00:13:05.621 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "647ded64-5dbe-11ef-bccf-c7b262605968", 2024-08-19T00:13:05.621 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 4, 2024-08-19T00:13:05.621 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 24418, 2024-08-19T00:13:05.622 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-08-19T00:13:05.622 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-08-19T00:13:05.622 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-08-19T00:13:05.622 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 89.687582331000002, 2024-08-19T00:13:05.622 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 27, 2024-08-19T00:13:05.622 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 94, 2024-08-19T00:13:05.622 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 90, 2024-08-19T00:13:05.622 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 158.25108224300001 2024-08-19T00:13:05.622 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-08-19T00:13:05.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.578+0000 7f370ae75740 1 -- 172.21.15.44:0/2109446161 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36f8003e20 con 0x5583744b8810 2024-08-19T00:13:05.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.578+0000 7f36e9ffb640 1 -- 172.21.15.44:0/2109446161 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9187+0+0 (secure 0 0 0) 0x7f36f803b640 con 0x5583744b8810 2024-08-19T00:13:05.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.578+0000 7f36e9ffb640 1 -- 172.21.15.44:0/2109446161 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f36f8003940 con 0x5583744b8810 2024-08-19T00:13:05.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.578+0000 7f370ae75740 10 client.15201 fetch_fsmap learned FSMap version 27 2024-08-19T00:13:05.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.578+0000 7f370ae75740 1 -- 172.21.15.44:0/2109446161 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558374533d40 con 0x5583744b8810 2024-08-19T00:13:05.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.578+0000 7f36e9ffb640 1 -- 172.21.15.44:0/2109446161 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f36f8003e20 con 0x5583744b8810 2024-08-19T00:13:05.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.578+0000 7f36e9ffb640 1 -- 172.21.15.44:0/2109446161 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f36f8062450 con 0x5583744b8810 2024-08-19T00:13:05.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.578+0000 7f370ae75740 10 client.15201 fetch_fsmap finished waiting for FSMap version 27 2024-08-19T00:13:05.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.578+0000 7f370ae75740 10 client.15201 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-19T00:13:05.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.578+0000 7f370ae75740 20 client.15201 populate_metadata read hostname 'smithi044' 2024-08-19T00:13:05.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.578+0000 7f370ae75740 1 --2- 172.21.15.44:0/2109446161 >> [v2:172.21.15.171:6836/316231795,v1:172.21.15.171:6837/316231795] conn(0x558374538590 0x5583745372a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:05.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.578+0000 7f370ae75740 4 client.15201 mds_command: new command op to 24418 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-19T00:13:05.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.578+0000 7f370ae75740 1 -- 172.21.15.44:0/2109446161 --> [v2:172.21.15.171:6836/316231795,v1:172.21.15.171:6837/316231795] -- command(tid 0: {"prefix": "status"}) -- 0x55837441a190 con 0x558374538590 2024-08-19T00:13:05.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.578+0000 7f370259c640 1 --2- 172.21.15.44:0/2109446161 >> [v2:172.21.15.171:6836/316231795,v1:172.21.15.171:6837/316231795] conn(0x558374538590 0x5583745372a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:05.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.579+0000 7f370259c640 1 --2- 172.21.15.44:0/2109446161 >> [v2:172.21.15.171:6836/316231795,v1:172.21.15.171:6837/316231795] conn(0x558374538590 0x5583745372a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=377d6a1d378f464 server_cookie=d9db88ba5070a71 in_seq=0 out_seq=0 2024-08-19T00:13:05.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.579+0000 7f36e9ffb640 10 client.15201 ms_handle_connect on v2:172.21.15.171:6836/316231795 2024-08-19T00:13:05.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.579+0000 7f36e9ffb640 1 -- 172.21.15.44:0/2109446161 <== mds.4 v2:172.21.15.171:6836/316231795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55837441a190 con 0x558374538590 2024-08-19T00:13:05.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.579+0000 7f36e9ffb640 10 client.15201 handle_command_reply: tid=0 2024-08-19T00:13:05.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.579+0000 7f370ae75740 1 client.15201 shutdown 2024-08-19T00:13:05.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.579+0000 7f370ae75740 1 -- 172.21.15.44:0/2109446161 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583744b8810 msgr2=0x5583744cd090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:05.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.579+0000 7f370ae75740 1 --2- 172.21.15.44:0/2109446161 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583744b8810 0x5583744cd090 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f36f802a940 tx=0x7f36f802ab60 comp rx=0 tx=0).stop 2024-08-19T00:13:05.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.579+0000 7f370ae75740 1 -- 172.21.15.44:0/2109446161 shutdown_connections 2024-08-19T00:13:05.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.579+0000 7f370ae75740 1 --2- 172.21.15.44:0/2109446161 >> [v2:172.21.15.171:6836/316231795,v1:172.21.15.171:6837/316231795] conn(0x558374538590 0x5583745372a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:05.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.579+0000 7f370ae75740 1 --2- 172.21.15.44:0/2109446161 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5583744adf50 0x5583744cc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:05.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.579+0000 7f370ae75740 1 --2- 172.21.15.44:0/2109446161 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5583744b8810 0x5583744cd090 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:05.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.579+0000 7f36e9ffb640 0 client.15201 ms_handle_reset on v2:172.21.15.171:6836/316231795 2024-08-19T00:13:05.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.579+0000 7f370ae75740 1 --2- 172.21.15.44:0/2109446161 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5583744ad630 0x5583744d3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:05.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.579+0000 7f370ae75740 1 -- 172.21.15.44:0/2109446161 >> 172.21.15.44:0/2109446161 conn(0x5583744a9bc0 msgr2=0x5583744b43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:05.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.579+0000 7f370ae75740 1 -- 172.21.15.44:0/2109446161 shutdown_connections 2024-08-19T00:13:05.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.579+0000 7f370ae75740 1 -- 172.21.15.44:0/2109446161 wait complete. 2024-08-19T00:13:05.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.579+0000 7f370ae75740 20 client.15201 trim_cache size 0 max 16384 2024-08-19T00:13:05.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.580+0000 7f3708a77640 1 -- 172.21.15.44:0/1924328902 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f36ec0a2c10 msgr2=0x7f36ec0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:05.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.580+0000 7f3708a77640 1 --2- 172.21.15.44:0/1924328902 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f36ec0a2c10 0x7f36ec0a50d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f36fc09b7f0 tx=0x7f36fc0973e0 comp rx=0 tx=0).stop 2024-08-19T00:13:05.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.580+0000 7f3708a77640 1 -- 172.21.15.44:0/1924328902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37041078b0 msgr2=0x7f3704074ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:05.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.580+0000 7f3708a77640 1 --2- 172.21.15.44:0/1924328902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37041078b0 0x7f3704074ca0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f36fc00c970 tx=0x7f36fc00ce30 comp rx=0 tx=0).stop 2024-08-19T00:13:05.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.580+0000 7f3708a77640 1 -- 172.21.15.44:0/1924328902 shutdown_connections 2024-08-19T00:13:05.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.580+0000 7f3708a77640 1 --2- 172.21.15.44:0/1924328902 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f36ec0a2c10 0x7f36ec0a50d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:05.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.580+0000 7f3708a77640 1 --2- 172.21.15.44:0/1924328902 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3704102250 0x7f3704074760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:05.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.580+0000 7f3708a77640 1 --2- 172.21.15.44:0/1924328902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37041078b0 0x7f3704074ca0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:05.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.580+0000 7f3708a77640 1 --2- 172.21.15.44:0/1924328902 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f37041018b0 0x7f3704074220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:05.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.580+0000 7f3708a77640 1 -- 172.21.15.44:0/1924328902 >> 172.21.15.44:0/1924328902 conn(0x7f37040fd5f0 msgr2=0x7f37040fdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:05.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.580+0000 7f3708a77640 1 -- 172.21.15.44:0/1924328902 shutdown_connections 2024-08-19T00:13:05.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:05.580+0000 7f3708a77640 1 -- 172.21.15.44:0/1924328902 wait complete. 2024-08-19T00:13:06.455 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph tell mds.e status 2024-08-19T00:13:06.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:06 smithi171 ceph-mon[21810]: pgmap v337: 129 pgs: 129 active+clean; 645 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-08-19T00:13:06.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:06 smithi116 ceph-mon[21873]: pgmap v337: 129 pgs: 129 active+clean; 645 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-08-19T00:13:06.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:06 smithi044 ceph-mon[18489]: pgmap v337: 129 pgs: 129 active+clean; 645 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-08-19T00:13:06.722 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:13:07.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.207+0000 7f79e7a21640 1 -- 172.21.15.44:0/3669351833 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79e0102c20 msgr2=0x7f79e010d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:07.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.207+0000 7f79e7a21640 1 --2- 172.21.15.44:0/3669351833 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79e0102c20 0x7f79e010d770 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f79d8009ca0 tx=0x7f79d802a950 comp rx=0 tx=0).stop 2024-08-19T00:13:07.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.207+0000 7f79e7a21640 1 -- 172.21.15.44:0/3669351833 shutdown_connections 2024-08-19T00:13:07.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.207+0000 7f79e7a21640 1 --2- 172.21.15.44:0/3669351833 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79e0102c20 0x7f79e010d770 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:07.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.207+0000 7f79e7a21640 1 --2- 172.21.15.44:0/3669351833 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f79e01022a0 0x7f79e01026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:07.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.208+0000 7f79e7a21640 1 --2- 172.21.15.44:0/3669351833 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f79e0100b50 0x7f79e0100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:07.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.208+0000 7f79e7a21640 1 -- 172.21.15.44:0/3669351833 >> 172.21.15.44:0/3669351833 conn(0x7f79e00fc500 msgr2=0x7f79e00fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:07.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.208+0000 7f79e7a21640 1 -- 172.21.15.44:0/3669351833 shutdown_connections 2024-08-19T00:13:07.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.208+0000 7f79e7a21640 1 -- 172.21.15.44:0/3669351833 wait complete. 2024-08-19T00:13:07.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.208+0000 7f79e7a21640 1 Processor -- start 2024-08-19T00:13:07.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.208+0000 7f79e7a21640 1 -- start start 2024-08-19T00:13:07.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.208+0000 7f79e7a21640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f79e0100b50 0x7f79e00fc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:07.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.208+0000 7f79e7a21640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79e01022a0 0x7f79e00fcef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:07.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.208+0000 7f79e7a21640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f79e0102c20 0x7f79e00fd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:07.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.208+0000 7f79e7a21640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f79e0110cb0 con 0x7f79e01022a0 2024-08-19T00:13:07.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.208+0000 7f79e7a21640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f79e0110b30 con 0x7f79e0102c20 2024-08-19T00:13:07.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.208+0000 7f79e7a21640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f79e0110e30 con 0x7f79e0100b50 2024-08-19T00:13:07.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.209+0000 7f79e4fbc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79e01022a0 0x7f79e00fcef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:07.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.209+0000 7f79e4fbc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79e01022a0 0x7f79e00fcef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35096/0 (socket says 172.21.15.44:35096) 2024-08-19T00:13:07.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.209+0000 7f79e4fbc640 1 -- 172.21.15.44:0/4243552631 learned_addr learned my addr 172.21.15.44:0/4243552631 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:07.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.209+0000 7f79e57bd640 1 --2- 172.21.15.44:0/4243552631 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f79e0100b50 0x7f79e00fc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:07.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.209+0000 7f79e5fbe640 1 --2- 172.21.15.44:0/4243552631 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f79e0102c20 0x7f79e00fd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:07.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.209+0000 7f79e4fbc640 1 -- 172.21.15.44:0/4243552631 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f79e0100b50 msgr2=0x7f79e00fc9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:07.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.209+0000 7f79e4fbc640 1 --2- 172.21.15.44:0/4243552631 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f79e0100b50 0x7f79e00fc9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:07.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.209+0000 7f79e4fbc640 1 -- 172.21.15.44:0/4243552631 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f79e0102c20 msgr2=0x7f79e00fd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:07.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.209+0000 7f79e4fbc640 1 --2- 172.21.15.44:0/4243552631 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f79e0102c20 0x7f79e00fd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:07.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.209+0000 7f79e4fbc640 1 -- 172.21.15.44:0/4243552631 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79e01a66d0 con 0x7f79e01022a0 2024-08-19T00:13:07.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.209+0000 7f79e4fbc640 1 --2- 172.21.15.44:0/4243552631 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79e01022a0 0x7f79e00fcef0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f79d400d950 tx=0x7f79d400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:07.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.209+0000 7f79d27fc640 1 -- 172.21.15.44:0/4243552631 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d4017070 con 0x7f79e01022a0 2024-08-19T00:13:07.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.209+0000 7f79d27fc640 1 -- 172.21.15.44:0/4243552631 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79d4009c30 con 0x7f79e01022a0 2024-08-19T00:13:07.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.209+0000 7f79d27fc640 1 -- 172.21.15.44:0/4243552631 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d400f6b0 con 0x7f79e01022a0 2024-08-19T00:13:07.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.209+0000 7f79e7a21640 1 -- 172.21.15.44:0/4243552631 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79e01a69c0 con 0x7f79e01022a0 2024-08-19T00:13:07.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.210+0000 7f79e7a21640 1 -- 172.21.15.44:0/4243552631 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79e01a6eb0 con 0x7f79e01022a0 2024-08-19T00:13:07.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.212+0000 7f79d27fc640 1 -- 172.21.15.44:0/4243552631 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f79d40109d0 con 0x7f79e01022a0 2024-08-19T00:13:07.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.212+0000 7f79e9e1f740 1 Processor -- start 2024-08-19T00:13:07.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.212+0000 7f79e9e1f740 1 -- start start 2024-08-19T00:13:07.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.213+0000 7f79e9e1f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611b47e6630 0x5611b47e6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:07.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.213+0000 7f79e9e1f740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5611b47e6f50 0x5611b47f12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:07.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.213+0000 7f79e9e1f740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5611b47f1810 0x5611b47f3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:07.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.213+0000 7f79e9e1f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5611b474b710 con 0x5611b47e6630 2024-08-19T00:13:07.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.213+0000 7f79e9e1f740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5611b46e3770 con 0x5611b47e6f50 2024-08-19T00:13:07.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.213+0000 7f79d27fc640 1 --2- 172.21.15.44:0/4243552631 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f79cc0a2c10 0x7f79cc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:07.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.213+0000 7f79e9e1f740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5611b47476d0 con 0x5611b47f1810 2024-08-19T00:13:07.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.213+0000 7f79e5fbe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611b47e6630 0x5611b47e6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:07.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.213+0000 7f79e5fbe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611b47e6630 0x5611b47e6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35104/0 (socket says 172.21.15.44:35104) 2024-08-19T00:13:07.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.213+0000 7f79e57bd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5611b47e6f50 0x5611b47f12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:07.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.213+0000 7f79e5fbe640 1 -- 172.21.15.44:0/540297193 learned_addr learned my addr 172.21.15.44:0/540297193 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:07.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.213+0000 7f79d27fc640 1 -- 172.21.15.44:0/4243552631 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9187+0+0 (secure 0 0 0) 0x7f79d40cf070 con 0x7f79e01022a0 2024-08-19T00:13:07.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.213+0000 7f79e5fbe640 1 --2- 172.21.15.44:0/4243552631 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f79cc0a2c10 0x7f79cc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:07.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.213+0000 7f79e57bd640 1 -- 172.21.15.44:0/540297193 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5611b47f1810 msgr2=0x5611b47f3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:07.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.213+0000 7f79e57bd640 1 --2- 172.21.15.44:0/540297193 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5611b47f1810 0x5611b47f3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:07.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.213+0000 7f79e57bd640 1 -- 172.21.15.44:0/540297193 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611b47e6630 msgr2=0x5611b47e6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:07.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.213+0000 7f79e57bd640 1 --2- 172.21.15.44:0/540297193 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611b47e6630 0x5611b47e6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:07.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.213+0000 7f79e57bd640 1 -- 172.21.15.44:0/540297193 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611b46ea3e0 con 0x5611b47e6f50 2024-08-19T00:13:07.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.213+0000 7f79e5fbe640 1 --2- 172.21.15.44:0/540297193 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611b47e6630 0x5611b47e6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:13:07.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.214+0000 7f79e5fbe640 1 --2- 172.21.15.44:0/4243552631 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f79cc0a2c10 0x7f79cc0a50d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f79d8009a60 tx=0x7f79d8005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:07.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.214+0000 7f79e57bd640 1 --2- 172.21.15.44:0/540297193 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5611b47e6f50 0x5611b47f12d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f79dc004630 tx=0x7f79dc00bb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b0a1b069cc0d2d3 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:07.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.214+0000 7f79cb7fe640 1 -- 172.21.15.44:0/540297193 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79dc003bd0 con 0x5611b47e6f50 2024-08-19T00:13:07.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.214+0000 7f79cb7fe640 1 -- 172.21.15.44:0/540297193 <== mon.2 v2:172.21.15.116:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79dc015070 con 0x5611b47e6f50 2024-08-19T00:13:07.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.214+0000 7f79cb7fe640 1 -- 172.21.15.44:0/540297193 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79dc004d90 con 0x5611b47e6f50 2024-08-19T00:13:07.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.215+0000 7f79e9e1f740 1 -- 172.21.15.44:0/540297193 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5611b47e6f50 msgr2=0x5611b47f12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:07.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.215+0000 7f79e9e1f740 1 --2- 172.21.15.44:0/540297193 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5611b47e6f50 0x5611b47f12d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f79dc004630 tx=0x7f79dc00bb20 comp rx=0 tx=0).stop 2024-08-19T00:13:07.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.215+0000 7f79e9e1f740 1 -- 172.21.15.44:0/540297193 shutdown_connections 2024-08-19T00:13:07.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.215+0000 7f79e9e1f740 1 --2- 172.21.15.44:0/540297193 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5611b47f1810 0x5611b47f3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:07.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.215+0000 7f79e9e1f740 1 --2- 172.21.15.44:0/540297193 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5611b47e6f50 0x5611b47f12d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:07.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.215+0000 7f79e9e1f740 1 --2- 172.21.15.44:0/540297193 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611b47e6630 0x5611b47e6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:07.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.215+0000 7f79e9e1f740 1 -- 172.21.15.44:0/540297193 >> 172.21.15.44:0/540297193 conn(0x5611b47e2bc0 msgr2=0x5611b47e2fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:07.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.215+0000 7f79e9e1f740 1 -- 172.21.15.44:0/540297193 shutdown_connections 2024-08-19T00:13:07.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.215+0000 7f79e9e1f740 1 -- 172.21.15.44:0/540297193 wait complete. 2024-08-19T00:13:07.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.215+0000 7f79e9e1f740 1 -- start start 2024-08-19T00:13:07.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.216+0000 7f79e9e1f740 1 Processor -- start 2024-08-19T00:13:07.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.216+0000 7f79e9e1f740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5611b47e6630 0x5611b47ee690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:07.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.216+0000 7f79e9e1f740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5611b47e6f50 0x5611b47eebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:07.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.216+0000 7f79e9e1f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611b47f1810 0x5611b47ef110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:07.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.216+0000 7f79e9e1f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5611b47f43e0 con 0x5611b47f1810 2024-08-19T00:13:07.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.216+0000 7f79e9e1f740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5611b4706970 con 0x5611b47e6630 2024-08-19T00:13:07.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.216+0000 7f79e9e1f740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5611b47f4560 con 0x5611b47e6f50 2024-08-19T00:13:07.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.216+0000 7f79e9e1f740 10 client.0 _ll_register_callbacks cb 0x5611b445a7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:13:07.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.216+0000 7f79e5fbe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611b47f1810 0x5611b47ef110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:07.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.216+0000 7f79e5fbe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611b47f1810 0x5611b47ef110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35108/0 (socket says 172.21.15.44:35108) 2024-08-19T00:13:07.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.216+0000 7f79e5fbe640 1 -- 172.21.15.44:0/137879447 learned_addr learned my addr 172.21.15.44:0/137879447 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:07.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.216+0000 7f79e57bd640 1 --2- 172.21.15.44:0/137879447 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5611b47e6630 0x5611b47ee690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:07.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.216+0000 7f79e4fbc640 1 --2- 172.21.15.44:0/137879447 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5611b47e6f50 0x5611b47eebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:07.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.217+0000 7f79e5fbe640 1 -- 172.21.15.44:0/137879447 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5611b47e6f50 msgr2=0x5611b47eebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:07.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.217+0000 7f79e5fbe640 1 --2- 172.21.15.44:0/137879447 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5611b47e6f50 0x5611b47eebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:07.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.217+0000 7f79e5fbe640 1 -- 172.21.15.44:0/137879447 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5611b47e6630 msgr2=0x5611b47ee690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:07.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.217+0000 7f79e5fbe640 1 --2- 172.21.15.44:0/137879447 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5611b47e6630 0x5611b47ee690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:07.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.217+0000 7f79e5fbe640 1 -- 172.21.15.44:0/137879447 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611b44bd2b0 con 0x5611b47f1810 2024-08-19T00:13:07.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.217+0000 7f79e57bd640 1 --2- 172.21.15.44:0/137879447 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5611b47e6630 0x5611b47ee690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:13:07.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.217+0000 7f79e5fbe640 1 --2- 172.21.15.44:0/137879447 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611b47f1810 0x5611b47ef110 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f79d8005e30 tx=0x7f79d80095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83224d56f5803234 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:07.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.217+0000 7f79c8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:13:07.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.217+0000 7f79c8ff9640 1 -- 172.21.15.44:0/137879447 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d804f030 con 0x5611b47f1810 2024-08-19T00:13:07.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.217+0000 7f79c8ff9640 1 -- 172.21.15.44:0/137879447 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9187+0+0 (secure 0 0 0) 0x7f79d8004250 con 0x5611b47f1810 2024-08-19T00:13:07.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.217+0000 7f79e9e1f740 1 -- 172.21.15.44:0/137879447 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79dc015070 con 0x5611b47f1810 2024-08-19T00:13:07.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.217+0000 7f79c8ff9640 1 -- 172.21.15.44:0/137879447 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f79d8034040 con 0x5611b47f1810 2024-08-19T00:13:07.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.217+0000 7f79e9e1f740 10 client.15213 fetch_fsmap learned FSMap version 27 2024-08-19T00:13:07.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.217+0000 7f79e9e1f740 1 -- 172.21.15.44:0/137879447 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5611b47ffff0 con 0x5611b47f1810 2024-08-19T00:13:07.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.218+0000 7f79c8ff9640 1 -- 172.21.15.44:0/137879447 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79dc015070 con 0x5611b47f1810 2024-08-19T00:13:07.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.218+0000 7f79c8ff9640 1 -- 172.21.15.44:0/137879447 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f79d804bbc0 con 0x5611b47f1810 2024-08-19T00:13:07.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.218+0000 7f79e9e1f740 10 client.15213 fetch_fsmap finished waiting for FSMap version 27 2024-08-19T00:13:07.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.218+0000 7f79e9e1f740 10 client.15213 resolve_mds: resolved name 'e' to daemon mds.e 2024-08-19T00:13:07.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.218+0000 7f79e9e1f740 20 client.15213 populate_metadata read hostname 'smithi044' 2024-08-19T00:13:07.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.218+0000 7f79e9e1f740 1 --2- 172.21.15.44:0/137879447 >> [v2:172.21.15.116:6834/3507399322,v1:172.21.15.116:6835/3507399322] conn(0x5611b4802650 0x5611b4803ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:07.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.218+0000 7f79e9e1f740 4 client.15213 mds_command: new command op to 24431 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:13:07.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.218+0000 7f79e9e1f740 1 -- 172.21.15.44:0/137879447 --> [v2:172.21.15.116:6834/3507399322,v1:172.21.15.116:6835/3507399322] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5611b4758c80 con 0x5611b4802650 2024-08-19T00:13:07.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.218+0000 7f79e57bd640 1 --2- 172.21.15.44:0/137879447 >> [v2:172.21.15.116:6834/3507399322,v1:172.21.15.116:6835/3507399322] conn(0x5611b4802650 0x5611b4803ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:07.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.219+0000 7f79e57bd640 1 --2- 172.21.15.44:0/137879447 >> [v2:172.21.15.116:6834/3507399322,v1:172.21.15.116:6835/3507399322] conn(0x5611b4802650 0x5611b4803ac0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=788304cbe1558ad4 server_cookie=5799662fd1a37a54 in_seq=0 out_seq=0 2024-08-19T00:13:07.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.219+0000 7f79c8ff9640 10 client.15213 ms_handle_connect on v2:172.21.15.116:6834/3507399322 2024-08-19T00:13:07.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.219+0000 7f79c8ff9640 1 -- 172.21.15.44:0/137879447 <== mds.3 v2:172.21.15.116:6834/3507399322 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5611b4758c80 con 0x5611b4802650 2024-08-19T00:13:07.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.219+0000 7f79c8ff9640 10 client.15213 handle_command_reply: tid=0 2024-08-19T00:13:07.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.219+0000 7f79e9e1f740 1 client.15213 shutdown 2024-08-19T00:13:07.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.220+0000 7f79e9e1f740 1 -- 172.21.15.44:0/137879447 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611b47f1810 msgr2=0x5611b47ef110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:07.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.220+0000 7f79e9e1f740 1 --2- 172.21.15.44:0/137879447 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611b47f1810 0x5611b47ef110 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f79d8005e30 tx=0x7f79d80095c0 comp rx=0 tx=0).stop 2024-08-19T00:13:07.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.220+0000 7f79e9e1f740 1 -- 172.21.15.44:0/137879447 shutdown_connections 2024-08-19T00:13:07.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.220+0000 7f79e9e1f740 1 --2- 172.21.15.44:0/137879447 >> [v2:172.21.15.116:6834/3507399322,v1:172.21.15.116:6835/3507399322] conn(0x5611b4802650 0x5611b4803ac0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:07.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.220+0000 7f79e9e1f740 1 --2- 172.21.15.44:0/137879447 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5611b47e6f50 0x5611b47eebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:07.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.220+0000 7f79e9e1f740 1 --2- 172.21.15.44:0/137879447 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611b47f1810 0x5611b47ef110 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:07.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.220+0000 7f79e9e1f740 1 --2- 172.21.15.44:0/137879447 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5611b47e6630 0x5611b47ee690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:07.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.220+0000 7f79e9e1f740 1 -- 172.21.15.44:0/137879447 >> 172.21.15.44:0/137879447 conn(0x5611b47e2bc0 msgr2=0x5611b47e88f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:07.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.220+0000 7f79c8ff9640 0 client.15213 ms_handle_reset on v2:172.21.15.116:6834/3507399322 2024-08-19T00:13:07.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.220+0000 7f79e9e1f740 1 -- 172.21.15.44:0/137879447 shutdown_connections 2024-08-19T00:13:07.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.220+0000 7f79e9e1f740 1 -- 172.21.15.44:0/137879447 wait complete. 2024-08-19T00:13:07.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.220+0000 7f79e9e1f740 20 client.15213 trim_cache size 0 max 16384 2024-08-19T00:13:07.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.238+0000 7f79e9e1f740 1 Processor -- start 2024-08-19T00:13:07.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.238+0000 7f79e9e1f740 1 -- start start 2024-08-19T00:13:07.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.238+0000 7f79e9e1f740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5611b47e6630 0x5611b4802650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:07.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.238+0000 7f79e9e1f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611b47e6f50 0x5611b4801f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:07.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.238+0000 7f79e9e1f740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5611b47f1810 0x5611b47edfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:07.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.238+0000 7f79e9e1f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5611b4801e00 con 0x5611b47e6f50 2024-08-19T00:13:07.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.238+0000 7f79e9e1f740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5611b48024d0 con 0x5611b47f1810 2024-08-19T00:13:07.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.238+0000 7f79e9e1f740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5611b4802ba0 con 0x5611b47e6630 2024-08-19T00:13:07.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.238+0000 7f79e4fbc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611b47e6f50 0x5611b4801f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:07.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.238+0000 7f79e4fbc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611b47e6f50 0x5611b4801f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35110/0 (socket says 172.21.15.44:35110) 2024-08-19T00:13:07.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.238+0000 7f79e4fbc640 1 -- 172.21.15.44:0/946774170 learned_addr learned my addr 172.21.15.44:0/946774170 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:07.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.238+0000 7f79e5fbe640 1 --2- 172.21.15.44:0/946774170 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5611b47f1810 0x5611b47edfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:07.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.238+0000 7f79e4fbc640 1 -- 172.21.15.44:0/946774170 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5611b47e6630 msgr2=0x5611b4802650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:07.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.238+0000 7f79e4fbc640 1 --2- 172.21.15.44:0/946774170 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5611b47e6630 0x5611b4802650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:07.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.238+0000 7f79e4fbc640 1 -- 172.21.15.44:0/946774170 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5611b47f1810 msgr2=0x5611b47edfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:07.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.238+0000 7f79e4fbc640 1 --2- 172.21.15.44:0/946774170 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5611b47f1810 0x5611b47edfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:07.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.238+0000 7f79e4fbc640 1 -- 172.21.15.44:0/946774170 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611b47e6d80 con 0x5611b47e6f50 2024-08-19T00:13:07.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.238+0000 7f79e5fbe640 1 --2- 172.21.15.44:0/946774170 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5611b47f1810 0x5611b47edfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:13:07.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.239+0000 7f79e4fbc640 1 --2- 172.21.15.44:0/946774170 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611b47e6f50 0x5611b4801f80 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f79d40978c0 tx=0x7f79d4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=905c2630e232486 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:07.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.239+0000 7f79caffd640 1 -- 172.21.15.44:0/946774170 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d4020040 con 0x5611b47e6f50 2024-08-19T00:13:07.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.239+0000 7f79caffd640 1 -- 172.21.15.44:0/946774170 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79d40a4ee0 con 0x5611b47e6f50 2024-08-19T00:13:07.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.239+0000 7f79caffd640 1 -- 172.21.15.44:0/946774170 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d40ab220 con 0x5611b47e6f50 2024-08-19T00:13:07.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.240+0000 7f79e9e1f740 1 -- 172.21.15.44:0/946774170 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611b47e6f50 msgr2=0x5611b4801f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:07.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.240+0000 7f79e9e1f740 1 --2- 172.21.15.44:0/946774170 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611b47e6f50 0x5611b4801f80 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f79d40978c0 tx=0x7f79d4005880 comp rx=0 tx=0).stop 2024-08-19T00:13:07.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.240+0000 7f79e9e1f740 1 -- 172.21.15.44:0/946774170 shutdown_connections 2024-08-19T00:13:07.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.240+0000 7f79e9e1f740 1 --2- 172.21.15.44:0/946774170 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5611b47f1810 0x5611b47edfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:07.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.240+0000 7f79e9e1f740 1 --2- 172.21.15.44:0/946774170 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611b47e6f50 0x5611b4801f80 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:07.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.240+0000 7f79e9e1f740 1 --2- 172.21.15.44:0/946774170 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5611b47e6630 0x5611b4802650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:07.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.240+0000 7f79e9e1f740 1 -- 172.21.15.44:0/946774170 >> 172.21.15.44:0/946774170 conn(0x5611b47e2bc0 msgr2=0x5611b47e80d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:07.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.240+0000 7f79e9e1f740 1 -- 172.21.15.44:0/946774170 shutdown_connections 2024-08-19T00:13:07.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.240+0000 7f79e9e1f740 1 -- 172.21.15.44:0/946774170 wait complete. 2024-08-19T00:13:07.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.240+0000 7f79e9e1f740 1 -- start start 2024-08-19T00:13:07.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.240+0000 7f79e9e1f740 1 Processor -- start 2024-08-19T00:13:07.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.240+0000 7f79e9e1f740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5611b47e6630 0x5611b47ead00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:07.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.240+0000 7f79e9e1f740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5611b47e6f50 0x5611b47eb240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:07.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.240+0000 7f79e9e1f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611b47f1810 0x5611b480ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:07.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.241+0000 7f79e9e1f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5611b4803940 con 0x5611b47f1810 2024-08-19T00:13:07.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.241+0000 7f79e9e1f740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5611b4803270 con 0x5611b47e6630 2024-08-19T00:13:07.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.241+0000 7f79e9e1f740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5611b4804010 con 0x5611b47e6f50 2024-08-19T00:13:07.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.241+0000 7f79e9e1f740 10 client.0 _ll_register_callbacks cb 0x7f79d8044040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:13:07.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.241+0000 7f79e5fbe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611b47f1810 0x5611b480ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:07.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.241+0000 7f79e5fbe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611b47f1810 0x5611b480ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35112/0 (socket says 172.21.15.44:35112) 2024-08-19T00:13:07.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.241+0000 7f79e5fbe640 1 -- 172.21.15.44:0/2604322023 learned_addr learned my addr 172.21.15.44:0/2604322023 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:07.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.241+0000 7f79e57bd640 1 --2- 172.21.15.44:0/2604322023 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5611b47e6630 0x5611b47ead00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:07.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.241+0000 7f79e4fbc640 1 --2- 172.21.15.44:0/2604322023 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5611b47e6f50 0x5611b47eb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:07.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.241+0000 7f79e5fbe640 1 -- 172.21.15.44:0/2604322023 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5611b47e6f50 msgr2=0x5611b47eb240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:07.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.241+0000 7f79e5fbe640 1 --2- 172.21.15.44:0/2604322023 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5611b47e6f50 0x5611b47eb240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:07.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.241+0000 7f79e5fbe640 1 -- 172.21.15.44:0/2604322023 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5611b47e6630 msgr2=0x5611b47ead00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:07.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.241+0000 7f79e5fbe640 1 --2- 172.21.15.44:0/2604322023 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5611b47e6630 0x5611b47ead00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:07.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.241+0000 7f79e5fbe640 1 -- 172.21.15.44:0/2604322023 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611b47ebad0 con 0x5611b47f1810 2024-08-19T00:13:07.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.241+0000 7f79e57bd640 1 --2- 172.21.15.44:0/2604322023 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5611b47e6630 0x5611b47ead00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:13:07.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.241+0000 7f79e4fbc640 1 --2- 172.21.15.44:0/2604322023 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5611b47e6f50 0x5611b47eb240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:13:07.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.241+0000 7f79e5fbe640 1 --2- 172.21.15.44:0/2604322023 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611b47f1810 0x5611b480ad10 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f79d8009ca0 tx=0x7f79d8056f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42bb1fdd0b6697ee server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:07.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.241+0000 7f79c8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:13:07.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.241+0000 7f79c8ff9640 1 -- 172.21.15.44:0/2604322023 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d804f070 con 0x5611b47f1810 2024-08-19T00:13:07.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.241+0000 7f79c8ff9640 1 -- 172.21.15.44:0/2604322023 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9187+0+0 (secure 0 0 0) 0x7f79d80562d0 con 0x5611b47f1810 2024-08-19T00:13:07.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.242+0000 7f79e9e1f740 1 -- 172.21.15.44:0/2604322023 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79d40a4ee0 con 0x5611b47f1810 2024-08-19T00:13:07.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.242+0000 7f79c8ff9640 1 -- 172.21.15.44:0/2604322023 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f79d8056720 con 0x5611b47f1810 2024-08-19T00:13:07.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.242+0000 7f79e9e1f740 10 client.15219 fetch_fsmap learned FSMap version 27 2024-08-19T00:13:07.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.242+0000 7f79e9e1f740 1 -- 172.21.15.44:0/2604322023 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5611b480c380 con 0x5611b47f1810 2024-08-19T00:13:07.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.242+0000 7f79c8ff9640 1 -- 172.21.15.44:0/2604322023 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79d40a4ee0 con 0x5611b47f1810 2024-08-19T00:13:07.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.242+0000 7f79c8ff9640 1 -- 172.21.15.44:0/2604322023 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f79d8004c40 con 0x5611b47f1810 2024-08-19T00:13:07.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.242+0000 7f79e9e1f740 10 client.15219 fetch_fsmap finished waiting for FSMap version 27 2024-08-19T00:13:07.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.242+0000 7f79e9e1f740 10 client.15219 resolve_mds: resolved name 'e' to daemon mds.e 2024-08-19T00:13:07.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.242+0000 7f79e9e1f740 20 client.15219 populate_metadata read hostname 'smithi044' 2024-08-19T00:13:07.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.242+0000 7f79e9e1f740 1 --2- 172.21.15.44:0/2604322023 >> [v2:172.21.15.116:6834/3507399322,v1:172.21.15.116:6835/3507399322] conn(0x5611b4871050 0x5611b486fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:07.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.242+0000 7f79e9e1f740 4 client.15219 mds_command: new command op to 24431 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-19T00:13:07.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.242+0000 7f79e9e1f740 1 -- 172.21.15.44:0/2604322023 --> [v2:172.21.15.116:6834/3507399322,v1:172.21.15.116:6835/3507399322] -- command(tid 0: {"prefix": "status"}) -- 0x5611b4753190 con 0x5611b4871050 2024-08-19T00:13:07.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.242+0000 7f79e57bd640 1 --2- 172.21.15.44:0/2604322023 >> [v2:172.21.15.116:6834/3507399322,v1:172.21.15.116:6835/3507399322] conn(0x5611b4871050 0x5611b486fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:07.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.243+0000 7f79e57bd640 1 --2- 172.21.15.44:0/2604322023 >> [v2:172.21.15.116:6834/3507399322,v1:172.21.15.116:6835/3507399322] conn(0x5611b4871050 0x5611b486fd60 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a8f682adfc238acd server_cookie=619ff89f947928fd in_seq=0 out_seq=0 2024-08-19T00:13:07.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.243+0000 7f79c8ff9640 10 client.15219 ms_handle_connect on v2:172.21.15.116:6834/3507399322 2024-08-19T00:13:07.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.243+0000 7f79c8ff9640 1 -- 172.21.15.44:0/2604322023 <== mds.3 v2:172.21.15.116:6834/3507399322 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5611b4753190 con 0x5611b4871050 2024-08-19T00:13:07.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.243+0000 7f79c8ff9640 10 client.15219 handle_command_reply: tid=0 2024-08-19T00:13:07.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.243+0000 7f79e9e1f740 1 client.15219 shutdown 2024-08-19T00:13:07.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.243+0000 7f79e9e1f740 1 -- 172.21.15.44:0/2604322023 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611b47f1810 msgr2=0x5611b480ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:07.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.243+0000 7f79e9e1f740 1 --2- 172.21.15.44:0/2604322023 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611b47f1810 0x5611b480ad10 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f79d8009ca0 tx=0x7f79d8056f90 comp rx=0 tx=0).stop 2024-08-19T00:13:07.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.243+0000 7f79e9e1f740 1 -- 172.21.15.44:0/2604322023 shutdown_connections 2024-08-19T00:13:07.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.243+0000 7f79e9e1f740 1 --2- 172.21.15.44:0/2604322023 >> [v2:172.21.15.116:6834/3507399322,v1:172.21.15.116:6835/3507399322] conn(0x5611b4871050 0x5611b486fd60 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:07.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.243+0000 7f79e9e1f740 1 --2- 172.21.15.44:0/2604322023 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5611b47e6f50 0x5611b47eb240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:07.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.243+0000 7f79e9e1f740 1 --2- 172.21.15.44:0/2604322023 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611b47f1810 0x5611b480ad10 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:07.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.243+0000 7f79e9e1f740 1 --2- 172.21.15.44:0/2604322023 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5611b47e6630 0x5611b47ead00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:07.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.243+0000 7f79e9e1f740 1 -- 172.21.15.44:0/2604322023 >> 172.21.15.44:0/2604322023 conn(0x5611b47e2bc0 msgr2=0x5611b47fd030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:07.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.243+0000 7f79c8ff9640 0 client.15219 ms_handle_reset on v2:172.21.15.116:6834/3507399322 2024-08-19T00:13:07.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.243+0000 7f79e9e1f740 1 -- 172.21.15.44:0/2604322023 shutdown_connections 2024-08-19T00:13:07.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.243+0000 7f79e9e1f740 1 -- 172.21.15.44:0/2604322023 wait complete. 2024-08-19T00:13:07.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.244+0000 7f79e9e1f740 20 client.15219 trim_cache size 0 max 16384 2024-08-19T00:13:07.252 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-08-19T00:13:07.252 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "647ded64-5dbe-11ef-bccf-c7b262605968", 2024-08-19T00:13:07.253 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 3, 2024-08-19T00:13:07.253 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 24431, 2024-08-19T00:13:07.253 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-08-19T00:13:07.253 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-08-19T00:13:07.253 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-08-19T00:13:07.253 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 92.360478310000005, 2024-08-19T00:13:07.253 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 27, 2024-08-19T00:13:07.253 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 94, 2024-08-19T00:13:07.253 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 90, 2024-08-19T00:13:07.253 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 165.05470607699999 2024-08-19T00:13:07.253 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-08-19T00:13:07.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.244+0000 7f79e7a21640 1 -- 172.21.15.44:0/4243552631 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f79cc0a2c10 msgr2=0x7f79cc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:07.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.244+0000 7f79e7a21640 1 --2- 172.21.15.44:0/4243552631 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f79cc0a2c10 0x7f79cc0a50d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f79d8009a60 tx=0x7f79d8005c50 comp rx=0 tx=0).stop 2024-08-19T00:13:07.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.244+0000 7f79e7a21640 1 -- 172.21.15.44:0/4243552631 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79e01022a0 msgr2=0x7f79e00fcef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:07.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.244+0000 7f79e7a21640 1 --2- 172.21.15.44:0/4243552631 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79e01022a0 0x7f79e00fcef0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f79d400d950 tx=0x7f79d400de10 comp rx=0 tx=0).stop 2024-08-19T00:13:07.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.244+0000 7f79e7a21640 1 -- 172.21.15.44:0/4243552631 shutdown_connections 2024-08-19T00:13:07.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.244+0000 7f79e7a21640 1 --2- 172.21.15.44:0/4243552631 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f79cc0a2c10 0x7f79cc0a50d0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:07.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.244+0000 7f79e7a21640 1 --2- 172.21.15.44:0/4243552631 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f79e0102c20 0x7f79e00fd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:07.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.244+0000 7f79e7a21640 1 --2- 172.21.15.44:0/4243552631 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79e01022a0 0x7f79e00fcef0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:07.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.244+0000 7f79e7a21640 1 --2- 172.21.15.44:0/4243552631 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f79e0100b50 0x7f79e00fc9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:07.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.244+0000 7f79e7a21640 1 -- 172.21.15.44:0/4243552631 >> 172.21.15.44:0/4243552631 conn(0x7f79e00fc500 msgr2=0x7f79e0069f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:07.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.244+0000 7f79e7a21640 1 -- 172.21.15.44:0/4243552631 shutdown_connections 2024-08-19T00:13:07.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:07.244+0000 7f79e7a21640 1 -- 172.21.15.44:0/4243552631 wait complete. 2024-08-19T00:13:08.067 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph tell mds.i status 2024-08-19T00:13:08.326 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:13:08.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:08 smithi171 ceph-mon[21810]: pgmap v338: 129 pgs: 129 active+clean; 645 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-08-19T00:13:08.613 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:08 smithi044 ceph-mon[18489]: pgmap v338: 129 pgs: 129 active+clean; 645 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-08-19T00:13:08.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:08 smithi116 ceph-mon[21873]: pgmap v338: 129 pgs: 129 active+clean; 645 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-08-19T00:13:08.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.831+0000 7f53d4709640 1 -- 172.21.15.44:0/476069258 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53cc102ad0 msgr2=0x7f53cc102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:08.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.831+0000 7f53d4709640 1 --2- 172.21.15.44:0/476069258 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53cc102ad0 0x7f53cc102eb0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f53c8009900 tx=0x7f53c802a480 comp rx=0 tx=0).stop 2024-08-19T00:13:08.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.831+0000 7f53d4709640 1 -- 172.21.15.44:0/476069258 shutdown_connections 2024-08-19T00:13:08.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.831+0000 7f53d4709640 1 --2- 172.21.15.44:0/476069258 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f53cc1033f0 0x7f53cc10b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:08.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.831+0000 7f53d4709640 1 --2- 172.21.15.44:0/476069258 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f53cc10beb0 0x7f53cc10e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:08.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.831+0000 7f53d4709640 1 --2- 172.21.15.44:0/476069258 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53cc102ad0 0x7f53cc102eb0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:08.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.831+0000 7f53d4709640 1 -- 172.21.15.44:0/476069258 >> 172.21.15.44:0/476069258 conn(0x7f53cc0fc4d0 msgr2=0x7f53cc0fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:08.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.831+0000 7f53d4709640 1 -- 172.21.15.44:0/476069258 shutdown_connections 2024-08-19T00:13:08.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.832+0000 7f53d4709640 1 -- 172.21.15.44:0/476069258 wait complete. 2024-08-19T00:13:08.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.832+0000 7f53d4709640 1 Processor -- start 2024-08-19T00:13:08.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.832+0000 7f53d4709640 1 -- start start 2024-08-19T00:13:08.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.832+0000 7f53d4709640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f53cc102ad0 0x7f53cc19a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:08.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.832+0000 7f53d4709640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53cc1033f0 0x7f53cc19a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:08.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.832+0000 7f53d4709640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f53cc10beb0 0x7f53cc19ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:08.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.832+0000 7f53d4709640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f53cc111c90 con 0x7f53cc1033f0 2024-08-19T00:13:08.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.832+0000 7f53d4709640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f53cc111b10 con 0x7f53cc102ad0 2024-08-19T00:13:08.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.832+0000 7f53d4709640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f53cc111e10 con 0x7f53cc10beb0 2024-08-19T00:13:08.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.832+0000 7f53d1ca4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53cc1033f0 0x7f53cc19a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:08.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.832+0000 7f53d1ca4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53cc1033f0 0x7f53cc19a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41562/0 (socket says 172.21.15.44:41562) 2024-08-19T00:13:08.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.833+0000 7f53d1ca4640 1 -- 172.21.15.44:0/3168713400 learned_addr learned my addr 172.21.15.44:0/3168713400 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:08.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.833+0000 7f53d24a5640 1 --2- 172.21.15.44:0/3168713400 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f53cc102ad0 0x7f53cc19a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:08.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.833+0000 7f53d2ca6640 1 --2- 172.21.15.44:0/3168713400 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f53cc10beb0 0x7f53cc19ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:08.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.833+0000 7f53d1ca4640 1 -- 172.21.15.44:0/3168713400 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f53cc10beb0 msgr2=0x7f53cc19ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:08.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.833+0000 7f53d1ca4640 1 --2- 172.21.15.44:0/3168713400 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f53cc10beb0 0x7f53cc19ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:08.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.833+0000 7f53d1ca4640 1 -- 172.21.15.44:0/3168713400 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f53cc102ad0 msgr2=0x7f53cc19a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:08.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.833+0000 7f53d1ca4640 1 --2- 172.21.15.44:0/3168713400 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f53cc102ad0 0x7f53cc19a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:08.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.833+0000 7f53d1ca4640 1 -- 172.21.15.44:0/3168713400 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53cc19f330 con 0x7f53cc1033f0 2024-08-19T00:13:08.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.833+0000 7f53d24a5640 1 --2- 172.21.15.44:0/3168713400 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f53cc102ad0 0x7f53cc19a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:13:08.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.833+0000 7f53d1ca4640 1 --2- 172.21.15.44:0/3168713400 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53cc1033f0 0x7f53cc19a8c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f53bc00d770 tx=0x7f53bc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:08.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.833+0000 7f53c37fe640 1 -- 172.21.15.44:0/3168713400 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53bc017070 con 0x7f53cc1033f0 2024-08-19T00:13:08.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.833+0000 7f53d4709640 1 -- 172.21.15.44:0/3168713400 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53cc19f620 con 0x7f53cc1033f0 2024-08-19T00:13:08.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.833+0000 7f53c37fe640 1 -- 172.21.15.44:0/3168713400 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53bc005500 con 0x7f53cc1033f0 2024-08-19T00:13:08.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.833+0000 7f53c37fe640 1 -- 172.21.15.44:0/3168713400 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53bc004e00 con 0x7f53cc1033f0 2024-08-19T00:13:08.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.833+0000 7f53d4709640 1 -- 172.21.15.44:0/3168713400 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53cc1a6f00 con 0x7f53cc1033f0 2024-08-19T00:13:08.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.835+0000 7f53c37fe640 1 -- 172.21.15.44:0/3168713400 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f53bc004fa0 con 0x7f53cc1033f0 2024-08-19T00:13:08.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.836+0000 7f53d6b07740 1 Processor -- start 2024-08-19T00:13:08.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.836+0000 7f53d6b07740 1 -- start start 2024-08-19T00:13:08.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.836+0000 7f53d6b07740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb97a87630 0x55eb97a87a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:08.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.836+0000 7f53d6b07740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb97a87f50 0x55eb97a922d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:08.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.836+0000 7f53d6b07740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eb97a92810 0x55eb97a94c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:08.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.836+0000 7f53d6b07740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55eb979ec710 con 0x55eb97a87f50 2024-08-19T00:13:08.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.836+0000 7f53d6b07740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55eb97984770 con 0x55eb97a87630 2024-08-19T00:13:08.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.836+0000 7f53d6b07740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55eb979e86d0 con 0x55eb97a92810 2024-08-19T00:13:08.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.837+0000 7f53d24a5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb97a87f50 0x55eb97a922d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:08.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.837+0000 7f53c37fe640 1 --2- 172.21.15.44:0/3168713400 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f53b80a2c10 0x7f53b80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:08.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.837+0000 7f53d24a5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb97a87f50 0x55eb97a922d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41574/0 (socket says 172.21.15.44:41574) 2024-08-19T00:13:08.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.837+0000 7f53d24a5640 1 -- 172.21.15.44:0/2565899100 learned_addr learned my addr 172.21.15.44:0/2565899100 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:08.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.837+0000 7f53d2ca6640 1 --2- 172.21.15.44:0/2565899100 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb97a87630 0x55eb97a87a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:08.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.837+0000 7f53d1ca4640 1 --2- 172.21.15.44:0/2565899100 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eb97a92810 0x55eb97a94c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:08.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.837+0000 7f53d2ca6640 1 --2- 172.21.15.44:0/3168713400 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f53b80a2c10 0x7f53b80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:08.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.837+0000 7f53c37fe640 1 -- 172.21.15.44:0/3168713400 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9187+0+0 (secure 0 0 0) 0x7f53bc0cf0d0 con 0x7f53cc1033f0 2024-08-19T00:13:08.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.837+0000 7f53d24a5640 1 -- 172.21.15.44:0/2565899100 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eb97a92810 msgr2=0x55eb97a94c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:08.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.837+0000 7f53d24a5640 1 --2- 172.21.15.44:0/2565899100 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eb97a92810 0x55eb97a94c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:08.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.837+0000 7f53d24a5640 1 -- 172.21.15.44:0/2565899100 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb97a87630 msgr2=0x55eb97a87a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:08.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.837+0000 7f53d24a5640 1 --2- 172.21.15.44:0/2565899100 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb97a87630 0x55eb97a87a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:08.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.837+0000 7f53d24a5640 1 -- 172.21.15.44:0/2565899100 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb9798b3e0 con 0x55eb97a87f50 2024-08-19T00:13:08.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.837+0000 7f53d2ca6640 1 --2- 172.21.15.44:0/2565899100 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb97a87630 0x55eb97a87a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:13:08.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.837+0000 7f53d24a5640 1 --2- 172.21.15.44:0/2565899100 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb97a87f50 0x55eb97a922d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f53c8033000 tx=0x7f53c8032cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d98298a0b3e51f5 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:08.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.837+0000 7f53d2ca6640 1 --2- 172.21.15.44:0/3168713400 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f53b80a2c10 0x7f53b80a50d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f53c4009fd0 tx=0x7f53c4005bd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:08.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.837+0000 7f53c0ff9640 1 -- 172.21.15.44:0/2565899100 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c803f070 con 0x55eb97a87f50 2024-08-19T00:13:08.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.837+0000 7f53c0ff9640 1 -- 172.21.15.44:0/2565899100 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53c80317b0 con 0x55eb97a87f50 2024-08-19T00:13:08.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.837+0000 7f53c0ff9640 1 -- 172.21.15.44:0/2565899100 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c8035070 con 0x55eb97a87f50 2024-08-19T00:13:08.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.838+0000 7f53d6b07740 1 -- 172.21.15.44:0/2565899100 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb97a87f50 msgr2=0x55eb97a922d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:08.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.838+0000 7f53d6b07740 1 --2- 172.21.15.44:0/2565899100 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb97a87f50 0x55eb97a922d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f53c8033000 tx=0x7f53c8032cb0 comp rx=0 tx=0).stop 2024-08-19T00:13:08.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.838+0000 7f53d6b07740 1 -- 172.21.15.44:0/2565899100 shutdown_connections 2024-08-19T00:13:08.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.838+0000 7f53d6b07740 1 --2- 172.21.15.44:0/2565899100 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eb97a92810 0x55eb97a94c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:08.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.838+0000 7f53d6b07740 1 --2- 172.21.15.44:0/2565899100 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb97a87f50 0x55eb97a922d0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:08.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.838+0000 7f53d6b07740 1 --2- 172.21.15.44:0/2565899100 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb97a87630 0x55eb97a87a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:08.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.838+0000 7f53d6b07740 1 -- 172.21.15.44:0/2565899100 >> 172.21.15.44:0/2565899100 conn(0x55eb97a83bc0 msgr2=0x55eb97a83fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:08.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.838+0000 7f53d6b07740 1 -- 172.21.15.44:0/2565899100 shutdown_connections 2024-08-19T00:13:08.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.838+0000 7f53d6b07740 1 -- 172.21.15.44:0/2565899100 wait complete. 2024-08-19T00:13:08.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.839+0000 7f53d6b07740 1 -- start start 2024-08-19T00:13:08.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.839+0000 7f53d6b07740 1 Processor -- start 2024-08-19T00:13:08.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.839+0000 7f53d6b07740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb97a87630 0x55eb97a8f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:08.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.839+0000 7f53d6b07740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eb97a87f50 0x55eb97a8fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:08.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.839+0000 7f53d6b07740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb97a92810 0x55eb97a90180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:08.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.839+0000 7f53d6b07740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55eb97a953e0 con 0x55eb97a87630 2024-08-19T00:13:08.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.839+0000 7f53d6b07740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55eb979a7970 con 0x55eb97a92810 2024-08-19T00:13:08.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.839+0000 7f53d6b07740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55eb97a95560 con 0x55eb97a87f50 2024-08-19T00:13:08.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.839+0000 7f53d6b07740 10 client.0 _ll_register_callbacks cb 0x55eb976fb7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:13:08.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.839+0000 7f53d24a5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb97a87630 0x55eb97a8f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:08.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.839+0000 7f53d24a5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb97a87630 0x55eb97a8f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41590/0 (socket says 172.21.15.44:41590) 2024-08-19T00:13:08.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.839+0000 7f53d24a5640 1 -- 172.21.15.44:0/3477619048 learned_addr learned my addr 172.21.15.44:0/3477619048 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:08.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.839+0000 7f53d24a5640 1 -- 172.21.15.44:0/3477619048 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eb97a87f50 msgr2=0x55eb97a8fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:08.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.839+0000 7f53d24a5640 1 --2- 172.21.15.44:0/3477619048 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eb97a87f50 0x55eb97a8fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:08.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.839+0000 7f53d24a5640 1 -- 172.21.15.44:0/3477619048 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb97a92810 msgr2=0x55eb97a90180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:08.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.839+0000 7f53d24a5640 1 --2- 172.21.15.44:0/3477619048 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb97a92810 0x55eb97a90180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:08.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.839+0000 7f53d24a5640 1 -- 172.21.15.44:0/3477619048 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb9775e2b0 con 0x55eb97a87630 2024-08-19T00:13:08.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.839+0000 7f53d24a5640 1 --2- 172.21.15.44:0/3477619048 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb97a87630 0x55eb97a8f700 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f53c8009900 tx=0x7f53c80052d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a97e8cb9c09a552b server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:08.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.839+0000 7f53b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:13:08.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.840+0000 7f53b5ffb640 1 -- 172.21.15.44:0/3477619048 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c8035070 con 0x55eb97a87630 2024-08-19T00:13:08.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.840+0000 7f53b5ffb640 1 -- 172.21.15.44:0/3477619048 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9187+0+0 (secure 0 0 0) 0x7f53c80054f0 con 0x55eb97a87630 2024-08-19T00:13:08.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.840+0000 7f53d6b07740 1 -- 172.21.15.44:0/3477619048 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53c80317b0 con 0x55eb97a87630 2024-08-19T00:13:08.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.840+0000 7f53b5ffb640 1 -- 172.21.15.44:0/3477619048 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f53c8055050 con 0x55eb97a87630 2024-08-19T00:13:08.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.840+0000 7f53d6b07740 10 client.15231 fetch_fsmap learned FSMap version 27 2024-08-19T00:13:08.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.840+0000 7f53d6b07740 1 -- 172.21.15.44:0/3477619048 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55eb97aa0ff0 con 0x55eb97a87630 2024-08-19T00:13:08.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.840+0000 7f53b5ffb640 1 -- 172.21.15.44:0/3477619048 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53c80317b0 con 0x55eb97a87630 2024-08-19T00:13:08.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.840+0000 7f53b5ffb640 1 -- 172.21.15.44:0/3477619048 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f53c803bc70 con 0x55eb97a87630 2024-08-19T00:13:08.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.840+0000 7f53d6b07740 10 client.15231 fetch_fsmap finished waiting for FSMap version 27 2024-08-19T00:13:08.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.840+0000 7f53d6b07740 10 client.15231 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-19T00:13:08.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.840+0000 7f53d6b07740 20 client.15231 populate_metadata read hostname 'smithi044' 2024-08-19T00:13:08.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.840+0000 7f53d6b07740 1 --2- 172.21.15.44:0/3477619048 >> [v2:172.21.15.171:6838/1466585795,v1:172.21.15.171:6839/1466585795] conn(0x55eb97aa31b0 0x55eb97aa4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:08.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.840+0000 7f53d6b07740 4 client.15231 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:13:08.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.840+0000 7f53d6b07740 1 -- 172.21.15.44:0/3477619048 --> [v2:172.21.15.171:6838/1466585795,v1:172.21.15.171:6839/1466585795] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eb979f9c80 con 0x55eb97aa31b0 2024-08-19T00:13:08.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.841+0000 7f53d1ca4640 1 --2- 172.21.15.44:0/3477619048 >> [v2:172.21.15.171:6838/1466585795,v1:172.21.15.171:6839/1466585795] conn(0x55eb97aa31b0 0x55eb97aa4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:08.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.841+0000 7f53d1ca4640 1 --2- 172.21.15.44:0/3477619048 >> [v2:172.21.15.171:6838/1466585795,v1:172.21.15.171:6839/1466585795] conn(0x55eb97aa31b0 0x55eb97aa4620 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6d9ed8edf8ee377c server_cookie=f7f6d720fd73e306 in_seq=0 out_seq=0 2024-08-19T00:13:08.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.841+0000 7f53b5ffb640 10 client.15231 ms_handle_connect on v2:172.21.15.171:6838/1466585795 2024-08-19T00:13:08.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.842+0000 7f53b5ffb640 1 -- 172.21.15.44:0/3477619048 <== mds.2 v2:172.21.15.171:6838/1466585795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55eb979f9c80 con 0x55eb97aa31b0 2024-08-19T00:13:08.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.842+0000 7f53b5ffb640 10 client.15231 handle_command_reply: tid=0 2024-08-19T00:13:08.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.842+0000 7f53d6b07740 1 client.15231 shutdown 2024-08-19T00:13:08.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.842+0000 7f53d6b07740 1 -- 172.21.15.44:0/3477619048 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb97a87630 msgr2=0x55eb97a8f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:08.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.842+0000 7f53d6b07740 1 --2- 172.21.15.44:0/3477619048 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb97a87630 0x55eb97a8f700 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f53c8009900 tx=0x7f53c80052d0 comp rx=0 tx=0).stop 2024-08-19T00:13:08.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.842+0000 7f53d6b07740 1 -- 172.21.15.44:0/3477619048 shutdown_connections 2024-08-19T00:13:08.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.842+0000 7f53d6b07740 1 --2- 172.21.15.44:0/3477619048 >> [v2:172.21.15.171:6838/1466585795,v1:172.21.15.171:6839/1466585795] conn(0x55eb97aa31b0 0x55eb97aa4620 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:08.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.842+0000 7f53d6b07740 1 --2- 172.21.15.44:0/3477619048 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eb97a87f50 0x55eb97a8fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:08.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.842+0000 7f53d6b07740 1 --2- 172.21.15.44:0/3477619048 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb97a92810 0x55eb97a90180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:08.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.842+0000 7f53d6b07740 1 --2- 172.21.15.44:0/3477619048 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb97a87630 0x55eb97a8f700 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:08.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.842+0000 7f53b5ffb640 0 client.15231 ms_handle_reset on v2:172.21.15.171:6838/1466585795 2024-08-19T00:13:08.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.842+0000 7f53d6b07740 1 -- 172.21.15.44:0/3477619048 >> 172.21.15.44:0/3477619048 conn(0x55eb97a83bc0 msgr2=0x55eb97a82d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:08.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.842+0000 7f53d6b07740 1 -- 172.21.15.44:0/3477619048 shutdown_connections 2024-08-19T00:13:08.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.842+0000 7f53d6b07740 1 -- 172.21.15.44:0/3477619048 wait complete. 2024-08-19T00:13:08.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.842+0000 7f53d6b07740 20 client.15231 trim_cache size 0 max 16384 2024-08-19T00:13:08.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.860+0000 7f53d6b07740 1 Processor -- start 2024-08-19T00:13:08.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.860+0000 7f53d6b07740 1 -- start start 2024-08-19T00:13:08.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.860+0000 7f53d6b07740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb97a87630 0x55eb97a91e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:08.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.860+0000 7f53d6b07740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb97a87f50 0x55eb97a8fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:08.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.860+0000 7f53d6b07740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eb97a92810 0x55eb97a90190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:08.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.860+0000 7f53d6b07740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55eb97aa2960 con 0x55eb97a87630 2024-08-19T00:13:08.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.860+0000 7f53d6b07740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55eb97aa3030 con 0x55eb97a87f50 2024-08-19T00:13:08.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.860+0000 7f53d6b07740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55eb97aa3700 con 0x55eb97a92810 2024-08-19T00:13:08.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.861+0000 7f53d24a5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb97a87630 0x55eb97a91e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:08.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.861+0000 7f53d24a5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb97a87630 0x55eb97a91e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41594/0 (socket says 172.21.15.44:41594) 2024-08-19T00:13:08.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.861+0000 7f53d24a5640 1 -- 172.21.15.44:0/2032351621 learned_addr learned my addr 172.21.15.44:0/2032351621 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:08.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.861+0000 7f53d24a5640 1 -- 172.21.15.44:0/2032351621 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eb97a92810 msgr2=0x55eb97a90190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:08.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.861+0000 7f53d24a5640 1 --2- 172.21.15.44:0/2032351621 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eb97a92810 0x55eb97a90190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:08.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.861+0000 7f53d24a5640 1 -- 172.21.15.44:0/2032351621 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb97a87f50 msgr2=0x55eb97a8fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:08.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.861+0000 7f53d24a5640 1 --2- 172.21.15.44:0/2032351621 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb97a87f50 0x55eb97a8fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:08.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.861+0000 7f53d24a5640 1 -- 172.21.15.44:0/2032351621 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb97a7f130 con 0x55eb97a87630 2024-08-19T00:13:08.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.861+0000 7f53d24a5640 1 --2- 172.21.15.44:0/2032351621 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb97a87630 0x55eb97a91e60 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f53c802a9a0 tx=0x7f53c8009520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da451571f1f4f955 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:08.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.861+0000 7f53b7fff640 1 -- 172.21.15.44:0/2032351621 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c805e070 con 0x55eb97a87630 2024-08-19T00:13:08.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.861+0000 7f53b7fff640 1 -- 172.21.15.44:0/2032351621 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53c804c070 con 0x55eb97a87630 2024-08-19T00:13:08.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.861+0000 7f53b7fff640 1 -- 172.21.15.44:0/2032351621 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c8035070 con 0x55eb97a87630 2024-08-19T00:13:08.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.862+0000 7f53d6b07740 1 -- 172.21.15.44:0/2032351621 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb97a87630 msgr2=0x55eb97a91e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:08.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.862+0000 7f53d6b07740 1 --2- 172.21.15.44:0/2032351621 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb97a87630 0x55eb97a91e60 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f53c802a9a0 tx=0x7f53c8009520 comp rx=0 tx=0).stop 2024-08-19T00:13:08.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.862+0000 7f53d6b07740 1 -- 172.21.15.44:0/2032351621 shutdown_connections 2024-08-19T00:13:08.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.862+0000 7f53d6b07740 1 --2- 172.21.15.44:0/2032351621 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eb97a92810 0x55eb97a90190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:08.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.862+0000 7f53d6b07740 1 --2- 172.21.15.44:0/2032351621 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb97a87f50 0x55eb97a8fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:08.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.862+0000 7f53d6b07740 1 --2- 172.21.15.44:0/2032351621 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb97a87630 0x55eb97a91e60 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:08.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.862+0000 7f53d6b07740 1 -- 172.21.15.44:0/2032351621 >> 172.21.15.44:0/2032351621 conn(0x55eb97a83bc0 msgr2=0x55eb97a9dfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:08.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.862+0000 7f53d6b07740 1 -- 172.21.15.44:0/2032351621 shutdown_connections 2024-08-19T00:13:08.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.862+0000 7f53d6b07740 1 -- 172.21.15.44:0/2032351621 wait complete. 2024-08-19T00:13:08.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.862+0000 7f53d6b07740 1 -- start start 2024-08-19T00:13:08.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.862+0000 7f53d6b07740 1 Processor -- start 2024-08-19T00:13:08.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.863+0000 7f53d6b07740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb97a87630 0x55eb97aac880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:08.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.863+0000 7f53d6b07740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eb97a87f50 0x55eb97aacdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:08.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.863+0000 7f53d6b07740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb97a92810 0x55eb97aa7830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:08.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.863+0000 7f53d6b07740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55eb97aa44a0 con 0x55eb97a87630 2024-08-19T00:13:08.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.863+0000 7f53d6b07740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55eb97aa3dd0 con 0x55eb97a92810 2024-08-19T00:13:08.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.863+0000 7f53d6b07740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55eb97aa4b70 con 0x55eb97a87f50 2024-08-19T00:13:08.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.863+0000 7f53d6b07740 10 client.0 _ll_register_callbacks cb 0x7f53c8005de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:13:08.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.863+0000 7f53d24a5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb97a87630 0x55eb97aac880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:08.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.863+0000 7f53d24a5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb97a87630 0x55eb97aac880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41596/0 (socket says 172.21.15.44:41596) 2024-08-19T00:13:08.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.863+0000 7f53d24a5640 1 -- 172.21.15.44:0/1383709353 learned_addr learned my addr 172.21.15.44:0/1383709353 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:08.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.863+0000 7f53d2ca6640 1 --2- 172.21.15.44:0/1383709353 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb97a92810 0x55eb97aa7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:08.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.863+0000 7f53d24a5640 1 -- 172.21.15.44:0/1383709353 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eb97a87f50 msgr2=0x55eb97aacdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:08.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.863+0000 7f53d24a5640 1 --2- 172.21.15.44:0/1383709353 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eb97a87f50 0x55eb97aacdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:08.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.863+0000 7f53d24a5640 1 -- 172.21.15.44:0/1383709353 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb97a92810 msgr2=0x55eb97aa7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:08.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.863+0000 7f53d24a5640 1 --2- 172.21.15.44:0/1383709353 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb97a92810 0x55eb97aa7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:08.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.863+0000 7f53d24a5640 1 -- 172.21.15.44:0/1383709353 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb97aa7d70 con 0x55eb97a87630 2024-08-19T00:13:08.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.863+0000 7f53d2ca6640 1 --2- 172.21.15.44:0/1383709353 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb97a92810 0x55eb97aa7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:13:08.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.864+0000 7f53d24a5640 1 --2- 172.21.15.44:0/1383709353 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb97a87630 0x55eb97aac880 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f53c8006010 tx=0x7f53c802a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ed4e7f5bc400b84 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:08.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.864+0000 7f53b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:13:08.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.864+0000 7f53b5ffb640 1 -- 172.21.15.44:0/1383709353 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c805e030 con 0x55eb97a87630 2024-08-19T00:13:08.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.864+0000 7f53b5ffb640 1 -- 172.21.15.44:0/1383709353 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9187+0+0 (secure 0 0 0) 0x7f53c80315b0 con 0x55eb97a87630 2024-08-19T00:13:08.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.864+0000 7f53d6b07740 1 -- 172.21.15.44:0/1383709353 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53c804c070 con 0x55eb97a87630 2024-08-19T00:13:08.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.864+0000 7f53b5ffb640 1 -- 172.21.15.44:0/1383709353 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f53c8035040 con 0x55eb97a87630 2024-08-19T00:13:08.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.864+0000 7f53d6b07740 10 client.15237 fetch_fsmap learned FSMap version 27 2024-08-19T00:13:08.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.864+0000 7f53d6b07740 1 -- 172.21.15.44:0/1383709353 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55eb97b0dfd0 con 0x55eb97a87630 2024-08-19T00:13:08.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.864+0000 7f53b5ffb640 1 -- 172.21.15.44:0/1383709353 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53c804c070 con 0x55eb97a87630 2024-08-19T00:13:08.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.864+0000 7f53b5ffb640 1 -- 172.21.15.44:0/1383709353 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f53c8051450 con 0x55eb97a87630 2024-08-19T00:13:08.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.864+0000 7f53d6b07740 10 client.15237 fetch_fsmap finished waiting for FSMap version 27 2024-08-19T00:13:08.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.864+0000 7f53d6b07740 10 client.15237 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-19T00:13:08.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.864+0000 7f53d6b07740 20 client.15237 populate_metadata read hostname 'smithi044' 2024-08-19T00:13:08.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.864+0000 7f53d6b07740 1 --2- 172.21.15.44:0/1383709353 >> [v2:172.21.15.171:6838/1466585795,v1:172.21.15.171:6839/1466585795] conn(0x55eb97aa31b0 0x55eb97b11310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:08.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.864+0000 7f53d6b07740 4 client.15237 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-19T00:13:08.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.864+0000 7f53d6b07740 1 -- 172.21.15.44:0/1383709353 --> [v2:172.21.15.171:6838/1466585795,v1:172.21.15.171:6839/1466585795] -- command(tid 0: {"prefix": "status"}) -- 0x55eb979f4190 con 0x55eb97aa31b0 2024-08-19T00:13:08.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.865+0000 7f53d1ca4640 1 --2- 172.21.15.44:0/1383709353 >> [v2:172.21.15.171:6838/1466585795,v1:172.21.15.171:6839/1466585795] conn(0x55eb97aa31b0 0x55eb97b11310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:08.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.866+0000 7f53d1ca4640 1 --2- 172.21.15.44:0/1383709353 >> [v2:172.21.15.171:6838/1466585795,v1:172.21.15.171:6839/1466585795] conn(0x55eb97aa31b0 0x55eb97b11310 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bc2769ad8e7b22d7 server_cookie=b9fb957180365b9 in_seq=0 out_seq=0 2024-08-19T00:13:08.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.866+0000 7f53b5ffb640 10 client.15237 ms_handle_connect on v2:172.21.15.171:6838/1466585795 2024-08-19T00:13:08.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.867+0000 7f53b5ffb640 1 -- 172.21.15.44:0/1383709353 <== mds.2 v2:172.21.15.171:6838/1466585795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55eb979f4190 con 0x55eb97aa31b0 2024-08-19T00:13:08.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.867+0000 7f53b5ffb640 10 client.15237 handle_command_reply: tid=0 2024-08-19T00:13:08.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.867+0000 7f53d6b07740 1 client.15237 shutdown 2024-08-19T00:13:08.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.867+0000 7f53d6b07740 1 -- 172.21.15.44:0/1383709353 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb97a87630 msgr2=0x55eb97aac880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:08.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.867+0000 7f53d6b07740 1 --2- 172.21.15.44:0/1383709353 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb97a87630 0x55eb97aac880 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f53c8006010 tx=0x7f53c802a480 comp rx=0 tx=0).stop 2024-08-19T00:13:08.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.867+0000 7f53d6b07740 1 -- 172.21.15.44:0/1383709353 shutdown_connections 2024-08-19T00:13:08.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.867+0000 7f53d6b07740 1 --2- 172.21.15.44:0/1383709353 >> [v2:172.21.15.171:6838/1466585795,v1:172.21.15.171:6839/1466585795] conn(0x55eb97aa31b0 0x55eb97b11310 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:08.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.867+0000 7f53b5ffb640 0 client.15237 ms_handle_reset on v2:172.21.15.171:6838/1466585795 2024-08-19T00:13:08.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.867+0000 7f53d6b07740 1 --2- 172.21.15.44:0/1383709353 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eb97a87f50 0x55eb97aacdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:08.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.867+0000 7f53d6b07740 1 --2- 172.21.15.44:0/1383709353 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb97a92810 0x55eb97aa7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:08.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.867+0000 7f53d6b07740 1 --2- 172.21.15.44:0/1383709353 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb97a87630 0x55eb97aac880 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:08.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.867+0000 7f53d6b07740 1 -- 172.21.15.44:0/1383709353 >> 172.21.15.44:0/1383709353 conn(0x55eb97a83bc0 msgr2=0x55eb97a82520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:08.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.867+0000 7f53d6b07740 1 -- 172.21.15.44:0/1383709353 shutdown_connections 2024-08-19T00:13:08.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.867+0000 7f53d6b07740 1 -- 172.21.15.44:0/1383709353 wait complete. 2024-08-19T00:13:08.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.867+0000 7f53d6b07740 20 client.15237 trim_cache size 0 max 16384 2024-08-19T00:13:08.872 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-08-19T00:13:08.872 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "647ded64-5dbe-11ef-bccf-c7b262605968", 2024-08-19T00:13:08.872 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 2, 2024-08-19T00:13:08.872 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 24439, 2024-08-19T00:13:08.873 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-08-19T00:13:08.873 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-08-19T00:13:08.873 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-08-19T00:13:08.873 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 94.997274000000004, 2024-08-19T00:13:08.873 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 27, 2024-08-19T00:13:08.873 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 94, 2024-08-19T00:13:08.873 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 90, 2024-08-19T00:13:08.873 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 156.174101931 2024-08-19T00:13:08.873 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-08-19T00:13:08.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.867+0000 7f53d4709640 1 -- 172.21.15.44:0/3168713400 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f53b80a2c10 msgr2=0x7f53b80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:08.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.867+0000 7f53d4709640 1 --2- 172.21.15.44:0/3168713400 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f53b80a2c10 0x7f53b80a50d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f53c4009fd0 tx=0x7f53c4005bd0 comp rx=0 tx=0).stop 2024-08-19T00:13:08.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.867+0000 7f53d4709640 1 -- 172.21.15.44:0/3168713400 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53cc1033f0 msgr2=0x7f53cc19a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:08.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.867+0000 7f53d4709640 1 --2- 172.21.15.44:0/3168713400 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53cc1033f0 0x7f53cc19a8c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f53bc00d770 tx=0x7f53bc00dc30 comp rx=0 tx=0).stop 2024-08-19T00:13:08.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.868+0000 7f53d4709640 1 -- 172.21.15.44:0/3168713400 shutdown_connections 2024-08-19T00:13:08.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.868+0000 7f53d4709640 1 --2- 172.21.15.44:0/3168713400 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f53b80a2c10 0x7f53b80a50d0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:08.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.868+0000 7f53d4709640 1 --2- 172.21.15.44:0/3168713400 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f53cc10beb0 0x7f53cc19ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:08.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.868+0000 7f53d4709640 1 --2- 172.21.15.44:0/3168713400 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53cc1033f0 0x7f53cc19a8c0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:08.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.868+0000 7f53d4709640 1 --2- 172.21.15.44:0/3168713400 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f53cc102ad0 0x7f53cc19a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:08.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.868+0000 7f53d4709640 1 -- 172.21.15.44:0/3168713400 >> 172.21.15.44:0/3168713400 conn(0x7f53cc0fc4d0 msgr2=0x7f53cc100660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:08.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.868+0000 7f53d4709640 1 -- 172.21.15.44:0/3168713400 shutdown_connections 2024-08-19T00:13:08.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:08.868+0000 7f53d4709640 1 -- 172.21.15.44:0/3168713400 wait complete. 2024-08-19T00:13:09.638 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph tell mds.h status 2024-08-19T00:13:09.899 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:13:10.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.397+0000 7ff7f1d4b640 1 -- 172.21.15.44:0/2201412784 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff7ec102c20 msgr2=0x7ff7ec10d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:10.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.397+0000 7ff7f1d4b640 1 --2- 172.21.15.44:0/2201412784 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff7ec102c20 0x7ff7ec10d770 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7ff7e4009900 tx=0x7ff7e402a480 comp rx=0 tx=0).stop 2024-08-19T00:13:10.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.397+0000 7ff7f1d4b640 1 -- 172.21.15.44:0/2201412784 shutdown_connections 2024-08-19T00:13:10.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.397+0000 7ff7f1d4b640 1 --2- 172.21.15.44:0/2201412784 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff7ec102c20 0x7ff7ec10d770 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:10.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.397+0000 7ff7f1d4b640 1 --2- 172.21.15.44:0/2201412784 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff7ec1022a0 0x7ff7ec1026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:10.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.397+0000 7ff7f1d4b640 1 --2- 172.21.15.44:0/2201412784 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff7ec100b50 0x7ff7ec100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:10.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.397+0000 7ff7f1d4b640 1 -- 172.21.15.44:0/2201412784 >> 172.21.15.44:0/2201412784 conn(0x7ff7ec0fc500 msgr2=0x7ff7ec0fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:10.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.397+0000 7ff7f1d4b640 1 -- 172.21.15.44:0/2201412784 shutdown_connections 2024-08-19T00:13:10.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.397+0000 7ff7f1d4b640 1 -- 172.21.15.44:0/2201412784 wait complete. 2024-08-19T00:13:10.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.397+0000 7ff7f1d4b640 1 Processor -- start 2024-08-19T00:13:10.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.398+0000 7ff7f1d4b640 1 -- start start 2024-08-19T00:13:10.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.398+0000 7ff7f1d4b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff7ec100b50 0x7ff7ec198fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:10.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.398+0000 7ff7f1d4b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff7ec1022a0 0x7ff7ec199510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:10.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.398+0000 7ff7f1d4b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff7ec102c20 0x7ff7ec1a4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:10.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.398+0000 7ff7f1d4b640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ec110cd0 con 0x7ff7ec100b50 2024-08-19T00:13:10.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.398+0000 7ff7f1d4b640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ec110b50 con 0x7ff7ec1022a0 2024-08-19T00:13:10.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.398+0000 7ff7f1d4b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ec110e50 con 0x7ff7ec102c20 2024-08-19T00:13:10.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.398+0000 7ff7eb7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff7ec100b50 0x7ff7ec198fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:10.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.398+0000 7ff7eb7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff7ec100b50 0x7ff7ec198fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41600/0 (socket says 172.21.15.44:41600) 2024-08-19T00:13:10.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.398+0000 7ff7eb7fe640 1 -- 172.21.15.44:0/3966991144 learned_addr learned my addr 172.21.15.44:0/3966991144 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:10.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.398+0000 7ff7ebfff640 1 --2- 172.21.15.44:0/3966991144 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff7ec102c20 0x7ff7ec1a4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:10.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.398+0000 7ff7eaffd640 1 --2- 172.21.15.44:0/3966991144 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff7ec1022a0 0x7ff7ec199510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:10.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.398+0000 7ff7eb7fe640 1 -- 172.21.15.44:0/3966991144 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff7ec102c20 msgr2=0x7ff7ec1a4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:10.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.398+0000 7ff7eb7fe640 1 --2- 172.21.15.44:0/3966991144 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff7ec102c20 0x7ff7ec1a4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:10.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.398+0000 7ff7eb7fe640 1 -- 172.21.15.44:0/3966991144 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff7ec1022a0 msgr2=0x7ff7ec199510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:10.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.398+0000 7ff7eb7fe640 1 --2- 172.21.15.44:0/3966991144 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff7ec1022a0 0x7ff7ec199510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:10.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.398+0000 7ff7eb7fe640 1 -- 172.21.15.44:0/3966991144 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7ec1a4590 con 0x7ff7ec100b50 2024-08-19T00:13:10.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.399+0000 7ff7eb7fe640 1 --2- 172.21.15.44:0/3966991144 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff7ec100b50 0x7ff7ec198fd0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc00ba50 tx=0x7ff7dc00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:10.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.399+0000 7ff7e8ff9640 1 -- 172.21.15.44:0/3966991144 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc019070 con 0x7ff7ec100b50 2024-08-19T00:13:10.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.399+0000 7ff7e8ff9640 1 -- 172.21.15.44:0/3966991144 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7dc014440 con 0x7ff7ec100b50 2024-08-19T00:13:10.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.399+0000 7ff7f1d4b640 1 -- 172.21.15.44:0/3966991144 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7ec1a4760 con 0x7ff7ec100b50 2024-08-19T00:13:10.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.399+0000 7ff7e8ff9640 1 -- 172.21.15.44:0/3966991144 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc0075d0 con 0x7ff7ec100b50 2024-08-19T00:13:10.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.399+0000 7ff7f1d4b640 1 -- 172.21.15.44:0/3966991144 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7ec1a4c70 con 0x7ff7ec100b50 2024-08-19T00:13:10.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.401+0000 7ff7e8ff9640 1 -- 172.21.15.44:0/3966991144 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7ff7dc01c070 con 0x7ff7ec100b50 2024-08-19T00:13:10.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.401+0000 7ff7f4149740 1 Processor -- start 2024-08-19T00:13:10.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.401+0000 7ff7f4149740 1 -- start start 2024-08-19T00:13:10.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.402+0000 7ff7e8ff9640 1 --2- 172.21.15.44:0/3966991144 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7ff7d40a2b80 0x7ff7d40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:10.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.402+0000 7ff7f4149740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db4e565630 0x55db4e565a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:10.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.402+0000 7ff7f4149740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55db4e565f50 0x55db4e5702d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:10.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.402+0000 7ff7f4149740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55db4e570810 0x55db4e572c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:10.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.402+0000 7ff7f4149740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55db4e4ca710 con 0x55db4e565630 2024-08-19T00:13:10.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.402+0000 7ff7f4149740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55db4e462770 con 0x55db4e565f50 2024-08-19T00:13:10.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.402+0000 7ff7f4149740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55db4e4c66d0 con 0x55db4e570810 2024-08-19T00:13:10.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.402+0000 7ff7ebfff640 1 --2- 172.21.15.44:0/3966991144 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7ff7d40a2b80 0x7ff7d40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:10.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.402+0000 7ff7eb7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db4e565630 0x55db4e565a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:10.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.402+0000 7ff7eb7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db4e565630 0x55db4e565a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41614/0 (socket says 172.21.15.44:41614) 2024-08-19T00:13:10.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.402+0000 7ff7eb7fe640 1 -- 172.21.15.44:0/1740928797 learned_addr learned my addr 172.21.15.44:0/1740928797 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:10.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.402+0000 7ff7e8ff9640 1 -- 172.21.15.44:0/3966991144 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9187+0+0 (secure 0 0 0) 0x7ff7dc0ce950 con 0x7ff7ec100b50 2024-08-19T00:13:10.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.402+0000 7ff7eaffd640 1 --2- 172.21.15.44:0/1740928797 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55db4e565f50 0x55db4e5702d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:10.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.402+0000 7ff7ebfff640 1 --2- 172.21.15.44:0/1740928797 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55db4e570810 0x55db4e572c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:10.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.402+0000 7ff7eb7fe640 1 -- 172.21.15.44:0/1740928797 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55db4e570810 msgr2=0x55db4e572c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:10.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.402+0000 7ff7eb7fe640 1 --2- 172.21.15.44:0/1740928797 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55db4e570810 0x55db4e572c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:10.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.402+0000 7ff7eb7fe640 1 -- 172.21.15.44:0/1740928797 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55db4e565f50 msgr2=0x55db4e5702d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:10.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.402+0000 7ff7eb7fe640 1 --2- 172.21.15.44:0/1740928797 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55db4e565f50 0x55db4e5702d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:10.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.402+0000 7ff7eb7fe640 1 -- 172.21.15.44:0/1740928797 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db4e4693e0 con 0x55db4e565630 2024-08-19T00:13:10.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.402+0000 7ff7eaffd640 1 --2- 172.21.15.44:0/1740928797 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55db4e565f50 0x55db4e5702d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:13:10.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.402+0000 7ff7eb7fe640 1 --2- 172.21.15.44:0/1740928797 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db4e565630 0x55db4e565a10 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc014d20 tx=0x7ff7dc017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce1eaa7ec61f67fb server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:10.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.402+0000 7ff7ebfff640 1 --2- 172.21.15.44:0/3966991144 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7ff7d40a2b80 0x7ff7d40a5040 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff7e40096c0 tx=0x7ff7e4004470 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:10.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.402+0000 7ff7d1ffb640 1 -- 172.21.15.44:0/1740928797 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc00f160 con 0x55db4e565630 2024-08-19T00:13:10.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.402+0000 7ff7d1ffb640 1 -- 172.21.15.44:0/1740928797 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7dc09aea0 con 0x55db4e565630 2024-08-19T00:13:10.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.403+0000 7ff7d1ffb640 1 -- 172.21.15.44:0/1740928797 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc0bc250 con 0x55db4e565630 2024-08-19T00:13:10.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.403+0000 7ff7f4149740 1 -- 172.21.15.44:0/1740928797 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db4e565630 msgr2=0x55db4e565a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:10.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.403+0000 7ff7f4149740 1 --2- 172.21.15.44:0/1740928797 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db4e565630 0x55db4e565a10 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc014d20 tx=0x7ff7dc017e30 comp rx=0 tx=0).stop 2024-08-19T00:13:10.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.403+0000 7ff7f4149740 1 -- 172.21.15.44:0/1740928797 shutdown_connections 2024-08-19T00:13:10.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.403+0000 7ff7f4149740 1 --2- 172.21.15.44:0/1740928797 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55db4e570810 0x55db4e572c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:10.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.403+0000 7ff7f4149740 1 --2- 172.21.15.44:0/1740928797 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55db4e565f50 0x55db4e5702d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:10.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.403+0000 7ff7f4149740 1 --2- 172.21.15.44:0/1740928797 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db4e565630 0x55db4e565a10 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:10.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.403+0000 7ff7f4149740 1 -- 172.21.15.44:0/1740928797 >> 172.21.15.44:0/1740928797 conn(0x55db4e561bc0 msgr2=0x55db4e561fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:10.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.403+0000 7ff7f4149740 1 -- 172.21.15.44:0/1740928797 shutdown_connections 2024-08-19T00:13:10.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.403+0000 7ff7f4149740 1 -- 172.21.15.44:0/1740928797 wait complete. 2024-08-19T00:13:10.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.404+0000 7ff7f4149740 1 -- start start 2024-08-19T00:13:10.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.404+0000 7ff7f4149740 1 Processor -- start 2024-08-19T00:13:10.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.404+0000 7ff7f4149740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55db4e565630 0x55db4e56d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:10.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.404+0000 7ff7f4149740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55db4e565f50 0x55db4e56dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:10.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.404+0000 7ff7f4149740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db4e570810 0x55db4e56e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:10.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.404+0000 7ff7f4149740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55db4e5777f0 con 0x55db4e570810 2024-08-19T00:13:10.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.404+0000 7ff7f4149740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55db4e485970 con 0x55db4e565f50 2024-08-19T00:13:10.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.404+0000 7ff7f4149740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55db4e577970 con 0x55db4e565630 2024-08-19T00:13:10.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.404+0000 7ff7f4149740 10 client.0 _ll_register_callbacks cb 0x55db4e1d97b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:13:10.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.404+0000 7ff7ebfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db4e570810 0x55db4e56e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:10.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.404+0000 7ff7ebfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db4e570810 0x55db4e56e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41628/0 (socket says 172.21.15.44:41628) 2024-08-19T00:13:10.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.404+0000 7ff7ebfff640 1 -- 172.21.15.44:0/1127694793 learned_addr learned my addr 172.21.15.44:0/1127694793 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:10.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.404+0000 7ff7eaffd640 1 --2- 172.21.15.44:0/1127694793 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55db4e565f50 0x55db4e56dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:10.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.404+0000 7ff7eb7fe640 1 --2- 172.21.15.44:0/1127694793 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55db4e565630 0x55db4e56d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:10.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.405+0000 7ff7ebfff640 1 -- 172.21.15.44:0/1127694793 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55db4e565630 msgr2=0x55db4e56d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:10.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.405+0000 7ff7ebfff640 1 --2- 172.21.15.44:0/1127694793 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55db4e565630 0x55db4e56d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:10.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.405+0000 7ff7ebfff640 1 -- 172.21.15.44:0/1127694793 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55db4e565f50 msgr2=0x55db4e56dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:10.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.405+0000 7ff7ebfff640 1 --2- 172.21.15.44:0/1127694793 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55db4e565f50 0x55db4e56dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:10.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.405+0000 7ff7ebfff640 1 -- 172.21.15.44:0/1127694793 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db4e23c2b0 con 0x55db4e570810 2024-08-19T00:13:10.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.405+0000 7ff7ebfff640 1 --2- 172.21.15.44:0/1127694793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db4e570810 0x55db4e56e1a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff7e4033000 tx=0x7ff7e402a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e3bfa7bae85a593 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:10.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.405+0000 7ff7caffd640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:13:10.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.405+0000 7ff7caffd640 1 -- 172.21.15.44:0/1127694793 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e4035050 con 0x55db4e570810 2024-08-19T00:13:10.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.405+0000 7ff7f4149740 1 -- 172.21.15.44:0/1127694793 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff7dc09aea0 con 0x55db4e570810 2024-08-19T00:13:10.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.405+0000 7ff7caffd640 1 -- 172.21.15.44:0/1127694793 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9187+0+0 (secure 0 0 0) 0x7ff7e4003b80 con 0x55db4e570810 2024-08-19T00:13:10.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.405+0000 7ff7caffd640 1 -- 172.21.15.44:0/1127694793 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff7e405b050 con 0x55db4e570810 2024-08-19T00:13:10.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.405+0000 7ff7f4149740 10 client.15249 fetch_fsmap learned FSMap version 27 2024-08-19T00:13:10.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.405+0000 7ff7f4149740 1 -- 172.21.15.44:0/1127694793 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55db4e583420 con 0x55db4e570810 2024-08-19T00:13:10.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.405+0000 7ff7caffd640 1 -- 172.21.15.44:0/1127694793 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7dc09aea0 con 0x55db4e570810 2024-08-19T00:13:10.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.405+0000 7ff7caffd640 1 -- 172.21.15.44:0/1127694793 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7ff7e404a3f0 con 0x55db4e570810 2024-08-19T00:13:10.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.406+0000 7ff7f4149740 10 client.15249 fetch_fsmap finished waiting for FSMap version 27 2024-08-19T00:13:10.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.406+0000 7ff7f4149740 10 client.15249 resolve_mds: resolved name 'h' to daemon mds.h 2024-08-19T00:13:10.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.406+0000 7ff7f4149740 20 client.15249 populate_metadata read hostname 'smithi044' 2024-08-19T00:13:10.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.406+0000 7ff7f4149740 1 --2- 172.21.15.44:0/1127694793 >> [v2:172.21.15.116:6836/2764513846,v1:172.21.15.116:6837/2764513846] conn(0x55db4e585b20 0x55db4e586f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:10.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.406+0000 7ff7f4149740 4 client.15249 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:13:10.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.406+0000 7ff7f4149740 1 -- 172.21.15.44:0/1127694793 --> [v2:172.21.15.116:6836/2764513846,v1:172.21.15.116:6837/2764513846] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55db4e4d7c80 con 0x55db4e585b20 2024-08-19T00:13:10.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.406+0000 7ff7eb7fe640 1 --2- 172.21.15.44:0/1127694793 >> [v2:172.21.15.116:6836/2764513846,v1:172.21.15.116:6837/2764513846] conn(0x55db4e585b20 0x55db4e586f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:10.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.406+0000 7ff7eb7fe640 1 --2- 172.21.15.44:0/1127694793 >> [v2:172.21.15.116:6836/2764513846,v1:172.21.15.116:6837/2764513846] conn(0x55db4e585b20 0x55db4e586f90 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a24e2984e9d98179 server_cookie=c7e68834c058d55 in_seq=0 out_seq=0 2024-08-19T00:13:10.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.406+0000 7ff7caffd640 10 client.15249 ms_handle_connect on v2:172.21.15.116:6836/2764513846 2024-08-19T00:13:10.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.407+0000 7ff7caffd640 1 -- 172.21.15.44:0/1127694793 <== mds.1 v2:172.21.15.116:6836/2764513846 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55db4e4d7c80 con 0x55db4e585b20 2024-08-19T00:13:10.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.407+0000 7ff7caffd640 10 client.15249 handle_command_reply: tid=0 2024-08-19T00:13:10.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.407+0000 7ff7f4149740 1 client.15249 shutdown 2024-08-19T00:13:10.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.407+0000 7ff7f4149740 1 -- 172.21.15.44:0/1127694793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db4e570810 msgr2=0x55db4e56e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:10.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.407+0000 7ff7f4149740 1 --2- 172.21.15.44:0/1127694793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db4e570810 0x55db4e56e1a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff7e4033000 tx=0x7ff7e402a480 comp rx=0 tx=0).stop 2024-08-19T00:13:10.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.408+0000 7ff7f4149740 1 -- 172.21.15.44:0/1127694793 shutdown_connections 2024-08-19T00:13:10.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.408+0000 7ff7f4149740 1 --2- 172.21.15.44:0/1127694793 >> [v2:172.21.15.116:6836/2764513846,v1:172.21.15.116:6837/2764513846] conn(0x55db4e585b20 0x55db4e586f90 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:10.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.408+0000 7ff7f4149740 1 --2- 172.21.15.44:0/1127694793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db4e570810 0x55db4e56e1a0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:10.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.408+0000 7ff7f4149740 1 --2- 172.21.15.44:0/1127694793 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55db4e565f50 0x55db4e56dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:10.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.408+0000 7ff7f4149740 1 --2- 172.21.15.44:0/1127694793 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55db4e565630 0x55db4e56d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:10.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.408+0000 7ff7caffd640 0 client.15249 ms_handle_reset on v2:172.21.15.116:6836/2764513846 2024-08-19T00:13:10.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.408+0000 7ff7f4149740 1 -- 172.21.15.44:0/1127694793 >> 172.21.15.44:0/1127694793 conn(0x55db4e561bc0 msgr2=0x55db4e5678f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:10.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.408+0000 7ff7f4149740 1 -- 172.21.15.44:0/1127694793 shutdown_connections 2024-08-19T00:13:10.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.408+0000 7ff7f4149740 1 -- 172.21.15.44:0/1127694793 wait complete. 2024-08-19T00:13:10.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.408+0000 7ff7f4149740 20 client.15249 trim_cache size 0 max 16384 2024-08-19T00:13:10.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.426+0000 7ff7f4149740 1 Processor -- start 2024-08-19T00:13:10.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.426+0000 7ff7f4149740 1 -- start start 2024-08-19T00:13:10.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.426+0000 7ff7f4149740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55db4e565630 0x55db4e568090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:10.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.426+0000 7ff7f4149740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55db4e565f50 0x55db4e56bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:10.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.426+0000 7ff7f4149740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db4e570810 0x55db4e56c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:10.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.426+0000 7ff7f4149740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55db4e5852d0 con 0x55db4e570810 2024-08-19T00:13:10.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.426+0000 7ff7f4149740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55db4e5859a0 con 0x55db4e565f50 2024-08-19T00:13:10.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.426+0000 7ff7f4149740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55db4e586070 con 0x55db4e565630 2024-08-19T00:13:10.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.426+0000 7ff7ebfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db4e570810 0x55db4e56c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:10.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.426+0000 7ff7ebfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db4e570810 0x55db4e56c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41640/0 (socket says 172.21.15.44:41640) 2024-08-19T00:13:10.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.426+0000 7ff7ebfff640 1 -- 172.21.15.44:0/3916906654 learned_addr learned my addr 172.21.15.44:0/3916906654 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:10.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.426+0000 7ff7eaffd640 1 --2- 172.21.15.44:0/3916906654 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55db4e565f50 0x55db4e56bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:10.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.426+0000 7ff7eb7fe640 1 --2- 172.21.15.44:0/3916906654 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55db4e565630 0x55db4e568090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:10.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.426+0000 7ff7ebfff640 1 -- 172.21.15.44:0/3916906654 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55db4e565630 msgr2=0x55db4e568090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:10.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.426+0000 7ff7ebfff640 1 --2- 172.21.15.44:0/3916906654 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55db4e565630 0x55db4e568090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:10.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.426+0000 7ff7ebfff640 1 -- 172.21.15.44:0/3916906654 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55db4e565f50 msgr2=0x55db4e56bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:10.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.426+0000 7ff7ebfff640 1 --2- 172.21.15.44:0/3916906654 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55db4e565f50 0x55db4e56bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:10.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.426+0000 7ff7ebfff640 1 -- 172.21.15.44:0/3916906654 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db4e55d130 con 0x55db4e570810 2024-08-19T00:13:10.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.426+0000 7ff7eaffd640 1 --2- 172.21.15.44:0/3916906654 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55db4e565f50 0x55db4e56bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:13:10.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.427+0000 7ff7ebfff640 1 --2- 172.21.15.44:0/3916906654 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db4e570810 0x55db4e56c530 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ff7e4005c40 tx=0x7ff7e4009230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c64d32c6d36c98 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:10.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.427+0000 7ff7d17fa640 1 -- 172.21.15.44:0/3916906654 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e4035050 con 0x55db4e570810 2024-08-19T00:13:10.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.427+0000 7ff7d17fa640 1 -- 172.21.15.44:0/3916906654 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7e4003e60 con 0x55db4e570810 2024-08-19T00:13:10.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.427+0000 7ff7d17fa640 1 -- 172.21.15.44:0/3916906654 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e405f900 con 0x55db4e570810 2024-08-19T00:13:10.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.427+0000 7ff7f4149740 1 -- 172.21.15.44:0/3916906654 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db4e570810 msgr2=0x55db4e56c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:10.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.427+0000 7ff7f4149740 1 --2- 172.21.15.44:0/3916906654 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db4e570810 0x55db4e56c530 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ff7e4005c40 tx=0x7ff7e4009230 comp rx=0 tx=0).stop 2024-08-19T00:13:10.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.427+0000 7ff7f4149740 1 -- 172.21.15.44:0/3916906654 shutdown_connections 2024-08-19T00:13:10.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.427+0000 7ff7f4149740 1 --2- 172.21.15.44:0/3916906654 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db4e570810 0x55db4e56c530 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:10.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.427+0000 7ff7f4149740 1 --2- 172.21.15.44:0/3916906654 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55db4e565f50 0x55db4e56bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:10.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.427+0000 7ff7f4149740 1 --2- 172.21.15.44:0/3916906654 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55db4e565630 0x55db4e568090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:10.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.427+0000 7ff7f4149740 1 -- 172.21.15.44:0/3916906654 >> 172.21.15.44:0/3916906654 conn(0x55db4e561bc0 msgr2=0x55db4e568a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:10.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.428+0000 7ff7f4149740 1 -- 172.21.15.44:0/3916906654 shutdown_connections 2024-08-19T00:13:10.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.428+0000 7ff7f4149740 1 -- 172.21.15.44:0/3916906654 wait complete. 2024-08-19T00:13:10.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.428+0000 7ff7f4149740 1 -- start start 2024-08-19T00:13:10.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.428+0000 7ff7f4149740 1 Processor -- start 2024-08-19T00:13:10.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.428+0000 7ff7f4149740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55db4e565630 0x55db4e58f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:10.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.428+0000 7ff7f4149740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db4e565f50 0x55db4e588d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:10.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.428+0000 7ff7f4149740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55db4e570810 0x55db4e5892a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:10.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.428+0000 7ff7f4149740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55db4e586e10 con 0x55db4e565f50 2024-08-19T00:13:10.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.428+0000 7ff7f4149740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55db4e586740 con 0x55db4e570810 2024-08-19T00:13:10.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.428+0000 7ff7f4149740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55db4e5874e0 con 0x55db4e565630 2024-08-19T00:13:10.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.429+0000 7ff7f4149740 10 client.0 _ll_register_callbacks cb 0x7ff7e4005b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:13:10.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.429+0000 7ff7eaffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db4e565f50 0x55db4e588d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:10.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.429+0000 7ff7eaffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db4e565f50 0x55db4e588d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41644/0 (socket says 172.21.15.44:41644) 2024-08-19T00:13:10.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.429+0000 7ff7eaffd640 1 -- 172.21.15.44:0/507398137 learned_addr learned my addr 172.21.15.44:0/507398137 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:10.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.429+0000 7ff7eb7fe640 1 --2- 172.21.15.44:0/507398137 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55db4e565630 0x55db4e58f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:10.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.429+0000 7ff7ebfff640 1 --2- 172.21.15.44:0/507398137 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55db4e570810 0x55db4e5892a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:10.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.429+0000 7ff7eaffd640 1 -- 172.21.15.44:0/507398137 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55db4e565630 msgr2=0x55db4e58f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:10.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.429+0000 7ff7eaffd640 1 --2- 172.21.15.44:0/507398137 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55db4e565630 0x55db4e58f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:10.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.429+0000 7ff7eaffd640 1 -- 172.21.15.44:0/507398137 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55db4e570810 msgr2=0x55db4e5892a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:10.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.429+0000 7ff7eaffd640 1 --2- 172.21.15.44:0/507398137 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55db4e570810 0x55db4e5892a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:10.466 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-08-19T00:13:10.466 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "647ded64-5dbe-11ef-bccf-c7b262605968", 2024-08-19T00:13:10.466 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 1, 2024-08-19T00:13:10.466 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 24446, 2024-08-19T00:13:10.466 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-08-19T00:13:10.466 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-08-19T00:13:10.466 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-08-19T00:13:10.467 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 97.569272194000007, 2024-08-19T00:13:10.467 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 27, 2024-08-19T00:13:10.467 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 94, 2024-08-19T00:13:10.467 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 90, 2024-08-19T00:13:10.467 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 160.53785232300001 2024-08-19T00:13:10.467 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-08-19T00:13:10.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.429+0000 7ff7eaffd640 1 -- 172.21.15.44:0/507398137 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db4e589ad0 con 0x55db4e565f50 2024-08-19T00:13:10.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.429+0000 7ff7eaffd640 1 --2- 172.21.15.44:0/507398137 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db4e565f50 0x55db4e588d00 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x55db4e562a20 tx=0x7ff7e0011c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=340e92560119078e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:10.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.429+0000 7ff7caffd640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:13:10.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.429+0000 7ff7caffd640 1 -- 172.21.15.44:0/507398137 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e0010d70 con 0x55db4e565f50 2024-08-19T00:13:10.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.429+0000 7ff7caffd640 1 -- 172.21.15.44:0/507398137 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9187+0+0 (secure 0 0 0) 0x7ff7e001c3f0 con 0x55db4e565f50 2024-08-19T00:13:10.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.429+0000 7ff7f4149740 1 -- 172.21.15.44:0/507398137 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff7e4003e60 con 0x55db4e565f50 2024-08-19T00:13:10.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.429+0000 7ff7caffd640 1 -- 172.21.15.44:0/507398137 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff7e002a050 con 0x55db4e565f50 2024-08-19T00:13:10.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.429+0000 7ff7f4149740 10 client.15255 fetch_fsmap learned FSMap version 27 2024-08-19T00:13:10.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.429+0000 7ff7f4149740 1 -- 172.21.15.44:0/507398137 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55db4e5f0380 con 0x55db4e565f50 2024-08-19T00:13:10.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.430+0000 7ff7caffd640 1 -- 172.21.15.44:0/507398137 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7e4003e60 con 0x55db4e565f50 2024-08-19T00:13:10.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.430+0000 7ff7caffd640 1 -- 172.21.15.44:0/507398137 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7ff7e0025610 con 0x55db4e565f50 2024-08-19T00:13:10.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.430+0000 7ff7f4149740 10 client.15255 fetch_fsmap finished waiting for FSMap version 27 2024-08-19T00:13:10.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.430+0000 7ff7f4149740 10 client.15255 resolve_mds: resolved name 'h' to daemon mds.h 2024-08-19T00:13:10.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.430+0000 7ff7f4149740 20 client.15255 populate_metadata read hostname 'smithi044' 2024-08-19T00:13:10.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.430+0000 7ff7f4149740 1 --2- 172.21.15.44:0/507398137 >> [v2:172.21.15.116:6836/2764513846,v1:172.21.15.116:6837/2764513846] conn(0x55db4e5f5070 0x55db4e5f3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:10.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.430+0000 7ff7f4149740 4 client.15255 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-19T00:13:10.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.430+0000 7ff7f4149740 1 -- 172.21.15.44:0/507398137 --> [v2:172.21.15.116:6836/2764513846,v1:172.21.15.116:6837/2764513846] -- command(tid 0: {"prefix": "status"}) -- 0x55db4e4d2190 con 0x55db4e5f5070 2024-08-19T00:13:10.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.430+0000 7ff7eb7fe640 1 --2- 172.21.15.44:0/507398137 >> [v2:172.21.15.116:6836/2764513846,v1:172.21.15.116:6837/2764513846] conn(0x55db4e5f5070 0x55db4e5f3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:10.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.431+0000 7ff7caffd640 10 client.15255 ms_handle_connect on v2:172.21.15.116:6836/2764513846 2024-08-19T00:13:10.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.431+0000 7ff7eb7fe640 1 --2- 172.21.15.44:0/507398137 >> [v2:172.21.15.116:6836/2764513846,v1:172.21.15.116:6837/2764513846] conn(0x55db4e5f5070 0x55db4e5f3d80 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=672b79cb91e60965 server_cookie=eaba9513543b9366 in_seq=0 out_seq=0 2024-08-19T00:13:10.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.431+0000 7ff7caffd640 1 -- 172.21.15.44:0/507398137 <== mds.1 v2:172.21.15.116:6836/2764513846 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55db4e4d2190 con 0x55db4e5f5070 2024-08-19T00:13:10.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.431+0000 7ff7caffd640 10 client.15255 handle_command_reply: tid=0 2024-08-19T00:13:10.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.431+0000 7ff7f4149740 1 client.15255 shutdown 2024-08-19T00:13:10.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.431+0000 7ff7f4149740 1 -- 172.21.15.44:0/507398137 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db4e565f50 msgr2=0x55db4e588d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:10.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.431+0000 7ff7f4149740 1 --2- 172.21.15.44:0/507398137 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db4e565f50 0x55db4e588d00 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x55db4e562a20 tx=0x7ff7e0011c20 comp rx=0 tx=0).stop 2024-08-19T00:13:10.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.431+0000 7ff7f4149740 1 -- 172.21.15.44:0/507398137 shutdown_connections 2024-08-19T00:13:10.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.431+0000 7ff7f4149740 1 --2- 172.21.15.44:0/507398137 >> [v2:172.21.15.116:6836/2764513846,v1:172.21.15.116:6837/2764513846] conn(0x55db4e5f5070 0x55db4e5f3d80 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:10.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.431+0000 7ff7f4149740 1 --2- 172.21.15.44:0/507398137 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55db4e570810 0x55db4e5892a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:10.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.431+0000 7ff7f4149740 1 --2- 172.21.15.44:0/507398137 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db4e565f50 0x55db4e588d00 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:10.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.431+0000 7ff7caffd640 0 client.15255 ms_handle_reset on v2:172.21.15.116:6836/2764513846 2024-08-19T00:13:10.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.431+0000 7ff7f4149740 1 --2- 172.21.15.44:0/507398137 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55db4e565630 0x55db4e58f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:10.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.431+0000 7ff7f4149740 1 -- 172.21.15.44:0/507398137 >> 172.21.15.44:0/507398137 conn(0x55db4e561bc0 msgr2=0x55db4e56be80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:10.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.431+0000 7ff7f4149740 1 -- 172.21.15.44:0/507398137 shutdown_connections 2024-08-19T00:13:10.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.431+0000 7ff7f4149740 1 -- 172.21.15.44:0/507398137 wait complete. 2024-08-19T00:13:10.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.431+0000 7ff7f4149740 20 client.15255 trim_cache size 0 max 16384 2024-08-19T00:13:10.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.432+0000 7ff7f1d4b640 1 -- 172.21.15.44:0/3966991144 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7ff7d40a2b80 msgr2=0x7ff7d40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:10.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.432+0000 7ff7f1d4b640 1 --2- 172.21.15.44:0/3966991144 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7ff7d40a2b80 0x7ff7d40a5040 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff7e40096c0 tx=0x7ff7e4004470 comp rx=0 tx=0).stop 2024-08-19T00:13:10.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.432+0000 7ff7f1d4b640 1 -- 172.21.15.44:0/3966991144 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff7ec100b50 msgr2=0x7ff7ec198fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:10.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.432+0000 7ff7f1d4b640 1 --2- 172.21.15.44:0/3966991144 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff7ec100b50 0x7ff7ec198fd0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc00ba50 tx=0x7ff7dc00be50 comp rx=0 tx=0).stop 2024-08-19T00:13:10.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.432+0000 7ff7f1d4b640 1 -- 172.21.15.44:0/3966991144 shutdown_connections 2024-08-19T00:13:10.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.432+0000 7ff7f1d4b640 1 --2- 172.21.15.44:0/3966991144 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7ff7d40a2b80 0x7ff7d40a5040 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:10.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.432+0000 7ff7f1d4b640 1 --2- 172.21.15.44:0/3966991144 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff7ec102c20 0x7ff7ec1a4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:10.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.432+0000 7ff7f1d4b640 1 --2- 172.21.15.44:0/3966991144 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff7ec1022a0 0x7ff7ec199510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:10.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.432+0000 7ff7f1d4b640 1 --2- 172.21.15.44:0/3966991144 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff7ec100b50 0x7ff7ec198fd0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:10.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.432+0000 7ff7f1d4b640 1 -- 172.21.15.44:0/3966991144 >> 172.21.15.44:0/3966991144 conn(0x7ff7ec0fc500 msgr2=0x7ff7ec106530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:10.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.432+0000 7ff7f1d4b640 1 -- 172.21.15.44:0/3966991144 shutdown_connections 2024-08-19T00:13:10.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:10.432+0000 7ff7f1d4b640 1 -- 172.21.15.44:0/3966991144 wait complete. 2024-08-19T00:13:10.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:10 smithi171 ceph-mon[21810]: pgmap v339: 129 pgs: 129 active+clean; 645 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-19T00:13:10.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:10 smithi171 ceph-mon[21810]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-08-19T00:13:10.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:10 smithi116 ceph-mon[21873]: pgmap v339: 129 pgs: 129 active+clean; 645 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-19T00:13:10.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:10 smithi116 ceph-mon[21873]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-08-19T00:13:10.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:10 smithi044 ceph-mon[18489]: pgmap v339: 129 pgs: 129 active+clean; 645 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-19T00:13:10.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:10 smithi044 ceph-mon[18489]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-08-19T00:13:11.127 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph tell mds.b status 2024-08-19T00:13:11.382 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:13:11.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.857+0000 7f58a5187640 1 -- 172.21.15.44:0/2092411332 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58a0102260 msgr2=0x7f58a010e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:11.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.857+0000 7f58a5187640 1 --2- 172.21.15.44:0/2092411332 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58a0102260 0x7f58a010e790 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f5898009cd0 tx=0x7f589802a8e0 comp rx=0 tx=0).stop 2024-08-19T00:13:11.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.857+0000 7f58a5187640 1 -- 172.21.15.44:0/2092411332 shutdown_connections 2024-08-19T00:13:11.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.857+0000 7f58a5187640 1 --2- 172.21.15.44:0/2092411332 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58a0102260 0x7f58a010e790 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:11.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.857+0000 7f58a5187640 1 --2- 172.21.15.44:0/2092411332 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f58a01018c0 0x7f58a0101d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:11.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.857+0000 7f58a5187640 1 --2- 172.21.15.44:0/2092411332 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58a01078c0 0x7f58a0107ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:11.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.857+0000 7f58a5187640 1 -- 172.21.15.44:0/2092411332 >> 172.21.15.44:0/2092411332 conn(0x7f58a00fd620 msgr2=0x7f58a00ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:11.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.857+0000 7f58a5187640 1 -- 172.21.15.44:0/2092411332 shutdown_connections 2024-08-19T00:13:11.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.857+0000 7f58a5187640 1 -- 172.21.15.44:0/2092411332 wait complete. 2024-08-19T00:13:11.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.857+0000 7f58a5187640 1 Processor -- start 2024-08-19T00:13:11.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.858+0000 7f58a5187640 1 -- start start 2024-08-19T00:13:11.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.858+0000 7f58a5187640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58a01018c0 0x7f58a0074220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:11.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.858+0000 7f58a5187640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f58a0102260 0x7f58a0074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:11.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.858+0000 7f58a5187640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58a01078c0 0x7f58a0074ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:11.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.858+0000 7f58a5187640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f58a0111ce0 con 0x7f58a01078c0 2024-08-19T00:13:11.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.858+0000 7f58a5187640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f58a0111b60 con 0x7f58a0102260 2024-08-19T00:13:11.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.858+0000 7f58a5187640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f58a0111e60 con 0x7f58a01018c0 2024-08-19T00:13:11.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.858+0000 7f589f59e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58a01078c0 0x7f58a0074ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:11.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.858+0000 7f589f59e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58a01078c0 0x7f58a0074ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41652/0 (socket says 172.21.15.44:41652) 2024-08-19T00:13:11.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.858+0000 7f589f59e640 1 -- 172.21.15.44:0/2414513403 learned_addr learned my addr 172.21.15.44:0/2414513403 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:11.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.858+0000 7f589e59c640 1 --2- 172.21.15.44:0/2414513403 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f58a0102260 0x7f58a0074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:11.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.858+0000 7f589f59e640 1 -- 172.21.15.44:0/2414513403 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58a01018c0 msgr2=0x7f58a0074220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:11.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.858+0000 7f589f59e640 1 --2- 172.21.15.44:0/2414513403 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58a01018c0 0x7f58a0074220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:11.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.858+0000 7f589f59e640 1 -- 172.21.15.44:0/2414513403 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f58a0102260 msgr2=0x7f58a0074760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:11.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.858+0000 7f589f59e640 1 --2- 172.21.15.44:0/2414513403 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f58a0102260 0x7f58a0074760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:11.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.858+0000 7f589f59e640 1 -- 172.21.15.44:0/2414513403 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58a01a6720 con 0x7f58a01078c0 2024-08-19T00:13:11.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.859+0000 7f589f59e640 1 --2- 172.21.15.44:0/2414513403 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58a01078c0 0x7f58a0074ca0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f5898006010 tx=0x7f5898003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:11.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.859+0000 7f5887fff640 1 -- 172.21.15.44:0/2414513403 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5898004450 con 0x7f58a01078c0 2024-08-19T00:13:11.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.859+0000 7f58a5187640 1 -- 172.21.15.44:0/2414513403 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58a01a69b0 con 0x7f58a01078c0 2024-08-19T00:13:11.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.859+0000 7f5887fff640 1 -- 172.21.15.44:0/2414513403 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5898003e10 con 0x7f58a01078c0 2024-08-19T00:13:11.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.859+0000 7f5887fff640 1 -- 172.21.15.44:0/2414513403 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58980466e0 con 0x7f58a01078c0 2024-08-19T00:13:11.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.859+0000 7f58a5187640 1 -- 172.21.15.44:0/2414513403 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58a01a6f40 con 0x7f58a01078c0 2024-08-19T00:13:11.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.861+0000 7f5887fff640 1 -- 172.21.15.44:0/2414513403 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f58980305a0 con 0x7f58a01078c0 2024-08-19T00:13:11.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.862+0000 7f58a7585740 1 Processor -- start 2024-08-19T00:13:11.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.862+0000 7f58a7585740 1 -- start start 2024-08-19T00:13:11.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.862+0000 7f58a7585740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559b78496630 0x559b78496a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:11.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.862+0000 7f58a7585740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559b78496f50 0x559b784a12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:11.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.862+0000 7f58a7585740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b784a1810 0x559b784a3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:11.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.862+0000 7f58a7585740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559b783fb710 con 0x559b784a1810 2024-08-19T00:13:11.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.862+0000 7f58a7585740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x559b78393770 con 0x559b78496f50 2024-08-19T00:13:11.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.862+0000 7f58a7585740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x559b783f76d0 con 0x559b78496630 2024-08-19T00:13:11.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.862+0000 7f5887fff640 1 --2- 172.21.15.44:0/2414513403 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f58880a2b80 0x7f58880a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:11.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.862+0000 7f589e59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b784a1810 0x559b784a3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:11.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.862+0000 7f589e59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b784a1810 0x559b784a3c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41656/0 (socket says 172.21.15.44:41656) 2024-08-19T00:13:11.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.862+0000 7f589e59c640 1 -- 172.21.15.44:0/3911120964 learned_addr learned my addr 172.21.15.44:0/3911120964 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:11.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.862+0000 7f589f59e640 1 --2- 172.21.15.44:0/2414513403 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f58880a2b80 0x7f58880a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:11.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.862+0000 7f589ed9d640 1 --2- 172.21.15.44:0/3911120964 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559b78496f50 0x559b784a12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:11.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.862+0000 7f589e59c640 1 --2- 172.21.15.44:0/3911120964 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559b78496630 0x559b78496a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:11.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.862+0000 7f589e59c640 1 -- 172.21.15.44:0/3911120964 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559b78496630 msgr2=0x559b78496a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:11.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.862+0000 7f589e59c640 1 --2- 172.21.15.44:0/3911120964 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559b78496630 0x559b78496a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:11.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.862+0000 7f589e59c640 1 -- 172.21.15.44:0/3911120964 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559b78496f50 msgr2=0x559b784a12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:11.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.862+0000 7f589e59c640 1 --2- 172.21.15.44:0/3911120964 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559b78496f50 0x559b784a12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:11.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.862+0000 7f589e59c640 1 -- 172.21.15.44:0/3911120964 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b7839a3e0 con 0x559b784a1810 2024-08-19T00:13:11.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.862+0000 7f5887fff640 1 -- 172.21.15.44:0/2414513403 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9187+0+0 (secure 0 0 0) 0x7f589802e030 con 0x7f58a01078c0 2024-08-19T00:13:11.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.863+0000 7f589e59c640 1 --2- 172.21.15.44:0/3911120964 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b784a1810 0x559b784a3c00 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f589400ad80 tx=0x7f589400a490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f36c6cdad90f5422 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:11.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.863+0000 7f589f59e640 1 --2- 172.21.15.44:0/2414513403 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f58880a2b80 0x7f58880a5040 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f58980b9cd0 tx=0x7f58980b8f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:11.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.863+0000 7f58857fa640 1 -- 172.21.15.44:0/3911120964 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f589401b070 con 0x559b784a1810 2024-08-19T00:13:11.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.863+0000 7f58857fa640 1 -- 172.21.15.44:0/3911120964 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f589400fdf0 con 0x559b784a1810 2024-08-19T00:13:11.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.863+0000 7f58857fa640 1 -- 172.21.15.44:0/3911120964 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58940146c0 con 0x559b784a1810 2024-08-19T00:13:11.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.863+0000 7f58a7585740 1 -- 172.21.15.44:0/3911120964 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b784a1810 msgr2=0x559b784a3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:11.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.864+0000 7f58a7585740 1 --2- 172.21.15.44:0/3911120964 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b784a1810 0x559b784a3c00 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f589400ad80 tx=0x7f589400a490 comp rx=0 tx=0).stop 2024-08-19T00:13:11.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.864+0000 7f58a7585740 1 -- 172.21.15.44:0/3911120964 shutdown_connections 2024-08-19T00:13:11.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.864+0000 7f58a7585740 1 --2- 172.21.15.44:0/3911120964 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b784a1810 0x559b784a3c00 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:11.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.864+0000 7f58a7585740 1 --2- 172.21.15.44:0/3911120964 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559b78496f50 0x559b784a12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:11.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.864+0000 7f58a7585740 1 --2- 172.21.15.44:0/3911120964 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559b78496630 0x559b78496a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:11.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.864+0000 7f58a7585740 1 -- 172.21.15.44:0/3911120964 >> 172.21.15.44:0/3911120964 conn(0x559b78492bc0 msgr2=0x559b78492fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:11.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.864+0000 7f58a7585740 1 -- 172.21.15.44:0/3911120964 shutdown_connections 2024-08-19T00:13:11.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.864+0000 7f58a7585740 1 -- 172.21.15.44:0/3911120964 wait complete. 2024-08-19T00:13:11.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.864+0000 7f58a7585740 1 -- start start 2024-08-19T00:13:11.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.864+0000 7f58a7585740 1 Processor -- start 2024-08-19T00:13:11.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.864+0000 7f58a7585740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559b78496630 0x559b7849e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:11.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.864+0000 7f58a7585740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b78496f50 0x559b7849ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:11.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.864+0000 7f58a7585740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559b784a1810 0x559b7849f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:11.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.864+0000 7f58a7585740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559b784a43e0 con 0x559b78496f50 2024-08-19T00:13:11.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.864+0000 7f58a7585740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x559b783b6970 con 0x559b78496630 2024-08-19T00:13:11.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.864+0000 7f58a7585740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x559b784a4560 con 0x559b784a1810 2024-08-19T00:13:11.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.864+0000 7f58a7585740 10 client.0 _ll_register_callbacks cb 0x559b7810a7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:13:11.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.865+0000 7f589ed9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b78496f50 0x559b7849ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:11.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.865+0000 7f589ed9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b78496f50 0x559b7849ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41662/0 (socket says 172.21.15.44:41662) 2024-08-19T00:13:11.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.865+0000 7f589ed9d640 1 -- 172.21.15.44:0/2270499677 learned_addr learned my addr 172.21.15.44:0/2270499677 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:11.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.865+0000 7f589e59c640 1 --2- 172.21.15.44:0/2270499677 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559b784a1810 0x559b7849f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:11.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.865+0000 7f589e59c640 1 --2- 172.21.15.44:0/2270499677 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559b78496630 0x559b7849e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:11.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.865+0000 7f589ed9d640 1 -- 172.21.15.44:0/2270499677 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559b784a1810 msgr2=0x559b7849f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:11.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.865+0000 7f589ed9d640 1 --2- 172.21.15.44:0/2270499677 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559b784a1810 0x559b7849f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:11.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.865+0000 7f589ed9d640 1 -- 172.21.15.44:0/2270499677 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559b78496630 msgr2=0x559b7849e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:11.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.865+0000 7f589ed9d640 1 --2- 172.21.15.44:0/2270499677 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559b78496630 0x559b7849e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:11.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.865+0000 7f589ed9d640 1 -- 172.21.15.44:0/2270499677 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b7816d2b0 con 0x559b78496f50 2024-08-19T00:13:11.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.865+0000 7f589e59c640 1 --2- 172.21.15.44:0/2270499677 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559b78496630 0x559b7849e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:13:11.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.865+0000 7f589ed9d640 1 --2- 172.21.15.44:0/2270499677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b78496f50 0x559b7849ec30 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f589000f6b0 tx=0x7f589000fb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93320770a6471a8c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:11.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.865+0000 7f5882ff5640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:13:11.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.865+0000 7f5882ff5640 1 -- 172.21.15.44:0/2270499677 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5890004220 con 0x559b78496f50 2024-08-19T00:13:11.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.865+0000 7f5882ff5640 1 -- 172.21.15.44:0/2270499677 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9187+0+0 (secure 0 0 0) 0x7f58900043c0 con 0x559b78496f50 2024-08-19T00:13:11.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.865+0000 7f58a7585740 1 -- 172.21.15.44:0/2270499677 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f589400fdf0 con 0x559b78496f50 2024-08-19T00:13:11.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.865+0000 7f5882ff5640 1 -- 172.21.15.44:0/2270499677 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f589000d8c0 con 0x559b78496f50 2024-08-19T00:13:11.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.865+0000 7f58a7585740 10 client.15267 fetch_fsmap learned FSMap version 27 2024-08-19T00:13:11.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.865+0000 7f58a7585740 1 -- 172.21.15.44:0/2270499677 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559b784b00f0 con 0x559b78496f50 2024-08-19T00:13:11.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.866+0000 7f5882ff5640 1 -- 172.21.15.44:0/2270499677 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f589400fdf0 con 0x559b78496f50 2024-08-19T00:13:11.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.866+0000 7f5882ff5640 1 -- 172.21.15.44:0/2270499677 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f5890005020 con 0x559b78496f50 2024-08-19T00:13:11.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.866+0000 7f58a7585740 10 client.15267 fetch_fsmap finished waiting for FSMap version 27 2024-08-19T00:13:11.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.866+0000 7f58a7585740 10 client.15267 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-19T00:13:11.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.866+0000 7f58a7585740 20 client.15267 populate_metadata read hostname 'smithi044' 2024-08-19T00:13:11.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.866+0000 7f58a7585740 1 --2- 172.21.15.44:0/2270499677 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x559b784b27c0 0x559b784b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:11.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.866+0000 7f58a7585740 4 client.15267 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:13:11.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.866+0000 7f58a7585740 1 -- 172.21.15.44:0/2270499677 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559b78408c80 con 0x559b784b27c0 2024-08-19T00:13:11.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.866+0000 7f589e59c640 1 --2- 172.21.15.44:0/2270499677 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x559b784b27c0 0x559b784b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:11.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.867+0000 7f589e59c640 1 --2- 172.21.15.44:0/2270499677 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x559b784b27c0 0x559b784b3c30 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac793faae6a3a689 server_cookie=fab80cb427b7dcfd in_seq=0 out_seq=0 2024-08-19T00:13:11.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.867+0000 7f5882ff5640 10 client.15267 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:13:11.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.867+0000 7f5882ff5640 1 -- 172.21.15.44:0/2270499677 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559b78408c80 con 0x559b784b27c0 2024-08-19T00:13:11.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.867+0000 7f5882ff5640 10 client.15267 handle_command_reply: tid=0 2024-08-19T00:13:11.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.868+0000 7f58a7585740 1 client.15267 shutdown 2024-08-19T00:13:11.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.868+0000 7f58a7585740 1 -- 172.21.15.44:0/2270499677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b78496f50 msgr2=0x559b7849ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:11.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.868+0000 7f58a7585740 1 --2- 172.21.15.44:0/2270499677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b78496f50 0x559b7849ec30 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f589000f6b0 tx=0x7f589000fb70 comp rx=0 tx=0).stop 2024-08-19T00:13:11.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.868+0000 7f58a7585740 1 -- 172.21.15.44:0/2270499677 shutdown_connections 2024-08-19T00:13:11.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.868+0000 7f58a7585740 1 --2- 172.21.15.44:0/2270499677 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x559b784b27c0 0x559b784b3c30 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:11.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.868+0000 7f58a7585740 1 --2- 172.21.15.44:0/2270499677 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559b784a1810 0x559b7849f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:11.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.868+0000 7f58a7585740 1 --2- 172.21.15.44:0/2270499677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b78496f50 0x559b7849ec30 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:11.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.868+0000 7f58a7585740 1 --2- 172.21.15.44:0/2270499677 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559b78496630 0x559b7849e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:11.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.868+0000 7f5882ff5640 0 client.15267 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:13:11.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.868+0000 7f58a7585740 1 -- 172.21.15.44:0/2270499677 >> 172.21.15.44:0/2270499677 conn(0x559b78492bc0 msgr2=0x559b784988a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:11.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.868+0000 7f58a7585740 1 -- 172.21.15.44:0/2270499677 shutdown_connections 2024-08-19T00:13:11.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.868+0000 7f58a7585740 1 -- 172.21.15.44:0/2270499677 wait complete. 2024-08-19T00:13:11.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.868+0000 7f58a7585740 20 client.15267 trim_cache size 0 max 16384 2024-08-19T00:13:11.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.886+0000 7f58a7585740 1 Processor -- start 2024-08-19T00:13:11.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.886+0000 7f58a7585740 1 -- start start 2024-08-19T00:13:11.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.886+0000 7f58a7585740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b78496630 0x559b784b2e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:11.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.886+0000 7f58a7585740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559b78496f50 0x559b7849efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:11.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.886+0000 7f58a7585740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559b784a1810 0x559b7849b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:11.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.886+0000 7f58a7585740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559b784b1f70 con 0x559b78496630 2024-08-19T00:13:11.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.886+0000 7f58a7585740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x559b784b2640 con 0x559b78496f50 2024-08-19T00:13:11.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.886+0000 7f58a7585740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x559b784b2d10 con 0x559b784a1810 2024-08-19T00:13:11.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.886+0000 7f589e59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b78496630 0x559b784b2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:11.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.886+0000 7f589e59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b78496630 0x559b784b2e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41672/0 (socket says 172.21.15.44:41672) 2024-08-19T00:13:11.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.886+0000 7f589e59c640 1 -- 172.21.15.44:0/3803645 learned_addr learned my addr 172.21.15.44:0/3803645 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:11.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.886+0000 7f589ed9d640 1 --2- 172.21.15.44:0/3803645 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559b78496f50 0x559b7849efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:11.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.886+0000 7f589e59c640 1 -- 172.21.15.44:0/3803645 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559b784a1810 msgr2=0x559b7849b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:11.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.886+0000 7f589e59c640 1 --2- 172.21.15.44:0/3803645 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559b784a1810 0x559b7849b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:11.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.886+0000 7f589e59c640 1 -- 172.21.15.44:0/3803645 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559b78496f50 msgr2=0x559b7849efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:11.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.886+0000 7f589e59c640 1 --2- 172.21.15.44:0/3803645 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559b78496f50 0x559b7849efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:11.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.886+0000 7f589e59c640 1 -- 172.21.15.44:0/3803645 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b7848e130 con 0x559b78496630 2024-08-19T00:13:11.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.886+0000 7f589ed9d640 1 --2- 172.21.15.44:0/3803645 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559b78496f50 0x559b7849efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:13:11.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.887+0000 7f589e59c640 1 --2- 172.21.15.44:0/3803645 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b78496630 0x559b784b2e90 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f589400ad20 tx=0x7f589400aba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d289213507cf30 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:11.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.887+0000 7f5884ff9640 1 -- 172.21.15.44:0/3803645 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f589401b040 con 0x559b78496630 2024-08-19T00:13:11.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.887+0000 7f5884ff9640 1 -- 172.21.15.44:0/3803645 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5894030070 con 0x559b78496630 2024-08-19T00:13:11.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.887+0000 7f5884ff9640 1 -- 172.21.15.44:0/3803645 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58940227e0 con 0x559b78496630 2024-08-19T00:13:11.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.887+0000 7f58a7585740 1 -- 172.21.15.44:0/3803645 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b78496630 msgr2=0x559b784b2e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:11.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.887+0000 7f58a7585740 1 --2- 172.21.15.44:0/3803645 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b78496630 0x559b784b2e90 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f589400ad20 tx=0x7f589400aba0 comp rx=0 tx=0).stop 2024-08-19T00:13:11.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.887+0000 7f58a7585740 1 -- 172.21.15.44:0/3803645 shutdown_connections 2024-08-19T00:13:11.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.887+0000 7f58a7585740 1 --2- 172.21.15.44:0/3803645 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559b784a1810 0x559b7849b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:11.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.887+0000 7f58a7585740 1 --2- 172.21.15.44:0/3803645 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559b78496f50 0x559b7849efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:11.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.887+0000 7f58a7585740 1 --2- 172.21.15.44:0/3803645 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b78496630 0x559b784b2e90 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:11.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.887+0000 7f58a7585740 1 -- 172.21.15.44:0/3803645 >> 172.21.15.44:0/3803645 conn(0x559b78492bc0 msgr2=0x559b7849d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:11.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.887+0000 7f58a7585740 1 -- 172.21.15.44:0/3803645 shutdown_connections 2024-08-19T00:13:11.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.887+0000 7f58a7585740 1 -- 172.21.15.44:0/3803645 wait complete. 2024-08-19T00:13:11.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.888+0000 7f58a7585740 1 -- start start 2024-08-19T00:13:11.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.888+0000 7f58a7585740 1 Processor -- start 2024-08-19T00:13:11.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.888+0000 7f58a7585740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559b78496630 0x559b784b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:11.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.888+0000 7f58a7585740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b78496f50 0x559b784b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:11.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.888+0000 7f58a7585740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559b784a1810 0x559b784b6710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:11.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.888+0000 7f58a7585740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559b784b3ab0 con 0x559b78496f50 2024-08-19T00:13:11.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.888+0000 7f58a7585740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x559b784b33e0 con 0x559b78496630 2024-08-19T00:13:11.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.888+0000 7f58a7585740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x559b784b4180 con 0x559b784a1810 2024-08-19T00:13:11.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.888+0000 7f58a7585740 10 client.0 _ll_register_callbacks cb 0x7f589000a5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:13:11.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.888+0000 7f589ed9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b78496f50 0x559b784b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:11.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.888+0000 7f589ed9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b78496f50 0x559b784b61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41676/0 (socket says 172.21.15.44:41676) 2024-08-19T00:13:11.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.888+0000 7f589ed9d640 1 -- 172.21.15.44:0/519998535 learned_addr learned my addr 172.21.15.44:0/519998535 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:11.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.888+0000 7f589e59c640 1 --2- 172.21.15.44:0/519998535 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559b78496630 0x559b784b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:11.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.888+0000 7f589e59c640 1 --2- 172.21.15.44:0/519998535 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559b784a1810 0x559b784b6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:11.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.889+0000 7f589ed9d640 1 -- 172.21.15.44:0/519998535 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559b784a1810 msgr2=0x559b784b6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:11.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.889+0000 7f589ed9d640 1 --2- 172.21.15.44:0/519998535 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559b784a1810 0x559b784b6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:11.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.889+0000 7f589ed9d640 1 -- 172.21.15.44:0/519998535 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559b78496630 msgr2=0x559b784b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:11.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.889+0000 7f589ed9d640 1 --2- 172.21.15.44:0/519998535 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559b78496630 0x559b784b5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:11.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.889+0000 7f589ed9d640 1 -- 172.21.15.44:0/519998535 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b784ba4b0 con 0x559b78496f50 2024-08-19T00:13:11.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.889+0000 7f589e59c640 1 --2- 172.21.15.44:0/519998535 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559b78496630 0x559b784b5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:13:11.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.889+0000 7f589ed9d640 1 --2- 172.21.15.44:0/519998535 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b78496f50 0x559b784b61d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x559b7849fd30 tx=0x7f5890018670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54977916f6c12304 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:11.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.889+0000 7f5882ff5640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:13:11.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.889+0000 7f5882ff5640 1 -- 172.21.15.44:0/519998535 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5890018c70 con 0x559b78496f50 2024-08-19T00:13:11.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.889+0000 7f5882ff5640 1 -- 172.21.15.44:0/519998535 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9187+0+0 (secure 0 0 0) 0x7f5890004020 con 0x559b78496f50 2024-08-19T00:13:11.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.889+0000 7f58a7585740 1 -- 172.21.15.44:0/519998535 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5894030070 con 0x559b78496f50 2024-08-19T00:13:11.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.889+0000 7f5882ff5640 1 -- 172.21.15.44:0/519998535 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f589000d710 con 0x559b78496f50 2024-08-19T00:13:11.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.889+0000 7f58a7585740 10 client.15273 fetch_fsmap learned FSMap version 27 2024-08-19T00:13:11.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.889+0000 7f58a7585740 1 -- 172.21.15.44:0/519998535 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559b7851d190 con 0x559b78496f50 2024-08-19T00:13:11.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.889+0000 7f5882ff5640 1 -- 172.21.15.44:0/519998535 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5894030070 con 0x559b78496f50 2024-08-19T00:13:11.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.889+0000 7f5882ff5640 1 -- 172.21.15.44:0/519998535 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f5890003ad0 con 0x559b78496f50 2024-08-19T00:13:11.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.889+0000 7f58a7585740 10 client.15273 fetch_fsmap finished waiting for FSMap version 27 2024-08-19T00:13:11.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.889+0000 7f58a7585740 10 client.15273 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-19T00:13:11.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.890+0000 7f58a7585740 20 client.15273 populate_metadata read hostname 'smithi044' 2024-08-19T00:13:11.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.890+0000 7f58a7585740 1 --2- 172.21.15.44:0/519998535 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x559b78521db0 0x559b78520ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:11.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.890+0000 7f58a7585740 4 client.15273 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-19T00:13:11.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.890+0000 7f58a7585740 1 -- 172.21.15.44:0/519998535 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "status"}) -- 0x559b78403190 con 0x559b78521db0 2024-08-19T00:13:11.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.890+0000 7f589e59c640 1 --2- 172.21.15.44:0/519998535 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x559b78521db0 0x559b78520ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:11.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.890+0000 7f589e59c640 1 --2- 172.21.15.44:0/519998535 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x559b78521db0 0x559b78520ac0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98b2f07034c57a32 server_cookie=84f790e51eb76521 in_seq=0 out_seq=0 2024-08-19T00:13:11.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.890+0000 7f5882ff5640 10 client.15273 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:13:11.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.891+0000 7f5882ff5640 1 -- 172.21.15.44:0/519998535 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x559b78403190 con 0x559b78521db0 2024-08-19T00:13:11.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.891+0000 7f5882ff5640 10 client.15273 handle_command_reply: tid=0 2024-08-19T00:13:11.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.891+0000 7f58a7585740 1 client.15273 shutdown 2024-08-19T00:13:11.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.891+0000 7f58a7585740 1 -- 172.21.15.44:0/519998535 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b78496f50 msgr2=0x559b784b61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:11.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.891+0000 7f58a7585740 1 --2- 172.21.15.44:0/519998535 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b78496f50 0x559b784b61d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x559b7849fd30 tx=0x7f5890018670 comp rx=0 tx=0).stop 2024-08-19T00:13:11.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.891+0000 7f58a7585740 1 -- 172.21.15.44:0/519998535 shutdown_connections 2024-08-19T00:13:11.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.891+0000 7f58a7585740 1 --2- 172.21.15.44:0/519998535 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x559b78521db0 0x559b78520ac0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:11.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.891+0000 7f58a7585740 1 --2- 172.21.15.44:0/519998535 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559b784a1810 0x559b784b6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:11.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.891+0000 7f58a7585740 1 --2- 172.21.15.44:0/519998535 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559b78496f50 0x559b784b61d0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:11.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.891+0000 7f58a7585740 1 --2- 172.21.15.44:0/519998535 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559b78496630 0x559b784b5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:11.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.891+0000 7f58a7585740 1 -- 172.21.15.44:0/519998535 >> 172.21.15.44:0/519998535 conn(0x559b78492bc0 msgr2=0x559b784ac810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:11.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.891+0000 7f5882ff5640 0 client.15273 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:13:11.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.891+0000 7f58a7585740 1 -- 172.21.15.44:0/519998535 shutdown_connections 2024-08-19T00:13:11.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.891+0000 7f58a7585740 1 -- 172.21.15.44:0/519998535 wait complete. 2024-08-19T00:13:11.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.891+0000 7f58a7585740 20 client.15273 trim_cache size 0 max 16384 2024-08-19T00:13:11.899 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-08-19T00:13:11.899 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "647ded64-5dbe-11ef-bccf-c7b262605968", 2024-08-19T00:13:11.899 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 0, 2024-08-19T00:13:11.899 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 24473, 2024-08-19T00:13:11.899 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-08-19T00:13:11.899 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-08-19T00:13:11.899 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-08-19T00:13:11.899 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 138.39124960500001, 2024-08-19T00:13:11.899 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 27, 2024-08-19T00:13:11.899 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 94, 2024-08-19T00:13:11.899 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 90, 2024-08-19T00:13:11.899 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 150.31652586499999 2024-08-19T00:13:11.900 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-08-19T00:13:11.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.891+0000 7f58a5187640 1 -- 172.21.15.44:0/2414513403 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f58880a2b80 msgr2=0x7f58880a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:11.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.891+0000 7f58a5187640 1 --2- 172.21.15.44:0/2414513403 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f58880a2b80 0x7f58880a5040 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f58980b9cd0 tx=0x7f58980b8f40 comp rx=0 tx=0).stop 2024-08-19T00:13:11.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.891+0000 7f58a5187640 1 -- 172.21.15.44:0/2414513403 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58a01078c0 msgr2=0x7f58a0074ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:11.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.891+0000 7f58a5187640 1 --2- 172.21.15.44:0/2414513403 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58a01078c0 0x7f58a0074ca0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f5898006010 tx=0x7f5898003c20 comp rx=0 tx=0).stop 2024-08-19T00:13:11.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.892+0000 7f58a5187640 1 -- 172.21.15.44:0/2414513403 shutdown_connections 2024-08-19T00:13:11.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.892+0000 7f58a5187640 1 --2- 172.21.15.44:0/2414513403 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f58880a2b80 0x7f58880a5040 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:11.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.892+0000 7f58a5187640 1 --2- 172.21.15.44:0/2414513403 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58a01078c0 0x7f58a0074ca0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:11.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.892+0000 7f58a5187640 1 --2- 172.21.15.44:0/2414513403 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f58a0102260 0x7f58a0074760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:11.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.892+0000 7f58a5187640 1 --2- 172.21.15.44:0/2414513403 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58a01018c0 0x7f58a0074220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:11.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.892+0000 7f58a5187640 1 -- 172.21.15.44:0/2414513403 >> 172.21.15.44:0/2414513403 conn(0x7f58a00fd620 msgr2=0x7f58a00fdee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:11.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.892+0000 7f58a5187640 1 -- 172.21.15.44:0/2414513403 shutdown_connections 2024-08-19T00:13:11.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:11.892+0000 7f58a5187640 1 -- 172.21.15.44:0/2414513403 wait complete. 2024-08-19T00:13:12.581 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:12 smithi044 ceph-mon[18489]: pgmap v340: 129 pgs: 129 active+clean; 645 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2024-08-19T00:13:12.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:12 smithi171 ceph-mon[21810]: pgmap v340: 129 pgs: 129 active+clean; 645 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2024-08-19T00:13:12.609 INFO:teuthology.run_tasks:Running task sequential... 2024-08-19T00:13:12.620 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-08-19T00:13:12.620 INFO:teuthology.task.sequential:In sequential, running task print... 2024-08-19T00:13:12.620 INFO:teuthology.task.print:Enabling mgr modules 2024-08-19T00:13:12.620 INFO:teuthology.task.sequential:In sequential, running task exec... 2024-08-19T00:13:12.621 INFO:teuthology.task.exec:Executing custom commands... 2024-08-19T00:13:12.622 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi044.front.sepia.ceph.com 2024-08-19T00:13:12.622 DEBUG:teuthology.orchestra.run.smithi044:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-08-19T00:13:12.622 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:12 smithi116 ceph-mon[21873]: pgmap v340: 129 pgs: 129 active+clean; 645 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2024-08-19T00:13:12.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:12.723+0000 7fc0e54df640 1 -- 172.21.15.44:0/2743840284 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0e0102330 msgr2=0x7fc0e0108bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:12.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:12.723+0000 7fc0e54df640 1 --2- 172.21.15.44:0/2743840284 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0e0102330 0x7fc0e0108bc0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc0d8009900 tx=0x7fc0d802a410 comp rx=0 tx=0).stop 2024-08-19T00:13:12.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:12.723+0000 7fc0e54df640 1 -- 172.21.15.44:0/2743840284 shutdown_connections 2024-08-19T00:13:12.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:12.723+0000 7fc0e54df640 1 --2- 172.21.15.44:0/2743840284 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0e0102330 0x7fc0e0108bc0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:12.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:12.723+0000 7fc0e54df640 1 --2- 172.21.15.44:0/2743840284 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc0e0101970 0x7fc0e0101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:12.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:12.723+0000 7fc0e54df640 1 --2- 172.21.15.44:0/2743840284 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc0e0100780 0x7fc0e0100b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:12.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:12.723+0000 7fc0e54df640 1 -- 172.21.15.44:0/2743840284 >> 172.21.15.44:0/2743840284 conn(0x7fc0e00fbee0 msgr2=0x7fc0e00fe320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:12.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:12.723+0000 7fc0e54df640 1 -- 172.21.15.44:0/2743840284 shutdown_connections 2024-08-19T00:13:12.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:12.723+0000 7fc0e54df640 1 -- 172.21.15.44:0/2743840284 wait complete. 2024-08-19T00:13:12.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:12.724+0000 7fc0e54df640 1 Processor -- start 2024-08-19T00:13:12.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:12.724+0000 7fc0e54df640 1 -- start start 2024-08-19T00:13:12.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:12.724+0000 7fc0e54df640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0e0100780 0x7fc0e01979f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:12.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:12.724+0000 7fc0e54df640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc0e0101970 0x7fc0e0197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:12.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:12.724+0000 7fc0e54df640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc0e0102330 0x7fc0e019efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:12.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:12.724+0000 7fc0e54df640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e010d550 con 0x7fc0e0100780 2024-08-19T00:13:12.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:12.724+0000 7fc0e54df640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e010d3d0 con 0x7fc0e0101970 2024-08-19T00:13:12.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:12.724+0000 7fc0e54df640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e010d6d0 con 0x7fc0e0102330 2024-08-19T00:13:12.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:12.724+0000 7fc0deffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0e0100780 0x7fc0e01979f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:12.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:12.724+0000 7fc0deffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0e0100780 0x7fc0e01979f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41694/0 (socket says 172.21.15.44:41694) 2024-08-19T00:13:12.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:12.724+0000 7fc0deffd640 1 -- 172.21.15.44:0/617354859 learned_addr learned my addr 172.21.15.44:0/617354859 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:12.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:12.724+0000 7fc0de7fc640 1 --2- 172.21.15.44:0/617354859 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc0e0101970 0x7fc0e0197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:12.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:12.724+0000 7fc0deffd640 1 -- 172.21.15.44:0/617354859 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc0e0102330 msgr2=0x7fc0e019efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:12.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:12.724+0000 7fc0deffd640 1 --2- 172.21.15.44:0/617354859 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc0e0102330 0x7fc0e019efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:12.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:12.724+0000 7fc0deffd640 1 -- 172.21.15.44:0/617354859 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc0e0101970 msgr2=0x7fc0e0197f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:12.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:12.724+0000 7fc0deffd640 1 --2- 172.21.15.44:0/617354859 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc0e0101970 0x7fc0e0197f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:12.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:12.724+0000 7fc0deffd640 1 -- 172.21.15.44:0/617354859 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0e019f610 con 0x7fc0e0100780 2024-08-19T00:13:12.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:12.724+0000 7fc0de7fc640 1 --2- 172.21.15.44:0/617354859 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc0e0101970 0x7fc0e0197f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:13:12.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:12.725+0000 7fc0deffd640 1 --2- 172.21.15.44:0/617354859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0e0100780 0x7fc0e01979f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fc0d000eaa0 tx=0x7fc0d000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:12.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:12.725+0000 7fc0c7fff640 1 -- 172.21.15.44:0/617354859 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d0016070 con 0x7fc0e0100780 2024-08-19T00:13:12.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:12.725+0000 7fc0c7fff640 1 -- 172.21.15.44:0/617354859 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc0d0003e50 con 0x7fc0e0100780 2024-08-19T00:13:12.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:12.725+0000 7fc0e54df640 1 -- 172.21.15.44:0/617354859 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0e019f900 con 0x7fc0e0100780 2024-08-19T00:13:12.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:12.725+0000 7fc0c7fff640 1 -- 172.21.15.44:0/617354859 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d00116d0 con 0x7fc0e0100780 2024-08-19T00:13:12.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:12.725+0000 7fc0e54df640 1 -- 172.21.15.44:0/617354859 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0e019fe00 con 0x7fc0e0100780 2024-08-19T00:13:12.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:12.726+0000 7fc0e54df640 1 -- 172.21.15.44:0/617354859 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0e01079d0 con 0x7fc0e0100780 2024-08-19T00:13:12.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:12.727+0000 7fc0c7fff640 1 -- 172.21.15.44:0/617354859 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fc0d0019070 con 0x7fc0e0100780 2024-08-19T00:13:12.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:12.727+0000 7fc0c7fff640 1 --2- 172.21.15.44:0/617354859 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fc0c80a2c30 0x7fc0c80a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:12.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:12.728+0000 7fc0de7fc640 1 --2- 172.21.15.44:0/617354859 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fc0c80a2c30 0x7fc0c80a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:12.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:12.728+0000 7fc0c7fff640 1 -- 172.21.15.44:0/617354859 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9187+0+0 (secure 0 0 0) 0x7fc0d00cf5b0 con 0x7fc0e0100780 2024-08-19T00:13:12.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:12.728+0000 7fc0de7fc640 1 --2- 172.21.15.44:0/617354859 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fc0c80a2c30 0x7fc0c80a50f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc0e0198f00 tx=0x7fc0d4005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:12.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:12.732+0000 7fc0c7fff640 1 -- 172.21.15.44:0/617354859 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fc0d009c150 con 0x7fc0e0100780 2024-08-19T00:13:12.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:12.957+0000 7fc0e54df640 1 -- 172.21.15.44:0/617354859 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) -- 0x7fc0e0062bc0 con 0x7fc0e0100780 2024-08-19T00:13:13.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:13.322+0000 7fc0c7fff640 1 -- 172.21.15.44:0/617354859 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v19) ==== 92+0+0 (secure 0 0 0) 0x7fc0d009ba50 con 0x7fc0e0100780 2024-08-19T00:13:13.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:13.325+0000 7fc0e54df640 1 -- 172.21.15.44:0/617354859 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fc0c80a2c30 msgr2=0x7fc0c80a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:13.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:13.325+0000 7fc0e54df640 1 --2- 172.21.15.44:0/617354859 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fc0c80a2c30 0x7fc0c80a50f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc0e0198f00 tx=0x7fc0d4005d90 comp rx=0 tx=0).stop 2024-08-19T00:13:13.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:13.325+0000 7fc0e54df640 1 -- 172.21.15.44:0/617354859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0e0100780 msgr2=0x7fc0e01979f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:13.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:13.325+0000 7fc0e54df640 1 --2- 172.21.15.44:0/617354859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0e0100780 0x7fc0e01979f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fc0d000eaa0 tx=0x7fc0d000ef60 comp rx=0 tx=0).stop 2024-08-19T00:13:13.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:13.325+0000 7fc0e54df640 1 -- 172.21.15.44:0/617354859 shutdown_connections 2024-08-19T00:13:13.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:13.325+0000 7fc0e54df640 1 --2- 172.21.15.44:0/617354859 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7fc0c80a2c30 0x7fc0c80a50f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:13.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:13.325+0000 7fc0e54df640 1 --2- 172.21.15.44:0/617354859 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc0e0102330 0x7fc0e019efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:13.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:13.325+0000 7fc0e54df640 1 --2- 172.21.15.44:0/617354859 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc0e0101970 0x7fc0e0197f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:13.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:13.325+0000 7fc0e54df640 1 --2- 172.21.15.44:0/617354859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0e0100780 0x7fc0e01979f0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:13.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:13.325+0000 7fc0e54df640 1 -- 172.21.15.44:0/617354859 >> 172.21.15.44:0/617354859 conn(0x7fc0e00fbee0 msgr2=0x7fc0e0104ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:13.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:13.325+0000 7fc0e54df640 1 -- 172.21.15.44:0/617354859 shutdown_connections 2024-08-19T00:13:13.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:13.326+0000 7fc0e54df640 1 -- 172.21.15.44:0/617354859 wait complete. 2024-08-19T00:13:13.344 INFO:teuthology.run_tasks:Running task kclient... 2024-08-19T00:13:13.358 INFO:tasks.kclient:Mounting kernel clients... 2024-08-19T00:13:13.359 INFO:tasks.kclient:config is {'client.0': {}} 2024-08-19T00:13:13.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:13:13.359 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2024-08-19T00:13:13.375 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-08-19T00:13:13.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:13:13.376 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-19T00:13:13.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:13:13.441 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link delete ceph-brx 2024-08-19T00:13:13.546 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=crc', 'wsync'], 'syntax': 'v2', 'mount_subvol_num': 1} 2024-08-19T00:13:13.546 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-08-19T00:13:13.546 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-19T00:13:13.546 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph fs ls 2024-08-19T00:13:13.569 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:13 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/617354859' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-08-19T00:13:13.570 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:13:13 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-z[23624]: ignoring --setuser ceph since I am not root 2024-08-19T00:13:13.570 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:13:13 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-z[23624]: ignoring --setgroup ceph since I am not root 2024-08-19T00:13:13.570 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:13:13 smithi171 ceph-mgr[23628]: -- 172.21.15.171:0/3724614360 <== mon.1 v2:172.21.15.171:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5645be0a70e0 con 0x5645be084800 2024-08-19T00:13:13.570 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:13:13 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-z[23624]: 2024-08-19T00:13:13.567+0000 7f8b88304040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-19T00:13:13.570 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:13 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/617354859' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-08-19T00:13:13.571 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:13:13 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: ignoring --setuser ceph since I am not root 2024-08-19T00:13:13.571 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:13:13 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: ignoring --setgroup ceph since I am not root 2024-08-19T00:13:13.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:13 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/617354859' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-08-19T00:13:13.616 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:13:13 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-y[23237]: ignoring --setuser ceph since I am not root 2024-08-19T00:13:13.616 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:13:13 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-y[23237]: ignoring --setgroup ceph since I am not root 2024-08-19T00:13:13.616 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:13:13 smithi116 ceph-mgr[23241]: -- 172.21.15.116:0/3053301254 <== mon.2 v2:172.21.15.116:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b04c4bb0e0 con 0x55b04c499000 2024-08-19T00:13:13.616 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:13:13 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-y[23237]: 2024-08-19T00:13:13.561+0000 7f277fc76040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-19T00:13:13.811 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:13:13.842 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:13:13 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-z[23624]: 2024-08-19T00:13:13.634+0000 7f8b88304040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-19T00:13:13.842 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:13:13 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-z[23624]: 2024-08-19T00:13:13.779+0000 7f8b88304040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-19T00:13:13.869 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:13:13 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:13:13.576+0000 7f51e0695040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-19T00:13:13.869 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:13:13 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:13:13.646+0000 7f51e0695040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-19T00:13:13.869 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:13:13 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:13:13.803+0000 7f51e0695040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-19T00:13:13.929 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:13:13 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-y[23237]: 2024-08-19T00:13:13.628+0000 7f277fc76040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-19T00:13:13.929 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:13:13 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-y[23237]: 2024-08-19T00:13:13.770+0000 7f277fc76040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-19T00:13:14.197 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:13:13 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-y[23237]: 2024-08-19T00:13:13.928+0000 7f277fc76040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-19T00:13:14.197 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:13:14 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-y[23237]: 2024-08-19T00:13:14.070+0000 7f277fc76040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-19T00:13:14.210 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:13:13 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-z[23624]: 2024-08-19T00:13:13.937+0000 7f8b88304040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-19T00:13:14.210 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:13:14 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-z[23624]: 2024-08-19T00:13:14.083+0000 7f8b88304040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-19T00:13:14.210 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:13:14 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-z[23624]: 2024-08-19T00:13:14.208+0000 7f8b88304040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-19T00:13:14.264 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:13:13 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:13:13.975+0000 7f51e0695040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-19T00:13:14.265 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:13:14 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:13:14.132+0000 7f51e0695040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-19T00:13:14.265 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:13:14 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:13:14.263+0000 7f51e0695040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-19T00:13:14.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:14.354+0000 7f1df4771640 1 -- 172.21.15.44:0/2134357250 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1dec103470 msgr2=0x7f1dec1078b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:14.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:14.354+0000 7f1df4771640 1 --2- 172.21.15.44:0/2134357250 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1dec103470 0x7f1dec1078b0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc009930 tx=0x7f1ddc02a420 comp rx=0 tx=0).stop 2024-08-19T00:13:14.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:14.354+0000 7f1df4771640 1 -- 172.21.15.44:0/2134357250 shutdown_connections 2024-08-19T00:13:14.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:14.354+0000 7f1df4771640 1 --2- 172.21.15.44:0/2134357250 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1dec107fc0 0x7f1dec10e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:14.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:14.354+0000 7f1df4771640 1 --2- 172.21.15.44:0/2134357250 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1dec103470 0x7f1dec1078b0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:14.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:14.354+0000 7f1df4771640 1 --2- 172.21.15.44:0/2134357250 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1dec102ac0 0x7f1dec102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:14.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:14.354+0000 7f1df4771640 1 -- 172.21.15.44:0/2134357250 >> 172.21.15.44:0/2134357250 conn(0x7f1dec0fc500 msgr2=0x7f1dec0fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:14.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:14.354+0000 7f1df4771640 1 -- 172.21.15.44:0/2134357250 shutdown_connections 2024-08-19T00:13:14.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:14.355+0000 7f1df4771640 1 -- 172.21.15.44:0/2134357250 wait complete. 2024-08-19T00:13:14.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:14.355+0000 7f1df4771640 1 Processor -- start 2024-08-19T00:13:14.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:14.355+0000 7f1df4771640 1 -- start start 2024-08-19T00:13:14.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:14.355+0000 7f1df4771640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1dec102ac0 0x7f1dec1982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:14.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:14.355+0000 7f1df4771640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1dec103470 0x7f1dec198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:14.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:14.356+0000 7f1df4771640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1dec107fc0 0x7f1dec19cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:14.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:14.356+0000 7f1df4771640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1dec111dc0 con 0x7f1dec107fc0 2024-08-19T00:13:14.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:14.356+0000 7f1df4771640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f1dec111c40 con 0x7f1dec103470 2024-08-19T00:13:14.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:14.356+0000 7f1df4771640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1dec111f40 con 0x7f1dec102ac0 2024-08-19T00:13:14.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:14.356+0000 7f1df2d0e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1dec107fc0 0x7f1dec19cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:14.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:14.356+0000 7f1df2d0e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1dec107fc0 0x7f1dec19cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41736/0 (socket says 172.21.15.44:41736) 2024-08-19T00:13:14.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:14.356+0000 7f1df2d0e640 1 -- 172.21.15.44:0/4021581910 learned_addr learned my addr 172.21.15.44:0/4021581910 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:14.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:14.356+0000 7f1df1d0c640 1 --2- 172.21.15.44:0/4021581910 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1dec103470 0x7f1dec198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:14.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:14.356+0000 7f1df2d0e640 1 -- 172.21.15.44:0/4021581910 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1dec102ac0 msgr2=0x7f1dec1982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:14.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:14.356+0000 7f1df2d0e640 1 --2- 172.21.15.44:0/4021581910 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1dec102ac0 0x7f1dec1982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:14.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:14.356+0000 7f1df2d0e640 1 -- 172.21.15.44:0/4021581910 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1dec103470 msgr2=0x7f1dec198830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:14.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:14.356+0000 7f1df2d0e640 1 --2- 172.21.15.44:0/4021581910 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1dec103470 0x7f1dec198830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:14.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:14.356+0000 7f1df2d0e640 1 -- 172.21.15.44:0/4021581910 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dec19d2a0 con 0x7f1dec107fc0 2024-08-19T00:13:14.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:14.356+0000 7f1df2d0e640 1 --2- 172.21.15.44:0/4021581910 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1dec107fc0 0x7f1dec19cbc0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f1de400eb10 tx=0x7f1de400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:14.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:14.356+0000 7f1de37fe640 1 -- 172.21.15.44:0/4021581910 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1de4004b20 con 0x7f1dec107fc0 2024-08-19T00:13:14.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:14.356+0000 7f1df4771640 1 -- 172.21.15.44:0/4021581910 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dec19d590 con 0x7f1dec107fc0 2024-08-19T00:13:14.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:14.356+0000 7f1de37fe640 1 -- 172.21.15.44:0/4021581910 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1de4004cc0 con 0x7f1dec107fc0 2024-08-19T00:13:14.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:14.356+0000 7f1de37fe640 1 -- 172.21.15.44:0/4021581910 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1de4010760 con 0x7f1dec107fc0 2024-08-19T00:13:14.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:14.356+0000 7f1df4771640 1 -- 172.21.15.44:0/4021581910 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dec1a4e70 con 0x7f1dec107fc0 2024-08-19T00:13:14.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:14.358+0000 7f1df4771640 1 -- 172.21.15.44:0/4021581910 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dec06a520 con 0x7f1dec107fc0 2024-08-19T00:13:14.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:14.360+0000 7f1de37fe640 1 -- 172.21.15.44:0/4021581910 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 19) ==== 137850+0+0 (secure 0 0 0) 0x7f1de4005000 con 0x7f1dec107fc0 2024-08-19T00:13:14.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:14.360+0000 7f1de37fe640 1 --2- 172.21.15.44:0/4021581910 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f1dd80a2bd0 0x7f1dd80a5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:14.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:14.360+0000 7f1df250d640 1 -- 172.21.15.44:0/4021581910 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f1dd80a2bd0 msgr2=0x7f1dd80a5090 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.44:6800/1330072146 2024-08-19T00:13:14.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:14.360+0000 7f1de37fe640 1 -- 172.21.15.44:0/4021581910 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9187+0+0 (secure 0 0 0) 0x7f1de40cfc20 con 0x7f1dec107fc0 2024-08-19T00:13:14.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:14.360+0000 7f1df250d640 1 --2- 172.21.15.44:0/4021581910 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f1dd80a2bd0 0x7f1dd80a5090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T00:13:14.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:14.363+0000 7f1de37fe640 1 -- 172.21.15.44:0/4021581910 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f1de4053df0 con 0x7f1dec107fc0 2024-08-19T00:13:14.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:14.561+0000 7f1df250d640 1 -- 172.21.15.44:0/4021581910 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f1dd80a2bd0 msgr2=0x7f1dd80a5090 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.44:6800/1330072146 2024-08-19T00:13:14.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:14.561+0000 7f1df250d640 1 --2- 172.21.15.44:0/4021581910 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f1dd80a2bd0 0x7f1dd80a5090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T00:13:14.563 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:13:14 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:13:14.400+0000 7f51e0695040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-19T00:13:14.563 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:13:14 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:13:14.461+0000 7f51e0695040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-19T00:13:14.563 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:14 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/617354859' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-08-19T00:13:14.563 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:14 smithi044 ceph-mon[18489]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-08-19T00:13:14.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:14.579+0000 7f1df4771640 1 -- 172.21.15.44:0/4021581910 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f1dec102ea0 con 0x7f1dec107fc0 2024-08-19T00:13:14.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:14.580+0000 7f1de37fe640 1 -- 172.21.15.44:0/4021581910 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) ==== 53+0+88 (secure 0 0 0) 0x7f1dec102ea0 con 0x7f1dec107fc0 2024-08-19T00:13:14.581 INFO:teuthology.orchestra.run.smithi044.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-08-19T00:13:14.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:14.582+0000 7f1df4771640 1 -- 172.21.15.44:0/4021581910 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f1dd80a2bd0 msgr2=0x7f1dd80a5090 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T00:13:14.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:14.582+0000 7f1df4771640 1 --2- 172.21.15.44:0/4021581910 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f1dd80a2bd0 0x7f1dd80a5090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:14.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:14.582+0000 7f1df4771640 1 -- 172.21.15.44:0/4021581910 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1dec107fc0 msgr2=0x7f1dec19cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:14.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:14.582+0000 7f1df4771640 1 --2- 172.21.15.44:0/4021581910 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1dec107fc0 0x7f1dec19cbc0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f1de400eb10 tx=0x7f1de400c2d0 comp rx=0 tx=0).stop 2024-08-19T00:13:14.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:14.582+0000 7f1df4771640 1 -- 172.21.15.44:0/4021581910 shutdown_connections 2024-08-19T00:13:14.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:14.582+0000 7f1df4771640 1 --2- 172.21.15.44:0/4021581910 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f1dd80a2bd0 0x7f1dd80a5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:14.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:14.582+0000 7f1df4771640 1 --2- 172.21.15.44:0/4021581910 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1dec107fc0 0x7f1dec19cbc0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:14.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:14.582+0000 7f1df4771640 1 --2- 172.21.15.44:0/4021581910 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1dec103470 0x7f1dec198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:14.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:14.582+0000 7f1df4771640 1 --2- 172.21.15.44:0/4021581910 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1dec102ac0 0x7f1dec1982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:14.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:14.582+0000 7f1df4771640 1 -- 172.21.15.44:0/4021581910 >> 172.21.15.44:0/4021581910 conn(0x7f1dec0fc500 msgr2=0x7f1dec105b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:14.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:14.582+0000 7f1df4771640 1 -- 172.21.15.44:0/4021581910 shutdown_connections 2024-08-19T00:13:14.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:14.582+0000 7f1df4771640 1 -- 172.21.15.44:0/4021581910 wait complete. 2024-08-19T00:13:14.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:14 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/617354859' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-08-19T00:13:14.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:14 smithi171 ceph-mon[21810]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-08-19T00:13:14.592 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:13:14 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-z[23624]: 2024-08-19T00:13:14.332+0000 7f8b88304040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-19T00:13:14.592 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:13:14 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-z[23624]: 2024-08-19T00:13:14.390+0000 7f8b88304040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-19T00:13:14.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:14 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/617354859' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-08-19T00:13:14.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:14 smithi116 ceph-mon[21873]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-08-19T00:13:14.615 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:13:14 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-y[23237]: 2024-08-19T00:13:14.196+0000 7f277fc76040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-19T00:13:14.615 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:13:14 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-y[23237]: 2024-08-19T00:13:14.320+0000 7f277fc76040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-19T00:13:14.616 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:13:14 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-y[23237]: 2024-08-19T00:13:14.378+0000 7f277fc76040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-19T00:13:14.849 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:13:14 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:13:14.783+0000 7f51e0695040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-19T00:13:14.955 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:13:14 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-y[23237]: 2024-08-19T00:13:14.680+0000 7f277fc76040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-19T00:13:14.955 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:13:14 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-y[23237]: 2024-08-19T00:13:14.740+0000 7f277fc76040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-19T00:13:14.955 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:13:14 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-y[23237]: 2024-08-19T00:13:14.808+0000 7f277fc76040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-19T00:13:14.977 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:13:14 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-z[23624]: 2024-08-19T00:13:14.696+0000 7f8b88304040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-19T00:13:14.977 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:13:14 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-z[23624]: 2024-08-19T00:13:14.757+0000 7f8b88304040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-19T00:13:14.977 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:13:14 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-z[23624]: 2024-08-19T00:13:14.826+0000 7f8b88304040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-19T00:13:14.977 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:13:14 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-z[23624]: 2024-08-19T00:13:14.975+0000 7f8b88304040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-08-19T00:13:15.119 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:13:14 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:13:14.848+0000 7f51e0695040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-19T00:13:15.119 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:13:14 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:13:14.919+0000 7f51e0695040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-19T00:13:15.119 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:13:15 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:13:15.073+0000 7f51e0695040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-08-19T00:13:15.262 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:13:14 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-y[23237]: 2024-08-19T00:13:14.954+0000 7f277fc76040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-08-19T00:13:15.263 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:13:15 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-y[23237]: 2024-08-19T00:13:15.012+0000 7f277fc76040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-19T00:13:15.263 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:13:15 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-y[23237]: 2024-08-19T00:13:15.078+0000 7f277fc76040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-19T00:13:15.263 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:13:15 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-y[23237]: 2024-08-19T00:13:15.261+0000 7f277fc76040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-19T00:13:15.279 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-19T00:13:15.279 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-19T00:13:15.279 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi044.front.sepia.ceph.com 2024-08-19T00:13:15.279 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-19T00:13:15.279 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-19T00:13:15.279 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-19T00:13:15.280 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-19T00:13:15.280 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-19T00:13:15.280 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:13:15.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:13:15.280 DEBUG:teuthology.orchestra.run.smithi044:> ip addr 2024-08-19T00:13:15.289 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:13:15 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-z[23624]: 2024-08-19T00:13:15.035+0000 7f8b88304040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-19T00:13:15.289 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:13:15 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-z[23624]: 2024-08-19T00:13:15.102+0000 7f8b88304040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-19T00:13:15.335 INFO:teuthology.orchestra.run.smithi044.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-19T00:13:15.336 INFO:teuthology.orchestra.run.smithi044.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-19T00:13:15.336 INFO:teuthology.orchestra.run.smithi044.stdout: inet 127.0.0.1/8 scope host lo 2024-08-19T00:13:15.336 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:13:15.336 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 ::1/128 scope host 2024-08-19T00:13:15.336 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:13:15.336 INFO:teuthology.orchestra.run.smithi044.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:13:15.336 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8c brd ff:ff:ff:ff:ff:ff 2024-08-19T00:13:15.336 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f0 2024-08-19T00:13:15.336 INFO:teuthology.orchestra.run.smithi044.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:13:15.336 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8d brd ff:ff:ff:ff:ff:ff 2024-08-19T00:13:15.336 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f1 2024-08-19T00:13:15.336 INFO:teuthology.orchestra.run.smithi044.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-19T00:13:15.336 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:72 brd ff:ff:ff:ff:ff:ff 2024-08-19T00:13:15.337 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f0 2024-08-19T00:13:15.337 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.21.15.44/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-19T00:13:15.337 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft 42273sec preferred_lft 42273sec 2024-08-19T00:13:15.337 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::9c56:c472:40c2:758e/64 scope link noprefixroute 2024-08-19T00:13:15.337 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:13:15.337 INFO:teuthology.orchestra.run.smithi044.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:13:15.337 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:73 brd ff:ff:ff:ff:ff:ff 2024-08-19T00:13:15.337 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f1 2024-08-19T00:13:15.337 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-19T00:13:15.338 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-19T00:13:15.338 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-08-19T00:13:15.338 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link add name ceph-brx type bridge 2024-08-19T00:13:15.338 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip addr flush dev ceph-brx 2024-08-19T00:13:15.338 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set ceph-brx up 2024-08-19T00:13:15.338 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-19T00:13:15.338 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-08-19T00:13:15.403 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:15 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/4021581910' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-08-19T00:13:15.404 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:13:15 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:13:15.135+0000 7f51e0695040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-19T00:13:15.404 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:13:15 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:13:15.204+0000 7f51e0695040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-19T00:13:15.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:13:15.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:13:15.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:13:15.480 DEBUG:teuthology.orchestra.run.smithi044:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-19T00:13:15.545 INFO:teuthology.orchestra.run.smithi044.stdout:1 2024-08-19T00:13:15.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:13:15.550 DEBUG:teuthology.orchestra.run.smithi044:> route 2024-08-19T00:13:15.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:15 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/4021581910' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-08-19T00:13:15.592 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:13:15 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-z[23624]: 2024-08-19T00:13:15.287+0000 7f8b88304040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-19T00:13:15.592 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:13:15 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-z[23624]: 2024-08-19T00:13:15.350+0000 7f8b88304040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-19T00:13:15.592 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:13:15 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-z[23624]: 2024-08-19T00:13:15.410+0000 7f8b88304040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-19T00:13:15.592 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:13:15 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-z[23624]: 2024-08-19T00:13:15.477+0000 7f8b88304040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-19T00:13:15.603 INFO:teuthology.orchestra.run.smithi044.stdout:Kernel IP routing table 2024-08-19T00:13:15.603 INFO:teuthology.orchestra.run.smithi044.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-19T00:13:15.603 INFO:teuthology.orchestra.run.smithi044.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-19T00:13:15.603 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-19T00:13:15.603 INFO:teuthology.orchestra.run.smithi044.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-19T00:13:15.603 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-19T00:13:15.604 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-08-19T00:13:15.604 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-19T00:13:15.604 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-19T00:13:15.604 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-19T00:13:15.604 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-08-19T00:13:15.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:15 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/4021581910' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-08-19T00:13:15.615 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:13:15 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-y[23237]: 2024-08-19T00:13:15.322+0000 7f277fc76040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-19T00:13:15.615 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:13:15 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-y[23237]: 2024-08-19T00:13:15.383+0000 7f277fc76040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-19T00:13:15.615 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:13:15 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-y[23237]: 2024-08-19T00:13:15.450+0000 7f277fc76040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-19T00:13:15.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:13:15.700 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:13:15 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:13:15.402+0000 7f51e0695040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-19T00:13:15.700 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:13:15 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:13:15.470+0000 7f51e0695040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-19T00:13:15.700 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:13:15 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:13:15.534+0000 7f51e0695040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-19T00:13:15.700 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:13:15 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:13:15.606+0000 7f51e0695040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-19T00:13:15.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:13:15.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:13:15.732 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2024-08-19T00:13:15.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:13:15.747 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list-id 2024-08-19T00:13:15.803 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-19T00:13:15.803 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-08-19T00:13:15.803 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-19T00:13:15.803 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-08-19T00:13:15.803 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-08-19T00:13:15.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:13:15.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:13:15.922 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-08-19T00:13:15.922 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-19T00:13:15.923 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-08-19T00:13:15.923 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-08-19T00:13:15.923 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-19T00:13:15.923 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-08-19T00:13:15.923 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-08-19T00:13:15.923 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-08-19T00:13:15.923 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-08-19T00:13:15.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:13:15.980 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:13:15 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:13:15.834+0000 7f51e0695040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-19T00:13:15.980 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:13:15 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:13:15.897+0000 7f51e0695040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-19T00:13:16.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:13:16.039 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-19T00:13:16.039 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-08-19T00:13:16.039 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set brx.0 up 2024-08-19T00:13:16.039 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set dev brx.0 master ceph-brx 2024-08-19T00:13:16.039 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-08-19T00:13:16.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:13:16.092 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:13:15 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-z[23624]: 2024-08-19T00:13:15.687+0000 7f8b88304040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-19T00:13:16.092 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:13:15 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-z[23624]: 2024-08-19T00:13:15.746+0000 7f8b88304040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-19T00:13:16.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:13:16.115 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:13:15 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-y[23237]: 2024-08-19T00:13:15.659+0000 7f277fc76040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-19T00:13:16.115 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:13:15 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-y[23237]: 2024-08-19T00:13:15.719+0000 7f277fc76040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-19T00:13:16.117 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-19T00:13:16.117 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-19T00:13:16.131 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:13:16.132 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-19T00:13:16.132 DEBUG:teuthology.orchestra.run.smithi044:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-19T00:13:16.187 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-08-19T00:13:16.187 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-08-19T00:13:16.187 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/6abd1eb0-902d-42d1-a61d-3eb92f1944c4 2024-08-19T00:13:16.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:13:16.188 DEBUG:teuthology.orchestra.run.smithi044:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/6abd1eb0-902d-42d1-a61d-3eb92f1944c4 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-08-19T00:13:16.270 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-08-19T00:13:16.271 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync". 2024-08-19T00:13:16.407 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-08-19T00:13:16.407 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync". 2024-08-19T00:13:16.407 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: resolved to: "172.21.15.44:3300,172.21.15.116:3300,172.21.15.171:3300" 2024-08-19T00:13:16.407 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: trying mount with new device syntax: 0@647ded64-5dbe-11ef-bccf-c7b262605968.cephfs=/volumes/qa/sv_1/6abd1eb0-902d-42d1-a61d-3eb92f1944c4 2024-08-19T00:13:16.407 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync,name=0,key=0,mon_addr=172.21.15.44:3300/172.21.15.116:3300/172.21.15.171:3300" will pass to kernel 2024-08-19T00:13:16.408 INFO:teuthology.orchestra.run.smithi044.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-08-19T00:13:16.408 INFO:teuthology.orchestra.run.smithi044.stdout: You just mounted a file system that supports labels which does not 2024-08-19T00:13:16.408 INFO:teuthology.orchestra.run.smithi044.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-19T00:13:16.408 INFO:teuthology.orchestra.run.smithi044.stdout: applications will generate AVC messages and not be allowed access to 2024-08-19T00:13:16.408 INFO:teuthology.orchestra.run.smithi044.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-19T00:13:16.410 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-19T00:13:16.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:13:16.410 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-19T00:13:16.476 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-19T00:13:16.552 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:13:16 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-y[23237]: 2024-08-19T00:13:16.239+0000 7f277fc76040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-19T00:13:16.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-19T00:13:16.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:13:16.575 INFO:teuthology.orchestra.run.smithi044.stdout:client15306 2024-08-19T00:13:16.575 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-08-19T00:13:16.575 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:13:16.583 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:13:16 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-z[23624]: 2024-08-19T00:13:16.266+0000 7f8b88304040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-19T00:13:16.592 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-19T00:13:16.619 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:13:16 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:13:16.458+0000 7f51e0695040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-19T00:13:16.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-19T00:13:16.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:13:16.675 INFO:teuthology.orchestra.run.smithi044.stdout:client15306 2024-08-19T00:13:16.675 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-19T00:13:16.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-19T00:13:16.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:13:16.731 INFO:teuthology.orchestra.run.smithi044.stdout:client15306 2024-08-19T00:13:16.731 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/647ded64-5dbe-11ef-bccf-c7b262605968.client15306/status') 2024-08-19T00:13:16.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:13:16.789 INFO:teuthology.orchestra.run.smithi044.stdout:instance: client.15306 (3)192.168.0.1:0/1818496950 2024-08-19T00:13:16.789 INFO:teuthology.orchestra.run.smithi044.stdout:blocklisted: false 2024-08-19T00:13:16.790 INFO:teuthology.orchestra.run.smithi044.stderr:0+1 records in 2024-08-19T00:13:16.790 INFO:teuthology.orchestra.run.smithi044.stderr:0+1 records out 2024-08-19T00:13:16.790 INFO:teuthology.orchestra.run.smithi044.stderr:70 bytes copied, 2.2559e-05 s, 3.1 MB/s 2024-08-19T00:13:16.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:13:16.797 INFO:teuthology.run_tasks:Running task exec... 2024-08-19T00:13:16.807 INFO:teuthology.task.exec:Executing custom commands... 2024-08-19T00:13:16.807 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi044.front.sepia.ceph.com 2024-08-19T00:13:16.807 DEBUG:teuthology.orchestra.run.smithi044:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-08-19T00:13:16.842 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:13:16 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-z[23624]: 2024-08-19T00:13:16.581+0000 7f8b88304040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-19T00:13:16.865 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:13:16 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-y[23237]: 2024-08-19T00:13:16.552+0000 7f277fc76040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-19T00:13:16.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:16.910+0000 7f6028825640 1 -- 172.21.15.44:0/1005980604 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6024101060 msgr2=0x7f60241014e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:16.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:16.910+0000 7f6028825640 1 --2- 172.21.15.44:0/1005980604 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6024101060 0x7f60241014e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f600c009900 tx=0x7f600c02a400 comp rx=0 tx=0).stop 2024-08-19T00:13:16.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:16.910+0000 7f6028825640 1 -- 172.21.15.44:0/1005980604 shutdown_connections 2024-08-19T00:13:16.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:16.910+0000 7f6028825640 1 --2- 172.21.15.44:0/1005980604 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6024101a20 0x7f6024108340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:16.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:16.910+0000 7f6028825640 1 --2- 172.21.15.44:0/1005980604 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6024101060 0x7f60241014e0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:16.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:16.910+0000 7f6028825640 1 --2- 172.21.15.44:0/1005980604 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f60240fff10 0x7f6024100310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:16.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:16.910+0000 7f6028825640 1 -- 172.21.15.44:0/1005980604 >> 172.21.15.44:0/1005980604 conn(0x7f60240fb6b0 msgr2=0x7f60240fdad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:16.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:16.910+0000 7f6028825640 1 -- 172.21.15.44:0/1005980604 shutdown_connections 2024-08-19T00:13:16.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:16.910+0000 7f6028825640 1 -- 172.21.15.44:0/1005980604 wait complete. 2024-08-19T00:13:16.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:16.911+0000 7f6028825640 1 Processor -- start 2024-08-19T00:13:16.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:16.911+0000 7f6028825640 1 -- start start 2024-08-19T00:13:16.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:16.911+0000 7f6028825640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f60240fff10 0x7f6024197b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:16.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:16.911+0000 7f6028825640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6024101060 0x7f60241980b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:16.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:16.911+0000 7f6028825640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6024101a20 0x7f602419f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:16.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:16.911+0000 7f6028825640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f602410b340 con 0x7f6024101060 2024-08-19T00:13:16.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:16.911+0000 7f6028825640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f602410b1c0 con 0x7f6024101a20 2024-08-19T00:13:16.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:16.911+0000 7f6028825640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f602410b4c0 con 0x7f60240fff10 2024-08-19T00:13:16.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:16.911+0000 7f601bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6024101060 0x7f60241980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:16.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:16.911+0000 7f601bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6024101060 0x7f60241980b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41754/0 (socket says 172.21.15.44:41754) 2024-08-19T00:13:16.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:16.911+0000 7f601bfff640 1 -- 172.21.15.44:0/3402698461 learned_addr learned my addr 172.21.15.44:0/3402698461 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:16.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:16.911+0000 7f6022d9d640 1 --2- 172.21.15.44:0/3402698461 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6024101a20 0x7f602419f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:16.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:16.911+0000 7f601bfff640 1 -- 172.21.15.44:0/3402698461 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f60240fff10 msgr2=0x7f6024197b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:16.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:16.911+0000 7f601bfff640 1 --2- 172.21.15.44:0/3402698461 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f60240fff10 0x7f6024197b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:16.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:16.911+0000 7f601bfff640 1 -- 172.21.15.44:0/3402698461 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6024101a20 msgr2=0x7f602419f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:16.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:16.911+0000 7f601bfff640 1 --2- 172.21.15.44:0/3402698461 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6024101a20 0x7f602419f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:16.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:16.911+0000 7f601bfff640 1 -- 172.21.15.44:0/3402698461 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f602419f790 con 0x7f6024101060 2024-08-19T00:13:16.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:16.911+0000 7f6022d9d640 1 --2- 172.21.15.44:0/3402698461 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6024101a20 0x7f602419f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:13:16.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:16.912+0000 7f601bfff640 1 --2- 172.21.15.44:0/3402698461 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6024101060 0x7f60241980b0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f600c031610 tx=0x7f600c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:16.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:16.912+0000 7f601b7fe640 1 -- 172.21.15.44:0/3402698461 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f600c03f030 con 0x7f6024101060 2024-08-19T00:13:16.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:16.912+0000 7f6028825640 1 -- 172.21.15.44:0/3402698461 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f602419fa20 con 0x7f6024101060 2024-08-19T00:13:16.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:16.912+0000 7f601b7fe640 1 -- 172.21.15.44:0/3402698461 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f600c003ad0 con 0x7f6024101060 2024-08-19T00:13:16.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:16.912+0000 7f601b7fe640 1 -- 172.21.15.44:0/3402698461 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f600c035070 con 0x7f6024101060 2024-08-19T00:13:16.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:16.912+0000 7f6028825640 1 -- 172.21.15.44:0/3402698461 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f602419ff60 con 0x7f6024101060 2024-08-19T00:13:16.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:16.913+0000 7f6028825640 1 -- 172.21.15.44:0/3402698461 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60241a0190 con 0x7f6024101060 2024-08-19T00:13:16.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:16.915+0000 7f601b7fe640 1 -- 172.21.15.44:0/3402698461 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 19) ==== 137850+0+0 (secure 0 0 0) 0x7f600c042030 con 0x7f6024101060 2024-08-19T00:13:16.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:16.916+0000 7f601b7fe640 1 --2- 172.21.15.44:0/3402698461 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f60100a2c80 0x7f60100a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:16.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:16.916+0000 7f602259c640 1 -- 172.21.15.44:0/3402698461 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f60100a2c80 msgr2=0x7f60100a5140 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.44:6800/1330072146 2024-08-19T00:13:16.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:16.916+0000 7f601b7fe640 1 -- 172.21.15.44:0/3402698461 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9187+0+0 (secure 0 0 0) 0x7f600c0efb00 con 0x7f6024101060 2024-08-19T00:13:16.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:16.916+0000 7f602259c640 1 --2- 172.21.15.44:0/3402698461 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f60100a2c80 0x7f60100a5140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T00:13:16.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:16.920+0000 7f601b7fe640 1 -- 172.21.15.44:0/3402698461 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f600c0bc640 con 0x7f6024101060 2024-08-19T00:13:17.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:17.117+0000 7f602259c640 1 -- 172.21.15.44:0/3402698461 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f60100a2c80 msgr2=0x7f60100a5140 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.44:6800/1330072146 2024-08-19T00:13:17.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:17.117+0000 7f602259c640 1 --2- 172.21.15.44:0/3402698461 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f60100a2c80 0x7f60100a5140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T00:13:17.119 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:13:16 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:13:16.790+0000 7f51e0695040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-19T00:13:17.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:17.135+0000 7f6028825640 1 -- 172.21.15.44:0/3402698461 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) -- 0x7f6024106c80 con 0x7f6024101060 2024-08-19T00:13:17.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:17.187+0000 7f601b7fe640 1 -- 172.21.15.44:0/3402698461 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v28) ==== 118+0+0 (secure 0 0 0) 0x7f600c0bbf40 con 0x7f6024101060 2024-08-19T00:13:17.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:17.189+0000 7f6028825640 1 -- 172.21.15.44:0/3402698461 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f60100a2c80 msgr2=0x7f60100a5140 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T00:13:17.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:17.189+0000 7f6028825640 1 --2- 172.21.15.44:0/3402698461 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f60100a2c80 0x7f60100a5140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:17.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:17.189+0000 7f6028825640 1 -- 172.21.15.44:0/3402698461 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6024101060 msgr2=0x7f60241980b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:17.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:17.189+0000 7f6028825640 1 --2- 172.21.15.44:0/3402698461 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6024101060 0x7f60241980b0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f600c031610 tx=0x7f600c004270 comp rx=0 tx=0).stop 2024-08-19T00:13:17.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:17.189+0000 7f6028825640 1 -- 172.21.15.44:0/3402698461 shutdown_connections 2024-08-19T00:13:17.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:17.189+0000 7f6028825640 1 --2- 172.21.15.44:0/3402698461 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7f60100a2c80 0x7f60100a5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:17.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:17.189+0000 7f6028825640 1 --2- 172.21.15.44:0/3402698461 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6024101a20 0x7f602419f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:17.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:17.189+0000 7f6028825640 1 --2- 172.21.15.44:0/3402698461 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6024101060 0x7f60241980b0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:17.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:17.189+0000 7f6028825640 1 --2- 172.21.15.44:0/3402698461 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f60240fff10 0x7f6024197b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:17.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:17.189+0000 7f6028825640 1 -- 172.21.15.44:0/3402698461 >> 172.21.15.44:0/3402698461 conn(0x7f60240fb6b0 msgr2=0x7f60240fd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:17.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:17.189+0000 7f6028825640 1 -- 172.21.15.44:0/3402698461 shutdown_connections 2024-08-19T00:13:17.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:17.190+0000 7f6028825640 1 -- 172.21.15.44:0/3402698461 wait complete. 2024-08-19T00:13:17.203 DEBUG:teuthology.orchestra.run.smithi044:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-08-19T00:13:17.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:17.308+0000 7ffab19f8640 1 -- 172.21.15.44:0/1754521277 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffaac102330 msgr2=0x7ffaac108bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:17.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:17.308+0000 7ffab19f8640 1 --2- 172.21.15.44:0/1754521277 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffaac102330 0x7ffaac108bc0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4009ca0 tx=0x7ffaa402a8c0 comp rx=0 tx=0).stop 2024-08-19T00:13:17.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:17.308+0000 7ffab19f8640 1 -- 172.21.15.44:0/1754521277 shutdown_connections 2024-08-19T00:13:17.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:17.308+0000 7ffab19f8640 1 --2- 172.21.15.44:0/1754521277 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffaac102330 0x7ffaac108bc0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:17.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:17.308+0000 7ffab19f8640 1 --2- 172.21.15.44:0/1754521277 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffaac101970 0x7ffaac101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:17.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:17.308+0000 7ffab19f8640 1 --2- 172.21.15.44:0/1754521277 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffaac100780 0x7ffaac100b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:17.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:17.308+0000 7ffab19f8640 1 -- 172.21.15.44:0/1754521277 >> 172.21.15.44:0/1754521277 conn(0x7ffaac0fbee0 msgr2=0x7ffaac0fe320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:17.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:17.308+0000 7ffab19f8640 1 -- 172.21.15.44:0/1754521277 shutdown_connections 2024-08-19T00:13:17.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:17.308+0000 7ffab19f8640 1 -- 172.21.15.44:0/1754521277 wait complete. 2024-08-19T00:13:17.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:17.308+0000 7ffab19f8640 1 Processor -- start 2024-08-19T00:13:17.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:17.309+0000 7ffab19f8640 1 -- start start 2024-08-19T00:13:17.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:17.309+0000 7ffab19f8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffaac100780 0x7ffaac06ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:17.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:17.309+0000 7ffab19f8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffaac101970 0x7ffaac19c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:17.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:17.309+0000 7ffab19f8640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffaac102330 0x7ffaac19eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:17.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:17.309+0000 7ffab19f8640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ffaac10c430 con 0x7ffaac101970 2024-08-19T00:13:17.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:17.309+0000 7ffab19f8640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7ffaac10c2b0 con 0x7ffaac100780 2024-08-19T00:13:17.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:17.309+0000 7ffab19f8640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ffaac10c5b0 con 0x7ffaac102330 2024-08-19T00:13:17.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:17.309+0000 7ffaaa7fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffaac101970 0x7ffaac19c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:17.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:17.309+0000 7ffaaa7fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffaac101970 0x7ffaac19c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41784/0 (socket says 172.21.15.44:41784) 2024-08-19T00:13:17.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:17.309+0000 7ffaaa7fc640 1 -- 172.21.15.44:0/3288995535 learned_addr learned my addr 172.21.15.44:0/3288995535 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:17.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:17.309+0000 7ffaaaffd640 1 --2- 172.21.15.44:0/3288995535 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffaac100780 0x7ffaac06ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:17.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:17.309+0000 7ffaab7fe640 1 --2- 172.21.15.44:0/3288995535 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffaac102330 0x7ffaac19eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:17.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:17.309+0000 7ffaaa7fc640 1 -- 172.21.15.44:0/3288995535 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffaac102330 msgr2=0x7ffaac19eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:17.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:17.309+0000 7ffaaa7fc640 1 --2- 172.21.15.44:0/3288995535 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffaac102330 0x7ffaac19eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:17.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:17.309+0000 7ffaaa7fc640 1 -- 172.21.15.44:0/3288995535 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffaac100780 msgr2=0x7ffaac06ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:17.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:17.309+0000 7ffaaa7fc640 1 --2- 172.21.15.44:0/3288995535 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffaac100780 0x7ffaac06ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:17.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:17.309+0000 7ffaaa7fc640 1 -- 172.21.15.44:0/3288995535 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaac19f7d0 con 0x7ffaac101970 2024-08-19T00:13:17.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:17.310+0000 7ffaaa7fc640 1 --2- 172.21.15.44:0/3288995535 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffaac101970 0x7ffaac19c8a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ffaa000d950 tx=0x7ffaa000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:17.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:17.310+0000 7ffab09f6640 1 -- 172.21.15.44:0/3288995535 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa0017030 con 0x7ffaac101970 2024-08-19T00:13:17.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:17.310+0000 7ffab09f6640 1 -- 172.21.15.44:0/3288995535 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffaa0004020 con 0x7ffaac101970 2024-08-19T00:13:17.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:17.310+0000 7ffab19f8640 1 -- 172.21.15.44:0/3288995535 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaac19fa60 con 0x7ffaac101970 2024-08-19T00:13:17.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:17.310+0000 7ffab09f6640 1 -- 172.21.15.44:0/3288995535 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa00047a0 con 0x7ffaac101970 2024-08-19T00:13:17.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:17.310+0000 7ffab19f8640 1 -- 172.21.15.44:0/3288995535 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaac1a0000 con 0x7ffaac101970 2024-08-19T00:13:17.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:17.311+0000 7ffab19f8640 1 -- 172.21.15.44:0/3288995535 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffaac107b20 con 0x7ffaac101970 2024-08-19T00:13:17.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:17.312+0000 7ffab09f6640 1 -- 172.21.15.44:0/3288995535 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 19) ==== 137850+0+0 (secure 0 0 0) 0x7ffaa00041d0 con 0x7ffaac101970 2024-08-19T00:13:17.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:17.313+0000 7ffab09f6640 1 --2- 172.21.15.44:0/3288995535 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7ffa940a2d00 0x7ffa940a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:17.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:17.313+0000 7ffaaaffd640 1 -- 172.21.15.44:0/3288995535 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7ffa940a2d00 msgr2=0x7ffa940a51c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.44:6800/1330072146 2024-08-19T00:13:17.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:17.313+0000 7ffab09f6640 1 -- 172.21.15.44:0/3288995535 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9187+0+0 (secure 0 0 0) 0x7ffaa00cec80 con 0x7ffaac101970 2024-08-19T00:13:17.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:17.313+0000 7ffaaaffd640 1 --2- 172.21.15.44:0/3288995535 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7ffa940a2d00 0x7ffa940a51c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T00:13:17.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:17.317+0000 7ffab09f6640 1 -- 172.21.15.44:0/3288995535 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7ffaa009b820 con 0x7ffaac101970 2024-08-19T00:13:17.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:17 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/3402698461' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-08-19T00:13:17.342 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:13:17 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-z[23624]: 2024-08-19T00:13:17.001+0000 7f8b88304040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-19T00:13:17.342 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:13:17 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-z[23624]: 2024-08-19T00:13:17.057+0000 7f8b88304040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-19T00:13:17.342 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:13:17 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-z[23624]: 2024-08-19T00:13:17.118+0000 7f8b88304040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-19T00:13:17.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:17 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/3402698461' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-08-19T00:13:17.365 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:13:16 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-y[23237]: 2024-08-19T00:13:16.969+0000 7f277fc76040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-19T00:13:17.365 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:13:17 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-y[23237]: 2024-08-19T00:13:17.025+0000 7f277fc76040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-19T00:13:17.366 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:13:17 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-y[23237]: 2024-08-19T00:13:17.085+0000 7f277fc76040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-19T00:13:17.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:17.514+0000 7ffaaaffd640 1 -- 172.21.15.44:0/3288995535 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7ffa940a2d00 msgr2=0x7ffa940a51c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.44:6800/1330072146 2024-08-19T00:13:17.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:17.514+0000 7ffaaaffd640 1 --2- 172.21.15.44:0/3288995535 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7ffa940a2d00 0x7ffa940a51c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T00:13:17.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:17.520+0000 7ffab19f8640 1 -- 172.21.15.44:0/3288995535 --> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7ffaac0624c0 con 0x7ffa940a2d00 2024-08-19T00:13:17.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:17 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/3402698461' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-08-19T00:13:17.619 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:13:17 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:13:17.232+0000 7f51e0695040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-19T00:13:17.619 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:13:17 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:13:17.293+0000 7f51e0695040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-19T00:13:17.619 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:13:17 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:13:17.357+0000 7f51e0695040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-19T00:13:17.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:17.915+0000 7ffaaaffd640 1 -- 172.21.15.44:0/3288995535 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7ffa940a2d00 msgr2=0x7ffa940a51c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.44:6800/1330072146 2024-08-19T00:13:17.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:17.915+0000 7ffaaaffd640 1 --2- 172.21.15.44:0/3288995535 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7ffa940a2d00 0x7ffa940a51c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T00:13:18.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:18.206+0000 7ffab09f6640 1 -- 172.21.15.44:0/3288995535 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mgrmap(e 20) ==== 137850+0+0 (secure 0 0 0) 0x7ffaa0097790 con 0x7ffaac101970 2024-08-19T00:13:18.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:18.512+0000 7ffab09f6640 1 -- 172.21.15.44:0/3288995535 <== mon.0 v2:172.21.15.44:3300/0 8 ==== mgrmap(e 21) ==== 137518+0+0 (secure 0 0 0) 0x7ffaa0096e70 con 0x7ffaac101970 2024-08-19T00:13:18.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:18.513+0000 7ffab09f6640 1 -- 172.21.15.44:0/3288995535 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7ffa940a2d00 msgr2=0x7ffa940a51c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T00:13:18.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:18.513+0000 7ffab09f6640 1 --2- 172.21.15.44:0/3288995535 >> [v2:172.21.15.44:6800/1330072146,v1:172.21.15.44:6801/1330072146] conn(0x7ffa940a2d00 0x7ffa940a51c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:18.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:18 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/3402698461' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-08-19T00:13:18.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:18 smithi171 ceph-mon[21810]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-19T00:13:18.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:18 smithi171 ceph-mon[21810]: Standby manager daemon y restarted 2024-08-19T00:13:18.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:18 smithi171 ceph-mon[21810]: Standby manager daemon y started 2024-08-19T00:13:18.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:18 smithi171 ceph-mon[21810]: from='mgr.? 172.21.15.116:0/3264933257' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-08-19T00:13:18.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:18 smithi171 ceph-mon[21810]: from='mgr.? 172.21.15.116:0/3264933257' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-19T00:13:18.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:18 smithi171 ceph-mon[21810]: from='mgr.? 172.21.15.116:0/3264933257' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-08-19T00:13:18.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:18 smithi171 ceph-mon[21810]: from='mgr.? 172.21.15.116:0/3264933257' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-19T00:13:18.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:18 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/3402698461' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-08-19T00:13:18.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:18 smithi116 ceph-mon[21873]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-19T00:13:18.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:18 smithi116 ceph-mon[21873]: Standby manager daemon y restarted 2024-08-19T00:13:18.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:18 smithi116 ceph-mon[21873]: Standby manager daemon y started 2024-08-19T00:13:18.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:18 smithi116 ceph-mon[21873]: from='mgr.? 172.21.15.116:0/3264933257' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-08-19T00:13:18.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:18 smithi116 ceph-mon[21873]: from='mgr.? 172.21.15.116:0/3264933257' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-19T00:13:18.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:18 smithi116 ceph-mon[21873]: from='mgr.? 172.21.15.116:0/3264933257' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-08-19T00:13:18.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:18 smithi116 ceph-mon[21873]: from='mgr.? 172.21.15.116:0/3264933257' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-19T00:13:18.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:18 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/3402698461' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-08-19T00:13:18.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:18 smithi044 ceph-mon[18489]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-19T00:13:18.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:18 smithi044 ceph-mon[18489]: Standby manager daemon y restarted 2024-08-19T00:13:18.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:18 smithi044 ceph-mon[18489]: Standby manager daemon y started 2024-08-19T00:13:18.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:18 smithi044 ceph-mon[18489]: from='mgr.? 172.21.15.116:0/3264933257' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-08-19T00:13:18.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:18 smithi044 ceph-mon[18489]: from='mgr.? 172.21.15.116:0/3264933257' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-19T00:13:18.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:18 smithi044 ceph-mon[18489]: from='mgr.? 172.21.15.116:0/3264933257' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-08-19T00:13:18.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:18 smithi044 ceph-mon[18489]: from='mgr.? 172.21.15.116:0/3264933257' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-19T00:13:19.085 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:13:18 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:13:18.748+0000 7f5148116640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-19T00:13:19.085 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:13:18 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:13:18.748+0000 7f5148116640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-19T00:13:19.085 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:13:18 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:13:18.748+0000 7f5148116640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-19T00:13:19.085 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:13:18 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:13:18.748+0000 7f5148116640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-19T00:13:19.085 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:13:18 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:13:18.748+0000 7f5148116640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-19T00:13:19.085 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:13:18 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:13:18.750+0000 7f514b11c640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-19T00:13:19.085 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:13:18 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:13:18.750+0000 7f514b11c640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-19T00:13:19.085 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:13:18 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:13:18.750+0000 7f514b11c640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-19T00:13:19.085 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:13:18 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:13:18.750+0000 7f514b11c640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-19T00:13:19.085 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:13:18 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:13:18.750+0000 7f514b11c640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-19T00:13:19.370 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:19 smithi044 ceph-mon[18489]: mgrmap e20: x(active, since 8m), standbys: z, y 2024-08-19T00:13:19.370 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:19 smithi044 ceph-mon[18489]: Standby manager daemon z restarted 2024-08-19T00:13:19.370 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:19 smithi044 ceph-mon[18489]: Standby manager daemon z started 2024-08-19T00:13:19.370 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:19 smithi044 ceph-mon[18489]: from='mgr.? 172.21.15.171:0/538610868' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-08-19T00:13:19.370 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:19 smithi044 ceph-mon[18489]: from='mgr.? 172.21.15.171:0/538610868' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-19T00:13:19.370 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:19 smithi044 ceph-mon[18489]: from='mgr.? 172.21.15.171:0/538610868' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-08-19T00:13:19.370 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:19 smithi044 ceph-mon[18489]: from='mgr.? 172.21.15.171:0/538610868' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-19T00:13:19.370 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:19 smithi044 ceph-mon[18489]: Active manager daemon x restarted 2024-08-19T00:13:19.371 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:19 smithi044 ceph-mon[18489]: Activating manager daemon x 2024-08-19T00:13:19.371 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:19 smithi044 ceph-mon[18489]: osdmap e95: 12 total, 12 up, 12 in 2024-08-19T00:13:19.371 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:19 smithi044 ceph-mon[18489]: mgrmap e21: x(active, starting, since 0.0125526s), standbys: z, y 2024-08-19T00:13:19.371 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:19 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-19T00:13:19.371 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:19 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-19T00:13:19.371 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:19 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-19T00:13:19.371 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:19 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-08-19T00:13:19.371 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:19 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-08-19T00:13:19.371 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:19 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-08-19T00:13:19.371 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:19 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-08-19T00:13:19.371 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:19 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-08-19T00:13:19.371 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:19 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-08-19T00:13:19.371 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:19 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-08-19T00:13:19.371 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:19 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-08-19T00:13:19.372 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:19 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-08-19T00:13:19.372 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:19 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-08-19T00:13:19.372 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:19 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-08-19T00:13:19.372 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:19 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-08-19T00:13:19.372 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:19 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-08-19T00:13:19.372 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:19 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-08-19T00:13:19.372 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:19 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-08-19T00:13:19.372 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:19 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-19T00:13:19.372 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:19 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-19T00:13:19.372 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:19 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-19T00:13:19.372 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:19 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-19T00:13:19.372 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:19 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-19T00:13:19.372 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:19 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-19T00:13:19.373 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:19 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-19T00:13:19.373 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:19 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-19T00:13:19.373 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:19 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-19T00:13:19.373 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:19 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-19T00:13:19.373 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:19 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-19T00:13:19.373 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:19 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-19T00:13:19.373 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:19 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-19T00:13:19.373 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:19 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-19T00:13:19.373 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:19 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-19T00:13:19.373 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:19 smithi044 ceph-mon[18489]: Manager daemon x is now available 2024-08-19T00:13:19.373 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:19 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:13:19.373 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:19 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-08-19T00:13:19.373 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:19 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-08-19T00:13:19.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.519+0000 7ffab09f6640 1 -- 172.21.15.44:0/3288995535 <== mon.0 v2:172.21.15.44:3300/0 9 ==== mgrmap(e 22) ==== 137645+0+0 (secure 0 0 0) 0x7ffaa004cb20 con 0x7ffaac101970 2024-08-19T00:13:19.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.520+0000 7ffab09f6640 1 --2- 172.21.15.44:0/3288995535 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7ffa940347f0 0x7ffa94034bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:19.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.520+0000 7ffab09f6640 1 -- 172.21.15.44:0/3288995535 --> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7ffaac0624c0 con 0x7ffa940347f0 2024-08-19T00:13:19.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.521+0000 7ffaaaffd640 1 --2- 172.21.15.44:0/3288995535 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7ffa940347f0 0x7ffa94034bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:19.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.526+0000 7ffaaaffd640 1 --2- 172.21.15.44:0/3288995535 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7ffa940347f0 0x7ffa94034bd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c005fd0 tx=0x7ffa9c00b410 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:19.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.547+0000 7ffab09f6640 1 -- 172.21.15.44:0/3288995535 <== mgr.15297 v2:172.21.15.44:6800/1029670730 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3 (secure 0 0 0) 0x7ffaac0624c0 con 0x7ffa940347f0 2024-08-19T00:13:19.571 INFO:teuthology.orchestra.run.smithi044.stdout:{} 2024-08-19T00:13:19.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.550+0000 7ffab19f8640 1 -- 172.21.15.44:0/3288995535 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7ffa940347f0 msgr2=0x7ffa94034bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:19.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.550+0000 7ffab19f8640 1 --2- 172.21.15.44:0/3288995535 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7ffa940347f0 0x7ffa94034bd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c005fd0 tx=0x7ffa9c00b410 comp rx=0 tx=0).stop 2024-08-19T00:13:19.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.550+0000 7ffab19f8640 1 -- 172.21.15.44:0/3288995535 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffaac101970 msgr2=0x7ffaac19c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:19.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.550+0000 7ffab19f8640 1 --2- 172.21.15.44:0/3288995535 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffaac101970 0x7ffaac19c8a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ffaa000d950 tx=0x7ffaa000de10 comp rx=0 tx=0).stop 2024-08-19T00:13:19.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.550+0000 7ffaab7fe640 1 -- 172.21.15.44:0/3288995535 reap_dead start 2024-08-19T00:13:19.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.550+0000 7ffab19f8640 1 -- 172.21.15.44:0/3288995535 shutdown_connections 2024-08-19T00:13:19.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.550+0000 7ffab19f8640 1 -- 172.21.15.44:0/3288995535 >> 172.21.15.44:0/3288995535 conn(0x7ffaac0fbee0 msgr2=0x7ffaac104cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:19.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.550+0000 7ffab19f8640 1 -- 172.21.15.44:0/3288995535 shutdown_connections 2024-08-19T00:13:19.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.550+0000 7ffab19f8640 1 -- 172.21.15.44:0/3288995535 wait complete. 2024-08-19T00:13:19.574 INFO:teuthology.run_tasks:Running task check-counter... 2024-08-19T00:13:19.611 INFO:teuthology.run_tasks:Running task exec... 2024-08-19T00:13:19.664 INFO:teuthology.task.exec:Executing custom commands... 2024-08-19T00:13:19.665 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi044.front.sepia.ceph.com 2024-08-19T00:13:19.665 DEBUG:teuthology.orchestra.run.smithi044:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/log_level debug' 2024-08-19T00:13:19.666 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:19 smithi116 ceph-mon[21873]: mgrmap e20: x(active, since 8m), standbys: z, y 2024-08-19T00:13:19.666 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:19 smithi116 ceph-mon[21873]: Standby manager daemon z restarted 2024-08-19T00:13:19.666 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:19 smithi116 ceph-mon[21873]: Standby manager daemon z started 2024-08-19T00:13:19.666 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:19 smithi116 ceph-mon[21873]: from='mgr.? 172.21.15.171:0/538610868' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-08-19T00:13:19.667 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:19 smithi116 ceph-mon[21873]: from='mgr.? 172.21.15.171:0/538610868' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-19T00:13:19.667 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:19 smithi116 ceph-mon[21873]: from='mgr.? 172.21.15.171:0/538610868' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-08-19T00:13:19.667 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:19 smithi116 ceph-mon[21873]: from='mgr.? 172.21.15.171:0/538610868' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-19T00:13:19.667 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:19 smithi116 ceph-mon[21873]: Active manager daemon x restarted 2024-08-19T00:13:19.667 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:19 smithi116 ceph-mon[21873]: Activating manager daemon x 2024-08-19T00:13:19.667 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:19 smithi116 ceph-mon[21873]: osdmap e95: 12 total, 12 up, 12 in 2024-08-19T00:13:19.667 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:19 smithi116 ceph-mon[21873]: mgrmap e21: x(active, starting, since 0.0125526s), standbys: z, y 2024-08-19T00:13:19.667 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:19 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-19T00:13:19.667 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:19 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-19T00:13:19.667 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:19 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-19T00:13:19.667 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:19 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-08-19T00:13:19.668 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:19 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-08-19T00:13:19.668 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:19 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-08-19T00:13:19.668 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:19 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-08-19T00:13:19.668 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:19 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-08-19T00:13:19.668 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:19 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-08-19T00:13:19.668 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:19 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-08-19T00:13:19.668 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:19 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-08-19T00:13:19.668 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:19 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-08-19T00:13:19.668 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:19 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-08-19T00:13:19.668 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:19 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-08-19T00:13:19.668 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:19 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-08-19T00:13:19.668 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:19 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-08-19T00:13:19.668 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:19 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-08-19T00:13:19.668 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:19 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-08-19T00:13:19.669 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:19 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-19T00:13:19.669 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:19 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-19T00:13:19.669 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:19 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-19T00:13:19.669 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:19 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-19T00:13:19.669 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:19 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-19T00:13:19.669 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:19 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-19T00:13:19.669 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:19 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-19T00:13:19.669 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:19 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-19T00:13:19.669 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:19 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-19T00:13:19.669 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:19 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-19T00:13:19.669 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:19 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-19T00:13:19.669 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:19 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-19T00:13:19.669 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:19 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-19T00:13:19.670 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:19 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-19T00:13:19.670 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:19 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-19T00:13:19.670 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:19 smithi116 ceph-mon[21873]: Manager daemon x is now available 2024-08-19T00:13:19.670 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:19 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:13:19.670 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:19 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-08-19T00:13:19.670 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:19 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-08-19T00:13:19.670 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:19 smithi171 ceph-mon[21810]: mgrmap e20: x(active, since 8m), standbys: z, y 2024-08-19T00:13:19.670 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:19 smithi171 ceph-mon[21810]: Standby manager daemon z restarted 2024-08-19T00:13:19.670 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:19 smithi171 ceph-mon[21810]: Standby manager daemon z started 2024-08-19T00:13:19.670 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:19 smithi171 ceph-mon[21810]: from='mgr.? 172.21.15.171:0/538610868' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-08-19T00:13:19.670 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:19 smithi171 ceph-mon[21810]: from='mgr.? 172.21.15.171:0/538610868' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-19T00:13:19.670 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:19 smithi171 ceph-mon[21810]: from='mgr.? 172.21.15.171:0/538610868' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-08-19T00:13:19.671 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:19 smithi171 ceph-mon[21810]: from='mgr.? 172.21.15.171:0/538610868' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-19T00:13:19.671 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:19 smithi171 ceph-mon[21810]: Active manager daemon x restarted 2024-08-19T00:13:19.671 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:19 smithi171 ceph-mon[21810]: Activating manager daemon x 2024-08-19T00:13:19.671 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:19 smithi171 ceph-mon[21810]: osdmap e95: 12 total, 12 up, 12 in 2024-08-19T00:13:19.671 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:19 smithi171 ceph-mon[21810]: mgrmap e21: x(active, starting, since 0.0125526s), standbys: z, y 2024-08-19T00:13:19.671 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:19 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-19T00:13:19.671 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:19 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-19T00:13:19.671 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:19 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-19T00:13:19.671 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:19 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-08-19T00:13:19.671 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:19 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-08-19T00:13:19.671 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:19 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-08-19T00:13:19.671 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:19 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-08-19T00:13:19.671 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:19 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-08-19T00:13:19.671 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:19 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-08-19T00:13:19.672 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:19 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-08-19T00:13:19.672 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:19 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-08-19T00:13:19.672 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:19 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-08-19T00:13:19.672 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:19 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-08-19T00:13:19.672 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:19 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-08-19T00:13:19.672 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:19 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-08-19T00:13:19.672 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:19 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-08-19T00:13:19.672 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:19 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-08-19T00:13:19.672 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:19 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-08-19T00:13:19.672 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:19 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-19T00:13:19.672 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:19 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-19T00:13:19.672 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:19 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-19T00:13:19.672 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:19 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-19T00:13:19.672 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:19 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-19T00:13:19.673 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:19 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-19T00:13:19.673 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:19 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-19T00:13:19.673 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:19 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-19T00:13:19.673 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:19 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-19T00:13:19.673 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:19 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-19T00:13:19.673 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:19 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-19T00:13:19.673 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:19 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-19T00:13:19.673 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:19 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-19T00:13:19.673 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:19 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-19T00:13:19.673 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:19 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-19T00:13:19.673 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:19 smithi171 ceph-mon[21810]: Manager daemon x is now available 2024-08-19T00:13:19.673 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:19 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:13:19.673 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:19 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-08-19T00:13:19.673 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:19 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-08-19T00:13:19.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.777+0000 7f82336ae640 1 -- 172.21.15.44:0/3546834783 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f822c100770 msgr2=0x7f822c100b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:19.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.777+0000 7f82336ae640 1 --2- 172.21.15.44:0/3546834783 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f822c100770 0x7f822c100b70 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f8228009900 tx=0x7f822802a410 comp rx=0 tx=0).stop 2024-08-19T00:13:19.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.777+0000 7f82336ae640 1 -- 172.21.15.44:0/3546834783 shutdown_connections 2024-08-19T00:13:19.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.777+0000 7f82336ae640 1 --2- 172.21.15.44:0/3546834783 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f822c102320 0x7f822c108bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:19.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.777+0000 7f82336ae640 1 --2- 172.21.15.44:0/3546834783 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f822c101960 0x7f822c101de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:19.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.777+0000 7f82336ae640 1 --2- 172.21.15.44:0/3546834783 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f822c100770 0x7f822c100b70 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:19.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.777+0000 7f82336ae640 1 -- 172.21.15.44:0/3546834783 >> 172.21.15.44:0/3546834783 conn(0x7f822c0fbf10 msgr2=0x7f822c0fe330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:19.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.777+0000 7f82336ae640 1 -- 172.21.15.44:0/3546834783 shutdown_connections 2024-08-19T00:13:19.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.777+0000 7f82336ae640 1 -- 172.21.15.44:0/3546834783 wait complete. 2024-08-19T00:13:19.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.778+0000 7f82336ae640 1 Processor -- start 2024-08-19T00:13:19.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.778+0000 7f82336ae640 1 -- start start 2024-08-19T00:13:19.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.778+0000 7f82336ae640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f822c100770 0x7f822c196a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:19.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.778+0000 7f82336ae640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f822c101960 0x7f822c196f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:19.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.778+0000 7f82336ae640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f822c102320 0x7f822c19dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:19.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.778+0000 7f82336ae640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f822c10c440 con 0x7f822c100770 2024-08-19T00:13:19.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.778+0000 7f82336ae640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f822c10c2c0 con 0x7f822c101960 2024-08-19T00:13:19.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.778+0000 7f82336ae640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f822c10c5c0 con 0x7f822c102320 2024-08-19T00:13:19.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.778+0000 7f823144a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f822c100770 0x7f822c196a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:19.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.778+0000 7f823144a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f822c100770 0x7f822c196a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36918/0 (socket says 172.21.15.44:36918) 2024-08-19T00:13:19.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.778+0000 7f823144a640 1 -- 172.21.15.44:0/4206586473 learned_addr learned my addr 172.21.15.44:0/4206586473 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:19.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.779+0000 7f8231c4b640 1 --2- 172.21.15.44:0/4206586473 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f822c102320 0x7f822c19dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:19.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.779+0000 7f8230c49640 1 --2- 172.21.15.44:0/4206586473 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f822c101960 0x7f822c196f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:19.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.779+0000 7f8231c4b640 1 -- 172.21.15.44:0/4206586473 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f822c101960 msgr2=0x7f822c196f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:19.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.779+0000 7f8231c4b640 1 --2- 172.21.15.44:0/4206586473 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f822c101960 0x7f822c196f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:19.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.779+0000 7f8231c4b640 1 -- 172.21.15.44:0/4206586473 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f822c100770 msgr2=0x7f822c196a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:19.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.779+0000 7f8231c4b640 1 --2- 172.21.15.44:0/4206586473 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f822c100770 0x7f822c196a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:19.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.779+0000 7f8231c4b640 1 -- 172.21.15.44:0/4206586473 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f822c19e620 con 0x7f822c102320 2024-08-19T00:13:19.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.779+0000 7f823144a640 1 --2- 172.21.15.44:0/4206586473 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f822c100770 0x7f822c196a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:13:19.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.779+0000 7f8230c49640 1 --2- 172.21.15.44:0/4206586473 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f822c101960 0x7f822c196f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:13:19.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.779+0000 7f8231c4b640 1 --2- 172.21.15.44:0/4206586473 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f822c102320 0x7f822c19dfb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8224009fd0 tx=0x7f822400ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:19.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.779+0000 7f82227fc640 1 -- 172.21.15.44:0/4206586473 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f822400ce20 con 0x7f822c102320 2024-08-19T00:13:19.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.779+0000 7f82336ae640 1 -- 172.21.15.44:0/4206586473 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f822c19e910 con 0x7f822c102320 2024-08-19T00:13:19.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.779+0000 7f82227fc640 1 -- 172.21.15.44:0/4206586473 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8224005020 con 0x7f822c102320 2024-08-19T00:13:19.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.779+0000 7f82227fc640 1 -- 172.21.15.44:0/4206586473 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8224010720 con 0x7f822c102320 2024-08-19T00:13:19.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.779+0000 7f82336ae640 1 -- 172.21.15.44:0/4206586473 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f822c19eeb0 con 0x7f822c102320 2024-08-19T00:13:19.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.780+0000 7f82336ae640 1 -- 172.21.15.44:0/4206586473 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f822c107a90 con 0x7f822c102320 2024-08-19T00:13:19.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.782+0000 7f82227fc640 1 -- 172.21.15.44:0/4206586473 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 22) ==== 137645+0+0 (secure 0 0 0) 0x7f8224005540 con 0x7f822c102320 2024-08-19T00:13:19.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.783+0000 7f82227fc640 1 --2- 172.21.15.44:0/4206586473 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f82180a2a40 0x7f82180a4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:19.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.783+0000 7f82227fc640 1 -- 172.21.15.44:0/4206586473 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f82240cf710 con 0x7f822c102320 2024-08-19T00:13:19.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.783+0000 7f823144a640 1 --2- 172.21.15.44:0/4206586473 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f82180a2a40 0x7f82180a4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:19.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.783+0000 7f823144a640 1 --2- 172.21.15.44:0/4206586473 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f82180a2a40 0x7f82180a4f00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8228000c00 tx=0x7f82280315b0 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:19.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.785+0000 7f82227fc640 1 -- 172.21.15.44:0/4206586473 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f822409c4a0 con 0x7f822c102320 2024-08-19T00:13:19.869 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:13:19 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:13:19.532+0000 7f51458d1640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-19T00:13:19.869 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:13:19 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:13:19.532+0000 7f51458d1640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-19T00:13:19.869 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:13:19 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:13:19.532+0000 7f51458d1640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-19T00:13:19.869 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:13:19 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:13:19.532+0000 7f51458d1640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-19T00:13:19.869 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:13:19 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:13:19.532+0000 7f51458d1640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-19T00:13:19.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.965+0000 7f82336ae640 1 -- 172.21.15.44:0/4206586473 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7f822c02d5e0 con 0x7f822c102320 2024-08-19T00:13:19.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.971+0000 7f82227fc640 1 -- 172.21.15.44:0/4206586473 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v31)=0 v31) ==== 129+0+0 (secure 0 0 0) 0x7f822409bda0 con 0x7f822c102320 2024-08-19T00:13:19.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.973+0000 7f82336ae640 1 -- 172.21.15.44:0/4206586473 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f82180a2a40 msgr2=0x7f82180a4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:19.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.973+0000 7f82336ae640 1 --2- 172.21.15.44:0/4206586473 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f82180a2a40 0x7f82180a4f00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8228000c00 tx=0x7f82280315b0 comp rx=0 tx=0).stop 2024-08-19T00:13:19.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.973+0000 7f82336ae640 1 -- 172.21.15.44:0/4206586473 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f822c102320 msgr2=0x7f822c19dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:19.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.973+0000 7f82336ae640 1 --2- 172.21.15.44:0/4206586473 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f822c102320 0x7f822c19dfb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8224009fd0 tx=0x7f822400ef10 comp rx=0 tx=0).stop 2024-08-19T00:13:19.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.973+0000 7f82336ae640 1 -- 172.21.15.44:0/4206586473 shutdown_connections 2024-08-19T00:13:19.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.973+0000 7f82336ae640 1 --2- 172.21.15.44:0/4206586473 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f82180a2a40 0x7f82180a4f00 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:19.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.973+0000 7f82336ae640 1 --2- 172.21.15.44:0/4206586473 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f822c102320 0x7f822c19dfb0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:19.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.973+0000 7f82336ae640 1 --2- 172.21.15.44:0/4206586473 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f822c101960 0x7f822c196f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:19.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.973+0000 7f82336ae640 1 --2- 172.21.15.44:0/4206586473 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f822c100770 0x7f822c196a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:19.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.973+0000 7f82336ae640 1 -- 172.21.15.44:0/4206586473 >> 172.21.15.44:0/4206586473 conn(0x7f822c0fbf10 msgr2=0x7f822c104c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:19.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.973+0000 7f82336ae640 1 -- 172.21.15.44:0/4206586473 shutdown_connections 2024-08-19T00:13:19.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:19.973+0000 7f82336ae640 1 -- 172.21.15.44:0/4206586473 wait complete. 2024-08-19T00:13:19.985 DEBUG:teuthology.orchestra.run.smithi044:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-08-19T00:13:20.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.089+0000 7f8d8a4fe640 1 -- 172.21.15.44:0/2455787096 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8d84101960 msgr2=0x7f8d84101de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:20.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.089+0000 7f8d8a4fe640 1 --2- 172.21.15.44:0/2455787096 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8d84101960 0x7f8d84101de0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c009900 tx=0x7f8d6c02a410 comp rx=0 tx=0).stop 2024-08-19T00:13:20.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.089+0000 7f8d8a4fe640 1 -- 172.21.15.44:0/2455787096 shutdown_connections 2024-08-19T00:13:20.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.089+0000 7f8d8a4fe640 1 --2- 172.21.15.44:0/2455787096 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8d84102320 0x7f8d84108bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:20.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.089+0000 7f8d8a4fe640 1 --2- 172.21.15.44:0/2455787096 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8d84101960 0x7f8d84101de0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:20.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.089+0000 7f8d8a4fe640 1 --2- 172.21.15.44:0/2455787096 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d84100770 0x7f8d84100b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:20.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.089+0000 7f8d8a4fe640 1 -- 172.21.15.44:0/2455787096 >> 172.21.15.44:0/2455787096 conn(0x7f8d840fbf10 msgr2=0x7f8d840fe330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:20.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.090+0000 7f8d8a4fe640 1 -- 172.21.15.44:0/2455787096 shutdown_connections 2024-08-19T00:13:20.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.090+0000 7f8d8a4fe640 1 -- 172.21.15.44:0/2455787096 wait complete. 2024-08-19T00:13:20.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.090+0000 7f8d8a4fe640 1 Processor -- start 2024-08-19T00:13:20.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.090+0000 7f8d8a4fe640 1 -- start start 2024-08-19T00:13:20.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.090+0000 7f8d8a4fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8d84100770 0x7f8d8406a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:20.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.090+0000 7f8d8a4fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8d84101960 0x7f8d8419c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:20.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.090+0000 7f8d8a4fe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d84102320 0x7f8d8419ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:20.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.090+0000 7f8d8a4fe640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8d8410c420 con 0x7f8d84100770 2024-08-19T00:13:20.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.090+0000 7f8d8a4fe640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f8d8410c2a0 con 0x7f8d84101960 2024-08-19T00:13:20.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.090+0000 7f8d8a4fe640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8d8410c5a0 con 0x7f8d84102320 2024-08-19T00:13:20.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.090+0000 7f8d83fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8d84100770 0x7f8d8406a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:20.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.090+0000 7f8d83fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8d84100770 0x7f8d8406a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36932/0 (socket says 172.21.15.44:36932) 2024-08-19T00:13:20.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.090+0000 7f8d83fff640 1 -- 172.21.15.44:0/2317141191 learned_addr learned my addr 172.21.15.44:0/2317141191 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:20.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.090+0000 7f8d7bfff640 1 --2- 172.21.15.44:0/2317141191 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8d84101960 0x7f8d8419c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:20.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.091+0000 7f8d88a9b640 1 --2- 172.21.15.44:0/2317141191 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d84102320 0x7f8d8419ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:20.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.091+0000 7f8d83fff640 1 -- 172.21.15.44:0/2317141191 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d84102320 msgr2=0x7f8d8419ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:20.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.091+0000 7f8d83fff640 1 --2- 172.21.15.44:0/2317141191 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d84102320 0x7f8d8419ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:20.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.091+0000 7f8d83fff640 1 -- 172.21.15.44:0/2317141191 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8d84101960 msgr2=0x7f8d8419c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:20.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.091+0000 7f8d83fff640 1 --2- 172.21.15.44:0/2317141191 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8d84101960 0x7f8d8419c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:20.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.091+0000 7f8d83fff640 1 -- 172.21.15.44:0/2317141191 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d8419f770 con 0x7f8d84100770 2024-08-19T00:13:20.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.091+0000 7f8d83fff640 1 --2- 172.21.15.44:0/2317141191 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8d84100770 0x7f8d8406a140 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f8d7400d770 tx=0x7f8d7400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:20.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.091+0000 7f8d81ffb640 1 -- 172.21.15.44:0/2317141191 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d74017070 con 0x7f8d84100770 2024-08-19T00:13:20.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.091+0000 7f8d8a4fe640 1 -- 172.21.15.44:0/2317141191 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d8419fa00 con 0x7f8d84100770 2024-08-19T00:13:20.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.091+0000 7f8d81ffb640 1 -- 172.21.15.44:0/2317141191 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d74009c30 con 0x7f8d84100770 2024-08-19T00:13:20.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.091+0000 7f8d81ffb640 1 -- 172.21.15.44:0/2317141191 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d74003dd0 con 0x7f8d84100770 2024-08-19T00:13:20.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.091+0000 7f8d8a4fe640 1 -- 172.21.15.44:0/2317141191 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d8419ff70 con 0x7f8d84100770 2024-08-19T00:13:20.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.092+0000 7f8d8a4fe640 1 -- 172.21.15.44:0/2317141191 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d84107a90 con 0x7f8d84100770 2024-08-19T00:13:20.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.093+0000 7f8d81ffb640 1 -- 172.21.15.44:0/2317141191 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 22) ==== 137645+0+0 (secure 0 0 0) 0x7f8d74003f70 con 0x7f8d84100770 2024-08-19T00:13:20.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.094+0000 7f8d81ffb640 1 --2- 172.21.15.44:0/2317141191 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f8d700a2a40 0x7f8d700a4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:20.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.094+0000 7f8d7bfff640 1 --2- 172.21.15.44:0/2317141191 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f8d700a2a40 0x7f8d700a4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:20.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.094+0000 7f8d81ffb640 1 -- 172.21.15.44:0/2317141191 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f8d740ceb00 con 0x7f8d84100770 2024-08-19T00:13:20.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.094+0000 7f8d7bfff640 1 --2- 172.21.15.44:0/2317141191 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f8d700a2a40 0x7f8d700a4f00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c031440 tx=0x7f8d6c0315b0 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:20.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.098+0000 7f8d81ffb640 1 -- 172.21.15.44:0/2317141191 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f8d7409b850 con 0x7f8d84100770 2024-08-19T00:13:20.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.277+0000 7f8d8a4fe640 1 -- 172.21.15.44:0/2317141191 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7f8d84062b20 con 0x7f8d84100770 2024-08-19T00:13:20.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.281+0000 7f8d81ffb640 1 -- 172.21.15.44:0/2317141191 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v32)=0 v32) ==== 138+0+0 (secure 0 0 0) 0x7f8d74009de0 con 0x7f8d84100770 2024-08-19T00:13:20.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.283+0000 7f8d8a4fe640 1 -- 172.21.15.44:0/2317141191 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f8d700a2a40 msgr2=0x7f8d700a4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:20.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.283+0000 7f8d8a4fe640 1 --2- 172.21.15.44:0/2317141191 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f8d700a2a40 0x7f8d700a4f00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c031440 tx=0x7f8d6c0315b0 comp rx=0 tx=0).stop 2024-08-19T00:13:20.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.283+0000 7f8d8a4fe640 1 -- 172.21.15.44:0/2317141191 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8d84100770 msgr2=0x7f8d8406a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:20.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.283+0000 7f8d8a4fe640 1 --2- 172.21.15.44:0/2317141191 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8d84100770 0x7f8d8406a140 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f8d7400d770 tx=0x7f8d7400dc30 comp rx=0 tx=0).stop 2024-08-19T00:13:20.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.283+0000 7f8d8a4fe640 1 -- 172.21.15.44:0/2317141191 shutdown_connections 2024-08-19T00:13:20.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.283+0000 7f8d8a4fe640 1 --2- 172.21.15.44:0/2317141191 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f8d700a2a40 0x7f8d700a4f00 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:20.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.283+0000 7f8d8a4fe640 1 --2- 172.21.15.44:0/2317141191 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d84102320 0x7f8d8419ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:20.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.283+0000 7f8d8a4fe640 1 --2- 172.21.15.44:0/2317141191 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8d84101960 0x7f8d8419c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:20.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.283+0000 7f8d8a4fe640 1 --2- 172.21.15.44:0/2317141191 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8d84100770 0x7f8d8406a140 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:20.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.283+0000 7f8d8a4fe640 1 -- 172.21.15.44:0/2317141191 >> 172.21.15.44:0/2317141191 conn(0x7f8d840fbf10 msgr2=0x7f8d84104c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:20.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.283+0000 7f8d8a4fe640 1 -- 172.21.15.44:0/2317141191 shutdown_connections 2024-08-19T00:13:20.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.283+0000 7f8d8a4fe640 1 -- 172.21.15.44:0/2317141191 wait complete. 2024-08-19T00:13:20.297 DEBUG:teuthology.orchestra.run.smithi044:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2024-08-19T00:13:20.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.412+0000 7fa9d0f9d640 1 -- 172.21.15.44:0/522971329 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa9cc102150 msgr2=0x7fa9cc104540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:20.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.412+0000 7fa9d0f9d640 1 --2- 172.21.15.44:0/522971329 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa9cc102150 0x7fa9cc104540 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc009860 tx=0x7fa9bc02a340 comp rx=0 tx=0).stop 2024-08-19T00:13:20.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.412+0000 7fa9d0f9d640 1 -- 172.21.15.44:0/522971329 shutdown_connections 2024-08-19T00:13:20.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.412+0000 7fa9d0f9d640 1 --2- 172.21.15.44:0/522971329 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa9cc1073b0 0x7fa9cc1097c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:20.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.412+0000 7fa9d0f9d640 1 --2- 172.21.15.44:0/522971329 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9cc104a80 0x7fa9cc106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:20.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.412+0000 7fa9d0f9d640 1 --2- 172.21.15.44:0/522971329 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa9cc102150 0x7fa9cc104540 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:20.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.412+0000 7fa9d0f9d640 1 -- 172.21.15.44:0/522971329 >> 172.21.15.44:0/522971329 conn(0x7fa9cc0fbcd0 msgr2=0x7fa9cc0fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:20.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.412+0000 7fa9d0f9d640 1 -- 172.21.15.44:0/522971329 shutdown_connections 2024-08-19T00:13:20.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.412+0000 7fa9d0f9d640 1 -- 172.21.15.44:0/522971329 wait complete. 2024-08-19T00:13:20.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.413+0000 7fa9d0f9d640 1 Processor -- start 2024-08-19T00:13:20.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.413+0000 7fa9d0f9d640 1 -- start start 2024-08-19T00:13:20.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.413+0000 7fa9d0f9d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa9cc102150 0x7fa9cc197ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:20.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.413+0000 7fa9d0f9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9cc104a80 0x7fa9cc197ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:20.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.413+0000 7fa9d0f9d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa9cc1073b0 0x7fa9cc19f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:20.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.413+0000 7fa9d0f9d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa9cc10d3a0 con 0x7fa9cc104a80 2024-08-19T00:13:20.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.413+0000 7fa9d0f9d640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fa9cc10d220 con 0x7fa9cc102150 2024-08-19T00:13:20.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.413+0000 7fa9d0f9d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa9cc10d520 con 0x7fa9cc1073b0 2024-08-19T00:13:20.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.414+0000 7fa9cb7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa9cc102150 0x7fa9cc197ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:20.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.414+0000 7fa9c3fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9cc104a80 0x7fa9cc197ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:20.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.414+0000 7fa9cb7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa9cc102150 0x7fa9cc197ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.44:42360/0 (socket says 172.21.15.44:42360) 2024-08-19T00:13:20.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.414+0000 7fa9c3fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9cc104a80 0x7fa9cc197ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36956/0 (socket says 172.21.15.44:36956) 2024-08-19T00:13:20.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.414+0000 7fa9cb7fe640 1 -- 172.21.15.44:0/2296772403 learned_addr learned my addr 172.21.15.44:0/2296772403 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:20.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.414+0000 7fa9cbfff640 1 --2- 172.21.15.44:0/2296772403 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa9cc1073b0 0x7fa9cc19f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:20.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.414+0000 7fa9cb7fe640 1 -- 172.21.15.44:0/2296772403 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa9cc1073b0 msgr2=0x7fa9cc19f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:20.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.414+0000 7fa9cb7fe640 1 --2- 172.21.15.44:0/2296772403 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa9cc1073b0 0x7fa9cc19f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:20.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.414+0000 7fa9cb7fe640 1 -- 172.21.15.44:0/2296772403 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9cc104a80 msgr2=0x7fa9cc197ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:20.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.414+0000 7fa9cb7fe640 1 --2- 172.21.15.44:0/2296772403 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9cc104a80 0x7fa9cc197ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:20.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.414+0000 7fa9cb7fe640 1 -- 172.21.15.44:0/2296772403 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9cc19f680 con 0x7fa9cc102150 2024-08-19T00:13:20.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.414+0000 7fa9cbfff640 1 --2- 172.21.15.44:0/2296772403 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa9cc1073b0 0x7fa9cc19f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:13:20.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.414+0000 7fa9c3fff640 1 --2- 172.21.15.44:0/2296772403 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9cc104a80 0x7fa9cc197ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:13:20.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.414+0000 7fa9cb7fe640 1 --2- 172.21.15.44:0/2296772403 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa9cc102150 0x7fa9cc197ab0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc005940 tx=0x7fa9bc033d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:20.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.414+0000 7fa9c97fa640 1 -- 172.21.15.44:0/2296772403 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9bc03f020 con 0x7fa9cc102150 2024-08-19T00:13:20.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.414+0000 7fa9c97fa640 1 -- 172.21.15.44:0/2296772403 <== mon.2 v2:172.21.15.116:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa9bc030850 con 0x7fa9cc102150 2024-08-19T00:13:20.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.414+0000 7fa9c97fa640 1 -- 172.21.15.44:0/2296772403 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9bc037040 con 0x7fa9cc102150 2024-08-19T00:13:20.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.414+0000 7fa9d0f9d640 1 -- 172.21.15.44:0/2296772403 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9cc0fff40 con 0x7fa9cc102150 2024-08-19T00:13:20.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.415+0000 7fa9d0f9d640 1 -- 172.21.15.44:0/2296772403 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9cc1004b0 con 0x7fa9cc102150 2024-08-19T00:13:20.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.415+0000 7fa9d0f9d640 1 -- 172.21.15.44:0/2296772403 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9cc0fd7c0 con 0x7fa9cc102150 2024-08-19T00:13:20.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.417+0000 7fa9c97fa640 1 -- 172.21.15.44:0/2296772403 <== mon.2 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 22) ==== 137645+0+0 (secure 0 0 0) 0x7fa9bc042020 con 0x7fa9cc102150 2024-08-19T00:13:20.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.418+0000 7fa9c97fa640 1 --2- 172.21.15.44:0/2296772403 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fa9b80a2970 0x7fa9b80a4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:20.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.418+0000 7fa9c3fff640 1 --2- 172.21.15.44:0/2296772403 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fa9b80a2970 0x7fa9b80a4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:20.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.418+0000 7fa9c97fa640 1 -- 172.21.15.44:0/2296772403 <== mon.2 v2:172.21.15.116:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7fa9bc0ef760 con 0x7fa9cc102150 2024-08-19T00:13:20.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.418+0000 7fa9c3fff640 1 --2- 172.21.15.44:0/2296772403 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fa9b80a2970 0x7fa9b80a4e30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa9b40096c0 tx=0x7fa9b4012040 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:20.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.421+0000 7fa9c97fa640 1 -- 172.21.15.44:0/2296772403 <== mon.2 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fa9bc049020 con 0x7fa9cc102150 2024-08-19T00:13:20.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:20 smithi044 ceph-mon[18489]: mgrmap e22: x(active, since 1.02257s), standbys: z, y 2024-08-19T00:13:20.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:20 smithi044 ceph-mon[18489]: from='client.15318 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:13:20.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:20 smithi044 ceph-mon[18489]: pgmap v3: 129 pgs: 129 active+clean; 1.1 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:13:20.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:20 smithi044 ceph-mon[18489]: from='client.? ' entity='client.admin' 2024-08-19T00:13:20.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:20 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/2317141191' entity='client.admin' 2024-08-19T00:13:20.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.651+0000 7fa9d0f9d640 1 -- 172.21.15.44:0/2296772403 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7fa9cc02d5e0 con 0x7fa9cc102150 2024-08-19T00:13:20.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.656+0000 7fa9c97fa640 1 -- 172.21.15.44:0/2296772403 <== mon.2 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v33)=0 v33) ==== 133+0+0 (secure 0 0 0) 0x7fa9bc0bc4f0 con 0x7fa9cc102150 2024-08-19T00:13:20.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.660+0000 7fa9d0f9d640 1 -- 172.21.15.44:0/2296772403 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fa9b80a2970 msgr2=0x7fa9b80a4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:20.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.660+0000 7fa9d0f9d640 1 --2- 172.21.15.44:0/2296772403 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fa9b80a2970 0x7fa9b80a4e30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa9b40096c0 tx=0x7fa9b4012040 comp rx=0 tx=0).stop 2024-08-19T00:13:20.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.660+0000 7fa9d0f9d640 1 -- 172.21.15.44:0/2296772403 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa9cc102150 msgr2=0x7fa9cc197ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:20.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.660+0000 7fa9d0f9d640 1 --2- 172.21.15.44:0/2296772403 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa9cc102150 0x7fa9cc197ab0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc005940 tx=0x7fa9bc033d90 comp rx=0 tx=0).stop 2024-08-19T00:13:20.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.660+0000 7fa9d0f9d640 1 -- 172.21.15.44:0/2296772403 shutdown_connections 2024-08-19T00:13:20.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.660+0000 7fa9d0f9d640 1 --2- 172.21.15.44:0/2296772403 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fa9b80a2970 0x7fa9b80a4e30 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:20.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.660+0000 7fa9d0f9d640 1 --2- 172.21.15.44:0/2296772403 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa9cc1073b0 0x7fa9cc19f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:20.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.660+0000 7fa9d0f9d640 1 --2- 172.21.15.44:0/2296772403 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9cc104a80 0x7fa9cc197ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:20.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.660+0000 7fa9d0f9d640 1 --2- 172.21.15.44:0/2296772403 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa9cc102150 0x7fa9cc197ab0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:20.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.660+0000 7fa9d0f9d640 1 -- 172.21.15.44:0/2296772403 >> 172.21.15.44:0/2296772403 conn(0x7fa9cc0fbcd0 msgr2=0x7fa9cc102a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:20.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.660+0000 7fa9d0f9d640 1 -- 172.21.15.44:0/2296772403 shutdown_connections 2024-08-19T00:13:20.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.660+0000 7fa9d0f9d640 1 -- 172.21.15.44:0/2296772403 wait complete. 2024-08-19T00:13:20.676 DEBUG:teuthology.orchestra.run.smithi044:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-08-19T00:13:20.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.796+0000 7f58569fc640 1 -- 172.21.15.44:0/925186042 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5850102300 msgr2=0x7f58501046f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:20.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.796+0000 7f58569fc640 1 --2- 172.21.15.44:0/925186042 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5850102300 0x7f58501046f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f5840009900 tx=0x7f584002a410 comp rx=0 tx=0).stop 2024-08-19T00:13:20.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.796+0000 7f58569fc640 1 -- 172.21.15.44:0/925186042 shutdown_connections 2024-08-19T00:13:20.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.796+0000 7f58569fc640 1 --2- 172.21.15.44:0/925186042 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5850107560 0x7f58501099d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:20.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.796+0000 7f58569fc640 1 --2- 172.21.15.44:0/925186042 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5850104c30 0x7f5850107020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:20.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.796+0000 7f58569fc640 1 --2- 172.21.15.44:0/925186042 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5850102300 0x7f58501046f0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:20.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.796+0000 7f58569fc640 1 -- 172.21.15.44:0/925186042 >> 172.21.15.44:0/925186042 conn(0x7f58500fbee0 msgr2=0x7f58500fe320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:20.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.796+0000 7f58569fc640 1 -- 172.21.15.44:0/925186042 shutdown_connections 2024-08-19T00:13:20.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.796+0000 7f58569fc640 1 -- 172.21.15.44:0/925186042 wait complete. 2024-08-19T00:13:20.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.796+0000 7f58569fc640 1 Processor -- start 2024-08-19T00:13:20.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.796+0000 7f58569fc640 1 -- start start 2024-08-19T00:13:20.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.797+0000 7f58569fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5850102300 0x7f5850197b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:20.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.797+0000 7f58569fc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5850104c30 0x7f58501980d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:20.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.797+0000 7f58569fc640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5850107560 0x7f585019f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:20.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.797+0000 7f58569fc640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f585010d570 con 0x7f5850102300 2024-08-19T00:13:20.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.797+0000 7f58569fc640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f585010d3f0 con 0x7f5850104c30 2024-08-19T00:13:20.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.797+0000 7f58569fc640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f585010d6f0 con 0x7f5850107560 2024-08-19T00:13:20.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.797+0000 7f584ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5850102300 0x7f5850197b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:20.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.797+0000 7f584ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5850102300 0x7f5850197b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37012/0 (socket says 172.21.15.44:37012) 2024-08-19T00:13:20.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.797+0000 7f584ffff640 1 -- 172.21.15.44:0/3912984958 learned_addr learned my addr 172.21.15.44:0/3912984958 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:20.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.797+0000 7f584f7fe640 1 --2- 172.21.15.44:0/3912984958 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5850104c30 0x7f58501980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:20.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.797+0000 7f5854f99640 1 --2- 172.21.15.44:0/3912984958 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5850107560 0x7f585019f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:20.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.797+0000 7f584f7fe640 1 -- 172.21.15.44:0/3912984958 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5850107560 msgr2=0x7f585019f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:20.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.797+0000 7f584f7fe640 1 --2- 172.21.15.44:0/3912984958 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5850107560 0x7f585019f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:20.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.797+0000 7f584f7fe640 1 -- 172.21.15.44:0/3912984958 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5850102300 msgr2=0x7f5850197b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:20.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.797+0000 7f584f7fe640 1 --2- 172.21.15.44:0/3912984958 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5850102300 0x7f5850197b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:20.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.797+0000 7f584f7fe640 1 -- 172.21.15.44:0/3912984958 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f585019f7b0 con 0x7f5850104c30 2024-08-19T00:13:20.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.797+0000 7f584ffff640 1 --2- 172.21.15.44:0/3912984958 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5850102300 0x7f5850197b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:13:20.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.798+0000 7f584f7fe640 1 --2- 172.21.15.44:0/3912984958 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5850104c30 0x7f58501980d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f584400e9c0 tx=0x7f584400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:20.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.798+0000 7f584d7fa640 1 -- 172.21.15.44:0/3912984958 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f584400cd80 con 0x7f5850104c30 2024-08-19T00:13:20.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.798+0000 7f584d7fa640 1 -- 172.21.15.44:0/3912984958 <== mon.2 v2:172.21.15.116:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58440035f0 con 0x7f5850104c30 2024-08-19T00:13:20.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.798+0000 7f58569fc640 1 -- 172.21.15.44:0/3912984958 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f585019faa0 con 0x7f5850104c30 2024-08-19T00:13:20.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.798+0000 7f584d7fa640 1 -- 172.21.15.44:0/3912984958 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5844010690 con 0x7f5850104c30 2024-08-19T00:13:20.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.798+0000 7f58569fc640 1 -- 172.21.15.44:0/3912984958 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f585019fff0 con 0x7f5850104c30 2024-08-19T00:13:20.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.799+0000 7f58569fc640 1 -- 172.21.15.44:0/3912984958 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58500fd9d0 con 0x7f5850104c30 2024-08-19T00:13:20.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.800+0000 7f584d7fa640 1 -- 172.21.15.44:0/3912984958 <== mon.2 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 22) ==== 137645+0+0 (secure 0 0 0) 0x7f5844004020 con 0x7f5850104c30 2024-08-19T00:13:20.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.801+0000 7f584d7fa640 1 --2- 172.21.15.44:0/3912984958 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f58380a2a40 0x7f58380a4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:20.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.801+0000 7f584ffff640 1 --2- 172.21.15.44:0/3912984958 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f58380a2a40 0x7f58380a4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:20.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.801+0000 7f584d7fa640 1 -- 172.21.15.44:0/3912984958 <== mon.2 v2:172.21.15.116:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f58440cf390 con 0x7f5850104c30 2024-08-19T00:13:20.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.801+0000 7f584ffff640 1 --2- 172.21.15.44:0/3912984958 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f58380a2a40 0x7f58380a4f00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5840031440 tx=0x7f58400315b0 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:20.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:20.805+0000 7f584d7fa640 1 -- 172.21.15.44:0/3912984958 <== mon.2 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f584409c120 con 0x7f5850104c30 2024-08-19T00:13:20.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:20 smithi171 ceph-mon[21810]: mgrmap e22: x(active, since 1.02257s), standbys: z, y 2024-08-19T00:13:20.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:20 smithi171 ceph-mon[21810]: from='client.15318 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:13:20.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:20 smithi171 ceph-mon[21810]: pgmap v3: 129 pgs: 129 active+clean; 1.1 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:13:20.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:20 smithi171 ceph-mon[21810]: from='client.? ' entity='client.admin' 2024-08-19T00:13:20.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:20 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/2317141191' entity='client.admin' 2024-08-19T00:13:20.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:20 smithi116 ceph-mon[21873]: mgrmap e22: x(active, since 1.02257s), standbys: z, y 2024-08-19T00:13:20.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:20 smithi116 ceph-mon[21873]: from='client.15318 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:13:20.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:20 smithi116 ceph-mon[21873]: pgmap v3: 129 pgs: 129 active+clean; 1.1 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:13:20.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:20 smithi116 ceph-mon[21873]: from='client.? ' entity='client.admin' 2024-08-19T00:13:20.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:20 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/2317141191' entity='client.admin' 2024-08-19T00:13:21.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.038+0000 7f58569fc640 1 -- 172.21.15.44:0/3912984958 --> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f5850062360 con 0x7f58380a2a40 2024-08-19T00:13:21.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.102+0000 7f584d7fa640 1 -- 172.21.15.44:0/3912984958 <== mgr.15297 v2:172.21.15.44:6800/1029670730 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f5850062360 con 0x7f58380a2a40 2024-08-19T00:13:21.104 INFO:teuthology.orchestra.run.smithi044.stdout:Schedule set for path / 2024-08-19T00:13:21.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.104+0000 7f58569fc640 1 -- 172.21.15.44:0/3912984958 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f58380a2a40 msgr2=0x7f58380a4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:21.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.104+0000 7f58569fc640 1 --2- 172.21.15.44:0/3912984958 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f58380a2a40 0x7f58380a4f00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5840031440 tx=0x7f58400315b0 comp rx=0 tx=0).stop 2024-08-19T00:13:21.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.104+0000 7f58569fc640 1 -- 172.21.15.44:0/3912984958 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5850104c30 msgr2=0x7f58501980d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:21.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.104+0000 7f58569fc640 1 --2- 172.21.15.44:0/3912984958 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5850104c30 0x7f58501980d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f584400e9c0 tx=0x7f584400ee80 comp rx=0 tx=0).stop 2024-08-19T00:13:21.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.104+0000 7f58569fc640 1 -- 172.21.15.44:0/3912984958 shutdown_connections 2024-08-19T00:13:21.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.104+0000 7f58569fc640 1 --2- 172.21.15.44:0/3912984958 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f58380a2a40 0x7f58380a4f00 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:21.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.104+0000 7f58569fc640 1 --2- 172.21.15.44:0/3912984958 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5850107560 0x7f585019f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:21.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.104+0000 7f58569fc640 1 --2- 172.21.15.44:0/3912984958 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5850104c30 0x7f58501980d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:21.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.104+0000 7f58569fc640 1 --2- 172.21.15.44:0/3912984958 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5850102300 0x7f5850197b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:21.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.104+0000 7f58569fc640 1 -- 172.21.15.44:0/3912984958 >> 172.21.15.44:0/3912984958 conn(0x7f58500fbee0 msgr2=0x7f5850102cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:21.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.104+0000 7f58569fc640 1 -- 172.21.15.44:0/3912984958 shutdown_connections 2024-08-19T00:13:21.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.104+0000 7f58569fc640 1 -- 172.21.15.44:0/3912984958 wait complete. 2024-08-19T00:13:21.117 DEBUG:teuthology.orchestra.run.smithi044:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-08-19T00:13:21.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.223+0000 7f7653642640 1 -- 172.21.15.44:0/1277127049 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f764c107550 msgr2=0x7f764c1099c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:21.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.223+0000 7f7653642640 1 --2- 172.21.15.44:0/1277127049 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f764c107550 0x7f764c1099c0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f7644009ca0 tx=0x7f764402a8c0 comp rx=0 tx=0).stop 2024-08-19T00:13:21.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.223+0000 7f7653642640 1 -- 172.21.15.44:0/1277127049 shutdown_connections 2024-08-19T00:13:21.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.223+0000 7f7653642640 1 --2- 172.21.15.44:0/1277127049 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f764c104c20 0x7f764c107010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:21.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.223+0000 7f7653642640 1 --2- 172.21.15.44:0/1277127049 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f764c107550 0x7f764c1099c0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:21.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.223+0000 7f7653642640 1 --2- 172.21.15.44:0/1277127049 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f764c1022f0 0x7f764c1046e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:21.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.223+0000 7f7653642640 1 -- 172.21.15.44:0/1277127049 >> 172.21.15.44:0/1277127049 conn(0x7f764c0fbf10 msgr2=0x7f764c0fe330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:21.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.223+0000 7f7653642640 1 -- 172.21.15.44:0/1277127049 shutdown_connections 2024-08-19T00:13:21.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.223+0000 7f7653642640 1 -- 172.21.15.44:0/1277127049 wait complete. 2024-08-19T00:13:21.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.224+0000 7f7653642640 1 Processor -- start 2024-08-19T00:13:21.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.224+0000 7f7653642640 1 -- start start 2024-08-19T00:13:21.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.224+0000 7f7653642640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f764c1022f0 0x7f764c197b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:21.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.224+0000 7f7653642640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f764c104c20 0x7f764c198080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:21.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.224+0000 7f7653642640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f764c107550 0x7f764c19f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:21.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.224+0000 7f7653642640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f764c10d530 con 0x7f764c1022f0 2024-08-19T00:13:21.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.224+0000 7f7653642640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f764c10d3b0 con 0x7f764c104c20 2024-08-19T00:13:21.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.224+0000 7f7653642640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f764c10d6b0 con 0x7f764c107550 2024-08-19T00:13:21.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.225+0000 7f76513de640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f764c1022f0 0x7f764c197b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:21.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.225+0000 7f76513de640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f764c1022f0 0x7f764c197b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37020/0 (socket says 172.21.15.44:37020) 2024-08-19T00:13:21.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.225+0000 7f76513de640 1 -- 172.21.15.44:0/3790657569 learned_addr learned my addr 172.21.15.44:0/3790657569 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:21.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.225+0000 7f7650bdd640 1 --2- 172.21.15.44:0/3790657569 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f764c104c20 0x7f764c198080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:21.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.225+0000 7f7651bdf640 1 --2- 172.21.15.44:0/3790657569 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f764c107550 0x7f764c19f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:21.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.225+0000 7f7650bdd640 1 -- 172.21.15.44:0/3790657569 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f764c107550 msgr2=0x7f764c19f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:21.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.225+0000 7f7650bdd640 1 --2- 172.21.15.44:0/3790657569 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f764c107550 0x7f764c19f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:21.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.225+0000 7f7650bdd640 1 -- 172.21.15.44:0/3790657569 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f764c1022f0 msgr2=0x7f764c197b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:21.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.225+0000 7f7650bdd640 1 --2- 172.21.15.44:0/3790657569 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f764c1022f0 0x7f764c197b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:21.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.225+0000 7f7650bdd640 1 -- 172.21.15.44:0/3790657569 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f764c19f760 con 0x7f764c104c20 2024-08-19T00:13:21.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.225+0000 7f76513de640 1 --2- 172.21.15.44:0/3790657569 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f764c1022f0 0x7f764c197b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:13:21.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.225+0000 7f7650bdd640 1 --2- 172.21.15.44:0/3790657569 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f764c104c20 0x7f764c198080 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f763c00e9c0 tx=0x7f763c00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:21.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.225+0000 7f76427fc640 1 -- 172.21.15.44:0/3790657569 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f763c00ccc0 con 0x7f764c104c20 2024-08-19T00:13:21.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.225+0000 7f7653642640 1 -- 172.21.15.44:0/3790657569 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f764c19fa50 con 0x7f764c104c20 2024-08-19T00:13:21.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.225+0000 7f76427fc640 1 -- 172.21.15.44:0/3790657569 <== mon.2 v2:172.21.15.116:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f763c005020 con 0x7f764c104c20 2024-08-19T00:13:21.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.225+0000 7f76427fc640 1 -- 172.21.15.44:0/3790657569 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f763c004a00 con 0x7f764c104c20 2024-08-19T00:13:21.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.226+0000 7f7653642640 1 -- 172.21.15.44:0/3790657569 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f764c19ff50 con 0x7f764c104c20 2024-08-19T00:13:21.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.226+0000 7f7653642640 1 -- 172.21.15.44:0/3790657569 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f764c0fda00 con 0x7f764c104c20 2024-08-19T00:13:21.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.228+0000 7f76427fc640 1 -- 172.21.15.44:0/3790657569 <== mon.2 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 22) ==== 137645+0+0 (secure 0 0 0) 0x7f763c0051d0 con 0x7f764c104c20 2024-08-19T00:13:21.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.229+0000 7f76427fc640 1 --2- 172.21.15.44:0/3790657569 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f76380a2a40 0x7f76380a4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:21.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.229+0000 7f76513de640 1 --2- 172.21.15.44:0/3790657569 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f76380a2a40 0x7f76380a4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:21.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.229+0000 7f76427fc640 1 -- 172.21.15.44:0/3790657569 <== mon.2 v2:172.21.15.116:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f763c0cf150 con 0x7f764c104c20 2024-08-19T00:13:21.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.230+0000 7f76513de640 1 --2- 172.21.15.44:0/3790657569 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f76380a2a40 0x7f76380a4f00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7648011550 tx=0x7f7648005f90 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:21.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.235+0000 7f76427fc640 1 -- 172.21.15.44:0/3790657569 <== mon.2 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f763c09bf30 con 0x7f764c104c20 2024-08-19T00:13:21.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.291+0000 7f76427fc640 1 -- 172.21.15.44:0/3790657569 <== mon.2 v2:172.21.15.116:3300/0 7 ==== mgrmap(e 23) ==== 138004+0+0 (secure 0 0 0) 0x7f763c097ea0 con 0x7f764c104c20 2024-08-19T00:13:21.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.452+0000 7f7653642640 1 -- 172.21.15.44:0/3790657569 --> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7f764c062360 con 0x7f76380a2a40 2024-08-19T00:13:21.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.514+0000 7f76427fc640 1 -- 172.21.15.44:0/3790657569 <== mgr.15297 v2:172.21.15.44:6800/1029670730 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7f764c062360 con 0x7f76380a2a40 2024-08-19T00:13:21.515 INFO:teuthology.orchestra.run.smithi044.stdout:Retention added to path / 2024-08-19T00:13:21.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.516+0000 7f7653642640 1 -- 172.21.15.44:0/3790657569 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f76380a2a40 msgr2=0x7f76380a4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:21.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.516+0000 7f7653642640 1 --2- 172.21.15.44:0/3790657569 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f76380a2a40 0x7f76380a4f00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7648011550 tx=0x7f7648005f90 comp rx=0 tx=0).stop 2024-08-19T00:13:21.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.516+0000 7f7653642640 1 -- 172.21.15.44:0/3790657569 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f764c104c20 msgr2=0x7f764c198080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:21.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.516+0000 7f7653642640 1 --2- 172.21.15.44:0/3790657569 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f764c104c20 0x7f764c198080 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f763c00e9c0 tx=0x7f763c00ee80 comp rx=0 tx=0).stop 2024-08-19T00:13:21.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.516+0000 7f7653642640 1 -- 172.21.15.44:0/3790657569 shutdown_connections 2024-08-19T00:13:21.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.516+0000 7f7653642640 1 --2- 172.21.15.44:0/3790657569 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f76380a2a40 0x7f76380a4f00 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:21.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.516+0000 7f7653642640 1 --2- 172.21.15.44:0/3790657569 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f764c107550 0x7f764c19f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:21.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.516+0000 7f7653642640 1 --2- 172.21.15.44:0/3790657569 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f764c104c20 0x7f764c198080 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:21.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.516+0000 7f7653642640 1 --2- 172.21.15.44:0/3790657569 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f764c1022f0 0x7f764c197b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:21.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.516+0000 7f7653642640 1 -- 172.21.15.44:0/3790657569 >> 172.21.15.44:0/3790657569 conn(0x7f764c0fbf10 msgr2=0x7f764c102b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:21.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.516+0000 7f7653642640 1 -- 172.21.15.44:0/3790657569 shutdown_connections 2024-08-19T00:13:21.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.516+0000 7f7653642640 1 -- 172.21.15.44:0/3790657569 wait complete. 2024-08-19T00:13:21.529 DEBUG:teuthology.orchestra.run.smithi044:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-08-19T00:13:21.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.636+0000 7f6cf7ecb640 1 -- 172.21.15.44:0/3181063400 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6cf0103440 msgr2=0x7f6cf0109cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:21.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.636+0000 7f6cf7ecb640 1 --2- 172.21.15.44:0/3181063400 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6cf0103440 0x7f6cf0109cd0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f6ce8009ca0 tx=0x7f6ce802a8c0 comp rx=0 tx=0).stop 2024-08-19T00:13:21.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.636+0000 7f6cf7ecb640 1 -- 172.21.15.44:0/3181063400 shutdown_connections 2024-08-19T00:13:21.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.636+0000 7f6cf7ecb640 1 --2- 172.21.15.44:0/3181063400 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6cf0102a80 0x7f6cf0102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:21.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.636+0000 7f6cf7ecb640 1 --2- 172.21.15.44:0/3181063400 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6cf0103440 0x7f6cf0109cd0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:21.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.636+0000 7f6cf7ecb640 1 --2- 172.21.15.44:0/3181063400 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6cf0101890 0x7f6cf0101c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:21.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.637+0000 7f6cf7ecb640 1 -- 172.21.15.44:0/3181063400 >> 172.21.15.44:0/3181063400 conn(0x7f6cf00fd010 msgr2=0x7f6cf00ff430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:21.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.637+0000 7f6cf7ecb640 1 -- 172.21.15.44:0/3181063400 shutdown_connections 2024-08-19T00:13:21.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.637+0000 7f6cf7ecb640 1 -- 172.21.15.44:0/3181063400 wait complete. 2024-08-19T00:13:21.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.637+0000 7f6cf7ecb640 1 Processor -- start 2024-08-19T00:13:21.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.637+0000 7f6cf7ecb640 1 -- start start 2024-08-19T00:13:21.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.637+0000 7f6cf7ecb640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6cf0101890 0x7f6cf0197ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:21.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.637+0000 7f6cf7ecb640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6cf0102a80 0x7f6cf0197ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:21.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.637+0000 7f6cf7ecb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6cf0103440 0x7f6cf019f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:21.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.637+0000 7f6cf7ecb640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf010d4f0 con 0x7f6cf0103440 2024-08-19T00:13:21.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.637+0000 7f6cf7ecb640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf010d370 con 0x7f6cf0101890 2024-08-19T00:13:21.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.637+0000 7f6cf7ecb640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf010d670 con 0x7f6cf0102a80 2024-08-19T00:13:21.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.638+0000 7f6cf5c67640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6cf0101890 0x7f6cf0197ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:21.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.638+0000 7f6cf6468640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6cf0103440 0x7f6cf019f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:21.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.638+0000 7f6cf5c67640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6cf0101890 0x7f6cf0197ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.44:42442/0 (socket says 172.21.15.44:42442) 2024-08-19T00:13:21.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.638+0000 7f6cf5c67640 1 -- 172.21.15.44:0/4274760788 learned_addr learned my addr 172.21.15.44:0/4274760788 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:21.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.638+0000 7f6cf6468640 1 -- 172.21.15.44:0/4274760788 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6cf0102a80 msgr2=0x7f6cf0197ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:21.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.638+0000 7f6cf6468640 1 --2- 172.21.15.44:0/4274760788 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6cf0102a80 0x7f6cf0197ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:21.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.638+0000 7f6cf6468640 1 -- 172.21.15.44:0/4274760788 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6cf0101890 msgr2=0x7f6cf0197ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:21.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.638+0000 7f6cf6468640 1 --2- 172.21.15.44:0/4274760788 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6cf0101890 0x7f6cf0197ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:21.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.638+0000 7f6cf6468640 1 -- 172.21.15.44:0/4274760788 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cf019f6d0 con 0x7f6cf0103440 2024-08-19T00:13:21.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.639+0000 7f6cf6468640 1 --2- 172.21.15.44:0/4274760788 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6cf0103440 0x7f6cf019f060 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f6ce8031ae0 tx=0x7f6ce8031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:21.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.639+0000 7f6ce6ffd640 1 -- 172.21.15.44:0/4274760788 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce8003c30 con 0x7f6cf0103440 2024-08-19T00:13:21.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.639+0000 7f6cf7ecb640 1 -- 172.21.15.44:0/4274760788 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cf019f960 con 0x7f6cf0103440 2024-08-19T00:13:21.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.639+0000 7f6ce6ffd640 1 -- 172.21.15.44:0/4274760788 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ce8003dd0 con 0x7f6cf0103440 2024-08-19T00:13:21.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.639+0000 7f6cf7ecb640 1 -- 172.21.15.44:0/4274760788 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cf019fed0 con 0x7f6cf0103440 2024-08-19T00:13:21.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.639+0000 7f6ce6ffd640 1 -- 172.21.15.44:0/4274760788 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce802fd40 con 0x7f6cf0103440 2024-08-19T00:13:21.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.640+0000 7f6cf7ecb640 1 -- 172.21.15.44:0/4274760788 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cd40052c0 con 0x7f6cf0103440 2024-08-19T00:13:21.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.641+0000 7f6ce6ffd640 1 -- 172.21.15.44:0/4274760788 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 23) ==== 138004+0+0 (secure 0 0 0) 0x7f6ce8004050 con 0x7f6cf0103440 2024-08-19T00:13:21.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.642+0000 7f6ce6ffd640 1 --2- 172.21.15.44:0/4274760788 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f6cdc0a2e40 0x7f6cdc0a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:21.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.642+0000 7f6cf5c67640 1 --2- 172.21.15.44:0/4274760788 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f6cdc0a2e40 0x7f6cdc0a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:21.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.642+0000 7f6ce6ffd640 1 -- 172.21.15.44:0/4274760788 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f6ce80f0c10 con 0x7f6cf0103440 2024-08-19T00:13:21.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.643+0000 7f6cf5c67640 1 --2- 172.21.15.44:0/4274760788 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f6cdc0a2e40 0x7f6cdc0a5300 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6cec00bc80 tx=0x7f6cec00b410 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:21.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.646+0000 7f6ce6ffd640 1 -- 172.21.15.44:0/4274760788 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f6ce80bd430 con 0x7f6cf0103440 2024-08-19T00:13:21.792 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:21 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:13:21.792 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:21 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:13:21.792 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:21 smithi044 ceph-mon[18489]: from='client.? ' entity='client.admin' 2024-08-19T00:13:21.792 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:21 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:13:21.792 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:21 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:13:21.792 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:21 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:13:21.792 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:21 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:13:21.792 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:21 smithi044 ceph-mon[18489]: mgrmap e23: x(active, since 2s), standbys: z, y 2024-08-19T00:13:21.793 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:21 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:13:21.793 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:21 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:13:21.793 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:21 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:13:21.793 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:21 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:13:21.793 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:21 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:13:21.793 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:21 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:13:21.793 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:21 smithi044 ceph-mon[18489]: Adjusting osd_memory_target on smithi116 to 176.0M 2024-08-19T00:13:21.793 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:21 smithi044 ceph-mon[18489]: Unable to set osd_memory_target on smithi116 to 184593920: error parsing value: Value '184593920' is below minimum 939524096 2024-08-19T00:13:21.793 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:21 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:13:21.793 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:21 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:13:21.793 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:21 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:13:21.794 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:21 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:13:21.794 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:21 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:13:21.794 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:21 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:13:21.794 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:21 smithi044 ceph-mon[18489]: Adjusting osd_memory_target on smithi171 to 176.0M 2024-08-19T00:13:21.794 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:21 smithi044 ceph-mon[18489]: Unable to set osd_memory_target on smithi171 to 184595353: error parsing value: Value '184595353' is below minimum 939524096 2024-08-19T00:13:21.794 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:21 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:13:21.794 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:21 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:13:21.794 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:21 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:13:21.794 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:21 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:13:21.795 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:21 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:13:21.795 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:21 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:13:21.795 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:21 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:13:21.795 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:21 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:13:21.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:21 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:13:21.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:21 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:13:21.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:21 smithi171 ceph-mon[21810]: from='client.? ' entity='client.admin' 2024-08-19T00:13:21.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:21 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:13:21.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:21 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:13:21.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:21 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:13:21.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:21 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:13:21.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:21 smithi171 ceph-mon[21810]: mgrmap e23: x(active, since 2s), standbys: z, y 2024-08-19T00:13:21.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:21 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:13:21.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:21 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:13:21.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:21 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:13:21.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:21 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:13:21.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:21 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:13:21.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:21 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:13:21.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:21 smithi171 ceph-mon[21810]: Adjusting osd_memory_target on smithi116 to 176.0M 2024-08-19T00:13:21.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:21 smithi171 ceph-mon[21810]: Unable to set osd_memory_target on smithi116 to 184593920: error parsing value: Value '184593920' is below minimum 939524096 2024-08-19T00:13:21.843 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:21 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:13:21.844 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:21 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:13:21.844 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:21 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:13:21.844 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:21 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:13:21.844 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:21 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:13:21.844 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:21 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:13:21.844 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:21 smithi171 ceph-mon[21810]: Adjusting osd_memory_target on smithi171 to 176.0M 2024-08-19T00:13:21.844 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:21 smithi171 ceph-mon[21810]: Unable to set osd_memory_target on smithi171 to 184595353: error parsing value: Value '184595353' is below minimum 939524096 2024-08-19T00:13:21.844 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:21 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:13:21.844 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:21 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:13:21.844 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:21 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:13:21.844 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:21 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:13:21.844 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:21 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:13:21.844 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:21 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:13:21.844 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:21 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:13:21.844 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:21 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:13:21.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:21 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:13:21.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:21 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:13:21.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:21 smithi116 ceph-mon[21873]: from='client.? ' entity='client.admin' 2024-08-19T00:13:21.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:21 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:13:21.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:21 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:13:21.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:21 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:13:21.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:21 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:13:21.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:21 smithi116 ceph-mon[21873]: mgrmap e23: x(active, since 2s), standbys: z, y 2024-08-19T00:13:21.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:21 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:13:21.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:21 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:13:21.867 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:21 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:13:21.867 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:21 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:13:21.867 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:21 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:13:21.867 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:21 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:13:21.867 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:21 smithi116 ceph-mon[21873]: Adjusting osd_memory_target on smithi116 to 176.0M 2024-08-19T00:13:21.867 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:21 smithi116 ceph-mon[21873]: Unable to set osd_memory_target on smithi116 to 184593920: error parsing value: Value '184593920' is below minimum 939524096 2024-08-19T00:13:21.867 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:21 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:13:21.867 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:21 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:13:21.867 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:21 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:13:21.867 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:21 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:13:21.867 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:21 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:13:21.867 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:21 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:13:21.867 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:21 smithi116 ceph-mon[21873]: Adjusting osd_memory_target on smithi171 to 176.0M 2024-08-19T00:13:21.867 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:21 smithi116 ceph-mon[21873]: Unable to set osd_memory_target on smithi171 to 184595353: error parsing value: Value '184595353' is below minimum 939524096 2024-08-19T00:13:21.867 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:21 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:13:21.868 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:21 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:13:21.868 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:21 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:13:21.868 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:21 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:13:21.868 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:21 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:13:21.868 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:21 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:13:21.868 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:21 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:13:21.868 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:21 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:13:21.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.880+0000 7f6cf7ecb640 1 -- 172.21.15.44:0/4274760788 --> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f6cd4000bf0 con 0x7f6cdc0a2e40 2024-08-19T00:13:21.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.887+0000 7f6ce6ffd640 1 -- 172.21.15.44:0/4274760788 <== mgr.15297 v2:172.21.15.44:6800/1029670730 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7f6cd4000bf0 con 0x7f6cdc0a2e40 2024-08-19T00:13:21.890 INFO:teuthology.orchestra.run.smithi044.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-08-19T00:00:00", "created": "2024-08-19T00:13:21", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-08-19T00:13:21.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.889+0000 7f6cf7ecb640 1 -- 172.21.15.44:0/4274760788 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f6cdc0a2e40 msgr2=0x7f6cdc0a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:21.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.889+0000 7f6cf7ecb640 1 --2- 172.21.15.44:0/4274760788 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f6cdc0a2e40 0x7f6cdc0a5300 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6cec00bc80 tx=0x7f6cec00b410 comp rx=0 tx=0).stop 2024-08-19T00:13:21.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.889+0000 7f6cf7ecb640 1 -- 172.21.15.44:0/4274760788 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6cf0103440 msgr2=0x7f6cf019f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:21.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.889+0000 7f6cf7ecb640 1 --2- 172.21.15.44:0/4274760788 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6cf0103440 0x7f6cf019f060 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f6ce8031ae0 tx=0x7f6ce8031ee0 comp rx=0 tx=0).stop 2024-08-19T00:13:21.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.889+0000 7f6cf7ecb640 1 -- 172.21.15.44:0/4274760788 shutdown_connections 2024-08-19T00:13:21.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.889+0000 7f6cf7ecb640 1 --2- 172.21.15.44:0/4274760788 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f6cdc0a2e40 0x7f6cdc0a5300 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:21.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.889+0000 7f6cf7ecb640 1 --2- 172.21.15.44:0/4274760788 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6cf0102a80 0x7f6cf0197ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:21.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.889+0000 7f6cf7ecb640 1 --2- 172.21.15.44:0/4274760788 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6cf0103440 0x7f6cf019f060 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:21.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.889+0000 7f6cf7ecb640 1 --2- 172.21.15.44:0/4274760788 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6cf0101890 0x7f6cf0197ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:21.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.889+0000 7f6cf7ecb640 1 -- 172.21.15.44:0/4274760788 >> 172.21.15.44:0/4274760788 conn(0x7f6cf00fd010 msgr2=0x7f6cf0105e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:21.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.889+0000 7f6cf7ecb640 1 -- 172.21.15.44:0/4274760788 shutdown_connections 2024-08-19T00:13:21.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:21.889+0000 7f6cf7ecb640 1 -- 172.21.15.44:0/4274760788 wait complete. 2024-08-19T00:13:21.902 DEBUG:teuthology.orchestra.run.smithi044:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-08-19T00:13:22.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:22.014+0000 7f6c62b6f640 1 -- 172.21.15.44:0/4212613256 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c5c101890 msgr2=0x7f6c5c101c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:22.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:22.014+0000 7f6c62b6f640 1 --2- 172.21.15.44:0/4212613256 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c5c101890 0x7f6c5c101c90 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f6c50009900 tx=0x7f6c5002a410 comp rx=0 tx=0).stop 2024-08-19T00:13:22.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:22.014+0000 7f6c62b6f640 1 -- 172.21.15.44:0/4212613256 shutdown_connections 2024-08-19T00:13:22.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:22.014+0000 7f6c62b6f640 1 --2- 172.21.15.44:0/4212613256 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c5c102a80 0x7f6c5c102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:22.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:22.014+0000 7f6c62b6f640 1 --2- 172.21.15.44:0/4212613256 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6c5c103440 0x7f6c5c109cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:22.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:22.014+0000 7f6c62b6f640 1 --2- 172.21.15.44:0/4212613256 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c5c101890 0x7f6c5c101c90 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:22.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:22.014+0000 7f6c62b6f640 1 -- 172.21.15.44:0/4212613256 >> 172.21.15.44:0/4212613256 conn(0x7f6c5c0fcff0 msgr2=0x7f6c5c0ff430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:22.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:22.014+0000 7f6c62b6f640 1 -- 172.21.15.44:0/4212613256 shutdown_connections 2024-08-19T00:13:22.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:22.014+0000 7f6c62b6f640 1 -- 172.21.15.44:0/4212613256 wait complete. 2024-08-19T00:13:22.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:22.014+0000 7f6c62b6f640 1 Processor -- start 2024-08-19T00:13:22.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:22.014+0000 7f6c62b6f640 1 -- start start 2024-08-19T00:13:22.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:22.015+0000 7f6c62b6f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c5c101890 0x7f6c5c075cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:22.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:22.015+0000 7f6c62b6f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c5c102a80 0x7f6c5c074310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:22.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:22.015+0000 7f6c62b6f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6c5c103440 0x7f6c5c074850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:22.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:22.015+0000 7f6c62b6f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6c5c10d4f0 con 0x7f6c5c102a80 2024-08-19T00:13:22.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:22.015+0000 7f6c62b6f640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f6c5c10d370 con 0x7f6c5c103440 2024-08-19T00:13:22.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:22.015+0000 7f6c62b6f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6c5c10d670 con 0x7f6c5c101890 2024-08-19T00:13:22.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:22.015+0000 7f6c5bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c5c102a80 0x7f6c5c074310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:22.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:22.015+0000 7f6c5bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c5c102a80 0x7f6c5c074310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37062/0 (socket says 172.21.15.44:37062) 2024-08-19T00:13:22.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:22.015+0000 7f6c5bfff640 1 -- 172.21.15.44:0/1770736825 learned_addr learned my addr 172.21.15.44:0/1770736825 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:22.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:22.015+0000 7f6c6110c640 1 --2- 172.21.15.44:0/1770736825 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6c5c103440 0x7f6c5c074850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:22.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:22.015+0000 7f6c6090b640 1 --2- 172.21.15.44:0/1770736825 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c5c101890 0x7f6c5c075cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:22.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:22.015+0000 7f6c5bfff640 1 -- 172.21.15.44:0/1770736825 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c5c101890 msgr2=0x7f6c5c075cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:22.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:22.015+0000 7f6c5bfff640 1 --2- 172.21.15.44:0/1770736825 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c5c101890 0x7f6c5c075cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:22.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:22.015+0000 7f6c5bfff640 1 -- 172.21.15.44:0/1770736825 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6c5c103440 msgr2=0x7f6c5c074850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:22.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:22.015+0000 7f6c5bfff640 1 --2- 172.21.15.44:0/1770736825 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6c5c103440 0x7f6c5c074850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:22.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:22.015+0000 7f6c5bfff640 1 -- 172.21.15.44:0/1770736825 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c5c0750e0 con 0x7f6c5c102a80 2024-08-19T00:13:22.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:22.015+0000 7f6c6110c640 1 --2- 172.21.15.44:0/1770736825 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6c5c103440 0x7f6c5c074850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:13:22.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:22.015+0000 7f6c5bfff640 1 --2- 172.21.15.44:0/1770736825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c5c102a80 0x7f6c5c074310 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f6c4800d950 tx=0x7f6c4800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:22.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:22.016+0000 7f6c59ffb640 1 -- 172.21.15.44:0/1770736825 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c48017030 con 0x7f6c5c102a80 2024-08-19T00:13:22.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:22.016+0000 7f6c62b6f640 1 -- 172.21.15.44:0/1770736825 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c5c1a1cc0 con 0x7f6c5c102a80 2024-08-19T00:13:22.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:22.016+0000 7f6c59ffb640 1 -- 172.21.15.44:0/1770736825 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c48004020 con 0x7f6c5c102a80 2024-08-19T00:13:22.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:22.016+0000 7f6c59ffb640 1 -- 172.21.15.44:0/1770736825 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c480047a0 con 0x7f6c5c102a80 2024-08-19T00:13:22.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:22.016+0000 7f6c62b6f640 1 -- 172.21.15.44:0/1770736825 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c5c1a21b0 con 0x7f6c5c102a80 2024-08-19T00:13:22.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:22.017+0000 7f6c62b6f640 1 -- 172.21.15.44:0/1770736825 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c5c108d20 con 0x7f6c5c102a80 2024-08-19T00:13:22.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:22.018+0000 7f6c59ffb640 1 -- 172.21.15.44:0/1770736825 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 23) ==== 138004+0+0 (secure 0 0 0) 0x7f6c480041d0 con 0x7f6c5c102a80 2024-08-19T00:13:22.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:22.019+0000 7f6c59ffb640 1 --2- 172.21.15.44:0/1770736825 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f6c4c0a2e40 0x7f6c4c0a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:22.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:22.020+0000 7f6c6090b640 1 --2- 172.21.15.44:0/1770736825 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f6c4c0a2e40 0x7f6c4c0a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:22.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:22.020+0000 7f6c59ffb640 1 -- 172.21.15.44:0/1770736825 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f6c480cfac0 con 0x7f6c5c102a80 2024-08-19T00:13:22.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:22.020+0000 7f6c6090b640 1 --2- 172.21.15.44:0/1770736825 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f6c4c0a2e40 0x7f6c4c0a5300 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6c50000c00 tx=0x7f6c500315b0 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:22.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:22.023+0000 7f6c59ffb640 1 -- 172.21.15.44:0/1770736825 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f6c4809c1d0 con 0x7f6c5c102a80 2024-08-19T00:13:22.119 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:13:21 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:13:21.789+0000 7f512b863640 -1 log_channel(cephadm) log [ERR] : [19/Aug/2024:00:13:21] ENGINE Error in HTTPServer.serve 2024-08-19T00:13:22.120 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:13:21 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: Traceback (most recent call last): 2024-08-19T00:13:22.120 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:13:21 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-19T00:13:22.120 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:13:21 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: self._connections.run(self.expiration_interval) 2024-08-19T00:13:22.120 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:13:21 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-19T00:13:22.120 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:13:21 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: self._run(expiration_interval) 2024-08-19T00:13:22.120 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:13:21 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-19T00:13:22.120 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:13:21 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: new_conn = self._from_server_socket(self.server.socket) 2024-08-19T00:13:22.120 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:13:21 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-19T00:13:22.120 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:13:21 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-19T00:13:22.120 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:13:21 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-19T00:13:22.120 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:13:21 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: s = self.context.wrap_socket( 2024-08-19T00:13:22.120 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:13:21 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-19T00:13:22.121 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:13:21 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: return self.sslsocket_class._create( 2024-08-19T00:13:22.121 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:13:21 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-19T00:13:22.121 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:13:21 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: self.do_handshake() 2024-08-19T00:13:22.121 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:13:21 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-19T00:13:22.121 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:13:21 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: self._sslobj.do_handshake() 2024-08-19T00:13:22.121 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:13:21 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-19T00:13:22.121 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:13:21 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:13:22.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:22.236+0000 7f6c62b6f640 1 -- 172.21.15.44:0/1770736825 --> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f6c5c062360 con 0x7f6c4c0a2e40 2024-08-19T00:13:22.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:22.243+0000 7f6c59ffb640 1 -- 172.21.15.44:0/1770736825 <== mgr.15297 v2:172.21.15.44:6800/1029670730 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f6c5c062360 con 0x7f6c4c0a2e40 2024-08-19T00:13:22.244 INFO:teuthology.orchestra.run.smithi044.stdout:/ 1m 6m3h 2024-08-19T00:13:22.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:22.245+0000 7f6c62b6f640 1 -- 172.21.15.44:0/1770736825 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f6c4c0a2e40 msgr2=0x7f6c4c0a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:22.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:22.245+0000 7f6c62b6f640 1 --2- 172.21.15.44:0/1770736825 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f6c4c0a2e40 0x7f6c4c0a5300 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6c50000c00 tx=0x7f6c500315b0 comp rx=0 tx=0).stop 2024-08-19T00:13:22.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:22.245+0000 7f6c62b6f640 1 -- 172.21.15.44:0/1770736825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c5c102a80 msgr2=0x7f6c5c074310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:22.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:22.245+0000 7f6c62b6f640 1 --2- 172.21.15.44:0/1770736825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c5c102a80 0x7f6c5c074310 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f6c4800d950 tx=0x7f6c4800de10 comp rx=0 tx=0).stop 2024-08-19T00:13:22.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:22.245+0000 7f6c62b6f640 1 -- 172.21.15.44:0/1770736825 shutdown_connections 2024-08-19T00:13:22.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:22.245+0000 7f6c62b6f640 1 --2- 172.21.15.44:0/1770736825 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f6c4c0a2e40 0x7f6c4c0a5300 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:22.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:22.245+0000 7f6c62b6f640 1 --2- 172.21.15.44:0/1770736825 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6c5c103440 0x7f6c5c074850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:22.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:22.245+0000 7f6c62b6f640 1 --2- 172.21.15.44:0/1770736825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c5c102a80 0x7f6c5c074310 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:22.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:22.245+0000 7f6c62b6f640 1 --2- 172.21.15.44:0/1770736825 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c5c101890 0x7f6c5c075cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:22.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:22.245+0000 7f6c62b6f640 1 -- 172.21.15.44:0/1770736825 >> 172.21.15.44:0/1770736825 conn(0x7f6c5c0fcff0 msgr2=0x7f6c5c105ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:22.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:22.245+0000 7f6c62b6f640 1 -- 172.21.15.44:0/1770736825 shutdown_connections 2024-08-19T00:13:22.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:22.245+0000 7f6c62b6f640 1 -- 172.21.15.44:0/1770736825 wait complete. 2024-08-19T00:13:22.258 DEBUG:teuthology.orchestra.run.smithi044:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-08-19T00:13:22.285 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-08-19T00:13:22.301 INFO:teuthology.run_tasks:Running task background_exec... 2024-08-19T00:13:22.341 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi044.front.sepia.ceph.com 2024-08-19T00:13:22.341 DEBUG:teuthology.orchestra.run.smithi044:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-08-19T00:13:22.343 INFO:teuthology.run_tasks:Running task quiescer... 2024-08-19T00:13:22.377 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-08-19T00:13:22.377 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph pg dump --format=json 2024-08-19T00:13:22.653 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:13:22.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:22 smithi116 ceph-mon[21873]: from='client.25004 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:13:22.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:22 smithi116 ceph-mon[21873]: Adjusting osd_memory_target on smithi044 to 177.1M 2024-08-19T00:13:22.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:22 smithi116 ceph-mon[21873]: Unable to set osd_memory_target on smithi044 to 185704960: error parsing value: Value '185704960' is below minimum 939524096 2024-08-19T00:13:22.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:22 smithi116 ceph-mon[21873]: Updating smithi044:/etc/ceph/ceph.conf 2024-08-19T00:13:22.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:22 smithi116 ceph-mon[21873]: Updating smithi116:/etc/ceph/ceph.conf 2024-08-19T00:13:22.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:22 smithi116 ceph-mon[21873]: Updating smithi171:/etc/ceph/ceph.conf 2024-08-19T00:13:22.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:22 smithi116 ceph-mon[21873]: [19/Aug/2024:00:13:21] ENGINE Bus STARTING 2024-08-19T00:13:22.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:22 smithi116 ceph-mon[21873]: [19/Aug/2024:00:13:21] ENGINE Serving on https://172.21.15.44:7150 2024-08-19T00:13:22.867 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:22 smithi116 ceph-mon[21873]: [19/Aug/2024:00:13:21] ENGINE Error in HTTPServer.serve 2024-08-19T00:13:22.867 INFO:journalctl@ceph.mon.b.smithi116.stdout: Traceback (most recent call last): 2024-08-19T00:13:22.867 INFO:journalctl@ceph.mon.b.smithi116.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-19T00:13:22.867 INFO:journalctl@ceph.mon.b.smithi116.stdout: self._connections.run(self.expiration_interval) 2024-08-19T00:13:22.867 INFO:journalctl@ceph.mon.b.smithi116.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-19T00:13:22.867 INFO:journalctl@ceph.mon.b.smithi116.stdout: self._run(expiration_interval) 2024-08-19T00:13:22.867 INFO:journalctl@ceph.mon.b.smithi116.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-19T00:13:22.867 INFO:journalctl@ceph.mon.b.smithi116.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-19T00:13:22.867 INFO:journalctl@ceph.mon.b.smithi116.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-19T00:13:22.867 INFO:journalctl@ceph.mon.b.smithi116.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-19T00:13:22.867 INFO:journalctl@ceph.mon.b.smithi116.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-19T00:13:22.867 INFO:journalctl@ceph.mon.b.smithi116.stdout: s = self.context.wrap_socket( 2024-08-19T00:13:22.868 INFO:journalctl@ceph.mon.b.smithi116.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-19T00:13:22.868 INFO:journalctl@ceph.mon.b.smithi116.stdout: return self.sslsocket_class._create( 2024-08-19T00:13:22.868 INFO:journalctl@ceph.mon.b.smithi116.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-19T00:13:22.868 INFO:journalctl@ceph.mon.b.smithi116.stdout: self.do_handshake() 2024-08-19T00:13:22.868 INFO:journalctl@ceph.mon.b.smithi116.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-19T00:13:22.868 INFO:journalctl@ceph.mon.b.smithi116.stdout: self._sslobj.do_handshake() 2024-08-19T00:13:22.868 INFO:journalctl@ceph.mon.b.smithi116.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-19T00:13:22.868 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:22 smithi116 ceph-mon[21873]: Updating smithi116:/var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-19T00:13:22.868 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:22 smithi116 ceph-mon[21873]: Updating smithi171:/var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-19T00:13:22.868 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:22 smithi116 ceph-mon[21873]: Updating smithi044:/var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-19T00:13:22.868 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:22 smithi116 ceph-mon[21873]: from='client.15402 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:13:22.868 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:22 smithi116 ceph-mon[21873]: [19/Aug/2024:00:13:21] ENGINE Serving on http://172.21.15.44:8765 2024-08-19T00:13:22.869 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:22 smithi116 ceph-mon[21873]: [19/Aug/2024:00:13:21] ENGINE Bus STARTED 2024-08-19T00:13:22.869 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:22 smithi116 ceph-mon[21873]: Updating smithi116:/etc/ceph/ceph.client.admin.keyring 2024-08-19T00:13:22.869 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:22 smithi116 ceph-mon[21873]: Updating smithi171:/etc/ceph/ceph.client.admin.keyring 2024-08-19T00:13:22.869 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:22 smithi116 ceph-mon[21873]: Updating smithi044:/etc/ceph/ceph.client.admin.keyring 2024-08-19T00:13:22.869 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:22 smithi116 ceph-mon[21873]: from='client.15408 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:13:22.869 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:22 smithi116 ceph-mon[21873]: Updating smithi116:/var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-19T00:13:22.869 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:22 smithi116 ceph-mon[21873]: Updating smithi171:/var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-19T00:13:22.869 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:22 smithi116 ceph-mon[21873]: Updating smithi044:/var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-19T00:13:22.869 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:22 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:13:22.869 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:22 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:13:22.870 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:22 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:13:22.870 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:22 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:13:22.870 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:22 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:13:22.870 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:22 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:13:22.870 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:22 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:13:22.871 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:22 smithi044 ceph-mon[18489]: from='client.25004 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:13:22.871 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:22 smithi044 ceph-mon[18489]: Adjusting osd_memory_target on smithi044 to 177.1M 2024-08-19T00:13:22.871 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:22 smithi044 ceph-mon[18489]: Unable to set osd_memory_target on smithi044 to 185704960: error parsing value: Value '185704960' is below minimum 939524096 2024-08-19T00:13:22.871 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:22 smithi044 ceph-mon[18489]: Updating smithi044:/etc/ceph/ceph.conf 2024-08-19T00:13:22.871 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:22 smithi044 ceph-mon[18489]: Updating smithi116:/etc/ceph/ceph.conf 2024-08-19T00:13:22.871 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:22 smithi044 ceph-mon[18489]: Updating smithi171:/etc/ceph/ceph.conf 2024-08-19T00:13:22.871 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:22 smithi044 ceph-mon[18489]: [19/Aug/2024:00:13:21] ENGINE Bus STARTING 2024-08-19T00:13:22.871 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:22 smithi044 ceph-mon[18489]: [19/Aug/2024:00:13:21] ENGINE Serving on https://172.21.15.44:7150 2024-08-19T00:13:22.871 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:22 smithi044 ceph-mon[18489]: [19/Aug/2024:00:13:21] ENGINE Error in HTTPServer.serve 2024-08-19T00:13:22.871 INFO:journalctl@ceph.mon.a.smithi044.stdout: Traceback (most recent call last): 2024-08-19T00:13:22.872 INFO:journalctl@ceph.mon.a.smithi044.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-19T00:13:22.872 INFO:journalctl@ceph.mon.a.smithi044.stdout: self._connections.run(self.expiration_interval) 2024-08-19T00:13:22.872 INFO:journalctl@ceph.mon.a.smithi044.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-19T00:13:22.872 INFO:journalctl@ceph.mon.a.smithi044.stdout: self._run(expiration_interval) 2024-08-19T00:13:22.872 INFO:journalctl@ceph.mon.a.smithi044.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-19T00:13:22.872 INFO:journalctl@ceph.mon.a.smithi044.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-19T00:13:22.872 INFO:journalctl@ceph.mon.a.smithi044.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-19T00:13:22.872 INFO:journalctl@ceph.mon.a.smithi044.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-19T00:13:22.872 INFO:journalctl@ceph.mon.a.smithi044.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-19T00:13:22.872 INFO:journalctl@ceph.mon.a.smithi044.stdout: s = self.context.wrap_socket( 2024-08-19T00:13:22.872 INFO:journalctl@ceph.mon.a.smithi044.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-19T00:13:22.873 INFO:journalctl@ceph.mon.a.smithi044.stdout: return self.sslsocket_class._create( 2024-08-19T00:13:22.873 INFO:journalctl@ceph.mon.a.smithi044.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-19T00:13:22.873 INFO:journalctl@ceph.mon.a.smithi044.stdout: self.do_handshake() 2024-08-19T00:13:22.873 INFO:journalctl@ceph.mon.a.smithi044.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-19T00:13:22.873 INFO:journalctl@ceph.mon.a.smithi044.stdout: self._sslobj.do_handshake() 2024-08-19T00:13:22.873 INFO:journalctl@ceph.mon.a.smithi044.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-19T00:13:22.873 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:22 smithi044 ceph-mon[18489]: Updating smithi116:/var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-19T00:13:22.873 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:22 smithi044 ceph-mon[18489]: Updating smithi171:/var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-19T00:13:22.873 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:22 smithi044 ceph-mon[18489]: Updating smithi044:/var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-19T00:13:22.873 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:22 smithi044 ceph-mon[18489]: from='client.15402 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:13:22.873 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:22 smithi044 ceph-mon[18489]: [19/Aug/2024:00:13:21] ENGINE Serving on http://172.21.15.44:8765 2024-08-19T00:13:22.874 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:22 smithi044 ceph-mon[18489]: [19/Aug/2024:00:13:21] ENGINE Bus STARTED 2024-08-19T00:13:22.874 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:22 smithi044 ceph-mon[18489]: Updating smithi116:/etc/ceph/ceph.client.admin.keyring 2024-08-19T00:13:22.874 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:22 smithi044 ceph-mon[18489]: Updating smithi171:/etc/ceph/ceph.client.admin.keyring 2024-08-19T00:13:22.874 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:22 smithi044 ceph-mon[18489]: Updating smithi044:/etc/ceph/ceph.client.admin.keyring 2024-08-19T00:13:22.874 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:22 smithi044 ceph-mon[18489]: from='client.15408 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:13:22.874 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:22 smithi044 ceph-mon[18489]: Updating smithi116:/var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-19T00:13:22.874 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:22 smithi044 ceph-mon[18489]: Updating smithi171:/var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-19T00:13:22.874 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:22 smithi044 ceph-mon[18489]: Updating smithi044:/var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-19T00:13:22.874 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:22 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:13:22.874 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:22 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:13:22.875 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:22 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:13:22.875 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:22 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:13:22.875 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:22 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:13:22.875 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:22 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:13:22.875 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:22 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:13:23.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:22 smithi171 ceph-mon[21810]: from='client.25004 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:13:23.093 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:22 smithi171 ceph-mon[21810]: Adjusting osd_memory_target on smithi044 to 177.1M 2024-08-19T00:13:23.093 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:22 smithi171 ceph-mon[21810]: Unable to set osd_memory_target on smithi044 to 185704960: error parsing value: Value '185704960' is below minimum 939524096 2024-08-19T00:13:23.093 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:22 smithi171 ceph-mon[21810]: Updating smithi044:/etc/ceph/ceph.conf 2024-08-19T00:13:23.093 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:22 smithi171 ceph-mon[21810]: Updating smithi116:/etc/ceph/ceph.conf 2024-08-19T00:13:23.093 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:22 smithi171 ceph-mon[21810]: Updating smithi171:/etc/ceph/ceph.conf 2024-08-19T00:13:23.093 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:22 smithi171 ceph-mon[21810]: [19/Aug/2024:00:13:21] ENGINE Bus STARTING 2024-08-19T00:13:23.093 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:22 smithi171 ceph-mon[21810]: [19/Aug/2024:00:13:21] ENGINE Serving on https://172.21.15.44:7150 2024-08-19T00:13:23.093 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:22 smithi171 ceph-mon[21810]: [19/Aug/2024:00:13:21] ENGINE Error in HTTPServer.serve 2024-08-19T00:13:23.093 INFO:journalctl@ceph.mon.c.smithi171.stdout: Traceback (most recent call last): 2024-08-19T00:13:23.093 INFO:journalctl@ceph.mon.c.smithi171.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-19T00:13:23.093 INFO:journalctl@ceph.mon.c.smithi171.stdout: self._connections.run(self.expiration_interval) 2024-08-19T00:13:23.093 INFO:journalctl@ceph.mon.c.smithi171.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-19T00:13:23.093 INFO:journalctl@ceph.mon.c.smithi171.stdout: self._run(expiration_interval) 2024-08-19T00:13:23.094 INFO:journalctl@ceph.mon.c.smithi171.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-19T00:13:23.094 INFO:journalctl@ceph.mon.c.smithi171.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-19T00:13:23.094 INFO:journalctl@ceph.mon.c.smithi171.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-19T00:13:23.094 INFO:journalctl@ceph.mon.c.smithi171.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-19T00:13:23.094 INFO:journalctl@ceph.mon.c.smithi171.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-19T00:13:23.094 INFO:journalctl@ceph.mon.c.smithi171.stdout: s = self.context.wrap_socket( 2024-08-19T00:13:23.094 INFO:journalctl@ceph.mon.c.smithi171.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-19T00:13:23.094 INFO:journalctl@ceph.mon.c.smithi171.stdout: return self.sslsocket_class._create( 2024-08-19T00:13:23.094 INFO:journalctl@ceph.mon.c.smithi171.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-19T00:13:23.094 INFO:journalctl@ceph.mon.c.smithi171.stdout: self.do_handshake() 2024-08-19T00:13:23.094 INFO:journalctl@ceph.mon.c.smithi171.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-19T00:13:23.094 INFO:journalctl@ceph.mon.c.smithi171.stdout: self._sslobj.do_handshake() 2024-08-19T00:13:23.094 INFO:journalctl@ceph.mon.c.smithi171.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-19T00:13:23.095 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:22 smithi171 ceph-mon[21810]: Updating smithi116:/var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-19T00:13:23.095 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:22 smithi171 ceph-mon[21810]: Updating smithi171:/var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-19T00:13:23.095 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:22 smithi171 ceph-mon[21810]: Updating smithi044:/var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-19T00:13:23.095 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:22 smithi171 ceph-mon[21810]: from='client.15402 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:13:23.095 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:22 smithi171 ceph-mon[21810]: [19/Aug/2024:00:13:21] ENGINE Serving on http://172.21.15.44:8765 2024-08-19T00:13:23.095 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:22 smithi171 ceph-mon[21810]: [19/Aug/2024:00:13:21] ENGINE Bus STARTED 2024-08-19T00:13:23.095 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:22 smithi171 ceph-mon[21810]: Updating smithi116:/etc/ceph/ceph.client.admin.keyring 2024-08-19T00:13:23.095 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:22 smithi171 ceph-mon[21810]: Updating smithi171:/etc/ceph/ceph.client.admin.keyring 2024-08-19T00:13:23.095 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:22 smithi171 ceph-mon[21810]: Updating smithi044:/etc/ceph/ceph.client.admin.keyring 2024-08-19T00:13:23.095 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:22 smithi171 ceph-mon[21810]: from='client.15408 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:13:23.095 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:22 smithi171 ceph-mon[21810]: Updating smithi116:/var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-19T00:13:23.095 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:22 smithi171 ceph-mon[21810]: Updating smithi171:/var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-19T00:13:23.095 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:22 smithi171 ceph-mon[21810]: Updating smithi044:/var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-19T00:13:23.096 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:22 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:13:23.096 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:22 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:13:23.096 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:22 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:13:23.096 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:22 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:13:23.096 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:22 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:13:23.096 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:22 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:13:23.096 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:22 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:13:23.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:23.145+0000 7fa97862e640 1 -- 172.21.15.44:0/2310131279 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa970107fc0 msgr2=0x7fa97010e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:23.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:23.145+0000 7fa97862e640 1 --2- 172.21.15.44:0/2310131279 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa970107fc0 0x7fa97010e960 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa960009cd0 tx=0x7fa96002a8e0 comp rx=0 tx=0).stop 2024-08-19T00:13:23.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:23.145+0000 7fa97862e640 1 -- 172.21.15.44:0/2310131279 shutdown_connections 2024-08-19T00:13:23.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:23.145+0000 7fa97862e640 1 --2- 172.21.15.44:0/2310131279 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa970103470 0x7fa9701078b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:23.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:23.145+0000 7fa97862e640 1 --2- 172.21.15.44:0/2310131279 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa970107fc0 0x7fa97010e960 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:23.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:23.145+0000 7fa97862e640 1 --2- 172.21.15.44:0/2310131279 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa970102ac0 0x7fa970102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:23.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:23.145+0000 7fa97862e640 1 -- 172.21.15.44:0/2310131279 >> 172.21.15.44:0/2310131279 conn(0x7fa9700fc500 msgr2=0x7fa9700fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:23.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:23.145+0000 7fa97862e640 1 -- 172.21.15.44:0/2310131279 shutdown_connections 2024-08-19T00:13:23.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:23.145+0000 7fa97862e640 1 -- 172.21.15.44:0/2310131279 wait complete. 2024-08-19T00:13:23.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:23.146+0000 7fa97862e640 1 Processor -- start 2024-08-19T00:13:23.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:23.146+0000 7fa97862e640 1 -- start start 2024-08-19T00:13:23.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:23.146+0000 7fa97862e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa970102ac0 0x7fa970198240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:23.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:23.146+0000 7fa97862e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa970103470 0x7fa970198780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:23.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:23.146+0000 7fa97862e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa970107fc0 0x7fa97019cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:23.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:23.146+0000 7fa97862e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa970111e00 con 0x7fa970107fc0 2024-08-19T00:13:23.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:23.146+0000 7fa97862e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fa970111c80 con 0x7fa970103470 2024-08-19T00:13:23.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:23.146+0000 7fa97862e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa970111f80 con 0x7fa970102ac0 2024-08-19T00:13:23.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:23.146+0000 7fa976bcb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa970107fc0 0x7fa97019cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:23.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:23.146+0000 7fa976bcb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa970107fc0 0x7fa97019cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37086/0 (socket says 172.21.15.44:37086) 2024-08-19T00:13:23.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:23.146+0000 7fa976bcb640 1 -- 172.21.15.44:0/2249573667 learned_addr learned my addr 172.21.15.44:0/2249573667 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:23.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:23.146+0000 7fa975bc9640 1 --2- 172.21.15.44:0/2249573667 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa970103470 0x7fa970198780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:23.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:23.146+0000 7fa9763ca640 1 --2- 172.21.15.44:0/2249573667 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa970102ac0 0x7fa970198240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:23.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:23.146+0000 7fa976bcb640 1 -- 172.21.15.44:0/2249573667 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa970102ac0 msgr2=0x7fa970198240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:23.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:23.146+0000 7fa976bcb640 1 --2- 172.21.15.44:0/2249573667 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa970102ac0 0x7fa970198240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:23.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:23.146+0000 7fa976bcb640 1 -- 172.21.15.44:0/2249573667 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa970103470 msgr2=0x7fa970198780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:23.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:23.146+0000 7fa976bcb640 1 --2- 172.21.15.44:0/2249573667 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa970103470 0x7fa970198780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:23.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:23.146+0000 7fa976bcb640 1 -- 172.21.15.44:0/2249573667 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa97019d1f0 con 0x7fa970107fc0 2024-08-19T00:13:23.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:23.147+0000 7fa976bcb640 1 --2- 172.21.15.44:0/2249573667 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa970107fc0 0x7fa97019cb10 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa960006010 tx=0x7fa960003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:23.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:23.147+0000 7fa96f7fe640 1 -- 172.21.15.44:0/2249573667 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa960004450 con 0x7fa970107fc0 2024-08-19T00:13:23.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:23.147+0000 7fa96f7fe640 1 -- 172.21.15.44:0/2249573667 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa960003e10 con 0x7fa970107fc0 2024-08-19T00:13:23.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:23.147+0000 7fa97862e640 1 -- 172.21.15.44:0/2249573667 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa97019d480 con 0x7fa970107fc0 2024-08-19T00:13:23.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:23.147+0000 7fa96f7fe640 1 -- 172.21.15.44:0/2249573667 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa960046480 con 0x7fa970107fc0 2024-08-19T00:13:23.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:23.147+0000 7fa97862e640 1 -- 172.21.15.44:0/2249573667 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9701a4dc0 con 0x7fa970107fc0 2024-08-19T00:13:23.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:23.148+0000 7fa97862e640 1 -- 172.21.15.44:0/2249573667 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa97006a520 con 0x7fa970107fc0 2024-08-19T00:13:23.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:23.149+0000 7fa96f7fe640 1 -- 172.21.15.44:0/2249573667 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 24) ==== 138060+0+0 (secure 0 0 0) 0x7fa9600045f0 con 0x7fa970107fc0 2024-08-19T00:13:23.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:23.150+0000 7fa96f7fe640 1 --2- 172.21.15.44:0/2249573667 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fa9580a2e10 0x7fa9580a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:23.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:23.150+0000 7fa96f7fe640 1 -- 172.21.15.44:0/2249573667 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7fa96002e030 con 0x7fa970107fc0 2024-08-19T00:13:23.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:23.150+0000 7fa9763ca640 1 --2- 172.21.15.44:0/2249573667 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fa9580a2e10 0x7fa9580a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:23.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:23.150+0000 7fa9763ca640 1 --2- 172.21.15.44:0/2249573667 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fa9580a2e10 0x7fa9580a52d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa968009890 tx=0x7fa968008040 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:23.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:23.153+0000 7fa96f7fe640 1 -- 172.21.15.44:0/2249573667 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fa96004b060 con 0x7fa970107fc0 2024-08-19T00:13:23.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:23.324+0000 7fa97862e640 1 -- 172.21.15.44:0/2249573667 --> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa9700fe7f0 con 0x7fa9580a2e10 2024-08-19T00:13:23.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:23.333+0000 7fa96f7fe640 1 -- 172.21.15.44:0/2249573667 <== mgr.15297 v2:172.21.15.44:6800/1029670730 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+339433 (secure 0 0 0) 0x7fa9700fe7f0 con 0x7fa9580a2e10 2024-08-19T00:13:23.338 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:13:23.340 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-08-19T00:13:23.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:23.336+0000 7fa97862e640 1 -- 172.21.15.44:0/2249573667 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fa9580a2e10 msgr2=0x7fa9580a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:23.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:23.336+0000 7fa97862e640 1 --2- 172.21.15.44:0/2249573667 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fa9580a2e10 0x7fa9580a52d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa968009890 tx=0x7fa968008040 comp rx=0 tx=0).stop 2024-08-19T00:13:23.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:23.336+0000 7fa97862e640 1 -- 172.21.15.44:0/2249573667 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa970107fc0 msgr2=0x7fa97019cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:23.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:23.336+0000 7fa97862e640 1 --2- 172.21.15.44:0/2249573667 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa970107fc0 0x7fa97019cb10 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa960006010 tx=0x7fa960003c20 comp rx=0 tx=0).stop 2024-08-19T00:13:23.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:23.336+0000 7fa97862e640 1 -- 172.21.15.44:0/2249573667 shutdown_connections 2024-08-19T00:13:23.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:23.336+0000 7fa97862e640 1 --2- 172.21.15.44:0/2249573667 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fa9580a2e10 0x7fa9580a52d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:23.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:23.336+0000 7fa97862e640 1 --2- 172.21.15.44:0/2249573667 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa970107fc0 0x7fa97019cb10 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:23.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:23.336+0000 7fa97862e640 1 --2- 172.21.15.44:0/2249573667 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa970103470 0x7fa970198780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:23.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:23.336+0000 7fa97862e640 1 --2- 172.21.15.44:0/2249573667 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa970102ac0 0x7fa970198240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:23.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:23.336+0000 7fa97862e640 1 -- 172.21.15.44:0/2249573667 >> 172.21.15.44:0/2249573667 conn(0x7fa9700fc500 msgr2=0x7fa9700fe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:23.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:23.337+0000 7fa97862e640 1 -- 172.21.15.44:0/2249573667 shutdown_connections 2024-08-19T00:13:23.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:23.337+0000 7fa97862e640 1 -- 172.21.15.44:0/2249573667 wait complete. 2024-08-19T00:13:23.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:23 smithi116 ceph-mon[21873]: pgmap v5: 129 pgs: 129 active+clean; 1.1 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:13:23.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:23 smithi116 ceph-mon[21873]: mgrmap e24: x(active, since 4s), standbys: z, y 2024-08-19T00:13:23.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:23 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:13:23.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:23 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:13:23.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:23 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:13:23.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:23 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:13:23.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:23 smithi116 ceph-mon[21873]: from='client.15414 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-19T00:13:23.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:23 smithi044 ceph-mon[18489]: pgmap v5: 129 pgs: 129 active+clean; 1.1 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:13:23.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:23 smithi044 ceph-mon[18489]: mgrmap e24: x(active, since 4s), standbys: z, y 2024-08-19T00:13:23.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:23 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:13:23.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:23 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:13:23.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:23 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:13:23.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:23 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:13:23.870 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:23 smithi044 ceph-mon[18489]: from='client.15414 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-19T00:13:24.058 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-08-19T00:13:22.520913+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1193583,"num_objects":104,"num_object_clones":0,"num_object_copies":314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":1302,"num_read_kb":819,"num_write":559,"num_write_kb":4407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1180848,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":941,"ondisk_log_size":941,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":407688,"kb_used_data":16664,"kb_used_omap":18,"kb_used_meta":390637,"kb_avail":1124534136,"statfs":{"total":1151940427776,"available":1151522955264,"internally_reserved":0,"allocated":17063936,"data_stored":10119473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":400012601},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.989186"},"pg_stats":[{"pgid":"2.1f","version":"95'14","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.756376+0000","last_change":"2024-08-19T00:10:50.471635+0000","last_active":"2024-08-19T00:13:18.756376+0000","last_peered":"2024-08-19T00:13:18.756376+0000","last_clean":"2024-08-19T00:13:18.756376+0000","last_became_active":"2024-08-19T00:10:50.471324+0000","last_became_peered":"2024-08-19T00:10:50.471324+0000","last_unstale":"2024-08-19T00:13:18.756376+0000","last_undegraded":"2024-08-19T00:13:18.756376+0000","last_fullsized":"2024-08-19T00:13:18.756376+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:41:02.945782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":104,"num_read_kb":104,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"94'5","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.598581+0000","last_change":"2024-08-19T00:12:40.812782+0000","last_active":"2024-08-19T00:13:18.598581+0000","last_peered":"2024-08-19T00:13:18.598581+0000","last_clean":"2024-08-19T00:13:18.598581+0000","last_became_active":"2024-08-19T00:12:40.812506+0000","last_became_peered":"2024-08-19T00:12:40.812506+0000","last_unstale":"2024-08-19T00:13:18.598581+0000","last_undegraded":"2024-08-19T00:13:18.598581+0000","last_fullsized":"2024-08-19T00:13:18.598581+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:32:54.681461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,8],"acting":[9,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744057+0000","last_change":"2024-08-19T00:10:59.789370+0000","last_active":"2024-08-19T00:13:18.744057+0000","last_peered":"2024-08-19T00:13:18.744057+0000","last_clean":"2024-08-19T00:13:18.744057+0000","last_became_active":"2024-08-19T00:10:59.788901+0000","last_became_peered":"2024-08-19T00:10:59.788901+0000","last_unstale":"2024-08-19T00:13:18.744057+0000","last_undegraded":"2024-08-19T00:13:18.744057+0000","last_fullsized":"2024-08-19T00:13:18.744057+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:15:45.247674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"90'2","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.509703+0000","last_change":"2024-08-19T00:10:50.618000+0000","last_active":"2024-08-19T00:13:18.509703+0000","last_peered":"2024-08-19T00:13:18.509703+0000","last_clean":"2024-08-19T00:13:18.509703+0000","last_became_active":"2024-08-19T00:10:50.617648+0000","last_became_peered":"2024-08-19T00:10:50.617648+0000","last_unstale":"2024-08-19T00:13:18.509703+0000","last_undegraded":"2024-08-19T00:13:18.509703+0000","last_fullsized":"2024-08-19T00:13:18.509703+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:39:00.310466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"94'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.745061+0000","last_change":"2024-08-19T00:10:52.518075+0000","last_active":"2024-08-19T00:13:18.745061+0000","last_peered":"2024-08-19T00:13:18.745061+0000","last_clean":"2024-08-19T00:13:18.745061+0000","last_became_active":"2024-08-19T00:10:52.517735+0000","last_became_peered":"2024-08-19T00:10:52.517735+0000","last_unstale":"2024-08-19T00:13:18.745061+0000","last_undegraded":"2024-08-19T00:13:18.745061+0000","last_fullsized":"2024-08-19T00:13:18.745061+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:02:32.657776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.511525+0000","last_change":"2024-08-19T00:10:59.787563+0000","last_active":"2024-08-19T00:13:18.511525+0000","last_peered":"2024-08-19T00:13:18.511525+0000","last_clean":"2024-08-19T00:13:18.511525+0000","last_became_active":"2024-08-19T00:10:59.787143+0000","last_became_peered":"2024-08-19T00:10:59.787143+0000","last_unstale":"2024-08-19T00:13:18.511525+0000","last_undegraded":"2024-08-19T00:13:18.511525+0000","last_fullsized":"2024-08-19T00:13:18.511525+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:41:47.101296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"90'12","reported_seq":53,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.509564+0000","last_change":"2024-08-19T00:10:50.475869+0000","last_active":"2024-08-19T00:13:18.509564+0000","last_peered":"2024-08-19T00:13:18.509564+0000","last_clean":"2024-08-19T00:13:18.509564+0000","last_became_active":"2024-08-19T00:10:50.475550+0000","last_became_peered":"2024-08-19T00:10:50.475550+0000","last_unstale":"2024-08-19T00:13:18.509564+0000","last_undegraded":"2024-08-19T00:13:18.509564+0000","last_fullsized":"2024-08-19T00:13:18.509564+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:47:23.724503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"94'9","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743612+0000","last_change":"2024-08-19T00:10:52.511901+0000","last_active":"2024-08-19T00:13:18.743612+0000","last_peered":"2024-08-19T00:13:18.743612+0000","last_clean":"2024-08-19T00:13:18.743612+0000","last_became_active":"2024-08-19T00:10:52.511595+0000","last_became_peered":"2024-08-19T00:10:52.511595+0000","last_unstale":"2024-08-19T00:13:18.743612+0000","last_undegraded":"2024-08-19T00:13:18.743612+0000","last_fullsized":"2024-08-19T00:13:18.743612+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:57:30.613865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.511802+0000","last_change":"2024-08-19T00:10:59.785611+0000","last_active":"2024-08-19T00:13:18.511802+0000","last_peered":"2024-08-19T00:13:18.511802+0000","last_clean":"2024-08-19T00:13:18.511802+0000","last_became_active":"2024-08-19T00:10:59.785105+0000","last_became_peered":"2024-08-19T00:10:59.785105+0000","last_unstale":"2024-08-19T00:13:18.511802+0000","last_undegraded":"2024-08-19T00:13:18.511802+0000","last_fullsized":"2024-08-19T00:13:18.511802+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:05:31.007647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"90'5","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.509236+0000","last_change":"2024-08-19T00:10:50.474439+0000","last_active":"2024-08-19T00:13:18.509236+0000","last_peered":"2024-08-19T00:13:18.509236+0000","last_clean":"2024-08-19T00:13:18.509236+0000","last_became_active":"2024-08-19T00:10:50.473984+0000","last_became_peered":"2024-08-19T00:10:50.473984+0000","last_unstale":"2024-08-19T00:13:18.509236+0000","last_undegraded":"2024-08-19T00:13:18.509236+0000","last_fullsized":"2024-08-19T00:13:18.509236+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:16:06.934392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"94'15","reported_seq":50,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.609081+0000","last_change":"2024-08-19T00:10:52.521664+0000","last_active":"2024-08-19T00:13:18.609081+0000","last_peered":"2024-08-19T00:13:18.609081+0000","last_clean":"2024-08-19T00:13:18.609081+0000","last_became_active":"2024-08-19T00:10:52.520792+0000","last_became_peered":"2024-08-19T00:10:52.520792+0000","last_unstale":"2024-08-19T00:13:18.609081+0000","last_undegraded":"2024-08-19T00:13:18.609081+0000","last_fullsized":"2024-08-19T00:13:18.609081+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:55:27.199456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.511618+0000","last_change":"2024-08-19T00:10:59.789736+0000","last_active":"2024-08-19T00:13:18.511618+0000","last_peered":"2024-08-19T00:13:18.511618+0000","last_clean":"2024-08-19T00:13:18.511618+0000","last_became_active":"2024-08-19T00:10:59.786880+0000","last_became_peered":"2024-08-19T00:10:59.786880+0000","last_unstale":"2024-08-19T00:13:18.511618+0000","last_undegraded":"2024-08-19T00:13:18.511618+0000","last_fullsized":"2024-08-19T00:13:18.511618+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:20:53.615561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"94'5","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743922+0000","last_change":"2024-08-19T00:10:52.519887+0000","last_active":"2024-08-19T00:13:18.743922+0000","last_peered":"2024-08-19T00:13:18.743922+0000","last_clean":"2024-08-19T00:13:18.743922+0000","last_became_active":"2024-08-19T00:10:52.519550+0000","last_became_peered":"2024-08-19T00:10:52.519550+0000","last_unstale":"2024-08-19T00:13:18.743922+0000","last_undegraded":"2024-08-19T00:13:18.743922+0000","last_fullsized":"2024-08-19T00:13:18.743922+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:27:43.493012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"90'4","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.508917+0000","last_change":"2024-08-19T00:10:50.478131+0000","last_active":"2024-08-19T00:13:18.508917+0000","last_peered":"2024-08-19T00:13:18.508917+0000","last_clean":"2024-08-19T00:13:18.508917+0000","last_became_active":"2024-08-19T00:10:50.477826+0000","last_became_peered":"2024-08-19T00:10:50.477826+0000","last_unstale":"2024-08-19T00:13:18.508917+0000","last_undegraded":"2024-08-19T00:13:18.508917+0000","last_fullsized":"2024-08-19T00:13:18.508917+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:41:24.066453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.511970+0000","last_change":"2024-08-19T00:10:59.787634+0000","last_active":"2024-08-19T00:13:18.511970+0000","last_peered":"2024-08-19T00:13:18.511970+0000","last_clean":"2024-08-19T00:13:18.511970+0000","last_became_active":"2024-08-19T00:10:59.786508+0000","last_became_peered":"2024-08-19T00:10:59.786508+0000","last_unstale":"2024-08-19T00:13:18.511970+0000","last_undegraded":"2024-08-19T00:13:18.511970+0000","last_fullsized":"2024-08-19T00:13:18.511970+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:50:19.071853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"94'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.507964+0000","last_change":"2024-08-19T00:10:52.512462+0000","last_active":"2024-08-19T00:13:18.507964+0000","last_peered":"2024-08-19T00:13:18.507964+0000","last_clean":"2024-08-19T00:13:18.507964+0000","last_became_active":"2024-08-19T00:10:52.512139+0000","last_became_peered":"2024-08-19T00:10:52.512139+0000","last_unstale":"2024-08-19T00:13:18.507964+0000","last_undegraded":"2024-08-19T00:13:18.507964+0000","last_fullsized":"2024-08-19T00:13:18.507964+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:39:18.677836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"95'4","reported_seq":24,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744069+0000","last_change":"2024-08-19T00:11:39.930130+0000","last_active":"2024-08-19T00:13:18.744069+0000","last_peered":"2024-08-19T00:13:18.744069+0000","last_clean":"2024-08-19T00:13:18.744069+0000","last_became_active":"2024-08-19T00:11:39.919566+0000","last_became_peered":"2024-08-19T00:11:39.919566+0000","last_unstale":"2024-08-19T00:13:18.744069+0000","last_undegraded":"2024-08-19T00:13:18.744069+0000","last_fullsized":"2024-08-19T00:13:18.744069+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:50:25.001784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"92'1","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.511923+0000","last_change":"2024-08-19T00:10:59.787455+0000","last_active":"2024-08-19T00:13:18.511923+0000","last_peered":"2024-08-19T00:13:18.511923+0000","last_clean":"2024-08-19T00:13:18.511923+0000","last_became_active":"2024-08-19T00:10:59.787054+0000","last_became_peered":"2024-08-19T00:10:59.787054+0000","last_unstale":"2024-08-19T00:13:18.511923+0000","last_undegraded":"2024-08-19T00:13:18.511923+0000","last_fullsized":"2024-08-19T00:13:18.511923+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:13:31.356220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"94'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743845+0000","last_change":"2024-08-19T00:10:52.520993+0000","last_active":"2024-08-19T00:13:18.743845+0000","last_peered":"2024-08-19T00:13:18.743845+0000","last_clean":"2024-08-19T00:13:18.743845+0000","last_became_active":"2024-08-19T00:10:52.520697+0000","last_became_peered":"2024-08-19T00:10:52.520697+0000","last_unstale":"2024-08-19T00:13:18.743845+0000","last_undegraded":"2024-08-19T00:13:18.743845+0000","last_fullsized":"2024-08-19T00:13:18.743845+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:30:15.408193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"90'7","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.507822+0000","last_change":"2024-08-19T00:10:50.470746+0000","last_active":"2024-08-19T00:13:18.507822+0000","last_peered":"2024-08-19T00:13:18.507822+0000","last_clean":"2024-08-19T00:13:18.507822+0000","last_became_active":"2024-08-19T00:10:50.470454+0000","last_became_peered":"2024-08-19T00:10:50.470454+0000","last_unstale":"2024-08-19T00:13:18.507822+0000","last_undegraded":"2024-08-19T00:13:18.507822+0000","last_fullsized":"2024-08-19T00:13:18.507822+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:37:34.718543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.509316+0000","last_change":"2024-08-19T00:11:39.924217+0000","last_active":"2024-08-19T00:13:18.509316+0000","last_peered":"2024-08-19T00:13:18.509316+0000","last_clean":"2024-08-19T00:13:18.509316+0000","last_became_active":"2024-08-19T00:11:39.923541+0000","last_became_peered":"2024-08-19T00:11:39.923541+0000","last_unstale":"2024-08-19T00:13:18.509316+0000","last_undegraded":"2024-08-19T00:13:18.509316+0000","last_fullsized":"2024-08-19T00:13:18.509316+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:29:35.040424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,2,5],"acting":[8,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.9","version":"94'2","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.508727+0000","last_change":"2024-08-19T00:10:52.516838+0000","last_active":"2024-08-19T00:13:18.508727+0000","last_peered":"2024-08-19T00:13:18.508727+0000","last_clean":"2024-08-19T00:13:18.508727+0000","last_became_active":"2024-08-19T00:10:52.516471+0000","last_became_peered":"2024-08-19T00:10:52.516471+0000","last_unstale":"2024-08-19T00:13:18.508727+0000","last_undegraded":"2024-08-19T00:13:18.508727+0000","last_fullsized":"2024-08-19T00:13:18.508727+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:11:26.974655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"90'2","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743362+0000","last_change":"2024-08-19T00:10:50.618745+0000","last_active":"2024-08-19T00:13:18.743362+0000","last_peered":"2024-08-19T00:13:18.743362+0000","last_clean":"2024-08-19T00:13:18.743362+0000","last_became_active":"2024-08-19T00:10:50.618426+0000","last_became_peered":"2024-08-19T00:10:50.618426+0000","last_unstale":"2024-08-19T00:13:18.743362+0000","last_undegraded":"2024-08-19T00:13:18.743362+0000","last_fullsized":"2024-08-19T00:13:18.743362+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:12:57.777142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.512249+0000","last_change":"2024-08-19T00:10:59.793740+0000","last_active":"2024-08-19T00:13:18.512249+0000","last_peered":"2024-08-19T00:13:18.512249+0000","last_clean":"2024-08-19T00:13:18.512249+0000","last_became_active":"2024-08-19T00:10:59.793181+0000","last_became_peered":"2024-08-19T00:10:59.793181+0000","last_unstale":"2024-08-19T00:13:18.512249+0000","last_undegraded":"2024-08-19T00:13:18.512249+0000","last_fullsized":"2024-08-19T00:13:18.512249+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:04:15.429505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"94'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744045+0000","last_change":"2024-08-19T00:10:52.512200+0000","last_active":"2024-08-19T00:13:18.744045+0000","last_peered":"2024-08-19T00:13:18.744045+0000","last_clean":"2024-08-19T00:13:18.744045+0000","last_became_active":"2024-08-19T00:10:52.511891+0000","last_became_peered":"2024-08-19T00:10:52.511891+0000","last_unstale":"2024-08-19T00:13:18.744045+0000","last_undegraded":"2024-08-19T00:13:18.744045+0000","last_fullsized":"2024-08-19T00:13:18.744045+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:02:08.400026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"90'7","reported_seq":49,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.512396+0000","last_change":"2024-08-19T00:10:50.476209+0000","last_active":"2024-08-19T00:13:18.512396+0000","last_peered":"2024-08-19T00:13:18.512396+0000","last_clean":"2024-08-19T00:13:18.512396+0000","last_became_active":"2024-08-19T00:10:50.475410+0000","last_became_peered":"2024-08-19T00:10:50.475410+0000","last_unstale":"2024-08-19T00:13:18.512396+0000","last_undegraded":"2024-08-19T00:13:18.512396+0000","last_fullsized":"2024-08-19T00:13:18.512396+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:46:25.093738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744155+0000","last_change":"2024-08-19T00:10:59.786550+0000","last_active":"2024-08-19T00:13:18.744155+0000","last_peered":"2024-08-19T00:13:18.744155+0000","last_clean":"2024-08-19T00:13:18.744155+0000","last_became_active":"2024-08-19T00:10:59.785531+0000","last_became_peered":"2024-08-19T00:10:59.785531+0000","last_unstale":"2024-08-19T00:13:18.744155+0000","last_undegraded":"2024-08-19T00:13:18.744155+0000","last_fullsized":"2024-08-19T00:13:18.744155+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:59:53.605678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"94'5","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.509486+0000","last_change":"2024-08-19T00:10:52.514936+0000","last_active":"2024-08-19T00:13:18.509486+0000","last_peered":"2024-08-19T00:13:18.509486+0000","last_clean":"2024-08-19T00:13:18.509486+0000","last_became_active":"2024-08-19T00:10:52.514597+0000","last_became_peered":"2024-08-19T00:10:52.514597+0000","last_unstale":"2024-08-19T00:13:18.509486+0000","last_undegraded":"2024-08-19T00:13:18.509486+0000","last_fullsized":"2024-08-19T00:13:18.509486+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:03:42.275705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"95'52","reported_seq":116,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.711935+0000","last_change":"2024-08-19T00:10:50.470637+0000","last_active":"2024-08-19T00:13:18.711935+0000","last_peered":"2024-08-19T00:13:18.711935+0000","last_clean":"2024-08-19T00:13:18.711935+0000","last_became_active":"2024-08-19T00:10:50.470276+0000","last_became_peered":"2024-08-19T00:10:50.470276+0000","last_unstale":"2024-08-19T00:13:18.711935+0000","last_undegraded":"2024-08-19T00:13:18.711935+0000","last_fullsized":"2024-08-19T00:13:18.711935+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:42:16.186669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":92,"num_write_kb":838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.507497+0000","last_change":"2024-08-19T00:10:59.784742+0000","last_active":"2024-08-19T00:13:18.507497+0000","last_peered":"2024-08-19T00:13:18.507497+0000","last_clean":"2024-08-19T00:13:18.507497+0000","last_became_active":"2024-08-19T00:10:59.784372+0000","last_became_peered":"2024-08-19T00:10:59.784372+0000","last_unstale":"2024-08-19T00:13:18.507497+0000","last_undegraded":"2024-08-19T00:13:18.507497+0000","last_fullsized":"2024-08-19T00:13:18.507497+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:58:03.216882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"94'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744841+0000","last_change":"2024-08-19T00:10:52.511172+0000","last_active":"2024-08-19T00:13:18.744841+0000","last_peered":"2024-08-19T00:13:18.744841+0000","last_clean":"2024-08-19T00:13:18.744841+0000","last_became_active":"2024-08-19T00:10:52.510816+0000","last_became_peered":"2024-08-19T00:10:52.510816+0000","last_unstale":"2024-08-19T00:13:18.744841+0000","last_undegraded":"2024-08-19T00:13:18.744841+0000","last_fullsized":"2024-08-19T00:13:18.744841+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:31:39.889398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"90'4","reported_seq":25,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744284+0000","last_change":"2024-08-19T00:11:39.926806+0000","last_active":"2024-08-19T00:13:18.744284+0000","last_peered":"2024-08-19T00:13:18.744284+0000","last_clean":"2024-08-19T00:13:18.744284+0000","last_became_active":"2024-08-19T00:11:39.917115+0000","last_became_peered":"2024-08-19T00:11:39.917115+0000","last_unstale":"2024-08-19T00:13:18.744284+0000","last_undegraded":"2024-08-19T00:13:18.744284+0000","last_fullsized":"2024-08-19T00:13:18.744284+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:58:19.965471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744267+0000","last_change":"2024-08-19T00:10:59.778996+0000","last_active":"2024-08-19T00:13:18.744267+0000","last_peered":"2024-08-19T00:13:18.744267+0000","last_clean":"2024-08-19T00:13:18.744267+0000","last_became_active":"2024-08-19T00:10:59.778589+0000","last_became_peered":"2024-08-19T00:10:59.778589+0000","last_unstale":"2024-08-19T00:13:18.744267+0000","last_undegraded":"2024-08-19T00:13:18.744267+0000","last_fullsized":"2024-08-19T00:13:18.744267+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:40:23.690051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"94'4","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.611723+0000","last_change":"2024-08-19T00:10:52.512796+0000","last_active":"2024-08-19T00:13:18.611723+0000","last_peered":"2024-08-19T00:13:18.611723+0000","last_clean":"2024-08-19T00:13:18.611723+0000","last_became_active":"2024-08-19T00:10:52.512459+0000","last_became_peered":"2024-08-19T00:10:52.512459+0000","last_unstale":"2024-08-19T00:13:18.611723+0000","last_undegraded":"2024-08-19T00:13:18.611723+0000","last_fullsized":"2024-08-19T00:13:18.611723+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:07:47.124129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"90'1","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.599347+0000","last_change":"2024-08-19T00:10:50.618118+0000","last_active":"2024-08-19T00:13:18.599347+0000","last_peered":"2024-08-19T00:13:18.599347+0000","last_clean":"2024-08-19T00:13:18.599347+0000","last_became_active":"2024-08-19T00:10:50.617759+0000","last_became_peered":"2024-08-19T00:10:50.617759+0000","last_unstale":"2024-08-19T00:13:18.599347+0000","last_undegraded":"2024-08-19T00:13:18.599347+0000","last_fullsized":"2024-08-19T00:13:18.599347+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:38:10.830722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.508792+0000","last_change":"2024-08-19T00:10:59.783548+0000","last_active":"2024-08-19T00:13:18.508792+0000","last_peered":"2024-08-19T00:13:18.508792+0000","last_clean":"2024-08-19T00:13:18.508792+0000","last_became_active":"2024-08-19T00:10:59.783091+0000","last_became_peered":"2024-08-19T00:10:59.783091+0000","last_unstale":"2024-08-19T00:13:18.508792+0000","last_undegraded":"2024-08-19T00:13:18.508792+0000","last_fullsized":"2024-08-19T00:13:18.508792+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:26:21.191829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"94'7","reported_seq":49,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.611787+0000","last_change":"2024-08-19T00:12:40.994390+0000","last_active":"2024-08-19T00:13:18.611787+0000","last_peered":"2024-08-19T00:13:18.611787+0000","last_clean":"2024-08-19T00:13:18.611787+0000","last_became_active":"2024-08-19T00:12:40.994099+0000","last_became_peered":"2024-08-19T00:12:40.994099+0000","last_unstale":"2024-08-19T00:13:18.611787+0000","last_undegraded":"2024-08-19T00:13:18.611787+0000","last_fullsized":"2024-08-19T00:13:18.611787+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:28:07.374407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"95'7","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:19.051982+0000","last_change":"2024-08-19T00:10:50.478742+0000","last_active":"2024-08-19T00:13:19.051982+0000","last_peered":"2024-08-19T00:13:19.051982+0000","last_clean":"2024-08-19T00:13:19.051982+0000","last_became_active":"2024-08-19T00:10:50.478139+0000","last_became_peered":"2024-08-19T00:10:50.478139+0000","last_unstale":"2024-08-19T00:13:19.051982+0000","last_undegraded":"2024-08-19T00:13:19.051982+0000","last_fullsized":"2024-08-19T00:13:19.051982+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:23:25.727268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":2,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744335+0000","last_change":"2024-08-19T00:10:59.785350+0000","last_active":"2024-08-19T00:13:18.744335+0000","last_peered":"2024-08-19T00:13:18.744335+0000","last_clean":"2024-08-19T00:13:18.744335+0000","last_became_active":"2024-08-19T00:10:59.784929+0000","last_became_peered":"2024-08-19T00:10:59.784929+0000","last_unstale":"2024-08-19T00:13:18.744335+0000","last_undegraded":"2024-08-19T00:13:18.744335+0000","last_fullsized":"2024-08-19T00:13:18.744335+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:58:49.878253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"94'8","reported_seq":50,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.608802+0000","last_change":"2024-08-19T00:11:39.924921+0000","last_active":"2024-08-19T00:13:18.608802+0000","last_peered":"2024-08-19T00:13:18.608802+0000","last_clean":"2024-08-19T00:13:18.608802+0000","last_became_active":"2024-08-19T00:11:39.924551+0000","last_became_peered":"2024-08-19T00:11:39.924551+0000","last_unstale":"2024-08-19T00:13:18.608802+0000","last_undegraded":"2024-08-19T00:13:18.608802+0000","last_fullsized":"2024-08-19T00:13:18.608802+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:14:23.042222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"90'5","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743434+0000","last_change":"2024-08-19T00:10:50.618159+0000","last_active":"2024-08-19T00:13:18.743434+0000","last_peered":"2024-08-19T00:13:18.743434+0000","last_clean":"2024-08-19T00:13:18.743434+0000","last_became_active":"2024-08-19T00:10:50.617828+0000","last_became_peered":"2024-08-19T00:10:50.617828+0000","last_unstale":"2024-08-19T00:13:18.743434+0000","last_undegraded":"2024-08-19T00:13:18.743434+0000","last_fullsized":"2024-08-19T00:13:18.743434+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:36:40.702592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":104,"num_read_kb":104,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.745102+0000","last_change":"2024-08-19T00:10:59.787615+0000","last_active":"2024-08-19T00:13:18.745102+0000","last_peered":"2024-08-19T00:13:18.745102+0000","last_clean":"2024-08-19T00:13:18.745102+0000","last_became_active":"2024-08-19T00:10:59.787184+0000","last_became_peered":"2024-08-19T00:10:59.787184+0000","last_unstale":"2024-08-19T00:13:18.745102+0000","last_undegraded":"2024-08-19T00:13:18.745102+0000","last_fullsized":"2024-08-19T00:13:18.745102+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:20:42.174337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"94'5","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743137+0000","last_change":"2024-08-19T00:10:52.509235+0000","last_active":"2024-08-19T00:13:18.743137+0000","last_peered":"2024-08-19T00:13:18.743137+0000","last_clean":"2024-08-19T00:13:18.743137+0000","last_became_active":"2024-08-19T00:10:52.508934+0000","last_became_peered":"2024-08-19T00:10:52.508934+0000","last_unstale":"2024-08-19T00:13:18.743137+0000","last_undegraded":"2024-08-19T00:13:18.743137+0000","last_fullsized":"2024-08-19T00:13:18.743137+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:12:59.654711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"90'4","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743372+0000","last_change":"2024-08-19T00:10:50.477180+0000","last_active":"2024-08-19T00:13:18.743372+0000","last_peered":"2024-08-19T00:13:18.743372+0000","last_clean":"2024-08-19T00:13:18.743372+0000","last_became_active":"2024-08-19T00:10:50.476875+0000","last_became_peered":"2024-08-19T00:10:50.476875+0000","last_unstale":"2024-08-19T00:13:18.743372+0000","last_undegraded":"2024-08-19T00:13:18.743372+0000","last_fullsized":"2024-08-19T00:13:18.743372+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:15:57.383599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.608964+0000","last_change":"2024-08-19T00:10:59.783389+0000","last_active":"2024-08-19T00:13:18.608964+0000","last_peered":"2024-08-19T00:13:18.608964+0000","last_clean":"2024-08-19T00:13:18.608964+0000","last_became_active":"2024-08-19T00:10:59.782983+0000","last_became_peered":"2024-08-19T00:10:59.782983+0000","last_unstale":"2024-08-19T00:13:18.608964+0000","last_undegraded":"2024-08-19T00:13:18.608964+0000","last_fullsized":"2024-08-19T00:13:18.608964+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:55:47.419588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"94'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.507821+0000","last_change":"2024-08-19T00:10:52.517477+0000","last_active":"2024-08-19T00:13:18.507821+0000","last_peered":"2024-08-19T00:13:18.507821+0000","last_clean":"2024-08-19T00:13:18.507821+0000","last_became_active":"2024-08-19T00:10:52.517192+0000","last_became_peered":"2024-08-19T00:10:52.517192+0000","last_unstale":"2024-08-19T00:13:18.507821+0000","last_undegraded":"2024-08-19T00:13:18.507821+0000","last_fullsized":"2024-08-19T00:13:18.507821+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:31:01.125780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"90'6","reported_seq":50,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.511955+0000","last_change":"2024-08-19T00:10:50.476296+0000","last_active":"2024-08-19T00:13:18.511955+0000","last_peered":"2024-08-19T00:13:18.511955+0000","last_clean":"2024-08-19T00:13:18.511955+0000","last_became_active":"2024-08-19T00:10:50.475835+0000","last_became_peered":"2024-08-19T00:10:50.475835+0000","last_unstale":"2024-08-19T00:13:18.511955+0000","last_undegraded":"2024-08-19T00:13:18.511955+0000","last_fullsized":"2024-08-19T00:13:18.511955+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:23:27.585779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":369,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743570+0000","last_change":"2024-08-19T00:09:43.445224+0000","last_active":"2024-08-19T00:13:18.743570+0000","last_peered":"2024-08-19T00:13:18.743570+0000","last_clean":"2024-08-19T00:13:18.743570+0000","last_became_active":"2024-08-19T00:09:43.444826+0000","last_became_peered":"2024-08-19T00:09:43.444826+0000","last_unstale":"2024-08-19T00:13:18.743570+0000","last_undegraded":"2024-08-19T00:13:18.743570+0000","last_fullsized":"2024-08-19T00:13:18.743570+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:06:42.707047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:06:42.707047+0000","last_clean_scrub_stamp":"2024-08-19T00:06:42.707047+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:37:10.588547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"92'1","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744441+0000","last_change":"2024-08-19T00:10:59.783987+0000","last_active":"2024-08-19T00:13:18.744441+0000","last_peered":"2024-08-19T00:13:18.744441+0000","last_clean":"2024-08-19T00:13:18.744441+0000","last_became_active":"2024-08-19T00:10:59.783569+0000","last_became_peered":"2024-08-19T00:10:59.783569+0000","last_unstale":"2024-08-19T00:13:18.744441+0000","last_undegraded":"2024-08-19T00:13:18.744441+0000","last_fullsized":"2024-08-19T00:13:18.744441+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:04:01.744644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"94'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744566+0000","last_change":"2024-08-19T00:10:52.516201+0000","last_active":"2024-08-19T00:13:18.744566+0000","last_peered":"2024-08-19T00:13:18.744566+0000","last_clean":"2024-08-19T00:13:18.744566+0000","last_became_active":"2024-08-19T00:10:52.515871+0000","last_became_peered":"2024-08-19T00:10:52.515871+0000","last_unstale":"2024-08-19T00:13:18.744566+0000","last_undegraded":"2024-08-19T00:13:18.744566+0000","last_fullsized":"2024-08-19T00:13:18.744566+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:54:49.528215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"95'7","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:19.065451+0000","last_change":"2024-08-19T00:10:50.620185+0000","last_active":"2024-08-19T00:13:19.065451+0000","last_peered":"2024-08-19T00:13:19.065451+0000","last_clean":"2024-08-19T00:13:19.065451+0000","last_became_active":"2024-08-19T00:10:50.619858+0000","last_became_peered":"2024-08-19T00:10:50.619858+0000","last_unstale":"2024-08-19T00:13:19.065451+0000","last_undegraded":"2024-08-19T00:13:19.065451+0000","last_fullsized":"2024-08-19T00:13:19.065451+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:30:21.893859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1950,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":3,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743313+0000","last_change":"2024-08-19T00:10:59.782056+0000","last_active":"2024-08-19T00:13:18.743313+0000","last_peered":"2024-08-19T00:13:18.743313+0000","last_clean":"2024-08-19T00:13:18.743313+0000","last_became_active":"2024-08-19T00:10:59.781666+0000","last_became_peered":"2024-08-19T00:10:59.781666+0000","last_unstale":"2024-08-19T00:13:18.743313+0000","last_undegraded":"2024-08-19T00:13:18.743313+0000","last_fullsized":"2024-08-19T00:13:18.743313+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:06:15.614372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"94'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744343+0000","last_change":"2024-08-19T00:10:52.523346+0000","last_active":"2024-08-19T00:13:18.744343+0000","last_peered":"2024-08-19T00:13:18.744343+0000","last_clean":"2024-08-19T00:13:18.744343+0000","last_became_active":"2024-08-19T00:10:52.523020+0000","last_became_peered":"2024-08-19T00:10:52.523020+0000","last_unstale":"2024-08-19T00:13:18.744343+0000","last_undegraded":"2024-08-19T00:13:18.744343+0000","last_fullsized":"2024-08-19T00:13:18.744343+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:09:58.259666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"95'41","reported_seq":90,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.709251+0000","last_change":"2024-08-19T00:10:50.471739+0000","last_active":"2024-08-19T00:13:18.709251+0000","last_peered":"2024-08-19T00:13:18.709251+0000","last_clean":"2024-08-19T00:13:18.709251+0000","last_became_active":"2024-08-19T00:10:50.471425+0000","last_became_peered":"2024-08-19T00:10:50.471425+0000","last_unstale":"2024-08-19T00:13:18.709251+0000","last_undegraded":"2024-08-19T00:13:18.709251+0000","last_fullsized":"2024-08-19T00:13:18.709251+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:55:26.332380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743933+0000","last_change":"2024-08-19T00:10:59.788685+0000","last_active":"2024-08-19T00:13:18.743933+0000","last_peered":"2024-08-19T00:13:18.743933+0000","last_clean":"2024-08-19T00:13:18.743933+0000","last_became_active":"2024-08-19T00:10:59.788343+0000","last_became_peered":"2024-08-19T00:10:59.788343+0000","last_unstale":"2024-08-19T00:13:18.743933+0000","last_undegraded":"2024-08-19T00:13:18.743933+0000","last_fullsized":"2024-08-19T00:13:18.743933+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:20:59.595494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"94'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744559+0000","last_change":"2024-08-19T00:10:52.516469+0000","last_active":"2024-08-19T00:13:18.744559+0000","last_peered":"2024-08-19T00:13:18.744559+0000","last_clean":"2024-08-19T00:13:18.744559+0000","last_became_active":"2024-08-19T00:10:52.516093+0000","last_became_peered":"2024-08-19T00:10:52.516093+0000","last_unstale":"2024-08-19T00:13:18.744559+0000","last_undegraded":"2024-08-19T00:13:18.744559+0000","last_fullsized":"2024-08-19T00:13:18.744559+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:18:29.327336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"90'5","reported_seq":58,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744970+0000","last_change":"2024-08-19T00:11:39.921825+0000","last_active":"2024-08-19T00:13:18.744970+0000","last_peered":"2024-08-19T00:13:18.744970+0000","last_clean":"2024-08-19T00:13:18.744970+0000","last_became_active":"2024-08-19T00:11:39.917689+0000","last_became_peered":"2024-08-19T00:11:39.917689+0000","last_unstale":"2024-08-19T00:13:18.744970+0000","last_undegraded":"2024-08-19T00:13:18.744970+0000","last_fullsized":"2024-08-19T00:13:18.744970+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:37:47.940707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.608635+0000","last_change":"2024-08-19T00:10:59.785347+0000","last_active":"2024-08-19T00:13:18.608635+0000","last_peered":"2024-08-19T00:13:18.608635+0000","last_clean":"2024-08-19T00:13:18.608635+0000","last_became_active":"2024-08-19T00:10:59.784927+0000","last_became_peered":"2024-08-19T00:10:59.784927+0000","last_unstale":"2024-08-19T00:13:18.608635+0000","last_undegraded":"2024-08-19T00:13:18.608635+0000","last_fullsized":"2024-08-19T00:13:18.608635+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:39:41.919021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"94'5","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744842+0000","last_change":"2024-08-19T00:12:41.004215+0000","last_active":"2024-08-19T00:13:18.744842+0000","last_peered":"2024-08-19T00:13:18.744842+0000","last_clean":"2024-08-19T00:13:18.744842+0000","last_became_active":"2024-08-19T00:12:41.003770+0000","last_became_peered":"2024-08-19T00:12:41.003770+0000","last_unstale":"2024-08-19T00:13:18.744842+0000","last_undegraded":"2024-08-19T00:13:18.744842+0000","last_fullsized":"2024-08-19T00:13:18.744842+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:17:42.279811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"90'2","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.509422+0000","last_change":"2024-08-19T00:10:50.474977+0000","last_active":"2024-08-19T00:13:18.509422+0000","last_peered":"2024-08-19T00:13:18.509422+0000","last_clean":"2024-08-19T00:13:18.509422+0000","last_became_active":"2024-08-19T00:10:50.474653+0000","last_became_peered":"2024-08-19T00:10:50.474653+0000","last_unstale":"2024-08-19T00:13:18.509422+0000","last_undegraded":"2024-08-19T00:13:18.509422+0000","last_fullsized":"2024-08-19T00:13:18.509422+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:20:31.565098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.608795+0000","last_change":"2024-08-19T00:10:59.789912+0000","last_active":"2024-08-19T00:13:18.608795+0000","last_peered":"2024-08-19T00:13:18.608795+0000","last_clean":"2024-08-19T00:13:18.608795+0000","last_became_active":"2024-08-19T00:10:59.789143+0000","last_became_peered":"2024-08-19T00:10:59.789143+0000","last_unstale":"2024-08-19T00:13:18.608795+0000","last_undegraded":"2024-08-19T00:13:18.608795+0000","last_fullsized":"2024-08-19T00:13:18.608795+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:06:53.447173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"94'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.608953+0000","last_change":"2024-08-19T00:10:52.525061+0000","last_active":"2024-08-19T00:13:18.608953+0000","last_peered":"2024-08-19T00:13:18.608953+0000","last_clean":"2024-08-19T00:13:18.608953+0000","last_became_active":"2024-08-19T00:10:52.524752+0000","last_became_peered":"2024-08-19T00:10:52.524752+0000","last_unstale":"2024-08-19T00:13:18.608953+0000","last_undegraded":"2024-08-19T00:13:18.608953+0000","last_fullsized":"2024-08-19T00:13:18.608953+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:50:47.817220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"90'17","reported_seq":59,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.508845+0000","last_change":"2024-08-19T00:10:50.618923+0000","last_active":"2024-08-19T00:13:18.508845+0000","last_peered":"2024-08-19T00:13:18.508845+0000","last_clean":"2024-08-19T00:13:18.508845+0000","last_became_active":"2024-08-19T00:10:50.618586+0000","last_became_peered":"2024-08-19T00:10:50.618586+0000","last_unstale":"2024-08-19T00:13:18.508845+0000","last_undegraded":"2024-08-19T00:13:18.508845+0000","last_fullsized":"2024-08-19T00:13:18.508845+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:07:45.186059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744860+0000","last_change":"2024-08-19T00:10:59.785681+0000","last_active":"2024-08-19T00:13:18.744860+0000","last_peered":"2024-08-19T00:13:18.744860+0000","last_clean":"2024-08-19T00:13:18.744860+0000","last_became_active":"2024-08-19T00:10:59.785299+0000","last_became_peered":"2024-08-19T00:10:59.785299+0000","last_unstale":"2024-08-19T00:13:18.744860+0000","last_undegraded":"2024-08-19T00:13:18.744860+0000","last_fullsized":"2024-08-19T00:13:18.744860+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:36:08.151180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"94'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743809+0000","last_change":"2024-08-19T00:10:52.523398+0000","last_active":"2024-08-19T00:13:18.743809+0000","last_peered":"2024-08-19T00:13:18.743809+0000","last_clean":"2024-08-19T00:13:18.743809+0000","last_became_active":"2024-08-19T00:10:52.523066+0000","last_became_peered":"2024-08-19T00:10:52.523066+0000","last_unstale":"2024-08-19T00:13:18.743809+0000","last_undegraded":"2024-08-19T00:13:18.743809+0000","last_fullsized":"2024-08-19T00:13:18.743809+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:47:25.137487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"90'5","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.511735+0000","last_change":"2024-08-19T00:10:50.475827+0000","last_active":"2024-08-19T00:13:18.511735+0000","last_peered":"2024-08-19T00:13:18.511735+0000","last_clean":"2024-08-19T00:13:18.511735+0000","last_became_active":"2024-08-19T00:10:50.475470+0000","last_became_peered":"2024-08-19T00:10:50.475470+0000","last_unstale":"2024-08-19T00:13:18.511735+0000","last_undegraded":"2024-08-19T00:13:18.511735+0000","last_fullsized":"2024-08-19T00:13:18.511735+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:25:14.200317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.599896+0000","last_change":"2024-08-19T00:10:59.789047+0000","last_active":"2024-08-19T00:13:18.599896+0000","last_peered":"2024-08-19T00:13:18.599896+0000","last_clean":"2024-08-19T00:13:18.599896+0000","last_became_active":"2024-08-19T00:10:59.788694+0000","last_became_peered":"2024-08-19T00:10:59.788694+0000","last_unstale":"2024-08-19T00:13:18.599896+0000","last_undegraded":"2024-08-19T00:13:18.599896+0000","last_fullsized":"2024-08-19T00:13:18.599896+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:00:22.463593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"94'15","reported_seq":51,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744056+0000","last_change":"2024-08-19T00:10:52.511480+0000","last_active":"2024-08-19T00:13:18.744056+0000","last_peered":"2024-08-19T00:13:18.744056+0000","last_clean":"2024-08-19T00:13:18.744056+0000","last_became_active":"2024-08-19T00:10:52.511159+0000","last_became_peered":"2024-08-19T00:10:52.511159+0000","last_unstale":"2024-08-19T00:13:18.744056+0000","last_undegraded":"2024-08-19T00:13:18.744056+0000","last_fullsized":"2024-08-19T00:13:18.744056+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:28:31.136900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"90'5","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.608926+0000","last_change":"2024-08-19T00:10:50.476761+0000","last_active":"2024-08-19T00:13:18.608926+0000","last_peered":"2024-08-19T00:13:18.608926+0000","last_clean":"2024-08-19T00:13:18.608926+0000","last_became_active":"2024-08-19T00:10:50.476455+0000","last_became_peered":"2024-08-19T00:10:50.476455+0000","last_unstale":"2024-08-19T00:13:18.608926+0000","last_undegraded":"2024-08-19T00:13:18.608926+0000","last_fullsized":"2024-08-19T00:13:18.608926+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:34:52.158438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743981+0000","last_change":"2024-08-19T00:10:59.778313+0000","last_active":"2024-08-19T00:13:18.743981+0000","last_peered":"2024-08-19T00:13:18.743981+0000","last_clean":"2024-08-19T00:13:18.743981+0000","last_became_active":"2024-08-19T00:10:59.777831+0000","last_became_peered":"2024-08-19T00:10:59.777831+0000","last_unstale":"2024-08-19T00:13:18.743981+0000","last_undegraded":"2024-08-19T00:13:18.743981+0000","last_fullsized":"2024-08-19T00:13:18.743981+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:34:05.474277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"94'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743606+0000","last_change":"2024-08-19T00:10:52.513719+0000","last_active":"2024-08-19T00:13:18.743606+0000","last_peered":"2024-08-19T00:13:18.743606+0000","last_clean":"2024-08-19T00:13:18.743606+0000","last_became_active":"2024-08-19T00:10:52.513345+0000","last_became_peered":"2024-08-19T00:10:52.513345+0000","last_unstale":"2024-08-19T00:13:18.743606+0000","last_undegraded":"2024-08-19T00:13:18.743606+0000","last_fullsized":"2024-08-19T00:13:18.743606+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:50:28.862870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"90'9","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744336+0000","last_change":"2024-08-19T00:10:50.475529+0000","last_active":"2024-08-19T00:13:18.744336+0000","last_peered":"2024-08-19T00:13:18.744336+0000","last_clean":"2024-08-19T00:13:18.744336+0000","last_became_active":"2024-08-19T00:10:50.473544+0000","last_became_peered":"2024-08-19T00:10:50.473544+0000","last_unstale":"2024-08-19T00:13:18.744336+0000","last_undegraded":"2024-08-19T00:13:18.744336+0000","last_fullsized":"2024-08-19T00:13:18.744336+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:49:42.663650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.609068+0000","last_change":"2024-08-19T00:10:59.789028+0000","last_active":"2024-08-19T00:13:18.609068+0000","last_peered":"2024-08-19T00:13:18.609068+0000","last_clean":"2024-08-19T00:13:18.609068+0000","last_became_active":"2024-08-19T00:10:59.788606+0000","last_became_peered":"2024-08-19T00:10:59.788606+0000","last_unstale":"2024-08-19T00:13:18.609068+0000","last_undegraded":"2024-08-19T00:13:18.609068+0000","last_fullsized":"2024-08-19T00:13:18.609068+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:59:06.617755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"94'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.509199+0000","last_change":"2024-08-19T00:10:52.520826+0000","last_active":"2024-08-19T00:13:18.509199+0000","last_peered":"2024-08-19T00:13:18.509199+0000","last_clean":"2024-08-19T00:13:18.509199+0000","last_became_active":"2024-08-19T00:10:52.520437+0000","last_became_peered":"2024-08-19T00:10:52.520437+0000","last_unstale":"2024-08-19T00:13:18.509199+0000","last_undegraded":"2024-08-19T00:13:18.509199+0000","last_fullsized":"2024-08-19T00:13:18.509199+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:30:06.843697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"95'41","reported_seq":300,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:19.087442+0000","last_change":"2024-08-19T00:10:50.473195+0000","last_active":"2024-08-19T00:13:19.087442+0000","last_peered":"2024-08-19T00:13:19.087442+0000","last_clean":"2024-08-19T00:13:19.087442+0000","last_became_active":"2024-08-19T00:10:50.472863+0000","last_became_peered":"2024-08-19T00:10:50.472863+0000","last_unstale":"2024-08-19T00:13:19.087442+0000","last_undegraded":"2024-08-19T00:13:19.087442+0000","last_fullsized":"2024-08-19T00:13:19.087442+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:09:04.859829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69793,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":218,"num_read_kb":177,"num_write":43,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.611579+0000","last_change":"2024-08-19T00:11:39.922405+0000","last_active":"2024-08-19T00:13:18.611579+0000","last_peered":"2024-08-19T00:13:18.611579+0000","last_clean":"2024-08-19T00:13:18.611579+0000","last_became_active":"2024-08-19T00:11:39.922054+0000","last_became_peered":"2024-08-19T00:11:39.922054+0000","last_unstale":"2024-08-19T00:13:18.611579+0000","last_undegraded":"2024-08-19T00:13:18.611579+0000","last_fullsized":"2024-08-19T00:13:18.611579+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:47:01.990229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.14","version":"94'11","reported_seq":53,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743816+0000","last_change":"2024-08-19T00:11:39.918080+0000","last_active":"2024-08-19T00:13:18.743816+0000","last_peered":"2024-08-19T00:13:18.743816+0000","last_clean":"2024-08-19T00:13:18.743816+0000","last_became_active":"2024-08-19T00:11:39.917742+0000","last_became_peered":"2024-08-19T00:11:39.917742+0000","last_unstale":"2024-08-19T00:13:18.743816+0000","last_undegraded":"2024-08-19T00:13:18.743816+0000","last_fullsized":"2024-08-19T00:13:18.743816+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:57:19.983148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"90'5","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.609345+0000","last_change":"2024-08-19T00:10:50.618094+0000","last_active":"2024-08-19T00:13:18.609345+0000","last_peered":"2024-08-19T00:13:18.609345+0000","last_clean":"2024-08-19T00:13:18.609345+0000","last_became_active":"2024-08-19T00:10:50.617786+0000","last_became_peered":"2024-08-19T00:10:50.617786+0000","last_unstale":"2024-08-19T00:13:18.609345+0000","last_undegraded":"2024-08-19T00:13:18.609345+0000","last_fullsized":"2024-08-19T00:13:18.609345+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:05:46.231214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.511811+0000","last_change":"2024-08-19T00:10:59.780786+0000","last_active":"2024-08-19T00:13:18.511811+0000","last_peered":"2024-08-19T00:13:18.511811+0000","last_clean":"2024-08-19T00:13:18.511811+0000","last_became_active":"2024-08-19T00:10:59.780364+0000","last_became_peered":"2024-08-19T00:10:59.780364+0000","last_unstale":"2024-08-19T00:13:18.511811+0000","last_undegraded":"2024-08-19T00:13:18.511811+0000","last_fullsized":"2024-08-19T00:13:18.511811+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:39:45.113590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"94'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.745242+0000","last_change":"2024-08-19T00:10:52.520623+0000","last_active":"2024-08-19T00:13:18.745242+0000","last_peered":"2024-08-19T00:13:18.745242+0000","last_clean":"2024-08-19T00:13:18.745242+0000","last_became_active":"2024-08-19T00:10:52.520321+0000","last_became_peered":"2024-08-19T00:10:52.520321+0000","last_unstale":"2024-08-19T00:13:18.745242+0000","last_undegraded":"2024-08-19T00:13:18.745242+0000","last_fullsized":"2024-08-19T00:13:18.745242+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:56:42.526199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"90'4","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744494+0000","last_change":"2024-08-19T00:10:50.474925+0000","last_active":"2024-08-19T00:13:18.744494+0000","last_peered":"2024-08-19T00:13:18.744494+0000","last_clean":"2024-08-19T00:13:18.744494+0000","last_became_active":"2024-08-19T00:10:50.474573+0000","last_became_peered":"2024-08-19T00:10:50.474573+0000","last_unstale":"2024-08-19T00:13:18.744494+0000","last_undegraded":"2024-08-19T00:13:18.744494+0000","last_fullsized":"2024-08-19T00:13:18.744494+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:10:32.136867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.508672+0000","last_change":"2024-08-19T00:11:39.920527+0000","last_active":"2024-08-19T00:13:18.508672+0000","last_peered":"2024-08-19T00:13:18.508672+0000","last_clean":"2024-08-19T00:13:18.508672+0000","last_became_active":"2024-08-19T00:11:39.919490+0000","last_became_peered":"2024-08-19T00:11:39.919490+0000","last_unstale":"2024-08-19T00:13:18.508672+0000","last_undegraded":"2024-08-19T00:13:18.508672+0000","last_fullsized":"2024-08-19T00:13:18.508672+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:33:09.191177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"94'10","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743676+0000","last_change":"2024-08-19T00:10:52.510783+0000","last_active":"2024-08-19T00:13:18.743676+0000","last_peered":"2024-08-19T00:13:18.743676+0000","last_clean":"2024-08-19T00:13:18.743676+0000","last_became_active":"2024-08-19T00:10:52.510359+0000","last_became_peered":"2024-08-19T00:10:52.510359+0000","last_unstale":"2024-08-19T00:13:18.743676+0000","last_undegraded":"2024-08-19T00:13:18.743676+0000","last_fullsized":"2024-08-19T00:13:18.743676+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:20:03.682633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"95'6","reported_seq":253,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:19.065004+0000","last_change":"2024-08-19T00:10:50.470887+0000","last_active":"2024-08-19T00:13:19.065004+0000","last_peered":"2024-08-19T00:13:19.065004+0000","last_clean":"2024-08-19T00:13:19.065004+0000","last_became_active":"2024-08-19T00:10:50.470517+0000","last_became_peered":"2024-08-19T00:10:50.470517+0000","last_unstale":"2024-08-19T00:13:19.065004+0000","last_undegraded":"2024-08-19T00:13:19.065004+0000","last_fullsized":"2024-08-19T00:13:19.065004+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:52:33.864552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":206,"num_read_kb":206,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.507670+0000","last_change":"2024-08-19T00:10:59.787686+0000","last_active":"2024-08-19T00:13:18.507670+0000","last_peered":"2024-08-19T00:13:18.507670+0000","last_clean":"2024-08-19T00:13:18.507670+0000","last_became_active":"2024-08-19T00:10:59.787236+0000","last_became_peered":"2024-08-19T00:10:59.787236+0000","last_unstale":"2024-08-19T00:13:18.507670+0000","last_undegraded":"2024-08-19T00:13:18.507670+0000","last_fullsized":"2024-08-19T00:13:18.507670+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:57:11.012865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743827+0000","last_change":"2024-08-19T00:10:59.782541+0000","last_active":"2024-08-19T00:13:18.743827+0000","last_peered":"2024-08-19T00:13:18.743827+0000","last_clean":"2024-08-19T00:13:18.743827+0000","last_became_active":"2024-08-19T00:10:59.782136+0000","last_became_peered":"2024-08-19T00:10:59.782136+0000","last_unstale":"2024-08-19T00:13:18.743827+0000","last_undegraded":"2024-08-19T00:13:18.743827+0000","last_fullsized":"2024-08-19T00:13:18.743827+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:44:39.501168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"94'11","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.598488+0000","last_change":"2024-08-19T00:10:52.509396+0000","last_active":"2024-08-19T00:13:18.598488+0000","last_peered":"2024-08-19T00:13:18.598488+0000","last_clean":"2024-08-19T00:13:18.598488+0000","last_became_active":"2024-08-19T00:10:52.509075+0000","last_became_peered":"2024-08-19T00:10:52.509075+0000","last_unstale":"2024-08-19T00:13:18.598488+0000","last_undegraded":"2024-08-19T00:13:18.598488+0000","last_fullsized":"2024-08-19T00:13:18.598488+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:40:53.611213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"90'3","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.609141+0000","last_change":"2024-08-19T00:10:50.476723+0000","last_active":"2024-08-19T00:13:18.609141+0000","last_peered":"2024-08-19T00:13:18.609141+0000","last_clean":"2024-08-19T00:13:18.609141+0000","last_became_active":"2024-08-19T00:10:50.476399+0000","last_became_peered":"2024-08-19T00:10:50.476399+0000","last_unstale":"2024-08-19T00:13:18.609141+0000","last_undegraded":"2024-08-19T00:13:18.609141+0000","last_fullsized":"2024-08-19T00:13:18.609141+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:04:01.951387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744326+0000","last_change":"2024-08-19T00:10:59.781481+0000","last_active":"2024-08-19T00:13:18.744326+0000","last_peered":"2024-08-19T00:13:18.744326+0000","last_clean":"2024-08-19T00:13:18.744326+0000","last_became_active":"2024-08-19T00:10:59.780160+0000","last_became_peered":"2024-08-19T00:10:59.780160+0000","last_unstale":"2024-08-19T00:13:18.744326+0000","last_undegraded":"2024-08-19T00:13:18.744326+0000","last_fullsized":"2024-08-19T00:13:18.744326+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:14:46.340158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"94'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.507696+0000","last_change":"2024-08-19T00:10:52.516780+0000","last_active":"2024-08-19T00:13:18.507696+0000","last_peered":"2024-08-19T00:13:18.507696+0000","last_clean":"2024-08-19T00:13:18.507696+0000","last_became_active":"2024-08-19T00:10:52.513264+0000","last_became_peered":"2024-08-19T00:10:52.513264+0000","last_unstale":"2024-08-19T00:13:18.507696+0000","last_undegraded":"2024-08-19T00:13:18.507696+0000","last_fullsized":"2024-08-19T00:13:18.507696+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:36:49.238267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"90'3","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743315+0000","last_change":"2024-08-19T00:10:50.472840+0000","last_active":"2024-08-19T00:13:18.743315+0000","last_peered":"2024-08-19T00:13:18.743315+0000","last_clean":"2024-08-19T00:13:18.743315+0000","last_became_active":"2024-08-19T00:10:50.472534+0000","last_became_peered":"2024-08-19T00:10:50.472534+0000","last_unstale":"2024-08-19T00:13:18.743315+0000","last_undegraded":"2024-08-19T00:13:18.743315+0000","last_fullsized":"2024-08-19T00:13:18.743315+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:41:53.505360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"90'7","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.611874+0000","last_change":"2024-08-19T00:10:50.469342+0000","last_active":"2024-08-19T00:13:18.611874+0000","last_peered":"2024-08-19T00:13:18.611874+0000","last_clean":"2024-08-19T00:13:18.611874+0000","last_became_active":"2024-08-19T00:10:50.468800+0000","last_became_peered":"2024-08-19T00:10:50.468800+0000","last_unstale":"2024-08-19T00:13:18.611874+0000","last_undegraded":"2024-08-19T00:13:18.611874+0000","last_fullsized":"2024-08-19T00:13:18.611874+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:58:28.804117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"94'8","reported_seq":49,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.609074+0000","last_change":"2024-08-19T00:12:41.003498+0000","last_active":"2024-08-19T00:13:18.609074+0000","last_peered":"2024-08-19T00:13:18.609074+0000","last_clean":"2024-08-19T00:13:18.609074+0000","last_became_active":"2024-08-19T00:12:41.003165+0000","last_became_peered":"2024-08-19T00:12:41.003165+0000","last_unstale":"2024-08-19T00:13:18.609074+0000","last_undegraded":"2024-08-19T00:13:18.609074+0000","last_fullsized":"2024-08-19T00:13:18.609074+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:17:46.977154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744443+0000","last_change":"2024-08-19T00:11:39.922401+0000","last_active":"2024-08-19T00:13:18.744443+0000","last_peered":"2024-08-19T00:13:18.744443+0000","last_clean":"2024-08-19T00:13:18.744443+0000","last_became_active":"2024-08-19T00:11:39.921979+0000","last_became_peered":"2024-08-19T00:11:39.921979+0000","last_unstale":"2024-08-19T00:13:18.744443+0000","last_undegraded":"2024-08-19T00:13:18.744443+0000","last_fullsized":"2024-08-19T00:13:18.744443+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:58:57.453222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,8],"acting":[2,6,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"95'6","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:19.065950+0000","last_change":"2024-08-19T00:10:50.476035+0000","last_active":"2024-08-19T00:13:19.065950+0000","last_peered":"2024-08-19T00:13:19.065950+0000","last_clean":"2024-08-19T00:13:19.065950+0000","last_became_active":"2024-08-19T00:10:50.475733+0000","last_became_peered":"2024-08-19T00:10:50.475733+0000","last_unstale":"2024-08-19T00:13:19.065950+0000","last_undegraded":"2024-08-19T00:13:19.065950+0000","last_fullsized":"2024-08-19T00:13:19.065950+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:27:59.026582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1012,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"94'7","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.508894+0000","last_change":"2024-08-19T00:10:52.522185+0000","last_active":"2024-08-19T00:13:18.508894+0000","last_peered":"2024-08-19T00:13:18.508894+0000","last_clean":"2024-08-19T00:13:18.508894+0000","last_became_active":"2024-08-19T00:10:52.521747+0000","last_became_peered":"2024-08-19T00:10:52.521747+0000","last_unstale":"2024-08-19T00:13:18.508894+0000","last_undegraded":"2024-08-19T00:13:18.508894+0000","last_fullsized":"2024-08-19T00:13:18.508894+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:14:23.631484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744081+0000","last_change":"2024-08-19T00:10:59.783512+0000","last_active":"2024-08-19T00:13:18.744081+0000","last_peered":"2024-08-19T00:13:18.744081+0000","last_clean":"2024-08-19T00:13:18.744081+0000","last_became_active":"2024-08-19T00:10:59.783099+0000","last_became_peered":"2024-08-19T00:10:59.783099+0000","last_unstale":"2024-08-19T00:13:18.744081+0000","last_undegraded":"2024-08-19T00:13:18.744081+0000","last_fullsized":"2024-08-19T00:13:18.744081+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:02:27.977608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"94'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743805+0000","last_change":"2024-08-19T00:10:52.524213+0000","last_active":"2024-08-19T00:13:18.743805+0000","last_peered":"2024-08-19T00:13:18.743805+0000","last_clean":"2024-08-19T00:13:18.743805+0000","last_became_active":"2024-08-19T00:10:52.523185+0000","last_became_peered":"2024-08-19T00:10:52.523185+0000","last_unstale":"2024-08-19T00:13:18.743805+0000","last_undegraded":"2024-08-19T00:13:18.743805+0000","last_fullsized":"2024-08-19T00:13:18.743805+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:23:48.569312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"94'12","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744418+0000","last_change":"2024-08-19T00:10:52.521436+0000","last_active":"2024-08-19T00:13:18.744418+0000","last_peered":"2024-08-19T00:13:18.744418+0000","last_clean":"2024-08-19T00:13:18.744418+0000","last_became_active":"2024-08-19T00:10:52.520842+0000","last_became_peered":"2024-08-19T00:10:52.520842+0000","last_unstale":"2024-08-19T00:13:18.744418+0000","last_undegraded":"2024-08-19T00:13:18.744418+0000","last_fullsized":"2024-08-19T00:13:18.744418+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:22:31.568680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"94'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743973+0000","last_change":"2024-08-19T00:10:52.514170+0000","last_active":"2024-08-19T00:13:18.743973+0000","last_peered":"2024-08-19T00:13:18.743973+0000","last_clean":"2024-08-19T00:13:18.743973+0000","last_became_active":"2024-08-19T00:10:52.513870+0000","last_became_peered":"2024-08-19T00:10:52.513870+0000","last_unstale":"2024-08-19T00:13:18.743973+0000","last_undegraded":"2024-08-19T00:13:18.743973+0000","last_fullsized":"2024-08-19T00:13:18.743973+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:29:04.125347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"94'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743995+0000","last_change":"2024-08-19T00:10:52.512320+0000","last_active":"2024-08-19T00:13:18.743995+0000","last_peered":"2024-08-19T00:13:18.743995+0000","last_clean":"2024-08-19T00:13:18.743995+0000","last_became_active":"2024-08-19T00:10:52.512003+0000","last_became_peered":"2024-08-19T00:10:52.512003+0000","last_unstale":"2024-08-19T00:13:18.743995+0000","last_undegraded":"2024-08-19T00:13:18.743995+0000","last_fullsized":"2024-08-19T00:13:18.743995+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:28:52.261457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"94'4","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744707+0000","last_change":"2024-08-19T00:10:52.511454+0000","last_active":"2024-08-19T00:13:18.744707+0000","last_peered":"2024-08-19T00:13:18.744707+0000","last_clean":"2024-08-19T00:13:18.744707+0000","last_became_active":"2024-08-19T00:10:52.511036+0000","last_became_peered":"2024-08-19T00:10:52.511036+0000","last_unstale":"2024-08-19T00:13:18.744707+0000","last_undegraded":"2024-08-19T00:13:18.744707+0000","last_fullsized":"2024-08-19T00:13:18.744707+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:14:04.749222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"94'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744667+0000","last_change":"2024-08-19T00:10:52.526393+0000","last_active":"2024-08-19T00:13:18.744667+0000","last_peered":"2024-08-19T00:13:18.744667+0000","last_clean":"2024-08-19T00:13:18.744667+0000","last_became_active":"2024-08-19T00:10:52.526043+0000","last_became_peered":"2024-08-19T00:10:52.526043+0000","last_unstale":"2024-08-19T00:13:18.744667+0000","last_undegraded":"2024-08-19T00:13:18.744667+0000","last_fullsized":"2024-08-19T00:13:18.744667+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:18:48.505255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"94'15","reported_seq":51,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744575+0000","last_change":"2024-08-19T00:10:52.516028+0000","last_active":"2024-08-19T00:13:18.744575+0000","last_peered":"2024-08-19T00:13:18.744575+0000","last_clean":"2024-08-19T00:13:18.744575+0000","last_became_active":"2024-08-19T00:10:52.515659+0000","last_became_peered":"2024-08-19T00:10:52.515659+0000","last_unstale":"2024-08-19T00:13:18.744575+0000","last_undegraded":"2024-08-19T00:13:18.744575+0000","last_fullsized":"2024-08-19T00:13:18.744575+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:31:14.995175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"94'2","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.509366+0000","last_change":"2024-08-19T00:10:52.516196+0000","last_active":"2024-08-19T00:13:18.509366+0000","last_peered":"2024-08-19T00:13:18.509366+0000","last_clean":"2024-08-19T00:13:18.509366+0000","last_became_active":"2024-08-19T00:10:52.515533+0000","last_became_peered":"2024-08-19T00:10:52.515533+0000","last_unstale":"2024-08-19T00:13:18.509366+0000","last_undegraded":"2024-08-19T00:13:18.509366+0000","last_fullsized":"2024-08-19T00:13:18.509366+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:32:25.207184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"94'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.608755+0000","last_change":"2024-08-19T00:10:52.527433+0000","last_active":"2024-08-19T00:13:18.608755+0000","last_peered":"2024-08-19T00:13:18.608755+0000","last_clean":"2024-08-19T00:13:18.608755+0000","last_became_active":"2024-08-19T00:10:52.525490+0000","last_became_peered":"2024-08-19T00:10:52.525490+0000","last_unstale":"2024-08-19T00:13:18.608755+0000","last_undegraded":"2024-08-19T00:13:18.608755+0000","last_fullsized":"2024-08-19T00:13:18.608755+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:21:14.545808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"94'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.507749+0000","last_change":"2024-08-19T00:10:52.515503+0000","last_active":"2024-08-19T00:13:18.507749+0000","last_peered":"2024-08-19T00:13:18.507749+0000","last_clean":"2024-08-19T00:13:18.507749+0000","last_became_active":"2024-08-19T00:10:52.515178+0000","last_became_peered":"2024-08-19T00:10:52.515178+0000","last_unstale":"2024-08-19T00:13:18.507749+0000","last_undegraded":"2024-08-19T00:13:18.507749+0000","last_fullsized":"2024-08-19T00:13:18.507749+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:30:27.825463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"94'10","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743607+0000","last_change":"2024-08-19T00:10:52.515133+0000","last_active":"2024-08-19T00:13:18.743607+0000","last_peered":"2024-08-19T00:13:18.743607+0000","last_clean":"2024-08-19T00:13:18.743607+0000","last_became_active":"2024-08-19T00:10:52.514851+0000","last_became_peered":"2024-08-19T00:10:52.514851+0000","last_unstale":"2024-08-19T00:13:18.743607+0000","last_undegraded":"2024-08-19T00:13:18.743607+0000","last_fullsized":"2024-08-19T00:13:18.743607+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:38:53.593993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"94'11","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744148+0000","last_change":"2024-08-19T00:10:52.512127+0000","last_active":"2024-08-19T00:13:18.744148+0000","last_peered":"2024-08-19T00:13:18.744148+0000","last_clean":"2024-08-19T00:13:18.744148+0000","last_became_active":"2024-08-19T00:10:52.511840+0000","last_became_peered":"2024-08-19T00:10:52.511840+0000","last_unstale":"2024-08-19T00:13:18.744148+0000","last_undegraded":"2024-08-19T00:13:18.744148+0000","last_fullsized":"2024-08-19T00:13:18.744148+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:36:32.878531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"94'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744083+0000","last_change":"2024-08-19T00:10:52.519470+0000","last_active":"2024-08-19T00:13:18.744083+0000","last_peered":"2024-08-19T00:13:18.744083+0000","last_clean":"2024-08-19T00:13:18.744083+0000","last_became_active":"2024-08-19T00:10:52.519131+0000","last_became_peered":"2024-08-19T00:10:52.519131+0000","last_unstale":"2024-08-19T00:13:18.744083+0000","last_undegraded":"2024-08-19T00:13:18.744083+0000","last_fullsized":"2024-08-19T00:13:18.744083+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:56:53.628868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"94'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744233+0000","last_change":"2024-08-19T00:10:52.511114+0000","last_active":"2024-08-19T00:13:18.744233+0000","last_peered":"2024-08-19T00:13:18.744233+0000","last_clean":"2024-08-19T00:13:18.744233+0000","last_became_active":"2024-08-19T00:10:52.510759+0000","last_became_peered":"2024-08-19T00:10:52.510759+0000","last_unstale":"2024-08-19T00:13:18.744233+0000","last_undegraded":"2024-08-19T00:13:18.744233+0000","last_fullsized":"2024-08-19T00:13:18.744233+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:54:10.590297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"94'10","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.600061+0000","last_change":"2024-08-19T00:10:52.507998+0000","last_active":"2024-08-19T00:13:18.600061+0000","last_peered":"2024-08-19T00:13:18.600061+0000","last_clean":"2024-08-19T00:13:18.600061+0000","last_became_active":"2024-08-19T00:10:52.507679+0000","last_became_peered":"2024-08-19T00:10:52.507679+0000","last_unstale":"2024-08-19T00:13:18.600061+0000","last_undegraded":"2024-08-19T00:13:18.600061+0000","last_fullsized":"2024-08-19T00:13:18.600061+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:59:48.098911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"94'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744812+0000","last_change":"2024-08-19T00:10:52.524171+0000","last_active":"2024-08-19T00:13:18.744812+0000","last_peered":"2024-08-19T00:13:18.744812+0000","last_clean":"2024-08-19T00:13:18.744812+0000","last_became_active":"2024-08-19T00:10:52.523028+0000","last_became_peered":"2024-08-19T00:10:52.523028+0000","last_unstale":"2024-08-19T00:13:18.744812+0000","last_undegraded":"2024-08-19T00:13:18.744812+0000","last_fullsized":"2024-08-19T00:13:18.744812+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:51:24.567971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"94'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743295+0000","last_change":"2024-08-19T00:10:52.514309+0000","last_active":"2024-08-19T00:13:18.743295+0000","last_peered":"2024-08-19T00:13:18.743295+0000","last_clean":"2024-08-19T00:13:18.743295+0000","last_became_active":"2024-08-19T00:10:52.513992+0000","last_became_peered":"2024-08-19T00:10:52.513992+0000","last_unstale":"2024-08-19T00:13:18.743295+0000","last_undegraded":"2024-08-19T00:13:18.743295+0000","last_fullsized":"2024-08-19T00:13:18.743295+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:34:14.014490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"94'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743785+0000","last_change":"2024-08-19T00:10:52.516033+0000","last_active":"2024-08-19T00:13:18.743785+0000","last_peered":"2024-08-19T00:13:18.743785+0000","last_clean":"2024-08-19T00:13:18.743785+0000","last_became_active":"2024-08-19T00:10:52.515713+0000","last_became_peered":"2024-08-19T00:10:52.515713+0000","last_unstale":"2024-08-19T00:13:18.743785+0000","last_undegraded":"2024-08-19T00:13:18.743785+0000","last_fullsized":"2024-08-19T00:13:18.743785+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:06:40.832460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"94'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743710+0000","last_change":"2024-08-19T00:10:52.518521+0000","last_active":"2024-08-19T00:13:18.743710+0000","last_peered":"2024-08-19T00:13:18.743710+0000","last_clean":"2024-08-19T00:13:18.743710+0000","last_became_active":"2024-08-19T00:10:52.518237+0000","last_became_peered":"2024-08-19T00:10:52.518237+0000","last_unstale":"2024-08-19T00:13:18.743710+0000","last_undegraded":"2024-08-19T00:13:18.743710+0000","last_fullsized":"2024-08-19T00:13:18.743710+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:17:20.569044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"94'10","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744044+0000","last_change":"2024-08-19T00:10:52.519774+0000","last_active":"2024-08-19T00:13:18.744044+0000","last_peered":"2024-08-19T00:13:18.744044+0000","last_clean":"2024-08-19T00:13:18.744044+0000","last_became_active":"2024-08-19T00:10:52.519456+0000","last_became_peered":"2024-08-19T00:10:52.519456+0000","last_unstale":"2024-08-19T00:13:18.744044+0000","last_undegraded":"2024-08-19T00:13:18.744044+0000","last_fullsized":"2024-08-19T00:13:18.744044+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:47:52.675650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"94'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.512063+0000","last_change":"2024-08-19T00:10:52.514200+0000","last_active":"2024-08-19T00:13:18.512063+0000","last_peered":"2024-08-19T00:13:18.512063+0000","last_clean":"2024-08-19T00:13:18.512063+0000","last_became_active":"2024-08-19T00:10:52.513821+0000","last_became_peered":"2024-08-19T00:10:52.513821+0000","last_unstale":"2024-08-19T00:13:18.512063+0000","last_undegraded":"2024-08-19T00:13:18.512063+0000","last_fullsized":"2024-08-19T00:13:18.512063+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:15:30.084873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"94'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744616+0000","last_change":"2024-08-19T00:10:52.519781+0000","last_active":"2024-08-19T00:13:18.744616+0000","last_peered":"2024-08-19T00:13:18.744616+0000","last_clean":"2024-08-19T00:13:18.744616+0000","last_became_active":"2024-08-19T00:10:52.519395+0000","last_became_peered":"2024-08-19T00:10:52.519395+0000","last_unstale":"2024-08-19T00:13:18.744616+0000","last_undegraded":"2024-08-19T00:13:18.744616+0000","last_fullsized":"2024-08-19T00:13:18.744616+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:10:15.160535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"94'16","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.612076+0000","last_change":"2024-08-19T00:10:52.510293+0000","last_active":"2024-08-19T00:13:18.612076+0000","last_peered":"2024-08-19T00:13:18.612076+0000","last_clean":"2024-08-19T00:13:18.612076+0000","last_became_active":"2024-08-19T00:10:52.509983+0000","last_became_peered":"2024-08-19T00:10:52.509983+0000","last_unstale":"2024-08-19T00:13:18.612076+0000","last_undegraded":"2024-08-19T00:13:18.612076+0000","last_fullsized":"2024-08-19T00:13:18.612076+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:59:11.488742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"94'11","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743853+0000","last_change":"2024-08-19T00:10:52.518778+0000","last_active":"2024-08-19T00:13:18.743853+0000","last_peered":"2024-08-19T00:13:18.743853+0000","last_clean":"2024-08-19T00:13:18.743853+0000","last_became_active":"2024-08-19T00:10:52.518209+0000","last_became_peered":"2024-08-19T00:10:52.518209+0000","last_unstale":"2024-08-19T00:13:18.743853+0000","last_undegraded":"2024-08-19T00:13:18.743853+0000","last_fullsized":"2024-08-19T00:13:18.743853+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:23:19.255833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"94'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.507723+0000","last_change":"2024-08-19T00:10:52.523824+0000","last_active":"2024-08-19T00:13:18.507723+0000","last_peered":"2024-08-19T00:13:18.507723+0000","last_clean":"2024-08-19T00:13:18.507723+0000","last_became_active":"2024-08-19T00:10:52.523075+0000","last_became_peered":"2024-08-19T00:10:52.523075+0000","last_unstale":"2024-08-19T00:13:18.507723+0000","last_undegraded":"2024-08-19T00:13:18.507723+0000","last_fullsized":"2024-08-19T00:13:18.507723+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:23:58.618712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"94'5","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743412+0000","last_change":"2024-08-19T00:10:52.523508+0000","last_active":"2024-08-19T00:13:18.743412+0000","last_peered":"2024-08-19T00:13:18.743412+0000","last_clean":"2024-08-19T00:13:18.743412+0000","last_became_active":"2024-08-19T00:10:52.523104+0000","last_became_peered":"2024-08-19T00:10:52.523104+0000","last_unstale":"2024-08-19T00:13:18.743412+0000","last_undegraded":"2024-08-19T00:13:18.743412+0000","last_fullsized":"2024-08-19T00:13:18.743412+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:04:06.932548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"94'6","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.611708+0000","last_change":"2024-08-19T00:10:52.510147+0000","last_active":"2024-08-19T00:13:18.611708+0000","last_peered":"2024-08-19T00:13:18.611708+0000","last_clean":"2024-08-19T00:13:18.611708+0000","last_became_active":"2024-08-19T00:10:52.509807+0000","last_became_peered":"2024-08-19T00:10:52.509807+0000","last_unstale":"2024-08-19T00:13:18.611708+0000","last_undegraded":"2024-08-19T00:13:18.611708+0000","last_fullsized":"2024-08-19T00:13:18.611708+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:09:55.965318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"94'4","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.509061+0000","last_change":"2024-08-19T00:10:52.512997+0000","last_active":"2024-08-19T00:13:18.509061+0000","last_peered":"2024-08-19T00:13:18.509061+0000","last_clean":"2024-08-19T00:13:18.509061+0000","last_became_active":"2024-08-19T00:10:52.512688+0000","last_became_peered":"2024-08-19T00:10:52.512688+0000","last_unstale":"2024-08-19T00:13:18.509061+0000","last_undegraded":"2024-08-19T00:13:18.509061+0000","last_fullsized":"2024-08-19T00:13:18.509061+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:57:33.607060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"94'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.512004+0000","last_change":"2024-08-19T00:10:52.517492+0000","last_active":"2024-08-19T00:13:18.512004+0000","last_peered":"2024-08-19T00:13:18.512004+0000","last_clean":"2024-08-19T00:13:18.512004+0000","last_became_active":"2024-08-19T00:10:52.517153+0000","last_became_peered":"2024-08-19T00:10:52.517153+0000","last_unstale":"2024-08-19T00:13:18.512004+0000","last_undegraded":"2024-08-19T00:13:18.512004+0000","last_fullsized":"2024-08-19T00:13:18.512004+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:07:07.244331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"94'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744527+0000","last_change":"2024-08-19T00:10:52.517396+0000","last_active":"2024-08-19T00:13:18.744527+0000","last_peered":"2024-08-19T00:13:18.744527+0000","last_clean":"2024-08-19T00:13:18.744527+0000","last_became_active":"2024-08-19T00:10:52.517108+0000","last_became_peered":"2024-08-19T00:10:52.517108+0000","last_unstale":"2024-08-19T00:13:18.744527+0000","last_undegraded":"2024-08-19T00:13:18.744527+0000","last_fullsized":"2024-08-19T00:13:18.744527+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:10:41.477770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"94'4","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743934+0000","last_change":"2024-08-19T00:10:52.515841+0000","last_active":"2024-08-19T00:13:18.743934+0000","last_peered":"2024-08-19T00:13:18.743934+0000","last_clean":"2024-08-19T00:13:18.743934+0000","last_became_active":"2024-08-19T00:10:52.515524+0000","last_became_peered":"2024-08-19T00:10:52.515524+0000","last_unstale":"2024-08-19T00:13:18.743934+0000","last_undegraded":"2024-08-19T00:13:18.743934+0000","last_fullsized":"2024-08-19T00:13:18.743934+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:18:51.991468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"94'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744654+0000","last_change":"2024-08-19T00:10:52.522670+0000","last_active":"2024-08-19T00:13:18.744654+0000","last_peered":"2024-08-19T00:13:18.744654+0000","last_clean":"2024-08-19T00:13:18.744654+0000","last_became_active":"2024-08-19T00:10:52.522275+0000","last_became_peered":"2024-08-19T00:10:52.522275+0000","last_unstale":"2024-08-19T00:13:18.744654+0000","last_undegraded":"2024-08-19T00:13:18.744654+0000","last_fullsized":"2024-08-19T00:13:18.744654+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:55:48.756230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":602981,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":1166,"num_read_kb":700,"num_write":376,"num_write_kb":1467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2174976,"data_stored":1808943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":302,"ondisk_log_size":302,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449131,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36428,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708724,"statfs":{"total":95995035648,"available":95957733376,"internally_reserved":0,"allocated":1114112,"data_stored":548434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":71,"seq":304942678062,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37292,"kb_used_data":1896,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93707860,"statfs":{"total":95995035648,"available":95956848640,"internally_reserved":0,"allocated":1941504,"data_stored":1335751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":65,"seq":279172874291,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28512,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716640,"statfs":{"total":95995035648,"available":95965839360,"internally_reserved":0,"allocated":1527808,"data_stored":944784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135927,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28496,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716656,"statfs":{"total":95995035648,"available":95965855744,"internally_reserved":0,"allocated":1511424,"data_stored":940954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397564,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37024,"kb_used_data":1684,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708128,"statfs":{"total":95995035648,"available":95957123072,"internally_reserved":0,"allocated":1724416,"data_stored":1145126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561089,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28100,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717052,"statfs":{"total":95995035648,"available":95966261248,"internally_reserved":0,"allocated":1105920,"data_stored":543756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822725,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37340,"kb_used_data":1824,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93707812,"statfs":{"total":95995035648,"available":95956799488,"internally_reserved":0,"allocated":1867776,"data_stored":1271138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986250,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36428,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708724,"statfs":{"total":95995035648,"available":95957733376,"internally_reserved":0,"allocated":1114112,"data_stored":547050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215182,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36944,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708208,"statfs":{"total":95995035648,"available":95957204992,"internally_reserved":0,"allocated":1646592,"data_stored":1067500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411410,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36508,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708644,"statfs":{"total":95995035648,"available":95957651456,"internally_reserved":0,"allocated":1200128,"data_stored":615189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28172,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716980,"statfs":{"total":95995035648,"available":95966187520,"internally_reserved":0,"allocated":1179648,"data_stored":614579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738459,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36444,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708708,"statfs":{"total":95995035648,"available":95957716992,"internally_reserved":0,"allocated":1130496,"data_stored":545212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":72325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":72935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":557056,"data_stored":525246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":134810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":394604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":394338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":258048,"data_stored":203129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-19T00:13:24.064 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph pg dump --format=json 2024-08-19T00:13:24.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:23 smithi171 ceph-mon[21810]: pgmap v5: 129 pgs: 129 active+clean; 1.1 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:13:24.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:23 smithi171 ceph-mon[21810]: mgrmap e24: x(active, since 4s), standbys: z, y 2024-08-19T00:13:24.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:23 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:13:24.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:23 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:13:24.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:23 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:13:24.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:23 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:13:24.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:23 smithi171 ceph-mon[21810]: from='client.15414 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-19T00:13:24.323 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:13:24.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:24.868+0000 7fa58c684640 1 -- 172.21.15.44:0/2345801007 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5841018b0 msgr2=0x7fa584101d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:24.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:24.868+0000 7fa58c684640 1 --2- 172.21.15.44:0/2345801007 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5841018b0 0x7fa584101d10 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fa574009930 tx=0x7fa57402a420 comp rx=0 tx=0).stop 2024-08-19T00:13:24.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:24.869+0000 7fa58c684640 1 -- 172.21.15.44:0/2345801007 shutdown_connections 2024-08-19T00:13:24.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:24.869+0000 7fa58c684640 1 --2- 172.21.15.44:0/2345801007 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa584102250 0x7fa58410e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:24.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:24.869+0000 7fa58c684640 1 --2- 172.21.15.44:0/2345801007 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5841018b0 0x7fa584101d10 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:24.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:24.869+0000 7fa58c684640 1 --2- 172.21.15.44:0/2345801007 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa5841078b0 0x7fa584107c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:24.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:24.869+0000 7fa58c684640 1 -- 172.21.15.44:0/2345801007 >> 172.21.15.44:0/2345801007 conn(0x7fa5840fd5f0 msgr2=0x7fa5840ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:24.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:24.869+0000 7fa58c684640 1 -- 172.21.15.44:0/2345801007 shutdown_connections 2024-08-19T00:13:24.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:24.869+0000 7fa58c684640 1 -- 172.21.15.44:0/2345801007 wait complete. 2024-08-19T00:13:24.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:24.869+0000 7fa58c684640 1 Processor -- start 2024-08-19T00:13:24.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:24.869+0000 7fa58c684640 1 -- start start 2024-08-19T00:13:24.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:24.869+0000 7fa58c684640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa5841018b0 0x7fa584198210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:24.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:24.869+0000 7fa58c684640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa584102250 0x7fa584198750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:24.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:24.869+0000 7fa58c684640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5841078b0 0x7fa58419cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:24.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:24.869+0000 7fa58c684640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa584111cb0 con 0x7fa5841078b0 2024-08-19T00:13:24.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:24.869+0000 7fa58c684640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fa584111b30 con 0x7fa5841018b0 2024-08-19T00:13:24.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:24.869+0000 7fa58c684640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa584111e30 con 0x7fa584102250 2024-08-19T00:13:24.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:24.869+0000 7fa58ac21640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5841078b0 0x7fa58419cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:24.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:24.870+0000 7fa58ac21640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5841078b0 0x7fa58419cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37104/0 (socket says 172.21.15.44:37104) 2024-08-19T00:13:24.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:24.870+0000 7fa58ac21640 1 -- 172.21.15.44:0/4193048068 learned_addr learned my addr 172.21.15.44:0/4193048068 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:24.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:24.870+0000 7fa58a420640 1 --2- 172.21.15.44:0/4193048068 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa5841018b0 0x7fa584198210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:24.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:24.870+0000 7fa589c1f640 1 --2- 172.21.15.44:0/4193048068 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa584102250 0x7fa584198750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:24.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:24.870+0000 7fa58ac21640 1 -- 172.21.15.44:0/4193048068 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa584102250 msgr2=0x7fa584198750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:24.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:24.870+0000 7fa58ac21640 1 --2- 172.21.15.44:0/4193048068 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa584102250 0x7fa584198750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:24.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:24.870+0000 7fa58ac21640 1 -- 172.21.15.44:0/4193048068 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa5841018b0 msgr2=0x7fa584198210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:24.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:24.870+0000 7fa58ac21640 1 --2- 172.21.15.44:0/4193048068 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa5841018b0 0x7fa584198210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:24.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:24.870+0000 7fa58ac21640 1 -- 172.21.15.44:0/4193048068 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa58419d1c0 con 0x7fa5841078b0 2024-08-19T00:13:24.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:24.870+0000 7fa589c1f640 1 --2- 172.21.15.44:0/4193048068 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa584102250 0x7fa584198750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:13:24.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:24.870+0000 7fa58ac21640 1 --2- 172.21.15.44:0/4193048068 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5841078b0 0x7fa58419cae0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa57c00eaa0 tx=0x7fa57c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:24.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:24.870+0000 7fa57b7fe640 1 -- 172.21.15.44:0/4193048068 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa57c00cdb0 con 0x7fa5841078b0 2024-08-19T00:13:24.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:24.870+0000 7fa58c684640 1 -- 172.21.15.44:0/4193048068 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa58419d4b0 con 0x7fa5841078b0 2024-08-19T00:13:24.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:24.870+0000 7fa57b7fe640 1 -- 172.21.15.44:0/4193048068 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa57c005020 con 0x7fa5841078b0 2024-08-19T00:13:24.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:24.870+0000 7fa57b7fe640 1 -- 172.21.15.44:0/4193048068 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa57c0116b0 con 0x7fa5841078b0 2024-08-19T00:13:24.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:24.870+0000 7fa58c684640 1 -- 172.21.15.44:0/4193048068 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5841a4d90 con 0x7fa5841078b0 2024-08-19T00:13:24.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:24.871+0000 7fa58c684640 1 -- 172.21.15.44:0/4193048068 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa584101d10 con 0x7fa5841078b0 2024-08-19T00:13:24.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:24.872+0000 7fa57b7fe640 1 -- 172.21.15.44:0/4193048068 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 24) ==== 138060+0+0 (secure 0 0 0) 0x7fa57c005560 con 0x7fa5841078b0 2024-08-19T00:13:24.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:24.873+0000 7fa57b7fe640 1 --2- 172.21.15.44:0/4193048068 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fa5700a2e10 0x7fa5700a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:24.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:24.873+0000 7fa58a420640 1 --2- 172.21.15.44:0/4193048068 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fa5700a2e10 0x7fa5700a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:24.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:24.873+0000 7fa57b7fe640 1 -- 172.21.15.44:0/4193048068 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7fa57c0cfd20 con 0x7fa5841078b0 2024-08-19T00:13:24.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:24.873+0000 7fa58a420640 1 --2- 172.21.15.44:0/4193048068 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fa5700a2e10 0x7fa5700a52d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa580005fd0 tx=0x7fa58000b390 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:24.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:24.877+0000 7fa57b7fe640 1 -- 172.21.15.44:0/4193048068 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fa57c016030 con 0x7fa5841078b0 2024-08-19T00:13:25.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:25.048+0000 7fa58c684640 1 -- 172.21.15.44:0/4193048068 --> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa584062360 con 0x7fa5700a2e10 2024-08-19T00:13:25.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:25.059+0000 7fa57b7fe640 1 -- 172.21.15.44:0/4193048068 <== mgr.15297 v2:172.21.15.44:6800/1029670730 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+339433 (secure 0 0 0) 0x7fa584062360 con 0x7fa5700a2e10 2024-08-19T00:13:25.064 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:13:25.065 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-08-19T00:13:25.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:25.062+0000 7fa58c684640 1 -- 172.21.15.44:0/4193048068 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fa5700a2e10 msgr2=0x7fa5700a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:25.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:25.062+0000 7fa58c684640 1 --2- 172.21.15.44:0/4193048068 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fa5700a2e10 0x7fa5700a52d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa580005fd0 tx=0x7fa58000b390 comp rx=0 tx=0).stop 2024-08-19T00:13:25.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:25.062+0000 7fa58c684640 1 -- 172.21.15.44:0/4193048068 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5841078b0 msgr2=0x7fa58419cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:25.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:25.062+0000 7fa58c684640 1 --2- 172.21.15.44:0/4193048068 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5841078b0 0x7fa58419cae0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa57c00eaa0 tx=0x7fa57c00ef60 comp rx=0 tx=0).stop 2024-08-19T00:13:25.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:25.062+0000 7fa58c684640 1 -- 172.21.15.44:0/4193048068 shutdown_connections 2024-08-19T00:13:25.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:25.062+0000 7fa58c684640 1 --2- 172.21.15.44:0/4193048068 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fa5700a2e10 0x7fa5700a52d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:25.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:25.062+0000 7fa58c684640 1 --2- 172.21.15.44:0/4193048068 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa584102250 0x7fa584198750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:25.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:25.062+0000 7fa58c684640 1 --2- 172.21.15.44:0/4193048068 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5841078b0 0x7fa58419cae0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:25.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:25.062+0000 7fa58c684640 1 --2- 172.21.15.44:0/4193048068 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa5841018b0 0x7fa584198210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:25.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:25.062+0000 7fa58c684640 1 -- 172.21.15.44:0/4193048068 >> 172.21.15.44:0/4193048068 conn(0x7fa5840fd5f0 msgr2=0x7fa5840fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:25.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:25.062+0000 7fa58c684640 1 -- 172.21.15.44:0/4193048068 shutdown_connections 2024-08-19T00:13:25.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:25.062+0000 7fa58c684640 1 -- 172.21.15.44:0/4193048068 wait complete. 2024-08-19T00:13:25.861 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:25 smithi044 ceph-mon[18489]: pgmap v6: 129 pgs: 129 active+clean; 1.1 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 205 B/s wr, 1 op/s 2024-08-19T00:13:25.861 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:25 smithi044 ceph-mon[18489]: from='client.15420 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-19T00:13:25.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:25 smithi116 ceph-mon[21873]: pgmap v6: 129 pgs: 129 active+clean; 1.1 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 205 B/s wr, 1 op/s 2024-08-19T00:13:25.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:25 smithi116 ceph-mon[21873]: from='client.15420 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-19T00:13:25.894 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":6,"stamp":"2024-08-19T00:13:24.521222+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1193583,"num_objects":104,"num_object_clones":0,"num_object_copies":314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":1307,"num_read_kb":824,"num_write":560,"num_write_kb":4408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1180848,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":942,"ondisk_log_size":942,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":407996,"kb_used_data":16856,"kb_used_omap":18,"kb_used_meta":390637,"kb_avail":1124533828,"statfs":{"total":1151940427776,"available":1151522639872,"internally_reserved":0,"allocated":17260544,"data_stored":10316495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":400012601},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.989495"},"pg_stats":[{"pgid":"2.1f","version":"95'14","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.756376+0000","last_change":"2024-08-19T00:10:50.471635+0000","last_active":"2024-08-19T00:13:18.756376+0000","last_peered":"2024-08-19T00:13:18.756376+0000","last_clean":"2024-08-19T00:13:18.756376+0000","last_became_active":"2024-08-19T00:10:50.471324+0000","last_became_peered":"2024-08-19T00:10:50.471324+0000","last_unstale":"2024-08-19T00:13:18.756376+0000","last_undegraded":"2024-08-19T00:13:18.756376+0000","last_fullsized":"2024-08-19T00:13:18.756376+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:41:02.945782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":104,"num_read_kb":104,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"94'5","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.598581+0000","last_change":"2024-08-19T00:12:40.812782+0000","last_active":"2024-08-19T00:13:18.598581+0000","last_peered":"2024-08-19T00:13:18.598581+0000","last_clean":"2024-08-19T00:13:18.598581+0000","last_became_active":"2024-08-19T00:12:40.812506+0000","last_became_peered":"2024-08-19T00:12:40.812506+0000","last_unstale":"2024-08-19T00:13:18.598581+0000","last_undegraded":"2024-08-19T00:13:18.598581+0000","last_fullsized":"2024-08-19T00:13:18.598581+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:32:54.681461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,8],"acting":[9,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744057+0000","last_change":"2024-08-19T00:10:59.789370+0000","last_active":"2024-08-19T00:13:18.744057+0000","last_peered":"2024-08-19T00:13:18.744057+0000","last_clean":"2024-08-19T00:13:18.744057+0000","last_became_active":"2024-08-19T00:10:59.788901+0000","last_became_peered":"2024-08-19T00:10:59.788901+0000","last_unstale":"2024-08-19T00:13:18.744057+0000","last_undegraded":"2024-08-19T00:13:18.744057+0000","last_fullsized":"2024-08-19T00:13:18.744057+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:15:45.247674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"90'2","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.509703+0000","last_change":"2024-08-19T00:10:50.618000+0000","last_active":"2024-08-19T00:13:18.509703+0000","last_peered":"2024-08-19T00:13:18.509703+0000","last_clean":"2024-08-19T00:13:18.509703+0000","last_became_active":"2024-08-19T00:10:50.617648+0000","last_became_peered":"2024-08-19T00:10:50.617648+0000","last_unstale":"2024-08-19T00:13:18.509703+0000","last_undegraded":"2024-08-19T00:13:18.509703+0000","last_fullsized":"2024-08-19T00:13:18.509703+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:39:00.310466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"94'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.745061+0000","last_change":"2024-08-19T00:10:52.518075+0000","last_active":"2024-08-19T00:13:18.745061+0000","last_peered":"2024-08-19T00:13:18.745061+0000","last_clean":"2024-08-19T00:13:18.745061+0000","last_became_active":"2024-08-19T00:10:52.517735+0000","last_became_peered":"2024-08-19T00:10:52.517735+0000","last_unstale":"2024-08-19T00:13:18.745061+0000","last_undegraded":"2024-08-19T00:13:18.745061+0000","last_fullsized":"2024-08-19T00:13:18.745061+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:02:32.657776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.511525+0000","last_change":"2024-08-19T00:10:59.787563+0000","last_active":"2024-08-19T00:13:18.511525+0000","last_peered":"2024-08-19T00:13:18.511525+0000","last_clean":"2024-08-19T00:13:18.511525+0000","last_became_active":"2024-08-19T00:10:59.787143+0000","last_became_peered":"2024-08-19T00:10:59.787143+0000","last_unstale":"2024-08-19T00:13:18.511525+0000","last_undegraded":"2024-08-19T00:13:18.511525+0000","last_fullsized":"2024-08-19T00:13:18.511525+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:41:47.101296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"90'12","reported_seq":53,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.509564+0000","last_change":"2024-08-19T00:10:50.475869+0000","last_active":"2024-08-19T00:13:18.509564+0000","last_peered":"2024-08-19T00:13:18.509564+0000","last_clean":"2024-08-19T00:13:18.509564+0000","last_became_active":"2024-08-19T00:10:50.475550+0000","last_became_peered":"2024-08-19T00:10:50.475550+0000","last_unstale":"2024-08-19T00:13:18.509564+0000","last_undegraded":"2024-08-19T00:13:18.509564+0000","last_fullsized":"2024-08-19T00:13:18.509564+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:47:23.724503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"94'9","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743612+0000","last_change":"2024-08-19T00:10:52.511901+0000","last_active":"2024-08-19T00:13:18.743612+0000","last_peered":"2024-08-19T00:13:18.743612+0000","last_clean":"2024-08-19T00:13:18.743612+0000","last_became_active":"2024-08-19T00:10:52.511595+0000","last_became_peered":"2024-08-19T00:10:52.511595+0000","last_unstale":"2024-08-19T00:13:18.743612+0000","last_undegraded":"2024-08-19T00:13:18.743612+0000","last_fullsized":"2024-08-19T00:13:18.743612+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:57:30.613865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.511802+0000","last_change":"2024-08-19T00:10:59.785611+0000","last_active":"2024-08-19T00:13:18.511802+0000","last_peered":"2024-08-19T00:13:18.511802+0000","last_clean":"2024-08-19T00:13:18.511802+0000","last_became_active":"2024-08-19T00:10:59.785105+0000","last_became_peered":"2024-08-19T00:10:59.785105+0000","last_unstale":"2024-08-19T00:13:18.511802+0000","last_undegraded":"2024-08-19T00:13:18.511802+0000","last_fullsized":"2024-08-19T00:13:18.511802+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:05:31.007647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"90'5","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.509236+0000","last_change":"2024-08-19T00:10:50.474439+0000","last_active":"2024-08-19T00:13:18.509236+0000","last_peered":"2024-08-19T00:13:18.509236+0000","last_clean":"2024-08-19T00:13:18.509236+0000","last_became_active":"2024-08-19T00:10:50.473984+0000","last_became_peered":"2024-08-19T00:10:50.473984+0000","last_unstale":"2024-08-19T00:13:18.509236+0000","last_undegraded":"2024-08-19T00:13:18.509236+0000","last_fullsized":"2024-08-19T00:13:18.509236+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:16:06.934392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"94'15","reported_seq":50,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.609081+0000","last_change":"2024-08-19T00:10:52.521664+0000","last_active":"2024-08-19T00:13:18.609081+0000","last_peered":"2024-08-19T00:13:18.609081+0000","last_clean":"2024-08-19T00:13:18.609081+0000","last_became_active":"2024-08-19T00:10:52.520792+0000","last_became_peered":"2024-08-19T00:10:52.520792+0000","last_unstale":"2024-08-19T00:13:18.609081+0000","last_undegraded":"2024-08-19T00:13:18.609081+0000","last_fullsized":"2024-08-19T00:13:18.609081+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:55:27.199456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.511618+0000","last_change":"2024-08-19T00:10:59.789736+0000","last_active":"2024-08-19T00:13:18.511618+0000","last_peered":"2024-08-19T00:13:18.511618+0000","last_clean":"2024-08-19T00:13:18.511618+0000","last_became_active":"2024-08-19T00:10:59.786880+0000","last_became_peered":"2024-08-19T00:10:59.786880+0000","last_unstale":"2024-08-19T00:13:18.511618+0000","last_undegraded":"2024-08-19T00:13:18.511618+0000","last_fullsized":"2024-08-19T00:13:18.511618+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:20:53.615561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"94'5","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743922+0000","last_change":"2024-08-19T00:10:52.519887+0000","last_active":"2024-08-19T00:13:18.743922+0000","last_peered":"2024-08-19T00:13:18.743922+0000","last_clean":"2024-08-19T00:13:18.743922+0000","last_became_active":"2024-08-19T00:10:52.519550+0000","last_became_peered":"2024-08-19T00:10:52.519550+0000","last_unstale":"2024-08-19T00:13:18.743922+0000","last_undegraded":"2024-08-19T00:13:18.743922+0000","last_fullsized":"2024-08-19T00:13:18.743922+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:27:43.493012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"90'4","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.508917+0000","last_change":"2024-08-19T00:10:50.478131+0000","last_active":"2024-08-19T00:13:18.508917+0000","last_peered":"2024-08-19T00:13:18.508917+0000","last_clean":"2024-08-19T00:13:18.508917+0000","last_became_active":"2024-08-19T00:10:50.477826+0000","last_became_peered":"2024-08-19T00:10:50.477826+0000","last_unstale":"2024-08-19T00:13:18.508917+0000","last_undegraded":"2024-08-19T00:13:18.508917+0000","last_fullsized":"2024-08-19T00:13:18.508917+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:41:24.066453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.511970+0000","last_change":"2024-08-19T00:10:59.787634+0000","last_active":"2024-08-19T00:13:18.511970+0000","last_peered":"2024-08-19T00:13:18.511970+0000","last_clean":"2024-08-19T00:13:18.511970+0000","last_became_active":"2024-08-19T00:10:59.786508+0000","last_became_peered":"2024-08-19T00:10:59.786508+0000","last_unstale":"2024-08-19T00:13:18.511970+0000","last_undegraded":"2024-08-19T00:13:18.511970+0000","last_fullsized":"2024-08-19T00:13:18.511970+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:50:19.071853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"94'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.507964+0000","last_change":"2024-08-19T00:10:52.512462+0000","last_active":"2024-08-19T00:13:18.507964+0000","last_peered":"2024-08-19T00:13:18.507964+0000","last_clean":"2024-08-19T00:13:18.507964+0000","last_became_active":"2024-08-19T00:10:52.512139+0000","last_became_peered":"2024-08-19T00:10:52.512139+0000","last_unstale":"2024-08-19T00:13:18.507964+0000","last_undegraded":"2024-08-19T00:13:18.507964+0000","last_fullsized":"2024-08-19T00:13:18.507964+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:39:18.677836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"95'4","reported_seq":24,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744069+0000","last_change":"2024-08-19T00:11:39.930130+0000","last_active":"2024-08-19T00:13:18.744069+0000","last_peered":"2024-08-19T00:13:18.744069+0000","last_clean":"2024-08-19T00:13:18.744069+0000","last_became_active":"2024-08-19T00:11:39.919566+0000","last_became_peered":"2024-08-19T00:11:39.919566+0000","last_unstale":"2024-08-19T00:13:18.744069+0000","last_undegraded":"2024-08-19T00:13:18.744069+0000","last_fullsized":"2024-08-19T00:13:18.744069+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:50:25.001784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"92'1","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.511923+0000","last_change":"2024-08-19T00:10:59.787455+0000","last_active":"2024-08-19T00:13:18.511923+0000","last_peered":"2024-08-19T00:13:18.511923+0000","last_clean":"2024-08-19T00:13:18.511923+0000","last_became_active":"2024-08-19T00:10:59.787054+0000","last_became_peered":"2024-08-19T00:10:59.787054+0000","last_unstale":"2024-08-19T00:13:18.511923+0000","last_undegraded":"2024-08-19T00:13:18.511923+0000","last_fullsized":"2024-08-19T00:13:18.511923+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:13:31.356220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"94'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743845+0000","last_change":"2024-08-19T00:10:52.520993+0000","last_active":"2024-08-19T00:13:18.743845+0000","last_peered":"2024-08-19T00:13:18.743845+0000","last_clean":"2024-08-19T00:13:18.743845+0000","last_became_active":"2024-08-19T00:10:52.520697+0000","last_became_peered":"2024-08-19T00:10:52.520697+0000","last_unstale":"2024-08-19T00:13:18.743845+0000","last_undegraded":"2024-08-19T00:13:18.743845+0000","last_fullsized":"2024-08-19T00:13:18.743845+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:30:15.408193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"90'7","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.507822+0000","last_change":"2024-08-19T00:10:50.470746+0000","last_active":"2024-08-19T00:13:18.507822+0000","last_peered":"2024-08-19T00:13:18.507822+0000","last_clean":"2024-08-19T00:13:18.507822+0000","last_became_active":"2024-08-19T00:10:50.470454+0000","last_became_peered":"2024-08-19T00:10:50.470454+0000","last_unstale":"2024-08-19T00:13:18.507822+0000","last_undegraded":"2024-08-19T00:13:18.507822+0000","last_fullsized":"2024-08-19T00:13:18.507822+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:37:34.718543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.509316+0000","last_change":"2024-08-19T00:11:39.924217+0000","last_active":"2024-08-19T00:13:18.509316+0000","last_peered":"2024-08-19T00:13:18.509316+0000","last_clean":"2024-08-19T00:13:18.509316+0000","last_became_active":"2024-08-19T00:11:39.923541+0000","last_became_peered":"2024-08-19T00:11:39.923541+0000","last_unstale":"2024-08-19T00:13:18.509316+0000","last_undegraded":"2024-08-19T00:13:18.509316+0000","last_fullsized":"2024-08-19T00:13:18.509316+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:29:35.040424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,2,5],"acting":[8,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.9","version":"94'2","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.508727+0000","last_change":"2024-08-19T00:10:52.516838+0000","last_active":"2024-08-19T00:13:18.508727+0000","last_peered":"2024-08-19T00:13:18.508727+0000","last_clean":"2024-08-19T00:13:18.508727+0000","last_became_active":"2024-08-19T00:10:52.516471+0000","last_became_peered":"2024-08-19T00:10:52.516471+0000","last_unstale":"2024-08-19T00:13:18.508727+0000","last_undegraded":"2024-08-19T00:13:18.508727+0000","last_fullsized":"2024-08-19T00:13:18.508727+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:11:26.974655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"90'2","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743362+0000","last_change":"2024-08-19T00:10:50.618745+0000","last_active":"2024-08-19T00:13:18.743362+0000","last_peered":"2024-08-19T00:13:18.743362+0000","last_clean":"2024-08-19T00:13:18.743362+0000","last_became_active":"2024-08-19T00:10:50.618426+0000","last_became_peered":"2024-08-19T00:10:50.618426+0000","last_unstale":"2024-08-19T00:13:18.743362+0000","last_undegraded":"2024-08-19T00:13:18.743362+0000","last_fullsized":"2024-08-19T00:13:18.743362+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:12:57.777142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.512249+0000","last_change":"2024-08-19T00:10:59.793740+0000","last_active":"2024-08-19T00:13:18.512249+0000","last_peered":"2024-08-19T00:13:18.512249+0000","last_clean":"2024-08-19T00:13:18.512249+0000","last_became_active":"2024-08-19T00:10:59.793181+0000","last_became_peered":"2024-08-19T00:10:59.793181+0000","last_unstale":"2024-08-19T00:13:18.512249+0000","last_undegraded":"2024-08-19T00:13:18.512249+0000","last_fullsized":"2024-08-19T00:13:18.512249+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:04:15.429505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"94'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744045+0000","last_change":"2024-08-19T00:10:52.512200+0000","last_active":"2024-08-19T00:13:18.744045+0000","last_peered":"2024-08-19T00:13:18.744045+0000","last_clean":"2024-08-19T00:13:18.744045+0000","last_became_active":"2024-08-19T00:10:52.511891+0000","last_became_peered":"2024-08-19T00:10:52.511891+0000","last_unstale":"2024-08-19T00:13:18.744045+0000","last_undegraded":"2024-08-19T00:13:18.744045+0000","last_fullsized":"2024-08-19T00:13:18.744045+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:02:08.400026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"90'7","reported_seq":49,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.512396+0000","last_change":"2024-08-19T00:10:50.476209+0000","last_active":"2024-08-19T00:13:18.512396+0000","last_peered":"2024-08-19T00:13:18.512396+0000","last_clean":"2024-08-19T00:13:18.512396+0000","last_became_active":"2024-08-19T00:10:50.475410+0000","last_became_peered":"2024-08-19T00:10:50.475410+0000","last_unstale":"2024-08-19T00:13:18.512396+0000","last_undegraded":"2024-08-19T00:13:18.512396+0000","last_fullsized":"2024-08-19T00:13:18.512396+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:46:25.093738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744155+0000","last_change":"2024-08-19T00:10:59.786550+0000","last_active":"2024-08-19T00:13:18.744155+0000","last_peered":"2024-08-19T00:13:18.744155+0000","last_clean":"2024-08-19T00:13:18.744155+0000","last_became_active":"2024-08-19T00:10:59.785531+0000","last_became_peered":"2024-08-19T00:10:59.785531+0000","last_unstale":"2024-08-19T00:13:18.744155+0000","last_undegraded":"2024-08-19T00:13:18.744155+0000","last_fullsized":"2024-08-19T00:13:18.744155+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:59:53.605678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"94'5","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.509486+0000","last_change":"2024-08-19T00:10:52.514936+0000","last_active":"2024-08-19T00:13:18.509486+0000","last_peered":"2024-08-19T00:13:18.509486+0000","last_clean":"2024-08-19T00:13:18.509486+0000","last_became_active":"2024-08-19T00:10:52.514597+0000","last_became_peered":"2024-08-19T00:10:52.514597+0000","last_unstale":"2024-08-19T00:13:18.509486+0000","last_undegraded":"2024-08-19T00:13:18.509486+0000","last_fullsized":"2024-08-19T00:13:18.509486+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:03:42.275705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"95'52","reported_seq":116,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.711935+0000","last_change":"2024-08-19T00:10:50.470637+0000","last_active":"2024-08-19T00:13:18.711935+0000","last_peered":"2024-08-19T00:13:18.711935+0000","last_clean":"2024-08-19T00:13:18.711935+0000","last_became_active":"2024-08-19T00:10:50.470276+0000","last_became_peered":"2024-08-19T00:10:50.470276+0000","last_unstale":"2024-08-19T00:13:18.711935+0000","last_undegraded":"2024-08-19T00:13:18.711935+0000","last_fullsized":"2024-08-19T00:13:18.711935+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:42:16.186669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":92,"num_write_kb":838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.507497+0000","last_change":"2024-08-19T00:10:59.784742+0000","last_active":"2024-08-19T00:13:18.507497+0000","last_peered":"2024-08-19T00:13:18.507497+0000","last_clean":"2024-08-19T00:13:18.507497+0000","last_became_active":"2024-08-19T00:10:59.784372+0000","last_became_peered":"2024-08-19T00:10:59.784372+0000","last_unstale":"2024-08-19T00:13:18.507497+0000","last_undegraded":"2024-08-19T00:13:18.507497+0000","last_fullsized":"2024-08-19T00:13:18.507497+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:58:03.216882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"94'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744841+0000","last_change":"2024-08-19T00:10:52.511172+0000","last_active":"2024-08-19T00:13:18.744841+0000","last_peered":"2024-08-19T00:13:18.744841+0000","last_clean":"2024-08-19T00:13:18.744841+0000","last_became_active":"2024-08-19T00:10:52.510816+0000","last_became_peered":"2024-08-19T00:10:52.510816+0000","last_unstale":"2024-08-19T00:13:18.744841+0000","last_undegraded":"2024-08-19T00:13:18.744841+0000","last_fullsized":"2024-08-19T00:13:18.744841+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:31:39.889398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"90'4","reported_seq":25,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744284+0000","last_change":"2024-08-19T00:11:39.926806+0000","last_active":"2024-08-19T00:13:18.744284+0000","last_peered":"2024-08-19T00:13:18.744284+0000","last_clean":"2024-08-19T00:13:18.744284+0000","last_became_active":"2024-08-19T00:11:39.917115+0000","last_became_peered":"2024-08-19T00:11:39.917115+0000","last_unstale":"2024-08-19T00:13:18.744284+0000","last_undegraded":"2024-08-19T00:13:18.744284+0000","last_fullsized":"2024-08-19T00:13:18.744284+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:58:19.965471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744267+0000","last_change":"2024-08-19T00:10:59.778996+0000","last_active":"2024-08-19T00:13:18.744267+0000","last_peered":"2024-08-19T00:13:18.744267+0000","last_clean":"2024-08-19T00:13:18.744267+0000","last_became_active":"2024-08-19T00:10:59.778589+0000","last_became_peered":"2024-08-19T00:10:59.778589+0000","last_unstale":"2024-08-19T00:13:18.744267+0000","last_undegraded":"2024-08-19T00:13:18.744267+0000","last_fullsized":"2024-08-19T00:13:18.744267+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:40:23.690051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"94'4","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.611723+0000","last_change":"2024-08-19T00:10:52.512796+0000","last_active":"2024-08-19T00:13:18.611723+0000","last_peered":"2024-08-19T00:13:18.611723+0000","last_clean":"2024-08-19T00:13:18.611723+0000","last_became_active":"2024-08-19T00:10:52.512459+0000","last_became_peered":"2024-08-19T00:10:52.512459+0000","last_unstale":"2024-08-19T00:13:18.611723+0000","last_undegraded":"2024-08-19T00:13:18.611723+0000","last_fullsized":"2024-08-19T00:13:18.611723+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:07:47.124129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"90'1","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.599347+0000","last_change":"2024-08-19T00:10:50.618118+0000","last_active":"2024-08-19T00:13:18.599347+0000","last_peered":"2024-08-19T00:13:18.599347+0000","last_clean":"2024-08-19T00:13:18.599347+0000","last_became_active":"2024-08-19T00:10:50.617759+0000","last_became_peered":"2024-08-19T00:10:50.617759+0000","last_unstale":"2024-08-19T00:13:18.599347+0000","last_undegraded":"2024-08-19T00:13:18.599347+0000","last_fullsized":"2024-08-19T00:13:18.599347+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:38:10.830722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.508792+0000","last_change":"2024-08-19T00:10:59.783548+0000","last_active":"2024-08-19T00:13:18.508792+0000","last_peered":"2024-08-19T00:13:18.508792+0000","last_clean":"2024-08-19T00:13:18.508792+0000","last_became_active":"2024-08-19T00:10:59.783091+0000","last_became_peered":"2024-08-19T00:10:59.783091+0000","last_unstale":"2024-08-19T00:13:18.508792+0000","last_undegraded":"2024-08-19T00:13:18.508792+0000","last_fullsized":"2024-08-19T00:13:18.508792+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:26:21.191829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"94'7","reported_seq":49,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.611787+0000","last_change":"2024-08-19T00:12:40.994390+0000","last_active":"2024-08-19T00:13:18.611787+0000","last_peered":"2024-08-19T00:13:18.611787+0000","last_clean":"2024-08-19T00:13:18.611787+0000","last_became_active":"2024-08-19T00:12:40.994099+0000","last_became_peered":"2024-08-19T00:12:40.994099+0000","last_unstale":"2024-08-19T00:13:18.611787+0000","last_undegraded":"2024-08-19T00:13:18.611787+0000","last_fullsized":"2024-08-19T00:13:18.611787+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:28:07.374407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"95'7","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:19.051982+0000","last_change":"2024-08-19T00:10:50.478742+0000","last_active":"2024-08-19T00:13:19.051982+0000","last_peered":"2024-08-19T00:13:19.051982+0000","last_clean":"2024-08-19T00:13:19.051982+0000","last_became_active":"2024-08-19T00:10:50.478139+0000","last_became_peered":"2024-08-19T00:10:50.478139+0000","last_unstale":"2024-08-19T00:13:19.051982+0000","last_undegraded":"2024-08-19T00:13:19.051982+0000","last_fullsized":"2024-08-19T00:13:19.051982+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:23:25.727268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":2,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744335+0000","last_change":"2024-08-19T00:10:59.785350+0000","last_active":"2024-08-19T00:13:18.744335+0000","last_peered":"2024-08-19T00:13:18.744335+0000","last_clean":"2024-08-19T00:13:18.744335+0000","last_became_active":"2024-08-19T00:10:59.784929+0000","last_became_peered":"2024-08-19T00:10:59.784929+0000","last_unstale":"2024-08-19T00:13:18.744335+0000","last_undegraded":"2024-08-19T00:13:18.744335+0000","last_fullsized":"2024-08-19T00:13:18.744335+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:58:49.878253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"94'8","reported_seq":50,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.608802+0000","last_change":"2024-08-19T00:11:39.924921+0000","last_active":"2024-08-19T00:13:18.608802+0000","last_peered":"2024-08-19T00:13:18.608802+0000","last_clean":"2024-08-19T00:13:18.608802+0000","last_became_active":"2024-08-19T00:11:39.924551+0000","last_became_peered":"2024-08-19T00:11:39.924551+0000","last_unstale":"2024-08-19T00:13:18.608802+0000","last_undegraded":"2024-08-19T00:13:18.608802+0000","last_fullsized":"2024-08-19T00:13:18.608802+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:14:23.042222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"95'6","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:23.056915+0000","last_change":"2024-08-19T00:10:50.618159+0000","last_active":"2024-08-19T00:13:23.056915+0000","last_peered":"2024-08-19T00:13:23.056915+0000","last_clean":"2024-08-19T00:13:23.056915+0000","last_became_active":"2024-08-19T00:10:50.617828+0000","last_became_peered":"2024-08-19T00:10:50.617828+0000","last_unstale":"2024-08-19T00:13:23.056915+0000","last_undegraded":"2024-08-19T00:13:23.056915+0000","last_fullsized":"2024-08-19T00:13:23.056915+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:36:40.702592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":109,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.745102+0000","last_change":"2024-08-19T00:10:59.787615+0000","last_active":"2024-08-19T00:13:18.745102+0000","last_peered":"2024-08-19T00:13:18.745102+0000","last_clean":"2024-08-19T00:13:18.745102+0000","last_became_active":"2024-08-19T00:10:59.787184+0000","last_became_peered":"2024-08-19T00:10:59.787184+0000","last_unstale":"2024-08-19T00:13:18.745102+0000","last_undegraded":"2024-08-19T00:13:18.745102+0000","last_fullsized":"2024-08-19T00:13:18.745102+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:20:42.174337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"94'5","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743137+0000","last_change":"2024-08-19T00:10:52.509235+0000","last_active":"2024-08-19T00:13:18.743137+0000","last_peered":"2024-08-19T00:13:18.743137+0000","last_clean":"2024-08-19T00:13:18.743137+0000","last_became_active":"2024-08-19T00:10:52.508934+0000","last_became_peered":"2024-08-19T00:10:52.508934+0000","last_unstale":"2024-08-19T00:13:18.743137+0000","last_undegraded":"2024-08-19T00:13:18.743137+0000","last_fullsized":"2024-08-19T00:13:18.743137+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:12:59.654711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"90'4","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743372+0000","last_change":"2024-08-19T00:10:50.477180+0000","last_active":"2024-08-19T00:13:18.743372+0000","last_peered":"2024-08-19T00:13:18.743372+0000","last_clean":"2024-08-19T00:13:18.743372+0000","last_became_active":"2024-08-19T00:10:50.476875+0000","last_became_peered":"2024-08-19T00:10:50.476875+0000","last_unstale":"2024-08-19T00:13:18.743372+0000","last_undegraded":"2024-08-19T00:13:18.743372+0000","last_fullsized":"2024-08-19T00:13:18.743372+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:15:57.383599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.608964+0000","last_change":"2024-08-19T00:10:59.783389+0000","last_active":"2024-08-19T00:13:18.608964+0000","last_peered":"2024-08-19T00:13:18.608964+0000","last_clean":"2024-08-19T00:13:18.608964+0000","last_became_active":"2024-08-19T00:10:59.782983+0000","last_became_peered":"2024-08-19T00:10:59.782983+0000","last_unstale":"2024-08-19T00:13:18.608964+0000","last_undegraded":"2024-08-19T00:13:18.608964+0000","last_fullsized":"2024-08-19T00:13:18.608964+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:55:47.419588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"94'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.507821+0000","last_change":"2024-08-19T00:10:52.517477+0000","last_active":"2024-08-19T00:13:18.507821+0000","last_peered":"2024-08-19T00:13:18.507821+0000","last_clean":"2024-08-19T00:13:18.507821+0000","last_became_active":"2024-08-19T00:10:52.517192+0000","last_became_peered":"2024-08-19T00:10:52.517192+0000","last_unstale":"2024-08-19T00:13:18.507821+0000","last_undegraded":"2024-08-19T00:13:18.507821+0000","last_fullsized":"2024-08-19T00:13:18.507821+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:31:01.125780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"90'6","reported_seq":50,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.511955+0000","last_change":"2024-08-19T00:10:50.476296+0000","last_active":"2024-08-19T00:13:18.511955+0000","last_peered":"2024-08-19T00:13:18.511955+0000","last_clean":"2024-08-19T00:13:18.511955+0000","last_became_active":"2024-08-19T00:10:50.475835+0000","last_became_peered":"2024-08-19T00:10:50.475835+0000","last_unstale":"2024-08-19T00:13:18.511955+0000","last_undegraded":"2024-08-19T00:13:18.511955+0000","last_fullsized":"2024-08-19T00:13:18.511955+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:23:27.585779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":369,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743570+0000","last_change":"2024-08-19T00:09:43.445224+0000","last_active":"2024-08-19T00:13:18.743570+0000","last_peered":"2024-08-19T00:13:18.743570+0000","last_clean":"2024-08-19T00:13:18.743570+0000","last_became_active":"2024-08-19T00:09:43.444826+0000","last_became_peered":"2024-08-19T00:09:43.444826+0000","last_unstale":"2024-08-19T00:13:18.743570+0000","last_undegraded":"2024-08-19T00:13:18.743570+0000","last_fullsized":"2024-08-19T00:13:18.743570+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:06:42.707047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:06:42.707047+0000","last_clean_scrub_stamp":"2024-08-19T00:06:42.707047+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:37:10.588547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"92'1","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744441+0000","last_change":"2024-08-19T00:10:59.783987+0000","last_active":"2024-08-19T00:13:18.744441+0000","last_peered":"2024-08-19T00:13:18.744441+0000","last_clean":"2024-08-19T00:13:18.744441+0000","last_became_active":"2024-08-19T00:10:59.783569+0000","last_became_peered":"2024-08-19T00:10:59.783569+0000","last_unstale":"2024-08-19T00:13:18.744441+0000","last_undegraded":"2024-08-19T00:13:18.744441+0000","last_fullsized":"2024-08-19T00:13:18.744441+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:04:01.744644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"94'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744566+0000","last_change":"2024-08-19T00:10:52.516201+0000","last_active":"2024-08-19T00:13:18.744566+0000","last_peered":"2024-08-19T00:13:18.744566+0000","last_clean":"2024-08-19T00:13:18.744566+0000","last_became_active":"2024-08-19T00:10:52.515871+0000","last_became_peered":"2024-08-19T00:10:52.515871+0000","last_unstale":"2024-08-19T00:13:18.744566+0000","last_undegraded":"2024-08-19T00:13:18.744566+0000","last_fullsized":"2024-08-19T00:13:18.744566+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:54:49.528215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"95'7","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:19.065451+0000","last_change":"2024-08-19T00:10:50.620185+0000","last_active":"2024-08-19T00:13:19.065451+0000","last_peered":"2024-08-19T00:13:19.065451+0000","last_clean":"2024-08-19T00:13:19.065451+0000","last_became_active":"2024-08-19T00:10:50.619858+0000","last_became_peered":"2024-08-19T00:10:50.619858+0000","last_unstale":"2024-08-19T00:13:19.065451+0000","last_undegraded":"2024-08-19T00:13:19.065451+0000","last_fullsized":"2024-08-19T00:13:19.065451+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:30:21.893859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1950,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":3,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743313+0000","last_change":"2024-08-19T00:10:59.782056+0000","last_active":"2024-08-19T00:13:18.743313+0000","last_peered":"2024-08-19T00:13:18.743313+0000","last_clean":"2024-08-19T00:13:18.743313+0000","last_became_active":"2024-08-19T00:10:59.781666+0000","last_became_peered":"2024-08-19T00:10:59.781666+0000","last_unstale":"2024-08-19T00:13:18.743313+0000","last_undegraded":"2024-08-19T00:13:18.743313+0000","last_fullsized":"2024-08-19T00:13:18.743313+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:06:15.614372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"94'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744343+0000","last_change":"2024-08-19T00:10:52.523346+0000","last_active":"2024-08-19T00:13:18.744343+0000","last_peered":"2024-08-19T00:13:18.744343+0000","last_clean":"2024-08-19T00:13:18.744343+0000","last_became_active":"2024-08-19T00:10:52.523020+0000","last_became_peered":"2024-08-19T00:10:52.523020+0000","last_unstale":"2024-08-19T00:13:18.744343+0000","last_undegraded":"2024-08-19T00:13:18.744343+0000","last_fullsized":"2024-08-19T00:13:18.744343+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:09:58.259666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"95'41","reported_seq":90,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.709251+0000","last_change":"2024-08-19T00:10:50.471739+0000","last_active":"2024-08-19T00:13:18.709251+0000","last_peered":"2024-08-19T00:13:18.709251+0000","last_clean":"2024-08-19T00:13:18.709251+0000","last_became_active":"2024-08-19T00:10:50.471425+0000","last_became_peered":"2024-08-19T00:10:50.471425+0000","last_unstale":"2024-08-19T00:13:18.709251+0000","last_undegraded":"2024-08-19T00:13:18.709251+0000","last_fullsized":"2024-08-19T00:13:18.709251+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:55:26.332380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743933+0000","last_change":"2024-08-19T00:10:59.788685+0000","last_active":"2024-08-19T00:13:18.743933+0000","last_peered":"2024-08-19T00:13:18.743933+0000","last_clean":"2024-08-19T00:13:18.743933+0000","last_became_active":"2024-08-19T00:10:59.788343+0000","last_became_peered":"2024-08-19T00:10:59.788343+0000","last_unstale":"2024-08-19T00:13:18.743933+0000","last_undegraded":"2024-08-19T00:13:18.743933+0000","last_fullsized":"2024-08-19T00:13:18.743933+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:20:59.595494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"94'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744559+0000","last_change":"2024-08-19T00:10:52.516469+0000","last_active":"2024-08-19T00:13:18.744559+0000","last_peered":"2024-08-19T00:13:18.744559+0000","last_clean":"2024-08-19T00:13:18.744559+0000","last_became_active":"2024-08-19T00:10:52.516093+0000","last_became_peered":"2024-08-19T00:10:52.516093+0000","last_unstale":"2024-08-19T00:13:18.744559+0000","last_undegraded":"2024-08-19T00:13:18.744559+0000","last_fullsized":"2024-08-19T00:13:18.744559+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:18:29.327336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"90'5","reported_seq":58,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744970+0000","last_change":"2024-08-19T00:11:39.921825+0000","last_active":"2024-08-19T00:13:18.744970+0000","last_peered":"2024-08-19T00:13:18.744970+0000","last_clean":"2024-08-19T00:13:18.744970+0000","last_became_active":"2024-08-19T00:11:39.917689+0000","last_became_peered":"2024-08-19T00:11:39.917689+0000","last_unstale":"2024-08-19T00:13:18.744970+0000","last_undegraded":"2024-08-19T00:13:18.744970+0000","last_fullsized":"2024-08-19T00:13:18.744970+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:37:47.940707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.608635+0000","last_change":"2024-08-19T00:10:59.785347+0000","last_active":"2024-08-19T00:13:18.608635+0000","last_peered":"2024-08-19T00:13:18.608635+0000","last_clean":"2024-08-19T00:13:18.608635+0000","last_became_active":"2024-08-19T00:10:59.784927+0000","last_became_peered":"2024-08-19T00:10:59.784927+0000","last_unstale":"2024-08-19T00:13:18.608635+0000","last_undegraded":"2024-08-19T00:13:18.608635+0000","last_fullsized":"2024-08-19T00:13:18.608635+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:39:41.919021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"94'5","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744842+0000","last_change":"2024-08-19T00:12:41.004215+0000","last_active":"2024-08-19T00:13:18.744842+0000","last_peered":"2024-08-19T00:13:18.744842+0000","last_clean":"2024-08-19T00:13:18.744842+0000","last_became_active":"2024-08-19T00:12:41.003770+0000","last_became_peered":"2024-08-19T00:12:41.003770+0000","last_unstale":"2024-08-19T00:13:18.744842+0000","last_undegraded":"2024-08-19T00:13:18.744842+0000","last_fullsized":"2024-08-19T00:13:18.744842+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:17:42.279811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"90'2","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.509422+0000","last_change":"2024-08-19T00:10:50.474977+0000","last_active":"2024-08-19T00:13:18.509422+0000","last_peered":"2024-08-19T00:13:18.509422+0000","last_clean":"2024-08-19T00:13:18.509422+0000","last_became_active":"2024-08-19T00:10:50.474653+0000","last_became_peered":"2024-08-19T00:10:50.474653+0000","last_unstale":"2024-08-19T00:13:18.509422+0000","last_undegraded":"2024-08-19T00:13:18.509422+0000","last_fullsized":"2024-08-19T00:13:18.509422+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:20:31.565098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.608795+0000","last_change":"2024-08-19T00:10:59.789912+0000","last_active":"2024-08-19T00:13:18.608795+0000","last_peered":"2024-08-19T00:13:18.608795+0000","last_clean":"2024-08-19T00:13:18.608795+0000","last_became_active":"2024-08-19T00:10:59.789143+0000","last_became_peered":"2024-08-19T00:10:59.789143+0000","last_unstale":"2024-08-19T00:13:18.608795+0000","last_undegraded":"2024-08-19T00:13:18.608795+0000","last_fullsized":"2024-08-19T00:13:18.608795+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:06:53.447173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"94'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.608953+0000","last_change":"2024-08-19T00:10:52.525061+0000","last_active":"2024-08-19T00:13:18.608953+0000","last_peered":"2024-08-19T00:13:18.608953+0000","last_clean":"2024-08-19T00:13:18.608953+0000","last_became_active":"2024-08-19T00:10:52.524752+0000","last_became_peered":"2024-08-19T00:10:52.524752+0000","last_unstale":"2024-08-19T00:13:18.608953+0000","last_undegraded":"2024-08-19T00:13:18.608953+0000","last_fullsized":"2024-08-19T00:13:18.608953+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:50:47.817220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"90'17","reported_seq":59,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.508845+0000","last_change":"2024-08-19T00:10:50.618923+0000","last_active":"2024-08-19T00:13:18.508845+0000","last_peered":"2024-08-19T00:13:18.508845+0000","last_clean":"2024-08-19T00:13:18.508845+0000","last_became_active":"2024-08-19T00:10:50.618586+0000","last_became_peered":"2024-08-19T00:10:50.618586+0000","last_unstale":"2024-08-19T00:13:18.508845+0000","last_undegraded":"2024-08-19T00:13:18.508845+0000","last_fullsized":"2024-08-19T00:13:18.508845+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:07:45.186059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744904+0000","last_change":"2024-08-19T00:10:59.785681+0000","last_active":"2024-08-19T00:13:18.744904+0000","last_peered":"2024-08-19T00:13:18.744904+0000","last_clean":"2024-08-19T00:13:18.744904+0000","last_became_active":"2024-08-19T00:10:59.785299+0000","last_became_peered":"2024-08-19T00:10:59.785299+0000","last_unstale":"2024-08-19T00:13:18.744904+0000","last_undegraded":"2024-08-19T00:13:18.744904+0000","last_fullsized":"2024-08-19T00:13:18.744904+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:36:08.151180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"94'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743809+0000","last_change":"2024-08-19T00:10:52.523398+0000","last_active":"2024-08-19T00:13:18.743809+0000","last_peered":"2024-08-19T00:13:18.743809+0000","last_clean":"2024-08-19T00:13:18.743809+0000","last_became_active":"2024-08-19T00:10:52.523066+0000","last_became_peered":"2024-08-19T00:10:52.523066+0000","last_unstale":"2024-08-19T00:13:18.743809+0000","last_undegraded":"2024-08-19T00:13:18.743809+0000","last_fullsized":"2024-08-19T00:13:18.743809+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:47:25.137487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"90'5","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.511735+0000","last_change":"2024-08-19T00:10:50.475827+0000","last_active":"2024-08-19T00:13:18.511735+0000","last_peered":"2024-08-19T00:13:18.511735+0000","last_clean":"2024-08-19T00:13:18.511735+0000","last_became_active":"2024-08-19T00:10:50.475470+0000","last_became_peered":"2024-08-19T00:10:50.475470+0000","last_unstale":"2024-08-19T00:13:18.511735+0000","last_undegraded":"2024-08-19T00:13:18.511735+0000","last_fullsized":"2024-08-19T00:13:18.511735+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:25:14.200317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.599896+0000","last_change":"2024-08-19T00:10:59.789047+0000","last_active":"2024-08-19T00:13:18.599896+0000","last_peered":"2024-08-19T00:13:18.599896+0000","last_clean":"2024-08-19T00:13:18.599896+0000","last_became_active":"2024-08-19T00:10:59.788694+0000","last_became_peered":"2024-08-19T00:10:59.788694+0000","last_unstale":"2024-08-19T00:13:18.599896+0000","last_undegraded":"2024-08-19T00:13:18.599896+0000","last_fullsized":"2024-08-19T00:13:18.599896+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:00:22.463593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"94'15","reported_seq":51,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744056+0000","last_change":"2024-08-19T00:10:52.511480+0000","last_active":"2024-08-19T00:13:18.744056+0000","last_peered":"2024-08-19T00:13:18.744056+0000","last_clean":"2024-08-19T00:13:18.744056+0000","last_became_active":"2024-08-19T00:10:52.511159+0000","last_became_peered":"2024-08-19T00:10:52.511159+0000","last_unstale":"2024-08-19T00:13:18.744056+0000","last_undegraded":"2024-08-19T00:13:18.744056+0000","last_fullsized":"2024-08-19T00:13:18.744056+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:28:31.136900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"90'5","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.608926+0000","last_change":"2024-08-19T00:10:50.476761+0000","last_active":"2024-08-19T00:13:18.608926+0000","last_peered":"2024-08-19T00:13:18.608926+0000","last_clean":"2024-08-19T00:13:18.608926+0000","last_became_active":"2024-08-19T00:10:50.476455+0000","last_became_peered":"2024-08-19T00:10:50.476455+0000","last_unstale":"2024-08-19T00:13:18.608926+0000","last_undegraded":"2024-08-19T00:13:18.608926+0000","last_fullsized":"2024-08-19T00:13:18.608926+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:34:52.158438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743981+0000","last_change":"2024-08-19T00:10:59.778313+0000","last_active":"2024-08-19T00:13:18.743981+0000","last_peered":"2024-08-19T00:13:18.743981+0000","last_clean":"2024-08-19T00:13:18.743981+0000","last_became_active":"2024-08-19T00:10:59.777831+0000","last_became_peered":"2024-08-19T00:10:59.777831+0000","last_unstale":"2024-08-19T00:13:18.743981+0000","last_undegraded":"2024-08-19T00:13:18.743981+0000","last_fullsized":"2024-08-19T00:13:18.743981+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:34:05.474277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"94'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743606+0000","last_change":"2024-08-19T00:10:52.513719+0000","last_active":"2024-08-19T00:13:18.743606+0000","last_peered":"2024-08-19T00:13:18.743606+0000","last_clean":"2024-08-19T00:13:18.743606+0000","last_became_active":"2024-08-19T00:10:52.513345+0000","last_became_peered":"2024-08-19T00:10:52.513345+0000","last_unstale":"2024-08-19T00:13:18.743606+0000","last_undegraded":"2024-08-19T00:13:18.743606+0000","last_fullsized":"2024-08-19T00:13:18.743606+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:50:28.862870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"90'9","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744336+0000","last_change":"2024-08-19T00:10:50.475529+0000","last_active":"2024-08-19T00:13:18.744336+0000","last_peered":"2024-08-19T00:13:18.744336+0000","last_clean":"2024-08-19T00:13:18.744336+0000","last_became_active":"2024-08-19T00:10:50.473544+0000","last_became_peered":"2024-08-19T00:10:50.473544+0000","last_unstale":"2024-08-19T00:13:18.744336+0000","last_undegraded":"2024-08-19T00:13:18.744336+0000","last_fullsized":"2024-08-19T00:13:18.744336+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:49:42.663650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.609068+0000","last_change":"2024-08-19T00:10:59.789028+0000","last_active":"2024-08-19T00:13:18.609068+0000","last_peered":"2024-08-19T00:13:18.609068+0000","last_clean":"2024-08-19T00:13:18.609068+0000","last_became_active":"2024-08-19T00:10:59.788606+0000","last_became_peered":"2024-08-19T00:10:59.788606+0000","last_unstale":"2024-08-19T00:13:18.609068+0000","last_undegraded":"2024-08-19T00:13:18.609068+0000","last_fullsized":"2024-08-19T00:13:18.609068+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:59:06.617755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"94'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.509199+0000","last_change":"2024-08-19T00:10:52.520826+0000","last_active":"2024-08-19T00:13:18.509199+0000","last_peered":"2024-08-19T00:13:18.509199+0000","last_clean":"2024-08-19T00:13:18.509199+0000","last_became_active":"2024-08-19T00:10:52.520437+0000","last_became_peered":"2024-08-19T00:10:52.520437+0000","last_unstale":"2024-08-19T00:13:18.509199+0000","last_undegraded":"2024-08-19T00:13:18.509199+0000","last_fullsized":"2024-08-19T00:13:18.509199+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:30:06.843697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"95'41","reported_seq":300,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:19.087442+0000","last_change":"2024-08-19T00:10:50.473195+0000","last_active":"2024-08-19T00:13:19.087442+0000","last_peered":"2024-08-19T00:13:19.087442+0000","last_clean":"2024-08-19T00:13:19.087442+0000","last_became_active":"2024-08-19T00:10:50.472863+0000","last_became_peered":"2024-08-19T00:10:50.472863+0000","last_unstale":"2024-08-19T00:13:19.087442+0000","last_undegraded":"2024-08-19T00:13:19.087442+0000","last_fullsized":"2024-08-19T00:13:19.087442+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:09:04.859829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69793,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":218,"num_read_kb":177,"num_write":43,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.611579+0000","last_change":"2024-08-19T00:11:39.922405+0000","last_active":"2024-08-19T00:13:18.611579+0000","last_peered":"2024-08-19T00:13:18.611579+0000","last_clean":"2024-08-19T00:13:18.611579+0000","last_became_active":"2024-08-19T00:11:39.922054+0000","last_became_peered":"2024-08-19T00:11:39.922054+0000","last_unstale":"2024-08-19T00:13:18.611579+0000","last_undegraded":"2024-08-19T00:13:18.611579+0000","last_fullsized":"2024-08-19T00:13:18.611579+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:47:01.990229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.14","version":"94'11","reported_seq":53,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743816+0000","last_change":"2024-08-19T00:11:39.918080+0000","last_active":"2024-08-19T00:13:18.743816+0000","last_peered":"2024-08-19T00:13:18.743816+0000","last_clean":"2024-08-19T00:13:18.743816+0000","last_became_active":"2024-08-19T00:11:39.917742+0000","last_became_peered":"2024-08-19T00:11:39.917742+0000","last_unstale":"2024-08-19T00:13:18.743816+0000","last_undegraded":"2024-08-19T00:13:18.743816+0000","last_fullsized":"2024-08-19T00:13:18.743816+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:57:19.983148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"90'5","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.609345+0000","last_change":"2024-08-19T00:10:50.618094+0000","last_active":"2024-08-19T00:13:18.609345+0000","last_peered":"2024-08-19T00:13:18.609345+0000","last_clean":"2024-08-19T00:13:18.609345+0000","last_became_active":"2024-08-19T00:10:50.617786+0000","last_became_peered":"2024-08-19T00:10:50.617786+0000","last_unstale":"2024-08-19T00:13:18.609345+0000","last_undegraded":"2024-08-19T00:13:18.609345+0000","last_fullsized":"2024-08-19T00:13:18.609345+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:05:46.231214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.511811+0000","last_change":"2024-08-19T00:10:59.780786+0000","last_active":"2024-08-19T00:13:18.511811+0000","last_peered":"2024-08-19T00:13:18.511811+0000","last_clean":"2024-08-19T00:13:18.511811+0000","last_became_active":"2024-08-19T00:10:59.780364+0000","last_became_peered":"2024-08-19T00:10:59.780364+0000","last_unstale":"2024-08-19T00:13:18.511811+0000","last_undegraded":"2024-08-19T00:13:18.511811+0000","last_fullsized":"2024-08-19T00:13:18.511811+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:39:45.113590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"94'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.745242+0000","last_change":"2024-08-19T00:10:52.520623+0000","last_active":"2024-08-19T00:13:18.745242+0000","last_peered":"2024-08-19T00:13:18.745242+0000","last_clean":"2024-08-19T00:13:18.745242+0000","last_became_active":"2024-08-19T00:10:52.520321+0000","last_became_peered":"2024-08-19T00:10:52.520321+0000","last_unstale":"2024-08-19T00:13:18.745242+0000","last_undegraded":"2024-08-19T00:13:18.745242+0000","last_fullsized":"2024-08-19T00:13:18.745242+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:56:42.526199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"90'4","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744494+0000","last_change":"2024-08-19T00:10:50.474925+0000","last_active":"2024-08-19T00:13:18.744494+0000","last_peered":"2024-08-19T00:13:18.744494+0000","last_clean":"2024-08-19T00:13:18.744494+0000","last_became_active":"2024-08-19T00:10:50.474573+0000","last_became_peered":"2024-08-19T00:10:50.474573+0000","last_unstale":"2024-08-19T00:13:18.744494+0000","last_undegraded":"2024-08-19T00:13:18.744494+0000","last_fullsized":"2024-08-19T00:13:18.744494+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:10:32.136867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.508672+0000","last_change":"2024-08-19T00:11:39.920527+0000","last_active":"2024-08-19T00:13:18.508672+0000","last_peered":"2024-08-19T00:13:18.508672+0000","last_clean":"2024-08-19T00:13:18.508672+0000","last_became_active":"2024-08-19T00:11:39.919490+0000","last_became_peered":"2024-08-19T00:11:39.919490+0000","last_unstale":"2024-08-19T00:13:18.508672+0000","last_undegraded":"2024-08-19T00:13:18.508672+0000","last_fullsized":"2024-08-19T00:13:18.508672+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:33:09.191177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"94'10","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743676+0000","last_change":"2024-08-19T00:10:52.510783+0000","last_active":"2024-08-19T00:13:18.743676+0000","last_peered":"2024-08-19T00:13:18.743676+0000","last_clean":"2024-08-19T00:13:18.743676+0000","last_became_active":"2024-08-19T00:10:52.510359+0000","last_became_peered":"2024-08-19T00:10:52.510359+0000","last_unstale":"2024-08-19T00:13:18.743676+0000","last_undegraded":"2024-08-19T00:13:18.743676+0000","last_fullsized":"2024-08-19T00:13:18.743676+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:20:03.682633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"95'6","reported_seq":253,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:19.065004+0000","last_change":"2024-08-19T00:10:50.470887+0000","last_active":"2024-08-19T00:13:19.065004+0000","last_peered":"2024-08-19T00:13:19.065004+0000","last_clean":"2024-08-19T00:13:19.065004+0000","last_became_active":"2024-08-19T00:10:50.470517+0000","last_became_peered":"2024-08-19T00:10:50.470517+0000","last_unstale":"2024-08-19T00:13:19.065004+0000","last_undegraded":"2024-08-19T00:13:19.065004+0000","last_fullsized":"2024-08-19T00:13:19.065004+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:52:33.864552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":206,"num_read_kb":206,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.507670+0000","last_change":"2024-08-19T00:10:59.787686+0000","last_active":"2024-08-19T00:13:18.507670+0000","last_peered":"2024-08-19T00:13:18.507670+0000","last_clean":"2024-08-19T00:13:18.507670+0000","last_became_active":"2024-08-19T00:10:59.787236+0000","last_became_peered":"2024-08-19T00:10:59.787236+0000","last_unstale":"2024-08-19T00:13:18.507670+0000","last_undegraded":"2024-08-19T00:13:18.507670+0000","last_fullsized":"2024-08-19T00:13:18.507670+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:57:11.012865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743827+0000","last_change":"2024-08-19T00:10:59.782541+0000","last_active":"2024-08-19T00:13:18.743827+0000","last_peered":"2024-08-19T00:13:18.743827+0000","last_clean":"2024-08-19T00:13:18.743827+0000","last_became_active":"2024-08-19T00:10:59.782136+0000","last_became_peered":"2024-08-19T00:10:59.782136+0000","last_unstale":"2024-08-19T00:13:18.743827+0000","last_undegraded":"2024-08-19T00:13:18.743827+0000","last_fullsized":"2024-08-19T00:13:18.743827+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:44:39.501168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"94'11","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.598488+0000","last_change":"2024-08-19T00:10:52.509396+0000","last_active":"2024-08-19T00:13:18.598488+0000","last_peered":"2024-08-19T00:13:18.598488+0000","last_clean":"2024-08-19T00:13:18.598488+0000","last_became_active":"2024-08-19T00:10:52.509075+0000","last_became_peered":"2024-08-19T00:10:52.509075+0000","last_unstale":"2024-08-19T00:13:18.598488+0000","last_undegraded":"2024-08-19T00:13:18.598488+0000","last_fullsized":"2024-08-19T00:13:18.598488+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:40:53.611213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"90'3","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.609141+0000","last_change":"2024-08-19T00:10:50.476723+0000","last_active":"2024-08-19T00:13:18.609141+0000","last_peered":"2024-08-19T00:13:18.609141+0000","last_clean":"2024-08-19T00:13:18.609141+0000","last_became_active":"2024-08-19T00:10:50.476399+0000","last_became_peered":"2024-08-19T00:10:50.476399+0000","last_unstale":"2024-08-19T00:13:18.609141+0000","last_undegraded":"2024-08-19T00:13:18.609141+0000","last_fullsized":"2024-08-19T00:13:18.609141+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:04:01.951387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744326+0000","last_change":"2024-08-19T00:10:59.781481+0000","last_active":"2024-08-19T00:13:18.744326+0000","last_peered":"2024-08-19T00:13:18.744326+0000","last_clean":"2024-08-19T00:13:18.744326+0000","last_became_active":"2024-08-19T00:10:59.780160+0000","last_became_peered":"2024-08-19T00:10:59.780160+0000","last_unstale":"2024-08-19T00:13:18.744326+0000","last_undegraded":"2024-08-19T00:13:18.744326+0000","last_fullsized":"2024-08-19T00:13:18.744326+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:14:46.340158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"94'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.507696+0000","last_change":"2024-08-19T00:10:52.516780+0000","last_active":"2024-08-19T00:13:18.507696+0000","last_peered":"2024-08-19T00:13:18.507696+0000","last_clean":"2024-08-19T00:13:18.507696+0000","last_became_active":"2024-08-19T00:10:52.513264+0000","last_became_peered":"2024-08-19T00:10:52.513264+0000","last_unstale":"2024-08-19T00:13:18.507696+0000","last_undegraded":"2024-08-19T00:13:18.507696+0000","last_fullsized":"2024-08-19T00:13:18.507696+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:36:49.238267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"90'3","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743315+0000","last_change":"2024-08-19T00:10:50.472840+0000","last_active":"2024-08-19T00:13:18.743315+0000","last_peered":"2024-08-19T00:13:18.743315+0000","last_clean":"2024-08-19T00:13:18.743315+0000","last_became_active":"2024-08-19T00:10:50.472534+0000","last_became_peered":"2024-08-19T00:10:50.472534+0000","last_unstale":"2024-08-19T00:13:18.743315+0000","last_undegraded":"2024-08-19T00:13:18.743315+0000","last_fullsized":"2024-08-19T00:13:18.743315+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:41:53.505360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"90'7","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.611874+0000","last_change":"2024-08-19T00:10:50.469342+0000","last_active":"2024-08-19T00:13:18.611874+0000","last_peered":"2024-08-19T00:13:18.611874+0000","last_clean":"2024-08-19T00:13:18.611874+0000","last_became_active":"2024-08-19T00:10:50.468800+0000","last_became_peered":"2024-08-19T00:10:50.468800+0000","last_unstale":"2024-08-19T00:13:18.611874+0000","last_undegraded":"2024-08-19T00:13:18.611874+0000","last_fullsized":"2024-08-19T00:13:18.611874+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:58:28.804117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"94'8","reported_seq":49,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.609074+0000","last_change":"2024-08-19T00:12:41.003498+0000","last_active":"2024-08-19T00:13:18.609074+0000","last_peered":"2024-08-19T00:13:18.609074+0000","last_clean":"2024-08-19T00:13:18.609074+0000","last_became_active":"2024-08-19T00:12:41.003165+0000","last_became_peered":"2024-08-19T00:12:41.003165+0000","last_unstale":"2024-08-19T00:13:18.609074+0000","last_undegraded":"2024-08-19T00:13:18.609074+0000","last_fullsized":"2024-08-19T00:13:18.609074+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:17:46.977154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744443+0000","last_change":"2024-08-19T00:11:39.922401+0000","last_active":"2024-08-19T00:13:18.744443+0000","last_peered":"2024-08-19T00:13:18.744443+0000","last_clean":"2024-08-19T00:13:18.744443+0000","last_became_active":"2024-08-19T00:11:39.921979+0000","last_became_peered":"2024-08-19T00:11:39.921979+0000","last_unstale":"2024-08-19T00:13:18.744443+0000","last_undegraded":"2024-08-19T00:13:18.744443+0000","last_fullsized":"2024-08-19T00:13:18.744443+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:58:57.453222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,8],"acting":[2,6,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"95'6","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:19.065950+0000","last_change":"2024-08-19T00:10:50.476035+0000","last_active":"2024-08-19T00:13:19.065950+0000","last_peered":"2024-08-19T00:13:19.065950+0000","last_clean":"2024-08-19T00:13:19.065950+0000","last_became_active":"2024-08-19T00:10:50.475733+0000","last_became_peered":"2024-08-19T00:10:50.475733+0000","last_unstale":"2024-08-19T00:13:19.065950+0000","last_undegraded":"2024-08-19T00:13:19.065950+0000","last_fullsized":"2024-08-19T00:13:19.065950+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:27:59.026582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1012,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"94'7","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.508894+0000","last_change":"2024-08-19T00:10:52.522185+0000","last_active":"2024-08-19T00:13:18.508894+0000","last_peered":"2024-08-19T00:13:18.508894+0000","last_clean":"2024-08-19T00:13:18.508894+0000","last_became_active":"2024-08-19T00:10:52.521747+0000","last_became_peered":"2024-08-19T00:10:52.521747+0000","last_unstale":"2024-08-19T00:13:18.508894+0000","last_undegraded":"2024-08-19T00:13:18.508894+0000","last_fullsized":"2024-08-19T00:13:18.508894+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:14:23.631484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744081+0000","last_change":"2024-08-19T00:10:59.783512+0000","last_active":"2024-08-19T00:13:18.744081+0000","last_peered":"2024-08-19T00:13:18.744081+0000","last_clean":"2024-08-19T00:13:18.744081+0000","last_became_active":"2024-08-19T00:10:59.783099+0000","last_became_peered":"2024-08-19T00:10:59.783099+0000","last_unstale":"2024-08-19T00:13:18.744081+0000","last_undegraded":"2024-08-19T00:13:18.744081+0000","last_fullsized":"2024-08-19T00:13:18.744081+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:02:27.977608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"94'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743805+0000","last_change":"2024-08-19T00:10:52.524213+0000","last_active":"2024-08-19T00:13:18.743805+0000","last_peered":"2024-08-19T00:13:18.743805+0000","last_clean":"2024-08-19T00:13:18.743805+0000","last_became_active":"2024-08-19T00:10:52.523185+0000","last_became_peered":"2024-08-19T00:10:52.523185+0000","last_unstale":"2024-08-19T00:13:18.743805+0000","last_undegraded":"2024-08-19T00:13:18.743805+0000","last_fullsized":"2024-08-19T00:13:18.743805+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:23:48.569312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"94'12","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744418+0000","last_change":"2024-08-19T00:10:52.521436+0000","last_active":"2024-08-19T00:13:18.744418+0000","last_peered":"2024-08-19T00:13:18.744418+0000","last_clean":"2024-08-19T00:13:18.744418+0000","last_became_active":"2024-08-19T00:10:52.520842+0000","last_became_peered":"2024-08-19T00:10:52.520842+0000","last_unstale":"2024-08-19T00:13:18.744418+0000","last_undegraded":"2024-08-19T00:13:18.744418+0000","last_fullsized":"2024-08-19T00:13:18.744418+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:22:31.568680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"94'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743973+0000","last_change":"2024-08-19T00:10:52.514170+0000","last_active":"2024-08-19T00:13:18.743973+0000","last_peered":"2024-08-19T00:13:18.743973+0000","last_clean":"2024-08-19T00:13:18.743973+0000","last_became_active":"2024-08-19T00:10:52.513870+0000","last_became_peered":"2024-08-19T00:10:52.513870+0000","last_unstale":"2024-08-19T00:13:18.743973+0000","last_undegraded":"2024-08-19T00:13:18.743973+0000","last_fullsized":"2024-08-19T00:13:18.743973+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:29:04.125347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"94'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743995+0000","last_change":"2024-08-19T00:10:52.512320+0000","last_active":"2024-08-19T00:13:18.743995+0000","last_peered":"2024-08-19T00:13:18.743995+0000","last_clean":"2024-08-19T00:13:18.743995+0000","last_became_active":"2024-08-19T00:10:52.512003+0000","last_became_peered":"2024-08-19T00:10:52.512003+0000","last_unstale":"2024-08-19T00:13:18.743995+0000","last_undegraded":"2024-08-19T00:13:18.743995+0000","last_fullsized":"2024-08-19T00:13:18.743995+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:28:52.261457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"94'4","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744707+0000","last_change":"2024-08-19T00:10:52.511454+0000","last_active":"2024-08-19T00:13:18.744707+0000","last_peered":"2024-08-19T00:13:18.744707+0000","last_clean":"2024-08-19T00:13:18.744707+0000","last_became_active":"2024-08-19T00:10:52.511036+0000","last_became_peered":"2024-08-19T00:10:52.511036+0000","last_unstale":"2024-08-19T00:13:18.744707+0000","last_undegraded":"2024-08-19T00:13:18.744707+0000","last_fullsized":"2024-08-19T00:13:18.744707+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:14:04.749222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"94'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744667+0000","last_change":"2024-08-19T00:10:52.526393+0000","last_active":"2024-08-19T00:13:18.744667+0000","last_peered":"2024-08-19T00:13:18.744667+0000","last_clean":"2024-08-19T00:13:18.744667+0000","last_became_active":"2024-08-19T00:10:52.526043+0000","last_became_peered":"2024-08-19T00:10:52.526043+0000","last_unstale":"2024-08-19T00:13:18.744667+0000","last_undegraded":"2024-08-19T00:13:18.744667+0000","last_fullsized":"2024-08-19T00:13:18.744667+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:18:48.505255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"94'15","reported_seq":51,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744575+0000","last_change":"2024-08-19T00:10:52.516028+0000","last_active":"2024-08-19T00:13:18.744575+0000","last_peered":"2024-08-19T00:13:18.744575+0000","last_clean":"2024-08-19T00:13:18.744575+0000","last_became_active":"2024-08-19T00:10:52.515659+0000","last_became_peered":"2024-08-19T00:10:52.515659+0000","last_unstale":"2024-08-19T00:13:18.744575+0000","last_undegraded":"2024-08-19T00:13:18.744575+0000","last_fullsized":"2024-08-19T00:13:18.744575+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:31:14.995175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"94'2","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.509366+0000","last_change":"2024-08-19T00:10:52.516196+0000","last_active":"2024-08-19T00:13:18.509366+0000","last_peered":"2024-08-19T00:13:18.509366+0000","last_clean":"2024-08-19T00:13:18.509366+0000","last_became_active":"2024-08-19T00:10:52.515533+0000","last_became_peered":"2024-08-19T00:10:52.515533+0000","last_unstale":"2024-08-19T00:13:18.509366+0000","last_undegraded":"2024-08-19T00:13:18.509366+0000","last_fullsized":"2024-08-19T00:13:18.509366+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:32:25.207184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"94'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.608755+0000","last_change":"2024-08-19T00:10:52.527433+0000","last_active":"2024-08-19T00:13:18.608755+0000","last_peered":"2024-08-19T00:13:18.608755+0000","last_clean":"2024-08-19T00:13:18.608755+0000","last_became_active":"2024-08-19T00:10:52.525490+0000","last_became_peered":"2024-08-19T00:10:52.525490+0000","last_unstale":"2024-08-19T00:13:18.608755+0000","last_undegraded":"2024-08-19T00:13:18.608755+0000","last_fullsized":"2024-08-19T00:13:18.608755+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:21:14.545808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"94'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.507749+0000","last_change":"2024-08-19T00:10:52.515503+0000","last_active":"2024-08-19T00:13:18.507749+0000","last_peered":"2024-08-19T00:13:18.507749+0000","last_clean":"2024-08-19T00:13:18.507749+0000","last_became_active":"2024-08-19T00:10:52.515178+0000","last_became_peered":"2024-08-19T00:10:52.515178+0000","last_unstale":"2024-08-19T00:13:18.507749+0000","last_undegraded":"2024-08-19T00:13:18.507749+0000","last_fullsized":"2024-08-19T00:13:18.507749+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:30:27.825463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"94'10","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743607+0000","last_change":"2024-08-19T00:10:52.515133+0000","last_active":"2024-08-19T00:13:18.743607+0000","last_peered":"2024-08-19T00:13:18.743607+0000","last_clean":"2024-08-19T00:13:18.743607+0000","last_became_active":"2024-08-19T00:10:52.514851+0000","last_became_peered":"2024-08-19T00:10:52.514851+0000","last_unstale":"2024-08-19T00:13:18.743607+0000","last_undegraded":"2024-08-19T00:13:18.743607+0000","last_fullsized":"2024-08-19T00:13:18.743607+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:38:53.593993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"94'11","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744148+0000","last_change":"2024-08-19T00:10:52.512127+0000","last_active":"2024-08-19T00:13:18.744148+0000","last_peered":"2024-08-19T00:13:18.744148+0000","last_clean":"2024-08-19T00:13:18.744148+0000","last_became_active":"2024-08-19T00:10:52.511840+0000","last_became_peered":"2024-08-19T00:10:52.511840+0000","last_unstale":"2024-08-19T00:13:18.744148+0000","last_undegraded":"2024-08-19T00:13:18.744148+0000","last_fullsized":"2024-08-19T00:13:18.744148+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:36:32.878531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"94'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744083+0000","last_change":"2024-08-19T00:10:52.519470+0000","last_active":"2024-08-19T00:13:18.744083+0000","last_peered":"2024-08-19T00:13:18.744083+0000","last_clean":"2024-08-19T00:13:18.744083+0000","last_became_active":"2024-08-19T00:10:52.519131+0000","last_became_peered":"2024-08-19T00:10:52.519131+0000","last_unstale":"2024-08-19T00:13:18.744083+0000","last_undegraded":"2024-08-19T00:13:18.744083+0000","last_fullsized":"2024-08-19T00:13:18.744083+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:56:53.628868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"94'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744233+0000","last_change":"2024-08-19T00:10:52.511114+0000","last_active":"2024-08-19T00:13:18.744233+0000","last_peered":"2024-08-19T00:13:18.744233+0000","last_clean":"2024-08-19T00:13:18.744233+0000","last_became_active":"2024-08-19T00:10:52.510759+0000","last_became_peered":"2024-08-19T00:10:52.510759+0000","last_unstale":"2024-08-19T00:13:18.744233+0000","last_undegraded":"2024-08-19T00:13:18.744233+0000","last_fullsized":"2024-08-19T00:13:18.744233+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:54:10.590297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"94'10","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.600061+0000","last_change":"2024-08-19T00:10:52.507998+0000","last_active":"2024-08-19T00:13:18.600061+0000","last_peered":"2024-08-19T00:13:18.600061+0000","last_clean":"2024-08-19T00:13:18.600061+0000","last_became_active":"2024-08-19T00:10:52.507679+0000","last_became_peered":"2024-08-19T00:10:52.507679+0000","last_unstale":"2024-08-19T00:13:18.600061+0000","last_undegraded":"2024-08-19T00:13:18.600061+0000","last_fullsized":"2024-08-19T00:13:18.600061+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:59:48.098911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"94'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744812+0000","last_change":"2024-08-19T00:10:52.524171+0000","last_active":"2024-08-19T00:13:18.744812+0000","last_peered":"2024-08-19T00:13:18.744812+0000","last_clean":"2024-08-19T00:13:18.744812+0000","last_became_active":"2024-08-19T00:10:52.523028+0000","last_became_peered":"2024-08-19T00:10:52.523028+0000","last_unstale":"2024-08-19T00:13:18.744812+0000","last_undegraded":"2024-08-19T00:13:18.744812+0000","last_fullsized":"2024-08-19T00:13:18.744812+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:51:24.567971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"94'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743295+0000","last_change":"2024-08-19T00:10:52.514309+0000","last_active":"2024-08-19T00:13:18.743295+0000","last_peered":"2024-08-19T00:13:18.743295+0000","last_clean":"2024-08-19T00:13:18.743295+0000","last_became_active":"2024-08-19T00:10:52.513992+0000","last_became_peered":"2024-08-19T00:10:52.513992+0000","last_unstale":"2024-08-19T00:13:18.743295+0000","last_undegraded":"2024-08-19T00:13:18.743295+0000","last_fullsized":"2024-08-19T00:13:18.743295+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:34:14.014490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"94'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743785+0000","last_change":"2024-08-19T00:10:52.516033+0000","last_active":"2024-08-19T00:13:18.743785+0000","last_peered":"2024-08-19T00:13:18.743785+0000","last_clean":"2024-08-19T00:13:18.743785+0000","last_became_active":"2024-08-19T00:10:52.515713+0000","last_became_peered":"2024-08-19T00:10:52.515713+0000","last_unstale":"2024-08-19T00:13:18.743785+0000","last_undegraded":"2024-08-19T00:13:18.743785+0000","last_fullsized":"2024-08-19T00:13:18.743785+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:06:40.832460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"94'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743710+0000","last_change":"2024-08-19T00:10:52.518521+0000","last_active":"2024-08-19T00:13:18.743710+0000","last_peered":"2024-08-19T00:13:18.743710+0000","last_clean":"2024-08-19T00:13:18.743710+0000","last_became_active":"2024-08-19T00:10:52.518237+0000","last_became_peered":"2024-08-19T00:10:52.518237+0000","last_unstale":"2024-08-19T00:13:18.743710+0000","last_undegraded":"2024-08-19T00:13:18.743710+0000","last_fullsized":"2024-08-19T00:13:18.743710+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:17:20.569044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"94'10","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744044+0000","last_change":"2024-08-19T00:10:52.519774+0000","last_active":"2024-08-19T00:13:18.744044+0000","last_peered":"2024-08-19T00:13:18.744044+0000","last_clean":"2024-08-19T00:13:18.744044+0000","last_became_active":"2024-08-19T00:10:52.519456+0000","last_became_peered":"2024-08-19T00:10:52.519456+0000","last_unstale":"2024-08-19T00:13:18.744044+0000","last_undegraded":"2024-08-19T00:13:18.744044+0000","last_fullsized":"2024-08-19T00:13:18.744044+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:47:52.675650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"94'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.512063+0000","last_change":"2024-08-19T00:10:52.514200+0000","last_active":"2024-08-19T00:13:18.512063+0000","last_peered":"2024-08-19T00:13:18.512063+0000","last_clean":"2024-08-19T00:13:18.512063+0000","last_became_active":"2024-08-19T00:10:52.513821+0000","last_became_peered":"2024-08-19T00:10:52.513821+0000","last_unstale":"2024-08-19T00:13:18.512063+0000","last_undegraded":"2024-08-19T00:13:18.512063+0000","last_fullsized":"2024-08-19T00:13:18.512063+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:15:30.084873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"94'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744616+0000","last_change":"2024-08-19T00:10:52.519781+0000","last_active":"2024-08-19T00:13:18.744616+0000","last_peered":"2024-08-19T00:13:18.744616+0000","last_clean":"2024-08-19T00:13:18.744616+0000","last_became_active":"2024-08-19T00:10:52.519395+0000","last_became_peered":"2024-08-19T00:10:52.519395+0000","last_unstale":"2024-08-19T00:13:18.744616+0000","last_undegraded":"2024-08-19T00:13:18.744616+0000","last_fullsized":"2024-08-19T00:13:18.744616+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:10:15.160535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"94'16","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.612076+0000","last_change":"2024-08-19T00:10:52.510293+0000","last_active":"2024-08-19T00:13:18.612076+0000","last_peered":"2024-08-19T00:13:18.612076+0000","last_clean":"2024-08-19T00:13:18.612076+0000","last_became_active":"2024-08-19T00:10:52.509983+0000","last_became_peered":"2024-08-19T00:10:52.509983+0000","last_unstale":"2024-08-19T00:13:18.612076+0000","last_undegraded":"2024-08-19T00:13:18.612076+0000","last_fullsized":"2024-08-19T00:13:18.612076+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:59:11.488742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"94'11","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743853+0000","last_change":"2024-08-19T00:10:52.518778+0000","last_active":"2024-08-19T00:13:18.743853+0000","last_peered":"2024-08-19T00:13:18.743853+0000","last_clean":"2024-08-19T00:13:18.743853+0000","last_became_active":"2024-08-19T00:10:52.518209+0000","last_became_peered":"2024-08-19T00:10:52.518209+0000","last_unstale":"2024-08-19T00:13:18.743853+0000","last_undegraded":"2024-08-19T00:13:18.743853+0000","last_fullsized":"2024-08-19T00:13:18.743853+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:23:19.255833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"94'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.507723+0000","last_change":"2024-08-19T00:10:52.523824+0000","last_active":"2024-08-19T00:13:18.507723+0000","last_peered":"2024-08-19T00:13:18.507723+0000","last_clean":"2024-08-19T00:13:18.507723+0000","last_became_active":"2024-08-19T00:10:52.523075+0000","last_became_peered":"2024-08-19T00:10:52.523075+0000","last_unstale":"2024-08-19T00:13:18.507723+0000","last_undegraded":"2024-08-19T00:13:18.507723+0000","last_fullsized":"2024-08-19T00:13:18.507723+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:23:58.618712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"94'5","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743412+0000","last_change":"2024-08-19T00:10:52.523508+0000","last_active":"2024-08-19T00:13:18.743412+0000","last_peered":"2024-08-19T00:13:18.743412+0000","last_clean":"2024-08-19T00:13:18.743412+0000","last_became_active":"2024-08-19T00:10:52.523104+0000","last_became_peered":"2024-08-19T00:10:52.523104+0000","last_unstale":"2024-08-19T00:13:18.743412+0000","last_undegraded":"2024-08-19T00:13:18.743412+0000","last_fullsized":"2024-08-19T00:13:18.743412+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:04:06.932548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"94'6","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.611708+0000","last_change":"2024-08-19T00:10:52.510147+0000","last_active":"2024-08-19T00:13:18.611708+0000","last_peered":"2024-08-19T00:13:18.611708+0000","last_clean":"2024-08-19T00:13:18.611708+0000","last_became_active":"2024-08-19T00:10:52.509807+0000","last_became_peered":"2024-08-19T00:10:52.509807+0000","last_unstale":"2024-08-19T00:13:18.611708+0000","last_undegraded":"2024-08-19T00:13:18.611708+0000","last_fullsized":"2024-08-19T00:13:18.611708+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:09:55.965318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"94'4","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.509061+0000","last_change":"2024-08-19T00:10:52.512997+0000","last_active":"2024-08-19T00:13:18.509061+0000","last_peered":"2024-08-19T00:13:18.509061+0000","last_clean":"2024-08-19T00:13:18.509061+0000","last_became_active":"2024-08-19T00:10:52.512688+0000","last_became_peered":"2024-08-19T00:10:52.512688+0000","last_unstale":"2024-08-19T00:13:18.509061+0000","last_undegraded":"2024-08-19T00:13:18.509061+0000","last_fullsized":"2024-08-19T00:13:18.509061+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:57:33.607060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"94'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.512004+0000","last_change":"2024-08-19T00:10:52.517492+0000","last_active":"2024-08-19T00:13:18.512004+0000","last_peered":"2024-08-19T00:13:18.512004+0000","last_clean":"2024-08-19T00:13:18.512004+0000","last_became_active":"2024-08-19T00:10:52.517153+0000","last_became_peered":"2024-08-19T00:10:52.517153+0000","last_unstale":"2024-08-19T00:13:18.512004+0000","last_undegraded":"2024-08-19T00:13:18.512004+0000","last_fullsized":"2024-08-19T00:13:18.512004+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:07:07.244331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"94'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744527+0000","last_change":"2024-08-19T00:10:52.517396+0000","last_active":"2024-08-19T00:13:18.744527+0000","last_peered":"2024-08-19T00:13:18.744527+0000","last_clean":"2024-08-19T00:13:18.744527+0000","last_became_active":"2024-08-19T00:10:52.517108+0000","last_became_peered":"2024-08-19T00:10:52.517108+0000","last_unstale":"2024-08-19T00:13:18.744527+0000","last_undegraded":"2024-08-19T00:13:18.744527+0000","last_fullsized":"2024-08-19T00:13:18.744527+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:10:41.477770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"94'4","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743934+0000","last_change":"2024-08-19T00:10:52.515841+0000","last_active":"2024-08-19T00:13:18.743934+0000","last_peered":"2024-08-19T00:13:18.743934+0000","last_clean":"2024-08-19T00:13:18.743934+0000","last_became_active":"2024-08-19T00:10:52.515524+0000","last_became_peered":"2024-08-19T00:10:52.515524+0000","last_unstale":"2024-08-19T00:13:18.743934+0000","last_undegraded":"2024-08-19T00:13:18.743934+0000","last_fullsized":"2024-08-19T00:13:18.743934+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:18:51.991468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"94'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744654+0000","last_change":"2024-08-19T00:10:52.522670+0000","last_active":"2024-08-19T00:13:18.744654+0000","last_peered":"2024-08-19T00:13:18.744654+0000","last_clean":"2024-08-19T00:13:18.744654+0000","last_became_active":"2024-08-19T00:10:52.522275+0000","last_became_peered":"2024-08-19T00:10:52.522275+0000","last_unstale":"2024-08-19T00:13:18.744654+0000","last_undegraded":"2024-08-19T00:13:18.744654+0000","last_fullsized":"2024-08-19T00:13:18.744654+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:55:48.756230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":602981,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":1171,"num_read_kb":705,"num_write":377,"num_write_kb":1468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2371584,"data_stored":2005965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":303,"ondisk_log_size":303,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449131,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36428,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708724,"statfs":{"total":95995035648,"available":95957733376,"internally_reserved":0,"allocated":1114112,"data_stored":548434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":71,"seq":304942678062,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37292,"kb_used_data":1896,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93707860,"statfs":{"total":95995035648,"available":95956848640,"internally_reserved":0,"allocated":1941504,"data_stored":1335751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":65,"seq":279172874291,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28512,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716640,"statfs":{"total":95995035648,"available":95965839360,"internally_reserved":0,"allocated":1527808,"data_stored":944784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135927,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28496,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716656,"statfs":{"total":95995035648,"available":95965855744,"internally_reserved":0,"allocated":1511424,"data_stored":940954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397564,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37024,"kb_used_data":1684,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708128,"statfs":{"total":95995035648,"available":95957123072,"internally_reserved":0,"allocated":1724416,"data_stored":1145126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561090,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28096,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717056,"statfs":{"total":95995035648,"available":95966265344,"internally_reserved":0,"allocated":1105920,"data_stored":544146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822725,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37340,"kb_used_data":1824,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93707812,"statfs":{"total":95995035648,"available":95956799488,"internally_reserved":0,"allocated":1867776,"data_stored":1271138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986250,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36428,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708724,"statfs":{"total":95995035648,"available":95957733376,"internally_reserved":0,"allocated":1114112,"data_stored":547050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215183,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37256,"kb_used_data":1800,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93707896,"statfs":{"total":95995035648,"available":95956885504,"internally_reserved":0,"allocated":1843200,"data_stored":1264132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411410,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36508,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708644,"statfs":{"total":95995035648,"available":95957651456,"internally_reserved":0,"allocated":1200128,"data_stored":615189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28172,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716980,"statfs":{"total":95995035648,"available":95966187520,"internally_reserved":0,"allocated":1179648,"data_stored":614579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738460,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36444,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708708,"statfs":{"total":95995035648,"available":95957716992,"internally_reserved":0,"allocated":1130496,"data_stored":545212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":72325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":72935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":753664,"data_stored":721878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":134810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":394604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":394338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":258048,"data_stored":203129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-19T00:13:25.958 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-08-19T00:13:25.958 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph pg dump --format=json 2024-08-19T00:13:26.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:25 smithi171 ceph-mon[21810]: pgmap v6: 129 pgs: 129 active+clean; 1.1 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 205 B/s wr, 1 op/s 2024-08-19T00:13:26.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:25 smithi171 ceph-mon[21810]: from='client.15420 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-19T00:13:26.224 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:13:26.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:26.685+0000 7f55d9386640 1 -- 172.21.15.44:0/1043484732 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55d410bea0 msgr2=0x7f55d410e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:26.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:26.685+0000 7f55d9386640 1 --2- 172.21.15.44:0/1043484732 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55d410bea0 0x7f55d410e340 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f55cc009ca0 tx=0x7f55cc02a950 comp rx=0 tx=0).stop 2024-08-19T00:13:26.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:26.685+0000 7f55d9386640 1 -- 172.21.15.44:0/1043484732 shutdown_connections 2024-08-19T00:13:26.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:26.685+0000 7f55d9386640 1 --2- 172.21.15.44:0/1043484732 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55d410bea0 0x7f55d410e340 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:26.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:26.685+0000 7f55d9386640 1 --2- 172.21.15.44:0/1043484732 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f55d4103390 0x7f55d410b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:26.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:26.685+0000 7f55d9386640 1 --2- 172.21.15.44:0/1043484732 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f55d4102a70 0x7f55d4102e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:26.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:26.685+0000 7f55d9386640 1 -- 172.21.15.44:0/1043484732 >> 172.21.15.44:0/1043484732 conn(0x7f55d40fc4d0 msgr2=0x7f55d40fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:26.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:26.685+0000 7f55d9386640 1 -- 172.21.15.44:0/1043484732 shutdown_connections 2024-08-19T00:13:26.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:26.685+0000 7f55d9386640 1 -- 172.21.15.44:0/1043484732 wait complete. 2024-08-19T00:13:26.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:26.686+0000 7f55d9386640 1 Processor -- start 2024-08-19T00:13:26.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:26.686+0000 7f55d9386640 1 -- start start 2024-08-19T00:13:26.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:26.686+0000 7f55d9386640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f55d4102a70 0x7f55d4198100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:26.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:26.686+0000 7f55d9386640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55d4103390 0x7f55d4198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:26.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:26.686+0000 7f55d9386640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f55d410bea0 0x7f55d419c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:26.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:26.686+0000 7f55d9386640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f55d4111ce0 con 0x7f55d4103390 2024-08-19T00:13:26.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:26.686+0000 7f55d9386640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f55d4111b60 con 0x7f55d410bea0 2024-08-19T00:13:26.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:26.686+0000 7f55d9386640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f55d4111e60 con 0x7f55d4102a70 2024-08-19T00:13:26.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:26.686+0000 7f55cbfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55d4103390 0x7f55d4198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:26.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:26.686+0000 7f55cbfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55d4103390 0x7f55d4198640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37134/0 (socket says 172.21.15.44:37134) 2024-08-19T00:13:26.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:26.686+0000 7f55cbfff640 1 -- 172.21.15.44:0/1229229685 learned_addr learned my addr 172.21.15.44:0/1229229685 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:26.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:26.686+0000 7f55d37fe640 1 --2- 172.21.15.44:0/1229229685 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f55d410bea0 0x7f55d419c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:26.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:26.686+0000 7f55d2ffd640 1 --2- 172.21.15.44:0/1229229685 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f55d4102a70 0x7f55d4198100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:26.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:26.687+0000 7f55cbfff640 1 -- 172.21.15.44:0/1229229685 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f55d4102a70 msgr2=0x7f55d4198100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:26.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:26.687+0000 7f55cbfff640 1 --2- 172.21.15.44:0/1229229685 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f55d4102a70 0x7f55d4198100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:26.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:26.687+0000 7f55cbfff640 1 -- 172.21.15.44:0/1229229685 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f55d410bea0 msgr2=0x7f55d419c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:26.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:26.687+0000 7f55cbfff640 1 --2- 172.21.15.44:0/1229229685 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f55d410bea0 0x7f55d419c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:26.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:26.687+0000 7f55cbfff640 1 -- 172.21.15.44:0/1229229685 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55d419d0b0 con 0x7f55d4103390 2024-08-19T00:13:26.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:26.687+0000 7f55cbfff640 1 --2- 172.21.15.44:0/1229229685 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55d4103390 0x7f55d4198640 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f55bc00c970 tx=0x7f55bc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:26.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:26.687+0000 7f55d0ff9640 1 -- 172.21.15.44:0/1229229685 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55bc007bb0 con 0x7f55d4103390 2024-08-19T00:13:26.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:26.687+0000 7f55d9386640 1 -- 172.21.15.44:0/1229229685 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55d419d3a0 con 0x7f55d4103390 2024-08-19T00:13:26.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:26.687+0000 7f55d0ff9640 1 -- 172.21.15.44:0/1229229685 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f55bc007d50 con 0x7f55d4103390 2024-08-19T00:13:26.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:26.687+0000 7f55d0ff9640 1 -- 172.21.15.44:0/1229229685 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55bc018820 con 0x7f55d4103390 2024-08-19T00:13:26.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:26.687+0000 7f55d9386640 1 -- 172.21.15.44:0/1229229685 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55d41a4c80 con 0x7f55d4103390 2024-08-19T00:13:26.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:26.688+0000 7f55d9386640 1 -- 172.21.15.44:0/1229229685 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55d4102e50 con 0x7f55d4103390 2024-08-19T00:13:26.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:26.689+0000 7f55d0ff9640 1 -- 172.21.15.44:0/1229229685 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 24) ==== 138060+0+0 (secure 0 0 0) 0x7f55bc0189c0 con 0x7f55d4103390 2024-08-19T00:13:26.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:26.690+0000 7f55d0ff9640 1 --2- 172.21.15.44:0/1229229685 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f55c00a2e10 0x7f55c00a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:26.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:26.690+0000 7f55d0ff9640 1 -- 172.21.15.44:0/1229229685 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f55bc0cfd70 con 0x7f55d4103390 2024-08-19T00:13:26.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:26.690+0000 7f55d2ffd640 1 --2- 172.21.15.44:0/1229229685 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f55c00a2e10 0x7f55c00a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:26.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:26.690+0000 7f55d2ffd640 1 --2- 172.21.15.44:0/1229229685 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f55c00a2e10 0x7f55c00a52d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f55c4009890 tx=0x7f55c4008040 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:26.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:26.693+0000 7f55d0ff9640 1 -- 172.21.15.44:0/1229229685 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f55bc014030 con 0x7f55d4103390 2024-08-19T00:13:26.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:26.867+0000 7f55d9386640 1 -- 172.21.15.44:0/1229229685 --> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f55d40fe7f0 con 0x7f55c00a2e10 2024-08-19T00:13:26.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:26.875+0000 7f55d0ff9640 1 -- 172.21.15.44:0/1229229685 <== mgr.15297 v2:172.21.15.44:6800/1029670730 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+339458 (secure 0 0 0) 0x7f55d40fe7f0 con 0x7f55c00a2e10 2024-08-19T00:13:26.879 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:13:26.881 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-08-19T00:13:26.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:26.878+0000 7f55d9386640 1 -- 172.21.15.44:0/1229229685 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f55c00a2e10 msgr2=0x7f55c00a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:26.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:26.878+0000 7f55d9386640 1 --2- 172.21.15.44:0/1229229685 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f55c00a2e10 0x7f55c00a52d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f55c4009890 tx=0x7f55c4008040 comp rx=0 tx=0).stop 2024-08-19T00:13:26.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:26.878+0000 7f55d9386640 1 -- 172.21.15.44:0/1229229685 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55d4103390 msgr2=0x7f55d4198640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:26.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:26.878+0000 7f55d9386640 1 --2- 172.21.15.44:0/1229229685 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55d4103390 0x7f55d4198640 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f55bc00c970 tx=0x7f55bc00ce30 comp rx=0 tx=0).stop 2024-08-19T00:13:26.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:26.878+0000 7f55d9386640 1 -- 172.21.15.44:0/1229229685 shutdown_connections 2024-08-19T00:13:26.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:26.878+0000 7f55d9386640 1 --2- 172.21.15.44:0/1229229685 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f55c00a2e10 0x7f55c00a52d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:26.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:26.878+0000 7f55d9386640 1 --2- 172.21.15.44:0/1229229685 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f55d410bea0 0x7f55d419c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:26.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:26.878+0000 7f55d9386640 1 --2- 172.21.15.44:0/1229229685 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55d4103390 0x7f55d4198640 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:26.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:26.878+0000 7f55d9386640 1 --2- 172.21.15.44:0/1229229685 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f55d4102a70 0x7f55d4198100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:26.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:26.878+0000 7f55d9386640 1 -- 172.21.15.44:0/1229229685 >> 172.21.15.44:0/1229229685 conn(0x7f55d40fc4d0 msgr2=0x7f55d40fd0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:26.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:26.878+0000 7f55d9386640 1 -- 172.21.15.44:0/1229229685 shutdown_connections 2024-08-19T00:13:26.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:26.878+0000 7f55d9386640 1 -- 172.21.15.44:0/1229229685 wait complete. 2024-08-19T00:13:27.555 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":7,"stamp":"2024-08-19T00:13:26.521709+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1394295,"num_objects":104,"num_object_clones":0,"num_object_copies":314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":1711,"num_read_kb":1292,"num_write":715,"num_write_kb":5331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1180848,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1039,"ondisk_log_size":1039,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":408256,"kb_used_data":17252,"kb_used_omap":18,"kb_used_meta":390637,"kb_avail":1124533568,"statfs":{"total":1151940427776,"available":1151522373632,"internally_reserved":0,"allocated":17666048,"data_stored":10721999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":400012601},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":200712,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":409,"num_read_kb":473,"num_write":156,"num_write_kb":924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.989981"},"pg_stats":[{"pgid":"2.1f","version":"95'14","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:23.057076+0000","last_change":"2024-08-19T00:10:50.471635+0000","last_active":"2024-08-19T00:13:23.057076+0000","last_peered":"2024-08-19T00:13:23.057076+0000","last_clean":"2024-08-19T00:13:23.057076+0000","last_became_active":"2024-08-19T00:10:50.471324+0000","last_became_peered":"2024-08-19T00:10:50.471324+0000","last_unstale":"2024-08-19T00:13:23.057076+0000","last_undegraded":"2024-08-19T00:13:23.057076+0000","last_fullsized":"2024-08-19T00:13:23.057076+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:41:02.945782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":109,"num_read_kb":109,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"94'5","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.598581+0000","last_change":"2024-08-19T00:12:40.812782+0000","last_active":"2024-08-19T00:13:18.598581+0000","last_peered":"2024-08-19T00:13:18.598581+0000","last_clean":"2024-08-19T00:13:18.598581+0000","last_became_active":"2024-08-19T00:12:40.812506+0000","last_became_peered":"2024-08-19T00:12:40.812506+0000","last_unstale":"2024-08-19T00:13:18.598581+0000","last_undegraded":"2024-08-19T00:13:18.598581+0000","last_fullsized":"2024-08-19T00:13:18.598581+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:32:54.681461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,8],"acting":[9,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744057+0000","last_change":"2024-08-19T00:10:59.789370+0000","last_active":"2024-08-19T00:13:18.744057+0000","last_peered":"2024-08-19T00:13:18.744057+0000","last_clean":"2024-08-19T00:13:18.744057+0000","last_became_active":"2024-08-19T00:10:59.788901+0000","last_became_peered":"2024-08-19T00:10:59.788901+0000","last_unstale":"2024-08-19T00:13:18.744057+0000","last_undegraded":"2024-08-19T00:13:18.744057+0000","last_fullsized":"2024-08-19T00:13:18.744057+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:15:45.247674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"90'2","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.509703+0000","last_change":"2024-08-19T00:10:50.618000+0000","last_active":"2024-08-19T00:13:18.509703+0000","last_peered":"2024-08-19T00:13:18.509703+0000","last_clean":"2024-08-19T00:13:18.509703+0000","last_became_active":"2024-08-19T00:10:50.617648+0000","last_became_peered":"2024-08-19T00:10:50.617648+0000","last_unstale":"2024-08-19T00:13:18.509703+0000","last_undegraded":"2024-08-19T00:13:18.509703+0000","last_fullsized":"2024-08-19T00:13:18.509703+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:39:00.310466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"94'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.745061+0000","last_change":"2024-08-19T00:10:52.518075+0000","last_active":"2024-08-19T00:13:18.745061+0000","last_peered":"2024-08-19T00:13:18.745061+0000","last_clean":"2024-08-19T00:13:18.745061+0000","last_became_active":"2024-08-19T00:10:52.517735+0000","last_became_peered":"2024-08-19T00:10:52.517735+0000","last_unstale":"2024-08-19T00:13:18.745061+0000","last_undegraded":"2024-08-19T00:13:18.745061+0000","last_fullsized":"2024-08-19T00:13:18.745061+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:02:32.657776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.511590+0000","last_change":"2024-08-19T00:10:59.787563+0000","last_active":"2024-08-19T00:13:18.511590+0000","last_peered":"2024-08-19T00:13:18.511590+0000","last_clean":"2024-08-19T00:13:18.511590+0000","last_became_active":"2024-08-19T00:10:59.787143+0000","last_became_peered":"2024-08-19T00:10:59.787143+0000","last_unstale":"2024-08-19T00:13:18.511590+0000","last_undegraded":"2024-08-19T00:13:18.511590+0000","last_fullsized":"2024-08-19T00:13:18.511590+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:41:47.101296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"90'12","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.509613+0000","last_change":"2024-08-19T00:10:50.475869+0000","last_active":"2024-08-19T00:13:18.509613+0000","last_peered":"2024-08-19T00:13:18.509613+0000","last_clean":"2024-08-19T00:13:18.509613+0000","last_became_active":"2024-08-19T00:10:50.475550+0000","last_became_peered":"2024-08-19T00:10:50.475550+0000","last_unstale":"2024-08-19T00:13:18.509613+0000","last_undegraded":"2024-08-19T00:13:18.509613+0000","last_fullsized":"2024-08-19T00:13:18.509613+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:47:23.724503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"94'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743798+0000","last_change":"2024-08-19T00:10:52.511901+0000","last_active":"2024-08-19T00:13:18.743798+0000","last_peered":"2024-08-19T00:13:18.743798+0000","last_clean":"2024-08-19T00:13:18.743798+0000","last_became_active":"2024-08-19T00:10:52.511595+0000","last_became_peered":"2024-08-19T00:10:52.511595+0000","last_unstale":"2024-08-19T00:13:18.743798+0000","last_undegraded":"2024-08-19T00:13:18.743798+0000","last_fullsized":"2024-08-19T00:13:18.743798+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:57:30.613865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.511802+0000","last_change":"2024-08-19T00:10:59.785611+0000","last_active":"2024-08-19T00:13:18.511802+0000","last_peered":"2024-08-19T00:13:18.511802+0000","last_clean":"2024-08-19T00:13:18.511802+0000","last_became_active":"2024-08-19T00:10:59.785105+0000","last_became_peered":"2024-08-19T00:10:59.785105+0000","last_unstale":"2024-08-19T00:13:18.511802+0000","last_undegraded":"2024-08-19T00:13:18.511802+0000","last_fullsized":"2024-08-19T00:13:18.511802+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:05:31.007647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"90'5","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.509283+0000","last_change":"2024-08-19T00:10:50.474439+0000","last_active":"2024-08-19T00:13:18.509283+0000","last_peered":"2024-08-19T00:13:18.509283+0000","last_clean":"2024-08-19T00:13:18.509283+0000","last_became_active":"2024-08-19T00:10:50.473984+0000","last_became_peered":"2024-08-19T00:10:50.473984+0000","last_unstale":"2024-08-19T00:13:18.509283+0000","last_undegraded":"2024-08-19T00:13:18.509283+0000","last_fullsized":"2024-08-19T00:13:18.509283+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:16:06.934392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"94'15","reported_seq":50,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.609081+0000","last_change":"2024-08-19T00:10:52.521664+0000","last_active":"2024-08-19T00:13:18.609081+0000","last_peered":"2024-08-19T00:13:18.609081+0000","last_clean":"2024-08-19T00:13:18.609081+0000","last_became_active":"2024-08-19T00:10:52.520792+0000","last_became_peered":"2024-08-19T00:10:52.520792+0000","last_unstale":"2024-08-19T00:13:18.609081+0000","last_undegraded":"2024-08-19T00:13:18.609081+0000","last_fullsized":"2024-08-19T00:13:18.609081+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:55:27.199456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.511618+0000","last_change":"2024-08-19T00:10:59.789736+0000","last_active":"2024-08-19T00:13:18.511618+0000","last_peered":"2024-08-19T00:13:18.511618+0000","last_clean":"2024-08-19T00:13:18.511618+0000","last_became_active":"2024-08-19T00:10:59.786880+0000","last_became_peered":"2024-08-19T00:10:59.786880+0000","last_unstale":"2024-08-19T00:13:18.511618+0000","last_undegraded":"2024-08-19T00:13:18.511618+0000","last_fullsized":"2024-08-19T00:13:18.511618+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:20:53.615561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"94'5","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743922+0000","last_change":"2024-08-19T00:10:52.519887+0000","last_active":"2024-08-19T00:13:18.743922+0000","last_peered":"2024-08-19T00:13:18.743922+0000","last_clean":"2024-08-19T00:13:18.743922+0000","last_became_active":"2024-08-19T00:10:52.519550+0000","last_became_peered":"2024-08-19T00:10:52.519550+0000","last_unstale":"2024-08-19T00:13:18.743922+0000","last_undegraded":"2024-08-19T00:13:18.743922+0000","last_fullsized":"2024-08-19T00:13:18.743922+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:27:43.493012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"90'4","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.508917+0000","last_change":"2024-08-19T00:10:50.478131+0000","last_active":"2024-08-19T00:13:18.508917+0000","last_peered":"2024-08-19T00:13:18.508917+0000","last_clean":"2024-08-19T00:13:18.508917+0000","last_became_active":"2024-08-19T00:10:50.477826+0000","last_became_peered":"2024-08-19T00:10:50.477826+0000","last_unstale":"2024-08-19T00:13:18.508917+0000","last_undegraded":"2024-08-19T00:13:18.508917+0000","last_fullsized":"2024-08-19T00:13:18.508917+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:41:24.066453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.511970+0000","last_change":"2024-08-19T00:10:59.787634+0000","last_active":"2024-08-19T00:13:18.511970+0000","last_peered":"2024-08-19T00:13:18.511970+0000","last_clean":"2024-08-19T00:13:18.511970+0000","last_became_active":"2024-08-19T00:10:59.786508+0000","last_became_peered":"2024-08-19T00:10:59.786508+0000","last_unstale":"2024-08-19T00:13:18.511970+0000","last_undegraded":"2024-08-19T00:13:18.511970+0000","last_fullsized":"2024-08-19T00:13:18.511970+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:50:19.071853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"94'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.507964+0000","last_change":"2024-08-19T00:10:52.512462+0000","last_active":"2024-08-19T00:13:18.507964+0000","last_peered":"2024-08-19T00:13:18.507964+0000","last_clean":"2024-08-19T00:13:18.507964+0000","last_became_active":"2024-08-19T00:10:52.512139+0000","last_became_peered":"2024-08-19T00:10:52.512139+0000","last_unstale":"2024-08-19T00:13:18.507964+0000","last_undegraded":"2024-08-19T00:13:18.507964+0000","last_fullsized":"2024-08-19T00:13:18.507964+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:39:18.677836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"95'4","reported_seq":24,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744069+0000","last_change":"2024-08-19T00:11:39.930130+0000","last_active":"2024-08-19T00:13:18.744069+0000","last_peered":"2024-08-19T00:13:18.744069+0000","last_clean":"2024-08-19T00:13:18.744069+0000","last_became_active":"2024-08-19T00:11:39.919566+0000","last_became_peered":"2024-08-19T00:11:39.919566+0000","last_unstale":"2024-08-19T00:13:18.744069+0000","last_undegraded":"2024-08-19T00:13:18.744069+0000","last_fullsized":"2024-08-19T00:13:18.744069+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:50:25.001784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"92'1","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.511923+0000","last_change":"2024-08-19T00:10:59.787455+0000","last_active":"2024-08-19T00:13:18.511923+0000","last_peered":"2024-08-19T00:13:18.511923+0000","last_clean":"2024-08-19T00:13:18.511923+0000","last_became_active":"2024-08-19T00:10:59.787054+0000","last_became_peered":"2024-08-19T00:10:59.787054+0000","last_unstale":"2024-08-19T00:13:18.511923+0000","last_undegraded":"2024-08-19T00:13:18.511923+0000","last_fullsized":"2024-08-19T00:13:18.511923+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:13:31.356220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"94'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743845+0000","last_change":"2024-08-19T00:10:52.520993+0000","last_active":"2024-08-19T00:13:18.743845+0000","last_peered":"2024-08-19T00:13:18.743845+0000","last_clean":"2024-08-19T00:13:18.743845+0000","last_became_active":"2024-08-19T00:10:52.520697+0000","last_became_peered":"2024-08-19T00:10:52.520697+0000","last_unstale":"2024-08-19T00:13:18.743845+0000","last_undegraded":"2024-08-19T00:13:18.743845+0000","last_fullsized":"2024-08-19T00:13:18.743845+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:30:15.408193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"90'7","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.507822+0000","last_change":"2024-08-19T00:10:50.470746+0000","last_active":"2024-08-19T00:13:18.507822+0000","last_peered":"2024-08-19T00:13:18.507822+0000","last_clean":"2024-08-19T00:13:18.507822+0000","last_became_active":"2024-08-19T00:10:50.470454+0000","last_became_peered":"2024-08-19T00:10:50.470454+0000","last_unstale":"2024-08-19T00:13:18.507822+0000","last_undegraded":"2024-08-19T00:13:18.507822+0000","last_fullsized":"2024-08-19T00:13:18.507822+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:37:34.718543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.509316+0000","last_change":"2024-08-19T00:11:39.924217+0000","last_active":"2024-08-19T00:13:18.509316+0000","last_peered":"2024-08-19T00:13:18.509316+0000","last_clean":"2024-08-19T00:13:18.509316+0000","last_became_active":"2024-08-19T00:11:39.923541+0000","last_became_peered":"2024-08-19T00:11:39.923541+0000","last_unstale":"2024-08-19T00:13:18.509316+0000","last_undegraded":"2024-08-19T00:13:18.509316+0000","last_fullsized":"2024-08-19T00:13:18.509316+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:29:35.040424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,2,5],"acting":[8,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.9","version":"94'2","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.508727+0000","last_change":"2024-08-19T00:10:52.516838+0000","last_active":"2024-08-19T00:13:18.508727+0000","last_peered":"2024-08-19T00:13:18.508727+0000","last_clean":"2024-08-19T00:13:18.508727+0000","last_became_active":"2024-08-19T00:10:52.516471+0000","last_became_peered":"2024-08-19T00:10:52.516471+0000","last_unstale":"2024-08-19T00:13:18.508727+0000","last_undegraded":"2024-08-19T00:13:18.508727+0000","last_fullsized":"2024-08-19T00:13:18.508727+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:11:26.974655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"90'2","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743362+0000","last_change":"2024-08-19T00:10:50.618745+0000","last_active":"2024-08-19T00:13:18.743362+0000","last_peered":"2024-08-19T00:13:18.743362+0000","last_clean":"2024-08-19T00:13:18.743362+0000","last_became_active":"2024-08-19T00:10:50.618426+0000","last_became_peered":"2024-08-19T00:10:50.618426+0000","last_unstale":"2024-08-19T00:13:18.743362+0000","last_undegraded":"2024-08-19T00:13:18.743362+0000","last_fullsized":"2024-08-19T00:13:18.743362+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:12:57.777142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.512249+0000","last_change":"2024-08-19T00:10:59.793740+0000","last_active":"2024-08-19T00:13:18.512249+0000","last_peered":"2024-08-19T00:13:18.512249+0000","last_clean":"2024-08-19T00:13:18.512249+0000","last_became_active":"2024-08-19T00:10:59.793181+0000","last_became_peered":"2024-08-19T00:10:59.793181+0000","last_unstale":"2024-08-19T00:13:18.512249+0000","last_undegraded":"2024-08-19T00:13:18.512249+0000","last_fullsized":"2024-08-19T00:13:18.512249+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:04:15.429505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"94'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744045+0000","last_change":"2024-08-19T00:10:52.512200+0000","last_active":"2024-08-19T00:13:18.744045+0000","last_peered":"2024-08-19T00:13:18.744045+0000","last_clean":"2024-08-19T00:13:18.744045+0000","last_became_active":"2024-08-19T00:10:52.511891+0000","last_became_peered":"2024-08-19T00:10:52.511891+0000","last_unstale":"2024-08-19T00:13:18.744045+0000","last_undegraded":"2024-08-19T00:13:18.744045+0000","last_fullsized":"2024-08-19T00:13:18.744045+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:02:08.400026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"90'7","reported_seq":49,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.512396+0000","last_change":"2024-08-19T00:10:50.476209+0000","last_active":"2024-08-19T00:13:18.512396+0000","last_peered":"2024-08-19T00:13:18.512396+0000","last_clean":"2024-08-19T00:13:18.512396+0000","last_became_active":"2024-08-19T00:10:50.475410+0000","last_became_peered":"2024-08-19T00:10:50.475410+0000","last_unstale":"2024-08-19T00:13:18.512396+0000","last_undegraded":"2024-08-19T00:13:18.512396+0000","last_fullsized":"2024-08-19T00:13:18.512396+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:46:25.093738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744155+0000","last_change":"2024-08-19T00:10:59.786550+0000","last_active":"2024-08-19T00:13:18.744155+0000","last_peered":"2024-08-19T00:13:18.744155+0000","last_clean":"2024-08-19T00:13:18.744155+0000","last_became_active":"2024-08-19T00:10:59.785531+0000","last_became_peered":"2024-08-19T00:10:59.785531+0000","last_unstale":"2024-08-19T00:13:18.744155+0000","last_undegraded":"2024-08-19T00:13:18.744155+0000","last_fullsized":"2024-08-19T00:13:18.744155+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:59:53.605678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"94'5","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.509486+0000","last_change":"2024-08-19T00:10:52.514936+0000","last_active":"2024-08-19T00:13:18.509486+0000","last_peered":"2024-08-19T00:13:18.509486+0000","last_clean":"2024-08-19T00:13:18.509486+0000","last_became_active":"2024-08-19T00:10:52.514597+0000","last_became_peered":"2024-08-19T00:10:52.514597+0000","last_unstale":"2024-08-19T00:13:18.509486+0000","last_undegraded":"2024-08-19T00:13:18.509486+0000","last_fullsized":"2024-08-19T00:13:18.509486+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:03:42.275705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"95'107","reported_seq":240,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:22.241805+0000","last_change":"2024-08-19T00:10:50.470637+0000","last_active":"2024-08-19T00:13:22.241805+0000","last_peered":"2024-08-19T00:13:22.241805+0000","last_clean":"2024-08-19T00:13:22.241805+0000","last_became_active":"2024-08-19T00:10:50.470276+0000","last_became_peered":"2024-08-19T00:10:50.470276+0000","last_unstale":"2024-08-19T00:13:22.241805+0000","last_undegraded":"2024-08-19T00:13:22.241805+0000","last_fullsized":"2024-08-19T00:13:22.241805+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:42:16.186669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":312,"num_read_kb":277,"num_write":195,"num_write_kb":1288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.507497+0000","last_change":"2024-08-19T00:10:59.784742+0000","last_active":"2024-08-19T00:13:18.507497+0000","last_peered":"2024-08-19T00:13:18.507497+0000","last_clean":"2024-08-19T00:13:18.507497+0000","last_became_active":"2024-08-19T00:10:59.784372+0000","last_became_peered":"2024-08-19T00:10:59.784372+0000","last_unstale":"2024-08-19T00:13:18.507497+0000","last_undegraded":"2024-08-19T00:13:18.507497+0000","last_fullsized":"2024-08-19T00:13:18.507497+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:58:03.216882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"94'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744841+0000","last_change":"2024-08-19T00:10:52.511172+0000","last_active":"2024-08-19T00:13:18.744841+0000","last_peered":"2024-08-19T00:13:18.744841+0000","last_clean":"2024-08-19T00:13:18.744841+0000","last_became_active":"2024-08-19T00:10:52.510816+0000","last_became_peered":"2024-08-19T00:10:52.510816+0000","last_unstale":"2024-08-19T00:13:18.744841+0000","last_undegraded":"2024-08-19T00:13:18.744841+0000","last_fullsized":"2024-08-19T00:13:18.744841+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:31:39.889398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"90'4","reported_seq":25,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744284+0000","last_change":"2024-08-19T00:11:39.926806+0000","last_active":"2024-08-19T00:13:18.744284+0000","last_peered":"2024-08-19T00:13:18.744284+0000","last_clean":"2024-08-19T00:13:18.744284+0000","last_became_active":"2024-08-19T00:11:39.917115+0000","last_became_peered":"2024-08-19T00:11:39.917115+0000","last_unstale":"2024-08-19T00:13:18.744284+0000","last_undegraded":"2024-08-19T00:13:18.744284+0000","last_fullsized":"2024-08-19T00:13:18.744284+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:58:19.965471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744267+0000","last_change":"2024-08-19T00:10:59.778996+0000","last_active":"2024-08-19T00:13:18.744267+0000","last_peered":"2024-08-19T00:13:18.744267+0000","last_clean":"2024-08-19T00:13:18.744267+0000","last_became_active":"2024-08-19T00:10:59.778589+0000","last_became_peered":"2024-08-19T00:10:59.778589+0000","last_unstale":"2024-08-19T00:13:18.744267+0000","last_undegraded":"2024-08-19T00:13:18.744267+0000","last_fullsized":"2024-08-19T00:13:18.744267+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:40:23.690051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"94'4","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.611723+0000","last_change":"2024-08-19T00:10:52.512796+0000","last_active":"2024-08-19T00:13:18.611723+0000","last_peered":"2024-08-19T00:13:18.611723+0000","last_clean":"2024-08-19T00:13:18.611723+0000","last_became_active":"2024-08-19T00:10:52.512459+0000","last_became_peered":"2024-08-19T00:10:52.512459+0000","last_unstale":"2024-08-19T00:13:18.611723+0000","last_undegraded":"2024-08-19T00:13:18.611723+0000","last_fullsized":"2024-08-19T00:13:18.611723+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:07:47.124129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"90'1","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.599347+0000","last_change":"2024-08-19T00:10:50.618118+0000","last_active":"2024-08-19T00:13:18.599347+0000","last_peered":"2024-08-19T00:13:18.599347+0000","last_clean":"2024-08-19T00:13:18.599347+0000","last_became_active":"2024-08-19T00:10:50.617759+0000","last_became_peered":"2024-08-19T00:10:50.617759+0000","last_unstale":"2024-08-19T00:13:18.599347+0000","last_undegraded":"2024-08-19T00:13:18.599347+0000","last_fullsized":"2024-08-19T00:13:18.599347+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:38:10.830722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.508792+0000","last_change":"2024-08-19T00:10:59.783548+0000","last_active":"2024-08-19T00:13:18.508792+0000","last_peered":"2024-08-19T00:13:18.508792+0000","last_clean":"2024-08-19T00:13:18.508792+0000","last_became_active":"2024-08-19T00:10:59.783091+0000","last_became_peered":"2024-08-19T00:10:59.783091+0000","last_unstale":"2024-08-19T00:13:18.508792+0000","last_undegraded":"2024-08-19T00:13:18.508792+0000","last_fullsized":"2024-08-19T00:13:18.508792+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:26:21.191829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"94'7","reported_seq":49,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.611787+0000","last_change":"2024-08-19T00:12:40.994390+0000","last_active":"2024-08-19T00:13:18.611787+0000","last_peered":"2024-08-19T00:13:18.611787+0000","last_clean":"2024-08-19T00:13:18.611787+0000","last_became_active":"2024-08-19T00:12:40.994099+0000","last_became_peered":"2024-08-19T00:12:40.994099+0000","last_unstale":"2024-08-19T00:13:18.611787+0000","last_undegraded":"2024-08-19T00:13:18.611787+0000","last_fullsized":"2024-08-19T00:13:18.611787+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:28:07.374407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"95'8","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:23.057467+0000","last_change":"2024-08-19T00:10:50.478742+0000","last_active":"2024-08-19T00:13:23.057467+0000","last_peered":"2024-08-19T00:13:23.057467+0000","last_clean":"2024-08-19T00:13:23.057467+0000","last_became_active":"2024-08-19T00:10:50.478139+0000","last_became_peered":"2024-08-19T00:10:50.478139+0000","last_unstale":"2024-08-19T00:13:23.057467+0000","last_undegraded":"2024-08-19T00:13:23.057467+0000","last_fullsized":"2024-08-19T00:13:23.057467+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:23:25.727268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1758,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":3,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744335+0000","last_change":"2024-08-19T00:10:59.785350+0000","last_active":"2024-08-19T00:13:18.744335+0000","last_peered":"2024-08-19T00:13:18.744335+0000","last_clean":"2024-08-19T00:13:18.744335+0000","last_became_active":"2024-08-19T00:10:59.784929+0000","last_became_peered":"2024-08-19T00:10:59.784929+0000","last_unstale":"2024-08-19T00:13:18.744335+0000","last_undegraded":"2024-08-19T00:13:18.744335+0000","last_fullsized":"2024-08-19T00:13:18.744335+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:58:49.878253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"94'8","reported_seq":50,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.608802+0000","last_change":"2024-08-19T00:11:39.924921+0000","last_active":"2024-08-19T00:13:18.608802+0000","last_peered":"2024-08-19T00:13:18.608802+0000","last_clean":"2024-08-19T00:13:18.608802+0000","last_became_active":"2024-08-19T00:11:39.924551+0000","last_became_peered":"2024-08-19T00:11:39.924551+0000","last_unstale":"2024-08-19T00:13:18.608802+0000","last_undegraded":"2024-08-19T00:13:18.608802+0000","last_fullsized":"2024-08-19T00:13:18.608802+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:14:23.042222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"95'6","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:23.056915+0000","last_change":"2024-08-19T00:10:50.618159+0000","last_active":"2024-08-19T00:13:23.056915+0000","last_peered":"2024-08-19T00:13:23.056915+0000","last_clean":"2024-08-19T00:13:23.056915+0000","last_became_active":"2024-08-19T00:10:50.617828+0000","last_became_peered":"2024-08-19T00:10:50.617828+0000","last_unstale":"2024-08-19T00:13:23.056915+0000","last_undegraded":"2024-08-19T00:13:23.056915+0000","last_fullsized":"2024-08-19T00:13:23.056915+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:36:40.702592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":109,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.745102+0000","last_change":"2024-08-19T00:10:59.787615+0000","last_active":"2024-08-19T00:13:18.745102+0000","last_peered":"2024-08-19T00:13:18.745102+0000","last_clean":"2024-08-19T00:13:18.745102+0000","last_became_active":"2024-08-19T00:10:59.787184+0000","last_became_peered":"2024-08-19T00:10:59.787184+0000","last_unstale":"2024-08-19T00:13:18.745102+0000","last_undegraded":"2024-08-19T00:13:18.745102+0000","last_fullsized":"2024-08-19T00:13:18.745102+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:20:42.174337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"94'5","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743137+0000","last_change":"2024-08-19T00:10:52.509235+0000","last_active":"2024-08-19T00:13:18.743137+0000","last_peered":"2024-08-19T00:13:18.743137+0000","last_clean":"2024-08-19T00:13:18.743137+0000","last_became_active":"2024-08-19T00:10:52.508934+0000","last_became_peered":"2024-08-19T00:10:52.508934+0000","last_unstale":"2024-08-19T00:13:18.743137+0000","last_undegraded":"2024-08-19T00:13:18.743137+0000","last_fullsized":"2024-08-19T00:13:18.743137+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:12:59.654711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"90'4","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743372+0000","last_change":"2024-08-19T00:10:50.477180+0000","last_active":"2024-08-19T00:13:18.743372+0000","last_peered":"2024-08-19T00:13:18.743372+0000","last_clean":"2024-08-19T00:13:18.743372+0000","last_became_active":"2024-08-19T00:10:50.476875+0000","last_became_peered":"2024-08-19T00:10:50.476875+0000","last_unstale":"2024-08-19T00:13:18.743372+0000","last_undegraded":"2024-08-19T00:13:18.743372+0000","last_fullsized":"2024-08-19T00:13:18.743372+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:15:57.383599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.608964+0000","last_change":"2024-08-19T00:10:59.783389+0000","last_active":"2024-08-19T00:13:18.608964+0000","last_peered":"2024-08-19T00:13:18.608964+0000","last_clean":"2024-08-19T00:13:18.608964+0000","last_became_active":"2024-08-19T00:10:59.782983+0000","last_became_peered":"2024-08-19T00:10:59.782983+0000","last_unstale":"2024-08-19T00:13:18.608964+0000","last_undegraded":"2024-08-19T00:13:18.608964+0000","last_fullsized":"2024-08-19T00:13:18.608964+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:55:47.419588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"94'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.507821+0000","last_change":"2024-08-19T00:10:52.517477+0000","last_active":"2024-08-19T00:13:18.507821+0000","last_peered":"2024-08-19T00:13:18.507821+0000","last_clean":"2024-08-19T00:13:18.507821+0000","last_became_active":"2024-08-19T00:10:52.517192+0000","last_became_peered":"2024-08-19T00:10:52.517192+0000","last_unstale":"2024-08-19T00:13:18.507821+0000","last_undegraded":"2024-08-19T00:13:18.507821+0000","last_fullsized":"2024-08-19T00:13:18.507821+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:31:01.125780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"90'6","reported_seq":50,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.511955+0000","last_change":"2024-08-19T00:10:50.476296+0000","last_active":"2024-08-19T00:13:18.511955+0000","last_peered":"2024-08-19T00:13:18.511955+0000","last_clean":"2024-08-19T00:13:18.511955+0000","last_became_active":"2024-08-19T00:10:50.475835+0000","last_became_peered":"2024-08-19T00:10:50.475835+0000","last_unstale":"2024-08-19T00:13:18.511955+0000","last_undegraded":"2024-08-19T00:13:18.511955+0000","last_fullsized":"2024-08-19T00:13:18.511955+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:23:27.585779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"95'148","reported_seq":413,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:20.607740+0000","last_change":"2024-08-19T00:09:43.445224+0000","last_active":"2024-08-19T00:13:20.607740+0000","last_peered":"2024-08-19T00:13:20.607740+0000","last_clean":"2024-08-19T00:13:20.607740+0000","last_became_active":"2024-08-19T00:09:43.444826+0000","last_became_peered":"2024-08-19T00:09:43.444826+0000","last_unstale":"2024-08-19T00:13:20.607740+0000","last_undegraded":"2024-08-19T00:13:20.607740+0000","last_fullsized":"2024-08-19T00:13:20.607740+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:06:42.707047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:06:42.707047+0000","last_clean_scrub_stamp":"2024-08-19T00:06:42.707047+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:37:10.588547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"92'1","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744441+0000","last_change":"2024-08-19T00:10:59.783987+0000","last_active":"2024-08-19T00:13:18.744441+0000","last_peered":"2024-08-19T00:13:18.744441+0000","last_clean":"2024-08-19T00:13:18.744441+0000","last_became_active":"2024-08-19T00:10:59.783569+0000","last_became_peered":"2024-08-19T00:10:59.783569+0000","last_unstale":"2024-08-19T00:13:18.744441+0000","last_undegraded":"2024-08-19T00:13:18.744441+0000","last_fullsized":"2024-08-19T00:13:18.744441+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:04:01.744644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"94'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744566+0000","last_change":"2024-08-19T00:10:52.516201+0000","last_active":"2024-08-19T00:13:18.744566+0000","last_peered":"2024-08-19T00:13:18.744566+0000","last_clean":"2024-08-19T00:13:18.744566+0000","last_became_active":"2024-08-19T00:10:52.515871+0000","last_became_peered":"2024-08-19T00:10:52.515871+0000","last_unstale":"2024-08-19T00:13:18.744566+0000","last_undegraded":"2024-08-19T00:13:18.744566+0000","last_fullsized":"2024-08-19T00:13:18.744566+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:54:49.528215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"95'7","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:23.070948+0000","last_change":"2024-08-19T00:10:50.620185+0000","last_active":"2024-08-19T00:13:23.070948+0000","last_peered":"2024-08-19T00:13:23.070948+0000","last_clean":"2024-08-19T00:13:23.070948+0000","last_became_active":"2024-08-19T00:10:50.619858+0000","last_became_peered":"2024-08-19T00:10:50.619858+0000","last_unstale":"2024-08-19T00:13:23.070948+0000","last_undegraded":"2024-08-19T00:13:23.070948+0000","last_fullsized":"2024-08-19T00:13:23.070948+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:30:21.893859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1950,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":111,"num_read_kb":3,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743313+0000","last_change":"2024-08-19T00:10:59.782056+0000","last_active":"2024-08-19T00:13:18.743313+0000","last_peered":"2024-08-19T00:13:18.743313+0000","last_clean":"2024-08-19T00:13:18.743313+0000","last_became_active":"2024-08-19T00:10:59.781666+0000","last_became_peered":"2024-08-19T00:10:59.781666+0000","last_unstale":"2024-08-19T00:13:18.743313+0000","last_undegraded":"2024-08-19T00:13:18.743313+0000","last_fullsized":"2024-08-19T00:13:18.743313+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:06:15.614372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"94'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744343+0000","last_change":"2024-08-19T00:10:52.523346+0000","last_active":"2024-08-19T00:13:18.744343+0000","last_peered":"2024-08-19T00:13:18.744343+0000","last_clean":"2024-08-19T00:13:18.744343+0000","last_became_active":"2024-08-19T00:10:52.523020+0000","last_became_peered":"2024-08-19T00:10:52.523020+0000","last_unstale":"2024-08-19T00:13:18.744343+0000","last_undegraded":"2024-08-19T00:13:18.744343+0000","last_fullsized":"2024-08-19T00:13:18.744343+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:09:58.259666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"95'67","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:21.885481+0000","last_change":"2024-08-19T00:10:50.471739+0000","last_active":"2024-08-19T00:13:21.885481+0000","last_peered":"2024-08-19T00:13:21.885481+0000","last_clean":"2024-08-19T00:13:21.885481+0000","last_became_active":"2024-08-19T00:10:50.471425+0000","last_became_peered":"2024-08-19T00:10:50.471425+0000","last_unstale":"2024-08-19T00:13:21.885481+0000","last_undegraded":"2024-08-19T00:13:21.885481+0000","last_fullsized":"2024-08-19T00:13:21.885481+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:55:26.332380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328302,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":33,"num_write":76,"num_write_kb":941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743933+0000","last_change":"2024-08-19T00:10:59.788685+0000","last_active":"2024-08-19T00:13:18.743933+0000","last_peered":"2024-08-19T00:13:18.743933+0000","last_clean":"2024-08-19T00:13:18.743933+0000","last_became_active":"2024-08-19T00:10:59.788343+0000","last_became_peered":"2024-08-19T00:10:59.788343+0000","last_unstale":"2024-08-19T00:13:18.743933+0000","last_undegraded":"2024-08-19T00:13:18.743933+0000","last_fullsized":"2024-08-19T00:13:18.743933+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:20:59.595494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"94'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744559+0000","last_change":"2024-08-19T00:10:52.516469+0000","last_active":"2024-08-19T00:13:18.744559+0000","last_peered":"2024-08-19T00:13:18.744559+0000","last_clean":"2024-08-19T00:13:18.744559+0000","last_became_active":"2024-08-19T00:10:52.516093+0000","last_became_peered":"2024-08-19T00:10:52.516093+0000","last_unstale":"2024-08-19T00:13:18.744559+0000","last_undegraded":"2024-08-19T00:13:18.744559+0000","last_fullsized":"2024-08-19T00:13:18.744559+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:18:29.327336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"90'5","reported_seq":58,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744970+0000","last_change":"2024-08-19T00:11:39.921825+0000","last_active":"2024-08-19T00:13:18.744970+0000","last_peered":"2024-08-19T00:13:18.744970+0000","last_clean":"2024-08-19T00:13:18.744970+0000","last_became_active":"2024-08-19T00:11:39.917689+0000","last_became_peered":"2024-08-19T00:11:39.917689+0000","last_unstale":"2024-08-19T00:13:18.744970+0000","last_undegraded":"2024-08-19T00:13:18.744970+0000","last_fullsized":"2024-08-19T00:13:18.744970+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:37:47.940707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.608635+0000","last_change":"2024-08-19T00:10:59.785347+0000","last_active":"2024-08-19T00:13:18.608635+0000","last_peered":"2024-08-19T00:13:18.608635+0000","last_clean":"2024-08-19T00:13:18.608635+0000","last_became_active":"2024-08-19T00:10:59.784927+0000","last_became_peered":"2024-08-19T00:10:59.784927+0000","last_unstale":"2024-08-19T00:13:18.608635+0000","last_undegraded":"2024-08-19T00:13:18.608635+0000","last_fullsized":"2024-08-19T00:13:18.608635+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:39:41.919021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"94'5","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744842+0000","last_change":"2024-08-19T00:12:41.004215+0000","last_active":"2024-08-19T00:13:18.744842+0000","last_peered":"2024-08-19T00:13:18.744842+0000","last_clean":"2024-08-19T00:13:18.744842+0000","last_became_active":"2024-08-19T00:12:41.003770+0000","last_became_peered":"2024-08-19T00:12:41.003770+0000","last_unstale":"2024-08-19T00:13:18.744842+0000","last_undegraded":"2024-08-19T00:13:18.744842+0000","last_fullsized":"2024-08-19T00:13:18.744842+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:17:42.279811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"90'2","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.509422+0000","last_change":"2024-08-19T00:10:50.474977+0000","last_active":"2024-08-19T00:13:18.509422+0000","last_peered":"2024-08-19T00:13:18.509422+0000","last_clean":"2024-08-19T00:13:18.509422+0000","last_became_active":"2024-08-19T00:10:50.474653+0000","last_became_peered":"2024-08-19T00:10:50.474653+0000","last_unstale":"2024-08-19T00:13:18.509422+0000","last_undegraded":"2024-08-19T00:13:18.509422+0000","last_fullsized":"2024-08-19T00:13:18.509422+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:20:31.565098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.608795+0000","last_change":"2024-08-19T00:10:59.789912+0000","last_active":"2024-08-19T00:13:18.608795+0000","last_peered":"2024-08-19T00:13:18.608795+0000","last_clean":"2024-08-19T00:13:18.608795+0000","last_became_active":"2024-08-19T00:10:59.789143+0000","last_became_peered":"2024-08-19T00:10:59.789143+0000","last_unstale":"2024-08-19T00:13:18.608795+0000","last_undegraded":"2024-08-19T00:13:18.608795+0000","last_fullsized":"2024-08-19T00:13:18.608795+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:06:53.447173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"94'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.608953+0000","last_change":"2024-08-19T00:10:52.525061+0000","last_active":"2024-08-19T00:13:18.608953+0000","last_peered":"2024-08-19T00:13:18.608953+0000","last_clean":"2024-08-19T00:13:18.608953+0000","last_became_active":"2024-08-19T00:10:52.524752+0000","last_became_peered":"2024-08-19T00:10:52.524752+0000","last_unstale":"2024-08-19T00:13:18.608953+0000","last_undegraded":"2024-08-19T00:13:18.608953+0000","last_fullsized":"2024-08-19T00:13:18.608953+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:50:47.817220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"90'17","reported_seq":59,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.508845+0000","last_change":"2024-08-19T00:10:50.618923+0000","last_active":"2024-08-19T00:13:18.508845+0000","last_peered":"2024-08-19T00:13:18.508845+0000","last_clean":"2024-08-19T00:13:18.508845+0000","last_became_active":"2024-08-19T00:10:50.618586+0000","last_became_peered":"2024-08-19T00:10:50.618586+0000","last_unstale":"2024-08-19T00:13:18.508845+0000","last_undegraded":"2024-08-19T00:13:18.508845+0000","last_fullsized":"2024-08-19T00:13:18.508845+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:07:45.186059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744904+0000","last_change":"2024-08-19T00:10:59.785681+0000","last_active":"2024-08-19T00:13:18.744904+0000","last_peered":"2024-08-19T00:13:18.744904+0000","last_clean":"2024-08-19T00:13:18.744904+0000","last_became_active":"2024-08-19T00:10:59.785299+0000","last_became_peered":"2024-08-19T00:10:59.785299+0000","last_unstale":"2024-08-19T00:13:18.744904+0000","last_undegraded":"2024-08-19T00:13:18.744904+0000","last_fullsized":"2024-08-19T00:13:18.744904+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:36:08.151180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"94'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743809+0000","last_change":"2024-08-19T00:10:52.523398+0000","last_active":"2024-08-19T00:13:18.743809+0000","last_peered":"2024-08-19T00:13:18.743809+0000","last_clean":"2024-08-19T00:13:18.743809+0000","last_became_active":"2024-08-19T00:10:52.523066+0000","last_became_peered":"2024-08-19T00:10:52.523066+0000","last_unstale":"2024-08-19T00:13:18.743809+0000","last_undegraded":"2024-08-19T00:13:18.743809+0000","last_fullsized":"2024-08-19T00:13:18.743809+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:47:25.137487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"95'6","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:23.057428+0000","last_change":"2024-08-19T00:10:50.475827+0000","last_active":"2024-08-19T00:13:23.057428+0000","last_peered":"2024-08-19T00:13:23.057428+0000","last_clean":"2024-08-19T00:13:23.057428+0000","last_became_active":"2024-08-19T00:10:50.475470+0000","last_became_peered":"2024-08-19T00:10:50.475470+0000","last_unstale":"2024-08-19T00:13:23.057428+0000","last_undegraded":"2024-08-19T00:13:23.057428+0000","last_fullsized":"2024-08-19T00:13:23.057428+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:25:14.200317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":978,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":112,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.599896+0000","last_change":"2024-08-19T00:10:59.789047+0000","last_active":"2024-08-19T00:13:18.599896+0000","last_peered":"2024-08-19T00:13:18.599896+0000","last_clean":"2024-08-19T00:13:18.599896+0000","last_became_active":"2024-08-19T00:10:59.788694+0000","last_became_peered":"2024-08-19T00:10:59.788694+0000","last_unstale":"2024-08-19T00:13:18.599896+0000","last_undegraded":"2024-08-19T00:13:18.599896+0000","last_fullsized":"2024-08-19T00:13:18.599896+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:00:22.463593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"94'15","reported_seq":51,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744056+0000","last_change":"2024-08-19T00:10:52.511480+0000","last_active":"2024-08-19T00:13:18.744056+0000","last_peered":"2024-08-19T00:13:18.744056+0000","last_clean":"2024-08-19T00:13:18.744056+0000","last_became_active":"2024-08-19T00:10:52.511159+0000","last_became_peered":"2024-08-19T00:10:52.511159+0000","last_unstale":"2024-08-19T00:13:18.744056+0000","last_undegraded":"2024-08-19T00:13:18.744056+0000","last_fullsized":"2024-08-19T00:13:18.744056+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:28:31.136900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"90'5","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.608926+0000","last_change":"2024-08-19T00:10:50.476761+0000","last_active":"2024-08-19T00:13:18.608926+0000","last_peered":"2024-08-19T00:13:18.608926+0000","last_clean":"2024-08-19T00:13:18.608926+0000","last_became_active":"2024-08-19T00:10:50.476455+0000","last_became_peered":"2024-08-19T00:10:50.476455+0000","last_unstale":"2024-08-19T00:13:18.608926+0000","last_undegraded":"2024-08-19T00:13:18.608926+0000","last_fullsized":"2024-08-19T00:13:18.608926+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:34:52.158438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744026+0000","last_change":"2024-08-19T00:10:59.778313+0000","last_active":"2024-08-19T00:13:18.744026+0000","last_peered":"2024-08-19T00:13:18.744026+0000","last_clean":"2024-08-19T00:13:18.744026+0000","last_became_active":"2024-08-19T00:10:59.777831+0000","last_became_peered":"2024-08-19T00:10:59.777831+0000","last_unstale":"2024-08-19T00:13:18.744026+0000","last_undegraded":"2024-08-19T00:13:18.744026+0000","last_fullsized":"2024-08-19T00:13:18.744026+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:34:05.474277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"94'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743606+0000","last_change":"2024-08-19T00:10:52.513719+0000","last_active":"2024-08-19T00:13:18.743606+0000","last_peered":"2024-08-19T00:13:18.743606+0000","last_clean":"2024-08-19T00:13:18.743606+0000","last_became_active":"2024-08-19T00:10:52.513345+0000","last_became_peered":"2024-08-19T00:10:52.513345+0000","last_unstale":"2024-08-19T00:13:18.743606+0000","last_undegraded":"2024-08-19T00:13:18.743606+0000","last_fullsized":"2024-08-19T00:13:18.743606+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:50:28.862870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"90'9","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744336+0000","last_change":"2024-08-19T00:10:50.475529+0000","last_active":"2024-08-19T00:13:18.744336+0000","last_peered":"2024-08-19T00:13:18.744336+0000","last_clean":"2024-08-19T00:13:18.744336+0000","last_became_active":"2024-08-19T00:10:50.473544+0000","last_became_peered":"2024-08-19T00:10:50.473544+0000","last_unstale":"2024-08-19T00:13:18.744336+0000","last_undegraded":"2024-08-19T00:13:18.744336+0000","last_fullsized":"2024-08-19T00:13:18.744336+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:49:42.663650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.609117+0000","last_change":"2024-08-19T00:10:59.789028+0000","last_active":"2024-08-19T00:13:18.609117+0000","last_peered":"2024-08-19T00:13:18.609117+0000","last_clean":"2024-08-19T00:13:18.609117+0000","last_became_active":"2024-08-19T00:10:59.788606+0000","last_became_peered":"2024-08-19T00:10:59.788606+0000","last_unstale":"2024-08-19T00:13:18.609117+0000","last_undegraded":"2024-08-19T00:13:18.609117+0000","last_fullsized":"2024-08-19T00:13:18.609117+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:59:06.617755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"94'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.509199+0000","last_change":"2024-08-19T00:10:52.520826+0000","last_active":"2024-08-19T00:13:18.509199+0000","last_peered":"2024-08-19T00:13:18.509199+0000","last_clean":"2024-08-19T00:13:18.509199+0000","last_became_active":"2024-08-19T00:10:52.520437+0000","last_became_peered":"2024-08-19T00:10:52.520437+0000","last_unstale":"2024-08-19T00:13:18.509199+0000","last_undegraded":"2024-08-19T00:13:18.509199+0000","last_fullsized":"2024-08-19T00:13:18.509199+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:30:06.843697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"95'43","reported_seq":314,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:24.094720+0000","last_change":"2024-08-19T00:10:50.473195+0000","last_active":"2024-08-19T00:13:24.094720+0000","last_peered":"2024-08-19T00:13:24.094720+0000","last_clean":"2024-08-19T00:13:24.094720+0000","last_became_active":"2024-08-19T00:10:50.472863+0000","last_became_peered":"2024-08-19T00:10:50.472863+0000","last_unstale":"2024-08-19T00:13:24.094720+0000","last_undegraded":"2024-08-19T00:13:24.094720+0000","last_fullsized":"2024-08-19T00:13:24.094720+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:09:04.859829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72703,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":230,"num_read_kb":186,"num_write":45,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.611579+0000","last_change":"2024-08-19T00:11:39.922405+0000","last_active":"2024-08-19T00:13:18.611579+0000","last_peered":"2024-08-19T00:13:18.611579+0000","last_clean":"2024-08-19T00:13:18.611579+0000","last_became_active":"2024-08-19T00:11:39.922054+0000","last_became_peered":"2024-08-19T00:11:39.922054+0000","last_unstale":"2024-08-19T00:13:18.611579+0000","last_undegraded":"2024-08-19T00:13:18.611579+0000","last_fullsized":"2024-08-19T00:13:18.611579+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:47:01.990229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.14","version":"94'11","reported_seq":53,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743816+0000","last_change":"2024-08-19T00:11:39.918080+0000","last_active":"2024-08-19T00:13:18.743816+0000","last_peered":"2024-08-19T00:13:18.743816+0000","last_clean":"2024-08-19T00:13:18.743816+0000","last_became_active":"2024-08-19T00:11:39.917742+0000","last_became_peered":"2024-08-19T00:11:39.917742+0000","last_unstale":"2024-08-19T00:13:18.743816+0000","last_undegraded":"2024-08-19T00:13:18.743816+0000","last_fullsized":"2024-08-19T00:13:18.743816+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:57:19.983148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"90'5","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.609345+0000","last_change":"2024-08-19T00:10:50.618094+0000","last_active":"2024-08-19T00:13:18.609345+0000","last_peered":"2024-08-19T00:13:18.609345+0000","last_clean":"2024-08-19T00:13:18.609345+0000","last_became_active":"2024-08-19T00:10:50.617786+0000","last_became_peered":"2024-08-19T00:10:50.617786+0000","last_unstale":"2024-08-19T00:13:18.609345+0000","last_undegraded":"2024-08-19T00:13:18.609345+0000","last_fullsized":"2024-08-19T00:13:18.609345+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:05:46.231214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.511811+0000","last_change":"2024-08-19T00:10:59.780786+0000","last_active":"2024-08-19T00:13:18.511811+0000","last_peered":"2024-08-19T00:13:18.511811+0000","last_clean":"2024-08-19T00:13:18.511811+0000","last_became_active":"2024-08-19T00:10:59.780364+0000","last_became_peered":"2024-08-19T00:10:59.780364+0000","last_unstale":"2024-08-19T00:13:18.511811+0000","last_undegraded":"2024-08-19T00:13:18.511811+0000","last_fullsized":"2024-08-19T00:13:18.511811+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:39:45.113590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"94'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.745242+0000","last_change":"2024-08-19T00:10:52.520623+0000","last_active":"2024-08-19T00:13:18.745242+0000","last_peered":"2024-08-19T00:13:18.745242+0000","last_clean":"2024-08-19T00:13:18.745242+0000","last_became_active":"2024-08-19T00:10:52.520321+0000","last_became_peered":"2024-08-19T00:10:52.520321+0000","last_unstale":"2024-08-19T00:13:18.745242+0000","last_undegraded":"2024-08-19T00:13:18.745242+0000","last_fullsized":"2024-08-19T00:13:18.745242+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:56:42.526199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"90'4","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744494+0000","last_change":"2024-08-19T00:10:50.474925+0000","last_active":"2024-08-19T00:13:18.744494+0000","last_peered":"2024-08-19T00:13:18.744494+0000","last_clean":"2024-08-19T00:13:18.744494+0000","last_became_active":"2024-08-19T00:10:50.474573+0000","last_became_peered":"2024-08-19T00:10:50.474573+0000","last_unstale":"2024-08-19T00:13:18.744494+0000","last_undegraded":"2024-08-19T00:13:18.744494+0000","last_fullsized":"2024-08-19T00:13:18.744494+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:10:32.136867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.508672+0000","last_change":"2024-08-19T00:11:39.920527+0000","last_active":"2024-08-19T00:13:18.508672+0000","last_peered":"2024-08-19T00:13:18.508672+0000","last_clean":"2024-08-19T00:13:18.508672+0000","last_became_active":"2024-08-19T00:11:39.919490+0000","last_became_peered":"2024-08-19T00:11:39.919490+0000","last_unstale":"2024-08-19T00:13:18.508672+0000","last_undegraded":"2024-08-19T00:13:18.508672+0000","last_fullsized":"2024-08-19T00:13:18.508672+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:33:09.191177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"94'10","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743676+0000","last_change":"2024-08-19T00:10:52.510783+0000","last_active":"2024-08-19T00:13:18.743676+0000","last_peered":"2024-08-19T00:13:18.743676+0000","last_clean":"2024-08-19T00:13:18.743676+0000","last_became_active":"2024-08-19T00:10:52.510359+0000","last_became_peered":"2024-08-19T00:10:52.510359+0000","last_unstale":"2024-08-19T00:13:18.743676+0000","last_undegraded":"2024-08-19T00:13:18.743676+0000","last_fullsized":"2024-08-19T00:13:18.743676+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:20:03.682633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"95'6","reported_seq":263,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:24.071909+0000","last_change":"2024-08-19T00:10:50.470887+0000","last_active":"2024-08-19T00:13:24.071909+0000","last_peered":"2024-08-19T00:13:24.071909+0000","last_clean":"2024-08-19T00:13:24.071909+0000","last_became_active":"2024-08-19T00:10:50.470517+0000","last_became_peered":"2024-08-19T00:10:50.470517+0000","last_unstale":"2024-08-19T00:13:24.071909+0000","last_undegraded":"2024-08-19T00:13:24.071909+0000","last_fullsized":"2024-08-19T00:13:24.071909+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:52:33.864552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":216,"num_read_kb":216,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.507670+0000","last_change":"2024-08-19T00:10:59.787686+0000","last_active":"2024-08-19T00:13:18.507670+0000","last_peered":"2024-08-19T00:13:18.507670+0000","last_clean":"2024-08-19T00:13:18.507670+0000","last_became_active":"2024-08-19T00:10:59.787236+0000","last_became_peered":"2024-08-19T00:10:59.787236+0000","last_unstale":"2024-08-19T00:13:18.507670+0000","last_undegraded":"2024-08-19T00:13:18.507670+0000","last_fullsized":"2024-08-19T00:13:18.507670+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:57:11.012865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743827+0000","last_change":"2024-08-19T00:10:59.782541+0000","last_active":"2024-08-19T00:13:18.743827+0000","last_peered":"2024-08-19T00:13:18.743827+0000","last_clean":"2024-08-19T00:13:18.743827+0000","last_became_active":"2024-08-19T00:10:59.782136+0000","last_became_peered":"2024-08-19T00:10:59.782136+0000","last_unstale":"2024-08-19T00:13:18.743827+0000","last_undegraded":"2024-08-19T00:13:18.743827+0000","last_fullsized":"2024-08-19T00:13:18.743827+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:44:39.501168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"94'11","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.598488+0000","last_change":"2024-08-19T00:10:52.509396+0000","last_active":"2024-08-19T00:13:18.598488+0000","last_peered":"2024-08-19T00:13:18.598488+0000","last_clean":"2024-08-19T00:13:18.598488+0000","last_became_active":"2024-08-19T00:10:52.509075+0000","last_became_peered":"2024-08-19T00:10:52.509075+0000","last_unstale":"2024-08-19T00:13:18.598488+0000","last_undegraded":"2024-08-19T00:13:18.598488+0000","last_fullsized":"2024-08-19T00:13:18.598488+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:40:53.611213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"90'3","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.609141+0000","last_change":"2024-08-19T00:10:50.476723+0000","last_active":"2024-08-19T00:13:18.609141+0000","last_peered":"2024-08-19T00:13:18.609141+0000","last_clean":"2024-08-19T00:13:18.609141+0000","last_became_active":"2024-08-19T00:10:50.476399+0000","last_became_peered":"2024-08-19T00:10:50.476399+0000","last_unstale":"2024-08-19T00:13:18.609141+0000","last_undegraded":"2024-08-19T00:13:18.609141+0000","last_fullsized":"2024-08-19T00:13:18.609141+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:04:01.951387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744326+0000","last_change":"2024-08-19T00:10:59.781481+0000","last_active":"2024-08-19T00:13:18.744326+0000","last_peered":"2024-08-19T00:13:18.744326+0000","last_clean":"2024-08-19T00:13:18.744326+0000","last_became_active":"2024-08-19T00:10:59.780160+0000","last_became_peered":"2024-08-19T00:10:59.780160+0000","last_unstale":"2024-08-19T00:13:18.744326+0000","last_undegraded":"2024-08-19T00:13:18.744326+0000","last_fullsized":"2024-08-19T00:13:18.744326+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:14:46.340158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"94'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.507696+0000","last_change":"2024-08-19T00:10:52.516780+0000","last_active":"2024-08-19T00:13:18.507696+0000","last_peered":"2024-08-19T00:13:18.507696+0000","last_clean":"2024-08-19T00:13:18.507696+0000","last_became_active":"2024-08-19T00:10:52.513264+0000","last_became_peered":"2024-08-19T00:10:52.513264+0000","last_unstale":"2024-08-19T00:13:18.507696+0000","last_undegraded":"2024-08-19T00:13:18.507696+0000","last_fullsized":"2024-08-19T00:13:18.507696+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:36:49.238267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"90'3","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743315+0000","last_change":"2024-08-19T00:10:50.472840+0000","last_active":"2024-08-19T00:13:18.743315+0000","last_peered":"2024-08-19T00:13:18.743315+0000","last_clean":"2024-08-19T00:13:18.743315+0000","last_became_active":"2024-08-19T00:10:50.472534+0000","last_became_peered":"2024-08-19T00:10:50.472534+0000","last_unstale":"2024-08-19T00:13:18.743315+0000","last_undegraded":"2024-08-19T00:13:18.743315+0000","last_fullsized":"2024-08-19T00:13:18.743315+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:41:53.505360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"90'7","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.611874+0000","last_change":"2024-08-19T00:10:50.469342+0000","last_active":"2024-08-19T00:13:18.611874+0000","last_peered":"2024-08-19T00:13:18.611874+0000","last_clean":"2024-08-19T00:13:18.611874+0000","last_became_active":"2024-08-19T00:10:50.468800+0000","last_became_peered":"2024-08-19T00:10:50.468800+0000","last_unstale":"2024-08-19T00:13:18.611874+0000","last_undegraded":"2024-08-19T00:13:18.611874+0000","last_fullsized":"2024-08-19T00:13:18.611874+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:58:28.804117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"94'8","reported_seq":50,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.609141+0000","last_change":"2024-08-19T00:12:41.003498+0000","last_active":"2024-08-19T00:13:18.609141+0000","last_peered":"2024-08-19T00:13:18.609141+0000","last_clean":"2024-08-19T00:13:18.609141+0000","last_became_active":"2024-08-19T00:12:41.003165+0000","last_became_peered":"2024-08-19T00:12:41.003165+0000","last_unstale":"2024-08-19T00:13:18.609141+0000","last_undegraded":"2024-08-19T00:13:18.609141+0000","last_fullsized":"2024-08-19T00:13:18.609141+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:17:46.977154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744443+0000","last_change":"2024-08-19T00:11:39.922401+0000","last_active":"2024-08-19T00:13:18.744443+0000","last_peered":"2024-08-19T00:13:18.744443+0000","last_clean":"2024-08-19T00:13:18.744443+0000","last_became_active":"2024-08-19T00:11:39.921979+0000","last_became_peered":"2024-08-19T00:11:39.921979+0000","last_unstale":"2024-08-19T00:13:18.744443+0000","last_undegraded":"2024-08-19T00:13:18.744443+0000","last_fullsized":"2024-08-19T00:13:18.744443+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:58:57.453222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,8],"acting":[2,6,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"95'7","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:23.071034+0000","last_change":"2024-08-19T00:10:50.476035+0000","last_active":"2024-08-19T00:13:23.071034+0000","last_peered":"2024-08-19T00:13:23.071034+0000","last_clean":"2024-08-19T00:13:23.071034+0000","last_became_active":"2024-08-19T00:10:50.475733+0000","last_became_peered":"2024-08-19T00:10:50.475733+0000","last_unstale":"2024-08-19T00:13:23.071034+0000","last_undegraded":"2024-08-19T00:13:23.071034+0000","last_fullsized":"2024-08-19T00:13:23.071034+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:49.454856+0000","last_clean_scrub_stamp":"2024-08-19T00:10:49.454856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:27:59.026582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1402,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":112,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"94'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.508940+0000","last_change":"2024-08-19T00:10:52.522185+0000","last_active":"2024-08-19T00:13:18.508940+0000","last_peered":"2024-08-19T00:13:18.508940+0000","last_clean":"2024-08-19T00:13:18.508940+0000","last_became_active":"2024-08-19T00:10:52.521747+0000","last_became_peered":"2024-08-19T00:10:52.521747+0000","last_unstale":"2024-08-19T00:13:18.508940+0000","last_undegraded":"2024-08-19T00:13:18.508940+0000","last_fullsized":"2024-08-19T00:13:18.508940+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:14:23.631484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744081+0000","last_change":"2024-08-19T00:10:59.783512+0000","last_active":"2024-08-19T00:13:18.744081+0000","last_peered":"2024-08-19T00:13:18.744081+0000","last_clean":"2024-08-19T00:13:18.744081+0000","last_became_active":"2024-08-19T00:10:59.783099+0000","last_became_peered":"2024-08-19T00:10:59.783099+0000","last_unstale":"2024-08-19T00:13:18.744081+0000","last_undegraded":"2024-08-19T00:13:18.744081+0000","last_fullsized":"2024-08-19T00:13:18.744081+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:58.761458+0000","last_clean_scrub_stamp":"2024-08-19T00:10:58.761458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:02:27.977608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"94'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743805+0000","last_change":"2024-08-19T00:10:52.524213+0000","last_active":"2024-08-19T00:13:18.743805+0000","last_peered":"2024-08-19T00:13:18.743805+0000","last_clean":"2024-08-19T00:13:18.743805+0000","last_became_active":"2024-08-19T00:10:52.523185+0000","last_became_peered":"2024-08-19T00:10:52.523185+0000","last_unstale":"2024-08-19T00:13:18.743805+0000","last_undegraded":"2024-08-19T00:13:18.743805+0000","last_fullsized":"2024-08-19T00:13:18.743805+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:23:48.569312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"94'12","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744418+0000","last_change":"2024-08-19T00:10:52.521436+0000","last_active":"2024-08-19T00:13:18.744418+0000","last_peered":"2024-08-19T00:13:18.744418+0000","last_clean":"2024-08-19T00:13:18.744418+0000","last_became_active":"2024-08-19T00:10:52.520842+0000","last_became_peered":"2024-08-19T00:10:52.520842+0000","last_unstale":"2024-08-19T00:13:18.744418+0000","last_undegraded":"2024-08-19T00:13:18.744418+0000","last_fullsized":"2024-08-19T00:13:18.744418+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:22:31.568680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"94'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743973+0000","last_change":"2024-08-19T00:10:52.514170+0000","last_active":"2024-08-19T00:13:18.743973+0000","last_peered":"2024-08-19T00:13:18.743973+0000","last_clean":"2024-08-19T00:13:18.743973+0000","last_became_active":"2024-08-19T00:10:52.513870+0000","last_became_peered":"2024-08-19T00:10:52.513870+0000","last_unstale":"2024-08-19T00:13:18.743973+0000","last_undegraded":"2024-08-19T00:13:18.743973+0000","last_fullsized":"2024-08-19T00:13:18.743973+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:29:04.125347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"94'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743995+0000","last_change":"2024-08-19T00:10:52.512320+0000","last_active":"2024-08-19T00:13:18.743995+0000","last_peered":"2024-08-19T00:13:18.743995+0000","last_clean":"2024-08-19T00:13:18.743995+0000","last_became_active":"2024-08-19T00:10:52.512003+0000","last_became_peered":"2024-08-19T00:10:52.512003+0000","last_unstale":"2024-08-19T00:13:18.743995+0000","last_undegraded":"2024-08-19T00:13:18.743995+0000","last_fullsized":"2024-08-19T00:13:18.743995+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:28:52.261457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"94'4","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744707+0000","last_change":"2024-08-19T00:10:52.511454+0000","last_active":"2024-08-19T00:13:18.744707+0000","last_peered":"2024-08-19T00:13:18.744707+0000","last_clean":"2024-08-19T00:13:18.744707+0000","last_became_active":"2024-08-19T00:10:52.511036+0000","last_became_peered":"2024-08-19T00:10:52.511036+0000","last_unstale":"2024-08-19T00:13:18.744707+0000","last_undegraded":"2024-08-19T00:13:18.744707+0000","last_fullsized":"2024-08-19T00:13:18.744707+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:14:04.749222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"94'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744667+0000","last_change":"2024-08-19T00:10:52.526393+0000","last_active":"2024-08-19T00:13:18.744667+0000","last_peered":"2024-08-19T00:13:18.744667+0000","last_clean":"2024-08-19T00:13:18.744667+0000","last_became_active":"2024-08-19T00:10:52.526043+0000","last_became_peered":"2024-08-19T00:10:52.526043+0000","last_unstale":"2024-08-19T00:13:18.744667+0000","last_undegraded":"2024-08-19T00:13:18.744667+0000","last_fullsized":"2024-08-19T00:13:18.744667+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:18:48.505255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"94'15","reported_seq":51,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744575+0000","last_change":"2024-08-19T00:10:52.516028+0000","last_active":"2024-08-19T00:13:18.744575+0000","last_peered":"2024-08-19T00:13:18.744575+0000","last_clean":"2024-08-19T00:13:18.744575+0000","last_became_active":"2024-08-19T00:10:52.515659+0000","last_became_peered":"2024-08-19T00:10:52.515659+0000","last_unstale":"2024-08-19T00:13:18.744575+0000","last_undegraded":"2024-08-19T00:13:18.744575+0000","last_fullsized":"2024-08-19T00:13:18.744575+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:31:14.995175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"94'2","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.509366+0000","last_change":"2024-08-19T00:10:52.516196+0000","last_active":"2024-08-19T00:13:18.509366+0000","last_peered":"2024-08-19T00:13:18.509366+0000","last_clean":"2024-08-19T00:13:18.509366+0000","last_became_active":"2024-08-19T00:10:52.515533+0000","last_became_peered":"2024-08-19T00:10:52.515533+0000","last_unstale":"2024-08-19T00:13:18.509366+0000","last_undegraded":"2024-08-19T00:13:18.509366+0000","last_fullsized":"2024-08-19T00:13:18.509366+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:32:25.207184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"94'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.608755+0000","last_change":"2024-08-19T00:10:52.527433+0000","last_active":"2024-08-19T00:13:18.608755+0000","last_peered":"2024-08-19T00:13:18.608755+0000","last_clean":"2024-08-19T00:13:18.608755+0000","last_became_active":"2024-08-19T00:10:52.525490+0000","last_became_peered":"2024-08-19T00:10:52.525490+0000","last_unstale":"2024-08-19T00:13:18.608755+0000","last_undegraded":"2024-08-19T00:13:18.608755+0000","last_fullsized":"2024-08-19T00:13:18.608755+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:21:14.545808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"94'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.507749+0000","last_change":"2024-08-19T00:10:52.515503+0000","last_active":"2024-08-19T00:13:18.507749+0000","last_peered":"2024-08-19T00:13:18.507749+0000","last_clean":"2024-08-19T00:13:18.507749+0000","last_became_active":"2024-08-19T00:10:52.515178+0000","last_became_peered":"2024-08-19T00:10:52.515178+0000","last_unstale":"2024-08-19T00:13:18.507749+0000","last_undegraded":"2024-08-19T00:13:18.507749+0000","last_fullsized":"2024-08-19T00:13:18.507749+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:30:27.825463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"94'10","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743607+0000","last_change":"2024-08-19T00:10:52.515133+0000","last_active":"2024-08-19T00:13:18.743607+0000","last_peered":"2024-08-19T00:13:18.743607+0000","last_clean":"2024-08-19T00:13:18.743607+0000","last_became_active":"2024-08-19T00:10:52.514851+0000","last_became_peered":"2024-08-19T00:10:52.514851+0000","last_unstale":"2024-08-19T00:13:18.743607+0000","last_undegraded":"2024-08-19T00:13:18.743607+0000","last_fullsized":"2024-08-19T00:13:18.743607+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:38:53.593993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"94'11","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744148+0000","last_change":"2024-08-19T00:10:52.512127+0000","last_active":"2024-08-19T00:13:18.744148+0000","last_peered":"2024-08-19T00:13:18.744148+0000","last_clean":"2024-08-19T00:13:18.744148+0000","last_became_active":"2024-08-19T00:10:52.511840+0000","last_became_peered":"2024-08-19T00:10:52.511840+0000","last_unstale":"2024-08-19T00:13:18.744148+0000","last_undegraded":"2024-08-19T00:13:18.744148+0000","last_fullsized":"2024-08-19T00:13:18.744148+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:36:32.878531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"94'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744083+0000","last_change":"2024-08-19T00:10:52.519470+0000","last_active":"2024-08-19T00:13:18.744083+0000","last_peered":"2024-08-19T00:13:18.744083+0000","last_clean":"2024-08-19T00:13:18.744083+0000","last_became_active":"2024-08-19T00:10:52.519131+0000","last_became_peered":"2024-08-19T00:10:52.519131+0000","last_unstale":"2024-08-19T00:13:18.744083+0000","last_undegraded":"2024-08-19T00:13:18.744083+0000","last_fullsized":"2024-08-19T00:13:18.744083+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:56:53.628868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"94'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744233+0000","last_change":"2024-08-19T00:10:52.511114+0000","last_active":"2024-08-19T00:13:18.744233+0000","last_peered":"2024-08-19T00:13:18.744233+0000","last_clean":"2024-08-19T00:13:18.744233+0000","last_became_active":"2024-08-19T00:10:52.510759+0000","last_became_peered":"2024-08-19T00:10:52.510759+0000","last_unstale":"2024-08-19T00:13:18.744233+0000","last_undegraded":"2024-08-19T00:13:18.744233+0000","last_fullsized":"2024-08-19T00:13:18.744233+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:54:10.590297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"94'10","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.600061+0000","last_change":"2024-08-19T00:10:52.507998+0000","last_active":"2024-08-19T00:13:18.600061+0000","last_peered":"2024-08-19T00:13:18.600061+0000","last_clean":"2024-08-19T00:13:18.600061+0000","last_became_active":"2024-08-19T00:10:52.507679+0000","last_became_peered":"2024-08-19T00:10:52.507679+0000","last_unstale":"2024-08-19T00:13:18.600061+0000","last_undegraded":"2024-08-19T00:13:18.600061+0000","last_fullsized":"2024-08-19T00:13:18.600061+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:59:48.098911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"94'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744812+0000","last_change":"2024-08-19T00:10:52.524171+0000","last_active":"2024-08-19T00:13:18.744812+0000","last_peered":"2024-08-19T00:13:18.744812+0000","last_clean":"2024-08-19T00:13:18.744812+0000","last_became_active":"2024-08-19T00:10:52.523028+0000","last_became_peered":"2024-08-19T00:10:52.523028+0000","last_unstale":"2024-08-19T00:13:18.744812+0000","last_undegraded":"2024-08-19T00:13:18.744812+0000","last_fullsized":"2024-08-19T00:13:18.744812+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:51:24.567971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"94'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743295+0000","last_change":"2024-08-19T00:10:52.514309+0000","last_active":"2024-08-19T00:13:18.743295+0000","last_peered":"2024-08-19T00:13:18.743295+0000","last_clean":"2024-08-19T00:13:18.743295+0000","last_became_active":"2024-08-19T00:10:52.513992+0000","last_became_peered":"2024-08-19T00:10:52.513992+0000","last_unstale":"2024-08-19T00:13:18.743295+0000","last_undegraded":"2024-08-19T00:13:18.743295+0000","last_fullsized":"2024-08-19T00:13:18.743295+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:34:14.014490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"94'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743785+0000","last_change":"2024-08-19T00:10:52.516033+0000","last_active":"2024-08-19T00:13:18.743785+0000","last_peered":"2024-08-19T00:13:18.743785+0000","last_clean":"2024-08-19T00:13:18.743785+0000","last_became_active":"2024-08-19T00:10:52.515713+0000","last_became_peered":"2024-08-19T00:10:52.515713+0000","last_unstale":"2024-08-19T00:13:18.743785+0000","last_undegraded":"2024-08-19T00:13:18.743785+0000","last_fullsized":"2024-08-19T00:13:18.743785+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:06:40.832460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"94'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743710+0000","last_change":"2024-08-19T00:10:52.518521+0000","last_active":"2024-08-19T00:13:18.743710+0000","last_peered":"2024-08-19T00:13:18.743710+0000","last_clean":"2024-08-19T00:13:18.743710+0000","last_became_active":"2024-08-19T00:10:52.518237+0000","last_became_peered":"2024-08-19T00:10:52.518237+0000","last_unstale":"2024-08-19T00:13:18.743710+0000","last_undegraded":"2024-08-19T00:13:18.743710+0000","last_fullsized":"2024-08-19T00:13:18.743710+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:17:20.569044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"94'10","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744044+0000","last_change":"2024-08-19T00:10:52.519774+0000","last_active":"2024-08-19T00:13:18.744044+0000","last_peered":"2024-08-19T00:13:18.744044+0000","last_clean":"2024-08-19T00:13:18.744044+0000","last_became_active":"2024-08-19T00:10:52.519456+0000","last_became_peered":"2024-08-19T00:10:52.519456+0000","last_unstale":"2024-08-19T00:13:18.744044+0000","last_undegraded":"2024-08-19T00:13:18.744044+0000","last_fullsized":"2024-08-19T00:13:18.744044+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:47:52.675650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"94'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.512063+0000","last_change":"2024-08-19T00:10:52.514200+0000","last_active":"2024-08-19T00:13:18.512063+0000","last_peered":"2024-08-19T00:13:18.512063+0000","last_clean":"2024-08-19T00:13:18.512063+0000","last_became_active":"2024-08-19T00:10:52.513821+0000","last_became_peered":"2024-08-19T00:10:52.513821+0000","last_unstale":"2024-08-19T00:13:18.512063+0000","last_undegraded":"2024-08-19T00:13:18.512063+0000","last_fullsized":"2024-08-19T00:13:18.512063+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:15:30.084873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"94'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744616+0000","last_change":"2024-08-19T00:10:52.519781+0000","last_active":"2024-08-19T00:13:18.744616+0000","last_peered":"2024-08-19T00:13:18.744616+0000","last_clean":"2024-08-19T00:13:18.744616+0000","last_became_active":"2024-08-19T00:10:52.519395+0000","last_became_peered":"2024-08-19T00:10:52.519395+0000","last_unstale":"2024-08-19T00:13:18.744616+0000","last_undegraded":"2024-08-19T00:13:18.744616+0000","last_fullsized":"2024-08-19T00:13:18.744616+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T12:10:15.160535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"94'16","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.612076+0000","last_change":"2024-08-19T00:10:52.510293+0000","last_active":"2024-08-19T00:13:18.612076+0000","last_peered":"2024-08-19T00:13:18.612076+0000","last_clean":"2024-08-19T00:13:18.612076+0000","last_became_active":"2024-08-19T00:10:52.509983+0000","last_became_peered":"2024-08-19T00:10:52.509983+0000","last_unstale":"2024-08-19T00:13:18.612076+0000","last_undegraded":"2024-08-19T00:13:18.612076+0000","last_fullsized":"2024-08-19T00:13:18.612076+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:59:11.488742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"94'11","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743899+0000","last_change":"2024-08-19T00:10:52.518778+0000","last_active":"2024-08-19T00:13:18.743899+0000","last_peered":"2024-08-19T00:13:18.743899+0000","last_clean":"2024-08-19T00:13:18.743899+0000","last_became_active":"2024-08-19T00:10:52.518209+0000","last_became_peered":"2024-08-19T00:10:52.518209+0000","last_unstale":"2024-08-19T00:13:18.743899+0000","last_undegraded":"2024-08-19T00:13:18.743899+0000","last_fullsized":"2024-08-19T00:13:18.743899+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:23:19.255833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"94'9","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.507723+0000","last_change":"2024-08-19T00:10:52.523824+0000","last_active":"2024-08-19T00:13:18.507723+0000","last_peered":"2024-08-19T00:13:18.507723+0000","last_clean":"2024-08-19T00:13:18.507723+0000","last_became_active":"2024-08-19T00:10:52.523075+0000","last_became_peered":"2024-08-19T00:10:52.523075+0000","last_unstale":"2024-08-19T00:13:18.507723+0000","last_undegraded":"2024-08-19T00:13:18.507723+0000","last_fullsized":"2024-08-19T00:13:18.507723+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:23:58.618712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"94'5","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743460+0000","last_change":"2024-08-19T00:10:52.523508+0000","last_active":"2024-08-19T00:13:18.743460+0000","last_peered":"2024-08-19T00:13:18.743460+0000","last_clean":"2024-08-19T00:13:18.743460+0000","last_became_active":"2024-08-19T00:10:52.523104+0000","last_became_peered":"2024-08-19T00:10:52.523104+0000","last_unstale":"2024-08-19T00:13:18.743460+0000","last_undegraded":"2024-08-19T00:13:18.743460+0000","last_fullsized":"2024-08-19T00:13:18.743460+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:04:06.932548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"94'6","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.611758+0000","last_change":"2024-08-19T00:10:52.510147+0000","last_active":"2024-08-19T00:13:18.611758+0000","last_peered":"2024-08-19T00:13:18.611758+0000","last_clean":"2024-08-19T00:13:18.611758+0000","last_became_active":"2024-08-19T00:10:52.509807+0000","last_became_peered":"2024-08-19T00:10:52.509807+0000","last_unstale":"2024-08-19T00:13:18.611758+0000","last_undegraded":"2024-08-19T00:13:18.611758+0000","last_fullsized":"2024-08-19T00:13:18.611758+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:09:55.965318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"94'4","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.509115+0000","last_change":"2024-08-19T00:10:52.512997+0000","last_active":"2024-08-19T00:13:18.509115+0000","last_peered":"2024-08-19T00:13:18.509115+0000","last_clean":"2024-08-19T00:13:18.509115+0000","last_became_active":"2024-08-19T00:10:52.512688+0000","last_became_peered":"2024-08-19T00:10:52.512688+0000","last_unstale":"2024-08-19T00:13:18.509115+0000","last_undegraded":"2024-08-19T00:13:18.509115+0000","last_fullsized":"2024-08-19T00:13:18.509115+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:57:33.607060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"94'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.512004+0000","last_change":"2024-08-19T00:10:52.517492+0000","last_active":"2024-08-19T00:13:18.512004+0000","last_peered":"2024-08-19T00:13:18.512004+0000","last_clean":"2024-08-19T00:13:18.512004+0000","last_became_active":"2024-08-19T00:10:52.517153+0000","last_became_peered":"2024-08-19T00:10:52.517153+0000","last_unstale":"2024-08-19T00:13:18.512004+0000","last_undegraded":"2024-08-19T00:13:18.512004+0000","last_fullsized":"2024-08-19T00:13:18.512004+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:07:07.244331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"94'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744527+0000","last_change":"2024-08-19T00:10:52.517396+0000","last_active":"2024-08-19T00:13:18.744527+0000","last_peered":"2024-08-19T00:13:18.744527+0000","last_clean":"2024-08-19T00:13:18.744527+0000","last_became_active":"2024-08-19T00:10:52.517108+0000","last_became_peered":"2024-08-19T00:10:52.517108+0000","last_unstale":"2024-08-19T00:13:18.744527+0000","last_undegraded":"2024-08-19T00:13:18.744527+0000","last_fullsized":"2024-08-19T00:13:18.744527+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:10:41.477770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"94'4","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.743934+0000","last_change":"2024-08-19T00:10:52.515841+0000","last_active":"2024-08-19T00:13:18.743934+0000","last_peered":"2024-08-19T00:13:18.743934+0000","last_clean":"2024-08-19T00:13:18.743934+0000","last_became_active":"2024-08-19T00:10:52.515524+0000","last_became_peered":"2024-08-19T00:10:52.515524+0000","last_unstale":"2024-08-19T00:13:18.743934+0000","last_undegraded":"2024-08-19T00:13:18.743934+0000","last_fullsized":"2024-08-19T00:13:18.743934+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:18:51.991468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"94'8","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-08-19T00:13:18.744654+0000","last_change":"2024-08-19T00:10:52.522670+0000","last_active":"2024-08-19T00:13:18.744654+0000","last_peered":"2024-08-19T00:13:18.744654+0000","last_clean":"2024-08-19T00:13:18.744654+0000","last_became_active":"2024-08-19T00:10:52.522275+0000","last_became_peered":"2024-08-19T00:10:52.522275+0000","last_unstale":"2024-08-19T00:13:18.744654+0000","last_undegraded":"2024-08-19T00:13:18.744654+0000","last_fullsized":"2024-08-19T00:13:18.744654+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:10:51.482326+0000","last_clean_scrub_stamp":"2024-08-19T00:10:51.482326+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:55:48.756230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":803693,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":1474,"num_read_kb":962,"num_write":512,"num_write_kb":2391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2777088,"data_stored":2411079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":389,"ondisk_log_size":389,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449132,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36428,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708724,"statfs":{"total":95995035648,"available":95957733376,"internally_reserved":0,"allocated":1114112,"data_stored":548434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":71,"seq":304942678063,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37428,"kb_used_data":2092,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93707724,"statfs":{"total":95995035648,"available":95956709376,"internally_reserved":0,"allocated":2142208,"data_stored":1535683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":65,"seq":279172874292,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28508,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716644,"statfs":{"total":95995035648,"available":95965843456,"internally_reserved":0,"allocated":1527808,"data_stored":944784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135928,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28492,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716660,"statfs":{"total":95995035648,"available":95965859840,"internally_reserved":0,"allocated":1511424,"data_stored":940954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397565,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37020,"kb_used_data":1684,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708132,"statfs":{"total":95995035648,"available":95957127168,"internally_reserved":0,"allocated":1724416,"data_stored":1146296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561090,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28096,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717056,"statfs":{"total":95995035648,"available":95966265344,"internally_reserved":0,"allocated":1105920,"data_stored":544146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822726,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37472,"kb_used_data":2016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93707680,"statfs":{"total":95995035648,"available":95956664320,"internally_reserved":0,"allocated":2064384,"data_stored":1468550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986251,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36428,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708724,"statfs":{"total":95995035648,"available":95957733376,"internally_reserved":0,"allocated":1114112,"data_stored":547440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215183,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37256,"kb_used_data":1800,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93707896,"statfs":{"total":95995035648,"available":95956885504,"internally_reserved":0,"allocated":1843200,"data_stored":1264132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411411,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36512,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708640,"statfs":{"total":95995035648,"available":95957647360,"internally_reserved":0,"allocated":1204224,"data_stored":618489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574936,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28172,"kb_used_data":1156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716980,"statfs":{"total":95995035648,"available":95966187520,"internally_reserved":0,"allocated":1183744,"data_stored":617879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738460,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36444,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708708,"statfs":{"total":95995035648,"available":95957716992,"internally_reserved":0,"allocated":1130496,"data_stored":545212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":75625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":76235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":753664,"data_stored":721878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":331832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":394604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":394338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":458752,"data_stored":403061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-19T00:13:27.560 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-19T00:13:27.818 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:13:27.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:27 smithi116 ceph-mon[21873]: pgmap v7: 129 pgs: 129 active+clean; 1.3 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 132 KiB/s wr, 80 op/s 2024-08-19T00:13:27.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:27 smithi116 ceph-mon[21873]: from='client.15426 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-19T00:13:27.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:27 smithi044 ceph-mon[18489]: pgmap v7: 129 pgs: 129 active+clean; 1.3 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 132 KiB/s wr, 80 op/s 2024-08-19T00:13:27.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:27 smithi044 ceph-mon[18489]: from='client.15426 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-19T00:13:28.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:27 smithi171 ceph-mon[21810]: pgmap v7: 129 pgs: 129 active+clean; 1.3 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 132 KiB/s wr, 80 op/s 2024-08-19T00:13:28.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:27 smithi171 ceph-mon[21810]: from='client.15426 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-19T00:13:28.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:28.284+0000 7f48af340640 1 -- 172.21.15.44:0/1090063668 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48a8108030 msgr2=0x7f48a810e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:28.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:28.284+0000 7f48af340640 1 --2- 172.21.15.44:0/1090063668 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48a8108030 0x7f48a810e9a0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f48a0009cd0 tx=0x7f48a002a8f0 comp rx=0 tx=0).stop 2024-08-19T00:13:28.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:28.285+0000 7f48af340640 1 -- 172.21.15.44:0/1090063668 shutdown_connections 2024-08-19T00:13:28.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:28.285+0000 7f48af340640 1 --2- 172.21.15.44:0/1090063668 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f48a81034b0 0x7f48a81078f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:28.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:28.285+0000 7f48af340640 1 --2- 172.21.15.44:0/1090063668 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48a8108030 0x7f48a810e9a0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:28.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:28.285+0000 7f48af340640 1 --2- 172.21.15.44:0/1090063668 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f48a8102b00 0x7f48a8102ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:28.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:28.285+0000 7f48af340640 1 -- 172.21.15.44:0/1090063668 >> 172.21.15.44:0/1090063668 conn(0x7f48a80fc500 msgr2=0x7f48a80fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:28.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:28.285+0000 7f48af340640 1 -- 172.21.15.44:0/1090063668 shutdown_connections 2024-08-19T00:13:28.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:28.285+0000 7f48af340640 1 -- 172.21.15.44:0/1090063668 wait complete. 2024-08-19T00:13:28.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:28.285+0000 7f48af340640 1 Processor -- start 2024-08-19T00:13:28.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:28.285+0000 7f48af340640 1 -- start start 2024-08-19T00:13:28.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:28.285+0000 7f48af340640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f48a8102b00 0x7f48a81983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:28.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:28.285+0000 7f48af340640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48a81034b0 0x7f48a8198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:28.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:28.286+0000 7f48af340640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f48a8108030 0x7f48a819ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:28.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:28.286+0000 7f48af340640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f48a8111ef0 con 0x7f48a81034b0 2024-08-19T00:13:28.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:28.286+0000 7f48af340640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f48a8111d70 con 0x7f48a8102b00 2024-08-19T00:13:28.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:28.286+0000 7f48af340640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f48a8112070 con 0x7f48a8108030 2024-08-19T00:13:28.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:28.286+0000 7f48ac8db640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48a81034b0 0x7f48a8198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:28.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:28.286+0000 7f48ac8db640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48a81034b0 0x7f48a8198920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37156/0 (socket says 172.21.15.44:37156) 2024-08-19T00:13:28.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:28.286+0000 7f48ac8db640 1 -- 172.21.15.44:0/3255985745 learned_addr learned my addr 172.21.15.44:0/3255985745 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:28.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:28.286+0000 7f48ad8dd640 1 --2- 172.21.15.44:0/3255985745 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f48a8108030 0x7f48a819ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:28.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:28.286+0000 7f48ad0dc640 1 --2- 172.21.15.44:0/3255985745 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f48a8102b00 0x7f48a81983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:28.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:28.286+0000 7f48ac8db640 1 -- 172.21.15.44:0/3255985745 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f48a8108030 msgr2=0x7f48a819ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:28.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:28.286+0000 7f48ac8db640 1 --2- 172.21.15.44:0/3255985745 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f48a8108030 0x7f48a819ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:28.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:28.286+0000 7f48ac8db640 1 -- 172.21.15.44:0/3255985745 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f48a8102b00 msgr2=0x7f48a81983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:28.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:28.286+0000 7f48ac8db640 1 --2- 172.21.15.44:0/3255985745 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f48a8102b00 0x7f48a81983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:28.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:28.286+0000 7f48ac8db640 1 -- 172.21.15.44:0/3255985745 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48a819d390 con 0x7f48a81034b0 2024-08-19T00:13:28.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:28.286+0000 7f48ac8db640 1 --2- 172.21.15.44:0/3255985745 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48a81034b0 0x7f48a8198920 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f489c006fd0 tx=0x7f489c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:28.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:28.286+0000 7f489a7fc640 1 -- 172.21.15.44:0/3255985745 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f489c011830 con 0x7f48a81034b0 2024-08-19T00:13:28.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:28.286+0000 7f489a7fc640 1 -- 172.21.15.44:0/3255985745 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f489c016070 con 0x7f48a81034b0 2024-08-19T00:13:28.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:28.286+0000 7f48af340640 1 -- 172.21.15.44:0/3255985745 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48a819d680 con 0x7f48a81034b0 2024-08-19T00:13:28.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:28.286+0000 7f489a7fc640 1 -- 172.21.15.44:0/3255985745 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f489c00f2e0 con 0x7f48a81034b0 2024-08-19T00:13:28.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:28.286+0000 7f48af340640 1 -- 172.21.15.44:0/3255985745 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48a81a4f60 con 0x7f48a81034b0 2024-08-19T00:13:28.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:28.287+0000 7f48af340640 1 -- 172.21.15.44:0/3255985745 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48a8102f60 con 0x7f48a81034b0 2024-08-19T00:13:28.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:28.288+0000 7f489a7fc640 1 -- 172.21.15.44:0/3255985745 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 24) ==== 138060+0+0 (secure 0 0 0) 0x7f489c01b460 con 0x7f48a81034b0 2024-08-19T00:13:28.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:28.289+0000 7f489a7fc640 1 --2- 172.21.15.44:0/3255985745 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f48940a2e10 0x7f48940a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:28.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:28.290+0000 7f48ad0dc640 1 --2- 172.21.15.44:0/3255985745 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f48940a2e10 0x7f48940a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:28.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:28.290+0000 7f489a7fc640 1 -- 172.21.15.44:0/3255985745 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f489c0cf0d0 con 0x7f48a81034b0 2024-08-19T00:13:28.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:28.290+0000 7f48ad0dc640 1 --2- 172.21.15.44:0/3255985745 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f48940a2e10 0x7f48940a52d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f48a4009890 tx=0x7f48a4008040 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:28.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:28.294+0000 7f489a7fc640 1 -- 172.21.15.44:0/3255985745 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f489c09b810 con 0x7f48a81034b0 2024-08-19T00:13:28.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:28.505+0000 7f48af340640 1 -- 172.21.15.44:0/3255985745 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f48a8109fc0 con 0x7f48a81034b0 2024-08-19T00:13:28.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:28.506+0000 7f489a7fc640 1 -- 172.21.15.44:0/3255985745 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11989 (secure 0 0 0) 0x7f489c09b110 con 0x7f48a81034b0 2024-08-19T00:13:28.508 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:13:28.508 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":28,"btime":"2024-08-19T00:13:17:187002+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14511,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1538841896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1538841896},{"type":"v1","addr":"172.21.15.116:6833","nonce":1538841896}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/4044471606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4044471606},{"type":"v1","addr":"172.21.15.44:6835","nonce":4044471606}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-19T00:10:53.196636+0000","modified":"2024-08-19T00:13:17.136820+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24473,"mds_1":24446,"mds_2":24439,"mds_3":24431,"mds_4":24418},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14529":{"gid":14529,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6837/1824829052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1824829052},{"type":"v1","addr":"172.21.15.44:6837","nonce":1824829052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14577":{"gid":14577,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6839/3591739042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":3591739042},{"type":"v1","addr":"172.21.15.44:6839","nonce":3591739042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14589":{"gid":14589,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6841/3667695717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6840","nonce":3667695717},{"type":"v1","addr":"172.21.15.44:6841","nonce":3667695717}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24388":{"gid":24388,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1183022838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1183022838},{"type":"v1","addr":"172.21.15.171:6833","nonce":1183022838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6835/2190623851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":2190623851},{"type":"v1","addr":"172.21.15.171:6835","nonce":2190623851}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.171:6837/316231795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":316231795},{"type":"v1","addr":"172.21.15.171:6837","nonce":316231795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":20,"addr":"172.21.15.116:6835/3507399322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3507399322},{"type":"v1","addr":"172.21.15.116:6835","nonce":3507399322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.171:6839/1466585795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":1466585795},{"type":"v1","addr":"172.21.15.171:6839","nonce":1466585795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":17,"addr":"172.21.15.116:6837/2764513846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":2764513846},{"type":"v1","addr":"172.21.15.116:6837","nonce":2764513846}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.116:6839/1032741033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":1032741033},{"type":"v1","addr":"172.21.15.116:6839","nonce":1032741033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24418,24431,24439,24446,24473]},"id":1}]} 2024-08-19T00:13:28.508 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 28 2024-08-19T00:13:28.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:28.508+0000 7f48af340640 1 -- 172.21.15.44:0/3255985745 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f48940a2e10 msgr2=0x7f48940a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:28.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:28.508+0000 7f48af340640 1 --2- 172.21.15.44:0/3255985745 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f48940a2e10 0x7f48940a52d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f48a4009890 tx=0x7f48a4008040 comp rx=0 tx=0).stop 2024-08-19T00:13:28.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:28.508+0000 7f48af340640 1 -- 172.21.15.44:0/3255985745 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48a81034b0 msgr2=0x7f48a8198920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:28.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:28.508+0000 7f48af340640 1 --2- 172.21.15.44:0/3255985745 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48a81034b0 0x7f48a8198920 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f489c006fd0 tx=0x7f489c00b8e0 comp rx=0 tx=0).stop 2024-08-19T00:13:28.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:28.508+0000 7f48af340640 1 -- 172.21.15.44:0/3255985745 shutdown_connections 2024-08-19T00:13:28.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:28.508+0000 7f48af340640 1 --2- 172.21.15.44:0/3255985745 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f48940a2e10 0x7f48940a52d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:28.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:28.508+0000 7f48af340640 1 --2- 172.21.15.44:0/3255985745 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f48a8108030 0x7f48a819ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:28.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:28.508+0000 7f48af340640 1 --2- 172.21.15.44:0/3255985745 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48a81034b0 0x7f48a8198920 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:28.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:28.508+0000 7f48af340640 1 --2- 172.21.15.44:0/3255985745 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f48a8102b00 0x7f48a81983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:28.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:28.508+0000 7f48af340640 1 -- 172.21.15.44:0/3255985745 >> 172.21.15.44:0/3255985745 conn(0x7f48a80fc500 msgr2=0x7f48a8105b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:28.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:28.508+0000 7f48af340640 1 -- 172.21.15.44:0/3255985745 shutdown_connections 2024-08-19T00:13:28.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:28.508+0000 7f48af340640 1 -- 172.21.15.44:0/3255985745 wait complete. 2024-08-19T00:13:28.868 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:28 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/3255985745' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:13:29.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:28 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/3255985745' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:13:29.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:28 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/3255985745' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:13:29.227 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-19T00:13:29.485 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:13:29.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:29 smithi044 ceph-mon[18489]: pgmap v8: 129 pgs: 129 active+clean; 1.3 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 103 KiB/s wr, 62 op/s 2024-08-19T00:13:30.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:29.986+0000 7f7ff8dce640 1 -- 172.21.15.44:0/3329367099 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ff41018b0 msgr2=0x7f7ff4101d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:30.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:29.986+0000 7f7ff8dce640 1 --2- 172.21.15.44:0/3329367099 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ff41018b0 0x7f7ff4101d10 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f7fe8009930 tx=0x7f7fe802a420 comp rx=0 tx=0).stop 2024-08-19T00:13:30.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:29.986+0000 7f7ff8dce640 1 -- 172.21.15.44:0/3329367099 shutdown_connections 2024-08-19T00:13:30.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:29.986+0000 7f7ff8dce640 1 --2- 172.21.15.44:0/3329367099 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7ff4102250 0x7f7ff410e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:30.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:29.986+0000 7f7ff8dce640 1 --2- 172.21.15.44:0/3329367099 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ff41018b0 0x7f7ff4101d10 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:30.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:29.986+0000 7f7ff8dce640 1 --2- 172.21.15.44:0/3329367099 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7ff41078b0 0x7f7ff4107c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:30.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:29.986+0000 7f7ff8dce640 1 -- 172.21.15.44:0/3329367099 >> 172.21.15.44:0/3329367099 conn(0x7f7ff40fd5f0 msgr2=0x7f7ff40ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:30.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:29.986+0000 7f7ff8dce640 1 -- 172.21.15.44:0/3329367099 shutdown_connections 2024-08-19T00:13:30.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:29.986+0000 7f7ff8dce640 1 -- 172.21.15.44:0/3329367099 wait complete. 2024-08-19T00:13:30.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:29.987+0000 7f7ff8dce640 1 Processor -- start 2024-08-19T00:13:30.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:29.987+0000 7f7ff8dce640 1 -- start start 2024-08-19T00:13:30.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:29.987+0000 7f7ff8dce640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7ff41018b0 0x7f7ff419a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:30.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:29.987+0000 7f7ff8dce640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ff4102250 0x7f7ff419a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:30.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:29.987+0000 7f7ff8dce640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7ff41078b0 0x7f7ff419eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:30.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:29.987+0000 7f7ff8dce640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff4111cb0 con 0x7f7ff4102250 2024-08-19T00:13:30.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:29.987+0000 7f7ff8dce640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff4111b30 con 0x7f7ff41018b0 2024-08-19T00:13:30.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:29.987+0000 7f7ff8dce640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff4111e30 con 0x7f7ff41078b0 2024-08-19T00:13:30.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:29.987+0000 7f7ff1d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ff4102250 0x7f7ff419a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:30.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:29.987+0000 7f7ff1d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ff4102250 0x7f7ff419a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55416/0 (socket says 172.21.15.44:55416) 2024-08-19T00:13:30.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:29.987+0000 7f7ff1d9b640 1 -- 172.21.15.44:0/550187112 learned_addr learned my addr 172.21.15.44:0/550187112 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:30.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:29.988+0000 7f7ff259c640 1 --2- 172.21.15.44:0/550187112 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7ff41018b0 0x7f7ff419a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:30.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:29.988+0000 7f7ff2d9d640 1 --2- 172.21.15.44:0/550187112 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7ff41078b0 0x7f7ff419eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:30.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:29.988+0000 7f7ff1d9b640 1 -- 172.21.15.44:0/550187112 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7ff41078b0 msgr2=0x7f7ff419eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:30.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:29.988+0000 7f7ff1d9b640 1 --2- 172.21.15.44:0/550187112 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7ff41078b0 0x7f7ff419eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:30.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:29.988+0000 7f7ff1d9b640 1 -- 172.21.15.44:0/550187112 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7ff41018b0 msgr2=0x7f7ff419a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:30.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:29.988+0000 7f7ff1d9b640 1 --2- 172.21.15.44:0/550187112 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7ff41018b0 0x7f7ff419a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:30.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:29.988+0000 7f7ff1d9b640 1 -- 172.21.15.44:0/550187112 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ff419f380 con 0x7f7ff4102250 2024-08-19T00:13:30.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:29.988+0000 7f7ff1d9b640 1 --2- 172.21.15.44:0/550187112 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ff4102250 0x7f7ff419a910 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f7fe8009230 tx=0x7f7fe8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:30.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:29.988+0000 7f7fe37fe640 1 -- 172.21.15.44:0/550187112 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe803f030 con 0x7f7ff4102250 2024-08-19T00:13:30.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:29.988+0000 7f7ff8dce640 1 -- 172.21.15.44:0/550187112 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ff419f610 con 0x7f7ff4102250 2024-08-19T00:13:30.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:29.988+0000 7f7fe37fe640 1 -- 172.21.15.44:0/550187112 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7fe8003ad0 con 0x7f7ff4102250 2024-08-19T00:13:30.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:29.988+0000 7f7fe37fe640 1 -- 172.21.15.44:0/550187112 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe8035070 con 0x7f7ff4102250 2024-08-19T00:13:30.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:29.988+0000 7f7ff8dce640 1 -- 172.21.15.44:0/550187112 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ff41a6f50 con 0x7f7ff4102250 2024-08-19T00:13:30.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:29.989+0000 7f7ff8dce640 1 -- 172.21.15.44:0/550187112 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ff4102ff0 con 0x7f7ff4102250 2024-08-19T00:13:30.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:29.991+0000 7f7fe37fe640 1 -- 172.21.15.44:0/550187112 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 24) ==== 138060+0+0 (secure 0 0 0) 0x7f7fe8042030 con 0x7f7ff4102250 2024-08-19T00:13:30.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:29.991+0000 7f7fe37fe640 1 --2- 172.21.15.44:0/550187112 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f7fdc0a2e10 0x7f7fdc0a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:30.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:29.991+0000 7f7fe37fe640 1 -- 172.21.15.44:0/550187112 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f7fe80f0300 con 0x7f7ff4102250 2024-08-19T00:13:30.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:29.991+0000 7f7ff259c640 1 --2- 172.21.15.44:0/550187112 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f7fdc0a2e10 0x7f7fdc0a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:30.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:29.992+0000 7f7ff259c640 1 --2- 172.21.15.44:0/550187112 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f7fdc0a2e10 0x7f7fdc0a52d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7fe400bb60 tx=0x7f7fe400b390 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:30.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:29.995+0000 7f7fe37fe640 1 -- 172.21.15.44:0/550187112 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f7fe80bca00 con 0x7f7ff4102250 2024-08-19T00:13:30.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:29 smithi171 ceph-mon[21810]: pgmap v8: 129 pgs: 129 active+clean; 1.3 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 103 KiB/s wr, 62 op/s 2024-08-19T00:13:30.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:29 smithi116 ceph-mon[21873]: pgmap v8: 129 pgs: 129 active+clean; 1.3 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 103 KiB/s wr, 62 op/s 2024-08-19T00:13:30.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:30.206+0000 7f7ff8dce640 1 -- 172.21.15.44:0/550187112 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7ff4101d10 con 0x7f7ff4102250 2024-08-19T00:13:30.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:30.207+0000 7f7fe37fe640 1 -- 172.21.15.44:0/550187112 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11989 (secure 0 0 0) 0x7f7ff4101d10 con 0x7f7ff4102250 2024-08-19T00:13:30.208 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:13:30.209 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":28,"btime":"2024-08-19T00:13:17:187002+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14511,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1538841896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1538841896},{"type":"v1","addr":"172.21.15.116:6833","nonce":1538841896}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/4044471606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4044471606},{"type":"v1","addr":"172.21.15.44:6835","nonce":4044471606}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-19T00:10:53.196636+0000","modified":"2024-08-19T00:13:17.136820+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24473,"mds_1":24446,"mds_2":24439,"mds_3":24431,"mds_4":24418},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14529":{"gid":14529,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6837/1824829052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1824829052},{"type":"v1","addr":"172.21.15.44:6837","nonce":1824829052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14577":{"gid":14577,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6839/3591739042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":3591739042},{"type":"v1","addr":"172.21.15.44:6839","nonce":3591739042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14589":{"gid":14589,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6841/3667695717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6840","nonce":3667695717},{"type":"v1","addr":"172.21.15.44:6841","nonce":3667695717}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24388":{"gid":24388,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1183022838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1183022838},{"type":"v1","addr":"172.21.15.171:6833","nonce":1183022838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6835/2190623851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":2190623851},{"type":"v1","addr":"172.21.15.171:6835","nonce":2190623851}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.171:6837/316231795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":316231795},{"type":"v1","addr":"172.21.15.171:6837","nonce":316231795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":20,"addr":"172.21.15.116:6835/3507399322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3507399322},{"type":"v1","addr":"172.21.15.116:6835","nonce":3507399322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.171:6839/1466585795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":1466585795},{"type":"v1","addr":"172.21.15.171:6839","nonce":1466585795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":17,"addr":"172.21.15.116:6837/2764513846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":2764513846},{"type":"v1","addr":"172.21.15.116:6837","nonce":2764513846}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.116:6839/1032741033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":1032741033},{"type":"v1","addr":"172.21.15.116:6839","nonce":1032741033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24418,24431,24439,24446,24473]},"id":1}]} 2024-08-19T00:13:30.209 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 28 2024-08-19T00:13:30.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:30.209+0000 7f7ff8dce640 1 -- 172.21.15.44:0/550187112 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f7fdc0a2e10 msgr2=0x7f7fdc0a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:30.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:30.209+0000 7f7ff8dce640 1 --2- 172.21.15.44:0/550187112 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f7fdc0a2e10 0x7f7fdc0a52d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7fe400bb60 tx=0x7f7fe400b390 comp rx=0 tx=0).stop 2024-08-19T00:13:30.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:30.209+0000 7f7ff8dce640 1 -- 172.21.15.44:0/550187112 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ff4102250 msgr2=0x7f7ff419a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:30.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:30.209+0000 7f7ff8dce640 1 --2- 172.21.15.44:0/550187112 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ff4102250 0x7f7ff419a910 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f7fe8009230 tx=0x7f7fe8004270 comp rx=0 tx=0).stop 2024-08-19T00:13:30.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:30.209+0000 7f7ff8dce640 1 -- 172.21.15.44:0/550187112 shutdown_connections 2024-08-19T00:13:30.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:30.209+0000 7f7ff8dce640 1 --2- 172.21.15.44:0/550187112 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f7fdc0a2e10 0x7f7fdc0a52d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:30.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:30.209+0000 7f7ff8dce640 1 --2- 172.21.15.44:0/550187112 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7ff41078b0 0x7f7ff419eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:30.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:30.209+0000 7f7ff8dce640 1 --2- 172.21.15.44:0/550187112 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ff4102250 0x7f7ff419a910 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:30.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:30.209+0000 7f7ff8dce640 1 --2- 172.21.15.44:0/550187112 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7ff41018b0 0x7f7ff419a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:30.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:30.209+0000 7f7ff8dce640 1 -- 172.21.15.44:0/550187112 >> 172.21.15.44:0/550187112 conn(0x7f7ff40fd5f0 msgr2=0x7f7ff410cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:30.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:30.209+0000 7f7ff8dce640 1 -- 172.21.15.44:0/550187112 shutdown_connections 2024-08-19T00:13:30.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:30.209+0000 7f7ff8dce640 1 -- 172.21.15.44:0/550187112 wait complete. 2024-08-19T00:13:30.878 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:30 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/550187112' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:13:30.908 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-19T00:13:30.950 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:30 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/550187112' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:13:31.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:30 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/550187112' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:13:31.163 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:13:31.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:31.669+0000 7fa484c9d640 1 -- 172.21.15.44:0/1500231569 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4801007b0 msgr2=0x7fa480100c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:31.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:31.669+0000 7fa484c9d640 1 --2- 172.21.15.44:0/1500231569 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4801007b0 0x7fa480100c10 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fa468009930 tx=0x7fa46802a420 comp rx=0 tx=0).stop 2024-08-19T00:13:31.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:31.669+0000 7fa484c9d640 1 -- 172.21.15.44:0/1500231569 shutdown_connections 2024-08-19T00:13:31.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:31.669+0000 7fa484c9d640 1 --2- 172.21.15.44:0/1500231569 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa480101150 0x7fa48010d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:31.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:31.669+0000 7fa484c9d640 1 --2- 172.21.15.44:0/1500231569 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4801007b0 0x7fa480100c10 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:31.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:31.669+0000 7fa484c9d640 1 --2- 172.21.15.44:0/1500231569 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa4801067b0 0x7fa480106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:31.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:31.669+0000 7fa484c9d640 1 -- 172.21.15.44:0/1500231569 >> 172.21.15.44:0/1500231569 conn(0x7fa4800fc4d0 msgr2=0x7fa4800fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:31.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:31.669+0000 7fa484c9d640 1 -- 172.21.15.44:0/1500231569 shutdown_connections 2024-08-19T00:13:31.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:31.669+0000 7fa484c9d640 1 -- 172.21.15.44:0/1500231569 wait complete. 2024-08-19T00:13:31.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:31.670+0000 7fa484c9d640 1 Processor -- start 2024-08-19T00:13:31.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:31.670+0000 7fa484c9d640 1 -- start start 2024-08-19T00:13:31.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:31.670+0000 7fa484c9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4801007b0 0x7fa480198190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:31.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:31.670+0000 7fa484c9d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa480101150 0x7fa4801986d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:31.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:31.670+0000 7fa484c9d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa4801067b0 0x7fa48019ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:31.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:31.670+0000 7fa484c9d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa480111cd0 con 0x7fa4801007b0 2024-08-19T00:13:31.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:31.670+0000 7fa484c9d640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fa480111b50 con 0x7fa480101150 2024-08-19T00:13:31.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:31.670+0000 7fa484c9d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa480111e50 con 0x7fa4801067b0 2024-08-19T00:13:31.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:31.671+0000 7fa47e59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4801007b0 0x7fa480198190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:31.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:31.671+0000 7fa47e59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4801007b0 0x7fa480198190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55432/0 (socket says 172.21.15.44:55432) 2024-08-19T00:13:31.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:31.671+0000 7fa47e59c640 1 -- 172.21.15.44:0/3184569469 learned_addr learned my addr 172.21.15.44:0/3184569469 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:31.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:31.671+0000 7fa475d9b640 1 --2- 172.21.15.44:0/3184569469 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa480101150 0x7fa4801986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:31.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:31.671+0000 7fa47ed9d640 1 --2- 172.21.15.44:0/3184569469 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa4801067b0 0x7fa48019ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:31.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:31.671+0000 7fa47e59c640 1 -- 172.21.15.44:0/3184569469 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa4801067b0 msgr2=0x7fa48019ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:31.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:31.671+0000 7fa47e59c640 1 --2- 172.21.15.44:0/3184569469 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa4801067b0 0x7fa48019ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:31.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:31.671+0000 7fa47e59c640 1 -- 172.21.15.44:0/3184569469 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa480101150 msgr2=0x7fa4801986d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:31.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:31.671+0000 7fa47e59c640 1 --2- 172.21.15.44:0/3184569469 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa480101150 0x7fa4801986d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:31.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:31.671+0000 7fa47e59c640 1 -- 172.21.15.44:0/3184569469 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa48019d140 con 0x7fa4801007b0 2024-08-19T00:13:31.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:31.671+0000 7fa47e59c640 1 --2- 172.21.15.44:0/3184569469 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4801007b0 0x7fa480198190 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fa47000d950 tx=0x7fa47000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:31.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:31.671+0000 7fa477fff640 1 -- 172.21.15.44:0/3184569469 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa470017070 con 0x7fa4801007b0 2024-08-19T00:13:31.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:31.671+0000 7fa477fff640 1 -- 172.21.15.44:0/3184569469 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa470009c30 con 0x7fa4801007b0 2024-08-19T00:13:31.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:31.671+0000 7fa484c9d640 1 -- 172.21.15.44:0/3184569469 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa48019d430 con 0x7fa4801007b0 2024-08-19T00:13:31.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:31.671+0000 7fa477fff640 1 -- 172.21.15.44:0/3184569469 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa47000f6b0 con 0x7fa4801007b0 2024-08-19T00:13:31.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:31.671+0000 7fa484c9d640 1 -- 172.21.15.44:0/3184569469 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4801a4d10 con 0x7fa4801007b0 2024-08-19T00:13:31.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:31.672+0000 7fa484c9d640 1 -- 172.21.15.44:0/3184569469 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa480100c10 con 0x7fa4801007b0 2024-08-19T00:13:31.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:31.673+0000 7fa477fff640 1 -- 172.21.15.44:0/3184569469 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 24) ==== 138060+0+0 (secure 0 0 0) 0x7fa4700109d0 con 0x7fa4801007b0 2024-08-19T00:13:31.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:31.674+0000 7fa477fff640 1 --2- 172.21.15.44:0/3184569469 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fa46c0a2e10 0x7fa46c0a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:31.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:31.674+0000 7fa475d9b640 1 --2- 172.21.15.44:0/3184569469 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fa46c0a2e10 0x7fa46c0a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:31.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:31.674+0000 7fa477fff640 1 -- 172.21.15.44:0/3184569469 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7fa4700cf5a0 con 0x7fa4801007b0 2024-08-19T00:13:31.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:31.675+0000 7fa475d9b640 1 --2- 172.21.15.44:0/3184569469 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fa46c0a2e10 0x7fa46c0a52d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa468009900 tx=0x7fa4680058d0 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:31.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:31.677+0000 7fa477fff640 1 -- 172.21.15.44:0/3184569469 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fa470009de0 con 0x7fa4801007b0 2024-08-19T00:13:31.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:31 smithi171 ceph-mon[21810]: pgmap v9: 129 pgs: 129 active+clean; 1.3 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 84 KiB/s wr, 55 op/s 2024-08-19T00:13:31.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:31.857+0000 7fa484c9d640 1 -- 172.21.15.44:0/3184569469 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa4801994f0 con 0x7fa4801007b0 2024-08-19T00:13:31.858 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:31 smithi044 ceph-mon[18489]: pgmap v9: 129 pgs: 129 active+clean; 1.3 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 84 KiB/s wr, 55 op/s 2024-08-19T00:13:31.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:31.858+0000 7fa477fff640 1 -- 172.21.15.44:0/3184569469 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) ==== 74+0+25177 (secure 0 0 0) 0x7fa47009b580 con 0x7fa4801007b0 2024-08-19T00:13:31.860 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:13:31.860 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":95,"fsid":"647ded64-5dbe-11ef-bccf-c7b262605968","created":"2024-08-19T00:03:43.667929+0000","modified":"2024-08-19T00:13:18.502719+0000","last_up_change":"2024-08-19T00:10:01.557590+0000","last_in_change":"2024-08-19T00:09:42.433933+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T00:06:42.706553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-19T00:10:48.735065+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-19T00:10:51.481810+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-19T00:10:58.013004+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b15ad904-d07d-4ecb-be8f-d99323425eed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":600251465},{"type":"v1","addr":"172.21.15.44:6803","nonce":600251465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":600251465},{"type":"v1","addr":"172.21.15.44:6805","nonce":600251465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":600251465},{"type":"v1","addr":"172.21.15.44:6809","nonce":600251465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":600251465},{"type":"v1","addr":"172.21.15.44:6807","nonce":600251465}]},"public_addr":"172.21.15.44:6803/600251465","cluster_addr":"172.21.15.44:6805/600251465","heartbeat_back_addr":"172.21.15.44:6809/600251465","heartbeat_front_addr":"172.21.15.44:6807/600251465","state":["exists","up"]},{"osd":1,"uuid":"8f70512f-21a3-4fec-8278-04b2bc9b2d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":613509556},{"type":"v1","addr":"172.21.15.116:6801","nonce":613509556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":613509556},{"type":"v1","addr":"172.21.15.116:6803","nonce":613509556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":613509556},{"type":"v1","addr":"172.21.15.116:6807","nonce":613509556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":613509556},{"type":"v1","addr":"172.21.15.116:6805","nonce":613509556}]},"public_addr":"172.21.15.116:6801/613509556","cluster_addr":"172.21.15.116:6803/613509556","heartbeat_back_addr":"172.21.15.116:6807/613509556","heartbeat_front_addr":"172.21.15.116:6805/613509556","state":["exists","up"]},{"osd":2,"uuid":"56994dfd-5fcf-4d82-addf-38764239d82a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2130938937},{"type":"v1","addr":"172.21.15.171:6801","nonce":2130938937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2130938937},{"type":"v1","addr":"172.21.15.171:6803","nonce":2130938937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2130938937},{"type":"v1","addr":"172.21.15.171:6807","nonce":2130938937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2130938937},{"type":"v1","addr":"172.21.15.171:6805","nonce":2130938937}]},"public_addr":"172.21.15.171:6801/2130938937","cluster_addr":"172.21.15.171:6803/2130938937","heartbeat_back_addr":"172.21.15.171:6807/2130938937","heartbeat_front_addr":"172.21.15.171:6805/2130938937","state":["exists","up"]},{"osd":3,"uuid":"6d2ddb19-74e0-4e68-b9ea-58b73fd1e9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":3537027669},{"type":"v1","addr":"172.21.15.44:6811","nonce":3537027669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":3537027669},{"type":"v1","addr":"172.21.15.44:6813","nonce":3537027669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3537027669},{"type":"v1","addr":"172.21.15.44:6817","nonce":3537027669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":3537027669},{"type":"v1","addr":"172.21.15.44:6815","nonce":3537027669}]},"public_addr":"172.21.15.44:6811/3537027669","cluster_addr":"172.21.15.44:6813/3537027669","heartbeat_back_addr":"172.21.15.44:6817/3537027669","heartbeat_front_addr":"172.21.15.44:6815/3537027669","state":["exists","up"]},{"osd":4,"uuid":"190d208e-ae54-497d-ad72-d07a5a26991b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":3768627455},{"type":"v1","addr":"172.21.15.116:6809","nonce":3768627455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":3768627455},{"type":"v1","addr":"172.21.15.116:6811","nonce":3768627455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":3768627455},{"type":"v1","addr":"172.21.15.116:6815","nonce":3768627455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":3768627455},{"type":"v1","addr":"172.21.15.116:6813","nonce":3768627455}]},"public_addr":"172.21.15.116:6809/3768627455","cluster_addr":"172.21.15.116:6811/3768627455","heartbeat_back_addr":"172.21.15.116:6815/3768627455","heartbeat_front_addr":"172.21.15.116:6813/3768627455","state":["exists","up"]},{"osd":5,"uuid":"d8afacad-6d3d-4703-9744-8d01ff2a2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":938785018},{"type":"v1","addr":"172.21.15.171:6809","nonce":938785018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":938785018},{"type":"v1","addr":"172.21.15.171:6811","nonce":938785018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":938785018},{"type":"v1","addr":"172.21.15.171:6815","nonce":938785018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":938785018},{"type":"v1","addr":"172.21.15.171:6813","nonce":938785018}]},"public_addr":"172.21.15.171:6809/938785018","cluster_addr":"172.21.15.171:6811/938785018","heartbeat_back_addr":"172.21.15.171:6815/938785018","heartbeat_front_addr":"172.21.15.171:6813/938785018","state":["exists","up"]},{"osd":6,"uuid":"55bf1f89-99e5-409d-99fa-f0124aa042df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":1219334797},{"type":"v1","addr":"172.21.15.44:6819","nonce":1219334797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":1219334797},{"type":"v1","addr":"172.21.15.44:6821","nonce":1219334797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":1219334797},{"type":"v1","addr":"172.21.15.44:6825","nonce":1219334797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":1219334797},{"type":"v1","addr":"172.21.15.44:6823","nonce":1219334797}]},"public_addr":"172.21.15.44:6819/1219334797","cluster_addr":"172.21.15.44:6821/1219334797","heartbeat_back_addr":"172.21.15.44:6825/1219334797","heartbeat_front_addr":"172.21.15.44:6823/1219334797","state":["exists","up"]},{"osd":7,"uuid":"70130d71-d28c-4a58-b603-75610c8d3ea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":3861873415},{"type":"v1","addr":"172.21.15.116:6817","nonce":3861873415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":3861873415},{"type":"v1","addr":"172.21.15.116:6819","nonce":3861873415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":3861873415},{"type":"v1","addr":"172.21.15.116:6823","nonce":3861873415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":3861873415},{"type":"v1","addr":"172.21.15.116:6821","nonce":3861873415}]},"public_addr":"172.21.15.116:6817/3861873415","cluster_addr":"172.21.15.116:6819/3861873415","heartbeat_back_addr":"172.21.15.116:6823/3861873415","heartbeat_front_addr":"172.21.15.116:6821/3861873415","state":["exists","up"]},{"osd":8,"uuid":"c5121f70-e423-4f86-a3c6-90945c9385f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":843701060},{"type":"v1","addr":"172.21.15.171:6817","nonce":843701060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":843701060},{"type":"v1","addr":"172.21.15.171:6819","nonce":843701060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":843701060},{"type":"v1","addr":"172.21.15.171:6823","nonce":843701060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":843701060},{"type":"v1","addr":"172.21.15.171:6821","nonce":843701060}]},"public_addr":"172.21.15.171:6817/843701060","cluster_addr":"172.21.15.171:6819/843701060","heartbeat_back_addr":"172.21.15.171:6823/843701060","heartbeat_front_addr":"172.21.15.171:6821/843701060","state":["exists","up"]},{"osd":9,"uuid":"cd13693a-0f25-47cc-b1a5-9c42481935ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3206550013},{"type":"v1","addr":"172.21.15.44:6827","nonce":3206550013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":3206550013},{"type":"v1","addr":"172.21.15.44:6829","nonce":3206550013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3206550013},{"type":"v1","addr":"172.21.15.44:6833","nonce":3206550013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3206550013},{"type":"v1","addr":"172.21.15.44:6831","nonce":3206550013}]},"public_addr":"172.21.15.44:6827/3206550013","cluster_addr":"172.21.15.44:6829/3206550013","heartbeat_back_addr":"172.21.15.44:6833/3206550013","heartbeat_front_addr":"172.21.15.44:6831/3206550013","state":["exists","up"]},{"osd":10,"uuid":"a36ffeb1-6ecf-4899-bdfa-18515afefb86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3034738363},{"type":"v1","addr":"172.21.15.116:6825","nonce":3034738363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3034738363},{"type":"v1","addr":"172.21.15.116:6827","nonce":3034738363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3034738363},{"type":"v1","addr":"172.21.15.116:6831","nonce":3034738363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3034738363},{"type":"v1","addr":"172.21.15.116:6829","nonce":3034738363}]},"public_addr":"172.21.15.116:6825/3034738363","cluster_addr":"172.21.15.116:6827/3034738363","heartbeat_back_addr":"172.21.15.116:6831/3034738363","heartbeat_front_addr":"172.21.15.116:6829/3034738363","state":["exists","up"]},{"osd":11,"uuid":"ffcf44a8-3094-4a29-822e-a6ce95da119e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1500842656},{"type":"v1","addr":"172.21.15.171:6825","nonce":1500842656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1500842656},{"type":"v1","addr":"172.21.15.171:6827","nonce":1500842656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1500842656},{"type":"v1","addr":"172.21.15.171:6831","nonce":1500842656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1500842656},{"type":"v1","addr":"172.21.15.171:6829","nonce":1500842656}]},"public_addr":"172.21.15.171:6825/1500842656","cluster_addr":"172.21.15.171:6827/1500842656","heartbeat_back_addr":"172.21.15.171:6831/1500842656","heartbeat_front_addr":"172.21.15.171:6829/1500842656","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:05:56.916127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:06:17.603805+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:06:38.642970+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:07:00.667062+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:07:22.542529+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:07:44.732304+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:08:07.050742+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:08:29.451498+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:08:52.222169+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:09:15.422629+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:09:37.295311+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:09:59.716431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":7}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9},{"from":5,"to":8}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:0/1732405694":"2024-08-20T00:13:18.502685+0000","172.21.15.44:0/2504116080":"2024-08-20T00:13:18.502685+0000","172.21.15.44:6800/1374527587":"2024-08-20T00:04:14.604141+0000","172.21.15.44:0/1869412718":"2024-08-20T00:04:14.604141+0000","172.21.15.44:0/3023439260":"2024-08-20T00:13:18.502685+0000","172.21.15.44:0/911382683":"2024-08-20T00:04:14.604141+0000","172.21.15.44:0/3096491642":"2024-08-20T00:04:14.604141+0000","172.21.15.44:0/400419582":"2024-08-20T00:04:38.392912+0000","172.21.15.44:0/3800526625":"2024-08-20T00:04:38.392912+0000","172.21.15.44:6801/1374527587":"2024-08-20T00:04:14.604141+0000","172.21.15.44:0/1001446555":"2024-08-20T00:04:38.392912+0000","172.21.15.44:0/3489931602":"2024-08-20T00:13:18.502685+0000","172.21.15.44:6800/1330072146":"2024-08-20T00:13:18.502685+0000","172.21.15.44:6801/1300308907":"2024-08-20T00:04:38.392912+0000","172.21.15.44:6800/1300308907":"2024-08-20T00:04:38.392912+0000","172.21.15.44:6801/1330072146":"2024-08-20T00:13:18.502685+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:13:31.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:31.861+0000 7fa484c9d640 1 -- 172.21.15.44:0/3184569469 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fa46c0a2e10 msgr2=0x7fa46c0a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:31.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:31.861+0000 7fa484c9d640 1 --2- 172.21.15.44:0/3184569469 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fa46c0a2e10 0x7fa46c0a52d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa468009900 tx=0x7fa4680058d0 comp rx=0 tx=0).stop 2024-08-19T00:13:31.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:31.861+0000 7fa484c9d640 1 -- 172.21.15.44:0/3184569469 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4801007b0 msgr2=0x7fa480198190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:31.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:31.861+0000 7fa484c9d640 1 --2- 172.21.15.44:0/3184569469 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4801007b0 0x7fa480198190 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fa47000d950 tx=0x7fa47000de10 comp rx=0 tx=0).stop 2024-08-19T00:13:31.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:31.861+0000 7fa484c9d640 1 -- 172.21.15.44:0/3184569469 shutdown_connections 2024-08-19T00:13:31.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:31.861+0000 7fa484c9d640 1 --2- 172.21.15.44:0/3184569469 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fa46c0a2e10 0x7fa46c0a52d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:31.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:31.861+0000 7fa484c9d640 1 --2- 172.21.15.44:0/3184569469 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa4801067b0 0x7fa48019ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:31.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:31.861+0000 7fa484c9d640 1 --2- 172.21.15.44:0/3184569469 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa480101150 0x7fa4801986d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:31.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:31.861+0000 7fa484c9d640 1 --2- 172.21.15.44:0/3184569469 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4801007b0 0x7fa480198190 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:31.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:31.861+0000 7fa484c9d640 1 -- 172.21.15.44:0/3184569469 >> 172.21.15.44:0/3184569469 conn(0x7fa4800fc4d0 msgr2=0x7fa4800fcce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:31.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:31.862+0000 7fa484c9d640 1 -- 172.21.15.44:0/3184569469 shutdown_connections 2024-08-19T00:13:31.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:31.862+0000 7fa484c9d640 1 -- 172.21.15.44:0/3184569469 wait complete. 2024-08-19T00:13:32.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:31 smithi116 ceph-mon[21873]: pgmap v9: 129 pgs: 129 active+clean; 1.3 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 84 KiB/s wr, 55 op/s 2024-08-19T00:13:32.516 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph daemon mon.a --format=json config get run_dir 2024-08-19T00:13:32.774 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:13:32.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:32 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/3184569469' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-19T00:13:32.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:32 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/3184569469' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-19T00:13:33.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:32 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/3184569469' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-19T00:13:33.861 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:33 smithi044 ceph-mon[18489]: pgmap v10: 129 pgs: 129 active+clean; 1.3 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 77 KiB/s wr, 51 op/s 2024-08-19T00:13:33.891 INFO:teuthology.orchestra.run.smithi044.stdout:{"run_dir":"/var/run/ceph"} 2024-08-19T00:13:33.892 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-08-19T00:13:33.892 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 1664 2024-08-19T00:13:33.892 DEBUG:tasks.quiescer:Yielding 2024-08-19T00:13:33.892 INFO:teuthology.run_tasks:Running task workunit... 2024-08-19T00:13:33.907 INFO:tasks.workunit:Pulling workunits from ref 78215f5a1cf5eaf321d506a66539942e12851f34 2024-08-19T00:13:33.907 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-08-19T00:13:33.907 INFO:tasks.workunit:timeout=3h 2024-08-19T00:13:33.907 INFO:tasks.workunit:cleanup=True 2024-08-19T00:13:33.907 DEBUG:teuthology.orchestra.run.smithi044:> stat -- /home/ubuntu/cephtest/mnt.0 2024-08-19T00:13:33.908 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-19T00:13:33.925 INFO:teuthology.orchestra.run.smithi044.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-08-19T00:13:33.925 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-08-19T00:13:33.925 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 79h/121d Inode: 1099511628283 Links: 2 2024-08-19T00:13:33.925 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-19T00:13:33.926 INFO:teuthology.orchestra.run.smithi044.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-08-19T00:13:33.926 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-08-19 00:11:43.608484094 +0000 2024-08-19T00:13:33.926 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-08-19 00:11:43.608484094 +0000 2024-08-19T00:13:33.926 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-08-19 00:13:16.473272552 +0000 2024-08-19T00:13:33.926 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: 2024-08-19 00:11:43.608484094 +0000 2024-08-19T00:13:33.926 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-08-19T00:13:33.926 DEBUG:teuthology.orchestra.run.smithi044:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-08-19T00:13:33.999 DEBUG:teuthology.orchestra.run.smithi044:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 78215f5a1cf5eaf321d506a66539942e12851f34 2024-08-19T00:13:34.055 INFO:tasks.workunit.client.0.smithi044.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-08-19T00:13:34.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:33 smithi171 ceph-mon[21810]: pgmap v10: 129 pgs: 129 active+clean; 1.3 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 77 KiB/s wr, 51 op/s 2024-08-19T00:13:34.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:33 smithi116 ceph-mon[21873]: pgmap v10: 129 pgs: 129 active+clean; 1.3 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 77 KiB/s wr, 51 op/s 2024-08-19T00:13:34.174 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:13:34.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:34.670+0000 7f321f70c640 1 -- 172.21.15.44:0/3251817310 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32181018c0 msgr2=0x7f3218101d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:34.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:34.670+0000 7f321f70c640 1 --2- 172.21.15.44:0/3251817310 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32181018c0 0x7f3218101d20 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f3208009930 tx=0x7f320802a420 comp rx=0 tx=0).stop 2024-08-19T00:13:34.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:34.670+0000 7f321f70c640 1 -- 172.21.15.44:0/3251817310 shutdown_connections 2024-08-19T00:13:34.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:34.670+0000 7f321f70c640 1 --2- 172.21.15.44:0/3251817310 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3218102260 0x7f321810e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:34.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:34.670+0000 7f321f70c640 1 --2- 172.21.15.44:0/3251817310 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32181018c0 0x7f3218101d20 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:34.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:34.670+0000 7f321f70c640 1 --2- 172.21.15.44:0/3251817310 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32181078c0 0x7f3218107ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:34.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:34.670+0000 7f321f70c640 1 -- 172.21.15.44:0/3251817310 >> 172.21.15.44:0/3251817310 conn(0x7f32180fd620 msgr2=0x7f32180ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:34.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:34.670+0000 7f321f70c640 1 -- 172.21.15.44:0/3251817310 shutdown_connections 2024-08-19T00:13:34.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:34.670+0000 7f321f70c640 1 -- 172.21.15.44:0/3251817310 wait complete. 2024-08-19T00:13:34.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:34.671+0000 7f321f70c640 1 Processor -- start 2024-08-19T00:13:34.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:34.671+0000 7f321f70c640 1 -- start start 2024-08-19T00:13:34.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:34.671+0000 7f321f70c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32181018c0 0x7f32181981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:34.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:34.671+0000 7f321f70c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3218102260 0x7f3218198720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:34.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:34.671+0000 7f321f70c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32181078c0 0x7f321819cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:34.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:34.671+0000 7f321f70c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3218111c80 con 0x7f3218102260 2024-08-19T00:13:34.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:34.671+0000 7f321f70c640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f3218111b00 con 0x7f32181078c0 2024-08-19T00:13:34.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:34.671+0000 7f321f70c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f3218111e00 con 0x7f32181018c0 2024-08-19T00:13:34.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:34.671+0000 7f321cca7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3218102260 0x7f3218198720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:34.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:34.671+0000 7f321cca7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3218102260 0x7f3218198720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55438/0 (socket says 172.21.15.44:55438) 2024-08-19T00:13:34.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:34.671+0000 7f321cca7640 1 -- 172.21.15.44:0/4145239810 learned_addr learned my addr 172.21.15.44:0/4145239810 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:34.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:34.671+0000 7f321d4a8640 1 --2- 172.21.15.44:0/4145239810 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32181018c0 0x7f32181981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:34.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:34.671+0000 7f321dca9640 1 --2- 172.21.15.44:0/4145239810 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32181078c0 0x7f321819cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:34.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:34.672+0000 7f321cca7640 1 -- 172.21.15.44:0/4145239810 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32181018c0 msgr2=0x7f32181981e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:34.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:34.672+0000 7f321cca7640 1 --2- 172.21.15.44:0/4145239810 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32181018c0 0x7f32181981e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:34.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:34.672+0000 7f321cca7640 1 -- 172.21.15.44:0/4145239810 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32181078c0 msgr2=0x7f321819cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:34.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:34.672+0000 7f321cca7640 1 --2- 172.21.15.44:0/4145239810 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32181078c0 0x7f321819cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:34.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:34.672+0000 7f321cca7640 1 -- 172.21.15.44:0/4145239810 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f321819d190 con 0x7f3218102260 2024-08-19T00:13:34.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:34.672+0000 7f321cca7640 1 --2- 172.21.15.44:0/4145239810 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3218102260 0x7f3218198720 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f3208009230 tx=0x7f3208004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:34.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:34.672+0000 7f320e7fc640 1 -- 172.21.15.44:0/4145239810 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f320803f030 con 0x7f3218102260 2024-08-19T00:13:34.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:34.672+0000 7f320e7fc640 1 -- 172.21.15.44:0/4145239810 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3208003ad0 con 0x7f3218102260 2024-08-19T00:13:34.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:34.672+0000 7f321f70c640 1 -- 172.21.15.44:0/4145239810 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f321819d420 con 0x7f3218102260 2024-08-19T00:13:34.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:34.672+0000 7f320e7fc640 1 -- 172.21.15.44:0/4145239810 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3208035070 con 0x7f3218102260 2024-08-19T00:13:34.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:34.672+0000 7f321f70c640 1 -- 172.21.15.44:0/4145239810 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32181a4d60 con 0x7f3218102260 2024-08-19T00:13:34.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:34.673+0000 7f321f70c640 1 -- 172.21.15.44:0/4145239810 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3218103000 con 0x7f3218102260 2024-08-19T00:13:34.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:34.674+0000 7f320e7fc640 1 -- 172.21.15.44:0/4145239810 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 24) ==== 138060+0+0 (secure 0 0 0) 0x7f3208042030 con 0x7f3218102260 2024-08-19T00:13:34.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:34.675+0000 7f320e7fc640 1 --2- 172.21.15.44:0/4145239810 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f32040a2e10 0x7f32040a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:34.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:34.675+0000 7f321d4a8640 1 --2- 172.21.15.44:0/4145239810 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f32040a2e10 0x7f32040a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:34.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:34.675+0000 7f320e7fc640 1 -- 172.21.15.44:0/4145239810 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f32080efe30 con 0x7f3218102260 2024-08-19T00:13:34.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:34.676+0000 7f321d4a8640 1 --2- 172.21.15.44:0/4145239810 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f32040a2e10 0x7f32040a52d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3214005d00 tx=0x7f321400b410 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:34.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:34.680+0000 7f320e7fc640 1 -- 172.21.15.44:0/4145239810 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f32080bbee0 con 0x7f3218102260 2024-08-19T00:13:34.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:34.891+0000 7f321f70c640 1 -- 172.21.15.44:0/4145239810 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3218109e50 con 0x7f3218102260 2024-08-19T00:13:34.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:34.891+0000 7f320e7fc640 1 -- 172.21.15.44:0/4145239810 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11989 (secure 0 0 0) 0x7f32080c01e0 con 0x7f3218102260 2024-08-19T00:13:34.894 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:13:34.894 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":28,"btime":"2024-08-19T00:13:17:187002+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14511,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1538841896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1538841896},{"type":"v1","addr":"172.21.15.116:6833","nonce":1538841896}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/4044471606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4044471606},{"type":"v1","addr":"172.21.15.44:6835","nonce":4044471606}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-19T00:10:53.196636+0000","modified":"2024-08-19T00:13:17.136820+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24473,"mds_1":24446,"mds_2":24439,"mds_3":24431,"mds_4":24418},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14529":{"gid":14529,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6837/1824829052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1824829052},{"type":"v1","addr":"172.21.15.44:6837","nonce":1824829052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14577":{"gid":14577,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6839/3591739042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":3591739042},{"type":"v1","addr":"172.21.15.44:6839","nonce":3591739042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14589":{"gid":14589,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6841/3667695717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6840","nonce":3667695717},{"type":"v1","addr":"172.21.15.44:6841","nonce":3667695717}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24388":{"gid":24388,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1183022838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1183022838},{"type":"v1","addr":"172.21.15.171:6833","nonce":1183022838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6835/2190623851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":2190623851},{"type":"v1","addr":"172.21.15.171:6835","nonce":2190623851}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.171:6837/316231795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":316231795},{"type":"v1","addr":"172.21.15.171:6837","nonce":316231795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":20,"addr":"172.21.15.116:6835/3507399322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3507399322},{"type":"v1","addr":"172.21.15.116:6835","nonce":3507399322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.171:6839/1466585795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":1466585795},{"type":"v1","addr":"172.21.15.171:6839","nonce":1466585795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":17,"addr":"172.21.15.116:6837/2764513846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":2764513846},{"type":"v1","addr":"172.21.15.116:6837","nonce":2764513846}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.116:6839/1032741033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":1032741033},{"type":"v1","addr":"172.21.15.116:6839","nonce":1032741033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24418,24431,24439,24446,24473]},"id":1}]} 2024-08-19T00:13:34.895 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 28 2024-08-19T00:13:34.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:34.893+0000 7f321f70c640 1 -- 172.21.15.44:0/4145239810 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f32040a2e10 msgr2=0x7f32040a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:34.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:34.893+0000 7f321f70c640 1 --2- 172.21.15.44:0/4145239810 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f32040a2e10 0x7f32040a52d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3214005d00 tx=0x7f321400b410 comp rx=0 tx=0).stop 2024-08-19T00:13:34.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:34.893+0000 7f321f70c640 1 -- 172.21.15.44:0/4145239810 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3218102260 msgr2=0x7f3218198720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:34.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:34.893+0000 7f321f70c640 1 --2- 172.21.15.44:0/4145239810 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3218102260 0x7f3218198720 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f3208009230 tx=0x7f3208004270 comp rx=0 tx=0).stop 2024-08-19T00:13:34.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:34.893+0000 7f321f70c640 1 -- 172.21.15.44:0/4145239810 shutdown_connections 2024-08-19T00:13:34.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:34.893+0000 7f321f70c640 1 --2- 172.21.15.44:0/4145239810 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f32040a2e10 0x7f32040a52d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:34.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:34.893+0000 7f321f70c640 1 --2- 172.21.15.44:0/4145239810 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32181078c0 0x7f321819cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:34.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:34.893+0000 7f321f70c640 1 --2- 172.21.15.44:0/4145239810 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3218102260 0x7f3218198720 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:34.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:34.893+0000 7f321f70c640 1 --2- 172.21.15.44:0/4145239810 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32181018c0 0x7f32181981e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:34.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:34.893+0000 7f321f70c640 1 -- 172.21.15.44:0/4145239810 >> 172.21.15.44:0/4145239810 conn(0x7f32180fd620 msgr2=0x7f32180fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:34.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:34.894+0000 7f321f70c640 1 -- 172.21.15.44:0/4145239810 shutdown_connections 2024-08-19T00:13:34.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:34.894+0000 7f321f70c640 1 -- 172.21.15.44:0/4145239810 wait complete. 2024-08-19T00:13:35.482 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.478+0000 7f94dd9df640 1 -- 172.21.15.44:0/3808795181 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f94d8106730 msgr2=0x7f94d8106b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:35.483 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.478+0000 7f94dd9df640 1 --2- 172.21.15.44:0/3808795181 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f94d8106730 0x7f94d8106b10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f94c8009930 tx=0x7f94c802a420 comp rx=0 tx=0).stop 2024-08-19T00:13:35.483 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.478+0000 7f94dd9df640 1 -- 172.21.15.44:0/3808795181 shutdown_connections 2024-08-19T00:13:35.483 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.478+0000 7f94dd9df640 1 --2- 172.21.15.44:0/3808795181 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94d81010c0 0x7f94d810d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:35.483 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.478+0000 7f94dd9df640 1 --2- 172.21.15.44:0/3808795181 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94d8100720 0x7f94d8100b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:35.483 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.478+0000 7f94dd9df640 1 --2- 172.21.15.44:0/3808795181 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f94d8106730 0x7f94d8106b10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:35.483 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.478+0000 7f94dd9df640 1 -- 172.21.15.44:0/3808795181 >> 172.21.15.44:0/3808795181 conn(0x7f94d80fc3e0 msgr2=0x7f94d80fe800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:35.483 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.478+0000 7f94dd9df640 1 -- 172.21.15.44:0/3808795181 shutdown_connections 2024-08-19T00:13:35.483 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.478+0000 7f94dd9df640 1 -- 172.21.15.44:0/3808795181 wait complete. 2024-08-19T00:13:35.483 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.478+0000 7f94dd9df640 1 Processor -- start 2024-08-19T00:13:35.483 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.479+0000 7f94dd9df640 1 -- start start 2024-08-19T00:13:35.483 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.479+0000 7f94dd9df640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94d8100720 0x7f94d8198130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.479+0000 7f94dd9df640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94d81010c0 0x7f94d8198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.479+0000 7f94dd9df640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f94d8106730 0x7f94d819c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.479+0000 7f94dd9df640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f94d8110b30 con 0x7f94d8100720 2024-08-19T00:13:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.479+0000 7f94dd9df640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f94d81109b0 con 0x7f94d81010c0 2024-08-19T00:13:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.479+0000 7f94dd9df640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f94d8110cb0 con 0x7f94d8106730 2024-08-19T00:13:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.479+0000 7f94d6ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94d8100720 0x7f94d8198130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.479+0000 7f94d6ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94d8100720 0x7f94d8198130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55460/0 (socket says 172.21.15.44:55460) 2024-08-19T00:13:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.479+0000 7f94d6ffd640 1 -- 172.21.15.44:0/1294366472 learned_addr learned my addr 172.21.15.44:0/1294366472 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.479+0000 7f94d67fc640 1 --2- 172.21.15.44:0/1294366472 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94d81010c0 0x7f94d8198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.479+0000 7f94d6ffd640 1 -- 172.21.15.44:0/1294366472 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f94d8106730 msgr2=0x7f94d819c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.479+0000 7f94d6ffd640 1 --2- 172.21.15.44:0/1294366472 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f94d8106730 0x7f94d819c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.479+0000 7f94d6ffd640 1 -- 172.21.15.44:0/1294366472 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94d81010c0 msgr2=0x7f94d8198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.479+0000 7f94d6ffd640 1 --2- 172.21.15.44:0/1294366472 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94d81010c0 0x7f94d8198670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.479+0000 7f94d6ffd640 1 -- 172.21.15.44:0/1294366472 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94d819d120 con 0x7f94d8100720 2024-08-19T00:13:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.479+0000 7f94d67fc640 1 --2- 172.21.15.44:0/1294366472 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94d81010c0 0x7f94d8198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:13:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.480+0000 7f94d6ffd640 1 --2- 172.21.15.44:0/1294366472 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94d8100720 0x7f94d8198130 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f94c8009230 tx=0x7f94c8004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.480+0000 7f94dc9dd640 1 -- 172.21.15.44:0/1294366472 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94c803f030 con 0x7f94d8100720 2024-08-19T00:13:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.480+0000 7f94dd9df640 1 -- 172.21.15.44:0/1294366472 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94d819d3b0 con 0x7f94d8100720 2024-08-19T00:13:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.480+0000 7f94dc9dd640 1 -- 172.21.15.44:0/1294366472 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94c8004440 con 0x7f94d8100720 2024-08-19T00:13:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.480+0000 7f94dc9dd640 1 -- 172.21.15.44:0/1294366472 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94c8035070 con 0x7f94d8100720 2024-08-19T00:13:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.480+0000 7f94dd9df640 1 -- 172.21.15.44:0/1294366472 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94d81a4ca0 con 0x7f94d8100720 2024-08-19T00:13:35.492 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.482+0000 7f94dc9dd640 1 -- 172.21.15.44:0/1294366472 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 24) ==== 138060+0+0 (secure 0 0 0) 0x7f94c8042030 con 0x7f94d8100720 2024-08-19T00:13:35.492 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.483+0000 7f94e0881740 1 Processor -- start 2024-08-19T00:13:35.492 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.483+0000 7f94e0881740 1 -- start start 2024-08-19T00:13:35.492 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.483+0000 7f94dc9dd640 1 --2- 172.21.15.44:0/1294366472 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f94c00a2ec0 0x7f94c00a5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:35.492 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.483+0000 7f94e0881740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f9423d67d0 0x55f9423d6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:35.492 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.483+0000 7f94e0881740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f9423d70f0 0x55f9423e1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:35.492 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.483+0000 7f94e0881740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f9423e1990 0x55f9423e3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:35.492 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.483+0000 7f94e0881740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55f94233a9d0 con 0x55f9423d70f0 2024-08-19T00:13:35.492 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.483+0000 7f94e0881740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55f9422e2820 con 0x55f9423e1990 2024-08-19T00:13:35.492 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.483+0000 7f94e0881740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55f942336990 con 0x55f9423d67d0 2024-08-19T00:13:35.492 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.483+0000 7f94d67fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f9423d70f0 0x55f9423e1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:35.493 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.483+0000 7f94d77fe640 1 --2- 172.21.15.44:0/1294366472 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f94c00a2ec0 0x7f94c00a5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:35.493 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.483+0000 7f94dc9dd640 1 -- 172.21.15.44:0/1294366472 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f94c80efdf0 con 0x7f94d8100720 2024-08-19T00:13:35.493 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.483+0000 7f94d67fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f9423d70f0 0x55f9423e1450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55468/0 (socket says 172.21.15.44:55468) 2024-08-19T00:13:35.493 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.483+0000 7f94d67fc640 1 -- 172.21.15.44:0/3329916853 learned_addr learned my addr 172.21.15.44:0/3329916853 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:35.493 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.483+0000 7f94d6ffd640 1 --2- 172.21.15.44:0/3329916853 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f9423d67d0 0x55f9423d6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:35.493 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.483+0000 7f94d67fc640 1 -- 172.21.15.44:0/3329916853 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f9423d67d0 msgr2=0x55f9423d6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:35.493 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.483+0000 7f94d67fc640 1 --2- 172.21.15.44:0/3329916853 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f9423d67d0 0x55f9423d6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:35.493 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.483+0000 7f94d67fc640 1 -- 172.21.15.44:0/3329916853 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f9423e1990 msgr2=0x55f9423e3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:35.493 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.483+0000 7f94d67fc640 1 --2- 172.21.15.44:0/3329916853 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f9423e1990 0x55f9423e3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:35.493 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.483+0000 7f94d67fc640 1 -- 172.21.15.44:0/3329916853 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f94204e210 con 0x55f9423d70f0 2024-08-19T00:13:35.493 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.483+0000 7f94d6ffd640 1 --2- 172.21.15.44:0/3329916853 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f9423d67d0 0x55f9423d6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:13:35.493 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.483+0000 7f94d77fe640 1 --2- 172.21.15.44:0/1294366472 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f94c00a2ec0 0x7f94c00a5380 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f94d0005fd0 tx=0x7f94d0010740 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:35.493 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.483+0000 7f94d67fc640 1 --2- 172.21.15.44:0/3329916853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f9423d70f0 0x55f9423e1450 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f94cc009c00 tx=0x7f94cc010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef3446c7e5589550 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:35.494 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.484+0000 7f94bdffb640 1 -- 172.21.15.44:0/3329916853 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94cc005020 con 0x55f9423d70f0 2024-08-19T00:13:35.494 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.484+0000 7f94bdffb640 1 -- 172.21.15.44:0/3329916853 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94cc0047a0 con 0x55f9423d70f0 2024-08-19T00:13:35.494 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.484+0000 7f94bdffb640 1 -- 172.21.15.44:0/3329916853 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94cc0126b0 con 0x55f9423d70f0 2024-08-19T00:13:35.494 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.484+0000 7f94e0881740 1 -- 172.21.15.44:0/3329916853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f9423d70f0 msgr2=0x55f9423e1450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:35.494 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.484+0000 7f94e0881740 1 --2- 172.21.15.44:0/3329916853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f9423d70f0 0x55f9423e1450 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f94cc009c00 tx=0x7f94cc010740 comp rx=0 tx=0).stop 2024-08-19T00:13:35.494 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.484+0000 7f94e0881740 1 -- 172.21.15.44:0/3329916853 shutdown_connections 2024-08-19T00:13:35.494 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.484+0000 7f94e0881740 1 --2- 172.21.15.44:0/3329916853 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f9423e1990 0x55f9423e3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:35.494 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.484+0000 7f94e0881740 1 --2- 172.21.15.44:0/3329916853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f9423d70f0 0x55f9423e1450 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:35.494 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.484+0000 7f94e0881740 1 --2- 172.21.15.44:0/3329916853 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f9423d67d0 0x55f9423d6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:35.494 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.484+0000 7f94e0881740 1 -- 172.21.15.44:0/3329916853 >> 172.21.15.44:0/3329916853 conn(0x55f9423d2d40 msgr2=0x55f9423d3120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:35.494 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.484+0000 7f94e0881740 1 -- 172.21.15.44:0/3329916853 shutdown_connections 2024-08-19T00:13:35.494 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.484+0000 7f94e0881740 1 -- 172.21.15.44:0/3329916853 wait complete. 2024-08-19T00:13:35.494 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.485+0000 7f94e0881740 1 -- start start 2024-08-19T00:13:35.495 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.485+0000 7f94e0881740 1 Processor -- start 2024-08-19T00:13:35.495 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.485+0000 7f94e0881740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f9423d67d0 0x55f9423de8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:35.495 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.485+0000 7f94e0881740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f9423d70f0 0x55f9423dee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:35.495 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.485+0000 7f94e0881740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f9423e1990 0x55f9423df360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:35.495 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.485+0000 7f94e0881740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55f9423e4560 con 0x55f9423d70f0 2024-08-19T00:13:35.495 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.485+0000 7f94e0881740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55f9422f6520 con 0x55f9423e1990 2024-08-19T00:13:35.495 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.485+0000 7f94e0881740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55f9423e46e0 con 0x55f9423d67d0 2024-08-19T00:13:35.495 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.485+0000 7f94e0881740 10 client.0 _ll_register_callbacks cb 0x55f94204da00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:13:35.495 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.485+0000 7f94d67fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f9423d70f0 0x55f9423dee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:35.495 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.485+0000 7f94d67fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f9423d70f0 0x55f9423dee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55472/0 (socket says 172.21.15.44:55472) 2024-08-19T00:13:35.495 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.485+0000 7f94d67fc640 1 -- 172.21.15.44:0/1837523888 learned_addr learned my addr 172.21.15.44:0/1837523888 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:35.495 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.485+0000 7f94d6ffd640 1 --2- 172.21.15.44:0/1837523888 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f9423d67d0 0x55f9423de8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:35.495 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.486+0000 7f94d77fe640 1 --2- 172.21.15.44:0/1837523888 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f9423e1990 0x55f9423df360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:35.496 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.486+0000 7f94d67fc640 1 -- 172.21.15.44:0/1837523888 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f9423d67d0 msgr2=0x55f9423de8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:35.496 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.486+0000 7f94d67fc640 1 --2- 172.21.15.44:0/1837523888 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f9423d67d0 0x55f9423de8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:35.496 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.486+0000 7f94d67fc640 1 -- 172.21.15.44:0/1837523888 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f9423e1990 msgr2=0x55f9423df360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:35.496 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.486+0000 7f94d67fc640 1 --2- 172.21.15.44:0/1837523888 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f9423e1990 0x55f9423df360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:35.496 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.486+0000 7f94d67fc640 1 -- 172.21.15.44:0/1837523888 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f94211a620 con 0x55f9423d70f0 2024-08-19T00:13:35.496 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.486+0000 7f94d77fe640 1 --2- 172.21.15.44:0/1837523888 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f9423e1990 0x55f9423df360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:13:35.496 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.486+0000 7f94d67fc640 1 --2- 172.21.15.44:0/1837523888 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f9423d70f0 0x55f9423dee20 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f94cc0095f0 tx=0x7f94cc005d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d921f27f2303233 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:35.496 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.486+0000 7f94b6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:13:35.496 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.486+0000 7f94b6ffd640 1 -- 172.21.15.44:0/1837523888 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94cc009810 con 0x55f9423d70f0 2024-08-19T00:13:35.496 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.486+0000 7f94b6ffd640 1 -- 172.21.15.44:0/1837523888 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f94cc005210 con 0x55f9423d70f0 2024-08-19T00:13:35.496 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.486+0000 7f94e0881740 1 -- 172.21.15.44:0/1837523888 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94cc0047a0 con 0x55f9423d70f0 2024-08-19T00:13:35.496 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.486+0000 7f94b6ffd640 1 -- 172.21.15.44:0/1837523888 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f94cc005430 con 0x55f9423d70f0 2024-08-19T00:13:35.496 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.486+0000 7f94e0881740 10 client.15462 fetch_fsmap learned FSMap version 28 2024-08-19T00:13:35.497 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.486+0000 7f94e0881740 1 -- 172.21.15.44:0/1837523888 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f9423f01c0 con 0x55f9423d70f0 2024-08-19T00:13:35.497 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.486+0000 7f94b6ffd640 1 -- 172.21.15.44:0/1837523888 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94cc0047a0 con 0x55f9423d70f0 2024-08-19T00:13:35.497 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.487+0000 7f94b6ffd640 1 -- 172.21.15.44:0/1837523888 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f94cc00f040 con 0x55f9423d70f0 2024-08-19T00:13:35.497 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.487+0000 7f94e0881740 10 client.15462 fetch_fsmap finished waiting for FSMap version 28 2024-08-19T00:13:35.497 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.487+0000 7f94e0881740 10 client.15462 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:13:35.497 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.487+0000 7f94e0881740 20 client.15462 populate_metadata read hostname 'smithi044' 2024-08-19T00:13:35.497 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.487+0000 7f94e0881740 1 --2- 172.21.15.44:0/1837523888 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55f9423f15d0 0x55f9423f39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:35.497 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.487+0000 7f94e0881740 4 client.15462 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:13:35.497 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.487+0000 7f94e0881740 1 -- 172.21.15.44:0/1837523888 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f942348100 con 0x55f9423f15d0 2024-08-19T00:13:35.497 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.487+0000 7f94d6ffd640 1 --2- 172.21.15.44:0/1837523888 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55f9423f15d0 0x55f9423f39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:35.497 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.488+0000 7f94d6ffd640 1 --2- 172.21.15.44:0/1837523888 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55f9423f15d0 0x55f9423f39c0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=152ae6d89287db72 server_cookie=fc643f69c17167ab in_seq=0 out_seq=0 2024-08-19T00:13:35.497 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.488+0000 7f94b6ffd640 10 client.15462 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:13:35.497 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.488+0000 7f94b6ffd640 1 -- 172.21.15.44:0/1837523888 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f942348100 con 0x55f9423f15d0 2024-08-19T00:13:35.497 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.488+0000 7f94b6ffd640 10 client.15462 handle_command_reply: tid=0 2024-08-19T00:13:35.498 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.488+0000 7f94e0881740 1 client.15462 shutdown 2024-08-19T00:13:35.498 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.488+0000 7f94e0881740 1 -- 172.21.15.44:0/1837523888 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f9423d70f0 msgr2=0x55f9423dee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:35.498 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.488+0000 7f94e0881740 1 --2- 172.21.15.44:0/1837523888 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f9423d70f0 0x55f9423dee20 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f94cc0095f0 tx=0x7f94cc005d10 comp rx=0 tx=0).stop 2024-08-19T00:13:35.498 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.488+0000 7f94e0881740 1 -- 172.21.15.44:0/1837523888 shutdown_connections 2024-08-19T00:13:35.498 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.488+0000 7f94e0881740 1 --2- 172.21.15.44:0/1837523888 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55f9423f15d0 0x55f9423f39c0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:35.498 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.488+0000 7f94e0881740 1 --2- 172.21.15.44:0/1837523888 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f9423e1990 0x55f9423df360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:35.498 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.488+0000 7f94e0881740 1 --2- 172.21.15.44:0/1837523888 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f9423d70f0 0x55f9423dee20 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:35.498 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.488+0000 7f94b6ffd640 0 client.15462 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:13:35.498 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.488+0000 7f94e0881740 1 --2- 172.21.15.44:0/1837523888 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f9423d67d0 0x55f9423de8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:35.498 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.488+0000 7f94e0881740 1 -- 172.21.15.44:0/1837523888 >> 172.21.15.44:0/1837523888 conn(0x55f9423d2d40 msgr2=0x55f9423d8a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:35.498 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.489+0000 7f94e0881740 1 -- 172.21.15.44:0/1837523888 shutdown_connections 2024-08-19T00:13:35.498 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.489+0000 7f94e0881740 1 -- 172.21.15.44:0/1837523888 wait complete. 2024-08-19T00:13:35.498 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.489+0000 7f94e0881740 20 client.15462 trim_cache size 0 max 16384 2024-08-19T00:13:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.503+0000 7f94e0881740 1 Processor -- start 2024-08-19T00:13:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.503+0000 7f94e0881740 1 -- start start 2024-08-19T00:13:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.503+0000 7f94e0881740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f9423d67d0 0x55f9423df190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.503+0000 7f94e0881740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f9423d70f0 0x55f9423e9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.503+0000 7f94e0881740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f9423e1990 0x55f9423ea2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:35.508 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.503+0000 7f94e0881740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f94d81aed20 con 0x55f9423d70f0 2024-08-19T00:13:35.508 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.503+0000 7f94e0881740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f94d81b0860 con 0x55f9423e1990 2024-08-19T00:13:35.508 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.503+0000 7f94e0881740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f94d81af3f0 con 0x55f9423d67d0 2024-08-19T00:13:35.508 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.503+0000 7f94d67fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f9423d70f0 0x55f9423e9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:35.508 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.503+0000 7f94d67fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f9423d70f0 0x55f9423e9d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55484/0 (socket says 172.21.15.44:55484) 2024-08-19T00:13:35.508 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.503+0000 7f94d67fc640 1 -- 172.21.15.44:0/64181688 learned_addr learned my addr 172.21.15.44:0/64181688 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:35.508 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.504+0000 7f94d6ffd640 1 --2- 172.21.15.44:0/64181688 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f9423d67d0 0x55f9423df190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:35.508 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.504+0000 7f94d77fe640 1 --2- 172.21.15.44:0/64181688 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f9423e1990 0x55f9423ea2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:35.508 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.504+0000 7f94d67fc640 1 -- 172.21.15.44:0/64181688 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f9423d67d0 msgr2=0x55f9423df190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:35.508 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.504+0000 7f94d67fc640 1 --2- 172.21.15.44:0/64181688 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f9423d67d0 0x55f9423df190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:35.508 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.504+0000 7f94d67fc640 1 -- 172.21.15.44:0/64181688 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f9423e1990 msgr2=0x55f9423ea2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:35.508 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.504+0000 7f94d67fc640 1 --2- 172.21.15.44:0/64181688 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f9423e1990 0x55f9423ea2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:35.508 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.504+0000 7f94d67fc640 1 -- 172.21.15.44:0/64181688 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9423d2b70 con 0x55f9423d70f0 2024-08-19T00:13:35.508 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.504+0000 7f94d6ffd640 1 --2- 172.21.15.44:0/64181688 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f9423d67d0 0x55f9423df190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:13:35.509 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.504+0000 7f94d67fc640 1 --2- 172.21.15.44:0/64181688 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f9423d70f0 0x55f9423e9d80 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f94cc000c00 tx=0x7f94cc001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41af5f24ba627806 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:35.509 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.504+0000 7f94bd7fa640 1 -- 172.21.15.44:0/64181688 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94cc0047a0 con 0x55f9423d70f0 2024-08-19T00:13:35.509 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.504+0000 7f94bd7fa640 1 -- 172.21.15.44:0/64181688 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94cc004440 con 0x55f9423d70f0 2024-08-19T00:13:35.509 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.504+0000 7f94bd7fa640 1 -- 172.21.15.44:0/64181688 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94cc0038e0 con 0x55f9423d70f0 2024-08-19T00:13:35.509 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.505+0000 7f94e0881740 1 -- 172.21.15.44:0/64181688 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f9423d70f0 msgr2=0x55f9423e9d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:35.509 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.505+0000 7f94e0881740 1 --2- 172.21.15.44:0/64181688 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f9423d70f0 0x55f9423e9d80 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f94cc000c00 tx=0x7f94cc001e50 comp rx=0 tx=0).stop 2024-08-19T00:13:35.509 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.505+0000 7f94e0881740 1 -- 172.21.15.44:0/64181688 shutdown_connections 2024-08-19T00:13:35.509 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.505+0000 7f94e0881740 1 --2- 172.21.15.44:0/64181688 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f9423e1990 0x55f9423ea2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:35.509 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.505+0000 7f94e0881740 1 --2- 172.21.15.44:0/64181688 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f9423d70f0 0x55f9423e9d80 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:35.509 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.505+0000 7f94e0881740 1 --2- 172.21.15.44:0/64181688 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f9423d67d0 0x55f9423df190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:35.509 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.505+0000 7f94e0881740 1 -- 172.21.15.44:0/64181688 >> 172.21.15.44:0/64181688 conn(0x55f9423d2d40 msgr2=0x55f9423e0850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:35.509 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.505+0000 7f94e0881740 1 -- 172.21.15.44:0/64181688 shutdown_connections 2024-08-19T00:13:35.509 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.505+0000 7f94e0881740 1 -- 172.21.15.44:0/64181688 wait complete. 2024-08-19T00:13:35.509 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.505+0000 7f94e0881740 1 -- start start 2024-08-19T00:13:35.510 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.505+0000 7f94e0881740 1 Processor -- start 2024-08-19T00:13:35.512 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.505+0000 7f94e0881740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f9423d67d0 0x55f9424540c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:35.512 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.505+0000 7f94e0881740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f9423d70f0 0x55f942454600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:35.512 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.505+0000 7f94e0881740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f9423e1990 0x55f942454b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:35.512 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.505+0000 7f94e0881740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f94d81b0190 con 0x55f9423e1990 2024-08-19T00:13:35.512 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.505+0000 7f94e0881740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f94d81afac0 con 0x55f9423d70f0 2024-08-19T00:13:35.512 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.505+0000 7f94e0881740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f94d81acd00 con 0x55f9423d67d0 2024-08-19T00:13:35.512 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.505+0000 7f94e0881740 10 client.0 _ll_register_callbacks cb 0x7f94cc009a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:13:35.512 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.506+0000 7f94d77fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f9423e1990 0x55f942454b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:35.512 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.506+0000 7f94d77fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f9423e1990 0x55f942454b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55500/0 (socket says 172.21.15.44:55500) 2024-08-19T00:13:35.513 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.506+0000 7f94d77fe640 1 -- 172.21.15.44:0/3139162797 learned_addr learned my addr 172.21.15.44:0/3139162797 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:35.513 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.506+0000 7f94d67fc640 1 --2- 172.21.15.44:0/3139162797 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f9423d70f0 0x55f942454600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:35.513 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.506+0000 7f94d6ffd640 1 --2- 172.21.15.44:0/3139162797 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f9423d67d0 0x55f9424540c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:35.513 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.506+0000 7f94d77fe640 1 -- 172.21.15.44:0/3139162797 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f9423d67d0 msgr2=0x55f9424540c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:35.513 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.506+0000 7f94d77fe640 1 --2- 172.21.15.44:0/3139162797 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f9423d67d0 0x55f9424540c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:35.513 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.506+0000 7f94d77fe640 1 -- 172.21.15.44:0/3139162797 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f9423d70f0 msgr2=0x55f942454600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:35.513 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.506+0000 7f94d77fe640 1 --2- 172.21.15.44:0/3139162797 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f9423d70f0 0x55f942454600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:35.513 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.506+0000 7f94d77fe640 1 -- 172.21.15.44:0/3139162797 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f94245f360 con 0x55f9423e1990 2024-08-19T00:13:35.513 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.506+0000 7f94d77fe640 1 --2- 172.21.15.44:0/3139162797 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f9423e1990 0x55f942454b40 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f94d00042e0 tx=0x7f94d0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12e6075bac4247fc server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:35.513 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.506+0000 7f94b6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:13:35.513 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.506+0000 7f94b6ffd640 1 -- 172.21.15.44:0/3139162797 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d0024070 con 0x55f9423e1990 2024-08-19T00:13:35.513 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.506+0000 7f94b6ffd640 1 -- 172.21.15.44:0/3139162797 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f94d00129d0 con 0x55f9423e1990 2024-08-19T00:13:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.506+0000 7f94e0881740 1 -- 172.21.15.44:0/3139162797 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94cc004440 con 0x55f9423e1990 2024-08-19T00:13:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.506+0000 7f94b6ffd640 1 -- 172.21.15.44:0/3139162797 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f94d0030050 con 0x55f9423e1990 2024-08-19T00:13:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.506+0000 7f94e0881740 10 client.15468 fetch_fsmap learned FSMap version 28 2024-08-19T00:13:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.506+0000 7f94e0881740 1 -- 172.21.15.44:0/3139162797 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f9424606b0 con 0x55f9423e1990 2024-08-19T00:13:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.507+0000 7f94b6ffd640 1 -- 172.21.15.44:0/3139162797 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94cc004440 con 0x55f9423e1990 2024-08-19T00:13:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.507+0000 7f94b6ffd640 1 -- 172.21.15.44:0/3139162797 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f94d0020c80 con 0x55f9423e1990 2024-08-19T00:13:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.507+0000 7f94e0881740 10 client.15468 fetch_fsmap finished waiting for FSMap version 28 2024-08-19T00:13:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.507+0000 7f94e0881740 10 client.15468 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:13:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.507+0000 7f94e0881740 20 client.15468 populate_metadata read hostname 'smithi044' 2024-08-19T00:13:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.507+0000 7f94e0881740 1 --2- 172.21.15.44:0/3139162797 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55f942460e60 0x55f942463280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.507+0000 7f94e0881740 4 client.15468 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-19T00:13:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.507+0000 7f94e0881740 1 -- 172.21.15.44:0/3139162797 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f942342450 con 0x55f942460e60 2024-08-19T00:13:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.507+0000 7f94d6ffd640 1 --2- 172.21.15.44:0/3139162797 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55f942460e60 0x55f942463280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.507+0000 7f94d6ffd640 1 --2- 172.21.15.44:0/3139162797 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55f942460e60 0x55f942463280 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3bd1a83693af858f server_cookie=f3028b368bfceca8 in_seq=0 out_seq=0 2024-08-19T00:13:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.507+0000 7f94b6ffd640 10 client.15468 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:13:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.520+0000 7f94b6ffd640 1 -- 172.21.15.44:0/3139162797 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f942342450 con 0x55f942460e60 2024-08-19T00:13:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.520+0000 7f94b6ffd640 10 client.15468 handle_command_reply: tid=0 2024-08-19T00:13:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.520+0000 7f94e0881740 1 client.15468 shutdown 2024-08-19T00:13:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.520+0000 7f94e0881740 1 -- 172.21.15.44:0/3139162797 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f9423e1990 msgr2=0x55f942454b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.520+0000 7f94e0881740 1 --2- 172.21.15.44:0/3139162797 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f9423e1990 0x55f942454b40 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f94d00042e0 tx=0x7f94d0004a40 comp rx=0 tx=0).stop 2024-08-19T00:13:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.520+0000 7f94e0881740 1 -- 172.21.15.44:0/3139162797 shutdown_connections 2024-08-19T00:13:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.520+0000 7f94e0881740 1 --2- 172.21.15.44:0/3139162797 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55f942460e60 0x55f942463280 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.520+0000 7f94e0881740 1 --2- 172.21.15.44:0/3139162797 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f9423e1990 0x55f942454b40 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.520+0000 7f94e0881740 1 --2- 172.21.15.44:0/3139162797 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f9423d70f0 0x55f942454600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.520+0000 7f94b6ffd640 0 client.15468 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:13:35.524 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.520+0000 7f94e0881740 1 --2- 172.21.15.44:0/3139162797 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f9423d67d0 0x55f9424540c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:35.524 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.520+0000 7f94e0881740 1 -- 172.21.15.44:0/3139162797 >> 172.21.15.44:0/3139162797 conn(0x55f9423d2d40 msgr2=0x55f9423d81a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:35.524 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.520+0000 7f94e0881740 1 -- 172.21.15.44:0/3139162797 shutdown_connections 2024-08-19T00:13:35.524 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.520+0000 7f94e0881740 1 -- 172.21.15.44:0/3139162797 wait complete. 2024-08-19T00:13:35.524 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.520+0000 7f94e0881740 20 client.15468 trim_cache size 0 max 16384 2024-08-19T00:13:35.524 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:{ 2024-08-19T00:13:35.524 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "message": "", 2024-08-19T00:13:35.524 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "return_code": 0 2024-08-19T00:13:35.524 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:} 2024-08-19T00:13:35.525 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.521+0000 7f94dd9df640 1 -- 172.21.15.44:0/1294366472 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f94c00a2ec0 msgr2=0x7f94c00a5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:35.525 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.521+0000 7f94dd9df640 1 --2- 172.21.15.44:0/1294366472 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f94c00a2ec0 0x7f94c00a5380 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f94d0005fd0 tx=0x7f94d0010740 comp rx=0 tx=0).stop 2024-08-19T00:13:35.525 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.521+0000 7f94dd9df640 1 -- 172.21.15.44:0/1294366472 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94d8100720 msgr2=0x7f94d8198130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:35.525 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.521+0000 7f94dd9df640 1 --2- 172.21.15.44:0/1294366472 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94d8100720 0x7f94d8198130 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f94c8009230 tx=0x7f94c8004040 comp rx=0 tx=0).stop 2024-08-19T00:13:35.526 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.521+0000 7f94dd9df640 1 -- 172.21.15.44:0/1294366472 shutdown_connections 2024-08-19T00:13:35.526 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.521+0000 7f94dd9df640 1 --2- 172.21.15.44:0/1294366472 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f94c00a2ec0 0x7f94c00a5380 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:35.526 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.521+0000 7f94dd9df640 1 --2- 172.21.15.44:0/1294366472 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f94d8106730 0x7f94d819c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:35.526 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.521+0000 7f94dd9df640 1 --2- 172.21.15.44:0/1294366472 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94d81010c0 0x7f94d8198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:35.526 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.521+0000 7f94dd9df640 1 --2- 172.21.15.44:0/1294366472 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94d8100720 0x7f94d8198130 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:35.526 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.521+0000 7f94dd9df640 1 -- 172.21.15.44:0/1294366472 >> 172.21.15.44:0/1294366472 conn(0x7f94d80fc3e0 msgr2=0x7f94d806a370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:35.526 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.521+0000 7f94dd9df640 1 -- 172.21.15.44:0/1294366472 shutdown_connections 2024-08-19T00:13:35.526 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:35.521+0000 7f94dd9df640 1 -- 172.21.15.44:0/1294366472 wait complete. 2024-08-19T00:13:35.544 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-08-19T00:10:53.196636+0000', 'modified': '2024-08-19T00:13:17.136820+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24473, 'mds_1': 24446, 'mds_2': 24439, 'mds_3': 24431, 'mds_4': 24418}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14529': {'gid': 14529, 'name': 'd', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.44:6837/1824829052', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6836', 'nonce': 1824829052}, {'type': 'v1', 'addr': '172.21.15.44:6837', 'nonce': 1824829052}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14577': {'gid': 14577, 'name': 'g', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.44:6839/3591739042', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6838', 'nonce': 3591739042}, {'type': 'v1', 'addr': '172.21.15.44:6839', 'nonce': 3591739042}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14589': {'gid': 14589, 'name': 'a', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.44:6841/3667695717', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6840', 'nonce': 3667695717}, {'type': 'v1', 'addr': '172.21.15.44:6841', 'nonce': 3667695717}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24388': {'gid': 24388, 'name': 'l', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.171:6833/1183022838', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6832', 'nonce': 1183022838}, {'type': 'v1', 'addr': '172.21.15.171:6833', 'nonce': 1183022838}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24412': {'gid': 24412, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.171:6835/2190623851', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6834', 'nonce': 2190623851}, {'type': 'v1', 'addr': '172.21.15.171:6835', 'nonce': 2190623851}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24418': {'gid': 24418, 'name': 'c', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 19, 'addr': '172.21.15.171:6837/316231795', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6836', 'nonce': 316231795}, {'type': 'v1', 'addr': '172.21.15.171:6837', 'nonce': 316231795}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24431': {'gid': 24431, 'name': 'e', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 20, 'addr': '172.21.15.116:6835/3507399322', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6834', 'nonce': 3507399322}, {'type': 'v1', 'addr': '172.21.15.116:6835', 'nonce': 3507399322}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24439': {'gid': 24439, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.171:6839/1466585795', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6838', 'nonce': 1466585795}, {'type': 'v1', 'addr': '172.21.15.171:6839', 'nonce': 1466585795}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24446': {'gid': 24446, 'name': 'h', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.116:6837/2764513846', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6836', 'nonce': 2764513846}, {'type': 'v1', 'addr': '172.21.15.116:6837', 'nonce': 2764513846}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24473': {'gid': 24473, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.116:6839/1032741033', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6838', 'nonce': 1032741033}, {'type': 'v1', 'addr': '172.21.15.116:6839', 'nonce': 1032741033}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24473, 'qdb_cluster': [24418, 24431, 24439, 24446, 24473]} 2024-08-19T00:13:35.544 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-08-19T00:13:35.544 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph tell mds.c status 2024-08-19T00:13:35.840 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:13:35.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:35 smithi044 ceph-mon[18489]: pgmap v11: 129 pgs: 129 active+clean; 1.3 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 77 KiB/s wr, 52 op/s 2024-08-19T00:13:35.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:35 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/4145239810' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:13:36.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:35 smithi171 ceph-mon[21810]: pgmap v11: 129 pgs: 129 active+clean; 1.3 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 77 KiB/s wr, 52 op/s 2024-08-19T00:13:36.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:35 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/4145239810' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:13:36.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:35 smithi116 ceph-mon[21873]: pgmap v11: 129 pgs: 129 active+clean; 1.3 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 77 KiB/s wr, 52 op/s 2024-08-19T00:13:36.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:35 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/4145239810' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:13:36.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.329+0000 7fde32f76640 1 -- 172.21.15.44:0/12919046 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde2c1007a0 msgr2=0x7fde2c100c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:36.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.329+0000 7fde32f76640 1 --2- 172.21.15.44:0/12919046 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde2c1007a0 0x7fde2c100c00 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fde18009930 tx=0x7fde1802a420 comp rx=0 tx=0).stop 2024-08-19T00:13:36.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.329+0000 7fde32f76640 1 -- 172.21.15.44:0/12919046 shutdown_connections 2024-08-19T00:13:36.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.329+0000 7fde32f76640 1 --2- 172.21.15.44:0/12919046 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde2c101140 0x7fde2c10d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:36.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.329+0000 7fde32f76640 1 --2- 172.21.15.44:0/12919046 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde2c1007a0 0x7fde2c100c00 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:36.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.329+0000 7fde32f76640 1 --2- 172.21.15.44:0/12919046 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde2c1067a0 0x7fde2c106b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:36.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.329+0000 7fde32f76640 1 -- 172.21.15.44:0/12919046 >> 172.21.15.44:0/12919046 conn(0x7fde2c0fc4c0 msgr2=0x7fde2c0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:36.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.329+0000 7fde32f76640 1 -- 172.21.15.44:0/12919046 shutdown_connections 2024-08-19T00:13:36.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.329+0000 7fde32f76640 1 -- 172.21.15.44:0/12919046 wait complete. 2024-08-19T00:13:36.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.330+0000 7fde32f76640 1 Processor -- start 2024-08-19T00:13:36.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.330+0000 7fde32f76640 1 -- start start 2024-08-19T00:13:36.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.330+0000 7fde32f76640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde2c1007a0 0x7fde2c198fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:36.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.330+0000 7fde32f76640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde2c101140 0x7fde2c199510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:36.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.330+0000 7fde32f76640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde2c1067a0 0x7fde2c1a4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:36.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.330+0000 7fde32f76640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fde2c110ba0 con 0x7fde2c1067a0 2024-08-19T00:13:36.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.330+0000 7fde32f76640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fde2c110a20 con 0x7fde2c101140 2024-08-19T00:13:36.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.330+0000 7fde32f76640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fde2c110d20 con 0x7fde2c1007a0 2024-08-19T00:13:36.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.330+0000 7fde31513640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde2c1067a0 0x7fde2c1a4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:36.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.330+0000 7fde31513640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde2c1067a0 0x7fde2c1a4050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55526/0 (socket says 172.21.15.44:55526) 2024-08-19T00:13:36.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.330+0000 7fde31513640 1 -- 172.21.15.44:0/2490387695 learned_addr learned my addr 172.21.15.44:0/2490387695 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:36.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.330+0000 7fde30d12640 1 --2- 172.21.15.44:0/2490387695 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde2c1007a0 0x7fde2c198fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:36.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.330+0000 7fde2bfff640 1 --2- 172.21.15.44:0/2490387695 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde2c101140 0x7fde2c199510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:36.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.331+0000 7fde31513640 1 -- 172.21.15.44:0/2490387695 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde2c1007a0 msgr2=0x7fde2c198fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:36.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.331+0000 7fde31513640 1 --2- 172.21.15.44:0/2490387695 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde2c1007a0 0x7fde2c198fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:36.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.331+0000 7fde31513640 1 -- 172.21.15.44:0/2490387695 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde2c101140 msgr2=0x7fde2c199510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:36.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.331+0000 7fde31513640 1 --2- 172.21.15.44:0/2490387695 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde2c101140 0x7fde2c199510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:36.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.331+0000 7fde31513640 1 -- 172.21.15.44:0/2490387695 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde2c1a4590 con 0x7fde2c1067a0 2024-08-19T00:13:36.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.331+0000 7fde31513640 1 --2- 172.21.15.44:0/2490387695 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde2c1067a0 0x7fde2c1a4050 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fde24009fd0 tx=0x7fde2400def0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:36.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.331+0000 7fde29ffb640 1 -- 172.21.15.44:0/2490387695 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde24017070 con 0x7fde2c1067a0 2024-08-19T00:13:36.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.331+0000 7fde32f76640 1 -- 172.21.15.44:0/2490387695 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde2c1a4760 con 0x7fde2c1067a0 2024-08-19T00:13:36.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.331+0000 7fde29ffb640 1 -- 172.21.15.44:0/2490387695 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde24003e50 con 0x7fde2c1067a0 2024-08-19T00:13:36.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.331+0000 7fde29ffb640 1 -- 172.21.15.44:0/2490387695 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde24010460 con 0x7fde2c1067a0 2024-08-19T00:13:36.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.331+0000 7fde32f76640 1 -- 172.21.15.44:0/2490387695 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde2c1a4c20 con 0x7fde2c1067a0 2024-08-19T00:13:36.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.334+0000 7fde35374740 1 Processor -- start 2024-08-19T00:13:36.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.334+0000 7fde29ffb640 1 -- 172.21.15.44:0/2490387695 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 24) ==== 138060+0+0 (secure 0 0 0) 0x7fde24003970 con 0x7fde2c1067a0 2024-08-19T00:13:36.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.334+0000 7fde35374740 1 -- start start 2024-08-19T00:13:36.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.335+0000 7fde35374740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555dd22fa630 0x555dd22faa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:36.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.335+0000 7fde35374740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555dd22faf50 0x555dd23052d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:36.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.335+0000 7fde35374740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555dd2305810 0x555dd2307c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:36.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.335+0000 7fde35374740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x555dd225f710 con 0x555dd2305810 2024-08-19T00:13:36.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.335+0000 7fde35374740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x555dd21f7770 con 0x555dd22fa630 2024-08-19T00:13:36.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.335+0000 7fde35374740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x555dd225b6d0 con 0x555dd22faf50 2024-08-19T00:13:36.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.335+0000 7fde2bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555dd2305810 0x555dd2307c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:36.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.335+0000 7fde2bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555dd2305810 0x555dd2307c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55538/0 (socket says 172.21.15.44:55538) 2024-08-19T00:13:36.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.335+0000 7fde2bfff640 1 -- 172.21.15.44:0/3062190880 learned_addr learned my addr 172.21.15.44:0/3062190880 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:36.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.335+0000 7fde2bfff640 1 --2- 172.21.15.44:0/3062190880 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555dd22fa630 0x555dd22faa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:36.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.335+0000 7fde30d12640 1 --2- 172.21.15.44:0/3062190880 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555dd22faf50 0x555dd23052d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:36.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.335+0000 7fde2bfff640 1 -- 172.21.15.44:0/3062190880 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555dd22faf50 msgr2=0x555dd23052d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:36.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.335+0000 7fde2bfff640 1 --2- 172.21.15.44:0/3062190880 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555dd22faf50 0x555dd23052d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:36.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.335+0000 7fde2bfff640 1 -- 172.21.15.44:0/3062190880 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555dd22fa630 msgr2=0x555dd22faa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:36.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.335+0000 7fde2bfff640 1 --2- 172.21.15.44:0/3062190880 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555dd22fa630 0x555dd22faa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:36.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.335+0000 7fde2bfff640 1 -- 172.21.15.44:0/3062190880 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555dd21fe3e0 con 0x555dd2305810 2024-08-19T00:13:36.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.335+0000 7fde29ffb640 1 --2- 172.21.15.44:0/2490387695 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fde1c0a2e10 0x7fde1c0a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:36.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.335+0000 7fde2bfff640 1 --2- 172.21.15.44:0/3062190880 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555dd2305810 0x555dd2307c00 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fde1802a940 tx=0x7fde18005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e09e8d811041a2d4 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:36.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.335+0000 7fde30d12640 1 --2- 172.21.15.44:0/2490387695 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fde1c0a2e10 0x7fde1c0a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:36.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.335+0000 7fde29ffb640 1 -- 172.21.15.44:0/2490387695 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7fde240cf710 con 0x7fde2c1067a0 2024-08-19T00:13:36.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.336+0000 7fde16ffd640 1 -- 172.21.15.44:0/3062190880 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde18044030 con 0x555dd2305810 2024-08-19T00:13:36.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.336+0000 7fde30d12640 1 --2- 172.21.15.44:0/2490387695 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fde1c0a2e10 0x7fde1c0a52d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x555dd22f7a20 tx=0x7fde2000a2d0 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:36.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.336+0000 7fde16ffd640 1 -- 172.21.15.44:0/3062190880 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde18005020 con 0x555dd2305810 2024-08-19T00:13:36.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.336+0000 7fde16ffd640 1 -- 172.21.15.44:0/3062190880 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde18035070 con 0x555dd2305810 2024-08-19T00:13:36.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.337+0000 7fde35374740 1 -- 172.21.15.44:0/3062190880 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555dd2305810 msgr2=0x555dd2307c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:36.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.337+0000 7fde35374740 1 --2- 172.21.15.44:0/3062190880 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555dd2305810 0x555dd2307c00 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fde1802a940 tx=0x7fde18005fd0 comp rx=0 tx=0).stop 2024-08-19T00:13:36.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.337+0000 7fde35374740 1 -- 172.21.15.44:0/3062190880 shutdown_connections 2024-08-19T00:13:36.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.337+0000 7fde35374740 1 --2- 172.21.15.44:0/3062190880 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555dd22faf50 0x555dd23052d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:36.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.337+0000 7fde35374740 1 --2- 172.21.15.44:0/3062190880 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555dd2305810 0x555dd2307c00 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:36.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.337+0000 7fde35374740 1 --2- 172.21.15.44:0/3062190880 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555dd22fa630 0x555dd22faa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:36.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.337+0000 7fde35374740 1 -- 172.21.15.44:0/3062190880 >> 172.21.15.44:0/3062190880 conn(0x555dd22f6bc0 msgr2=0x555dd22f6fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:36.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.337+0000 7fde35374740 1 -- 172.21.15.44:0/3062190880 shutdown_connections 2024-08-19T00:13:36.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.337+0000 7fde35374740 1 -- 172.21.15.44:0/3062190880 wait complete. 2024-08-19T00:13:36.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.337+0000 7fde35374740 1 -- start start 2024-08-19T00:13:36.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.337+0000 7fde35374740 1 Processor -- start 2024-08-19T00:13:36.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.338+0000 7fde35374740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555dd22fa630 0x555dd23026b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:36.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.338+0000 7fde35374740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555dd22faf50 0x555dd2302bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:36.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.338+0000 7fde35374740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555dd2305810 0x555dd2303130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:36.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.338+0000 7fde35374740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x555dd23083e0 con 0x555dd22fa630 2024-08-19T00:13:36.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.338+0000 7fde35374740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x555dd221a970 con 0x555dd22faf50 2024-08-19T00:13:36.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.338+0000 7fde35374740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x555dd2308560 con 0x555dd2305810 2024-08-19T00:13:36.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.338+0000 7fde35374740 10 client.0 _ll_register_callbacks cb 0x555dd1f6e7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:13:36.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.338+0000 7fde30d12640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555dd22fa630 0x555dd23026b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:36.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.338+0000 7fde30d12640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555dd22fa630 0x555dd23026b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55548/0 (socket says 172.21.15.44:55548) 2024-08-19T00:13:36.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.338+0000 7fde30d12640 1 -- 172.21.15.44:0/511694606 learned_addr learned my addr 172.21.15.44:0/511694606 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:36.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.338+0000 7fde31513640 1 --2- 172.21.15.44:0/511694606 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555dd2305810 0x555dd2303130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:36.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.338+0000 7fde2bfff640 1 --2- 172.21.15.44:0/511694606 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555dd22faf50 0x555dd2302bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:36.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.338+0000 7fde30d12640 1 -- 172.21.15.44:0/511694606 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555dd2305810 msgr2=0x555dd2303130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:36.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.338+0000 7fde30d12640 1 --2- 172.21.15.44:0/511694606 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555dd2305810 0x555dd2303130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:36.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.338+0000 7fde30d12640 1 -- 172.21.15.44:0/511694606 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555dd22faf50 msgr2=0x555dd2302bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:36.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.338+0000 7fde30d12640 1 --2- 172.21.15.44:0/511694606 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555dd22faf50 0x555dd2302bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:36.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.338+0000 7fde30d12640 1 -- 172.21.15.44:0/511694606 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555dd1fd12b0 con 0x555dd22fa630 2024-08-19T00:13:36.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.338+0000 7fde31513640 1 --2- 172.21.15.44:0/511694606 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555dd2305810 0x555dd2303130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:13:36.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.338+0000 7fde30d12640 1 --2- 172.21.15.44:0/511694606 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555dd22fa630 0x555dd23026b0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fde20010f10 tx=0x7fde200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4756f9a420e4652e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:36.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.338+0000 7fde0bfff640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:13:36.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.338+0000 7fde0bfff640 1 -- 172.21.15.44:0/511694606 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde2001b870 con 0x555dd22fa630 2024-08-19T00:13:36.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.338+0000 7fde0bfff640 1 -- 172.21.15.44:0/511694606 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7fde2001ba10 con 0x555dd22fa630 2024-08-19T00:13:36.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.338+0000 7fde35374740 1 -- 172.21.15.44:0/511694606 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde18005020 con 0x555dd22fa630 2024-08-19T00:13:36.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.339+0000 7fde0bfff640 1 -- 172.21.15.44:0/511694606 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fde2001bc10 con 0x555dd22fa630 2024-08-19T00:13:36.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.339+0000 7fde35374740 10 client.15480 fetch_fsmap learned FSMap version 28 2024-08-19T00:13:36.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.339+0000 7fde35374740 1 -- 172.21.15.44:0/511694606 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555dd2314090 con 0x555dd22fa630 2024-08-19T00:13:36.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.339+0000 7fde0bfff640 1 -- 172.21.15.44:0/511694606 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde18005020 con 0x555dd22fa630 2024-08-19T00:13:36.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.339+0000 7fde0bfff640 1 -- 172.21.15.44:0/511694606 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fde20024070 con 0x555dd22fa630 2024-08-19T00:13:36.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.339+0000 7fde35374740 10 client.15480 fetch_fsmap finished waiting for FSMap version 28 2024-08-19T00:13:36.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.339+0000 7fde35374740 10 client.15480 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-19T00:13:36.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.339+0000 7fde35374740 20 client.15480 populate_metadata read hostname 'smithi044' 2024-08-19T00:13:36.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.339+0000 7fde35374740 1 --2- 172.21.15.44:0/511694606 >> [v2:172.21.15.171:6836/316231795,v1:172.21.15.171:6837/316231795] conn(0x555dd2316790 0x555dd2317c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:36.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.339+0000 7fde35374740 4 client.15480 mds_command: new command op to 24418 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:13:36.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.339+0000 7fde35374740 1 -- 172.21.15.44:0/511694606 --> [v2:172.21.15.171:6836/316231795,v1:172.21.15.171:6837/316231795] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555dd226cc80 con 0x555dd2316790 2024-08-19T00:13:36.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.339+0000 7fde2bfff640 1 --2- 172.21.15.44:0/511694606 >> [v2:172.21.15.171:6836/316231795,v1:172.21.15.171:6837/316231795] conn(0x555dd2316790 0x555dd2317c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:36.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.340+0000 7fde2bfff640 1 --2- 172.21.15.44:0/511694606 >> [v2:172.21.15.171:6836/316231795,v1:172.21.15.171:6837/316231795] conn(0x555dd2316790 0x555dd2317c00 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=43bb82b90819c08d server_cookie=e8797b15dd1d554f in_seq=0 out_seq=0 2024-08-19T00:13:36.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.340+0000 7fde0bfff640 10 client.15480 ms_handle_connect on v2:172.21.15.171:6836/316231795 2024-08-19T00:13:36.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.341+0000 7fde0bfff640 1 -- 172.21.15.44:0/511694606 <== mds.4 v2:172.21.15.171:6836/316231795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555dd226cc80 con 0x555dd2316790 2024-08-19T00:13:36.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.341+0000 7fde0bfff640 10 client.15480 handle_command_reply: tid=0 2024-08-19T00:13:36.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.341+0000 7fde35374740 1 client.15480 shutdown 2024-08-19T00:13:36.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.341+0000 7fde35374740 1 -- 172.21.15.44:0/511694606 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555dd22fa630 msgr2=0x555dd23026b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:36.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.341+0000 7fde35374740 1 --2- 172.21.15.44:0/511694606 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555dd22fa630 0x555dd23026b0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fde20010f10 tx=0x7fde200046c0 comp rx=0 tx=0).stop 2024-08-19T00:13:36.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.341+0000 7fde35374740 1 -- 172.21.15.44:0/511694606 shutdown_connections 2024-08-19T00:13:36.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.341+0000 7fde35374740 1 --2- 172.21.15.44:0/511694606 >> [v2:172.21.15.171:6836/316231795,v1:172.21.15.171:6837/316231795] conn(0x555dd2316790 0x555dd2317c00 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:36.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.341+0000 7fde35374740 1 --2- 172.21.15.44:0/511694606 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555dd2305810 0x555dd2303130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:36.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.341+0000 7fde35374740 1 --2- 172.21.15.44:0/511694606 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555dd22faf50 0x555dd2302bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:36.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.341+0000 7fde35374740 1 --2- 172.21.15.44:0/511694606 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555dd22fa630 0x555dd23026b0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:36.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.341+0000 7fde0bfff640 0 client.15480 ms_handle_reset on v2:172.21.15.171:6836/316231795 2024-08-19T00:13:36.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.341+0000 7fde35374740 1 -- 172.21.15.44:0/511694606 >> 172.21.15.44:0/511694606 conn(0x555dd22f6bc0 msgr2=0x555dd22fc8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:36.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.341+0000 7fde35374740 1 -- 172.21.15.44:0/511694606 shutdown_connections 2024-08-19T00:13:36.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.341+0000 7fde35374740 1 -- 172.21.15.44:0/511694606 wait complete. 2024-08-19T00:13:36.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.341+0000 7fde35374740 20 client.15480 trim_cache size 0 max 16384 2024-08-19T00:13:36.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.359+0000 7fde35374740 1 Processor -- start 2024-08-19T00:13:36.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.359+0000 7fde35374740 1 -- start start 2024-08-19T00:13:36.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.359+0000 7fde35374740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555dd22fa630 0x555dd2302f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:36.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.359+0000 7fde35374740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555dd22faf50 0x555dd23202d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:36.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.359+0000 7fde35374740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555dd2305810 0x555dd23107e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:36.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.359+0000 7fde35374740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x555dd2315f40 con 0x555dd2305810 2024-08-19T00:13:36.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.359+0000 7fde35374740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x555dd2316610 con 0x555dd22fa630 2024-08-19T00:13:36.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.359+0000 7fde35374740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x555dd2316ce0 con 0x555dd22faf50 2024-08-19T00:13:36.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.359+0000 7fde31513640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555dd2305810 0x555dd23107e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:36.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.359+0000 7fde31513640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555dd2305810 0x555dd23107e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55554/0 (socket says 172.21.15.44:55554) 2024-08-19T00:13:36.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.359+0000 7fde31513640 1 -- 172.21.15.44:0/3885273369 learned_addr learned my addr 172.21.15.44:0/3885273369 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:36.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.360+0000 7fde30d12640 1 --2- 172.21.15.44:0/3885273369 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555dd22fa630 0x555dd2302f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:36.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.360+0000 7fde2bfff640 1 --2- 172.21.15.44:0/3885273369 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555dd22faf50 0x555dd23202d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:36.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.360+0000 7fde31513640 1 -- 172.21.15.44:0/3885273369 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555dd22faf50 msgr2=0x555dd23202d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:36.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.360+0000 7fde31513640 1 --2- 172.21.15.44:0/3885273369 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555dd22faf50 0x555dd23202d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:36.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.360+0000 7fde31513640 1 -- 172.21.15.44:0/3885273369 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555dd22fa630 msgr2=0x555dd2302f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:36.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.360+0000 7fde31513640 1 --2- 172.21.15.44:0/3885273369 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555dd22fa630 0x555dd2302f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:36.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.360+0000 7fde31513640 1 -- 172.21.15.44:0/3885273369 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555dd22f2130 con 0x555dd2305810 2024-08-19T00:13:36.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.360+0000 7fde2bfff640 1 --2- 172.21.15.44:0/3885273369 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555dd22faf50 0x555dd23202d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:13:36.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.360+0000 7fde31513640 1 --2- 172.21.15.44:0/3885273369 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555dd2305810 0x555dd23107e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fde24097aa0 tx=0x7fde2409afa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88e5a88517a0dbd server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:36.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.360+0000 7fde167fc640 1 -- 172.21.15.44:0/3885273369 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde240b4070 con 0x555dd2305810 2024-08-19T00:13:36.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.360+0000 7fde167fc640 1 -- 172.21.15.44:0/3885273369 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde2409f9f0 con 0x555dd2305810 2024-08-19T00:13:36.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.360+0000 7fde167fc640 1 -- 172.21.15.44:0/3885273369 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde24020040 con 0x555dd2305810 2024-08-19T00:13:36.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.361+0000 7fde35374740 1 -- 172.21.15.44:0/3885273369 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555dd2305810 msgr2=0x555dd23107e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:36.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.361+0000 7fde35374740 1 --2- 172.21.15.44:0/3885273369 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555dd2305810 0x555dd23107e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fde24097aa0 tx=0x7fde2409afa0 comp rx=0 tx=0).stop 2024-08-19T00:13:36.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.361+0000 7fde35374740 1 -- 172.21.15.44:0/3885273369 shutdown_connections 2024-08-19T00:13:36.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.361+0000 7fde35374740 1 --2- 172.21.15.44:0/3885273369 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555dd22faf50 0x555dd23202d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:36.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.361+0000 7fde35374740 1 --2- 172.21.15.44:0/3885273369 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555dd2305810 0x555dd23107e0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:36.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.361+0000 7fde35374740 1 --2- 172.21.15.44:0/3885273369 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555dd22fa630 0x555dd2302f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:36.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.361+0000 7fde35374740 1 -- 172.21.15.44:0/3885273369 >> 172.21.15.44:0/3885273369 conn(0x555dd22f6bc0 msgr2=0x555dd23017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:36.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.361+0000 7fde35374740 1 -- 172.21.15.44:0/3885273369 shutdown_connections 2024-08-19T00:13:36.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.361+0000 7fde35374740 1 -- 172.21.15.44:0/3885273369 wait complete. 2024-08-19T00:13:36.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.361+0000 7fde35374740 1 -- start start 2024-08-19T00:13:36.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.361+0000 7fde35374740 1 Processor -- start 2024-08-19T00:13:36.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.362+0000 7fde35374740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555dd22fa630 0x555dd2318fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:36.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.362+0000 7fde35374740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555dd22faf50 0x555dd2319520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:36.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.362+0000 7fde35374740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555dd2305810 0x555dd2383ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:36.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.362+0000 7fde35374740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x555dd2317a80 con 0x555dd2305810 2024-08-19T00:13:36.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.362+0000 7fde35374740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x555dd23173b0 con 0x555dd22fa630 2024-08-19T00:13:36.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.362+0000 7fde35374740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x555dd2318150 con 0x555dd22faf50 2024-08-19T00:13:36.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.362+0000 7fde35374740 10 client.0 _ll_register_callbacks cb 0x7fde20010bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:13:36.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.362+0000 7fde31513640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555dd2305810 0x555dd2383ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:36.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.362+0000 7fde31513640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555dd2305810 0x555dd2383ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55560/0 (socket says 172.21.15.44:55560) 2024-08-19T00:13:36.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.362+0000 7fde31513640 1 -- 172.21.15.44:0/3718933497 learned_addr learned my addr 172.21.15.44:0/3718933497 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:36.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.362+0000 7fde30d12640 1 --2- 172.21.15.44:0/3718933497 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555dd22fa630 0x555dd2318fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:36.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.362+0000 7fde2bfff640 1 --2- 172.21.15.44:0/3718933497 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555dd22faf50 0x555dd2319520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:36.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.362+0000 7fde31513640 1 -- 172.21.15.44:0/3718933497 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555dd22faf50 msgr2=0x555dd2319520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:36.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.362+0000 7fde31513640 1 --2- 172.21.15.44:0/3718933497 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555dd22faf50 0x555dd2319520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:36.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.362+0000 7fde31513640 1 -- 172.21.15.44:0/3718933497 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555dd22fa630 msgr2=0x555dd2318fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:36.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.362+0000 7fde31513640 1 --2- 172.21.15.44:0/3718933497 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555dd22fa630 0x555dd2318fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:36.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.362+0000 7fde31513640 1 -- 172.21.15.44:0/3718933497 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555dd2384410 con 0x555dd2305810 2024-08-19T00:13:36.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.363+0000 7fde31513640 1 --2- 172.21.15.44:0/3718933497 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555dd2305810 0x555dd2383ed0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fde2409b5d0 tx=0x7fde24099b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b561416f32bfe87 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:36.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.363+0000 7fde0bfff640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:13:36.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.363+0000 7fde0bfff640 1 -- 172.21.15.44:0/3718933497 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde240b8020 con 0x555dd2305810 2024-08-19T00:13:36.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.363+0000 7fde0bfff640 1 -- 172.21.15.44:0/3718933497 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7fde240cf510 con 0x555dd2305810 2024-08-19T00:13:36.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.363+0000 7fde35374740 1 -- 172.21.15.44:0/3718933497 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde2409f9f0 con 0x555dd2305810 2024-08-19T00:13:36.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.363+0000 7fde0bfff640 1 -- 172.21.15.44:0/3718933497 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fde24020070 con 0x555dd2305810 2024-08-19T00:13:36.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.363+0000 7fde35374740 10 client.15486 fetch_fsmap learned FSMap version 28 2024-08-19T00:13:36.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.363+0000 7fde35374740 1 -- 172.21.15.44:0/3718933497 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555dd2385680 con 0x555dd2305810 2024-08-19T00:13:36.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.363+0000 7fde0bfff640 1 -- 172.21.15.44:0/3718933497 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde2409f9f0 con 0x555dd2305810 2024-08-19T00:13:36.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.363+0000 7fde0bfff640 1 -- 172.21.15.44:0/3718933497 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fde24084b80 con 0x555dd2305810 2024-08-19T00:13:36.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.363+0000 7fde35374740 10 client.15486 fetch_fsmap finished waiting for FSMap version 28 2024-08-19T00:13:36.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.363+0000 7fde35374740 10 client.15486 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-19T00:13:36.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.363+0000 7fde35374740 20 client.15486 populate_metadata read hostname 'smithi044' 2024-08-19T00:13:36.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.363+0000 7fde35374740 1 --2- 172.21.15.44:0/3718933497 >> [v2:172.21.15.171:6836/316231795,v1:172.21.15.171:6837/316231795] conn(0x555dd2389cd0 0x555dd23889e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:36.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.364+0000 7fde35374740 4 client.15486 mds_command: new command op to 24418 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-19T00:13:36.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.364+0000 7fde35374740 1 -- 172.21.15.44:0/3718933497 --> [v2:172.21.15.171:6836/316231795,v1:172.21.15.171:6837/316231795] -- command(tid 0: {"prefix": "status"}) -- 0x555dd2267190 con 0x555dd2389cd0 2024-08-19T00:13:36.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.364+0000 7fde30d12640 1 --2- 172.21.15.44:0/3718933497 >> [v2:172.21.15.171:6836/316231795,v1:172.21.15.171:6837/316231795] conn(0x555dd2389cd0 0x555dd23889e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:36.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.364+0000 7fde30d12640 1 --2- 172.21.15.44:0/3718933497 >> [v2:172.21.15.171:6836/316231795,v1:172.21.15.171:6837/316231795] conn(0x555dd2389cd0 0x555dd23889e0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6c15f4d8faa588d7 server_cookie=7da531d05a3fe0e5 in_seq=0 out_seq=0 2024-08-19T00:13:36.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.364+0000 7fde0bfff640 10 client.15486 ms_handle_connect on v2:172.21.15.171:6836/316231795 2024-08-19T00:13:36.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.365+0000 7fde0bfff640 1 -- 172.21.15.44:0/3718933497 <== mds.4 v2:172.21.15.171:6836/316231795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x555dd2267190 con 0x555dd2389cd0 2024-08-19T00:13:36.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.365+0000 7fde0bfff640 10 client.15486 handle_command_reply: tid=0 2024-08-19T00:13:36.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.365+0000 7fde35374740 1 client.15486 shutdown 2024-08-19T00:13:36.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.365+0000 7fde35374740 1 -- 172.21.15.44:0/3718933497 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555dd2305810 msgr2=0x555dd2383ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:36.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.365+0000 7fde35374740 1 --2- 172.21.15.44:0/3718933497 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555dd2305810 0x555dd2383ed0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fde2409b5d0 tx=0x7fde24099b50 comp rx=0 tx=0).stop 2024-08-19T00:13:36.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.365+0000 7fde35374740 1 -- 172.21.15.44:0/3718933497 shutdown_connections 2024-08-19T00:13:36.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.365+0000 7fde35374740 1 --2- 172.21.15.44:0/3718933497 >> [v2:172.21.15.171:6836/316231795,v1:172.21.15.171:6837/316231795] conn(0x555dd2389cd0 0x555dd23889e0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:36.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.365+0000 7fde0bfff640 0 client.15486 ms_handle_reset on v2:172.21.15.171:6836/316231795 2024-08-19T00:13:36.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.365+0000 7fde35374740 1 --2- 172.21.15.44:0/3718933497 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555dd22faf50 0x555dd2319520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:36.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.365+0000 7fde35374740 1 --2- 172.21.15.44:0/3718933497 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555dd2305810 0x555dd2383ed0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:36.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.365+0000 7fde35374740 1 --2- 172.21.15.44:0/3718933497 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555dd22fa630 0x555dd2318fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:36.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.365+0000 7fde35374740 1 -- 172.21.15.44:0/3718933497 >> 172.21.15.44:0/3718933497 conn(0x555dd22f6bc0 msgr2=0x555dd23107e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:36.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.365+0000 7fde35374740 1 -- 172.21.15.44:0/3718933497 shutdown_connections 2024-08-19T00:13:36.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.365+0000 7fde35374740 1 -- 172.21.15.44:0/3718933497 wait complete. 2024-08-19T00:13:36.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.365+0000 7fde35374740 20 client.15486 trim_cache size 0 max 16384 2024-08-19T00:13:36.383 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-08-19T00:13:36.383 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "647ded64-5dbe-11ef-bccf-c7b262605968", 2024-08-19T00:13:36.383 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 4, 2024-08-19T00:13:36.383 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 24418, 2024-08-19T00:13:36.383 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-08-19T00:13:36.383 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-08-19T00:13:36.383 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-08-19T00:13:36.383 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 120.474122912, 2024-08-19T00:13:36.383 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 28, 2024-08-19T00:13:36.384 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 95, 2024-08-19T00:13:36.384 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 94, 2024-08-19T00:13:36.384 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 189.03762155699999 2024-08-19T00:13:36.384 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-08-19T00:13:36.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.366+0000 7fde32f76640 1 -- 172.21.15.44:0/2490387695 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fde1c0a2e10 msgr2=0x7fde1c0a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:36.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.366+0000 7fde32f76640 1 --2- 172.21.15.44:0/2490387695 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fde1c0a2e10 0x7fde1c0a52d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x555dd22f7a20 tx=0x7fde2000a2d0 comp rx=0 tx=0).stop 2024-08-19T00:13:36.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.366+0000 7fde32f76640 1 -- 172.21.15.44:0/2490387695 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde2c1067a0 msgr2=0x7fde2c1a4050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:36.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.366+0000 7fde32f76640 1 --2- 172.21.15.44:0/2490387695 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde2c1067a0 0x7fde2c1a4050 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fde24009fd0 tx=0x7fde2400def0 comp rx=0 tx=0).stop 2024-08-19T00:13:36.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.366+0000 7fde32f76640 1 -- 172.21.15.44:0/2490387695 shutdown_connections 2024-08-19T00:13:36.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.366+0000 7fde32f76640 1 --2- 172.21.15.44:0/2490387695 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fde1c0a2e10 0x7fde1c0a52d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:36.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.366+0000 7fde32f76640 1 --2- 172.21.15.44:0/2490387695 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde2c1067a0 0x7fde2c1a4050 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:36.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.366+0000 7fde32f76640 1 --2- 172.21.15.44:0/2490387695 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde2c101140 0x7fde2c199510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:36.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.366+0000 7fde32f76640 1 --2- 172.21.15.44:0/2490387695 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde2c1007a0 0x7fde2c198fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:36.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.366+0000 7fde32f76640 1 -- 172.21.15.44:0/2490387695 >> 172.21.15.44:0/2490387695 conn(0x7fde2c0fc4c0 msgr2=0x7fde2c0fccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:36.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.366+0000 7fde32f76640 1 -- 172.21.15.44:0/2490387695 shutdown_connections 2024-08-19T00:13:36.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:36.366+0000 7fde32f76640 1 -- 172.21.15.44:0/2490387695 wait complete. 2024-08-19T00:13:37.073 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph tell mds.e status 2024-08-19T00:13:37.332 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:13:37.723 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:37 smithi044 ceph-mon[18489]: pgmap v12: 129 pgs: 129 active+clean; 1.3 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 78 KiB/s wr, 55 op/s 2024-08-19T00:13:37.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.804+0000 7fad362a5640 1 -- 172.21.15.44:0/3550861028 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad301018b0 msgr2=0x7fad30101d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:37.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.804+0000 7fad362a5640 1 --2- 172.21.15.44:0/3550861028 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad301018b0 0x7fad30101d10 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fad24009930 tx=0x7fad2402a420 comp rx=0 tx=0).stop 2024-08-19T00:13:37.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.804+0000 7fad362a5640 1 -- 172.21.15.44:0/3550861028 shutdown_connections 2024-08-19T00:13:37.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.804+0000 7fad362a5640 1 --2- 172.21.15.44:0/3550861028 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fad30102250 0x7fad3010e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:37.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.804+0000 7fad362a5640 1 --2- 172.21.15.44:0/3550861028 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad301018b0 0x7fad30101d10 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:37.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.804+0000 7fad362a5640 1 --2- 172.21.15.44:0/3550861028 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad301078b0 0x7fad30107c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:37.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.804+0000 7fad362a5640 1 -- 172.21.15.44:0/3550861028 >> 172.21.15.44:0/3550861028 conn(0x7fad300fd5f0 msgr2=0x7fad300ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:37.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.804+0000 7fad362a5640 1 -- 172.21.15.44:0/3550861028 shutdown_connections 2024-08-19T00:13:37.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.804+0000 7fad362a5640 1 -- 172.21.15.44:0/3550861028 wait complete. 2024-08-19T00:13:37.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.805+0000 7fad362a5640 1 Processor -- start 2024-08-19T00:13:37.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.805+0000 7fad362a5640 1 -- start start 2024-08-19T00:13:37.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.805+0000 7fad362a5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad301018b0 0x7fad30198130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:37.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.805+0000 7fad362a5640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fad30102250 0x7fad30198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:37.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.805+0000 7fad362a5640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad301078b0 0x7fad3019ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:37.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.805+0000 7fad362a5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fad30111cb0 con 0x7fad301018b0 2024-08-19T00:13:37.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.805+0000 7fad362a5640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fad30111b30 con 0x7fad301078b0 2024-08-19T00:13:37.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.805+0000 7fad362a5640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fad30111e30 con 0x7fad30102250 2024-08-19T00:13:37.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.805+0000 7fad2ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad301018b0 0x7fad30198130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:37.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.805+0000 7fad2ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad301018b0 0x7fad30198130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55580/0 (socket says 172.21.15.44:55580) 2024-08-19T00:13:37.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.805+0000 7fad2ffff640 1 -- 172.21.15.44:0/4217493308 learned_addr learned my addr 172.21.15.44:0/4217493308 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:37.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.806+0000 7fad2f7fe640 1 --2- 172.21.15.44:0/4217493308 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fad30102250 0x7fad30198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:37.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.806+0000 7fad34842640 1 --2- 172.21.15.44:0/4217493308 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad301078b0 0x7fad3019ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:37.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.806+0000 7fad2ffff640 1 -- 172.21.15.44:0/4217493308 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fad30102250 msgr2=0x7fad30198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:37.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.806+0000 7fad2ffff640 1 --2- 172.21.15.44:0/4217493308 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fad30102250 0x7fad30198670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:37.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.806+0000 7fad2ffff640 1 -- 172.21.15.44:0/4217493308 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad301078b0 msgr2=0x7fad3019ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:37.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.806+0000 7fad2ffff640 1 --2- 172.21.15.44:0/4217493308 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad301078b0 0x7fad3019ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:37.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.806+0000 7fad2ffff640 1 -- 172.21.15.44:0/4217493308 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad3019d0e0 con 0x7fad301018b0 2024-08-19T00:13:37.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.806+0000 7fad2f7fe640 1 --2- 172.21.15.44:0/4217493308 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fad30102250 0x7fad30198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:13:37.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.806+0000 7fad34842640 1 --2- 172.21.15.44:0/4217493308 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad301078b0 0x7fad3019ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:13:37.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.806+0000 7fad2ffff640 1 --2- 172.21.15.44:0/4217493308 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad301018b0 0x7fad30198130 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fad2000c920 tx=0x7fad2000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:37.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.806+0000 7fad2d7fa640 1 -- 172.21.15.44:0/4217493308 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad20007c70 con 0x7fad301018b0 2024-08-19T00:13:37.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.806+0000 7fad362a5640 1 -- 172.21.15.44:0/4217493308 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad3019d3d0 con 0x7fad301018b0 2024-08-19T00:13:37.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.806+0000 7fad2d7fa640 1 -- 172.21.15.44:0/4217493308 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad20007e10 con 0x7fad301018b0 2024-08-19T00:13:37.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.806+0000 7fad2d7fa640 1 -- 172.21.15.44:0/4217493308 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad20018890 con 0x7fad301018b0 2024-08-19T00:13:37.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.806+0000 7fad362a5640 1 -- 172.21.15.44:0/4217493308 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad301a4cb0 con 0x7fad301018b0 2024-08-19T00:13:37.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.809+0000 7fad386a3740 1 Processor -- start 2024-08-19T00:13:37.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.809+0000 7fad2d7fa640 1 -- 172.21.15.44:0/4217493308 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 24) ==== 138060+0+0 (secure 0 0 0) 0x7fad20018a70 con 0x7fad301018b0 2024-08-19T00:13:37.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.809+0000 7fad386a3740 1 -- start start 2024-08-19T00:13:37.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.809+0000 7fad386a3740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560516c0b530 0x560516c0b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:37.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.809+0000 7fad386a3740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560516c0be50 0x560516c1a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:37.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.809+0000 7fad386a3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560516c1ac20 0x560516c1d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:37.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.809+0000 7fad386a3740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x560516b70710 con 0x560516c1ac20 2024-08-19T00:13:37.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.809+0000 7fad386a3740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x560516b08770 con 0x560516c0b530 2024-08-19T00:13:37.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.809+0000 7fad386a3740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x560516b6c6d0 con 0x560516c0be50 2024-08-19T00:13:37.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.809+0000 7fad2f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560516c1ac20 0x560516c1d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:37.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.809+0000 7fad2f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560516c1ac20 0x560516c1d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55592/0 (socket says 172.21.15.44:55592) 2024-08-19T00:13:37.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.809+0000 7fad2f7fe640 1 -- 172.21.15.44:0/4171149671 learned_addr learned my addr 172.21.15.44:0/4171149671 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:37.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.809+0000 7fad2ffff640 1 --2- 172.21.15.44:0/4171149671 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560516c0be50 0x560516c1a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:37.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.809+0000 7fad34842640 1 --2- 172.21.15.44:0/4171149671 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560516c0b530 0x560516c0b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:37.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.809+0000 7fad2f7fe640 1 -- 172.21.15.44:0/4171149671 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560516c0be50 msgr2=0x560516c1a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:37.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.809+0000 7fad2f7fe640 1 --2- 172.21.15.44:0/4171149671 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560516c0be50 0x560516c1a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:37.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.809+0000 7fad2f7fe640 1 -- 172.21.15.44:0/4171149671 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560516c0b530 msgr2=0x560516c0b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:37.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.809+0000 7fad2f7fe640 1 --2- 172.21.15.44:0/4171149671 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560516c0b530 0x560516c0b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:37.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.809+0000 7fad2f7fe640 1 -- 172.21.15.44:0/4171149671 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560516b0f3e0 con 0x560516c1ac20 2024-08-19T00:13:37.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.809+0000 7fad2d7fa640 1 --2- 172.21.15.44:0/4217493308 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fad180a2e10 0x7fad180a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:37.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.810+0000 7fad34842640 1 --2- 172.21.15.44:0/4217493308 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fad180a2e10 0x7fad180a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:37.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.810+0000 7fad2f7fe640 1 --2- 172.21.15.44:0/4171149671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560516c1ac20 0x560516c1d010 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fad24009930 tx=0x7fad24032d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b1a4977a933bd45 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:37.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.810+0000 7fad2d7fa640 1 -- 172.21.15.44:0/4217493308 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7fad200cfc20 con 0x7fad301018b0 2024-08-19T00:13:37.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.810+0000 7fad167fc640 1 -- 172.21.15.44:0/4171149671 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad2403f070 con 0x560516c1ac20 2024-08-19T00:13:37.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.810+0000 7fad167fc640 1 -- 172.21.15.44:0/4171149671 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad240317b0 con 0x560516c1ac20 2024-08-19T00:13:37.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.810+0000 7fad167fc640 1 -- 172.21.15.44:0/4171149671 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad24035070 con 0x560516c1ac20 2024-08-19T00:13:37.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.811+0000 7fad386a3740 1 -- 172.21.15.44:0/4171149671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560516c1ac20 msgr2=0x560516c1d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:37.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.811+0000 7fad34842640 1 --2- 172.21.15.44:0/4217493308 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fad180a2e10 0x7fad180a52d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fad28005fd0 tx=0x7fad28009580 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:37.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.811+0000 7fad386a3740 1 --2- 172.21.15.44:0/4171149671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560516c1ac20 0x560516c1d010 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fad24009930 tx=0x7fad24032d60 comp rx=0 tx=0).stop 2024-08-19T00:13:37.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.811+0000 7fad386a3740 1 -- 172.21.15.44:0/4171149671 shutdown_connections 2024-08-19T00:13:37.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.811+0000 7fad386a3740 1 --2- 172.21.15.44:0/4171149671 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560516c0be50 0x560516c1a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:37.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.811+0000 7fad386a3740 1 --2- 172.21.15.44:0/4171149671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560516c1ac20 0x560516c1d010 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:37.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.811+0000 7fad386a3740 1 --2- 172.21.15.44:0/4171149671 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560516c0b530 0x560516c0b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:37.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.811+0000 7fad386a3740 1 -- 172.21.15.44:0/4171149671 >> 172.21.15.44:0/4171149671 conn(0x560516c07bc0 msgr2=0x560516c07fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:37.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.811+0000 7fad386a3740 1 -- 172.21.15.44:0/4171149671 shutdown_connections 2024-08-19T00:13:37.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.811+0000 7fad386a3740 1 -- 172.21.15.44:0/4171149671 wait complete. 2024-08-19T00:13:37.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.811+0000 7fad386a3740 1 -- start start 2024-08-19T00:13:37.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.811+0000 7fad386a3740 1 Processor -- start 2024-08-19T00:13:37.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.812+0000 7fad386a3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560516c0b530 0x560516c17b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:37.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.812+0000 7fad386a3740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560516c0be50 0x560516c180a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:37.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.812+0000 7fad386a3740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560516c1ac20 0x560516c185e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:37.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.812+0000 7fad386a3740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x560516c1d7f0 con 0x560516c0b530 2024-08-19T00:13:37.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.812+0000 7fad386a3740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x560516b2b970 con 0x560516c1ac20 2024-08-19T00:13:37.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.812+0000 7fad386a3740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x560516c1d970 con 0x560516c0be50 2024-08-19T00:13:37.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.812+0000 7fad386a3740 10 client.0 _ll_register_callbacks cb 0x56051687f7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:13:37.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.812+0000 7fad2ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560516c0b530 0x560516c17b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:37.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.812+0000 7fad2ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560516c0b530 0x560516c17b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55596/0 (socket says 172.21.15.44:55596) 2024-08-19T00:13:37.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.812+0000 7fad2ffff640 1 -- 172.21.15.44:0/122923157 learned_addr learned my addr 172.21.15.44:0/122923157 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:37.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.812+0000 7fad2f7fe640 1 --2- 172.21.15.44:0/122923157 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560516c0be50 0x560516c180a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:37.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.812+0000 7fad34842640 1 --2- 172.21.15.44:0/122923157 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560516c1ac20 0x560516c185e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:37.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.812+0000 7fad2ffff640 1 -- 172.21.15.44:0/122923157 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560516c0be50 msgr2=0x560516c180a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:37.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.812+0000 7fad2ffff640 1 --2- 172.21.15.44:0/122923157 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560516c0be50 0x560516c180a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:37.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.812+0000 7fad2ffff640 1 -- 172.21.15.44:0/122923157 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560516c1ac20 msgr2=0x560516c185e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:37.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.812+0000 7fad2ffff640 1 --2- 172.21.15.44:0/122923157 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560516c1ac20 0x560516c185e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:37.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.812+0000 7fad2ffff640 1 -- 172.21.15.44:0/122923157 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605168e22b0 con 0x560516c0b530 2024-08-19T00:13:37.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.812+0000 7fad2f7fe640 1 --2- 172.21.15.44:0/122923157 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560516c0be50 0x560516c180a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:13:37.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.812+0000 7fad34842640 1 --2- 172.21.15.44:0/122923157 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560516c1ac20 0x560516c185e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:13:37.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.812+0000 7fad2ffff640 1 --2- 172.21.15.44:0/122923157 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560516c0b530 0x560516c17b60 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fad20097fb0 tx=0x7fad2009b9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1c81bcbaa13de76 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:37.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.812+0000 7fad0f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:13:37.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.812+0000 7fad0f7fe640 1 -- 172.21.15.44:0/122923157 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad200a4530 con 0x560516c0b530 2024-08-19T00:13:37.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.812+0000 7fad386a3740 1 -- 172.21.15.44:0/122923157 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad240317b0 con 0x560516c0b530 2024-08-19T00:13:37.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.812+0000 7fad0f7fe640 1 -- 172.21.15.44:0/122923157 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7fad200cd130 con 0x560516c0b530 2024-08-19T00:13:37.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.813+0000 7fad0f7fe640 1 -- 172.21.15.44:0/122923157 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fad200b9050 con 0x560516c0b530 2024-08-19T00:13:37.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.813+0000 7fad386a3740 10 client.15498 fetch_fsmap learned FSMap version 28 2024-08-19T00:13:37.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.813+0000 7fad386a3740 1 -- 172.21.15.44:0/122923157 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560516c29540 con 0x560516c0b530 2024-08-19T00:13:37.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.813+0000 7fad0f7fe640 1 -- 172.21.15.44:0/122923157 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad240317b0 con 0x560516c0b530 2024-08-19T00:13:37.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.813+0000 7fad0f7fe640 1 -- 172.21.15.44:0/122923157 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fad200d5070 con 0x560516c0b530 2024-08-19T00:13:37.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.813+0000 7fad386a3740 10 client.15498 fetch_fsmap finished waiting for FSMap version 28 2024-08-19T00:13:37.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.813+0000 7fad386a3740 10 client.15498 resolve_mds: resolved name 'e' to daemon mds.e 2024-08-19T00:13:37.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.813+0000 7fad386a3740 20 client.15498 populate_metadata read hostname 'smithi044' 2024-08-19T00:13:37.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.813+0000 7fad386a3740 1 --2- 172.21.15.44:0/122923157 >> [v2:172.21.15.116:6834/3507399322,v1:172.21.15.116:6835/3507399322] conn(0x560516c2bb70 0x560516c2cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:37.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.813+0000 7fad386a3740 4 client.15498 mds_command: new command op to 24431 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:13:37.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.813+0000 7fad386a3740 1 -- 172.21.15.44:0/122923157 --> [v2:172.21.15.116:6834/3507399322,v1:172.21.15.116:6835/3507399322] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560516b7dc80 con 0x560516c2bb70 2024-08-19T00:13:37.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.813+0000 7fad2f7fe640 1 --2- 172.21.15.44:0/122923157 >> [v2:172.21.15.116:6834/3507399322,v1:172.21.15.116:6835/3507399322] conn(0x560516c2bb70 0x560516c2cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:37.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.814+0000 7fad2f7fe640 1 --2- 172.21.15.44:0/122923157 >> [v2:172.21.15.116:6834/3507399322,v1:172.21.15.116:6835/3507399322] conn(0x560516c2bb70 0x560516c2cfe0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=62af3fc9344df892 server_cookie=fcf953f1360aadef in_seq=0 out_seq=0 2024-08-19T00:13:37.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.814+0000 7fad0f7fe640 10 client.15498 ms_handle_connect on v2:172.21.15.116:6834/3507399322 2024-08-19T00:13:37.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.814+0000 7fad0f7fe640 1 -- 172.21.15.44:0/122923157 <== mds.3 v2:172.21.15.116:6834/3507399322 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560516b7dc80 con 0x560516c2bb70 2024-08-19T00:13:37.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.814+0000 7fad0f7fe640 10 client.15498 handle_command_reply: tid=0 2024-08-19T00:13:37.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.814+0000 7fad386a3740 1 client.15498 shutdown 2024-08-19T00:13:37.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.815+0000 7fad386a3740 1 -- 172.21.15.44:0/122923157 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560516c0b530 msgr2=0x560516c17b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:37.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.815+0000 7fad386a3740 1 --2- 172.21.15.44:0/122923157 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560516c0b530 0x560516c17b60 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fad20097fb0 tx=0x7fad2009b9e0 comp rx=0 tx=0).stop 2024-08-19T00:13:37.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.815+0000 7fad386a3740 1 -- 172.21.15.44:0/122923157 shutdown_connections 2024-08-19T00:13:37.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.815+0000 7fad386a3740 1 --2- 172.21.15.44:0/122923157 >> [v2:172.21.15.116:6834/3507399322,v1:172.21.15.116:6835/3507399322] conn(0x560516c2bb70 0x560516c2cfe0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:37.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.815+0000 7fad386a3740 1 --2- 172.21.15.44:0/122923157 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560516c0be50 0x560516c180a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:37.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.815+0000 7fad386a3740 1 --2- 172.21.15.44:0/122923157 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560516c1ac20 0x560516c185e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:37.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.815+0000 7fad386a3740 1 --2- 172.21.15.44:0/122923157 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560516c0b530 0x560516c17b60 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:37.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.815+0000 7fad0f7fe640 0 client.15498 ms_handle_reset on v2:172.21.15.116:6834/3507399322 2024-08-19T00:13:37.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.815+0000 7fad386a3740 1 -- 172.21.15.44:0/122923157 >> 172.21.15.44:0/122923157 conn(0x560516c07bc0 msgr2=0x560516c0d920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:37.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.815+0000 7fad386a3740 1 -- 172.21.15.44:0/122923157 shutdown_connections 2024-08-19T00:13:37.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.815+0000 7fad386a3740 1 -- 172.21.15.44:0/122923157 wait complete. 2024-08-19T00:13:37.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.815+0000 7fad386a3740 20 client.15498 trim_cache size 0 max 16384 2024-08-19T00:13:37.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.833+0000 7fad386a3740 1 Processor -- start 2024-08-19T00:13:37.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.833+0000 7fad386a3740 1 -- start start 2024-08-19T00:13:37.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.833+0000 7fad386a3740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560516c0b530 0x560516c1a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:37.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.833+0000 7fad386a3740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560516c0be50 0x560516c2cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:37.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.833+0000 7fad386a3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560516c1ac20 0x560516c16430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:37.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.833+0000 7fad386a3740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x560516c2b320 con 0x560516c1ac20 2024-08-19T00:13:37.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.833+0000 7fad386a3740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x560516c2b9f0 con 0x560516c0be50 2024-08-19T00:13:37.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.833+0000 7fad386a3740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x560516c2c0c0 con 0x560516c0b530 2024-08-19T00:13:37.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.833+0000 7fad34842640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560516c1ac20 0x560516c16430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:37.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.833+0000 7fad34842640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560516c1ac20 0x560516c16430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55604/0 (socket says 172.21.15.44:55604) 2024-08-19T00:13:37.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.833+0000 7fad34842640 1 -- 172.21.15.44:0/2445994643 learned_addr learned my addr 172.21.15.44:0/2445994643 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:37.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.833+0000 7fad2f7fe640 1 --2- 172.21.15.44:0/2445994643 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560516c0be50 0x560516c2cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:37.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.833+0000 7fad2ffff640 1 --2- 172.21.15.44:0/2445994643 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560516c0b530 0x560516c1a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:37.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.833+0000 7fad34842640 1 -- 172.21.15.44:0/2445994643 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560516c0b530 msgr2=0x560516c1a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:37.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.833+0000 7fad34842640 1 --2- 172.21.15.44:0/2445994643 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560516c0b530 0x560516c1a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:37.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.833+0000 7fad34842640 1 -- 172.21.15.44:0/2445994643 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560516c0be50 msgr2=0x560516c2cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:37.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.833+0000 7fad34842640 1 --2- 172.21.15.44:0/2445994643 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560516c0be50 0x560516c2cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:37.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.833+0000 7fad34842640 1 -- 172.21.15.44:0/2445994643 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560516c079f0 con 0x560516c1ac20 2024-08-19T00:13:37.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.833+0000 7fad2ffff640 1 --2- 172.21.15.44:0/2445994643 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560516c0b530 0x560516c1a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:13:37.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.834+0000 7fad34842640 1 --2- 172.21.15.44:0/2445994643 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560516c1ac20 0x560516c16430 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fad2801e5d0 tx=0x7fad28015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c83375f03455603 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:37.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.834+0000 7fad15ffb640 1 -- 172.21.15.44:0/2445994643 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad280107e0 con 0x560516c1ac20 2024-08-19T00:13:37.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.834+0000 7fad15ffb640 1 -- 172.21.15.44:0/2445994643 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad28010e60 con 0x560516c1ac20 2024-08-19T00:13:37.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.834+0000 7fad15ffb640 1 -- 172.21.15.44:0/2445994643 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad2801c400 con 0x560516c1ac20 2024-08-19T00:13:37.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.835+0000 7fad386a3740 1 -- 172.21.15.44:0/2445994643 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560516c1ac20 msgr2=0x560516c16430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:37.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.835+0000 7fad386a3740 1 --2- 172.21.15.44:0/2445994643 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560516c1ac20 0x560516c16430 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fad2801e5d0 tx=0x7fad28015000 comp rx=0 tx=0).stop 2024-08-19T00:13:37.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.835+0000 7fad386a3740 1 -- 172.21.15.44:0/2445994643 shutdown_connections 2024-08-19T00:13:37.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.835+0000 7fad386a3740 1 --2- 172.21.15.44:0/2445994643 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560516c1ac20 0x560516c16430 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:37.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.835+0000 7fad386a3740 1 --2- 172.21.15.44:0/2445994643 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560516c0be50 0x560516c2cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:37.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.835+0000 7fad386a3740 1 --2- 172.21.15.44:0/2445994643 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560516c0b530 0x560516c1a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:37.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.835+0000 7fad386a3740 1 -- 172.21.15.44:0/2445994643 >> 172.21.15.44:0/2445994643 conn(0x560516c07bc0 msgr2=0x560516c12e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:37.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.835+0000 7fad386a3740 1 -- 172.21.15.44:0/2445994643 shutdown_connections 2024-08-19T00:13:37.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.835+0000 7fad386a3740 1 -- 172.21.15.44:0/2445994643 wait complete. 2024-08-19T00:13:37.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.835+0000 7fad386a3740 1 -- start start 2024-08-19T00:13:37.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.835+0000 7fad386a3740 1 Processor -- start 2024-08-19T00:13:37.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.835+0000 7fad386a3740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560516c0b530 0x560516c35b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:37.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.835+0000 7fad386a3740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560516c0be50 0x560516c2ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:37.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.835+0000 7fad386a3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560516c1ac20 0x560516c2f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:37.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.835+0000 7fad386a3740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x560516c2ce60 con 0x560516c1ac20 2024-08-19T00:13:37.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.835+0000 7fad386a3740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x560516c2c790 con 0x560516c0be50 2024-08-19T00:13:37.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.836+0000 7fad386a3740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x560516c2d530 con 0x560516c0b530 2024-08-19T00:13:37.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.836+0000 7fad386a3740 10 client.0 _ll_register_callbacks cb 0x7fad2000a560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:13:37.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.836+0000 7fad34842640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560516c1ac20 0x560516c2f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:37.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.836+0000 7fad34842640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560516c1ac20 0x560516c2f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55610/0 (socket says 172.21.15.44:55610) 2024-08-19T00:13:37.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.836+0000 7fad34842640 1 -- 172.21.15.44:0/1557211757 learned_addr learned my addr 172.21.15.44:0/1557211757 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:37.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.836+0000 7fad2ffff640 1 --2- 172.21.15.44:0/1557211757 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560516c0b530 0x560516c35b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:37.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.836+0000 7fad2f7fe640 1 --2- 172.21.15.44:0/1557211757 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560516c0be50 0x560516c2ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:37.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.836+0000 7fad34842640 1 -- 172.21.15.44:0/1557211757 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560516c0b530 msgr2=0x560516c35b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:37.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.836+0000 7fad34842640 1 --2- 172.21.15.44:0/1557211757 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560516c0b530 0x560516c35b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:37.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.836+0000 7fad34842640 1 -- 172.21.15.44:0/1557211757 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560516c0be50 msgr2=0x560516c2ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:37.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.836+0000 7fad34842640 1 --2- 172.21.15.44:0/1557211757 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560516c0be50 0x560516c2ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:37.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.836+0000 7fad34842640 1 -- 172.21.15.44:0/1557211757 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560516c1d960 con 0x560516c1ac20 2024-08-19T00:13:37.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.836+0000 7fad2f7fe640 1 --2- 172.21.15.44:0/1557211757 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560516c0be50 0x560516c2ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:13:37.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.836+0000 7fad34842640 1 --2- 172.21.15.44:0/1557211757 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560516c1ac20 0x560516c2f460 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fad28012c50 tx=0x7fad28004d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91b7cee4ae031c90 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:37.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.836+0000 7fad0f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:13:37.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.836+0000 7fad0f7fe640 1 -- 172.21.15.44:0/1557211757 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad28039060 con 0x560516c1ac20 2024-08-19T00:13:37.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.836+0000 7fad0f7fe640 1 -- 172.21.15.44:0/1557211757 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7fad28029710 con 0x560516c1ac20 2024-08-19T00:13:37.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.836+0000 7fad386a3740 1 -- 172.21.15.44:0/1557211757 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad28010e60 con 0x560516c1ac20 2024-08-19T00:13:37.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.837+0000 7fad0f7fe640 1 -- 172.21.15.44:0/1557211757 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fad28040050 con 0x560516c1ac20 2024-08-19T00:13:37.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.837+0000 7fad386a3740 10 client.15504 fetch_fsmap learned FSMap version 28 2024-08-19T00:13:37.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.837+0000 7fad386a3740 1 -- 172.21.15.44:0/1557211757 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560516c03130 con 0x560516c1ac20 2024-08-19T00:13:37.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.837+0000 7fad0f7fe640 1 -- 172.21.15.44:0/1557211757 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad28010e60 con 0x560516c1ac20 2024-08-19T00:13:37.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.837+0000 7fad0f7fe640 1 -- 172.21.15.44:0/1557211757 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fad2800f040 con 0x560516c1ac20 2024-08-19T00:13:37.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.837+0000 7fad386a3740 10 client.15504 fetch_fsmap finished waiting for FSMap version 28 2024-08-19T00:13:37.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.837+0000 7fad386a3740 10 client.15504 resolve_mds: resolved name 'e' to daemon mds.e 2024-08-19T00:13:37.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.837+0000 7fad386a3740 20 client.15504 populate_metadata read hostname 'smithi044' 2024-08-19T00:13:37.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.837+0000 7fad386a3740 1 --2- 172.21.15.44:0/1557211757 >> [v2:172.21.15.116:6834/3507399322,v1:172.21.15.116:6835/3507399322] conn(0x560516c9a7a0 0x560516c994b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:37.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.837+0000 7fad386a3740 4 client.15504 mds_command: new command op to 24431 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-19T00:13:37.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.837+0000 7fad386a3740 1 -- 172.21.15.44:0/1557211757 --> [v2:172.21.15.116:6834/3507399322,v1:172.21.15.116:6835/3507399322] -- command(tid 0: {"prefix": "status"}) -- 0x560516b78190 con 0x560516c9a7a0 2024-08-19T00:13:37.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.837+0000 7fad2ffff640 1 --2- 172.21.15.44:0/1557211757 >> [v2:172.21.15.116:6834/3507399322,v1:172.21.15.116:6835/3507399322] conn(0x560516c9a7a0 0x560516c994b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:37.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.838+0000 7fad2ffff640 1 --2- 172.21.15.44:0/1557211757 >> [v2:172.21.15.116:6834/3507399322,v1:172.21.15.116:6835/3507399322] conn(0x560516c9a7a0 0x560516c994b0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d0f752ad76d0157d server_cookie=987921670f1dc4b7 in_seq=0 out_seq=0 2024-08-19T00:13:37.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.838+0000 7fad0f7fe640 10 client.15504 ms_handle_connect on v2:172.21.15.116:6834/3507399322 2024-08-19T00:13:37.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.838+0000 7fad0f7fe640 1 -- 172.21.15.44:0/1557211757 <== mds.3 v2:172.21.15.116:6834/3507399322 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x560516b78190 con 0x560516c9a7a0 2024-08-19T00:13:37.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.838+0000 7fad0f7fe640 10 client.15504 handle_command_reply: tid=0 2024-08-19T00:13:37.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.838+0000 7fad386a3740 1 client.15504 shutdown 2024-08-19T00:13:37.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.838+0000 7fad386a3740 1 -- 172.21.15.44:0/1557211757 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560516c1ac20 msgr2=0x560516c2f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:37.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.838+0000 7fad386a3740 1 --2- 172.21.15.44:0/1557211757 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560516c1ac20 0x560516c2f460 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fad28012c50 tx=0x7fad28004d60 comp rx=0 tx=0).stop 2024-08-19T00:13:37.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.838+0000 7fad386a3740 1 -- 172.21.15.44:0/1557211757 shutdown_connections 2024-08-19T00:13:37.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.838+0000 7fad386a3740 1 --2- 172.21.15.44:0/1557211757 >> [v2:172.21.15.116:6834/3507399322,v1:172.21.15.116:6835/3507399322] conn(0x560516c9a7a0 0x560516c994b0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:37.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.838+0000 7fad386a3740 1 --2- 172.21.15.44:0/1557211757 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560516c1ac20 0x560516c2f460 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:37.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.838+0000 7fad386a3740 1 --2- 172.21.15.44:0/1557211757 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560516c0be50 0x560516c2ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:37.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.838+0000 7fad386a3740 1 --2- 172.21.15.44:0/1557211757 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560516c0b530 0x560516c35b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:37.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.838+0000 7fad0f7fe640 0 client.15504 ms_handle_reset on v2:172.21.15.116:6834/3507399322 2024-08-19T00:13:37.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.838+0000 7fad386a3740 1 -- 172.21.15.44:0/1557211757 >> 172.21.15.44:0/1557211757 conn(0x560516c07bc0 msgr2=0x560516c163f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:37.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.838+0000 7fad386a3740 1 -- 172.21.15.44:0/1557211757 shutdown_connections 2024-08-19T00:13:37.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.838+0000 7fad386a3740 1 -- 172.21.15.44:0/1557211757 wait complete. 2024-08-19T00:13:37.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.838+0000 7fad386a3740 20 client.15504 trim_cache size 0 max 16384 2024-08-19T00:13:37.847 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-08-19T00:13:37.847 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "647ded64-5dbe-11ef-bccf-c7b262605968", 2024-08-19T00:13:37.847 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 3, 2024-08-19T00:13:37.847 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 24431, 2024-08-19T00:13:37.847 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-08-19T00:13:37.847 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-08-19T00:13:37.848 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-08-19T00:13:37.848 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 122.956418289, 2024-08-19T00:13:37.848 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 28, 2024-08-19T00:13:37.848 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 95, 2024-08-19T00:13:37.848 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 94, 2024-08-19T00:13:37.848 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 195.65064902399999 2024-08-19T00:13:37.848 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-08-19T00:13:37.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.839+0000 7fad362a5640 1 -- 172.21.15.44:0/4217493308 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fad180a2e10 msgr2=0x7fad180a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:37.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.839+0000 7fad362a5640 1 --2- 172.21.15.44:0/4217493308 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fad180a2e10 0x7fad180a52d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fad28005fd0 tx=0x7fad28009580 comp rx=0 tx=0).stop 2024-08-19T00:13:37.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.839+0000 7fad362a5640 1 -- 172.21.15.44:0/4217493308 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad301018b0 msgr2=0x7fad30198130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:37.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.839+0000 7fad362a5640 1 --2- 172.21.15.44:0/4217493308 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad301018b0 0x7fad30198130 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fad2000c920 tx=0x7fad2000cde0 comp rx=0 tx=0).stop 2024-08-19T00:13:37.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.839+0000 7fad362a5640 1 -- 172.21.15.44:0/4217493308 shutdown_connections 2024-08-19T00:13:37.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.839+0000 7fad362a5640 1 --2- 172.21.15.44:0/4217493308 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fad180a2e10 0x7fad180a52d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:37.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.839+0000 7fad362a5640 1 --2- 172.21.15.44:0/4217493308 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fad30102250 0x7fad30198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:37.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.839+0000 7fad362a5640 1 --2- 172.21.15.44:0/4217493308 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad301078b0 0x7fad3019ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:37.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.839+0000 7fad362a5640 1 --2- 172.21.15.44:0/4217493308 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad301018b0 0x7fad30198130 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:37.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.839+0000 7fad362a5640 1 -- 172.21.15.44:0/4217493308 >> 172.21.15.44:0/4217493308 conn(0x7fad300fd5f0 msgr2=0x7fad300fdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:37.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.839+0000 7fad362a5640 1 -- 172.21.15.44:0/4217493308 shutdown_connections 2024-08-19T00:13:37.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:37.839+0000 7fad362a5640 1 -- 172.21.15.44:0/4217493308 wait complete. 2024-08-19T00:13:38.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:37 smithi171 ceph-mon[21810]: pgmap v12: 129 pgs: 129 active+clean; 1.3 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 78 KiB/s wr, 55 op/s 2024-08-19T00:13:38.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:37 smithi116 ceph-mon[21873]: pgmap v12: 129 pgs: 129 active+clean; 1.3 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 78 KiB/s wr, 55 op/s 2024-08-19T00:13:38.542 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph tell mds.i status 2024-08-19T00:13:38.803 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:13:39.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.279+0000 7f4f9ed83640 1 -- 172.21.15.44:0/471642281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f98102a60 msgr2=0x7f4f98102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:39.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.279+0000 7f4f9ed83640 1 --2- 172.21.15.44:0/471642281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f98102a60 0x7f4f98102e40 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f4f88009930 tx=0x7f4f8802a420 comp rx=0 tx=0).stop 2024-08-19T00:13:39.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.279+0000 7f4f9ed83640 1 -- 172.21.15.44:0/471642281 shutdown_connections 2024-08-19T00:13:39.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.279+0000 7f4f9ed83640 1 --2- 172.21.15.44:0/471642281 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4f98103410 0x7f4f981078c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:39.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.279+0000 7f4f9ed83640 1 --2- 172.21.15.44:0/471642281 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4f98107fd0 0x7f4f9810e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:39.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.279+0000 7f4f9ed83640 1 --2- 172.21.15.44:0/471642281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f98102a60 0x7f4f98102e40 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:39.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.279+0000 7f4f9ed83640 1 -- 172.21.15.44:0/471642281 >> 172.21.15.44:0/471642281 conn(0x7f4f980fc500 msgr2=0x7f4f980fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:39.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.280+0000 7f4f9ed83640 1 -- 172.21.15.44:0/471642281 shutdown_connections 2024-08-19T00:13:39.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.280+0000 7f4f9ed83640 1 -- 172.21.15.44:0/471642281 wait complete. 2024-08-19T00:13:39.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.280+0000 7f4f9ed83640 1 Processor -- start 2024-08-19T00:13:39.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.280+0000 7f4f9ed83640 1 -- start start 2024-08-19T00:13:39.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.280+0000 7f4f9ed83640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f98102a60 0x7f4f98198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:39.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.280+0000 7f4f9ed83640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4f98103410 0x7f4f98198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:39.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.280+0000 7f4f9ed83640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4f98107fd0 0x7f4f9819cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:39.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.280+0000 7f4f9ed83640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4f98111e30 con 0x7f4f98102a60 2024-08-19T00:13:39.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.280+0000 7f4f9ed83640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f4f98111cb0 con 0x7f4f98107fd0 2024-08-19T00:13:39.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.280+0000 7f4f9ed83640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4f98111fb0 con 0x7f4f98103410 2024-08-19T00:13:39.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.280+0000 7f4f9cb1f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f98102a60 0x7f4f98198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:39.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.281+0000 7f4f9cb1f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f98102a60 0x7f4f98198350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51546/0 (socket says 172.21.15.44:51546) 2024-08-19T00:13:39.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.281+0000 7f4f9cb1f640 1 -- 172.21.15.44:0/1970914943 learned_addr learned my addr 172.21.15.44:0/1970914943 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:39.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.281+0000 7f4f97fff640 1 --2- 172.21.15.44:0/1970914943 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4f98103410 0x7f4f98198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:39.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.281+0000 7f4f9d320640 1 --2- 172.21.15.44:0/1970914943 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4f98107fd0 0x7f4f9819cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:39.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.281+0000 7f4f9cb1f640 1 -- 172.21.15.44:0/1970914943 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4f98103410 msgr2=0x7f4f98198890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:39.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.281+0000 7f4f9cb1f640 1 --2- 172.21.15.44:0/1970914943 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4f98103410 0x7f4f98198890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:39.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.281+0000 7f4f9cb1f640 1 -- 172.21.15.44:0/1970914943 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4f98107fd0 msgr2=0x7f4f9819cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:39.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.281+0000 7f4f9cb1f640 1 --2- 172.21.15.44:0/1970914943 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4f98107fd0 0x7f4f9819cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:39.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.281+0000 7f4f9cb1f640 1 -- 172.21.15.44:0/1970914943 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f9819d300 con 0x7f4f98102a60 2024-08-19T00:13:39.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.281+0000 7f4f9d320640 1 --2- 172.21.15.44:0/1970914943 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4f98107fd0 0x7f4f9819cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:13:39.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.281+0000 7f4f9cb1f640 1 --2- 172.21.15.44:0/1970914943 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f98102a60 0x7f4f98198350 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f4f88009a50 tx=0x7f4f88004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:39.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.281+0000 7f4f95ffb640 1 -- 172.21.15.44:0/1970914943 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f8803f030 con 0x7f4f98102a60 2024-08-19T00:13:39.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.281+0000 7f4f9ed83640 1 -- 172.21.15.44:0/1970914943 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f9819d590 con 0x7f4f98102a60 2024-08-19T00:13:39.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.281+0000 7f4f95ffb640 1 -- 172.21.15.44:0/1970914943 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4f88003ce0 con 0x7f4f98102a60 2024-08-19T00:13:39.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.281+0000 7f4f95ffb640 1 -- 172.21.15.44:0/1970914943 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f88035070 con 0x7f4f98102a60 2024-08-19T00:13:39.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.281+0000 7f4f9ed83640 1 -- 172.21.15.44:0/1970914943 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f981a4ed0 con 0x7f4f98102a60 2024-08-19T00:13:39.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.284+0000 7f4f95ffb640 1 -- 172.21.15.44:0/1970914943 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 24) ==== 138060+0+0 (secure 0 0 0) 0x7f4f88042030 con 0x7f4f98102a60 2024-08-19T00:13:39.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.284+0000 7f4fa1181740 1 Processor -- start 2024-08-19T00:13:39.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.284+0000 7f4fa1181740 1 -- start start 2024-08-19T00:13:39.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.284+0000 7f4fa1181740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590e749f630 0x5590e749fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:39.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.284+0000 7f4fa1181740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5590e749ff50 0x5590e74aa2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:39.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.284+0000 7f4fa1181740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5590e74aa810 0x5590e74acc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:39.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.284+0000 7f4fa1181740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5590e7404710 con 0x5590e749f630 2024-08-19T00:13:39.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.284+0000 7f4fa1181740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5590e739c770 con 0x5590e74aa810 2024-08-19T00:13:39.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.284+0000 7f4fa1181740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5590e74006d0 con 0x5590e749ff50 2024-08-19T00:13:39.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.284+0000 7f4f9d320640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590e749f630 0x5590e749fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:39.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.284+0000 7f4f9d320640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590e749f630 0x5590e749fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51560/0 (socket says 172.21.15.44:51560) 2024-08-19T00:13:39.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.284+0000 7f4f9d320640 1 -- 172.21.15.44:0/3743566282 learned_addr learned my addr 172.21.15.44:0/3743566282 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:39.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.284+0000 7f4f9cb1f640 1 --2- 172.21.15.44:0/3743566282 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5590e749ff50 0x5590e74aa2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:39.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.285+0000 7f4f95ffb640 1 --2- 172.21.15.44:0/1970914943 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f4f800a2e10 0x7f4f800a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:39.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.285+0000 7f4f97fff640 1 --2- 172.21.15.44:0/3743566282 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5590e74aa810 0x5590e74acc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:39.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.285+0000 7f4f9d320640 1 -- 172.21.15.44:0/3743566282 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5590e749ff50 msgr2=0x5590e74aa2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:39.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.285+0000 7f4f9d320640 1 --2- 172.21.15.44:0/3743566282 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5590e749ff50 0x5590e74aa2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:39.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.285+0000 7f4f9d320640 1 -- 172.21.15.44:0/3743566282 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5590e74aa810 msgr2=0x5590e74acc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:39.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.285+0000 7f4f9d320640 1 --2- 172.21.15.44:0/3743566282 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5590e74aa810 0x5590e74acc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:39.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.285+0000 7f4f9d320640 1 -- 172.21.15.44:0/3743566282 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590e73a33e0 con 0x5590e749f630 2024-08-19T00:13:39.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.285+0000 7f4f9cb1f640 1 --2- 172.21.15.44:0/3743566282 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5590e749ff50 0x5590e74aa2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:13:39.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.285+0000 7f4f95ffb640 1 -- 172.21.15.44:0/1970914943 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f4f880f0040 con 0x7f4f98102a60 2024-08-19T00:13:39.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.285+0000 7f4f9d320640 1 --2- 172.21.15.44:0/1970914943 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f4f800a2e10 0x7f4f800a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:39.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.285+0000 7f4f9d320640 1 --2- 172.21.15.44:0/3743566282 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590e749f630 0x5590e749fa10 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f4f9000c370 tx=0x7f4f9000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebe6a21a35a1eda0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:39.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.285+0000 7f4f7effd640 1 -- 172.21.15.44:0/3743566282 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f9001ab30 con 0x5590e749f630 2024-08-19T00:13:39.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.285+0000 7f4f7effd640 1 -- 172.21.15.44:0/3743566282 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4f9001acd0 con 0x5590e749f630 2024-08-19T00:13:39.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.285+0000 7f4f7effd640 1 -- 172.21.15.44:0/3743566282 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f9000d330 con 0x5590e749f630 2024-08-19T00:13:39.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.285+0000 7f4f9d320640 1 --2- 172.21.15.44:0/1970914943 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f4f800a2e10 0x7f4f800a52d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4f90021000 tx=0x7f4f9001e000 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:39.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.286+0000 7f4fa1181740 1 -- 172.21.15.44:0/3743566282 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590e749f630 msgr2=0x5590e749fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:39.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.286+0000 7f4fa1181740 1 --2- 172.21.15.44:0/3743566282 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590e749f630 0x5590e749fa10 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f4f9000c370 tx=0x7f4f9000c830 comp rx=0 tx=0).stop 2024-08-19T00:13:39.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.286+0000 7f4fa1181740 1 -- 172.21.15.44:0/3743566282 shutdown_connections 2024-08-19T00:13:39.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.286+0000 7f4fa1181740 1 --2- 172.21.15.44:0/3743566282 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5590e749ff50 0x5590e74aa2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:39.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.286+0000 7f4fa1181740 1 --2- 172.21.15.44:0/3743566282 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5590e74aa810 0x5590e74acc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:39.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.286+0000 7f4fa1181740 1 --2- 172.21.15.44:0/3743566282 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590e749f630 0x5590e749fa10 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:39.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.286+0000 7f4fa1181740 1 -- 172.21.15.44:0/3743566282 >> 172.21.15.44:0/3743566282 conn(0x5590e749bbc0 msgr2=0x5590e749bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:39.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.286+0000 7f4fa1181740 1 -- 172.21.15.44:0/3743566282 shutdown_connections 2024-08-19T00:13:39.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.286+0000 7f4fa1181740 1 -- 172.21.15.44:0/3743566282 wait complete. 2024-08-19T00:13:39.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.286+0000 7f4fa1181740 1 -- start start 2024-08-19T00:13:39.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.287+0000 7f4fa1181740 1 Processor -- start 2024-08-19T00:13:39.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.287+0000 7f4fa1181740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5590e749f630 0x5590e74a7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:39.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.287+0000 7f4fa1181740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5590e749ff50 0x5590e74a7c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:39.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.287+0000 7f4fa1181740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590e74aa810 0x5590e74a8180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:39.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.287+0000 7f4fa1181740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5590e74ad3e0 con 0x5590e74aa810 2024-08-19T00:13:39.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.287+0000 7f4fa1181740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5590e73bf970 con 0x5590e749f630 2024-08-19T00:13:39.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.287+0000 7f4fa1181740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5590e74ad560 con 0x5590e749ff50 2024-08-19T00:13:39.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.287+0000 7f4fa1181740 10 client.0 _ll_register_callbacks cb 0x5590e71137b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:13:39.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.287+0000 7f4f9d320640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590e74aa810 0x5590e74a8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:39.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.287+0000 7f4f9d320640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590e74aa810 0x5590e74a8180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51566/0 (socket says 172.21.15.44:51566) 2024-08-19T00:13:39.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.287+0000 7f4f9d320640 1 -- 172.21.15.44:0/2963173889 learned_addr learned my addr 172.21.15.44:0/2963173889 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:39.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.287+0000 7f4f9cb1f640 1 --2- 172.21.15.44:0/2963173889 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5590e749f630 0x5590e74a7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:39.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.287+0000 7f4f97fff640 1 --2- 172.21.15.44:0/2963173889 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5590e749ff50 0x5590e74a7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:39.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.287+0000 7f4f9d320640 1 -- 172.21.15.44:0/2963173889 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5590e749ff50 msgr2=0x5590e74a7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:39.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.287+0000 7f4f9d320640 1 --2- 172.21.15.44:0/2963173889 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5590e749ff50 0x5590e74a7c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:39.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.287+0000 7f4f9d320640 1 -- 172.21.15.44:0/2963173889 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5590e749f630 msgr2=0x5590e74a7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:39.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.287+0000 7f4f9d320640 1 --2- 172.21.15.44:0/2963173889 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5590e749f630 0x5590e74a7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:39.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.287+0000 7f4f9d320640 1 -- 172.21.15.44:0/2963173889 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590e71762b0 con 0x5590e74aa810 2024-08-19T00:13:39.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.287+0000 7f4f97fff640 1 --2- 172.21.15.44:0/2963173889 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5590e749ff50 0x5590e74a7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:13:39.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.288+0000 7f4f9d320640 1 --2- 172.21.15.44:0/2963173889 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590e74aa810 0x5590e74a8180 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f4f9001bbe0 tx=0x7f4f9001b640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24a1911743f35e85 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:39.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.288+0000 7f4f77fff640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:13:39.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.288+0000 7f4f77fff640 1 -- 172.21.15.44:0/2963173889 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f9000d330 con 0x5590e74aa810 2024-08-19T00:13:39.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.288+0000 7f4f77fff640 1 -- 172.21.15.44:0/2963173889 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f4f9000d820 con 0x5590e74aa810 2024-08-19T00:13:39.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.288+0000 7f4fa1181740 1 -- 172.21.15.44:0/2963173889 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f9001acd0 con 0x5590e74aa810 2024-08-19T00:13:39.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.288+0000 7f4f77fff640 1 -- 172.21.15.44:0/2963173889 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4f9003c050 con 0x5590e74aa810 2024-08-19T00:13:39.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.288+0000 7f4fa1181740 10 client.15516 fetch_fsmap learned FSMap version 28 2024-08-19T00:13:39.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.288+0000 7f4fa1181740 1 -- 172.21.15.44:0/2963173889 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5590e74b8ff0 con 0x5590e74aa810 2024-08-19T00:13:39.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.288+0000 7f4f77fff640 1 -- 172.21.15.44:0/2963173889 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4f9001acd0 con 0x5590e74aa810 2024-08-19T00:13:39.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.288+0000 7f4f77fff640 1 -- 172.21.15.44:0/2963173889 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f4f90037030 con 0x5590e74aa810 2024-08-19T00:13:39.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.288+0000 7f4fa1181740 10 client.15516 fetch_fsmap finished waiting for FSMap version 28 2024-08-19T00:13:39.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.288+0000 7f4fa1181740 10 client.15516 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-19T00:13:39.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.288+0000 7f4fa1181740 20 client.15516 populate_metadata read hostname 'smithi044' 2024-08-19T00:13:39.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.289+0000 7f4fa1181740 1 --2- 172.21.15.44:0/2963173889 >> [v2:172.21.15.171:6838/1466585795,v1:172.21.15.171:6839/1466585795] conn(0x5590e74bb340 0x5590e74bc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:39.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.289+0000 7f4fa1181740 4 client.15516 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:13:39.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.289+0000 7f4fa1181740 1 -- 172.21.15.44:0/2963173889 --> [v2:172.21.15.171:6838/1466585795,v1:172.21.15.171:6839/1466585795] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5590e7411c80 con 0x5590e74bb340 2024-08-19T00:13:39.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.289+0000 7f4f9cb1f640 1 --2- 172.21.15.44:0/2963173889 >> [v2:172.21.15.171:6838/1466585795,v1:172.21.15.171:6839/1466585795] conn(0x5590e74bb340 0x5590e74bc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:39.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.289+0000 7f4f9cb1f640 1 --2- 172.21.15.44:0/2963173889 >> [v2:172.21.15.171:6838/1466585795,v1:172.21.15.171:6839/1466585795] conn(0x5590e74bb340 0x5590e74bc7b0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4486883ca69ba3e0 server_cookie=4535df3f92d15472 in_seq=0 out_seq=0 2024-08-19T00:13:39.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.289+0000 7f4f77fff640 10 client.15516 ms_handle_connect on v2:172.21.15.171:6838/1466585795 2024-08-19T00:13:39.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.290+0000 7f4f77fff640 1 -- 172.21.15.44:0/2963173889 <== mds.2 v2:172.21.15.171:6838/1466585795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5590e7411c80 con 0x5590e74bb340 2024-08-19T00:13:39.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.290+0000 7f4f77fff640 10 client.15516 handle_command_reply: tid=0 2024-08-19T00:13:39.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.290+0000 7f4fa1181740 1 client.15516 shutdown 2024-08-19T00:13:39.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.290+0000 7f4fa1181740 1 -- 172.21.15.44:0/2963173889 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590e74aa810 msgr2=0x5590e74a8180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:39.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.290+0000 7f4fa1181740 1 --2- 172.21.15.44:0/2963173889 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590e74aa810 0x5590e74a8180 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f4f9001bbe0 tx=0x7f4f9001b640 comp rx=0 tx=0).stop 2024-08-19T00:13:39.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.290+0000 7f4fa1181740 1 -- 172.21.15.44:0/2963173889 shutdown_connections 2024-08-19T00:13:39.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.290+0000 7f4fa1181740 1 --2- 172.21.15.44:0/2963173889 >> [v2:172.21.15.171:6838/1466585795,v1:172.21.15.171:6839/1466585795] conn(0x5590e74bb340 0x5590e74bc7b0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:39.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.290+0000 7f4fa1181740 1 --2- 172.21.15.44:0/2963173889 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5590e749ff50 0x5590e74a7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:39.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.290+0000 7f4f77fff640 0 client.15516 ms_handle_reset on v2:172.21.15.171:6838/1466585795 2024-08-19T00:13:39.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.290+0000 7f4fa1181740 1 --2- 172.21.15.44:0/2963173889 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590e74aa810 0x5590e74a8180 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:39.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.290+0000 7f4fa1181740 1 --2- 172.21.15.44:0/2963173889 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5590e749f630 0x5590e74a7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:39.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.290+0000 7f4fa1181740 1 -- 172.21.15.44:0/2963173889 >> 172.21.15.44:0/2963173889 conn(0x5590e749bbc0 msgr2=0x5590e749ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:39.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.291+0000 7f4fa1181740 1 -- 172.21.15.44:0/2963173889 shutdown_connections 2024-08-19T00:13:39.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.291+0000 7f4fa1181740 1 -- 172.21.15.44:0/2963173889 wait complete. 2024-08-19T00:13:39.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.291+0000 7f4fa1181740 20 client.15516 trim_cache size 0 max 16384 2024-08-19T00:13:39.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.309+0000 7f4fa1181740 1 Processor -- start 2024-08-19T00:13:39.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.309+0000 7f4fa1181740 1 -- start start 2024-08-19T00:13:39.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.309+0000 7f4fa1181740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5590e749f630 0x5590e74a9560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:39.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.309+0000 7f4fa1181740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5590e749ff50 0x5590e74a7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:39.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.309+0000 7f4fa1181740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590e74aa810 0x5590e74c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:39.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.309+0000 7f4fa1181740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5590e74baaf0 con 0x5590e74aa810 2024-08-19T00:13:39.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.309+0000 7f4fa1181740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5590e74bb1c0 con 0x5590e749ff50 2024-08-19T00:13:39.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.309+0000 7f4fa1181740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5590e74bb890 con 0x5590e749f630 2024-08-19T00:13:39.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.309+0000 7f4f9d320640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590e74aa810 0x5590e74c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:39.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.309+0000 7f4f9d320640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590e74aa810 0x5590e74c4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51580/0 (socket says 172.21.15.44:51580) 2024-08-19T00:13:39.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.309+0000 7f4f9d320640 1 -- 172.21.15.44:0/1158095227 learned_addr learned my addr 172.21.15.44:0/1158095227 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:39.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.309+0000 7f4f97fff640 1 --2- 172.21.15.44:0/1158095227 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5590e749ff50 0x5590e74a7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:39.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.309+0000 7f4f9cb1f640 1 --2- 172.21.15.44:0/1158095227 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5590e749f630 0x5590e74a9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:39.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.309+0000 7f4f9d320640 1 -- 172.21.15.44:0/1158095227 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5590e749f630 msgr2=0x5590e74a9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:39.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.309+0000 7f4f9d320640 1 --2- 172.21.15.44:0/1158095227 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5590e749f630 0x5590e74a9560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:39.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.309+0000 7f4f9d320640 1 -- 172.21.15.44:0/1158095227 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5590e749ff50 msgr2=0x5590e74a7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:39.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.309+0000 7f4f9d320640 1 --2- 172.21.15.44:0/1158095227 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5590e749ff50 0x5590e74a7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:39.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.309+0000 7f4f9d320640 1 -- 172.21.15.44:0/1158095227 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590e7497130 con 0x5590e74aa810 2024-08-19T00:13:39.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.309+0000 7f4f9d320640 1 --2- 172.21.15.44:0/1158095227 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590e74aa810 0x5590e74c4a90 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f4f90004a80 tx=0x7f4f9000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=425d18aa528969cf server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:39.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.310+0000 7f4f7e7fc640 1 -- 172.21.15.44:0/1158095227 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f9000d330 con 0x5590e74aa810 2024-08-19T00:13:39.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.310+0000 7f4f7e7fc640 1 -- 172.21.15.44:0/1158095227 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4f90045070 con 0x5590e74aa810 2024-08-19T00:13:39.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.310+0000 7f4f7e7fc640 1 -- 172.21.15.44:0/1158095227 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f9000d620 con 0x5590e74aa810 2024-08-19T00:13:39.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.310+0000 7f4fa1181740 1 -- 172.21.15.44:0/1158095227 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590e74aa810 msgr2=0x5590e74c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:39.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.310+0000 7f4fa1181740 1 --2- 172.21.15.44:0/1158095227 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590e74aa810 0x5590e74c4a90 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f4f90004a80 tx=0x7f4f9000c830 comp rx=0 tx=0).stop 2024-08-19T00:13:39.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.310+0000 7f4fa1181740 1 -- 172.21.15.44:0/1158095227 shutdown_connections 2024-08-19T00:13:39.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.310+0000 7f4fa1181740 1 --2- 172.21.15.44:0/1158095227 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590e74aa810 0x5590e74c4a90 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:39.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.310+0000 7f4fa1181740 1 --2- 172.21.15.44:0/1158095227 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5590e749ff50 0x5590e74a7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:39.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.310+0000 7f4fa1181740 1 --2- 172.21.15.44:0/1158095227 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5590e749f630 0x5590e74a9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:39.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.310+0000 7f4fa1181740 1 -- 172.21.15.44:0/1158095227 >> 172.21.15.44:0/1158095227 conn(0x5590e749bbc0 msgr2=0x5590e74a8e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:39.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.310+0000 7f4fa1181740 1 -- 172.21.15.44:0/1158095227 shutdown_connections 2024-08-19T00:13:39.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.310+0000 7f4fa1181740 1 -- 172.21.15.44:0/1158095227 wait complete. 2024-08-19T00:13:39.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.311+0000 7f4fa1181740 1 -- start start 2024-08-19T00:13:39.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.311+0000 7f4fa1181740 1 Processor -- start 2024-08-19T00:13:39.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.311+0000 7f4fa1181740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5590e749f630 0x5590e74c5270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:39.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.311+0000 7f4fa1181740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5590e749ff50 0x5590e74a4550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:39.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.311+0000 7f4fa1181740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590e74aa810 0x5590e74a4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:39.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.311+0000 7f4fa1181740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5590e74bc630 con 0x5590e74aa810 2024-08-19T00:13:39.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.311+0000 7f4fa1181740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5590e74bbf60 con 0x5590e749f630 2024-08-19T00:13:39.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.311+0000 7f4fa1181740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5590e74bcd00 con 0x5590e749ff50 2024-08-19T00:13:39.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.311+0000 7f4fa1181740 10 client.0 _ll_register_callbacks cb 0x7f4f90007ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:13:39.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.311+0000 7f4f9d320640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590e74aa810 0x5590e74a4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:39.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.311+0000 7f4f9d320640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590e74aa810 0x5590e74a4b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51588/0 (socket says 172.21.15.44:51588) 2024-08-19T00:13:39.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.311+0000 7f4f9d320640 1 -- 172.21.15.44:0/1328550430 learned_addr learned my addr 172.21.15.44:0/1328550430 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:39.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.311+0000 7f4f97fff640 1 --2- 172.21.15.44:0/1328550430 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5590e749ff50 0x5590e74a4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:39.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.311+0000 7f4f9cb1f640 1 --2- 172.21.15.44:0/1328550430 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5590e749f630 0x5590e74c5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:39.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.312+0000 7f4f9d320640 1 -- 172.21.15.44:0/1328550430 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5590e749ff50 msgr2=0x5590e74a4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:39.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.312+0000 7f4f9d320640 1 --2- 172.21.15.44:0/1328550430 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5590e749ff50 0x5590e74a4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:39.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.312+0000 7f4f9d320640 1 -- 172.21.15.44:0/1328550430 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5590e749f630 msgr2=0x5590e74c5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:39.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.312+0000 7f4f9d320640 1 --2- 172.21.15.44:0/1328550430 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5590e749f630 0x5590e74c5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:39.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.312+0000 7f4f9d320640 1 -- 172.21.15.44:0/1328550430 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590e74a5390 con 0x5590e74aa810 2024-08-19T00:13:39.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.312+0000 7f4f9cb1f640 1 --2- 172.21.15.44:0/1328550430 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5590e749f630 0x5590e74c5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:13:39.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.312+0000 7f4f9d320640 1 --2- 172.21.15.44:0/1328550430 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590e74aa810 0x5590e74a4b60 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f4f90007e90 tx=0x7f4f90007890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e525d2f117e409d9 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:39.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.312+0000 7f4f77fff640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:13:39.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.312+0000 7f4f77fff640 1 -- 172.21.15.44:0/1328550430 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f9004d070 con 0x5590e74aa810 2024-08-19T00:13:39.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.312+0000 7f4f77fff640 1 -- 172.21.15.44:0/1328550430 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f4f9000d820 con 0x5590e74aa810 2024-08-19T00:13:39.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.312+0000 7f4fa1181740 1 -- 172.21.15.44:0/1328550430 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f90045070 con 0x5590e74aa810 2024-08-19T00:13:39.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.312+0000 7f4f77fff640 1 -- 172.21.15.44:0/1328550430 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4f90059050 con 0x5590e74aa810 2024-08-19T00:13:39.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.312+0000 7f4fa1181740 10 client.15522 fetch_fsmap learned FSMap version 28 2024-08-19T00:13:39.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.312+0000 7f4fa1181740 1 -- 172.21.15.44:0/1328550430 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5590e7525b80 con 0x5590e74aa810 2024-08-19T00:13:39.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.312+0000 7f4f77fff640 1 -- 172.21.15.44:0/1328550430 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4f90045070 con 0x5590e74aa810 2024-08-19T00:13:39.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.313+0000 7f4f77fff640 1 -- 172.21.15.44:0/1328550430 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f4f90037070 con 0x5590e74aa810 2024-08-19T00:13:39.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.313+0000 7f4fa1181740 10 client.15522 fetch_fsmap finished waiting for FSMap version 28 2024-08-19T00:13:39.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.313+0000 7f4fa1181740 10 client.15522 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-19T00:13:39.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.313+0000 7f4fa1181740 20 client.15522 populate_metadata read hostname 'smithi044' 2024-08-19T00:13:39.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.313+0000 7f4fa1181740 1 --2- 172.21.15.44:0/1328550430 >> [v2:172.21.15.171:6838/1466585795,v1:172.21.15.171:6839/1466585795] conn(0x5590e74bb340 0x5590e7529060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:39.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.313+0000 7f4fa1181740 4 client.15522 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-19T00:13:39.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.313+0000 7f4fa1181740 1 -- 172.21.15.44:0/1328550430 --> [v2:172.21.15.171:6838/1466585795,v1:172.21.15.171:6839/1466585795] -- command(tid 0: {"prefix": "status"}) -- 0x5590e740c190 con 0x5590e74bb340 2024-08-19T00:13:39.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.313+0000 7f4f9cb1f640 1 --2- 172.21.15.44:0/1328550430 >> [v2:172.21.15.171:6838/1466585795,v1:172.21.15.171:6839/1466585795] conn(0x5590e74bb340 0x5590e7529060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:39.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.313+0000 7f4f9cb1f640 1 --2- 172.21.15.44:0/1328550430 >> [v2:172.21.15.171:6838/1466585795,v1:172.21.15.171:6839/1466585795] conn(0x5590e74bb340 0x5590e7529060 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=420836074a067d5a server_cookie=b8c8786c7f951f98 in_seq=0 out_seq=0 2024-08-19T00:13:39.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.313+0000 7f4f77fff640 10 client.15522 ms_handle_connect on v2:172.21.15.171:6838/1466585795 2024-08-19T00:13:39.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.314+0000 7f4f77fff640 1 -- 172.21.15.44:0/1328550430 <== mds.2 v2:172.21.15.171:6838/1466585795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x5590e740c190 con 0x5590e74bb340 2024-08-19T00:13:39.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.314+0000 7f4f77fff640 10 client.15522 handle_command_reply: tid=0 2024-08-19T00:13:39.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.314+0000 7f4fa1181740 1 client.15522 shutdown 2024-08-19T00:13:39.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.314+0000 7f4fa1181740 1 -- 172.21.15.44:0/1328550430 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590e74aa810 msgr2=0x5590e74a4b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:39.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.314+0000 7f4fa1181740 1 --2- 172.21.15.44:0/1328550430 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590e74aa810 0x5590e74a4b60 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f4f90007e90 tx=0x7f4f90007890 comp rx=0 tx=0).stop 2024-08-19T00:13:39.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.314+0000 7f4fa1181740 1 -- 172.21.15.44:0/1328550430 shutdown_connections 2024-08-19T00:13:39.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.314+0000 7f4fa1181740 1 --2- 172.21.15.44:0/1328550430 >> [v2:172.21.15.171:6838/1466585795,v1:172.21.15.171:6839/1466585795] conn(0x5590e74bb340 0x5590e7529060 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:39.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.314+0000 7f4fa1181740 1 --2- 172.21.15.44:0/1328550430 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5590e749ff50 0x5590e74a4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:39.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.314+0000 7f4fa1181740 1 --2- 172.21.15.44:0/1328550430 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590e74aa810 0x5590e74a4b60 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:39.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.314+0000 7f4fa1181740 1 --2- 172.21.15.44:0/1328550430 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5590e749f630 0x5590e74c5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:39.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.314+0000 7f4f77fff640 0 client.15522 ms_handle_reset on v2:172.21.15.171:6838/1466585795 2024-08-19T00:13:39.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.314+0000 7f4fa1181740 1 -- 172.21.15.44:0/1328550430 >> 172.21.15.44:0/1328550430 conn(0x5590e749bbc0 msgr2=0x5590e74b5fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:39.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.314+0000 7f4fa1181740 1 -- 172.21.15.44:0/1328550430 shutdown_connections 2024-08-19T00:13:39.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.314+0000 7f4fa1181740 1 -- 172.21.15.44:0/1328550430 wait complete. 2024-08-19T00:13:39.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.314+0000 7f4fa1181740 20 client.15522 trim_cache size 0 max 16384 2024-08-19T00:13:39.322 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-08-19T00:13:39.322 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "647ded64-5dbe-11ef-bccf-c7b262605968", 2024-08-19T00:13:39.322 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 2, 2024-08-19T00:13:39.323 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 24439, 2024-08-19T00:13:39.323 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-08-19T00:13:39.323 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-08-19T00:13:39.323 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-08-19T00:13:39.323 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 125.444460115, 2024-08-19T00:13:39.323 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 28, 2024-08-19T00:13:39.323 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 95, 2024-08-19T00:13:39.323 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 94, 2024-08-19T00:13:39.323 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 186.621288252 2024-08-19T00:13:39.323 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-08-19T00:13:39.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.315+0000 7f4f9ed83640 1 -- 172.21.15.44:0/1970914943 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f4f800a2e10 msgr2=0x7f4f800a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:39.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.315+0000 7f4f9ed83640 1 --2- 172.21.15.44:0/1970914943 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f4f800a2e10 0x7f4f800a52d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4f90021000 tx=0x7f4f9001e000 comp rx=0 tx=0).stop 2024-08-19T00:13:39.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.315+0000 7f4f9ed83640 1 -- 172.21.15.44:0/1970914943 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f98102a60 msgr2=0x7f4f98198350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:39.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.315+0000 7f4f9ed83640 1 --2- 172.21.15.44:0/1970914943 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f98102a60 0x7f4f98198350 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f4f88009a50 tx=0x7f4f88004270 comp rx=0 tx=0).stop 2024-08-19T00:13:39.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.315+0000 7f4f9ed83640 1 -- 172.21.15.44:0/1970914943 shutdown_connections 2024-08-19T00:13:39.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.315+0000 7f4f9ed83640 1 --2- 172.21.15.44:0/1970914943 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f4f800a2e10 0x7f4f800a52d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:39.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.315+0000 7f4f9ed83640 1 --2- 172.21.15.44:0/1970914943 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4f98103410 0x7f4f98198890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:39.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.315+0000 7f4f9ed83640 1 --2- 172.21.15.44:0/1970914943 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4f98107fd0 0x7f4f9819cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:39.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.315+0000 7f4f9ed83640 1 --2- 172.21.15.44:0/1970914943 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f98102a60 0x7f4f98198350 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:39.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.315+0000 7f4f9ed83640 1 -- 172.21.15.44:0/1970914943 >> 172.21.15.44:0/1970914943 conn(0x7f4f980fc500 msgr2=0x7f4f98105ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:39.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.315+0000 7f4f9ed83640 1 -- 172.21.15.44:0/1970914943 shutdown_connections 2024-08-19T00:13:39.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:39.315+0000 7f4f9ed83640 1 -- 172.21.15.44:0/1970914943 wait complete. 2024-08-19T00:13:40.080 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:39 smithi044 ceph-mon[18489]: pgmap v13: 129 pgs: 129 active+clean; 1.3 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 8 op/s 2024-08-19T00:13:40.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:39 smithi171 ceph-mon[21810]: pgmap v13: 129 pgs: 129 active+clean; 1.3 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 8 op/s 2024-08-19T00:13:40.110 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph tell mds.h status 2024-08-19T00:13:40.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:39 smithi116 ceph-mon[21873]: pgmap v13: 129 pgs: 129 active+clean; 1.3 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 8 op/s 2024-08-19T00:13:40.367 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:13:40.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.840+0000 7fc285df7640 1 -- 172.21.15.44:0/887386094 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc280105290 msgr2=0x7fc28010ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:40.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.840+0000 7fc285df7640 1 --2- 172.21.15.44:0/887386094 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc280105290 0x7fc28010ce10 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fc278009ca0 tx=0x7fc27802a8c0 comp rx=0 tx=0).stop 2024-08-19T00:13:40.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.840+0000 7fc285df7640 1 -- 172.21.15.44:0/887386094 shutdown_connections 2024-08-19T00:13:40.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.840+0000 7fc285df7640 1 --2- 172.21.15.44:0/887386094 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc280100b10 0x7fc280104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:40.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.840+0000 7fc285df7640 1 --2- 172.21.15.44:0/887386094 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc280105290 0x7fc28010ce10 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:40.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.840+0000 7fc285df7640 1 --2- 172.21.15.44:0/887386094 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc280100160 0x7fc280100540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:40.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.840+0000 7fc285df7640 1 -- 172.21.15.44:0/887386094 >> 172.21.15.44:0/887386094 conn(0x7fc280076f60 msgr2=0x7fc2800fe370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:40.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.840+0000 7fc285df7640 1 -- 172.21.15.44:0/887386094 shutdown_connections 2024-08-19T00:13:40.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.840+0000 7fc285df7640 1 -- 172.21.15.44:0/887386094 wait complete. 2024-08-19T00:13:40.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.840+0000 7fc285df7640 1 Processor -- start 2024-08-19T00:13:40.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.841+0000 7fc285df7640 1 -- start start 2024-08-19T00:13:40.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.841+0000 7fc285df7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc280100160 0x7fc28010e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:40.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.841+0000 7fc285df7640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc280100b10 0x7fc28010ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:40.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.841+0000 7fc285df7640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc280105290 0x7fc28010efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:40.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.841+0000 7fc285df7640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc280111c70 con 0x7fc280105290 2024-08-19T00:13:40.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.841+0000 7fc285df7640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fc280111af0 con 0x7fc280100160 2024-08-19T00:13:40.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.841+0000 7fc285df7640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc280111df0 con 0x7fc280100b10 2024-08-19T00:13:40.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.841+0000 7fc27ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc280105290 0x7fc28010efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:40.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.841+0000 7fc27ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc280105290 0x7fc28010efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51600/0 (socket says 172.21.15.44:51600) 2024-08-19T00:13:40.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.841+0000 7fc27ffff640 1 -- 172.21.15.44:0/4202735884 learned_addr learned my addr 172.21.15.44:0/4202735884 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:40.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.841+0000 7fc27effd640 1 --2- 172.21.15.44:0/4202735884 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc280100b10 0x7fc28010ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:40.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.841+0000 7fc27f7fe640 1 --2- 172.21.15.44:0/4202735884 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc280100160 0x7fc28010e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:40.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.841+0000 7fc27ffff640 1 -- 172.21.15.44:0/4202735884 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc280100b10 msgr2=0x7fc28010ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:40.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.841+0000 7fc27ffff640 1 --2- 172.21.15.44:0/4202735884 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc280100b10 0x7fc28010ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:40.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.841+0000 7fc27ffff640 1 -- 172.21.15.44:0/4202735884 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc280100160 msgr2=0x7fc28010e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:40.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.841+0000 7fc27ffff640 1 --2- 172.21.15.44:0/4202735884 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc280100160 0x7fc28010e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:40.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.841+0000 7fc27ffff640 1 -- 172.21.15.44:0/4202735884 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2801a65f0 con 0x7fc280105290 2024-08-19T00:13:40.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.841+0000 7fc27ffff640 1 --2- 172.21.15.44:0/4202735884 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc280105290 0x7fc28010efb0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fc278031a20 tx=0x7fc278031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:40.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.842+0000 7fc27cff9640 1 -- 172.21.15.44:0/4202735884 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc278003c30 con 0x7fc280105290 2024-08-19T00:13:40.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.842+0000 7fc285df7640 1 -- 172.21.15.44:0/4202735884 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2801a6880 con 0x7fc280105290 2024-08-19T00:13:40.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.842+0000 7fc27cff9640 1 -- 172.21.15.44:0/4202735884 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc278003dd0 con 0x7fc280105290 2024-08-19T00:13:40.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.842+0000 7fc27cff9640 1 -- 172.21.15.44:0/4202735884 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc27802fc40 con 0x7fc280105290 2024-08-19T00:13:40.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.842+0000 7fc285df7640 1 -- 172.21.15.44:0/4202735884 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2801a6e10 con 0x7fc280105290 2024-08-19T00:13:40.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.844+0000 7fc27cff9640 1 -- 172.21.15.44:0/4202735884 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 24) ==== 138060+0+0 (secure 0 0 0) 0x7fc278004050 con 0x7fc280105290 2024-08-19T00:13:40.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.844+0000 7fc2881f5740 1 Processor -- start 2024-08-19T00:13:40.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.844+0000 7fc2881f5740 1 -- start start 2024-08-19T00:13:40.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.844+0000 7fc27cff9640 1 --2- 172.21.15.44:0/4202735884 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fc2680a2e10 0x7fc2680a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:40.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.845+0000 7fc2881f5740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55807d2ec630 0x55807d2eca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:40.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.845+0000 7fc2881f5740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55807d2ecf50 0x55807d2f72d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:40.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.845+0000 7fc2881f5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55807d2f7810 0x55807d2f9c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:40.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.845+0000 7fc27effd640 1 --2- 172.21.15.44:0/4202735884 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fc2680a2e10 0x7fc2680a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:40.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.845+0000 7fc2881f5740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55807d251710 con 0x55807d2f7810 2024-08-19T00:13:40.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.845+0000 7fc2881f5740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55807d1e9770 con 0x55807d2ec630 2024-08-19T00:13:40.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.845+0000 7fc27cff9640 1 -- 172.21.15.44:0/4202735884 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7fc2780f0cc0 con 0x7fc280105290 2024-08-19T00:13:40.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.845+0000 7fc2881f5740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55807d24d6d0 con 0x55807d2ecf50 2024-08-19T00:13:40.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.845+0000 7fc27f7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55807d2ec630 0x55807d2eca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:40.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.845+0000 7fc27ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55807d2f7810 0x55807d2f9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:40.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.845+0000 7fc27f7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55807d2ec630 0x55807d2eca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.44:44074/0 (socket says 172.21.15.44:44074) 2024-08-19T00:13:40.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.845+0000 7fc27f7fe640 1 -- 172.21.15.44:0/1055717699 learned_addr learned my addr 172.21.15.44:0/1055717699 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:40.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.845+0000 7fc27effd640 1 --2- 172.21.15.44:0/1055717699 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55807d2ecf50 0x55807d2f72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:40.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.845+0000 7fc27ffff640 1 -- 172.21.15.44:0/1055717699 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55807d2ecf50 msgr2=0x55807d2f72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:40.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.845+0000 7fc27ffff640 1 --2- 172.21.15.44:0/1055717699 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55807d2ecf50 0x55807d2f72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:40.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.845+0000 7fc27effd640 1 --2- 172.21.15.44:0/4202735884 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fc2680a2e10 0x7fc2680a52d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc274005fd0 tx=0x7fc27400bf60 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:40.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.845+0000 7fc27ffff640 1 -- 172.21.15.44:0/1055717699 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55807d2ec630 msgr2=0x55807d2eca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:40.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.845+0000 7fc27ffff640 1 --2- 172.21.15.44:0/1055717699 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55807d2ec630 0x55807d2eca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:40.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.845+0000 7fc27ffff640 1 -- 172.21.15.44:0/1055717699 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55807d1f03e0 con 0x55807d2f7810 2024-08-19T00:13:40.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.845+0000 7fc27f7fe640 1 --2- 172.21.15.44:0/1055717699 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55807d2ec630 0x55807d2eca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:13:40.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.845+0000 7fc27ffff640 1 --2- 172.21.15.44:0/1055717699 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55807d2f7810 0x55807d2f9c00 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fc2780edfa0 tx=0x7fc2780bc870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9d6dcc0eb1602ba server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:40.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.845+0000 7fc265ffb640 1 -- 172.21.15.44:0/1055717699 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2780bcd30 con 0x55807d2f7810 2024-08-19T00:13:40.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.846+0000 7fc265ffb640 1 -- 172.21.15.44:0/1055717699 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc278036040 con 0x55807d2f7810 2024-08-19T00:13:40.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.846+0000 7fc265ffb640 1 -- 172.21.15.44:0/1055717699 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2780b93a0 con 0x55807d2f7810 2024-08-19T00:13:40.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.846+0000 7fc2881f5740 1 -- 172.21.15.44:0/1055717699 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55807d2f7810 msgr2=0x55807d2f9c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:40.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.846+0000 7fc2881f5740 1 --2- 172.21.15.44:0/1055717699 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55807d2f7810 0x55807d2f9c00 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fc2780edfa0 tx=0x7fc2780bc870 comp rx=0 tx=0).stop 2024-08-19T00:13:40.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.846+0000 7fc2881f5740 1 -- 172.21.15.44:0/1055717699 shutdown_connections 2024-08-19T00:13:40.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.846+0000 7fc2881f5740 1 --2- 172.21.15.44:0/1055717699 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55807d2ecf50 0x55807d2f72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:40.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.846+0000 7fc2881f5740 1 --2- 172.21.15.44:0/1055717699 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55807d2f7810 0x55807d2f9c00 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:40.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.846+0000 7fc2881f5740 1 --2- 172.21.15.44:0/1055717699 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55807d2ec630 0x55807d2eca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:40.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.846+0000 7fc2881f5740 1 -- 172.21.15.44:0/1055717699 >> 172.21.15.44:0/1055717699 conn(0x55807d2e8bc0 msgr2=0x55807d2e8fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:40.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.846+0000 7fc2881f5740 1 -- 172.21.15.44:0/1055717699 shutdown_connections 2024-08-19T00:13:40.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.846+0000 7fc2881f5740 1 -- 172.21.15.44:0/1055717699 wait complete. 2024-08-19T00:13:40.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.847+0000 7fc2881f5740 1 -- start start 2024-08-19T00:13:40.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.847+0000 7fc2881f5740 1 Processor -- start 2024-08-19T00:13:40.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.847+0000 7fc2881f5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55807d2ec630 0x55807d2f46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:40.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.847+0000 7fc2881f5740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55807d2ecf50 0x55807d2f4c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:40.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.847+0000 7fc2881f5740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55807d2f7810 0x55807d2f5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:40.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.847+0000 7fc2881f5740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55807d251710 con 0x55807d2ec630 2024-08-19T00:13:40.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.847+0000 7fc2881f5740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55807d20c970 con 0x55807d2ecf50 2024-08-19T00:13:40.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.847+0000 7fc2881f5740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55807d2fa1a0 con 0x55807d2f7810 2024-08-19T00:13:40.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.847+0000 7fc2881f5740 10 client.0 _ll_register_callbacks cb 0x55807cf607b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:13:40.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.847+0000 7fc27f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55807d2ec630 0x55807d2f46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:40.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.847+0000 7fc27f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55807d2ec630 0x55807d2f46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51620/0 (socket says 172.21.15.44:51620) 2024-08-19T00:13:40.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.847+0000 7fc27f7fe640 1 -- 172.21.15.44:0/1167889410 learned_addr learned my addr 172.21.15.44:0/1167889410 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:40.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.847+0000 7fc27ffff640 1 --2- 172.21.15.44:0/1167889410 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55807d2f7810 0x55807d2f5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:40.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.848+0000 7fc27effd640 1 --2- 172.21.15.44:0/1167889410 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55807d2ecf50 0x55807d2f4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:40.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.848+0000 7fc27f7fe640 1 -- 172.21.15.44:0/1167889410 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55807d2f7810 msgr2=0x55807d2f5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:40.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.848+0000 7fc27f7fe640 1 --2- 172.21.15.44:0/1167889410 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55807d2f7810 0x55807d2f5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:40.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.848+0000 7fc27f7fe640 1 -- 172.21.15.44:0/1167889410 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55807d2ecf50 msgr2=0x55807d2f4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:40.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.848+0000 7fc27f7fe640 1 --2- 172.21.15.44:0/1167889410 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55807d2ecf50 0x55807d2f4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:40.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.848+0000 7fc27f7fe640 1 -- 172.21.15.44:0/1167889410 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55807cfc32b0 con 0x55807d2ec630 2024-08-19T00:13:40.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.848+0000 7fc27f7fe640 1 --2- 172.21.15.44:0/1167889410 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55807d2ec630 0x55807d2f46c0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fc270012720 tx=0x7fc270012be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c4adb51fbdeba60 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:40.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.848+0000 7fc25effd640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:13:40.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.848+0000 7fc25effd640 1 -- 172.21.15.44:0/1167889410 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc270011bb0 con 0x55807d2ec630 2024-08-19T00:13:40.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.848+0000 7fc25effd640 1 -- 172.21.15.44:0/1167889410 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7fc270011d50 con 0x55807d2ec630 2024-08-19T00:13:40.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.848+0000 7fc2881f5740 1 -- 172.21.15.44:0/1167889410 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc278036040 con 0x55807d2ec630 2024-08-19T00:13:40.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.848+0000 7fc25effd640 1 -- 172.21.15.44:0/1167889410 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc27001c420 con 0x55807d2ec630 2024-08-19T00:13:40.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.848+0000 7fc2881f5740 10 client.15534 fetch_fsmap learned FSMap version 28 2024-08-19T00:13:40.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.848+0000 7fc2881f5740 1 -- 172.21.15.44:0/1167889410 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55807d305bc0 con 0x55807d2ec630 2024-08-19T00:13:40.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.849+0000 7fc25effd640 1 -- 172.21.15.44:0/1167889410 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc278036040 con 0x55807d2ec630 2024-08-19T00:13:40.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.849+0000 7fc25effd640 1 -- 172.21.15.44:0/1167889410 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fc27000f7d0 con 0x55807d2ec630 2024-08-19T00:13:40.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.849+0000 7fc2881f5740 10 client.15534 fetch_fsmap finished waiting for FSMap version 28 2024-08-19T00:13:40.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.849+0000 7fc2881f5740 10 client.15534 resolve_mds: resolved name 'h' to daemon mds.h 2024-08-19T00:13:40.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.849+0000 7fc2881f5740 20 client.15534 populate_metadata read hostname 'smithi044' 2024-08-19T00:13:40.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.849+0000 7fc2881f5740 1 --2- 172.21.15.44:0/1167889410 >> [v2:172.21.15.116:6836/2764513846,v1:172.21.15.116:6837/2764513846] conn(0x55807d308220 0x55807d309690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:40.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.849+0000 7fc2881f5740 4 client.15534 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:13:40.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.849+0000 7fc2881f5740 1 -- 172.21.15.44:0/1167889410 --> [v2:172.21.15.116:6836/2764513846,v1:172.21.15.116:6837/2764513846] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55807d25ec80 con 0x55807d308220 2024-08-19T00:13:40.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.849+0000 7fc27effd640 1 --2- 172.21.15.44:0/1167889410 >> [v2:172.21.15.116:6836/2764513846,v1:172.21.15.116:6837/2764513846] conn(0x55807d308220 0x55807d309690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:40.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.849+0000 7fc27effd640 1 --2- 172.21.15.44:0/1167889410 >> [v2:172.21.15.116:6836/2764513846,v1:172.21.15.116:6837/2764513846] conn(0x55807d308220 0x55807d309690 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5019f11a6de199ec server_cookie=a4b3bab0147ebd02 in_seq=0 out_seq=0 2024-08-19T00:13:40.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.849+0000 7fc25effd640 10 client.15534 ms_handle_connect on v2:172.21.15.116:6836/2764513846 2024-08-19T00:13:40.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.850+0000 7fc25effd640 1 -- 172.21.15.44:0/1167889410 <== mds.1 v2:172.21.15.116:6836/2764513846 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55807d25ec80 con 0x55807d308220 2024-08-19T00:13:40.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.850+0000 7fc25effd640 10 client.15534 handle_command_reply: tid=0 2024-08-19T00:13:40.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.850+0000 7fc2881f5740 1 client.15534 shutdown 2024-08-19T00:13:40.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.850+0000 7fc2881f5740 1 -- 172.21.15.44:0/1167889410 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55807d2ec630 msgr2=0x55807d2f46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:40.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.850+0000 7fc2881f5740 1 --2- 172.21.15.44:0/1167889410 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55807d2ec630 0x55807d2f46c0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fc270012720 tx=0x7fc270012be0 comp rx=0 tx=0).stop 2024-08-19T00:13:40.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.850+0000 7fc2881f5740 1 -- 172.21.15.44:0/1167889410 shutdown_connections 2024-08-19T00:13:40.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.850+0000 7fc2881f5740 1 --2- 172.21.15.44:0/1167889410 >> [v2:172.21.15.116:6836/2764513846,v1:172.21.15.116:6837/2764513846] conn(0x55807d308220 0x55807d309690 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:40.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.850+0000 7fc2881f5740 1 --2- 172.21.15.44:0/1167889410 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55807d2f7810 0x55807d2f5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:40.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.850+0000 7fc2881f5740 1 --2- 172.21.15.44:0/1167889410 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55807d2ecf50 0x55807d2f4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:40.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.850+0000 7fc25effd640 0 client.15534 ms_handle_reset on v2:172.21.15.116:6836/2764513846 2024-08-19T00:13:40.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.850+0000 7fc2881f5740 1 --2- 172.21.15.44:0/1167889410 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55807d2ec630 0x55807d2f46c0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:40.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.850+0000 7fc2881f5740 1 -- 172.21.15.44:0/1167889410 >> 172.21.15.44:0/1167889410 conn(0x55807d2e8bc0 msgr2=0x55807d2e7d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:40.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.850+0000 7fc2881f5740 1 -- 172.21.15.44:0/1167889410 shutdown_connections 2024-08-19T00:13:40.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.851+0000 7fc2881f5740 1 -- 172.21.15.44:0/1167889410 wait complete. 2024-08-19T00:13:40.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.851+0000 7fc2881f5740 20 client.15534 trim_cache size 0 max 16384 2024-08-19T00:13:40.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.869+0000 7fc2881f5740 1 Processor -- start 2024-08-19T00:13:40.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.869+0000 7fc2881f5740 1 -- start start 2024-08-19T00:13:40.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.869+0000 7fc2881f5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55807d2ec630 0x55807d2f6520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:40.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.869+0000 7fc2881f5740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55807d2ecf50 0x55807d2f1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:40.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.869+0000 7fc2881f5740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55807d2f7810 0x55807d2f1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:40.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.869+0000 7fc2881f5740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55807d3079d0 con 0x55807d2ec630 2024-08-19T00:13:40.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.869+0000 7fc2881f5740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55807d3080a0 con 0x55807d2ecf50 2024-08-19T00:13:40.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.869+0000 7fc2881f5740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55807d308770 con 0x55807d2f7810 2024-08-19T00:13:40.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.869+0000 7fc27f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55807d2ec630 0x55807d2f6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:40.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.869+0000 7fc27f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55807d2ec630 0x55807d2f6520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51622/0 (socket says 172.21.15.44:51622) 2024-08-19T00:13:40.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.869+0000 7fc27f7fe640 1 -- 172.21.15.44:0/2524607424 learned_addr learned my addr 172.21.15.44:0/2524607424 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:40.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.869+0000 7fc27effd640 1 --2- 172.21.15.44:0/2524607424 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55807d2ecf50 0x55807d2f1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:40.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.869+0000 7fc27f7fe640 1 -- 172.21.15.44:0/2524607424 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55807d2f7810 msgr2=0x55807d2f1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:40.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.869+0000 7fc27f7fe640 1 --2- 172.21.15.44:0/2524607424 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55807d2f7810 0x55807d2f1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:40.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.869+0000 7fc27f7fe640 1 -- 172.21.15.44:0/2524607424 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55807d2ecf50 msgr2=0x55807d2f1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:40.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.869+0000 7fc27f7fe640 1 --2- 172.21.15.44:0/2524607424 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55807d2ecf50 0x55807d2f1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:40.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.869+0000 7fc27f7fe640 1 -- 172.21.15.44:0/2524607424 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55807d2e89f0 con 0x55807d2ec630 2024-08-19T00:13:40.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.869+0000 7fc27f7fe640 1 --2- 172.21.15.44:0/2524607424 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55807d2ec630 0x55807d2f6520 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fc270005c00 tx=0x7fc2700058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49607d499602259c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:40.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.870+0000 7fc2657fa640 1 -- 172.21.15.44:0/2524607424 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc27002e020 con 0x55807d2ec630 2024-08-19T00:13:40.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.870+0000 7fc2657fa640 1 -- 172.21.15.44:0/2524607424 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc270011bb0 con 0x55807d2ec630 2024-08-19T00:13:40.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.870+0000 7fc2657fa640 1 -- 172.21.15.44:0/2524607424 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc27000f460 con 0x55807d2ec630 2024-08-19T00:13:40.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.870+0000 7fc2881f5740 1 -- 172.21.15.44:0/2524607424 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55807d2ec630 msgr2=0x55807d2f6520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:40.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.870+0000 7fc2881f5740 1 --2- 172.21.15.44:0/2524607424 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55807d2ec630 0x55807d2f6520 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fc270005c00 tx=0x7fc2700058d0 comp rx=0 tx=0).stop 2024-08-19T00:13:40.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.870+0000 7fc2881f5740 1 -- 172.21.15.44:0/2524607424 shutdown_connections 2024-08-19T00:13:40.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.870+0000 7fc2881f5740 1 --2- 172.21.15.44:0/2524607424 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55807d2f7810 0x55807d2f1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:40.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.870+0000 7fc2881f5740 1 --2- 172.21.15.44:0/2524607424 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55807d2ecf50 0x55807d2f1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:40.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.870+0000 7fc2881f5740 1 --2- 172.21.15.44:0/2524607424 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55807d2ec630 0x55807d2f6520 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:40.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.870+0000 7fc2881f5740 1 -- 172.21.15.44:0/2524607424 >> 172.21.15.44:0/2524607424 conn(0x55807d2e8bc0 msgr2=0x55807d2f5e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:40.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.870+0000 7fc2881f5740 1 -- 172.21.15.44:0/2524607424 shutdown_connections 2024-08-19T00:13:40.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.870+0000 7fc2881f5740 1 -- 172.21.15.44:0/2524607424 wait complete. 2024-08-19T00:13:40.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.871+0000 7fc2881f5740 1 -- start start 2024-08-19T00:13:40.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.871+0000 7fc2881f5740 1 Processor -- start 2024-08-19T00:13:40.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.871+0000 7fc2881f5740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55807d2ec630 0x55807d312030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:40.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.871+0000 7fc2881f5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55807d2ecf50 0x55807d30d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:40.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.871+0000 7fc2881f5740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55807d2f7810 0x55807d30d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:40.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.871+0000 7fc2881f5740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55807d309510 con 0x55807d2ecf50 2024-08-19T00:13:40.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.871+0000 7fc2881f5740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55807d308e40 con 0x55807d2f7810 2024-08-19T00:13:40.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.871+0000 7fc2881f5740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55807d309be0 con 0x55807d2ec630 2024-08-19T00:13:40.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.871+0000 7fc2881f5740 10 client.0 _ll_register_callbacks cb 0x7fc2700097d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:13:40.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.871+0000 7fc27effd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55807d2ecf50 0x55807d30d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:40.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.871+0000 7fc27effd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55807d2ecf50 0x55807d30d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51630/0 (socket says 172.21.15.44:51630) 2024-08-19T00:13:40.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.871+0000 7fc27effd640 1 -- 172.21.15.44:0/1537242492 learned_addr learned my addr 172.21.15.44:0/1537242492 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:40.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.871+0000 7fc27ffff640 1 --2- 172.21.15.44:0/1537242492 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55807d2f7810 0x55807d30d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:40.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.871+0000 7fc27f7fe640 1 --2- 172.21.15.44:0/1537242492 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55807d2ec630 0x55807d312030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:40.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.871+0000 7fc27effd640 1 -- 172.21.15.44:0/1537242492 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55807d2ec630 msgr2=0x55807d312030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:40.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.871+0000 7fc27effd640 1 --2- 172.21.15.44:0/1537242492 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55807d2ec630 0x55807d312030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:40.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.871+0000 7fc27effd640 1 -- 172.21.15.44:0/1537242492 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55807d2f7810 msgr2=0x55807d30d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:40.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.871+0000 7fc27effd640 1 --2- 172.21.15.44:0/1537242492 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55807d2f7810 0x55807d30d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:40.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.871+0000 7fc27effd640 1 -- 172.21.15.44:0/1537242492 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55807d2e4130 con 0x55807d2ecf50 2024-08-19T00:13:40.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.871+0000 7fc27f7fe640 1 --2- 172.21.15.44:0/1537242492 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55807d2ec630 0x55807d312030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:13:40.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.872+0000 7fc27effd640 1 --2- 172.21.15.44:0/1537242492 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55807d2ecf50 0x55807d30d360 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fc27400bfd0 tx=0x7fc274004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81cb9a1eb4ba78ff server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:40.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.872+0000 7fc25effd640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:13:40.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.872+0000 7fc25effd640 1 -- 172.21.15.44:0/1537242492 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc274029840 con 0x55807d2ecf50 2024-08-19T00:13:40.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.872+0000 7fc25effd640 1 -- 172.21.15.44:0/1537242492 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7fc2740299e0 con 0x55807d2ecf50 2024-08-19T00:13:40.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.872+0000 7fc2881f5740 1 -- 172.21.15.44:0/1537242492 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc270011bb0 con 0x55807d2ecf50 2024-08-19T00:13:40.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.872+0000 7fc25effd640 1 -- 172.21.15.44:0/1537242492 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc274039050 con 0x55807d2ecf50 2024-08-19T00:13:40.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.872+0000 7fc2881f5740 10 client.15540 fetch_fsmap learned FSMap version 28 2024-08-19T00:13:40.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.872+0000 7fc2881f5740 1 -- 172.21.15.44:0/1537242492 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55807d372790 con 0x55807d2ecf50 2024-08-19T00:13:40.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.872+0000 7fc25effd640 1 -- 172.21.15.44:0/1537242492 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc270011bb0 con 0x55807d2ecf50 2024-08-19T00:13:40.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.872+0000 7fc25effd640 1 -- 172.21.15.44:0/1537242492 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fc2740313a0 con 0x55807d2ecf50 2024-08-19T00:13:40.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.872+0000 7fc2881f5740 10 client.15540 fetch_fsmap finished waiting for FSMap version 28 2024-08-19T00:13:40.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.872+0000 7fc2881f5740 10 client.15540 resolve_mds: resolved name 'h' to daemon mds.h 2024-08-19T00:13:40.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.872+0000 7fc2881f5740 20 client.15540 populate_metadata read hostname 'smithi044' 2024-08-19T00:13:40.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.872+0000 7fc2881f5740 1 --2- 172.21.15.44:0/1537242492 >> [v2:172.21.15.116:6836/2764513846,v1:172.21.15.116:6837/2764513846] conn(0x55807d377380 0x55807d376090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:40.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.872+0000 7fc2881f5740 4 client.15540 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-19T00:13:40.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.872+0000 7fc2881f5740 1 -- 172.21.15.44:0/1537242492 --> [v2:172.21.15.116:6836/2764513846,v1:172.21.15.116:6837/2764513846] -- command(tid 0: {"prefix": "status"}) -- 0x55807d259190 con 0x55807d377380 2024-08-19T00:13:40.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.873+0000 7fc27f7fe640 1 --2- 172.21.15.44:0/1537242492 >> [v2:172.21.15.116:6836/2764513846,v1:172.21.15.116:6837/2764513846] conn(0x55807d377380 0x55807d376090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:40.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.873+0000 7fc27f7fe640 1 --2- 172.21.15.44:0/1537242492 >> [v2:172.21.15.116:6836/2764513846,v1:172.21.15.116:6837/2764513846] conn(0x55807d377380 0x55807d376090 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=df6317fac7edd52f server_cookie=d0e955f2ca719806 in_seq=0 out_seq=0 2024-08-19T00:13:40.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.873+0000 7fc25effd640 10 client.15540 ms_handle_connect on v2:172.21.15.116:6836/2764513846 2024-08-19T00:13:40.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.873+0000 7fc25effd640 1 -- 172.21.15.44:0/1537242492 <== mds.1 v2:172.21.15.116:6836/2764513846 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x55807d259190 con 0x55807d377380 2024-08-19T00:13:40.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.873+0000 7fc25effd640 10 client.15540 handle_command_reply: tid=0 2024-08-19T00:13:40.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.873+0000 7fc2881f5740 1 client.15540 shutdown 2024-08-19T00:13:40.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.873+0000 7fc2881f5740 1 -- 172.21.15.44:0/1537242492 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55807d2ecf50 msgr2=0x55807d30d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:40.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.873+0000 7fc2881f5740 1 --2- 172.21.15.44:0/1537242492 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55807d2ecf50 0x55807d30d360 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fc27400bfd0 tx=0x7fc274004730 comp rx=0 tx=0).stop 2024-08-19T00:13:40.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.873+0000 7fc2881f5740 1 -- 172.21.15.44:0/1537242492 shutdown_connections 2024-08-19T00:13:40.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.873+0000 7fc2881f5740 1 --2- 172.21.15.44:0/1537242492 >> [v2:172.21.15.116:6836/2764513846,v1:172.21.15.116:6837/2764513846] conn(0x55807d377380 0x55807d376090 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:40.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.873+0000 7fc2881f5740 1 --2- 172.21.15.44:0/1537242492 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55807d2f7810 0x55807d30d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:40.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.873+0000 7fc2881f5740 1 --2- 172.21.15.44:0/1537242492 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55807d2ecf50 0x55807d30d360 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:40.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.874+0000 7fc2881f5740 1 --2- 172.21.15.44:0/1537242492 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55807d2ec630 0x55807d312030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:40.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.874+0000 7fc2881f5740 1 -- 172.21.15.44:0/1537242492 >> 172.21.15.44:0/1537242492 conn(0x55807d2e8bc0 msgr2=0x55807d2e7d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:40.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.874+0000 7fc25effd640 0 client.15540 ms_handle_reset on v2:172.21.15.116:6836/2764513846 2024-08-19T00:13:40.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.874+0000 7fc2881f5740 1 -- 172.21.15.44:0/1537242492 shutdown_connections 2024-08-19T00:13:40.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.874+0000 7fc2881f5740 1 -- 172.21.15.44:0/1537242492 wait complete. 2024-08-19T00:13:40.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.874+0000 7fc2881f5740 20 client.15540 trim_cache size 0 max 16384 2024-08-19T00:13:40.881 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-08-19T00:13:40.881 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "647ded64-5dbe-11ef-bccf-c7b262605968", 2024-08-19T00:13:40.881 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 1, 2024-08-19T00:13:40.881 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 24446, 2024-08-19T00:13:40.881 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-08-19T00:13:40.881 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-08-19T00:13:40.881 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-08-19T00:13:40.881 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 128.011788755, 2024-08-19T00:13:40.881 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 28, 2024-08-19T00:13:40.882 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 95, 2024-08-19T00:13:40.882 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 94, 2024-08-19T00:13:40.882 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 190.980369231 2024-08-19T00:13:40.882 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-08-19T00:13:40.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.874+0000 7fc285df7640 1 -- 172.21.15.44:0/4202735884 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fc2680a2e10 msgr2=0x7fc2680a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:40.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.874+0000 7fc285df7640 1 --2- 172.21.15.44:0/4202735884 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fc2680a2e10 0x7fc2680a52d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc274005fd0 tx=0x7fc27400bf60 comp rx=0 tx=0).stop 2024-08-19T00:13:40.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.874+0000 7fc285df7640 1 -- 172.21.15.44:0/4202735884 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc280105290 msgr2=0x7fc28010efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:40.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.874+0000 7fc285df7640 1 --2- 172.21.15.44:0/4202735884 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc280105290 0x7fc28010efb0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fc278031a20 tx=0x7fc278031a50 comp rx=0 tx=0).stop 2024-08-19T00:13:40.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.874+0000 7fc285df7640 1 -- 172.21.15.44:0/4202735884 shutdown_connections 2024-08-19T00:13:40.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.874+0000 7fc285df7640 1 --2- 172.21.15.44:0/4202735884 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fc2680a2e10 0x7fc2680a52d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:40.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.874+0000 7fc285df7640 1 --2- 172.21.15.44:0/4202735884 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc280100b10 0x7fc28010ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:40.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.874+0000 7fc285df7640 1 --2- 172.21.15.44:0/4202735884 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc280105290 0x7fc28010efb0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:40.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.874+0000 7fc285df7640 1 --2- 172.21.15.44:0/4202735884 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc280100160 0x7fc28010e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:40.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.874+0000 7fc285df7640 1 -- 172.21.15.44:0/4202735884 >> 172.21.15.44:0/4202735884 conn(0x7fc280076f60 msgr2=0x7fc280103550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:40.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.874+0000 7fc285df7640 1 -- 172.21.15.44:0/4202735884 shutdown_connections 2024-08-19T00:13:40.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:40.874+0000 7fc285df7640 1 -- 172.21.15.44:0/4202735884 wait complete. 2024-08-19T00:13:41.684 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph tell mds.b status 2024-08-19T00:13:41.942 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:13:42.063 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:41 smithi044 ceph-mon[18489]: pgmap v14: 129 pgs: 129 active+clean; 1.3 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.2 KiB/s wr, 17 op/s 2024-08-19T00:13:42.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:41 smithi171 ceph-mon[21810]: pgmap v14: 129 pgs: 129 active+clean; 1.3 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.2 KiB/s wr, 17 op/s 2024-08-19T00:13:42.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:41 smithi116 ceph-mon[21873]: pgmap v14: 129 pgs: 129 active+clean; 1.3 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.2 KiB/s wr, 17 op/s 2024-08-19T00:13:42.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.414+0000 7f90af922640 1 -- 172.21.15.44:0/432301383 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f90a8102250 msgr2=0x7f90a810e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:42.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.414+0000 7f90af922640 1 --2- 172.21.15.44:0/432301383 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f90a8102250 0x7f90a810e780 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f90a0009cd0 tx=0x7f90a002a8e0 comp rx=0 tx=0).stop 2024-08-19T00:13:42.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.414+0000 7f90af922640 1 -- 172.21.15.44:0/432301383 shutdown_connections 2024-08-19T00:13:42.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.414+0000 7f90af922640 1 --2- 172.21.15.44:0/432301383 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f90a8102250 0x7f90a810e780 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:42.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.414+0000 7f90af922640 1 --2- 172.21.15.44:0/432301383 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90a81018b0 0x7f90a8101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:42.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.414+0000 7f90af922640 1 --2- 172.21.15.44:0/432301383 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f90a81078b0 0x7f90a8107c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:42.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.414+0000 7f90af922640 1 -- 172.21.15.44:0/432301383 >> 172.21.15.44:0/432301383 conn(0x7f90a80fd5f0 msgr2=0x7f90a80ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:42.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.414+0000 7f90af922640 1 -- 172.21.15.44:0/432301383 shutdown_connections 2024-08-19T00:13:42.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.414+0000 7f90af922640 1 -- 172.21.15.44:0/432301383 wait complete. 2024-08-19T00:13:42.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.415+0000 7f90af922640 1 Processor -- start 2024-08-19T00:13:42.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.415+0000 7f90af922640 1 -- start start 2024-08-19T00:13:42.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.415+0000 7f90af922640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90a81018b0 0x7f90a8198140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:42.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.415+0000 7f90af922640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f90a8102250 0x7f90a8198680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:42.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.415+0000 7f90af922640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f90a81078b0 0x7f90a819ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:42.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.415+0000 7f90af922640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f90a8111cb0 con 0x7f90a8102250 2024-08-19T00:13:42.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.415+0000 7f90af922640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f90a8111b30 con 0x7f90a81018b0 2024-08-19T00:13:42.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.415+0000 7f90af922640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f90a8111e30 con 0x7f90a81078b0 2024-08-19T00:13:42.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.415+0000 7f90acebd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f90a8102250 0x7f90a8198680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:42.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.415+0000 7f90acebd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f90a8102250 0x7f90a8198680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51636/0 (socket says 172.21.15.44:51636) 2024-08-19T00:13:42.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.415+0000 7f90acebd640 1 -- 172.21.15.44:0/2643595836 learned_addr learned my addr 172.21.15.44:0/2643595836 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:42.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.415+0000 7f90adebf640 1 --2- 172.21.15.44:0/2643595836 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f90a81078b0 0x7f90a819ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:42.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.415+0000 7f90ad6be640 1 --2- 172.21.15.44:0/2643595836 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90a81018b0 0x7f90a8198140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:42.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.415+0000 7f90acebd640 1 -- 172.21.15.44:0/2643595836 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f90a81078b0 msgr2=0x7f90a819ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:42.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.415+0000 7f90acebd640 1 --2- 172.21.15.44:0/2643595836 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f90a81078b0 0x7f90a819ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:42.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.415+0000 7f90acebd640 1 -- 172.21.15.44:0/2643595836 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90a81018b0 msgr2=0x7f90a8198140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:42.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.415+0000 7f90acebd640 1 --2- 172.21.15.44:0/2643595836 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90a81018b0 0x7f90a8198140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:42.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.415+0000 7f90acebd640 1 -- 172.21.15.44:0/2643595836 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90a819d0f0 con 0x7f90a8102250 2024-08-19T00:13:42.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.416+0000 7f90acebd640 1 --2- 172.21.15.44:0/2643595836 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f90a8102250 0x7f90a8198680 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f909800d950 tx=0x7f909800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:42.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.416+0000 7f909e7fc640 1 -- 172.21.15.44:0/2643595836 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9098017070 con 0x7f90a8102250 2024-08-19T00:13:42.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.416+0000 7f909e7fc640 1 -- 172.21.15.44:0/2643595836 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9098009c30 con 0x7f90a8102250 2024-08-19T00:13:42.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.416+0000 7f90af922640 1 -- 172.21.15.44:0/2643595836 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90a819d3e0 con 0x7f90a8102250 2024-08-19T00:13:42.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.416+0000 7f909e7fc640 1 -- 172.21.15.44:0/2643595836 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f909800f6b0 con 0x7f90a8102250 2024-08-19T00:13:42.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.416+0000 7f90af922640 1 -- 172.21.15.44:0/2643595836 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90a81a4cc0 con 0x7f90a8102250 2024-08-19T00:13:42.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.418+0000 7f909e7fc640 1 -- 172.21.15.44:0/2643595836 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 24) ==== 138060+0+0 (secure 0 0 0) 0x7f90980109d0 con 0x7f90a8102250 2024-08-19T00:13:42.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.418+0000 7f90b1d20740 1 Processor -- start 2024-08-19T00:13:42.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.418+0000 7f90b1d20740 1 -- start start 2024-08-19T00:13:42.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.419+0000 7f90b1d20740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a6b63b510 0x560a6b63b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:42.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.419+0000 7f90b1d20740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560a6b63be30 0x560a6b64a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:42.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.419+0000 7f909e7fc640 1 --2- 172.21.15.44:0/2643595836 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f90940a2e90 0x7f90940a5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:42.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.419+0000 7f90b1d20740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560a6b64ac20 0x560a6b64d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:42.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.419+0000 7f90b1d20740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x560a6b5a0710 con 0x560a6b63b510 2024-08-19T00:13:42.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.419+0000 7f90b1d20740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x560a6b538770 con 0x560a6b63be30 2024-08-19T00:13:42.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.419+0000 7f90b1d20740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x560a6b59c6d0 con 0x560a6b64ac20 2024-08-19T00:13:42.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.419+0000 7f90adebf640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a6b63b510 0x560a6b63b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:42.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.419+0000 7f90adebf640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a6b63b510 0x560a6b63b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51638/0 (socket says 172.21.15.44:51638) 2024-08-19T00:13:42.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.419+0000 7f90adebf640 1 -- 172.21.15.44:0/4153744890 learned_addr learned my addr 172.21.15.44:0/4153744890 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:42.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.419+0000 7f90acebd640 1 --2- 172.21.15.44:0/2643595836 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f90940a2e90 0x7f90940a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:42.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.419+0000 7f909e7fc640 1 -- 172.21.15.44:0/2643595836 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f90980cf5e0 con 0x7f90a8102250 2024-08-19T00:13:42.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.419+0000 7f90ad6be640 1 --2- 172.21.15.44:0/4153744890 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560a6b63be30 0x560a6b64a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:42.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.419+0000 7f90adebf640 1 --2- 172.21.15.44:0/4153744890 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560a6b64ac20 0x560a6b64d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:42.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.419+0000 7f90adebf640 1 -- 172.21.15.44:0/4153744890 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560a6b64ac20 msgr2=0x560a6b64d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:42.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.419+0000 7f90adebf640 1 --2- 172.21.15.44:0/4153744890 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560a6b64ac20 0x560a6b64d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:42.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.419+0000 7f90adebf640 1 -- 172.21.15.44:0/4153744890 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560a6b63be30 msgr2=0x560a6b64a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:42.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.419+0000 7f90adebf640 1 --2- 172.21.15.44:0/4153744890 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560a6b63be30 0x560a6b64a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:42.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.419+0000 7f90adebf640 1 -- 172.21.15.44:0/4153744890 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a6b53f3e0 con 0x560a6b63b510 2024-08-19T00:13:42.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.419+0000 7f90acebd640 1 --2- 172.21.15.44:0/2643595836 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f90940a2e90 0x7f90940a5350 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f90980cc870 tx=0x7f909800dfa0 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:42.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.420+0000 7f90adebf640 1 --2- 172.21.15.44:0/4153744890 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a6b63b510 0x560a6b63b8f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f90a0004ab0 tx=0x7f90a0005fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bd38ce54c429639 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:42.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.420+0000 7f90937fe640 1 -- 172.21.15.44:0/4153744890 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a0031c90 con 0x560a6b63b510 2024-08-19T00:13:42.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.420+0000 7f90937fe640 1 -- 172.21.15.44:0/4153744890 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90a0036040 con 0x560a6b63b510 2024-08-19T00:13:42.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.420+0000 7f90937fe640 1 -- 172.21.15.44:0/4153744890 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a00305a0 con 0x560a6b63b510 2024-08-19T00:13:42.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.420+0000 7f90b1d20740 1 -- 172.21.15.44:0/4153744890 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a6b63b510 msgr2=0x560a6b63b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:42.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.420+0000 7f90b1d20740 1 --2- 172.21.15.44:0/4153744890 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a6b63b510 0x560a6b63b8f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f90a0004ab0 tx=0x7f90a0005fa0 comp rx=0 tx=0).stop 2024-08-19T00:13:42.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.420+0000 7f90b1d20740 1 -- 172.21.15.44:0/4153744890 shutdown_connections 2024-08-19T00:13:42.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.420+0000 7f90b1d20740 1 --2- 172.21.15.44:0/4153744890 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560a6b64ac20 0x560a6b64d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:42.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.420+0000 7f90b1d20740 1 --2- 172.21.15.44:0/4153744890 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560a6b63be30 0x560a6b64a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:42.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.420+0000 7f90b1d20740 1 --2- 172.21.15.44:0/4153744890 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a6b63b510 0x560a6b63b8f0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:42.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.421+0000 7f90b1d20740 1 -- 172.21.15.44:0/4153744890 >> 172.21.15.44:0/4153744890 conn(0x560a6b637bc0 msgr2=0x560a6b637fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:42.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.421+0000 7f90b1d20740 1 -- 172.21.15.44:0/4153744890 shutdown_connections 2024-08-19T00:13:42.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.421+0000 7f90b1d20740 1 -- 172.21.15.44:0/4153744890 wait complete. 2024-08-19T00:13:42.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.421+0000 7f90b1d20740 1 -- start start 2024-08-19T00:13:42.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.421+0000 7f90b1d20740 1 Processor -- start 2024-08-19T00:13:42.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.421+0000 7f90b1d20740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560a6b63b510 0x560a6b647ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:42.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.421+0000 7f90b1d20740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a6b63be30 0x560a6b648000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:42.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.421+0000 7f90b1d20740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560a6b64ac20 0x560a6b648540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:42.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.421+0000 7f90b1d20740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x560a6b64d7f0 con 0x560a6b63be30 2024-08-19T00:13:42.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.421+0000 7f90b1d20740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x560a6b55b970 con 0x560a6b63b510 2024-08-19T00:13:42.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.421+0000 7f90b1d20740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x560a6b64d970 con 0x560a6b64ac20 2024-08-19T00:13:42.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.421+0000 7f90b1d20740 10 client.0 _ll_register_callbacks cb 0x560a6b2af7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:13:42.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.421+0000 7f90ad6be640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a6b63be30 0x560a6b648000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:42.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.422+0000 7f90ad6be640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a6b63be30 0x560a6b648000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51650/0 (socket says 172.21.15.44:51650) 2024-08-19T00:13:42.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.422+0000 7f90ad6be640 1 -- 172.21.15.44:0/3365123801 learned_addr learned my addr 172.21.15.44:0/3365123801 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:42.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.422+0000 7f90adebf640 1 --2- 172.21.15.44:0/3365123801 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560a6b63b510 0x560a6b647ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:42.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.422+0000 7f90adebf640 1 --2- 172.21.15.44:0/3365123801 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560a6b64ac20 0x560a6b648540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:42.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.422+0000 7f90ad6be640 1 -- 172.21.15.44:0/3365123801 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560a6b64ac20 msgr2=0x560a6b648540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:42.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.422+0000 7f90ad6be640 1 --2- 172.21.15.44:0/3365123801 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560a6b64ac20 0x560a6b648540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:42.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.422+0000 7f90ad6be640 1 -- 172.21.15.44:0/3365123801 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560a6b63b510 msgr2=0x560a6b647ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:42.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.422+0000 7f90ad6be640 1 --2- 172.21.15.44:0/3365123801 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560a6b63b510 0x560a6b647ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:42.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.422+0000 7f90ad6be640 1 -- 172.21.15.44:0/3365123801 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a6b3122b0 con 0x560a6b63be30 2024-08-19T00:13:42.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.422+0000 7f90adebf640 1 --2- 172.21.15.44:0/3365123801 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560a6b63b510 0x560a6b647ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:13:42.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.422+0000 7f90ad6be640 1 --2- 172.21.15.44:0/3365123801 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a6b63be30 0x560a6b648000 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f90a4010850 tx=0x7f90a4010d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29752d3ef206ff09 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:42.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.422+0000 7f9090ff9640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:13:42.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.422+0000 7f9090ff9640 1 -- 172.21.15.44:0/3365123801 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a400fb10 con 0x560a6b63be30 2024-08-19T00:13:42.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.422+0000 7f9090ff9640 1 -- 172.21.15.44:0/3365123801 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f90a400fcb0 con 0x560a6b63be30 2024-08-19T00:13:42.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.422+0000 7f90b1d20740 1 -- 172.21.15.44:0/3365123801 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f90a0036040 con 0x560a6b63be30 2024-08-19T00:13:42.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.422+0000 7f9090ff9640 1 -- 172.21.15.44:0/3365123801 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f90a4024050 con 0x560a6b63be30 2024-08-19T00:13:42.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.422+0000 7f90b1d20740 10 client.15552 fetch_fsmap learned FSMap version 28 2024-08-19T00:13:42.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.422+0000 7f90b1d20740 1 -- 172.21.15.44:0/3365123801 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560a6b6594b0 con 0x560a6b63be30 2024-08-19T00:13:42.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.422+0000 7f9090ff9640 1 -- 172.21.15.44:0/3365123801 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90a0036040 con 0x560a6b63be30 2024-08-19T00:13:42.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.423+0000 7f9090ff9640 1 -- 172.21.15.44:0/3365123801 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f90a4018530 con 0x560a6b63be30 2024-08-19T00:13:42.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.423+0000 7f90b1d20740 10 client.15552 fetch_fsmap finished waiting for FSMap version 28 2024-08-19T00:13:42.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.423+0000 7f90b1d20740 10 client.15552 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-19T00:13:42.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.423+0000 7f90b1d20740 20 client.15552 populate_metadata read hostname 'smithi044' 2024-08-19T00:13:42.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.423+0000 7f90b1d20740 1 --2- 172.21.15.44:0/3365123801 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x560a6b65bb50 0x560a6b65cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:42.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.423+0000 7f90b1d20740 4 client.15552 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:13:42.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.423+0000 7f90b1d20740 1 -- 172.21.15.44:0/3365123801 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560a6b5adc80 con 0x560a6b65bb50 2024-08-19T00:13:42.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.423+0000 7f90adebf640 1 --2- 172.21.15.44:0/3365123801 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x560a6b65bb50 0x560a6b65cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:42.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.423+0000 7f9090ff9640 10 client.15552 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:13:42.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.423+0000 7f90adebf640 1 --2- 172.21.15.44:0/3365123801 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x560a6b65bb50 0x560a6b65cfc0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=494c420e35d993d4 server_cookie=b236f40fa2c93ef9 in_seq=0 out_seq=0 2024-08-19T00:13:42.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.424+0000 7f9090ff9640 1 -- 172.21.15.44:0/3365123801 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560a6b5adc80 con 0x560a6b65bb50 2024-08-19T00:13:42.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.424+0000 7f9090ff9640 10 client.15552 handle_command_reply: tid=0 2024-08-19T00:13:42.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.424+0000 7f90b1d20740 1 client.15552 shutdown 2024-08-19T00:13:42.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.424+0000 7f90b1d20740 1 -- 172.21.15.44:0/3365123801 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a6b63be30 msgr2=0x560a6b648000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:42.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.424+0000 7f90b1d20740 1 --2- 172.21.15.44:0/3365123801 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a6b63be30 0x560a6b648000 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f90a4010850 tx=0x7f90a4010d10 comp rx=0 tx=0).stop 2024-08-19T00:13:42.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.424+0000 7f90b1d20740 1 -- 172.21.15.44:0/3365123801 shutdown_connections 2024-08-19T00:13:42.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.424+0000 7f90b1d20740 1 --2- 172.21.15.44:0/3365123801 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x560a6b65bb50 0x560a6b65cfc0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:42.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.424+0000 7f90b1d20740 1 --2- 172.21.15.44:0/3365123801 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560a6b64ac20 0x560a6b648540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:42.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.424+0000 7f9090ff9640 0 client.15552 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:13:42.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.424+0000 7f90b1d20740 1 --2- 172.21.15.44:0/3365123801 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a6b63be30 0x560a6b648000 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:42.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.424+0000 7f90b1d20740 1 --2- 172.21.15.44:0/3365123801 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560a6b63b510 0x560a6b647ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:42.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.424+0000 7f90b1d20740 1 -- 172.21.15.44:0/3365123801 >> 172.21.15.44:0/3365123801 conn(0x560a6b637bc0 msgr2=0x560a6b63d920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:42.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.424+0000 7f90b1d20740 1 -- 172.21.15.44:0/3365123801 shutdown_connections 2024-08-19T00:13:42.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.424+0000 7f90b1d20740 1 -- 172.21.15.44:0/3365123801 wait complete. 2024-08-19T00:13:42.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.425+0000 7f90b1d20740 20 client.15552 trim_cache size 0 max 16384 2024-08-19T00:13:42.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.443+0000 7f90b1d20740 1 Processor -- start 2024-08-19T00:13:42.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.443+0000 7f90b1d20740 1 -- start start 2024-08-19T00:13:42.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.443+0000 7f90b1d20740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560a6b63b510 0x560a6b656d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:42.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.443+0000 7f90b1d20740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560a6b63be30 0x560a6b648390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:42.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.443+0000 7f90b1d20740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a6b64ac20 0x560a6b646aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:42.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.443+0000 7f90b1d20740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x560a6b65b300 con 0x560a6b64ac20 2024-08-19T00:13:42.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.443+0000 7f90b1d20740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x560a6b65b9d0 con 0x560a6b63b510 2024-08-19T00:13:42.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.443+0000 7f90b1d20740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x560a6b65c0a0 con 0x560a6b63be30 2024-08-19T00:13:42.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.443+0000 7f90adebf640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a6b64ac20 0x560a6b646aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:42.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.443+0000 7f90adebf640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a6b64ac20 0x560a6b646aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51664/0 (socket says 172.21.15.44:51664) 2024-08-19T00:13:42.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.443+0000 7f90adebf640 1 -- 172.21.15.44:0/1174029417 learned_addr learned my addr 172.21.15.44:0/1174029417 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:42.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.443+0000 7f90adebf640 1 --2- 172.21.15.44:0/1174029417 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560a6b63b510 0x560a6b656d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:42.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.443+0000 7f90ad6be640 1 --2- 172.21.15.44:0/1174029417 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560a6b63be30 0x560a6b648390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:42.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.443+0000 7f90adebf640 1 -- 172.21.15.44:0/1174029417 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560a6b63be30 msgr2=0x560a6b648390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:42.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.444+0000 7f90adebf640 1 --2- 172.21.15.44:0/1174029417 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560a6b63be30 0x560a6b648390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:42.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.444+0000 7f90adebf640 1 -- 172.21.15.44:0/1174029417 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560a6b63b510 msgr2=0x560a6b656d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:42.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.444+0000 7f90adebf640 1 --2- 172.21.15.44:0/1174029417 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560a6b63b510 0x560a6b656d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:42.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.444+0000 7f90adebf640 1 -- 172.21.15.44:0/1174029417 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a6b646010 con 0x560a6b64ac20 2024-08-19T00:13:42.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.444+0000 7f90ad6be640 1 --2- 172.21.15.44:0/1174029417 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560a6b63be30 0x560a6b648390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:13:42.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.444+0000 7f90adebf640 1 --2- 172.21.15.44:0/1174029417 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a6b64ac20 0x560a6b646aa0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f90a0031580 tx=0x7f90a00317d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1041d7ce64775f85 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:42.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.444+0000 7f9092ffd640 1 -- 172.21.15.44:0/1174029417 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a0031b10 con 0x560a6b64ac20 2024-08-19T00:13:42.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.444+0000 7f9092ffd640 1 -- 172.21.15.44:0/1174029417 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90a0053020 con 0x560a6b64ac20 2024-08-19T00:13:42.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.444+0000 7f9092ffd640 1 -- 172.21.15.44:0/1174029417 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a0030ed0 con 0x560a6b64ac20 2024-08-19T00:13:42.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.445+0000 7f90b1d20740 1 -- 172.21.15.44:0/1174029417 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a6b64ac20 msgr2=0x560a6b646aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:42.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.445+0000 7f90b1d20740 1 --2- 172.21.15.44:0/1174029417 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a6b64ac20 0x560a6b646aa0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f90a0031580 tx=0x7f90a00317d0 comp rx=0 tx=0).stop 2024-08-19T00:13:42.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.445+0000 7f90b1d20740 1 -- 172.21.15.44:0/1174029417 shutdown_connections 2024-08-19T00:13:42.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.445+0000 7f90b1d20740 1 --2- 172.21.15.44:0/1174029417 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560a6b63be30 0x560a6b648390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:42.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.445+0000 7f90b1d20740 1 --2- 172.21.15.44:0/1174029417 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a6b64ac20 0x560a6b646aa0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:42.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.445+0000 7f90b1d20740 1 --2- 172.21.15.44:0/1174029417 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560a6b63b510 0x560a6b656d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:42.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.445+0000 7f90b1d20740 1 -- 172.21.15.44:0/1174029417 >> 172.21.15.44:0/1174029417 conn(0x560a6b637bc0 msgr2=0x560a6b646390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:42.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.445+0000 7f90b1d20740 1 -- 172.21.15.44:0/1174029417 shutdown_connections 2024-08-19T00:13:42.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.445+0000 7f90b1d20740 1 -- 172.21.15.44:0/1174029417 wait complete. 2024-08-19T00:13:42.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.445+0000 7f90b1d20740 1 -- start start 2024-08-19T00:13:42.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.445+0000 7f90b1d20740 1 Processor -- start 2024-08-19T00:13:42.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.445+0000 7f90b1d20740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560a6b63b510 0x560a6b6657e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:42.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.445+0000 7f90b1d20740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a6b63be30 0x560a6b65eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:42.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.445+0000 7f90b1d20740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560a6b64ac20 0x560a6b65f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:42.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.446+0000 7f90b1d20740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x560a6b65ce40 con 0x560a6b63be30 2024-08-19T00:13:42.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.446+0000 7f90b1d20740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x560a6b65c770 con 0x560a6b64ac20 2024-08-19T00:13:42.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.446+0000 7f90b1d20740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x560a6b65d510 con 0x560a6b63b510 2024-08-19T00:13:42.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.446+0000 7f90b1d20740 10 client.0 _ll_register_callbacks cb 0x7f90a400a720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:13:42.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.446+0000 7f90ad6be640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a6b63be30 0x560a6b65eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:42.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.446+0000 7f90ad6be640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a6b63be30 0x560a6b65eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51676/0 (socket says 172.21.15.44:51676) 2024-08-19T00:13:42.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.446+0000 7f90ad6be640 1 -- 172.21.15.44:0/2310397844 learned_addr learned my addr 172.21.15.44:0/2310397844 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:42.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.446+0000 7f90adebf640 1 --2- 172.21.15.44:0/2310397844 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560a6b63b510 0x560a6b6657e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:42.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.446+0000 7f90adebf640 1 --2- 172.21.15.44:0/2310397844 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560a6b64ac20 0x560a6b65f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:42.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.446+0000 7f90ad6be640 1 -- 172.21.15.44:0/2310397844 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560a6b63b510 msgr2=0x560a6b6657e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:42.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.446+0000 7f90ad6be640 1 --2- 172.21.15.44:0/2310397844 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560a6b63b510 0x560a6b6657e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:42.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.446+0000 7f90ad6be640 1 -- 172.21.15.44:0/2310397844 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560a6b64ac20 msgr2=0x560a6b65f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:42.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.446+0000 7f90ad6be640 1 --2- 172.21.15.44:0/2310397844 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560a6b64ac20 0x560a6b65f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:42.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.446+0000 7f90ad6be640 1 -- 172.21.15.44:0/2310397844 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a6b65f640 con 0x560a6b63be30 2024-08-19T00:13:42.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.446+0000 7f90ad6be640 1 --2- 172.21.15.44:0/2310397844 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a6b63be30 0x560a6b65eb10 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x560a6b649100 tx=0x7f90a4018ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44a7b43e29b720f1 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:42.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.446+0000 7f9090ff9640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:13:42.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.446+0000 7f9090ff9640 1 -- 172.21.15.44:0/2310397844 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a402d060 con 0x560a6b63be30 2024-08-19T00:13:42.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.446+0000 7f9090ff9640 1 -- 172.21.15.44:0/2310397844 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f90a400fd20 con 0x560a6b63be30 2024-08-19T00:13:42.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.446+0000 7f90b1d20740 1 -- 172.21.15.44:0/2310397844 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f90a0053020 con 0x560a6b63be30 2024-08-19T00:13:42.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.447+0000 7f9090ff9640 1 -- 172.21.15.44:0/2310397844 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f90a4018370 con 0x560a6b63be30 2024-08-19T00:13:42.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.447+0000 7f90b1d20740 10 client.15558 fetch_fsmap learned FSMap version 28 2024-08-19T00:13:42.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.447+0000 7f90b1d20740 1 -- 172.21.15.44:0/2310397844 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560a6b6640c0 con 0x560a6b63be30 2024-08-19T00:13:42.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.447+0000 7f9090ff9640 1 -- 172.21.15.44:0/2310397844 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90a0053020 con 0x560a6b63be30 2024-08-19T00:13:42.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.447+0000 7f9090ff9640 1 -- 172.21.15.44:0/2310397844 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f90a4004660 con 0x560a6b63be30 2024-08-19T00:13:42.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.447+0000 7f90b1d20740 10 client.15558 fetch_fsmap finished waiting for FSMap version 28 2024-08-19T00:13:42.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.447+0000 7f90b1d20740 10 client.15558 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-19T00:13:42.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.447+0000 7f90b1d20740 20 client.15558 populate_metadata read hostname 'smithi044' 2024-08-19T00:13:42.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.447+0000 7f90b1d20740 1 --2- 172.21.15.44:0/2310397844 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x560a6b6cac20 0x560a6b6c9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:42.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.447+0000 7f90b1d20740 4 client.15558 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-19T00:13:42.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.447+0000 7f90b1d20740 1 -- 172.21.15.44:0/2310397844 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "status"}) -- 0x560a6b5a8190 con 0x560a6b6cac20 2024-08-19T00:13:42.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.447+0000 7f90adebf640 1 --2- 172.21.15.44:0/2310397844 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x560a6b6cac20 0x560a6b6c9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:42.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.448+0000 7f90adebf640 1 --2- 172.21.15.44:0/2310397844 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x560a6b6cac20 0x560a6b6c9930 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46629c2a4e6bf0ef server_cookie=4d2b70cd894919a8 in_seq=0 out_seq=0 2024-08-19T00:13:42.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.448+0000 7f9090ff9640 10 client.15558 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:13:42.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.448+0000 7f9090ff9640 1 -- 172.21.15.44:0/2310397844 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x560a6b5a8190 con 0x560a6b6cac20 2024-08-19T00:13:42.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.448+0000 7f9090ff9640 10 client.15558 handle_command_reply: tid=0 2024-08-19T00:13:42.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.448+0000 7f90b1d20740 1 client.15558 shutdown 2024-08-19T00:13:42.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.448+0000 7f90b1d20740 1 -- 172.21.15.44:0/2310397844 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a6b63be30 msgr2=0x560a6b65eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:42.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.448+0000 7f90b1d20740 1 --2- 172.21.15.44:0/2310397844 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a6b63be30 0x560a6b65eb10 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x560a6b649100 tx=0x7f90a4018ef0 comp rx=0 tx=0).stop 2024-08-19T00:13:42.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.448+0000 7f90b1d20740 1 -- 172.21.15.44:0/2310397844 shutdown_connections 2024-08-19T00:13:42.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.448+0000 7f90b1d20740 1 --2- 172.21.15.44:0/2310397844 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x560a6b6cac20 0x560a6b6c9930 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:42.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.448+0000 7f90b1d20740 1 --2- 172.21.15.44:0/2310397844 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560a6b64ac20 0x560a6b65f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:42.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.448+0000 7f90b1d20740 1 --2- 172.21.15.44:0/2310397844 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560a6b63be30 0x560a6b65eb10 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:42.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.448+0000 7f90b1d20740 1 --2- 172.21.15.44:0/2310397844 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560a6b63b510 0x560a6b6657e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:42.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.448+0000 7f90b1d20740 1 -- 172.21.15.44:0/2310397844 >> 172.21.15.44:0/2310397844 conn(0x560a6b637bc0 msgr2=0x560a6b646bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:42.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.448+0000 7f9090ff9640 0 client.15558 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:13:42.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.448+0000 7f90b1d20740 1 -- 172.21.15.44:0/2310397844 shutdown_connections 2024-08-19T00:13:42.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.448+0000 7f90b1d20740 1 -- 172.21.15.44:0/2310397844 wait complete. 2024-08-19T00:13:42.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.448+0000 7f90b1d20740 20 client.15558 trim_cache size 0 max 16384 2024-08-19T00:13:42.456 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-08-19T00:13:42.456 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "647ded64-5dbe-11ef-bccf-c7b262605968", 2024-08-19T00:13:42.456 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 0, 2024-08-19T00:13:42.457 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 24473, 2024-08-19T00:13:42.457 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-08-19T00:13:42.457 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-08-19T00:13:42.457 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-08-19T00:13:42.457 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 168.948504429, 2024-08-19T00:13:42.457 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 28, 2024-08-19T00:13:42.457 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 95, 2024-08-19T00:13:42.457 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 94, 2024-08-19T00:13:42.457 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 180.87378076799999 2024-08-19T00:13:42.457 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-08-19T00:13:42.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.449+0000 7f90af922640 1 -- 172.21.15.44:0/2643595836 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f90940a2e90 msgr2=0x7f90940a5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:42.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.449+0000 7f90af922640 1 --2- 172.21.15.44:0/2643595836 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f90940a2e90 0x7f90940a5350 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f90980cc870 tx=0x7f909800dfa0 comp rx=0 tx=0).stop 2024-08-19T00:13:42.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.449+0000 7f90af922640 1 -- 172.21.15.44:0/2643595836 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f90a8102250 msgr2=0x7f90a8198680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:42.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.449+0000 7f90af922640 1 --2- 172.21.15.44:0/2643595836 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f90a8102250 0x7f90a8198680 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f909800d950 tx=0x7f909800de10 comp rx=0 tx=0).stop 2024-08-19T00:13:42.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.449+0000 7f90af922640 1 -- 172.21.15.44:0/2643595836 shutdown_connections 2024-08-19T00:13:42.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.449+0000 7f90af922640 1 --2- 172.21.15.44:0/2643595836 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f90940a2e90 0x7f90940a5350 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:42.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.449+0000 7f90af922640 1 --2- 172.21.15.44:0/2643595836 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f90a81078b0 0x7f90a819ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:42.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.449+0000 7f90af922640 1 --2- 172.21.15.44:0/2643595836 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f90a8102250 0x7f90a8198680 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:42.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.449+0000 7f90af922640 1 --2- 172.21.15.44:0/2643595836 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90a81018b0 0x7f90a8198140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:42.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.449+0000 7f90af922640 1 -- 172.21.15.44:0/2643595836 >> 172.21.15.44:0/2643595836 conn(0x7f90a80fd5f0 msgr2=0x7f90a80fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:42.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.449+0000 7f90af922640 1 -- 172.21.15.44:0/2643595836 shutdown_connections 2024-08-19T00:13:42.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:42.449+0000 7f90af922640 1 -- 172.21.15.44:0/2643595836 wait complete. 2024-08-19T00:13:43.163 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-08-19T00:13:44.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:43 smithi171 ceph-mon[21810]: pgmap v15: 129 pgs: 129 active+clean; 1.3 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.2 KiB/s wr, 13 op/s 2024-08-19T00:13:44.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:43 smithi116 ceph-mon[21873]: pgmap v15: 129 pgs: 129 active+clean; 1.3 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.2 KiB/s wr, 13 op/s 2024-08-19T00:13:44.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:43 smithi044 ceph-mon[18489]: pgmap v15: 129 pgs: 129 active+clean; 1.3 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.2 KiB/s wr, 13 op/s 2024-08-19T00:13:46.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:45 smithi171 ceph-mon[21810]: pgmap v16: 129 pgs: 129 active+clean; 1.3 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2024-08-19T00:13:46.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:45 smithi116 ceph-mon[21873]: pgmap v16: 129 pgs: 129 active+clean; 1.3 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2024-08-19T00:13:46.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:45 smithi044 ceph-mon[18489]: pgmap v16: 129 pgs: 129 active+clean; 1.3 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2024-08-19T00:13:48.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:47 smithi171 ceph-mon[21810]: pgmap v17: 129 pgs: 129 active+clean; 1.3 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.2 KiB/s wr, 16 op/s 2024-08-19T00:13:48.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:47 smithi116 ceph-mon[21873]: pgmap v17: 129 pgs: 129 active+clean; 1.3 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.2 KiB/s wr, 16 op/s 2024-08-19T00:13:48.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:47 smithi044 ceph-mon[18489]: pgmap v17: 129 pgs: 129 active+clean; 1.3 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.2 KiB/s wr, 16 op/s 2024-08-19T00:13:48.623 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.619+0000 7fd88f954640 1 -- 172.21.15.44:0/2080652321 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd888101080 msgr2=0x7fd88810d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:48.623 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.619+0000 7fd88f954640 1 --2- 172.21.15.44:0/2080652321 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd888101080 0x7fd88810d5b0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fd880009cd0 tx=0x7fd88002a8e0 comp rx=0 tx=0).stop 2024-08-19T00:13:48.623 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.619+0000 7fd88f954640 1 -- 172.21.15.44:0/2080652321 shutdown_connections 2024-08-19T00:13:48.623 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.619+0000 7fd88f954640 1 --2- 172.21.15.44:0/2080652321 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd888101080 0x7fd88810d5b0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:48.623 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.619+0000 7fd88f954640 1 --2- 172.21.15.44:0/2080652321 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd8881006e0 0x7fd888100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:48.623 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.619+0000 7fd88f954640 1 --2- 172.21.15.44:0/2080652321 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd8881066f0 0x7fd888106ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:48.623 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.619+0000 7fd88f954640 1 -- 172.21.15.44:0/2080652321 >> 172.21.15.44:0/2080652321 conn(0x7fd8880776c0 msgr2=0x7fd8880fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:48.623 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.619+0000 7fd88f954640 1 -- 172.21.15.44:0/2080652321 shutdown_connections 2024-08-19T00:13:48.623 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.619+0000 7fd88f954640 1 -- 172.21.15.44:0/2080652321 wait complete. 2024-08-19T00:13:48.623 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.620+0000 7fd88f954640 1 Processor -- start 2024-08-19T00:13:48.624 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.620+0000 7fd88f954640 1 -- start start 2024-08-19T00:13:48.624 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.620+0000 7fd88f954640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd8881006e0 0x7fd888198ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:48.624 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.620+0000 7fd88f954640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd888101080 0x7fd888199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:48.624 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.620+0000 7fd88f954640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd8881066f0 0x7fd8881a3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:48.624 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.620+0000 7fd88f954640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd888110b80 con 0x7fd8881006e0 2024-08-19T00:13:48.624 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.620+0000 7fd88f954640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fd888110a00 con 0x7fd8881066f0 2024-08-19T00:13:48.624 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.620+0000 7fd88f954640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd888110d00 con 0x7fd888101080 2024-08-19T00:13:48.624 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.620+0000 7fd88d6f0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd8881006e0 0x7fd888198ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:48.624 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.620+0000 7fd88d6f0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd8881006e0 0x7fd888198ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51688/0 (socket says 172.21.15.44:51688) 2024-08-19T00:13:48.624 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.620+0000 7fd88d6f0640 1 -- 172.21.15.44:0/2256938468 learned_addr learned my addr 172.21.15.44:0/2256938468 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:48.624 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.620+0000 7fd88def1640 1 --2- 172.21.15.44:0/2256938468 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd8881066f0 0x7fd8881a3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:48.624 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.620+0000 7fd88ceef640 1 --2- 172.21.15.44:0/2256938468 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd888101080 0x7fd888199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:48.625 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.620+0000 7fd88d6f0640 1 -- 172.21.15.44:0/2256938468 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd888101080 msgr2=0x7fd888199430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:48.625 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.620+0000 7fd88d6f0640 1 --2- 172.21.15.44:0/2256938468 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd888101080 0x7fd888199430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:48.625 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.620+0000 7fd88d6f0640 1 -- 172.21.15.44:0/2256938468 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd8881066f0 msgr2=0x7fd8881a3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:48.625 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.620+0000 7fd88d6f0640 1 --2- 172.21.15.44:0/2256938468 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd8881066f0 0x7fd8881a3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:48.625 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.620+0000 7fd88d6f0640 1 -- 172.21.15.44:0/2256938468 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8881a44b0 con 0x7fd8881006e0 2024-08-19T00:13:48.625 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.621+0000 7fd88d6f0640 1 --2- 172.21.15.44:0/2256938468 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd8881006e0 0x7fd888198ef0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fd88400b4a0 tx=0x7fd88400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:48.625 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.621+0000 7fd87e7fc640 1 -- 172.21.15.44:0/2256938468 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd884014070 con 0x7fd8881006e0 2024-08-19T00:13:48.625 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.621+0000 7fd87e7fc640 1 -- 172.21.15.44:0/2256938468 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd884010af0 con 0x7fd8881006e0 2024-08-19T00:13:48.625 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.621+0000 7fd88f954640 1 -- 172.21.15.44:0/2256938468 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8881a4680 con 0x7fd8881006e0 2024-08-19T00:13:48.625 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.621+0000 7fd87e7fc640 1 -- 172.21.15.44:0/2256938468 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd884017d10 con 0x7fd8881006e0 2024-08-19T00:13:48.625 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.621+0000 7fd88f954640 1 -- 172.21.15.44:0/2256938468 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8881a4bf0 con 0x7fd8881006e0 2024-08-19T00:13:48.631 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.623+0000 7fd87e7fc640 1 -- 172.21.15.44:0/2256938468 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 24) ==== 138060+0+0 (secure 0 0 0) 0x7fd884017070 con 0x7fd8881006e0 2024-08-19T00:13:48.632 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.624+0000 7fd8927f1740 1 Processor -- start 2024-08-19T00:13:48.632 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.624+0000 7fd8927f1740 1 -- start start 2024-08-19T00:13:48.632 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.624+0000 7fd8927f1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d1d87dd6d0 0x55d1d87ddab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:48.632 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.624+0000 7fd8927f1740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1d87ddff0 0x55d1d87ec860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:48.632 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.624+0000 7fd8927f1740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d1d87ecda0 0x55d1d87ef190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:48.632 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.624+0000 7fd8927f1740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55d1d87419d0 con 0x55d1d87dd6d0 2024-08-19T00:13:48.632 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.624+0000 7fd8927f1740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55d1d86e9820 con 0x55d1d87ddff0 2024-08-19T00:13:48.632 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.624+0000 7fd8927f1740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55d1d873d990 con 0x55d1d87ecda0 2024-08-19T00:13:48.632 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.624+0000 7fd88def1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d1d87dd6d0 0x55d1d87ddab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:48.632 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.624+0000 7fd88def1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d1d87dd6d0 0x55d1d87ddab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51704/0 (socket says 172.21.15.44:51704) 2024-08-19T00:13:48.632 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.624+0000 7fd88def1640 1 -- 172.21.15.44:0/4000107922 learned_addr learned my addr 172.21.15.44:0/4000107922 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:48.632 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.624+0000 7fd87e7fc640 1 --2- 172.21.15.44:0/2256938468 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fd8740a2f40 0x7fd8740a5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:48.633 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.624+0000 7fd88d6f0640 1 --2- 172.21.15.44:0/4000107922 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1d87ddff0 0x55d1d87ec860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:48.633 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.624+0000 7fd88def1640 1 --2- 172.21.15.44:0/2256938468 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fd8740a2f40 0x7fd8740a5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:48.633 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.624+0000 7fd88ceef640 1 --2- 172.21.15.44:0/4000107922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d1d87ecda0 0x55d1d87ef190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:48.633 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.624+0000 7fd87e7fc640 1 -- 172.21.15.44:0/2256938468 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7fd8840ced30 con 0x7fd8881006e0 2024-08-19T00:13:48.633 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.624+0000 7fd88def1640 1 -- 172.21.15.44:0/4000107922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d1d87ecda0 msgr2=0x55d1d87ef190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:48.633 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.624+0000 7fd88def1640 1 --2- 172.21.15.44:0/4000107922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d1d87ecda0 0x55d1d87ef190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:48.633 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.624+0000 7fd88def1640 1 -- 172.21.15.44:0/4000107922 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1d87ddff0 msgr2=0x55d1d87ec860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:48.633 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.624+0000 7fd88def1640 1 --2- 172.21.15.44:0/4000107922 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1d87ddff0 0x55d1d87ec860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:48.633 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.624+0000 7fd88def1640 1 -- 172.21.15.44:0/4000107922 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1d8455210 con 0x55d1d87dd6d0 2024-08-19T00:13:48.633 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.624+0000 7fd88d6f0640 1 --2- 172.21.15.44:0/4000107922 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1d87ddff0 0x55d1d87ec860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:13:48.633 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.625+0000 7fd88def1640 1 --2- 172.21.15.44:0/4000107922 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d1d87dd6d0 0x55d1d87ddab0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fd880005fe0 tx=0x7fd880031c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5981b6f4c01fa43b server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:48.633 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.625+0000 7fd8737fe640 1 -- 172.21.15.44:0/4000107922 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd880004b40 con 0x55d1d87dd6d0 2024-08-19T00:13:48.633 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.625+0000 7fd88def1640 1 --2- 172.21.15.44:0/2256938468 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fd8740a2f40 0x7fd8740a5400 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd88004d000 tx=0x7fd88004b000 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:48.634 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.625+0000 7fd8737fe640 1 -- 172.21.15.44:0/4000107922 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd880036040 con 0x55d1d87dd6d0 2024-08-19T00:13:48.634 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.625+0000 7fd8737fe640 1 -- 172.21.15.44:0/4000107922 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd880030ae0 con 0x55d1d87dd6d0 2024-08-19T00:13:48.634 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.626+0000 7fd8927f1740 1 -- 172.21.15.44:0/4000107922 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d1d87dd6d0 msgr2=0x55d1d87ddab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:48.634 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.626+0000 7fd8927f1740 1 --2- 172.21.15.44:0/4000107922 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d1d87dd6d0 0x55d1d87ddab0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fd880005fe0 tx=0x7fd880031c00 comp rx=0 tx=0).stop 2024-08-19T00:13:48.634 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.626+0000 7fd8927f1740 1 -- 172.21.15.44:0/4000107922 shutdown_connections 2024-08-19T00:13:48.634 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.626+0000 7fd8927f1740 1 --2- 172.21.15.44:0/4000107922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d1d87ecda0 0x55d1d87ef190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:48.634 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.626+0000 7fd8927f1740 1 --2- 172.21.15.44:0/4000107922 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1d87ddff0 0x55d1d87ec860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:48.634 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.626+0000 7fd8927f1740 1 --2- 172.21.15.44:0/4000107922 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d1d87dd6d0 0x55d1d87ddab0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:48.634 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.626+0000 7fd8927f1740 1 -- 172.21.15.44:0/4000107922 >> 172.21.15.44:0/4000107922 conn(0x55d1d87d9d40 msgr2=0x55d1d87da120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:48.634 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.626+0000 7fd8927f1740 1 -- 172.21.15.44:0/4000107922 shutdown_connections 2024-08-19T00:13:48.634 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.626+0000 7fd8927f1740 1 -- 172.21.15.44:0/4000107922 wait complete. 2024-08-19T00:13:48.634 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.626+0000 7fd8927f1740 1 -- start start 2024-08-19T00:13:48.634 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.626+0000 7fd8927f1740 1 Processor -- start 2024-08-19T00:13:48.634 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.627+0000 7fd8927f1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d1d87dd6d0 0x55d1d87e9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:48.635 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.627+0000 7fd8927f1740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1d87ddff0 0x55d1d87ea2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:48.635 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.627+0000 7fd8927f1740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d1d87ecda0 0x55d1d87ea800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:48.635 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.627+0000 7fd8927f1740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55d1d87efa00 con 0x55d1d87dd6d0 2024-08-19T00:13:48.635 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.627+0000 7fd8927f1740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55d1d86fd520 con 0x55d1d87ddff0 2024-08-19T00:13:48.635 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.627+0000 7fd8927f1740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55d1d87efb80 con 0x55d1d87ecda0 2024-08-19T00:13:48.635 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.627+0000 7fd8927f1740 10 client.0 _ll_register_callbacks cb 0x55d1d8454a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:13:48.635 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.627+0000 7fd88d6f0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d1d87dd6d0 0x55d1d87e9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:48.635 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.627+0000 7fd88d6f0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d1d87dd6d0 0x55d1d87e9d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51710/0 (socket says 172.21.15.44:51710) 2024-08-19T00:13:48.635 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.627+0000 7fd88d6f0640 1 -- 172.21.15.44:0/274941666 learned_addr learned my addr 172.21.15.44:0/274941666 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:48.635 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.627+0000 7fd88ceef640 1 --2- 172.21.15.44:0/274941666 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1d87ddff0 0x55d1d87ea2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:48.635 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.627+0000 7fd88def1640 1 --2- 172.21.15.44:0/274941666 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d1d87ecda0 0x55d1d87ea800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:48.635 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.627+0000 7fd88d6f0640 1 -- 172.21.15.44:0/274941666 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d1d87ecda0 msgr2=0x55d1d87ea800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:48.635 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.627+0000 7fd88d6f0640 1 --2- 172.21.15.44:0/274941666 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d1d87ecda0 0x55d1d87ea800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.627+0000 7fd88d6f0640 1 -- 172.21.15.44:0/274941666 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1d87ddff0 msgr2=0x55d1d87ea2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.627+0000 7fd88d6f0640 1 --2- 172.21.15.44:0/274941666 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1d87ddff0 0x55d1d87ea2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.627+0000 7fd88d6f0640 1 -- 172.21.15.44:0/274941666 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1d8521620 con 0x55d1d87dd6d0 2024-08-19T00:13:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.628+0000 7fd88d6f0640 1 --2- 172.21.15.44:0/274941666 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d1d87dd6d0 0x55d1d87e9d80 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fd88400be60 tx=0x7fd8840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15241a0e15c50962 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.628+0000 7fd870ff9640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:13:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.628+0000 7fd870ff9640 1 -- 172.21.15.44:0/274941666 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd88401e070 con 0x55d1d87dd6d0 2024-08-19T00:13:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.628+0000 7fd870ff9640 1 -- 172.21.15.44:0/274941666 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7fd884017360 con 0x55d1d87dd6d0 2024-08-19T00:13:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.628+0000 7fd8927f1740 1 -- 172.21.15.44:0/274941666 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd880036040 con 0x55d1d87dd6d0 2024-08-19T00:13:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.628+0000 7fd870ff9640 1 -- 172.21.15.44:0/274941666 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd88409f120 con 0x55d1d87dd6d0 2024-08-19T00:13:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.628+0000 7fd8927f1740 10 client.15570 fetch_fsmap learned FSMap version 28 2024-08-19T00:13:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.628+0000 7fd8927f1740 1 -- 172.21.15.44:0/274941666 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d1d87fb750 con 0x55d1d87dd6d0 2024-08-19T00:13:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.628+0000 7fd870ff9640 1 -- 172.21.15.44:0/274941666 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd880036040 con 0x55d1d87dd6d0 2024-08-19T00:13:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.628+0000 7fd870ff9640 1 -- 172.21.15.44:0/274941666 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fd8840c9230 con 0x55d1d87dd6d0 2024-08-19T00:13:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.628+0000 7fd8927f1740 10 client.15570 fetch_fsmap finished waiting for FSMap version 28 2024-08-19T00:13:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.628+0000 7fd8927f1740 10 client.15570 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:13:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.628+0000 7fd8927f1740 20 client.15570 populate_metadata read hostname 'smithi044' 2024-08-19T00:13:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.628+0000 7fd8927f1740 1 --2- 172.21.15.44:0/274941666 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55d1d87fcc10 0x55d1d87ff020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.628+0000 7fd8927f1740 4 client.15570 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:13:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.628+0000 7fd8927f1740 1 -- 172.21.15.44:0/274941666 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d1d874f100 con 0x55d1d87fcc10 2024-08-19T00:13:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.629+0000 7fd88ceef640 1 --2- 172.21.15.44:0/274941666 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55d1d87fcc10 0x55d1d87ff020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.629+0000 7fd870ff9640 10 client.15570 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:13:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.629+0000 7fd88ceef640 1 --2- 172.21.15.44:0/274941666 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55d1d87fcc10 0x55d1d87ff020 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f1346e998de083c server_cookie=4841dacd9601b89e in_seq=0 out_seq=0 2024-08-19T00:13:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.630+0000 7fd870ff9640 1 -- 172.21.15.44:0/274941666 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d1d874f100 con 0x55d1d87fcc10 2024-08-19T00:13:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.630+0000 7fd870ff9640 10 client.15570 handle_command_reply: tid=0 2024-08-19T00:13:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.630+0000 7fd8927f1740 1 client.15570 shutdown 2024-08-19T00:13:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.630+0000 7fd8927f1740 1 -- 172.21.15.44:0/274941666 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d1d87dd6d0 msgr2=0x55d1d87e9d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.630+0000 7fd8927f1740 1 --2- 172.21.15.44:0/274941666 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d1d87dd6d0 0x55d1d87e9d80 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fd88400be60 tx=0x7fd8840046c0 comp rx=0 tx=0).stop 2024-08-19T00:13:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.630+0000 7fd8927f1740 1 -- 172.21.15.44:0/274941666 shutdown_connections 2024-08-19T00:13:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.630+0000 7fd8927f1740 1 --2- 172.21.15.44:0/274941666 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55d1d87fcc10 0x55d1d87ff020 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.630+0000 7fd8927f1740 1 --2- 172.21.15.44:0/274941666 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d1d87ecda0 0x55d1d87ea800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.630+0000 7fd8927f1740 1 --2- 172.21.15.44:0/274941666 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1d87ddff0 0x55d1d87ea2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.630+0000 7fd8927f1740 1 --2- 172.21.15.44:0/274941666 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d1d87dd6d0 0x55d1d87e9d80 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.630+0000 7fd870ff9640 0 client.15570 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:13:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.630+0000 7fd8927f1740 1 -- 172.21.15.44:0/274941666 >> 172.21.15.44:0/274941666 conn(0x55d1d87d9d40 msgr2=0x55d1d87dfaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.630+0000 7fd8927f1740 1 -- 172.21.15.44:0/274941666 shutdown_connections 2024-08-19T00:13:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.630+0000 7fd8927f1740 1 -- 172.21.15.44:0/274941666 wait complete. 2024-08-19T00:13:48.639 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.630+0000 7fd8927f1740 20 client.15570 trim_cache size 0 max 16384 2024-08-19T00:13:48.647 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.645+0000 7fd8927f1740 1 Processor -- start 2024-08-19T00:13:48.647 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.645+0000 7fd8927f1740 1 -- start start 2024-08-19T00:13:48.647 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.645+0000 7fd8927f1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d1d87dd6d0 0x55d1d87ebbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:48.647 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.645+0000 7fd8927f1740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d1d87ddff0 0x55d1d8804930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:48.647 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.645+0000 7fd8927f1740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1d87ecda0 0x55d1d8804e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:48.647 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.645+0000 7fd8927f1740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd8881acad0 con 0x55d1d87dd6d0 2024-08-19T00:13:48.647 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.645+0000 7fd8927f1740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fd8881ae610 con 0x55d1d87ecda0 2024-08-19T00:13:48.648 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.645+0000 7fd8927f1740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd8881ad1a0 con 0x55d1d87ddff0 2024-08-19T00:13:48.648 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.645+0000 7fd88d6f0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d1d87dd6d0 0x55d1d87ebbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:48.648 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.645+0000 7fd88d6f0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d1d87dd6d0 0x55d1d87ebbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51724/0 (socket says 172.21.15.44:51724) 2024-08-19T00:13:48.648 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.645+0000 7fd88d6f0640 1 -- 172.21.15.44:0/692179757 learned_addr learned my addr 172.21.15.44:0/692179757 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:48.648 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.645+0000 7fd88d6f0640 1 -- 172.21.15.44:0/692179757 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d1d87ddff0 msgr2=0x55d1d8804930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:48.648 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.645+0000 7fd88d6f0640 1 --2- 172.21.15.44:0/692179757 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d1d87ddff0 0x55d1d8804930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:48.648 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.645+0000 7fd88def1640 1 --2- 172.21.15.44:0/692179757 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1d87ecda0 0x55d1d8804e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:48.648 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.645+0000 7fd88d6f0640 1 -- 172.21.15.44:0/692179757 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1d87ecda0 msgr2=0x55d1d8804e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:48.648 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.645+0000 7fd88d6f0640 1 --2- 172.21.15.44:0/692179757 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1d87ecda0 0x55d1d8804e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:48.648 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.645+0000 7fd88d6f0640 1 -- 172.21.15.44:0/692179757 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1d87dde20 con 0x55d1d87dd6d0 2024-08-19T00:13:48.648 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.645+0000 7fd88d6f0640 1 --2- 172.21.15.44:0/692179757 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d1d87dd6d0 0x55d1d87ebbe0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fd8840cc180 tx=0x7fd88400bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f95cbbd388ef578e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:48.648 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.646+0000 7fd872ffd640 1 -- 172.21.15.44:0/692179757 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd88401e070 con 0x55d1d87dd6d0 2024-08-19T00:13:48.648 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.646+0000 7fd872ffd640 1 -- 172.21.15.44:0/692179757 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd8840a39e0 con 0x55d1d87dd6d0 2024-08-19T00:13:48.648 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.646+0000 7fd872ffd640 1 -- 172.21.15.44:0/692179757 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8840c9230 con 0x55d1d87dd6d0 2024-08-19T00:13:48.652 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.646+0000 7fd8927f1740 1 -- 172.21.15.44:0/692179757 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d1d87dd6d0 msgr2=0x55d1d87ebbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:48.652 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.646+0000 7fd8927f1740 1 --2- 172.21.15.44:0/692179757 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d1d87dd6d0 0x55d1d87ebbe0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fd8840cc180 tx=0x7fd88400bf90 comp rx=0 tx=0).stop 2024-08-19T00:13:48.652 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.646+0000 7fd8927f1740 1 -- 172.21.15.44:0/692179757 shutdown_connections 2024-08-19T00:13:48.652 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.646+0000 7fd8927f1740 1 --2- 172.21.15.44:0/692179757 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d1d87ddff0 0x55d1d8804930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:48.652 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.646+0000 7fd8927f1740 1 --2- 172.21.15.44:0/692179757 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1d87ecda0 0x55d1d8804e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:48.652 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.646+0000 7fd8927f1740 1 --2- 172.21.15.44:0/692179757 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d1d87dd6d0 0x55d1d87ebbe0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.646+0000 7fd8927f1740 1 -- 172.21.15.44:0/692179757 >> 172.21.15.44:0/692179757 conn(0x55d1d87d9d40 msgr2=0x55d1d87eb4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.646+0000 7fd8927f1740 1 -- 172.21.15.44:0/692179757 shutdown_connections 2024-08-19T00:13:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.646+0000 7fd8927f1740 1 -- 172.21.15.44:0/692179757 wait complete. 2024-08-19T00:13:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.647+0000 7fd8927f1740 1 -- start start 2024-08-19T00:13:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.647+0000 7fd8927f1740 1 Processor -- start 2024-08-19T00:13:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.647+0000 7fd8927f1740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d1d87dd6d0 0x55d1d87f0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.647+0000 7fd8927f1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d1d87ddff0 0x55d1d87f1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.647+0000 7fd8927f1740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1d87ecda0 0x55d1d87f1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.647+0000 7fd8927f1740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd8881adf40 con 0x55d1d87ddff0 2024-08-19T00:13:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.647+0000 7fd8927f1740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fd8881ad870 con 0x55d1d87ecda0 2024-08-19T00:13:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.647+0000 7fd8927f1740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd8881aaab0 con 0x55d1d87dd6d0 2024-08-19T00:13:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.647+0000 7fd8927f1740 10 client.0 _ll_register_callbacks cb 0x7fd884009330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:13:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.647+0000 7fd88ceef640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d1d87ddff0 0x55d1d87f1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.647+0000 7fd88ceef640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d1d87ddff0 0x55d1d87f1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51740/0 (socket says 172.21.15.44:51740) 2024-08-19T00:13:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.647+0000 7fd88ceef640 1 -- 172.21.15.44:0/3230710711 learned_addr learned my addr 172.21.15.44:0/3230710711 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.647+0000 7fd88d6f0640 1 --2- 172.21.15.44:0/3230710711 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d1d87dd6d0 0x55d1d87f0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.647+0000 7fd88def1640 1 --2- 172.21.15.44:0/3230710711 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1d87ecda0 0x55d1d87f1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.648+0000 7fd88ceef640 1 -- 172.21.15.44:0/3230710711 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d1d87dd6d0 msgr2=0x55d1d87f0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.648+0000 7fd88ceef640 1 --2- 172.21.15.44:0/3230710711 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d1d87dd6d0 0x55d1d87f0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.648+0000 7fd88ceef640 1 -- 172.21.15.44:0/3230710711 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1d87ecda0 msgr2=0x55d1d87f1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:13:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.648+0000 7fd88ceef640 1 --2- 172.21.15.44:0/3230710711 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1d87ecda0 0x55d1d87f1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.648+0000 7fd88ceef640 1 -- 172.21.15.44:0/3230710711 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1d8866980 con 0x55d1d87ddff0 2024-08-19T00:13:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.648+0000 7fd88ceef640 1 --2- 172.21.15.44:0/3230710711 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d1d87ddff0 0x55d1d87f1100 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x55d1d87df250 tx=0x7fd878004df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd71853159fba452 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.648+0000 7fd870ff9640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:13:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.648+0000 7fd870ff9640 1 -- 172.21.15.44:0/3230710711 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd87801b530 con 0x55d1d87ddff0 2024-08-19T00:13:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.648+0000 7fd870ff9640 1 -- 172.21.15.44:0/3230710711 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7fd87801b6d0 con 0x55d1d87ddff0 2024-08-19T00:13:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.648+0000 7fd8927f1740 1 -- 172.21.15.44:0/3230710711 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8840a39e0 con 0x55d1d87ddff0 2024-08-19T00:13:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.648+0000 7fd870ff9640 1 -- 172.21.15.44:0/3230710711 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd87802b050 con 0x55d1d87ddff0 2024-08-19T00:13:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.648+0000 7fd8927f1740 10 client.15576 fetch_fsmap learned FSMap version 28 2024-08-19T00:13:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.648+0000 7fd8927f1740 1 -- 172.21.15.44:0/3230710711 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d1d8867ce0 con 0x55d1d87ddff0 2024-08-19T00:13:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.648+0000 7fd870ff9640 1 -- 172.21.15.44:0/3230710711 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd8840a39e0 con 0x55d1d87ddff0 2024-08-19T00:13:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.649+0000 7fd870ff9640 1 -- 172.21.15.44:0/3230710711 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fd87800f040 con 0x55d1d87ddff0 2024-08-19T00:13:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.649+0000 7fd8927f1740 10 client.15576 fetch_fsmap finished waiting for FSMap version 28 2024-08-19T00:13:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.649+0000 7fd8927f1740 10 client.15576 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:13:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.649+0000 7fd8927f1740 20 client.15576 populate_metadata read hostname 'smithi044' 2024-08-19T00:13:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.649+0000 7fd8927f1740 1 --2- 172.21.15.44:0/3230710711 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55d1d8868490 0x55d1d886a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.649+0000 7fd8927f1740 4 client.15576 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-19T00:13:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.649+0000 7fd8927f1740 1 -- 172.21.15.44:0/3230710711 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d1d8749450 con 0x55d1d8868490 2024-08-19T00:13:48.656 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.649+0000 7fd88d6f0640 1 --2- 172.21.15.44:0/3230710711 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55d1d8868490 0x55d1d886a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:48.656 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.649+0000 7fd88d6f0640 1 --2- 172.21.15.44:0/3230710711 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55d1d8868490 0x55d1d886a8b0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=850283e03c3812ba server_cookie=afc377b3d4c47783 in_seq=0 out_seq=0 2024-08-19T00:13:48.656 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.649+0000 7fd870ff9640 10 client.15576 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:13:48.657 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.653+0000 7fd870ff9640 1 -- 172.21.15.44:0/3230710711 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d1d8749450 con 0x55d1d8868490 2024-08-19T00:13:48.657 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.653+0000 7fd870ff9640 10 client.15576 handle_command_reply: tid=0 2024-08-19T00:13:48.657 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.653+0000 7fd8927f1740 1 client.15576 shutdown 2024-08-19T00:13:48.657 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.653+0000 7fd8927f1740 1 -- 172.21.15.44:0/3230710711 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d1d87ddff0 msgr2=0x55d1d87f1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:48.657 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.653+0000 7fd8927f1740 1 --2- 172.21.15.44:0/3230710711 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d1d87ddff0 0x55d1d87f1100 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x55d1d87df250 tx=0x7fd878004df0 comp rx=0 tx=0).stop 2024-08-19T00:13:48.657 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.653+0000 7fd8927f1740 1 -- 172.21.15.44:0/3230710711 shutdown_connections 2024-08-19T00:13:48.657 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.653+0000 7fd8927f1740 1 --2- 172.21.15.44:0/3230710711 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55d1d8868490 0x55d1d886a8b0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:48.657 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.653+0000 7fd8927f1740 1 --2- 172.21.15.44:0/3230710711 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1d87ecda0 0x55d1d87f1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:48.657 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.653+0000 7fd8927f1740 1 --2- 172.21.15.44:0/3230710711 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d1d87ddff0 0x55d1d87f1100 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:48.657 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.653+0000 7fd870ff9640 0 client.15576 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:13:48.658 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.653+0000 7fd8927f1740 1 --2- 172.21.15.44:0/3230710711 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d1d87dd6d0 0x55d1d87f0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:48.658 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.653+0000 7fd8927f1740 1 -- 172.21.15.44:0/3230710711 >> 172.21.15.44:0/3230710711 conn(0x55d1d87d9d40 msgr2=0x55d1d87dfaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:48.658 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.653+0000 7fd8927f1740 1 -- 172.21.15.44:0/3230710711 shutdown_connections 2024-08-19T00:13:48.658 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.653+0000 7fd8927f1740 1 -- 172.21.15.44:0/3230710711 wait complete. 2024-08-19T00:13:48.658 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.653+0000 7fd8927f1740 20 client.15576 trim_cache size 0 max 16384 2024-08-19T00:13:48.658 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:{ 2024-08-19T00:13:48.658 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "message": "", 2024-08-19T00:13:48.658 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "return_code": 0 2024-08-19T00:13:48.658 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:} 2024-08-19T00:13:48.659 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.654+0000 7fd88f954640 1 -- 172.21.15.44:0/2256938468 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fd8740a2f40 msgr2=0x7fd8740a5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:48.659 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.654+0000 7fd88f954640 1 --2- 172.21.15.44:0/2256938468 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fd8740a2f40 0x7fd8740a5400 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd88004d000 tx=0x7fd88004b000 comp rx=0 tx=0).stop 2024-08-19T00:13:48.659 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.654+0000 7fd88f954640 1 -- 172.21.15.44:0/2256938468 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd8881006e0 msgr2=0x7fd888198ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:48.659 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.654+0000 7fd88f954640 1 --2- 172.21.15.44:0/2256938468 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd8881006e0 0x7fd888198ef0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fd88400b4a0 tx=0x7fd88400b960 comp rx=0 tx=0).stop 2024-08-19T00:13:48.659 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.654+0000 7fd88f954640 1 -- 172.21.15.44:0/2256938468 shutdown_connections 2024-08-19T00:13:48.659 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.654+0000 7fd88f954640 1 --2- 172.21.15.44:0/2256938468 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fd8740a2f40 0x7fd8740a5400 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:48.659 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.654+0000 7fd88f954640 1 --2- 172.21.15.44:0/2256938468 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd888101080 0x7fd888199430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:48.660 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.654+0000 7fd88f954640 1 --2- 172.21.15.44:0/2256938468 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd8881066f0 0x7fd8881a3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:48.660 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.654+0000 7fd88f954640 1 --2- 172.21.15.44:0/2256938468 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd8881006e0 0x7fd888198ef0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:48.660 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.654+0000 7fd88f954640 1 -- 172.21.15.44:0/2256938468 >> 172.21.15.44:0/2256938468 conn(0x7fd8880776c0 msgr2=0x7fd8880fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:48.660 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.654+0000 7fd88f954640 1 -- 172.21.15.44:0/2256938468 shutdown_connections 2024-08-19T00:13:48.660 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:13:48.654+0000 7fd88f954640 1 -- 172.21.15.44:0/2256938468 wait complete. 2024-08-19T00:13:50.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:49 smithi171 ceph-mon[21810]: pgmap v18: 129 pgs: 129 active+clean; 1.3 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-08-19T00:13:50.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:49 smithi116 ceph-mon[21873]: pgmap v18: 129 pgs: 129 active+clean; 1.3 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-08-19T00:13:50.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:49 smithi044 ceph-mon[18489]: pgmap v18: 129 pgs: 129 active+clean; 1.3 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-08-19T00:13:52.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:51 smithi171 ceph-mon[21810]: pgmap v19: 129 pgs: 129 active+clean; 1.3 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.8 KiB/s wr, 17 op/s 2024-08-19T00:13:52.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:51 smithi116 ceph-mon[21873]: pgmap v19: 129 pgs: 129 active+clean; 1.3 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.8 KiB/s wr, 17 op/s 2024-08-19T00:13:52.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:51 smithi044 ceph-mon[18489]: pgmap v19: 129 pgs: 129 active+clean; 1.3 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.8 KiB/s wr, 17 op/s 2024-08-19T00:13:54.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:53 smithi171 ceph-mon[21810]: pgmap v20: 129 pgs: 129 active+clean; 1.3 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-08-19T00:13:54.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:53 smithi116 ceph-mon[21873]: pgmap v20: 129 pgs: 129 active+clean; 1.3 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-08-19T00:13:54.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:53 smithi044 ceph-mon[18489]: pgmap v20: 129 pgs: 129 active+clean; 1.3 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-08-19T00:13:56.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:55 smithi171 ceph-mon[21810]: pgmap v21: 129 pgs: 129 active+clean; 1.3 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 10 op/s 2024-08-19T00:13:56.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:55 smithi116 ceph-mon[21873]: pgmap v21: 129 pgs: 129 active+clean; 1.3 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 10 op/s 2024-08-19T00:13:56.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:55 smithi044 ceph-mon[18489]: pgmap v21: 129 pgs: 129 active+clean; 1.3 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 10 op/s 2024-08-19T00:13:58.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:57 smithi171 ceph-mon[21810]: pgmap v22: 129 pgs: 129 active+clean; 1.3 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 11 op/s 2024-08-19T00:13:58.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:57 smithi116 ceph-mon[21873]: pgmap v22: 129 pgs: 129 active+clean; 1.3 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 11 op/s 2024-08-19T00:13:58.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:57 smithi044 ceph-mon[18489]: pgmap v22: 129 pgs: 129 active+clean; 1.3 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 11 op/s 2024-08-19T00:13:58.164 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 34.7 2024-08-19T00:13:58.165 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-19T00:13:58.443 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:13:59.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:59.048+0000 7f97ff03f640 1 -- 172.21.15.44:0/4278204470 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97f8102a60 msgr2=0x7f97f8102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:59.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:59.048+0000 7f97ff03f640 1 --2- 172.21.15.44:0/4278204470 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97f8102a60 0x7f97f8102e40 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f97ec009930 tx=0x7f97ec02a420 comp rx=0 tx=0).stop 2024-08-19T00:13:59.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:59.048+0000 7f97ff03f640 1 -- 172.21.15.44:0/4278204470 shutdown_connections 2024-08-19T00:13:59.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:59.048+0000 7f97ff03f640 1 --2- 172.21.15.44:0/4278204470 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f97f8107fd0 0x7f97f810e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:59.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:59.048+0000 7f97ff03f640 1 --2- 172.21.15.44:0/4278204470 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97f8103410 0x7f97f81078c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:59.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:59.048+0000 7f97ff03f640 1 --2- 172.21.15.44:0/4278204470 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97f8102a60 0x7f97f8102e40 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:59.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:59.048+0000 7f97ff03f640 1 -- 172.21.15.44:0/4278204470 >> 172.21.15.44:0/4278204470 conn(0x7f97f80fc500 msgr2=0x7f97f80fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:59.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:59.048+0000 7f97ff03f640 1 -- 172.21.15.44:0/4278204470 shutdown_connections 2024-08-19T00:13:59.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:59.048+0000 7f97ff03f640 1 -- 172.21.15.44:0/4278204470 wait complete. 2024-08-19T00:13:59.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:59.049+0000 7f97ff03f640 1 Processor -- start 2024-08-19T00:13:59.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:59.049+0000 7f97ff03f640 1 -- start start 2024-08-19T00:13:59.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:59.049+0000 7f97ff03f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97f8102a60 0x7f97f81982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:59.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:59.049+0000 7f97ff03f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f97f8103410 0x7f97f8198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:59.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:59.049+0000 7f97ff03f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97f8107fd0 0x7f97f819cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:59.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:59.049+0000 7f97ff03f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f97f8111dd0 con 0x7f97f8107fd0 2024-08-19T00:13:59.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:59.049+0000 7f97ff03f640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f97f8111c50 con 0x7f97f8102a60 2024-08-19T00:13:59.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:59.049+0000 7f97ff03f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f97f8111f50 con 0x7f97f8103410 2024-08-19T00:13:59.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:59.049+0000 7f97fd5dc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97f8107fd0 0x7f97f819cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:59.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:59.049+0000 7f97fd5dc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97f8107fd0 0x7f97f819cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42046/0 (socket says 172.21.15.44:42046) 2024-08-19T00:13:59.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:59.049+0000 7f97fd5dc640 1 -- 172.21.15.44:0/1515809883 learned_addr learned my addr 172.21.15.44:0/1515809883 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:13:59.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:59.049+0000 7f97fcddb640 1 --2- 172.21.15.44:0/1515809883 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97f8102a60 0x7f97f81982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:59.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:59.049+0000 7f97f7fff640 1 --2- 172.21.15.44:0/1515809883 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f97f8103410 0x7f97f8198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:59.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:59.049+0000 7f97fd5dc640 1 -- 172.21.15.44:0/1515809883 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f97f8103410 msgr2=0x7f97f8198810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:59.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:59.049+0000 7f97fd5dc640 1 --2- 172.21.15.44:0/1515809883 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f97f8103410 0x7f97f8198810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:59.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:59.049+0000 7f97fd5dc640 1 -- 172.21.15.44:0/1515809883 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97f8102a60 msgr2=0x7f97f81982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:59.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:59.049+0000 7f97fd5dc640 1 --2- 172.21.15.44:0/1515809883 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97f8102a60 0x7f97f81982d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:59.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:59.050+0000 7f97fd5dc640 1 -- 172.21.15.44:0/1515809883 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97f819d280 con 0x7f97f8107fd0 2024-08-19T00:13:59.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:59.050+0000 7f97fd5dc640 1 --2- 172.21.15.44:0/1515809883 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97f8107fd0 0x7f97f819cba0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f97f000eaa0 tx=0x7f97f000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:59.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:59.050+0000 7f97f5ffb640 1 -- 172.21.15.44:0/1515809883 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f000cdb0 con 0x7f97f8107fd0 2024-08-19T00:13:59.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:59.050+0000 7f97ff03f640 1 -- 172.21.15.44:0/1515809883 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97f819d570 con 0x7f97f8107fd0 2024-08-19T00:13:59.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:59.050+0000 7f97f5ffb640 1 -- 172.21.15.44:0/1515809883 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f97f0005020 con 0x7f97f8107fd0 2024-08-19T00:13:59.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:59.050+0000 7f97f5ffb640 1 -- 172.21.15.44:0/1515809883 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f00116b0 con 0x7f97f8107fd0 2024-08-19T00:13:59.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:59.050+0000 7f97ff03f640 1 -- 172.21.15.44:0/1515809883 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97f81a4e50 con 0x7f97f8107fd0 2024-08-19T00:13:59.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:59.051+0000 7f97ff03f640 1 -- 172.21.15.44:0/1515809883 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97f806a580 con 0x7f97f8107fd0 2024-08-19T00:13:59.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:59.052+0000 7f97f5ffb640 1 -- 172.21.15.44:0/1515809883 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 24) ==== 138060+0+0 (secure 0 0 0) 0x7f97f0005560 con 0x7f97f8107fd0 2024-08-19T00:13:59.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:59.053+0000 7f97f5ffb640 1 --2- 172.21.15.44:0/1515809883 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f97e80a2e10 0x7f97e80a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:13:59.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:59.053+0000 7f97f5ffb640 1 -- 172.21.15.44:0/1515809883 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f97f00cfc90 con 0x7f97f8107fd0 2024-08-19T00:13:59.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:59.053+0000 7f97fcddb640 1 --2- 172.21.15.44:0/1515809883 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f97e80a2e10 0x7f97e80a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:13:59.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:59.054+0000 7f97fcddb640 1 --2- 172.21.15.44:0/1515809883 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f97e80a2e10 0x7f97e80a52d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f97ec009900 tx=0x7f97ec0058d0 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:13:59.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:59.057+0000 7f97f5ffb640 1 -- 172.21.15.44:0/1515809883 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f97f0016030 con 0x7f97f8107fd0 2024-08-19T00:13:59.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:59.313+0000 7f97ff03f640 1 -- 172.21.15.44:0/1515809883 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f97f8109fe0 con 0x7f97f8107fd0 2024-08-19T00:13:59.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:59.314+0000 7f97f5ffb640 1 -- 172.21.15.44:0/1515809883 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11989 (secure 0 0 0) 0x7f97f009c2c0 con 0x7f97f8107fd0 2024-08-19T00:13:59.315 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:13:59.316 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":28,"btime":"2024-08-19T00:13:17:187002+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14511,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1538841896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1538841896},{"type":"v1","addr":"172.21.15.116:6833","nonce":1538841896}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/4044471606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4044471606},{"type":"v1","addr":"172.21.15.44:6835","nonce":4044471606}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-19T00:10:53.196636+0000","modified":"2024-08-19T00:13:17.136820+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24473,"mds_1":24446,"mds_2":24439,"mds_3":24431,"mds_4":24418},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14529":{"gid":14529,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6837/1824829052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1824829052},{"type":"v1","addr":"172.21.15.44:6837","nonce":1824829052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14577":{"gid":14577,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6839/3591739042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":3591739042},{"type":"v1","addr":"172.21.15.44:6839","nonce":3591739042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14589":{"gid":14589,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6841/3667695717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6840","nonce":3667695717},{"type":"v1","addr":"172.21.15.44:6841","nonce":3667695717}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24388":{"gid":24388,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1183022838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1183022838},{"type":"v1","addr":"172.21.15.171:6833","nonce":1183022838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6835/2190623851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":2190623851},{"type":"v1","addr":"172.21.15.171:6835","nonce":2190623851}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.171:6837/316231795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":316231795},{"type":"v1","addr":"172.21.15.171:6837","nonce":316231795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":20,"addr":"172.21.15.116:6835/3507399322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3507399322},{"type":"v1","addr":"172.21.15.116:6835","nonce":3507399322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.171:6839/1466585795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":1466585795},{"type":"v1","addr":"172.21.15.171:6839","nonce":1466585795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":17,"addr":"172.21.15.116:6837/2764513846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":2764513846},{"type":"v1","addr":"172.21.15.116:6837","nonce":2764513846}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.116:6839/1032741033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":1032741033},{"type":"v1","addr":"172.21.15.116:6839","nonce":1032741033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24418,24431,24439,24446,24473]},"id":1}]} 2024-08-19T00:13:59.316 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 28 2024-08-19T00:13:59.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:59.316+0000 7f97ff03f640 1 -- 172.21.15.44:0/1515809883 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f97e80a2e10 msgr2=0x7f97e80a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:59.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:59.316+0000 7f97ff03f640 1 --2- 172.21.15.44:0/1515809883 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f97e80a2e10 0x7f97e80a52d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f97ec009900 tx=0x7f97ec0058d0 comp rx=0 tx=0).stop 2024-08-19T00:13:59.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:59.316+0000 7f97ff03f640 1 -- 172.21.15.44:0/1515809883 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97f8107fd0 msgr2=0x7f97f819cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:13:59.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:59.316+0000 7f97ff03f640 1 --2- 172.21.15.44:0/1515809883 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97f8107fd0 0x7f97f819cba0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f97f000eaa0 tx=0x7f97f000ef60 comp rx=0 tx=0).stop 2024-08-19T00:13:59.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:59.316+0000 7f97ff03f640 1 -- 172.21.15.44:0/1515809883 shutdown_connections 2024-08-19T00:13:59.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:59.316+0000 7f97ff03f640 1 --2- 172.21.15.44:0/1515809883 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f97e80a2e10 0x7f97e80a52d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:59.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:59.316+0000 7f97ff03f640 1 --2- 172.21.15.44:0/1515809883 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f97f8103410 0x7f97f8198810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:59.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:59.316+0000 7f97ff03f640 1 --2- 172.21.15.44:0/1515809883 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97f8107fd0 0x7f97f819cba0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:59.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:59.316+0000 7f97ff03f640 1 --2- 172.21.15.44:0/1515809883 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f97f8102a60 0x7f97f81982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:13:59.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:59.316+0000 7f97ff03f640 1 -- 172.21.15.44:0/1515809883 >> 172.21.15.44:0/1515809883 conn(0x7f97f80fc500 msgr2=0x7f97f8105a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:13:59.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:59.316+0000 7f97ff03f640 1 -- 172.21.15.44:0/1515809883 shutdown_connections 2024-08-19T00:13:59.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:13:59.316+0000 7f97ff03f640 1 -- 172.21.15.44:0/1515809883 wait complete. 2024-08-19T00:14:00.084 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:59 smithi044 ceph-mon[18489]: pgmap v23: 129 pgs: 129 active+clean; 1.3 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-08-19T00:14:00.084 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:13:59 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/1515809883' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:14:00.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:59 smithi171 ceph-mon[21810]: pgmap v23: 129 pgs: 129 active+clean; 1.3 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-08-19T00:14:00.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:13:59 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/1515809883' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:14:00.113 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24473 quiesce db / --timeout 90 --expiration 154.7 --await-for 45.0' 2024-08-19T00:14:00.113 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24473 quiesce db / --timeout 90 --expiration 154.7 --await-for 45.0 2024-08-19T00:14:00.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:59 smithi116 ceph-mon[21873]: pgmap v23: 129 pgs: 129 active+clean; 1.3 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-08-19T00:14:00.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:13:59 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/1515809883' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:14:00.384 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:14:00.780 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:14:00 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:14:00.524+0000 7f512b022640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-19T00:14:00.780 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:14:00 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:14:00.524+0000 7f512b022640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-19T00:14:00.780 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:14:00 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:14:00.524+0000 7f512b022640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-19T00:14:00.780 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:14:00 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:14:00.524+0000 7f512b022640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-19T00:14:00.780 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:14:00 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:14:00.524+0000 7f512b022640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-19T00:14:00.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.872+0000 7f6086e14640 1 -- 172.21.15.44:0/2056037411 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6080100230 msgr2=0x7f6080100610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:00.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.872+0000 7f6086e14640 1 --2- 172.21.15.44:0/2056037411 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6080100230 0x7f6080100610 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f607c009900 tx=0x7f607c02a410 comp rx=0 tx=0).stop 2024-08-19T00:14:00.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.872+0000 7f6086e14640 1 -- 172.21.15.44:0/2056037411 shutdown_connections 2024-08-19T00:14:00.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.872+0000 7f6086e14640 1 --2- 172.21.15.44:0/2056037411 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6080106ca0 0x7f608010e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:00.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.872+0000 7f6086e14640 1 --2- 172.21.15.44:0/2056037411 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6080100be0 0x7f6080106570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:00.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.872+0000 7f6086e14640 1 --2- 172.21.15.44:0/2056037411 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6080100230 0x7f6080100610 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:00.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.872+0000 7f6086e14640 1 -- 172.21.15.44:0/2056037411 >> 172.21.15.44:0/2056037411 conn(0x7f60800fc2f0 msgr2=0x7f60800fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:14:00.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.872+0000 7f6086e14640 1 -- 172.21.15.44:0/2056037411 shutdown_connections 2024-08-19T00:14:00.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.873+0000 7f6086e14640 1 -- 172.21.15.44:0/2056037411 wait complete. 2024-08-19T00:14:00.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.873+0000 7f6086e14640 1 Processor -- start 2024-08-19T00:14:00.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.873+0000 7f6086e14640 1 -- start start 2024-08-19T00:14:00.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.873+0000 7f6086e14640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6080100230 0x7f6080198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:00.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.873+0000 7f6086e14640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6080100be0 0x7f6080198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:00.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.873+0000 7f6086e14640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6080106ca0 0x7f608019cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:00.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.873+0000 7f6086e14640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6080111d70 con 0x7f6080100230 2024-08-19T00:14:00.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.873+0000 7f6086e14640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f6080111bf0 con 0x7f6080106ca0 2024-08-19T00:14:00.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.873+0000 7f6086e14640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6080111ef0 con 0x7f6080100be0 2024-08-19T00:14:00.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.873+0000 7f6084bb0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6080100230 0x7f6080198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:00.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.873+0000 7f6084bb0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6080100230 0x7f6080198330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42084/0 (socket says 172.21.15.44:42084) 2024-08-19T00:14:00.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.873+0000 7f6084bb0640 1 -- 172.21.15.44:0/154701319 learned_addr learned my addr 172.21.15.44:0/154701319 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:14:00.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.874+0000 7f60853b1640 1 --2- 172.21.15.44:0/154701319 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6080106ca0 0x7f608019cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:00.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.874+0000 7f6077fff640 1 --2- 172.21.15.44:0/154701319 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6080100be0 0x7f6080198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:00.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.874+0000 7f6084bb0640 1 -- 172.21.15.44:0/154701319 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6080100be0 msgr2=0x7f6080198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:00.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.874+0000 7f6084bb0640 1 --2- 172.21.15.44:0/154701319 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6080100be0 0x7f6080198870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:00.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.874+0000 7f6084bb0640 1 -- 172.21.15.44:0/154701319 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6080106ca0 msgr2=0x7f608019cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:00.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.874+0000 7f6084bb0640 1 --2- 172.21.15.44:0/154701319 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6080106ca0 0x7f608019cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:00.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.874+0000 7f6084bb0640 1 -- 172.21.15.44:0/154701319 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f608019d2e0 con 0x7f6080100230 2024-08-19T00:14:00.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.874+0000 7f60853b1640 1 --2- 172.21.15.44:0/154701319 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6080106ca0 0x7f608019cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:14:00.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.874+0000 7f6084bb0640 1 --2- 172.21.15.44:0/154701319 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6080100230 0x7f6080198330 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f607c02a930 tx=0x7f607c003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:14:00.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.874+0000 7f6075ffb640 1 -- 172.21.15.44:0/154701319 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f607c03f070 con 0x7f6080100230 2024-08-19T00:14:00.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.874+0000 7f6075ffb640 1 -- 172.21.15.44:0/154701319 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f607c031c90 con 0x7f6080100230 2024-08-19T00:14:00.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.874+0000 7f6086e14640 1 -- 172.21.15.44:0/154701319 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f608019d570 con 0x7f6080100230 2024-08-19T00:14:00.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.874+0000 7f6075ffb640 1 -- 172.21.15.44:0/154701319 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f607c035030 con 0x7f6080100230 2024-08-19T00:14:00.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.874+0000 7f6086e14640 1 -- 172.21.15.44:0/154701319 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60801a4eb0 con 0x7f6080100230 2024-08-19T00:14:00.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.877+0000 7f6075ffb640 1 -- 172.21.15.44:0/154701319 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 24) ==== 138060+0+0 (secure 0 0 0) 0x7f607c042070 con 0x7f6080100230 2024-08-19T00:14:00.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.877+0000 7f6089212740 1 Processor -- start 2024-08-19T00:14:00.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.877+0000 7f6089212740 1 -- start start 2024-08-19T00:14:00.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.877+0000 7f6089212740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffae7b8030 0x55ffae7b8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:00.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.877+0000 7f6089212740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ffae7b8950 0x55ffae7c71e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:00.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.877+0000 7f6089212740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffae7c7720 0x55ffae7c9b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:00.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.877+0000 7f6089212740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ffae71da70 con 0x55ffae7b8030 2024-08-19T00:14:00.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.877+0000 7f6089212740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55ffae6b5780 con 0x55ffae7c7720 2024-08-19T00:14:00.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.878+0000 7f6089212740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55ffae719a30 con 0x55ffae7b8950 2024-08-19T00:14:00.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.878+0000 7f60853b1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffae7b8030 0x55ffae7b8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:00.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.878+0000 7f60853b1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffae7b8030 0x55ffae7b8410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42088/0 (socket says 172.21.15.44:42088) 2024-08-19T00:14:00.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.878+0000 7f60853b1640 1 -- 172.21.15.44:0/983220191 learned_addr learned my addr 172.21.15.44:0/983220191 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:14:00.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.878+0000 7f6075ffb640 1 --2- 172.21.15.44:0/154701319 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f60680a2e10 0x7f60680a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:00.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.878+0000 7f6084bb0640 1 --2- 172.21.15.44:0/983220191 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ffae7b8950 0x55ffae7c71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:00.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.878+0000 7f6077fff640 1 --2- 172.21.15.44:0/983220191 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffae7c7720 0x55ffae7c9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:00.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.878+0000 7f60853b1640 1 --2- 172.21.15.44:0/154701319 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f60680a2e10 0x7f60680a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:00.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.878+0000 7f6075ffb640 1 -- 172.21.15.44:0/154701319 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f607c0f0280 con 0x7f6080100230 2024-08-19T00:14:00.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.878+0000 7f60853b1640 1 -- 172.21.15.44:0/983220191 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ffae7b8950 msgr2=0x55ffae7c71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:14:00.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.878+0000 7f60853b1640 1 --2- 172.21.15.44:0/983220191 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ffae7b8950 0x55ffae7c71e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:00.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.878+0000 7f60853b1640 1 -- 172.21.15.44:0/983220191 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffae7c7720 msgr2=0x55ffae7c9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:14:00.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.878+0000 7f60853b1640 1 --2- 172.21.15.44:0/983220191 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffae7c7720 0x55ffae7c9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:00.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.878+0000 7f60853b1640 1 -- 172.21.15.44:0/983220191 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffae48fb90 con 0x55ffae7b8030 2024-08-19T00:14:00.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.878+0000 7f6077fff640 1 --2- 172.21.15.44:0/983220191 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffae7c7720 0x55ffae7c9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:14:00.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.878+0000 7f60853b1640 1 --2- 172.21.15.44:0/983220191 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffae7b8030 0x55ffae7b8410 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f607800cf80 tx=0x7f6078007740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e947ca1f2b320b62 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:14:00.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.879+0000 7f60853b1640 1 --2- 172.21.15.44:0/154701319 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f60680a2e10 0x7f60680a52d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6078007c40 tx=0x7f607801b000 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:14:00.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.879+0000 7f6066ffd640 1 -- 172.21.15.44:0/983220191 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6078015050 con 0x55ffae7b8030 2024-08-19T00:14:00.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.879+0000 7f6066ffd640 1 -- 172.21.15.44:0/983220191 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6078016040 con 0x55ffae7b8030 2024-08-19T00:14:00.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.879+0000 7f6066ffd640 1 -- 172.21.15.44:0/983220191 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f607801bb00 con 0x55ffae7b8030 2024-08-19T00:14:00.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.880+0000 7f6089212740 1 -- 172.21.15.44:0/983220191 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffae7b8030 msgr2=0x55ffae7b8410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:00.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.880+0000 7f6089212740 1 --2- 172.21.15.44:0/983220191 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffae7b8030 0x55ffae7b8410 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f607800cf80 tx=0x7f6078007740 comp rx=0 tx=0).stop 2024-08-19T00:14:00.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.880+0000 7f6089212740 1 -- 172.21.15.44:0/983220191 shutdown_connections 2024-08-19T00:14:00.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.880+0000 7f6089212740 1 --2- 172.21.15.44:0/983220191 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ffae7b8950 0x55ffae7c71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:00.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.880+0000 7f6089212740 1 --2- 172.21.15.44:0/983220191 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffae7c7720 0x55ffae7c9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:00.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.880+0000 7f6089212740 1 --2- 172.21.15.44:0/983220191 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffae7b8030 0x55ffae7b8410 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:00.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.880+0000 7f6089212740 1 -- 172.21.15.44:0/983220191 >> 172.21.15.44:0/983220191 conn(0x55ffae7b46c0 msgr2=0x55ffae7b4aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:14:00.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.880+0000 7f6089212740 1 -- 172.21.15.44:0/983220191 shutdown_connections 2024-08-19T00:14:00.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.880+0000 7f6089212740 1 -- 172.21.15.44:0/983220191 wait complete. 2024-08-19T00:14:00.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.880+0000 7f6089212740 1 -- start start 2024-08-19T00:14:00.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.880+0000 7f6089212740 1 Processor -- start 2024-08-19T00:14:00.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.881+0000 7f6089212740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffae7b8030 0x55ffae7c46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:00.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.881+0000 7f6089212740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffae7b8950 0x55ffae7c4be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:00.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.881+0000 7f6089212740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ffae7c7720 0x55ffae7c5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:00.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.881+0000 7f6089212740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ffae7ca2f0 con 0x55ffae7b8950 2024-08-19T00:14:00.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.881+0000 7f6089212740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55ffae6d8990 con 0x55ffae7b8030 2024-08-19T00:14:00.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.881+0000 7f6089212740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55ffae7ca470 con 0x55ffae7c7720 2024-08-19T00:14:00.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.881+0000 7f6089212740 10 client.0 _ll_register_callbacks cb 0x55ffae42d090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:14:00.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.881+0000 7f6077fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffae7b8950 0x55ffae7c4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:00.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.881+0000 7f6077fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffae7b8950 0x55ffae7c4be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42102/0 (socket says 172.21.15.44:42102) 2024-08-19T00:14:00.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.881+0000 7f6077fff640 1 -- 172.21.15.44:0/565001192 learned_addr learned my addr 172.21.15.44:0/565001192 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:14:00.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.881+0000 7f60853b1640 1 --2- 172.21.15.44:0/565001192 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ffae7c7720 0x55ffae7c5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:00.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.881+0000 7f6084bb0640 1 --2- 172.21.15.44:0/565001192 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffae7b8030 0x55ffae7c46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:00.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.881+0000 7f6077fff640 1 -- 172.21.15.44:0/565001192 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ffae7c7720 msgr2=0x55ffae7c5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:14:00.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.881+0000 7f6077fff640 1 --2- 172.21.15.44:0/565001192 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ffae7c7720 0x55ffae7c5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:00.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.881+0000 7f6077fff640 1 -- 172.21.15.44:0/565001192 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffae7b8030 msgr2=0x55ffae7c46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:14:00.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.881+0000 7f6077fff640 1 --2- 172.21.15.44:0/565001192 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffae7b8030 0x55ffae7c46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:00.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.881+0000 7f6077fff640 1 -- 172.21.15.44:0/565001192 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ffae6d76c0 con 0x55ffae7b8950 2024-08-19T00:14:00.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.881+0000 7f6084bb0640 1 --2- 172.21.15.44:0/565001192 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffae7b8030 0x55ffae7c46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:14:00.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.881+0000 7f6077fff640 1 --2- 172.21.15.44:0/565001192 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffae7b8950 0x55ffae7c4be0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f607000be60 tx=0x7f6070012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=866db0f2fd43d4ad server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:14:00.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.881+0000 7f605ffff640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:14:00.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.882+0000 7f605ffff640 1 -- 172.21.15.44:0/565001192 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f607001f060 con 0x55ffae7b8950 2024-08-19T00:14:00.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.882+0000 7f605ffff640 1 -- 172.21.15.44:0/565001192 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f6070010960 con 0x55ffae7b8950 2024-08-19T00:14:00.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.882+0000 7f6089212740 1 -- 172.21.15.44:0/565001192 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6078016040 con 0x55ffae7b8950 2024-08-19T00:14:00.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.882+0000 7f605ffff640 1 -- 172.21.15.44:0/565001192 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6070026050 con 0x55ffae7b8950 2024-08-19T00:14:00.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.882+0000 7f6089212740 10 client.15600 fetch_fsmap learned FSMap version 28 2024-08-19T00:14:00.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.882+0000 7f6089212740 1 -- 172.21.15.44:0/565001192 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ffae7d60c0 con 0x55ffae7b8950 2024-08-19T00:14:00.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.882+0000 7f605ffff640 1 -- 172.21.15.44:0/565001192 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6078016040 con 0x55ffae7b8950 2024-08-19T00:14:00.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.882+0000 7f605ffff640 1 -- 172.21.15.44:0/565001192 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f6070019030 con 0x55ffae7b8950 2024-08-19T00:14:00.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.882+0000 7f6089212740 10 client.15600 fetch_fsmap finished waiting for FSMap version 28 2024-08-19T00:14:00.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.882+0000 7f6089212740 10 client.15600 resolve_mds: validated gid 24473 aka daemon mds.b 2024-08-19T00:14:00.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.882+0000 7f6089212740 20 client.15600 populate_metadata read hostname 'smithi044' 2024-08-19T00:14:00.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.882+0000 7f6089212740 1 --2- 172.21.15.44:0/565001192 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55ffae7d7580 0x55ffae7d99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:00.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.882+0000 7f6089212740 4 client.15600 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:14:00.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.882+0000 7f6089212740 1 -- 172.21.15.44:0/565001192 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ffae72b1a0 con 0x55ffae7d7580 2024-08-19T00:14:00.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.883+0000 7f6084bb0640 1 --2- 172.21.15.44:0/565001192 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55ffae7d7580 0x55ffae7d99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:00.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.883+0000 7f605ffff640 10 client.15600 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:14:00.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.883+0000 7f6084bb0640 1 --2- 172.21.15.44:0/565001192 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55ffae7d7580 0x55ffae7d99b0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=247ae461ee64d30c server_cookie=76f8b5d2a8f14a46 in_seq=0 out_seq=0 2024-08-19T00:14:00.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.884+0000 7f605ffff640 1 -- 172.21.15.44:0/565001192 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ffae72b1a0 con 0x55ffae7d7580 2024-08-19T00:14:00.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.884+0000 7f605ffff640 10 client.15600 handle_command_reply: tid=0 2024-08-19T00:14:00.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.884+0000 7f6089212740 1 client.15600 shutdown 2024-08-19T00:14:00.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.884+0000 7f6089212740 1 -- 172.21.15.44:0/565001192 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffae7b8950 msgr2=0x55ffae7c4be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:00.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.884+0000 7f6089212740 1 --2- 172.21.15.44:0/565001192 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffae7b8950 0x55ffae7c4be0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f607000be60 tx=0x7f6070012820 comp rx=0 tx=0).stop 2024-08-19T00:14:00.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.884+0000 7f6089212740 1 -- 172.21.15.44:0/565001192 shutdown_connections 2024-08-19T00:14:00.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.884+0000 7f6089212740 1 --2- 172.21.15.44:0/565001192 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55ffae7d7580 0x55ffae7d99b0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:00.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.884+0000 7f6089212740 1 --2- 172.21.15.44:0/565001192 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ffae7c7720 0x55ffae7c5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:00.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.884+0000 7f605ffff640 0 client.15600 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:14:00.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.884+0000 7f6089212740 1 --2- 172.21.15.44:0/565001192 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffae7b8950 0x55ffae7c4be0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:00.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.884+0000 7f6089212740 1 --2- 172.21.15.44:0/565001192 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffae7b8030 0x55ffae7c46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:00.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.884+0000 7f6089212740 1 -- 172.21.15.44:0/565001192 >> 172.21.15.44:0/565001192 conn(0x55ffae7b46c0 msgr2=0x55ffae7ba420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:14:00.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.884+0000 7f6089212740 1 -- 172.21.15.44:0/565001192 shutdown_connections 2024-08-19T00:14:00.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.884+0000 7f6089212740 1 -- 172.21.15.44:0/565001192 wait complete. 2024-08-19T00:14:00.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.885+0000 7f6089212740 20 client.15600 trim_cache size 0 max 16384 2024-08-19T00:14:00.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.903+0000 7f6089212740 1 Processor -- start 2024-08-19T00:14:00.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.903+0000 7f6089212740 1 -- start start 2024-08-19T00:14:00.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.903+0000 7f6089212740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffae7b8030 0x55ffae7ba270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:00.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.903+0000 7f6089212740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ffae7b8950 0x55ffae7df2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:00.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.903+0000 7f6089212740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffae7c7720 0x55ffae7df800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:00.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.903+0000 7f6089212740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f60801acbc0 con 0x55ffae7b8030 2024-08-19T00:14:00.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.903+0000 7f6089212740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f60801ae700 con 0x55ffae7c7720 2024-08-19T00:14:00.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.903+0000 7f6089212740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f60801ad290 con 0x55ffae7b8950 2024-08-19T00:14:00.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.903+0000 7f6084bb0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffae7b8030 0x55ffae7ba270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:00.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.903+0000 7f6084bb0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffae7b8030 0x55ffae7ba270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42114/0 (socket says 172.21.15.44:42114) 2024-08-19T00:14:00.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.903+0000 7f6084bb0640 1 -- 172.21.15.44:0/2147095355 learned_addr learned my addr 172.21.15.44:0/2147095355 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:14:00.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.903+0000 7f6077fff640 1 --2- 172.21.15.44:0/2147095355 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ffae7b8950 0x55ffae7df2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:00.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.904+0000 7f60853b1640 1 --2- 172.21.15.44:0/2147095355 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffae7c7720 0x55ffae7df800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:00.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.904+0000 7f6084bb0640 1 -- 172.21.15.44:0/2147095355 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ffae7b8950 msgr2=0x55ffae7df2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:14:00.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.904+0000 7f6084bb0640 1 --2- 172.21.15.44:0/2147095355 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ffae7b8950 0x55ffae7df2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:00.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.904+0000 7f6084bb0640 1 -- 172.21.15.44:0/2147095355 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffae7c7720 msgr2=0x55ffae7df800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:14:00.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.904+0000 7f6084bb0640 1 --2- 172.21.15.44:0/2147095355 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffae7c7720 0x55ffae7df800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:00.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.904+0000 7f6084bb0640 1 -- 172.21.15.44:0/2147095355 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffae7b8780 con 0x55ffae7b8030 2024-08-19T00:14:00.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.904+0000 7f60853b1640 1 --2- 172.21.15.44:0/2147095355 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffae7c7720 0x55ffae7df800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:14:00.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.904+0000 7f6084bb0640 1 --2- 172.21.15.44:0/2147095355 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffae7b8030 0x55ffae7ba270 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f607c0b8680 tx=0x7f607c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b0d3cc897eeca81 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:14:00.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.904+0000 7f60667fc640 1 -- 172.21.15.44:0/2147095355 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f607c049040 con 0x55ffae7b8030 2024-08-19T00:14:00.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.904+0000 7f60667fc640 1 -- 172.21.15.44:0/2147095355 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f607c0c05d0 con 0x55ffae7b8030 2024-08-19T00:14:00.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.904+0000 7f60667fc640 1 -- 172.21.15.44:0/2147095355 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f607c0dae60 con 0x55ffae7b8030 2024-08-19T00:14:00.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.905+0000 7f6089212740 1 -- 172.21.15.44:0/2147095355 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffae7b8030 msgr2=0x55ffae7ba270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:00.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.905+0000 7f6089212740 1 --2- 172.21.15.44:0/2147095355 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffae7b8030 0x55ffae7ba270 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f607c0b8680 tx=0x7f607c02a410 comp rx=0 tx=0).stop 2024-08-19T00:14:00.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.905+0000 7f6089212740 1 -- 172.21.15.44:0/2147095355 shutdown_connections 2024-08-19T00:14:00.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.905+0000 7f6089212740 1 --2- 172.21.15.44:0/2147095355 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ffae7b8950 0x55ffae7df2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:00.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.905+0000 7f6089212740 1 --2- 172.21.15.44:0/2147095355 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffae7c7720 0x55ffae7df800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:00.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.905+0000 7f6089212740 1 --2- 172.21.15.44:0/2147095355 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffae7b8030 0x55ffae7ba270 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:00.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.905+0000 7f6089212740 1 -- 172.21.15.44:0/2147095355 >> 172.21.15.44:0/2147095355 conn(0x55ffae7b46c0 msgr2=0x55ffae7b9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:14:00.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.905+0000 7f6089212740 1 -- 172.21.15.44:0/2147095355 shutdown_connections 2024-08-19T00:14:00.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.905+0000 7f6089212740 1 -- 172.21.15.44:0/2147095355 wait complete. 2024-08-19T00:14:00.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.905+0000 7f6089212740 1 -- start start 2024-08-19T00:14:00.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.906+0000 7f6089212740 1 Processor -- start 2024-08-19T00:14:00.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.906+0000 7f6089212740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffae7b8030 0x55ffae7cbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:00.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.906+0000 7f6089212740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ffae7b8950 0x55ffae7cc110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:00.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.906+0000 7f6089212740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffae7c7720 0x55ffae841290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:00.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.906+0000 7f6089212740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f60801ae030 con 0x55ffae7c7720 2024-08-19T00:14:00.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.906+0000 7f6089212740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f60801ad960 con 0x55ffae7b8030 2024-08-19T00:14:00.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.906+0000 7f6089212740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f60801aabc0 con 0x55ffae7b8950 2024-08-19T00:14:00.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.906+0000 7f6089212740 10 client.0 _ll_register_callbacks cb 0x7f607000b7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:14:00.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.906+0000 7f6084bb0640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffae7b8030 0x55ffae7cbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:00.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.906+0000 7f6084bb0640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffae7b8030 0x55ffae7cbbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.44:34756/0 (socket says 172.21.15.44:34756) 2024-08-19T00:14:00.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.906+0000 7f6084bb0640 1 -- 172.21.15.44:0/2676219046 learned_addr learned my addr 172.21.15.44:0/2676219046 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:14:00.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.906+0000 7f60853b1640 1 --2- 172.21.15.44:0/2676219046 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffae7c7720 0x55ffae841290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:00.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.906+0000 7f6077fff640 1 --2- 172.21.15.44:0/2676219046 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ffae7b8950 0x55ffae7cc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:00.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.907+0000 7f6084bb0640 1 -- 172.21.15.44:0/2676219046 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ffae7b8950 msgr2=0x55ffae7cc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:14:00.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.907+0000 7f6084bb0640 1 --2- 172.21.15.44:0/2676219046 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ffae7b8950 0x55ffae7cc110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:00.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.907+0000 7f6084bb0640 1 -- 172.21.15.44:0/2676219046 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffae7c7720 msgr2=0x55ffae841290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:14:00.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.907+0000 7f6084bb0640 1 --2- 172.21.15.44:0/2676219046 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffae7c7720 0x55ffae841290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:00.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.907+0000 7f6084bb0640 1 -- 172.21.15.44:0/2676219046 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ffae8417d0 con 0x55ffae7b8030 2024-08-19T00:14:00.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.907+0000 7f6077fff640 1 --2- 172.21.15.44:0/2676219046 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ffae7b8950 0x55ffae7cc110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:14:00.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.907+0000 7f60853b1640 1 --2- 172.21.15.44:0/2676219046 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffae7c7720 0x55ffae841290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:14:00.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.907+0000 7f6084bb0640 1 --2- 172.21.15.44:0/2676219046 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffae7b8030 0x55ffae7cbbd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f607c006010 tx=0x7f607c005bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4c06c8c972f02e4 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:14:00.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.907+0000 7f605ffff640 10 client.0 ms_handle_connect on v2:172.21.15.116:3300/0 2024-08-19T00:14:00.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.907+0000 7f605ffff640 1 -- 172.21.15.44:0/2676219046 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f607c049070 con 0x55ffae7b8030 2024-08-19T00:14:00.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.907+0000 7f605ffff640 1 -- 172.21.15.44:0/2676219046 <== mon.2 v2:172.21.15.116:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f607c03b5f0 con 0x55ffae7b8030 2024-08-19T00:14:00.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.907+0000 7f6089212740 1 -- 172.21.15.44:0/2676219046 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f607c0c05d0 con 0x55ffae7b8030 2024-08-19T00:14:00.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.907+0000 7f605ffff640 1 -- 172.21.15.44:0/2676219046 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f607c0dae60 con 0x55ffae7b8030 2024-08-19T00:14:00.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.907+0000 7f6089212740 10 client.25175 fetch_fsmap learned FSMap version 28 2024-08-19T00:14:00.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.908+0000 7f6089212740 1 -- 172.21.15.44:0/2676219046 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ffae8429a0 con 0x55ffae7b8030 2024-08-19T00:14:00.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.908+0000 7f605ffff640 1 -- 172.21.15.44:0/2676219046 <== mon.2 v2:172.21.15.116:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f607c0c05d0 con 0x55ffae7b8030 2024-08-19T00:14:00.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.908+0000 7f605ffff640 1 -- 172.21.15.44:0/2676219046 <== mon.2 v2:172.21.15.116:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f607c0bc480 con 0x55ffae7b8030 2024-08-19T00:14:00.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.908+0000 7f6089212740 10 client.25175 fetch_fsmap finished waiting for FSMap version 28 2024-08-19T00:14:00.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.908+0000 7f6089212740 10 client.25175 resolve_mds: validated gid 24473 aka daemon mds.b 2024-08-19T00:14:00.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.908+0000 7f6089212740 20 client.25175 populate_metadata read hostname 'smithi044' 2024-08-19T00:14:00.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.908+0000 7f6089212740 1 --2- 172.21.15.44:0/2676219046 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55ffae7d7580 0x55ffae8450a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:00.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.908+0000 7f6089212740 4 client.25175 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 154.7, "await_for": 45.0}] 2024-08-19T00:14:00.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.908+0000 7f6089212740 1 -- 172.21.15.44:0/2676219046 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 154.7, "await_for": 45.0}) -- 0x55ffae7254f0 con 0x55ffae7d7580 2024-08-19T00:14:00.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.908+0000 7f6077fff640 1 --2- 172.21.15.44:0/2676219046 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55ffae7d7580 0x55ffae8450a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:00.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.909+0000 7f605ffff640 10 client.25175 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:14:00.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.909+0000 7f6077fff640 1 --2- 172.21.15.44:0/2676219046 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55ffae7d7580 0x55ffae8450a0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=679a5b2fef499e64 server_cookie=1881549543ab4e81 in_seq=0 out_seq=0 2024-08-19T00:14:00.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.920+0000 7f605ffff640 1 -- 172.21.15.44:0/2676219046 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55ffae7254f0 con 0x55ffae7d7580 2024-08-19T00:14:00.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.920+0000 7f605ffff640 10 client.25175 handle_command_reply: tid=0 2024-08-19T00:14:00.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.920+0000 7f6089212740 1 client.25175 shutdown 2024-08-19T00:14:00.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.920+0000 7f6089212740 1 -- 172.21.15.44:0/2676219046 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffae7b8030 msgr2=0x55ffae7cbbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:00.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.920+0000 7f6089212740 1 --2- 172.21.15.44:0/2676219046 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffae7b8030 0x55ffae7cbbd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f607c006010 tx=0x7f607c005bd0 comp rx=0 tx=0).stop 2024-08-19T00:14:00.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.920+0000 7f6089212740 1 -- 172.21.15.44:0/2676219046 shutdown_connections 2024-08-19T00:14:00.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.920+0000 7f6089212740 1 --2- 172.21.15.44:0/2676219046 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55ffae7d7580 0x55ffae8450a0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:00.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.920+0000 7f6089212740 1 --2- 172.21.15.44:0/2676219046 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ffae7b8950 0x55ffae7cc110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:00.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.920+0000 7f6089212740 1 --2- 172.21.15.44:0/2676219046 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffae7c7720 0x55ffae841290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:00.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.920+0000 7f605ffff640 0 client.25175 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:14:00.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.920+0000 7f6089212740 1 --2- 172.21.15.44:0/2676219046 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffae7b8030 0x55ffae7cbbd0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:00.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.920+0000 7f6089212740 1 -- 172.21.15.44:0/2676219046 >> 172.21.15.44:0/2676219046 conn(0x55ffae7b46c0 msgr2=0x55ffae7ba380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:14:00.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.920+0000 7f6089212740 1 -- 172.21.15.44:0/2676219046 shutdown_connections 2024-08-19T00:14:00.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.920+0000 7f6089212740 1 -- 172.21.15.44:0/2676219046 wait complete. 2024-08-19T00:14:00.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.920+0000 7f6089212740 20 client.25175 trim_cache size 0 max 16384 2024-08-19T00:14:00.923 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-08-19T00:14:00.923 INFO:teuthology.orchestra.run.smithi044.stdout: "epoch": 28, 2024-08-19T00:14:00.923 INFO:teuthology.orchestra.run.smithi044.stdout: "leader": 24473, 2024-08-19T00:14:00.923 INFO:teuthology.orchestra.run.smithi044.stdout: "set_version": 2, 2024-08-19T00:14:00.923 INFO:teuthology.orchestra.run.smithi044.stdout: "sets": { 2024-08-19T00:14:00.923 INFO:teuthology.orchestra.run.smithi044.stdout: "bb4507ff": { 2024-08-19T00:14:00.923 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 2, 2024-08-19T00:14:00.923 INFO:teuthology.orchestra.run.smithi044.stdout: "age_ref": 0.0, 2024-08-19T00:14:00.923 INFO:teuthology.orchestra.run.smithi044.stdout: "state": { 2024-08-19T00:14:00.923 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "QUIESCED", 2024-08-19T00:14:00.923 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.0 2024-08-19T00:14:00.923 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:14:00.924 INFO:teuthology.orchestra.run.smithi044.stdout: "timeout": 90.0, 2024-08-19T00:14:00.924 INFO:teuthology.orchestra.run.smithi044.stdout: "expiration": 154.7, 2024-08-19T00:14:00.924 INFO:teuthology.orchestra.run.smithi044.stdout: "members": { 2024-08-19T00:14:00.924 INFO:teuthology.orchestra.run.smithi044.stdout: "file:/": { 2024-08-19T00:14:00.924 INFO:teuthology.orchestra.run.smithi044.stdout: "excluded": false, 2024-08-19T00:14:00.924 INFO:teuthology.orchestra.run.smithi044.stdout: "state": { 2024-08-19T00:14:00.924 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "QUIESCED", 2024-08-19T00:14:00.924 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.0 2024-08-19T00:14:00.924 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:14:00.924 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:14:00.924 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:14:00.924 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:14:00.924 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:14:00.925 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-08-19T00:14:00.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.920+0000 7f6086e14640 1 -- 172.21.15.44:0/154701319 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f60680a2e10 msgr2=0x7f60680a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:00.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.921+0000 7f6086e14640 1 --2- 172.21.15.44:0/154701319 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f60680a2e10 0x7f60680a52d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6078007c40 tx=0x7f607801b000 comp rx=0 tx=0).stop 2024-08-19T00:14:00.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.921+0000 7f6086e14640 1 -- 172.21.15.44:0/154701319 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6080100230 msgr2=0x7f6080198330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:00.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.921+0000 7f6086e14640 1 --2- 172.21.15.44:0/154701319 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6080100230 0x7f6080198330 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f607c02a930 tx=0x7f607c003b90 comp rx=0 tx=0).stop 2024-08-19T00:14:00.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.921+0000 7f6086e14640 1 -- 172.21.15.44:0/154701319 shutdown_connections 2024-08-19T00:14:00.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.921+0000 7f6086e14640 1 --2- 172.21.15.44:0/154701319 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f60680a2e10 0x7f60680a52d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:00.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.921+0000 7f6086e14640 1 --2- 172.21.15.44:0/154701319 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6080100be0 0x7f6080198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:00.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.921+0000 7f6086e14640 1 --2- 172.21.15.44:0/154701319 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6080106ca0 0x7f608019cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:00.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.921+0000 7f6086e14640 1 --2- 172.21.15.44:0/154701319 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6080100230 0x7f6080198330 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:00.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.921+0000 7f6086e14640 1 -- 172.21.15.44:0/154701319 >> 172.21.15.44:0/154701319 conn(0x7f60800fc2f0 msgr2=0x7f60800fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:14:00.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.921+0000 7f6086e14640 1 -- 172.21.15.44:0/154701319 shutdown_connections 2024-08-19T00:14:00.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:00.921+0000 7f6086e14640 1 -- 172.21.15.44:0/154701319 wait complete. 2024-08-19T00:14:01.673 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'bb4507ff', quiesce took 3.5 seconds. Will release after: 31.200000000000003 2024-08-19T00:14:01.783 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.777+0000 7f23aeb81640 1 -- 172.21.15.44:0/2026747238 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23a81021a0 msgr2=0x7f23a810e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:01.783 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.777+0000 7f23aeb81640 1 --2- 172.21.15.44:0/2026747238 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23a81021a0 0x7f23a810e6d0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f23a0009cd0 tx=0x7f23a002a8e0 comp rx=0 tx=0).stop 2024-08-19T00:14:01.784 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.778+0000 7f23aeb81640 1 -- 172.21.15.44:0/2026747238 shutdown_connections 2024-08-19T00:14:01.784 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.778+0000 7f23aeb81640 1 --2- 172.21.15.44:0/2026747238 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23a81021a0 0x7f23a810e6d0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:01.784 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.778+0000 7f23aeb81640 1 --2- 172.21.15.44:0/2026747238 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f23a8101800 0x7f23a8101c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:01.784 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.778+0000 7f23aeb81640 1 --2- 172.21.15.44:0/2026747238 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23a8107810 0x7f23a8107bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:01.785 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.778+0000 7f23aeb81640 1 -- 172.21.15.44:0/2026747238 >> 172.21.15.44:0/2026747238 conn(0x7f23a80fd500 msgr2=0x7f23a80ff920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:14:01.785 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.778+0000 7f23aeb81640 1 -- 172.21.15.44:0/2026747238 shutdown_connections 2024-08-19T00:14:01.785 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.778+0000 7f23aeb81640 1 -- 172.21.15.44:0/2026747238 wait complete. 2024-08-19T00:14:01.785 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.778+0000 7f23aeb81640 1 Processor -- start 2024-08-19T00:14:01.785 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.778+0000 7f23aeb81640 1 -- start start 2024-08-19T00:14:01.785 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.778+0000 7f23aeb81640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23a8101800 0x7f23a8198080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:01.786 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.778+0000 7f23aeb81640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23a81021a0 0x7f23a81985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:01.786 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.778+0000 7f23aeb81640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f23a8107810 0x7f23a819c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:01.786 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.779+0000 7f23ac91d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23a8101800 0x7f23a8198080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:01.786 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.779+0000 7f23aeb81640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f23a8111c50 con 0x7f23a8101800 2024-08-19T00:14:01.787 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.779+0000 7f23ac91d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23a8101800 0x7f23a8198080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42146/0 (socket says 172.21.15.44:42146) 2024-08-19T00:14:01.787 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.779+0000 7f23ac91d640 1 -- 172.21.15.44:0/570528527 learned_addr learned my addr 172.21.15.44:0/570528527 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:14:01.787 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.779+0000 7f23aeb81640 1 -- 172.21.15.44:0/570528527 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f23a8111ad0 con 0x7f23a8107810 2024-08-19T00:14:01.787 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.779+0000 7f23aeb81640 1 -- 172.21.15.44:0/570528527 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f23a8111dd0 con 0x7f23a81021a0 2024-08-19T00:14:01.787 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.779+0000 7f23a7fff640 1 --2- 172.21.15.44:0/570528527 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23a81021a0 0x7f23a81985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:01.788 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.779+0000 7f23ad11e640 1 --2- 172.21.15.44:0/570528527 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f23a8107810 0x7f23a819c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:01.788 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.779+0000 7f23ac91d640 1 -- 172.21.15.44:0/570528527 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23a81021a0 msgr2=0x7f23a81985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:01.788 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.779+0000 7f23ac91d640 1 --2- 172.21.15.44:0/570528527 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23a81021a0 0x7f23a81985c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:01.788 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.779+0000 7f23ac91d640 1 -- 172.21.15.44:0/570528527 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f23a8107810 msgr2=0x7f23a819c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:01.788 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.779+0000 7f23ac91d640 1 --2- 172.21.15.44:0/570528527 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f23a8107810 0x7f23a819c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:01.789 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.779+0000 7f23ac91d640 1 -- 172.21.15.44:0/570528527 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23a819d070 con 0x7f23a8101800 2024-08-19T00:14:01.789 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.779+0000 7f23ad11e640 1 --2- 172.21.15.44:0/570528527 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f23a8107810 0x7f23a819c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:14:01.789 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.779+0000 7f23ac91d640 1 --2- 172.21.15.44:0/570528527 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23a8101800 0x7f23a8198080 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f239c00e9f0 tx=0x7f239c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:14:01.789 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.779+0000 7f23a5ffb640 1 -- 172.21.15.44:0/570528527 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f239c00ccc0 con 0x7f23a8101800 2024-08-19T00:14:01.789 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.779+0000 7f23a5ffb640 1 -- 172.21.15.44:0/570528527 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f239c00ce60 con 0x7f23a8101800 2024-08-19T00:14:01.790 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.780+0000 7f23a5ffb640 1 -- 172.21.15.44:0/570528527 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f239c010690 con 0x7f23a8101800 2024-08-19T00:14:01.790 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.780+0000 7f23aeb81640 1 -- 172.21.15.44:0/570528527 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23a819d360 con 0x7f23a8101800 2024-08-19T00:14:01.790 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.780+0000 7f23aeb81640 1 -- 172.21.15.44:0/570528527 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23a81a4bf0 con 0x7f23a8101800 2024-08-19T00:14:01.799 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.783+0000 7f23b1a18740 1 Processor -- start 2024-08-19T00:14:01.799 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.783+0000 7f23b1a18740 1 -- start start 2024-08-19T00:14:01.799 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.783+0000 7f23b1a18740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5568384486b0 0x556838448a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:01.800 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.783+0000 7f23b1a18740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556838448fd0 0x556838457860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:01.800 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.783+0000 7f23b1a18740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556838457da0 0x55683845a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:01.800 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.783+0000 7f23b1a18740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5568383ac9d0 con 0x556838448fd0 2024-08-19T00:14:01.800 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.783+0000 7f23b1a18740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x556838354820 con 0x556838457da0 2024-08-19T00:14:01.800 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.783+0000 7f23b1a18740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5568383a8990 con 0x5568384486b0 2024-08-19T00:14:01.800 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.784+0000 7f23a5ffb640 1 -- 172.21.15.44:0/570528527 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 24) ==== 138060+0+0 (secure 0 0 0) 0x7f239c0046c0 con 0x7f23a8101800 2024-08-19T00:14:01.801 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.784+0000 7f23ac91d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556838448fd0 0x556838457860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:01.801 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.784+0000 7f23ad11e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5568384486b0 0x556838448a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:01.801 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.784+0000 7f23a7fff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556838457da0 0x55683845a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:01.801 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.784+0000 7f23ac91d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556838448fd0 0x556838457860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42150/0 (socket says 172.21.15.44:42150) 2024-08-19T00:14:01.801 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.784+0000 7f23ad11e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5568384486b0 0x556838448a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.44:55678/0 (socket says 172.21.15.44:55678) 2024-08-19T00:14:01.802 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.784+0000 7f23ac91d640 1 -- 172.21.15.44:0/2244760677 learned_addr learned my addr 172.21.15.44:0/2244760677 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:14:01.802 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.784+0000 7f23ac91d640 1 -- 172.21.15.44:0/2244760677 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5568384486b0 msgr2=0x556838448a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:14:01.802 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.784+0000 7f23ac91d640 1 --2- 172.21.15.44:0/2244760677 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5568384486b0 0x556838448a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:01.802 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.784+0000 7f23ac91d640 1 -- 172.21.15.44:0/2244760677 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556838457da0 msgr2=0x55683845a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:14:01.802 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.784+0000 7f23ac91d640 1 --2- 172.21.15.44:0/2244760677 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556838457da0 0x55683845a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:01.803 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.784+0000 7f23ac91d640 1 -- 172.21.15.44:0/2244760677 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568380c0210 con 0x556838448fd0 2024-08-19T00:14:01.803 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.785+0000 7f23ac91d640 1 --2- 172.21.15.44:0/2244760677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556838448fd0 0x556838457860 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f239c0cd070 tx=0x7f239c0d84b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8496d18500d1f2fe server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:14:01.803 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.785+0000 7f23a5ffb640 1 --2- 172.21.15.44:0/570528527 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f23980a2f40 0x7f23980a5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:01.803 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.785+0000 7f2392ffd640 1 -- 172.21.15.44:0/2244760677 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f239c0e3070 con 0x556838448fd0 2024-08-19T00:14:01.803 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.785+0000 7f23ad11e640 1 --2- 172.21.15.44:0/570528527 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f23980a2f40 0x7f23980a5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:01.803 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.785+0000 7f2392ffd640 1 -- 172.21.15.44:0/2244760677 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f239c09c4d0 con 0x556838448fd0 2024-08-19T00:14:01.804 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.785+0000 7f2392ffd640 1 -- 172.21.15.44:0/2244760677 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f239c09bba0 con 0x556838448fd0 2024-08-19T00:14:01.804 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.785+0000 7f23a5ffb640 1 -- 172.21.15.44:0/570528527 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f239c0cfea0 con 0x7f23a8101800 2024-08-19T00:14:01.804 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.786+0000 7f23b1a18740 1 -- 172.21.15.44:0/2244760677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556838448fd0 msgr2=0x556838457860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:01.804 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.786+0000 7f23ad11e640 1 --2- 172.21.15.44:0/570528527 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f23980a2f40 0x7f23980a5400 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f23a0009a60 tx=0x7f23a0005d80 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:14:01.804 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.786+0000 7f23b1a18740 1 --2- 172.21.15.44:0/2244760677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556838448fd0 0x556838457860 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f239c0cd070 tx=0x7f239c0d84b0 comp rx=0 tx=0).stop 2024-08-19T00:14:01.805 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.786+0000 7f23b1a18740 1 -- 172.21.15.44:0/2244760677 shutdown_connections 2024-08-19T00:14:01.805 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.786+0000 7f23b1a18740 1 --2- 172.21.15.44:0/2244760677 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556838457da0 0x55683845a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:01.805 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.786+0000 7f23b1a18740 1 --2- 172.21.15.44:0/2244760677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556838448fd0 0x556838457860 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:01.805 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.786+0000 7f23b1a18740 1 --2- 172.21.15.44:0/2244760677 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5568384486b0 0x556838448a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:01.805 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.786+0000 7f23b1a18740 1 -- 172.21.15.44:0/2244760677 >> 172.21.15.44:0/2244760677 conn(0x556838444d40 msgr2=0x556838445120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:14:01.805 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.786+0000 7f23b1a18740 1 -- 172.21.15.44:0/2244760677 shutdown_connections 2024-08-19T00:14:01.806 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.786+0000 7f23b1a18740 1 -- 172.21.15.44:0/2244760677 wait complete. 2024-08-19T00:14:01.806 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.786+0000 7f23b1a18740 1 -- start start 2024-08-19T00:14:01.806 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.787+0000 7f23b1a18740 1 Processor -- start 2024-08-19T00:14:01.806 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.787+0000 7f23b1a18740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5568384486b0 0x556838454d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:01.806 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.787+0000 7f23b1a18740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556838448fd0 0x556838455240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:01.807 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.787+0000 7f23b1a18740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556838457da0 0x556838455780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:01.807 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.787+0000 7f23b1a18740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55683845a9d0 con 0x556838457da0 2024-08-19T00:14:01.807 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.787+0000 7f23b1a18740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x556838368520 con 0x5568384486b0 2024-08-19T00:14:01.807 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.787+0000 7f23b1a18740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55683845ab50 con 0x556838448fd0 2024-08-19T00:14:01.807 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.787+0000 7f23b1a18740 10 client.0 _ll_register_callbacks cb 0x5568380bfa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:14:01.808 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.787+0000 7f23ad11e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556838457da0 0x556838455780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:01.808 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.787+0000 7f23ad11e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556838457da0 0x556838455780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42152/0 (socket says 172.21.15.44:42152) 2024-08-19T00:14:01.808 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.787+0000 7f23ad11e640 1 -- 172.21.15.44:0/657320401 learned_addr learned my addr 172.21.15.44:0/657320401 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:14:01.808 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.787+0000 7f23a7fff640 1 --2- 172.21.15.44:0/657320401 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556838448fd0 0x556838455240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:01.808 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.787+0000 7f23ac91d640 1 --2- 172.21.15.44:0/657320401 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5568384486b0 0x556838454d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:01.809 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.788+0000 7f23ad11e640 1 -- 172.21.15.44:0/657320401 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556838448fd0 msgr2=0x556838455240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:14:01.809 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.788+0000 7f23ad11e640 1 --2- 172.21.15.44:0/657320401 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556838448fd0 0x556838455240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:01.809 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.788+0000 7f23ad11e640 1 -- 172.21.15.44:0/657320401 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5568384486b0 msgr2=0x556838454d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:14:01.809 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.788+0000 7f23ad11e640 1 --2- 172.21.15.44:0/657320401 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5568384486b0 0x556838454d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:01.809 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.788+0000 7f23ad11e640 1 -- 172.21.15.44:0/657320401 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55683818c620 con 0x556838457da0 2024-08-19T00:14:01.809 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.788+0000 7f23ad11e640 1 --2- 172.21.15.44:0/657320401 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556838457da0 0x556838455780 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f23a0003c20 tx=0x7f23a00095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8251a9fb75d62ec server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:14:01.810 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.788+0000 7f2387fff640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:14:01.810 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.788+0000 7f2387fff640 1 -- 172.21.15.44:0/657320401 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a0003e50 con 0x556838457da0 2024-08-19T00:14:01.810 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.788+0000 7f23b1a18740 1 -- 172.21.15.44:0/657320401 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f239c09c4d0 con 0x556838457da0 2024-08-19T00:14:01.810 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.788+0000 7f2387fff640 1 -- 172.21.15.44:0/657320401 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f23a0004540 con 0x556838457da0 2024-08-19T00:14:01.810 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.788+0000 7f2387fff640 1 -- 172.21.15.44:0/657320401 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f23a0004740 con 0x556838457da0 2024-08-19T00:14:01.811 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.788+0000 7f23b1a18740 10 client.15618 fetch_fsmap learned FSMap version 28 2024-08-19T00:14:01.811 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.788+0000 7f23b1a18740 1 -- 172.21.15.44:0/657320401 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5568384666f0 con 0x556838457da0 2024-08-19T00:14:01.811 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.789+0000 7f2387fff640 1 -- 172.21.15.44:0/657320401 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f239c09c4d0 con 0x556838457da0 2024-08-19T00:14:01.811 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.789+0000 7f2387fff640 1 -- 172.21.15.44:0/657320401 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f23a005c080 con 0x556838457da0 2024-08-19T00:14:01.811 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.789+0000 7f23b1a18740 10 client.15618 fetch_fsmap finished waiting for FSMap version 28 2024-08-19T00:14:01.811 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.789+0000 7f23b1a18740 10 client.15618 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:14:01.812 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.789+0000 7f23b1a18740 20 client.15618 populate_metadata read hostname 'smithi044' 2024-08-19T00:14:01.812 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.789+0000 7f23b1a18740 1 --2- 172.21.15.44:0/657320401 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x556838467c70 0x55683846a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:01.812 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.789+0000 7f23b1a18740 4 client.15618 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:14:01.812 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.789+0000 7f23b1a18740 1 -- 172.21.15.44:0/657320401 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5568383ba100 con 0x556838467c70 2024-08-19T00:14:01.812 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.789+0000 7f23ac91d640 1 --2- 172.21.15.44:0/657320401 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x556838467c70 0x55683846a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:01.813 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.789+0000 7f2387fff640 10 client.15618 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:14:01.813 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.789+0000 7f23ac91d640 1 --2- 172.21.15.44:0/657320401 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x556838467c70 0x55683846a080 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f1ec6e07eac2908 server_cookie=fae867b874453856 in_seq=0 out_seq=0 2024-08-19T00:14:01.813 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.790+0000 7f2387fff640 1 -- 172.21.15.44:0/657320401 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5568383ba100 con 0x556838467c70 2024-08-19T00:14:01.813 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.790+0000 7f2387fff640 10 client.15618 handle_command_reply: tid=0 2024-08-19T00:14:01.813 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.790+0000 7f23b1a18740 1 client.15618 shutdown 2024-08-19T00:14:01.813 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.790+0000 7f23b1a18740 1 -- 172.21.15.44:0/657320401 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556838457da0 msgr2=0x556838455780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:01.814 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.790+0000 7f23b1a18740 1 --2- 172.21.15.44:0/657320401 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556838457da0 0x556838455780 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f23a0003c20 tx=0x7f23a00095c0 comp rx=0 tx=0).stop 2024-08-19T00:14:01.814 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.790+0000 7f23b1a18740 1 -- 172.21.15.44:0/657320401 shutdown_connections 2024-08-19T00:14:01.814 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.790+0000 7f23b1a18740 1 --2- 172.21.15.44:0/657320401 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x556838467c70 0x55683846a080 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:01.814 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.790+0000 7f23b1a18740 1 --2- 172.21.15.44:0/657320401 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556838448fd0 0x556838455240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:01.815 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.790+0000 7f23b1a18740 1 --2- 172.21.15.44:0/657320401 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556838457da0 0x556838455780 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:01.815 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.790+0000 7f23b1a18740 1 --2- 172.21.15.44:0/657320401 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5568384486b0 0x556838454d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:01.815 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.790+0000 7f23b1a18740 1 -- 172.21.15.44:0/657320401 >> 172.21.15.44:0/657320401 conn(0x556838444d40 msgr2=0x55683844aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:14:01.815 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.790+0000 7f2387fff640 0 client.15618 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:14:01.815 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.791+0000 7f23b1a18740 1 -- 172.21.15.44:0/657320401 shutdown_connections 2024-08-19T00:14:01.815 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.791+0000 7f23b1a18740 1 -- 172.21.15.44:0/657320401 wait complete. 2024-08-19T00:14:01.816 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.791+0000 7f23b1a18740 20 client.15618 trim_cache size 0 max 16384 2024-08-19T00:14:01.822 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.813+0000 7f23b1a18740 1 Processor -- start 2024-08-19T00:14:01.822 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.813+0000 7f23b1a18740 1 -- start start 2024-08-19T00:14:01.822 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.814+0000 7f23b1a18740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5568384486b0 0x55683843f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:01.822 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.814+0000 7f23b1a18740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556838448fd0 0x55683846f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:01.822 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.814+0000 7f23b1a18740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556838457da0 0x55683846fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:01.822 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.814+0000 7f23b1a18740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f23a81aca10 con 0x556838448fd0 2024-08-19T00:14:01.822 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.814+0000 7f23b1a18740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f23a81ae550 con 0x5568384486b0 2024-08-19T00:14:01.822 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.814+0000 7f23b1a18740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f23a81ad0e0 con 0x556838457da0 2024-08-19T00:14:01.823 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.814+0000 7f23a7fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556838448fd0 0x55683846f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:01.823 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.814+0000 7f23a7fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556838448fd0 0x55683846f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42158/0 (socket says 172.21.15.44:42158) 2024-08-19T00:14:01.823 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.814+0000 7f23a7fff640 1 -- 172.21.15.44:0/3875131951 learned_addr learned my addr 172.21.15.44:0/3875131951 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:14:01.823 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.814+0000 7f23ac91d640 1 --2- 172.21.15.44:0/3875131951 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5568384486b0 0x55683843f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:01.823 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.814+0000 7f23ad11e640 1 --2- 172.21.15.44:0/3875131951 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556838457da0 0x55683846fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:01.823 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.814+0000 7f23a7fff640 1 -- 172.21.15.44:0/3875131951 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556838457da0 msgr2=0x55683846fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:14:01.823 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.814+0000 7f23a7fff640 1 --2- 172.21.15.44:0/3875131951 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556838457da0 0x55683846fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:01.823 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.814+0000 7f23a7fff640 1 -- 172.21.15.44:0/3875131951 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5568384486b0 msgr2=0x55683843f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:14:01.823 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.814+0000 7f23a7fff640 1 --2- 172.21.15.44:0/3875131951 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5568384486b0 0x55683843f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:01.823 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.814+0000 7f23a7fff640 1 -- 172.21.15.44:0/3875131951 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556838453c90 con 0x556838448fd0 2024-08-19T00:14:01.823 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.815+0000 7f23a7fff640 1 --2- 172.21.15.44:0/3875131951 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556838448fd0 0x55683846f990 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f239400ae00 tx=0x7f239400a2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f8af8b53b7126f9 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:14:01.823 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.815+0000 7f23927fc640 1 -- 172.21.15.44:0/3875131951 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f239401e030 con 0x556838448fd0 2024-08-19T00:14:01.823 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.815+0000 7f23927fc640 1 -- 172.21.15.44:0/3875131951 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2394005500 con 0x556838448fd0 2024-08-19T00:14:01.823 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.815+0000 7f23927fc640 1 -- 172.21.15.44:0/3875131951 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f239401a870 con 0x556838448fd0 2024-08-19T00:14:01.823 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.816+0000 7f23b1a18740 1 -- 172.21.15.44:0/3875131951 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556838448fd0 msgr2=0x55683846f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:01.824 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.816+0000 7f23b1a18740 1 --2- 172.21.15.44:0/3875131951 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556838448fd0 0x55683846f990 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f239400ae00 tx=0x7f239400a2d0 comp rx=0 tx=0).stop 2024-08-19T00:14:01.824 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.816+0000 7f23b1a18740 1 -- 172.21.15.44:0/3875131951 shutdown_connections 2024-08-19T00:14:01.824 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.816+0000 7f23b1a18740 1 --2- 172.21.15.44:0/3875131951 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556838457da0 0x55683846fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:01.824 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.816+0000 7f23b1a18740 1 --2- 172.21.15.44:0/3875131951 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556838448fd0 0x55683846f990 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:01.824 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.816+0000 7f23b1a18740 1 --2- 172.21.15.44:0/3875131951 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5568384486b0 0x55683843f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:01.824 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.816+0000 7f23b1a18740 1 -- 172.21.15.44:0/3875131951 >> 172.21.15.44:0/3875131951 conn(0x556838444d40 msgr2=0x556838456c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:14:01.824 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.816+0000 7f23b1a18740 1 -- 172.21.15.44:0/3875131951 shutdown_connections 2024-08-19T00:14:01.824 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.816+0000 7f23b1a18740 1 -- 172.21.15.44:0/3875131951 wait complete. 2024-08-19T00:14:01.824 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.816+0000 7f23b1a18740 1 -- start start 2024-08-19T00:14:01.824 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.816+0000 7f23b1a18740 1 Processor -- start 2024-08-19T00:14:01.824 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.817+0000 7f23b1a18740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5568384486b0 0x55683845c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:01.824 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.817+0000 7f23b1a18740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556838448fd0 0x55683845c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:01.824 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.817+0000 7f23b1a18740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556838457da0 0x5568384d1960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:01.825 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.817+0000 7f23b1a18740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f23a81ade80 con 0x556838448fd0 2024-08-19T00:14:01.825 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.817+0000 7f23b1a18740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f23a81ad7b0 con 0x556838457da0 2024-08-19T00:14:01.825 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.817+0000 7f23b1a18740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f23a81aaa40 con 0x5568384486b0 2024-08-19T00:14:01.825 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.817+0000 7f23b1a18740 10 client.0 _ll_register_callbacks cb 0x7f23a0009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:14:01.825 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.817+0000 7f23a7fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556838448fd0 0x55683845c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:01.825 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.817+0000 7f23a7fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556838448fd0 0x55683845c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42168/0 (socket says 172.21.15.44:42168) 2024-08-19T00:14:01.825 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.817+0000 7f23a7fff640 1 -- 172.21.15.44:0/2350174886 learned_addr learned my addr 172.21.15.44:0/2350174886 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:14:01.825 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.817+0000 7f23ac91d640 1 --2- 172.21.15.44:0/2350174886 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5568384486b0 0x55683845c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:01.825 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.817+0000 7f23ad11e640 1 --2- 172.21.15.44:0/2350174886 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556838457da0 0x5568384d1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:01.825 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.817+0000 7f23a7fff640 1 -- 172.21.15.44:0/2350174886 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5568384486b0 msgr2=0x55683845c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:14:01.825 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.817+0000 7f23a7fff640 1 --2- 172.21.15.44:0/2350174886 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5568384486b0 0x55683845c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:01.825 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.817+0000 7f23a7fff640 1 -- 172.21.15.44:0/2350174886 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556838457da0 msgr2=0x5568384d1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:14:01.826 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.817+0000 7f23a7fff640 1 --2- 172.21.15.44:0/2350174886 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556838457da0 0x5568384d1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:01.826 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.817+0000 7f23a7fff640 1 -- 172.21.15.44:0/2350174886 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568384d1ea0 con 0x556838448fd0 2024-08-19T00:14:01.826 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.818+0000 7f2387fff640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:14:01.826 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.818+0000 7f23a7fff640 1 --2- 172.21.15.44:0/2350174886 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556838448fd0 0x55683845c790 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f2394010c90 tx=0x7f23940052d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62d8fac29b0bb15c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:14:01.826 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.818+0000 7f2387fff640 1 -- 172.21.15.44:0/2350174886 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f239401aa20 con 0x556838448fd0 2024-08-19T00:14:01.826 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.818+0000 7f2387fff640 1 -- 172.21.15.44:0/2350174886 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f239401abc0 con 0x556838448fd0 2024-08-19T00:14:01.826 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.818+0000 7f23b1a18740 1 -- 172.21.15.44:0/2350174886 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2394005500 con 0x556838448fd0 2024-08-19T00:14:01.826 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.818+0000 7f2387fff640 1 -- 172.21.15.44:0/2350174886 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f239400aa90 con 0x556838448fd0 2024-08-19T00:14:01.826 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.818+0000 7f23b1a18740 10 client.15624 fetch_fsmap learned FSMap version 28 2024-08-19T00:14:01.826 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.818+0000 7f23b1a18740 1 -- 172.21.15.44:0/2350174886 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5568384d3180 con 0x556838448fd0 2024-08-19T00:14:01.826 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.818+0000 7f2387fff640 1 -- 172.21.15.44:0/2350174886 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2394005500 con 0x556838448fd0 2024-08-19T00:14:01.826 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.818+0000 7f2387fff640 1 -- 172.21.15.44:0/2350174886 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f239402c020 con 0x556838448fd0 2024-08-19T00:14:01.827 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.818+0000 7f23b1a18740 10 client.15624 fetch_fsmap finished waiting for FSMap version 28 2024-08-19T00:14:01.827 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.818+0000 7f23b1a18740 10 client.15624 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:14:01.827 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.818+0000 7f23b1a18740 20 client.15624 populate_metadata read hostname 'smithi044' 2024-08-19T00:14:01.827 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.818+0000 7f23b1a18740 1 --2- 172.21.15.44:0/2350174886 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5568384d3870 0x5568384d5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:01.827 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.818+0000 7f23b1a18740 4 client.15624 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-19T00:14:01.827 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.818+0000 7f23b1a18740 1 -- 172.21.15.44:0/2350174886 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5568383b4450 con 0x5568384d3870 2024-08-19T00:14:01.827 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.819+0000 7f23ac91d640 1 --2- 172.21.15.44:0/2350174886 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5568384d3870 0x5568384d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:01.827 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.819+0000 7f2387fff640 10 client.15624 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:14:01.827 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.819+0000 7f23ac91d640 1 --2- 172.21.15.44:0/2350174886 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5568384d3870 0x5568384d5c90 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb9f17bb25249c58 server_cookie=7b1bf0f062607d8b in_seq=0 out_seq=0 2024-08-19T00:14:01.829 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.827+0000 7f2387fff640 1 -- 172.21.15.44:0/2350174886 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5568383b4450 con 0x5568384d3870 2024-08-19T00:14:01.830 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.827+0000 7f2387fff640 10 client.15624 handle_command_reply: tid=0 2024-08-19T00:14:01.830 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.827+0000 7f23b1a18740 1 client.15624 shutdown 2024-08-19T00:14:01.830 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.827+0000 7f23b1a18740 1 -- 172.21.15.44:0/2350174886 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556838448fd0 msgr2=0x55683845c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:01.830 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.828+0000 7f23b1a18740 1 --2- 172.21.15.44:0/2350174886 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556838448fd0 0x55683845c790 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f2394010c90 tx=0x7f23940052d0 comp rx=0 tx=0).stop 2024-08-19T00:14:01.830 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.828+0000 7f23b1a18740 1 -- 172.21.15.44:0/2350174886 shutdown_connections 2024-08-19T00:14:01.830 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.828+0000 7f23b1a18740 1 --2- 172.21.15.44:0/2350174886 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5568384d3870 0x5568384d5c90 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:01.830 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.828+0000 7f23b1a18740 1 --2- 172.21.15.44:0/2350174886 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556838457da0 0x5568384d1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:01.830 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.828+0000 7f23b1a18740 1 --2- 172.21.15.44:0/2350174886 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556838448fd0 0x55683845c790 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:01.830 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.828+0000 7f2387fff640 0 client.15624 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:14:01.830 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.828+0000 7f23b1a18740 1 --2- 172.21.15.44:0/2350174886 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5568384486b0 0x55683845c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:01.830 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.828+0000 7f23b1a18740 1 -- 172.21.15.44:0/2350174886 >> 172.21.15.44:0/2350174886 conn(0x556838444d40 msgr2=0x556838454cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:14:01.831 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.828+0000 7f23b1a18740 1 -- 172.21.15.44:0/2350174886 shutdown_connections 2024-08-19T00:14:01.831 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.828+0000 7f23b1a18740 1 -- 172.21.15.44:0/2350174886 wait complete. 2024-08-19T00:14:01.831 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.828+0000 7f23b1a18740 20 client.15624 trim_cache size 0 max 16384 2024-08-19T00:14:01.831 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:{ 2024-08-19T00:14:01.831 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "message": "", 2024-08-19T00:14:01.831 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "return_code": 0 2024-08-19T00:14:01.831 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:} 2024-08-19T00:14:01.832 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.828+0000 7f23aeb81640 1 -- 172.21.15.44:0/570528527 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f23980a2f40 msgr2=0x7f23980a5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:01.832 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.828+0000 7f23aeb81640 1 --2- 172.21.15.44:0/570528527 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f23980a2f40 0x7f23980a5400 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f23a0009a60 tx=0x7f23a0005d80 comp rx=0 tx=0).stop 2024-08-19T00:14:01.832 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.828+0000 7f23aeb81640 1 -- 172.21.15.44:0/570528527 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23a8101800 msgr2=0x7f23a8198080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:01.832 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.829+0000 7f23aeb81640 1 --2- 172.21.15.44:0/570528527 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23a8101800 0x7f23a8198080 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f239c00e9f0 tx=0x7f239c00edf0 comp rx=0 tx=0).stop 2024-08-19T00:14:01.832 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.829+0000 7f23aeb81640 1 -- 172.21.15.44:0/570528527 shutdown_connections 2024-08-19T00:14:01.832 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.829+0000 7f23aeb81640 1 --2- 172.21.15.44:0/570528527 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f23980a2f40 0x7f23980a5400 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:01.832 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.829+0000 7f23aeb81640 1 --2- 172.21.15.44:0/570528527 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23a81021a0 0x7f23a81985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:01.833 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.829+0000 7f23aeb81640 1 --2- 172.21.15.44:0/570528527 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f23a8107810 0x7f23a819c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:01.833 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.829+0000 7f23aeb81640 1 --2- 172.21.15.44:0/570528527 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23a8101800 0x7f23a8198080 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:01.833 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.829+0000 7f23aeb81640 1 -- 172.21.15.44:0/570528527 >> 172.21.15.44:0/570528527 conn(0x7f23a80fd500 msgr2=0x7f23a80fd980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:14:01.833 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.829+0000 7f23aeb81640 1 -- 172.21.15.44:0/570528527 shutdown_connections 2024-08-19T00:14:01.833 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:01.829+0000 7f23aeb81640 1 -- 172.21.15.44:0/570528527 wait complete. 2024-08-19T00:14:02.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:14:01 smithi171 ceph-mon[21810]: pgmap v24: 129 pgs: 129 active+clean; 1.3 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-08-19T00:14:02.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:14:01 smithi116 ceph-mon[21873]: pgmap v24: 129 pgs: 129 active+clean; 1.3 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-08-19T00:14:02.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:14:01 smithi044 ceph-mon[18489]: pgmap v24: 129 pgs: 129 active+clean; 1.3 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-08-19T00:14:04.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:14:03 smithi171 ceph-mon[21810]: pgmap v25: 129 pgs: 129 active+clean; 1.3 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-19T00:14:04.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:14:03 smithi171 ceph-mon[21810]: mgrmap e25: x(active, since 44s), standbys: z, y 2024-08-19T00:14:04.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:14:03 smithi116 ceph-mon[21873]: pgmap v25: 129 pgs: 129 active+clean; 1.3 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-19T00:14:04.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:14:03 smithi116 ceph-mon[21873]: mgrmap e25: x(active, since 44s), standbys: z, y 2024-08-19T00:14:04.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:14:03 smithi044 ceph-mon[18489]: pgmap v25: 129 pgs: 129 active+clean; 1.3 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-19T00:14:04.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:14:03 smithi044 ceph-mon[18489]: mgrmap e25: x(active, since 44s), standbys: z, y 2024-08-19T00:14:06.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:14:05 smithi171 ceph-mon[21810]: pgmap v26: 129 pgs: 129 active+clean; 1.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 25 KiB/s wr, 28 op/s 2024-08-19T00:14:06.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:14:05 smithi116 ceph-mon[21873]: pgmap v26: 129 pgs: 129 active+clean; 1.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 25 KiB/s wr, 28 op/s 2024-08-19T00:14:06.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:14:05 smithi044 ceph-mon[18489]: pgmap v26: 129 pgs: 129 active+clean; 1.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 25 KiB/s wr, 28 op/s 2024-08-19T00:14:08.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:14:07 smithi171 ceph-mon[21810]: pgmap v27: 129 pgs: 129 active+clean; 1.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 KiB/s wr, 28 op/s 2024-08-19T00:14:08.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:14:07 smithi116 ceph-mon[21873]: pgmap v27: 129 pgs: 129 active+clean; 1.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 KiB/s wr, 28 op/s 2024-08-19T00:14:08.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:14:07 smithi044 ceph-mon[18489]: pgmap v27: 129 pgs: 129 active+clean; 1.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 KiB/s wr, 28 op/s 2024-08-19T00:14:10.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:14:09 smithi171 ceph-mon[21810]: pgmap v28: 129 pgs: 129 active+clean; 1.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 KiB/s wr, 26 op/s 2024-08-19T00:14:10.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:14:09 smithi116 ceph-mon[21873]: pgmap v28: 129 pgs: 129 active+clean; 1.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 KiB/s wr, 26 op/s 2024-08-19T00:14:10.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:14:09 smithi044 ceph-mon[18489]: pgmap v28: 129 pgs: 129 active+clean; 1.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 KiB/s wr, 26 op/s 2024-08-19T00:14:12.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:14:11 smithi171 ceph-mon[21810]: pgmap v29: 129 pgs: 129 active+clean; 1.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 25 KiB/s wr, 30 op/s 2024-08-19T00:14:12.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:14:11 smithi116 ceph-mon[21873]: pgmap v29: 129 pgs: 129 active+clean; 1.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 25 KiB/s wr, 30 op/s 2024-08-19T00:14:12.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:14:11 smithi044 ceph-mon[18489]: pgmap v29: 129 pgs: 129 active+clean; 1.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 25 KiB/s wr, 30 op/s 2024-08-19T00:14:14.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:14:13 smithi171 ceph-mon[21810]: pgmap v30: 129 pgs: 129 active+clean; 1.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 KiB/s wr, 26 op/s 2024-08-19T00:14:14.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:14:13 smithi116 ceph-mon[21873]: pgmap v30: 129 pgs: 129 active+clean; 1.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 KiB/s wr, 26 op/s 2024-08-19T00:14:14.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:14:13 smithi044 ceph-mon[18489]: pgmap v30: 129 pgs: 129 active+clean; 1.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 KiB/s wr, 26 op/s 2024-08-19T00:14:14.963 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.962+0000 7f7ddb29d640 1 -- 172.21.15.44:0/4090979436 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7dd4101080 msgr2=0x7f7dd410d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:14.964 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.962+0000 7f7ddb29d640 1 --2- 172.21.15.44:0/4090979436 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7dd4101080 0x7f7dd410d5b0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc009cd0 tx=0x7f7dcc02a8e0 comp rx=0 tx=0).stop 2024-08-19T00:14:14.964 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.962+0000 7f7ddb29d640 1 -- 172.21.15.44:0/4090979436 shutdown_connections 2024-08-19T00:14:14.964 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.962+0000 7f7ddb29d640 1 --2- 172.21.15.44:0/4090979436 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7dd4101080 0x7f7dd410d5b0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:14.964 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.962+0000 7f7ddb29d640 1 --2- 172.21.15.44:0/4090979436 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7dd41006e0 0x7f7dd4100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:14.964 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.962+0000 7f7ddb29d640 1 --2- 172.21.15.44:0/4090979436 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7dd41066f0 0x7f7dd4106ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:14.964 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.962+0000 7f7ddb29d640 1 -- 172.21.15.44:0/4090979436 >> 172.21.15.44:0/4090979436 conn(0x7f7dd40776c0 msgr2=0x7f7dd40fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:14:14.964 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.962+0000 7f7ddb29d640 1 -- 172.21.15.44:0/4090979436 shutdown_connections 2024-08-19T00:14:14.964 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.962+0000 7f7ddb29d640 1 -- 172.21.15.44:0/4090979436 wait complete. 2024-08-19T00:14:14.966 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.963+0000 7f7ddb29d640 1 Processor -- start 2024-08-19T00:14:14.966 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.963+0000 7f7ddb29d640 1 -- start start 2024-08-19T00:14:14.966 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.963+0000 7f7ddb29d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7dd41006e0 0x7f7dd4198020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:14.966 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.963+0000 7f7ddb29d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7dd4101080 0x7f7dd4198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:14.966 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.964+0000 7f7ddb29d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7dd41066f0 0x7f7dd419c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:14.966 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.964+0000 7f7dd9039640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7dd41006e0 0x7f7dd4198020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:14.966 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.964+0000 7f7ddb29d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd4110b80 con 0x7f7dd41006e0 2024-08-19T00:14:14.967 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.964+0000 7f7ddb29d640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd4110a00 con 0x7f7dd4101080 2024-08-19T00:14:14.967 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.964+0000 7f7ddb29d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd4110d00 con 0x7f7dd41066f0 2024-08-19T00:14:14.967 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.964+0000 7f7dd9039640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7dd41006e0 0x7f7dd4198020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57696/0 (socket says 172.21.15.44:57696) 2024-08-19T00:14:14.967 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.964+0000 7f7dd9039640 1 -- 172.21.15.44:0/3264984262 learned_addr learned my addr 172.21.15.44:0/3264984262 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:14:14.967 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.964+0000 7f7dd8838640 1 --2- 172.21.15.44:0/3264984262 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7dd4101080 0x7f7dd4198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:14.967 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.964+0000 7f7dd983a640 1 --2- 172.21.15.44:0/3264984262 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7dd41066f0 0x7f7dd419c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:14.967 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.964+0000 7f7dd9039640 1 -- 172.21.15.44:0/3264984262 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7dd41066f0 msgr2=0x7f7dd419c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:14.967 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.964+0000 7f7dd9039640 1 --2- 172.21.15.44:0/3264984262 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7dd41066f0 0x7f7dd419c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:14.967 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.964+0000 7f7dd9039640 1 -- 172.21.15.44:0/3264984262 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7dd4101080 msgr2=0x7f7dd4198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:14.967 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.964+0000 7f7dd9039640 1 --2- 172.21.15.44:0/3264984262 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7dd4101080 0x7f7dd4198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:14.967 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.964+0000 7f7dd9039640 1 -- 172.21.15.44:0/3264984262 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dd419d010 con 0x7f7dd41006e0 2024-08-19T00:14:14.967 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.964+0000 7f7dd9039640 1 --2- 172.21.15.44:0/3264984262 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7dd41006e0 0x7f7dd4198020 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f7dd000d770 tx=0x7f7dd000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:14:14.967 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.964+0000 7f7dca7fc640 1 -- 172.21.15.44:0/3264984262 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd0017070 con 0x7f7dd41006e0 2024-08-19T00:14:14.968 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.965+0000 7f7dca7fc640 1 -- 172.21.15.44:0/3264984262 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7dd0005500 con 0x7f7dd41006e0 2024-08-19T00:14:14.968 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.965+0000 7f7ddb29d640 1 -- 172.21.15.44:0/3264984262 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dd419d300 con 0x7f7dd41006e0 2024-08-19T00:14:14.968 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.965+0000 7f7dca7fc640 1 -- 172.21.15.44:0/3264984262 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd0004e00 con 0x7f7dd41006e0 2024-08-19T00:14:14.968 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.965+0000 7f7ddb29d640 1 -- 172.21.15.44:0/3264984262 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dd4107580 con 0x7f7dd41006e0 2024-08-19T00:14:14.969 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.968+0000 7f7dca7fc640 1 -- 172.21.15.44:0/3264984262 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 25) ==== 138117+0+0 (secure 0 0 0) 0x7f7dd0004fa0 con 0x7f7dd41006e0 2024-08-19T00:14:14.970 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.969+0000 7f7dde05c740 1 Processor -- start 2024-08-19T00:14:14.970 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.969+0000 7f7dde05c740 1 -- start start 2024-08-19T00:14:14.970 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.969+0000 7f7dde05c740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5603485ff7d0 0x5603485ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:14.971 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.969+0000 7f7dde05c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5603486000f0 0x56034860a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:14.971 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.969+0000 7f7dde05c740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56034860a990 0x56034860cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:14.971 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.969+0000 7f7dde05c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5603485639d0 con 0x5603486000f0 2024-08-19T00:14:14.971 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.969+0000 7f7dde05c740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x56034850b820 con 0x5603485ff7d0 2024-08-19T00:14:14.971 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.969+0000 7f7dde05c740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x56034855f990 con 0x56034860a990 2024-08-19T00:14:14.972 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.970+0000 7f7dd983a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5603485ff7d0 0x5603485ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:14.972 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.970+0000 7f7dd983a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5603485ff7d0 0x5603485ffbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.44:45064/0 (socket says 172.21.15.44:45064) 2024-08-19T00:14:14.973 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.970+0000 7f7dd983a640 1 -- 172.21.15.44:0/3264713214 learned_addr learned my addr 172.21.15.44:0/3264713214 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:14:14.973 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.970+0000 7f7dd9039640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5603486000f0 0x56034860a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:14.973 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.970+0000 7f7dd8838640 1 --2- 172.21.15.44:0/3264713214 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56034860a990 0x56034860cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:14.973 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.970+0000 7f7dd983a640 1 -- 172.21.15.44:0/3264713214 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56034860a990 msgr2=0x56034860cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:14:14.973 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.970+0000 7f7dd983a640 1 --2- 172.21.15.44:0/3264713214 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56034860a990 0x56034860cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:14.973 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.970+0000 7f7dd983a640 1 -- 172.21.15.44:0/3264713214 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5603486000f0 msgr2=0x56034860a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:14:14.973 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.970+0000 7f7dd983a640 1 --2- 172.21.15.44:0/3264713214 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5603486000f0 0x56034860a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:14.973 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.970+0000 7f7dd983a640 1 -- 172.21.15.44:0/3264713214 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560348277210 con 0x5603485ff7d0 2024-08-19T00:14:14.973 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.970+0000 7f7dd9039640 1 --2- 172.21.15.44:0/3264713214 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5603486000f0 0x56034860a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:14:14.973 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.970+0000 7f7dca7fc640 1 --2- 172.21.15.44:0/3264984262 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f7dc00a3050 0x7f7dc00a5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:14.973 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.970+0000 7f7dd983a640 1 --2- 172.21.15.44:0/3264713214 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5603485ff7d0 0x5603485ffbb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc035000 tx=0x7f7dcc031430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8dcfbb704b232b6 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:14:14.973 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.971+0000 7f7dd9039640 1 --2- 172.21.15.44:0/3264984262 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f7dc00a3050 0x7f7dc00a5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:14.973 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.971+0000 7f7dbf7fe640 1 -- 172.21.15.44:0/3264713214 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc0318c0 con 0x5603485ff7d0 2024-08-19T00:14:14.974 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.971+0000 7f7dca7fc640 1 -- 172.21.15.44:0/3264984262 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f7dd00cf190 con 0x7f7dd41006e0 2024-08-19T00:14:14.974 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.971+0000 7f7dbf7fe640 1 -- 172.21.15.44:0/3264713214 <== mon.2 v2:172.21.15.116:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7dcc036040 con 0x5603485ff7d0 2024-08-19T00:14:14.974 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.971+0000 7f7dbf7fe640 1 -- 172.21.15.44:0/3264713214 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc0046a0 con 0x5603485ff7d0 2024-08-19T00:14:14.977 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.972+0000 7f7dde05c740 1 -- 172.21.15.44:0/3264713214 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5603485ff7d0 msgr2=0x5603485ffbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:14.977 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.972+0000 7f7dde05c740 1 --2- 172.21.15.44:0/3264713214 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5603485ff7d0 0x5603485ffbb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc035000 tx=0x7f7dcc031430 comp rx=0 tx=0).stop 2024-08-19T00:14:14.977 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.972+0000 7f7dd9039640 1 --2- 172.21.15.44:0/3264984262 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f7dc00a3050 0x7f7dc00a5510 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7dd00cc360 tx=0x7f7dd00bb040 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:14:14.977 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.972+0000 7f7dde05c740 1 -- 172.21.15.44:0/3264713214 shutdown_connections 2024-08-19T00:14:14.977 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.972+0000 7f7dde05c740 1 --2- 172.21.15.44:0/3264713214 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56034860a990 0x56034860cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:14.977 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.972+0000 7f7dde05c740 1 --2- 172.21.15.44:0/3264713214 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5603486000f0 0x56034860a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:14.977 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.972+0000 7f7dde05c740 1 --2- 172.21.15.44:0/3264713214 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5603485ff7d0 0x5603485ffbb0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:14.977 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.972+0000 7f7dde05c740 1 -- 172.21.15.44:0/3264713214 >> 172.21.15.44:0/3264713214 conn(0x5603485fbd40 msgr2=0x5603485fc120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:14:14.977 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.972+0000 7f7dde05c740 1 -- 172.21.15.44:0/3264713214 shutdown_connections 2024-08-19T00:14:14.977 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.972+0000 7f7dde05c740 1 -- 172.21.15.44:0/3264713214 wait complete. 2024-08-19T00:14:14.978 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.972+0000 7f7dde05c740 1 -- start start 2024-08-19T00:14:14.978 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.972+0000 7f7dde05c740 1 Processor -- start 2024-08-19T00:14:14.978 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.973+0000 7f7dde05c740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5603485ff7d0 0x5603486077c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:14.978 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.973+0000 7f7dde05c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5603486000f0 0x560348607d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:14.978 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.973+0000 7f7dde05c740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56034860a990 0x560348608240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:14.978 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.973+0000 7f7dde05c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56034860d5b0 con 0x5603486000f0 2024-08-19T00:14:14.978 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.973+0000 7f7dde05c740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x56034851f520 con 0x56034860a990 2024-08-19T00:14:14.978 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.973+0000 7f7dde05c740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x56034860d730 con 0x5603485ff7d0 2024-08-19T00:14:14.978 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.973+0000 7f7dd8838640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5603486000f0 0x560348607d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:14.978 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.973+0000 7f7dde05c740 10 client.0 _ll_register_callbacks cb 0x560348276a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:14:14.978 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.973+0000 7f7dd8838640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5603486000f0 0x560348607d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57714/0 (socket says 172.21.15.44:57714) 2024-08-19T00:14:14.978 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.973+0000 7f7dd8838640 1 -- 172.21.15.44:0/1346888683 learned_addr learned my addr 172.21.15.44:0/1346888683 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:14:14.979 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.973+0000 7f7dd983a640 1 --2- 172.21.15.44:0/1346888683 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5603485ff7d0 0x5603486077c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:14.979 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.973+0000 7f7dd8838640 1 -- 172.21.15.44:0/1346888683 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5603485ff7d0 msgr2=0x5603486077c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:14:14.979 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.973+0000 7f7dd983a640 1 --2- 172.21.15.44:0/1346888683 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56034860a990 0x560348608240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:14.979 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.973+0000 7f7dd8838640 1 --2- 172.21.15.44:0/1346888683 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5603485ff7d0 0x5603486077c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:14.979 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.973+0000 7f7dd8838640 1 -- 172.21.15.44:0/1346888683 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56034860a990 msgr2=0x560348608240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:14:14.979 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.973+0000 7f7dd8838640 1 --2- 172.21.15.44:0/1346888683 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56034860a990 0x560348608240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:14.979 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.973+0000 7f7dd8838640 1 -- 172.21.15.44:0/1346888683 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560348343620 con 0x5603486000f0 2024-08-19T00:14:14.979 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.973+0000 7f7dd983a640 1 --2- 172.21.15.44:0/1346888683 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56034860a990 0x560348608240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:14:14.979 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.973+0000 7f7dd8838640 1 --2- 172.21.15.44:0/1346888683 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5603486000f0 0x560348607d00 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4012700 tx=0x7f7dc4012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=823ce28a4d886b06 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:14:14.979 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.973+0000 7f7dbcff9640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:14:14.979 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.974+0000 7f7dbcff9640 1 -- 172.21.15.44:0/1346888683 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc4004320 con 0x5603486000f0 2024-08-19T00:14:14.979 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.974+0000 7f7dde05c740 1 -- 172.21.15.44:0/1346888683 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7dcc036040 con 0x5603486000f0 2024-08-19T00:14:14.980 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.974+0000 7f7dbcff9640 1 -- 172.21.15.44:0/1346888683 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f7dc40119a0 con 0x5603486000f0 2024-08-19T00:14:14.980 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.974+0000 7f7dbcff9640 1 -- 172.21.15.44:0/1346888683 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7dc4025050 con 0x5603486000f0 2024-08-19T00:14:14.980 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.974+0000 7f7dde05c740 10 client.15636 fetch_fsmap learned FSMap version 28 2024-08-19T00:14:14.980 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.974+0000 7f7dde05c740 1 -- 172.21.15.44:0/1346888683 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560348619260 con 0x5603486000f0 2024-08-19T00:14:14.980 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.974+0000 7f7dbcff9640 1 -- 172.21.15.44:0/1346888683 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7dcc036040 con 0x5603486000f0 2024-08-19T00:14:14.980 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.974+0000 7f7dbcff9640 1 -- 172.21.15.44:0/1346888683 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f7dc400f440 con 0x5603486000f0 2024-08-19T00:14:14.980 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.974+0000 7f7dde05c740 10 client.15636 fetch_fsmap finished waiting for FSMap version 28 2024-08-19T00:14:14.980 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.974+0000 7f7dde05c740 10 client.15636 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:14:14.980 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.974+0000 7f7dde05c740 20 client.15636 populate_metadata read hostname 'smithi044' 2024-08-19T00:14:14.981 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.974+0000 7f7dde05c740 1 --2- 172.21.15.44:0/1346888683 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x56034861a770 0x56034861cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:14.981 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.974+0000 7f7dde05c740 4 client.15636 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:14:14.981 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.974+0000 7f7dde05c740 1 -- 172.21.15.44:0/1346888683 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560348571100 con 0x56034861a770 2024-08-19T00:14:14.981 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.975+0000 7f7dd983a640 1 --2- 172.21.15.44:0/1346888683 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x56034861a770 0x56034861cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:14.982 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.976+0000 7f7dbcff9640 10 client.15636 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:14:14.982 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.976+0000 7f7dd983a640 1 --2- 172.21.15.44:0/1346888683 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x56034861a770 0x56034861cb60 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4acf07e010e13a15 server_cookie=9b4d1edddb18f104 in_seq=0 out_seq=0 2024-08-19T00:14:14.982 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.977+0000 7f7dbcff9640 1 -- 172.21.15.44:0/1346888683 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560348571100 con 0x56034861a770 2024-08-19T00:14:14.982 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.977+0000 7f7dbcff9640 10 client.15636 handle_command_reply: tid=0 2024-08-19T00:14:14.982 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.977+0000 7f7dde05c740 1 client.15636 shutdown 2024-08-19T00:14:14.983 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.977+0000 7f7dde05c740 1 -- 172.21.15.44:0/1346888683 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5603486000f0 msgr2=0x560348607d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:14.983 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.977+0000 7f7dde05c740 1 --2- 172.21.15.44:0/1346888683 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5603486000f0 0x560348607d00 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4012700 tx=0x7f7dc4012bc0 comp rx=0 tx=0).stop 2024-08-19T00:14:14.983 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.977+0000 7f7dde05c740 1 -- 172.21.15.44:0/1346888683 shutdown_connections 2024-08-19T00:14:14.983 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.977+0000 7f7dde05c740 1 --2- 172.21.15.44:0/1346888683 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x56034861a770 0x56034861cb60 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:14.983 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.977+0000 7f7dbcff9640 0 client.15636 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:14:14.983 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.977+0000 7f7dde05c740 1 --2- 172.21.15.44:0/1346888683 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56034860a990 0x560348608240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:14.983 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.977+0000 7f7dde05c740 1 --2- 172.21.15.44:0/1346888683 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5603486000f0 0x560348607d00 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:14.983 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.977+0000 7f7dde05c740 1 --2- 172.21.15.44:0/1346888683 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5603485ff7d0 0x5603486077c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:14.983 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.977+0000 7f7dde05c740 1 -- 172.21.15.44:0/1346888683 >> 172.21.15.44:0/1346888683 conn(0x5603485fbd40 msgr2=0x560348601aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:14:14.983 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.977+0000 7f7dde05c740 1 -- 172.21.15.44:0/1346888683 shutdown_connections 2024-08-19T00:14:14.983 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.977+0000 7f7dde05c740 1 -- 172.21.15.44:0/1346888683 wait complete. 2024-08-19T00:14:14.983 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.977+0000 7f7dde05c740 20 client.15636 trim_cache size 0 max 16384 2024-08-19T00:14:14.994 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.992+0000 7f7dde05c740 1 Processor -- start 2024-08-19T00:14:14.994 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.992+0000 7f7dde05c740 1 -- start start 2024-08-19T00:14:14.994 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.992+0000 7f7dde05c740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5603485ff7d0 0x560348608070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:14.995 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.992+0000 7f7dde05c740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5603486000f0 0x560348622430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:14.995 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.992+0000 7f7dde05c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56034860a990 0x560348622970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:14.995 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.992+0000 7f7dde05c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd41b0e70 con 0x56034860a990 2024-08-19T00:14:14.995 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.992+0000 7f7dde05c740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd41b29b0 con 0x5603486000f0 2024-08-19T00:14:14.995 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.992+0000 7f7dde05c740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd41b1540 con 0x5603485ff7d0 2024-08-19T00:14:14.995 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.992+0000 7f7dd983a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56034860a990 0x560348622970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:14.995 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.992+0000 7f7dd983a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56034860a990 0x560348622970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57730/0 (socket says 172.21.15.44:57730) 2024-08-19T00:14:14.995 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.992+0000 7f7dd983a640 1 -- 172.21.15.44:0/1124108163 learned_addr learned my addr 172.21.15.44:0/1124108163 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:14:14.995 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.992+0000 7f7dd983a640 1 --2- 172.21.15.44:0/1124108163 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5603485ff7d0 0x560348608070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:14.995 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.992+0000 7f7dd8838640 1 --2- 172.21.15.44:0/1124108163 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5603486000f0 0x560348622430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:14.995 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.993+0000 7f7dd983a640 1 -- 172.21.15.44:0/1124108163 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5603485ff7d0 msgr2=0x560348608070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:14:14.995 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.993+0000 7f7dd983a640 1 --2- 172.21.15.44:0/1124108163 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5603485ff7d0 0x560348608070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:14.995 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.993+0000 7f7dd983a640 1 -- 172.21.15.44:0/1124108163 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5603486000f0 msgr2=0x560348622430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:14:14.996 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.993+0000 7f7dd983a640 1 --2- 172.21.15.44:0/1124108163 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5603486000f0 0x560348622430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:14.996 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.993+0000 7f7dd983a640 1 -- 172.21.15.44:0/1124108163 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603485fff20 con 0x56034860a990 2024-08-19T00:14:14.996 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.993+0000 7f7dd983a640 1 --2- 172.21.15.44:0/1124108163 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56034860a990 0x560348622970 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc000f80 tx=0x7f7dcc047040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0f8c812f64f57ce server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:14:14.996 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.993+0000 7f7dbeffd640 1 -- 172.21.15.44:0/1124108163 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc0318c0 con 0x56034860a990 2024-08-19T00:14:14.996 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.993+0000 7f7dbeffd640 1 -- 172.21.15.44:0/1124108163 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7dcc036070 con 0x56034860a990 2024-08-19T00:14:14.996 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.993+0000 7f7dbeffd640 1 -- 172.21.15.44:0/1124108163 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc004670 con 0x56034860a990 2024-08-19T00:14:14.999 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.994+0000 7f7dde05c740 1 -- 172.21.15.44:0/1124108163 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56034860a990 msgr2=0x560348622970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:14.999 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.994+0000 7f7dde05c740 1 --2- 172.21.15.44:0/1124108163 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56034860a990 0x560348622970 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc000f80 tx=0x7f7dcc047040 comp rx=0 tx=0).stop 2024-08-19T00:14:14.999 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.994+0000 7f7dde05c740 1 -- 172.21.15.44:0/1124108163 shutdown_connections 2024-08-19T00:14:14.999 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.994+0000 7f7dde05c740 1 --2- 172.21.15.44:0/1124108163 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56034860a990 0x560348622970 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:14.999 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.994+0000 7f7dde05c740 1 --2- 172.21.15.44:0/1124108163 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5603486000f0 0x560348622430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:15.000 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.994+0000 7f7dde05c740 1 --2- 172.21.15.44:0/1124108163 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5603485ff7d0 0x560348608070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:15.000 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.994+0000 7f7dde05c740 1 -- 172.21.15.44:0/1124108163 >> 172.21.15.44:0/1124108163 conn(0x5603485fbd40 msgr2=0x560348606890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:14:15.000 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.994+0000 7f7dde05c740 1 -- 172.21.15.44:0/1124108163 shutdown_connections 2024-08-19T00:14:15.000 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.994+0000 7f7dde05c740 1 -- 172.21.15.44:0/1124108163 wait complete. 2024-08-19T00:14:15.000 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.995+0000 7f7dde05c740 1 -- start start 2024-08-19T00:14:15.000 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.995+0000 7f7dde05c740 1 Processor -- start 2024-08-19T00:14:15.000 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.995+0000 7f7dde05c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5603485ff7d0 0x560348612a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:15.000 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.995+0000 7f7dde05c740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5603486000f0 0x560348612f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:15.000 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.995+0000 7f7dde05c740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56034860a990 0x560348603b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:15.000 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.995+0000 7f7dde05c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd41b22e0 con 0x5603485ff7d0 2024-08-19T00:14:15.000 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.995+0000 7f7dde05c740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd41b1c10 con 0x5603486000f0 2024-08-19T00:14:15.000 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.995+0000 7f7dd983a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5603485ff7d0 0x560348612a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:15.000 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.995+0000 7f7dde05c740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd41aee50 con 0x56034860a990 2024-08-19T00:14:15.001 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.995+0000 7f7dd983a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5603485ff7d0 0x560348612a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57732/0 (socket says 172.21.15.44:57732) 2024-08-19T00:14:15.001 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.995+0000 7f7dd983a640 1 -- 172.21.15.44:0/4048509256 learned_addr learned my addr 172.21.15.44:0/4048509256 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:14:15.001 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.996+0000 7f7dde05c740 10 client.0 _ll_register_callbacks cb 0x7f7dc40097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:14:15.001 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.996+0000 7f7dd8838640 1 --2- 172.21.15.44:0/4048509256 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5603486000f0 0x560348612f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:15.001 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.996+0000 7f7dd983a640 1 -- 172.21.15.44:0/4048509256 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56034860a990 msgr2=0x560348603b50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-19T00:14:15.001 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.996+0000 7f7dd983a640 1 --2- 172.21.15.44:0/4048509256 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56034860a990 0x560348603b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:15.001 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.996+0000 7f7dd983a640 1 -- 172.21.15.44:0/4048509256 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5603486000f0 msgr2=0x560348612f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:14:15.001 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.996+0000 7f7dd983a640 1 --2- 172.21.15.44:0/4048509256 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5603486000f0 0x560348612f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:15.001 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.996+0000 7f7dd983a640 1 -- 172.21.15.44:0/4048509256 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560348604090 con 0x5603485ff7d0 2024-08-19T00:14:15.001 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.996+0000 7f7dd8838640 1 --2- 172.21.15.44:0/4048509256 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5603486000f0 0x560348612f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:14:15.001 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.996+0000 7f7dd983a640 1 --2- 172.21.15.44:0/4048509256 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5603485ff7d0 0x560348612a10 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc031af0 tx=0x7f7dcc031b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30178371ef100995 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:14:15.001 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.996+0000 7f7dbcff9640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:14:15.002 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.996+0000 7f7dbcff9640 1 -- 172.21.15.44:0/4048509256 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc003b80 con 0x5603485ff7d0 2024-08-19T00:14:15.002 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.996+0000 7f7dde05c740 1 -- 172.21.15.44:0/4048509256 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7dcc036070 con 0x5603485ff7d0 2024-08-19T00:14:15.002 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.996+0000 7f7dbcff9640 1 -- 172.21.15.44:0/4048509256 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f7dcc003d20 con 0x5603485ff7d0 2024-08-19T00:14:15.002 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.996+0000 7f7dbcff9640 1 -- 172.21.15.44:0/4048509256 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7dcc003f20 con 0x5603485ff7d0 2024-08-19T00:14:15.002 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.997+0000 7f7dde05c740 10 client.15642 fetch_fsmap learned FSMap version 28 2024-08-19T00:14:15.002 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.997+0000 7f7dde05c740 1 -- 172.21.15.44:0/4048509256 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560348684aa0 con 0x5603485ff7d0 2024-08-19T00:14:15.002 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.997+0000 7f7dbcff9640 1 -- 172.21.15.44:0/4048509256 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7dcc036070 con 0x5603485ff7d0 2024-08-19T00:14:15.002 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.997+0000 7f7dbcff9640 1 -- 172.21.15.44:0/4048509256 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f7dcc030070 con 0x5603485ff7d0 2024-08-19T00:14:15.002 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.997+0000 7f7dde05c740 10 client.15642 fetch_fsmap finished waiting for FSMap version 28 2024-08-19T00:14:15.002 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.997+0000 7f7dde05c740 10 client.15642 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:14:15.002 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.997+0000 7f7dde05c740 20 client.15642 populate_metadata read hostname 'smithi044' 2024-08-19T00:14:15.002 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.997+0000 7f7dde05c740 1 --2- 172.21.15.44:0/4048509256 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x56034861a770 0x560348686d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:15.003 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.997+0000 7f7dde05c740 4 client.15642 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-19T00:14:15.003 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.997+0000 7f7dde05c740 1 -- 172.21.15.44:0/4048509256 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56034856b450 con 0x56034861a770 2024-08-19T00:14:15.003 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.997+0000 7f7dd8838640 1 --2- 172.21.15.44:0/4048509256 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x56034861a770 0x560348686d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:15.003 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.998+0000 7f7dbcff9640 10 client.15642 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:14:15.003 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:14.998+0000 7f7dd8838640 1 --2- 172.21.15.44:0/4048509256 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x56034861a770 0x560348686d30 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be52c88b60902b3d server_cookie=cda9e041e0dffc87 in_seq=0 out_seq=0 2024-08-19T00:14:15.007 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:15.005+0000 7f7dbcff9640 1 -- 172.21.15.44:0/4048509256 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56034856b450 con 0x56034861a770 2024-08-19T00:14:15.007 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:15.005+0000 7f7dbcff9640 10 client.15642 handle_command_reply: tid=0 2024-08-19T00:14:15.007 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:15.005+0000 7f7dde05c740 1 client.15642 shutdown 2024-08-19T00:14:15.007 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:15.005+0000 7f7dde05c740 1 -- 172.21.15.44:0/4048509256 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5603485ff7d0 msgr2=0x560348612a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:15.007 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:15.005+0000 7f7dde05c740 1 --2- 172.21.15.44:0/4048509256 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5603485ff7d0 0x560348612a10 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc031af0 tx=0x7f7dcc031b20 comp rx=0 tx=0).stop 2024-08-19T00:14:15.007 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:15.005+0000 7f7dde05c740 1 -- 172.21.15.44:0/4048509256 shutdown_connections 2024-08-19T00:14:15.007 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:15.005+0000 7f7dde05c740 1 --2- 172.21.15.44:0/4048509256 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x56034861a770 0x560348686d30 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:15.007 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:15.005+0000 7f7dde05c740 1 --2- 172.21.15.44:0/4048509256 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56034860a990 0x560348603b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:15.007 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:15.005+0000 7f7dde05c740 1 --2- 172.21.15.44:0/4048509256 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5603486000f0 0x560348612f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:15.007 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:15.005+0000 7f7dbcff9640 0 client.15642 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:14:15.007 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:15.005+0000 7f7dde05c740 1 --2- 172.21.15.44:0/4048509256 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5603485ff7d0 0x560348612a10 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:15.008 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:15.005+0000 7f7dde05c740 1 -- 172.21.15.44:0/4048509256 >> 172.21.15.44:0/4048509256 conn(0x5603485fbd40 msgr2=0x5603485fa680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:14:15.008 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:15.005+0000 7f7dde05c740 1 -- 172.21.15.44:0/4048509256 shutdown_connections 2024-08-19T00:14:15.008 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:15.005+0000 7f7dde05c740 1 -- 172.21.15.44:0/4048509256 wait complete. 2024-08-19T00:14:15.008 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:15.006+0000 7f7dde05c740 20 client.15642 trim_cache size 0 max 16384 2024-08-19T00:14:15.008 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:{ 2024-08-19T00:14:15.008 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "message": "", 2024-08-19T00:14:15.008 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "return_code": 0 2024-08-19T00:14:15.008 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:} 2024-08-19T00:14:15.009 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:15.006+0000 7f7ddb29d640 1 -- 172.21.15.44:0/3264984262 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f7dc00a3050 msgr2=0x7f7dc00a5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:15.010 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:15.006+0000 7f7ddb29d640 1 --2- 172.21.15.44:0/3264984262 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f7dc00a3050 0x7f7dc00a5510 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7dd00cc360 tx=0x7f7dd00bb040 comp rx=0 tx=0).stop 2024-08-19T00:14:15.010 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:15.006+0000 7f7ddb29d640 1 -- 172.21.15.44:0/3264984262 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7dd41006e0 msgr2=0x7f7dd4198020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:15.010 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:15.006+0000 7f7ddb29d640 1 --2- 172.21.15.44:0/3264984262 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7dd41006e0 0x7f7dd4198020 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f7dd000d770 tx=0x7f7dd000dc30 comp rx=0 tx=0).stop 2024-08-19T00:14:15.010 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:15.006+0000 7f7ddb29d640 1 -- 172.21.15.44:0/3264984262 shutdown_connections 2024-08-19T00:14:15.010 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:15.006+0000 7f7ddb29d640 1 --2- 172.21.15.44:0/3264984262 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f7dc00a3050 0x7f7dc00a5510 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:15.010 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:15.006+0000 7f7ddb29d640 1 --2- 172.21.15.44:0/3264984262 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7dd41066f0 0x7f7dd419c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:15.010 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:15.006+0000 7f7ddb29d640 1 --2- 172.21.15.44:0/3264984262 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7dd4101080 0x7f7dd4198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:15.010 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:15.006+0000 7f7ddb29d640 1 --2- 172.21.15.44:0/3264984262 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7dd41006e0 0x7f7dd4198020 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:15.010 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:15.006+0000 7f7ddb29d640 1 -- 172.21.15.44:0/3264984262 >> 172.21.15.44:0/3264984262 conn(0x7f7dd40776c0 msgr2=0x7f7dd40fda60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:14:15.010 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:15.007+0000 7f7ddb29d640 1 -- 172.21.15.44:0/3264984262 shutdown_connections 2024-08-19T00:14:15.010 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:15.007+0000 7f7ddb29d640 1 -- 172.21.15.44:0/3264984262 wait complete. 2024-08-19T00:14:16.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:14:15 smithi171 ceph-mon[21810]: pgmap v31: 129 pgs: 129 active+clean; 1.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 25 KiB/s wr, 29 op/s 2024-08-19T00:14:16.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:14:15 smithi116 ceph-mon[21873]: pgmap v31: 129 pgs: 129 active+clean; 1.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 25 KiB/s wr, 29 op/s 2024-08-19T00:14:16.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:14:15 smithi044 ceph-mon[18489]: pgmap v31: 129 pgs: 129 active+clean; 1.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 25 KiB/s wr, 29 op/s 2024-08-19T00:14:18.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:14:17 smithi171 ceph-mon[21810]: pgmap v32: 129 pgs: 129 active+clean; 1.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 426 B/s wr, 9 op/s 2024-08-19T00:14:18.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:14:17 smithi116 ceph-mon[21873]: pgmap v32: 129 pgs: 129 active+clean; 1.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 426 B/s wr, 9 op/s 2024-08-19T00:14:18.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:14:17 smithi044 ceph-mon[18489]: pgmap v32: 129 pgs: 129 active+clean; 1.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 426 B/s wr, 9 op/s 2024-08-19T00:14:20.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:14:19 smithi171 ceph-mon[21810]: pgmap v33: 129 pgs: 129 active+clean; 1.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-08-19T00:14:20.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:14:19 smithi116 ceph-mon[21873]: pgmap v33: 129 pgs: 129 active+clean; 1.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-08-19T00:14:20.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:14:19 smithi044 ceph-mon[18489]: pgmap v33: 129 pgs: 129 active+clean; 1.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-08-19T00:14:22.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:14:21 smithi116 ceph-mon[21873]: pgmap v34: 129 pgs: 129 active+clean; 1.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 853 B/s wr, 14 op/s 2024-08-19T00:14:22.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:14:21 smithi044 ceph-mon[18489]: pgmap v34: 129 pgs: 129 active+clean; 1.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 853 B/s wr, 14 op/s 2024-08-19T00:14:22.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:14:21 smithi171 ceph-mon[21810]: pgmap v34: 129 pgs: 129 active+clean; 1.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 853 B/s wr, 14 op/s 2024-08-19T00:14:23.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:14:22 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:14:23.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:14:22 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:14:23.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:14:22 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:14:24.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:14:23 smithi116 ceph-mon[21873]: pgmap v35: 129 pgs: 129 active+clean; 1.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 853 B/s wr, 9 op/s 2024-08-19T00:14:24.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:14:23 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:14:24.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:14:23 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:14:24.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:14:23 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:14:24.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:14:23 smithi044 ceph-mon[18489]: pgmap v35: 129 pgs: 129 active+clean; 1.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 853 B/s wr, 9 op/s 2024-08-19T00:14:24.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:14:23 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:14:24.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:14:23 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:14:24.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:14:23 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:14:24.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:14:23 smithi171 ceph-mon[21810]: pgmap v35: 129 pgs: 129 active+clean; 1.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 853 B/s wr, 9 op/s 2024-08-19T00:14:24.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:14:23 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:14:24.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:14:23 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:14:24.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:14:23 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:14:26.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:14:25 smithi116 ceph-mon[21873]: pgmap v36: 129 pgs: 129 active+clean; 1.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 853 B/s wr, 13 op/s 2024-08-19T00:14:26.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:14:25 smithi044 ceph-mon[18489]: pgmap v36: 129 pgs: 129 active+clean; 1.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 853 B/s wr, 13 op/s 2024-08-19T00:14:26.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:14:25 smithi171 ceph-mon[21810]: pgmap v36: 129 pgs: 129 active+clean; 1.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 853 B/s wr, 13 op/s 2024-08-19T00:14:28.105 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.101+0000 7fe96ccae640 1 -- 172.21.15.44:0/3344732307 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe9681006e0 msgr2=0x7fe968100b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:28.105 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.101+0000 7fe96ccae640 1 --2- 172.21.15.44:0/3344732307 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe9681006e0 0x7fe968100b40 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fe950009930 tx=0x7fe95002a420 comp rx=0 tx=0).stop 2024-08-19T00:14:28.105 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.101+0000 7fe96ccae640 1 -- 172.21.15.44:0/3344732307 shutdown_connections 2024-08-19T00:14:28.105 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.101+0000 7fe96ccae640 1 --2- 172.21.15.44:0/3344732307 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe968101080 0x7fe96810d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:28.105 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.101+0000 7fe96ccae640 1 --2- 172.21.15.44:0/3344732307 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe9681006e0 0x7fe968100b40 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:28.105 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.101+0000 7fe96ccae640 1 --2- 172.21.15.44:0/3344732307 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe9681066f0 0x7fe968106ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:28.105 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.101+0000 7fe96ccae640 1 -- 172.21.15.44:0/3344732307 >> 172.21.15.44:0/3344732307 conn(0x7fe9680776c0 msgr2=0x7fe9680fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:14:28.105 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.101+0000 7fe96ccae640 1 -- 172.21.15.44:0/3344732307 shutdown_connections 2024-08-19T00:14:28.105 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.101+0000 7fe96ccae640 1 -- 172.21.15.44:0/3344732307 wait complete. 2024-08-19T00:14:28.106 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.102+0000 7fe96ccae640 1 Processor -- start 2024-08-19T00:14:28.106 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.102+0000 7fe96ccae640 1 -- start start 2024-08-19T00:14:28.106 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.102+0000 7fe96ccae640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe9681006e0 0x7fe968198e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:28.106 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.102+0000 7fe96ccae640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe968101080 0x7fe9681993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:28.106 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.102+0000 7fe96ccae640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe9681066f0 0x7fe9681a3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:28.106 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.102+0000 7fe96ccae640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe968110b30 con 0x7fe9681066f0 2024-08-19T00:14:28.106 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.102+0000 7fe96ccae640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fe9681109b0 con 0x7fe9681006e0 2024-08-19T00:14:28.106 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.102+0000 7fe96ccae640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe968110cb0 con 0x7fe968101080 2024-08-19T00:14:28.106 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.102+0000 7fe966d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe9681066f0 0x7fe9681a3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:28.106 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.102+0000 7fe966d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe9681066f0 0x7fe9681a3f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54022/0 (socket says 172.21.15.44:54022) 2024-08-19T00:14:28.106 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.102+0000 7fe966d9d640 1 -- 172.21.15.44:0/4098251956 learned_addr learned my addr 172.21.15.44:0/4098251956 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:14:28.106 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.102+0000 7fe96659c640 1 --2- 172.21.15.44:0/4098251956 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe9681006e0 0x7fe968198e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:28.106 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.103+0000 7fe95ffff640 1 --2- 172.21.15.44:0/4098251956 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe968101080 0x7fe9681993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:28.107 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.103+0000 7fe966d9d640 1 -- 172.21.15.44:0/4098251956 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe968101080 msgr2=0x7fe9681993c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:28.107 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.103+0000 7fe966d9d640 1 --2- 172.21.15.44:0/4098251956 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe968101080 0x7fe9681993c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:28.107 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.103+0000 7fe966d9d640 1 -- 172.21.15.44:0/4098251956 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe9681006e0 msgr2=0x7fe968198e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:28.107 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.103+0000 7fe966d9d640 1 --2- 172.21.15.44:0/4098251956 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe9681006e0 0x7fe968198e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:28.107 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.103+0000 7fe966d9d640 1 -- 172.21.15.44:0/4098251956 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9681a4440 con 0x7fe9681066f0 2024-08-19T00:14:28.107 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.103+0000 7fe966d9d640 1 --2- 172.21.15.44:0/4098251956 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe9681066f0 0x7fe9681a3f00 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fe96000cce0 tx=0x7fe96000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:14:28.107 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.103+0000 7fe95f7fe640 1 -- 172.21.15.44:0/4098251956 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe96000f450 con 0x7fe9681066f0 2024-08-19T00:14:28.107 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.103+0000 7fe95f7fe640 1 -- 172.21.15.44:0/4098251956 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe96000fad0 con 0x7fe9681066f0 2024-08-19T00:14:28.107 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.103+0000 7fe95f7fe640 1 -- 172.21.15.44:0/4098251956 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe960018c10 con 0x7fe9681066f0 2024-08-19T00:14:28.107 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.103+0000 7fe96ccae640 1 -- 172.21.15.44:0/4098251956 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9681a4610 con 0x7fe9681066f0 2024-08-19T00:14:28.107 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.103+0000 7fe96ccae640 1 -- 172.21.15.44:0/4098251956 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9681a4b30 con 0x7fe9681066f0 2024-08-19T00:14:28.113 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.105+0000 7fe95f7fe640 1 -- 172.21.15.44:0/4098251956 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 25) ==== 138117+0+0 (secure 0 0 0) 0x7fe96000f5f0 con 0x7fe9681066f0 2024-08-19T00:14:28.113 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.106+0000 7fe96fa6e740 1 Processor -- start 2024-08-19T00:14:28.114 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.106+0000 7fe96fa6e740 1 -- start start 2024-08-19T00:14:28.114 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.106+0000 7fe96fa6e740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ffc87c0670 0x55ffc87c0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:28.114 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.106+0000 7fe96fa6e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffc87c0f90 0x55ffc87cf860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:28.114 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.106+0000 7fe96fa6e740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffc87cfda0 0x55ffc87d2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:28.114 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.106+0000 7fe96fa6e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ffc87249d0 con 0x55ffc87c0f90 2024-08-19T00:14:28.114 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.106+0000 7fe96fa6e740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55ffc86cc820 con 0x55ffc87cfda0 2024-08-19T00:14:28.114 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.106+0000 7fe96fa6e740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55ffc8720990 con 0x55ffc87c0670 2024-08-19T00:14:28.114 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.106+0000 7fe96659c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffc87c0f90 0x55ffc87cf860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:28.114 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.106+0000 7fe96659c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffc87c0f90 0x55ffc87cf860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54036/0 (socket says 172.21.15.44:54036) 2024-08-19T00:14:28.114 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.106+0000 7fe96659c640 1 -- 172.21.15.44:0/4246537907 learned_addr learned my addr 172.21.15.44:0/4246537907 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:14:28.114 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.106+0000 7fe95ffff640 1 --2- 172.21.15.44:0/4246537907 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffc87cfda0 0x55ffc87d2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:28.114 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.106+0000 7fe95ffff640 1 --2- 172.21.15.44:0/4246537907 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ffc87c0670 0x55ffc87c0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:28.114 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.107+0000 7fe95f7fe640 1 --2- 172.21.15.44:0/4098251956 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fe9540a2f50 0x7fe9540a5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:28.115 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.107+0000 7fe96659c640 1 -- 172.21.15.44:0/4246537907 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ffc87c0670 msgr2=0x55ffc87c0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:14:28.115 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.107+0000 7fe96659c640 1 --2- 172.21.15.44:0/4246537907 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ffc87c0670 0x55ffc87c0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:28.115 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.107+0000 7fe96659c640 1 -- 172.21.15.44:0/4246537907 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffc87cfda0 msgr2=0x55ffc87d2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:14:28.115 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.107+0000 7fe96659c640 1 --2- 172.21.15.44:0/4246537907 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffc87cfda0 0x55ffc87d2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:28.115 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.107+0000 7fe96659c640 1 -- 172.21.15.44:0/4246537907 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffc8438210 con 0x55ffc87c0f90 2024-08-19T00:14:28.115 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.107+0000 7fe966d9d640 1 --2- 172.21.15.44:0/4098251956 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fe9540a2f50 0x7fe9540a5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:28.115 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.107+0000 7fe96659c640 1 --2- 172.21.15.44:0/4246537907 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffc87c0f90 0x55ffc87cf860 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fe958009c70 tx=0x7fe958011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e8ebbdc5f658ad4 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:14:28.115 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.107+0000 7fe95f7fe640 1 -- 172.21.15.44:0/4098251956 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7fe9600cfda0 con 0x7fe9681066f0 2024-08-19T00:14:28.115 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.107+0000 7fe95cff9640 1 -- 172.21.15.44:0/4246537907 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe95801e070 con 0x55ffc87c0f90 2024-08-19T00:14:28.115 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.107+0000 7fe95cff9640 1 -- 172.21.15.44:0/4246537907 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe958009e20 con 0x55ffc87c0f90 2024-08-19T00:14:28.115 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.107+0000 7fe95cff9640 1 -- 172.21.15.44:0/4246537907 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe958019690 con 0x55ffc87c0f90 2024-08-19T00:14:28.115 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.108+0000 7fe96fa6e740 1 -- 172.21.15.44:0/4246537907 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffc87c0f90 msgr2=0x55ffc87cf860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:28.116 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.108+0000 7fe96fa6e740 1 --2- 172.21.15.44:0/4246537907 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffc87c0f90 0x55ffc87cf860 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fe958009c70 tx=0x7fe958011810 comp rx=0 tx=0).stop 2024-08-19T00:14:28.116 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.108+0000 7fe966d9d640 1 --2- 172.21.15.44:0/4098251956 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fe9540a2f50 0x7fe9540a5410 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe9600ccf70 tx=0x7fe96000af30 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:14:28.116 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.108+0000 7fe96fa6e740 1 -- 172.21.15.44:0/4246537907 shutdown_connections 2024-08-19T00:14:28.116 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.108+0000 7fe96fa6e740 1 --2- 172.21.15.44:0/4246537907 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffc87cfda0 0x55ffc87d2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:28.116 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.108+0000 7fe96fa6e740 1 --2- 172.21.15.44:0/4246537907 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffc87c0f90 0x55ffc87cf860 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:28.116 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.108+0000 7fe96fa6e740 1 --2- 172.21.15.44:0/4246537907 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ffc87c0670 0x55ffc87c0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:28.116 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.108+0000 7fe96fa6e740 1 -- 172.21.15.44:0/4246537907 >> 172.21.15.44:0/4246537907 conn(0x55ffc87bcd40 msgr2=0x55ffc87bd120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:14:28.116 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.108+0000 7fe96fa6e740 1 -- 172.21.15.44:0/4246537907 shutdown_connections 2024-08-19T00:14:28.116 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.108+0000 7fe96fa6e740 1 -- 172.21.15.44:0/4246537907 wait complete. 2024-08-19T00:14:28.116 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.108+0000 7fe96fa6e740 1 -- start start 2024-08-19T00:14:28.116 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.108+0000 7fe96fa6e740 1 Processor -- start 2024-08-19T00:14:28.116 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.109+0000 7fe96fa6e740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ffc87c0670 0x55ffc87ccd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:28.116 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.109+0000 7fe96fa6e740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffc87c0f90 0x55ffc87cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:28.117 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.109+0000 7fe96fa6e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffc87cfda0 0x55ffc87cd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:28.117 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.109+0000 7fe96fa6e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ffc87d29d0 con 0x55ffc87cfda0 2024-08-19T00:14:28.117 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.109+0000 7fe96fa6e740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55ffc86e0520 con 0x55ffc87c0f90 2024-08-19T00:14:28.117 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.109+0000 7fe96fa6e740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55ffc87d2b50 con 0x55ffc87c0670 2024-08-19T00:14:28.117 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.109+0000 7fe96fa6e740 10 client.0 _ll_register_callbacks cb 0x55ffc8437a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:14:28.117 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.109+0000 7fe95ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffc87cfda0 0x55ffc87cd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:28.117 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.109+0000 7fe95ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffc87cfda0 0x55ffc87cd7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54038/0 (socket says 172.21.15.44:54038) 2024-08-19T00:14:28.117 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.109+0000 7fe95ffff640 1 -- 172.21.15.44:0/831751502 learned_addr learned my addr 172.21.15.44:0/831751502 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:14:28.117 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.109+0000 7fe96659c640 1 --2- 172.21.15.44:0/831751502 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffc87c0f90 0x55ffc87cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:28.117 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.109+0000 7fe95ffff640 1 -- 172.21.15.44:0/831751502 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ffc87c0670 msgr2=0x55ffc87ccd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:14:28.117 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.109+0000 7fe95ffff640 1 --2- 172.21.15.44:0/831751502 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ffc87c0670 0x55ffc87ccd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:28.117 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.109+0000 7fe95ffff640 1 -- 172.21.15.44:0/831751502 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffc87c0f90 msgr2=0x55ffc87cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:14:28.117 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.109+0000 7fe95ffff640 1 --2- 172.21.15.44:0/831751502 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffc87c0f90 0x55ffc87cd2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:28.117 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.109+0000 7fe95ffff640 1 -- 172.21.15.44:0/831751502 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ffc8504620 con 0x55ffc87cfda0 2024-08-19T00:14:28.118 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.109+0000 7fe96659c640 1 --2- 172.21.15.44:0/831751502 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffc87c0f90 0x55ffc87cd2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:14:28.118 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.109+0000 7fe95ffff640 1 --2- 172.21.15.44:0/831751502 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffc87cfda0 0x55ffc87cd7e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fe950033000 tx=0x7fe950032cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=633b2c06f6a3fd0e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:14:28.118 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.109+0000 7fe94dffb640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:14:28.118 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.109+0000 7fe94dffb640 1 -- 172.21.15.44:0/831751502 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe950035040 con 0x55ffc87cfda0 2024-08-19T00:14:28.118 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.109+0000 7fe94dffb640 1 -- 172.21.15.44:0/831751502 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7fe950004240 con 0x55ffc87cfda0 2024-08-19T00:14:28.118 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.109+0000 7fe96fa6e740 1 -- 172.21.15.44:0/831751502 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe958009e20 con 0x55ffc87cfda0 2024-08-19T00:14:28.118 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.109+0000 7fe94dffb640 1 -- 172.21.15.44:0/831751502 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe950004440 con 0x55ffc87cfda0 2024-08-19T00:14:28.118 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.110+0000 7fe96fa6e740 10 client.15654 fetch_fsmap learned FSMap version 28 2024-08-19T00:14:28.118 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.110+0000 7fe96fa6e740 1 -- 172.21.15.44:0/831751502 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ffc87de710 con 0x55ffc87cfda0 2024-08-19T00:14:28.118 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.110+0000 7fe94dffb640 1 -- 172.21.15.44:0/831751502 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe958009e20 con 0x55ffc87cfda0 2024-08-19T00:14:28.118 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.110+0000 7fe94dffb640 1 -- 172.21.15.44:0/831751502 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fe95003d6b0 con 0x55ffc87cfda0 2024-08-19T00:14:28.118 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.110+0000 7fe96fa6e740 10 client.15654 fetch_fsmap finished waiting for FSMap version 28 2024-08-19T00:14:28.118 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.110+0000 7fe96fa6e740 10 client.15654 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:14:28.119 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.110+0000 7fe96fa6e740 20 client.15654 populate_metadata read hostname 'smithi044' 2024-08-19T00:14:28.119 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.110+0000 7fe96fa6e740 1 --2- 172.21.15.44:0/831751502 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55ffc87dfbd0 0x55ffc87e2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:28.119 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.110+0000 7fe96fa6e740 4 client.15654 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:14:28.119 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.110+0000 7fe96fa6e740 1 -- 172.21.15.44:0/831751502 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ffc8732100 con 0x55ffc87dfbd0 2024-08-19T00:14:28.119 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.110+0000 7fe96659c640 1 --2- 172.21.15.44:0/831751502 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55ffc87dfbd0 0x55ffc87e2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:28.119 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.111+0000 7fe96659c640 1 --2- 172.21.15.44:0/831751502 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55ffc87dfbd0 0x55ffc87e2020 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90b6fa3df6f46fe8 server_cookie=85d656f8de78a228 in_seq=0 out_seq=0 2024-08-19T00:14:28.119 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.111+0000 7fe94dffb640 10 client.15654 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:14:28.119 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.112+0000 7fe94dffb640 1 -- 172.21.15.44:0/831751502 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ffc8732100 con 0x55ffc87dfbd0 2024-08-19T00:14:28.119 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.112+0000 7fe94dffb640 10 client.15654 handle_command_reply: tid=0 2024-08-19T00:14:28.119 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.112+0000 7fe96fa6e740 1 client.15654 shutdown 2024-08-19T00:14:28.119 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.112+0000 7fe96fa6e740 1 -- 172.21.15.44:0/831751502 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffc87cfda0 msgr2=0x55ffc87cd7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:28.119 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.112+0000 7fe96fa6e740 1 --2- 172.21.15.44:0/831751502 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffc87cfda0 0x55ffc87cd7e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fe950033000 tx=0x7fe950032cc0 comp rx=0 tx=0).stop 2024-08-19T00:14:28.119 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.112+0000 7fe96fa6e740 1 -- 172.21.15.44:0/831751502 shutdown_connections 2024-08-19T00:14:28.119 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.112+0000 7fe96fa6e740 1 --2- 172.21.15.44:0/831751502 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55ffc87dfbd0 0x55ffc87e2020 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:28.120 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.112+0000 7fe96fa6e740 1 --2- 172.21.15.44:0/831751502 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffc87cfda0 0x55ffc87cd7e0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:28.120 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.112+0000 7fe94dffb640 0 client.15654 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:14:28.120 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.112+0000 7fe96fa6e740 1 --2- 172.21.15.44:0/831751502 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffc87c0f90 0x55ffc87cd2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:28.120 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.112+0000 7fe96fa6e740 1 --2- 172.21.15.44:0/831751502 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ffc87c0670 0x55ffc87ccd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:28.120 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.112+0000 7fe96fa6e740 1 -- 172.21.15.44:0/831751502 >> 172.21.15.44:0/831751502 conn(0x55ffc87bcd40 msgr2=0x55ffc87c2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:14:28.120 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.112+0000 7fe96fa6e740 1 -- 172.21.15.44:0/831751502 shutdown_connections 2024-08-19T00:14:28.120 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.112+0000 7fe96fa6e740 1 -- 172.21.15.44:0/831751502 wait complete. 2024-08-19T00:14:28.120 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.112+0000 7fe96fa6e740 20 client.15654 trim_cache size 0 max 16384 2024-08-19T00:14:28.121 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:14:27 smithi116 ceph-mon[21873]: pgmap v37: 129 pgs: 129 active+clean; 1.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 10 op/s 2024-08-19T00:14:28.121 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:14:27 smithi044 ceph-mon[18489]: pgmap v37: 129 pgs: 129 active+clean; 1.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 10 op/s 2024-08-19T00:14:28.132 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.126+0000 7fe96fa6e740 1 Processor -- start 2024-08-19T00:14:28.132 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.126+0000 7fe96fa6e740 1 -- start start 2024-08-19T00:14:28.133 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.127+0000 7fe96fa6e740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ffc87c0670 0x55ffc87e7930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:28.133 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.127+0000 7fe96fa6e740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffc87c0f90 0x55ffc87e7e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:28.133 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.127+0000 7fe96fa6e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffc87cfda0 0x55ffc87bb680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:28.133 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.127+0000 7fe96fa6e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe9681aca40 con 0x55ffc87cfda0 2024-08-19T00:14:28.133 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.127+0000 7fe96fa6e740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fe9681ae580 con 0x55ffc87c0f90 2024-08-19T00:14:28.133 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.127+0000 7fe96fa6e740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe9681ad110 con 0x55ffc87c0670 2024-08-19T00:14:28.133 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.127+0000 7fe95ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffc87cfda0 0x55ffc87bb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:28.133 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.127+0000 7fe95ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffc87cfda0 0x55ffc87bb680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54052/0 (socket says 172.21.15.44:54052) 2024-08-19T00:14:28.133 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.127+0000 7fe95ffff640 1 -- 172.21.15.44:0/2311633681 learned_addr learned my addr 172.21.15.44:0/2311633681 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:14:28.133 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.127+0000 7fe95ffff640 1 -- 172.21.15.44:0/2311633681 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ffc87c0670 msgr2=0x55ffc87e7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:14:28.133 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.127+0000 7fe95ffff640 1 --2- 172.21.15.44:0/2311633681 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ffc87c0670 0x55ffc87e7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:28.133 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.127+0000 7fe96659c640 1 --2- 172.21.15.44:0/2311633681 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffc87c0f90 0x55ffc87e7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:28.133 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.127+0000 7fe95ffff640 1 -- 172.21.15.44:0/2311633681 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffc87c0f90 msgr2=0x55ffc87e7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:14:28.134 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.127+0000 7fe95ffff640 1 --2- 172.21.15.44:0/2311633681 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffc87c0f90 0x55ffc87e7e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:28.134 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.127+0000 7fe95ffff640 1 -- 172.21.15.44:0/2311633681 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffc87cb2d0 con 0x55ffc87cfda0 2024-08-19T00:14:28.134 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.127+0000 7fe96659c640 1 --2- 172.21.15.44:0/2311633681 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffc87c0f90 0x55ffc87e7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:14:28.134 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.127+0000 7fe95ffff640 1 --2- 172.21.15.44:0/2311633681 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffc87cfda0 0x55ffc87bb680 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fe950032e80 tx=0x7fe950009520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51adc06d85b30288 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:14:28.134 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.127+0000 7fe94ffff640 1 -- 172.21.15.44:0/2311633681 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe95005e070 con 0x55ffc87cfda0 2024-08-19T00:14:28.134 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.127+0000 7fe94ffff640 1 -- 172.21.15.44:0/2311633681 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe95004a520 con 0x55ffc87cfda0 2024-08-19T00:14:28.134 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.127+0000 7fe94ffff640 1 -- 172.21.15.44:0/2311633681 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe950059680 con 0x55ffc87cfda0 2024-08-19T00:14:28.134 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.128+0000 7fe96fa6e740 1 -- 172.21.15.44:0/2311633681 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffc87cfda0 msgr2=0x55ffc87bb680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:28.134 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.128+0000 7fe96fa6e740 1 --2- 172.21.15.44:0/2311633681 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffc87cfda0 0x55ffc87bb680 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fe950032e80 tx=0x7fe950009520 comp rx=0 tx=0).stop 2024-08-19T00:14:28.134 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.128+0000 7fe96fa6e740 1 -- 172.21.15.44:0/2311633681 shutdown_connections 2024-08-19T00:14:28.134 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.128+0000 7fe96fa6e740 1 --2- 172.21.15.44:0/2311633681 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffc87cfda0 0x55ffc87bb680 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:28.134 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.128+0000 7fe96fa6e740 1 --2- 172.21.15.44:0/2311633681 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffc87c0f90 0x55ffc87e7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:28.134 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.128+0000 7fe96fa6e740 1 --2- 172.21.15.44:0/2311633681 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ffc87c0670 0x55ffc87e7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:28.134 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.128+0000 7fe96fa6e740 1 -- 172.21.15.44:0/2311633681 >> 172.21.15.44:0/2311633681 conn(0x55ffc87bcd40 msgr2=0x55ffc87b7970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:14:28.134 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.128+0000 7fe96fa6e740 1 -- 172.21.15.44:0/2311633681 shutdown_connections 2024-08-19T00:14:28.135 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.128+0000 7fe96fa6e740 1 -- 172.21.15.44:0/2311633681 wait complete. 2024-08-19T00:14:28.135 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.128+0000 7fe96fa6e740 1 -- start start 2024-08-19T00:14:28.135 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.128+0000 7fe96fa6e740 1 Processor -- start 2024-08-19T00:14:28.135 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.129+0000 7fe96fa6e740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ffc87c0670 0x55ffc87d7da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:28.135 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.129+0000 7fe96fa6e740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffc87c0f90 0x55ffc87d82e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:28.135 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.129+0000 7fe96fa6e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffc87cfda0 0x55ffc87d4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:28.135 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.129+0000 7fe96fa6e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe9681adeb0 con 0x55ffc87cfda0 2024-08-19T00:14:28.135 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.129+0000 7fe96fa6e740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fe9681ad7e0 con 0x55ffc87c0f90 2024-08-19T00:14:28.135 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.129+0000 7fe96fa6e740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe9681aaa20 con 0x55ffc87c0670 2024-08-19T00:14:28.135 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.129+0000 7fe96fa6e740 10 client.0 _ll_register_callbacks cb 0x7fe9500315b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:14:28.135 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.129+0000 7fe95ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffc87cfda0 0x55ffc87d4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:28.135 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.129+0000 7fe95ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffc87cfda0 0x55ffc87d4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54056/0 (socket says 172.21.15.44:54056) 2024-08-19T00:14:28.135 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.129+0000 7fe95ffff640 1 -- 172.21.15.44:0/85165775 learned_addr learned my addr 172.21.15.44:0/85165775 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:14:28.136 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.129+0000 7fe96659c640 1 --2- 172.21.15.44:0/85165775 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffc87c0f90 0x55ffc87d82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:28.136 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.129+0000 7fe95ffff640 1 -- 172.21.15.44:0/85165775 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ffc87c0670 msgr2=0x55ffc87d7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:14:28.136 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.129+0000 7fe95ffff640 1 --2- 172.21.15.44:0/85165775 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ffc87c0670 0x55ffc87d7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:28.136 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.129+0000 7fe95ffff640 1 -- 172.21.15.44:0/85165775 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffc87c0f90 msgr2=0x55ffc87d82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:14:28.136 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.129+0000 7fe95ffff640 1 --2- 172.21.15.44:0/85165775 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffc87c0f90 0x55ffc87d82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:28.136 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.129+0000 7fe95ffff640 1 -- 172.21.15.44:0/85165775 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ffc87d52b0 con 0x55ffc87cfda0 2024-08-19T00:14:28.136 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.129+0000 7fe96659c640 1 --2- 172.21.15.44:0/85165775 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffc87c0f90 0x55ffc87d82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:14:28.136 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.129+0000 7fe95ffff640 1 --2- 172.21.15.44:0/85165775 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffc87cfda0 0x55ffc87d4d70 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fe95003dad0 tx=0x7fe950031bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c1cabf2ac482044 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:14:28.136 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.129+0000 7fe94dffb640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:14:28.136 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.129+0000 7fe94dffb640 1 -- 172.21.15.44:0/85165775 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe95005e040 con 0x55ffc87cfda0 2024-08-19T00:14:28.136 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.129+0000 7fe94dffb640 1 -- 172.21.15.44:0/85165775 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7fe95003d650 con 0x55ffc87cfda0 2024-08-19T00:14:28.136 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.129+0000 7fe96fa6e740 1 -- 172.21.15.44:0/85165775 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe95004a520 con 0x55ffc87cfda0 2024-08-19T00:14:28.136 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.129+0000 7fe94dffb640 1 -- 172.21.15.44:0/85165775 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe95003d850 con 0x55ffc87cfda0 2024-08-19T00:14:28.136 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.130+0000 7fe96fa6e740 10 client.15660 fetch_fsmap learned FSMap version 28 2024-08-19T00:14:28.136 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.130+0000 7fe96fa6e740 1 -- 172.21.15.44:0/85165775 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ffc884aec0 con 0x55ffc87cfda0 2024-08-19T00:14:28.137 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.130+0000 7fe94dffb640 1 -- 172.21.15.44:0/85165775 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe95004a520 con 0x55ffc87cfda0 2024-08-19T00:14:28.137 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.130+0000 7fe94dffb640 1 -- 172.21.15.44:0/85165775 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fe950061020 con 0x55ffc87cfda0 2024-08-19T00:14:28.137 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.130+0000 7fe96fa6e740 10 client.15660 fetch_fsmap finished waiting for FSMap version 28 2024-08-19T00:14:28.137 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.130+0000 7fe96fa6e740 10 client.15660 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:14:28.137 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.130+0000 7fe96fa6e740 20 client.15660 populate_metadata read hostname 'smithi044' 2024-08-19T00:14:28.137 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.130+0000 7fe96fa6e740 1 --2- 172.21.15.44:0/85165775 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55ffc87dfbd0 0x55ffc884d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:28.137 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.130+0000 7fe96fa6e740 4 client.15660 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-19T00:14:28.137 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.130+0000 7fe96fa6e740 1 -- 172.21.15.44:0/85165775 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ffc872c450 con 0x55ffc87dfbd0 2024-08-19T00:14:28.137 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.130+0000 7fe96659c640 1 --2- 172.21.15.44:0/85165775 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55ffc87dfbd0 0x55ffc884d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:28.137 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.130+0000 7fe94dffb640 10 client.15660 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:14:28.137 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.130+0000 7fe96659c640 1 --2- 172.21.15.44:0/85165775 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55ffc87dfbd0 0x55ffc884d2f0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d698838c138545d server_cookie=4865da028c019d15 in_seq=0 out_seq=0 2024-08-19T00:14:28.138 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.134+0000 7fe94dffb640 1 -- 172.21.15.44:0/85165775 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ffc872c450 con 0x55ffc87dfbd0 2024-08-19T00:14:28.139 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.134+0000 7fe94dffb640 10 client.15660 handle_command_reply: tid=0 2024-08-19T00:14:28.139 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.134+0000 7fe96fa6e740 1 client.15660 shutdown 2024-08-19T00:14:28.139 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.134+0000 7fe96fa6e740 1 -- 172.21.15.44:0/85165775 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffc87cfda0 msgr2=0x55ffc87d4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:28.139 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.134+0000 7fe96fa6e740 1 --2- 172.21.15.44:0/85165775 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffc87cfda0 0x55ffc87d4d70 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fe95003dad0 tx=0x7fe950031bb0 comp rx=0 tx=0).stop 2024-08-19T00:14:28.139 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.134+0000 7fe96fa6e740 1 -- 172.21.15.44:0/85165775 shutdown_connections 2024-08-19T00:14:28.139 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.134+0000 7fe96fa6e740 1 --2- 172.21.15.44:0/85165775 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55ffc87dfbd0 0x55ffc884d2f0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:28.139 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.134+0000 7fe96fa6e740 1 --2- 172.21.15.44:0/85165775 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ffc87cfda0 0x55ffc87d4d70 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:28.139 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.134+0000 7fe96fa6e740 1 --2- 172.21.15.44:0/85165775 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ffc87c0f90 0x55ffc87d82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:28.139 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.134+0000 7fe94dffb640 0 client.15660 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:14:28.139 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.134+0000 7fe96fa6e740 1 --2- 172.21.15.44:0/85165775 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ffc87c0670 0x55ffc87d7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:28.139 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.134+0000 7fe96fa6e740 1 -- 172.21.15.44:0/85165775 >> 172.21.15.44:0/85165775 conn(0x55ffc87bcd40 msgr2=0x55ffc87bb680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:14:28.139 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.134+0000 7fe96fa6e740 1 -- 172.21.15.44:0/85165775 shutdown_connections 2024-08-19T00:14:28.139 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.134+0000 7fe96fa6e740 1 -- 172.21.15.44:0/85165775 wait complete. 2024-08-19T00:14:28.140 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.134+0000 7fe96fa6e740 20 client.15660 trim_cache size 0 max 16384 2024-08-19T00:14:28.140 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:{ 2024-08-19T00:14:28.140 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "message": "", 2024-08-19T00:14:28.140 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "return_code": 0 2024-08-19T00:14:28.140 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:} 2024-08-19T00:14:28.141 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.135+0000 7fe96ccae640 1 -- 172.21.15.44:0/4098251956 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fe9540a2f50 msgr2=0x7fe9540a5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:28.141 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.135+0000 7fe96ccae640 1 --2- 172.21.15.44:0/4098251956 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fe9540a2f50 0x7fe9540a5410 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe9600ccf70 tx=0x7fe96000af30 comp rx=0 tx=0).stop 2024-08-19T00:14:28.141 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.135+0000 7fe96ccae640 1 -- 172.21.15.44:0/4098251956 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe9681066f0 msgr2=0x7fe9681a3f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:28.141 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.135+0000 7fe96ccae640 1 --2- 172.21.15.44:0/4098251956 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe9681066f0 0x7fe9681a3f00 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fe96000cce0 tx=0x7fe96000a620 comp rx=0 tx=0).stop 2024-08-19T00:14:28.141 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.135+0000 7fe96ccae640 1 -- 172.21.15.44:0/4098251956 shutdown_connections 2024-08-19T00:14:28.141 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.135+0000 7fe96ccae640 1 --2- 172.21.15.44:0/4098251956 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fe9540a2f50 0x7fe9540a5410 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:28.141 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.135+0000 7fe96ccae640 1 --2- 172.21.15.44:0/4098251956 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe968101080 0x7fe9681993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:28.141 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.135+0000 7fe96ccae640 1 --2- 172.21.15.44:0/4098251956 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe9681066f0 0x7fe9681a3f00 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:28.141 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.135+0000 7fe96ccae640 1 --2- 172.21.15.44:0/4098251956 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe9681006e0 0x7fe968198e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:28.141 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.135+0000 7fe96ccae640 1 -- 172.21.15.44:0/4098251956 >> 172.21.15.44:0/4098251956 conn(0x7fe9680776c0 msgr2=0x7fe968103420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:14:28.142 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.135+0000 7fe96ccae640 1 -- 172.21.15.44:0/4098251956 shutdown_connections 2024-08-19T00:14:28.142 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:28.135+0000 7fe96ccae640 1 -- 172.21.15.44:0/4098251956 wait complete. 2024-08-19T00:14:28.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:14:27 smithi171 ceph-mon[21810]: pgmap v37: 129 pgs: 129 active+clean; 1.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 10 op/s 2024-08-19T00:14:30.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:14:29 smithi116 ceph-mon[21873]: pgmap v38: 129 pgs: 129 active+clean; 1.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 9 op/s 2024-08-19T00:14:30.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:14:29 smithi044 ceph-mon[18489]: pgmap v38: 129 pgs: 129 active+clean; 1.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 9 op/s 2024-08-19T00:14:30.282 INFO:tasks.workunit.client.0.smithi044.stderr:Updating files: 94% (12190/12849) Updating files: 95% (12207/12849) Updating files: 96% (12336/12849) Updating files: 97% (12464/12849) Updating files: 98% (12593/12849) Updating files: 99% (12721/12849) Updating files: 100% (12849/12849) Updating files: 100% (12849/12849), done. 2024-08-19T00:14:30.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:14:29 smithi171 ceph-mon[21810]: pgmap v38: 129 pgs: 129 active+clean; 1.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 9 op/s 2024-08-19T00:14:30.840 INFO:tasks.workunit.client.0.smithi044.stderr:Note: switching to '78215f5a1cf5eaf321d506a66539942e12851f34'. 2024-08-19T00:14:30.840 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-08-19T00:14:30.840 INFO:tasks.workunit.client.0.smithi044.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-08-19T00:14:30.840 INFO:tasks.workunit.client.0.smithi044.stderr:changes and commit them, and you can discard any commits you make in this 2024-08-19T00:14:30.840 INFO:tasks.workunit.client.0.smithi044.stderr:state without impacting any branches by switching back to a branch. 2024-08-19T00:14:30.840 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-08-19T00:14:30.841 INFO:tasks.workunit.client.0.smithi044.stderr:If you want to create a new branch to retain commits you create, you may 2024-08-19T00:14:30.841 INFO:tasks.workunit.client.0.smithi044.stderr:do so (now or later) by using -c with the switch command. Example: 2024-08-19T00:14:30.841 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-08-19T00:14:30.841 INFO:tasks.workunit.client.0.smithi044.stderr: git switch -c 2024-08-19T00:14:30.841 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-08-19T00:14:30.841 INFO:tasks.workunit.client.0.smithi044.stderr:Or undo this operation with: 2024-08-19T00:14:30.841 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-08-19T00:14:30.841 INFO:tasks.workunit.client.0.smithi044.stderr: git switch - 2024-08-19T00:14:30.841 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-08-19T00:14:30.841 INFO:tasks.workunit.client.0.smithi044.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-08-19T00:14:30.841 INFO:tasks.workunit.client.0.smithi044.stderr: 2024-08-19T00:14:30.841 INFO:tasks.workunit.client.0.smithi044.stderr:HEAD is now at 78215f5a1cf Merge pull request #59291 from zdover23/wip-doc-2024-08-19-backport-59290-to-squid 2024-08-19T00:14:30.845 DEBUG:teuthology.orchestra.run.smithi044:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-08-19T00:14:30.911 INFO:tasks.workunit.client.0.smithi044.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-08-19T00:14:30.913 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-08-19T00:14:30.913 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-08-19T00:14:31.584 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-08-19T00:14:31.647 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-08-19T00:14:31.686 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-08-19T00:14:31.688 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-08-19T00:14:31.688 INFO:tasks.workunit.client.0.smithi044.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-08-19T00:14:31.726 INFO:tasks.workunit.client.0.smithi044.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-08-19T00:14:31.729 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-08-19T00:14:31.730 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-08-19T00:14:31.786 INFO:tasks.workunit:Running workunits matching suites/dbench.sh on client.0... 2024-08-19T00:14:31.787 INFO:tasks.workunit:Running workunit suites/dbench.sh... 2024-08-19T00:14:31.788 DEBUG:teuthology.orchestra.run.smithi044:workunit test suites/dbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=78215f5a1cf5eaf321d506a66539942e12851f34 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh 2024-08-19T00:14:32.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:14:31 smithi116 ceph-mon[21873]: pgmap v39: 129 pgs: 129 active+clean; 1.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1023 B/s wr, 14 op/s 2024-08-19T00:14:32.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:14:31 smithi044 ceph-mon[18489]: pgmap v39: 129 pgs: 129 active+clean; 1.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1023 B/s wr, 14 op/s 2024-08-19T00:14:32.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:14:31 smithi171 ceph-mon[21810]: pgmap v39: 129 pgs: 129 active+clean; 1.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1023 B/s wr, 14 op/s 2024-08-19T00:14:32.874 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-19T00:14:33.147 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:14:33.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:33.707+0000 7f0cc4e42640 1 -- 172.21.15.44:0/1276881364 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cc0100b50 msgr2=0x7f0cc0100f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:33.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:33.707+0000 7f0cc4e42640 1 --2- 172.21.15.44:0/1276881364 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cc0100b50 0x7f0cc0100f30 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0009900 tx=0x7f0cb002a480 comp rx=0 tx=0).stop 2024-08-19T00:14:33.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:33.707+0000 7f0cc4e42640 1 -- 172.21.15.44:0/1276881364 shutdown_connections 2024-08-19T00:14:33.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:33.707+0000 7f0cc4e42640 1 --2- 172.21.15.44:0/1276881364 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0cc0102c20 0x7f0cc010d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:33.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:33.707+0000 7f0cc4e42640 1 --2- 172.21.15.44:0/1276881364 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0cc01022a0 0x7f0cc01026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:33.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:33.707+0000 7f0cc4e42640 1 --2- 172.21.15.44:0/1276881364 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cc0100b50 0x7f0cc0100f30 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:33.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:33.707+0000 7f0cc4e42640 1 -- 172.21.15.44:0/1276881364 >> 172.21.15.44:0/1276881364 conn(0x7f0cc00fc500 msgr2=0x7f0cc00fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:14:33.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:33.707+0000 7f0cc4e42640 1 -- 172.21.15.44:0/1276881364 shutdown_connections 2024-08-19T00:14:33.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:33.707+0000 7f0cc4e42640 1 -- 172.21.15.44:0/1276881364 wait complete. 2024-08-19T00:14:33.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:33.708+0000 7f0cc4e42640 1 Processor -- start 2024-08-19T00:14:33.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:33.708+0000 7f0cc4e42640 1 -- start start 2024-08-19T00:14:33.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:33.708+0000 7f0cc4e42640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0cc0100b50 0x7f0cc0196ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:33.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:33.708+0000 7f0cc4e42640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cc01022a0 0x7f0cc0197530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:33.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:33.708+0000 7f0cc4e42640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0cc0102c20 0x7f0cc019b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:33.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:33.708+0000 7f0cc4e42640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0cc0110cb0 con 0x7f0cc01022a0 2024-08-19T00:14:33.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:33.708+0000 7f0cc4e42640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f0cc0110b30 con 0x7f0cc0100b50 2024-08-19T00:14:33.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:33.708+0000 7f0cc4e42640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0cc0110e30 con 0x7f0cc0102c20 2024-08-19T00:14:33.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:33.708+0000 7f0cbdd9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cc01022a0 0x7f0cc0197530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:33.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:33.709+0000 7f0cbdd9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cc01022a0 0x7f0cc0197530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:32820/0 (socket says 172.21.15.44:32820) 2024-08-19T00:14:33.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:33.709+0000 7f0cbdd9b640 1 -- 172.21.15.44:0/3590650408 learned_addr learned my addr 172.21.15.44:0/3590650408 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:14:33.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:33.709+0000 7f0cbe59c640 1 --2- 172.21.15.44:0/3590650408 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0cc0100b50 0x7f0cc0196ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:33.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:33.709+0000 7f0cbed9d640 1 --2- 172.21.15.44:0/3590650408 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0cc0102c20 0x7f0cc019b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:33.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:33.709+0000 7f0cbdd9b640 1 -- 172.21.15.44:0/3590650408 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0cc0102c20 msgr2=0x7f0cc019b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:33.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:33.709+0000 7f0cbdd9b640 1 --2- 172.21.15.44:0/3590650408 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0cc0102c20 0x7f0cc019b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:33.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:33.709+0000 7f0cbdd9b640 1 -- 172.21.15.44:0/3590650408 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0cc0100b50 msgr2=0x7f0cc0196ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:33.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:33.709+0000 7f0cbdd9b640 1 --2- 172.21.15.44:0/3590650408 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0cc0100b50 0x7f0cc0196ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:33.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:33.709+0000 7f0cbdd9b640 1 -- 172.21.15.44:0/3590650408 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cc019bfa0 con 0x7f0cc01022a0 2024-08-19T00:14:33.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:33.709+0000 7f0cbe59c640 1 --2- 172.21.15.44:0/3590650408 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0cc0100b50 0x7f0cc0196ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:14:33.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:33.709+0000 7f0cbed9d640 1 --2- 172.21.15.44:0/3590650408 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0cc0102c20 0x7f0cc019b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:14:33.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:33.709+0000 7f0cbdd9b640 1 --2- 172.21.15.44:0/3590650408 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cc01022a0 0x7f0cc0197530 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f0cb400c920 tx=0x7f0cb400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:14:33.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:33.709+0000 7f0caf7fe640 1 -- 172.21.15.44:0/3590650408 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb4007c70 con 0x7f0cc01022a0 2024-08-19T00:14:33.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:33.709+0000 7f0cc4e42640 1 -- 172.21.15.44:0/3590650408 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cc019c290 con 0x7f0cc01022a0 2024-08-19T00:14:33.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:33.709+0000 7f0caf7fe640 1 -- 172.21.15.44:0/3590650408 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0cb4007e10 con 0x7f0cc01022a0 2024-08-19T00:14:33.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:33.709+0000 7f0caf7fe640 1 -- 172.21.15.44:0/3590650408 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb4018890 con 0x7f0cc01022a0 2024-08-19T00:14:33.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:33.709+0000 7f0cc4e42640 1 -- 172.21.15.44:0/3590650408 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cc0069ca0 con 0x7f0cc01022a0 2024-08-19T00:14:33.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:33.711+0000 7f0cc4e42640 1 -- 172.21.15.44:0/3590650408 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cc0100f30 con 0x7f0cc01022a0 2024-08-19T00:14:33.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:33.712+0000 7f0caf7fe640 1 -- 172.21.15.44:0/3590650408 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 25) ==== 138117+0+0 (secure 0 0 0) 0x7f0cb4018a70 con 0x7f0cc01022a0 2024-08-19T00:14:33.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:33.712+0000 7f0caf7fe640 1 --2- 172.21.15.44:0/3590650408 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f0ca80a2ea0 0x7f0ca80a5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:33.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:33.712+0000 7f0cbe59c640 1 --2- 172.21.15.44:0/3590650408 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f0ca80a2ea0 0x7f0ca80a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:33.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:33.712+0000 7f0caf7fe640 1 -- 172.21.15.44:0/3590650408 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f0cb40cfc20 con 0x7f0cc01022a0 2024-08-19T00:14:33.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:33.713+0000 7f0cbe59c640 1 --2- 172.21.15.44:0/3590650408 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f0ca80a2ea0 0x7f0ca80a5360 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0000c00 tx=0x7f0cb00058d0 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:14:33.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:33.721+0000 7f0caf7fe640 1 -- 172.21.15.44:0/3590650408 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f0cb4014030 con 0x7f0cc01022a0 2024-08-19T00:14:33.897 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:14:33 smithi044 ceph-mon[18489]: pgmap v40: 129 pgs: 129 active+clean; 1.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-08-19T00:14:33.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:33.936+0000 7f0cc4e42640 1 -- 172.21.15.44:0/3590650408 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0cc0069f60 con 0x7f0cc01022a0 2024-08-19T00:14:33.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:33.937+0000 7f0caf7fe640 1 -- 172.21.15.44:0/3590650408 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11989 (secure 0 0 0) 0x7f0cb409c260 con 0x7f0cc01022a0 2024-08-19T00:14:33.939 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:14:33.939 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":28,"btime":"2024-08-19T00:13:17:187002+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14511,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1538841896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1538841896},{"type":"v1","addr":"172.21.15.116:6833","nonce":1538841896}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/4044471606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4044471606},{"type":"v1","addr":"172.21.15.44:6835","nonce":4044471606}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-19T00:10:53.196636+0000","modified":"2024-08-19T00:13:17.136820+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24473,"mds_1":24446,"mds_2":24439,"mds_3":24431,"mds_4":24418},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14529":{"gid":14529,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6837/1824829052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1824829052},{"type":"v1","addr":"172.21.15.44:6837","nonce":1824829052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14577":{"gid":14577,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6839/3591739042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":3591739042},{"type":"v1","addr":"172.21.15.44:6839","nonce":3591739042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14589":{"gid":14589,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6841/3667695717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6840","nonce":3667695717},{"type":"v1","addr":"172.21.15.44:6841","nonce":3667695717}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24388":{"gid":24388,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1183022838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1183022838},{"type":"v1","addr":"172.21.15.171:6833","nonce":1183022838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6835/2190623851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":2190623851},{"type":"v1","addr":"172.21.15.171:6835","nonce":2190623851}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.171:6837/316231795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":316231795},{"type":"v1","addr":"172.21.15.171:6837","nonce":316231795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":20,"addr":"172.21.15.116:6835/3507399322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3507399322},{"type":"v1","addr":"172.21.15.116:6835","nonce":3507399322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.171:6839/1466585795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":1466585795},{"type":"v1","addr":"172.21.15.171:6839","nonce":1466585795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":17,"addr":"172.21.15.116:6837/2764513846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":2764513846},{"type":"v1","addr":"172.21.15.116:6837","nonce":2764513846}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.116:6839/1032741033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":1032741033},{"type":"v1","addr":"172.21.15.116:6839","nonce":1032741033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24418,24431,24439,24446,24473]},"id":1}]} 2024-08-19T00:14:33.939 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 28 2024-08-19T00:14:33.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:33.939+0000 7f0cc4e42640 1 -- 172.21.15.44:0/3590650408 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f0ca80a2ea0 msgr2=0x7f0ca80a5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:33.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:33.939+0000 7f0cc4e42640 1 --2- 172.21.15.44:0/3590650408 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f0ca80a2ea0 0x7f0ca80a5360 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0000c00 tx=0x7f0cb00058d0 comp rx=0 tx=0).stop 2024-08-19T00:14:33.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:33.939+0000 7f0cc4e42640 1 -- 172.21.15.44:0/3590650408 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cc01022a0 msgr2=0x7f0cc0197530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:33.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:33.939+0000 7f0cc4e42640 1 --2- 172.21.15.44:0/3590650408 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cc01022a0 0x7f0cc0197530 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f0cb400c920 tx=0x7f0cb400cde0 comp rx=0 tx=0).stop 2024-08-19T00:14:33.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:33.940+0000 7f0cc4e42640 1 -- 172.21.15.44:0/3590650408 shutdown_connections 2024-08-19T00:14:33.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:33.940+0000 7f0cc4e42640 1 --2- 172.21.15.44:0/3590650408 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f0ca80a2ea0 0x7f0ca80a5360 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:33.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:33.940+0000 7f0cc4e42640 1 --2- 172.21.15.44:0/3590650408 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0cc0102c20 0x7f0cc019b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:33.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:33.940+0000 7f0cc4e42640 1 --2- 172.21.15.44:0/3590650408 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cc01022a0 0x7f0cc0197530 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:33.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:33.940+0000 7f0cc4e42640 1 --2- 172.21.15.44:0/3590650408 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0cc0100b50 0x7f0cc0196ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:33.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:33.940+0000 7f0cc4e42640 1 -- 172.21.15.44:0/3590650408 >> 172.21.15.44:0/3590650408 conn(0x7f0cc00fc500 msgr2=0x7f0cc00fdd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:14:33.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:33.940+0000 7f0cc4e42640 1 -- 172.21.15.44:0/3590650408 shutdown_connections 2024-08-19T00:14:33.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:33.940+0000 7f0cc4e42640 1 -- 172.21.15.44:0/3590650408 wait complete. 2024-08-19T00:14:34.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:14:33 smithi171 ceph-mon[21810]: pgmap v40: 129 pgs: 129 active+clean; 1.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-08-19T00:14:34.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:14:33 smithi116 ceph-mon[21873]: pgmap v40: 129 pgs: 129 active+clean; 1.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-08-19T00:14:34.717 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24473 quiesce db --set-id bb4507ff --release --await' 2024-08-19T00:14:34.717 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24473 quiesce db --set-id bb4507ff --release --await 2024-08-19T00:14:34.987 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:14:35.109 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:14:34 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/3590650408' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:14:35.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:14:34 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/3590650408' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:14:35.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:14:34 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/3590650408' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:14:35.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.497+0000 7f0530167640 1 -- 172.21.15.44:0/368564561 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f05281018b0 msgr2=0x7f0528101d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:35.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.497+0000 7f0530167640 1 --2- 172.21.15.44:0/368564561 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f05281018b0 0x7f0528101d10 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f051c009930 tx=0x7f051c02a420 comp rx=0 tx=0).stop 2024-08-19T00:14:35.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.497+0000 7f0530167640 1 -- 172.21.15.44:0/368564561 shutdown_connections 2024-08-19T00:14:35.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.497+0000 7f0530167640 1 --2- 172.21.15.44:0/368564561 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0528102250 0x7f052810e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:35.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.497+0000 7f0530167640 1 --2- 172.21.15.44:0/368564561 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f05281018b0 0x7f0528101d10 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:35.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.497+0000 7f0530167640 1 --2- 172.21.15.44:0/368564561 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f05281078b0 0x7f0528107c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:35.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.497+0000 7f0530167640 1 -- 172.21.15.44:0/368564561 >> 172.21.15.44:0/368564561 conn(0x7f05280fd5f0 msgr2=0x7f05280ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:14:35.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.497+0000 7f0530167640 1 -- 172.21.15.44:0/368564561 shutdown_connections 2024-08-19T00:14:35.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.497+0000 7f0530167640 1 -- 172.21.15.44:0/368564561 wait complete. 2024-08-19T00:14:35.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.498+0000 7f0530167640 1 Processor -- start 2024-08-19T00:14:35.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.498+0000 7f0530167640 1 -- start start 2024-08-19T00:14:35.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.498+0000 7f0530167640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f05281018b0 0x7f0528198210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:35.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.498+0000 7f0530167640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0528102250 0x7f0528198750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:35.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.498+0000 7f0530167640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f05281078b0 0x7f052819cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:35.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.498+0000 7f0530167640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0528111cd0 con 0x7f05281018b0 2024-08-19T00:14:35.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.498+0000 7f0530167640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f0528111b50 con 0x7f0528102250 2024-08-19T00:14:35.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.498+0000 7f0530167640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0528111e50 con 0x7f05281078b0 2024-08-19T00:14:35.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.498+0000 7f052df03640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f05281018b0 0x7f0528198210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:35.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.498+0000 7f052df03640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f05281018b0 0x7f0528198210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:32834/0 (socket says 172.21.15.44:32834) 2024-08-19T00:14:35.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.498+0000 7f052df03640 1 -- 172.21.15.44:0/2905256186 learned_addr learned my addr 172.21.15.44:0/2905256186 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:14:35.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.498+0000 7f052d702640 1 --2- 172.21.15.44:0/2905256186 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0528102250 0x7f0528198750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:35.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.498+0000 7f052e704640 1 --2- 172.21.15.44:0/2905256186 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f05281078b0 0x7f052819cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:35.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.498+0000 7f052df03640 1 -- 172.21.15.44:0/2905256186 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f05281078b0 msgr2=0x7f052819cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:35.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.498+0000 7f052df03640 1 --2- 172.21.15.44:0/2905256186 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f05281078b0 0x7f052819cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:35.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.498+0000 7f052df03640 1 -- 172.21.15.44:0/2905256186 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0528102250 msgr2=0x7f0528198750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:35.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.498+0000 7f052df03640 1 --2- 172.21.15.44:0/2905256186 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0528102250 0x7f0528198750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:35.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.498+0000 7f052df03640 1 -- 172.21.15.44:0/2905256186 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f052819d1c0 con 0x7f05281018b0 2024-08-19T00:14:35.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.498+0000 7f052e704640 1 --2- 172.21.15.44:0/2905256186 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f05281078b0 0x7f052819cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:14:35.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.498+0000 7f052df03640 1 --2- 172.21.15.44:0/2905256186 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f05281018b0 0x7f0528198210 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f051800eab0 tx=0x7f051800ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:14:35.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.499+0000 7f0526ffd640 1 -- 172.21.15.44:0/2905256186 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f051800ce40 con 0x7f05281018b0 2024-08-19T00:14:35.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.499+0000 7f0530167640 1 -- 172.21.15.44:0/2905256186 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f052819d4b0 con 0x7f05281018b0 2024-08-19T00:14:35.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.499+0000 7f0526ffd640 1 -- 172.21.15.44:0/2905256186 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0518011950 con 0x7f05281018b0 2024-08-19T00:14:35.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.499+0000 7f0526ffd640 1 -- 172.21.15.44:0/2905256186 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0518010ae0 con 0x7f05281018b0 2024-08-19T00:14:35.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.499+0000 7f0530167640 1 -- 172.21.15.44:0/2905256186 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05281a4d90 con 0x7f05281018b0 2024-08-19T00:14:35.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.501+0000 7f0526ffd640 1 -- 172.21.15.44:0/2905256186 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 25) ==== 138117+0+0 (secure 0 0 0) 0x7f0518011b00 con 0x7f05281018b0 2024-08-19T00:14:35.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.501+0000 7f0526ffd640 1 --2- 172.21.15.44:0/2905256186 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f05100a2ea0 0x7f05100a5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:35.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.502+0000 7f0532565740 1 Processor -- start 2024-08-19T00:14:35.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.502+0000 7f052d702640 1 --2- 172.21.15.44:0/2905256186 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f05100a2ea0 0x7f05100a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:35.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.502+0000 7f0526ffd640 1 -- 172.21.15.44:0/2905256186 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f05180d02c0 con 0x7f05281018b0 2024-08-19T00:14:35.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.502+0000 7f0532565740 1 -- start start 2024-08-19T00:14:35.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.502+0000 7f0532565740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d93dbf4990 0x55d93dbf4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:35.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.502+0000 7f0532565740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d93dbf52b0 0x55d93dbff630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:35.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.502+0000 7f0532565740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d93dbffb70 0x55d93dc01f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:35.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.502+0000 7f0532565740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55d93db5ac60 con 0x55d93dbffb70 2024-08-19T00:14:35.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.502+0000 7f0532565740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55d93daf2b90 con 0x55d93dbf4990 2024-08-19T00:14:35.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.502+0000 7f0532565740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55d93db56c20 con 0x55d93dbf52b0 2024-08-19T00:14:35.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.502+0000 7f052d702640 1 --2- 172.21.15.44:0/2905256186 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f05100a2ea0 0x7f05100a5360 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f051c000c00 tx=0x7f051c005a20 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:14:35.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.502+0000 7f052e704640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d93dbffb70 0x55d93dc01f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:35.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.502+0000 7f052df03640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d93dbf4990 0x55d93dbf4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:35.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.502+0000 7f052df03640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d93dbf4990 0x55d93dbf4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.44:56558/0 (socket says 172.21.15.44:56558) 2024-08-19T00:14:35.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.502+0000 7f052e704640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d93dbffb70 0x55d93dc01f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:32836/0 (socket says 172.21.15.44:32836) 2024-08-19T00:14:35.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.502+0000 7f052df03640 1 -- 172.21.15.44:0/275749333 learned_addr learned my addr 172.21.15.44:0/275749333 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:14:35.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.502+0000 7f052d702640 1 --2- 172.21.15.44:0/275749333 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d93dbf52b0 0x55d93dbff630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:35.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.503+0000 7f052df03640 1 -- 172.21.15.44:0/275749333 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d93dbf52b0 msgr2=0x55d93dbff630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:14:35.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.503+0000 7f052df03640 1 --2- 172.21.15.44:0/275749333 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d93dbf52b0 0x55d93dbff630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:35.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.503+0000 7f052df03640 1 -- 172.21.15.44:0/275749333 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d93dbffb70 msgr2=0x55d93dc01f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:14:35.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.503+0000 7f052df03640 1 --2- 172.21.15.44:0/275749333 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d93dbffb70 0x55d93dc01f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:35.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.503+0000 7f052df03640 1 -- 172.21.15.44:0/275749333 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d93d86a580 con 0x55d93dbf4990 2024-08-19T00:14:35.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.503+0000 7f052d702640 1 --2- 172.21.15.44:0/275749333 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d93dbf52b0 0x55d93dbff630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:14:35.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.503+0000 7f052e704640 1 --2- 172.21.15.44:0/275749333 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d93dbffb70 0x55d93dc01f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:14:35.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.503+0000 7f052df03640 1 --2- 172.21.15.44:0/275749333 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d93dbf4990 0x55d93dbf4d70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f05180cd520 tx=0x7f051809bb60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f921650e1a855a3 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:14:35.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.503+0000 7f050ffff640 1 -- 172.21.15.44:0/275749333 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05180b5070 con 0x55d93dbf4990 2024-08-19T00:14:35.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.503+0000 7f050ffff640 1 -- 172.21.15.44:0/275749333 <== mon.2 v2:172.21.15.116:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05180a05b0 con 0x55d93dbf4990 2024-08-19T00:14:35.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.503+0000 7f050ffff640 1 -- 172.21.15.44:0/275749333 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05180bc0d0 con 0x55d93dbf4990 2024-08-19T00:14:35.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.504+0000 7f0532565740 1 -- 172.21.15.44:0/275749333 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d93dbf4990 msgr2=0x55d93dbf4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:35.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.504+0000 7f0532565740 1 --2- 172.21.15.44:0/275749333 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d93dbf4990 0x55d93dbf4d70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f05180cd520 tx=0x7f051809bb60 comp rx=0 tx=0).stop 2024-08-19T00:14:35.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.504+0000 7f0532565740 1 -- 172.21.15.44:0/275749333 shutdown_connections 2024-08-19T00:14:35.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.504+0000 7f0532565740 1 --2- 172.21.15.44:0/275749333 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d93dbf52b0 0x55d93dbff630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:35.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.504+0000 7f0532565740 1 --2- 172.21.15.44:0/275749333 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d93dbffb70 0x55d93dc01f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:35.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.504+0000 7f0532565740 1 --2- 172.21.15.44:0/275749333 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d93dbf4990 0x55d93dbf4d70 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:35.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.504+0000 7f0532565740 1 -- 172.21.15.44:0/275749333 >> 172.21.15.44:0/275749333 conn(0x55d93dbf0f20 msgr2=0x55d93dbf1300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:14:35.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.504+0000 7f0532565740 1 -- 172.21.15.44:0/275749333 shutdown_connections 2024-08-19T00:14:35.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.504+0000 7f0532565740 1 -- 172.21.15.44:0/275749333 wait complete. 2024-08-19T00:14:35.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.504+0000 7f0532565740 1 -- start start 2024-08-19T00:14:35.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.504+0000 7f0532565740 1 Processor -- start 2024-08-19T00:14:35.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.505+0000 7f0532565740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d93dbf4990 0x55d93dbfcab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:35.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.505+0000 7f0532565740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d93dbf52b0 0x55d93dbfcff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:35.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.505+0000 7f0532565740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d93dbffb70 0x55d93dbfd530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:35.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.505+0000 7f0532565740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55d93dc02740 con 0x55d93dbffb70 2024-08-19T00:14:35.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.505+0000 7f0532565740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55d93daf87c0 con 0x55d93dbf4990 2024-08-19T00:14:35.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.505+0000 7f0532565740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55d93dc028c0 con 0x55d93dbf52b0 2024-08-19T00:14:35.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.505+0000 7f0532565740 10 client.0 _ll_register_callbacks cb 0x55d93db01f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:14:35.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.505+0000 7f052e704640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d93dbffb70 0x55d93dbfd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:35.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.505+0000 7f052e704640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d93dbffb70 0x55d93dbfd530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:32842/0 (socket says 172.21.15.44:32842) 2024-08-19T00:14:35.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.505+0000 7f052e704640 1 -- 172.21.15.44:0/1682899875 learned_addr learned my addr 172.21.15.44:0/1682899875 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:14:35.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.505+0000 7f052df03640 1 --2- 172.21.15.44:0/1682899875 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d93dbf4990 0x55d93dbfcab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:35.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.505+0000 7f052d702640 1 --2- 172.21.15.44:0/1682899875 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d93dbf52b0 0x55d93dbfcff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:35.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.505+0000 7f052e704640 1 -- 172.21.15.44:0/1682899875 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d93dbf52b0 msgr2=0x55d93dbfcff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:14:35.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.505+0000 7f052e704640 1 --2- 172.21.15.44:0/1682899875 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d93dbf52b0 0x55d93dbfcff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:35.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.505+0000 7f052e704640 1 -- 172.21.15.44:0/1682899875 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d93dbf4990 msgr2=0x55d93dbfcab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:14:35.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.505+0000 7f052e704640 1 --2- 172.21.15.44:0/1682899875 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d93dbf4990 0x55d93dbfcab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:35.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.505+0000 7f052e704640 1 -- 172.21.15.44:0/1682899875 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d93d934960 con 0x55d93dbffb70 2024-08-19T00:14:35.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.506+0000 7f052e704640 1 --2- 172.21.15.44:0/1682899875 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d93dbffb70 0x55d93dbfd530 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f052000f4f0 tx=0x7f052000f9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d5c4e4318bc3e51 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:14:35.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.506+0000 7f050d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:14:35.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.506+0000 7f050d7fa640 1 -- 172.21.15.44:0/1682899875 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0520013850 con 0x55d93dbffb70 2024-08-19T00:14:35.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.506+0000 7f050d7fa640 1 -- 172.21.15.44:0/1682899875 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f05200139f0 con 0x55d93dbffb70 2024-08-19T00:14:35.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.506+0000 7f0532565740 1 -- 172.21.15.44:0/1682899875 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05180a05b0 con 0x55d93dbffb70 2024-08-19T00:14:35.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.506+0000 7f050d7fa640 1 -- 172.21.15.44:0/1682899875 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0520024050 con 0x55d93dbffb70 2024-08-19T00:14:35.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.506+0000 7f0532565740 10 client.15678 fetch_fsmap learned FSMap version 28 2024-08-19T00:14:35.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.506+0000 7f0532565740 1 -- 172.21.15.44:0/1682899875 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d93dc0e830 con 0x55d93dbffb70 2024-08-19T00:14:35.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.506+0000 7f050d7fa640 1 -- 172.21.15.44:0/1682899875 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05180a05b0 con 0x55d93dbffb70 2024-08-19T00:14:35.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.506+0000 7f050d7fa640 1 -- 172.21.15.44:0/1682899875 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f05200113e0 con 0x55d93dbffb70 2024-08-19T00:14:35.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.506+0000 7f0532565740 10 client.15678 fetch_fsmap finished waiting for FSMap version 28 2024-08-19T00:14:35.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.506+0000 7f0532565740 10 client.15678 resolve_mds: validated gid 24473 aka daemon mds.b 2024-08-19T00:14:35.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.506+0000 7f0532565740 20 client.15678 populate_metadata read hostname 'smithi044' 2024-08-19T00:14:35.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.506+0000 7f0532565740 1 --2- 172.21.15.44:0/1682899875 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55d93dc0fcf0 0x55d93dc120e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:35.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.506+0000 7f0532565740 4 client.15678 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:14:35.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.506+0000 7f0532565740 1 -- 172.21.15.44:0/1682899875 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d93db681d0 con 0x55d93dc0fcf0 2024-08-19T00:14:35.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.507+0000 7f052df03640 1 --2- 172.21.15.44:0/1682899875 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55d93dc0fcf0 0x55d93dc120e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:35.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.507+0000 7f052df03640 1 --2- 172.21.15.44:0/1682899875 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55d93dc0fcf0 0x55d93dc120e0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3810e77c5b585c4c server_cookie=cbc9ab531afa609 in_seq=0 out_seq=0 2024-08-19T00:14:35.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.507+0000 7f050d7fa640 10 client.15678 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:14:35.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.508+0000 7f050d7fa640 1 -- 172.21.15.44:0/1682899875 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d93db681d0 con 0x55d93dc0fcf0 2024-08-19T00:14:35.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.508+0000 7f050d7fa640 10 client.15678 handle_command_reply: tid=0 2024-08-19T00:14:35.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.508+0000 7f0532565740 1 client.15678 shutdown 2024-08-19T00:14:35.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.508+0000 7f0532565740 1 -- 172.21.15.44:0/1682899875 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d93dbffb70 msgr2=0x55d93dbfd530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:35.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.508+0000 7f0532565740 1 --2- 172.21.15.44:0/1682899875 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d93dbffb70 0x55d93dbfd530 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f052000f4f0 tx=0x7f052000f9b0 comp rx=0 tx=0).stop 2024-08-19T00:14:35.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.508+0000 7f0532565740 1 -- 172.21.15.44:0/1682899875 shutdown_connections 2024-08-19T00:14:35.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.508+0000 7f0532565740 1 --2- 172.21.15.44:0/1682899875 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55d93dc0fcf0 0x55d93dc120e0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:35.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.508+0000 7f0532565740 1 --2- 172.21.15.44:0/1682899875 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d93dbf52b0 0x55d93dbfcff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:35.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.508+0000 7f0532565740 1 --2- 172.21.15.44:0/1682899875 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d93dbffb70 0x55d93dbfd530 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:35.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.508+0000 7f050d7fa640 0 client.15678 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:14:35.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.508+0000 7f0532565740 1 --2- 172.21.15.44:0/1682899875 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d93dbf4990 0x55d93dbfcab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:35.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.508+0000 7f0532565740 1 -- 172.21.15.44:0/1682899875 >> 172.21.15.44:0/1682899875 conn(0x55d93dbf0f20 msgr2=0x55d93dbf6c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:14:35.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.508+0000 7f0532565740 1 -- 172.21.15.44:0/1682899875 shutdown_connections 2024-08-19T00:14:35.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.508+0000 7f0532565740 1 -- 172.21.15.44:0/1682899875 wait complete. 2024-08-19T00:14:35.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.508+0000 7f0532565740 20 client.15678 trim_cache size 0 max 16384 2024-08-19T00:14:35.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.525+0000 7f0532565740 1 Processor -- start 2024-08-19T00:14:35.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.525+0000 7f0532565740 1 -- start start 2024-08-19T00:14:35.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.526+0000 7f0532565740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d93dbf4990 0x55d93dbf73f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:35.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.526+0000 7f0532565740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d93dbf52b0 0x55d93dbeff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:35.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.526+0000 7f0532565740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d93dbffb70 0x55d93dc17940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:35.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.526+0000 7f0532565740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f05281aee50 con 0x55d93dbf52b0 2024-08-19T00:14:35.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.526+0000 7f0532565740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f05281b0990 con 0x55d93dbffb70 2024-08-19T00:14:35.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.526+0000 7f0532565740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f05281af520 con 0x55d93dbf4990 2024-08-19T00:14:35.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.526+0000 7f052d702640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d93dbf52b0 0x55d93dbeff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:35.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.526+0000 7f052d702640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d93dbf52b0 0x55d93dbeff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:32846/0 (socket says 172.21.15.44:32846) 2024-08-19T00:14:35.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.526+0000 7f052d702640 1 -- 172.21.15.44:0/3731734328 learned_addr learned my addr 172.21.15.44:0/3731734328 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:14:35.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.526+0000 7f052d702640 1 -- 172.21.15.44:0/3731734328 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d93dbf4990 msgr2=0x55d93dbf73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:14:35.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.526+0000 7f052d702640 1 --2- 172.21.15.44:0/3731734328 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d93dbf4990 0x55d93dbf73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:35.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.526+0000 7f052d702640 1 -- 172.21.15.44:0/3731734328 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d93dbffb70 msgr2=0x55d93dc17940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:14:35.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.526+0000 7f052d702640 1 --2- 172.21.15.44:0/3731734328 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d93dbffb70 0x55d93dc17940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:35.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.526+0000 7f052d702640 1 -- 172.21.15.44:0/3731734328 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d93dc12710 con 0x55d93dbf52b0 2024-08-19T00:14:35.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.526+0000 7f052d702640 1 --2- 172.21.15.44:0/3731734328 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d93dbf52b0 0x55d93dbeff70 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f051c02a940 tx=0x7f051c03c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=799c31e294af17f5 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:14:35.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.526+0000 7f050f7fe640 1 -- 172.21.15.44:0/3731734328 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f051c035050 con 0x55d93dbf52b0 2024-08-19T00:14:35.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.526+0000 7f050f7fe640 1 -- 172.21.15.44:0/3731734328 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f051c04d070 con 0x55d93dbf52b0 2024-08-19T00:14:35.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.526+0000 7f050f7fe640 1 -- 172.21.15.44:0/3731734328 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f051c004cf0 con 0x55d93dbf52b0 2024-08-19T00:14:35.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.527+0000 7f0532565740 1 -- 172.21.15.44:0/3731734328 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d93dbf52b0 msgr2=0x55d93dbeff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:35.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.527+0000 7f0532565740 1 --2- 172.21.15.44:0/3731734328 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d93dbf52b0 0x55d93dbeff70 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f051c02a940 tx=0x7f051c03c000 comp rx=0 tx=0).stop 2024-08-19T00:14:35.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.527+0000 7f0532565740 1 -- 172.21.15.44:0/3731734328 shutdown_connections 2024-08-19T00:14:35.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.527+0000 7f0532565740 1 --2- 172.21.15.44:0/3731734328 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d93dbffb70 0x55d93dc17940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:35.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.527+0000 7f0532565740 1 --2- 172.21.15.44:0/3731734328 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d93dbf52b0 0x55d93dbeff70 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:35.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.527+0000 7f0532565740 1 --2- 172.21.15.44:0/3731734328 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d93dbf4990 0x55d93dbf73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:35.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.527+0000 7f0532565740 1 -- 172.21.15.44:0/3731734328 >> 172.21.15.44:0/3731734328 conn(0x55d93dbf0f20 msgr2=0x55d93dbef860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:14:35.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.527+0000 7f0532565740 1 -- 172.21.15.44:0/3731734328 shutdown_connections 2024-08-19T00:14:35.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.527+0000 7f0532565740 1 -- 172.21.15.44:0/3731734328 wait complete. 2024-08-19T00:14:35.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.527+0000 7f0532565740 1 -- start start 2024-08-19T00:14:35.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.527+0000 7f0532565740 1 Processor -- start 2024-08-19T00:14:35.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.528+0000 7f0532565740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d93dbf4990 0x55d93dc03fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:35.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.528+0000 7f0532565740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d93dbf52b0 0x55d93dc04520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:35.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.528+0000 7f0532565740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d93dbffb70 0x55d93dc79910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:35.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.528+0000 7f0532565740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f05281b02c0 con 0x55d93dbf52b0 2024-08-19T00:14:35.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.528+0000 7f0532565740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f05281afbf0 con 0x55d93dbf4990 2024-08-19T00:14:35.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.528+0000 7f0532565740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f05281ace30 con 0x55d93dbffb70 2024-08-19T00:14:35.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.528+0000 7f0532565740 10 client.0 _ll_register_callbacks cb 0x7f052000adb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:14:35.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.528+0000 7f052d702640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d93dbf52b0 0x55d93dc04520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:35.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.528+0000 7f052d702640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d93dbf52b0 0x55d93dc04520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:32856/0 (socket says 172.21.15.44:32856) 2024-08-19T00:14:35.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.528+0000 7f052d702640 1 -- 172.21.15.44:0/2121477275 learned_addr learned my addr 172.21.15.44:0/2121477275 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:14:35.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.528+0000 7f052df03640 1 --2- 172.21.15.44:0/2121477275 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d93dbf4990 0x55d93dc03fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:35.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.528+0000 7f052e704640 1 --2- 172.21.15.44:0/2121477275 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d93dbffb70 0x55d93dc79910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:35.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.528+0000 7f052d702640 1 -- 172.21.15.44:0/2121477275 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d93dbffb70 msgr2=0x55d93dc79910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:14:35.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.528+0000 7f052d702640 1 --2- 172.21.15.44:0/2121477275 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d93dbffb70 0x55d93dc79910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:35.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.528+0000 7f052d702640 1 -- 172.21.15.44:0/2121477275 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d93dbf4990 msgr2=0x55d93dc03fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:14:35.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.528+0000 7f052d702640 1 --2- 172.21.15.44:0/2121477275 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d93dbf4990 0x55d93dc03fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:35.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.528+0000 7f052d702640 1 -- 172.21.15.44:0/2121477275 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d93dc79ed0 con 0x55d93dbf52b0 2024-08-19T00:14:35.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.528+0000 7f052e704640 1 --2- 172.21.15.44:0/2121477275 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d93dbffb70 0x55d93dc79910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:14:35.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.528+0000 7f052df03640 1 --2- 172.21.15.44:0/2121477275 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d93dbf4990 0x55d93dc03fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:14:35.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.528+0000 7f052d702640 1 --2- 172.21.15.44:0/2121477275 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d93dbf52b0 0x55d93dc04520 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f051c005ab0 tx=0x7f051c0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89221aa79781c320 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:14:35.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.529+0000 7f050d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:14:35.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.529+0000 7f050d7fa640 1 -- 172.21.15.44:0/2121477275 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f051c05f060 con 0x55d93dbf52b0 2024-08-19T00:14:35.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.529+0000 7f050d7fa640 1 -- 172.21.15.44:0/2121477275 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f051c052470 con 0x55d93dbf52b0 2024-08-19T00:14:35.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.529+0000 7f0532565740 1 -- 172.21.15.44:0/2121477275 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f051c04d070 con 0x55d93dbf52b0 2024-08-19T00:14:35.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.529+0000 7f050d7fa640 1 -- 172.21.15.44:0/2121477275 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f051c066050 con 0x55d93dbf52b0 2024-08-19T00:14:35.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.529+0000 7f0532565740 10 client.15684 fetch_fsmap learned FSMap version 28 2024-08-19T00:14:35.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.529+0000 7f0532565740 1 -- 172.21.15.44:0/2121477275 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d93dc7b200 con 0x55d93dbf52b0 2024-08-19T00:14:35.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.529+0000 7f050d7fa640 1 -- 172.21.15.44:0/2121477275 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f051c04d070 con 0x55d93dbf52b0 2024-08-19T00:14:35.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.529+0000 7f050d7fa640 1 -- 172.21.15.44:0/2121477275 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f051c049660 con 0x55d93dbf52b0 2024-08-19T00:14:35.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.529+0000 7f0532565740 10 client.15684 fetch_fsmap finished waiting for FSMap version 28 2024-08-19T00:14:35.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.529+0000 7f0532565740 10 client.15684 resolve_mds: validated gid 24473 aka daemon mds.b 2024-08-19T00:14:35.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.529+0000 7f0532565740 20 client.15684 populate_metadata read hostname 'smithi044' 2024-08-19T00:14:35.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.529+0000 7f0532565740 1 --2- 172.21.15.44:0/2121477275 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55d93dc7b960 0x55d93dc7dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:35.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.529+0000 7f0532565740 4 client.15684 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "bb4507ff", "release": true, "await": true}] 2024-08-19T00:14:35.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.529+0000 7f0532565740 1 -- 172.21.15.44:0/2121477275 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "quiesce db", "set_id": "bb4507ff", "release": true, "await": true}) -- 0x55d93db626e0 con 0x55d93dc7b960 2024-08-19T00:14:35.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.530+0000 7f052df03640 1 --2- 172.21.15.44:0/2121477275 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55d93dc7b960 0x55d93dc7dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:35.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.530+0000 7f052df03640 1 --2- 172.21.15.44:0/2121477275 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55d93dc7b960 0x55d93dc7dd80 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db3c46253754e8b6 server_cookie=b52f50b495fc78b7 in_seq=0 out_seq=0 2024-08-19T00:14:35.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.530+0000 7f050d7fa640 10 client.15684 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:14:35.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.533+0000 7f050d7fa640 1 -- 172.21.15.44:0/2121477275 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55d93db626e0 con 0x55d93dc7b960 2024-08-19T00:14:35.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.533+0000 7f050d7fa640 10 client.15684 handle_command_reply: tid=0 2024-08-19T00:14:35.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.533+0000 7f0532565740 1 client.15684 shutdown 2024-08-19T00:14:35.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.533+0000 7f0532565740 1 -- 172.21.15.44:0/2121477275 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d93dbf52b0 msgr2=0x55d93dc04520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:35.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.533+0000 7f0532565740 1 --2- 172.21.15.44:0/2121477275 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d93dbf52b0 0x55d93dc04520 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f051c005ab0 tx=0x7f051c0038a0 comp rx=0 tx=0).stop 2024-08-19T00:14:35.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.533+0000 7f0532565740 1 -- 172.21.15.44:0/2121477275 shutdown_connections 2024-08-19T00:14:35.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.533+0000 7f0532565740 1 --2- 172.21.15.44:0/2121477275 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55d93dc7b960 0x55d93dc7dd80 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:35.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.533+0000 7f0532565740 1 --2- 172.21.15.44:0/2121477275 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d93dbffb70 0x55d93dc79910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:35.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.533+0000 7f0532565740 1 --2- 172.21.15.44:0/2121477275 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d93dbf52b0 0x55d93dc04520 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:35.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.533+0000 7f0532565740 1 --2- 172.21.15.44:0/2121477275 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d93dbf4990 0x55d93dc03fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:35.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.533+0000 7f050d7fa640 0 client.15684 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:14:35.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.533+0000 7f0532565740 1 -- 172.21.15.44:0/2121477275 >> 172.21.15.44:0/2121477275 conn(0x55d93dbf0f20 msgr2=0x55d93dbfd240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:14:35.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.533+0000 7f0532565740 1 -- 172.21.15.44:0/2121477275 shutdown_connections 2024-08-19T00:14:35.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.533+0000 7f0532565740 1 -- 172.21.15.44:0/2121477275 wait complete. 2024-08-19T00:14:35.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.533+0000 7f0532565740 20 client.15684 trim_cache size 0 max 16384 2024-08-19T00:14:35.538 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-08-19T00:14:35.538 INFO:teuthology.orchestra.run.smithi044.stdout: "epoch": 28, 2024-08-19T00:14:35.538 INFO:teuthology.orchestra.run.smithi044.stdout: "leader": 24473, 2024-08-19T00:14:35.538 INFO:teuthology.orchestra.run.smithi044.stdout: "set_version": 4, 2024-08-19T00:14:35.538 INFO:teuthology.orchestra.run.smithi044.stdout: "sets": { 2024-08-19T00:14:35.538 INFO:teuthology.orchestra.run.smithi044.stdout: "bb4507ff": { 2024-08-19T00:14:35.538 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 4, 2024-08-19T00:14:35.538 INFO:teuthology.orchestra.run.smithi044.stdout: "age_ref": 0.0, 2024-08-19T00:14:35.539 INFO:teuthology.orchestra.run.smithi044.stdout: "state": { 2024-08-19T00:14:35.539 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "RELEASED", 2024-08-19T00:14:35.539 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.0 2024-08-19T00:14:35.539 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:14:35.539 INFO:teuthology.orchestra.run.smithi044.stdout: "timeout": 90.0, 2024-08-19T00:14:35.539 INFO:teuthology.orchestra.run.smithi044.stdout: "expiration": 154.7, 2024-08-19T00:14:35.539 INFO:teuthology.orchestra.run.smithi044.stdout: "members": { 2024-08-19T00:14:35.539 INFO:teuthology.orchestra.run.smithi044.stdout: "file:/": { 2024-08-19T00:14:35.539 INFO:teuthology.orchestra.run.smithi044.stdout: "excluded": false, 2024-08-19T00:14:35.539 INFO:teuthology.orchestra.run.smithi044.stdout: "state": { 2024-08-19T00:14:35.539 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "RELEASED", 2024-08-19T00:14:35.539 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.0 2024-08-19T00:14:35.539 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:14:35.539 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:14:35.540 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:14:35.540 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:14:35.540 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:14:35.540 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-08-19T00:14:35.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.534+0000 7f0530167640 1 -- 172.21.15.44:0/2905256186 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f05100a2ea0 msgr2=0x7f05100a5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:35.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.534+0000 7f0530167640 1 --2- 172.21.15.44:0/2905256186 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f05100a2ea0 0x7f05100a5360 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f051c000c00 tx=0x7f051c005a20 comp rx=0 tx=0).stop 2024-08-19T00:14:35.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.534+0000 7f0530167640 1 -- 172.21.15.44:0/2905256186 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f05281018b0 msgr2=0x7f0528198210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:35.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.534+0000 7f0530167640 1 --2- 172.21.15.44:0/2905256186 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f05281018b0 0x7f0528198210 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f051800eab0 tx=0x7f051800ef70 comp rx=0 tx=0).stop 2024-08-19T00:14:35.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.534+0000 7f0530167640 1 -- 172.21.15.44:0/2905256186 shutdown_connections 2024-08-19T00:14:35.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.534+0000 7f0530167640 1 --2- 172.21.15.44:0/2905256186 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f05100a2ea0 0x7f05100a5360 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:35.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.534+0000 7f0530167640 1 --2- 172.21.15.44:0/2905256186 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f05281078b0 0x7f052819cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:35.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.534+0000 7f0530167640 1 --2- 172.21.15.44:0/2905256186 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0528102250 0x7f0528198750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:35.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.534+0000 7f0530167640 1 --2- 172.21.15.44:0/2905256186 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f05281018b0 0x7f0528198210 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:35.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.534+0000 7f0530167640 1 -- 172.21.15.44:0/2905256186 >> 172.21.15.44:0/2905256186 conn(0x7f05280fd5f0 msgr2=0x7f05280fde30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:14:35.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.534+0000 7f0530167640 1 -- 172.21.15.44:0/2905256186 shutdown_connections 2024-08-19T00:14:35.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:14:35.534+0000 7f0530167640 1 -- 172.21.15.44:0/2905256186 wait complete. 2024-08-19T00:14:35.542 INFO:tasks.workunit.client.0.smithi044.stderr:+ dbench 1 2024-08-19T00:14:35.545 INFO:tasks.workunit.client.0.smithi044.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-08-19T00:14:35.545 INFO:tasks.workunit.client.0.smithi044.stdout: 2024-08-19T00:14:35.546 INFO:tasks.workunit.client.0.smithi044.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-08-19T00:14:35.546 INFO:tasks.workunit.client.0.smithi044.stdout:0 of 1 processes prepared for launch 0 sec 2024-08-19T00:14:35.646 INFO:tasks.workunit.client.0.smithi044.stdout:1 of 1 processes prepared for launch 0 sec 2024-08-19T00:14:35.647 INFO:tasks.workunit.client.0.smithi044.stdout:releasing clients 2024-08-19T00:14:36.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:14:35 smithi044 ceph-mon[18489]: pgmap v41: 129 pgs: 129 active+clean; 1.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 13 op/s 2024-08-19T00:14:36.258 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'bb4507ff', total seconds elapsed: 38.1 2024-08-19T00:14:36.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:14:35 smithi171 ceph-mon[21810]: pgmap v41: 129 pgs: 129 active+clean; 1.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 13 op/s 2024-08-19T00:14:36.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:14:35 smithi116 ceph-mon[21873]: pgmap v41: 129 pgs: 129 active+clean; 1.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 13 op/s 2024-08-19T00:14:36.646 INFO:tasks.workunit.client.0.smithi044.stdout: 1 3795 39.76 MB/sec warmup 1 sec latency 6.303 ms 2024-08-19T00:14:37.647 INFO:tasks.workunit.client.0.smithi044.stdout: 1 4628 21.01 MB/sec warmup 2 sec latency 488.349 ms 2024-08-19T00:14:38.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:14:37 smithi171 ceph-mon[21810]: pgmap v42: 129 pgs: 129 active+clean; 1.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 9 op/s 2024-08-19T00:14:38.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:14:37 smithi171 ceph-mon[21810]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-19T00:14:38.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:14:37 smithi116 ceph-mon[21873]: pgmap v42: 129 pgs: 129 active+clean; 1.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 9 op/s 2024-08-19T00:14:38.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:14:37 smithi116 ceph-mon[21873]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-19T00:14:38.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:14:37 smithi044 ceph-mon[18489]: pgmap v42: 129 pgs: 129 active+clean; 1.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 9 op/s 2024-08-19T00:14:38.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:14:37 smithi044 ceph-mon[18489]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-19T00:14:38.647 INFO:tasks.workunit.client.0.smithi044.stdout: 1 5894 15.65 MB/sec warmup 3 sec latency 668.563 ms 2024-08-19T00:14:39.647 INFO:tasks.workunit.client.0.smithi044.stdout: 1 5894 11.74 MB/sec warmup 4 sec latency 1668.656 ms 2024-08-19T00:14:40.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:14:39 smithi171 ceph-mon[21810]: pgmap v43: 129 pgs: 129 active+clean; 1.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2024-08-19T00:14:40.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:14:39 smithi116 ceph-mon[21873]: pgmap v43: 129 pgs: 129 active+clean; 1.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2024-08-19T00:14:40.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:14:39 smithi044 ceph-mon[18489]: pgmap v43: 129 pgs: 129 active+clean; 1.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2024-08-19T00:14:40.647 INFO:tasks.workunit.client.0.smithi044.stdout: 1 5894 9.39 MB/sec warmup 5 sec latency 2668.771 ms 2024-08-19T00:14:41.231 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.228+0000 7f0fc2dea640 1 -- 172.21.15.44:0/1604613122 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0fbc101080 msgr2=0x7f0fbc10d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:41.232 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.228+0000 7f0fc2dea640 1 --2- 172.21.15.44:0/1604613122 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0fbc101080 0x7f0fbc10d5b0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f0fb4009cd0 tx=0x7f0fb402a8e0 comp rx=0 tx=0).stop 2024-08-19T00:14:41.232 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.228+0000 7f0fc2dea640 1 -- 172.21.15.44:0/1604613122 shutdown_connections 2024-08-19T00:14:41.232 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.228+0000 7f0fc2dea640 1 --2- 172.21.15.44:0/1604613122 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0fbc1006e0 0x7f0fbc100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:41.232 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.228+0000 7f0fc2dea640 1 --2- 172.21.15.44:0/1604613122 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0fbc101080 0x7f0fbc10d5b0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:41.232 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.228+0000 7f0fc2dea640 1 --2- 172.21.15.44:0/1604613122 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0fbc1066f0 0x7f0fbc106ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:41.232 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.228+0000 7f0fc2dea640 1 -- 172.21.15.44:0/1604613122 >> 172.21.15.44:0/1604613122 conn(0x7f0fbc0776c0 msgr2=0x7f0fbc0fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:14:41.232 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.228+0000 7f0fc2dea640 1 -- 172.21.15.44:0/1604613122 shutdown_connections 2024-08-19T00:14:41.232 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.228+0000 7f0fc2dea640 1 -- 172.21.15.44:0/1604613122 wait complete. 2024-08-19T00:14:41.232 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.229+0000 7f0fc2dea640 1 Processor -- start 2024-08-19T00:14:41.232 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.229+0000 7f0fc2dea640 1 -- start start 2024-08-19T00:14:41.232 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.229+0000 7f0fc2dea640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0fbc1006e0 0x7f0fbc10e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:41.233 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.229+0000 7f0fc2dea640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0fbc101080 0x7f0fbc10e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:41.233 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.229+0000 7f0fc2dea640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0fbc1066f0 0x7f0fbc10eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:41.233 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.229+0000 7f0fc2dea640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0fbc111c20 con 0x7f0fbc1006e0 2024-08-19T00:14:41.233 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.229+0000 7f0fc2dea640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f0fbc111aa0 con 0x7f0fbc1066f0 2024-08-19T00:14:41.233 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.229+0000 7f0fc2dea640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0fbc111da0 con 0x7f0fbc101080 2024-08-19T00:14:41.233 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.229+0000 7f0fc0b86640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0fbc1006e0 0x7f0fbc10e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:41.233 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.229+0000 7f0fc0b86640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0fbc1006e0 0x7f0fbc10e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59562/0 (socket says 172.21.15.44:59562) 2024-08-19T00:14:41.233 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.229+0000 7f0fc0b86640 1 -- 172.21.15.44:0/3274814518 learned_addr learned my addr 172.21.15.44:0/3274814518 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:14:41.233 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.229+0000 7f0fbbfff640 1 --2- 172.21.15.44:0/3274814518 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0fbc101080 0x7f0fbc10e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:41.233 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.229+0000 7f0fc1387640 1 --2- 172.21.15.44:0/3274814518 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0fbc1066f0 0x7f0fbc10eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:41.233 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.229+0000 7f0fc0b86640 1 -- 172.21.15.44:0/3274814518 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0fbc101080 msgr2=0x7f0fbc10e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:41.233 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.229+0000 7f0fc0b86640 1 --2- 172.21.15.44:0/3274814518 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0fbc101080 0x7f0fbc10e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:41.233 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.229+0000 7f0fc0b86640 1 -- 172.21.15.44:0/3274814518 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0fbc1066f0 msgr2=0x7f0fbc10eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:41.233 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.229+0000 7f0fc0b86640 1 --2- 172.21.15.44:0/3274814518 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0fbc1066f0 0x7f0fbc10eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:41.234 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.229+0000 7f0fc0b86640 1 -- 172.21.15.44:0/3274814518 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fbc1a6510 con 0x7f0fbc1006e0 2024-08-19T00:14:41.234 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.229+0000 7f0fc1387640 1 --2- 172.21.15.44:0/3274814518 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0fbc1066f0 0x7f0fbc10eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:14:41.234 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.230+0000 7f0fc0b86640 1 --2- 172.21.15.44:0/3274814518 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0fbc1006e0 0x7f0fbc10e040 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f0fb000d950 tx=0x7f0fb000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:14:41.234 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.230+0000 7f0fb9ffb640 1 -- 172.21.15.44:0/3274814518 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb0017070 con 0x7f0fbc1006e0 2024-08-19T00:14:41.234 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.230+0000 7f0fb9ffb640 1 -- 172.21.15.44:0/3274814518 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0fb0009c30 con 0x7f0fbc1006e0 2024-08-19T00:14:41.234 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.230+0000 7f0fc2dea640 1 -- 172.21.15.44:0/3274814518 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fbc1a6800 con 0x7f0fbc1006e0 2024-08-19T00:14:41.234 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.230+0000 7f0fb9ffb640 1 -- 172.21.15.44:0/3274814518 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb000f6b0 con 0x7f0fbc1006e0 2024-08-19T00:14:41.234 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.230+0000 7f0fc2dea640 1 -- 172.21.15.44:0/3274814518 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fbc1a6da0 con 0x7f0fbc1006e0 2024-08-19T00:14:41.239 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.233+0000 7f0fb9ffb640 1 -- 172.21.15.44:0/3274814518 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 25) ==== 138117+0+0 (secure 0 0 0) 0x7f0fb00109d0 con 0x7f0fbc1006e0 2024-08-19T00:14:41.239 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.233+0000 7f0fc5c85740 1 Processor -- start 2024-08-19T00:14:41.240 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.233+0000 7f0fc5c85740 1 -- start start 2024-08-19T00:14:41.240 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.233+0000 7f0fc5c85740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cc02b427d0 0x55cc02b42bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:41.240 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.233+0000 7f0fc5c85740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc02b430f0 0x55cc02b4d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:41.240 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.233+0000 7f0fc5c85740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cc02b4d990 0x55cc02b4fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:41.240 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.233+0000 7f0fc5c85740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55cc02aa69d0 con 0x55cc02b430f0 2024-08-19T00:14:41.240 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.233+0000 7f0fc5c85740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55cc02a4e820 con 0x55cc02b4d990 2024-08-19T00:14:41.240 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.233+0000 7f0fc5c85740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55cc02aa2990 con 0x55cc02b427d0 2024-08-19T00:14:41.240 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.234+0000 7f0fc0b86640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc02b430f0 0x55cc02b4d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:41.240 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.234+0000 7f0fb9ffb640 1 --2- 172.21.15.44:0/3274814518 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f0fac0a2fd0 0x7f0fac0a5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:41.240 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.234+0000 7f0fc0b86640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc02b430f0 0x55cc02b4d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59568/0 (socket says 172.21.15.44:59568) 2024-08-19T00:14:41.240 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.234+0000 7f0fc0b86640 1 -- 172.21.15.44:0/1175743889 learned_addr learned my addr 172.21.15.44:0/1175743889 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:14:41.240 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.234+0000 7f0fbbfff640 1 --2- 172.21.15.44:0/1175743889 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cc02b4d990 0x55cc02b4fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:41.240 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.234+0000 7f0fc1387640 1 --2- 172.21.15.44:0/3274814518 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f0fac0a2fd0 0x7f0fac0a5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:41.241 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.234+0000 7f0fc1387640 1 --2- 172.21.15.44:0/1175743889 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cc02b427d0 0x55cc02b42bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:41.241 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.234+0000 7f0fb9ffb640 1 -- 172.21.15.44:0/3274814518 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f0fb00cf620 con 0x7f0fbc1006e0 2024-08-19T00:14:41.241 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.234+0000 7f0fc0b86640 1 -- 172.21.15.44:0/1175743889 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cc02b427d0 msgr2=0x55cc02b42bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:14:41.241 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.234+0000 7f0fc0b86640 1 --2- 172.21.15.44:0/1175743889 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cc02b427d0 0x55cc02b42bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:41.241 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.234+0000 7f0fc0b86640 1 -- 172.21.15.44:0/1175743889 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cc02b4d990 msgr2=0x55cc02b4fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:14:41.241 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.234+0000 7f0fc0b86640 1 --2- 172.21.15.44:0/1175743889 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cc02b4d990 0x55cc02b4fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:41.241 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.234+0000 7f0fc0b86640 1 -- 172.21.15.44:0/1175743889 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc027ba210 con 0x55cc02b430f0 2024-08-19T00:14:41.241 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.234+0000 7f0fbbfff640 1 --2- 172.21.15.44:0/1175743889 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cc02b4d990 0x55cc02b4fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:14:41.241 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.234+0000 7f0fc0b86640 1 --2- 172.21.15.44:0/1175743889 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc02b430f0 0x55cc02b4d450 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0010fd0 tx=0x7f0fb000bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e376b37ffe2e1e75 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:14:41.241 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.234+0000 7f0fc1387640 1 --2- 172.21.15.44:0/3274814518 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f0fac0a2fd0 0x7f0fac0a5490 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0fb4005fe0 tx=0x7f0fb4005d80 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:14:41.241 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.234+0000 7f0fa6ffd640 1 -- 172.21.15.44:0/1175743889 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb0020050 con 0x55cc02b430f0 2024-08-19T00:14:41.241 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.234+0000 7f0fa6ffd640 1 -- 172.21.15.44:0/1175743889 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0fb009b560 con 0x55cc02b430f0 2024-08-19T00:14:41.241 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.234+0000 7f0fa6ffd640 1 -- 172.21.15.44:0/1175743889 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb009a9b0 con 0x55cc02b430f0 2024-08-19T00:14:41.241 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.235+0000 7f0fc5c85740 1 -- 172.21.15.44:0/1175743889 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc02b430f0 msgr2=0x55cc02b4d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:41.241 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.235+0000 7f0fc5c85740 1 --2- 172.21.15.44:0/1175743889 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc02b430f0 0x55cc02b4d450 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0010fd0 tx=0x7f0fb000bf60 comp rx=0 tx=0).stop 2024-08-19T00:14:41.242 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.235+0000 7f0fc5c85740 1 -- 172.21.15.44:0/1175743889 shutdown_connections 2024-08-19T00:14:41.242 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.235+0000 7f0fc5c85740 1 --2- 172.21.15.44:0/1175743889 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cc02b4d990 0x55cc02b4fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:41.242 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.235+0000 7f0fc5c85740 1 --2- 172.21.15.44:0/1175743889 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc02b430f0 0x55cc02b4d450 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:41.242 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.235+0000 7f0fc5c85740 1 --2- 172.21.15.44:0/1175743889 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cc02b427d0 0x55cc02b42bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:41.242 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.235+0000 7f0fc5c85740 1 -- 172.21.15.44:0/1175743889 >> 172.21.15.44:0/1175743889 conn(0x55cc02b3ed40 msgr2=0x55cc02b3f120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:14:41.242 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.235+0000 7f0fc5c85740 1 -- 172.21.15.44:0/1175743889 shutdown_connections 2024-08-19T00:14:41.242 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.235+0000 7f0fc5c85740 1 -- 172.21.15.44:0/1175743889 wait complete. 2024-08-19T00:14:41.242 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.236+0000 7f0fc5c85740 1 -- start start 2024-08-19T00:14:41.242 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.236+0000 7f0fc5c85740 1 Processor -- start 2024-08-19T00:14:41.242 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.236+0000 7f0fc5c85740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cc02b427d0 0x55cc02b4a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:41.242 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.236+0000 7f0fc5c85740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cc02b430f0 0x55cc02b4ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:41.242 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.236+0000 7f0fc5c85740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc02b4d990 0x55cc02b4b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:41.242 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.236+0000 7f0fc5c85740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55cc02b50560 con 0x55cc02b4d990 2024-08-19T00:14:41.243 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.236+0000 7f0fc5c85740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55cc02a62520 con 0x55cc02b427d0 2024-08-19T00:14:41.243 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.236+0000 7f0fc5c85740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55cc02b506e0 con 0x55cc02b430f0 2024-08-19T00:14:41.243 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.236+0000 7f0fc5c85740 10 client.0 _ll_register_callbacks cb 0x55cc027b9a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:14:41.243 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.236+0000 7f0fc1387640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc02b4d990 0x55cc02b4b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:41.243 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.236+0000 7f0fc1387640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc02b4d990 0x55cc02b4b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59582/0 (socket says 172.21.15.44:59582) 2024-08-19T00:14:41.243 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.236+0000 7f0fc1387640 1 -- 172.21.15.44:0/3865192294 learned_addr learned my addr 172.21.15.44:0/3865192294 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:14:41.243 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.236+0000 7f0fc0b86640 1 --2- 172.21.15.44:0/3865192294 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cc02b427d0 0x55cc02b4a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:41.243 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.236+0000 7f0fbbfff640 1 --2- 172.21.15.44:0/3865192294 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cc02b430f0 0x55cc02b4ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:41.243 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.237+0000 7f0fc1387640 1 -- 172.21.15.44:0/3865192294 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cc02b430f0 msgr2=0x55cc02b4ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:14:41.243 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.237+0000 7f0fc1387640 1 --2- 172.21.15.44:0/3865192294 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cc02b430f0 0x55cc02b4ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:41.243 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.237+0000 7f0fc1387640 1 -- 172.21.15.44:0/3865192294 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cc02b427d0 msgr2=0x55cc02b4a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:14:41.243 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.237+0000 7f0fc1387640 1 --2- 172.21.15.44:0/3865192294 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cc02b427d0 0x55cc02b4a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:41.244 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.237+0000 7f0fc1387640 1 -- 172.21.15.44:0/3865192294 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc02886620 con 0x55cc02b4d990 2024-08-19T00:14:41.244 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.237+0000 7f0fc0b86640 1 --2- 172.21.15.44:0/3865192294 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cc02b427d0 0x55cc02b4a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:14:41.244 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.237+0000 7f0fc1387640 1 --2- 172.21.15.44:0/3865192294 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc02b4d990 0x55cc02b4b380 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f0fb4003bf0 tx=0x7f0fb40095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad904b29822eb5b8 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:14:41.244 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.237+0000 7f0f9bfff640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:14:41.244 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.237+0000 7f0f9bfff640 1 -- 172.21.15.44:0/3865192294 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb404d070 con 0x55cc02b4d990 2024-08-19T00:14:41.244 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.237+0000 7f0f9bfff640 1 -- 172.21.15.44:0/3865192294 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f0fb4004450 con 0x55cc02b4d990 2024-08-19T00:14:41.244 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.237+0000 7f0fc5c85740 1 -- 172.21.15.44:0/3865192294 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0fb009b560 con 0x55cc02b4d990 2024-08-19T00:14:41.244 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.237+0000 7f0f9bfff640 1 -- 172.21.15.44:0/3865192294 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0fb4004650 con 0x55cc02b4d990 2024-08-19T00:14:41.244 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.237+0000 7f0fc5c85740 10 client.15696 fetch_fsmap learned FSMap version 29 2024-08-19T00:14:41.244 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.237+0000 7f0fc5c85740 1 -- 172.21.15.44:0/3865192294 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55cc02b5c210 con 0x55cc02b4d990 2024-08-19T00:14:41.244 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.237+0000 7f0f9bfff640 1 -- 172.21.15.44:0/3865192294 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0fb009b560 con 0x55cc02b4d990 2024-08-19T00:14:41.244 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.237+0000 7f0f9bfff640 1 -- 172.21.15.44:0/3865192294 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 29) ==== 8378+0+0 (secure 0 0 0) 0x7f0fb4030070 con 0x55cc02b4d990 2024-08-19T00:14:41.244 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.237+0000 7f0fc5c85740 10 client.15696 fetch_fsmap finished waiting for FSMap version 29 2024-08-19T00:14:41.244 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.237+0000 7f0fc5c85740 10 client.15696 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:14:41.245 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.237+0000 7f0fc5c85740 20 client.15696 populate_metadata read hostname 'smithi044' 2024-08-19T00:14:41.245 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.238+0000 7f0fc5c85740 1 --2- 172.21.15.44:0/3865192294 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55cc02b5d720 0x55cc02b5fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:41.245 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.238+0000 7f0fc5c85740 4 client.15696 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:14:41.245 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.238+0000 7f0fc5c85740 1 -- 172.21.15.44:0/3865192294 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cc02ab4100 con 0x55cc02b5d720 2024-08-19T00:14:41.245 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.238+0000 7f0fc0b86640 1 --2- 172.21.15.44:0/3865192294 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55cc02b5d720 0x55cc02b5fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:41.245 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.238+0000 7f0f9bfff640 10 client.15696 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:14:41.245 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.238+0000 7f0fc0b86640 1 --2- 172.21.15.44:0/3865192294 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55cc02b5d720 0x55cc02b5fb40 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca8b14e537e89971 server_cookie=8c225d3b97a6c0fc in_seq=0 out_seq=0 2024-08-19T00:14:41.246 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.239+0000 7f0f9bfff640 1 -- 172.21.15.44:0/3865192294 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cc02ab4100 con 0x55cc02b5d720 2024-08-19T00:14:41.246 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.239+0000 7f0f9bfff640 10 client.15696 handle_command_reply: tid=0 2024-08-19T00:14:41.246 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.239+0000 7f0fc5c85740 1 client.15696 shutdown 2024-08-19T00:14:41.246 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.239+0000 7f0fc5c85740 1 -- 172.21.15.44:0/3865192294 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc02b4d990 msgr2=0x55cc02b4b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:41.246 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.239+0000 7f0fc5c85740 1 --2- 172.21.15.44:0/3865192294 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc02b4d990 0x55cc02b4b380 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f0fb4003bf0 tx=0x7f0fb40095c0 comp rx=0 tx=0).stop 2024-08-19T00:14:41.246 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.239+0000 7f0fc5c85740 1 -- 172.21.15.44:0/3865192294 shutdown_connections 2024-08-19T00:14:41.246 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.239+0000 7f0fc5c85740 1 --2- 172.21.15.44:0/3865192294 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55cc02b5d720 0x55cc02b5fb40 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:41.247 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.239+0000 7f0fc5c85740 1 --2- 172.21.15.44:0/3865192294 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cc02b430f0 0x55cc02b4ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:41.247 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.239+0000 7f0fc5c85740 1 --2- 172.21.15.44:0/3865192294 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc02b4d990 0x55cc02b4b380 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:41.247 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.239+0000 7f0fc5c85740 1 --2- 172.21.15.44:0/3865192294 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cc02b427d0 0x55cc02b4a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:41.247 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.239+0000 7f0f9bfff640 0 client.15696 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:14:41.247 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.239+0000 7f0fc5c85740 1 -- 172.21.15.44:0/3865192294 >> 172.21.15.44:0/3865192294 conn(0x55cc02b3ed40 msgr2=0x55cc02b44a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:14:41.247 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.239+0000 7f0fc5c85740 1 -- 172.21.15.44:0/3865192294 shutdown_connections 2024-08-19T00:14:41.247 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.239+0000 7f0fc5c85740 1 -- 172.21.15.44:0/3865192294 wait complete. 2024-08-19T00:14:41.247 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.239+0000 7f0fc5c85740 20 client.15696 trim_cache size 0 max 16384 2024-08-19T00:14:41.259 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.254+0000 7f0fc5c85740 1 Processor -- start 2024-08-19T00:14:41.259 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.254+0000 7f0fc5c85740 1 -- start start 2024-08-19T00:14:41.259 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.254+0000 7f0fc5c85740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cc02b427d0 0x55cc02b44940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:41.260 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.254+0000 7f0fc5c85740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cc02b430f0 0x55cc02b65450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:41.260 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.254+0000 7f0fc5c85740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc02b4d990 0x55cc02b65990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:41.260 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.254+0000 7f0fc5c85740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0fbc1b0e50 con 0x55cc02b4d990 2024-08-19T00:14:41.260 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.254+0000 7f0fc5c85740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f0fbc1b29f0 con 0x55cc02b427d0 2024-08-19T00:14:41.260 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.254+0000 7f0fc5c85740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0fbc1b1520 con 0x55cc02b430f0 2024-08-19T00:14:41.260 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.254+0000 7f0fc1387640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc02b4d990 0x55cc02b65990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:41.260 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.254+0000 7f0fc1387640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc02b4d990 0x55cc02b65990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59586/0 (socket says 172.21.15.44:59586) 2024-08-19T00:14:41.260 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.254+0000 7f0fc1387640 1 -- 172.21.15.44:0/3454843826 learned_addr learned my addr 172.21.15.44:0/3454843826 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:14:41.260 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.254+0000 7f0fc0b86640 1 --2- 172.21.15.44:0/3454843826 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cc02b427d0 0x55cc02b44940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:41.260 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.254+0000 7f0fc1387640 1 -- 172.21.15.44:0/3454843826 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cc02b430f0 msgr2=0x55cc02b65450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:14:41.260 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.254+0000 7f0fc1387640 1 --2- 172.21.15.44:0/3454843826 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cc02b430f0 0x55cc02b65450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:41.260 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.254+0000 7f0fc1387640 1 -- 172.21.15.44:0/3454843826 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cc02b427d0 msgr2=0x55cc02b44940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:14:41.260 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.254+0000 7f0fc1387640 1 --2- 172.21.15.44:0/3454843826 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cc02b427d0 0x55cc02b44940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:41.261 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.254+0000 7f0fc1387640 1 -- 172.21.15.44:0/3454843826 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc02b4d3b0 con 0x55cc02b4d990 2024-08-19T00:14:41.261 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.254+0000 7f0fc1387640 1 --2- 172.21.15.44:0/3454843826 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc02b4d990 0x55cc02b65990 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f0fb4031eb0 tx=0x7f0fb4009630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bd15665a9bb96dc server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:14:41.261 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.255+0000 7f0fa67fc640 1 -- 172.21.15.44:0/3454843826 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb404d050 con 0x55cc02b4d990 2024-08-19T00:14:41.261 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.255+0000 7f0fa67fc640 1 -- 172.21.15.44:0/3454843826 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0fb4063070 con 0x55cc02b4d990 2024-08-19T00:14:41.261 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.255+0000 7f0fa67fc640 1 -- 172.21.15.44:0/3454843826 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb4030a00 con 0x55cc02b4d990 2024-08-19T00:14:41.261 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.255+0000 7f0fc5c85740 1 -- 172.21.15.44:0/3454843826 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc02b4d990 msgr2=0x55cc02b65990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:41.261 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.255+0000 7f0fc5c85740 1 --2- 172.21.15.44:0/3454843826 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc02b4d990 0x55cc02b65990 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f0fb4031eb0 tx=0x7f0fb4009630 comp rx=0 tx=0).stop 2024-08-19T00:14:41.261 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.255+0000 7f0fc5c85740 1 -- 172.21.15.44:0/3454843826 shutdown_connections 2024-08-19T00:14:41.261 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.255+0000 7f0fc5c85740 1 --2- 172.21.15.44:0/3454843826 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cc02b430f0 0x55cc02b65450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:41.261 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.255+0000 7f0fc5c85740 1 --2- 172.21.15.44:0/3454843826 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc02b4d990 0x55cc02b65990 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:41.261 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.255+0000 7f0fc5c85740 1 --2- 172.21.15.44:0/3454843826 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cc02b427d0 0x55cc02b44940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:41.261 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.255+0000 7f0fc5c85740 1 -- 172.21.15.44:0/3454843826 >> 172.21.15.44:0/3454843826 conn(0x55cc02b3ed40 msgr2=0x55cc02b44230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:14:41.261 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.255+0000 7f0fc5c85740 1 -- 172.21.15.44:0/3454843826 shutdown_connections 2024-08-19T00:14:41.261 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.255+0000 7f0fc5c85740 1 -- 172.21.15.44:0/3454843826 wait complete. 2024-08-19T00:14:41.262 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.255+0000 7f0fc5c85740 1 -- start start 2024-08-19T00:14:41.262 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.256+0000 7f0fc5c85740 1 Processor -- start 2024-08-19T00:14:41.262 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.256+0000 7f0fc5c85740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cc02b427d0 0x55cc02b561b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:41.262 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.256+0000 7f0fc5c85740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc02b430f0 0x55cc02b514d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:41.262 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.256+0000 7f0fc5c85740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cc02b4d990 0x55cc02b51ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:41.262 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.256+0000 7f0fc5c85740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0fbc1b22c0 con 0x55cc02b430f0 2024-08-19T00:14:41.262 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.256+0000 7f0fc5c85740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f0fbc1b1bf0 con 0x55cc02b4d990 2024-08-19T00:14:41.262 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.256+0000 7f0fc5c85740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0fbc1aee30 con 0x55cc02b427d0 2024-08-19T00:14:41.262 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.256+0000 7f0fc5c85740 10 client.0 _ll_register_callbacks cb 0x7f0fb4009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:14:41.262 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.256+0000 7f0fbbfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc02b430f0 0x55cc02b514d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:41.262 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.256+0000 7f0fbbfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc02b430f0 0x55cc02b514d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59594/0 (socket says 172.21.15.44:59594) 2024-08-19T00:14:41.262 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.256+0000 7f0fbbfff640 1 -- 172.21.15.44:0/2027592815 learned_addr learned my addr 172.21.15.44:0/2027592815 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:14:41.262 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.256+0000 7f0fc1387640 1 --2- 172.21.15.44:0/2027592815 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cc02b4d990 0x55cc02b51ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:41.262 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.256+0000 7f0fc0b86640 1 --2- 172.21.15.44:0/2027592815 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cc02b427d0 0x55cc02b561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:41.263 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.256+0000 7f0fbbfff640 1 -- 172.21.15.44:0/2027592815 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cc02b427d0 msgr2=0x55cc02b561b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:14:41.263 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.256+0000 7f0fbbfff640 1 --2- 172.21.15.44:0/2027592815 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cc02b427d0 0x55cc02b561b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:41.263 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.256+0000 7f0fbbfff640 1 -- 172.21.15.44:0/2027592815 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cc02b4d990 msgr2=0x55cc02b51ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:14:41.263 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.256+0000 7f0fbbfff640 1 --2- 172.21.15.44:0/2027592815 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cc02b4d990 0x55cc02b51ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:41.263 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.256+0000 7f0fbbfff640 1 -- 172.21.15.44:0/2027592815 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc02b522c0 con 0x55cc02b430f0 2024-08-19T00:14:41.263 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.256+0000 7f0fc0b86640 1 --2- 172.21.15.44:0/2027592815 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cc02b427d0 0x55cc02b561b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:14:41.263 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.256+0000 7f0fc1387640 1 --2- 172.21.15.44:0/2027592815 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cc02b4d990 0x55cc02b51ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:14:41.263 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.257+0000 7f0fbbfff640 1 --2- 172.21.15.44:0/2027592815 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc02b430f0 0x55cc02b514d0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f0fa8005d00 tx=0x7f0fa8011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c7913072fc1534 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:14:41.263 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.257+0000 7f0f9bfff640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:14:41.263 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.257+0000 7f0f9bfff640 1 -- 172.21.15.44:0/2027592815 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fa8004020 con 0x55cc02b430f0 2024-08-19T00:14:41.263 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.257+0000 7f0f9bfff640 1 -- 172.21.15.44:0/2027592815 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f0fa80041c0 con 0x55cc02b430f0 2024-08-19T00:14:41.263 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.257+0000 7f0fc5c85740 1 -- 172.21.15.44:0/2027592815 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0fb4063070 con 0x55cc02b430f0 2024-08-19T00:14:41.263 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.257+0000 7f0f9bfff640 1 -- 172.21.15.44:0/2027592815 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0fa8028050 con 0x55cc02b430f0 2024-08-19T00:14:41.263 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.257+0000 7f0fc5c85740 10 client.15702 fetch_fsmap learned FSMap version 29 2024-08-19T00:14:41.263 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.257+0000 7f0fc5c85740 1 -- 172.21.15.44:0/2027592815 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55cc02bc85a0 con 0x55cc02b430f0 2024-08-19T00:14:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.257+0000 7f0f9bfff640 1 -- 172.21.15.44:0/2027592815 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0fb4063070 con 0x55cc02b430f0 2024-08-19T00:14:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.257+0000 7f0f9bfff640 1 -- 172.21.15.44:0/2027592815 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 29) ==== 8378+0+0 (secure 0 0 0) 0x7f0fa8003980 con 0x55cc02b430f0 2024-08-19T00:14:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.257+0000 7f0fc5c85740 10 client.15702 fetch_fsmap finished waiting for FSMap version 29 2024-08-19T00:14:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.257+0000 7f0fc5c85740 10 client.15702 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:14:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.257+0000 7f0fc5c85740 20 client.15702 populate_metadata read hostname 'smithi044' 2024-08-19T00:14:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.257+0000 7f0fc5c85740 1 --2- 172.21.15.44:0/2027592815 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55cc02bc8e30 0x55cc02bcb250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.257+0000 7f0fc5c85740 4 client.15702 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-19T00:14:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.257+0000 7f0fc5c85740 1 -- 172.21.15.44:0/2027592815 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cc02aae450 con 0x55cc02bc8e30 2024-08-19T00:14:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.258+0000 7f0fc0b86640 1 --2- 172.21.15.44:0/2027592815 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55cc02bc8e30 0x55cc02bcb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.258+0000 7f0fc0b86640 1 --2- 172.21.15.44:0/2027592815 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55cc02bc8e30 0x55cc02bcb250 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae42e65f9b3c360b server_cookie=d1b33aad54d9263e in_seq=0 out_seq=0 2024-08-19T00:14:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.258+0000 7f0f9bfff640 10 client.15702 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:14:41.338 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.336+0000 7f0f9bfff640 1 -- 172.21.15.44:0/2027592815 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cc02aae450 con 0x55cc02bc8e30 2024-08-19T00:14:41.338 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.336+0000 7f0f9bfff640 10 client.15702 handle_command_reply: tid=0 2024-08-19T00:14:41.338 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.336+0000 7f0fc5c85740 1 client.15702 shutdown 2024-08-19T00:14:41.338 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.336+0000 7f0fc5c85740 1 -- 172.21.15.44:0/2027592815 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc02b430f0 msgr2=0x55cc02b514d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:41.338 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.336+0000 7f0fc5c85740 1 --2- 172.21.15.44:0/2027592815 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc02b430f0 0x55cc02b514d0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f0fa8005d00 tx=0x7f0fa8011920 comp rx=0 tx=0).stop 2024-08-19T00:14:41.338 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.336+0000 7f0fc5c85740 1 -- 172.21.15.44:0/2027592815 shutdown_connections 2024-08-19T00:14:41.338 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.336+0000 7f0fc5c85740 1 --2- 172.21.15.44:0/2027592815 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55cc02bc8e30 0x55cc02bcb250 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:41.339 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.336+0000 7f0fc5c85740 1 --2- 172.21.15.44:0/2027592815 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cc02b4d990 0x55cc02b51ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:41.339 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.336+0000 7f0f9bfff640 0 client.15702 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:14:41.339 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.336+0000 7f0fc5c85740 1 --2- 172.21.15.44:0/2027592815 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cc02b430f0 0x55cc02b514d0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:41.339 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.336+0000 7f0fc5c85740 1 --2- 172.21.15.44:0/2027592815 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cc02b427d0 0x55cc02b561b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:41.339 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.336+0000 7f0fc5c85740 1 -- 172.21.15.44:0/2027592815 >> 172.21.15.44:0/2027592815 conn(0x55cc02b3ed40 msgr2=0x55cc02b44a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:14:41.339 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.336+0000 7f0fc5c85740 1 -- 172.21.15.44:0/2027592815 shutdown_connections 2024-08-19T00:14:41.339 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.336+0000 7f0fc5c85740 1 -- 172.21.15.44:0/2027592815 wait complete. 2024-08-19T00:14:41.339 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.337+0000 7f0fc5c85740 20 client.15702 trim_cache size 0 max 16384 2024-08-19T00:14:41.339 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:{ 2024-08-19T00:14:41.339 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "message": "", 2024-08-19T00:14:41.339 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "return_code": 0 2024-08-19T00:14:41.340 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:} 2024-08-19T00:14:41.340 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.337+0000 7f0fc2dea640 1 -- 172.21.15.44:0/3274814518 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f0fac0a2fd0 msgr2=0x7f0fac0a5490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:41.340 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.337+0000 7f0fc2dea640 1 --2- 172.21.15.44:0/3274814518 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f0fac0a2fd0 0x7f0fac0a5490 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0fb4005fe0 tx=0x7f0fb4005d80 comp rx=0 tx=0).stop 2024-08-19T00:14:41.340 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.337+0000 7f0fc2dea640 1 -- 172.21.15.44:0/3274814518 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0fbc1006e0 msgr2=0x7f0fbc10e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:41.340 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.337+0000 7f0fc2dea640 1 --2- 172.21.15.44:0/3274814518 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0fbc1006e0 0x7f0fbc10e040 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f0fb000d950 tx=0x7f0fb000de10 comp rx=0 tx=0).stop 2024-08-19T00:14:41.340 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.337+0000 7f0fc2dea640 1 -- 172.21.15.44:0/3274814518 shutdown_connections 2024-08-19T00:14:41.341 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.337+0000 7f0fc2dea640 1 --2- 172.21.15.44:0/3274814518 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f0fac0a2fd0 0x7f0fac0a5490 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:41.341 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.337+0000 7f0fc2dea640 1 --2- 172.21.15.44:0/3274814518 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0fbc101080 0x7f0fbc10e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:41.341 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.337+0000 7f0fc2dea640 1 --2- 172.21.15.44:0/3274814518 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0fbc1066f0 0x7f0fbc10eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:41.341 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.337+0000 7f0fc2dea640 1 --2- 172.21.15.44:0/3274814518 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0fbc1006e0 0x7f0fbc10e040 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:41.341 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.337+0000 7f0fc2dea640 1 -- 172.21.15.44:0/3274814518 >> 172.21.15.44:0/3274814518 conn(0x7f0fbc0776c0 msgr2=0x7f0fbc0fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:14:41.341 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.337+0000 7f0fc2dea640 1 -- 172.21.15.44:0/3274814518 shutdown_connections 2024-08-19T00:14:41.341 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:41.337+0000 7f0fc2dea640 1 -- 172.21.15.44:0/3274814518 wait complete. 2024-08-19T00:14:41.647 INFO:tasks.workunit.client.0.smithi044.stdout: 1 5960 7.85 MB/sec warmup 6 sec latency 2805.240 ms 2024-08-19T00:14:42.171 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:14:41 smithi044 ceph-mon[18489]: pgmap v44: 129 pgs: 129 active+clean; 4.5 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 318 KiB/s wr, 50 op/s 2024-08-19T00:14:42.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:14:41 smithi171 ceph-mon[21810]: pgmap v44: 129 pgs: 129 active+clean; 4.5 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 318 KiB/s wr, 50 op/s 2024-08-19T00:14:42.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:14:41 smithi116 ceph-mon[21873]: pgmap v44: 129 pgs: 129 active+clean; 4.5 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 318 KiB/s wr, 50 op/s 2024-08-19T00:14:42.647 INFO:tasks.workunit.client.0.smithi044.stdout: 1 6049 6.83 MB/sec warmup 7 sec latency 1374.900 ms 2024-08-19T00:14:43.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:14:42 smithi171 ceph-mon[21810]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-19T00:14:43.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:14:42 smithi116 ceph-mon[21873]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-19T00:14:43.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:14:42 smithi044 ceph-mon[18489]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-19T00:14:43.647 INFO:tasks.workunit.client.0.smithi044.stdout: 1 6049 5.98 MB/sec warmup 8 sec latency 1358.967 ms 2024-08-19T00:14:44.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:14:43 smithi171 ceph-mon[21810]: pgmap v45: 129 pgs: 129 active+clean; 4.5 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 317 KiB/s wr, 45 op/s 2024-08-19T00:14:44.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:14:43 smithi116 ceph-mon[21873]: pgmap v45: 129 pgs: 129 active+clean; 4.5 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 317 KiB/s wr, 45 op/s 2024-08-19T00:14:44.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:14:43 smithi044 ceph-mon[18489]: pgmap v45: 129 pgs: 129 active+clean; 4.5 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 317 KiB/s wr, 45 op/s 2024-08-19T00:14:44.647 INFO:tasks.workunit.client.0.smithi044.stdout: 1 6049 5.32 MB/sec warmup 9 sec latency 2359.058 ms 2024-08-19T00:14:45.647 INFO:tasks.workunit.client.0.smithi044.stdout: 1 6049 4.78 MB/sec warmup 10 sec latency 3359.100 ms 2024-08-19T00:14:46.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:14:45 smithi171 ceph-mon[21810]: pgmap v46: 129 pgs: 129 active+clean; 27 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 2.2 MiB/s wr, 81 op/s 2024-08-19T00:14:46.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:14:45 smithi116 ceph-mon[21873]: pgmap v46: 129 pgs: 129 active+clean; 27 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 2.2 MiB/s wr, 81 op/s 2024-08-19T00:14:46.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:14:45 smithi044 ceph-mon[18489]: pgmap v46: 129 pgs: 129 active+clean; 27 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 2.2 MiB/s wr, 81 op/s 2024-08-19T00:14:46.647 INFO:tasks.workunit.client.0.smithi044.stdout: 1 6049 4.35 MB/sec warmup 11 sec latency 4359.191 ms 2024-08-19T00:14:47.647 INFO:tasks.workunit.client.0.smithi044.stdout: 1 7352 4.91 MB/sec warmup 12 sec latency 4920.453 ms 2024-08-19T00:14:48.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:14:47 smithi171 ceph-mon[21810]: pgmap v47: 129 pgs: 129 active+clean; 27 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 2.2 MiB/s wr, 76 op/s 2024-08-19T00:14:48.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:14:47 smithi116 ceph-mon[21873]: pgmap v47: 129 pgs: 129 active+clean; 27 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 2.2 MiB/s wr, 76 op/s 2024-08-19T00:14:48.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:14:47 smithi044 ceph-mon[18489]: pgmap v47: 129 pgs: 129 active+clean; 27 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 2.2 MiB/s wr, 76 op/s 2024-08-19T00:14:48.647 INFO:tasks.workunit.client.0.smithi044.stdout: 1 9438 5.08 MB/sec warmup 13 sec latency 243.266 ms 2024-08-19T00:14:49.648 INFO:tasks.workunit.client.0.smithi044.stdout: 1 9492 4.73 MB/sec warmup 14 sec latency 880.416 ms 2024-08-19T00:14:50.166 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:14:49 smithi171 ceph-mon[21810]: pgmap v48: 129 pgs: 129 active+clean; 27 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 2.2 MiB/s wr, 76 op/s 2024-08-19T00:14:50.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:14:49 smithi116 ceph-mon[21873]: pgmap v48: 129 pgs: 129 active+clean; 27 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 2.2 MiB/s wr, 76 op/s 2024-08-19T00:14:50.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:14:49 smithi044 ceph-mon[18489]: pgmap v48: 129 pgs: 129 active+clean; 27 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 2.2 MiB/s wr, 76 op/s 2024-08-19T00:14:50.648 INFO:tasks.workunit.client.0.smithi044.stdout: 1 9492 4.41 MB/sec warmup 15 sec latency 1880.538 ms 2024-08-19T00:14:51.648 INFO:tasks.workunit.client.0.smithi044.stdout: 1 9492 4.14 MB/sec warmup 16 sec latency 2880.639 ms 2024-08-19T00:14:52.168 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:14:51 smithi116 ceph-mon[21873]: pgmap v49: 129 pgs: 129 active+clean; 26 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 2.4 MiB/s wr, 116 op/s 2024-08-19T00:14:52.168 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:14:51 smithi116 ceph-mon[21873]: mgrmap e26: x(active, since 92s), standbys: z, y 2024-08-19T00:14:52.225 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:14:51 smithi044 ceph-mon[18489]: pgmap v49: 129 pgs: 129 active+clean; 26 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 2.4 MiB/s wr, 116 op/s 2024-08-19T00:14:52.225 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:14:51 smithi044 ceph-mon[18489]: mgrmap e26: x(active, since 92s), standbys: z, y 2024-08-19T00:14:52.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:14:51 smithi171 ceph-mon[21810]: pgmap v49: 129 pgs: 129 active+clean; 26 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 2.4 MiB/s wr, 116 op/s 2024-08-19T00:14:52.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:14:51 smithi171 ceph-mon[21810]: mgrmap e26: x(active, since 92s), standbys: z, y 2024-08-19T00:14:52.648 INFO:tasks.workunit.client.0.smithi044.stdout: 1 9532 3.90 MB/sec warmup 17 sec latency 3445.848 ms 2024-08-19T00:14:53.648 INFO:tasks.workunit.client.0.smithi044.stdout: 1 9532 3.69 MB/sec warmup 18 sec latency 1398.112 ms 2024-08-19T00:14:54.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:14:53 smithi171 ceph-mon[21810]: pgmap v50: 129 pgs: 129 active+clean; 26 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 2.1 MiB/s wr, 75 op/s 2024-08-19T00:14:54.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:14:53 smithi116 ceph-mon[21873]: pgmap v50: 129 pgs: 129 active+clean; 26 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 2.1 MiB/s wr, 75 op/s 2024-08-19T00:14:54.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:14:53 smithi044 ceph-mon[18489]: pgmap v50: 129 pgs: 129 active+clean; 26 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 2.1 MiB/s wr, 75 op/s 2024-08-19T00:14:54.438 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.436+0000 7f11490c4640 1 -- 172.21.15.44:0/1086303814 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1144106730 msgr2=0x7f1144106b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:54.438 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.436+0000 7f11490c4640 1 --2- 172.21.15.44:0/1086303814 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1144106730 0x7f1144106b10 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f1134009930 tx=0x7f113402a420 comp rx=0 tx=0).stop 2024-08-19T00:14:54.438 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.436+0000 7f11490c4640 1 -- 172.21.15.44:0/1086303814 shutdown_connections 2024-08-19T00:14:54.438 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.436+0000 7f11490c4640 1 --2- 172.21.15.44:0/1086303814 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f11441010c0 0x7f114410d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:54.438 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.436+0000 7f11490c4640 1 --2- 172.21.15.44:0/1086303814 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1144100720 0x7f1144100b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:54.438 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.436+0000 7f11490c4640 1 --2- 172.21.15.44:0/1086303814 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1144106730 0x7f1144106b10 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:54.439 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.436+0000 7f11490c4640 1 -- 172.21.15.44:0/1086303814 >> 172.21.15.44:0/1086303814 conn(0x7f11440fc3e0 msgr2=0x7f11440fe800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:14:54.439 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.436+0000 7f11490c4640 1 -- 172.21.15.44:0/1086303814 shutdown_connections 2024-08-19T00:14:54.439 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.436+0000 7f11490c4640 1 -- 172.21.15.44:0/1086303814 wait complete. 2024-08-19T00:14:54.439 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.437+0000 7f11490c4640 1 Processor -- start 2024-08-19T00:14:54.441 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.437+0000 7f11490c4640 1 -- start start 2024-08-19T00:14:54.441 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.437+0000 7f11490c4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1144100720 0x7f1144198030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:54.441 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.437+0000 7f11490c4640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f11441010c0 0x7f1144198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:54.442 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.437+0000 7f11490c4640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1144106730 0x7f114419c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:54.442 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.437+0000 7f11490c4640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1144111c60 con 0x7f1144100720 2024-08-19T00:14:54.442 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.437+0000 7f11490c4640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f1144111ae0 con 0x7f11441010c0 2024-08-19T00:14:54.442 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.437+0000 7f11490c4640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1144111de0 con 0x7f1144106730 2024-08-19T00:14:54.442 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.438+0000 7f1142d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1144100720 0x7f1144198030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:54.442 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.438+0000 7f1142d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1144100720 0x7f1144198030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58602/0 (socket says 172.21.15.44:58602) 2024-08-19T00:14:54.442 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.438+0000 7f1142d9d640 1 -- 172.21.15.44:0/4011398100 learned_addr learned my addr 172.21.15.44:0/4011398100 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:14:54.442 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.438+0000 7f114259c640 1 --2- 172.21.15.44:0/4011398100 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f11441010c0 0x7f1144198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:54.442 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.438+0000 7f114359e640 1 --2- 172.21.15.44:0/4011398100 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1144106730 0x7f114419c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:54.442 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.438+0000 7f1142d9d640 1 -- 172.21.15.44:0/4011398100 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1144106730 msgr2=0x7f114419c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:54.443 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.438+0000 7f1142d9d640 1 --2- 172.21.15.44:0/4011398100 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1144106730 0x7f114419c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:54.443 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.438+0000 7f1142d9d640 1 -- 172.21.15.44:0/4011398100 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f11441010c0 msgr2=0x7f1144198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:54.443 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.438+0000 7f1142d9d640 1 --2- 172.21.15.44:0/4011398100 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f11441010c0 0x7f1144198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:54.443 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.438+0000 7f1142d9d640 1 -- 172.21.15.44:0/4011398100 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f114419d020 con 0x7f1144100720 2024-08-19T00:14:54.443 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.438+0000 7f114359e640 1 --2- 172.21.15.44:0/4011398100 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1144106730 0x7f114419c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:14:54.443 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.438+0000 7f1142d9d640 1 --2- 172.21.15.44:0/4011398100 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1144100720 0x7f1144198030 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f1134009230 tx=0x7f1134004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:14:54.443 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.438+0000 7f112bfff640 1 -- 172.21.15.44:0/4011398100 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f113403f030 con 0x7f1144100720 2024-08-19T00:14:54.443 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.438+0000 7f11490c4640 1 -- 172.21.15.44:0/4011398100 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f114419d2b0 con 0x7f1144100720 2024-08-19T00:14:54.443 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.438+0000 7f112bfff640 1 -- 172.21.15.44:0/4011398100 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1134003ad0 con 0x7f1144100720 2024-08-19T00:14:54.443 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.438+0000 7f112bfff640 1 -- 172.21.15.44:0/4011398100 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1134035070 con 0x7f1144100720 2024-08-19T00:14:54.443 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.438+0000 7f11490c4640 1 -- 172.21.15.44:0/4011398100 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11441a4ba0 con 0x7f1144100720 2024-08-19T00:14:54.450 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.441+0000 7f112bfff640 1 -- 172.21.15.44:0/4011398100 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f1134042030 con 0x7f1144100720 2024-08-19T00:14:54.450 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.441+0000 7f114be83740 1 Processor -- start 2024-08-19T00:14:54.450 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.441+0000 7f114be83740 1 -- start start 2024-08-19T00:14:54.450 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.442+0000 7f112bfff640 1 --2- 172.21.15.44:0/4011398100 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f112c0a2da0 0x7f112c0a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:54.450 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.442+0000 7f114be83740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561172c117d0 0x561172c11bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:54.450 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.442+0000 7f114be83740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561172c120f0 0x561172c1c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:54.451 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.442+0000 7f114be83740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561172c1c990 0x561172c1ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:54.451 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.442+0000 7f114be83740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561172b759d0 con 0x561172c117d0 2024-08-19T00:14:54.451 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.442+0000 7f114be83740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x561172b1d820 con 0x561172c1c990 2024-08-19T00:14:54.451 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.442+0000 7f114be83740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x561172b71990 con 0x561172c120f0 2024-08-19T00:14:54.451 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.442+0000 7f1142d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561172c117d0 0x561172c11bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:54.451 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.442+0000 7f114359e640 1 --2- 172.21.15.44:0/4011398100 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f112c0a2da0 0x7f112c0a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:54.451 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.442+0000 7f1142d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561172c117d0 0x561172c11bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58612/0 (socket says 172.21.15.44:58612) 2024-08-19T00:14:54.451 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.442+0000 7f1142d9d640 1 -- 172.21.15.44:0/2847500872 learned_addr learned my addr 172.21.15.44:0/2847500872 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:14:54.451 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.442+0000 7f112bfff640 1 -- 172.21.15.44:0/4011398100 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f11340efda0 con 0x7f1144100720 2024-08-19T00:14:54.451 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.442+0000 7f114259c640 1 --2- 172.21.15.44:0/2847500872 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561172c120f0 0x561172c1c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:54.452 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.442+0000 7f1142d9d640 1 -- 172.21.15.44:0/2847500872 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561172c120f0 msgr2=0x561172c1c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:14:54.452 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.442+0000 7f1142d9d640 1 --2- 172.21.15.44:0/2847500872 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561172c120f0 0x561172c1c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:54.452 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.442+0000 7f1142d9d640 1 -- 172.21.15.44:0/2847500872 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561172c1c990 msgr2=0x561172c1ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:14:54.452 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.442+0000 7f1142d9d640 1 --2- 172.21.15.44:0/2847500872 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561172c1c990 0x561172c1ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:54.452 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.442+0000 7f1142d9d640 1 -- 172.21.15.44:0/2847500872 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561172889210 con 0x561172c117d0 2024-08-19T00:14:54.452 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.442+0000 7f114259c640 1 --2- 172.21.15.44:0/2847500872 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561172c120f0 0x561172c1c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:14:54.452 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.442+0000 7f114359e640 1 --2- 172.21.15.44:0/4011398100 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f112c0a2da0 0x7f112c0a5260 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f113c005c40 tx=0x7f113c0097a0 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:14:54.452 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.442+0000 7f1142d9d640 1 --2- 172.21.15.44:0/2847500872 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561172c117d0 0x561172c11bb0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f11340bbeb0 tx=0x7f113408bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=150dc838a3712114 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:14:54.452 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.443+0000 7f11297fa640 1 -- 172.21.15.44:0/2847500872 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1134049050 con 0x561172c117d0 2024-08-19T00:14:54.452 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.443+0000 7f11297fa640 1 -- 172.21.15.44:0/2847500872 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f11340bc620 con 0x561172c117d0 2024-08-19T00:14:54.452 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.443+0000 7f11297fa640 1 -- 172.21.15.44:0/2847500872 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11340bbf20 con 0x561172c117d0 2024-08-19T00:14:54.453 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.443+0000 7f114be83740 1 -- 172.21.15.44:0/2847500872 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561172c117d0 msgr2=0x561172c11bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:54.453 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.443+0000 7f114be83740 1 --2- 172.21.15.44:0/2847500872 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561172c117d0 0x561172c11bb0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f11340bbeb0 tx=0x7f113408bd80 comp rx=0 tx=0).stop 2024-08-19T00:14:54.453 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.443+0000 7f114be83740 1 -- 172.21.15.44:0/2847500872 shutdown_connections 2024-08-19T00:14:54.453 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.443+0000 7f114be83740 1 --2- 172.21.15.44:0/2847500872 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561172c120f0 0x561172c1c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:54.453 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.443+0000 7f114be83740 1 --2- 172.21.15.44:0/2847500872 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561172c1c990 0x561172c1ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:54.453 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.443+0000 7f114be83740 1 --2- 172.21.15.44:0/2847500872 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561172c117d0 0x561172c11bb0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:54.453 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.443+0000 7f114be83740 1 -- 172.21.15.44:0/2847500872 >> 172.21.15.44:0/2847500872 conn(0x561172c0dd40 msgr2=0x561172c0e120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:14:54.453 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.443+0000 7f114be83740 1 -- 172.21.15.44:0/2847500872 shutdown_connections 2024-08-19T00:14:54.453 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.443+0000 7f114be83740 1 -- 172.21.15.44:0/2847500872 wait complete. 2024-08-19T00:14:54.453 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.444+0000 7f114be83740 1 -- start start 2024-08-19T00:14:54.454 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.444+0000 7f114be83740 1 Processor -- start 2024-08-19T00:14:54.454 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.444+0000 7f114be83740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561172c117d0 0x561172c198e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:54.454 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.444+0000 7f114be83740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561172c120f0 0x561172c19e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:54.454 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.444+0000 7f114be83740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561172c1c990 0x561172c1a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:54.454 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.444+0000 7f114be83740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561172c1f320 con 0x561172c120f0 2024-08-19T00:14:54.454 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.444+0000 7f114be83740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x561172b31520 con 0x561172c117d0 2024-08-19T00:14:54.454 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.444+0000 7f114be83740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x561172c1f4a0 con 0x561172c1c990 2024-08-19T00:14:54.454 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.444+0000 7f114be83740 10 client.0 _ll_register_callbacks cb 0x561172888a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:14:54.454 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.444+0000 7f114259c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561172c120f0 0x561172c19e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:54.454 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.444+0000 7f114259c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561172c120f0 0x561172c19e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58618/0 (socket says 172.21.15.44:58618) 2024-08-19T00:14:54.455 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.444+0000 7f114259c640 1 -- 172.21.15.44:0/3278218680 learned_addr learned my addr 172.21.15.44:0/3278218680 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:14:54.455 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.444+0000 7f1142d9d640 1 --2- 172.21.15.44:0/3278218680 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561172c117d0 0x561172c198e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:54.455 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.444+0000 7f114359e640 1 --2- 172.21.15.44:0/3278218680 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561172c1c990 0x561172c1a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:54.455 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.444+0000 7f114259c640 1 -- 172.21.15.44:0/3278218680 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561172c1c990 msgr2=0x561172c1a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:14:54.455 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.444+0000 7f114259c640 1 --2- 172.21.15.44:0/3278218680 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561172c1c990 0x561172c1a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:54.455 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.444+0000 7f114259c640 1 -- 172.21.15.44:0/3278218680 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561172c117d0 msgr2=0x561172c198e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:14:54.455 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.444+0000 7f114259c640 1 --2- 172.21.15.44:0/3278218680 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561172c117d0 0x561172c198e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:54.455 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.445+0000 7f114259c640 1 -- 172.21.15.44:0/3278218680 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561172955620 con 0x561172c120f0 2024-08-19T00:14:54.455 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.445+0000 7f1142d9d640 1 --2- 172.21.15.44:0/3278218680 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561172c117d0 0x561172c198e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:14:54.455 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.445+0000 7f114359e640 1 --2- 172.21.15.44:0/3278218680 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561172c1c990 0x561172c1a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:14:54.455 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.445+0000 7f114259c640 1 --2- 172.21.15.44:0/3278218680 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561172c120f0 0x561172c19e20 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f113800f490 tx=0x7f113800f950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d14c4526877466b server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:14:54.456 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.445+0000 7f1126ff5640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:14:54.456 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.445+0000 7f1126ff5640 1 -- 172.21.15.44:0/3278218680 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1138004440 con 0x561172c120f0 2024-08-19T00:14:54.456 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.445+0000 7f1126ff5640 1 -- 172.21.15.44:0/3278218680 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f11380035f0 con 0x561172c120f0 2024-08-19T00:14:54.456 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.445+0000 7f114be83740 1 -- 172.21.15.44:0/3278218680 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11340bc620 con 0x561172c120f0 2024-08-19T00:14:54.456 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.445+0000 7f1126ff5640 1 -- 172.21.15.44:0/3278218680 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1138005020 con 0x561172c120f0 2024-08-19T00:14:54.456 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.445+0000 7f114be83740 10 client.15714 fetch_fsmap learned FSMap version 30 2024-08-19T00:14:54.456 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.445+0000 7f114be83740 1 -- 172.21.15.44:0/3278218680 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x561172c2aef0 con 0x561172c120f0 2024-08-19T00:14:54.456 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.445+0000 7f1126ff5640 1 -- 172.21.15.44:0/3278218680 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f11340bc620 con 0x561172c120f0 2024-08-19T00:14:54.456 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.445+0000 7f1126ff5640 1 -- 172.21.15.44:0/3278218680 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 30) ==== 8386+0+0 (secure 0 0 0) 0x7f11380047a0 con 0x561172c120f0 2024-08-19T00:14:54.456 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.445+0000 7f114be83740 10 client.15714 fetch_fsmap finished waiting for FSMap version 30 2024-08-19T00:14:54.457 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.445+0000 7f114be83740 10 client.15714 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:14:54.457 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.445+0000 7f114be83740 20 client.15714 populate_metadata read hostname 'smithi044' 2024-08-19T00:14:54.457 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.446+0000 7f114be83740 1 --2- 172.21.15.44:0/3278218680 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x561172c2c470 0x561172c2e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:54.457 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.446+0000 7f114be83740 4 client.15714 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:14:54.457 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.446+0000 7f114be83740 1 -- 172.21.15.44:0/3278218680 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561172b83100 con 0x561172c2c470 2024-08-19T00:14:54.457 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.446+0000 7f1142d9d640 1 --2- 172.21.15.44:0/3278218680 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x561172c2c470 0x561172c2e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:54.457 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.446+0000 7f1142d9d640 1 --2- 172.21.15.44:0/3278218680 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x561172c2c470 0x561172c2e8d0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=abdc90990bc2d4b4 server_cookie=b06984ba7d6e8f8e in_seq=0 out_seq=0 2024-08-19T00:14:54.457 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.446+0000 7f1126ff5640 10 client.15714 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:14:54.457 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.447+0000 7f1126ff5640 1 -- 172.21.15.44:0/3278218680 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561172b83100 con 0x561172c2c470 2024-08-19T00:14:54.457 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.447+0000 7f1126ff5640 10 client.15714 handle_command_reply: tid=0 2024-08-19T00:14:54.457 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.447+0000 7f114be83740 1 client.15714 shutdown 2024-08-19T00:14:54.458 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.447+0000 7f114be83740 1 -- 172.21.15.44:0/3278218680 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561172c120f0 msgr2=0x561172c19e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:54.458 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.447+0000 7f114be83740 1 --2- 172.21.15.44:0/3278218680 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561172c120f0 0x561172c19e20 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f113800f490 tx=0x7f113800f950 comp rx=0 tx=0).stop 2024-08-19T00:14:54.458 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.447+0000 7f114be83740 1 -- 172.21.15.44:0/3278218680 shutdown_connections 2024-08-19T00:14:54.458 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.447+0000 7f114be83740 1 --2- 172.21.15.44:0/3278218680 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x561172c2c470 0x561172c2e8d0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:54.458 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.447+0000 7f114be83740 1 --2- 172.21.15.44:0/3278218680 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561172c1c990 0x561172c1a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:54.458 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.447+0000 7f114be83740 1 --2- 172.21.15.44:0/3278218680 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561172c120f0 0x561172c19e20 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:54.458 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.447+0000 7f1126ff5640 0 client.15714 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:14:54.458 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.447+0000 7f114be83740 1 --2- 172.21.15.44:0/3278218680 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561172c117d0 0x561172c198e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:54.458 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.447+0000 7f114be83740 1 -- 172.21.15.44:0/3278218680 >> 172.21.15.44:0/3278218680 conn(0x561172c0dd40 msgr2=0x561172c13aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:14:54.458 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.447+0000 7f114be83740 1 -- 172.21.15.44:0/3278218680 shutdown_connections 2024-08-19T00:14:54.458 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.447+0000 7f114be83740 1 -- 172.21.15.44:0/3278218680 wait complete. 2024-08-19T00:14:54.459 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.447+0000 7f114be83740 20 client.15714 trim_cache size 0 max 16384 2024-08-19T00:14:54.464 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.462+0000 7f114be83740 1 Processor -- start 2024-08-19T00:14:54.465 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.462+0000 7f114be83740 1 -- start start 2024-08-19T00:14:54.465 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.462+0000 7f114be83740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561172c117d0 0x561172c1b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:54.465 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.462+0000 7f114be83740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561172c120f0 0x561172c341a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:54.465 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.462+0000 7f114be83740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561172c1c990 0x561172c346e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:54.465 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.462+0000 7f114be83740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f11441aecd0 con 0x561172c1c990 2024-08-19T00:14:54.465 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.462+0000 7f114be83740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f11441b08d0 con 0x561172c120f0 2024-08-19T00:14:54.465 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.462+0000 7f114be83740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f11441af3a0 con 0x561172c117d0 2024-08-19T00:14:54.465 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.462+0000 7f114359e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561172c1c990 0x561172c346e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:54.465 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.462+0000 7f114359e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561172c1c990 0x561172c346e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58624/0 (socket says 172.21.15.44:58624) 2024-08-19T00:14:54.465 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.462+0000 7f114359e640 1 -- 172.21.15.44:0/3421149118 learned_addr learned my addr 172.21.15.44:0/3421149118 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:14:54.466 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.463+0000 7f114259c640 1 --2- 172.21.15.44:0/3421149118 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561172c120f0 0x561172c341a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:54.466 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.463+0000 7f114359e640 1 -- 172.21.15.44:0/3421149118 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561172c117d0 msgr2=0x561172c1b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:14:54.466 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.463+0000 7f114359e640 1 --2- 172.21.15.44:0/3421149118 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561172c117d0 0x561172c1b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:54.466 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.463+0000 7f114359e640 1 -- 172.21.15.44:0/3421149118 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561172c120f0 msgr2=0x561172c341a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:14:54.466 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.463+0000 7f114359e640 1 --2- 172.21.15.44:0/3421149118 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561172c120f0 0x561172c341a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:54.466 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.463+0000 7f114359e640 1 -- 172.21.15.44:0/3421149118 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561172c28580 con 0x561172c1c990 2024-08-19T00:14:54.466 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.463+0000 7f114359e640 1 --2- 172.21.15.44:0/3421149118 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561172c1c990 0x561172c346e0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f113c0124a0 tx=0x7f113c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdc1ee2c96f3b670 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:14:54.466 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.463+0000 7f1128ff9640 1 -- 172.21.15.44:0/3421149118 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f113c027600 con 0x561172c1c990 2024-08-19T00:14:54.466 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.463+0000 7f1128ff9640 1 -- 172.21.15.44:0/3421149118 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f113c016070 con 0x561172c1c990 2024-08-19T00:14:54.466 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.463+0000 7f1128ff9640 1 -- 172.21.15.44:0/3421149118 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f113c01fc40 con 0x561172c1c990 2024-08-19T00:14:54.470 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.464+0000 7f114be83740 1 -- 172.21.15.44:0/3421149118 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561172c1c990 msgr2=0x561172c346e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:54.470 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.464+0000 7f114be83740 1 --2- 172.21.15.44:0/3421149118 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561172c1c990 0x561172c346e0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f113c0124a0 tx=0x7f113c014000 comp rx=0 tx=0).stop 2024-08-19T00:14:54.471 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.464+0000 7f114be83740 1 -- 172.21.15.44:0/3421149118 shutdown_connections 2024-08-19T00:14:54.471 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.464+0000 7f114be83740 1 --2- 172.21.15.44:0/3421149118 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561172c1c990 0x561172c346e0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:54.471 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.464+0000 7f114be83740 1 --2- 172.21.15.44:0/3421149118 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561172c120f0 0x561172c341a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:54.471 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.464+0000 7f114be83740 1 --2- 172.21.15.44:0/3421149118 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561172c117d0 0x561172c1b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:54.471 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.464+0000 7f114be83740 1 -- 172.21.15.44:0/3421149118 >> 172.21.15.44:0/3421149118 conn(0x561172c0dd40 msgr2=0x561172c1b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:14:54.471 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.464+0000 7f114be83740 1 -- 172.21.15.44:0/3421149118 shutdown_connections 2024-08-19T00:14:54.471 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.464+0000 7f114be83740 1 -- 172.21.15.44:0/3421149118 wait complete. 2024-08-19T00:14:54.471 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.464+0000 7f114be83740 1 -- start start 2024-08-19T00:14:54.471 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.464+0000 7f114be83740 1 Processor -- start 2024-08-19T00:14:54.471 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.464+0000 7f114be83740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561172c117d0 0x561172c205e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:54.471 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.464+0000 7f114be83740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561172c120f0 0x561172c20b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:54.472 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.465+0000 7f114be83740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561172c1c990 0x561172c21060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:54.472 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.465+0000 7f114be83740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f11441b0140 con 0x561172c117d0 2024-08-19T00:14:54.472 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.465+0000 7f114be83740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f11441afa70 con 0x561172c1c990 2024-08-19T00:14:54.472 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.465+0000 7f114be83740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f11441accb0 con 0x561172c120f0 2024-08-19T00:14:54.472 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.465+0000 7f114be83740 10 client.0 _ll_register_callbacks cb 0x7f113800a3d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:14:54.472 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.465+0000 7f1142d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561172c117d0 0x561172c205e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:54.472 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.465+0000 7f1142d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561172c117d0 0x561172c205e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58640/0 (socket says 172.21.15.44:58640) 2024-08-19T00:14:54.472 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.465+0000 7f1142d9d640 1 -- 172.21.15.44:0/3208251662 learned_addr learned my addr 172.21.15.44:0/3208251662 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:14:54.472 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.465+0000 7f114259c640 1 --2- 172.21.15.44:0/3208251662 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561172c120f0 0x561172c20b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:54.472 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.465+0000 7f114359e640 1 --2- 172.21.15.44:0/3208251662 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561172c1c990 0x561172c21060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:54.472 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.465+0000 7f1142d9d640 1 -- 172.21.15.44:0/3208251662 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561172c120f0 msgr2=0x561172c20b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:14:54.473 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.465+0000 7f1142d9d640 1 --2- 172.21.15.44:0/3208251662 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561172c120f0 0x561172c20b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:54.473 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.465+0000 7f1142d9d640 1 -- 172.21.15.44:0/3208251662 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561172c1c990 msgr2=0x561172c21060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:14:54.473 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.465+0000 7f1142d9d640 1 --2- 172.21.15.44:0/3208251662 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561172c1c990 0x561172c21060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:54.473 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.465+0000 7f1142d9d640 1 -- 172.21.15.44:0/3208251662 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561172c96310 con 0x561172c117d0 2024-08-19T00:14:54.473 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.465+0000 7f114359e640 1 --2- 172.21.15.44:0/3208251662 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561172c1c990 0x561172c21060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:14:54.473 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.465+0000 7f1142d9d640 1 --2- 172.21.15.44:0/3208251662 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561172c117d0 0x561172c205e0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f11340b88f0 tx=0x7f113402a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccc6205b13d74dd7 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:14:54.473 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.465+0000 7f1126ff5640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:14:54.473 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.465+0000 7f1126ff5640 1 -- 172.21.15.44:0/3208251662 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1134049040 con 0x561172c117d0 2024-08-19T00:14:54.473 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.465+0000 7f1126ff5640 1 -- 172.21.15.44:0/3208251662 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f11340ed3d0 con 0x561172c117d0 2024-08-19T00:14:54.473 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.465+0000 7f114be83740 1 -- 172.21.15.44:0/3208251662 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f113c016070 con 0x561172c117d0 2024-08-19T00:14:54.473 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.465+0000 7f1126ff5640 1 -- 172.21.15.44:0/3208251662 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f11340bc620 con 0x561172c117d0 2024-08-19T00:14:54.474 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.465+0000 7f114be83740 10 client.15720 fetch_fsmap learned FSMap version 30 2024-08-19T00:14:54.474 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.465+0000 7f114be83740 1 -- 172.21.15.44:0/3208251662 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x561172c97660 con 0x561172c117d0 2024-08-19T00:14:54.474 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.466+0000 7f1126ff5640 1 -- 172.21.15.44:0/3208251662 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f113c016070 con 0x561172c117d0 2024-08-19T00:14:54.474 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.466+0000 7f1126ff5640 1 -- 172.21.15.44:0/3208251662 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 30) ==== 8386+0+0 (secure 0 0 0) 0x7f11340b8590 con 0x561172c117d0 2024-08-19T00:14:54.474 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.466+0000 7f114be83740 10 client.15720 fetch_fsmap finished waiting for FSMap version 30 2024-08-19T00:14:54.474 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.466+0000 7f114be83740 10 client.15720 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:14:54.474 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.466+0000 7f114be83740 20 client.15720 populate_metadata read hostname 'smithi044' 2024-08-19T00:14:54.474 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.466+0000 7f114be83740 1 --2- 172.21.15.44:0/3208251662 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x561172c97cd0 0x561172c9a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:14:54.474 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.466+0000 7f114be83740 4 client.15720 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-19T00:14:54.474 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.466+0000 7f114be83740 1 -- 172.21.15.44:0/3208251662 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561172b7d450 con 0x561172c97cd0 2024-08-19T00:14:54.474 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.466+0000 7f114259c640 1 --2- 172.21.15.44:0/3208251662 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x561172c97cd0 0x561172c9a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:14:54.475 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.467+0000 7f1126ff5640 10 client.15720 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:14:54.475 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.467+0000 7f114259c640 1 --2- 172.21.15.44:0/3208251662 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x561172c97cd0 0x561172c9a0f0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98374d1a4c7340d7 server_cookie=c81b4c18cfd7e654 in_seq=0 out_seq=0 2024-08-19T00:14:54.478 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.476+0000 7f1126ff5640 1 -- 172.21.15.44:0/3208251662 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561172b7d450 con 0x561172c97cd0 2024-08-19T00:14:54.478 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.476+0000 7f1126ff5640 10 client.15720 handle_command_reply: tid=0 2024-08-19T00:14:54.478 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.476+0000 7f114be83740 1 client.15720 shutdown 2024-08-19T00:14:54.478 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.476+0000 7f114be83740 1 -- 172.21.15.44:0/3208251662 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561172c117d0 msgr2=0x561172c205e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:54.478 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.476+0000 7f114be83740 1 --2- 172.21.15.44:0/3208251662 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561172c117d0 0x561172c205e0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f11340b88f0 tx=0x7f113402a420 comp rx=0 tx=0).stop 2024-08-19T00:14:54.478 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.476+0000 7f114be83740 1 -- 172.21.15.44:0/3208251662 shutdown_connections 2024-08-19T00:14:54.478 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.476+0000 7f114be83740 1 --2- 172.21.15.44:0/3208251662 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x561172c97cd0 0x561172c9a0f0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:54.479 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.476+0000 7f114be83740 1 --2- 172.21.15.44:0/3208251662 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561172c120f0 0x561172c20b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:54.479 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.476+0000 7f114be83740 1 --2- 172.21.15.44:0/3208251662 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561172c1c990 0x561172c21060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:54.479 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.476+0000 7f1126ff5640 0 client.15720 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:14:54.479 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.476+0000 7f114be83740 1 --2- 172.21.15.44:0/3208251662 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561172c117d0 0x561172c205e0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:54.479 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.476+0000 7f114be83740 1 -- 172.21.15.44:0/3208251662 >> 172.21.15.44:0/3208251662 conn(0x561172c0dd40 msgr2=0x561172c0cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:14:54.479 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.476+0000 7f114be83740 1 -- 172.21.15.44:0/3208251662 shutdown_connections 2024-08-19T00:14:54.479 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.476+0000 7f114be83740 1 -- 172.21.15.44:0/3208251662 wait complete. 2024-08-19T00:14:54.479 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.476+0000 7f114be83740 20 client.15720 trim_cache size 0 max 16384 2024-08-19T00:14:54.479 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:{ 2024-08-19T00:14:54.480 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "message": "", 2024-08-19T00:14:54.480 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "return_code": 0 2024-08-19T00:14:54.480 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:} 2024-08-19T00:14:54.480 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.477+0000 7f11490c4640 1 -- 172.21.15.44:0/4011398100 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f112c0a2da0 msgr2=0x7f112c0a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:54.480 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.477+0000 7f11490c4640 1 --2- 172.21.15.44:0/4011398100 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f112c0a2da0 0x7f112c0a5260 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f113c005c40 tx=0x7f113c0097a0 comp rx=0 tx=0).stop 2024-08-19T00:14:54.481 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.477+0000 7f11490c4640 1 -- 172.21.15.44:0/4011398100 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1144100720 msgr2=0x7f1144198030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:14:54.481 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.477+0000 7f11490c4640 1 --2- 172.21.15.44:0/4011398100 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1144100720 0x7f1144198030 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f1134009230 tx=0x7f1134004270 comp rx=0 tx=0).stop 2024-08-19T00:14:54.481 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.477+0000 7f11490c4640 1 -- 172.21.15.44:0/4011398100 shutdown_connections 2024-08-19T00:14:54.481 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.477+0000 7f11490c4640 1 --2- 172.21.15.44:0/4011398100 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f112c0a2da0 0x7f112c0a5260 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:54.481 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.477+0000 7f11490c4640 1 --2- 172.21.15.44:0/4011398100 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1144106730 0x7f114419c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:54.481 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.477+0000 7f11490c4640 1 --2- 172.21.15.44:0/4011398100 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f11441010c0 0x7f1144198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:54.481 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.477+0000 7f11490c4640 1 --2- 172.21.15.44:0/4011398100 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1144100720 0x7f1144198030 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:14:54.481 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.477+0000 7f11490c4640 1 -- 172.21.15.44:0/4011398100 >> 172.21.15.44:0/4011398100 conn(0x7f11440fc3e0 msgr2=0x7f11440fc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:14:54.481 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.477+0000 7f11490c4640 1 -- 172.21.15.44:0/4011398100 shutdown_connections 2024-08-19T00:14:54.481 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:14:54.477+0000 7f11490c4640 1 -- 172.21.15.44:0/4011398100 wait complete. 2024-08-19T00:14:54.648 INFO:tasks.workunit.client.0.smithi044.stdout: 1 9532 3.49 MB/sec warmup 19 sec latency 2398.216 ms 2024-08-19T00:14:55.648 INFO:tasks.workunit.client.0.smithi044.stdout: 1 9532 3.32 MB/sec warmup 20 sec latency 3398.308 ms 2024-08-19T00:14:56.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:14:55 smithi171 ceph-mon[21810]: pgmap v51: 129 pgs: 129 active+clean; 25 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 2.1 MiB/s wr, 86 op/s 2024-08-19T00:14:56.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:14:55 smithi116 ceph-mon[21873]: pgmap v51: 129 pgs: 129 active+clean; 25 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 2.1 MiB/s wr, 86 op/s 2024-08-19T00:14:56.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:14:55 smithi044 ceph-mon[18489]: pgmap v51: 129 pgs: 129 active+clean; 25 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 2.1 MiB/s wr, 86 op/s 2024-08-19T00:14:56.648 INFO:tasks.workunit.client.0.smithi044.stdout: 1 9532 3.16 MB/sec warmup 21 sec latency 4398.441 ms 2024-08-19T00:14:57.648 INFO:tasks.workunit.client.0.smithi044.stdout: 1 9593 3.04 MB/sec warmup 22 sec latency 4959.232 ms 2024-08-19T00:14:58.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:14:57 smithi171 ceph-mon[21810]: pgmap v52: 129 pgs: 129 active+clean; 25 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 178 KiB/s wr, 51 op/s 2024-08-19T00:14:58.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:14:57 smithi116 ceph-mon[21873]: pgmap v52: 129 pgs: 129 active+clean; 25 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 178 KiB/s wr, 51 op/s 2024-08-19T00:14:58.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:14:57 smithi044 ceph-mon[18489]: pgmap v52: 129 pgs: 129 active+clean; 25 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 178 KiB/s wr, 51 op/s 2024-08-19T00:14:58.648 INFO:tasks.workunit.client.0.smithi044.stdout: 1 9593 2.91 MB/sec warmup 23 sec latency 1381.766 ms 2024-08-19T00:14:59.649 INFO:tasks.workunit.client.0.smithi044.stdout: 1 9593 2.79 MB/sec warmup 24 sec latency 2381.855 ms 2024-08-19T00:15:00.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:14:59 smithi171 ceph-mon[21810]: pgmap v53: 129 pgs: 129 active+clean; 25 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 178 KiB/s wr, 51 op/s 2024-08-19T00:15:00.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:14:59 smithi116 ceph-mon[21873]: pgmap v53: 129 pgs: 129 active+clean; 25 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 178 KiB/s wr, 51 op/s 2024-08-19T00:15:00.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:14:59 smithi044 ceph-mon[18489]: pgmap v53: 129 pgs: 129 active+clean; 25 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 178 KiB/s wr, 51 op/s 2024-08-19T00:15:00.649 INFO:tasks.workunit.client.0.smithi044.stdout: 1 9652 2.69 MB/sec warmup 25 sec latency 3365.528 ms 2024-08-19T00:15:01.649 INFO:tasks.workunit.client.0.smithi044.stdout: 1 10629 2.95 MB/sec warmup 26 sec latency 91.534 ms 2024-08-19T00:15:02.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:15:01 smithi171 ceph-mon[21810]: pgmap v54: 129 pgs: 129 active+clean; 26 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 190 KiB/s wr, 57 op/s 2024-08-19T00:15:02.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:15:01 smithi116 ceph-mon[21873]: pgmap v54: 129 pgs: 129 active+clean; 26 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 190 KiB/s wr, 57 op/s 2024-08-19T00:15:02.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:15:01 smithi044 ceph-mon[18489]: pgmap v54: 129 pgs: 129 active+clean; 26 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 190 KiB/s wr, 57 op/s 2024-08-19T00:15:02.649 INFO:tasks.workunit.client.0.smithi044.stdout: 1 11717 2.97 MB/sec warmup 27 sec latency 350.140 ms 2024-08-19T00:15:03.650 INFO:tasks.workunit.client.0.smithi044.stdout: 1 14598 3.48 MB/sec warmup 28 sec latency 407.605 ms 2024-08-19T00:15:04.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:15:03 smithi171 ceph-mon[21810]: pgmap v55: 129 pgs: 129 active+clean; 26 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 27 KiB/s wr, 17 op/s 2024-08-19T00:15:04.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:15:03 smithi116 ceph-mon[21873]: pgmap v55: 129 pgs: 129 active+clean; 26 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 27 KiB/s wr, 17 op/s 2024-08-19T00:15:04.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:15:03 smithi044 ceph-mon[18489]: pgmap v55: 129 pgs: 129 active+clean; 26 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 27 KiB/s wr, 17 op/s 2024-08-19T00:15:04.649 INFO:tasks.workunit.client.0.smithi044.stdout: 1 15264 3.43 MB/sec warmup 29 sec latency 600.675 ms 2024-08-19T00:15:05.649 INFO:tasks.workunit.client.0.smithi044.stdout: 1 15264 3.31 MB/sec warmup 30 sec latency 1600.768 ms 2024-08-19T00:15:06.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:15:05 smithi171 ceph-mon[21810]: pgmap v56: 129 pgs: 129 active+clean; 29 MiB data, 488 MiB used, 1.0 TiB / 1.0 TiB avail; 692 KiB/s rd, 474 KiB/s wr, 100 op/s 2024-08-19T00:15:06.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:15:05 smithi116 ceph-mon[21873]: pgmap v56: 129 pgs: 129 active+clean; 29 MiB data, 488 MiB used, 1.0 TiB / 1.0 TiB avail; 692 KiB/s rd, 474 KiB/s wr, 100 op/s 2024-08-19T00:15:06.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:15:05 smithi044 ceph-mon[18489]: pgmap v56: 129 pgs: 129 active+clean; 29 MiB data, 488 MiB used, 1.0 TiB / 1.0 TiB avail; 692 KiB/s rd, 474 KiB/s wr, 100 op/s 2024-08-19T00:15:06.649 INFO:tasks.workunit.client.0.smithi044.stdout: 1 15264 3.21 MB/sec warmup 31 sec latency 2600.867 ms 2024-08-19T00:15:07.583 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.579+0000 7fa64619d640 1 -- 172.21.15.44:0/1317745905 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa6401065f0 msgr2=0x7fa6401069d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:07.583 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.579+0000 7fa64619d640 1 --2- 172.21.15.44:0/1317745905 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa6401065f0 0x7fa6401069d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa63c009930 tx=0x7fa63c02a420 comp rx=0 tx=0).stop 2024-08-19T00:15:07.583 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.579+0000 7fa64619d640 1 -- 172.21.15.44:0/1317745905 shutdown_connections 2024-08-19T00:15:07.583 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.579+0000 7fa64619d640 1 --2- 172.21.15.44:0/1317745905 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa640100ed0 0x7fa64010d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:07.584 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.579+0000 7fa64619d640 1 --2- 172.21.15.44:0/1317745905 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa640100530 0x7fa640100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:07.584 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.579+0000 7fa64619d640 1 --2- 172.21.15.44:0/1317745905 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa6401065f0 0x7fa6401069d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:07.584 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.579+0000 7fa64619d640 1 -- 172.21.15.44:0/1317745905 >> 172.21.15.44:0/1317745905 conn(0x7fa6400fc1d0 msgr2=0x7fa6400fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:15:07.584 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.579+0000 7fa64619d640 1 -- 172.21.15.44:0/1317745905 shutdown_connections 2024-08-19T00:15:07.584 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.579+0000 7fa64619d640 1 -- 172.21.15.44:0/1317745905 wait complete. 2024-08-19T00:15:07.584 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.580+0000 7fa64619d640 1 Processor -- start 2024-08-19T00:15:07.584 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.580+0000 7fa64619d640 1 -- start start 2024-08-19T00:15:07.584 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.580+0000 7fa64619d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa640100530 0x7fa640198d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:07.584 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.580+0000 7fa64619d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa640100ed0 0x7fa6401992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.580+0000 7fa64619d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa6401065f0 0x7fa6401a3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.580+0000 7fa64619d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa640110940 con 0x7fa6401065f0 2024-08-19T00:15:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.580+0000 7fa64619d640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fa6401107c0 con 0x7fa640100530 2024-08-19T00:15:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.580+0000 7fa64619d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa640110ac0 con 0x7fa640100ed0 2024-08-19T00:15:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.580+0000 7fa64599c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa6401065f0 0x7fa6401a3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.580+0000 7fa64599c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa6401065f0 0x7fa6401a3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54322/0 (socket says 172.21.15.44:54322) 2024-08-19T00:15:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.580+0000 7fa64599c640 1 -- 172.21.15.44:0/3063471823 learned_addr learned my addr 172.21.15.44:0/3063471823 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:15:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.580+0000 7fa64499a640 1 --2- 172.21.15.44:0/3063471823 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa640100ed0 0x7fa6401992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.580+0000 7fa64519b640 1 --2- 172.21.15.44:0/3063471823 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa640100530 0x7fa640198d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.581+0000 7fa64599c640 1 -- 172.21.15.44:0/3063471823 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa640100ed0 msgr2=0x7fa6401992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.581+0000 7fa64599c640 1 --2- 172.21.15.44:0/3063471823 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa640100ed0 0x7fa6401992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.581+0000 7fa64599c640 1 -- 172.21.15.44:0/3063471823 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa640100530 msgr2=0x7fa640198d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.581+0000 7fa64599c640 1 --2- 172.21.15.44:0/3063471823 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa640100530 0x7fa640198d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:07.586 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.581+0000 7fa64599c640 1 -- 172.21.15.44:0/3063471823 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6401a4330 con 0x7fa6401065f0 2024-08-19T00:15:07.586 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.581+0000 7fa64499a640 1 --2- 172.21.15.44:0/3063471823 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa640100ed0 0x7fa6401992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:15:07.586 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.581+0000 7fa64519b640 1 --2- 172.21.15.44:0/3063471823 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa640100530 0x7fa640198d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:15:07.586 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.581+0000 7fa64599c640 1 --2- 172.21.15.44:0/3063471823 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa6401065f0 0x7fa6401a3df0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fa63800efd0 tx=0x7fa63800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:15:07.586 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.581+0000 7fa6367fc640 1 -- 172.21.15.44:0/3063471823 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa638003b70 con 0x7fa6401065f0 2024-08-19T00:15:07.586 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.581+0000 7fa64619d640 1 -- 172.21.15.44:0/3063471823 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6401a4500 con 0x7fa6401065f0 2024-08-19T00:15:07.586 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.581+0000 7fa6367fc640 1 -- 172.21.15.44:0/3063471823 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa638003d10 con 0x7fa6401065f0 2024-08-19T00:15:07.586 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.581+0000 7fa6367fc640 1 -- 172.21.15.44:0/3063471823 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6380109f0 con 0x7fa6401065f0 2024-08-19T00:15:07.586 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.581+0000 7fa64619d640 1 -- 172.21.15.44:0/3063471823 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6401a4a20 con 0x7fa6401065f0 2024-08-19T00:15:07.592 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.583+0000 7fa6367fc640 1 -- 172.21.15.44:0/3063471823 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fa638004000 con 0x7fa6401065f0 2024-08-19T00:15:07.593 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.584+0000 7fa64a1c3740 1 Processor -- start 2024-08-19T00:15:07.593 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.584+0000 7fa64a1c3740 1 -- start start 2024-08-19T00:15:07.593 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.584+0000 7fa64a1c3740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a1cd2539b0 0x55a1cd253d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:07.593 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.584+0000 7fa64a1c3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a1cd2542d0 0x55a1cd25e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:07.593 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.584+0000 7fa64a1c3740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a1cd25eb70 0x55a1cd260f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:07.593 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.584+0000 7fa64a1c3740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a1cd1b79d0 con 0x55a1cd2542d0 2024-08-19T00:15:07.593 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.584+0000 7fa64a1c3740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55a1cd15f820 con 0x55a1cd25eb70 2024-08-19T00:15:07.593 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.584+0000 7fa64a1c3740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55a1cd1b3990 con 0x55a1cd2539b0 2024-08-19T00:15:07.593 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.584+0000 7fa6367fc640 1 --2- 172.21.15.44:0/3063471823 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fa62c0a2cf0 0x7fa62c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:07.593 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.585+0000 7fa64519b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a1cd2542d0 0x55a1cd25e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:07.593 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.585+0000 7fa64519b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a1cd2542d0 0x55a1cd25e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54324/0 (socket says 172.21.15.44:54324) 2024-08-19T00:15:07.593 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.585+0000 7fa64519b640 1 -- 172.21.15.44:0/3554772991 learned_addr learned my addr 172.21.15.44:0/3554772991 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:15:07.594 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.585+0000 7fa64499a640 1 --2- 172.21.15.44:0/3554772991 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a1cd2539b0 0x55a1cd253d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:07.594 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.585+0000 7fa64599c640 1 --2- 172.21.15.44:0/3063471823 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fa62c0a2cf0 0x7fa62c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:07.594 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.585+0000 7fa64499a640 1 --2- 172.21.15.44:0/3554772991 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a1cd25eb70 0x55a1cd260f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:07.594 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.585+0000 7fa6367fc640 1 -- 172.21.15.44:0/3063471823 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7fa6380cfb50 con 0x7fa6401065f0 2024-08-19T00:15:07.594 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.585+0000 7fa64519b640 1 -- 172.21.15.44:0/3554772991 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a1cd2539b0 msgr2=0x55a1cd253d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:15:07.594 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.585+0000 7fa64519b640 1 --2- 172.21.15.44:0/3554772991 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a1cd2539b0 0x55a1cd253d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:07.594 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.585+0000 7fa64519b640 1 -- 172.21.15.44:0/3554772991 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a1cd25eb70 msgr2=0x55a1cd260f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:15:07.594 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.585+0000 7fa64519b640 1 --2- 172.21.15.44:0/3554772991 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a1cd25eb70 0x55a1cd260f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:07.594 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.585+0000 7fa64519b640 1 -- 172.21.15.44:0/3554772991 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1ccecb210 con 0x55a1cd2542d0 2024-08-19T00:15:07.594 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.585+0000 7fa64599c640 1 --2- 172.21.15.44:0/3063471823 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fa62c0a2cf0 0x7fa62c0a51b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa63809bc60 tx=0x7fa638009f90 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:15:07.594 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.585+0000 7fa64519b640 1 --2- 172.21.15.44:0/3554772991 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a1cd2542d0 0x55a1cd25e630 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fa63c000c00 tx=0x7fa63c005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aea0bea8bc0a1685 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:15:07.594 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.585+0000 7fa62b7fe640 1 -- 172.21.15.44:0/3554772991 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa63c035040 con 0x55a1cd2542d0 2024-08-19T00:15:07.594 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.585+0000 7fa62b7fe640 1 -- 172.21.15.44:0/3554772991 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa63c031830 con 0x55a1cd2542d0 2024-08-19T00:15:07.595 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.585+0000 7fa62b7fe640 1 -- 172.21.15.44:0/3554772991 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa63c003d90 con 0x55a1cd2542d0 2024-08-19T00:15:07.595 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.586+0000 7fa64a1c3740 1 -- 172.21.15.44:0/3554772991 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a1cd2542d0 msgr2=0x55a1cd25e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:07.595 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.586+0000 7fa64a1c3740 1 --2- 172.21.15.44:0/3554772991 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a1cd2542d0 0x55a1cd25e630 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fa63c000c00 tx=0x7fa63c005d50 comp rx=0 tx=0).stop 2024-08-19T00:15:07.595 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.586+0000 7fa64a1c3740 1 -- 172.21.15.44:0/3554772991 shutdown_connections 2024-08-19T00:15:07.595 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.586+0000 7fa64a1c3740 1 --2- 172.21.15.44:0/3554772991 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a1cd25eb70 0x55a1cd260f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:07.595 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.586+0000 7fa64a1c3740 1 --2- 172.21.15.44:0/3554772991 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a1cd2542d0 0x55a1cd25e630 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:07.595 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.586+0000 7fa64a1c3740 1 --2- 172.21.15.44:0/3554772991 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a1cd2539b0 0x55a1cd253d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:07.595 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.586+0000 7fa64a1c3740 1 -- 172.21.15.44:0/3554772991 >> 172.21.15.44:0/3554772991 conn(0x55a1cd24ff20 msgr2=0x55a1cd250300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:15:07.595 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.586+0000 7fa64a1c3740 1 -- 172.21.15.44:0/3554772991 shutdown_connections 2024-08-19T00:15:07.595 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.587+0000 7fa64a1c3740 1 -- 172.21.15.44:0/3554772991 wait complete. 2024-08-19T00:15:07.595 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.587+0000 7fa64a1c3740 1 -- start start 2024-08-19T00:15:07.595 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.587+0000 7fa64a1c3740 1 Processor -- start 2024-08-19T00:15:07.595 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.587+0000 7fa64a1c3740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a1cd2539b0 0x55a1cd25ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:07.596 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.587+0000 7fa64a1c3740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a1cd2542d0 0x55a1cd25bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:07.596 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.587+0000 7fa64a1c3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a1cd25eb70 0x55a1cd25c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:07.596 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.587+0000 7fa64a1c3740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a1cd261740 con 0x55a1cd25eb70 2024-08-19T00:15:07.596 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.587+0000 7fa64a1c3740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55a1cd173520 con 0x55a1cd2542d0 2024-08-19T00:15:07.596 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.587+0000 7fa64a1c3740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55a1cd2618c0 con 0x55a1cd2539b0 2024-08-19T00:15:07.596 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.587+0000 7fa64a1c3740 10 client.0 _ll_register_callbacks cb 0x55a1ccecaa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:15:07.596 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.588+0000 7fa64499a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a1cd25eb70 0x55a1cd25c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:07.596 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.588+0000 7fa64519b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a1cd2542d0 0x55a1cd25bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:07.596 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.588+0000 7fa64519b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a1cd2542d0 0x55a1cd25bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.44:42776/0 (socket says 172.21.15.44:42776) 2024-08-19T00:15:07.596 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.588+0000 7fa64499a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a1cd25eb70 0x55a1cd25c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54332/0 (socket says 172.21.15.44:54332) 2024-08-19T00:15:07.596 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.588+0000 7fa64519b640 1 -- 172.21.15.44:0/1323456471 learned_addr learned my addr 172.21.15.44:0/1323456471 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:15:07.596 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.588+0000 7fa64499a640 1 --2- 172.21.15.44:0/1323456471 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a1cd2539b0 0x55a1cd25ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:07.596 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.588+0000 7fa64519b640 1 -- 172.21.15.44:0/1323456471 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a1cd2539b0 msgr2=0x55a1cd25ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:15:07.597 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.588+0000 7fa64519b640 1 --2- 172.21.15.44:0/1323456471 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a1cd2539b0 0x55a1cd25ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:07.597 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.588+0000 7fa64519b640 1 -- 172.21.15.44:0/1323456471 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a1cd25eb70 msgr2=0x55a1cd25c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:15:07.597 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.588+0000 7fa64519b640 1 --2- 172.21.15.44:0/1323456471 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a1cd25eb70 0x55a1cd25c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:07.597 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.588+0000 7fa64519b640 1 -- 172.21.15.44:0/1323456471 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1ccf97620 con 0x55a1cd2542d0 2024-08-19T00:15:07.597 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.588+0000 7fa64499a640 1 --2- 172.21.15.44:0/1323456471 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a1cd25eb70 0x55a1cd25c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:15:07.597 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.588+0000 7fa64519b640 1 --2- 172.21.15.44:0/1323456471 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a1cd2542d0 0x55a1cd25bf90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa63c009900 tx=0x7fa63c0038a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3b5f7ceb06df55 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:15:07.597 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.588+0000 7fa628ff9640 10 client.0 ms_handle_connect on v2:172.21.15.116:3300/0 2024-08-19T00:15:07.597 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.588+0000 7fa628ff9640 1 -- 172.21.15.44:0/1323456471 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa63c04e020 con 0x55a1cd2542d0 2024-08-19T00:15:07.597 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.588+0000 7fa64a1c3740 1 -- 172.21.15.44:0/1323456471 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa63c031830 con 0x55a1cd2542d0 2024-08-19T00:15:07.597 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.588+0000 7fa628ff9640 1 -- 172.21.15.44:0/1323456471 <== mon.2 v2:172.21.15.116:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7fa63c005250 con 0x55a1cd2542d0 2024-08-19T00:15:07.597 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.589+0000 7fa628ff9640 1 -- 172.21.15.44:0/1323456471 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa63c059050 con 0x55a1cd2542d0 2024-08-19T00:15:07.597 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.589+0000 7fa64a1c3740 10 client.25259 fetch_fsmap learned FSMap version 30 2024-08-19T00:15:07.597 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.589+0000 7fa64a1c3740 1 -- 172.21.15.44:0/1323456471 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55a1cd26d390 con 0x55a1cd2542d0 2024-08-19T00:15:07.598 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.589+0000 7fa628ff9640 1 -- 172.21.15.44:0/1323456471 <== mon.2 v2:172.21.15.116:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa63c031830 con 0x55a1cd2542d0 2024-08-19T00:15:07.598 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.589+0000 7fa628ff9640 1 -- 172.21.15.44:0/1323456471 <== mon.2 v2:172.21.15.116:3300/0 5 ==== fsmap(e 30) ==== 8386+0+0 (secure 0 0 0) 0x7fa63c003b30 con 0x55a1cd2542d0 2024-08-19T00:15:07.598 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.589+0000 7fa64a1c3740 10 client.25259 fetch_fsmap finished waiting for FSMap version 30 2024-08-19T00:15:07.598 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.589+0000 7fa64a1c3740 10 client.25259 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:15:07.598 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.589+0000 7fa64a1c3740 20 client.25259 populate_metadata read hostname 'smithi044' 2024-08-19T00:15:07.598 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.589+0000 7fa64a1c3740 1 --2- 172.21.15.44:0/1323456471 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55a1cd26e6e0 0x55a1cd270ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:07.598 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.589+0000 7fa64a1c3740 4 client.25259 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:15:07.598 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.589+0000 7fa64a1c3740 1 -- 172.21.15.44:0/1323456471 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a1cd1c5100 con 0x55a1cd26e6e0 2024-08-19T00:15:07.598 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.589+0000 7fa64499a640 1 --2- 172.21.15.44:0/1323456471 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55a1cd26e6e0 0x55a1cd270ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:07.598 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.590+0000 7fa64499a640 1 --2- 172.21.15.44:0/1323456471 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55a1cd26e6e0 0x55a1cd270ad0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6f6623d97813ada server_cookie=869175535517b891 in_seq=0 out_seq=0 2024-08-19T00:15:07.598 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.590+0000 7fa628ff9640 10 client.25259 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:15:07.598 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.590+0000 7fa628ff9640 1 -- 172.21.15.44:0/1323456471 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a1cd1c5100 con 0x55a1cd26e6e0 2024-08-19T00:15:07.599 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.590+0000 7fa628ff9640 10 client.25259 handle_command_reply: tid=0 2024-08-19T00:15:07.599 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.590+0000 7fa64a1c3740 1 client.25259 shutdown 2024-08-19T00:15:07.599 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.590+0000 7fa64a1c3740 1 -- 172.21.15.44:0/1323456471 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a1cd2542d0 msgr2=0x55a1cd25bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:07.599 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.590+0000 7fa64a1c3740 1 --2- 172.21.15.44:0/1323456471 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a1cd2542d0 0x55a1cd25bf90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa63c009900 tx=0x7fa63c0038a0 comp rx=0 tx=0).stop 2024-08-19T00:15:07.599 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.590+0000 7fa64a1c3740 1 -- 172.21.15.44:0/1323456471 shutdown_connections 2024-08-19T00:15:07.599 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.590+0000 7fa64a1c3740 1 --2- 172.21.15.44:0/1323456471 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55a1cd26e6e0 0x55a1cd270ad0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:07.599 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.590+0000 7fa64a1c3740 1 --2- 172.21.15.44:0/1323456471 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a1cd25eb70 0x55a1cd25c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:07.599 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.590+0000 7fa64a1c3740 1 --2- 172.21.15.44:0/1323456471 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a1cd2542d0 0x55a1cd25bf90 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:07.599 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.590+0000 7fa64a1c3740 1 --2- 172.21.15.44:0/1323456471 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a1cd2539b0 0x55a1cd25ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:07.599 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.590+0000 7fa628ff9640 0 client.25259 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:15:07.599 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.590+0000 7fa64a1c3740 1 -- 172.21.15.44:0/1323456471 >> 172.21.15.44:0/1323456471 conn(0x55a1cd24ff20 msgr2=0x55a1cd255c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:15:07.599 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.590+0000 7fa64a1c3740 1 -- 172.21.15.44:0/1323456471 shutdown_connections 2024-08-19T00:15:07.599 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.590+0000 7fa64a1c3740 1 -- 172.21.15.44:0/1323456471 wait complete. 2024-08-19T00:15:07.600 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.591+0000 7fa64a1c3740 20 client.25259 trim_cache size 0 max 16384 2024-08-19T00:15:07.609 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.606+0000 7fa64a1c3740 1 Processor -- start 2024-08-19T00:15:07.609 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.607+0000 7fa64a1c3740 1 -- start start 2024-08-19T00:15:07.609 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.607+0000 7fa64a1c3740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a1cd2539b0 0x55a1cd25b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:07.609 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.607+0000 7fa64a1c3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a1cd2542d0 0x55a1cd24ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:07.609 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.607+0000 7fa64a1c3740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a1cd25eb70 0x55a1cd276260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:07.609 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.607+0000 7fa64a1c3740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa6401aebb0 con 0x55a1cd2542d0 2024-08-19T00:15:07.610 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.607+0000 7fa64a1c3740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fa6401b07b0 con 0x55a1cd2539b0 2024-08-19T00:15:07.610 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.607+0000 7fa64a1c3740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa6401af280 con 0x55a1cd25eb70 2024-08-19T00:15:07.610 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.607+0000 7fa64519b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a1cd2542d0 0x55a1cd24ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:07.610 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.607+0000 7fa64519b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a1cd2542d0 0x55a1cd24ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54342/0 (socket says 172.21.15.44:54342) 2024-08-19T00:15:07.610 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.607+0000 7fa64519b640 1 -- 172.21.15.44:0/3489668296 learned_addr learned my addr 172.21.15.44:0/3489668296 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:15:07.610 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.607+0000 7fa64499a640 1 --2- 172.21.15.44:0/3489668296 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a1cd2539b0 0x55a1cd25b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:07.610 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.607+0000 7fa64499a640 1 --2- 172.21.15.44:0/3489668296 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a1cd25eb70 0x55a1cd276260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:07.611 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.607+0000 7fa64519b640 1 -- 172.21.15.44:0/3489668296 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a1cd25eb70 msgr2=0x55a1cd276260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:15:07.611 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.607+0000 7fa64519b640 1 --2- 172.21.15.44:0/3489668296 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a1cd25eb70 0x55a1cd276260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:07.611 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.607+0000 7fa64519b640 1 -- 172.21.15.44:0/3489668296 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a1cd2539b0 msgr2=0x55a1cd25b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:15:07.611 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.607+0000 7fa64519b640 1 --2- 172.21.15.44:0/3489668296 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a1cd2539b0 0x55a1cd25b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:07.611 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.607+0000 7fa64519b640 1 -- 172.21.15.44:0/3489668296 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1cd259f80 con 0x55a1cd2542d0 2024-08-19T00:15:07.611 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.607+0000 7fa64499a640 1 --2- 172.21.15.44:0/3489668296 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a1cd2539b0 0x55a1cd25b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:15:07.611 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.608+0000 7fa64519b640 1 --2- 172.21.15.44:0/3489668296 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a1cd2542d0 0x55a1cd24ef50 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fa63c003f00 tx=0x7fa63c005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17521d9f42e5882e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:15:07.611 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.608+0000 7fa62affd640 1 -- 172.21.15.44:0/3489668296 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa63c04e070 con 0x55a1cd2542d0 2024-08-19T00:15:07.611 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.608+0000 7fa62affd640 1 -- 172.21.15.44:0/3489668296 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa63c005250 con 0x55a1cd2542d0 2024-08-19T00:15:07.611 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.608+0000 7fa62affd640 1 -- 172.21.15.44:0/3489668296 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa63c035040 con 0x55a1cd2542d0 2024-08-19T00:15:07.614 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.609+0000 7fa64a1c3740 1 -- 172.21.15.44:0/3489668296 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a1cd2542d0 msgr2=0x55a1cd24ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:07.615 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.609+0000 7fa64a1c3740 1 --2- 172.21.15.44:0/3489668296 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a1cd2542d0 0x55a1cd24ef50 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fa63c003f00 tx=0x7fa63c005d50 comp rx=0 tx=0).stop 2024-08-19T00:15:07.615 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.609+0000 7fa64a1c3740 1 -- 172.21.15.44:0/3489668296 shutdown_connections 2024-08-19T00:15:07.615 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.609+0000 7fa64a1c3740 1 --2- 172.21.15.44:0/3489668296 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a1cd25eb70 0x55a1cd276260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:07.615 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.609+0000 7fa64a1c3740 1 --2- 172.21.15.44:0/3489668296 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a1cd2542d0 0x55a1cd24ef50 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:07.615 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.609+0000 7fa64a1c3740 1 --2- 172.21.15.44:0/3489668296 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a1cd2539b0 0x55a1cd25b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:07.615 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.609+0000 7fa64a1c3740 1 -- 172.21.15.44:0/3489668296 >> 172.21.15.44:0/3489668296 conn(0x55a1cd24ff20 msgr2=0x55a1cd250300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:15:07.615 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.609+0000 7fa64a1c3740 1 -- 172.21.15.44:0/3489668296 shutdown_connections 2024-08-19T00:15:07.615 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.609+0000 7fa64a1c3740 1 -- 172.21.15.44:0/3489668296 wait complete. 2024-08-19T00:15:07.615 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.609+0000 7fa64a1c3740 1 -- start start 2024-08-19T00:15:07.615 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.609+0000 7fa64a1c3740 1 Processor -- start 2024-08-19T00:15:07.615 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.609+0000 7fa64a1c3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a1cd2539b0 0x55a1cd261b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:07.615 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.609+0000 7fa64a1c3740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a1cd2542d0 0x55a1cd262090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:07.616 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.609+0000 7fa64a1c3740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a1cd25eb70 0x55a1cd262610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:07.616 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.609+0000 7fa64a1c3740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa6401b0020 con 0x55a1cd2539b0 2024-08-19T00:15:07.616 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.609+0000 7fa64a1c3740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fa6401af950 con 0x55a1cd2542d0 2024-08-19T00:15:07.616 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.609+0000 7fa64a1c3740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa6401acb90 con 0x55a1cd25eb70 2024-08-19T00:15:07.616 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.610+0000 7fa64a1c3740 10 client.0 _ll_register_callbacks cb 0x7fa63c040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:15:07.616 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.610+0000 7fa64499a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a1cd2539b0 0x55a1cd261b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:07.616 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.610+0000 7fa64499a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a1cd2539b0 0x55a1cd261b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54356/0 (socket says 172.21.15.44:54356) 2024-08-19T00:15:07.616 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.610+0000 7fa64499a640 1 -- 172.21.15.44:0/3953977043 learned_addr learned my addr 172.21.15.44:0/3953977043 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:15:07.616 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.610+0000 7fa64519b640 1 --2- 172.21.15.44:0/3953977043 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a1cd2542d0 0x55a1cd262090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:07.616 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.610+0000 7fa64499a640 1 --2- 172.21.15.44:0/3953977043 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a1cd25eb70 0x55a1cd262610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:07.616 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.610+0000 7fa64499a640 1 -- 172.21.15.44:0/3953977043 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a1cd25eb70 msgr2=0x55a1cd262610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:15:07.616 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.610+0000 7fa64499a640 1 --2- 172.21.15.44:0/3953977043 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a1cd25eb70 0x55a1cd262610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:07.616 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.610+0000 7fa64499a640 1 -- 172.21.15.44:0/3953977043 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a1cd2542d0 msgr2=0x55a1cd262090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:15:07.616 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.610+0000 7fa64499a640 1 --2- 172.21.15.44:0/3953977043 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a1cd2542d0 0x55a1cd262090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:07.617 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.610+0000 7fa64499a640 1 -- 172.21.15.44:0/3953977043 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1cd2d7510 con 0x55a1cd2539b0 2024-08-19T00:15:07.617 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.610+0000 7fa64519b640 1 --2- 172.21.15.44:0/3953977043 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a1cd2542d0 0x55a1cd262090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:15:07.617 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.610+0000 7fa64499a640 1 --2- 172.21.15.44:0/3953977043 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a1cd2539b0 0x55a1cd261b50 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fa630004650 tx=0x7fa630013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3645d30b6b5c85e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:15:07.617 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.610+0000 7fa628ff9640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:15:07.617 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.610+0000 7fa628ff9640 1 -- 172.21.15.44:0/3953977043 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa630003e60 con 0x55a1cd2539b0 2024-08-19T00:15:07.617 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.610+0000 7fa628ff9640 1 -- 172.21.15.44:0/3953977043 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7fa63001a040 con 0x55a1cd2539b0 2024-08-19T00:15:07.617 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.610+0000 7fa64a1c3740 1 -- 172.21.15.44:0/3953977043 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa63c005250 con 0x55a1cd2539b0 2024-08-19T00:15:07.617 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.610+0000 7fa628ff9640 1 -- 172.21.15.44:0/3953977043 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa63003c050 con 0x55a1cd2539b0 2024-08-19T00:15:07.617 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.610+0000 7fa64a1c3740 10 client.15738 fetch_fsmap learned FSMap version 30 2024-08-19T00:15:07.617 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.610+0000 7fa64a1c3740 1 -- 172.21.15.44:0/3953977043 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55a1cd2d8820 con 0x55a1cd2539b0 2024-08-19T00:15:07.617 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.611+0000 7fa628ff9640 1 -- 172.21.15.44:0/3953977043 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa63c005250 con 0x55a1cd2539b0 2024-08-19T00:15:07.617 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.611+0000 7fa628ff9640 1 -- 172.21.15.44:0/3953977043 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 30) ==== 8386+0+0 (secure 0 0 0) 0x7fa63002a070 con 0x55a1cd2539b0 2024-08-19T00:15:07.617 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.611+0000 7fa64a1c3740 10 client.15738 fetch_fsmap finished waiting for FSMap version 30 2024-08-19T00:15:07.618 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.611+0000 7fa64a1c3740 10 client.15738 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:15:07.618 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.611+0000 7fa64a1c3740 20 client.15738 populate_metadata read hostname 'smithi044' 2024-08-19T00:15:07.618 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.611+0000 7fa64a1c3740 1 --2- 172.21.15.44:0/3953977043 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55a1cd2d8fb0 0x55a1cd2db3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:07.618 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.611+0000 7fa64a1c3740 4 client.15738 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-19T00:15:07.618 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.611+0000 7fa64a1c3740 1 -- 172.21.15.44:0/3953977043 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a1cd1bf450 con 0x55a1cd2d8fb0 2024-08-19T00:15:07.618 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.611+0000 7fa64519b640 1 --2- 172.21.15.44:0/3953977043 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55a1cd2d8fb0 0x55a1cd2db3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:07.618 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.611+0000 7fa628ff9640 10 client.15738 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:15:07.618 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.611+0000 7fa64519b640 1 --2- 172.21.15.44:0/3953977043 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55a1cd2d8fb0 0x55a1cd2db3d0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c3c9b2faceeca7e server_cookie=c7fe76588620dcb7 in_seq=0 out_seq=0 2024-08-19T00:15:07.620 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.618+0000 7fa628ff9640 1 -- 172.21.15.44:0/3953977043 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a1cd1bf450 con 0x55a1cd2d8fb0 2024-08-19T00:15:07.620 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.618+0000 7fa628ff9640 10 client.15738 handle_command_reply: tid=0 2024-08-19T00:15:07.620 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.618+0000 7fa64a1c3740 1 client.15738 shutdown 2024-08-19T00:15:07.620 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.618+0000 7fa64a1c3740 1 -- 172.21.15.44:0/3953977043 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a1cd2539b0 msgr2=0x55a1cd261b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:07.620 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.618+0000 7fa64a1c3740 1 --2- 172.21.15.44:0/3953977043 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a1cd2539b0 0x55a1cd261b50 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fa630004650 tx=0x7fa630013040 comp rx=0 tx=0).stop 2024-08-19T00:15:07.620 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.618+0000 7fa64a1c3740 1 -- 172.21.15.44:0/3953977043 shutdown_connections 2024-08-19T00:15:07.620 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.618+0000 7fa64a1c3740 1 --2- 172.21.15.44:0/3953977043 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55a1cd2d8fb0 0x55a1cd2db3d0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:07.620 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.618+0000 7fa64a1c3740 1 --2- 172.21.15.44:0/3953977043 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a1cd25eb70 0x55a1cd262610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:07.621 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.618+0000 7fa64a1c3740 1 --2- 172.21.15.44:0/3953977043 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a1cd2542d0 0x55a1cd262090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:07.621 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.618+0000 7fa628ff9640 0 client.15738 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:15:07.621 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.618+0000 7fa64a1c3740 1 --2- 172.21.15.44:0/3953977043 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a1cd2539b0 0x55a1cd261b50 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:07.621 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.618+0000 7fa64a1c3740 1 -- 172.21.15.44:0/3953977043 >> 172.21.15.44:0/3953977043 conn(0x55a1cd24ff20 msgr2=0x55a1cd24ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:15:07.621 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.618+0000 7fa64a1c3740 1 -- 172.21.15.44:0/3953977043 shutdown_connections 2024-08-19T00:15:07.621 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.618+0000 7fa64a1c3740 1 -- 172.21.15.44:0/3953977043 wait complete. 2024-08-19T00:15:07.621 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.618+0000 7fa64a1c3740 20 client.15738 trim_cache size 0 max 16384 2024-08-19T00:15:07.621 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:{ 2024-08-19T00:15:07.621 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "message": "", 2024-08-19T00:15:07.622 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "return_code": 0 2024-08-19T00:15:07.622 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:} 2024-08-19T00:15:07.623 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.619+0000 7fa64619d640 1 -- 172.21.15.44:0/3063471823 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fa62c0a2cf0 msgr2=0x7fa62c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:07.623 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.619+0000 7fa64619d640 1 --2- 172.21.15.44:0/3063471823 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fa62c0a2cf0 0x7fa62c0a51b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa63809bc60 tx=0x7fa638009f90 comp rx=0 tx=0).stop 2024-08-19T00:15:07.623 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.619+0000 7fa64619d640 1 -- 172.21.15.44:0/3063471823 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa6401065f0 msgr2=0x7fa6401a3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:07.623 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.619+0000 7fa64619d640 1 --2- 172.21.15.44:0/3063471823 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa6401065f0 0x7fa6401a3df0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fa63800efd0 tx=0x7fa63800c6a0 comp rx=0 tx=0).stop 2024-08-19T00:15:07.623 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.619+0000 7fa64619d640 1 -- 172.21.15.44:0/3063471823 shutdown_connections 2024-08-19T00:15:07.623 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.619+0000 7fa64619d640 1 --2- 172.21.15.44:0/3063471823 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fa62c0a2cf0 0x7fa62c0a51b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:07.623 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.619+0000 7fa64619d640 1 --2- 172.21.15.44:0/3063471823 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa640100ed0 0x7fa6401992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:07.623 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.619+0000 7fa64619d640 1 --2- 172.21.15.44:0/3063471823 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa6401065f0 0x7fa6401a3df0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:07.623 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.619+0000 7fa64619d640 1 --2- 172.21.15.44:0/3063471823 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa640100530 0x7fa640198d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:07.623 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.619+0000 7fa64619d640 1 -- 172.21.15.44:0/3063471823 >> 172.21.15.44:0/3063471823 conn(0x7fa6400fc1d0 msgr2=0x7fa6400fdab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:15:07.623 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.619+0000 7fa64619d640 1 -- 172.21.15.44:0/3063471823 shutdown_connections 2024-08-19T00:15:07.624 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:07.619+0000 7fa64619d640 1 -- 172.21.15.44:0/3063471823 wait complete. 2024-08-19T00:15:07.649 INFO:tasks.workunit.client.0.smithi044.stdout: 1 16777 3.29 MB/sec warmup 32 sec latency 3155.983 ms 2024-08-19T00:15:08.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:15:07 smithi171 ceph-mon[21810]: pgmap v57: 129 pgs: 129 active+clean; 29 MiB data, 488 MiB used, 1.0 TiB / 1.0 TiB avail; 682 KiB/s rd, 459 KiB/s wr, 89 op/s 2024-08-19T00:15:08.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:15:07 smithi116 ceph-mon[21873]: pgmap v57: 129 pgs: 129 active+clean; 29 MiB data, 488 MiB used, 1.0 TiB / 1.0 TiB avail; 682 KiB/s rd, 459 KiB/s wr, 89 op/s 2024-08-19T00:15:08.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:15:07 smithi044 ceph-mon[18489]: pgmap v57: 129 pgs: 129 active+clean; 29 MiB data, 488 MiB used, 1.0 TiB / 1.0 TiB avail; 682 KiB/s rd, 459 KiB/s wr, 89 op/s 2024-08-19T00:15:08.649 INFO:tasks.workunit.client.0.smithi044.stdout: 1 19571 3.69 MB/sec warmup 33 sec latency 12.513 ms 2024-08-19T00:15:09.649 INFO:tasks.workunit.client.0.smithi044.stdout: 1 22191 4.01 MB/sec warmup 34 sec latency 14.115 ms 2024-08-19T00:15:10.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:15:09 smithi171 ceph-mon[21810]: pgmap v58: 129 pgs: 129 active+clean; 29 MiB data, 488 MiB used, 1.0 TiB / 1.0 TiB avail; 682 KiB/s rd, 459 KiB/s wr, 89 op/s 2024-08-19T00:15:10.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:15:09 smithi116 ceph-mon[21873]: pgmap v58: 129 pgs: 129 active+clean; 29 MiB data, 488 MiB used, 1.0 TiB / 1.0 TiB avail; 682 KiB/s rd, 459 KiB/s wr, 89 op/s 2024-08-19T00:15:10.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:15:09 smithi044 ceph-mon[18489]: pgmap v58: 129 pgs: 129 active+clean; 29 MiB data, 488 MiB used, 1.0 TiB / 1.0 TiB avail; 682 KiB/s rd, 459 KiB/s wr, 89 op/s 2024-08-19T00:15:10.649 INFO:tasks.workunit.client.0.smithi044.stdout: 1 25254 4.42 MB/sec warmup 35 sec latency 22.139 ms 2024-08-19T00:15:11.649 INFO:tasks.workunit.client.0.smithi044.stdout: 1 28047 4.67 MB/sec warmup 36 sec latency 12.084 ms 2024-08-19T00:15:12.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:15:11 smithi171 ceph-mon[21810]: pgmap v59: 129 pgs: 129 active+clean; 32 MiB data, 507 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 794 KiB/s wr, 140 op/s 2024-08-19T00:15:12.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:15:11 smithi116 ceph-mon[21873]: pgmap v59: 129 pgs: 129 active+clean; 32 MiB data, 507 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 794 KiB/s wr, 140 op/s 2024-08-19T00:15:12.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:15:11 smithi044 ceph-mon[18489]: pgmap v59: 129 pgs: 129 active+clean; 32 MiB data, 507 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 794 KiB/s wr, 140 op/s 2024-08-19T00:15:12.649 INFO:tasks.workunit.client.0.smithi044.stdout: 1 30764 4.89 MB/sec warmup 37 sec latency 12.153 ms 2024-08-19T00:15:13.649 INFO:tasks.workunit.client.0.smithi044.stdout: 1 32867 5.10 MB/sec warmup 38 sec latency 20.289 ms 2024-08-19T00:15:14.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:15:13 smithi171 ceph-mon[21810]: pgmap v60: 129 pgs: 129 active+clean; 32 MiB data, 507 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 782 KiB/s wr, 133 op/s 2024-08-19T00:15:14.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:15:13 smithi116 ceph-mon[21873]: pgmap v60: 129 pgs: 129 active+clean; 32 MiB data, 507 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 782 KiB/s wr, 133 op/s 2024-08-19T00:15:14.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:15:13 smithi044 ceph-mon[18489]: pgmap v60: 129 pgs: 129 active+clean; 32 MiB data, 507 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 782 KiB/s wr, 133 op/s 2024-08-19T00:15:14.649 INFO:tasks.workunit.client.0.smithi044.stdout: 1 35819 5.43 MB/sec warmup 39 sec latency 22.777 ms 2024-08-19T00:15:15.649 INFO:tasks.workunit.client.0.smithi044.stdout: 1 38497 5.62 MB/sec warmup 40 sec latency 21.128 ms 2024-08-19T00:15:16.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:15:15 smithi171 ceph-mon[21810]: pgmap v61: 129 pgs: 129 active+clean; 40 MiB data, 522 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 1.6 MiB/s wr, 241 op/s 2024-08-19T00:15:16.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:15:15 smithi116 ceph-mon[21873]: pgmap v61: 129 pgs: 129 active+clean; 40 MiB data, 522 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 1.6 MiB/s wr, 241 op/s 2024-08-19T00:15:16.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:15:15 smithi044 ceph-mon[18489]: pgmap v61: 129 pgs: 129 active+clean; 40 MiB data, 522 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 1.6 MiB/s wr, 241 op/s 2024-08-19T00:15:16.649 INFO:tasks.workunit.client.0.smithi044.stdout: 1 41354 5.81 MB/sec warmup 41 sec latency 14.490 ms 2024-08-19T00:15:17.650 INFO:tasks.workunit.client.0.smithi044.stdout: 1 43590 5.99 MB/sec warmup 42 sec latency 13.591 ms 2024-08-19T00:15:18.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:15:17 smithi171 ceph-mon[21810]: pgmap v62: 129 pgs: 129 active+clean; 40 MiB data, 522 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.1 MiB/s wr, 159 op/s 2024-08-19T00:15:18.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:15:17 smithi116 ceph-mon[21873]: pgmap v62: 129 pgs: 129 active+clean; 40 MiB data, 522 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.1 MiB/s wr, 159 op/s 2024-08-19T00:15:18.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:15:17 smithi044 ceph-mon[18489]: pgmap v62: 129 pgs: 129 active+clean; 40 MiB data, 522 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.1 MiB/s wr, 159 op/s 2024-08-19T00:15:18.649 INFO:tasks.workunit.client.0.smithi044.stdout: 1 46616 6.27 MB/sec warmup 43 sec latency 18.582 ms 2024-08-19T00:15:19.650 INFO:tasks.workunit.client.0.smithi044.stdout: 1 49686 6.52 MB/sec warmup 44 sec latency 13.173 ms 2024-08-19T00:15:20.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:15:19 smithi171 ceph-mon[21810]: pgmap v63: 129 pgs: 129 active+clean; 40 MiB data, 522 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.1 MiB/s wr, 159 op/s 2024-08-19T00:15:20.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:15:19 smithi116 ceph-mon[21873]: pgmap v63: 129 pgs: 129 active+clean; 40 MiB data, 522 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.1 MiB/s wr, 159 op/s 2024-08-19T00:15:20.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:15:19 smithi044 ceph-mon[18489]: pgmap v63: 129 pgs: 129 active+clean; 40 MiB data, 522 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.1 MiB/s wr, 159 op/s 2024-08-19T00:15:20.650 INFO:tasks.workunit.client.0.smithi044.stdout: 1 52132 6.57 MB/sec warmup 45 sec latency 14.661 ms 2024-08-19T00:15:20.714 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.710+0000 7fde968c4640 1 -- 172.21.15.44:0/2109693470 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde90105f50 msgr2=0x7fde90106330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:20.714 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.710+0000 7fde968c4640 1 --2- 172.21.15.44:0/2109693470 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde90105f50 0x7fde90106330 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fde80009930 tx=0x7fde8002a420 comp rx=0 tx=0).stop 2024-08-19T00:15:20.715 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.710+0000 7fde968c4640 1 -- 172.21.15.44:0/2109693470 shutdown_connections 2024-08-19T00:15:20.715 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.710+0000 7fde968c4640 1 --2- 172.21.15.44:0/2109693470 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde90100d00 0x7fde9010cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:20.715 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.710+0000 7fde968c4640 1 --2- 172.21.15.44:0/2109693470 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde90100360 0x7fde901007c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:20.715 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.710+0000 7fde968c4640 1 --2- 172.21.15.44:0/2109693470 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde90105f50 0x7fde90106330 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:20.715 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.710+0000 7fde968c4640 1 -- 172.21.15.44:0/2109693470 >> 172.21.15.44:0/2109693470 conn(0x7fde90075c20 msgr2=0x7fde90076030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:15:20.715 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.711+0000 7fde968c4640 1 -- 172.21.15.44:0/2109693470 shutdown_connections 2024-08-19T00:15:20.715 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.711+0000 7fde968c4640 1 -- 172.21.15.44:0/2109693470 wait complete. 2024-08-19T00:15:20.715 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.711+0000 7fde968c4640 1 Processor -- start 2024-08-19T00:15:20.715 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.711+0000 7fde968c4640 1 -- start start 2024-08-19T00:15:20.715 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.712+0000 7fde968c4640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde90100360 0x7fde90198130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:20.716 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.712+0000 7fde968c4640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde90100d00 0x7fde90198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:20.716 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.712+0000 7fde968c4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde90105f50 0x7fde9019c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:20.716 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.712+0000 7fde968c4640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fde9010fa60 con 0x7fde90105f50 2024-08-19T00:15:20.716 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.712+0000 7fde968c4640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fde9010f8e0 con 0x7fde90100d00 2024-08-19T00:15:20.716 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.712+0000 7fde968c4640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fde9010fbe0 con 0x7fde90100360 2024-08-19T00:15:20.716 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.712+0000 7fde94e61640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde90105f50 0x7fde9019c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:20.716 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.712+0000 7fde94e61640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde90105f50 0x7fde9019c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37966/0 (socket says 172.21.15.44:37966) 2024-08-19T00:15:20.716 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.712+0000 7fde94e61640 1 -- 172.21.15.44:0/3480849858 learned_addr learned my addr 172.21.15.44:0/3480849858 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:15:20.717 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.712+0000 7fde8ffff640 1 --2- 172.21.15.44:0/3480849858 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde90100360 0x7fde90198130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:20.717 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.712+0000 7fde8f7fe640 1 --2- 172.21.15.44:0/3480849858 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde90100d00 0x7fde90198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:20.717 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.712+0000 7fde94e61640 1 -- 172.21.15.44:0/3480849858 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde90100360 msgr2=0x7fde90198130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:20.717 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.712+0000 7fde94e61640 1 --2- 172.21.15.44:0/3480849858 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde90100360 0x7fde90198130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:20.717 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.712+0000 7fde94e61640 1 -- 172.21.15.44:0/3480849858 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde90100d00 msgr2=0x7fde90198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:20.717 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.712+0000 7fde94e61640 1 --2- 172.21.15.44:0/3480849858 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde90100d00 0x7fde90198670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:20.717 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.712+0000 7fde94e61640 1 -- 172.21.15.44:0/3480849858 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde9019d120 con 0x7fde90105f50 2024-08-19T00:15:20.717 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.712+0000 7fde8f7fe640 1 --2- 172.21.15.44:0/3480849858 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde90100d00 0x7fde90198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:15:20.717 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.712+0000 7fde94e61640 1 --2- 172.21.15.44:0/3480849858 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde90105f50 0x7fde9019c9f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fde8800eb10 tx=0x7fde8800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:15:20.718 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.712+0000 7fde8d7fa640 1 -- 172.21.15.44:0/3480849858 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde88004b20 con 0x7fde90105f50 2024-08-19T00:15:20.718 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.712+0000 7fde968c4640 1 -- 172.21.15.44:0/3480849858 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde9019d410 con 0x7fde90105f50 2024-08-19T00:15:20.718 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.712+0000 7fde8d7fa640 1 -- 172.21.15.44:0/3480849858 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde88004cc0 con 0x7fde90105f50 2024-08-19T00:15:20.718 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.712+0000 7fde8d7fa640 1 -- 172.21.15.44:0/3480849858 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde88010760 con 0x7fde90105f50 2024-08-19T00:15:20.718 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.713+0000 7fde968c4640 1 -- 172.21.15.44:0/3480849858 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde901a4ca0 con 0x7fde90105f50 2024-08-19T00:15:20.725 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.715+0000 7fde8d7fa640 1 -- 172.21.15.44:0/3480849858 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fde88005020 con 0x7fde90105f50 2024-08-19T00:15:20.725 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.715+0000 7fde99685740 1 Processor -- start 2024-08-19T00:15:20.725 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.715+0000 7fde99685740 1 -- start start 2024-08-19T00:15:20.725 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.716+0000 7fde8d7fa640 1 --2- 172.21.15.44:0/3480849858 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fde780a2da0 0x7fde780a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:20.725 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.716+0000 7fde99685740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556fa1a787d0 0x556fa1a78bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:20.726 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.716+0000 7fde99685740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556fa1a790f0 0x556fa1a83450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:20.726 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.716+0000 7fde99685740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556fa1a83990 0x556fa1a85d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:20.726 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.716+0000 7fde99685740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556fa19dc9d0 con 0x556fa1a787d0 2024-08-19T00:15:20.726 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.716+0000 7fde99685740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x556fa1984820 con 0x556fa1a83990 2024-08-19T00:15:20.726 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.716+0000 7fde99685740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x556fa19d8990 con 0x556fa1a790f0 2024-08-19T00:15:20.726 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.716+0000 7fde8d7fa640 1 -- 172.21.15.44:0/3480849858 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7fde880cfe20 con 0x7fde90105f50 2024-08-19T00:15:20.726 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.716+0000 7fde8f7fe640 1 --2- 172.21.15.44:0/3480849858 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fde780a2da0 0x7fde780a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:20.726 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.716+0000 7fde8ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556fa1a787d0 0x556fa1a78bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:20.726 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.716+0000 7fde8ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556fa1a787d0 0x556fa1a78bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37980/0 (socket says 172.21.15.44:37980) 2024-08-19T00:15:20.726 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.716+0000 7fde8ffff640 1 -- 172.21.15.44:0/394464983 learned_addr learned my addr 172.21.15.44:0/394464983 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:15:20.726 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.716+0000 7fde8f7fe640 1 --2- 172.21.15.44:0/394464983 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556fa1a790f0 0x556fa1a83450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:20.726 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.716+0000 7fde94e61640 1 --2- 172.21.15.44:0/394464983 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556fa1a83990 0x556fa1a85d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:20.727 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.716+0000 7fde8ffff640 1 -- 172.21.15.44:0/394464983 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556fa1a790f0 msgr2=0x556fa1a83450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:15:20.727 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.716+0000 7fde8ffff640 1 --2- 172.21.15.44:0/394464983 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556fa1a790f0 0x556fa1a83450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:20.727 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.716+0000 7fde8ffff640 1 -- 172.21.15.44:0/394464983 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556fa1a83990 msgr2=0x556fa1a85d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:15:20.727 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.716+0000 7fde8ffff640 1 --2- 172.21.15.44:0/394464983 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556fa1a83990 0x556fa1a85d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:20.727 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.716+0000 7fde8ffff640 1 -- 172.21.15.44:0/394464983 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556fa16f0210 con 0x556fa1a787d0 2024-08-19T00:15:20.727 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.716+0000 7fde8f7fe640 1 --2- 172.21.15.44:0/3480849858 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fde780a2da0 0x7fde780a5260 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fde8400afd0 tx=0x7fde8400aca0 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:15:20.727 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.716+0000 7fde8ffff640 1 --2- 172.21.15.44:0/394464983 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556fa1a787d0 0x556fa1a78bb0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fde8002a940 tx=0x7fde80005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8334412e2a77b36c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:15:20.727 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.717+0000 7fde767fc640 1 -- 172.21.15.44:0/394464983 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde80040070 con 0x556fa1a787d0 2024-08-19T00:15:20.727 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.717+0000 7fde767fc640 1 -- 172.21.15.44:0/394464983 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde800317b0 con 0x556fa1a787d0 2024-08-19T00:15:20.727 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.717+0000 7fde767fc640 1 -- 172.21.15.44:0/394464983 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde80035040 con 0x556fa1a787d0 2024-08-19T00:15:20.727 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.717+0000 7fde99685740 1 -- 172.21.15.44:0/394464983 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556fa1a787d0 msgr2=0x556fa1a78bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:20.727 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.717+0000 7fde99685740 1 --2- 172.21.15.44:0/394464983 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556fa1a787d0 0x556fa1a78bb0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fde8002a940 tx=0x7fde80005bd0 comp rx=0 tx=0).stop 2024-08-19T00:15:20.727 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.717+0000 7fde99685740 1 -- 172.21.15.44:0/394464983 shutdown_connections 2024-08-19T00:15:20.727 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.717+0000 7fde99685740 1 --2- 172.21.15.44:0/394464983 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556fa1a790f0 0x556fa1a83450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:20.727 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.717+0000 7fde99685740 1 --2- 172.21.15.44:0/394464983 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556fa1a83990 0x556fa1a85d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:20.728 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.717+0000 7fde99685740 1 --2- 172.21.15.44:0/394464983 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556fa1a787d0 0x556fa1a78bb0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:20.728 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.717+0000 7fde99685740 1 -- 172.21.15.44:0/394464983 >> 172.21.15.44:0/394464983 conn(0x556fa1a74d40 msgr2=0x556fa1a75120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:15:20.728 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.717+0000 7fde99685740 1 -- 172.21.15.44:0/394464983 shutdown_connections 2024-08-19T00:15:20.728 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.717+0000 7fde99685740 1 -- 172.21.15.44:0/394464983 wait complete. 2024-08-19T00:15:20.728 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.718+0000 7fde99685740 1 -- start start 2024-08-19T00:15:20.728 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.718+0000 7fde99685740 1 Processor -- start 2024-08-19T00:15:20.728 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.718+0000 7fde99685740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556fa1a787d0 0x556fa1a807e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:20.728 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.718+0000 7fde99685740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556fa1a790f0 0x556fa1a80d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:20.728 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.718+0000 7fde99685740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556fa1a83990 0x556fa1a81260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:20.728 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.718+0000 7fde99685740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556fa1a86560 con 0x556fa1a83990 2024-08-19T00:15:20.728 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.718+0000 7fde99685740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x556fa1998520 con 0x556fa1a790f0 2024-08-19T00:15:20.728 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.718+0000 7fde99685740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x556fa1a866e0 con 0x556fa1a787d0 2024-08-19T00:15:20.728 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.718+0000 7fde99685740 10 client.0 _ll_register_callbacks cb 0x556fa16efa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:15:20.728 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.718+0000 7fde94e61640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556fa1a83990 0x556fa1a81260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:20.729 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.718+0000 7fde8ffff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556fa1a787d0 0x556fa1a807e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:20.729 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.718+0000 7fde8f7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556fa1a790f0 0x556fa1a80d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:20.729 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.718+0000 7fde94e61640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556fa1a83990 0x556fa1a81260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37992/0 (socket says 172.21.15.44:37992) 2024-08-19T00:15:20.729 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.718+0000 7fde8ffff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556fa1a787d0 0x556fa1a807e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.44:44554/0 (socket says 172.21.15.44:44554) 2024-08-19T00:15:20.729 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.718+0000 7fde8f7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556fa1a790f0 0x556fa1a80d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.44:47160/0 (socket says 172.21.15.44:47160) 2024-08-19T00:15:20.729 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.718+0000 7fde94e61640 1 -- 172.21.15.44:0/39342079 learned_addr learned my addr 172.21.15.44:0/39342079 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:15:20.729 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.719+0000 7fde94e61640 1 -- 172.21.15.44:0/39342079 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556fa1a787d0 msgr2=0x556fa1a807e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:15:20.729 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.719+0000 7fde94e61640 1 --2- 172.21.15.44:0/39342079 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556fa1a787d0 0x556fa1a807e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:20.729 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.719+0000 7fde94e61640 1 -- 172.21.15.44:0/39342079 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556fa1a790f0 msgr2=0x556fa1a80d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:15:20.729 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.719+0000 7fde94e61640 1 --2- 172.21.15.44:0/39342079 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556fa1a790f0 0x556fa1a80d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:20.729 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.719+0000 7fde94e61640 1 -- 172.21.15.44:0/39342079 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556fa17bc620 con 0x556fa1a83990 2024-08-19T00:15:20.729 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.719+0000 7fde8f7fe640 1 --2- 172.21.15.44:0/39342079 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556fa1a790f0 0x556fa1a80d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:15:20.730 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.719+0000 7fde94e61640 1 --2- 172.21.15.44:0/39342079 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556fa1a83990 0x556fa1a81260 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fde880049d0 tx=0x7fde8809bae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=729f1ff00f58c931 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:15:20.730 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.719+0000 7fde6f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:15:20.730 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.719+0000 7fde6f7fe640 1 -- 172.21.15.44:0/39342079 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde880bade0 con 0x556fa1a83990 2024-08-19T00:15:20.730 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.719+0000 7fde6f7fe640 1 -- 172.21.15.44:0/39342079 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7fde88005310 con 0x556fa1a83990 2024-08-19T00:15:20.730 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.719+0000 7fde99685740 1 -- 172.21.15.44:0/39342079 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde800317b0 con 0x556fa1a83990 2024-08-19T00:15:20.730 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.719+0000 7fde6f7fe640 1 -- 172.21.15.44:0/39342079 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fde8809bfa0 con 0x556fa1a83990 2024-08-19T00:15:20.730 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.719+0000 7fde99685740 10 client.15750 fetch_fsmap learned FSMap version 30 2024-08-19T00:15:20.730 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.719+0000 7fde99685740 1 -- 172.21.15.44:0/39342079 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x556fa1a92190 con 0x556fa1a83990 2024-08-19T00:15:20.730 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.719+0000 7fde6f7fe640 1 -- 172.21.15.44:0/39342079 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde800317b0 con 0x556fa1a83990 2024-08-19T00:15:20.730 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.720+0000 7fde6f7fe640 1 -- 172.21.15.44:0/39342079 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 30) ==== 8386+0+0 (secure 0 0 0) 0x7fde8809b3f0 con 0x556fa1a83990 2024-08-19T00:15:20.730 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.720+0000 7fde99685740 10 client.15750 fetch_fsmap finished waiting for FSMap version 30 2024-08-19T00:15:20.730 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.720+0000 7fde99685740 10 client.15750 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:15:20.731 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.720+0000 7fde99685740 20 client.15750 populate_metadata read hostname 'smithi044' 2024-08-19T00:15:20.731 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.720+0000 7fde99685740 1 --2- 172.21.15.44:0/39342079 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x556fa1a93710 0x556fa1a95b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:20.731 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.720+0000 7fde99685740 4 client.15750 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:15:20.731 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.720+0000 7fde99685740 1 -- 172.21.15.44:0/39342079 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556fa19ea100 con 0x556fa1a93710 2024-08-19T00:15:20.731 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.720+0000 7fde8ffff640 1 --2- 172.21.15.44:0/39342079 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x556fa1a93710 0x556fa1a95b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:20.731 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.720+0000 7fde6f7fe640 10 client.15750 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:15:20.731 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.720+0000 7fde8ffff640 1 --2- 172.21.15.44:0/39342079 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x556fa1a93710 0x556fa1a95b90 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e3a8a9f91de0e0a server_cookie=422d7be4e78d0807 in_seq=0 out_seq=0 2024-08-19T00:15:20.731 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.721+0000 7fde6f7fe640 1 -- 172.21.15.44:0/39342079 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556fa19ea100 con 0x556fa1a93710 2024-08-19T00:15:20.731 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.721+0000 7fde6f7fe640 10 client.15750 handle_command_reply: tid=0 2024-08-19T00:15:20.731 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.721+0000 7fde99685740 1 client.15750 shutdown 2024-08-19T00:15:20.731 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.721+0000 7fde99685740 1 -- 172.21.15.44:0/39342079 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556fa1a83990 msgr2=0x556fa1a81260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:20.731 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.721+0000 7fde99685740 1 --2- 172.21.15.44:0/39342079 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556fa1a83990 0x556fa1a81260 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fde880049d0 tx=0x7fde8809bae0 comp rx=0 tx=0).stop 2024-08-19T00:15:20.731 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.721+0000 7fde99685740 1 -- 172.21.15.44:0/39342079 shutdown_connections 2024-08-19T00:15:20.732 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.721+0000 7fde99685740 1 --2- 172.21.15.44:0/39342079 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x556fa1a93710 0x556fa1a95b90 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:20.732 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.721+0000 7fde99685740 1 --2- 172.21.15.44:0/39342079 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556fa1a83990 0x556fa1a81260 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:20.732 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.721+0000 7fde99685740 1 --2- 172.21.15.44:0/39342079 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556fa1a790f0 0x556fa1a80d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:20.732 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.721+0000 7fde6f7fe640 0 client.15750 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:15:20.732 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.721+0000 7fde99685740 1 --2- 172.21.15.44:0/39342079 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556fa1a787d0 0x556fa1a807e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:20.732 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.721+0000 7fde99685740 1 -- 172.21.15.44:0/39342079 >> 172.21.15.44:0/39342079 conn(0x556fa1a74d40 msgr2=0x556fa1a73ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:15:20.732 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.721+0000 7fde99685740 1 -- 172.21.15.44:0/39342079 shutdown_connections 2024-08-19T00:15:20.732 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.721+0000 7fde99685740 1 -- 172.21.15.44:0/39342079 wait complete. 2024-08-19T00:15:20.732 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.721+0000 7fde99685740 20 client.15750 trim_cache size 0 max 16384 2024-08-19T00:15:20.743 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.736+0000 7fde99685740 1 Processor -- start 2024-08-19T00:15:20.743 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.736+0000 7fde99685740 1 -- start start 2024-08-19T00:15:20.743 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.736+0000 7fde99685740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556fa1a787d0 0x556fa1a7b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:20.743 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.736+0000 7fde99685740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556fa1a790f0 0x556fa1a9b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:20.743 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.736+0000 7fde99685740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556fa1a83990 0x556fa1a9b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:20.743 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.736+0000 7fde99685740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fde901aecd0 con 0x556fa1a787d0 2024-08-19T00:15:20.743 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.736+0000 7fde99685740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fde901b08d0 con 0x556fa1a83990 2024-08-19T00:15:20.743 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.736+0000 7fde99685740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fde901af3a0 con 0x556fa1a790f0 2024-08-19T00:15:20.743 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.736+0000 7fde8ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556fa1a787d0 0x556fa1a7b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:20.744 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.736+0000 7fde8ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556fa1a787d0 0x556fa1a7b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37996/0 (socket says 172.21.15.44:37996) 2024-08-19T00:15:20.744 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.737+0000 7fde8ffff640 1 -- 172.21.15.44:0/3270643652 learned_addr learned my addr 172.21.15.44:0/3270643652 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:15:20.744 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.737+0000 7fde8f7fe640 1 --2- 172.21.15.44:0/3270643652 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556fa1a790f0 0x556fa1a9b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:20.744 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.737+0000 7fde94e61640 1 --2- 172.21.15.44:0/3270643652 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556fa1a83990 0x556fa1a9b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:20.744 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.737+0000 7fde8ffff640 1 -- 172.21.15.44:0/3270643652 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556fa1a790f0 msgr2=0x556fa1a9b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:15:20.744 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.737+0000 7fde8ffff640 1 --2- 172.21.15.44:0/3270643652 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556fa1a790f0 0x556fa1a9b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:20.744 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.737+0000 7fde8ffff640 1 -- 172.21.15.44:0/3270643652 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556fa1a83990 msgr2=0x556fa1a9b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:15:20.744 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.737+0000 7fde8ffff640 1 --2- 172.21.15.44:0/3270643652 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556fa1a83990 0x556fa1a9b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:20.744 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.737+0000 7fde8ffff640 1 -- 172.21.15.44:0/3270643652 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556fa1a96210 con 0x556fa1a787d0 2024-08-19T00:15:20.744 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.737+0000 7fde8ffff640 1 --2- 172.21.15.44:0/3270643652 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556fa1a787d0 0x556fa1a7b240 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fde80005c40 tx=0x7fde80000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13521db61af10e14 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:15:20.744 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.737+0000 7fde75ffb640 1 -- 172.21.15.44:0/3270643652 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde80040050 con 0x556fa1a787d0 2024-08-19T00:15:20.744 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.737+0000 7fde75ffb640 1 -- 172.21.15.44:0/3270643652 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde80005610 con 0x556fa1a787d0 2024-08-19T00:15:20.744 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.737+0000 7fde75ffb640 1 -- 172.21.15.44:0/3270643652 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde80035040 con 0x556fa1a787d0 2024-08-19T00:15:20.745 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.738+0000 7fde99685740 1 -- 172.21.15.44:0/3270643652 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556fa1a787d0 msgr2=0x556fa1a7b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:20.745 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.738+0000 7fde99685740 1 --2- 172.21.15.44:0/3270643652 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556fa1a787d0 0x556fa1a7b240 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fde80005c40 tx=0x7fde80000bc0 comp rx=0 tx=0).stop 2024-08-19T00:15:20.745 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.738+0000 7fde99685740 1 -- 172.21.15.44:0/3270643652 shutdown_connections 2024-08-19T00:15:20.745 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.738+0000 7fde99685740 1 --2- 172.21.15.44:0/3270643652 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556fa1a790f0 0x556fa1a9b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:20.745 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.738+0000 7fde99685740 1 --2- 172.21.15.44:0/3270643652 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556fa1a83990 0x556fa1a9b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:20.745 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.738+0000 7fde99685740 1 --2- 172.21.15.44:0/3270643652 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556fa1a787d0 0x556fa1a7b240 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:20.745 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.738+0000 7fde99685740 1 -- 172.21.15.44:0/3270643652 >> 172.21.15.44:0/3270643652 conn(0x556fa1a74d40 msgr2=0x556fa1a82750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:15:20.745 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.738+0000 7fde99685740 1 -- 172.21.15.44:0/3270643652 shutdown_connections 2024-08-19T00:15:20.745 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.738+0000 7fde99685740 1 -- 172.21.15.44:0/3270643652 wait complete. 2024-08-19T00:15:20.745 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.738+0000 7fde99685740 1 -- start start 2024-08-19T00:15:20.745 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.738+0000 7fde99685740 1 Processor -- start 2024-08-19T00:15:20.745 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.739+0000 7fde99685740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556fa1a787d0 0x556fa1a86ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:20.745 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.739+0000 7fde99685740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556fa1a790f0 0x556fa1a87430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:20.745 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.739+0000 7fde99685740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556fa1a83990 0x556fa1afc460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:20.746 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.739+0000 7fde99685740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fde901b0140 con 0x556fa1a83990 2024-08-19T00:15:20.746 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.739+0000 7fde99685740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fde901afa70 con 0x556fa1a787d0 2024-08-19T00:15:20.746 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.739+0000 7fde99685740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fde901accb0 con 0x556fa1a790f0 2024-08-19T00:15:20.746 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.739+0000 7fde99685740 10 client.0 _ll_register_callbacks cb 0x7fde88004e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:15:20.746 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.739+0000 7fde94e61640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556fa1a83990 0x556fa1afc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:20.746 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.739+0000 7fde8f7fe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556fa1a790f0 0x556fa1a87430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:20.746 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.739+0000 7fde8ffff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556fa1a787d0 0x556fa1a86ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:20.747 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.739+0000 7fde8f7fe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556fa1a790f0 0x556fa1a87430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.44:44568/0 (socket says 172.21.15.44:44568) 2024-08-19T00:15:20.747 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.739+0000 7fde8f7fe640 1 -- 172.21.15.44:0/831798299 learned_addr learned my addr 172.21.15.44:0/831798299 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:15:20.747 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.739+0000 7fde8f7fe640 1 -- 172.21.15.44:0/831798299 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556fa1a787d0 msgr2=0x556fa1a86ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:15:20.747 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.739+0000 7fde8f7fe640 1 --2- 172.21.15.44:0/831798299 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556fa1a787d0 0x556fa1a86ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:20.747 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.739+0000 7fde8f7fe640 1 -- 172.21.15.44:0/831798299 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556fa1a83990 msgr2=0x556fa1afc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:15:20.747 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.739+0000 7fde8f7fe640 1 --2- 172.21.15.44:0/831798299 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556fa1a83990 0x556fa1afc460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:20.747 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.739+0000 7fde8f7fe640 1 -- 172.21.15.44:0/831798299 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556fa1afc9f0 con 0x556fa1a790f0 2024-08-19T00:15:20.747 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.739+0000 7fde8f7fe640 1 --2- 172.21.15.44:0/831798299 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556fa1a790f0 0x556fa1a87430 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x556fa1a80050 tx=0x7fde84004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad36f6dbb2386cd0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:15:20.747 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.739+0000 7fde6f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.171:3300/0 2024-08-19T00:15:20.747 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.740+0000 7fde6f7fe640 1 -- 172.21.15.44:0/831798299 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde84029400 con 0x556fa1a790f0 2024-08-19T00:15:20.747 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.740+0000 7fde99685740 1 -- 172.21.15.44:0/831798299 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde80005610 con 0x556fa1a790f0 2024-08-19T00:15:20.747 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.740+0000 7fde6f7fe640 1 -- 172.21.15.44:0/831798299 <== mon.1 v2:172.21.15.171:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7fde84025070 con 0x556fa1a790f0 2024-08-19T00:15:20.748 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.740+0000 7fde6f7fe640 1 -- 172.21.15.44:0/831798299 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fde84037050 con 0x556fa1a790f0 2024-08-19T00:15:20.748 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.740+0000 7fde99685740 10 client.25153 fetch_fsmap learned FSMap version 30 2024-08-19T00:15:20.748 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.740+0000 7fde99685740 1 -- 172.21.15.44:0/831798299 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x556fa1afdd80 con 0x556fa1a790f0 2024-08-19T00:15:20.748 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.740+0000 7fde6f7fe640 1 -- 172.21.15.44:0/831798299 <== mon.1 v2:172.21.15.171:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde80005610 con 0x556fa1a790f0 2024-08-19T00:15:20.748 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.740+0000 7fde6f7fe640 1 -- 172.21.15.44:0/831798299 <== mon.1 v2:172.21.15.171:3300/0 5 ==== fsmap(e 30) ==== 8386+0+0 (secure 0 0 0) 0x7fde8400b040 con 0x556fa1a790f0 2024-08-19T00:15:20.748 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.740+0000 7fde99685740 10 client.25153 fetch_fsmap finished waiting for FSMap version 30 2024-08-19T00:15:20.748 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.740+0000 7fde99685740 10 client.25153 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:15:20.748 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.740+0000 7fde99685740 20 client.25153 populate_metadata read hostname 'smithi044' 2024-08-19T00:15:20.748 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.740+0000 7fde99685740 1 --2- 172.21.15.44:0/831798299 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x556fa1afe5f0 0x556fa1b00a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:20.748 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.740+0000 7fde99685740 4 client.25153 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-19T00:15:20.749 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.740+0000 7fde99685740 1 -- 172.21.15.44:0/831798299 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556fa19e4450 con 0x556fa1afe5f0 2024-08-19T00:15:20.749 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.740+0000 7fde8ffff640 1 --2- 172.21.15.44:0/831798299 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x556fa1afe5f0 0x556fa1b00a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:20.749 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.741+0000 7fde6f7fe640 10 client.25153 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:15:20.749 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.741+0000 7fde8ffff640 1 --2- 172.21.15.44:0/831798299 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x556fa1afe5f0 0x556fa1b00a10 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8a2e35a5970244e server_cookie=9b9377af6ee1d25b in_seq=0 out_seq=0 2024-08-19T00:15:20.750 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.747+0000 7fde6f7fe640 1 -- 172.21.15.44:0/831798299 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556fa19e4450 con 0x556fa1afe5f0 2024-08-19T00:15:20.750 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.747+0000 7fde6f7fe640 10 client.25153 handle_command_reply: tid=0 2024-08-19T00:15:20.750 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.747+0000 7fde99685740 1 client.25153 shutdown 2024-08-19T00:15:20.751 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.748+0000 7fde99685740 1 -- 172.21.15.44:0/831798299 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556fa1a790f0 msgr2=0x556fa1a87430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:20.751 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.748+0000 7fde99685740 1 --2- 172.21.15.44:0/831798299 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556fa1a790f0 0x556fa1a87430 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x556fa1a80050 tx=0x7fde84004730 comp rx=0 tx=0).stop 2024-08-19T00:15:20.751 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.748+0000 7fde99685740 1 -- 172.21.15.44:0/831798299 shutdown_connections 2024-08-19T00:15:20.751 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.748+0000 7fde99685740 1 --2- 172.21.15.44:0/831798299 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x556fa1afe5f0 0x556fa1b00a10 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:20.751 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.748+0000 7fde99685740 1 --2- 172.21.15.44:0/831798299 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556fa1a790f0 0x556fa1a87430 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:20.751 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.748+0000 7fde99685740 1 --2- 172.21.15.44:0/831798299 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556fa1a83990 0x556fa1afc460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:20.751 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.748+0000 7fde6f7fe640 0 client.25153 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:15:20.751 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.748+0000 7fde99685740 1 --2- 172.21.15.44:0/831798299 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556fa1a787d0 0x556fa1a86ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:20.751 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.748+0000 7fde99685740 1 -- 172.21.15.44:0/831798299 >> 172.21.15.44:0/831798299 conn(0x556fa1a74d40 msgr2=0x556fa1a807a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:15:20.751 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.748+0000 7fde99685740 1 -- 172.21.15.44:0/831798299 shutdown_connections 2024-08-19T00:15:20.751 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.748+0000 7fde99685740 1 -- 172.21.15.44:0/831798299 wait complete. 2024-08-19T00:15:20.751 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.748+0000 7fde99685740 20 client.25153 trim_cache size 0 max 16384 2024-08-19T00:15:20.752 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:{ 2024-08-19T00:15:20.752 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "message": "", 2024-08-19T00:15:20.752 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "return_code": 0 2024-08-19T00:15:20.752 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:} 2024-08-19T00:15:20.753 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.748+0000 7fde968c4640 1 -- 172.21.15.44:0/3480849858 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fde780a2da0 msgr2=0x7fde780a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:20.753 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.748+0000 7fde968c4640 1 --2- 172.21.15.44:0/3480849858 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fde780a2da0 0x7fde780a5260 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fde8400afd0 tx=0x7fde8400aca0 comp rx=0 tx=0).stop 2024-08-19T00:15:20.753 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.748+0000 7fde968c4640 1 -- 172.21.15.44:0/3480849858 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde90105f50 msgr2=0x7fde9019c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:20.753 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.748+0000 7fde968c4640 1 --2- 172.21.15.44:0/3480849858 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde90105f50 0x7fde9019c9f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fde8800eb10 tx=0x7fde8800c2d0 comp rx=0 tx=0).stop 2024-08-19T00:15:20.753 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.748+0000 7fde968c4640 1 -- 172.21.15.44:0/3480849858 shutdown_connections 2024-08-19T00:15:20.753 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.748+0000 7fde968c4640 1 --2- 172.21.15.44:0/3480849858 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fde780a2da0 0x7fde780a5260 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:20.754 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.748+0000 7fde968c4640 1 --2- 172.21.15.44:0/3480849858 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde90105f50 0x7fde9019c9f0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:20.754 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.748+0000 7fde968c4640 1 --2- 172.21.15.44:0/3480849858 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde90100d00 0x7fde90198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:20.754 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.748+0000 7fde968c4640 1 --2- 172.21.15.44:0/3480849858 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde90100360 0x7fde90198130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:20.754 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.748+0000 7fde968c4640 1 -- 172.21.15.44:0/3480849858 >> 172.21.15.44:0/3480849858 conn(0x7fde90075c20 msgr2=0x7fde90104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:15:20.754 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.749+0000 7fde968c4640 1 -- 172.21.15.44:0/3480849858 shutdown_connections 2024-08-19T00:15:20.754 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:20.749+0000 7fde968c4640 1 -- 172.21.15.44:0/3480849858 wait complete. 2024-08-19T00:15:21.650 INFO:tasks.workunit.client.0.smithi044.stdout: 1 54499 6.74 MB/sec warmup 46 sec latency 12.418 ms 2024-08-19T00:15:22.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:15:21 smithi171 ceph-mon[21810]: pgmap v64: 129 pgs: 129 active+clean; 48 MiB data, 532 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 1.9 MiB/s wr, 266 op/s 2024-08-19T00:15:22.394 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:15:21 smithi044 ceph-mon[18489]: pgmap v64: 129 pgs: 129 active+clean; 48 MiB data, 532 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 1.9 MiB/s wr, 266 op/s 2024-08-19T00:15:22.395 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:15:21 smithi116 ceph-mon[21873]: pgmap v64: 129 pgs: 129 active+clean; 48 MiB data, 532 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 1.9 MiB/s wr, 266 op/s 2024-08-19T00:15:22.650 INFO:tasks.workunit.client.0.smithi044.stdout: 1 57252 6.96 MB/sec warmup 47 sec latency 20.840 ms 2024-08-19T00:15:23.650 INFO:tasks.workunit.client.0.smithi044.stdout: 1 60155 7.11 MB/sec warmup 48 sec latency 13.857 ms 2024-08-19T00:15:24.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:15:23 smithi171 ceph-mon[21810]: pgmap v65: 129 pgs: 129 active+clean; 48 MiB data, 532 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 1.6 MiB/s wr, 215 op/s 2024-08-19T00:15:24.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:15:23 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:15:24.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:15:23 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:15:24.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:15:23 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:15:24.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:15:23 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:15:24.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:15:23 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:15:24.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:15:23 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:15:24.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:15:23 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:15:24.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:15:23 smithi116 ceph-mon[21873]: pgmap v65: 129 pgs: 129 active+clean; 48 MiB data, 532 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 1.6 MiB/s wr, 215 op/s 2024-08-19T00:15:24.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:15:23 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:15:24.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:15:23 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:15:24.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:15:23 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:15:24.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:15:23 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:15:24.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:15:23 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:15:24.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:15:23 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:15:24.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:15:23 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:15:24.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:15:23 smithi044 ceph-mon[18489]: pgmap v65: 129 pgs: 129 active+clean; 48 MiB data, 532 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 1.6 MiB/s wr, 215 op/s 2024-08-19T00:15:24.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:15:23 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:15:24.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:15:23 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:15:24.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:15:23 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:15:24.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:15:23 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:15:24.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:15:23 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:15:24.370 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:15:23 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:15:24.370 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:15:23 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:15:24.650 INFO:tasks.workunit.client.0.smithi044.stdout: 1 62626 7.20 MB/sec warmup 49 sec latency 13.634 ms 2024-08-19T00:15:25.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:15:24 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:15:25.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:15:24 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:15:25.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:15:24 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:15:25.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:15:24 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:15:25.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:15:24 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:15:25.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:15:24 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:15:25.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:15:24 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:15:25.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:15:24 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:15:25.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:15:24 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:15:25.650 INFO:tasks.workunit.client.0.smithi044.stdout: 1 64859 7.32 MB/sec warmup 50 sec latency 13.665 ms 2024-08-19T00:15:26.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:15:26 smithi171 ceph-mon[21810]: pgmap v66: 129 pgs: 129 active+clean; 55 MiB data, 530 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 2.6 MiB/s wr, 326 op/s 2024-08-19T00:15:26.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:15:26 smithi116 ceph-mon[21873]: pgmap v66: 129 pgs: 129 active+clean; 55 MiB data, 530 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 2.6 MiB/s wr, 326 op/s 2024-08-19T00:15:26.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:15:26 smithi044 ceph-mon[18489]: pgmap v66: 129 pgs: 129 active+clean; 55 MiB data, 530 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 2.6 MiB/s wr, 326 op/s 2024-08-19T00:15:26.650 INFO:tasks.workunit.client.0.smithi044.stdout: 1 67809 7.53 MB/sec warmup 51 sec latency 18.955 ms 2024-08-19T00:15:27.650 INFO:tasks.workunit.client.0.smithi044.stdout: 1 70793 7.67 MB/sec warmup 52 sec latency 13.117 ms 2024-08-19T00:15:28.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:15:28 smithi171 ceph-mon[21810]: pgmap v67: 129 pgs: 129 active+clean; 55 MiB data, 530 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 1.8 MiB/s wr, 218 op/s 2024-08-19T00:15:28.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:15:28 smithi116 ceph-mon[21873]: pgmap v67: 129 pgs: 129 active+clean; 55 MiB data, 530 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 1.8 MiB/s wr, 218 op/s 2024-08-19T00:15:28.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:15:28 smithi044 ceph-mon[18489]: pgmap v67: 129 pgs: 129 active+clean; 55 MiB data, 530 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 1.8 MiB/s wr, 218 op/s 2024-08-19T00:15:28.650 INFO:tasks.workunit.client.0.smithi044.stdout: 1 73365 7.74 MB/sec warmup 53 sec latency 17.680 ms 2024-08-19T00:15:29.650 INFO:tasks.workunit.client.0.smithi044.stdout: 1 75427 7.84 MB/sec warmup 54 sec latency 20.006 ms 2024-08-19T00:15:30.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:15:30 smithi171 ceph-mon[21810]: pgmap v68: 129 pgs: 129 active+clean; 55 MiB data, 530 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 1.8 MiB/s wr, 218 op/s 2024-08-19T00:15:30.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:15:30 smithi116 ceph-mon[21873]: pgmap v68: 129 pgs: 129 active+clean; 55 MiB data, 530 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 1.8 MiB/s wr, 218 op/s 2024-08-19T00:15:30.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:15:30 smithi044 ceph-mon[18489]: pgmap v68: 129 pgs: 129 active+clean; 55 MiB data, 530 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 1.8 MiB/s wr, 218 op/s 2024-08-19T00:15:30.650 INFO:tasks.workunit.client.0.smithi044.stdout: 1 78456 8.03 MB/sec warmup 55 sec latency 10.313 ms 2024-08-19T00:15:31.650 INFO:tasks.workunit.client.0.smithi044.stdout: 1 81098 8.11 MB/sec warmup 56 sec latency 11.547 ms 2024-08-19T00:15:32.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:15:32 smithi171 ceph-mon[21810]: pgmap v69: 129 pgs: 129 active+clean; 62 MiB data, 588 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 2.5 MiB/s wr, 322 op/s 2024-08-19T00:15:32.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:15:32 smithi116 ceph-mon[21873]: pgmap v69: 129 pgs: 129 active+clean; 62 MiB data, 588 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 2.5 MiB/s wr, 322 op/s 2024-08-19T00:15:32.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:15:32 smithi044 ceph-mon[18489]: pgmap v69: 129 pgs: 129 active+clean; 62 MiB data, 588 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 2.5 MiB/s wr, 322 op/s 2024-08-19T00:15:32.650 INFO:tasks.workunit.client.0.smithi044.stdout: 1 83327 8.18 MB/sec warmup 57 sec latency 18.264 ms 2024-08-19T00:15:33.650 INFO:tasks.workunit.client.0.smithi044.stdout: 1 85911 8.28 MB/sec warmup 58 sec latency 16.190 ms 2024-08-19T00:15:33.844 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.843+0000 7f6f46361640 1 -- 172.21.15.44:0/1906581821 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f400ffd30 msgr2=0x7f6f40100190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:33.845 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.843+0000 7f6f46361640 1 --2- 172.21.15.44:0/1906581821 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f400ffd30 0x7f6f40100190 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f6f34009900 tx=0x7f6f3402a410 comp rx=0 tx=0).stop 2024-08-19T00:15:33.845 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.843+0000 7f6f46361640 1 -- 172.21.15.44:0/1906581821 shutdown_connections 2024-08-19T00:15:33.845 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.843+0000 7f6f46361640 1 --2- 172.21.15.44:0/1906581821 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6f401006d0 0x7f6f4010e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:33.845 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.843+0000 7f6f46361640 1 --2- 172.21.15.44:0/1906581821 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f400ffd30 0x7f6f40100190 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:33.845 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.843+0000 7f6f46361640 1 --2- 172.21.15.44:0/1906581821 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6f401037e0 0x7f6f40103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:33.845 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.843+0000 7f6f46361640 1 -- 172.21.15.44:0/1906581821 >> 172.21.15.44:0/1906581821 conn(0x7f6f40076e20 msgr2=0x7f6f400fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:15:33.845 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.843+0000 7f6f46361640 1 -- 172.21.15.44:0/1906581821 shutdown_connections 2024-08-19T00:15:33.845 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.843+0000 7f6f46361640 1 -- 172.21.15.44:0/1906581821 wait complete. 2024-08-19T00:15:33.845 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.843+0000 7f6f46361640 1 Processor -- start 2024-08-19T00:15:33.845 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.843+0000 7f6f46361640 1 -- start start 2024-08-19T00:15:33.847 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.844+0000 7f6f46361640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6f400ffd30 0x7f6f40198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:33.847 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.844+0000 7f6f46361640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6f401006d0 0x7f6f401987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:33.847 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.844+0000 7f6f46361640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f401037e0 0x7f6f4019cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:33.847 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.844+0000 7f6f46361640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6f40111da0 con 0x7f6f401037e0 2024-08-19T00:15:33.847 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.844+0000 7f6f46361640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f6f40111c20 con 0x7f6f401006d0 2024-08-19T00:15:33.847 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.844+0000 7f6f46361640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6f40111f20 con 0x7f6f400ffd30 2024-08-19T00:15:33.848 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.844+0000 7f6f448fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f401037e0 0x7f6f4019cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:33.848 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.844+0000 7f6f3ffff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6f400ffd30 0x7f6f40198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:33.848 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.844+0000 7f6f448fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f401037e0 0x7f6f4019cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48880/0 (socket says 172.21.15.44:48880) 2024-08-19T00:15:33.848 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.844+0000 7f6f3ffff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6f400ffd30 0x7f6f40198270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.44:42002/0 (socket says 172.21.15.44:42002) 2024-08-19T00:15:33.848 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.844+0000 7f6f448fe640 1 -- 172.21.15.44:0/3370311649 learned_addr learned my addr 172.21.15.44:0/3370311649 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:15:33.848 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.844+0000 7f6f3f7fe640 1 --2- 172.21.15.44:0/3370311649 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6f401006d0 0x7f6f401987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:33.848 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.844+0000 7f6f448fe640 1 -- 172.21.15.44:0/3370311649 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6f400ffd30 msgr2=0x7f6f40198270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:33.848 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.844+0000 7f6f448fe640 1 --2- 172.21.15.44:0/3370311649 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6f400ffd30 0x7f6f40198270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:33.848 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.844+0000 7f6f448fe640 1 -- 172.21.15.44:0/3370311649 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6f401006d0 msgr2=0x7f6f401987b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:33.848 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.844+0000 7f6f448fe640 1 --2- 172.21.15.44:0/3370311649 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6f401006d0 0x7f6f401987b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:33.848 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.844+0000 7f6f448fe640 1 -- 172.21.15.44:0/3370311649 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f4019d260 con 0x7f6f401037e0 2024-08-19T00:15:33.848 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.844+0000 7f6f3f7fe640 1 --2- 172.21.15.44:0/3370311649 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6f401006d0 0x7f6f401987b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:15:33.848 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.844+0000 7f6f448fe640 1 --2- 172.21.15.44:0/3370311649 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f401037e0 0x7f6f4019cb30 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f6f38009fd0 tx=0x7f6f3800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:15:33.848 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.845+0000 7f6f3d7fa640 1 -- 172.21.15.44:0/3370311649 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f38017070 con 0x7f6f401037e0 2024-08-19T00:15:33.849 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.845+0000 7f6f3d7fa640 1 -- 172.21.15.44:0/3370311649 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f38003e50 con 0x7f6f401037e0 2024-08-19T00:15:33.849 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.845+0000 7f6f46361640 1 -- 172.21.15.44:0/3370311649 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f4019d550 con 0x7f6f401037e0 2024-08-19T00:15:33.849 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.845+0000 7f6f3d7fa640 1 -- 172.21.15.44:0/3370311649 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f380106c0 con 0x7f6f401037e0 2024-08-19T00:15:33.849 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.845+0000 7f6f46361640 1 -- 172.21.15.44:0/3370311649 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f401a4de0 con 0x7f6f401037e0 2024-08-19T00:15:33.854 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.847+0000 7f6f3d7fa640 1 -- 172.21.15.44:0/3370311649 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f6f38003970 con 0x7f6f401037e0 2024-08-19T00:15:33.854 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.848+0000 7f6f491fc740 1 Processor -- start 2024-08-19T00:15:33.854 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.848+0000 7f6f491fc740 1 -- start start 2024-08-19T00:15:33.854 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.848+0000 7f6f491fc740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4ecbac6d0 0x55a4ecbacab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:33.854 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.848+0000 7f6f491fc740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a4ecbacff0 0x55a4ecbbb860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:33.854 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.848+0000 7f6f491fc740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a4ecbbbda0 0x55a4ecbbe190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:33.854 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.848+0000 7f6f491fc740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a4ecb109d0 con 0x55a4ecbacff0 2024-08-19T00:15:33.854 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.848+0000 7f6f491fc740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55a4ecab8820 con 0x55a4ecbbbda0 2024-08-19T00:15:33.855 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.848+0000 7f6f491fc740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55a4ecb0c990 con 0x55a4ecbac6d0 2024-08-19T00:15:33.855 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.848+0000 7f6f3ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a4ecbacff0 0x55a4ecbbb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:33.855 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.848+0000 7f6f3ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a4ecbacff0 0x55a4ecbbb860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48896/0 (socket says 172.21.15.44:48896) 2024-08-19T00:15:33.855 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.848+0000 7f6f3ffff640 1 -- 172.21.15.44:0/1829448784 learned_addr learned my addr 172.21.15.44:0/1829448784 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:15:33.855 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.848+0000 7f6f3f7fe640 1 --2- 172.21.15.44:0/1829448784 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4ecbac6d0 0x55a4ecbacab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:33.855 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.848+0000 7f6f3d7fa640 1 --2- 172.21.15.44:0/3370311649 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f6f280a2da0 0x7f6f280a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:33.855 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.848+0000 7f6f3f7fe640 1 --2- 172.21.15.44:0/1829448784 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a4ecbbbda0 0x55a4ecbbe190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:33.855 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.848+0000 7f6f3ffff640 1 -- 172.21.15.44:0/1829448784 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4ecbac6d0 msgr2=0x55a4ecbacab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:15:33.855 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.848+0000 7f6f3ffff640 1 --2- 172.21.15.44:0/1829448784 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4ecbac6d0 0x55a4ecbacab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:33.855 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.848+0000 7f6f3ffff640 1 -- 172.21.15.44:0/1829448784 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a4ecbbbda0 msgr2=0x55a4ecbbe190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:15:33.855 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.848+0000 7f6f3ffff640 1 --2- 172.21.15.44:0/1829448784 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a4ecbbbda0 0x55a4ecbbe190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:33.855 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.848+0000 7f6f3ffff640 1 -- 172.21.15.44:0/1829448784 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4ec824210 con 0x55a4ecbacff0 2024-08-19T00:15:33.855 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.848+0000 7f6f448fe640 1 --2- 172.21.15.44:0/3370311649 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f6f280a2da0 0x7f6f280a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:33.855 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.848+0000 7f6f3f7fe640 1 --2- 172.21.15.44:0/1829448784 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4ecbac6d0 0x55a4ecbacab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:15:33.856 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.848+0000 7f6f3d7fa640 1 -- 172.21.15.44:0/3370311649 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f6f380cf4d0 con 0x7f6f401037e0 2024-08-19T00:15:33.856 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.848+0000 7f6f3ffff640 1 --2- 172.21.15.44:0/1829448784 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a4ecbacff0 0x55a4ecbbb860 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f6f3000bc50 tx=0x7f6f300107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e026b2fe98ef97f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:15:33.856 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.849+0000 7f6f267fc640 1 -- 172.21.15.44:0/1829448784 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f3001c480 con 0x55a4ecbacff0 2024-08-19T00:15:33.856 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.849+0000 7f6f267fc640 1 -- 172.21.15.44:0/1829448784 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f3001cb00 con 0x55a4ecbacff0 2024-08-19T00:15:33.856 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.849+0000 7f6f267fc640 1 -- 172.21.15.44:0/1829448784 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f30011ce0 con 0x55a4ecbacff0 2024-08-19T00:15:33.856 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.849+0000 7f6f491fc740 1 -- 172.21.15.44:0/1829448784 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a4ecbacff0 msgr2=0x55a4ecbbb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:33.856 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.849+0000 7f6f491fc740 1 --2- 172.21.15.44:0/1829448784 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a4ecbacff0 0x55a4ecbbb860 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f6f3000bc50 tx=0x7f6f300107a0 comp rx=0 tx=0).stop 2024-08-19T00:15:33.856 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.849+0000 7f6f448fe640 1 --2- 172.21.15.44:0/3370311649 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f6f280a2da0 0x7f6f280a5260 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6f3809b690 tx=0x7f6f380152b0 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:15:33.856 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.849+0000 7f6f491fc740 1 -- 172.21.15.44:0/1829448784 shutdown_connections 2024-08-19T00:15:33.856 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.849+0000 7f6f491fc740 1 --2- 172.21.15.44:0/1829448784 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a4ecbbbda0 0x55a4ecbbe190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:33.856 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.849+0000 7f6f491fc740 1 --2- 172.21.15.44:0/1829448784 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a4ecbacff0 0x55a4ecbbb860 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:33.856 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.849+0000 7f6f491fc740 1 --2- 172.21.15.44:0/1829448784 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4ecbac6d0 0x55a4ecbacab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:33.856 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.849+0000 7f6f491fc740 1 -- 172.21.15.44:0/1829448784 >> 172.21.15.44:0/1829448784 conn(0x55a4ecba8d40 msgr2=0x55a4ecba9120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:15:33.856 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.850+0000 7f6f491fc740 1 -- 172.21.15.44:0/1829448784 shutdown_connections 2024-08-19T00:15:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.850+0000 7f6f491fc740 1 -- 172.21.15.44:0/1829448784 wait complete. 2024-08-19T00:15:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.850+0000 7f6f491fc740 1 -- start start 2024-08-19T00:15:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.850+0000 7f6f491fc740 1 Processor -- start 2024-08-19T00:15:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.850+0000 7f6f491fc740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a4ecbac6d0 0x55a4ecbb8c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.850+0000 7f6f491fc740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a4ecbacff0 0x55a4ecbb9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.850+0000 7f6f491fc740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4ecbbbda0 0x55a4ecbb96c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.850+0000 7f6f491fc740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a4ecbbea00 con 0x55a4ecbac6d0 2024-08-19T00:15:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.850+0000 7f6f491fc740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55a4ecacc520 con 0x55a4ecbacff0 2024-08-19T00:15:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.850+0000 7f6f491fc740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55a4ecbbeb80 con 0x55a4ecbbbda0 2024-08-19T00:15:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.850+0000 7f6f491fc740 10 client.0 _ll_register_callbacks cb 0x55a4ec823a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:15:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.850+0000 7f6f3f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a4ecbac6d0 0x55a4ecbb8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:33.858 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.850+0000 7f6f3f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a4ecbac6d0 0x55a4ecbb8c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48912/0 (socket says 172.21.15.44:48912) 2024-08-19T00:15:33.858 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.850+0000 7f6f3f7fe640 1 -- 172.21.15.44:0/2234307657 learned_addr learned my addr 172.21.15.44:0/2234307657 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:15:33.858 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.851+0000 7f6f3f7fe640 1 --2- 172.21.15.44:0/2234307657 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4ecbbbda0 0x55a4ecbb96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:33.858 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.851+0000 7f6f3ffff640 1 --2- 172.21.15.44:0/2234307657 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a4ecbacff0 0x55a4ecbb9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:33.858 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.851+0000 7f6f3f7fe640 1 -- 172.21.15.44:0/2234307657 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4ecbbbda0 msgr2=0x55a4ecbb96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:15:33.858 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.851+0000 7f6f3f7fe640 1 --2- 172.21.15.44:0/2234307657 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4ecbbbda0 0x55a4ecbb96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:33.858 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.851+0000 7f6f3f7fe640 1 -- 172.21.15.44:0/2234307657 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a4ecbacff0 msgr2=0x55a4ecbb9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:15:33.858 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.851+0000 7f6f3f7fe640 1 --2- 172.21.15.44:0/2234307657 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a4ecbacff0 0x55a4ecbb9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:33.858 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.851+0000 7f6f3f7fe640 1 -- 172.21.15.44:0/2234307657 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4ec8f0620 con 0x55a4ecbac6d0 2024-08-19T00:15:33.858 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.851+0000 7f6f3ffff640 1 --2- 172.21.15.44:0/2234307657 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a4ecbacff0 0x55a4ecbb9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:15:33.858 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.851+0000 7f6f3f7fe640 1 --2- 172.21.15.44:0/2234307657 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a4ecbac6d0 0x55a4ecbb8c40 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f6f34031550 tx=0x7f6f34009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c32931f87e90ac6 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:15:33.858 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.851+0000 7f6f1f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:15:33.859 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.851+0000 7f6f1f7fe640 1 -- 172.21.15.44:0/2234307657 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f34035070 con 0x55a4ecbac6d0 2024-08-19T00:15:33.859 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.851+0000 7f6f1f7fe640 1 -- 172.21.15.44:0/2234307657 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f6f34005020 con 0x55a4ecbac6d0 2024-08-19T00:15:33.859 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.851+0000 7f6f491fc740 1 -- 172.21.15.44:0/2234307657 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f3001cb00 con 0x55a4ecbac6d0 2024-08-19T00:15:33.859 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.852+0000 7f6f1f7fe640 1 -- 172.21.15.44:0/2234307657 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6f34054050 con 0x55a4ecbac6d0 2024-08-19T00:15:33.859 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.852+0000 7f6f491fc740 10 client.15768 fetch_fsmap learned FSMap version 30 2024-08-19T00:15:33.859 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.852+0000 7f6f491fc740 1 -- 172.21.15.44:0/2234307657 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55a4ecbca670 con 0x55a4ecbac6d0 2024-08-19T00:15:33.859 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.852+0000 7f6f1f7fe640 1 -- 172.21.15.44:0/2234307657 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f340047a0 con 0x55a4ecbac6d0 2024-08-19T00:15:33.859 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.852+0000 7f6f1f7fe640 1 -- 172.21.15.44:0/2234307657 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 30) ==== 8386+0+0 (secure 0 0 0) 0x7f6f34003680 con 0x55a4ecbac6d0 2024-08-19T00:15:33.859 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.852+0000 7f6f491fc740 10 client.15768 fetch_fsmap finished waiting for FSMap version 30 2024-08-19T00:15:33.859 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.852+0000 7f6f491fc740 10 client.15768 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:15:33.859 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.852+0000 7f6f491fc740 20 client.15768 populate_metadata read hostname 'smithi044' 2024-08-19T00:15:33.859 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.852+0000 7f6f491fc740 1 --2- 172.21.15.44:0/2234307657 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55a4ecbcbae0 0x55a4ecbcdf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:33.859 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.852+0000 7f6f491fc740 4 client.15768 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:15:33.859 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.852+0000 7f6f491fc740 1 -- 172.21.15.44:0/2234307657 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f6f3001cb00 con 0x55a4ecbcbae0 2024-08-19T00:15:33.860 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.853+0000 7f6f3ffff640 1 --2- 172.21.15.44:0/2234307657 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55a4ecbcbae0 0x55a4ecbcdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:33.860 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.853+0000 7f6f3ffff640 1 --2- 172.21.15.44:0/2234307657 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55a4ecbcbae0 0x55a4ecbcdf40 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ee6690e165d8d83 server_cookie=daef936661b18031 in_seq=0 out_seq=0 2024-08-19T00:15:33.860 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.853+0000 7f6f1f7fe640 10 client.15768 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:15:33.861 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.853+0000 7f6f1f7fe640 1 -- 172.21.15.44:0/2234307657 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f6f3001cb00 con 0x55a4ecbcbae0 2024-08-19T00:15:33.861 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.853+0000 7f6f1f7fe640 10 client.15768 handle_command_reply: tid=0 2024-08-19T00:15:33.861 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.854+0000 7f6f491fc740 1 client.15768 shutdown 2024-08-19T00:15:33.861 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.854+0000 7f6f491fc740 1 -- 172.21.15.44:0/2234307657 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a4ecbac6d0 msgr2=0x55a4ecbb8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:33.861 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.854+0000 7f6f491fc740 1 --2- 172.21.15.44:0/2234307657 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a4ecbac6d0 0x55a4ecbb8c40 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f6f34031550 tx=0x7f6f34009260 comp rx=0 tx=0).stop 2024-08-19T00:15:33.861 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.854+0000 7f6f491fc740 1 -- 172.21.15.44:0/2234307657 shutdown_connections 2024-08-19T00:15:33.861 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.854+0000 7f6f491fc740 1 --2- 172.21.15.44:0/2234307657 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55a4ecbcbae0 0x55a4ecbcdf40 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:33.861 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.854+0000 7f6f491fc740 1 --2- 172.21.15.44:0/2234307657 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4ecbbbda0 0x55a4ecbb96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:33.861 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.854+0000 7f6f491fc740 1 --2- 172.21.15.44:0/2234307657 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a4ecbacff0 0x55a4ecbb9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:33.861 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.854+0000 7f6f491fc740 1 --2- 172.21.15.44:0/2234307657 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a4ecbac6d0 0x55a4ecbb8c40 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:33.861 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.854+0000 7f6f1f7fe640 0 client.15768 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:15:33.862 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.854+0000 7f6f491fc740 1 -- 172.21.15.44:0/2234307657 >> 172.21.15.44:0/2234307657 conn(0x55a4ecba8d40 msgr2=0x55a4ecbaeaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:15:33.862 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.854+0000 7f6f491fc740 1 -- 172.21.15.44:0/2234307657 shutdown_connections 2024-08-19T00:15:33.862 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.854+0000 7f6f491fc740 1 -- 172.21.15.44:0/2234307657 wait complete. 2024-08-19T00:15:33.862 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.854+0000 7f6f491fc740 20 client.15768 trim_cache size 0 max 16384 2024-08-19T00:15:33.874 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.871+0000 7f6f491fc740 1 Processor -- start 2024-08-19T00:15:33.874 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.871+0000 7f6f491fc740 1 -- start start 2024-08-19T00:15:33.874 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.871+0000 7f6f491fc740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a4ecbac6d0 0x55a4ecbd3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:33.874 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.871+0000 7f6f491fc740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a4ecbacff0 0x55a4ecbd3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:33.874 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.871+0000 7f6f491fc740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4ecbbbda0 0x55a4ecbba390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:33.874 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.871+0000 7f6f491fc740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6f401acab0 con 0x55a4ecbac6d0 2024-08-19T00:15:33.874 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.871+0000 7f6f491fc740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f6f401ae6b0 con 0x55a4ecbacff0 2024-08-19T00:15:33.874 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.871+0000 7f6f491fc740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6f401ad180 con 0x55a4ecbbbda0 2024-08-19T00:15:33.875 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.871+0000 7f6f3f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a4ecbac6d0 0x55a4ecbd3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:33.875 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.871+0000 7f6f3f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a4ecbac6d0 0x55a4ecbd3850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48922/0 (socket says 172.21.15.44:48922) 2024-08-19T00:15:33.875 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.871+0000 7f6f3f7fe640 1 -- 172.21.15.44:0/1586252208 learned_addr learned my addr 172.21.15.44:0/1586252208 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:15:33.875 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.871+0000 7f6f3ffff640 1 --2- 172.21.15.44:0/1586252208 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a4ecbacff0 0x55a4ecbd3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:33.875 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.871+0000 7f6f3f7fe640 1 --2- 172.21.15.44:0/1586252208 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4ecbbbda0 0x55a4ecbba390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:33.875 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.871+0000 7f6f3f7fe640 1 -- 172.21.15.44:0/1586252208 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4ecbbbda0 msgr2=0x55a4ecbba390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:15:33.875 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.871+0000 7f6f3f7fe640 1 --2- 172.21.15.44:0/1586252208 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4ecbbbda0 0x55a4ecbba390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:33.875 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.871+0000 7f6f3f7fe640 1 -- 172.21.15.44:0/1586252208 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a4ecbacff0 msgr2=0x55a4ecbd3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:15:33.875 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.871+0000 7f6f3f7fe640 1 --2- 172.21.15.44:0/1586252208 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a4ecbacff0 0x55a4ecbd3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:33.875 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.871+0000 7f6f3f7fe640 1 -- 172.21.15.44:0/1586252208 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4ecba8b70 con 0x55a4ecbac6d0 2024-08-19T00:15:33.875 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.872+0000 7f6f3f7fe640 1 --2- 172.21.15.44:0/1586252208 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a4ecbac6d0 0x55a4ecbd3850 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f6f34004150 tx=0x7f6f3402ab90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1de89d44adb82547 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:15:33.875 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.872+0000 7f6f25ffb640 1 -- 172.21.15.44:0/1586252208 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f34035070 con 0x55a4ecbac6d0 2024-08-19T00:15:33.875 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.872+0000 7f6f25ffb640 1 -- 172.21.15.44:0/1586252208 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f340057d0 con 0x55a4ecbac6d0 2024-08-19T00:15:33.876 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.872+0000 7f6f25ffb640 1 -- 172.21.15.44:0/1586252208 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f3403d930 con 0x55a4ecbac6d0 2024-08-19T00:15:33.876 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.873+0000 7f6f491fc740 1 -- 172.21.15.44:0/1586252208 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a4ecbac6d0 msgr2=0x55a4ecbd3850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:33.876 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.873+0000 7f6f491fc740 1 --2- 172.21.15.44:0/1586252208 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a4ecbac6d0 0x55a4ecbd3850 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f6f34004150 tx=0x7f6f3402ab90 comp rx=0 tx=0).stop 2024-08-19T00:15:33.876 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.873+0000 7f6f491fc740 1 -- 172.21.15.44:0/1586252208 shutdown_connections 2024-08-19T00:15:33.876 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.873+0000 7f6f491fc740 1 --2- 172.21.15.44:0/1586252208 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4ecbbbda0 0x55a4ecbba390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:33.876 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.873+0000 7f6f491fc740 1 --2- 172.21.15.44:0/1586252208 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a4ecbacff0 0x55a4ecbd3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:33.876 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.873+0000 7f6f491fc740 1 --2- 172.21.15.44:0/1586252208 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a4ecbac6d0 0x55a4ecbd3850 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:33.876 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.873+0000 7f6f491fc740 1 -- 172.21.15.44:0/1586252208 >> 172.21.15.44:0/1586252208 conn(0x55a4ecba8d40 msgr2=0x55a4ecbaea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:15:33.876 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.873+0000 7f6f491fc740 1 -- 172.21.15.44:0/1586252208 shutdown_connections 2024-08-19T00:15:33.876 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.873+0000 7f6f491fc740 1 -- 172.21.15.44:0/1586252208 wait complete. 2024-08-19T00:15:33.876 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.873+0000 7f6f491fc740 1 -- start start 2024-08-19T00:15:33.879 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.873+0000 7f6f491fc740 1 Processor -- start 2024-08-19T00:15:33.879 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.873+0000 7f6f491fc740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a4ecbac6d0 0x55a4ecbbfc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:33.879 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.873+0000 7f6f491fc740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4ecbacff0 0x55a4ecbc0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:33.879 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.873+0000 7f6f491fc740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a4ecbbbda0 0x55a4ecbc06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:33.879 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.873+0000 7f6f491fc740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6f401adf20 con 0x55a4ecbac6d0 2024-08-19T00:15:33.879 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.873+0000 7f6f491fc740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f6f401ad850 con 0x55a4ecbbbda0 2024-08-19T00:15:33.879 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.873+0000 7f6f491fc740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6f401aaa90 con 0x55a4ecbacff0 2024-08-19T00:15:33.879 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.873+0000 7f6f491fc740 10 client.0 _ll_register_callbacks cb 0x7f6f34004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:15:33.879 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.874+0000 7f6f3f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a4ecbac6d0 0x55a4ecbbfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:33.879 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.874+0000 7f6f3f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a4ecbac6d0 0x55a4ecbbfc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48930/0 (socket says 172.21.15.44:48930) 2024-08-19T00:15:33.880 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.874+0000 7f6f3f7fe640 1 -- 172.21.15.44:0/375360673 learned_addr learned my addr 172.21.15.44:0/375360673 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:15:33.880 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.874+0000 7f6f3ffff640 1 --2- 172.21.15.44:0/375360673 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4ecbacff0 0x55a4ecbc0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:33.880 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.874+0000 7f6f3f7fe640 1 --2- 172.21.15.44:0/375360673 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a4ecbbbda0 0x55a4ecbc06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:33.880 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.874+0000 7f6f3f7fe640 1 -- 172.21.15.44:0/375360673 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4ecbacff0 msgr2=0x55a4ecbc0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:15:33.880 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.874+0000 7f6f3f7fe640 1 --2- 172.21.15.44:0/375360673 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4ecbacff0 0x55a4ecbc0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:33.880 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.874+0000 7f6f3f7fe640 1 -- 172.21.15.44:0/375360673 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a4ecbbbda0 msgr2=0x55a4ecbc06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:15:33.880 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.874+0000 7f6f3f7fe640 1 --2- 172.21.15.44:0/375360673 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a4ecbbbda0 0x55a4ecbc06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:33.880 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.874+0000 7f6f3f7fe640 1 -- 172.21.15.44:0/375360673 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4ecc35850 con 0x55a4ecbac6d0 2024-08-19T00:15:33.880 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.874+0000 7f6f3f7fe640 1 --2- 172.21.15.44:0/375360673 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a4ecbac6d0 0x55a4ecbbfc30 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f6f340039d0 tx=0x7f6f34032bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43d589b76133c013 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:15:33.880 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.874+0000 7f6f1f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:15:33.880 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.874+0000 7f6f1f7fe640 1 -- 172.21.15.44:0/375360673 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f34035070 con 0x55a4ecbac6d0 2024-08-19T00:15:33.880 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.874+0000 7f6f1f7fe640 1 -- 172.21.15.44:0/375360673 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f6f3403d450 con 0x55a4ecbac6d0 2024-08-19T00:15:33.880 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.874+0000 7f6f491fc740 1 -- 172.21.15.44:0/375360673 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f340057d0 con 0x55a4ecbac6d0 2024-08-19T00:15:33.881 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.874+0000 7f6f1f7fe640 1 -- 172.21.15.44:0/375360673 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6f34031b40 con 0x55a4ecbac6d0 2024-08-19T00:15:33.881 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.874+0000 7f6f491fc740 10 client.15774 fetch_fsmap learned FSMap version 30 2024-08-19T00:15:33.881 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.874+0000 7f6f491fc740 1 -- 172.21.15.44:0/375360673 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55a4ecc36b20 con 0x55a4ecbac6d0 2024-08-19T00:15:33.881 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.875+0000 7f6f1f7fe640 1 -- 172.21.15.44:0/375360673 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f340057d0 con 0x55a4ecbac6d0 2024-08-19T00:15:33.881 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.875+0000 7f6f1f7fe640 1 -- 172.21.15.44:0/375360673 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 30) ==== 8386+0+0 (secure 0 0 0) 0x7f6f34032020 con 0x55a4ecbac6d0 2024-08-19T00:15:33.881 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.875+0000 7f6f491fc740 10 client.15774 fetch_fsmap finished waiting for FSMap version 30 2024-08-19T00:15:33.881 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.875+0000 7f6f491fc740 10 client.15774 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:15:33.881 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.875+0000 7f6f491fc740 20 client.15774 populate_metadata read hostname 'smithi044' 2024-08-19T00:15:33.881 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.875+0000 7f6f491fc740 1 --2- 172.21.15.44:0/375360673 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55a4ecc371e0 0x55a4ecc39600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:33.881 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.875+0000 7f6f491fc740 4 client.15774 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-19T00:15:33.881 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.875+0000 7f6f491fc740 1 -- 172.21.15.44:0/375360673 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a4ecb1e100 con 0x55a4ecc371e0 2024-08-19T00:15:33.881 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.875+0000 7f6f3ffff640 1 --2- 172.21.15.44:0/375360673 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55a4ecc371e0 0x55a4ecc39600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:33.881 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.876+0000 7f6f1f7fe640 10 client.15774 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:15:33.881 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.876+0000 7f6f3ffff640 1 --2- 172.21.15.44:0/375360673 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55a4ecc371e0 0x55a4ecc39600 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e23e400d40d2e54 server_cookie=aa4284fb41499d63 in_seq=0 out_seq=0 2024-08-19T00:15:33.884 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.882+0000 7f6f1f7fe640 1 -- 172.21.15.44:0/375360673 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a4ecb1e100 con 0x55a4ecc371e0 2024-08-19T00:15:33.884 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.882+0000 7f6f1f7fe640 10 client.15774 handle_command_reply: tid=0 2024-08-19T00:15:33.884 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.882+0000 7f6f491fc740 1 client.15774 shutdown 2024-08-19T00:15:33.884 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.882+0000 7f6f491fc740 1 -- 172.21.15.44:0/375360673 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a4ecbac6d0 msgr2=0x55a4ecbbfc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:33.884 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.882+0000 7f6f491fc740 1 --2- 172.21.15.44:0/375360673 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a4ecbac6d0 0x55a4ecbbfc30 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f6f340039d0 tx=0x7f6f34032bc0 comp rx=0 tx=0).stop 2024-08-19T00:15:33.884 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.882+0000 7f6f491fc740 1 -- 172.21.15.44:0/375360673 shutdown_connections 2024-08-19T00:15:33.885 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.882+0000 7f6f491fc740 1 --2- 172.21.15.44:0/375360673 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55a4ecc371e0 0x55a4ecc39600 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:33.885 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.882+0000 7f6f491fc740 1 --2- 172.21.15.44:0/375360673 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4ecbacff0 0x55a4ecbc0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:33.885 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.882+0000 7f6f491fc740 1 --2- 172.21.15.44:0/375360673 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a4ecbbbda0 0x55a4ecbc06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:33.885 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.882+0000 7f6f491fc740 1 --2- 172.21.15.44:0/375360673 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a4ecbac6d0 0x55a4ecbbfc30 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:33.885 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.882+0000 7f6f1f7fe640 0 client.15774 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:15:33.885 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.882+0000 7f6f491fc740 1 -- 172.21.15.44:0/375360673 >> 172.21.15.44:0/375360673 conn(0x55a4ecba8d40 msgr2=0x55a4ecba7680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:15:33.885 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.882+0000 7f6f491fc740 1 -- 172.21.15.44:0/375360673 shutdown_connections 2024-08-19T00:15:33.885 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.882+0000 7f6f491fc740 1 -- 172.21.15.44:0/375360673 wait complete. 2024-08-19T00:15:33.885 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.882+0000 7f6f491fc740 20 client.15774 trim_cache size 0 max 16384 2024-08-19T00:15:33.885 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:{ 2024-08-19T00:15:33.885 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "message": "", 2024-08-19T00:15:33.886 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "return_code": 0 2024-08-19T00:15:33.886 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:} 2024-08-19T00:15:33.889 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.883+0000 7f6f46361640 1 -- 172.21.15.44:0/3370311649 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f6f280a2da0 msgr2=0x7f6f280a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:33.889 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.883+0000 7f6f46361640 1 --2- 172.21.15.44:0/3370311649 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f6f280a2da0 0x7f6f280a5260 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6f3809b690 tx=0x7f6f380152b0 comp rx=0 tx=0).stop 2024-08-19T00:15:33.889 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.883+0000 7f6f46361640 1 -- 172.21.15.44:0/3370311649 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f401037e0 msgr2=0x7f6f4019cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:33.889 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.883+0000 7f6f46361640 1 --2- 172.21.15.44:0/3370311649 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f401037e0 0x7f6f4019cb30 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f6f38009fd0 tx=0x7f6f3800b260 comp rx=0 tx=0).stop 2024-08-19T00:15:33.890 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.883+0000 7f6f46361640 1 -- 172.21.15.44:0/3370311649 shutdown_connections 2024-08-19T00:15:33.890 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.883+0000 7f6f46361640 1 --2- 172.21.15.44:0/3370311649 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f6f280a2da0 0x7f6f280a5260 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:33.890 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.883+0000 7f6f46361640 1 --2- 172.21.15.44:0/3370311649 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f401037e0 0x7f6f4019cb30 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:33.890 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.883+0000 7f6f46361640 1 --2- 172.21.15.44:0/3370311649 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6f401006d0 0x7f6f401987b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:33.890 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.883+0000 7f6f46361640 1 --2- 172.21.15.44:0/3370311649 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6f400ffd30 0x7f6f40198270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:33.890 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.883+0000 7f6f46361640 1 -- 172.21.15.44:0/3370311649 >> 172.21.15.44:0/3370311649 conn(0x7f6f40076e20 msgr2=0x7f6f401057e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:15:33.890 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.883+0000 7f6f46361640 1 -- 172.21.15.44:0/3370311649 shutdown_connections 2024-08-19T00:15:33.890 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:33.883+0000 7f6f46361640 1 -- 172.21.15.44:0/3370311649 wait complete. 2024-08-19T00:15:34.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:15:34 smithi171 ceph-mon[21810]: pgmap v70: 129 pgs: 129 active+clean; 62 MiB data, 588 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 1.7 MiB/s wr, 214 op/s 2024-08-19T00:15:34.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:15:34 smithi116 ceph-mon[21873]: pgmap v70: 129 pgs: 129 active+clean; 62 MiB data, 588 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 1.7 MiB/s wr, 214 op/s 2024-08-19T00:15:34.618 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:15:34 smithi044 ceph-mon[18489]: pgmap v70: 129 pgs: 129 active+clean; 62 MiB data, 588 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 1.7 MiB/s wr, 214 op/s 2024-08-19T00:15:34.650 INFO:tasks.workunit.client.0.smithi044.stdout: 1 88963 8.45 MB/sec warmup 59 sec latency 31.686 ms 2024-08-19T00:15:35.650 INFO:tasks.workunit.client.0.smithi044.stdout: 1 91654 8.53 MB/sec warmup 60 sec latency 15.895 ms 2024-08-19T00:15:36.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:15:36 smithi171 ceph-mon[21810]: pgmap v71: 129 pgs: 129 active+clean; 69 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 2.6 MiB/s wr, 320 op/s 2024-08-19T00:15:36.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:15:36 smithi116 ceph-mon[21873]: pgmap v71: 129 pgs: 129 active+clean; 69 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 2.6 MiB/s wr, 320 op/s 2024-08-19T00:15:36.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:15:36 smithi044 ceph-mon[18489]: pgmap v71: 129 pgs: 129 active+clean; 69 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 2.6 MiB/s wr, 320 op/s 2024-08-19T00:15:36.650 INFO:tasks.workunit.client.0.smithi044.stdout: 1 94305 8.59 MB/sec warmup 61 sec latency 11.118 ms 2024-08-19T00:15:37.650 INFO:tasks.workunit.client.0.smithi044.stdout: 1 96626 8.67 MB/sec warmup 62 sec latency 22.079 ms 2024-08-19T00:15:38.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:15:38 smithi171 ceph-mon[21810]: pgmap v72: 129 pgs: 129 active+clean; 69 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 1.6 MiB/s wr, 209 op/s 2024-08-19T00:15:38.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:15:38 smithi116 ceph-mon[21873]: pgmap v72: 129 pgs: 129 active+clean; 69 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 1.6 MiB/s wr, 209 op/s 2024-08-19T00:15:38.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:15:38 smithi044 ceph-mon[18489]: pgmap v72: 129 pgs: 129 active+clean; 69 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 1.6 MiB/s wr, 209 op/s 2024-08-19T00:15:38.650 INFO:tasks.workunit.client.0.smithi044.stdout: 1 99581 8.83 MB/sec warmup 63 sec latency 43.338 ms 2024-08-19T00:15:39.650 INFO:tasks.workunit.client.0.smithi044.stdout: 1 102253 8.88 MB/sec warmup 64 sec latency 12.922 ms 2024-08-19T00:15:40.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:15:40 smithi171 ceph-mon[21810]: pgmap v73: 129 pgs: 129 active+clean; 69 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 1.6 MiB/s wr, 209 op/s 2024-08-19T00:15:40.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:15:40 smithi116 ceph-mon[21873]: pgmap v73: 129 pgs: 129 active+clean; 69 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 1.6 MiB/s wr, 209 op/s 2024-08-19T00:15:40.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:15:40 smithi044 ceph-mon[18489]: pgmap v73: 129 pgs: 129 active+clean; 69 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 1.6 MiB/s wr, 209 op/s 2024-08-19T00:15:40.650 INFO:tasks.workunit.client.0.smithi044.stdout: 1 104168 8.89 MB/sec warmup 65 sec latency 17.761 ms 2024-08-19T00:15:40.702 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 10 2024-08-19T00:15:40.703 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-19T00:15:40.967 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:15:41.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:41.592+0000 7fe9e580c640 1 -- 172.21.15.44:0/1055051714 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe9e0101150 msgr2=0x7fe9e010d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:41.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:41.592+0000 7fe9e580c640 1 --2- 172.21.15.44:0/1055051714 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe9e0101150 0x7fe9e010d680 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8009cd0 tx=0x7fe9d802a8e0 comp rx=0 tx=0).stop 2024-08-19T00:15:41.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:41.592+0000 7fe9e580c640 1 -- 172.21.15.44:0/1055051714 shutdown_connections 2024-08-19T00:15:41.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:41.592+0000 7fe9e580c640 1 --2- 172.21.15.44:0/1055051714 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe9e0101150 0x7fe9e010d680 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:41.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:41.592+0000 7fe9e580c640 1 --2- 172.21.15.44:0/1055051714 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe9e01007b0 0x7fe9e0100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:41.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:41.592+0000 7fe9e580c640 1 --2- 172.21.15.44:0/1055051714 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe9e01067b0 0x7fe9e0106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:41.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:41.592+0000 7fe9e580c640 1 -- 172.21.15.44:0/1055051714 >> 172.21.15.44:0/1055051714 conn(0x7fe9e00fc4d0 msgr2=0x7fe9e00fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:15:41.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:41.592+0000 7fe9e580c640 1 -- 172.21.15.44:0/1055051714 shutdown_connections 2024-08-19T00:15:41.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:41.592+0000 7fe9e580c640 1 -- 172.21.15.44:0/1055051714 wait complete. 2024-08-19T00:15:41.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:41.593+0000 7fe9e580c640 1 Processor -- start 2024-08-19T00:15:41.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:41.593+0000 7fe9e580c640 1 -- start start 2024-08-19T00:15:41.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:41.593+0000 7fe9e580c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe9e01007b0 0x7fe9e0198fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:41.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:41.594+0000 7fe9e580c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe9e0101150 0x7fe9e01994f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:41.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:41.594+0000 7fe9e580c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe9e01067b0 0x7fe9e01a4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:41.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:41.594+0000 7fe9e580c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e0110bb0 con 0x7fe9e0101150 2024-08-19T00:15:41.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:41.594+0000 7fe9e580c640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e0110a30 con 0x7fe9e01007b0 2024-08-19T00:15:41.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:41.594+0000 7fe9e580c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e0110d30 con 0x7fe9e01067b0 2024-08-19T00:15:41.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:41.594+0000 7fe9de7fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe9e0101150 0x7fe9e01994f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:41.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:41.594+0000 7fe9de7fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe9e0101150 0x7fe9e01994f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53268/0 (socket says 172.21.15.44:53268) 2024-08-19T00:15:41.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:41.594+0000 7fe9de7fc640 1 -- 172.21.15.44:0/3149333875 learned_addr learned my addr 172.21.15.44:0/3149333875 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:15:41.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:41.594+0000 7fe9deffd640 1 --2- 172.21.15.44:0/3149333875 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe9e01007b0 0x7fe9e0198fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:41.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:41.594+0000 7fe9df7fe640 1 --2- 172.21.15.44:0/3149333875 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe9e01067b0 0x7fe9e01a4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:41.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:41.594+0000 7fe9de7fc640 1 -- 172.21.15.44:0/3149333875 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe9e01067b0 msgr2=0x7fe9e01a4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:41.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:41.594+0000 7fe9de7fc640 1 --2- 172.21.15.44:0/3149333875 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe9e01067b0 0x7fe9e01a4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:41.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:41.594+0000 7fe9de7fc640 1 -- 172.21.15.44:0/3149333875 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe9e01007b0 msgr2=0x7fe9e0198fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:41.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:41.594+0000 7fe9de7fc640 1 --2- 172.21.15.44:0/3149333875 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe9e01007b0 0x7fe9e0198fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:41.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:41.594+0000 7fe9de7fc640 1 -- 172.21.15.44:0/3149333875 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9e01a4570 con 0x7fe9e0101150 2024-08-19T00:15:41.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:41.594+0000 7fe9de7fc640 1 --2- 172.21.15.44:0/3149333875 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe9e0101150 0x7fe9e01994f0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fe9d400e9f0 tx=0x7fe9d400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:15:41.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:41.594+0000 7fe9e480a640 1 -- 172.21.15.44:0/3149333875 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d400cd80 con 0x7fe9e0101150 2024-08-19T00:15:41.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:41.594+0000 7fe9e580c640 1 -- 172.21.15.44:0/3149333875 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9e01a4740 con 0x7fe9e0101150 2024-08-19T00:15:41.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:41.594+0000 7fe9e480a640 1 -- 172.21.15.44:0/3149333875 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe9d4010910 con 0x7fe9e0101150 2024-08-19T00:15:41.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:41.594+0000 7fe9e480a640 1 -- 172.21.15.44:0/3149333875 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d40188f0 con 0x7fe9e0101150 2024-08-19T00:15:41.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:41.594+0000 7fe9e580c640 1 -- 172.21.15.44:0/3149333875 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9e01a4c80 con 0x7fe9e0101150 2024-08-19T00:15:41.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:41.595+0000 7fe9e580c640 1 -- 172.21.15.44:0/3149333875 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9e0100c10 con 0x7fe9e0101150 2024-08-19T00:15:41.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:41.597+0000 7fe9e480a640 1 -- 172.21.15.44:0/3149333875 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fe9d4010ac0 con 0x7fe9e0101150 2024-08-19T00:15:41.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:41.598+0000 7fe9e480a640 1 --2- 172.21.15.44:0/3149333875 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fe9c80a2cf0 0x7fe9c80a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:41.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:41.598+0000 7fe9deffd640 1 --2- 172.21.15.44:0/3149333875 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fe9c80a2cf0 0x7fe9c80a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:41.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:41.598+0000 7fe9e480a640 1 -- 172.21.15.44:0/3149333875 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7fe9d40cff50 con 0x7fe9e0101150 2024-08-19T00:15:41.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:41.598+0000 7fe9deffd640 1 --2- 172.21.15.44:0/3149333875 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fe9c80a2cf0 0x7fe9c80a51b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0009b50 tx=0x7fe9d0005f90 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:15:41.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:41.601+0000 7fe9e480a640 1 -- 172.21.15.44:0/3149333875 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fe9d409c180 con 0x7fe9e0101150 2024-08-19T00:15:41.650 INFO:tasks.workunit.client.0.smithi044.stdout: 1 106987 9.01 MB/sec warmup 66 sec latency 45.104 ms 2024-08-19T00:15:41.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:41.821+0000 7fe9e580c640 1 -- 172.21.15.44:0/3149333875 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe9e006aab0 con 0x7fe9e0101150 2024-08-19T00:15:41.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:41.821+0000 7fe9e480a640 1 -- 172.21.15.44:0/3149333875 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11996 (secure 0 0 0) 0x7fe9e006aab0 con 0x7fe9e0101150 2024-08-19T00:15:41.823 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:15:41.823 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":30,"btime":"2024-08-19T00:14:41:883285+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14511,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1538841896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1538841896},{"type":"v1","addr":"172.21.15.116:6833","nonce":1538841896}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/4044471606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4044471606},{"type":"v1","addr":"172.21.15.44:6835","nonce":4044471606}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-19T00:10:53.196636+0000","modified":"2024-08-19T00:14:41.583467+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24473,"mds_1":24446,"mds_2":24439,"mds_3":24431,"mds_4":24418},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14529":{"gid":14529,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6837/1824829052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1824829052},{"type":"v1","addr":"172.21.15.44:6837","nonce":1824829052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14577":{"gid":14577,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6839/3591739042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":3591739042},{"type":"v1","addr":"172.21.15.44:6839","nonce":3591739042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14589":{"gid":14589,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6841/3667695717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6840","nonce":3667695717},{"type":"v1","addr":"172.21.15.44:6841","nonce":3667695717}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24388":{"gid":24388,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1183022838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1183022838},{"type":"v1","addr":"172.21.15.171:6833","nonce":1183022838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6835/2190623851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":2190623851},{"type":"v1","addr":"172.21.15.171:6835","nonce":2190623851}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.171:6837/316231795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":316231795},{"type":"v1","addr":"172.21.15.171:6837","nonce":316231795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":20,"addr":"172.21.15.116:6835/3507399322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3507399322},{"type":"v1","addr":"172.21.15.116:6835","nonce":3507399322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.171:6839/1466585795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":1466585795},{"type":"v1","addr":"172.21.15.171:6839","nonce":1466585795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":17,"addr":"172.21.15.116:6837/2764513846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":2764513846},{"type":"v1","addr":"172.21.15.116:6837","nonce":2764513846}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.116:6839/1032741033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":1032741033},{"type":"v1","addr":"172.21.15.116:6839","nonce":1032741033}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24418,24431,24439,24446,24473]},"id":1}]} 2024-08-19T00:15:41.823 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 30 2024-08-19T00:15:41.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:41.823+0000 7fe9e580c640 1 -- 172.21.15.44:0/3149333875 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fe9c80a2cf0 msgr2=0x7fe9c80a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:41.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:41.824+0000 7fe9e580c640 1 --2- 172.21.15.44:0/3149333875 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fe9c80a2cf0 0x7fe9c80a51b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0009b50 tx=0x7fe9d0005f90 comp rx=0 tx=0).stop 2024-08-19T00:15:41.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:41.824+0000 7fe9e580c640 1 -- 172.21.15.44:0/3149333875 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe9e0101150 msgr2=0x7fe9e01994f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:41.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:41.824+0000 7fe9e580c640 1 --2- 172.21.15.44:0/3149333875 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe9e0101150 0x7fe9e01994f0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fe9d400e9f0 tx=0x7fe9d400eeb0 comp rx=0 tx=0).stop 2024-08-19T00:15:41.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:41.824+0000 7fe9e580c640 1 -- 172.21.15.44:0/3149333875 shutdown_connections 2024-08-19T00:15:41.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:41.824+0000 7fe9e580c640 1 --2- 172.21.15.44:0/3149333875 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fe9c80a2cf0 0x7fe9c80a51b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:41.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:41.824+0000 7fe9e580c640 1 --2- 172.21.15.44:0/3149333875 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe9e01067b0 0x7fe9e01a4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:41.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:41.824+0000 7fe9e580c640 1 --2- 172.21.15.44:0/3149333875 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe9e0101150 0x7fe9e01994f0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:41.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:41.824+0000 7fe9e580c640 1 --2- 172.21.15.44:0/3149333875 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe9e01007b0 0x7fe9e0198fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:41.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:41.824+0000 7fe9e580c640 1 -- 172.21.15.44:0/3149333875 >> 172.21.15.44:0/3149333875 conn(0x7fe9e00fc4d0 msgr2=0x7fe9e00fcd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:15:41.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:41.824+0000 7fe9e580c640 1 -- 172.21.15.44:0/3149333875 shutdown_connections 2024-08-19T00:15:41.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:41.824+0000 7fe9e580c640 1 -- 172.21.15.44:0/3149333875 wait complete. 2024-08-19T00:15:42.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:15:42 smithi171 ceph-mon[21810]: pgmap v74: 129 pgs: 129 active+clean; 76 MiB data, 627 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 2.6 MiB/s wr, 318 op/s 2024-08-19T00:15:42.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:15:42 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/3149333875' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:15:42.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:15:42 smithi116 ceph-mon[21873]: pgmap v74: 129 pgs: 129 active+clean; 76 MiB data, 627 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 2.6 MiB/s wr, 318 op/s 2024-08-19T00:15:42.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:15:42 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/3149333875' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:15:42.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:15:42 smithi044 ceph-mon[18489]: pgmap v74: 129 pgs: 129 active+clean; 76 MiB data, 627 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 2.6 MiB/s wr, 318 op/s 2024-08-19T00:15:42.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:15:42 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/3149333875' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:15:42.650 INFO:tasks.workunit.client.0.smithi044.stdout: 1 109425 9.06 MB/sec warmup 67 sec latency 101.849 ms 2024-08-19T00:15:42.847 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24473 quiesce db / --timeout 90 --expiration 130 --await-for 45.0' 2024-08-19T00:15:42.847 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24473 quiesce db / --timeout 90 --expiration 130 --await-for 45.0 2024-08-19T00:15:43.154 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:15:43.651 INFO:tasks.workunit.client.0.smithi044.stdout: 1 111280 9.06 MB/sec warmup 68 sec latency 50.472 ms 2024-08-19T00:15:43.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.672+0000 7fd357e51640 1 -- 172.21.15.44:0/2677274443 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3501067b0 msgr2=0x7fd350106b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:43.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.672+0000 7fd357e51640 1 --2- 172.21.15.44:0/2677274443 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3501067b0 0x7fd350106b90 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fd34c009930 tx=0x7fd34c02a420 comp rx=0 tx=0).stop 2024-08-19T00:15:43.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.672+0000 7fd357e51640 1 -- 172.21.15.44:0/2677274443 shutdown_connections 2024-08-19T00:15:43.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.672+0000 7fd357e51640 1 --2- 172.21.15.44:0/2677274443 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd3501007b0 0x7fd350100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:43.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.672+0000 7fd357e51640 1 --2- 172.21.15.44:0/2677274443 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd350101150 0x7fd35010d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:43.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.672+0000 7fd357e51640 1 --2- 172.21.15.44:0/2677274443 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3501067b0 0x7fd350106b90 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:43.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.672+0000 7fd357e51640 1 -- 172.21.15.44:0/2677274443 >> 172.21.15.44:0/2677274443 conn(0x7fd3500fc4d0 msgr2=0x7fd3500fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:15:43.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.672+0000 7fd357e51640 1 -- 172.21.15.44:0/2677274443 shutdown_connections 2024-08-19T00:15:43.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.672+0000 7fd357e51640 1 -- 172.21.15.44:0/2677274443 wait complete. 2024-08-19T00:15:43.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.673+0000 7fd357e51640 1 Processor -- start 2024-08-19T00:15:43.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.673+0000 7fd357e51640 1 -- start start 2024-08-19T00:15:43.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.673+0000 7fd357e51640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd3501007b0 0x7fd35019a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:43.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.673+0000 7fd357e51640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd350101150 0x7fd35019a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:43.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.673+0000 7fd357e51640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd3501067b0 0x7fd35019ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:43.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.673+0000 7fd357e51640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd350110b70 con 0x7fd350101150 2024-08-19T00:15:43.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.673+0000 7fd357e51640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fd3501109f0 con 0x7fd3501067b0 2024-08-19T00:15:43.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.673+0000 7fd357e51640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd350110cf0 con 0x7fd3501007b0 2024-08-19T00:15:43.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.673+0000 7fd3553ec640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd350101150 0x7fd35019a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:43.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.673+0000 7fd355bed640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd3501007b0 0x7fd35019a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:43.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.673+0000 7fd355bed640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd3501007b0 0x7fd35019a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.44:56218/0 (socket says 172.21.15.44:56218) 2024-08-19T00:15:43.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.673+0000 7fd3553ec640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd350101150 0x7fd35019a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53280/0 (socket says 172.21.15.44:53280) 2024-08-19T00:15:43.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.673+0000 7fd355bed640 1 -- 172.21.15.44:0/1232464891 learned_addr learned my addr 172.21.15.44:0/1232464891 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:15:43.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.673+0000 7fd3563ee640 1 --2- 172.21.15.44:0/1232464891 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd3501067b0 0x7fd35019ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:43.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.674+0000 7fd3553ec640 1 -- 172.21.15.44:0/1232464891 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd3501007b0 msgr2=0x7fd35019a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:43.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.674+0000 7fd3553ec640 1 --2- 172.21.15.44:0/1232464891 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd3501007b0 0x7fd35019a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:43.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.674+0000 7fd3553ec640 1 -- 172.21.15.44:0/1232464891 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd3501067b0 msgr2=0x7fd35019ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:43.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.674+0000 7fd3553ec640 1 --2- 172.21.15.44:0/1232464891 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd3501067b0 0x7fd35019ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:43.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.674+0000 7fd3553ec640 1 -- 172.21.15.44:0/1232464891 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd35019f3a0 con 0x7fd350101150 2024-08-19T00:15:43.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.674+0000 7fd3563ee640 1 --2- 172.21.15.44:0/1232464891 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd3501067b0 0x7fd35019ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:15:43.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.674+0000 7fd3553ec640 1 --2- 172.21.15.44:0/1232464891 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd350101150 0x7fd35019a930 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fd34000e9f0 tx=0x7fd34000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:15:43.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.674+0000 7fd346ffd640 1 -- 172.21.15.44:0/1232464891 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd34000ccc0 con 0x7fd350101150 2024-08-19T00:15:43.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.674+0000 7fd357e51640 1 -- 172.21.15.44:0/1232464891 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd35019f690 con 0x7fd350101150 2024-08-19T00:15:43.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.674+0000 7fd346ffd640 1 -- 172.21.15.44:0/1232464891 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd340010910 con 0x7fd350101150 2024-08-19T00:15:43.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.674+0000 7fd346ffd640 1 -- 172.21.15.44:0/1232464891 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd340018960 con 0x7fd350101150 2024-08-19T00:15:43.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.674+0000 7fd357e51640 1 -- 172.21.15.44:0/1232464891 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3501a6f70 con 0x7fd350101150 2024-08-19T00:15:43.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.676+0000 7fd346ffd640 1 -- 172.21.15.44:0/1232464891 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fd340010ac0 con 0x7fd350101150 2024-08-19T00:15:43.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.677+0000 7fd35a24f740 1 Processor -- start 2024-08-19T00:15:43.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.677+0000 7fd35a24f740 1 -- start start 2024-08-19T00:15:43.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.677+0000 7fd35a24f740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5586d9c7d130 0x5586d9c7d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:43.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.677+0000 7fd35a24f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586d9c7da50 0x5586d9c87dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:43.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.677+0000 7fd346ffd640 1 --2- 172.21.15.44:0/1232464891 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fd33c0a2cf0 0x7fd33c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:43.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.677+0000 7fd35a24f740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5586d9c88310 0x5586d9c8a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:43.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.677+0000 7fd35a24f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5586d9be2a70 con 0x5586d9c7da50 2024-08-19T00:15:43.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.677+0000 7fd35a24f740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5586d9b7a780 con 0x5586d9c7d130 2024-08-19T00:15:43.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.677+0000 7fd35a24f740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5586d9bdea30 con 0x5586d9c88310 2024-08-19T00:15:43.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.677+0000 7fd355bed640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586d9c7da50 0x5586d9c87dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:43.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.677+0000 7fd355bed640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586d9c7da50 0x5586d9c87dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53288/0 (socket says 172.21.15.44:53288) 2024-08-19T00:15:43.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.677+0000 7fd3553ec640 1 --2- 172.21.15.44:0/1232464891 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fd33c0a2cf0 0x7fd33c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:43.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.677+0000 7fd3563ee640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5586d9c7d130 0x5586d9c7d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:43.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.677+0000 7fd355bed640 1 -- 172.21.15.44:0/1503055785 learned_addr learned my addr 172.21.15.44:0/1503055785 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:15:43.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.677+0000 7fd3563ee640 1 --2- 172.21.15.44:0/1503055785 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5586d9c88310 0x5586d9c8a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:43.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.678+0000 7fd346ffd640 1 -- 172.21.15.44:0/1232464891 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7fd3400cfb80 con 0x7fd350101150 2024-08-19T00:15:43.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.678+0000 7fd3563ee640 1 -- 172.21.15.44:0/1503055785 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5586d9c88310 msgr2=0x5586d9c8a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:15:43.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.678+0000 7fd3563ee640 1 --2- 172.21.15.44:0/1503055785 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5586d9c88310 0x5586d9c8a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:43.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.678+0000 7fd3563ee640 1 -- 172.21.15.44:0/1503055785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586d9c7da50 msgr2=0x5586d9c87dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:15:43.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.678+0000 7fd3563ee640 1 --2- 172.21.15.44:0/1503055785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586d9c7da50 0x5586d9c87dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:43.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.678+0000 7fd3563ee640 1 -- 172.21.15.44:0/1503055785 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586d9954b90 con 0x5586d9c7d130 2024-08-19T00:15:43.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.678+0000 7fd3563ee640 1 --2- 172.21.15.44:0/1503055785 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5586d9c7d130 0x5586d9c7d510 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd348005fd0 tx=0x7fd348009500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33abbe1ad1ed7d1b server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:15:43.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.678+0000 7fd33bfff640 1 -- 172.21.15.44:0/1503055785 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3480130d0 con 0x5586d9c7d130 2024-08-19T00:15:43.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.678+0000 7fd3553ec640 1 --2- 172.21.15.44:0/1232464891 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fd33c0a2cf0 0x7fd33c0a51b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd34009bd40 tx=0x7fd3400c6890 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:15:43.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.678+0000 7fd33bfff640 1 -- 172.21.15.44:0/1503055785 <== mon.2 v2:172.21.15.116:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd348013270 con 0x5586d9c7d130 2024-08-19T00:15:43.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.678+0000 7fd33bfff640 1 -- 172.21.15.44:0/1503055785 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd348011440 con 0x5586d9c7d130 2024-08-19T00:15:43.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.679+0000 7fd35a24f740 1 -- 172.21.15.44:0/1503055785 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5586d9c7d130 msgr2=0x5586d9c7d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:43.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.679+0000 7fd35a24f740 1 --2- 172.21.15.44:0/1503055785 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5586d9c7d130 0x5586d9c7d510 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd348005fd0 tx=0x7fd348009500 comp rx=0 tx=0).stop 2024-08-19T00:15:43.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.679+0000 7fd35a24f740 1 -- 172.21.15.44:0/1503055785 shutdown_connections 2024-08-19T00:15:43.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.679+0000 7fd35a24f740 1 --2- 172.21.15.44:0/1503055785 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5586d9c88310 0x5586d9c8a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:43.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.679+0000 7fd35a24f740 1 --2- 172.21.15.44:0/1503055785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586d9c7da50 0x5586d9c87dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:43.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.679+0000 7fd35a24f740 1 --2- 172.21.15.44:0/1503055785 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5586d9c7d130 0x5586d9c7d510 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:43.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.679+0000 7fd35a24f740 1 -- 172.21.15.44:0/1503055785 >> 172.21.15.44:0/1503055785 conn(0x5586d9c796c0 msgr2=0x5586d9c79aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:15:43.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.679+0000 7fd35a24f740 1 -- 172.21.15.44:0/1503055785 shutdown_connections 2024-08-19T00:15:43.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.679+0000 7fd35a24f740 1 -- 172.21.15.44:0/1503055785 wait complete. 2024-08-19T00:15:43.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.679+0000 7fd35a24f740 1 -- start start 2024-08-19T00:15:43.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.680+0000 7fd35a24f740 1 Processor -- start 2024-08-19T00:15:43.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.680+0000 7fd35a24f740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5586d9c7d130 0x5586d9c85250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:43.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.680+0000 7fd35a24f740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5586d9c7da50 0x5586d9c85790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:43.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.680+0000 7fd35a24f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586d9c88310 0x5586d9c85cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:43.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.680+0000 7fd35a24f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5586d9c8aee0 con 0x5586d9c88310 2024-08-19T00:15:43.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.680+0000 7fd35a24f740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5586d9b9d990 con 0x5586d9c7d130 2024-08-19T00:15:43.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.680+0000 7fd35a24f740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5586d9c8b060 con 0x5586d9c7da50 2024-08-19T00:15:43.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.680+0000 7fd35a24f740 10 client.0 _ll_register_callbacks cb 0x5586d98f2090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:15:43.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.680+0000 7fd3563ee640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5586d9c7d130 0x5586d9c85250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:43.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.680+0000 7fd355bed640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5586d9c7da50 0x5586d9c85790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:43.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.680+0000 7fd3563ee640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5586d9c7d130 0x5586d9c85250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.44:44076/0 (socket says 172.21.15.44:44076) 2024-08-19T00:15:43.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.680+0000 7fd3563ee640 1 -- 172.21.15.44:0/2557272818 learned_addr learned my addr 172.21.15.44:0/2557272818 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:15:43.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.680+0000 7fd3563ee640 1 --2- 172.21.15.44:0/2557272818 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586d9c88310 0x5586d9c85cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:43.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.681+0000 7fd3563ee640 1 -- 172.21.15.44:0/2557272818 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5586d9c7da50 msgr2=0x5586d9c85790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:15:43.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.681+0000 7fd3563ee640 1 --2- 172.21.15.44:0/2557272818 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5586d9c7da50 0x5586d9c85790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:43.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.681+0000 7fd3563ee640 1 -- 172.21.15.44:0/2557272818 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586d9c88310 msgr2=0x5586d9c85cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:15:43.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.681+0000 7fd3563ee640 1 --2- 172.21.15.44:0/2557272818 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586d9c88310 0x5586d9c85cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:43.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.681+0000 7fd3563ee640 1 -- 172.21.15.44:0/2557272818 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586d9b9c6c0 con 0x5586d9c7d130 2024-08-19T00:15:43.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.681+0000 7fd3563ee640 1 --2- 172.21.15.44:0/2557272818 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5586d9c7d130 0x5586d9c85250 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd348005580 tx=0x7fd348005680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6865bb013c1b449e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:15:43.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.681+0000 7fd3397fa640 10 client.0 ms_handle_connect on v2:172.21.15.116:3300/0 2024-08-19T00:15:43.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.681+0000 7fd3397fa640 1 -- 172.21.15.44:0/2557272818 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd348004a40 con 0x5586d9c7d130 2024-08-19T00:15:43.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.681+0000 7fd35a24f740 1 -- 172.21.15.44:0/2557272818 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd348013270 con 0x5586d9c7d130 2024-08-19T00:15:43.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.681+0000 7fd3397fa640 1 -- 172.21.15.44:0/2557272818 <== mon.2 v2:172.21.15.116:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7fd348004be0 con 0x5586d9c7d130 2024-08-19T00:15:43.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.681+0000 7fd3397fa640 1 -- 172.21.15.44:0/2557272818 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd348004de0 con 0x5586d9c7d130 2024-08-19T00:15:43.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.681+0000 7fd35a24f740 10 client.25319 fetch_fsmap learned FSMap version 30 2024-08-19T00:15:43.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.681+0000 7fd35a24f740 1 -- 172.21.15.44:0/2557272818 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5586d9c96be0 con 0x5586d9c7d130 2024-08-19T00:15:43.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.681+0000 7fd3397fa640 1 -- 172.21.15.44:0/2557272818 <== mon.2 v2:172.21.15.116:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd348013270 con 0x5586d9c7d130 2024-08-19T00:15:43.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.682+0000 7fd3397fa640 1 -- 172.21.15.44:0/2557272818 <== mon.2 v2:172.21.15.116:3300/0 5 ==== fsmap(e 30) ==== 8386+0+0 (secure 0 0 0) 0x7fd34801d020 con 0x5586d9c7d130 2024-08-19T00:15:43.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.682+0000 7fd35a24f740 10 client.25319 fetch_fsmap finished waiting for FSMap version 30 2024-08-19T00:15:43.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.682+0000 7fd35a24f740 10 client.25319 resolve_mds: validated gid 24473 aka daemon mds.b 2024-08-19T00:15:43.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.682+0000 7fd35a24f740 20 client.25319 populate_metadata read hostname 'smithi044' 2024-08-19T00:15:43.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.682+0000 7fd35a24f740 1 --2- 172.21.15.44:0/2557272818 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5586d9c97f30 0x5586d9c9a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:43.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.682+0000 7fd35a24f740 4 client.25319 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:15:43.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.682+0000 7fd35a24f740 1 -- 172.21.15.44:0/2557272818 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5586d9bf01a0 con 0x5586d9c97f30 2024-08-19T00:15:43.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.682+0000 7fd355bed640 1 --2- 172.21.15.44:0/2557272818 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5586d9c97f30 0x5586d9c9a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:43.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.682+0000 7fd355bed640 1 --2- 172.21.15.44:0/2557272818 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5586d9c97f30 0x5586d9c9a320 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b2ebebd272033f1 server_cookie=76ad44e7f85a650a in_seq=0 out_seq=0 2024-08-19T00:15:43.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.682+0000 7fd3397fa640 10 client.25319 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:15:43.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.683+0000 7fd3397fa640 1 -- 172.21.15.44:0/2557272818 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5586d9bf01a0 con 0x5586d9c97f30 2024-08-19T00:15:43.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.683+0000 7fd3397fa640 10 client.25319 handle_command_reply: tid=0 2024-08-19T00:15:43.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.683+0000 7fd35a24f740 1 client.25319 shutdown 2024-08-19T00:15:43.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.683+0000 7fd35a24f740 1 -- 172.21.15.44:0/2557272818 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5586d9c7d130 msgr2=0x5586d9c85250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:43.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.683+0000 7fd35a24f740 1 --2- 172.21.15.44:0/2557272818 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5586d9c7d130 0x5586d9c85250 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd348005580 tx=0x7fd348005680 comp rx=0 tx=0).stop 2024-08-19T00:15:43.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.683+0000 7fd35a24f740 1 -- 172.21.15.44:0/2557272818 shutdown_connections 2024-08-19T00:15:43.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.683+0000 7fd35a24f740 1 --2- 172.21.15.44:0/2557272818 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5586d9c97f30 0x5586d9c9a320 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:43.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.683+0000 7fd35a24f740 1 --2- 172.21.15.44:0/2557272818 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5586d9c7da50 0x5586d9c85790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:43.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.683+0000 7fd35a24f740 1 --2- 172.21.15.44:0/2557272818 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586d9c88310 0x5586d9c85cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:43.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.683+0000 7fd35a24f740 1 --2- 172.21.15.44:0/2557272818 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5586d9c7d130 0x5586d9c85250 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:43.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.683+0000 7fd3397fa640 0 client.25319 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:15:43.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.683+0000 7fd35a24f740 1 -- 172.21.15.44:0/2557272818 >> 172.21.15.44:0/2557272818 conn(0x5586d9c796c0 msgr2=0x5586d9c7f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:15:43.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.683+0000 7fd35a24f740 1 -- 172.21.15.44:0/2557272818 shutdown_connections 2024-08-19T00:15:43.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.683+0000 7fd35a24f740 1 -- 172.21.15.44:0/2557272818 wait complete. 2024-08-19T00:15:43.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.683+0000 7fd35a24f740 20 client.25319 trim_cache size 0 max 16384 2024-08-19T00:15:43.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.703+0000 7fd35a24f740 1 Processor -- start 2024-08-19T00:15:43.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.703+0000 7fd35a24f740 1 -- start start 2024-08-19T00:15:43.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.704+0000 7fd35a24f740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5586d9c796c0 0x5586d9c9fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:43.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.704+0000 7fd35a24f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586d9c7d130 0x5586d9ca0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:43.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.704+0000 7fd35a24f740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5586d9c7da50 0x5586d9c824f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:43.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.704+0000 7fd35a24f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd3501b0fc0 con 0x5586d9c7d130 2024-08-19T00:15:43.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.704+0000 7fd35a24f740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fd3501b2bc0 con 0x5586d9c7da50 2024-08-19T00:15:43.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.704+0000 7fd35a24f740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd3501b1690 con 0x5586d9c796c0 2024-08-19T00:15:43.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.704+0000 7fd355bed640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586d9c7d130 0x5586d9ca0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:43.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.704+0000 7fd355bed640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586d9c7d130 0x5586d9ca0150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53302/0 (socket says 172.21.15.44:53302) 2024-08-19T00:15:43.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.704+0000 7fd355bed640 1 -- 172.21.15.44:0/539900440 learned_addr learned my addr 172.21.15.44:0/539900440 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:15:43.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.704+0000 7fd3563ee640 1 --2- 172.21.15.44:0/539900440 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5586d9c796c0 0x5586d9c9fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:43.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.704+0000 7fd3563ee640 1 --2- 172.21.15.44:0/539900440 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5586d9c7da50 0x5586d9c824f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:43.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.704+0000 7fd3563ee640 1 -- 172.21.15.44:0/539900440 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5586d9c7da50 msgr2=0x5586d9c824f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:15:43.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.704+0000 7fd3563ee640 1 --2- 172.21.15.44:0/539900440 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5586d9c7da50 0x5586d9c824f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:43.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.704+0000 7fd3563ee640 1 -- 172.21.15.44:0/539900440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586d9c7d130 msgr2=0x5586d9ca0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:15:43.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.704+0000 7fd3563ee640 1 --2- 172.21.15.44:0/539900440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586d9c7d130 0x5586d9ca0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:43.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.704+0000 7fd3563ee640 1 -- 172.21.15.44:0/539900440 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586d9c7d880 con 0x5586d9c796c0 2024-08-19T00:15:43.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.704+0000 7fd355bed640 1 --2- 172.21.15.44:0/539900440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586d9c7d130 0x5586d9ca0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:15:43.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.704+0000 7fd3563ee640 1 --2- 172.21.15.44:0/539900440 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5586d9c796c0 0x5586d9c9fc10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd348005fd0 tx=0x7fd348013b70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f832c7b6bae430a0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:15:43.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.705+0000 7fd33b7fe640 1 -- 172.21.15.44:0/539900440 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd348013270 con 0x5586d9c796c0 2024-08-19T00:15:43.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.705+0000 7fd33b7fe640 1 -- 172.21.15.44:0/539900440 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd348009480 con 0x5586d9c796c0 2024-08-19T00:15:43.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.705+0000 7fd33b7fe640 1 -- 172.21.15.44:0/539900440 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd348003970 con 0x5586d9c796c0 2024-08-19T00:15:43.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.705+0000 7fd35a24f740 1 -- 172.21.15.44:0/539900440 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5586d9c796c0 msgr2=0x5586d9c9fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:43.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.705+0000 7fd35a24f740 1 --2- 172.21.15.44:0/539900440 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5586d9c796c0 0x5586d9c9fc10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd348005fd0 tx=0x7fd348013b70 comp rx=0 tx=0).stop 2024-08-19T00:15:43.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.705+0000 7fd35a24f740 1 -- 172.21.15.44:0/539900440 shutdown_connections 2024-08-19T00:15:43.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.705+0000 7fd35a24f740 1 --2- 172.21.15.44:0/539900440 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5586d9c7da50 0x5586d9c824f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:43.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.705+0000 7fd35a24f740 1 --2- 172.21.15.44:0/539900440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586d9c7d130 0x5586d9ca0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:43.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.705+0000 7fd35a24f740 1 --2- 172.21.15.44:0/539900440 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5586d9c796c0 0x5586d9c9fc10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:43.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.705+0000 7fd35a24f740 1 -- 172.21.15.44:0/539900440 >> 172.21.15.44:0/539900440 conn(0x5586d9c7f720 msgr2=0x5586d9c7eb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:15:43.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.705+0000 7fd35a24f740 1 -- 172.21.15.44:0/539900440 shutdown_connections 2024-08-19T00:15:43.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.705+0000 7fd35a24f740 1 -- 172.21.15.44:0/539900440 wait complete. 2024-08-19T00:15:43.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.706+0000 7fd35a24f740 1 -- start start 2024-08-19T00:15:43.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.706+0000 7fd35a24f740 1 Processor -- start 2024-08-19T00:15:43.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.706+0000 7fd35a24f740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5586d9c796c0 0x5586d9c902b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:43.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.706+0000 7fd35a24f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586d9c7d130 0x5586d9c907f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:43.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.706+0000 7fd35a24f740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5586d9c7da50 0x5586d9c8d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:43.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.706+0000 7fd35a24f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd3501b2430 con 0x5586d9c7d130 2024-08-19T00:15:43.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.706+0000 7fd35a24f740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fd3501b1d60 con 0x5586d9c796c0 2024-08-19T00:15:43.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.706+0000 7fd35a24f740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd3501aefa0 con 0x5586d9c7da50 2024-08-19T00:15:43.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.706+0000 7fd35a24f740 10 client.0 _ll_register_callbacks cb 0x7fd340005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:15:43.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.706+0000 7fd355bed640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586d9c7d130 0x5586d9c907f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:43.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.706+0000 7fd3563ee640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5586d9c796c0 0x5586d9c902b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:43.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.706+0000 7fd3563ee640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5586d9c796c0 0x5586d9c902b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.44:44094/0 (socket says 172.21.15.44:44094) 2024-08-19T00:15:43.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.706+0000 7fd3563ee640 1 -- 172.21.15.44:0/2928410478 learned_addr learned my addr 172.21.15.44:0/2928410478 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:15:43.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.706+0000 7fd355bed640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586d9c7d130 0x5586d9c907f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53318/0 (socket says 172.21.15.44:53318) 2024-08-19T00:15:43.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.707+0000 7fd3563ee640 1 --2- 172.21.15.44:0/2928410478 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5586d9c7da50 0x5586d9c8d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:43.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.707+0000 7fd3563ee640 1 -- 172.21.15.44:0/2928410478 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5586d9c7da50 msgr2=0x5586d9c8d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:15:43.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.707+0000 7fd3563ee640 1 --2- 172.21.15.44:0/2928410478 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5586d9c7da50 0x5586d9c8d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:43.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.707+0000 7fd3563ee640 1 -- 172.21.15.44:0/2928410478 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586d9c7d130 msgr2=0x5586d9c907f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:15:43.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.707+0000 7fd3563ee640 1 --2- 172.21.15.44:0/2928410478 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586d9c7d130 0x5586d9c907f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:43.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.707+0000 7fd3563ee640 1 -- 172.21.15.44:0/2928410478 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586d9c8d8c0 con 0x5586d9c796c0 2024-08-19T00:15:43.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.707+0000 7fd3563ee640 1 --2- 172.21.15.44:0/2928410478 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5586d9c796c0 0x5586d9c902b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd348005d60 tx=0x7fd348005000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e885f68a43e5a289 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:15:43.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.707+0000 7fd3397fa640 10 client.0 ms_handle_connect on v2:172.21.15.116:3300/0 2024-08-19T00:15:43.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.707+0000 7fd3397fa640 1 -- 172.21.15.44:0/2928410478 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd348032070 con 0x5586d9c796c0 2024-08-19T00:15:43.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.707+0000 7fd35a24f740 1 -- 172.21.15.44:0/2928410478 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd348009480 con 0x5586d9c796c0 2024-08-19T00:15:43.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.707+0000 7fd3397fa640 1 -- 172.21.15.44:0/2928410478 <== mon.2 v2:172.21.15.116:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7fd348029040 con 0x5586d9c796c0 2024-08-19T00:15:43.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.707+0000 7fd3397fa640 1 -- 172.21.15.44:0/2928410478 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd348013270 con 0x5586d9c796c0 2024-08-19T00:15:43.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.707+0000 7fd35a24f740 10 client.25325 fetch_fsmap learned FSMap version 30 2024-08-19T00:15:43.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.707+0000 7fd35a24f740 1 -- 172.21.15.44:0/2928410478 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5586d9d034d0 con 0x5586d9c796c0 2024-08-19T00:15:43.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.708+0000 7fd3397fa640 1 -- 172.21.15.44:0/2928410478 <== mon.2 v2:172.21.15.116:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd348009480 con 0x5586d9c796c0 2024-08-19T00:15:43.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.708+0000 7fd3397fa640 1 -- 172.21.15.44:0/2928410478 <== mon.2 v2:172.21.15.116:3300/0 5 ==== fsmap(e 30) ==== 8386+0+0 (secure 0 0 0) 0x7fd34801d040 con 0x5586d9c796c0 2024-08-19T00:15:43.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.708+0000 7fd35a24f740 10 client.25325 fetch_fsmap finished waiting for FSMap version 30 2024-08-19T00:15:43.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.708+0000 7fd35a24f740 10 client.25325 resolve_mds: validated gid 24473 aka daemon mds.b 2024-08-19T00:15:43.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.708+0000 7fd35a24f740 20 client.25325 populate_metadata read hostname 'smithi044' 2024-08-19T00:15:43.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.708+0000 7fd35a24f740 1 --2- 172.21.15.44:0/2928410478 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5586d9c88310 0x5586d9d05bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:43.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.708+0000 7fd35a24f740 4 client.25325 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.0, "await_for": 45.0}] 2024-08-19T00:15:43.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.708+0000 7fd35a24f740 1 -- 172.21.15.44:0/2928410478 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.0, "await_for": 45.0}) -- 0x5586d9bea4f0 con 0x5586d9c88310 2024-08-19T00:15:43.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.708+0000 7fd355bed640 1 --2- 172.21.15.44:0/2928410478 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5586d9c88310 0x5586d9d05bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:43.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.708+0000 7fd355bed640 1 --2- 172.21.15.44:0/2928410478 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5586d9c88310 0x5586d9d05bf0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc869a269fcdf6f8 server_cookie=507ab86f0fdb763c in_seq=0 out_seq=0 2024-08-19T00:15:43.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.708+0000 7fd3397fa640 10 client.25325 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:15:43.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.784+0000 7fd3397fa640 1 -- 172.21.15.44:0/2928410478 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5586d9bea4f0 con 0x5586d9c88310 2024-08-19T00:15:43.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.784+0000 7fd3397fa640 10 client.25325 handle_command_reply: tid=0 2024-08-19T00:15:43.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.784+0000 7fd35a24f740 1 client.25325 shutdown 2024-08-19T00:15:43.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.784+0000 7fd35a24f740 1 -- 172.21.15.44:0/2928410478 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5586d9c796c0 msgr2=0x5586d9c902b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:43.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.784+0000 7fd35a24f740 1 --2- 172.21.15.44:0/2928410478 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5586d9c796c0 0x5586d9c902b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd348005d60 tx=0x7fd348005000 comp rx=0 tx=0).stop 2024-08-19T00:15:43.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.784+0000 7fd35a24f740 1 -- 172.21.15.44:0/2928410478 shutdown_connections 2024-08-19T00:15:43.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.784+0000 7fd35a24f740 1 --2- 172.21.15.44:0/2928410478 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5586d9c88310 0x5586d9d05bf0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:43.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.784+0000 7fd35a24f740 1 --2- 172.21.15.44:0/2928410478 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5586d9c7da50 0x5586d9c8d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:43.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.784+0000 7fd35a24f740 1 --2- 172.21.15.44:0/2928410478 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5586d9c7d130 0x5586d9c907f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:43.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.784+0000 7fd3397fa640 0 client.25325 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:15:43.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.784+0000 7fd35a24f740 1 --2- 172.21.15.44:0/2928410478 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5586d9c796c0 0x5586d9c902b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:43.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.784+0000 7fd35a24f740 1 -- 172.21.15.44:0/2928410478 >> 172.21.15.44:0/2928410478 conn(0x5586d9c7f720 msgr2=0x5586d9c86ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:15:43.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.784+0000 7fd35a24f740 1 -- 172.21.15.44:0/2928410478 shutdown_connections 2024-08-19T00:15:43.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.784+0000 7fd35a24f740 1 -- 172.21.15.44:0/2928410478 wait complete. 2024-08-19T00:15:43.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.784+0000 7fd35a24f740 20 client.25325 trim_cache size 0 max 16384 2024-08-19T00:15:43.787 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-08-19T00:15:43.787 INFO:teuthology.orchestra.run.smithi044.stdout: "epoch": 30, 2024-08-19T00:15:43.787 INFO:teuthology.orchestra.run.smithi044.stdout: "leader": 24473, 2024-08-19T00:15:43.787 INFO:teuthology.orchestra.run.smithi044.stdout: "set_version": 6, 2024-08-19T00:15:43.788 INFO:teuthology.orchestra.run.smithi044.stdout: "sets": { 2024-08-19T00:15:43.788 INFO:teuthology.orchestra.run.smithi044.stdout: "88dd3c11": { 2024-08-19T00:15:43.788 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 6, 2024-08-19T00:15:43.788 INFO:teuthology.orchestra.run.smithi044.stdout: "age_ref": 0.0, 2024-08-19T00:15:43.788 INFO:teuthology.orchestra.run.smithi044.stdout: "state": { 2024-08-19T00:15:43.788 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "QUIESCED", 2024-08-19T00:15:43.788 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.0 2024-08-19T00:15:43.788 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:15:43.788 INFO:teuthology.orchestra.run.smithi044.stdout: "timeout": 90.0, 2024-08-19T00:15:43.788 INFO:teuthology.orchestra.run.smithi044.stdout: "expiration": 130.0, 2024-08-19T00:15:43.788 INFO:teuthology.orchestra.run.smithi044.stdout: "members": { 2024-08-19T00:15:43.788 INFO:teuthology.orchestra.run.smithi044.stdout: "file:/": { 2024-08-19T00:15:43.788 INFO:teuthology.orchestra.run.smithi044.stdout: "excluded": false, 2024-08-19T00:15:43.788 INFO:teuthology.orchestra.run.smithi044.stdout: "state": { 2024-08-19T00:15:43.789 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "QUIESCED", 2024-08-19T00:15:43.789 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.0 2024-08-19T00:15:43.789 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:15:43.789 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:15:43.789 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:15:43.789 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:15:43.789 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:15:43.789 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-08-19T00:15:43.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.785+0000 7fd357e51640 1 -- 172.21.15.44:0/1232464891 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fd33c0a2cf0 msgr2=0x7fd33c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:43.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.785+0000 7fd357e51640 1 --2- 172.21.15.44:0/1232464891 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fd33c0a2cf0 0x7fd33c0a51b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd34009bd40 tx=0x7fd3400c6890 comp rx=0 tx=0).stop 2024-08-19T00:15:43.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.785+0000 7fd357e51640 1 -- 172.21.15.44:0/1232464891 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd350101150 msgr2=0x7fd35019a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:43.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.785+0000 7fd357e51640 1 --2- 172.21.15.44:0/1232464891 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd350101150 0x7fd35019a930 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fd34000e9f0 tx=0x7fd34000eeb0 comp rx=0 tx=0).stop 2024-08-19T00:15:43.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.785+0000 7fd357e51640 1 -- 172.21.15.44:0/1232464891 shutdown_connections 2024-08-19T00:15:43.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.785+0000 7fd357e51640 1 --2- 172.21.15.44:0/1232464891 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fd33c0a2cf0 0x7fd33c0a51b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:43.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.785+0000 7fd357e51640 1 --2- 172.21.15.44:0/1232464891 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd3501067b0 0x7fd35019ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:43.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.785+0000 7fd357e51640 1 --2- 172.21.15.44:0/1232464891 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd350101150 0x7fd35019a930 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:43.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.785+0000 7fd357e51640 1 --2- 172.21.15.44:0/1232464891 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd3501007b0 0x7fd35019a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:43.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.785+0000 7fd357e51640 1 -- 172.21.15.44:0/1232464891 >> 172.21.15.44:0/1232464891 conn(0x7fd3500fc4d0 msgr2=0x7fd35006a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:15:43.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.785+0000 7fd357e51640 1 -- 172.21.15.44:0/1232464891 shutdown_connections 2024-08-19T00:15:43.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:43.785+0000 7fd357e51640 1 -- 172.21.15.44:0/1232464891 wait complete. 2024-08-19T00:15:44.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:15:44 smithi171 ceph-mon[21810]: pgmap v75: 129 pgs: 129 active+clean; 76 MiB data, 627 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 1.9 MiB/s wr, 214 op/s 2024-08-19T00:15:44.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:15:44 smithi116 ceph-mon[21873]: pgmap v75: 129 pgs: 129 active+clean; 76 MiB data, 627 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 1.9 MiB/s wr, 214 op/s 2024-08-19T00:15:44.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:15:44 smithi044 ceph-mon[18489]: pgmap v75: 129 pgs: 129 active+clean; 76 MiB data, 627 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 1.9 MiB/s wr, 214 op/s 2024-08-19T00:15:44.651 INFO:tasks.workunit.client.0.smithi044.stdout: 1 111594 8.97 MB/sec warmup 69 sec latency 845.675 ms 2024-08-19T00:15:44.671 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '88dd3c11', quiesce took 4.0 seconds. Will release after: 6.0 2024-08-19T00:15:45.651 INFO:tasks.workunit.client.0.smithi044.stdout: 1 111594 8.84 MB/sec warmup 70 sec latency 1845.782 ms 2024-08-19T00:15:46.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:15:46 smithi171 ceph-mon[21810]: pgmap v76: 129 pgs: 129 active+clean; 80 MiB data, 694 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 3.4 MiB/s wr, 332 op/s 2024-08-19T00:15:46.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:15:46 smithi116 ceph-mon[21873]: pgmap v76: 129 pgs: 129 active+clean; 80 MiB data, 694 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 3.4 MiB/s wr, 332 op/s 2024-08-19T00:15:46.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:15:46 smithi044 ceph-mon[18489]: pgmap v76: 129 pgs: 129 active+clean; 80 MiB data, 694 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 3.4 MiB/s wr, 332 op/s 2024-08-19T00:15:46.651 INFO:tasks.workunit.client.0.smithi044.stdout: 1 111594 8.72 MB/sec warmup 71 sec latency 2845.868 ms 2024-08-19T00:15:46.983 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.982+0000 7f1e50725640 1 -- 172.21.15.44:0/2826755316 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e48105250 msgr2=0x7f1e4810cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:46.984 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.982+0000 7f1e50725640 1 --2- 172.21.15.44:0/2826755316 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e48105250 0x7f1e4810cda0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f1e40009ca0 tx=0x7f1e4002a8c0 comp rx=0 tx=0).stop 2024-08-19T00:15:46.984 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.982+0000 7f1e50725640 1 -- 172.21.15.44:0/2826755316 shutdown_connections 2024-08-19T00:15:46.984 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.982+0000 7f1e50725640 1 --2- 172.21.15.44:0/2826755316 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e48105250 0x7f1e4810cda0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:46.984 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.982+0000 7f1e50725640 1 --2- 172.21.15.44:0/2826755316 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1e48100f10 0x7f1e48104af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:46.984 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.982+0000 7f1e50725640 1 --2- 172.21.15.44:0/2826755316 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1e48100560 0x7f1e48100940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:46.984 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.982+0000 7f1e50725640 1 -- 172.21.15.44:0/2826755316 >> 172.21.15.44:0/2826755316 conn(0x7f1e48075c50 msgr2=0x7f1e48076060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:15:46.984 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.982+0000 7f1e50725640 1 -- 172.21.15.44:0/2826755316 shutdown_connections 2024-08-19T00:15:46.984 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.982+0000 7f1e50725640 1 -- 172.21.15.44:0/2826755316 wait complete. 2024-08-19T00:15:46.986 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.983+0000 7f1e50725640 1 Processor -- start 2024-08-19T00:15:46.986 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.983+0000 7f1e50725640 1 -- start start 2024-08-19T00:15:46.986 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.983+0000 7f1e50725640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e48100560 0x7f1e48197fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:46.986 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.983+0000 7f1e50725640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1e48100f10 0x7f1e481984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:46.986 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.983+0000 7f1e50725640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1e48105250 0x7f1e4819c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:46.986 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.983+0000 7f1e50725640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4810fa80 con 0x7f1e48100560 2024-08-19T00:15:46.987 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.983+0000 7f1e50725640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4810f900 con 0x7f1e48100f10 2024-08-19T00:15:46.987 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.983+0000 7f1e50725640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4810fc00 con 0x7f1e48105250 2024-08-19T00:15:46.987 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.983+0000 7f1e4e4c1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e48100560 0x7f1e48197fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:46.987 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.983+0000 7f1e4e4c1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e48100560 0x7f1e48197fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53348/0 (socket says 172.21.15.44:53348) 2024-08-19T00:15:46.987 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.983+0000 7f1e4e4c1640 1 -- 172.21.15.44:0/2149726524 learned_addr learned my addr 172.21.15.44:0/2149726524 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:15:46.987 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.983+0000 7f1e4dcc0640 1 --2- 172.21.15.44:0/2149726524 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1e48100f10 0x7f1e481984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:46.987 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.983+0000 7f1e4ecc2640 1 --2- 172.21.15.44:0/2149726524 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1e48105250 0x7f1e4819c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:46.987 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.983+0000 7f1e4e4c1640 1 -- 172.21.15.44:0/2149726524 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1e48105250 msgr2=0x7f1e4819c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:46.987 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.983+0000 7f1e4e4c1640 1 --2- 172.21.15.44:0/2149726524 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1e48105250 0x7f1e4819c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:46.987 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.983+0000 7f1e4e4c1640 1 -- 172.21.15.44:0/2149726524 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1e48100f10 msgr2=0x7f1e481984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:46.987 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.983+0000 7f1e4e4c1640 1 --2- 172.21.15.44:0/2149726524 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1e48100f10 0x7f1e481984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:46.987 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.983+0000 7f1e4e4c1640 1 -- 172.21.15.44:0/2149726524 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e4819cf90 con 0x7f1e48100560 2024-08-19T00:15:46.987 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.984+0000 7f1e4e4c1640 1 --2- 172.21.15.44:0/2149726524 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e48100560 0x7f1e48197fa0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f1e4400c920 tx=0x7f1e4400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:15:46.987 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.984+0000 7f1e3f7fe640 1 -- 172.21.15.44:0/2149726524 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e44007c70 con 0x7f1e48100560 2024-08-19T00:15:46.987 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.984+0000 7f1e3f7fe640 1 -- 172.21.15.44:0/2149726524 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e44007e10 con 0x7f1e48100560 2024-08-19T00:15:46.988 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.984+0000 7f1e50725640 1 -- 172.21.15.44:0/2149726524 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e4819d280 con 0x7f1e48100560 2024-08-19T00:15:46.988 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.984+0000 7f1e3f7fe640 1 -- 172.21.15.44:0/2149726524 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e44018890 con 0x7f1e48100560 2024-08-19T00:15:46.988 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.984+0000 7f1e50725640 1 -- 172.21.15.44:0/2149726524 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e481a4b10 con 0x7f1e48100560 2024-08-19T00:15:46.988 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.987+0000 7f1e3f7fe640 1 -- 172.21.15.44:0/2149726524 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f1e44018a70 con 0x7f1e48100560 2024-08-19T00:15:46.988 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.987+0000 7f1e535c5740 1 Processor -- start 2024-08-19T00:15:46.988 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.987+0000 7f1e535c5740 1 -- start start 2024-08-19T00:15:46.991 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.988+0000 7f1e535c5740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f0efba17d0 0x55f0efba1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:46.991 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.988+0000 7f1e535c5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0efba20f0 0x55f0efbac450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:46.991 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.988+0000 7f1e535c5740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0efbac990 0x55f0efbaed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:46.991 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.988+0000 7f1e535c5740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55f0efb059d0 con 0x55f0efba20f0 2024-08-19T00:15:46.991 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.988+0000 7f1e535c5740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55f0efaad820 con 0x55f0efbac990 2024-08-19T00:15:46.992 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.988+0000 7f1e535c5740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55f0efb01990 con 0x55f0efba17d0 2024-08-19T00:15:46.992 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.988+0000 7f1e4e4c1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0efba20f0 0x55f0efbac450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:46.992 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.988+0000 7f1e4e4c1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0efba20f0 0x55f0efbac450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53364/0 (socket says 172.21.15.44:53364) 2024-08-19T00:15:46.992 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.988+0000 7f1e4e4c1640 1 -- 172.21.15.44:0/405567507 learned_addr learned my addr 172.21.15.44:0/405567507 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:15:46.992 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.988+0000 7f1e4ecc2640 1 --2- 172.21.15.44:0/405567507 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f0efba17d0 0x55f0efba1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:46.992 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.988+0000 7f1e3f7fe640 1 --2- 172.21.15.44:0/2149726524 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f1e340a2da0 0x7f1e340a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:46.992 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.988+0000 7f1e4dcc0640 1 --2- 172.21.15.44:0/405567507 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0efbac990 0x55f0efbaed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:46.992 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.988+0000 7f1e4e4c1640 1 -- 172.21.15.44:0/405567507 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f0efba17d0 msgr2=0x55f0efba1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:15:46.992 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.988+0000 7f1e4ecc2640 1 --2- 172.21.15.44:0/2149726524 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f1e340a2da0 0x7f1e340a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:46.992 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.988+0000 7f1e4e4c1640 1 --2- 172.21.15.44:0/405567507 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f0efba17d0 0x55f0efba1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:46.992 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.988+0000 7f1e4e4c1640 1 -- 172.21.15.44:0/405567507 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0efbac990 msgr2=0x55f0efbaed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:15:46.992 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.988+0000 7f1e4e4c1640 1 --2- 172.21.15.44:0/405567507 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0efbac990 0x55f0efbaed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:46.993 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.988+0000 7f1e3f7fe640 1 -- 172.21.15.44:0/2149726524 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f1e440cf9a0 con 0x7f1e48100560 2024-08-19T00:15:46.993 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.988+0000 7f1e4e4c1640 1 -- 172.21.15.44:0/405567507 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0ef819210 con 0x55f0efba20f0 2024-08-19T00:15:46.993 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.988+0000 7f1e4dcc0640 1 --2- 172.21.15.44:0/405567507 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0efbac990 0x55f0efbaed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:15:46.993 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.989+0000 7f1e4e4c1640 1 --2- 172.21.15.44:0/405567507 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0efba20f0 0x55f0efbac450 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f1e44098490 tx=0x7f1e44000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3038eaac908ad020 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:15:46.993 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.989+0000 7f1e4ecc2640 1 --2- 172.21.15.44:0/2149726524 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f1e340a2da0 0x7f1e340a5260 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1e40009430 tx=0x7f1e4002a8c0 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:15:46.993 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.989+0000 7f1e3cff9640 1 -- 172.21.15.44:0/405567507 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e440a4730 con 0x55f0efba20f0 2024-08-19T00:15:46.993 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.989+0000 7f1e3cff9640 1 -- 172.21.15.44:0/405567507 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e4409bac0 con 0x55f0efba20f0 2024-08-19T00:15:46.993 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.989+0000 7f1e3cff9640 1 -- 172.21.15.44:0/405567507 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e4409bd20 con 0x55f0efba20f0 2024-08-19T00:15:46.993 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.989+0000 7f1e535c5740 1 -- 172.21.15.44:0/405567507 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0efba20f0 msgr2=0x55f0efbac450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:46.993 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.989+0000 7f1e535c5740 1 --2- 172.21.15.44:0/405567507 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0efba20f0 0x55f0efbac450 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f1e44098490 tx=0x7f1e44000bc0 comp rx=0 tx=0).stop 2024-08-19T00:15:46.993 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.989+0000 7f1e535c5740 1 -- 172.21.15.44:0/405567507 shutdown_connections 2024-08-19T00:15:46.993 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.989+0000 7f1e535c5740 1 --2- 172.21.15.44:0/405567507 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0efbac990 0x55f0efbaed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:46.993 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.989+0000 7f1e535c5740 1 --2- 172.21.15.44:0/405567507 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0efba20f0 0x55f0efbac450 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:46.994 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.990+0000 7f1e535c5740 1 --2- 172.21.15.44:0/405567507 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f0efba17d0 0x55f0efba1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:46.994 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.990+0000 7f1e535c5740 1 -- 172.21.15.44:0/405567507 >> 172.21.15.44:0/405567507 conn(0x55f0efb9dd40 msgr2=0x55f0efb9e120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:15:46.994 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.990+0000 7f1e535c5740 1 -- 172.21.15.44:0/405567507 shutdown_connections 2024-08-19T00:15:46.994 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.990+0000 7f1e535c5740 1 -- 172.21.15.44:0/405567507 wait complete. 2024-08-19T00:15:46.994 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.990+0000 7f1e535c5740 1 -- start start 2024-08-19T00:15:46.994 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.990+0000 7f1e535c5740 1 Processor -- start 2024-08-19T00:15:46.997 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.990+0000 7f1e535c5740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0efba17d0 0x55f0efba97f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:46.998 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.990+0000 7f1e535c5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0efba20f0 0x55f0efba9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:46.998 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.990+0000 7f1e535c5740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f0efbac990 0x55f0efbaa270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:46.998 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.990+0000 7f1e535c5740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55f0efbaf560 con 0x55f0efba20f0 2024-08-19T00:15:46.998 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.990+0000 7f1e535c5740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55f0efac1520 con 0x55f0efba17d0 2024-08-19T00:15:46.998 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.990+0000 7f1e535c5740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55f0efbaf6e0 con 0x55f0efbac990 2024-08-19T00:15:46.998 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.990+0000 7f1e535c5740 10 client.0 _ll_register_callbacks cb 0x55f0ef818a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:15:46.998 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.990+0000 7f1e4dcc0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0efba20f0 0x55f0efba9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:46.998 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.990+0000 7f1e4dcc0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0efba20f0 0x55f0efba9d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53366/0 (socket says 172.21.15.44:53366) 2024-08-19T00:15:46.998 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.990+0000 7f1e4dcc0640 1 -- 172.21.15.44:0/2095304537 learned_addr learned my addr 172.21.15.44:0/2095304537 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:15:46.998 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.991+0000 7f1e4e4c1640 1 --2- 172.21.15.44:0/2095304537 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0efba17d0 0x55f0efba97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:46.998 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.991+0000 7f1e4ecc2640 1 --2- 172.21.15.44:0/2095304537 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f0efbac990 0x55f0efbaa270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:46.999 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.991+0000 7f1e4dcc0640 1 -- 172.21.15.44:0/2095304537 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f0efbac990 msgr2=0x55f0efbaa270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:15:46.999 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.991+0000 7f1e4dcc0640 1 --2- 172.21.15.44:0/2095304537 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f0efbac990 0x55f0efbaa270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:46.999 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.991+0000 7f1e4dcc0640 1 -- 172.21.15.44:0/2095304537 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0efba17d0 msgr2=0x55f0efba97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:15:46.999 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.991+0000 7f1e4dcc0640 1 --2- 172.21.15.44:0/2095304537 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0efba17d0 0x55f0efba97f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:46.999 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.991+0000 7f1e4dcc0640 1 -- 172.21.15.44:0/2095304537 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0ef8e5620 con 0x55f0efba20f0 2024-08-19T00:15:46.999 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.991+0000 7f1e4dcc0640 1 --2- 172.21.15.44:0/2095304537 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0efba20f0 0x55f0efba9d30 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f1e3800ea40 tx=0x7f1e3800ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7facd1b557464a2c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:15:46.999 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.991+0000 7f1e31ffb640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:15:46.999 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.991+0000 7f1e31ffb640 1 -- 172.21.15.44:0/2095304537 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3801e060 con 0x55f0efba20f0 2024-08-19T00:15:46.999 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.991+0000 7f1e31ffb640 1 -- 172.21.15.44:0/2095304537 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f1e3800d9a0 con 0x55f0efba20f0 2024-08-19T00:15:46.999 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.991+0000 7f1e535c5740 1 -- 172.21.15.44:0/2095304537 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e4409bac0 con 0x55f0efba20f0 2024-08-19T00:15:46.999 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.991+0000 7f1e31ffb640 1 -- 172.21.15.44:0/2095304537 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1e38025050 con 0x55f0efba20f0 2024-08-19T00:15:46.999 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.991+0000 7f1e535c5740 10 client.15810 fetch_fsmap learned FSMap version 30 2024-08-19T00:15:46.999 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.991+0000 7f1e535c5740 1 -- 172.21.15.44:0/2095304537 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f0efbbb1c0 con 0x55f0efba20f0 2024-08-19T00:15:47.000 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.992+0000 7f1e31ffb640 1 -- 172.21.15.44:0/2095304537 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e4409bac0 con 0x55f0efba20f0 2024-08-19T00:15:47.000 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.992+0000 7f1e31ffb640 1 -- 172.21.15.44:0/2095304537 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 30) ==== 8386+0+0 (secure 0 0 0) 0x7f1e3800b040 con 0x55f0efba20f0 2024-08-19T00:15:47.000 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.992+0000 7f1e535c5740 10 client.15810 fetch_fsmap finished waiting for FSMap version 30 2024-08-19T00:15:47.000 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.992+0000 7f1e535c5740 10 client.15810 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:15:47.000 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.992+0000 7f1e535c5740 20 client.15810 populate_metadata read hostname 'smithi044' 2024-08-19T00:15:47.000 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.992+0000 7f1e535c5740 1 --2- 172.21.15.44:0/2095304537 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55f0efbbc720 0x55f0efbbeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:47.000 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.992+0000 7f1e535c5740 4 client.15810 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:15:47.000 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.992+0000 7f1e535c5740 1 -- 172.21.15.44:0/2095304537 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f0efb13100 con 0x55f0efbbc720 2024-08-19T00:15:47.000 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.992+0000 7f1e4e4c1640 1 --2- 172.21.15.44:0/2095304537 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55f0efbbc720 0x55f0efbbeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:47.000 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.993+0000 7f1e31ffb640 10 client.15810 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:15:47.000 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.993+0000 7f1e4e4c1640 1 --2- 172.21.15.44:0/2095304537 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55f0efbbc720 0x55f0efbbeb80 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28ef1ef831f888f9 server_cookie=a188ca3a3108d5a6 in_seq=0 out_seq=0 2024-08-19T00:15:47.000 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.993+0000 7f1e31ffb640 1 -- 172.21.15.44:0/2095304537 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f0efb13100 con 0x55f0efbbc720 2024-08-19T00:15:47.000 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.993+0000 7f1e31ffb640 10 client.15810 handle_command_reply: tid=0 2024-08-19T00:15:47.000 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.993+0000 7f1e535c5740 1 client.15810 shutdown 2024-08-19T00:15:47.001 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.993+0000 7f1e535c5740 1 -- 172.21.15.44:0/2095304537 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0efba20f0 msgr2=0x55f0efba9d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:47.001 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.993+0000 7f1e535c5740 1 --2- 172.21.15.44:0/2095304537 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0efba20f0 0x55f0efba9d30 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f1e3800ea40 tx=0x7f1e3800ef00 comp rx=0 tx=0).stop 2024-08-19T00:15:47.001 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.994+0000 7f1e535c5740 1 -- 172.21.15.44:0/2095304537 shutdown_connections 2024-08-19T00:15:47.001 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.994+0000 7f1e535c5740 1 --2- 172.21.15.44:0/2095304537 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55f0efbbc720 0x55f0efbbeb80 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:47.001 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.994+0000 7f1e535c5740 1 --2- 172.21.15.44:0/2095304537 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f0efbac990 0x55f0efbaa270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:47.001 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.994+0000 7f1e535c5740 1 --2- 172.21.15.44:0/2095304537 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0efba20f0 0x55f0efba9d30 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:47.001 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.994+0000 7f1e31ffb640 0 client.15810 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:15:47.001 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.994+0000 7f1e535c5740 1 --2- 172.21.15.44:0/2095304537 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0efba17d0 0x55f0efba97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:47.001 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.994+0000 7f1e535c5740 1 -- 172.21.15.44:0/2095304537 >> 172.21.15.44:0/2095304537 conn(0x55f0efb9dd40 msgr2=0x55f0efba3aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:15:47.001 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.994+0000 7f1e535c5740 1 -- 172.21.15.44:0/2095304537 shutdown_connections 2024-08-19T00:15:47.001 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.994+0000 7f1e535c5740 1 -- 172.21.15.44:0/2095304537 wait complete. 2024-08-19T00:15:47.001 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:46.994+0000 7f1e535c5740 20 client.15810 trim_cache size 0 max 16384 2024-08-19T00:15:47.011 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.008+0000 7f1e535c5740 1 Processor -- start 2024-08-19T00:15:47.011 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.008+0000 7f1e535c5740 1 -- start start 2024-08-19T00:15:47.011 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.008+0000 7f1e535c5740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0efba17d0 0x55f0efbc4490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:47.011 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.009+0000 7f1e535c5740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f0efba20f0 0x55f0efbc49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:47.011 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.009+0000 7f1e535c5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0efbac990 0x55f0efba3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:47.011 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.009+0000 7f1e535c5740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1e481aec50 con 0x55f0efbac990 2024-08-19T00:15:47.011 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.009+0000 7f1e535c5740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f1e481b0850 con 0x55f0efba17d0 2024-08-19T00:15:47.011 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.009+0000 7f1e535c5740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1e481af320 con 0x55f0efba20f0 2024-08-19T00:15:47.011 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.009+0000 7f1e4ecc2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0efbac990 0x55f0efba3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:47.011 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.009+0000 7f1e4ecc2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0efbac990 0x55f0efba3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53370/0 (socket says 172.21.15.44:53370) 2024-08-19T00:15:47.011 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.009+0000 7f1e4ecc2640 1 -- 172.21.15.44:0/3194087002 learned_addr learned my addr 172.21.15.44:0/3194087002 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:15:47.011 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.009+0000 7f1e4e4c1640 1 --2- 172.21.15.44:0/3194087002 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0efba17d0 0x55f0efbc4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:47.012 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.009+0000 7f1e4dcc0640 1 --2- 172.21.15.44:0/3194087002 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f0efba20f0 0x55f0efbc49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:47.012 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.009+0000 7f1e4ecc2640 1 -- 172.21.15.44:0/3194087002 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f0efba20f0 msgr2=0x55f0efbc49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:15:47.012 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.009+0000 7f1e4ecc2640 1 --2- 172.21.15.44:0/3194087002 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f0efba20f0 0x55f0efbc49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:47.012 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.009+0000 7f1e4ecc2640 1 -- 172.21.15.44:0/3194087002 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0efba17d0 msgr2=0x55f0efbc4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:15:47.012 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.009+0000 7f1e4ecc2640 1 --2- 172.21.15.44:0/3194087002 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0efba17d0 0x55f0efbc4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:47.012 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.009+0000 7f1e4ecc2640 1 -- 172.21.15.44:0/3194087002 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0efba1600 con 0x55f0efbac990 2024-08-19T00:15:47.012 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.009+0000 7f1e4e4c1640 1 --2- 172.21.15.44:0/3194087002 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0efba17d0 0x55f0efbc4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:15:47.012 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.009+0000 7f1e4ecc2640 1 --2- 172.21.15.44:0/3194087002 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0efbac990 0x55f0efba3230 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f1e4002aeb0 tx=0x7f1e40005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=228f43254cc5fe71 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:15:47.012 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.009+0000 7f1e33fff640 1 -- 172.21.15.44:0/3194087002 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e40045070 con 0x55f0efbac990 2024-08-19T00:15:47.012 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.009+0000 7f1e33fff640 1 -- 172.21.15.44:0/3194087002 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e40051030 con 0x55f0efbac990 2024-08-19T00:15:47.012 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.009+0000 7f1e33fff640 1 -- 172.21.15.44:0/3194087002 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e4002fb50 con 0x55f0efbac990 2024-08-19T00:15:47.016 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.010+0000 7f1e535c5740 1 -- 172.21.15.44:0/3194087002 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0efbac990 msgr2=0x55f0efba3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:47.016 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.010+0000 7f1e535c5740 1 --2- 172.21.15.44:0/3194087002 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0efbac990 0x55f0efba3230 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f1e4002aeb0 tx=0x7f1e40005f10 comp rx=0 tx=0).stop 2024-08-19T00:15:47.016 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.010+0000 7f1e535c5740 1 -- 172.21.15.44:0/3194087002 shutdown_connections 2024-08-19T00:15:47.016 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.010+0000 7f1e535c5740 1 --2- 172.21.15.44:0/3194087002 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f0efba20f0 0x55f0efbc49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:47.016 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.010+0000 7f1e535c5740 1 --2- 172.21.15.44:0/3194087002 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0efbac990 0x55f0efba3230 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:47.016 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.010+0000 7f1e535c5740 1 --2- 172.21.15.44:0/3194087002 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0efba17d0 0x55f0efbc4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:47.016 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.010+0000 7f1e535c5740 1 -- 172.21.15.44:0/3194087002 >> 172.21.15.44:0/3194087002 conn(0x55f0efb9dd40 msgr2=0x55f0efbab760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:15:47.016 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.010+0000 7f1e535c5740 1 -- 172.21.15.44:0/3194087002 shutdown_connections 2024-08-19T00:15:47.016 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.010+0000 7f1e535c5740 1 -- 172.21.15.44:0/3194087002 wait complete. 2024-08-19T00:15:47.016 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.010+0000 7f1e535c5740 1 -- start start 2024-08-19T00:15:47.016 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.010+0000 7f1e535c5740 1 Processor -- start 2024-08-19T00:15:47.017 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.011+0000 7f1e535c5740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f0efba17d0 0x55f0efba6820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:47.017 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.011+0000 7f1e535c5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0efba20f0 0x55f0efba6d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:47.017 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.011+0000 7f1e535c5740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0efbac990 0x55f0efba72a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:47.017 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.011+0000 7f1e535c5740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1e481b00c0 con 0x55f0efba20f0 2024-08-19T00:15:47.017 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.011+0000 7f1e535c5740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f1e481af9f0 con 0x55f0efbac990 2024-08-19T00:15:47.017 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.011+0000 7f1e535c5740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1e481acc30 con 0x55f0efba17d0 2024-08-19T00:15:47.017 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.011+0000 7f1e535c5740 10 client.0 _ll_register_callbacks cb 0x7f1e3800b920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:15:47.017 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.011+0000 7f1e4dcc0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0efba20f0 0x55f0efba6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:47.017 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.011+0000 7f1e4dcc0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0efba20f0 0x55f0efba6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53378/0 (socket says 172.21.15.44:53378) 2024-08-19T00:15:47.017 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.011+0000 7f1e4dcc0640 1 -- 172.21.15.44:0/2143965584 learned_addr learned my addr 172.21.15.44:0/2143965584 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:15:47.017 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.011+0000 7f1e4e4c1640 1 --2- 172.21.15.44:0/2143965584 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f0efba17d0 0x55f0efba6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:47.017 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.011+0000 7f1e4ecc2640 1 --2- 172.21.15.44:0/2143965584 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0efbac990 0x55f0efba72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:47.018 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.011+0000 7f1e4dcc0640 1 -- 172.21.15.44:0/2143965584 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f0efba17d0 msgr2=0x55f0efba6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:15:47.018 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.011+0000 7f1e4dcc0640 1 --2- 172.21.15.44:0/2143965584 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f0efba17d0 0x55f0efba6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:47.018 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.011+0000 7f1e4dcc0640 1 -- 172.21.15.44:0/2143965584 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0efbac990 msgr2=0x55f0efba72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:15:47.018 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.011+0000 7f1e4dcc0640 1 --2- 172.21.15.44:0/2143965584 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0efbac990 0x55f0efba72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:47.018 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.011+0000 7f1e4dcc0640 1 -- 172.21.15.44:0/2143965584 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0efb9db70 con 0x55f0efba20f0 2024-08-19T00:15:47.018 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.011+0000 7f1e4dcc0640 1 --2- 172.21.15.44:0/2143965584 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0efba20f0 0x55f0efba6d60 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f1e38001eb0 tx=0x7f1e3800b490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c33194574b40bedb server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:15:47.018 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.011+0000 7f1e31ffb640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:15:47.018 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.011+0000 7f1e31ffb640 1 -- 172.21.15.44:0/2143965584 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e380053a0 con 0x55f0efba20f0 2024-08-19T00:15:47.018 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.011+0000 7f1e31ffb640 1 -- 172.21.15.44:0/2143965584 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f1e38005540 con 0x55f0efba20f0 2024-08-19T00:15:47.018 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.012+0000 7f1e535c5740 1 -- 172.21.15.44:0/2143965584 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e40051030 con 0x55f0efba20f0 2024-08-19T00:15:47.018 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.012+0000 7f1e31ffb640 1 -- 172.21.15.44:0/2143965584 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1e3803d050 con 0x55f0efba20f0 2024-08-19T00:15:47.018 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.012+0000 7f1e535c5740 10 client.15816 fetch_fsmap learned FSMap version 30 2024-08-19T00:15:47.018 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.012+0000 7f1e535c5740 1 -- 172.21.15.44:0/2143965584 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f0efc275b0 con 0x55f0efba20f0 2024-08-19T00:15:47.019 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.012+0000 7f1e31ffb640 1 -- 172.21.15.44:0/2143965584 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e40051030 con 0x55f0efba20f0 2024-08-19T00:15:47.019 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.012+0000 7f1e31ffb640 1 -- 172.21.15.44:0/2143965584 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 30) ==== 8386+0+0 (secure 0 0 0) 0x7f1e380035f0 con 0x55f0efba20f0 2024-08-19T00:15:47.019 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.012+0000 7f1e535c5740 10 client.15816 fetch_fsmap finished waiting for FSMap version 30 2024-08-19T00:15:47.019 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.012+0000 7f1e535c5740 10 client.15816 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:15:47.019 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.012+0000 7f1e535c5740 20 client.15816 populate_metadata read hostname 'smithi044' 2024-08-19T00:15:47.019 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.012+0000 7f1e535c5740 1 --2- 172.21.15.44:0/2143965584 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55f0efc27e20 0x55f0efc2a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:47.019 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.012+0000 7f1e535c5740 4 client.15816 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-19T00:15:47.019 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.012+0000 7f1e535c5740 1 -- 172.21.15.44:0/2143965584 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f0efb0d450 con 0x55f0efc27e20 2024-08-19T00:15:47.019 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.012+0000 7f1e4e4c1640 1 --2- 172.21.15.44:0/2143965584 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55f0efc27e20 0x55f0efc2a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:47.019 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.013+0000 7f1e4e4c1640 1 --2- 172.21.15.44:0/2143965584 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55f0efc27e20 0x55f0efc2a240 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a76ff982b3158cb server_cookie=613579ed76db3176 in_seq=0 out_seq=0 2024-08-19T00:15:47.019 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.013+0000 7f1e31ffb640 10 client.15816 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:15:47.022 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.021+0000 7f1e31ffb640 1 -- 172.21.15.44:0/2143965584 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f0efb0d450 con 0x55f0efc27e20 2024-08-19T00:15:47.023 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.021+0000 7f1e31ffb640 10 client.15816 handle_command_reply: tid=0 2024-08-19T00:15:47.023 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.021+0000 7f1e535c5740 1 client.15816 shutdown 2024-08-19T00:15:47.023 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.021+0000 7f1e535c5740 1 -- 172.21.15.44:0/2143965584 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0efba20f0 msgr2=0x55f0efba6d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:47.023 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.021+0000 7f1e535c5740 1 --2- 172.21.15.44:0/2143965584 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0efba20f0 0x55f0efba6d60 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f1e38001eb0 tx=0x7f1e3800b490 comp rx=0 tx=0).stop 2024-08-19T00:15:47.023 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.021+0000 7f1e535c5740 1 -- 172.21.15.44:0/2143965584 shutdown_connections 2024-08-19T00:15:47.023 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.021+0000 7f1e535c5740 1 --2- 172.21.15.44:0/2143965584 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55f0efc27e20 0x55f0efc2a240 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:47.023 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.021+0000 7f1e535c5740 1 --2- 172.21.15.44:0/2143965584 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0efbac990 0x55f0efba72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:47.023 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.021+0000 7f1e535c5740 1 --2- 172.21.15.44:0/2143965584 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0efba20f0 0x55f0efba6d60 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:47.023 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.021+0000 7f1e31ffb640 0 client.15816 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:15:47.023 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.021+0000 7f1e535c5740 1 --2- 172.21.15.44:0/2143965584 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f0efba17d0 0x55f0efba6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:47.023 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.021+0000 7f1e535c5740 1 -- 172.21.15.44:0/2143965584 >> 172.21.15.44:0/2143965584 conn(0x55f0efb9dd40 msgr2=0x55f0efba9790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:15:47.024 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.021+0000 7f1e535c5740 1 -- 172.21.15.44:0/2143965584 shutdown_connections 2024-08-19T00:15:47.024 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.021+0000 7f1e535c5740 1 -- 172.21.15.44:0/2143965584 wait complete. 2024-08-19T00:15:47.024 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.021+0000 7f1e535c5740 20 client.15816 trim_cache size 0 max 16384 2024-08-19T00:15:47.024 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:{ 2024-08-19T00:15:47.024 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "message": "", 2024-08-19T00:15:47.024 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "return_code": 0 2024-08-19T00:15:47.024 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:} 2024-08-19T00:15:47.025 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.022+0000 7f1e50725640 1 -- 172.21.15.44:0/2149726524 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f1e340a2da0 msgr2=0x7f1e340a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:47.025 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.022+0000 7f1e50725640 1 --2- 172.21.15.44:0/2149726524 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f1e340a2da0 0x7f1e340a5260 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1e40009430 tx=0x7f1e4002a8c0 comp rx=0 tx=0).stop 2024-08-19T00:15:47.025 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.022+0000 7f1e50725640 1 -- 172.21.15.44:0/2149726524 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e48100560 msgr2=0x7f1e48197fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:47.025 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.022+0000 7f1e50725640 1 --2- 172.21.15.44:0/2149726524 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e48100560 0x7f1e48197fa0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f1e4400c920 tx=0x7f1e4400cde0 comp rx=0 tx=0).stop 2024-08-19T00:15:47.025 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.022+0000 7f1e50725640 1 -- 172.21.15.44:0/2149726524 shutdown_connections 2024-08-19T00:15:47.025 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.022+0000 7f1e50725640 1 --2- 172.21.15.44:0/2149726524 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f1e340a2da0 0x7f1e340a5260 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:47.025 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.022+0000 7f1e50725640 1 --2- 172.21.15.44:0/2149726524 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1e48105250 0x7f1e4819c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:47.025 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.022+0000 7f1e50725640 1 --2- 172.21.15.44:0/2149726524 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1e48100f10 0x7f1e481984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:47.026 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.022+0000 7f1e50725640 1 --2- 172.21.15.44:0/2149726524 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e48100560 0x7f1e48197fa0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:47.026 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.022+0000 7f1e50725640 1 -- 172.21.15.44:0/2149726524 >> 172.21.15.44:0/2149726524 conn(0x7f1e48075c50 msgr2=0x7f1e480fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:15:47.026 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.022+0000 7f1e50725640 1 -- 172.21.15.44:0/2149726524 shutdown_connections 2024-08-19T00:15:47.026 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:15:47.022+0000 7f1e50725640 1 -- 172.21.15.44:0/2149726524 wait complete. 2024-08-19T00:15:47.651 INFO:tasks.workunit.client.0.smithi044.stdout: 1 111594 8.60 MB/sec warmup 72 sec latency 3845.948 ms 2024-08-19T00:15:48.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:15:48 smithi171 ceph-mon[21810]: pgmap v77: 129 pgs: 129 active+clean; 80 MiB data, 694 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 2.5 MiB/s wr, 226 op/s 2024-08-19T00:15:48.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:15:48 smithi116 ceph-mon[21873]: pgmap v77: 129 pgs: 129 active+clean; 80 MiB data, 694 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 2.5 MiB/s wr, 226 op/s 2024-08-19T00:15:48.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:15:48 smithi044 ceph-mon[18489]: pgmap v77: 129 pgs: 129 active+clean; 80 MiB data, 694 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 2.5 MiB/s wr, 226 op/s 2024-08-19T00:15:48.651 INFO:tasks.workunit.client.0.smithi044.stdout: 1 111594 8.48 MB/sec warmup 73 sec latency 4846.062 ms 2024-08-19T00:15:49.651 INFO:tasks.workunit.client.0.smithi044.stdout: 1 111594 8.36 MB/sec warmup 74 sec latency 5846.165 ms 2024-08-19T00:15:50.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:15:50 smithi171 ceph-mon[21810]: pgmap v78: 129 pgs: 129 active+clean; 80 MiB data, 694 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 2.5 MiB/s wr, 226 op/s 2024-08-19T00:15:50.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:15:50 smithi116 ceph-mon[21873]: pgmap v78: 129 pgs: 129 active+clean; 80 MiB data, 694 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 2.5 MiB/s wr, 226 op/s 2024-08-19T00:15:50.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:15:50 smithi044 ceph-mon[18489]: pgmap v78: 129 pgs: 129 active+clean; 80 MiB data, 694 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 2.5 MiB/s wr, 226 op/s 2024-08-19T00:15:50.651 INFO:tasks.workunit.client.0.smithi044.stdout: 1 111594 8.25 MB/sec warmup 75 sec latency 6846.250 ms 2024-08-19T00:15:50.672 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-19T00:15:50.940 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:15:51.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:51.416+0000 7f1d6bd14640 1 -- 172.21.15.44:0/832130274 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d64100b50 msgr2=0x7f1d64100f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:51.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:51.416+0000 7f1d6bd14640 1 --2- 172.21.15.44:0/832130274 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d64100b50 0x7f1d64100f30 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f1d60009900 tx=0x7f1d6002a480 comp rx=0 tx=0).stop 2024-08-19T00:15:51.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:51.416+0000 7f1d6bd14640 1 -- 172.21.15.44:0/832130274 shutdown_connections 2024-08-19T00:15:51.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:51.416+0000 7f1d6bd14640 1 --2- 172.21.15.44:0/832130274 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1d64102c20 0x7f1d6410d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:51.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:51.416+0000 7f1d6bd14640 1 --2- 172.21.15.44:0/832130274 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1d641022a0 0x7f1d641026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:51.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:51.416+0000 7f1d6bd14640 1 --2- 172.21.15.44:0/832130274 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d64100b50 0x7f1d64100f30 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:51.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:51.416+0000 7f1d6bd14640 1 -- 172.21.15.44:0/832130274 >> 172.21.15.44:0/832130274 conn(0x7f1d640fc500 msgr2=0x7f1d640fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:15:51.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:51.416+0000 7f1d6bd14640 1 -- 172.21.15.44:0/832130274 shutdown_connections 2024-08-19T00:15:51.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:51.416+0000 7f1d6bd14640 1 -- 172.21.15.44:0/832130274 wait complete. 2024-08-19T00:15:51.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:51.417+0000 7f1d6bd14640 1 Processor -- start 2024-08-19T00:15:51.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:51.417+0000 7f1d6bd14640 1 -- start start 2024-08-19T00:15:51.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:51.417+0000 7f1d6bd14640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1d64100b50 0x7f1d641972b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:51.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:51.417+0000 7f1d6bd14640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1d641022a0 0x7f1d641977f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:51.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:51.417+0000 7f1d6bd14640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d64102c20 0x7f1d6419bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:51.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:51.417+0000 7f1d6bd14640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1d64110d50 con 0x7f1d64102c20 2024-08-19T00:15:51.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:51.417+0000 7f1d6bd14640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f1d64110bd0 con 0x7f1d64100b50 2024-08-19T00:15:51.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:51.417+0000 7f1d6bd14640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1d64110ed0 con 0x7f1d641022a0 2024-08-19T00:15:51.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:51.417+0000 7f1d6a2b1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d64102c20 0x7f1d6419bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:51.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:51.417+0000 7f1d6a2b1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d64102c20 0x7f1d6419bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34236/0 (socket says 172.21.15.44:34236) 2024-08-19T00:15:51.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:51.417+0000 7f1d6a2b1640 1 -- 172.21.15.44:0/2706644042 learned_addr learned my addr 172.21.15.44:0/2706644042 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:15:51.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:51.417+0000 7f1d69ab0640 1 --2- 172.21.15.44:0/2706644042 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1d64100b50 0x7f1d641972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:51.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:51.417+0000 7f1d692af640 1 --2- 172.21.15.44:0/2706644042 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1d641022a0 0x7f1d641977f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:51.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:51.417+0000 7f1d6a2b1640 1 -- 172.21.15.44:0/2706644042 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1d641022a0 msgr2=0x7f1d641977f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:51.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:51.417+0000 7f1d6a2b1640 1 --2- 172.21.15.44:0/2706644042 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1d641022a0 0x7f1d641977f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:51.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:51.417+0000 7f1d6a2b1640 1 -- 172.21.15.44:0/2706644042 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1d64100b50 msgr2=0x7f1d641972b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:51.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:51.417+0000 7f1d6a2b1640 1 --2- 172.21.15.44:0/2706644042 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1d64100b50 0x7f1d641972b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:51.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:51.417+0000 7f1d6a2b1640 1 -- 172.21.15.44:0/2706644042 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d6419c260 con 0x7f1d64102c20 2024-08-19T00:15:51.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:51.417+0000 7f1d69ab0640 1 --2- 172.21.15.44:0/2706644042 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1d64100b50 0x7f1d641972b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:15:51.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:51.418+0000 7f1d6a2b1640 1 --2- 172.21.15.44:0/2706644042 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d64102c20 0x7f1d6419bb80 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c00b970 tx=0x7f1d5c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:15:51.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:51.418+0000 7f1d5affd640 1 -- 172.21.15.44:0/2706644042 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d5c019070 con 0x7f1d64102c20 2024-08-19T00:15:51.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:51.418+0000 7f1d6bd14640 1 -- 172.21.15.44:0/2706644042 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d6419c550 con 0x7f1d64102c20 2024-08-19T00:15:51.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:51.418+0000 7f1d5affd640 1 -- 172.21.15.44:0/2706644042 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d5c00cb40 con 0x7f1d64102c20 2024-08-19T00:15:51.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:51.418+0000 7f1d5affd640 1 -- 172.21.15.44:0/2706644042 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d5c007610 con 0x7f1d64102c20 2024-08-19T00:15:51.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:51.418+0000 7f1d6bd14640 1 -- 172.21.15.44:0/2706644042 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d641a3e30 con 0x7f1d64102c20 2024-08-19T00:15:51.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:51.419+0000 7f1d6bd14640 1 -- 172.21.15.44:0/2706644042 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d64100fb0 con 0x7f1d64102c20 2024-08-19T00:15:51.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:51.420+0000 7f1d5affd640 1 -- 172.21.15.44:0/2706644042 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f1d5c01c070 con 0x7f1d64102c20 2024-08-19T00:15:51.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:51.421+0000 7f1d5affd640 1 --2- 172.21.15.44:0/2706644042 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f1d500a2cf0 0x7f1d500a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:51.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:51.421+0000 7f1d69ab0640 1 --2- 172.21.15.44:0/2706644042 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f1d500a2cf0 0x7f1d500a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:51.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:51.421+0000 7f1d5affd640 1 -- 172.21.15.44:0/2706644042 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f1d5c0cf230 con 0x7f1d64102c20 2024-08-19T00:15:51.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:51.421+0000 7f1d69ab0640 1 --2- 172.21.15.44:0/2706644042 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f1d500a2cf0 0x7f1d500a51b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1d60005ab0 tx=0x7f1d60005a20 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:15:51.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:51.424+0000 7f1d5affd640 1 -- 172.21.15.44:0/2706644042 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f1d5c09bb60 con 0x7f1d64102c20 2024-08-19T00:15:51.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:51.635+0000 7f1d6bd14640 1 -- 172.21.15.44:0/2706644042 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1d64108dc0 con 0x7f1d64102c20 2024-08-19T00:15:51.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:51.635+0000 7f1d5affd640 1 -- 172.21.15.44:0/2706644042 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11996 (secure 0 0 0) 0x7f1d5c09b460 con 0x7f1d64102c20 2024-08-19T00:15:51.638 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:15:51.638 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":30,"btime":"2024-08-19T00:14:41:883285+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14511,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1538841896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1538841896},{"type":"v1","addr":"172.21.15.116:6833","nonce":1538841896}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/4044471606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4044471606},{"type":"v1","addr":"172.21.15.44:6835","nonce":4044471606}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-19T00:10:53.196636+0000","modified":"2024-08-19T00:14:41.583467+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24473,"mds_1":24446,"mds_2":24439,"mds_3":24431,"mds_4":24418},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14529":{"gid":14529,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6837/1824829052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1824829052},{"type":"v1","addr":"172.21.15.44:6837","nonce":1824829052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14577":{"gid":14577,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6839/3591739042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":3591739042},{"type":"v1","addr":"172.21.15.44:6839","nonce":3591739042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14589":{"gid":14589,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6841/3667695717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6840","nonce":3667695717},{"type":"v1","addr":"172.21.15.44:6841","nonce":3667695717}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24388":{"gid":24388,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1183022838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1183022838},{"type":"v1","addr":"172.21.15.171:6833","nonce":1183022838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6835/2190623851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":2190623851},{"type":"v1","addr":"172.21.15.171:6835","nonce":2190623851}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.171:6837/316231795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":316231795},{"type":"v1","addr":"172.21.15.171:6837","nonce":316231795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":20,"addr":"172.21.15.116:6835/3507399322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3507399322},{"type":"v1","addr":"172.21.15.116:6835","nonce":3507399322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.171:6839/1466585795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":1466585795},{"type":"v1","addr":"172.21.15.171:6839","nonce":1466585795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":17,"addr":"172.21.15.116:6837/2764513846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":2764513846},{"type":"v1","addr":"172.21.15.116:6837","nonce":2764513846}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.116:6839/1032741033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":1032741033},{"type":"v1","addr":"172.21.15.116:6839","nonce":1032741033}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24418,24431,24439,24446,24473]},"id":1}]} 2024-08-19T00:15:51.638 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 30 2024-08-19T00:15:51.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:51.637+0000 7f1d6bd14640 1 -- 172.21.15.44:0/2706644042 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f1d500a2cf0 msgr2=0x7f1d500a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:51.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:51.637+0000 7f1d6bd14640 1 --2- 172.21.15.44:0/2706644042 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f1d500a2cf0 0x7f1d500a51b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1d60005ab0 tx=0x7f1d60005a20 comp rx=0 tx=0).stop 2024-08-19T00:15:51.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:51.637+0000 7f1d6bd14640 1 -- 172.21.15.44:0/2706644042 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d64102c20 msgr2=0x7f1d6419bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:51.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:51.637+0000 7f1d6bd14640 1 --2- 172.21.15.44:0/2706644042 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d64102c20 0x7f1d6419bb80 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c00b970 tx=0x7f1d5c00be30 comp rx=0 tx=0).stop 2024-08-19T00:15:51.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:51.637+0000 7f1d6bd14640 1 -- 172.21.15.44:0/2706644042 shutdown_connections 2024-08-19T00:15:51.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:51.637+0000 7f1d6bd14640 1 --2- 172.21.15.44:0/2706644042 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f1d500a2cf0 0x7f1d500a51b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:51.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:51.637+0000 7f1d6bd14640 1 --2- 172.21.15.44:0/2706644042 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1d641022a0 0x7f1d641977f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:51.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:51.637+0000 7f1d6bd14640 1 --2- 172.21.15.44:0/2706644042 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d64102c20 0x7f1d6419bb80 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:51.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:51.637+0000 7f1d6bd14640 1 --2- 172.21.15.44:0/2706644042 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1d64100b50 0x7f1d641972b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:51.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:51.637+0000 7f1d6bd14640 1 -- 172.21.15.44:0/2706644042 >> 172.21.15.44:0/2706644042 conn(0x7f1d640fc500 msgr2=0x7f1d640fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:15:51.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:51.638+0000 7f1d6bd14640 1 -- 172.21.15.44:0/2706644042 shutdown_connections 2024-08-19T00:15:51.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:51.638+0000 7f1d6bd14640 1 -- 172.21.15.44:0/2706644042 wait complete. 2024-08-19T00:15:51.651 INFO:tasks.workunit.client.0.smithi044.stdout: 1 111594 8.14 MB/sec warmup 76 sec latency 7846.306 ms 2024-08-19T00:15:52.335 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:15:52 smithi044 ceph-mon[18489]: pgmap v79: 129 pgs: 129 active+clean; 82 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.5 MiB/s wr, 266 op/s 2024-08-19T00:15:52.335 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:15:52 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/2706644042' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:15:52.367 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24473 quiesce db --set-id 88dd3c11 --release --await' 2024-08-19T00:15:52.367 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24473 quiesce db --set-id 88dd3c11 --release --await 2024-08-19T00:15:52.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:15:52 smithi171 ceph-mon[21810]: pgmap v79: 129 pgs: 129 active+clean; 82 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.5 MiB/s wr, 266 op/s 2024-08-19T00:15:52.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:15:52 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/2706644042' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:15:52.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:15:52 smithi116 ceph-mon[21873]: pgmap v79: 129 pgs: 129 active+clean; 82 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.5 MiB/s wr, 266 op/s 2024-08-19T00:15:52.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:15:52 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/2706644042' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:15:52.651 INFO:tasks.workunit.client.0.smithi044.stdout: 1 111594 8.04 MB/sec warmup 77 sec latency 8846.335 ms 2024-08-19T00:15:52.666 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:15:53.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.255+0000 7fb27e46b640 1 -- 172.21.15.44:0/1688185209 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb278102a70 msgr2=0x7fb278102e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:53.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.255+0000 7fb27e46b640 1 --2- 172.21.15.44:0/1688185209 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb278102a70 0x7fb278102e50 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fb268009900 tx=0x7fb26802a480 comp rx=0 tx=0).stop 2024-08-19T00:15:53.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.255+0000 7fb27e46b640 1 -- 172.21.15.44:0/1688185209 shutdown_connections 2024-08-19T00:15:53.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.255+0000 7fb27e46b640 1 --2- 172.21.15.44:0/1688185209 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb27810bea0 0x7fb27810e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:53.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.255+0000 7fb27e46b640 1 --2- 172.21.15.44:0/1688185209 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb278103390 0x7fb27810b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:53.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.255+0000 7fb27e46b640 1 --2- 172.21.15.44:0/1688185209 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb278102a70 0x7fb278102e50 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:53.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.255+0000 7fb27e46b640 1 -- 172.21.15.44:0/1688185209 >> 172.21.15.44:0/1688185209 conn(0x7fb2780fc4d0 msgr2=0x7fb2780fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:15:53.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.255+0000 7fb27e46b640 1 -- 172.21.15.44:0/1688185209 shutdown_connections 2024-08-19T00:15:53.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.255+0000 7fb27e46b640 1 -- 172.21.15.44:0/1688185209 wait complete. 2024-08-19T00:15:53.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.256+0000 7fb27e46b640 1 Processor -- start 2024-08-19T00:15:53.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.256+0000 7fb27e46b640 1 -- start start 2024-08-19T00:15:53.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.256+0000 7fb27e46b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb278102a70 0x7fb2781006d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:53.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.256+0000 7fb27e46b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb278103390 0x7fb278100c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:53.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.256+0000 7fb27e46b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb27810bea0 0x7fb278101150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:53.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.256+0000 7fb27e46b640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb278111ca0 con 0x7fb278103390 2024-08-19T00:15:53.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.256+0000 7fb27e46b640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fb278111b20 con 0x7fb278102a70 2024-08-19T00:15:53.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.256+0000 7fb27e46b640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb278111e20 con 0x7fb27810bea0 2024-08-19T00:15:53.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.256+0000 7fb26ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb278103390 0x7fb278100c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:53.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.256+0000 7fb277fff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb278102a70 0x7fb2781006d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:53.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.256+0000 7fb26ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb278103390 0x7fb278100c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34244/0 (socket says 172.21.15.44:34244) 2024-08-19T00:15:53.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.256+0000 7fb26ffff640 1 -- 172.21.15.44:0/2657946052 learned_addr learned my addr 172.21.15.44:0/2657946052 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:15:53.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.256+0000 7fb27ca08640 1 --2- 172.21.15.44:0/2657946052 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb27810bea0 0x7fb278101150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:53.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.257+0000 7fb26ffff640 1 -- 172.21.15.44:0/2657946052 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb27810bea0 msgr2=0x7fb278101150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:53.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.257+0000 7fb26ffff640 1 --2- 172.21.15.44:0/2657946052 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb27810bea0 0x7fb278101150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:53.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.257+0000 7fb26ffff640 1 -- 172.21.15.44:0/2657946052 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb278102a70 msgr2=0x7fb2781006d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:53.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.257+0000 7fb26ffff640 1 --2- 172.21.15.44:0/2657946052 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb278102a70 0x7fb2781006d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:53.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.257+0000 7fb26ffff640 1 -- 172.21.15.44:0/2657946052 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2781a6630 con 0x7fb278103390 2024-08-19T00:15:53.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.257+0000 7fb277fff640 1 --2- 172.21.15.44:0/2657946052 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb278102a70 0x7fb2781006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:15:53.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.257+0000 7fb26ffff640 1 --2- 172.21.15.44:0/2657946052 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb278103390 0x7fb278100c10 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fb26000e9f0 tx=0x7fb26000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:15:53.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.257+0000 7fb275ffb640 1 -- 172.21.15.44:0/2657946052 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb26000ccc0 con 0x7fb278103390 2024-08-19T00:15:53.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.257+0000 7fb275ffb640 1 -- 172.21.15.44:0/2657946052 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb260010910 con 0x7fb278103390 2024-08-19T00:15:53.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.257+0000 7fb27e46b640 1 -- 172.21.15.44:0/2657946052 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2781a6920 con 0x7fb278103390 2024-08-19T00:15:53.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.257+0000 7fb275ffb640 1 -- 172.21.15.44:0/2657946052 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb260018920 con 0x7fb278103390 2024-08-19T00:15:53.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.257+0000 7fb27e46b640 1 -- 172.21.15.44:0/2657946052 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2781a6e60 con 0x7fb278103390 2024-08-19T00:15:53.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.259+0000 7fb275ffb640 1 -- 172.21.15.44:0/2657946052 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fb260010430 con 0x7fb278103390 2024-08-19T00:15:53.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.259+0000 7fb280869740 1 Processor -- start 2024-08-19T00:15:53.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.260+0000 7fb280869740 1 -- start start 2024-08-19T00:15:53.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.260+0000 7fb280869740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5597f354d990 0x5597f354dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:53.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.260+0000 7fb280869740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5597f354e2b0 0x5597f3558630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:53.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.260+0000 7fb280869740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f3558b70 0x5597f355af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:53.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.260+0000 7fb280869740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5597f34b3c60 con 0x5597f3558b70 2024-08-19T00:15:53.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.260+0000 7fb280869740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5597f344bb90 con 0x5597f354d990 2024-08-19T00:15:53.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.260+0000 7fb280869740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5597f34afc20 con 0x5597f354e2b0 2024-08-19T00:15:53.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.260+0000 7fb275ffb640 1 --2- 172.21.15.44:0/2657946052 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fb2640a2cf0 0x7fb2640a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:53.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.260+0000 7fb26ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f3558b70 0x5597f355af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:53.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.260+0000 7fb26ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f3558b70 0x5597f355af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34256/0 (socket says 172.21.15.44:34256) 2024-08-19T00:15:53.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.260+0000 7fb26ffff640 1 -- 172.21.15.44:0/726044008 learned_addr learned my addr 172.21.15.44:0/726044008 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:15:53.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.260+0000 7fb277fff640 1 --2- 172.21.15.44:0/726044008 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5597f354e2b0 0x5597f3558630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:53.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.260+0000 7fb27ca08640 1 --2- 172.21.15.44:0/726044008 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5597f354d990 0x5597f354dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:53.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.260+0000 7fb27ca08640 1 --2- 172.21.15.44:0/2657946052 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fb2640a2cf0 0x7fb2640a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:53.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.260+0000 7fb277fff640 1 -- 172.21.15.44:0/726044008 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5597f354d990 msgr2=0x5597f354dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:15:53.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.260+0000 7fb275ffb640 1 -- 172.21.15.44:0/2657946052 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7fb2600cfa60 con 0x7fb278103390 2024-08-19T00:15:53.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.260+0000 7fb277fff640 1 --2- 172.21.15.44:0/726044008 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5597f354d990 0x5597f354dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:53.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.260+0000 7fb277fff640 1 -- 172.21.15.44:0/726044008 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f3558b70 msgr2=0x5597f355af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:15:53.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.260+0000 7fb277fff640 1 --2- 172.21.15.44:0/726044008 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f3558b70 0x5597f355af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:53.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.261+0000 7fb277fff640 1 -- 172.21.15.44:0/726044008 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597f31c3580 con 0x5597f354e2b0 2024-08-19T00:15:53.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.261+0000 7fb26ffff640 1 --2- 172.21.15.44:0/726044008 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f3558b70 0x5597f355af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:15:53.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.261+0000 7fb27ca08640 1 --2- 172.21.15.44:0/726044008 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5597f354d990 0x5597f354dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:15:53.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.261+0000 7fb277fff640 1 --2- 172.21.15.44:0/726044008 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5597f354e2b0 0x5597f3558630 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb268005940 tx=0x7fb268005d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b705d97b65fdd920 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:15:53.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.261+0000 7fb27ca08640 1 --2- 172.21.15.44:0/2657946052 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fb2640a2cf0 0x7fb2640a51b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb270005fd0 tx=0x7fb270009500 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:15:53.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.261+0000 7fb26e7fc640 1 -- 172.21.15.44:0/726044008 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb268035040 con 0x5597f354e2b0 2024-08-19T00:15:53.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.261+0000 7fb26e7fc640 1 -- 172.21.15.44:0/726044008 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb268031830 con 0x5597f354e2b0 2024-08-19T00:15:53.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.261+0000 7fb26e7fc640 1 -- 172.21.15.44:0/726044008 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb268004750 con 0x5597f354e2b0 2024-08-19T00:15:53.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.262+0000 7fb280869740 1 -- 172.21.15.44:0/726044008 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5597f354e2b0 msgr2=0x5597f3558630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:53.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.262+0000 7fb280869740 1 --2- 172.21.15.44:0/726044008 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5597f354e2b0 0x5597f3558630 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb268005940 tx=0x7fb268005d50 comp rx=0 tx=0).stop 2024-08-19T00:15:53.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.262+0000 7fb280869740 1 -- 172.21.15.44:0/726044008 shutdown_connections 2024-08-19T00:15:53.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.262+0000 7fb280869740 1 --2- 172.21.15.44:0/726044008 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5597f354e2b0 0x5597f3558630 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:53.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.262+0000 7fb280869740 1 --2- 172.21.15.44:0/726044008 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f3558b70 0x5597f355af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:53.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.262+0000 7fb280869740 1 --2- 172.21.15.44:0/726044008 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5597f354d990 0x5597f354dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:53.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.262+0000 7fb280869740 1 -- 172.21.15.44:0/726044008 >> 172.21.15.44:0/726044008 conn(0x5597f3549f20 msgr2=0x5597f354a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:15:53.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.262+0000 7fb280869740 1 -- 172.21.15.44:0/726044008 shutdown_connections 2024-08-19T00:15:53.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.262+0000 7fb280869740 1 -- 172.21.15.44:0/726044008 wait complete. 2024-08-19T00:15:53.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.262+0000 7fb280869740 1 -- start start 2024-08-19T00:15:53.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.262+0000 7fb280869740 1 Processor -- start 2024-08-19T00:15:53.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.263+0000 7fb280869740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5597f354d990 0x5597f3555a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:53.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.263+0000 7fb280869740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5597f354e2b0 0x5597f3555f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:53.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.263+0000 7fb280869740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f3558b70 0x5597f3556490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:53.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.263+0000 7fb280869740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5597f355b740 con 0x5597f3558b70 2024-08-19T00:15:53.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.263+0000 7fb280869740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5597f34517c0 con 0x5597f354e2b0 2024-08-19T00:15:53.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.263+0000 7fb280869740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5597f355b8c0 con 0x5597f354d990 2024-08-19T00:15:53.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.263+0000 7fb280869740 10 client.0 _ll_register_callbacks cb 0x5597f345af50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:15:53.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.263+0000 7fb27ca08640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f3558b70 0x5597f3556490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:53.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.263+0000 7fb27ca08640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f3558b70 0x5597f3556490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34272/0 (socket says 172.21.15.44:34272) 2024-08-19T00:15:53.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.263+0000 7fb27ca08640 1 -- 172.21.15.44:0/78512145 learned_addr learned my addr 172.21.15.44:0/78512145 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:15:53.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.263+0000 7fb277fff640 1 --2- 172.21.15.44:0/78512145 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5597f354d990 0x5597f3555a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:53.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.263+0000 7fb26ffff640 1 --2- 172.21.15.44:0/78512145 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5597f354e2b0 0x5597f3555f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:53.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.263+0000 7fb27ca08640 1 -- 172.21.15.44:0/78512145 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5597f354d990 msgr2=0x5597f3555a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:15:53.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.263+0000 7fb27ca08640 1 --2- 172.21.15.44:0/78512145 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5597f354d990 0x5597f3555a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:53.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.263+0000 7fb27ca08640 1 -- 172.21.15.44:0/78512145 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5597f354e2b0 msgr2=0x5597f3555f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:15:53.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.263+0000 7fb27ca08640 1 --2- 172.21.15.44:0/78512145 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5597f354e2b0 0x5597f3555f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:53.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.263+0000 7fb27ca08640 1 -- 172.21.15.44:0/78512145 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597f328d960 con 0x5597f3558b70 2024-08-19T00:15:53.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.263+0000 7fb27ca08640 1 --2- 172.21.15.44:0/78512145 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f3558b70 0x5597f3556490 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fb270010e70 tx=0x7fb270004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bbc1a26a5c39d81 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:15:53.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.263+0000 7fb2577fe640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:15:53.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.264+0000 7fb2577fe640 1 -- 172.21.15.44:0/78512145 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb27000edf0 con 0x5597f3558b70 2024-08-19T00:15:53.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.264+0000 7fb2577fe640 1 -- 172.21.15.44:0/78512145 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7fb27001f410 con 0x5597f3558b70 2024-08-19T00:15:53.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.264+0000 7fb280869740 1 -- 172.21.15.44:0/78512145 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb268031830 con 0x5597f3558b70 2024-08-19T00:15:53.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.264+0000 7fb2577fe640 1 -- 172.21.15.44:0/78512145 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb27001f610 con 0x5597f3558b70 2024-08-19T00:15:53.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.264+0000 7fb280869740 10 client.15834 fetch_fsmap learned FSMap version 30 2024-08-19T00:15:53.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.264+0000 7fb280869740 1 -- 172.21.15.44:0/78512145 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5597f3567790 con 0x5597f3558b70 2024-08-19T00:15:53.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.264+0000 7fb2577fe640 1 -- 172.21.15.44:0/78512145 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb268031830 con 0x5597f3558b70 2024-08-19T00:15:53.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.264+0000 7fb2577fe640 1 -- 172.21.15.44:0/78512145 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 30) ==== 8386+0+0 (secure 0 0 0) 0x7fb270028a00 con 0x5597f3558b70 2024-08-19T00:15:53.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.264+0000 7fb280869740 10 client.15834 fetch_fsmap finished waiting for FSMap version 30 2024-08-19T00:15:53.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.264+0000 7fb280869740 10 client.15834 resolve_mds: validated gid 24473 aka daemon mds.b 2024-08-19T00:15:53.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.264+0000 7fb280869740 20 client.15834 populate_metadata read hostname 'smithi044' 2024-08-19T00:15:53.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.264+0000 7fb280869740 1 --2- 172.21.15.44:0/78512145 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5597f3568cf0 0x5597f356b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:53.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.264+0000 7fb280869740 4 client.15834 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:15:53.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.264+0000 7fb280869740 1 -- 172.21.15.44:0/78512145 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5597f34c11d0 con 0x5597f3568cf0 2024-08-19T00:15:53.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.265+0000 7fb277fff640 1 --2- 172.21.15.44:0/78512145 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5597f3568cf0 0x5597f356b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:53.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.265+0000 7fb277fff640 1 --2- 172.21.15.44:0/78512145 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5597f3568cf0 0x5597f356b170 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26868bb5fc632f6d server_cookie=57e95f2dd52b6e12 in_seq=0 out_seq=0 2024-08-19T00:15:53.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.265+0000 7fb2577fe640 10 client.15834 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:15:53.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.266+0000 7fb2577fe640 1 -- 172.21.15.44:0/78512145 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5597f34c11d0 con 0x5597f3568cf0 2024-08-19T00:15:53.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.266+0000 7fb2577fe640 10 client.15834 handle_command_reply: tid=0 2024-08-19T00:15:53.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.266+0000 7fb280869740 1 client.15834 shutdown 2024-08-19T00:15:53.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.266+0000 7fb280869740 1 -- 172.21.15.44:0/78512145 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f3558b70 msgr2=0x5597f3556490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:53.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.266+0000 7fb280869740 1 --2- 172.21.15.44:0/78512145 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f3558b70 0x5597f3556490 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fb270010e70 tx=0x7fb270004a40 comp rx=0 tx=0).stop 2024-08-19T00:15:53.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.266+0000 7fb280869740 1 -- 172.21.15.44:0/78512145 shutdown_connections 2024-08-19T00:15:53.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.266+0000 7fb280869740 1 --2- 172.21.15.44:0/78512145 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5597f3568cf0 0x5597f356b170 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:53.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.266+0000 7fb2577fe640 0 client.15834 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:15:53.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.266+0000 7fb280869740 1 --2- 172.21.15.44:0/78512145 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f3558b70 0x5597f3556490 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:53.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.266+0000 7fb280869740 1 --2- 172.21.15.44:0/78512145 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5597f354e2b0 0x5597f3555f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:53.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.266+0000 7fb280869740 1 --2- 172.21.15.44:0/78512145 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5597f354d990 0x5597f3555a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:53.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.266+0000 7fb280869740 1 -- 172.21.15.44:0/78512145 >> 172.21.15.44:0/78512145 conn(0x5597f3549f20 msgr2=0x5597f354fc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:15:53.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.266+0000 7fb280869740 1 -- 172.21.15.44:0/78512145 shutdown_connections 2024-08-19T00:15:53.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.266+0000 7fb280869740 1 -- 172.21.15.44:0/78512145 wait complete. 2024-08-19T00:15:53.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.266+0000 7fb280869740 20 client.15834 trim_cache size 0 max 16384 2024-08-19T00:15:53.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.283+0000 7fb280869740 1 Processor -- start 2024-08-19T00:15:53.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.283+0000 7fb280869740 1 -- start start 2024-08-19T00:15:53.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.283+0000 7fb280869740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f354d990 0x5597f3554950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:53.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.283+0000 7fb280869740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5597f354e2b0 0x5597f35503f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:53.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.283+0000 7fb280869740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5597f3558b70 0x5597f3570a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:53.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.283+0000 7fb280869740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb2781b0fd0 con 0x5597f354d990 2024-08-19T00:15:53.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.283+0000 7fb280869740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fb2781b2bd0 con 0x5597f354e2b0 2024-08-19T00:15:53.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.283+0000 7fb280869740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb2781b16a0 con 0x5597f3558b70 2024-08-19T00:15:53.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.283+0000 7fb277fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f354d990 0x5597f3554950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:53.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.283+0000 7fb277fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f354d990 0x5597f3554950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34276/0 (socket says 172.21.15.44:34276) 2024-08-19T00:15:53.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.283+0000 7fb277fff640 1 -- 172.21.15.44:0/2234400169 learned_addr learned my addr 172.21.15.44:0/2234400169 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:15:53.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.283+0000 7fb26ffff640 1 --2- 172.21.15.44:0/2234400169 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5597f354e2b0 0x5597f35503f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:53.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.284+0000 7fb27ca08640 1 --2- 172.21.15.44:0/2234400169 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5597f3558b70 0x5597f3570a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:53.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.284+0000 7fb277fff640 1 -- 172.21.15.44:0/2234400169 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5597f3558b70 msgr2=0x5597f3570a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:15:53.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.284+0000 7fb277fff640 1 --2- 172.21.15.44:0/2234400169 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5597f3558b70 0x5597f3570a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:53.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.284+0000 7fb277fff640 1 -- 172.21.15.44:0/2234400169 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5597f354e2b0 msgr2=0x5597f35503f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:15:53.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.284+0000 7fb277fff640 1 --2- 172.21.15.44:0/2234400169 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5597f354e2b0 0x5597f35503f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:53.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.284+0000 7fb277fff640 1 -- 172.21.15.44:0/2234400169 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597f354abb0 con 0x5597f354d990 2024-08-19T00:15:53.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.284+0000 7fb27ca08640 1 --2- 172.21.15.44:0/2234400169 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5597f3558b70 0x5597f3570a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:15:53.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.284+0000 7fb277fff640 1 --2- 172.21.15.44:0/2234400169 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f354d990 0x5597f3554950 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fb268033000 tx=0x7fb268009520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fed07ba8578ecfb8 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:15:53.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.284+0000 7fb26dffb640 1 -- 172.21.15.44:0/2234400169 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb268059070 con 0x5597f354d990 2024-08-19T00:15:53.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.284+0000 7fb26dffb640 1 -- 172.21.15.44:0/2234400169 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb268031830 con 0x5597f354d990 2024-08-19T00:15:53.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.284+0000 7fb26dffb640 1 -- 172.21.15.44:0/2234400169 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb268035040 con 0x5597f354d990 2024-08-19T00:15:53.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.284+0000 7fb280869740 1 -- 172.21.15.44:0/2234400169 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f354d990 msgr2=0x5597f3554950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:53.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.284+0000 7fb280869740 1 --2- 172.21.15.44:0/2234400169 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f354d990 0x5597f3554950 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fb268033000 tx=0x7fb268009520 comp rx=0 tx=0).stop 2024-08-19T00:15:53.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.285+0000 7fb280869740 1 -- 172.21.15.44:0/2234400169 shutdown_connections 2024-08-19T00:15:53.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.285+0000 7fb280869740 1 --2- 172.21.15.44:0/2234400169 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5597f3558b70 0x5597f3570a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:53.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.285+0000 7fb280869740 1 --2- 172.21.15.44:0/2234400169 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5597f354e2b0 0x5597f35503f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:53.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.285+0000 7fb280869740 1 --2- 172.21.15.44:0/2234400169 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f354d990 0x5597f3554950 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:53.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.285+0000 7fb280869740 1 -- 172.21.15.44:0/2234400169 >> 172.21.15.44:0/2234400169 conn(0x5597f3549f20 msgr2=0x5597f3557a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:15:53.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.285+0000 7fb280869740 1 -- 172.21.15.44:0/2234400169 shutdown_connections 2024-08-19T00:15:53.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.285+0000 7fb280869740 1 -- 172.21.15.44:0/2234400169 wait complete. 2024-08-19T00:15:53.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.285+0000 7fb280869740 1 -- start start 2024-08-19T00:15:53.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.285+0000 7fb280869740 1 Processor -- start 2024-08-19T00:15:53.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.285+0000 7fb280869740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5597f354d990 0x5597f3561340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:53.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.285+0000 7fb280869740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f354e2b0 0x5597f355c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:53.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.285+0000 7fb280869740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5597f3558b70 0x5597f355cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:53.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.285+0000 7fb280869740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb2781b2440 con 0x5597f354e2b0 2024-08-19T00:15:53.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.285+0000 7fb280869740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fb2781b1d70 con 0x5597f3558b70 2024-08-19T00:15:53.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.285+0000 7fb280869740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb2781aefb0 con 0x5597f354d990 2024-08-19T00:15:53.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.286+0000 7fb280869740 10 client.0 _ll_register_callbacks cb 0x7fb270010ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:15:53.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.286+0000 7fb26ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f354e2b0 0x5597f355c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:53.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.286+0000 7fb26ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f354e2b0 0x5597f355c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34280/0 (socket says 172.21.15.44:34280) 2024-08-19T00:15:53.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.286+0000 7fb26ffff640 1 -- 172.21.15.44:0/2836062345 learned_addr learned my addr 172.21.15.44:0/2836062345 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:15:53.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.286+0000 7fb27ca08640 1 --2- 172.21.15.44:0/2836062345 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5597f3558b70 0x5597f355cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:53.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.286+0000 7fb277fff640 1 --2- 172.21.15.44:0/2836062345 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5597f354d990 0x5597f3561340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:53.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.286+0000 7fb26ffff640 1 -- 172.21.15.44:0/2836062345 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5597f354d990 msgr2=0x5597f3561340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:15:53.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.286+0000 7fb26ffff640 1 --2- 172.21.15.44:0/2836062345 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5597f354d990 0x5597f3561340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:53.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.286+0000 7fb26ffff640 1 -- 172.21.15.44:0/2836062345 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5597f3558b70 msgr2=0x5597f355cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:15:53.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.286+0000 7fb26ffff640 1 --2- 172.21.15.44:0/2836062345 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5597f3558b70 0x5597f355cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:53.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.286+0000 7fb26ffff640 1 -- 172.21.15.44:0/2836062345 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597f355d490 con 0x5597f354e2b0 2024-08-19T00:15:53.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.286+0000 7fb27ca08640 1 --2- 172.21.15.44:0/2836062345 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5597f3558b70 0x5597f355cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:15:53.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.286+0000 7fb26ffff640 1 --2- 172.21.15.44:0/2836062345 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f354e2b0 0x5597f355c670 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fb260009780 tx=0x7fb26009bb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f77a0db4fe63a79 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:15:53.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.286+0000 7fb2577fe640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:15:53.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.286+0000 7fb2577fe640 1 -- 172.21.15.44:0/2836062345 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2600a4850 con 0x5597f354e2b0 2024-08-19T00:15:53.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.286+0000 7fb2577fe640 1 -- 172.21.15.44:0/2836062345 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7fb260098300 con 0x5597f354e2b0 2024-08-19T00:15:53.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.286+0000 7fb280869740 1 -- 172.21.15.44:0/2836062345 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb268031830 con 0x5597f354e2b0 2024-08-19T00:15:53.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.286+0000 7fb2577fe640 1 -- 172.21.15.44:0/2836062345 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb260010720 con 0x5597f354e2b0 2024-08-19T00:15:53.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.286+0000 7fb280869740 10 client.15840 fetch_fsmap learned FSMap version 30 2024-08-19T00:15:53.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.286+0000 7fb280869740 1 -- 172.21.15.44:0/2836062345 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5597f35d3b40 con 0x5597f354e2b0 2024-08-19T00:15:53.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.287+0000 7fb2577fe640 1 -- 172.21.15.44:0/2836062345 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb268031830 con 0x5597f354e2b0 2024-08-19T00:15:53.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.287+0000 7fb2577fe640 1 -- 172.21.15.44:0/2836062345 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 30) ==== 8386+0+0 (secure 0 0 0) 0x7fb260018ac0 con 0x5597f354e2b0 2024-08-19T00:15:53.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.287+0000 7fb280869740 10 client.15840 fetch_fsmap finished waiting for FSMap version 30 2024-08-19T00:15:53.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.287+0000 7fb280869740 10 client.15840 resolve_mds: validated gid 24473 aka daemon mds.b 2024-08-19T00:15:53.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.287+0000 7fb280869740 20 client.15840 populate_metadata read hostname 'smithi044' 2024-08-19T00:15:53.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.287+0000 7fb280869740 1 --2- 172.21.15.44:0/2836062345 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5597f3568cf0 0x5597f35d63a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:15:53.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.287+0000 7fb280869740 4 client.15840 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "88dd3c11", "release": true, "await": true}] 2024-08-19T00:15:53.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.287+0000 7fb280869740 1 -- 172.21.15.44:0/2836062345 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "quiesce db", "set_id": "88dd3c11", "release": true, "await": true}) -- 0x5597f34bb6e0 con 0x5597f3568cf0 2024-08-19T00:15:53.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.287+0000 7fb277fff640 1 --2- 172.21.15.44:0/2836062345 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5597f3568cf0 0x5597f35d63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:15:53.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.287+0000 7fb2577fe640 10 client.15840 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:15:53.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.287+0000 7fb277fff640 1 --2- 172.21.15.44:0/2836062345 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5597f3568cf0 0x5597f35d63a0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3bbdc1695ed3a593 server_cookie=de93c64a7532e5d5 in_seq=0 out_seq=0 2024-08-19T00:15:53.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.296+0000 7fb2577fe640 1 -- 172.21.15.44:0/2836062345 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5597f34bb6e0 con 0x5597f3568cf0 2024-08-19T00:15:53.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.296+0000 7fb2577fe640 10 client.15840 handle_command_reply: tid=0 2024-08-19T00:15:53.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.296+0000 7fb280869740 1 client.15840 shutdown 2024-08-19T00:15:53.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.296+0000 7fb280869740 1 -- 172.21.15.44:0/2836062345 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f354e2b0 msgr2=0x5597f355c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:53.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.296+0000 7fb280869740 1 --2- 172.21.15.44:0/2836062345 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f354e2b0 0x5597f355c670 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fb260009780 tx=0x7fb26009bb80 comp rx=0 tx=0).stop 2024-08-19T00:15:53.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.296+0000 7fb280869740 1 -- 172.21.15.44:0/2836062345 shutdown_connections 2024-08-19T00:15:53.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.296+0000 7fb280869740 1 --2- 172.21.15.44:0/2836062345 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5597f3568cf0 0x5597f35d63a0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:53.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.296+0000 7fb280869740 1 --2- 172.21.15.44:0/2836062345 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5597f3558b70 0x5597f355cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:53.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.296+0000 7fb280869740 1 --2- 172.21.15.44:0/2836062345 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5597f354e2b0 0x5597f355c670 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:53.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.296+0000 7fb280869740 1 --2- 172.21.15.44:0/2836062345 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5597f354d990 0x5597f3561340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:53.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.296+0000 7fb280869740 1 -- 172.21.15.44:0/2836062345 >> 172.21.15.44:0/2836062345 conn(0x5597f3549f20 msgr2=0x5597f3548860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:15:53.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.296+0000 7fb2577fe640 0 client.15840 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:15:53.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.296+0000 7fb280869740 1 -- 172.21.15.44:0/2836062345 shutdown_connections 2024-08-19T00:15:53.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.296+0000 7fb280869740 1 -- 172.21.15.44:0/2836062345 wait complete. 2024-08-19T00:15:53.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.296+0000 7fb280869740 20 client.15840 trim_cache size 0 max 16384 2024-08-19T00:15:53.299 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-08-19T00:15:53.299 INFO:teuthology.orchestra.run.smithi044.stdout: "epoch": 30, 2024-08-19T00:15:53.299 INFO:teuthology.orchestra.run.smithi044.stdout: "leader": 24473, 2024-08-19T00:15:53.299 INFO:teuthology.orchestra.run.smithi044.stdout: "set_version": 8, 2024-08-19T00:15:53.299 INFO:teuthology.orchestra.run.smithi044.stdout: "sets": { 2024-08-19T00:15:53.299 INFO:teuthology.orchestra.run.smithi044.stdout: "88dd3c11": { 2024-08-19T00:15:53.299 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 8, 2024-08-19T00:15:53.300 INFO:teuthology.orchestra.run.smithi044.stdout: "age_ref": 0.0, 2024-08-19T00:15:53.300 INFO:teuthology.orchestra.run.smithi044.stdout: "state": { 2024-08-19T00:15:53.300 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "RELEASED", 2024-08-19T00:15:53.300 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.0 2024-08-19T00:15:53.300 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:15:53.300 INFO:teuthology.orchestra.run.smithi044.stdout: "timeout": 90.0, 2024-08-19T00:15:53.300 INFO:teuthology.orchestra.run.smithi044.stdout: "expiration": 130.0, 2024-08-19T00:15:53.300 INFO:teuthology.orchestra.run.smithi044.stdout: "members": { 2024-08-19T00:15:53.300 INFO:teuthology.orchestra.run.smithi044.stdout: "file:/": { 2024-08-19T00:15:53.300 INFO:teuthology.orchestra.run.smithi044.stdout: "excluded": false, 2024-08-19T00:15:53.301 INFO:teuthology.orchestra.run.smithi044.stdout: "state": { 2024-08-19T00:15:53.301 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "RELEASED", 2024-08-19T00:15:53.301 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.0 2024-08-19T00:15:53.301 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:15:53.301 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:15:53.301 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:15:53.301 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:15:53.301 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:15:53.301 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-08-19T00:15:53.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.297+0000 7fb27e46b640 1 -- 172.21.15.44:0/2657946052 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fb2640a2cf0 msgr2=0x7fb2640a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:53.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.297+0000 7fb27e46b640 1 --2- 172.21.15.44:0/2657946052 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fb2640a2cf0 0x7fb2640a51b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb270005fd0 tx=0x7fb270009500 comp rx=0 tx=0).stop 2024-08-19T00:15:53.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.297+0000 7fb27e46b640 1 -- 172.21.15.44:0/2657946052 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb278103390 msgr2=0x7fb278100c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:15:53.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.297+0000 7fb27e46b640 1 --2- 172.21.15.44:0/2657946052 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb278103390 0x7fb278100c10 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fb26000e9f0 tx=0x7fb26000eeb0 comp rx=0 tx=0).stop 2024-08-19T00:15:53.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.297+0000 7fb27e46b640 1 -- 172.21.15.44:0/2657946052 shutdown_connections 2024-08-19T00:15:53.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.297+0000 7fb27e46b640 1 --2- 172.21.15.44:0/2657946052 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fb2640a2cf0 0x7fb2640a51b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:53.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.297+0000 7fb27e46b640 1 --2- 172.21.15.44:0/2657946052 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb27810bea0 0x7fb278101150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:53.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.297+0000 7fb27e46b640 1 --2- 172.21.15.44:0/2657946052 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb278103390 0x7fb278100c10 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:53.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.297+0000 7fb27e46b640 1 --2- 172.21.15.44:0/2657946052 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb278102a70 0x7fb2781006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:15:53.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.297+0000 7fb27e46b640 1 -- 172.21.15.44:0/2657946052 >> 172.21.15.44:0/2657946052 conn(0x7fb2780fc4d0 msgr2=0x7fb2780fd130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:15:53.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.297+0000 7fb27e46b640 1 -- 172.21.15.44:0/2657946052 shutdown_connections 2024-08-19T00:15:53.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:15:53.297+0000 7fb27e46b640 1 -- 172.21.15.44:0/2657946052 wait complete. 2024-08-19T00:15:53.651 INFO:tasks.workunit.client.0.smithi044.stdout: 1 112875 8.01 MB/sec warmup 78 sec latency 9492.871 ms 2024-08-19T00:15:54.399 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '88dd3c11', total seconds elapsed: 13.7 2024-08-19T00:15:54.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:15:54 smithi171 ceph-mon[21810]: pgmap v80: 129 pgs: 129 active+clean; 82 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.5 MiB/s wr, 157 op/s 2024-08-19T00:15:54.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:15:54 smithi116 ceph-mon[21873]: pgmap v80: 129 pgs: 129 active+clean; 82 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.5 MiB/s wr, 157 op/s 2024-08-19T00:15:54.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:15:54 smithi044 ceph-mon[18489]: pgmap v80: 129 pgs: 129 active+clean; 82 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.5 MiB/s wr, 157 op/s 2024-08-19T00:15:54.651 INFO:tasks.workunit.client.0.smithi044.stdout: 1 115137 8.08 MB/sec warmup 79 sec latency 12.355 ms 2024-08-19T00:15:55.651 INFO:tasks.workunit.client.0.smithi044.stdout: 1 117771 8.15 MB/sec warmup 80 sec latency 17.374 ms 2024-08-19T00:15:56.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:15:56 smithi171 ceph-mon[21810]: pgmap v81: 129 pgs: 129 active+clean; 78 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.7 MiB/s wr, 225 op/s 2024-08-19T00:15:56.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:15:56 smithi116 ceph-mon[21873]: pgmap v81: 129 pgs: 129 active+clean; 78 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.7 MiB/s wr, 225 op/s 2024-08-19T00:15:56.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:15:56 smithi044 ceph-mon[18489]: pgmap v81: 129 pgs: 129 active+clean; 78 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.7 MiB/s wr, 225 op/s 2024-08-19T00:15:56.651 INFO:tasks.workunit.client.0.smithi044.stdout: 1 120853 8.28 MB/sec warmup 81 sec latency 21.615 ms 2024-08-19T00:15:57.652 INFO:tasks.workunit.client.0.smithi044.stdout: 1 122979 8.27 MB/sec warmup 82 sec latency 57.313 ms 2024-08-19T00:15:58.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:15:58 smithi171 ceph-mon[21810]: pgmap v82: 129 pgs: 129 active+clean; 78 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 2.2 MiB/s wr, 107 op/s 2024-08-19T00:15:58.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:15:58 smithi116 ceph-mon[21873]: pgmap v82: 129 pgs: 129 active+clean; 78 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 2.2 MiB/s wr, 107 op/s 2024-08-19T00:15:58.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:15:58 smithi044 ceph-mon[18489]: pgmap v82: 129 pgs: 129 active+clean; 78 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 2.2 MiB/s wr, 107 op/s 2024-08-19T00:15:58.652 INFO:tasks.workunit.client.0.smithi044.stdout: 1 124963 8.32 MB/sec warmup 83 sec latency 12.272 ms 2024-08-19T00:15:59.652 INFO:tasks.workunit.client.0.smithi044.stdout: 1 127968 8.44 MB/sec warmup 84 sec latency 42.699 ms 2024-08-19T00:16:00.124 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.122+0000 7fb9d68a8640 1 -- 172.21.15.44:0/3996765405 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9d0106710 msgr2=0x7fb9d0106af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:00.124 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.122+0000 7fb9d68a8640 1 --2- 172.21.15.44:0/3996765405 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9d0106710 0x7fb9d0106af0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fb9c0009860 tx=0x7fb9c002a340 comp rx=0 tx=0).stop 2024-08-19T00:16:00.124 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.122+0000 7fb9d68a8640 1 -- 172.21.15.44:0/3996765405 shutdown_connections 2024-08-19T00:16:00.124 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.122+0000 7fb9d68a8640 1 --2- 172.21.15.44:0/3996765405 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb9d0100700 0x7fb9d0100b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:00.124 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.122+0000 7fb9d68a8640 1 --2- 172.21.15.44:0/3996765405 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9d01010a0 0x7fb9d010d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:00.124 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.122+0000 7fb9d68a8640 1 --2- 172.21.15.44:0/3996765405 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9d0106710 0x7fb9d0106af0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:00.124 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.122+0000 7fb9d68a8640 1 -- 172.21.15.44:0/3996765405 >> 172.21.15.44:0/3996765405 conn(0x7fb9d00fc420 msgr2=0x7fb9d00fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:16:00.124 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.122+0000 7fb9d68a8640 1 -- 172.21.15.44:0/3996765405 shutdown_connections 2024-08-19T00:16:00.124 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.122+0000 7fb9d68a8640 1 -- 172.21.15.44:0/3996765405 wait complete. 2024-08-19T00:16:00.125 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.123+0000 7fb9d68a8640 1 Processor -- start 2024-08-19T00:16:00.125 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.123+0000 7fb9d68a8640 1 -- start start 2024-08-19T00:16:00.126 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.123+0000 7fb9d68a8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9d0100700 0x7fb9d010fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:00.126 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.123+0000 7fb9d68a8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9d01010a0 0x7fb9d0110330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:00.126 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.123+0000 7fb9d68a8640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb9d0106710 0x7fb9d0110870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:00.127 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.123+0000 7fb9d68a8640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d010fa10 con 0x7fb9d0100700 2024-08-19T00:16:00.127 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.123+0000 7fb9d68a8640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d010f890 con 0x7fb9d01010a0 2024-08-19T00:16:00.127 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.123+0000 7fb9d68a8640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d01aa8e0 con 0x7fb9d0106710 2024-08-19T00:16:00.127 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.124+0000 7fb9cf7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9d01010a0 0x7fb9d0110330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:00.127 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.124+0000 7fb9cffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9d0100700 0x7fb9d010fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:00.127 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.124+0000 7fb9cf7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9d01010a0 0x7fb9d0110330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.44:60590/0 (socket says 172.21.15.44:60590) 2024-08-19T00:16:00.127 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.124+0000 7fb9cffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9d0100700 0x7fb9d010fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51068/0 (socket says 172.21.15.44:51068) 2024-08-19T00:16:00.127 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.124+0000 7fb9cf7fe640 1 -- 172.21.15.44:0/3038412578 learned_addr learned my addr 172.21.15.44:0/3038412578 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:16:00.127 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.124+0000 7fb9d4e45640 1 --2- 172.21.15.44:0/3038412578 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb9d0106710 0x7fb9d0110870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:00.127 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.124+0000 7fb9cf7fe640 1 -- 172.21.15.44:0/3038412578 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb9d0106710 msgr2=0x7fb9d0110870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:00.127 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.124+0000 7fb9cf7fe640 1 --2- 172.21.15.44:0/3038412578 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb9d0106710 0x7fb9d0110870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:00.127 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.124+0000 7fb9cf7fe640 1 -- 172.21.15.44:0/3038412578 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9d0100700 msgr2=0x7fb9d010fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:00.127 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.124+0000 7fb9cf7fe640 1 --2- 172.21.15.44:0/3038412578 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9d0100700 0x7fb9d010fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:00.128 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.124+0000 7fb9cf7fe640 1 -- 172.21.15.44:0/3038412578 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9d01aaab0 con 0x7fb9d01010a0 2024-08-19T00:16:00.128 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.125+0000 7fb9cf7fe640 1 --2- 172.21.15.44:0/3038412578 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9d01010a0 0x7fb9d0110330 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb9c401fa30 tx=0x7fb9c401fe30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:16:00.128 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.125+0000 7fb9cd7fa640 1 -- 172.21.15.44:0/3038412578 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c400cd80 con 0x7fb9d01010a0 2024-08-19T00:16:00.128 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.125+0000 7fb9d68a8640 1 -- 172.21.15.44:0/3038412578 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9d019a050 con 0x7fb9d01010a0 2024-08-19T00:16:00.128 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.125+0000 7fb9d68a8640 1 -- 172.21.15.44:0/3038412578 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9d019a5a0 con 0x7fb9d01010a0 2024-08-19T00:16:00.128 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.125+0000 7fb9cd7fa640 1 -- 172.21.15.44:0/3038412578 <== mon.2 v2:172.21.15.116:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9c4005500 con 0x7fb9d01010a0 2024-08-19T00:16:00.128 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.125+0000 7fb9cd7fa640 1 -- 172.21.15.44:0/3038412578 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c40216a0 con 0x7fb9d01010a0 2024-08-19T00:16:00.130 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.128+0000 7fb9d9665740 1 Processor -- start 2024-08-19T00:16:00.130 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.129+0000 7fb9cd7fa640 1 -- 172.21.15.44:0/3038412578 <== mon.2 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fb9c4021840 con 0x7fb9d01010a0 2024-08-19T00:16:00.130 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.129+0000 7fb9d9665740 1 -- start start 2024-08-19T00:16:00.131 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.130+0000 7fb9d9665740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ecaf147d0 0x564ecaf14bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:00.131 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.130+0000 7fb9d9665740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ecaf150f0 0x564ecaf1f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:00.131 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.130+0000 7fb9d9665740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ecaf1f990 0x564ecaf21d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:00.131 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.130+0000 7fb9d9665740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564ecae789d0 con 0x564ecaf147d0 2024-08-19T00:16:00.131 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.130+0000 7fb9d9665740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x564ecae20820 con 0x564ecaf1f990 2024-08-19T00:16:00.131 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.130+0000 7fb9d9665740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x564ecae74990 con 0x564ecaf150f0 2024-08-19T00:16:00.132 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.130+0000 7fb9cffff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ecaf150f0 0x564ecaf1f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:00.132 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.130+0000 7fb9cffff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ecaf150f0 0x564ecaf1f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.44:56272/0 (socket says 172.21.15.44:56272) 2024-08-19T00:16:00.132 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.130+0000 7fb9cffff640 1 -- 172.21.15.44:0/37611915 learned_addr learned my addr 172.21.15.44:0/37611915 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:16:00.132 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.130+0000 7fb9d4e45640 1 --2- 172.21.15.44:0/37611915 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ecaf147d0 0x564ecaf14bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:00.132 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.130+0000 7fb9cf7fe640 1 --2- 172.21.15.44:0/37611915 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ecaf1f990 0x564ecaf21d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:00.132 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.131+0000 7fb9cf7fe640 1 -- 172.21.15.44:0/37611915 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ecaf150f0 msgr2=0x564ecaf1f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:16:00.132 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.131+0000 7fb9cf7fe640 1 --2- 172.21.15.44:0/37611915 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ecaf150f0 0x564ecaf1f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:00.133 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.131+0000 7fb9cf7fe640 1 -- 172.21.15.44:0/37611915 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ecaf147d0 msgr2=0x564ecaf14bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:16:00.133 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.131+0000 7fb9cf7fe640 1 --2- 172.21.15.44:0/37611915 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ecaf147d0 0x564ecaf14bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:00.134 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.131+0000 7fb9cf7fe640 1 -- 172.21.15.44:0/37611915 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ecab8c210 con 0x564ecaf1f990 2024-08-19T00:16:00.134 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.131+0000 7fb9d4e45640 1 --2- 172.21.15.44:0/37611915 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ecaf147d0 0x564ecaf14bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:16:00.134 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.132+0000 7fb9cf7fe640 1 --2- 172.21.15.44:0/37611915 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ecaf1f990 0x564ecaf21d80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb9c40dde00 tx=0x7fb9c40e4a90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70e2725701f94e2f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:16:00.134 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.132+0000 7fb9cd7fa640 1 --2- 172.21.15.44:0/3038412578 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fb9b80a2e20 0x7fb9b80a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:00.134 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.132+0000 7fb9b67fc640 1 -- 172.21.15.44:0/37611915 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c40f3070 con 0x564ecaf1f990 2024-08-19T00:16:00.134 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.132+0000 7fb9d4e45640 1 --2- 172.21.15.44:0/3038412578 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fb9b80a2e20 0x7fb9b80a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:00.134 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.132+0000 7fb9b67fc640 1 -- 172.21.15.44:0/37611915 <== mon.2 v2:172.21.15.116:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9c40e7070 con 0x564ecaf1f990 2024-08-19T00:16:00.134 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.132+0000 7fb9cd7fa640 1 -- 172.21.15.44:0/3038412578 <== mon.2 v2:172.21.15.116:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7fb9c40e0ab0 con 0x7fb9d01010a0 2024-08-19T00:16:00.134 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.133+0000 7fb9b67fc640 1 -- 172.21.15.44:0/37611915 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c40ad2d0 con 0x564ecaf1f990 2024-08-19T00:16:00.136 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.133+0000 7fb9d4e45640 1 --2- 172.21.15.44:0/3038412578 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fb9b80a2e20 0x7fb9b80a52e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8009fd0 tx=0x7fb9c8010040 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:16:00.136 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.133+0000 7fb9d9665740 1 -- 172.21.15.44:0/37611915 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ecaf1f990 msgr2=0x564ecaf21d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:00.136 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.133+0000 7fb9d9665740 1 --2- 172.21.15.44:0/37611915 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ecaf1f990 0x564ecaf21d80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb9c40dde00 tx=0x7fb9c40e4a90 comp rx=0 tx=0).stop 2024-08-19T00:16:00.136 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.133+0000 7fb9d9665740 1 -- 172.21.15.44:0/37611915 shutdown_connections 2024-08-19T00:16:00.136 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.133+0000 7fb9d9665740 1 --2- 172.21.15.44:0/37611915 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ecaf150f0 0x564ecaf1f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:00.136 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.133+0000 7fb9d9665740 1 --2- 172.21.15.44:0/37611915 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ecaf1f990 0x564ecaf21d80 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:00.136 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.133+0000 7fb9d9665740 1 --2- 172.21.15.44:0/37611915 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ecaf147d0 0x564ecaf14bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:00.136 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.133+0000 7fb9d9665740 1 -- 172.21.15.44:0/37611915 >> 172.21.15.44:0/37611915 conn(0x564ecaf10d40 msgr2=0x564ecaf11120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:16:00.136 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.133+0000 7fb9d9665740 1 -- 172.21.15.44:0/37611915 shutdown_connections 2024-08-19T00:16:00.137 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.133+0000 7fb9d9665740 1 -- 172.21.15.44:0/37611915 wait complete. 2024-08-19T00:16:00.137 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.134+0000 7fb9d9665740 1 -- start start 2024-08-19T00:16:00.137 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.134+0000 7fb9d9665740 1 Processor -- start 2024-08-19T00:16:00.137 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.134+0000 7fb9d9665740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ecaf147d0 0x564ecaf1f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:00.137 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.134+0000 7fb9d9665740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ecaf150f0 0x564ecaf1c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:00.137 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.134+0000 7fb9d9665740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ecaf1f990 0x564ecaf1ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:00.137 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.134+0000 7fb9d9665740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564ecaf22600 con 0x564ecaf147d0 2024-08-19T00:16:00.137 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.135+0000 7fb9d9665740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x564ecae34520 con 0x564ecaf150f0 2024-08-19T00:16:00.137 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.135+0000 7fb9d9665740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x564ecaf22780 con 0x564ecaf1f990 2024-08-19T00:16:00.137 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.135+0000 7fb9d9665740 10 client.0 _ll_register_callbacks cb 0x564ecab8ba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:16:00.137 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.135+0000 7fb9cffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ecaf147d0 0x564ecaf1f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:00.137 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.135+0000 7fb9d4e45640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ecaf1f990 0x564ecaf1ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:00.137 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.135+0000 7fb9cffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ecaf147d0 0x564ecaf1f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51086/0 (socket says 172.21.15.44:51086) 2024-08-19T00:16:00.137 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.135+0000 7fb9cffff640 1 -- 172.21.15.44:0/1769524764 learned_addr learned my addr 172.21.15.44:0/1769524764 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:16:00.138 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.135+0000 7fb9cf7fe640 1 --2- 172.21.15.44:0/1769524764 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ecaf150f0 0x564ecaf1c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:00.140 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.135+0000 7fb9cffff640 1 -- 172.21.15.44:0/1769524764 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ecaf1f990 msgr2=0x564ecaf1ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:16:00.140 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.135+0000 7fb9cffff640 1 --2- 172.21.15.44:0/1769524764 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ecaf1f990 0x564ecaf1ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:00.140 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.135+0000 7fb9cffff640 1 -- 172.21.15.44:0/1769524764 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ecaf150f0 msgr2=0x564ecaf1c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:16:00.140 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.135+0000 7fb9cffff640 1 --2- 172.21.15.44:0/1769524764 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ecaf150f0 0x564ecaf1c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:00.140 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.135+0000 7fb9cffff640 1 -- 172.21.15.44:0/1769524764 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ecac58620 con 0x564ecaf147d0 2024-08-19T00:16:00.140 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.135+0000 7fb9cf7fe640 1 --2- 172.21.15.44:0/1769524764 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ecaf150f0 0x564ecaf1c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:16:00.140 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.136+0000 7fb9cffff640 1 --2- 172.21.15.44:0/1769524764 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ecaf147d0 0x564ecaf1f410 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fb9c0035040 tx=0x7fb9c00303d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b8a8679f8dbfd3a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:16:00.140 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.136+0000 7fb9af7fe640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:16:00.140 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.136+0000 7fb9af7fe640 1 -- 172.21.15.44:0/1769524764 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c0037040 con 0x564ecaf147d0 2024-08-19T00:16:00.140 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.136+0000 7fb9d9665740 1 -- 172.21.15.44:0/1769524764 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9c40e7070 con 0x564ecaf147d0 2024-08-19T00:16:00.141 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.136+0000 7fb9af7fe640 1 -- 172.21.15.44:0/1769524764 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7fb9c0030550 con 0x564ecaf147d0 2024-08-19T00:16:00.141 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.136+0000 7fb9af7fe640 1 -- 172.21.15.44:0/1769524764 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb9c004c050 con 0x564ecaf147d0 2024-08-19T00:16:00.141 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.136+0000 7fb9d9665740 10 client.15852 fetch_fsmap learned FSMap version 30 2024-08-19T00:16:00.141 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.136+0000 7fb9d9665740 1 -- 172.21.15.44:0/1769524764 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564ecaf2e260 con 0x564ecaf147d0 2024-08-19T00:16:00.141 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.137+0000 7fb9af7fe640 1 -- 172.21.15.44:0/1769524764 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9c40e7070 con 0x564ecaf147d0 2024-08-19T00:16:00.141 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.137+0000 7fb9af7fe640 1 -- 172.21.15.44:0/1769524764 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 30) ==== 8386+0+0 (secure 0 0 0) 0x7fb9c0048510 con 0x564ecaf147d0 2024-08-19T00:16:00.141 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.137+0000 7fb9d9665740 10 client.15852 fetch_fsmap finished waiting for FSMap version 30 2024-08-19T00:16:00.141 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.137+0000 7fb9d9665740 10 client.15852 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:16:00.141 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.137+0000 7fb9d9665740 20 client.15852 populate_metadata read hostname 'smithi044' 2024-08-19T00:16:00.141 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.137+0000 7fb9d9665740 1 --2- 172.21.15.44:0/1769524764 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x564ecaf2f7e0 0x564ecaf31c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:00.141 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.137+0000 7fb9d9665740 4 client.15852 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:16:00.141 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.137+0000 7fb9d9665740 1 -- 172.21.15.44:0/1769524764 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564ecae86100 con 0x564ecaf2f7e0 2024-08-19T00:16:00.142 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.137+0000 7fb9cf7fe640 1 --2- 172.21.15.44:0/1769524764 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x564ecaf2f7e0 0x564ecaf31c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:00.142 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.138+0000 7fb9af7fe640 10 client.15852 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:16:00.142 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.138+0000 7fb9cf7fe640 1 --2- 172.21.15.44:0/1769524764 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x564ecaf2f7e0 0x564ecaf31c80 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=571a217c8cb1c36e server_cookie=af833bf0639e263e in_seq=0 out_seq=0 2024-08-19T00:16:00.143 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.139+0000 7fb9af7fe640 1 -- 172.21.15.44:0/1769524764 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564ecae86100 con 0x564ecaf2f7e0 2024-08-19T00:16:00.143 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.139+0000 7fb9af7fe640 10 client.15852 handle_command_reply: tid=0 2024-08-19T00:16:00.143 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.139+0000 7fb9d9665740 1 client.15852 shutdown 2024-08-19T00:16:00.143 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.140+0000 7fb9d9665740 1 -- 172.21.15.44:0/1769524764 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ecaf147d0 msgr2=0x564ecaf1f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:00.143 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.140+0000 7fb9d9665740 1 --2- 172.21.15.44:0/1769524764 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ecaf147d0 0x564ecaf1f410 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fb9c0035040 tx=0x7fb9c00303d0 comp rx=0 tx=0).stop 2024-08-19T00:16:00.143 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.140+0000 7fb9d9665740 1 -- 172.21.15.44:0/1769524764 shutdown_connections 2024-08-19T00:16:00.143 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.140+0000 7fb9d9665740 1 --2- 172.21.15.44:0/1769524764 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x564ecaf2f7e0 0x564ecaf31c80 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:00.143 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.140+0000 7fb9d9665740 1 --2- 172.21.15.44:0/1769524764 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ecaf1f990 0x564ecaf1ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:00.143 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.140+0000 7fb9af7fe640 0 client.15852 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:16:00.144 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.140+0000 7fb9d9665740 1 --2- 172.21.15.44:0/1769524764 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ecaf150f0 0x564ecaf1c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:00.144 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.140+0000 7fb9d9665740 1 --2- 172.21.15.44:0/1769524764 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ecaf147d0 0x564ecaf1f410 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:00.144 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.140+0000 7fb9d9665740 1 -- 172.21.15.44:0/1769524764 >> 172.21.15.44:0/1769524764 conn(0x564ecaf10d40 msgr2=0x564ecaf16aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:16:00.144 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.140+0000 7fb9d9665740 1 -- 172.21.15.44:0/1769524764 shutdown_connections 2024-08-19T00:16:00.144 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.140+0000 7fb9d9665740 1 -- 172.21.15.44:0/1769524764 wait complete. 2024-08-19T00:16:00.144 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.140+0000 7fb9d9665740 20 client.15852 trim_cache size 0 max 16384 2024-08-19T00:16:00.162 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.159+0000 7fb9d9665740 1 Processor -- start 2024-08-19T00:16:00.162 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.159+0000 7fb9d9665740 1 -- start start 2024-08-19T00:16:00.162 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.159+0000 7fb9d9665740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ecaf10d40 0x564ecaf2b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:00.162 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.160+0000 7fb9d9665740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ecaf147d0 0x564ecaf1bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:00.162 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.160+0000 7fb9d9665740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ecaf150f0 0x564ecaf37590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:00.162 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.160+0000 7fb9d9665740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb9bc00fef0 con 0x564ecaf150f0 2024-08-19T00:16:00.162 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.160+0000 7fb9d9665740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fb9bc011af0 con 0x564ecaf147d0 2024-08-19T00:16:00.162 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.160+0000 7fb9d9665740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb9bc0105c0 con 0x564ecaf10d40 2024-08-19T00:16:00.162 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.160+0000 7fb9d4e45640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ecaf150f0 0x564ecaf37590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:00.163 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.160+0000 7fb9d4e45640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ecaf150f0 0x564ecaf37590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51088/0 (socket says 172.21.15.44:51088) 2024-08-19T00:16:00.163 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.160+0000 7fb9d4e45640 1 -- 172.21.15.44:0/2459025286 learned_addr learned my addr 172.21.15.44:0/2459025286 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:16:00.163 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.160+0000 7fb9cffff640 1 --2- 172.21.15.44:0/2459025286 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ecaf10d40 0x564ecaf2b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:00.163 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.160+0000 7fb9cf7fe640 1 --2- 172.21.15.44:0/2459025286 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ecaf147d0 0x564ecaf1bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:00.163 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.160+0000 7fb9d4e45640 1 -- 172.21.15.44:0/2459025286 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ecaf10d40 msgr2=0x564ecaf2b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:16:00.163 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.160+0000 7fb9d4e45640 1 --2- 172.21.15.44:0/2459025286 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ecaf10d40 0x564ecaf2b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:00.163 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.160+0000 7fb9d4e45640 1 -- 172.21.15.44:0/2459025286 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ecaf147d0 msgr2=0x564ecaf1bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:16:00.163 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.160+0000 7fb9d4e45640 1 --2- 172.21.15.44:0/2459025286 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ecaf147d0 0x564ecaf1bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:00.163 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.160+0000 7fb9d4e45640 1 -- 172.21.15.44:0/2459025286 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ecaf10b70 con 0x564ecaf150f0 2024-08-19T00:16:00.163 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.160+0000 7fb9cf7fe640 1 --2- 172.21.15.44:0/2459025286 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ecaf147d0 0x564ecaf1bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:16:00.163 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.160+0000 7fb9d4e45640 1 --2- 172.21.15.44:0/2459025286 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ecaf150f0 0x564ecaf37590 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8003d80 tx=0x7fb9c8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c36280b5e26db02 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:16:00.163 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.160+0000 7fb9b5ffb640 1 -- 172.21.15.44:0/2459025286 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c8020040 con 0x564ecaf150f0 2024-08-19T00:16:00.163 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.161+0000 7fb9b5ffb640 1 -- 172.21.15.44:0/2459025286 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9c802b070 con 0x564ecaf150f0 2024-08-19T00:16:00.163 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.161+0000 7fb9b5ffb640 1 -- 172.21.15.44:0/2459025286 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c8026bf0 con 0x564ecaf150f0 2024-08-19T00:16:00.167 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.161+0000 7fb9d9665740 1 -- 172.21.15.44:0/2459025286 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ecaf150f0 msgr2=0x564ecaf37590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:00.167 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.161+0000 7fb9d9665740 1 --2- 172.21.15.44:0/2459025286 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ecaf150f0 0x564ecaf37590 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8003d80 tx=0x7fb9c8016000 comp rx=0 tx=0).stop 2024-08-19T00:16:00.167 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.161+0000 7fb9d9665740 1 -- 172.21.15.44:0/2459025286 shutdown_connections 2024-08-19T00:16:00.167 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.161+0000 7fb9d9665740 1 --2- 172.21.15.44:0/2459025286 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ecaf150f0 0x564ecaf37590 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:00.167 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.161+0000 7fb9d9665740 1 --2- 172.21.15.44:0/2459025286 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ecaf147d0 0x564ecaf1bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:00.167 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.161+0000 7fb9d9665740 1 --2- 172.21.15.44:0/2459025286 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ecaf10d40 0x564ecaf2b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:00.167 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.161+0000 7fb9d9665740 1 -- 172.21.15.44:0/2459025286 >> 172.21.15.44:0/2459025286 conn(0x564ecaf1f570 msgr2=0x564ecaf1e6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:16:00.167 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.161+0000 7fb9d9665740 1 -- 172.21.15.44:0/2459025286 shutdown_connections 2024-08-19T00:16:00.168 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.161+0000 7fb9d9665740 1 -- 172.21.15.44:0/2459025286 wait complete. 2024-08-19T00:16:00.168 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.162+0000 7fb9d9665740 1 -- start start 2024-08-19T00:16:00.168 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.162+0000 7fb9d9665740 1 Processor -- start 2024-08-19T00:16:00.168 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.162+0000 7fb9d9665740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ecaf10d40 0x564ecaf27af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:00.168 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.162+0000 7fb9d9665740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ecaf147d0 0x564ecaf28030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:00.168 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.162+0000 7fb9d9665740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ecaf150f0 0x564ecaf189a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:00.168 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.162+0000 7fb9d9665740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb9bc011360 con 0x564ecaf147d0 2024-08-19T00:16:00.168 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.162+0000 7fb9d9665740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fb9bc010c90 con 0x564ecaf150f0 2024-08-19T00:16:00.168 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.162+0000 7fb9d9665740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb9bc00ded0 con 0x564ecaf10d40 2024-08-19T00:16:00.168 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.162+0000 7fb9d9665740 10 client.0 _ll_register_callbacks cb 0x7fb9c4005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:16:00.168 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.162+0000 7fb9cf7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ecaf147d0 0x564ecaf28030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:00.168 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.162+0000 7fb9cf7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ecaf147d0 0x564ecaf28030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51102/0 (socket says 172.21.15.44:51102) 2024-08-19T00:16:00.168 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.162+0000 7fb9cf7fe640 1 -- 172.21.15.44:0/4252300662 learned_addr learned my addr 172.21.15.44:0/4252300662 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:16:00.168 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.162+0000 7fb9cffff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ecaf10d40 0x564ecaf27af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:00.169 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.163+0000 7fb9d4e45640 1 --2- 172.21.15.44:0/4252300662 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ecaf150f0 0x564ecaf189a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:00.169 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.163+0000 7fb9cf7fe640 1 -- 172.21.15.44:0/4252300662 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ecaf10d40 msgr2=0x564ecaf27af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:16:00.169 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.163+0000 7fb9cf7fe640 1 --2- 172.21.15.44:0/4252300662 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ecaf10d40 0x564ecaf27af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:00.169 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.163+0000 7fb9cf7fe640 1 -- 172.21.15.44:0/4252300662 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ecaf150f0 msgr2=0x564ecaf189a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:16:00.169 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.163+0000 7fb9cf7fe640 1 --2- 172.21.15.44:0/4252300662 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ecaf150f0 0x564ecaf189a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:00.169 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.163+0000 7fb9cf7fe640 1 -- 172.21.15.44:0/4252300662 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ecaf28720 con 0x564ecaf147d0 2024-08-19T00:16:00.169 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.163+0000 7fb9cf7fe640 1 --2- 172.21.15.44:0/4252300662 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ecaf147d0 0x564ecaf28030 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fb9c40dde60 tx=0x7fb9c4009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d3b87e0e9bdc9ad server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:16:00.169 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.163+0000 7fb9af7fe640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:16:00.169 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.163+0000 7fb9af7fe640 1 -- 172.21.15.44:0/4252300662 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c40ac710 con 0x564ecaf147d0 2024-08-19T00:16:00.169 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.163+0000 7fb9af7fe640 1 -- 172.21.15.44:0/4252300662 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7fb9c40de080 con 0x564ecaf147d0 2024-08-19T00:16:00.169 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.163+0000 7fb9d9665740 1 -- 172.21.15.44:0/4252300662 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9c802b070 con 0x564ecaf147d0 2024-08-19T00:16:00.169 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.163+0000 7fb9af7fe640 1 -- 172.21.15.44:0/4252300662 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb9c40a8e70 con 0x564ecaf147d0 2024-08-19T00:16:00.169 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.163+0000 7fb9d9665740 10 client.15858 fetch_fsmap learned FSMap version 30 2024-08-19T00:16:00.169 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.163+0000 7fb9d9665740 1 -- 172.21.15.44:0/4252300662 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564ecaf19fe0 con 0x564ecaf147d0 2024-08-19T00:16:00.170 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.163+0000 7fb9af7fe640 1 -- 172.21.15.44:0/4252300662 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9c802b070 con 0x564ecaf147d0 2024-08-19T00:16:00.170 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.163+0000 7fb9af7fe640 1 -- 172.21.15.44:0/4252300662 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 30) ==== 8386+0+0 (secure 0 0 0) 0x7fb9c40ace30 con 0x564ecaf147d0 2024-08-19T00:16:00.170 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.164+0000 7fb9d9665740 10 client.15858 fetch_fsmap finished waiting for FSMap version 30 2024-08-19T00:16:00.170 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.164+0000 7fb9d9665740 10 client.15858 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:16:00.170 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.164+0000 7fb9d9665740 20 client.15858 populate_metadata read hostname 'smithi044' 2024-08-19T00:16:00.170 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.164+0000 7fb9d9665740 1 --2- 172.21.15.44:0/4252300662 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x564ecaf1f990 0x564ecaf1a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:00.170 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.164+0000 7fb9d9665740 4 client.15858 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-19T00:16:00.170 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.164+0000 7fb9d9665740 1 -- 172.21.15.44:0/4252300662 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564ecae80450 con 0x564ecaf1f990 2024-08-19T00:16:00.170 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.164+0000 7fb9cffff640 1 --2- 172.21.15.44:0/4252300662 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x564ecaf1f990 0x564ecaf1a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:00.170 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.164+0000 7fb9cffff640 1 --2- 172.21.15.44:0/4252300662 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x564ecaf1f990 0x564ecaf1a460 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a469297d56b9b8c server_cookie=39ce9d5ef041d90e in_seq=0 out_seq=0 2024-08-19T00:16:00.170 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.164+0000 7fb9af7fe640 10 client.15858 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:16:00.176 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.174+0000 7fb9af7fe640 1 -- 172.21.15.44:0/4252300662 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564ecae80450 con 0x564ecaf1f990 2024-08-19T00:16:00.176 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.174+0000 7fb9af7fe640 10 client.15858 handle_command_reply: tid=0 2024-08-19T00:16:00.176 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.174+0000 7fb9d9665740 1 client.15858 shutdown 2024-08-19T00:16:00.176 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.175+0000 7fb9d9665740 1 -- 172.21.15.44:0/4252300662 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ecaf147d0 msgr2=0x564ecaf28030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:00.176 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.175+0000 7fb9d9665740 1 --2- 172.21.15.44:0/4252300662 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ecaf147d0 0x564ecaf28030 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fb9c40dde60 tx=0x7fb9c4009310 comp rx=0 tx=0).stop 2024-08-19T00:16:00.177 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.175+0000 7fb9d9665740 1 -- 172.21.15.44:0/4252300662 shutdown_connections 2024-08-19T00:16:00.177 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.175+0000 7fb9d9665740 1 --2- 172.21.15.44:0/4252300662 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x564ecaf1f990 0x564ecaf1a460 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:00.177 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.175+0000 7fb9d9665740 1 --2- 172.21.15.44:0/4252300662 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ecaf150f0 0x564ecaf189a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:00.177 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.175+0000 7fb9d9665740 1 --2- 172.21.15.44:0/4252300662 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ecaf147d0 0x564ecaf28030 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:00.177 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.175+0000 7fb9af7fe640 0 client.15858 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:16:00.177 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.175+0000 7fb9d9665740 1 --2- 172.21.15.44:0/4252300662 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ecaf10d40 0x564ecaf27af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:00.177 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.175+0000 7fb9d9665740 1 -- 172.21.15.44:0/4252300662 >> 172.21.15.44:0/4252300662 conn(0x564ecaf1f570 msgr2=0x564ecaf16280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:16:00.177 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.175+0000 7fb9d9665740 1 -- 172.21.15.44:0/4252300662 shutdown_connections 2024-08-19T00:16:00.177 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.175+0000 7fb9d9665740 1 -- 172.21.15.44:0/4252300662 wait complete. 2024-08-19T00:16:00.177 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.175+0000 7fb9d9665740 20 client.15858 trim_cache size 0 max 16384 2024-08-19T00:16:00.178 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:{ 2024-08-19T00:16:00.178 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "message": "", 2024-08-19T00:16:00.178 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "return_code": 0 2024-08-19T00:16:00.179 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:} 2024-08-19T00:16:00.179 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.176+0000 7fb9d68a8640 1 -- 172.21.15.44:0/3038412578 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fb9b80a2e20 msgr2=0x7fb9b80a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:00.179 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.176+0000 7fb9d68a8640 1 --2- 172.21.15.44:0/3038412578 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fb9b80a2e20 0x7fb9b80a52e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8009fd0 tx=0x7fb9c8010040 comp rx=0 tx=0).stop 2024-08-19T00:16:00.179 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.176+0000 7fb9d68a8640 1 -- 172.21.15.44:0/3038412578 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9d01010a0 msgr2=0x7fb9d0110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:00.180 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.176+0000 7fb9d68a8640 1 --2- 172.21.15.44:0/3038412578 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9d01010a0 0x7fb9d0110330 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb9c401fa30 tx=0x7fb9c401fe30 comp rx=0 tx=0).stop 2024-08-19T00:16:00.180 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.176+0000 7fb9d68a8640 1 -- 172.21.15.44:0/3038412578 shutdown_connections 2024-08-19T00:16:00.180 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.176+0000 7fb9d68a8640 1 --2- 172.21.15.44:0/3038412578 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fb9b80a2e20 0x7fb9b80a52e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:00.180 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.176+0000 7fb9d68a8640 1 --2- 172.21.15.44:0/3038412578 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb9d0106710 0x7fb9d0110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:00.180 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.176+0000 7fb9d68a8640 1 --2- 172.21.15.44:0/3038412578 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9d01010a0 0x7fb9d0110330 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:00.180 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.176+0000 7fb9d68a8640 1 --2- 172.21.15.44:0/3038412578 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9d0100700 0x7fb9d010fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:00.180 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.176+0000 7fb9d68a8640 1 -- 172.21.15.44:0/3038412578 >> 172.21.15.44:0/3038412578 conn(0x7fb9d00fc420 msgr2=0x7fb9d00fcb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:16:00.180 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.176+0000 7fb9d68a8640 1 -- 172.21.15.44:0/3038412578 shutdown_connections 2024-08-19T00:16:00.180 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:00.176+0000 7fb9d68a8640 1 -- 172.21.15.44:0/3038412578 wait complete. 2024-08-19T00:16:00.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:16:00 smithi171 ceph-mon[21810]: pgmap v83: 129 pgs: 129 active+clean; 78 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 2.2 MiB/s wr, 107 op/s 2024-08-19T00:16:00.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:16:00 smithi116 ceph-mon[21873]: pgmap v83: 129 pgs: 129 active+clean; 78 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 2.2 MiB/s wr, 107 op/s 2024-08-19T00:16:00.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:16:00 smithi044 ceph-mon[18489]: pgmap v83: 129 pgs: 129 active+clean; 78 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 2.2 MiB/s wr, 107 op/s 2024-08-19T00:16:00.651 INFO:tasks.workunit.client.0.smithi044.stdout: 1 130488 8.48 MB/sec warmup 85 sec latency 18.582 ms 2024-08-19T00:16:01.652 INFO:tasks.workunit.client.0.smithi044.stdout: 1 131406 8.46 MB/sec warmup 86 sec latency 59.974 ms 2024-08-19T00:16:02.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:16:02 smithi171 ceph-mon[21810]: pgmap v84: 129 pgs: 129 active+clean; 84 MiB data, 754 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.7 MiB/s wr, 238 op/s 2024-08-19T00:16:02.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:16:02 smithi116 ceph-mon[21873]: pgmap v84: 129 pgs: 129 active+clean; 84 MiB data, 754 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.7 MiB/s wr, 238 op/s 2024-08-19T00:16:02.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:16:02 smithi044 ceph-mon[18489]: pgmap v84: 129 pgs: 129 active+clean; 84 MiB data, 754 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.7 MiB/s wr, 238 op/s 2024-08-19T00:16:02.652 INFO:tasks.workunit.client.0.smithi044.stdout: 1 133745 8.46 MB/sec warmup 87 sec latency 21.163 ms 2024-08-19T00:16:03.652 INFO:tasks.workunit.client.0.smithi044.stdout: 1 135643 8.50 MB/sec warmup 88 sec latency 56.936 ms 2024-08-19T00:16:04.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:16:04 smithi171 ceph-mon[21810]: pgmap v85: 129 pgs: 129 active+clean; 84 MiB data, 754 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.7 MiB/s wr, 198 op/s 2024-08-19T00:16:04.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:16:04 smithi116 ceph-mon[21873]: pgmap v85: 129 pgs: 129 active+clean; 84 MiB data, 754 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.7 MiB/s wr, 198 op/s 2024-08-19T00:16:04.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:16:04 smithi044 ceph-mon[18489]: pgmap v85: 129 pgs: 129 active+clean; 84 MiB data, 754 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.7 MiB/s wr, 198 op/s 2024-08-19T00:16:04.652 INFO:tasks.workunit.client.0.smithi044.stdout: 1 138708 8.62 MB/sec warmup 89 sec latency 12.612 ms 2024-08-19T00:16:05.652 INFO:tasks.workunit.client.0.smithi044.stdout: 1 141575 8.67 MB/sec warmup 90 sec latency 12.015 ms 2024-08-19T00:16:06.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:16:06 smithi171 ceph-mon[21810]: pgmap v86: 129 pgs: 129 active+clean; 89 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.4 MiB/s wr, 352 op/s 2024-08-19T00:16:06.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:16:06 smithi116 ceph-mon[21873]: pgmap v86: 129 pgs: 129 active+clean; 89 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.4 MiB/s wr, 352 op/s 2024-08-19T00:16:06.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:16:06 smithi044 ceph-mon[18489]: pgmap v86: 129 pgs: 129 active+clean; 89 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.4 MiB/s wr, 352 op/s 2024-08-19T00:16:06.652 INFO:tasks.workunit.client.0.smithi044.stdout: 1 143890 8.70 MB/sec warmup 91 sec latency 16.912 ms 2024-08-19T00:16:07.652 INFO:tasks.workunit.client.0.smithi044.stdout: 1 146265 8.76 MB/sec warmup 92 sec latency 14.739 ms 2024-08-19T00:16:08.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:16:08 smithi171 ceph-mon[21810]: pgmap v87: 129 pgs: 129 active+clean; 89 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.2 MiB/s wr, 285 op/s 2024-08-19T00:16:08.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:16:08 smithi116 ceph-mon[21873]: pgmap v87: 129 pgs: 129 active+clean; 89 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.2 MiB/s wr, 285 op/s 2024-08-19T00:16:08.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:16:08 smithi044 ceph-mon[18489]: pgmap v87: 129 pgs: 129 active+clean; 89 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.2 MiB/s wr, 285 op/s 2024-08-19T00:16:08.654 INFO:tasks.workunit.client.0.smithi044.stdout: 1 148985 8.84 MB/sec warmup 93 sec latency 67.708 ms 2024-08-19T00:16:09.652 INFO:tasks.workunit.client.0.smithi044.stdout: 1 151378 8.84 MB/sec warmup 94 sec latency 11.534 ms 2024-08-19T00:16:10.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:16:10 smithi171 ceph-mon[21810]: pgmap v88: 129 pgs: 129 active+clean; 89 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.2 MiB/s wr, 285 op/s 2024-08-19T00:16:10.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:16:10 smithi116 ceph-mon[21873]: pgmap v88: 129 pgs: 129 active+clean; 89 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.2 MiB/s wr, 285 op/s 2024-08-19T00:16:10.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:16:10 smithi044 ceph-mon[18489]: pgmap v88: 129 pgs: 129 active+clean; 89 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.2 MiB/s wr, 285 op/s 2024-08-19T00:16:10.652 INFO:tasks.workunit.client.0.smithi044.stdout: 1 153474 8.88 MB/sec warmup 95 sec latency 12.877 ms 2024-08-19T00:16:11.652 INFO:tasks.workunit.client.0.smithi044.stdout: 1 156482 8.98 MB/sec warmup 96 sec latency 11.421 ms 2024-08-19T00:16:12.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:16:12 smithi171 ceph-mon[21810]: pgmap v89: 129 pgs: 129 active+clean; 95 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 5.0 MiB/s wr, 416 op/s 2024-08-19T00:16:12.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:16:12 smithi116 ceph-mon[21873]: pgmap v89: 129 pgs: 129 active+clean; 95 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 5.0 MiB/s wr, 416 op/s 2024-08-19T00:16:12.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:16:12 smithi044 ceph-mon[18489]: pgmap v89: 129 pgs: 129 active+clean; 95 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 5.0 MiB/s wr, 416 op/s 2024-08-19T00:16:12.652 INFO:tasks.workunit.client.0.smithi044.stdout: 1 159277 9.03 MB/sec warmup 97 sec latency 13.182 ms 2024-08-19T00:16:12.971 INFO:tasks.quiescer.fs.[cephfs]:Total duration (60) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-08-19T00:16:12.972 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-08-19T00:16:12.972 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-19T00:16:13.315 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:16:13.324 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.322+0000 7fa24cf7d640 1 -- 172.21.15.44:0/2867272961 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa2481135e0 msgr2=0x7fa2481159d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:13.324 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.322+0000 7fa24cf7d640 1 --2- 172.21.15.44:0/2867272961 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa2481135e0 0x7fa2481159d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa24000df70 tx=0x7fa24002e6b0 comp rx=0 tx=0).stop 2024-08-19T00:16:13.324 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.322+0000 7fa24cf7d640 1 -- 172.21.15.44:0/2867272961 shutdown_connections 2024-08-19T00:16:13.324 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.322+0000 7fa24cf7d640 1 --2- 172.21.15.44:0/2867272961 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa2481135e0 0x7fa2481159d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:13.324 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.322+0000 7fa24cf7d640 1 --2- 172.21.15.44:0/2867272961 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa24810a950 0x7fa2481130a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:13.324 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.322+0000 7fa24cf7d640 1 --2- 172.21.15.44:0/2867272961 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa24810a030 0x7fa24810a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:13.324 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.322+0000 7fa24cf7d640 1 -- 172.21.15.44:0/2867272961 >> 172.21.15.44:0/2867272961 conn(0x7fa24806c920 msgr2=0x7fa24806cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:16:13.324 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.322+0000 7fa24cf7d640 1 -- 172.21.15.44:0/2867272961 shutdown_connections 2024-08-19T00:16:13.324 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.322+0000 7fa24cf7d640 1 -- 172.21.15.44:0/2867272961 wait complete. 2024-08-19T00:16:13.324 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.323+0000 7fa24cf7d640 1 Processor -- start 2024-08-19T00:16:13.325 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.324+0000 7fa24cf7d640 1 -- start start 2024-08-19T00:16:13.325 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.324+0000 7fa24cf7d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa24810a030 0x7fa2481a6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:13.325 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.324+0000 7fa24cf7d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa24810a950 0x7fa2481a7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:13.325 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.324+0000 7fa24cf7d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2481135e0 0x7fa2481ab610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:13.326 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.324+0000 7fa24cf7d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa248118010 con 0x7fa2481135e0 2024-08-19T00:16:13.326 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.324+0000 7fa24cf7d640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fa248117e90 con 0x7fa24810a950 2024-08-19T00:16:13.326 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.324+0000 7fa24cf7d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa248118190 con 0x7fa24810a030 2024-08-19T00:16:13.326 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.324+0000 7fa246ffd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa24810a950 0x7fa2481a7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:13.326 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.324+0000 7fa246ffd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa24810a950 0x7fa2481a7290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.44:33742/0 (socket says 172.21.15.44:33742) 2024-08-19T00:16:13.326 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.324+0000 7fa246ffd640 1 -- 172.21.15.44:0/2892814792 learned_addr learned my addr 172.21.15.44:0/2892814792 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:16:13.326 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.324+0000 7fa2477fe640 1 --2- 172.21.15.44:0/2892814792 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa24810a030 0x7fa2481a6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:13.326 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.324+0000 7fa247fff640 1 --2- 172.21.15.44:0/2892814792 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2481135e0 0x7fa2481ab610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:13.327 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.325+0000 7fa246ffd640 1 -- 172.21.15.44:0/2892814792 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa24810a030 msgr2=0x7fa2481a6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:13.327 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.325+0000 7fa246ffd640 1 --2- 172.21.15.44:0/2892814792 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa24810a030 0x7fa2481a6d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:13.327 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.325+0000 7fa246ffd640 1 -- 172.21.15.44:0/2892814792 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2481135e0 msgr2=0x7fa2481ab610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:13.327 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.325+0000 7fa246ffd640 1 --2- 172.21.15.44:0/2892814792 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2481135e0 0x7fa2481ab610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:13.327 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.325+0000 7fa246ffd640 1 -- 172.21.15.44:0/2892814792 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2481abd40 con 0x7fa24810a950 2024-08-19T00:16:13.327 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.325+0000 7fa246ffd640 1 --2- 172.21.15.44:0/2892814792 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa24810a950 0x7fa2481a7290 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa238007860 tx=0x7fa238007d20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:16:13.327 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.326+0000 7fa244ff9640 1 -- 172.21.15.44:0/2892814792 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa238019020 con 0x7fa24810a950 2024-08-19T00:16:13.327 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.326+0000 7fa244ff9640 1 -- 172.21.15.44:0/2892814792 <== mon.2 v2:172.21.15.116:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa238015470 con 0x7fa24810a950 2024-08-19T00:16:13.327 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.326+0000 7fa244ff9640 1 -- 172.21.15.44:0/2892814792 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa238014630 con 0x7fa24810a950 2024-08-19T00:16:13.328 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.326+0000 7fa24cf7d640 1 -- 172.21.15.44:0/2892814792 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2481ac030 con 0x7fa24810a950 2024-08-19T00:16:13.328 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.327+0000 7fa24cf7d640 1 -- 172.21.15.44:0/2892814792 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2481b38c0 con 0x7fa24810a950 2024-08-19T00:16:13.332 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.331+0000 7fa25107a740 1 Processor -- start 2024-08-19T00:16:13.332 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.331+0000 7fa244ff9640 1 -- 172.21.15.44:0/2892814792 <== mon.2 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fa23801c020 con 0x7fa24810a950 2024-08-19T00:16:13.333 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.332+0000 7fa25107a740 1 -- start start 2024-08-19T00:16:13.333 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.332+0000 7fa25107a740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5564b47429b0 0x5564b4742d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:13.333 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.332+0000 7fa25107a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564b47432d0 0x5564b474d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:13.334 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.332+0000 7fa25107a740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5564b474db70 0x5564b474ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:13.334 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.332+0000 7fa25107a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5564b46a69d0 con 0x5564b47432d0 2024-08-19T00:16:13.334 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.332+0000 7fa25107a740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5564b464e820 con 0x5564b474db70 2024-08-19T00:16:13.334 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.332+0000 7fa25107a740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5564b46a2990 con 0x5564b47429b0 2024-08-19T00:16:13.334 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.332+0000 7fa244ff9640 1 --2- 172.21.15.44:0/2892814792 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fa2340a2f00 0x7fa2340a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:13.334 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.332+0000 7fa244ff9640 1 -- 172.21.15.44:0/2892814792 <== mon.2 v2:172.21.15.116:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7fa2380cfb40 con 0x7fa24810a950 2024-08-19T00:16:13.335 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.333+0000 7fa246ffd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5564b474db70 0x5564b474ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:13.335 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.333+0000 7fa246ffd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5564b474db70 0x5564b474ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.44:33746/0 (socket says 172.21.15.44:33746) 2024-08-19T00:16:13.335 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.333+0000 7fa246ffd640 1 -- 172.21.15.44:0/127478680 learned_addr learned my addr 172.21.15.44:0/127478680 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:16:13.335 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.333+0000 7fa247fff640 1 --2- 172.21.15.44:0/127478680 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5564b47429b0 0x5564b4742d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:13.335 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.333+0000 7fa247fff640 1 --2- 172.21.15.44:0/2892814792 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fa2340a2f00 0x7fa2340a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:13.335 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.333+0000 7fa2477fe640 1 --2- 172.21.15.44:0/127478680 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564b47432d0 0x5564b474d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:13.336 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.333+0000 7fa246ffd640 1 -- 172.21.15.44:0/127478680 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5564b47429b0 msgr2=0x5564b4742d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:16:13.336 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.333+0000 7fa246ffd640 1 --2- 172.21.15.44:0/127478680 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5564b47429b0 0x5564b4742d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:13.336 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.333+0000 7fa246ffd640 1 -- 172.21.15.44:0/127478680 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564b47432d0 msgr2=0x5564b474d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:16:13.336 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.333+0000 7fa246ffd640 1 --2- 172.21.15.44:0/127478680 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564b47432d0 0x5564b474d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:13.336 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.333+0000 7fa246ffd640 1 -- 172.21.15.44:0/127478680 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564b43ba210 con 0x5564b474db70 2024-08-19T00:16:13.336 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.333+0000 7fa246ffd640 1 --2- 172.21.15.44:0/127478680 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5564b474db70 0x5564b474ff60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa238000c00 tx=0x7fa23809b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60d4e04b6c50e23f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:16:13.336 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.334+0000 7fa23dffb640 1 -- 172.21.15.44:0/127478680 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2380b4e60 con 0x5564b474db70 2024-08-19T00:16:13.336 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.334+0000 7fa23dffb640 1 -- 172.21.15.44:0/127478680 <== mon.2 v2:172.21.15.116:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2380b1030 con 0x5564b474db70 2024-08-19T00:16:13.336 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.334+0000 7fa23dffb640 1 -- 172.21.15.44:0/127478680 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa238015620 con 0x5564b474db70 2024-08-19T00:16:13.336 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.334+0000 7fa247fff640 1 --2- 172.21.15.44:0/2892814792 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fa2340a2f00 0x7fa2340a53c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa24000df40 tx=0x7fa240005fd0 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:16:13.337 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.335+0000 7fa25107a740 1 -- 172.21.15.44:0/127478680 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5564b474db70 msgr2=0x5564b474ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:13.337 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.335+0000 7fa25107a740 1 --2- 172.21.15.44:0/127478680 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5564b474db70 0x5564b474ff60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa238000c00 tx=0x7fa23809b8d0 comp rx=0 tx=0).stop 2024-08-19T00:16:13.337 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.335+0000 7fa25107a740 1 -- 172.21.15.44:0/127478680 shutdown_connections 2024-08-19T00:16:13.337 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.335+0000 7fa25107a740 1 --2- 172.21.15.44:0/127478680 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5564b474db70 0x5564b474ff60 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:13.337 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.335+0000 7fa25107a740 1 --2- 172.21.15.44:0/127478680 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564b47432d0 0x5564b474d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:13.337 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.335+0000 7fa25107a740 1 --2- 172.21.15.44:0/127478680 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5564b47429b0 0x5564b4742d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:13.337 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.335+0000 7fa25107a740 1 -- 172.21.15.44:0/127478680 >> 172.21.15.44:0/127478680 conn(0x5564b473ef20 msgr2=0x5564b473f300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:16:13.338 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.336+0000 7fa25107a740 1 -- 172.21.15.44:0/127478680 shutdown_connections 2024-08-19T00:16:13.338 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.336+0000 7fa25107a740 1 -- 172.21.15.44:0/127478680 wait complete. 2024-08-19T00:16:13.340 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.336+0000 7fa25107a740 1 -- start start 2024-08-19T00:16:13.340 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.337+0000 7fa25107a740 1 Processor -- start 2024-08-19T00:16:13.340 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.337+0000 7fa25107a740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5564b47429b0 0x5564b474ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:13.340 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.337+0000 7fa25107a740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5564b47432d0 0x5564b474b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:13.340 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.337+0000 7fa25107a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564b474db70 0x5564b474b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:13.340 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.338+0000 7fa25107a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5564b4750740 con 0x5564b474db70 2024-08-19T00:16:13.340 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.338+0000 7fa25107a740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5564b4662520 con 0x5564b47432d0 2024-08-19T00:16:13.341 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.338+0000 7fa247fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564b474db70 0x5564b474b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:13.341 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.338+0000 7fa247fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564b474db70 0x5564b474b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48810/0 (socket says 172.21.15.44:48810) 2024-08-19T00:16:13.341 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.338+0000 7fa247fff640 1 -- 172.21.15.44:0/3239938133 learned_addr learned my addr 172.21.15.44:0/3239938133 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:16:13.341 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.338+0000 7fa25107a740 1 -- 172.21.15.44:0/3239938133 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5564b47508c0 con 0x5564b47429b0 2024-08-19T00:16:13.341 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.338+0000 7fa25107a740 10 client.0 _ll_register_callbacks cb 0x5564b43b9a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:16:13.341 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.338+0000 7fa2477fe640 1 --2- 172.21.15.44:0/3239938133 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5564b47429b0 0x5564b474ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:13.341 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.338+0000 7fa247fff640 1 -- 172.21.15.44:0/3239938133 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5564b47429b0 msgr2=0x5564b474ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:16:13.341 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.338+0000 7fa247fff640 1 --2- 172.21.15.44:0/3239938133 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5564b47429b0 0x5564b474ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:13.341 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.338+0000 7fa247fff640 1 -- 172.21.15.44:0/3239938133 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5564b47432d0 msgr2=0x5564b474b080 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T00:16:13.341 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.338+0000 7fa247fff640 1 --2- 172.21.15.44:0/3239938133 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5564b47432d0 0x5564b474b080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:13.341 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.338+0000 7fa247fff640 1 -- 172.21.15.44:0/3239938133 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564b4486620 con 0x5564b474db70 2024-08-19T00:16:13.341 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.339+0000 7fa247fff640 1 --2- 172.21.15.44:0/3239938133 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564b474db70 0x5564b474b5c0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fa240003d30 tx=0x7fa24000d910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0969ec15eca4ee2 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:16:13.342 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.339+0000 7fa226ffd640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:16:13.342 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.339+0000 7fa226ffd640 1 -- 172.21.15.44:0/3239938133 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa24003a040 con 0x5564b474db70 2024-08-19T00:16:13.342 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.340+0000 7fa25107a740 1 -- 172.21.15.44:0/3239938133 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2380b1030 con 0x5564b474db70 2024-08-19T00:16:13.342 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.340+0000 7fa226ffd640 1 -- 172.21.15.44:0/3239938133 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7fa240035c40 con 0x5564b474db70 2024-08-19T00:16:13.343 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.341+0000 7fa226ffd640 1 -- 172.21.15.44:0/3239938133 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa240035670 con 0x5564b474db70 2024-08-19T00:16:13.343 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.342+0000 7fa25107a740 10 client.15870 fetch_fsmap learned FSMap version 30 2024-08-19T00:16:13.343 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.342+0000 7fa25107a740 1 -- 172.21.15.44:0/3239938133 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5564b475c460 con 0x5564b474db70 2024-08-19T00:16:13.344 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.342+0000 7fa226ffd640 1 -- 172.21.15.44:0/3239938133 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2380b1030 con 0x5564b474db70 2024-08-19T00:16:13.344 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.343+0000 7fa226ffd640 1 -- 172.21.15.44:0/3239938133 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 30) ==== 8386+0+0 (secure 0 0 0) 0x7fa240042410 con 0x5564b474db70 2024-08-19T00:16:13.344 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.343+0000 7fa25107a740 10 client.15870 fetch_fsmap finished waiting for FSMap version 30 2024-08-19T00:16:13.345 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.343+0000 7fa25107a740 10 client.15870 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:16:13.345 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.343+0000 7fa25107a740 20 client.15870 populate_metadata read hostname 'smithi044' 2024-08-19T00:16:13.345 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.343+0000 7fa25107a740 1 --2- 172.21.15.44:0/3239938133 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5564b475de20 0x5564b47602e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:13.345 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.343+0000 7fa25107a740 4 client.15870 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:16:13.345 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.343+0000 7fa25107a740 1 -- 172.21.15.44:0/3239938133 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5564b46b4100 con 0x5564b475de20 2024-08-19T00:16:13.345 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.344+0000 7fa2477fe640 1 --2- 172.21.15.44:0/3239938133 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5564b475de20 0x5564b47602e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:13.345 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.344+0000 7fa226ffd640 10 client.15870 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:16:13.346 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.344+0000 7fa2477fe640 1 --2- 172.21.15.44:0/3239938133 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5564b475de20 0x5564b47602e0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e825f05104f4aaad server_cookie=7d2dcfd9209c2a05 in_seq=0 out_seq=0 2024-08-19T00:16:13.347 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.345+0000 7fa226ffd640 1 -- 172.21.15.44:0/3239938133 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5564b46b4100 con 0x5564b475de20 2024-08-19T00:16:13.347 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.345+0000 7fa226ffd640 10 client.15870 handle_command_reply: tid=0 2024-08-19T00:16:13.347 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.345+0000 7fa25107a740 1 client.15870 shutdown 2024-08-19T00:16:13.347 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.346+0000 7fa25107a740 1 -- 172.21.15.44:0/3239938133 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564b474db70 msgr2=0x5564b474b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:13.347 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.346+0000 7fa25107a740 1 --2- 172.21.15.44:0/3239938133 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564b474db70 0x5564b474b5c0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fa240003d30 tx=0x7fa24000d910 comp rx=0 tx=0).stop 2024-08-19T00:16:13.347 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.346+0000 7fa25107a740 1 -- 172.21.15.44:0/3239938133 shutdown_connections 2024-08-19T00:16:13.347 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.346+0000 7fa25107a740 1 --2- 172.21.15.44:0/3239938133 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5564b475de20 0x5564b47602e0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:13.348 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.346+0000 7fa25107a740 1 --2- 172.21.15.44:0/3239938133 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564b474db70 0x5564b474b5c0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:13.348 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.346+0000 7fa25107a740 1 --2- 172.21.15.44:0/3239938133 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5564b47432d0 0x5564b474b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:13.348 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.346+0000 7fa25107a740 1 --2- 172.21.15.44:0/3239938133 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5564b47429b0 0x5564b474ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:13.348 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.346+0000 7fa226ffd640 0 client.15870 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:16:13.348 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.346+0000 7fa25107a740 1 -- 172.21.15.44:0/3239938133 >> 172.21.15.44:0/3239938133 conn(0x5564b473ef20 msgr2=0x5564b4744c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:16:13.348 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.346+0000 7fa25107a740 1 -- 172.21.15.44:0/3239938133 shutdown_connections 2024-08-19T00:16:13.348 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.346+0000 7fa25107a740 1 -- 172.21.15.44:0/3239938133 wait complete. 2024-08-19T00:16:13.348 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.346+0000 7fa25107a740 20 client.15870 trim_cache size 0 max 16384 2024-08-19T00:16:13.369 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.366+0000 7fa25107a740 1 Processor -- start 2024-08-19T00:16:13.369 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.366+0000 7fa25107a740 1 -- start start 2024-08-19T00:16:13.369 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.366+0000 7fa25107a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564b47429b0 0x5564b473de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:13.369 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.367+0000 7fa25107a740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5564b47432d0 0x5564b4765bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:13.369 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.367+0000 7fa2477fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564b47429b0 0x5564b473de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:13.369 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.367+0000 7fa25107a740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5564b474db70 0x5564b4766130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:13.369 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.367+0000 7fa2477fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564b47429b0 0x5564b473de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48818/0 (socket says 172.21.15.44:48818) 2024-08-19T00:16:13.369 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.367+0000 7fa25107a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa2481bdaf0 con 0x5564b47429b0 2024-08-19T00:16:13.369 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.367+0000 7fa25107a740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fa2481bf6f0 con 0x5564b474db70 2024-08-19T00:16:13.370 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.367+0000 7fa25107a740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa2481be1c0 con 0x5564b47432d0 2024-08-19T00:16:13.370 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.367+0000 7fa2477fe640 1 -- 172.21.15.44:0/3458787522 learned_addr learned my addr 172.21.15.44:0/3458787522 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:16:13.370 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.367+0000 7fa246ffd640 1 --2- 172.21.15.44:0/3458787522 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5564b47432d0 0x5564b4765bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:13.370 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.367+0000 7fa247fff640 1 --2- 172.21.15.44:0/3458787522 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5564b474db70 0x5564b4766130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:13.370 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.367+0000 7fa2477fe640 1 -- 172.21.15.44:0/3458787522 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5564b47432d0 msgr2=0x5564b4765bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:16:13.370 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.367+0000 7fa2477fe640 1 --2- 172.21.15.44:0/3458787522 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5564b47432d0 0x5564b4765bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:13.370 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.367+0000 7fa2477fe640 1 -- 172.21.15.44:0/3458787522 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5564b474db70 msgr2=0x5564b4766130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:16:13.370 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.367+0000 7fa2477fe640 1 --2- 172.21.15.44:0/3458787522 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5564b474db70 0x5564b4766130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:13.370 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.367+0000 7fa2477fe640 1 -- 172.21.15.44:0/3458787522 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564b4760960 con 0x5564b47429b0 2024-08-19T00:16:13.370 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.367+0000 7fa246ffd640 1 --2- 172.21.15.44:0/3458787522 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5564b47432d0 0x5564b4765bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:16:13.370 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.367+0000 7fa2477fe640 1 --2- 172.21.15.44:0/3458787522 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564b47429b0 0x5564b473de40 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fa230005fd0 tx=0x7fa230009e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d510e3c6bb741791 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:16:13.371 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.367+0000 7fa23d7fa640 1 -- 172.21.15.44:0/3458787522 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa230023070 con 0x5564b47429b0 2024-08-19T00:16:13.371 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.367+0000 7fa23d7fa640 1 -- 172.21.15.44:0/3458787522 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2300035f0 con 0x5564b47429b0 2024-08-19T00:16:13.371 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.367+0000 7fa23d7fa640 1 -- 172.21.15.44:0/3458787522 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2300126b0 con 0x5564b47429b0 2024-08-19T00:16:13.374 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.368+0000 7fa25107a740 1 -- 172.21.15.44:0/3458787522 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564b47429b0 msgr2=0x5564b473de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:13.374 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.368+0000 7fa25107a740 1 --2- 172.21.15.44:0/3458787522 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564b47429b0 0x5564b473de40 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fa230005fd0 tx=0x7fa230009e80 comp rx=0 tx=0).stop 2024-08-19T00:16:13.374 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.368+0000 7fa25107a740 1 -- 172.21.15.44:0/3458787522 shutdown_connections 2024-08-19T00:16:13.374 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.368+0000 7fa25107a740 1 --2- 172.21.15.44:0/3458787522 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5564b47432d0 0x5564b4765bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:13.374 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.368+0000 7fa25107a740 1 --2- 172.21.15.44:0/3458787522 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5564b474db70 0x5564b4766130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:13.375 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.368+0000 7fa25107a740 1 --2- 172.21.15.44:0/3458787522 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564b47429b0 0x5564b473de40 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:13.375 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.368+0000 7fa25107a740 1 -- 172.21.15.44:0/3458787522 >> 172.21.15.44:0/3458787522 conn(0x5564b473ef20 msgr2=0x5564b473d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:16:13.375 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.368+0000 7fa25107a740 1 -- 172.21.15.44:0/3458787522 shutdown_connections 2024-08-19T00:16:13.375 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.368+0000 7fa25107a740 1 -- 172.21.15.44:0/3458787522 wait complete. 2024-08-19T00:16:13.375 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.369+0000 7fa25107a740 1 -- start start 2024-08-19T00:16:13.375 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.369+0000 7fa25107a740 1 Processor -- start 2024-08-19T00:16:13.375 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.369+0000 7fa25107a740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5564b47432d0 0x5564b4755b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:13.375 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.369+0000 7fa25107a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564b474db70 0x5564b4756090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:13.375 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.369+0000 7fa25107a740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5564b4752b20 0x5564b4752fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:13.375 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.369+0000 7fa25107a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa2481bef60 con 0x5564b474db70 2024-08-19T00:16:13.375 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.369+0000 7fa25107a740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fa2481be890 con 0x5564b47432d0 2024-08-19T00:16:13.375 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.369+0000 7fa25107a740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa2481bbad0 con 0x5564b4752b20 2024-08-19T00:16:13.376 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.369+0000 7fa25107a740 10 client.0 _ll_register_callbacks cb 0x7fa238005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:16:13.376 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.369+0000 7fa246ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564b474db70 0x5564b4756090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:13.376 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.369+0000 7fa2477fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5564b47432d0 0x5564b4755b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:13.376 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.369+0000 7fa2477fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5564b47432d0 0x5564b4755b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.44:33756/0 (socket says 172.21.15.44:33756) 2024-08-19T00:16:13.376 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.369+0000 7fa247fff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5564b4752b20 0x5564b4752fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:13.376 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.369+0000 7fa2477fe640 1 -- 172.21.15.44:0/1499275622 learned_addr learned my addr 172.21.15.44:0/1499275622 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:16:13.376 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.369+0000 7fa246ffd640 1 --2- 172.21.15.44:0/1499275622 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564b474db70 0x5564b4756090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48832/0 (socket says 172.21.15.44:48832) 2024-08-19T00:16:13.376 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.370+0000 7fa2477fe640 1 -- 172.21.15.44:0/1499275622 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5564b4752b20 msgr2=0x5564b4752fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:16:13.376 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.370+0000 7fa2477fe640 1 --2- 172.21.15.44:0/1499275622 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5564b4752b20 0x5564b4752fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:13.376 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.370+0000 7fa2477fe640 1 -- 172.21.15.44:0/1499275622 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564b474db70 msgr2=0x5564b4756090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:16:13.376 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.370+0000 7fa2477fe640 1 --2- 172.21.15.44:0/1499275622 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564b474db70 0x5564b4756090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:13.376 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.370+0000 7fa2477fe640 1 -- 172.21.15.44:0/1499275622 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564b47534e0 con 0x5564b47432d0 2024-08-19T00:16:13.376 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.370+0000 7fa247fff640 1 --2- 172.21.15.44:0/1499275622 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5564b4752b20 0x5564b4752fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:16:13.377 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.370+0000 7fa246ffd640 1 --2- 172.21.15.44:0/1499275622 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564b474db70 0x5564b4756090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:16:13.377 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.370+0000 7fa2477fe640 1 --2- 172.21.15.44:0/1499275622 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5564b47432d0 0x5564b4755b50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa230004030 tx=0x7fa230014190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c9cca2c20c7a5c7 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:16:13.377 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.370+0000 7fa226ffd640 10 client.0 ms_handle_connect on v2:172.21.15.116:3300/0 2024-08-19T00:16:13.377 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.370+0000 7fa226ffd640 1 -- 172.21.15.44:0/1499275622 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa23002c020 con 0x5564b47432d0 2024-08-19T00:16:13.377 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.370+0000 7fa25107a740 1 -- 172.21.15.44:0/1499275622 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2300035f0 con 0x5564b47432d0 2024-08-19T00:16:13.377 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.370+0000 7fa226ffd640 1 -- 172.21.15.44:0/1499275622 <== mon.2 v2:172.21.15.116:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7fa2300037a0 con 0x5564b47432d0 2024-08-19T00:16:13.377 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.370+0000 7fa226ffd640 1 -- 172.21.15.44:0/1499275622 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa230023070 con 0x5564b47432d0 2024-08-19T00:16:13.377 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.370+0000 7fa25107a740 10 client.25394 fetch_fsmap learned FSMap version 30 2024-08-19T00:16:13.377 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.370+0000 7fa25107a740 1 -- 172.21.15.44:0/1499275622 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5564b47c97e0 con 0x5564b47432d0 2024-08-19T00:16:13.377 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.370+0000 7fa226ffd640 1 -- 172.21.15.44:0/1499275622 <== mon.2 v2:172.21.15.116:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2300035f0 con 0x5564b47432d0 2024-08-19T00:16:13.377 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.371+0000 7fa226ffd640 1 -- 172.21.15.44:0/1499275622 <== mon.2 v2:172.21.15.116:3300/0 5 ==== fsmap(e 30) ==== 8386+0+0 (secure 0 0 0) 0x7fa230004700 con 0x5564b47432d0 2024-08-19T00:16:13.378 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.371+0000 7fa25107a740 10 client.25394 fetch_fsmap finished waiting for FSMap version 30 2024-08-19T00:16:13.378 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.371+0000 7fa25107a740 10 client.25394 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:16:13.378 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.371+0000 7fa25107a740 20 client.25394 populate_metadata read hostname 'smithi044' 2024-08-19T00:16:13.378 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.371+0000 7fa25107a740 1 --2- 172.21.15.44:0/1499275622 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5564b47c9f30 0x5564b47cc350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:13.378 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.371+0000 7fa25107a740 4 client.25394 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-19T00:16:13.378 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.371+0000 7fa25107a740 1 -- 172.21.15.44:0/1499275622 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5564b46ae450 con 0x5564b47c9f30 2024-08-19T00:16:13.378 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.371+0000 7fa246ffd640 1 --2- 172.21.15.44:0/1499275622 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5564b47c9f30 0x5564b47cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:13.378 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.371+0000 7fa226ffd640 10 client.25394 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:16:13.378 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.371+0000 7fa246ffd640 1 --2- 172.21.15.44:0/1499275622 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5564b47c9f30 0x5564b47cc350 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e55fc1604dbea31 server_cookie=1856fdea0d147e42 in_seq=0 out_seq=0 2024-08-19T00:16:13.380 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.378+0000 7fa226ffd640 1 -- 172.21.15.44:0/1499275622 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5564b46ae450 con 0x5564b47c9f30 2024-08-19T00:16:13.380 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.378+0000 7fa226ffd640 10 client.25394 handle_command_reply: tid=0 2024-08-19T00:16:13.380 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.378+0000 7fa25107a740 1 client.25394 shutdown 2024-08-19T00:16:13.380 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.379+0000 7fa25107a740 1 -- 172.21.15.44:0/1499275622 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5564b47432d0 msgr2=0x5564b4755b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:13.381 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.379+0000 7fa25107a740 1 --2- 172.21.15.44:0/1499275622 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5564b47432d0 0x5564b4755b50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa230004030 tx=0x7fa230014190 comp rx=0 tx=0).stop 2024-08-19T00:16:13.381 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.379+0000 7fa25107a740 1 -- 172.21.15.44:0/1499275622 shutdown_connections 2024-08-19T00:16:13.381 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.379+0000 7fa25107a740 1 --2- 172.21.15.44:0/1499275622 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5564b47c9f30 0x5564b47cc350 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:13.381 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.379+0000 7fa25107a740 1 --2- 172.21.15.44:0/1499275622 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5564b4752b20 0x5564b4752fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:13.381 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.379+0000 7fa226ffd640 0 client.25394 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:16:13.381 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.379+0000 7fa25107a740 1 --2- 172.21.15.44:0/1499275622 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5564b474db70 0x5564b4756090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:13.381 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.379+0000 7fa25107a740 1 --2- 172.21.15.44:0/1499275622 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5564b47432d0 0x5564b4755b50 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:13.381 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.379+0000 7fa25107a740 1 -- 172.21.15.44:0/1499275622 >> 172.21.15.44:0/1499275622 conn(0x5564b473ef20 msgr2=0x5564b474b300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:16:13.381 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.379+0000 7fa25107a740 1 -- 172.21.15.44:0/1499275622 shutdown_connections 2024-08-19T00:16:13.381 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.379+0000 7fa25107a740 1 -- 172.21.15.44:0/1499275622 wait complete. 2024-08-19T00:16:13.381 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.379+0000 7fa25107a740 20 client.25394 trim_cache size 0 max 16384 2024-08-19T00:16:13.382 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:{ 2024-08-19T00:16:13.382 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "message": "", 2024-08-19T00:16:13.382 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "return_code": 0 2024-08-19T00:16:13.382 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:} 2024-08-19T00:16:13.383 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.379+0000 7fa24cf7d640 1 -- 172.21.15.44:0/2892814792 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fa2340a2f00 msgr2=0x7fa2340a53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:13.383 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.379+0000 7fa24cf7d640 1 --2- 172.21.15.44:0/2892814792 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fa2340a2f00 0x7fa2340a53c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa24000df40 tx=0x7fa240005fd0 comp rx=0 tx=0).stop 2024-08-19T00:16:13.383 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.379+0000 7fa24cf7d640 1 -- 172.21.15.44:0/2892814792 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa24810a950 msgr2=0x7fa2481a7290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:13.383 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.379+0000 7fa24cf7d640 1 --2- 172.21.15.44:0/2892814792 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa24810a950 0x7fa2481a7290 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa238007860 tx=0x7fa238007d20 comp rx=0 tx=0).stop 2024-08-19T00:16:13.383 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.380+0000 7fa24cf7d640 1 -- 172.21.15.44:0/2892814792 shutdown_connections 2024-08-19T00:16:13.383 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.380+0000 7fa24cf7d640 1 --2- 172.21.15.44:0/2892814792 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fa2340a2f00 0x7fa2340a53c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:13.383 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.380+0000 7fa24cf7d640 1 --2- 172.21.15.44:0/2892814792 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2481135e0 0x7fa2481ab610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:13.383 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.380+0000 7fa24cf7d640 1 --2- 172.21.15.44:0/2892814792 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa24810a950 0x7fa2481a7290 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:13.383 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.380+0000 7fa24cf7d640 1 --2- 172.21.15.44:0/2892814792 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa24810a030 0x7fa2481a6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:13.383 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.380+0000 7fa24cf7d640 1 -- 172.21.15.44:0/2892814792 >> 172.21.15.44:0/2892814792 conn(0x7fa24806c920 msgr2=0x7fa248070470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:16:13.383 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.380+0000 7fa24cf7d640 1 -- 172.21.15.44:0/2892814792 shutdown_connections 2024-08-19T00:16:13.384 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:13.380+0000 7fa24cf7d640 1 -- 172.21.15.44:0/2892814792 wait complete. 2024-08-19T00:16:13.667 INFO:tasks.workunit.client.0.smithi044.stdout: 1 160547 9.00 MB/sec warmup 98 sec latency 45.267 ms 2024-08-19T00:16:13.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:13.890+0000 7f170f018640 1 -- 172.21.15.44:0/2959913444 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f17080ffe30 msgr2=0x7f1708100250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:13.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:13.890+0000 7f170f018640 1 --2- 172.21.15.44:0/2959913444 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f17080ffe30 0x7f1708100250 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f16f4009900 tx=0x7f16f402a3f0 comp rx=0 tx=0).stop 2024-08-19T00:16:13.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:13.890+0000 7f170f018640 1 -- 172.21.15.44:0/2959913444 shutdown_connections 2024-08-19T00:16:13.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:13.890+0000 7f170f018640 1 --2- 172.21.15.44:0/2959913444 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f17081009b0 0x7f17081105c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:13.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:13.890+0000 7f170f018640 1 --2- 172.21.15.44:0/2959913444 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f17080ffe30 0x7f1708100250 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:13.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:13.890+0000 7f170f018640 1 --2- 172.21.15.44:0/2959913444 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1708102780 0x7f1708102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:13.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:13.890+0000 7f170f018640 1 -- 172.21.15.44:0/2959913444 >> 172.21.15.44:0/2959913444 conn(0x7f1708076f60 msgr2=0x7f17080fe370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:16:13.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:13.890+0000 7f170f018640 1 -- 172.21.15.44:0/2959913444 shutdown_connections 2024-08-19T00:16:13.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:13.890+0000 7f170f018640 1 -- 172.21.15.44:0/2959913444 wait complete. 2024-08-19T00:16:13.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:13.891+0000 7f170f018640 1 Processor -- start 2024-08-19T00:16:13.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:13.891+0000 7f170f018640 1 -- start start 2024-08-19T00:16:13.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:13.891+0000 7f170f018640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f17080ffe30 0x7f170819a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:13.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:13.891+0000 7f170f018640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17081009b0 0x7f170819a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:13.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:13.891+0000 7f170f018640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1708102780 0x7f170819ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:13.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:13.891+0000 7f170f018640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1708113e40 con 0x7f17080ffe30 2024-08-19T00:16:13.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:13.891+0000 7f170f018640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f1708113cc0 con 0x7f1708102780 2024-08-19T00:16:13.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:13.891+0000 7f170f018640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1708113fc0 con 0x7f17081009b0 2024-08-19T00:16:13.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:13.891+0000 7f170cdb4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f17080ffe30 0x7f170819a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:13.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:13.891+0000 7f170cdb4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f17080ffe30 0x7f170819a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48862/0 (socket says 172.21.15.44:48862) 2024-08-19T00:16:13.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:13.892+0000 7f170cdb4640 1 -- 172.21.15.44:0/937467836 learned_addr learned my addr 172.21.15.44:0/937467836 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:16:13.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:13.892+0000 7f1707fff640 1 --2- 172.21.15.44:0/937467836 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17081009b0 0x7f170819a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:13.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:13.892+0000 7f170d5b5640 1 --2- 172.21.15.44:0/937467836 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1708102780 0x7f170819ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:13.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:13.892+0000 7f170cdb4640 1 -- 172.21.15.44:0/937467836 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17081009b0 msgr2=0x7f170819a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:13.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:13.892+0000 7f170cdb4640 1 --2- 172.21.15.44:0/937467836 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17081009b0 0x7f170819a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:13.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:13.892+0000 7f170cdb4640 1 -- 172.21.15.44:0/937467836 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1708102780 msgr2=0x7f170819ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:13.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:13.892+0000 7f170cdb4640 1 --2- 172.21.15.44:0/937467836 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1708102780 0x7f170819ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:13.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:13.892+0000 7f170cdb4640 1 -- 172.21.15.44:0/937467836 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f170819f330 con 0x7f17080ffe30 2024-08-19T00:16:13.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:13.892+0000 7f1707fff640 1 --2- 172.21.15.44:0/937467836 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17081009b0 0x7f170819a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:16:13.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:13.892+0000 7f170d5b5640 1 --2- 172.21.15.44:0/937467836 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1708102780 0x7f170819ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:16:13.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:13.892+0000 7f170cdb4640 1 --2- 172.21.15.44:0/937467836 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f17080ffe30 0x7f170819a380 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f16fc00e9f0 tx=0x7f16fc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:16:13.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:13.892+0000 7f1705ffb640 1 -- 172.21.15.44:0/937467836 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16fc00cd80 con 0x7f17080ffe30 2024-08-19T00:16:13.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:13.892+0000 7f170f018640 1 -- 172.21.15.44:0/937467836 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f170819f620 con 0x7f17080ffe30 2024-08-19T00:16:13.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:13.892+0000 7f1705ffb640 1 -- 172.21.15.44:0/937467836 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16fc010910 con 0x7f17080ffe30 2024-08-19T00:16:13.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:13.892+0000 7f1705ffb640 1 -- 172.21.15.44:0/937467836 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16fc0188f0 con 0x7f17080ffe30 2024-08-19T00:16:13.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:13.893+0000 7f170f018640 1 -- 172.21.15.44:0/937467836 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17081a6f00 con 0x7f17080ffe30 2024-08-19T00:16:13.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:13.893+0000 7f170f018640 1 -- 172.21.15.44:0/937467836 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1708100250 con 0x7f17080ffe30 2024-08-19T00:16:13.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:13.895+0000 7f1705ffb640 1 -- 172.21.15.44:0/937467836 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f16fc010ac0 con 0x7f17080ffe30 2024-08-19T00:16:13.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:13.896+0000 7f1705ffb640 1 --2- 172.21.15.44:0/937467836 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f16f80a2cf0 0x7f16f80a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:13.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:13.896+0000 7f1705ffb640 1 -- 172.21.15.44:0/937467836 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f16fc0cff00 con 0x7f17080ffe30 2024-08-19T00:16:13.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:13.896+0000 7f1707fff640 1 --2- 172.21.15.44:0/937467836 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f16f80a2cf0 0x7f16f80a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:13.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:13.897+0000 7f1707fff640 1 --2- 172.21.15.44:0/937467836 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f16f80a2cf0 0x7f16f80a51b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f16f4009230 tx=0x7f16f40058d0 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:16:13.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:13.900+0000 7f1705ffb640 1 -- 172.21.15.44:0/937467836 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f16fc09c130 con 0x7f17080ffe30 2024-08-19T00:16:14.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:14.167+0000 7f170f018640 1 -- 172.21.15.44:0/937467836 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f170810bc90 con 0x7f17080ffe30 2024-08-19T00:16:14.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:14.169+0000 7f1705ffb640 1 -- 172.21.15.44:0/937467836 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11996 (secure 0 0 0) 0x7f16fc0a0430 con 0x7f17080ffe30 2024-08-19T00:16:14.171 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:16:14.171 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":30,"btime":"2024-08-19T00:14:41:883285+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14511,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1538841896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1538841896},{"type":"v1","addr":"172.21.15.116:6833","nonce":1538841896}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/4044471606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4044471606},{"type":"v1","addr":"172.21.15.44:6835","nonce":4044471606}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-19T00:10:53.196636+0000","modified":"2024-08-19T00:14:41.583467+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24473,"mds_1":24446,"mds_2":24439,"mds_3":24431,"mds_4":24418},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14529":{"gid":14529,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6837/1824829052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1824829052},{"type":"v1","addr":"172.21.15.44:6837","nonce":1824829052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14577":{"gid":14577,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6839/3591739042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":3591739042},{"type":"v1","addr":"172.21.15.44:6839","nonce":3591739042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14589":{"gid":14589,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6841/3667695717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6840","nonce":3667695717},{"type":"v1","addr":"172.21.15.44:6841","nonce":3667695717}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24388":{"gid":24388,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1183022838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1183022838},{"type":"v1","addr":"172.21.15.171:6833","nonce":1183022838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6835/2190623851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":2190623851},{"type":"v1","addr":"172.21.15.171:6835","nonce":2190623851}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.171:6837/316231795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":316231795},{"type":"v1","addr":"172.21.15.171:6837","nonce":316231795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":20,"addr":"172.21.15.116:6835/3507399322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3507399322},{"type":"v1","addr":"172.21.15.116:6835","nonce":3507399322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.171:6839/1466585795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":1466585795},{"type":"v1","addr":"172.21.15.171:6839","nonce":1466585795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":17,"addr":"172.21.15.116:6837/2764513846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":2764513846},{"type":"v1","addr":"172.21.15.116:6837","nonce":2764513846}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.116:6839/1032741033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":1032741033},{"type":"v1","addr":"172.21.15.116:6839","nonce":1032741033}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24418,24431,24439,24446,24473]},"id":1}]} 2024-08-19T00:16:14.171 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 30 2024-08-19T00:16:14.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:14.171+0000 7f170f018640 1 -- 172.21.15.44:0/937467836 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f16f80a2cf0 msgr2=0x7f16f80a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:14.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:14.171+0000 7f170f018640 1 --2- 172.21.15.44:0/937467836 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f16f80a2cf0 0x7f16f80a51b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f16f4009230 tx=0x7f16f40058d0 comp rx=0 tx=0).stop 2024-08-19T00:16:14.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:14.171+0000 7f170f018640 1 -- 172.21.15.44:0/937467836 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f17080ffe30 msgr2=0x7f170819a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:14.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:14.171+0000 7f170f018640 1 --2- 172.21.15.44:0/937467836 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f17080ffe30 0x7f170819a380 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f16fc00e9f0 tx=0x7f16fc00eeb0 comp rx=0 tx=0).stop 2024-08-19T00:16:14.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:14.171+0000 7f170f018640 1 -- 172.21.15.44:0/937467836 shutdown_connections 2024-08-19T00:16:14.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:14.171+0000 7f170f018640 1 --2- 172.21.15.44:0/937467836 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f16f80a2cf0 0x7f16f80a51b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:14.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:14.171+0000 7f170f018640 1 --2- 172.21.15.44:0/937467836 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17081009b0 0x7f170819a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:14.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:14.171+0000 7f170f018640 1 --2- 172.21.15.44:0/937467836 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1708102780 0x7f170819ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:14.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:14.171+0000 7f170f018640 1 --2- 172.21.15.44:0/937467836 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f17080ffe30 0x7f170819a380 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:14.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:14.171+0000 7f170f018640 1 -- 172.21.15.44:0/937467836 >> 172.21.15.44:0/937467836 conn(0x7f1708076f60 msgr2=0x7f17080fd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:16:14.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:14.172+0000 7f170f018640 1 -- 172.21.15.44:0/937467836 shutdown_connections 2024-08-19T00:16:14.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:14.172+0000 7f170f018640 1 -- 172.21.15.44:0/937467836 wait complete. 2024-08-19T00:16:14.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:16:14 smithi044 ceph-mon[18489]: pgmap v90: 129 pgs: 129 active+clean; 95 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.4 MiB/s wr, 284 op/s 2024-08-19T00:16:14.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:16:14 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/937467836' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:16:14.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:16:14 smithi171 ceph-mon[21810]: pgmap v90: 129 pgs: 129 active+clean; 95 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.4 MiB/s wr, 284 op/s 2024-08-19T00:16:14.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:16:14 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/937467836' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:16:14.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:16:14 smithi116 ceph-mon[21873]: pgmap v90: 129 pgs: 129 active+clean; 95 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.4 MiB/s wr, 284 op/s 2024-08-19T00:16:14.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:16:14 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/937467836' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:16:14.667 INFO:tasks.workunit.client.0.smithi044.stdout: 1 163455 9.09 MB/sec warmup 99 sec latency 58.115 ms 2024-08-19T00:16:14.924 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24473 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0' 2024-08-19T00:16:14.925 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24473 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0 2024-08-19T00:16:15.228 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:16:15.667 INFO:tasks.workunit.client.0.smithi044.stdout: 1 165778 9.09 MB/sec warmup 100 sec latency 15.426 ms 2024-08-19T00:16:15.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.742+0000 7fd99772a640 1 -- 172.21.15.44:0/821354859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd990103410 msgr2=0x7fd9901078c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:15.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.742+0000 7fd99772a640 1 --2- 172.21.15.44:0/821354859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd990103410 0x7fd9901078c0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fd980009930 tx=0x7fd98002a420 comp rx=0 tx=0).stop 2024-08-19T00:16:15.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.742+0000 7fd99772a640 1 -- 172.21.15.44:0/821354859 shutdown_connections 2024-08-19T00:16:15.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.742+0000 7fd99772a640 1 --2- 172.21.15.44:0/821354859 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd990107fd0 0x7fd99010e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:15.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.742+0000 7fd99772a640 1 --2- 172.21.15.44:0/821354859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd990103410 0x7fd9901078c0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:15.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.742+0000 7fd99772a640 1 --2- 172.21.15.44:0/821354859 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd990102a60 0x7fd990102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:15.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.742+0000 7fd99772a640 1 -- 172.21.15.44:0/821354859 >> 172.21.15.44:0/821354859 conn(0x7fd9900fc500 msgr2=0x7fd9900fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:16:15.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.742+0000 7fd99772a640 1 -- 172.21.15.44:0/821354859 shutdown_connections 2024-08-19T00:16:15.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.742+0000 7fd99772a640 1 -- 172.21.15.44:0/821354859 wait complete. 2024-08-19T00:16:15.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.743+0000 7fd99772a640 1 Processor -- start 2024-08-19T00:16:15.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.743+0000 7fd99772a640 1 -- start start 2024-08-19T00:16:15.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.743+0000 7fd99772a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd990102a60 0x7fd9901006c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:15.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.743+0000 7fd99772a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd990103410 0x7fd990100c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:15.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.743+0000 7fd99772a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd990107fd0 0x7fd990101140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:15.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.743+0000 7fd99772a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd990111dd0 con 0x7fd990103410 2024-08-19T00:16:15.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.743+0000 7fd99772a640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fd990111c50 con 0x7fd990107fd0 2024-08-19T00:16:15.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.743+0000 7fd99772a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd990111f50 con 0x7fd990102a60 2024-08-19T00:16:15.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.743+0000 7fd994cc5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd990103410 0x7fd990100c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:15.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.743+0000 7fd9954c6640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd990102a60 0x7fd9901006c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:15.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.743+0000 7fd994cc5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd990103410 0x7fd990100c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48870/0 (socket says 172.21.15.44:48870) 2024-08-19T00:16:15.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.743+0000 7fd9954c6640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd990102a60 0x7fd9901006c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.44:59828/0 (socket says 172.21.15.44:59828) 2024-08-19T00:16:15.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.743+0000 7fd994cc5640 1 -- 172.21.15.44:0/2824151162 learned_addr learned my addr 172.21.15.44:0/2824151162 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:16:15.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.743+0000 7fd995cc7640 1 --2- 172.21.15.44:0/2824151162 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd990107fd0 0x7fd990101140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:15.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.743+0000 7fd994cc5640 1 -- 172.21.15.44:0/2824151162 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd990102a60 msgr2=0x7fd9901006c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:15.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.743+0000 7fd994cc5640 1 --2- 172.21.15.44:0/2824151162 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd990102a60 0x7fd9901006c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:15.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.743+0000 7fd994cc5640 1 -- 172.21.15.44:0/2824151162 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd990107fd0 msgr2=0x7fd990101140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:15.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.743+0000 7fd994cc5640 1 --2- 172.21.15.44:0/2824151162 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd990107fd0 0x7fd990101140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:15.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.743+0000 7fd994cc5640 1 -- 172.21.15.44:0/2824151162 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9901a67f0 con 0x7fd990103410 2024-08-19T00:16:15.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.744+0000 7fd9954c6640 1 --2- 172.21.15.44:0/2824151162 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd990102a60 0x7fd9901006c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:16:15.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.744+0000 7fd994cc5640 1 --2- 172.21.15.44:0/2824151162 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd990103410 0x7fd990100c00 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fd980005940 tx=0x7fd980031b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:16:15.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.744+0000 7fd9867fc640 1 -- 172.21.15.44:0/2824151162 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd98003f030 con 0x7fd990103410 2024-08-19T00:16:15.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.744+0000 7fd99772a640 1 -- 172.21.15.44:0/2824151162 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9901a6a80 con 0x7fd990103410 2024-08-19T00:16:15.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.744+0000 7fd99772a640 1 -- 172.21.15.44:0/2824151162 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9901a6fb0 con 0x7fd990103410 2024-08-19T00:16:15.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.744+0000 7fd9867fc640 1 -- 172.21.15.44:0/2824151162 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9800043d0 con 0x7fd990103410 2024-08-19T00:16:15.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.744+0000 7fd9867fc640 1 -- 172.21.15.44:0/2824151162 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd980035070 con 0x7fd990103410 2024-08-19T00:16:15.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.747+0000 7fd9867fc640 1 -- 172.21.15.44:0/2824151162 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fd980042030 con 0x7fd990103410 2024-08-19T00:16:15.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.748+0000 7fd999b28740 1 Processor -- start 2024-08-19T00:16:15.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.748+0000 7fd999b28740 1 -- start start 2024-08-19T00:16:15.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.748+0000 7fd999b28740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5625f2bf2130 0x5625f2bf2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:15.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.748+0000 7fd999b28740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5625f2bf2a50 0x5625f2bfcdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:15.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.748+0000 7fd999b28740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5625f2bfd310 0x5625f2bff700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:15.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.748+0000 7fd999b28740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5625f2b57a70 con 0x5625f2bfd310 2024-08-19T00:16:15.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.748+0000 7fd999b28740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5625f2aef780 con 0x5625f2bf2130 2024-08-19T00:16:15.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.748+0000 7fd999b28740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5625f2b53a30 con 0x5625f2bf2a50 2024-08-19T00:16:15.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.748+0000 7fd995cc7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5625f2bf2130 0x5625f2bf2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:15.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.748+0000 7fd994cc5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5625f2bfd310 0x5625f2bff700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:15.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.748+0000 7fd9954c6640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5625f2bf2a50 0x5625f2bfcdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:15.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.748+0000 7fd995cc7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5625f2bf2130 0x5625f2bf2510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.44:33794/0 (socket says 172.21.15.44:33794) 2024-08-19T00:16:15.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.748+0000 7fd9954c6640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5625f2bf2a50 0x5625f2bfcdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.44:59832/0 (socket says 172.21.15.44:59832) 2024-08-19T00:16:15.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.748+0000 7fd9867fc640 1 --2- 172.21.15.44:0/2824151162 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fd97c0a2cf0 0x7fd97c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:15.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.748+0000 7fd995cc7640 1 -- 172.21.15.44:0/3218826812 learned_addr learned my addr 172.21.15.44:0/3218826812 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:16:15.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.748+0000 7fd995cc7640 1 --2- 172.21.15.44:0/2824151162 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fd97c0a2cf0 0x7fd97c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:15.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.748+0000 7fd9954c6640 1 -- 172.21.15.44:0/3218826812 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5625f2bf2130 msgr2=0x5625f2bf2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:16:15.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.748+0000 7fd9954c6640 1 --2- 172.21.15.44:0/3218826812 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5625f2bf2130 0x5625f2bf2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:15.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.748+0000 7fd9954c6640 1 -- 172.21.15.44:0/3218826812 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5625f2bfd310 msgr2=0x5625f2bff700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:16:15.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.748+0000 7fd9954c6640 1 --2- 172.21.15.44:0/3218826812 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5625f2bfd310 0x5625f2bff700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:15.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.748+0000 7fd9954c6640 1 -- 172.21.15.44:0/3218826812 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625f28c9b90 con 0x5625f2bf2a50 2024-08-19T00:16:15.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.748+0000 7fd9867fc640 1 -- 172.21.15.44:0/2824151162 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7fd9800efd00 con 0x7fd990103410 2024-08-19T00:16:15.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.749+0000 7fd9954c6640 1 --2- 172.21.15.44:0/3218826812 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5625f2bf2a50 0x5625f2bfcdd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd98c009fd0 tx=0x7fd98c0118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=249aaf873c897ade server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:16:15.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.749+0000 7fd995cc7640 1 --2- 172.21.15.44:0/2824151162 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fd97c0a2cf0 0x7fd97c0a51b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd9880049d0 tx=0x7fd988004ab0 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:16:15.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.749+0000 7fd97b7fe640 1 -- 172.21.15.44:0/3218826812 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd98c004310 con 0x5625f2bf2a50 2024-08-19T00:16:15.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.749+0000 7fd97b7fe640 1 -- 172.21.15.44:0/3218826812 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd98c0044b0 con 0x5625f2bf2a50 2024-08-19T00:16:15.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.749+0000 7fd97b7fe640 1 -- 172.21.15.44:0/3218826812 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd98c003650 con 0x5625f2bf2a50 2024-08-19T00:16:15.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.750+0000 7fd999b28740 1 -- 172.21.15.44:0/3218826812 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5625f2bf2a50 msgr2=0x5625f2bfcdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:15.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.750+0000 7fd999b28740 1 --2- 172.21.15.44:0/3218826812 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5625f2bf2a50 0x5625f2bfcdd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd98c009fd0 tx=0x7fd98c0118d0 comp rx=0 tx=0).stop 2024-08-19T00:16:15.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.750+0000 7fd999b28740 1 -- 172.21.15.44:0/3218826812 shutdown_connections 2024-08-19T00:16:15.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.750+0000 7fd999b28740 1 --2- 172.21.15.44:0/3218826812 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5625f2bf2a50 0x5625f2bfcdd0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:15.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.750+0000 7fd999b28740 1 --2- 172.21.15.44:0/3218826812 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5625f2bfd310 0x5625f2bff700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:15.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.750+0000 7fd999b28740 1 --2- 172.21.15.44:0/3218826812 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5625f2bf2130 0x5625f2bf2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:15.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.750+0000 7fd999b28740 1 -- 172.21.15.44:0/3218826812 >> 172.21.15.44:0/3218826812 conn(0x5625f2bee6c0 msgr2=0x5625f2beeaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:16:15.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.750+0000 7fd999b28740 1 -- 172.21.15.44:0/3218826812 shutdown_connections 2024-08-19T00:16:15.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.750+0000 7fd999b28740 1 -- 172.21.15.44:0/3218826812 wait complete. 2024-08-19T00:16:15.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.750+0000 7fd999b28740 1 -- start start 2024-08-19T00:16:15.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.750+0000 7fd999b28740 1 Processor -- start 2024-08-19T00:16:15.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.751+0000 7fd999b28740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5625f2bf2130 0x5625f2bfa0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:15.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.751+0000 7fd999b28740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5625f2bf2a50 0x5625f2bfa610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:15.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.751+0000 7fd9954c6640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5625f2bf2130 0x5625f2bfa0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:15.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.751+0000 7fd9954c6640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5625f2bf2130 0x5625f2bfa0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.44:59836/0 (socket says 172.21.15.44:59836) 2024-08-19T00:16:15.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.751+0000 7fd994cc5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5625f2bf2a50 0x5625f2bfa610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:15.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.751+0000 7fd994cc5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5625f2bf2a50 0x5625f2bfa610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48892/0 (socket says 172.21.15.44:48892) 2024-08-19T00:16:15.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.751+0000 7fd9954c6640 1 -- 172.21.15.44:0/3850002531 learned_addr learned my addr 172.21.15.44:0/3850002531 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:16:15.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.751+0000 7fd999b28740 1 --2- 172.21.15.44:0/3850002531 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5625f2bfd310 0x5625f2bfab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:15.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.751+0000 7fd999b28740 1 -- 172.21.15.44:0/3850002531 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5625f2bffee0 con 0x5625f2bf2a50 2024-08-19T00:16:15.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.751+0000 7fd999b28740 1 -- 172.21.15.44:0/3850002531 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5625f2b12990 con 0x5625f2bfd310 2024-08-19T00:16:15.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.751+0000 7fd999b28740 1 -- 172.21.15.44:0/3850002531 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5625f2c00060 con 0x5625f2bf2130 2024-08-19T00:16:15.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.752+0000 7fd999b28740 10 client.0 _ll_register_callbacks cb 0x5625f2867090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:16:15.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.752+0000 7fd995cc7640 1 --2- 172.21.15.44:0/3850002531 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5625f2bfd310 0x5625f2bfab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:15.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.752+0000 7fd994cc5640 1 -- 172.21.15.44:0/3850002531 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5625f2bf2130 msgr2=0x5625f2bfa0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:16:15.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.752+0000 7fd994cc5640 1 --2- 172.21.15.44:0/3850002531 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5625f2bf2130 0x5625f2bfa0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:15.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.752+0000 7fd994cc5640 1 -- 172.21.15.44:0/3850002531 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5625f2bfd310 msgr2=0x5625f2bfab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:16:15.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.752+0000 7fd994cc5640 1 --2- 172.21.15.44:0/3850002531 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5625f2bfd310 0x5625f2bfab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:15.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.752+0000 7fd994cc5640 1 -- 172.21.15.44:0/3850002531 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625f2b116c0 con 0x5625f2bf2a50 2024-08-19T00:16:15.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.752+0000 7fd994cc5640 1 --2- 172.21.15.44:0/3850002531 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5625f2bf2a50 0x5625f2bfa610 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fd9800ed050 tx=0x7fd980000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9efbb79ec3bbdf95 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:16:15.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.752+0000 7fd978ff9640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:16:15.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.752+0000 7fd978ff9640 1 -- 172.21.15.44:0/3850002531 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9800ed4d0 con 0x5625f2bf2a50 2024-08-19T00:16:15.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.752+0000 7fd978ff9640 1 -- 172.21.15.44:0/3850002531 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7fd980031bd0 con 0x5625f2bf2a50 2024-08-19T00:16:15.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.752+0000 7fd999b28740 1 -- 172.21.15.44:0/3850002531 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd98c0044b0 con 0x5625f2bf2a50 2024-08-19T00:16:15.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.752+0000 7fd978ff9640 1 -- 172.21.15.44:0/3850002531 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd9800d9050 con 0x5625f2bf2a50 2024-08-19T00:16:15.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.753+0000 7fd999b28740 10 client.15894 fetch_fsmap learned FSMap version 30 2024-08-19T00:16:15.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.753+0000 7fd999b28740 1 -- 172.21.15.44:0/3850002531 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5625f2bffee0 con 0x5625f2bf2a50 2024-08-19T00:16:15.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.753+0000 7fd978ff9640 1 -- 172.21.15.44:0/3850002531 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd98c0044b0 con 0x5625f2bf2a50 2024-08-19T00:16:15.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.753+0000 7fd978ff9640 1 -- 172.21.15.44:0/3850002531 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 30) ==== 8386+0+0 (secure 0 0 0) 0x7fd9800c4ce0 con 0x5625f2bf2a50 2024-08-19T00:16:15.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.753+0000 7fd999b28740 10 client.15894 fetch_fsmap finished waiting for FSMap version 30 2024-08-19T00:16:15.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.753+0000 7fd999b28740 10 client.15894 resolve_mds: validated gid 24473 aka daemon mds.b 2024-08-19T00:16:15.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.753+0000 7fd999b28740 20 client.15894 populate_metadata read hostname 'smithi044' 2024-08-19T00:16:15.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.753+0000 7fd999b28740 1 --2- 172.21.15.44:0/3850002531 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5625f2c0d030 0x5625f2c0f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:15.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.753+0000 7fd999b28740 4 client.15894 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:16:15.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.753+0000 7fd999b28740 1 -- 172.21.15.44:0/3850002531 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5625f2b651a0 con 0x5625f2c0d030 2024-08-19T00:16:15.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.753+0000 7fd9954c6640 1 --2- 172.21.15.44:0/3850002531 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5625f2c0d030 0x5625f2c0f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:15.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.754+0000 7fd9954c6640 1 --2- 172.21.15.44:0/3850002531 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5625f2c0d030 0x5625f2c0f4f0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f275e7686b9498b server_cookie=195c7572a4d427e9 in_seq=0 out_seq=0 2024-08-19T00:16:15.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.754+0000 7fd978ff9640 10 client.15894 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:16:15.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.754+0000 7fd978ff9640 1 -- 172.21.15.44:0/3850002531 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5625f2b651a0 con 0x5625f2c0d030 2024-08-19T00:16:15.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.754+0000 7fd978ff9640 10 client.15894 handle_command_reply: tid=0 2024-08-19T00:16:15.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.754+0000 7fd999b28740 1 client.15894 shutdown 2024-08-19T00:16:15.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.754+0000 7fd999b28740 1 -- 172.21.15.44:0/3850002531 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5625f2bf2a50 msgr2=0x5625f2bfa610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:15.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.754+0000 7fd999b28740 1 --2- 172.21.15.44:0/3850002531 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5625f2bf2a50 0x5625f2bfa610 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fd9800ed050 tx=0x7fd980000bc0 comp rx=0 tx=0).stop 2024-08-19T00:16:15.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.754+0000 7fd999b28740 1 -- 172.21.15.44:0/3850002531 shutdown_connections 2024-08-19T00:16:15.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.754+0000 7fd999b28740 1 --2- 172.21.15.44:0/3850002531 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5625f2c0d030 0x5625f2c0f4f0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:15.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.754+0000 7fd999b28740 1 --2- 172.21.15.44:0/3850002531 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5625f2bfd310 0x5625f2bfab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:15.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.754+0000 7fd999b28740 1 --2- 172.21.15.44:0/3850002531 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5625f2bf2a50 0x5625f2bfa610 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:15.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.754+0000 7fd999b28740 1 --2- 172.21.15.44:0/3850002531 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5625f2bf2130 0x5625f2bfa0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:15.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.754+0000 7fd978ff9640 0 client.15894 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:16:15.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.754+0000 7fd999b28740 1 -- 172.21.15.44:0/3850002531 >> 172.21.15.44:0/3850002531 conn(0x5625f2bee6c0 msgr2=0x5625f2bf43a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:16:15.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.755+0000 7fd999b28740 1 -- 172.21.15.44:0/3850002531 shutdown_connections 2024-08-19T00:16:15.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.755+0000 7fd999b28740 1 -- 172.21.15.44:0/3850002531 wait complete. 2024-08-19T00:16:15.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.755+0000 7fd999b28740 20 client.15894 trim_cache size 0 max 16384 2024-08-19T00:16:15.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.773+0000 7fd999b28740 1 Processor -- start 2024-08-19T00:16:15.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.773+0000 7fd999b28740 1 -- start start 2024-08-19T00:16:15.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.774+0000 7fd999b28740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5625f2bf2130 0x5625f2c14dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:15.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.774+0000 7fd999b28740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5625f2bf2a50 0x5625f2c15300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:15.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.774+0000 7fd999b28740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5625f2bfd310 0x5625f2bf7330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:15.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.774+0000 7fd999b28740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd97400fe40 con 0x5625f2bf2a50 2024-08-19T00:16:15.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.774+0000 7fd999b28740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fd974011a40 con 0x5625f2bfd310 2024-08-19T00:16:15.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.774+0000 7fd999b28740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd974010510 con 0x5625f2bf2130 2024-08-19T00:16:15.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.774+0000 7fd994cc5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5625f2bf2a50 0x5625f2c15300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:15.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.774+0000 7fd994cc5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5625f2bf2a50 0x5625f2c15300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48902/0 (socket says 172.21.15.44:48902) 2024-08-19T00:16:15.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.774+0000 7fd994cc5640 1 -- 172.21.15.44:0/3481355398 learned_addr learned my addr 172.21.15.44:0/3481355398 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:16:15.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.774+0000 7fd9954c6640 1 --2- 172.21.15.44:0/3481355398 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5625f2bf2130 0x5625f2c14dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:15.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.774+0000 7fd995cc7640 1 --2- 172.21.15.44:0/3481355398 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5625f2bfd310 0x5625f2bf7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:15.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.774+0000 7fd994cc5640 1 -- 172.21.15.44:0/3481355398 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5625f2bf2130 msgr2=0x5625f2c14dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:16:15.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.774+0000 7fd994cc5640 1 --2- 172.21.15.44:0/3481355398 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5625f2bf2130 0x5625f2c14dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:15.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.774+0000 7fd994cc5640 1 -- 172.21.15.44:0/3481355398 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5625f2bfd310 msgr2=0x5625f2bf7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:16:15.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.774+0000 7fd994cc5640 1 --2- 172.21.15.44:0/3481355398 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5625f2bfd310 0x5625f2bf7330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:15.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.774+0000 7fd994cc5640 1 -- 172.21.15.44:0/3481355398 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625f2bf2880 con 0x5625f2bf2a50 2024-08-19T00:16:15.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.774+0000 7fd994cc5640 1 --2- 172.21.15.44:0/3481355398 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5625f2bf2a50 0x5625f2c15300 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fd980009340 tx=0x7fd9800bb780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45a66ba74b32e150 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:16:15.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.774+0000 7fd97affd640 1 -- 172.21.15.44:0/3481355398 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9800bc520 con 0x5625f2bf2a50 2024-08-19T00:16:15.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.775+0000 7fd97affd640 1 -- 172.21.15.44:0/3481355398 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9800c4a90 con 0x5625f2bf2a50 2024-08-19T00:16:15.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.775+0000 7fd97affd640 1 -- 172.21.15.44:0/3481355398 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9800bb4d0 con 0x5625f2bf2a50 2024-08-19T00:16:15.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.775+0000 7fd999b28740 1 -- 172.21.15.44:0/3481355398 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5625f2bf2a50 msgr2=0x5625f2c15300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:15.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.775+0000 7fd999b28740 1 --2- 172.21.15.44:0/3481355398 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5625f2bf2a50 0x5625f2c15300 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fd980009340 tx=0x7fd9800bb780 comp rx=0 tx=0).stop 2024-08-19T00:16:15.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.775+0000 7fd999b28740 1 -- 172.21.15.44:0/3481355398 shutdown_connections 2024-08-19T00:16:15.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.775+0000 7fd999b28740 1 --2- 172.21.15.44:0/3481355398 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5625f2bfd310 0x5625f2bf7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:15.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.775+0000 7fd999b28740 1 --2- 172.21.15.44:0/3481355398 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5625f2bf2a50 0x5625f2c15300 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:15.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.775+0000 7fd999b28740 1 --2- 172.21.15.44:0/3481355398 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5625f2bf2130 0x5625f2c14dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:15.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.775+0000 7fd999b28740 1 -- 172.21.15.44:0/3481355398 >> 172.21.15.44:0/3481355398 conn(0x5625f2bee6c0 msgr2=0x5625f2bed6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:16:15.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.775+0000 7fd999b28740 1 -- 172.21.15.44:0/3481355398 shutdown_connections 2024-08-19T00:16:15.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.775+0000 7fd999b28740 1 -- 172.21.15.44:0/3481355398 wait complete. 2024-08-19T00:16:15.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.776+0000 7fd999b28740 1 -- start start 2024-08-19T00:16:15.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.776+0000 7fd999b28740 1 Processor -- start 2024-08-19T00:16:15.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.776+0000 7fd999b28740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5625f2bf2130 0x5625f2c056c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:15.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.776+0000 7fd999b28740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5625f2bf2a50 0x5625f2c05c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:15.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.776+0000 7fd999b28740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5625f2bfd310 0x5625f2c00500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:15.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.776+0000 7fd999b28740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd9740112b0 con 0x5625f2bf2130 2024-08-19T00:16:15.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.776+0000 7fd999b28740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fd974010be0 con 0x5625f2bfd310 2024-08-19T00:16:15.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.776+0000 7fd999b28740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd97400de20 con 0x5625f2bf2a50 2024-08-19T00:16:15.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.776+0000 7fd999b28740 10 client.0 _ll_register_callbacks cb 0x7fd980009290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:16:15.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.777+0000 7fd995cc7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5625f2bfd310 0x5625f2c00500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:15.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.777+0000 7fd9954c6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5625f2bf2130 0x5625f2c056c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:15.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.777+0000 7fd994cc5640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5625f2bf2a50 0x5625f2c05c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:15.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.777+0000 7fd995cc7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5625f2bfd310 0x5625f2c00500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.44:33822/0 (socket says 172.21.15.44:33822) 2024-08-19T00:16:15.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.777+0000 7fd995cc7640 1 -- 172.21.15.44:0/4062976530 learned_addr learned my addr 172.21.15.44:0/4062976530 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:16:15.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.777+0000 7fd994cc5640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5625f2bf2a50 0x5625f2c05c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.44:59850/0 (socket says 172.21.15.44:59850) 2024-08-19T00:16:15.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.777+0000 7fd995cc7640 1 -- 172.21.15.44:0/4062976530 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5625f2bf2a50 msgr2=0x5625f2c05c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:16:15.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.777+0000 7fd995cc7640 1 --2- 172.21.15.44:0/4062976530 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5625f2bf2a50 0x5625f2c05c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:15.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.777+0000 7fd995cc7640 1 -- 172.21.15.44:0/4062976530 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5625f2bf2130 msgr2=0x5625f2c056c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:16:15.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.777+0000 7fd995cc7640 1 --2- 172.21.15.44:0/4062976530 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5625f2bf2130 0x5625f2c056c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:15.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.777+0000 7fd995cc7640 1 -- 172.21.15.44:0/4062976530 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625f2c00d30 con 0x5625f2bfd310 2024-08-19T00:16:15.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.777+0000 7fd9954c6640 1 --2- 172.21.15.44:0/4062976530 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5625f2bf2130 0x5625f2c056c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:16:15.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.777+0000 7fd995cc7640 1 --2- 172.21.15.44:0/4062976530 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5625f2bfd310 0x5625f2c00500 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd988012040 tx=0x7fd988004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34adddbc32bb8fa server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:16:15.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.777+0000 7fd978ff9640 10 client.0 ms_handle_connect on v2:172.21.15.116:3300/0 2024-08-19T00:16:15.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.777+0000 7fd978ff9640 1 -- 172.21.15.44:0/4062976530 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd988031060 con 0x5625f2bfd310 2024-08-19T00:16:15.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.777+0000 7fd999b28740 1 -- 172.21.15.44:0/4062976530 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9800c4a90 con 0x5625f2bfd310 2024-08-19T00:16:15.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.777+0000 7fd978ff9640 1 -- 172.21.15.44:0/4062976530 <== mon.2 v2:172.21.15.116:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7fd988010640 con 0x5625f2bfd310 2024-08-19T00:16:15.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.777+0000 7fd978ff9640 1 -- 172.21.15.44:0/4062976530 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd988038050 con 0x5625f2bfd310 2024-08-19T00:16:15.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.778+0000 7fd999b28740 10 client.25418 fetch_fsmap learned FSMap version 30 2024-08-19T00:16:15.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.778+0000 7fd999b28740 1 -- 172.21.15.44:0/4062976530 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5625f2c789d0 con 0x5625f2bfd310 2024-08-19T00:16:15.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.778+0000 7fd978ff9640 1 -- 172.21.15.44:0/4062976530 <== mon.2 v2:172.21.15.116:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9800c4a90 con 0x5625f2bfd310 2024-08-19T00:16:15.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.778+0000 7fd978ff9640 1 -- 172.21.15.44:0/4062976530 <== mon.2 v2:172.21.15.116:3300/0 5 ==== fsmap(e 30) ==== 8386+0+0 (secure 0 0 0) 0x7fd98801f040 con 0x5625f2bfd310 2024-08-19T00:16:15.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.778+0000 7fd999b28740 10 client.25418 fetch_fsmap finished waiting for FSMap version 30 2024-08-19T00:16:15.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.778+0000 7fd999b28740 10 client.25418 resolve_mds: validated gid 24473 aka daemon mds.b 2024-08-19T00:16:15.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.778+0000 7fd999b28740 20 client.25418 populate_metadata read hostname 'smithi044' 2024-08-19T00:16:15.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.778+0000 7fd999b28740 1 --2- 172.21.15.44:0/4062976530 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5625f2c79280 0x5625f2c7b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:15.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.778+0000 7fd999b28740 4 client.25418 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}] 2024-08-19T00:16:15.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.778+0000 7fd999b28740 1 -- 172.21.15.44:0/4062976530 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}) -- 0x5625f2b5f4f0 con 0x5625f2c79280 2024-08-19T00:16:15.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.778+0000 7fd9954c6640 1 --2- 172.21.15.44:0/4062976530 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5625f2c79280 0x5625f2c7b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:15.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.779+0000 7fd978ff9640 10 client.25418 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:16:15.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.779+0000 7fd9954c6640 1 --2- 172.21.15.44:0/4062976530 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5625f2c79280 0x5625f2c7b6a0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6131a854817f91de server_cookie=779fbf84d3302e65 in_seq=0 out_seq=0 2024-08-19T00:16:15.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.858+0000 7fd978ff9640 1 -- 172.21.15.44:0/4062976530 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5625f2b5f4f0 con 0x5625f2c79280 2024-08-19T00:16:15.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.858+0000 7fd978ff9640 10 client.25418 handle_command_reply: tid=0 2024-08-19T00:16:15.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.858+0000 7fd999b28740 1 client.25418 shutdown 2024-08-19T00:16:15.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.858+0000 7fd999b28740 1 -- 172.21.15.44:0/4062976530 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5625f2bfd310 msgr2=0x5625f2c00500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:15.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.858+0000 7fd999b28740 1 --2- 172.21.15.44:0/4062976530 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5625f2bfd310 0x5625f2c00500 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd988012040 tx=0x7fd988004a40 comp rx=0 tx=0).stop 2024-08-19T00:16:15.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.859+0000 7fd999b28740 1 -- 172.21.15.44:0/4062976530 shutdown_connections 2024-08-19T00:16:15.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.859+0000 7fd999b28740 1 --2- 172.21.15.44:0/4062976530 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5625f2c79280 0x5625f2c7b6a0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:15.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.859+0000 7fd999b28740 1 --2- 172.21.15.44:0/4062976530 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5625f2bf2a50 0x5625f2c05c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:15.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.859+0000 7fd999b28740 1 --2- 172.21.15.44:0/4062976530 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5625f2bfd310 0x5625f2c00500 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:15.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.859+0000 7fd999b28740 1 --2- 172.21.15.44:0/4062976530 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5625f2bf2130 0x5625f2c056c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:15.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.859+0000 7fd978ff9640 0 client.25418 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:16:15.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.859+0000 7fd999b28740 1 -- 172.21.15.44:0/4062976530 >> 172.21.15.44:0/4062976530 conn(0x5625f2bee6c0 msgr2=0x5625f2bfb930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:16:15.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.859+0000 7fd999b28740 1 -- 172.21.15.44:0/4062976530 shutdown_connections 2024-08-19T00:16:15.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.859+0000 7fd999b28740 1 -- 172.21.15.44:0/4062976530 wait complete. 2024-08-19T00:16:15.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.859+0000 7fd999b28740 20 client.25418 trim_cache size 0 max 16384 2024-08-19T00:16:15.862 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-08-19T00:16:15.862 INFO:teuthology.orchestra.run.smithi044.stdout: "epoch": 30, 2024-08-19T00:16:15.862 INFO:teuthology.orchestra.run.smithi044.stdout: "leader": 24473, 2024-08-19T00:16:15.862 INFO:teuthology.orchestra.run.smithi044.stdout: "set_version": 10, 2024-08-19T00:16:15.862 INFO:teuthology.orchestra.run.smithi044.stdout: "sets": { 2024-08-19T00:16:15.862 INFO:teuthology.orchestra.run.smithi044.stdout: "d96e3045": { 2024-08-19T00:16:15.862 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 10, 2024-08-19T00:16:15.862 INFO:teuthology.orchestra.run.smithi044.stdout: "age_ref": 0.0, 2024-08-19T00:16:15.862 INFO:teuthology.orchestra.run.smithi044.stdout: "state": { 2024-08-19T00:16:15.862 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "QUIESCED", 2024-08-19T00:16:15.863 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.0 2024-08-19T00:16:15.863 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:16:15.863 INFO:teuthology.orchestra.run.smithi044.stdout: "timeout": 90.0, 2024-08-19T00:16:15.863 INFO:teuthology.orchestra.run.smithi044.stdout: "expiration": 150.0, 2024-08-19T00:16:15.863 INFO:teuthology.orchestra.run.smithi044.stdout: "members": { 2024-08-19T00:16:15.863 INFO:teuthology.orchestra.run.smithi044.stdout: "file:/": { 2024-08-19T00:16:15.863 INFO:teuthology.orchestra.run.smithi044.stdout: "excluded": false, 2024-08-19T00:16:15.863 INFO:teuthology.orchestra.run.smithi044.stdout: "state": { 2024-08-19T00:16:15.863 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "QUIESCED", 2024-08-19T00:16:15.863 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.0 2024-08-19T00:16:15.863 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:16:15.863 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:16:15.863 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:16:15.863 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:16:15.863 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:16:15.864 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-08-19T00:16:15.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.859+0000 7fd99772a640 1 -- 172.21.15.44:0/2824151162 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fd97c0a2cf0 msgr2=0x7fd97c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:15.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.859+0000 7fd99772a640 1 --2- 172.21.15.44:0/2824151162 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fd97c0a2cf0 0x7fd97c0a51b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd9880049d0 tx=0x7fd988004ab0 comp rx=0 tx=0).stop 2024-08-19T00:16:15.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.859+0000 7fd99772a640 1 -- 172.21.15.44:0/2824151162 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd990103410 msgr2=0x7fd990100c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:15.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.859+0000 7fd99772a640 1 --2- 172.21.15.44:0/2824151162 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd990103410 0x7fd990100c00 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fd980005940 tx=0x7fd980031b50 comp rx=0 tx=0).stop 2024-08-19T00:16:15.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.860+0000 7fd99772a640 1 -- 172.21.15.44:0/2824151162 shutdown_connections 2024-08-19T00:16:15.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.860+0000 7fd99772a640 1 --2- 172.21.15.44:0/2824151162 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fd97c0a2cf0 0x7fd97c0a51b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:15.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.860+0000 7fd99772a640 1 --2- 172.21.15.44:0/2824151162 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd990107fd0 0x7fd990101140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:15.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.860+0000 7fd99772a640 1 --2- 172.21.15.44:0/2824151162 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd990103410 0x7fd990100c00 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:15.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.860+0000 7fd99772a640 1 --2- 172.21.15.44:0/2824151162 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd990102a60 0x7fd9901006c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:15.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.860+0000 7fd99772a640 1 -- 172.21.15.44:0/2824151162 >> 172.21.15.44:0/2824151162 conn(0x7fd9900fc500 msgr2=0x7fd990105b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:16:15.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.860+0000 7fd99772a640 1 -- 172.21.15.44:0/2824151162 shutdown_connections 2024-08-19T00:16:15.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:15.860+0000 7fd99772a640 1 -- 172.21.15.44:0/2824151162 wait complete. 2024-08-19T00:16:16.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:16:16 smithi171 ceph-mon[21810]: pgmap v91: 129 pgs: 129 active+clean; 103 MiB data, 926 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 5.3 MiB/s wr, 418 op/s 2024-08-19T00:16:16.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:16:16 smithi116 ceph-mon[21873]: pgmap v91: 129 pgs: 129 active+clean; 103 MiB data, 926 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 5.3 MiB/s wr, 418 op/s 2024-08-19T00:16:16.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:16:16 smithi044 ceph-mon[18489]: pgmap v91: 129 pgs: 129 active+clean; 103 MiB data, 926 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 5.3 MiB/s wr, 418 op/s 2024-08-19T00:16:16.666 INFO:tasks.workunit.client.0.smithi044.stdout: 1 166186 9.04 MB/sec warmup 101 sec latency 808.875 ms 2024-08-19T00:16:16.716 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'd96e3045', quiesce took 3.7 seconds. Will release after: 26.3 2024-08-19T00:16:17.667 INFO:tasks.workunit.client.0.smithi044.stdout: 1 166186 8.95 MB/sec warmup 102 sec latency 1808.956 ms 2024-08-19T00:16:18.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:16:18 smithi171 ceph-mon[21810]: pgmap v92: 129 pgs: 129 active+clean; 103 MiB data, 926 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.6 MiB/s wr, 264 op/s 2024-08-19T00:16:18.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:16:18 smithi116 ceph-mon[21873]: pgmap v92: 129 pgs: 129 active+clean; 103 MiB data, 926 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.6 MiB/s wr, 264 op/s 2024-08-19T00:16:18.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:16:18 smithi044 ceph-mon[18489]: pgmap v92: 129 pgs: 129 active+clean; 103 MiB data, 926 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.6 MiB/s wr, 264 op/s 2024-08-19T00:16:18.667 INFO:tasks.workunit.client.0.smithi044.stdout: 1 166186 8.86 MB/sec warmup 103 sec latency 2809.085 ms 2024-08-19T00:16:19.667 INFO:tasks.workunit.client.0.smithi044.stdout: 1 166186 8.78 MB/sec warmup 104 sec latency 3809.198 ms 2024-08-19T00:16:20.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:16:20 smithi171 ceph-mon[21810]: pgmap v93: 129 pgs: 129 active+clean; 103 MiB data, 926 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.6 MiB/s wr, 264 op/s 2024-08-19T00:16:20.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:16:20 smithi116 ceph-mon[21873]: pgmap v93: 129 pgs: 129 active+clean; 103 MiB data, 926 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.6 MiB/s wr, 264 op/s 2024-08-19T00:16:20.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:16:20 smithi044 ceph-mon[18489]: pgmap v93: 129 pgs: 129 active+clean; 103 MiB data, 926 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.6 MiB/s wr, 264 op/s 2024-08-19T00:16:20.667 INFO:tasks.workunit.client.0.smithi044.stdout: 1 166186 8.70 MB/sec warmup 105 sec latency 4809.309 ms 2024-08-19T00:16:21.667 INFO:tasks.workunit.client.0.smithi044.stdout: 1 166186 8.61 MB/sec warmup 106 sec latency 5809.387 ms 2024-08-19T00:16:22.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:16:22 smithi171 ceph-mon[21810]: pgmap v94: 129 pgs: 129 active+clean; 105 MiB data, 939 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 3.9 MiB/s wr, 297 op/s 2024-08-19T00:16:22.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:16:22 smithi116 ceph-mon[21873]: pgmap v94: 129 pgs: 129 active+clean; 105 MiB data, 939 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 3.9 MiB/s wr, 297 op/s 2024-08-19T00:16:22.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:16:22 smithi044 ceph-mon[18489]: pgmap v94: 129 pgs: 129 active+clean; 105 MiB data, 939 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 3.9 MiB/s wr, 297 op/s 2024-08-19T00:16:22.667 INFO:tasks.workunit.client.0.smithi044.stdout: 1 166186 8.53 MB/sec warmup 107 sec latency 6809.479 ms 2024-08-19T00:16:23.667 INFO:tasks.workunit.client.0.smithi044.stdout: 1 166186 8.45 MB/sec warmup 108 sec latency 7809.585 ms 2024-08-19T00:16:24.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:16:24 smithi171 ceph-mon[21810]: pgmap v95: 129 pgs: 129 active+clean; 105 MiB data, 939 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 166 op/s 2024-08-19T00:16:24.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:16:24 smithi116 ceph-mon[21873]: pgmap v95: 129 pgs: 129 active+clean; 105 MiB data, 939 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 166 op/s 2024-08-19T00:16:24.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:16:24 smithi044 ceph-mon[18489]: pgmap v95: 129 pgs: 129 active+clean; 105 MiB data, 939 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 166 op/s 2024-08-19T00:16:24.667 INFO:tasks.workunit.client.0.smithi044.stdout: 1 166186 8.38 MB/sec warmup 109 sec latency 8809.657 ms 2024-08-19T00:16:25.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:16:25 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:16:25.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:16:25 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:16:25.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:16:25 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:16:25.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:16:25 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:16:25.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:16:25 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:16:25.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:16:25 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:16:25.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:16:25 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:16:25.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:16:25 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:16:25.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:16:25 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:16:25.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:16:25 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:16:25.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:16:25 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:16:25.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:16:25 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:16:25.667 INFO:tasks.workunit.client.0.smithi044.stdout: 1 166186 8.30 MB/sec warmup 110 sec latency 9809.707 ms 2024-08-19T00:16:26.481 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.480+0000 7f9dd8944640 1 -- 172.21.15.44:0/1816208588 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9dd4106710 msgr2=0x7f9dd4106af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:26.482 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.480+0000 7f9dd8944640 1 --2- 172.21.15.44:0/1816208588 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9dd4106710 0x7f9dd4106af0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4009930 tx=0x7f9dc402a420 comp rx=0 tx=0).stop 2024-08-19T00:16:26.482 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.480+0000 7f9dd8944640 1 -- 172.21.15.44:0/1816208588 shutdown_connections 2024-08-19T00:16:26.482 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.480+0000 7f9dd8944640 1 --2- 172.21.15.44:0/1816208588 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9dd41010a0 0x7f9dd410d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:26.482 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.480+0000 7f9dd8944640 1 --2- 172.21.15.44:0/1816208588 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9dd4100700 0x7f9dd4100b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:26.482 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.480+0000 7f9dd8944640 1 --2- 172.21.15.44:0/1816208588 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9dd4106710 0x7f9dd4106af0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:26.482 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.480+0000 7f9dd8944640 1 -- 172.21.15.44:0/1816208588 >> 172.21.15.44:0/1816208588 conn(0x7f9dd40fc420 msgr2=0x7f9dd40fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:16:26.483 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.480+0000 7f9dd8944640 1 -- 172.21.15.44:0/1816208588 shutdown_connections 2024-08-19T00:16:26.483 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.480+0000 7f9dd8944640 1 -- 172.21.15.44:0/1816208588 wait complete. 2024-08-19T00:16:26.484 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.481+0000 7f9dd8944640 1 Processor -- start 2024-08-19T00:16:26.485 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.481+0000 7f9dd8944640 1 -- start start 2024-08-19T00:16:26.485 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.481+0000 7f9dd8944640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9dd4100700 0x7f9dd4198100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:26.485 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.481+0000 7f9dd8944640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9dd41010a0 0x7f9dd4198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:26.485 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.481+0000 7f9dd8944640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9dd4106710 0x7f9dd419c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:26.485 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.481+0000 7f9dd8944640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd4110ba0 con 0x7f9dd41010a0 2024-08-19T00:16:26.485 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.481+0000 7f9dd8944640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd4110a20 con 0x7f9dd4106710 2024-08-19T00:16:26.485 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.481+0000 7f9dd8944640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd4110d20 con 0x7f9dd4100700 2024-08-19T00:16:26.485 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.481+0000 7f9dd1d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9dd41010a0 0x7f9dd4198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:26.485 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.482+0000 7f9dd1d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9dd41010a0 0x7f9dd4198640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58044/0 (socket says 172.21.15.44:58044) 2024-08-19T00:16:26.485 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.482+0000 7f9dd1d9b640 1 -- 172.21.15.44:0/2093896471 learned_addr learned my addr 172.21.15.44:0/2093896471 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:16:26.485 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.482+0000 7f9dd259c640 1 --2- 172.21.15.44:0/2093896471 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9dd4100700 0x7f9dd4198100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:26.485 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.482+0000 7f9dd2d9d640 1 --2- 172.21.15.44:0/2093896471 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9dd4106710 0x7f9dd419c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:26.485 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.482+0000 7f9dd1d9b640 1 -- 172.21.15.44:0/2093896471 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9dd4100700 msgr2=0x7f9dd4198100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:26.486 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.482+0000 7f9dd1d9b640 1 --2- 172.21.15.44:0/2093896471 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9dd4100700 0x7f9dd4198100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:26.486 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.482+0000 7f9dd1d9b640 1 -- 172.21.15.44:0/2093896471 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9dd4106710 msgr2=0x7f9dd419c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:26.486 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.482+0000 7f9dd1d9b640 1 --2- 172.21.15.44:0/2093896471 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9dd4106710 0x7f9dd419c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:26.486 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.482+0000 7f9dd1d9b640 1 -- 172.21.15.44:0/2093896471 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dd419d0f0 con 0x7f9dd41010a0 2024-08-19T00:16:26.486 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.482+0000 7f9dd1d9b640 1 --2- 172.21.15.44:0/2093896471 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9dd41010a0 0x7f9dd4198640 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f9dc800d950 tx=0x7f9dc800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:16:26.486 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.482+0000 7f9dc37fe640 1 -- 172.21.15.44:0/2093896471 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc8017030 con 0x7f9dd41010a0 2024-08-19T00:16:26.486 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.482+0000 7f9dd8944640 1 -- 172.21.15.44:0/2093896471 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dd419d3e0 con 0x7f9dd41010a0 2024-08-19T00:16:26.486 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.482+0000 7f9dc37fe640 1 -- 172.21.15.44:0/2093896471 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9dc8004020 con 0x7f9dd41010a0 2024-08-19T00:16:26.486 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.482+0000 7f9dc37fe640 1 -- 172.21.15.44:0/2093896471 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc80047a0 con 0x7f9dd41010a0 2024-08-19T00:16:26.486 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.482+0000 7f9dd8944640 1 -- 172.21.15.44:0/2093896471 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dd41a4c70 con 0x7f9dd41010a0 2024-08-19T00:16:26.489 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.485+0000 7f9dc37fe640 1 -- 172.21.15.44:0/2093896471 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f9dc80041d0 con 0x7f9dd41010a0 2024-08-19T00:16:26.489 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.485+0000 7f9ddb7dc740 1 Processor -- start 2024-08-19T00:16:26.489 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.486+0000 7f9ddb7dc740 1 -- start start 2024-08-19T00:16:26.489 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.486+0000 7f9ddb7dc740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55577e0c87d0 0x55577e0c8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:26.489 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.486+0000 7f9ddb7dc740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55577e0c90f0 0x55577e0d3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:26.489 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.486+0000 7f9ddb7dc740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55577e0d3990 0x55577e0d5d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:26.489 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.486+0000 7f9ddb7dc740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55577e02c9d0 con 0x55577e0c87d0 2024-08-19T00:16:26.490 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.486+0000 7f9ddb7dc740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55577dfd4820 con 0x55577e0c90f0 2024-08-19T00:16:26.490 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.486+0000 7f9ddb7dc740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55577e028990 con 0x55577e0d3990 2024-08-19T00:16:26.490 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.486+0000 7f9dc37fe640 1 --2- 172.21.15.44:0/2093896471 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f9dbc0a2da0 0x7f9dbc0a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:26.490 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.486+0000 7f9dd2d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55577e0c87d0 0x55577e0c8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:26.490 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.486+0000 7f9dd259c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55577e0c90f0 0x55577e0d3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:26.490 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.486+0000 7f9dd2d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55577e0c87d0 0x55577e0c8bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58050/0 (socket says 172.21.15.44:58050) 2024-08-19T00:16:26.490 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.486+0000 7f9dd259c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55577e0c90f0 0x55577e0d3450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.44:33738/0 (socket says 172.21.15.44:33738) 2024-08-19T00:16:26.490 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.486+0000 7f9dd2d9d640 1 -- 172.21.15.44:0/2254570922 learned_addr learned my addr 172.21.15.44:0/2254570922 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:16:26.490 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.486+0000 7f9dd1d9b640 1 --2- 172.21.15.44:0/2254570922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55577e0d3990 0x55577e0d5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:26.490 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.486+0000 7f9dd2d9d640 1 --2- 172.21.15.44:0/2093896471 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f9dbc0a2da0 0x7f9dbc0a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:26.490 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.486+0000 7f9dc37fe640 1 -- 172.21.15.44:0/2093896471 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f9dc80cf160 con 0x7f9dd41010a0 2024-08-19T00:16:26.491 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.487+0000 7f9dd259c640 1 -- 172.21.15.44:0/2254570922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55577e0d3990 msgr2=0x55577e0d5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:16:26.491 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.487+0000 7f9dd259c640 1 --2- 172.21.15.44:0/2254570922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55577e0d3990 0x55577e0d5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:26.491 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.487+0000 7f9dd259c640 1 -- 172.21.15.44:0/2254570922 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55577e0c87d0 msgr2=0x55577e0c8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:16:26.491 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.487+0000 7f9dd259c640 1 --2- 172.21.15.44:0/2254570922 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55577e0c87d0 0x55577e0c8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:26.491 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.487+0000 7f9dd259c640 1 -- 172.21.15.44:0/2254570922 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55577dd40210 con 0x55577e0c90f0 2024-08-19T00:16:26.491 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.487+0000 7f9dd2d9d640 1 --2- 172.21.15.44:0/2254570922 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55577e0c87d0 0x55577e0c8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:16:26.491 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.487+0000 7f9dd259c640 1 --2- 172.21.15.44:0/2254570922 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55577e0c90f0 0x55577e0d3450 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9dc402a940 tx=0x7f9dc4004180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ecf2395af161ea7d server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:16:26.491 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.487+0000 7f9dd2d9d640 1 --2- 172.21.15.44:0/2093896471 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f9dbc0a2da0 0x7f9dbc0a5260 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc00a780 tx=0x7f9dcc00a4d0 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:16:26.491 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.487+0000 7f9dc0ff9640 1 -- 172.21.15.44:0/2254570922 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc4035040 con 0x55577e0c90f0 2024-08-19T00:16:26.491 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.487+0000 7f9dc0ff9640 1 -- 172.21.15.44:0/2254570922 <== mon.2 v2:172.21.15.116:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9dc4005520 con 0x55577e0c90f0 2024-08-19T00:16:26.491 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.487+0000 7f9dc0ff9640 1 -- 172.21.15.44:0/2254570922 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc4003850 con 0x55577e0c90f0 2024-08-19T00:16:26.497 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.488+0000 7f9ddb7dc740 1 -- 172.21.15.44:0/2254570922 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55577e0c90f0 msgr2=0x55577e0d3450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:26.497 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.488+0000 7f9ddb7dc740 1 --2- 172.21.15.44:0/2254570922 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55577e0c90f0 0x55577e0d3450 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9dc402a940 tx=0x7f9dc4004180 comp rx=0 tx=0).stop 2024-08-19T00:16:26.497 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.488+0000 7f9ddb7dc740 1 -- 172.21.15.44:0/2254570922 shutdown_connections 2024-08-19T00:16:26.497 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.488+0000 7f9ddb7dc740 1 --2- 172.21.15.44:0/2254570922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55577e0d3990 0x55577e0d5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:26.497 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.488+0000 7f9ddb7dc740 1 --2- 172.21.15.44:0/2254570922 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55577e0c90f0 0x55577e0d3450 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:26.497 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.488+0000 7f9ddb7dc740 1 --2- 172.21.15.44:0/2254570922 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55577e0c87d0 0x55577e0c8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:26.497 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.488+0000 7f9ddb7dc740 1 -- 172.21.15.44:0/2254570922 >> 172.21.15.44:0/2254570922 conn(0x55577e0c4d40 msgr2=0x55577e0c5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:16:26.497 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.488+0000 7f9ddb7dc740 1 -- 172.21.15.44:0/2254570922 shutdown_connections 2024-08-19T00:16:26.497 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.488+0000 7f9ddb7dc740 1 -- 172.21.15.44:0/2254570922 wait complete. 2024-08-19T00:16:26.498 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.488+0000 7f9ddb7dc740 1 -- start start 2024-08-19T00:16:26.498 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.489+0000 7f9ddb7dc740 1 Processor -- start 2024-08-19T00:16:26.498 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.489+0000 7f9ddb7dc740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55577e0c87d0 0x55577e0d0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:26.498 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.489+0000 7f9ddb7dc740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55577e0c90f0 0x55577e0d0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:26.498 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.489+0000 7f9ddb7dc740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55577e0d3990 0x55577e0d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:26.498 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.489+0000 7f9ddb7dc740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55577e0d6560 con 0x55577e0d3990 2024-08-19T00:16:26.498 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.489+0000 7f9ddb7dc740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55577dfe8520 con 0x55577e0c90f0 2024-08-19T00:16:26.498 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.489+0000 7f9ddb7dc740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55577e0d66e0 con 0x55577e0c87d0 2024-08-19T00:16:26.498 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.489+0000 7f9ddb7dc740 10 client.0 _ll_register_callbacks cb 0x55577dd3fa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:16:26.498 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.489+0000 7f9dd2d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55577e0d3990 0x55577e0d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:26.498 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.489+0000 7f9dd2d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55577e0d3990 0x55577e0d12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58058/0 (socket says 172.21.15.44:58058) 2024-08-19T00:16:26.499 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.489+0000 7f9dd2d9d640 1 -- 172.21.15.44:0/440246891 learned_addr learned my addr 172.21.15.44:0/440246891 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:16:26.499 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.489+0000 7f9dd1d9b640 1 --2- 172.21.15.44:0/440246891 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55577e0c90f0 0x55577e0d0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:26.499 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.489+0000 7f9dd259c640 1 --2- 172.21.15.44:0/440246891 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55577e0c87d0 0x55577e0d0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:26.499 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.489+0000 7f9dd2d9d640 1 -- 172.21.15.44:0/440246891 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55577e0c87d0 msgr2=0x55577e0d0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:16:26.499 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.489+0000 7f9dd2d9d640 1 --2- 172.21.15.44:0/440246891 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55577e0c87d0 0x55577e0d0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:26.499 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.489+0000 7f9dd2d9d640 1 -- 172.21.15.44:0/440246891 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55577e0c90f0 msgr2=0x55577e0d0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:16:26.499 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.489+0000 7f9dd2d9d640 1 --2- 172.21.15.44:0/440246891 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55577e0c90f0 0x55577e0d0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:26.499 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.489+0000 7f9dd2d9d640 1 -- 172.21.15.44:0/440246891 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55577de0c620 con 0x55577e0d3990 2024-08-19T00:16:26.499 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.489+0000 7f9dd259c640 1 --2- 172.21.15.44:0/440246891 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55577e0c87d0 0x55577e0d0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:16:26.499 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.489+0000 7f9dd2d9d640 1 --2- 172.21.15.44:0/440246891 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55577e0d3990 0x55577e0d12f0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc014bf0 tx=0x7f9dcc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2009b3dcb9d87766 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:16:26.499 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.489+0000 7f9db9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:16:26.500 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.490+0000 7f9db9ffb640 1 -- 172.21.15.44:0/440246891 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dcc026070 con 0x55577e0d3990 2024-08-19T00:16:26.500 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.490+0000 7f9db9ffb640 1 -- 172.21.15.44:0/440246891 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f9dcc003b70 con 0x55577e0d3990 2024-08-19T00:16:26.500 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.490+0000 7f9ddb7dc740 1 -- 172.21.15.44:0/440246891 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9dc4005520 con 0x55577e0d3990 2024-08-19T00:16:26.500 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.490+0000 7f9db9ffb640 1 -- 172.21.15.44:0/440246891 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9dcc031050 con 0x55577e0d3990 2024-08-19T00:16:26.500 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.490+0000 7f9ddb7dc740 10 client.15912 fetch_fsmap learned FSMap version 30 2024-08-19T00:16:26.500 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.490+0000 7f9ddb7dc740 1 -- 172.21.15.44:0/440246891 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55577e0e21b0 con 0x55577e0d3990 2024-08-19T00:16:26.500 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.490+0000 7f9db9ffb640 1 -- 172.21.15.44:0/440246891 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9dc4005520 con 0x55577e0d3990 2024-08-19T00:16:26.500 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.490+0000 7f9db9ffb640 1 -- 172.21.15.44:0/440246891 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 30) ==== 8386+0+0 (secure 0 0 0) 0x7f9dcc020450 con 0x55577e0d3990 2024-08-19T00:16:26.500 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.490+0000 7f9ddb7dc740 10 client.15912 fetch_fsmap finished waiting for FSMap version 30 2024-08-19T00:16:26.500 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.490+0000 7f9ddb7dc740 10 client.15912 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:16:26.500 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.490+0000 7f9ddb7dc740 20 client.15912 populate_metadata read hostname 'smithi044' 2024-08-19T00:16:26.500 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.490+0000 7f9ddb7dc740 1 --2- 172.21.15.44:0/440246891 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55577e0e36e0 0x55577e0e5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:26.501 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.490+0000 7f9ddb7dc740 4 client.15912 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:16:26.501 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.490+0000 7f9ddb7dc740 1 -- 172.21.15.44:0/440246891 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55577e03a100 con 0x55577e0e36e0 2024-08-19T00:16:26.501 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.491+0000 7f9dd259c640 1 --2- 172.21.15.44:0/440246891 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55577e0e36e0 0x55577e0e5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:26.501 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.491+0000 7f9dd259c640 1 --2- 172.21.15.44:0/440246891 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55577e0e36e0 0x55577e0e5b70 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ee4a617af181558 server_cookie=cf585b68a6544ae1 in_seq=0 out_seq=0 2024-08-19T00:16:26.501 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.491+0000 7f9db9ffb640 10 client.15912 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:16:26.501 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.492+0000 7f9db9ffb640 1 -- 172.21.15.44:0/440246891 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55577e03a100 con 0x55577e0e36e0 2024-08-19T00:16:26.501 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.492+0000 7f9db9ffb640 10 client.15912 handle_command_reply: tid=0 2024-08-19T00:16:26.501 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.492+0000 7f9ddb7dc740 1 client.15912 shutdown 2024-08-19T00:16:26.501 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.492+0000 7f9ddb7dc740 1 -- 172.21.15.44:0/440246891 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55577e0d3990 msgr2=0x55577e0d12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:26.501 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.492+0000 7f9ddb7dc740 1 --2- 172.21.15.44:0/440246891 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55577e0d3990 0x55577e0d12f0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc014bf0 tx=0x7f9dcc004a40 comp rx=0 tx=0).stop 2024-08-19T00:16:26.501 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.492+0000 7f9ddb7dc740 1 -- 172.21.15.44:0/440246891 shutdown_connections 2024-08-19T00:16:26.501 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.492+0000 7f9ddb7dc740 1 --2- 172.21.15.44:0/440246891 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55577e0e36e0 0x55577e0e5b70 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:26.501 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.492+0000 7f9ddb7dc740 1 --2- 172.21.15.44:0/440246891 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55577e0d3990 0x55577e0d12f0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:26.502 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.492+0000 7f9ddb7dc740 1 --2- 172.21.15.44:0/440246891 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55577e0c90f0 0x55577e0d0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:26.502 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.492+0000 7f9db9ffb640 0 client.15912 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:16:26.502 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.492+0000 7f9ddb7dc740 1 --2- 172.21.15.44:0/440246891 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55577e0c87d0 0x55577e0d0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:26.502 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.492+0000 7f9ddb7dc740 1 -- 172.21.15.44:0/440246891 >> 172.21.15.44:0/440246891 conn(0x55577e0c4d40 msgr2=0x55577e0caaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:16:26.502 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.492+0000 7f9ddb7dc740 1 -- 172.21.15.44:0/440246891 shutdown_connections 2024-08-19T00:16:26.502 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.492+0000 7f9ddb7dc740 1 -- 172.21.15.44:0/440246891 wait complete. 2024-08-19T00:16:26.502 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.492+0000 7f9ddb7dc740 20 client.15912 trim_cache size 0 max 16384 2024-08-19T00:16:26.510 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.507+0000 7f9ddb7dc740 1 Processor -- start 2024-08-19T00:16:26.510 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.507+0000 7f9ddb7dc740 1 -- start start 2024-08-19T00:16:26.510 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.507+0000 7f9ddb7dc740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55577e0c87d0 0x55577e0cb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:26.510 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.507+0000 7f9ddb7dc740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55577e0c90f0 0x55577e0eb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:26.510 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.507+0000 7f9ddb7dc740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55577e0d3990 0x55577e0eb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:26.510 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.507+0000 7f9ddb7dc740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd41aecb0 con 0x55577e0d3990 2024-08-19T00:16:26.510 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.507+0000 7f9ddb7dc740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd41b08b0 con 0x55577e0c87d0 2024-08-19T00:16:26.511 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.507+0000 7f9ddb7dc740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd41af380 con 0x55577e0c90f0 2024-08-19T00:16:26.511 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.507+0000 7f9dd2d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55577e0d3990 0x55577e0eb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:26.511 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.507+0000 7f9dd2d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55577e0d3990 0x55577e0eb9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58064/0 (socket says 172.21.15.44:58064) 2024-08-19T00:16:26.511 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.507+0000 7f9dd2d9d640 1 -- 172.21.15.44:0/2402967154 learned_addr learned my addr 172.21.15.44:0/2402967154 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:16:26.511 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.507+0000 7f9dd259c640 1 --2- 172.21.15.44:0/2402967154 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55577e0c87d0 0x55577e0cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:26.511 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.508+0000 7f9dd2d9d640 1 -- 172.21.15.44:0/2402967154 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55577e0c90f0 msgr2=0x55577e0eb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:16:26.511 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.508+0000 7f9dd2d9d640 1 --2- 172.21.15.44:0/2402967154 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55577e0c90f0 0x55577e0eb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:26.511 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.508+0000 7f9dd2d9d640 1 -- 172.21.15.44:0/2402967154 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55577e0c87d0 msgr2=0x55577e0cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:16:26.511 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.508+0000 7f9dd2d9d640 1 --2- 172.21.15.44:0/2402967154 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55577e0c87d0 0x55577e0cb290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:26.511 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.508+0000 7f9dd2d9d640 1 -- 172.21.15.44:0/2402967154 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55577e0e61f0 con 0x55577e0d3990 2024-08-19T00:16:26.511 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.508+0000 7f9dd2d9d640 1 --2- 172.21.15.44:0/2402967154 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55577e0d3990 0x55577e0eb9c0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc011cb0 tx=0x7f9dcc00aae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f3fa9b33c4067c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:16:26.511 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.508+0000 7f9dbbfff640 1 -- 172.21.15.44:0/2402967154 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dcc03a070 con 0x55577e0d3990 2024-08-19T00:16:26.512 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.508+0000 7f9dbbfff640 1 -- 172.21.15.44:0/2402967154 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9dcc020450 con 0x55577e0d3990 2024-08-19T00:16:26.512 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.508+0000 7f9dbbfff640 1 -- 172.21.15.44:0/2402967154 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dcc026040 con 0x55577e0d3990 2024-08-19T00:16:26.512 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.508+0000 7f9ddb7dc740 1 -- 172.21.15.44:0/2402967154 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55577e0d3990 msgr2=0x55577e0eb9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:26.512 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.508+0000 7f9ddb7dc740 1 --2- 172.21.15.44:0/2402967154 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55577e0d3990 0x55577e0eb9c0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc011cb0 tx=0x7f9dcc00aae0 comp rx=0 tx=0).stop 2024-08-19T00:16:26.512 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.508+0000 7f9ddb7dc740 1 -- 172.21.15.44:0/2402967154 shutdown_connections 2024-08-19T00:16:26.512 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.508+0000 7f9ddb7dc740 1 --2- 172.21.15.44:0/2402967154 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55577e0c90f0 0x55577e0eb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:26.512 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.508+0000 7f9ddb7dc740 1 --2- 172.21.15.44:0/2402967154 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55577e0d3990 0x55577e0eb9c0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:26.512 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.508+0000 7f9ddb7dc740 1 --2- 172.21.15.44:0/2402967154 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55577e0c87d0 0x55577e0cb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:26.512 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.508+0000 7f9ddb7dc740 1 -- 172.21.15.44:0/2402967154 >> 172.21.15.44:0/2402967154 conn(0x55577e0c4d40 msgr2=0x55577e0cf940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:16:26.512 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.508+0000 7f9ddb7dc740 1 -- 172.21.15.44:0/2402967154 shutdown_connections 2024-08-19T00:16:26.512 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.509+0000 7f9ddb7dc740 1 -- 172.21.15.44:0/2402967154 wait complete. 2024-08-19T00:16:26.512 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.509+0000 7f9ddb7dc740 1 -- start start 2024-08-19T00:16:26.512 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.509+0000 7f9ddb7dc740 1 Processor -- start 2024-08-19T00:16:26.515 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.509+0000 7f9ddb7dc740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55577e0c87d0 0x55577e0dc010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:26.515 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.509+0000 7f9ddb7dc740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55577e0c90f0 0x55577e0d7380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:26.515 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.509+0000 7f9ddb7dc740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55577e0d3990 0x55577e0d78c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:26.515 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.509+0000 7f9ddb7dc740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd41b0120 con 0x55577e0c87d0 2024-08-19T00:16:26.515 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.509+0000 7f9ddb7dc740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd41afa50 con 0x55577e0d3990 2024-08-19T00:16:26.515 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.509+0000 7f9ddb7dc740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd41acc90 con 0x55577e0c90f0 2024-08-19T00:16:26.515 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.509+0000 7f9ddb7dc740 10 client.0 _ll_register_callbacks cb 0x7f9dcc0148b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:16:26.515 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.509+0000 7f9dd259c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55577e0c87d0 0x55577e0dc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:26.516 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.509+0000 7f9dd259c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55577e0c87d0 0x55577e0dc010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58078/0 (socket says 172.21.15.44:58078) 2024-08-19T00:16:26.516 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.509+0000 7f9dd259c640 1 -- 172.21.15.44:0/142160852 learned_addr learned my addr 172.21.15.44:0/142160852 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:16:26.516 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.509+0000 7f9dd1d9b640 1 --2- 172.21.15.44:0/142160852 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55577e0c90f0 0x55577e0d7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:26.516 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.509+0000 7f9dd2d9d640 1 --2- 172.21.15.44:0/142160852 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55577e0d3990 0x55577e0d78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:26.516 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.509+0000 7f9dd259c640 1 -- 172.21.15.44:0/142160852 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55577e0c90f0 msgr2=0x55577e0d7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:16:26.516 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.509+0000 7f9dd259c640 1 --2- 172.21.15.44:0/142160852 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55577e0c90f0 0x55577e0d7380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:26.516 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.509+0000 7f9dd259c640 1 -- 172.21.15.44:0/142160852 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55577e0d3990 msgr2=0x55577e0d78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:16:26.516 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.509+0000 7f9dd259c640 1 --2- 172.21.15.44:0/142160852 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55577e0d3990 0x55577e0d78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:26.516 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.510+0000 7f9dd259c640 1 -- 172.21.15.44:0/142160852 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55577e0c4b70 con 0x55577e0c87d0 2024-08-19T00:16:26.516 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.510+0000 7f9dd259c640 1 --2- 172.21.15.44:0/142160852 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55577e0c87d0 0x55577e0dc010 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4031550 tx=0x7f9dc4004d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38ceb5e232d6877 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:16:26.516 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.510+0000 7f9db9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:16:26.516 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.510+0000 7f9db9ffb640 1 -- 172.21.15.44:0/142160852 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc4035040 con 0x55577e0c87d0 2024-08-19T00:16:26.516 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.510+0000 7f9ddb7dc740 1 -- 172.21.15.44:0/142160852 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9dcc020450 con 0x55577e0c87d0 2024-08-19T00:16:26.517 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.510+0000 7f9db9ffb640 1 -- 172.21.15.44:0/142160852 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f9dc4004ad0 con 0x55577e0c87d0 2024-08-19T00:16:26.517 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.510+0000 7f9db9ffb640 1 -- 172.21.15.44:0/142160852 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9dc405c050 con 0x55577e0c87d0 2024-08-19T00:16:26.517 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.510+0000 7f9ddb7dc740 10 client.15918 fetch_fsmap learned FSMap version 30 2024-08-19T00:16:26.517 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.510+0000 7f9ddb7dc740 1 -- 172.21.15.44:0/142160852 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55577e14e250 con 0x55577e0c87d0 2024-08-19T00:16:26.517 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.510+0000 7f9db9ffb640 1 -- 172.21.15.44:0/142160852 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9dcc020450 con 0x55577e0c87d0 2024-08-19T00:16:26.517 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.510+0000 7f9db9ffb640 1 -- 172.21.15.44:0/142160852 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 30) ==== 8386+0+0 (secure 0 0 0) 0x7f9dc40317e0 con 0x55577e0c87d0 2024-08-19T00:16:26.517 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.510+0000 7f9ddb7dc740 10 client.15918 fetch_fsmap finished waiting for FSMap version 30 2024-08-19T00:16:26.517 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.510+0000 7f9ddb7dc740 10 client.15918 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:16:26.517 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.510+0000 7f9ddb7dc740 20 client.15918 populate_metadata read hostname 'smithi044' 2024-08-19T00:16:26.517 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.510+0000 7f9ddb7dc740 1 --2- 172.21.15.44:0/142160852 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55577e14e6a0 0x55577e150a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:26.518 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.511+0000 7f9ddb7dc740 4 client.15918 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-19T00:16:26.518 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.511+0000 7f9ddb7dc740 1 -- 172.21.15.44:0/142160852 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55577e034450 con 0x55577e14e6a0 2024-08-19T00:16:26.518 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.511+0000 7f9dd1d9b640 1 --2- 172.21.15.44:0/142160852 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55577e14e6a0 0x55577e150a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:26.518 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.511+0000 7f9dd1d9b640 1 --2- 172.21.15.44:0/142160852 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55577e14e6a0 0x55577e150a90 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1aea4263a7dea14 server_cookie=67455eb2d9846945 in_seq=0 out_seq=0 2024-08-19T00:16:26.518 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.511+0000 7f9db9ffb640 10 client.15918 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:16:26.521 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.519+0000 7f9db9ffb640 1 -- 172.21.15.44:0/142160852 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55577e034450 con 0x55577e14e6a0 2024-08-19T00:16:26.521 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.519+0000 7f9db9ffb640 10 client.15918 handle_command_reply: tid=0 2024-08-19T00:16:26.521 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.519+0000 7f9ddb7dc740 1 client.15918 shutdown 2024-08-19T00:16:26.521 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.519+0000 7f9ddb7dc740 1 -- 172.21.15.44:0/142160852 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55577e0c87d0 msgr2=0x55577e0dc010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:26.521 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.519+0000 7f9ddb7dc740 1 --2- 172.21.15.44:0/142160852 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55577e0c87d0 0x55577e0dc010 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4031550 tx=0x7f9dc4004d90 comp rx=0 tx=0).stop 2024-08-19T00:16:26.521 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.519+0000 7f9ddb7dc740 1 -- 172.21.15.44:0/142160852 shutdown_connections 2024-08-19T00:16:26.521 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.519+0000 7f9ddb7dc740 1 --2- 172.21.15.44:0/142160852 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55577e14e6a0 0x55577e150a90 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:26.521 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.519+0000 7f9ddb7dc740 1 --2- 172.21.15.44:0/142160852 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55577e0c90f0 0x55577e0d7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:26.522 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.519+0000 7f9ddb7dc740 1 --2- 172.21.15.44:0/142160852 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55577e0d3990 0x55577e0d78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:26.522 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.519+0000 7f9db9ffb640 0 client.15918 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:16:26.522 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.519+0000 7f9ddb7dc740 1 --2- 172.21.15.44:0/142160852 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55577e0c87d0 0x55577e0dc010 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:26.522 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.519+0000 7f9ddb7dc740 1 -- 172.21.15.44:0/142160852 >> 172.21.15.44:0/142160852 conn(0x55577e0c4d40 msgr2=0x55577e0c3680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:16:26.522 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.519+0000 7f9ddb7dc740 1 -- 172.21.15.44:0/142160852 shutdown_connections 2024-08-19T00:16:26.522 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.519+0000 7f9ddb7dc740 1 -- 172.21.15.44:0/142160852 wait complete. 2024-08-19T00:16:26.522 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.519+0000 7f9ddb7dc740 20 client.15918 trim_cache size 0 max 16384 2024-08-19T00:16:26.523 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:{ 2024-08-19T00:16:26.523 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "message": "", 2024-08-19T00:16:26.523 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "return_code": 0 2024-08-19T00:16:26.523 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:} 2024-08-19T00:16:26.523 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.520+0000 7f9dd8944640 1 -- 172.21.15.44:0/2093896471 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f9dbc0a2da0 msgr2=0x7f9dbc0a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:26.524 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.520+0000 7f9dd8944640 1 --2- 172.21.15.44:0/2093896471 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f9dbc0a2da0 0x7f9dbc0a5260 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc00a780 tx=0x7f9dcc00a4d0 comp rx=0 tx=0).stop 2024-08-19T00:16:26.524 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.520+0000 7f9dd8944640 1 -- 172.21.15.44:0/2093896471 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9dd41010a0 msgr2=0x7f9dd4198640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:26.524 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.520+0000 7f9dd8944640 1 --2- 172.21.15.44:0/2093896471 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9dd41010a0 0x7f9dd4198640 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f9dc800d950 tx=0x7f9dc800de10 comp rx=0 tx=0).stop 2024-08-19T00:16:26.524 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.520+0000 7f9dd8944640 1 -- 172.21.15.44:0/2093896471 shutdown_connections 2024-08-19T00:16:26.524 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.520+0000 7f9dd8944640 1 --2- 172.21.15.44:0/2093896471 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f9dbc0a2da0 0x7f9dbc0a5260 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:26.524 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.520+0000 7f9dd8944640 1 --2- 172.21.15.44:0/2093896471 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9dd4106710 0x7f9dd419c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:26.524 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.520+0000 7f9dd8944640 1 --2- 172.21.15.44:0/2093896471 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9dd41010a0 0x7f9dd4198640 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:26.524 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.520+0000 7f9dd8944640 1 --2- 172.21.15.44:0/2093896471 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9dd4100700 0x7f9dd4198100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:26.524 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.520+0000 7f9dd8944640 1 -- 172.21.15.44:0/2093896471 >> 172.21.15.44:0/2093896471 conn(0x7f9dd40fc420 msgr2=0x7f9dd406a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:16:26.524 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.520+0000 7f9dd8944640 1 -- 172.21.15.44:0/2093896471 shutdown_connections 2024-08-19T00:16:26.524 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:26.520+0000 7f9dd8944640 1 -- 172.21.15.44:0/2093896471 wait complete. 2024-08-19T00:16:26.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:16:26 smithi171 ceph-mon[21810]: pgmap v96: 129 pgs: 129 active+clean; 105 MiB data, 938 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 174 op/s 2024-08-19T00:16:26.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:16:26 smithi116 ceph-mon[21873]: pgmap v96: 129 pgs: 129 active+clean; 105 MiB data, 938 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 174 op/s 2024-08-19T00:16:26.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:16:26 smithi044 ceph-mon[18489]: pgmap v96: 129 pgs: 129 active+clean; 105 MiB data, 938 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 174 op/s 2024-08-19T00:16:26.667 INFO:tasks.workunit.client.0.smithi044.stdout: 1 166186 8.23 MB/sec warmup 111 sec latency 10809.775 ms 2024-08-19T00:16:27.668 INFO:tasks.workunit.client.0.smithi044.stdout: 1 166186 8.15 MB/sec warmup 112 sec latency 11809.864 ms 2024-08-19T00:16:28.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:16:28 smithi171 ceph-mon[21810]: pgmap v97: 129 pgs: 129 active+clean; 105 MiB data, 938 MiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 262 KiB/s wr, 41 op/s 2024-08-19T00:16:28.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:16:28 smithi116 ceph-mon[21873]: pgmap v97: 129 pgs: 129 active+clean; 105 MiB data, 938 MiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 262 KiB/s wr, 41 op/s 2024-08-19T00:16:28.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:16:28 smithi044 ceph-mon[18489]: pgmap v97: 129 pgs: 129 active+clean; 105 MiB data, 938 MiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 262 KiB/s wr, 41 op/s 2024-08-19T00:16:28.668 INFO:tasks.workunit.client.0.smithi044.stdout: 1 166186 8.08 MB/sec warmup 113 sec latency 12809.954 ms 2024-08-19T00:16:29.668 INFO:tasks.workunit.client.0.smithi044.stdout: 1 166186 8.01 MB/sec warmup 114 sec latency 13810.051 ms 2024-08-19T00:16:30.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:16:30 smithi116 ceph-mon[21873]: pgmap v98: 129 pgs: 129 active+clean; 105 MiB data, 938 MiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 262 KiB/s wr, 41 op/s 2024-08-19T00:16:30.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:16:30 smithi044 ceph-mon[18489]: pgmap v98: 129 pgs: 129 active+clean; 105 MiB data, 938 MiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 262 KiB/s wr, 41 op/s 2024-08-19T00:16:30.668 INFO:tasks.workunit.client.0.smithi044.stdout: 1 166186 7.94 MB/sec warmup 115 sec latency 14810.115 ms 2024-08-19T00:16:30.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:16:30 smithi171 ceph-mon[21810]: pgmap v98: 129 pgs: 129 active+clean; 105 MiB data, 938 MiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 262 KiB/s wr, 41 op/s 2024-08-19T00:16:31.668 INFO:tasks.workunit.client.0.smithi044.stdout: 1 166186 7.87 MB/sec warmup 116 sec latency 15810.221 ms 2024-08-19T00:16:32.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:16:32 smithi116 ceph-mon[21873]: pgmap v99: 129 pgs: 129 active+clean; 120 MiB data, 1019 MiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 3.9 MiB/s wr, 155 op/s 2024-08-19T00:16:32.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:16:32 smithi044 ceph-mon[18489]: pgmap v99: 129 pgs: 129 active+clean; 120 MiB data, 1019 MiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 3.9 MiB/s wr, 155 op/s 2024-08-19T00:16:32.668 INFO:tasks.workunit.client.0.smithi044.stdout: 1 166186 7.80 MB/sec warmup 117 sec latency 16810.336 ms 2024-08-19T00:16:32.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:16:32 smithi171 ceph-mon[21810]: pgmap v99: 129 pgs: 129 active+clean; 120 MiB data, 1019 MiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 3.9 MiB/s wr, 155 op/s 2024-08-19T00:16:33.668 INFO:tasks.workunit.client.0.smithi044.stdout: 1 166186 7.74 MB/sec warmup 118 sec latency 17810.445 ms 2024-08-19T00:16:34.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:16:34 smithi116 ceph-mon[21873]: pgmap v100: 129 pgs: 129 active+clean; 120 MiB data, 1019 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 3.7 MiB/s wr, 121 op/s 2024-08-19T00:16:34.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:16:34 smithi044 ceph-mon[18489]: pgmap v100: 129 pgs: 129 active+clean; 120 MiB data, 1019 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 3.7 MiB/s wr, 121 op/s 2024-08-19T00:16:34.668 INFO:tasks.workunit.client.0.smithi044.stdout: 1 166186 7.67 MB/sec warmup 119 sec latency 18810.557 ms 2024-08-19T00:16:34.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:16:34 smithi171 ceph-mon[21810]: pgmap v100: 129 pgs: 129 active+clean; 120 MiB data, 1019 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 3.7 MiB/s wr, 121 op/s 2024-08-19T00:16:36.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:16:36 smithi116 ceph-mon[21873]: pgmap v101: 129 pgs: 129 active+clean; 102 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 3.7 MiB/s wr, 148 op/s 2024-08-19T00:16:36.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:16:36 smithi044 ceph-mon[18489]: pgmap v101: 129 pgs: 129 active+clean; 102 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 3.7 MiB/s wr, 148 op/s 2024-08-19T00:16:36.668 INFO:tasks.workunit.client.0.smithi044.stdout: 1 166186 0.00 MB/sec execute 1 sec latency 20810.705 ms 2024-08-19T00:16:36.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:16:36 smithi171 ceph-mon[21810]: pgmap v101: 129 pgs: 129 active+clean; 102 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 3.7 MiB/s wr, 148 op/s 2024-08-19T00:16:37.669 INFO:tasks.workunit.client.0.smithi044.stdout: 1 166186 0.00 MB/sec execute 2 sec latency 21810.815 ms 2024-08-19T00:16:38.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:16:38 smithi116 ceph-mon[21873]: pgmap v102: 129 pgs: 129 active+clean; 102 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 3.7 MiB/s wr, 141 op/s 2024-08-19T00:16:38.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:16:38 smithi044 ceph-mon[18489]: pgmap v102: 129 pgs: 129 active+clean; 102 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 3.7 MiB/s wr, 141 op/s 2024-08-19T00:16:38.669 INFO:tasks.workunit.client.0.smithi044.stdout: 1 166186 0.00 MB/sec execute 3 sec latency 22810.913 ms 2024-08-19T00:16:38.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:16:38 smithi171 ceph-mon[21810]: pgmap v102: 129 pgs: 129 active+clean; 102 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 3.7 MiB/s wr, 141 op/s 2024-08-19T00:16:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.620+0000 7fc505830640 1 -- 172.21.15.44:0/1485378014 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5001017f0 msgr2=0x7fc500101c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.620+0000 7fc505830640 1 --2- 172.21.15.44:0/1485378014 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5001017f0 0x7fc500101c50 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fc4f4009930 tx=0x7fc4f402a420 comp rx=0 tx=0).stop 2024-08-19T00:16:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.620+0000 7fc505830640 1 -- 172.21.15.44:0/1485378014 shutdown_connections 2024-08-19T00:16:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.620+0000 7fc505830640 1 --2- 172.21.15.44:0/1485378014 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc500102190 0x7fc50010e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.620+0000 7fc505830640 1 --2- 172.21.15.44:0/1485378014 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5001017f0 0x7fc500101c50 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.620+0000 7fc505830640 1 --2- 172.21.15.44:0/1485378014 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc500107800 0x7fc500107be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.620+0000 7fc505830640 1 -- 172.21.15.44:0/1485378014 >> 172.21.15.44:0/1485378014 conn(0x7fc5000fd550 msgr2=0x7fc5000ff970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:16:39.623 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.620+0000 7fc505830640 1 -- 172.21.15.44:0/1485378014 shutdown_connections 2024-08-19T00:16:39.623 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.620+0000 7fc505830640 1 -- 172.21.15.44:0/1485378014 wait complete. 2024-08-19T00:16:39.623 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.621+0000 7fc505830640 1 Processor -- start 2024-08-19T00:16:39.625 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.621+0000 7fc505830640 1 -- start start 2024-08-19T00:16:39.625 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.621+0000 7fc505830640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc5001017f0 0x7fc5001980c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:39.625 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.621+0000 7fc505830640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc500102190 0x7fc500198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:39.625 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.621+0000 7fc505830640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc500107800 0x7fc50019c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:39.625 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.621+0000 7fc505830640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc500111c90 con 0x7fc500107800 2024-08-19T00:16:39.625 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.621+0000 7fc505830640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fc500111b10 con 0x7fc500102190 2024-08-19T00:16:39.625 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.621+0000 7fc505830640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc500111e10 con 0x7fc5001017f0 2024-08-19T00:16:39.626 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.621+0000 7fc4ff7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc500107800 0x7fc50019c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:39.626 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.621+0000 7fc4feffd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc5001017f0 0x7fc5001980c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:39.626 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.621+0000 7fc4feffd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc5001017f0 0x7fc5001980c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.44:32800/0 (socket says 172.21.15.44:32800) 2024-08-19T00:16:39.626 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.621+0000 7fc4ff7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc500107800 0x7fc50019c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38672/0 (socket says 172.21.15.44:38672) 2024-08-19T00:16:39.626 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.621+0000 7fc4feffd640 1 -- 172.21.15.44:0/3377590412 learned_addr learned my addr 172.21.15.44:0/3377590412 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:16:39.626 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.621+0000 7fc4fe7fc640 1 --2- 172.21.15.44:0/3377590412 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc500102190 0x7fc500198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:39.626 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.622+0000 7fc4ff7fe640 1 -- 172.21.15.44:0/3377590412 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc5001017f0 msgr2=0x7fc5001980c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:39.626 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.622+0000 7fc4ff7fe640 1 --2- 172.21.15.44:0/3377590412 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc5001017f0 0x7fc5001980c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:39.626 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.622+0000 7fc4ff7fe640 1 -- 172.21.15.44:0/3377590412 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc500102190 msgr2=0x7fc500198600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:39.626 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.622+0000 7fc4ff7fe640 1 --2- 172.21.15.44:0/3377590412 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc500102190 0x7fc500198600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:39.626 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.622+0000 7fc4ff7fe640 1 -- 172.21.15.44:0/3377590412 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc50019d0b0 con 0x7fc500107800 2024-08-19T00:16:39.626 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.622+0000 7fc4ff7fe640 1 --2- 172.21.15.44:0/3377590412 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc500107800 0x7fc50019c980 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fc4f800cab0 tx=0x7fc4f800cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:16:39.627 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.622+0000 7fc50482e640 1 -- 172.21.15.44:0/3377590412 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4f800ae20 con 0x7fc500107800 2024-08-19T00:16:39.627 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.622+0000 7fc505830640 1 -- 172.21.15.44:0/3377590412 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc50019d3a0 con 0x7fc500107800 2024-08-19T00:16:39.627 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.622+0000 7fc50482e640 1 -- 172.21.15.44:0/3377590412 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4f800f930 con 0x7fc500107800 2024-08-19T00:16:39.627 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.622+0000 7fc50482e640 1 -- 172.21.15.44:0/3377590412 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4f8018b30 con 0x7fc500107800 2024-08-19T00:16:39.627 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.622+0000 7fc505830640 1 -- 172.21.15.44:0/3377590412 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5001a4c30 con 0x7fc500107800 2024-08-19T00:16:39.633 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.625+0000 7fc50482e640 1 -- 172.21.15.44:0/3377590412 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fc4f800fae0 con 0x7fc500107800 2024-08-19T00:16:39.633 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.625+0000 7fc5085e9740 1 Processor -- start 2024-08-19T00:16:39.633 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.625+0000 7fc5085e9740 1 -- start start 2024-08-19T00:16:39.633 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.625+0000 7fc5085e9740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5588ae5007d0 0x5588ae500bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:39.633 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.625+0000 7fc5085e9740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5588ae5010f0 0x5588ae50b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:39.634 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.625+0000 7fc5085e9740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5588ae50b990 0x5588ae50dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:39.634 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.625+0000 7fc5085e9740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5588ae4649d0 con 0x5588ae5007d0 2024-08-19T00:16:39.634 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.625+0000 7fc5085e9740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5588ae40c820 con 0x5588ae50b990 2024-08-19T00:16:39.634 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.625+0000 7fc5085e9740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5588ae460990 con 0x5588ae5010f0 2024-08-19T00:16:39.634 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.625+0000 7fc4fe7fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5588ae5007d0 0x5588ae500bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:39.634 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.625+0000 7fc4fe7fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5588ae5007d0 0x5588ae500bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38680/0 (socket says 172.21.15.44:38680) 2024-08-19T00:16:39.634 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.625+0000 7fc4fe7fc640 1 -- 172.21.15.44:0/87105465 learned_addr learned my addr 172.21.15.44:0/87105465 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:16:39.634 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.625+0000 7fc50482e640 1 --2- 172.21.15.44:0/3377590412 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fc4e80a2da0 0x7fc4e80a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:39.634 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.625+0000 7fc4fe7fc640 1 --2- 172.21.15.44:0/87105465 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5588ae50b990 0x5588ae50dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:39.634 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.625+0000 7fc4feffd640 1 --2- 172.21.15.44:0/87105465 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5588ae5010f0 0x5588ae50b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:39.634 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.625+0000 7fc4fe7fc640 1 -- 172.21.15.44:0/87105465 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5588ae5010f0 msgr2=0x5588ae50b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:16:39.635 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.626+0000 7fc4fe7fc640 1 --2- 172.21.15.44:0/87105465 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5588ae5010f0 0x5588ae50b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:39.635 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.626+0000 7fc4fe7fc640 1 -- 172.21.15.44:0/87105465 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5588ae50b990 msgr2=0x5588ae50dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:16:39.635 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.626+0000 7fc4fe7fc640 1 --2- 172.21.15.44:0/87105465 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5588ae50b990 0x5588ae50dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:39.635 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.626+0000 7fc4fe7fc640 1 -- 172.21.15.44:0/87105465 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588ae178210 con 0x5588ae5007d0 2024-08-19T00:16:39.635 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.626+0000 7fc4ff7fe640 1 --2- 172.21.15.44:0/3377590412 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fc4e80a2da0 0x7fc4e80a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:39.635 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.626+0000 7fc50482e640 1 -- 172.21.15.44:0/3377590412 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7fc4f80cfed0 con 0x7fc500107800 2024-08-19T00:16:39.635 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.626+0000 7fc4fe7fc640 1 --2- 172.21.15.44:0/87105465 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5588ae5007d0 0x5588ae500bb0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fc4f40096c0 tx=0x7fc4f4009610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d0afd8004e833a1 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:16:39.635 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.626+0000 7fc4e5ffb640 1 -- 172.21.15.44:0/87105465 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4f4044020 con 0x5588ae5007d0 2024-08-19T00:16:39.635 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.626+0000 7fc4e5ffb640 1 -- 172.21.15.44:0/87105465 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4f4004700 con 0x5588ae5007d0 2024-08-19T00:16:39.635 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.626+0000 7fc4e5ffb640 1 -- 172.21.15.44:0/87105465 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4f4035040 con 0x5588ae5007d0 2024-08-19T00:16:39.635 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.627+0000 7fc5085e9740 1 -- 172.21.15.44:0/87105465 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5588ae5007d0 msgr2=0x5588ae500bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:39.635 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.627+0000 7fc5085e9740 1 --2- 172.21.15.44:0/87105465 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5588ae5007d0 0x5588ae500bb0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fc4f40096c0 tx=0x7fc4f4009610 comp rx=0 tx=0).stop 2024-08-19T00:16:39.635 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.627+0000 7fc4ff7fe640 1 --2- 172.21.15.44:0/3377590412 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fc4e80a2da0 0x7fc4e80a5260 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc4f80cd330 tx=0x7fc4f8067120 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:16:39.636 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.627+0000 7fc5085e9740 1 -- 172.21.15.44:0/87105465 shutdown_connections 2024-08-19T00:16:39.636 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.627+0000 7fc5085e9740 1 --2- 172.21.15.44:0/87105465 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5588ae5010f0 0x5588ae50b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:39.636 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.627+0000 7fc5085e9740 1 --2- 172.21.15.44:0/87105465 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5588ae50b990 0x5588ae50dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:39.636 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.627+0000 7fc5085e9740 1 --2- 172.21.15.44:0/87105465 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5588ae5007d0 0x5588ae500bb0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:39.636 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.627+0000 7fc5085e9740 1 -- 172.21.15.44:0/87105465 >> 172.21.15.44:0/87105465 conn(0x5588ae4fcd40 msgr2=0x5588ae4fd120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:16:39.636 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.627+0000 7fc5085e9740 1 -- 172.21.15.44:0/87105465 shutdown_connections 2024-08-19T00:16:39.636 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.627+0000 7fc5085e9740 1 -- 172.21.15.44:0/87105465 wait complete. 2024-08-19T00:16:39.636 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.627+0000 7fc5085e9740 1 -- start start 2024-08-19T00:16:39.636 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.627+0000 7fc5085e9740 1 Processor -- start 2024-08-19T00:16:39.636 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.628+0000 7fc5085e9740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5588ae5007d0 0x5588ae508850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:39.636 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.628+0000 7fc5085e9740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5588ae5010f0 0x5588ae508d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:39.636 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.628+0000 7fc5085e9740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5588ae50b990 0x5588ae5092d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:39.636 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.628+0000 7fc5085e9740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5588ae50e560 con 0x5588ae5010f0 2024-08-19T00:16:39.637 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.628+0000 7fc5085e9740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5588ae420520 con 0x5588ae50b990 2024-08-19T00:16:39.637 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.628+0000 7fc5085e9740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5588ae50e6e0 con 0x5588ae5007d0 2024-08-19T00:16:39.637 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.628+0000 7fc5085e9740 10 client.0 _ll_register_callbacks cb 0x5588ae177a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:16:39.637 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.628+0000 7fc4feffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5588ae5010f0 0x5588ae508d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:39.637 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.628+0000 7fc4feffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5588ae5010f0 0x5588ae508d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38690/0 (socket says 172.21.15.44:38690) 2024-08-19T00:16:39.637 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.628+0000 7fc4feffd640 1 -- 172.21.15.44:0/3033624002 learned_addr learned my addr 172.21.15.44:0/3033624002 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:16:39.637 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.628+0000 7fc4feffd640 1 -- 172.21.15.44:0/3033624002 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5588ae5007d0 msgr2=0x5588ae508850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:16:39.637 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.628+0000 7fc4feffd640 1 --2- 172.21.15.44:0/3033624002 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5588ae5007d0 0x5588ae508850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:39.637 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.628+0000 7fc4feffd640 1 -- 172.21.15.44:0/3033624002 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5588ae50b990 msgr2=0x5588ae5092d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:16:39.637 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.628+0000 7fc4feffd640 1 --2- 172.21.15.44:0/3033624002 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5588ae50b990 0x5588ae5092d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:39.637 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.628+0000 7fc4feffd640 1 -- 172.21.15.44:0/3033624002 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588ae244620 con 0x5588ae5010f0 2024-08-19T00:16:39.637 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.628+0000 7fc4feffd640 1 --2- 172.21.15.44:0/3033624002 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5588ae5010f0 0x5588ae508d90 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fc4f000bfa0 tx=0x7fc4f000bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b4737cf3427693e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:16:39.637 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.628+0000 7fc4deffd640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:16:39.638 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.628+0000 7fc4deffd640 1 -- 172.21.15.44:0/3033624002 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4f001f060 con 0x5588ae5010f0 2024-08-19T00:16:39.638 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.628+0000 7fc4deffd640 1 -- 172.21.15.44:0/3033624002 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7fc4f00035f0 con 0x5588ae5010f0 2024-08-19T00:16:39.638 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.628+0000 7fc5085e9740 1 -- 172.21.15.44:0/3033624002 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4f4004700 con 0x5588ae5010f0 2024-08-19T00:16:39.638 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.629+0000 7fc4deffd640 1 -- 172.21.15.44:0/3033624002 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc4f0026050 con 0x5588ae5010f0 2024-08-19T00:16:39.638 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.629+0000 7fc5085e9740 10 client.15930 fetch_fsmap learned FSMap version 30 2024-08-19T00:16:39.638 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.629+0000 7fc5085e9740 1 -- 172.21.15.44:0/3033624002 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5588ae51a230 con 0x5588ae5010f0 2024-08-19T00:16:39.638 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.629+0000 7fc4deffd640 1 -- 172.21.15.44:0/3033624002 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4f4004700 con 0x5588ae5010f0 2024-08-19T00:16:39.638 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.629+0000 7fc4deffd640 1 -- 172.21.15.44:0/3033624002 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 30) ==== 8386+0+0 (secure 0 0 0) 0x7fc4f0019030 con 0x5588ae5010f0 2024-08-19T00:16:39.638 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.629+0000 7fc5085e9740 10 client.15930 fetch_fsmap finished waiting for FSMap version 30 2024-08-19T00:16:39.638 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.629+0000 7fc5085e9740 10 client.15930 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:16:39.638 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.629+0000 7fc5085e9740 20 client.15930 populate_metadata read hostname 'smithi044' 2024-08-19T00:16:39.638 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.629+0000 7fc5085e9740 1 --2- 172.21.15.44:0/3033624002 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5588ae51b830 0x5588ae51dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:39.638 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.629+0000 7fc5085e9740 4 client.15930 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:16:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.629+0000 7fc5085e9740 1 -- 172.21.15.44:0/3033624002 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5588ae472100 con 0x5588ae51b830 2024-08-19T00:16:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.629+0000 7fc4fe7fc640 1 --2- 172.21.15.44:0/3033624002 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5588ae51b830 0x5588ae51dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.630+0000 7fc4deffd640 10 client.15930 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:16:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.630+0000 7fc4fe7fc640 1 --2- 172.21.15.44:0/3033624002 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5588ae51b830 0x5588ae51dc70 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=404f566030236050 server_cookie=739771d36907e073 in_seq=0 out_seq=0 2024-08-19T00:16:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.630+0000 7fc4deffd640 1 -- 172.21.15.44:0/3033624002 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5588ae472100 con 0x5588ae51b830 2024-08-19T00:16:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.630+0000 7fc4deffd640 10 client.15930 handle_command_reply: tid=0 2024-08-19T00:16:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.630+0000 7fc5085e9740 1 client.15930 shutdown 2024-08-19T00:16:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.631+0000 7fc5085e9740 1 -- 172.21.15.44:0/3033624002 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5588ae5010f0 msgr2=0x5588ae508d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.631+0000 7fc5085e9740 1 --2- 172.21.15.44:0/3033624002 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5588ae5010f0 0x5588ae508d90 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fc4f000bfa0 tx=0x7fc4f000bfd0 comp rx=0 tx=0).stop 2024-08-19T00:16:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.631+0000 7fc5085e9740 1 -- 172.21.15.44:0/3033624002 shutdown_connections 2024-08-19T00:16:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.631+0000 7fc5085e9740 1 --2- 172.21.15.44:0/3033624002 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5588ae51b830 0x5588ae51dc70 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.631+0000 7fc5085e9740 1 --2- 172.21.15.44:0/3033624002 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5588ae50b990 0x5588ae5092d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.631+0000 7fc5085e9740 1 --2- 172.21.15.44:0/3033624002 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5588ae5010f0 0x5588ae508d90 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:39.640 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.631+0000 7fc4deffd640 0 client.15930 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:16:39.640 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.631+0000 7fc5085e9740 1 --2- 172.21.15.44:0/3033624002 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5588ae5007d0 0x5588ae508850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:39.640 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.631+0000 7fc5085e9740 1 -- 172.21.15.44:0/3033624002 >> 172.21.15.44:0/3033624002 conn(0x5588ae4fcd40 msgr2=0x5588ae502aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:16:39.640 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.631+0000 7fc5085e9740 1 -- 172.21.15.44:0/3033624002 shutdown_connections 2024-08-19T00:16:39.640 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.631+0000 7fc5085e9740 1 -- 172.21.15.44:0/3033624002 wait complete. 2024-08-19T00:16:39.640 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.631+0000 7fc5085e9740 20 client.15930 trim_cache size 0 max 16384 2024-08-19T00:16:39.648 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.646+0000 7fc5085e9740 1 Processor -- start 2024-08-19T00:16:39.648 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.646+0000 7fc5085e9740 1 -- start start 2024-08-19T00:16:39.648 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.646+0000 7fc5085e9740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5588ae5007d0 0x5588ae509100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:39.648 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.646+0000 7fc5085e9740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5588ae5010f0 0x5588ae523540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:39.648 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.646+0000 7fc5085e9740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5588ae50b990 0x5588ae523a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:39.648 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.646+0000 7fc5085e9740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc5001aeac0 con 0x5588ae5007d0 2024-08-19T00:16:39.648 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.646+0000 7fc5085e9740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fc5001b06c0 con 0x5588ae5010f0 2024-08-19T00:16:39.648 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.646+0000 7fc5085e9740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc5001af190 con 0x5588ae50b990 2024-08-19T00:16:39.648 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.646+0000 7fc4fe7fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5588ae5007d0 0x5588ae509100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:39.649 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.646+0000 7fc4fe7fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5588ae5007d0 0x5588ae509100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38696/0 (socket says 172.21.15.44:38696) 2024-08-19T00:16:39.649 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.646+0000 7fc4fe7fc640 1 -- 172.21.15.44:0/3065264122 learned_addr learned my addr 172.21.15.44:0/3065264122 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:16:39.649 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.646+0000 7fc4feffd640 1 --2- 172.21.15.44:0/3065264122 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5588ae5010f0 0x5588ae523540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:39.649 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.646+0000 7fc4fe7fc640 1 -- 172.21.15.44:0/3065264122 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5588ae50b990 msgr2=0x5588ae523a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:16:39.649 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.646+0000 7fc4fe7fc640 1 --2- 172.21.15.44:0/3065264122 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5588ae50b990 0x5588ae523a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:39.649 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.646+0000 7fc4fe7fc640 1 -- 172.21.15.44:0/3065264122 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5588ae5010f0 msgr2=0x5588ae523540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:16:39.649 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.646+0000 7fc4fe7fc640 1 --2- 172.21.15.44:0/3065264122 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5588ae5010f0 0x5588ae523540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:39.649 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.646+0000 7fc4fe7fc640 1 -- 172.21.15.44:0/3065264122 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588ae4fcb70 con 0x5588ae5007d0 2024-08-19T00:16:39.649 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.647+0000 7fc4fe7fc640 1 --2- 172.21.15.44:0/3065264122 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5588ae5007d0 0x5588ae509100 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fc4f4009930 tx=0x7fc4f4005a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59ebbd161fe88ed7 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:16:39.649 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.647+0000 7fc4e57fa640 1 -- 172.21.15.44:0/3065264122 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4f4044030 con 0x5588ae5007d0 2024-08-19T00:16:39.649 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.647+0000 7fc4e57fa640 1 -- 172.21.15.44:0/3065264122 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4f40046c0 con 0x5588ae5007d0 2024-08-19T00:16:39.649 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.647+0000 7fc4e57fa640 1 -- 172.21.15.44:0/3065264122 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4f4035040 con 0x5588ae5007d0 2024-08-19T00:16:39.653 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.647+0000 7fc5085e9740 1 -- 172.21.15.44:0/3065264122 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5588ae5007d0 msgr2=0x5588ae509100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:39.653 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.647+0000 7fc5085e9740 1 --2- 172.21.15.44:0/3065264122 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5588ae5007d0 0x5588ae509100 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fc4f4009930 tx=0x7fc4f4005a60 comp rx=0 tx=0).stop 2024-08-19T00:16:39.653 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.647+0000 7fc5085e9740 1 -- 172.21.15.44:0/3065264122 shutdown_connections 2024-08-19T00:16:39.654 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.647+0000 7fc5085e9740 1 --2- 172.21.15.44:0/3065264122 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5588ae50b990 0x5588ae523a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:39.654 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.647+0000 7fc5085e9740 1 --2- 172.21.15.44:0/3065264122 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5588ae5010f0 0x5588ae523540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:39.654 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.647+0000 7fc5085e9740 1 --2- 172.21.15.44:0/3065264122 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5588ae5007d0 0x5588ae509100 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:39.654 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.647+0000 7fc5085e9740 1 -- 172.21.15.44:0/3065264122 >> 172.21.15.44:0/3065264122 conn(0x5588ae4fcd40 msgr2=0x5588ae507960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:16:39.654 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.647+0000 7fc5085e9740 1 -- 172.21.15.44:0/3065264122 shutdown_connections 2024-08-19T00:16:39.654 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.647+0000 7fc5085e9740 1 -- 172.21.15.44:0/3065264122 wait complete. 2024-08-19T00:16:39.654 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.648+0000 7fc5085e9740 1 -- start start 2024-08-19T00:16:39.654 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.648+0000 7fc5085e9740 1 Processor -- start 2024-08-19T00:16:39.654 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.648+0000 7fc5085e9740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5588ae5007d0 0x5588ae513c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:39.654 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.648+0000 7fc5085e9740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5588ae5010f0 0x5588ae514140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:39.654 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.648+0000 7fc5085e9740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5588ae50b990 0x5588ae505100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:39.654 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.648+0000 7fc5085e9740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc5001aff30 con 0x5588ae5010f0 2024-08-19T00:16:39.655 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.648+0000 7fc5085e9740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fc5001af860 con 0x5588ae50b990 2024-08-19T00:16:39.655 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.648+0000 7fc5085e9740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc5001acaa0 con 0x5588ae5007d0 2024-08-19T00:16:39.655 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.648+0000 7fc5085e9740 10 client.0 _ll_register_callbacks cb 0x7fc4f000b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:16:39.655 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.648+0000 7fc4feffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5588ae5010f0 0x5588ae514140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:39.655 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.648+0000 7fc4feffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5588ae5010f0 0x5588ae514140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38706/0 (socket says 172.21.15.44:38706) 2024-08-19T00:16:39.655 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.648+0000 7fc4feffd640 1 -- 172.21.15.44:0/488441683 learned_addr learned my addr 172.21.15.44:0/488441683 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:16:39.655 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.649+0000 7fc4fe7fc640 1 --2- 172.21.15.44:0/488441683 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5588ae50b990 0x5588ae505100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:39.655 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.649+0000 7fc4fe7fc640 1 --2- 172.21.15.44:0/488441683 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5588ae5007d0 0x5588ae513c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:39.655 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.649+0000 7fc4feffd640 1 -- 172.21.15.44:0/488441683 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5588ae5007d0 msgr2=0x5588ae513c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:16:39.655 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.649+0000 7fc4feffd640 1 --2- 172.21.15.44:0/488441683 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5588ae5007d0 0x5588ae513c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:39.655 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.649+0000 7fc4feffd640 1 -- 172.21.15.44:0/488441683 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5588ae50b990 msgr2=0x5588ae505100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:16:39.655 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.649+0000 7fc4feffd640 1 --2- 172.21.15.44:0/488441683 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5588ae50b990 0x5588ae505100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:39.656 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.649+0000 7fc4feffd640 1 -- 172.21.15.44:0/488441683 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588ae505930 con 0x5588ae5010f0 2024-08-19T00:16:39.656 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.649+0000 7fc4fe7fc640 1 --2- 172.21.15.44:0/488441683 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5588ae50b990 0x5588ae505100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:16:39.656 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.649+0000 7fc4feffd640 1 --2- 172.21.15.44:0/488441683 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5588ae5010f0 0x5588ae514140 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fc4f0010c50 tx=0x7fc4f0012eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=876efa9df055a223 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:16:39.656 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.649+0000 7fc4deffd640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:16:39.656 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.649+0000 7fc4deffd640 1 -- 172.21.15.44:0/488441683 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4f0010490 con 0x5588ae5010f0 2024-08-19T00:16:39.656 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.649+0000 7fc4deffd640 1 -- 172.21.15.44:0/488441683 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7fc4f0010630 con 0x5588ae5010f0 2024-08-19T00:16:39.656 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.649+0000 7fc5085e9740 1 -- 172.21.15.44:0/488441683 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4f40046c0 con 0x5588ae5010f0 2024-08-19T00:16:39.656 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.649+0000 7fc4deffd640 1 -- 172.21.15.44:0/488441683 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc4f0038050 con 0x5588ae5010f0 2024-08-19T00:16:39.656 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.649+0000 7fc5085e9740 10 client.15936 fetch_fsmap learned FSMap version 30 2024-08-19T00:16:39.656 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.649+0000 7fc5085e9740 1 -- 172.21.15.44:0/488441683 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5588ae58a470 con 0x5588ae5010f0 2024-08-19T00:16:39.656 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.649+0000 7fc4deffd640 1 -- 172.21.15.44:0/488441683 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4f40046c0 con 0x5588ae5010f0 2024-08-19T00:16:39.656 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.650+0000 7fc4deffd640 1 -- 172.21.15.44:0/488441683 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 30) ==== 8386+0+0 (secure 0 0 0) 0x7fc4f0019040 con 0x5588ae5010f0 2024-08-19T00:16:39.656 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.650+0000 7fc5085e9740 10 client.15936 fetch_fsmap finished waiting for FSMap version 30 2024-08-19T00:16:39.656 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.650+0000 7fc5085e9740 10 client.15936 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:16:39.657 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.650+0000 7fc5085e9740 20 client.15936 populate_metadata read hostname 'smithi044' 2024-08-19T00:16:39.657 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.650+0000 7fc5085e9740 1 --2- 172.21.15.44:0/488441683 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5588ae58abe0 0x5588ae58d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:39.657 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.650+0000 7fc5085e9740 4 client.15936 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-19T00:16:39.657 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.650+0000 7fc5085e9740 1 -- 172.21.15.44:0/488441683 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5588ae46c450 con 0x5588ae58abe0 2024-08-19T00:16:39.657 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.650+0000 7fc4fe7fc640 1 --2- 172.21.15.44:0/488441683 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5588ae58abe0 0x5588ae58d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:39.657 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.650+0000 7fc4deffd640 10 client.15936 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:16:39.657 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.650+0000 7fc4fe7fc640 1 --2- 172.21.15.44:0/488441683 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5588ae58abe0 0x5588ae58d000 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea809810970028f2 server_cookie=cb8adec8e628a260 in_seq=0 out_seq=0 2024-08-19T00:16:39.660 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.659+0000 7fc4deffd640 1 -- 172.21.15.44:0/488441683 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5588ae46c450 con 0x5588ae58abe0 2024-08-19T00:16:39.661 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.659+0000 7fc4deffd640 10 client.15936 handle_command_reply: tid=0 2024-08-19T00:16:39.661 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.659+0000 7fc5085e9740 1 client.15936 shutdown 2024-08-19T00:16:39.661 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.659+0000 7fc5085e9740 1 -- 172.21.15.44:0/488441683 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5588ae5010f0 msgr2=0x5588ae514140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:39.661 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.659+0000 7fc5085e9740 1 --2- 172.21.15.44:0/488441683 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5588ae5010f0 0x5588ae514140 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fc4f0010c50 tx=0x7fc4f0012eb0 comp rx=0 tx=0).stop 2024-08-19T00:16:39.661 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.659+0000 7fc5085e9740 1 -- 172.21.15.44:0/488441683 shutdown_connections 2024-08-19T00:16:39.661 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.659+0000 7fc5085e9740 1 --2- 172.21.15.44:0/488441683 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5588ae58abe0 0x5588ae58d000 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:39.661 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.659+0000 7fc5085e9740 1 --2- 172.21.15.44:0/488441683 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5588ae50b990 0x5588ae505100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:39.661 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.659+0000 7fc4deffd640 0 client.15936 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:16:39.661 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.659+0000 7fc5085e9740 1 --2- 172.21.15.44:0/488441683 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5588ae5010f0 0x5588ae514140 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:39.661 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.659+0000 7fc5085e9740 1 --2- 172.21.15.44:0/488441683 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5588ae5007d0 0x5588ae513c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:39.661 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.659+0000 7fc5085e9740 1 -- 172.21.15.44:0/488441683 >> 172.21.15.44:0/488441683 conn(0x5588ae4fcd40 msgr2=0x5588ae502230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:16:39.661 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.659+0000 7fc5085e9740 1 -- 172.21.15.44:0/488441683 shutdown_connections 2024-08-19T00:16:39.662 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.659+0000 7fc5085e9740 1 -- 172.21.15.44:0/488441683 wait complete. 2024-08-19T00:16:39.662 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.659+0000 7fc5085e9740 20 client.15936 trim_cache size 0 max 16384 2024-08-19T00:16:39.662 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:{ 2024-08-19T00:16:39.662 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "message": "", 2024-08-19T00:16:39.662 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "return_code": 0 2024-08-19T00:16:39.662 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:} 2024-08-19T00:16:39.663 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.660+0000 7fc505830640 1 -- 172.21.15.44:0/3377590412 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fc4e80a2da0 msgr2=0x7fc4e80a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:39.663 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.660+0000 7fc505830640 1 --2- 172.21.15.44:0/3377590412 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fc4e80a2da0 0x7fc4e80a5260 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc4f80cd330 tx=0x7fc4f8067120 comp rx=0 tx=0).stop 2024-08-19T00:16:39.663 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.660+0000 7fc505830640 1 -- 172.21.15.44:0/3377590412 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc500107800 msgr2=0x7fc50019c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:39.663 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.660+0000 7fc505830640 1 --2- 172.21.15.44:0/3377590412 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc500107800 0x7fc50019c980 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fc4f800cab0 tx=0x7fc4f800cf70 comp rx=0 tx=0).stop 2024-08-19T00:16:39.663 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.660+0000 7fc505830640 1 -- 172.21.15.44:0/3377590412 shutdown_connections 2024-08-19T00:16:39.663 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.660+0000 7fc505830640 1 --2- 172.21.15.44:0/3377590412 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fc4e80a2da0 0x7fc4e80a5260 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:39.663 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.660+0000 7fc505830640 1 --2- 172.21.15.44:0/3377590412 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc500107800 0x7fc50019c980 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:39.664 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.660+0000 7fc505830640 1 --2- 172.21.15.44:0/3377590412 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc500102190 0x7fc500198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:39.664 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.660+0000 7fc505830640 1 --2- 172.21.15.44:0/3377590412 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc5001017f0 0x7fc5001980c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:39.664 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.660+0000 7fc505830640 1 -- 172.21.15.44:0/3377590412 >> 172.21.15.44:0/3377590412 conn(0x7fc5000fd550 msgr2=0x7fc5000fd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:16:39.664 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.660+0000 7fc505830640 1 -- 172.21.15.44:0/3377590412 shutdown_connections 2024-08-19T00:16:39.664 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:39.660+0000 7fc505830640 1 -- 172.21.15.44:0/3377590412 wait complete. 2024-08-19T00:16:39.668 INFO:tasks.workunit.client.0.smithi044.stdout: 1 166186 0.00 MB/sec execute 4 sec latency 23810.963 ms 2024-08-19T00:16:40.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:16:40 smithi116 ceph-mon[21873]: pgmap v103: 129 pgs: 129 active+clean; 102 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 3.7 MiB/s wr, 141 op/s 2024-08-19T00:16:40.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:16:40 smithi044 ceph-mon[18489]: pgmap v103: 129 pgs: 129 active+clean; 102 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 3.7 MiB/s wr, 141 op/s 2024-08-19T00:16:40.669 INFO:tasks.workunit.client.0.smithi044.stdout: 1 166186 0.00 MB/sec execute 5 sec latency 24811.051 ms 2024-08-19T00:16:40.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:16:40 smithi171 ceph-mon[21810]: pgmap v103: 129 pgs: 129 active+clean; 102 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 3.7 MiB/s wr, 141 op/s 2024-08-19T00:16:41.669 INFO:tasks.workunit.client.0.smithi044.stdout: 1 166186 0.00 MB/sec execute 6 sec latency 25811.191 ms 2024-08-19T00:16:42.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:16:42 smithi116 ceph-mon[21873]: pgmap v104: 129 pgs: 129 active+clean; 102 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 3.8 MiB/s wr, 146 op/s 2024-08-19T00:16:42.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:16:42 smithi044 ceph-mon[18489]: pgmap v104: 129 pgs: 129 active+clean; 102 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 3.8 MiB/s wr, 146 op/s 2024-08-19T00:16:42.669 INFO:tasks.workunit.client.0.smithi044.stdout: 1 166186 0.00 MB/sec execute 7 sec latency 26811.256 ms 2024-08-19T00:16:42.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:16:42 smithi171 ceph-mon[21810]: pgmap v104: 129 pgs: 129 active+clean; 102 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 3.8 MiB/s wr, 146 op/s 2024-08-19T00:16:43.018 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-19T00:16:43.286 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:16:43.669 INFO:tasks.workunit.client.0.smithi044.stdout: 1 166186 0.00 MB/sec execute 8 sec latency 27811.284 ms 2024-08-19T00:16:43.670 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:16:43 smithi044 ceph-mon[18489]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-19T00:16:43.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:43.796+0000 7f14f887f640 1 -- 172.21.15.44:0/3794904956 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f14f4102a70 msgr2=0x7f14f4102e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:43.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:43.796+0000 7f14f887f640 1 --2- 172.21.15.44:0/3794904956 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f14f4102a70 0x7f14f4102e50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f14e4009860 tx=0x7f14e402a3d0 comp rx=0 tx=0).stop 2024-08-19T00:16:43.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:43.797+0000 7f14f887f640 1 -- 172.21.15.44:0/3794904956 shutdown_connections 2024-08-19T00:16:43.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:43.797+0000 7f14f887f640 1 --2- 172.21.15.44:0/3794904956 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f14f410bea0 0x7f14f410e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:43.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:43.797+0000 7f14f887f640 1 --2- 172.21.15.44:0/3794904956 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14f4103390 0x7f14f410b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:43.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:43.797+0000 7f14f887f640 1 --2- 172.21.15.44:0/3794904956 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f14f4102a70 0x7f14f4102e50 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:43.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:43.797+0000 7f14f887f640 1 -- 172.21.15.44:0/3794904956 >> 172.21.15.44:0/3794904956 conn(0x7f14f40fc4d0 msgr2=0x7f14f40fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:16:43.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:43.797+0000 7f14f887f640 1 -- 172.21.15.44:0/3794904956 shutdown_connections 2024-08-19T00:16:43.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:43.797+0000 7f14f887f640 1 -- 172.21.15.44:0/3794904956 wait complete. 2024-08-19T00:16:43.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:43.797+0000 7f14f887f640 1 Processor -- start 2024-08-19T00:16:43.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:43.797+0000 7f14f887f640 1 -- start start 2024-08-19T00:16:43.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:43.797+0000 7f14f887f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f14f4102a70 0x7f14f41006d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:43.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:43.798+0000 7f14f887f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14f4103390 0x7f14f4100c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:43.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:43.798+0000 7f14f887f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f14f410bea0 0x7f14f4101150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:43.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:43.798+0000 7f14f887f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f14f4111ca0 con 0x7f14f4103390 2024-08-19T00:16:43.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:43.798+0000 7f14f887f640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f14f4111b20 con 0x7f14f4102a70 2024-08-19T00:16:43.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:43.798+0000 7f14f887f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f14f4111e20 con 0x7f14f410bea0 2024-08-19T00:16:43.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:43.798+0000 7f14ebfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14f4103390 0x7f14f4100c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:43.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:43.798+0000 7f14ebfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14f4103390 0x7f14f4100c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38720/0 (socket says 172.21.15.44:38720) 2024-08-19T00:16:43.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:43.798+0000 7f14ebfff640 1 -- 172.21.15.44:0/1478910007 learned_addr learned my addr 172.21.15.44:0/1478910007 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:16:43.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:43.798+0000 7f14f2d9d640 1 --2- 172.21.15.44:0/1478910007 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f14f410bea0 0x7f14f4101150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:43.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:43.798+0000 7f14f259c640 1 --2- 172.21.15.44:0/1478910007 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f14f4102a70 0x7f14f41006d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:43.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:43.798+0000 7f14ebfff640 1 -- 172.21.15.44:0/1478910007 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f14f410bea0 msgr2=0x7f14f4101150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:43.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:43.798+0000 7f14ebfff640 1 --2- 172.21.15.44:0/1478910007 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f14f410bea0 0x7f14f4101150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:43.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:43.798+0000 7f14ebfff640 1 -- 172.21.15.44:0/1478910007 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f14f4102a70 msgr2=0x7f14f41006d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:43.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:43.798+0000 7f14ebfff640 1 --2- 172.21.15.44:0/1478910007 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f14f4102a70 0x7f14f41006d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:43.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:43.798+0000 7f14ebfff640 1 -- 172.21.15.44:0/1478910007 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14f41a6600 con 0x7f14f4103390 2024-08-19T00:16:43.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:43.798+0000 7f14ebfff640 1 --2- 172.21.15.44:0/1478910007 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14f4103390 0x7f14f4100c10 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f14dc00e790 tx=0x7f14dc00ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:16:43.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:43.798+0000 7f14eb7fe640 1 -- 172.21.15.44:0/1478910007 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14dc00eea0 con 0x7f14f4103390 2024-08-19T00:16:43.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:43.798+0000 7f14f887f640 1 -- 172.21.15.44:0/1478910007 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14f41a68f0 con 0x7f14f4103390 2024-08-19T00:16:43.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:43.798+0000 7f14eb7fe640 1 -- 172.21.15.44:0/1478910007 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f14dc005500 con 0x7f14f4103390 2024-08-19T00:16:43.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:43.798+0000 7f14eb7fe640 1 -- 172.21.15.44:0/1478910007 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14dc010430 con 0x7f14f4103390 2024-08-19T00:16:43.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:43.798+0000 7f14f887f640 1 -- 172.21.15.44:0/1478910007 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14f41a6e80 con 0x7f14f4103390 2024-08-19T00:16:43.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:43.799+0000 7f14f887f640 1 -- 172.21.15.44:0/1478910007 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14f4102e50 con 0x7f14f4103390 2024-08-19T00:16:43.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:43.801+0000 7f14eb7fe640 1 -- 172.21.15.44:0/1478910007 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f14dc005000 con 0x7f14f4103390 2024-08-19T00:16:43.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:43.801+0000 7f14eb7fe640 1 --2- 172.21.15.44:0/1478910007 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f14e00a2cf0 0x7f14e00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:43.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:43.801+0000 7f14f259c640 1 --2- 172.21.15.44:0/1478910007 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f14e00a2cf0 0x7f14e00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:43.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:43.801+0000 7f14eb7fe640 1 -- 172.21.15.44:0/1478910007 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f14dc0cfbb0 con 0x7f14f4103390 2024-08-19T00:16:43.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:43.802+0000 7f14f259c640 1 --2- 172.21.15.44:0/1478910007 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f14e00a2cf0 0x7f14e00a51b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f14e4009830 tx=0x7f14e40094d0 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:16:43.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:43.804+0000 7f14eb7fe640 1 -- 172.21.15.44:0/1478910007 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f14dc053df0 con 0x7f14f4103390 2024-08-19T00:16:43.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:16:43 smithi171 ceph-mon[21810]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-19T00:16:43.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:16:43 smithi116 ceph-mon[21873]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-19T00:16:44.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:44.016+0000 7f14f887f640 1 -- 172.21.15.44:0/1478910007 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f14f4101c00 con 0x7f14f4103390 2024-08-19T00:16:44.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:44.017+0000 7f14eb7fe640 1 -- 172.21.15.44:0/1478910007 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11992 (secure 0 0 0) 0x7f14dc09c430 con 0x7f14f4103390 2024-08-19T00:16:44.019 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:16:44.019 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":31,"btime":"2024-08-19T00:16:42:359013+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14511,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1538841896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1538841896},{"type":"v1","addr":"172.21.15.116:6833","nonce":1538841896}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/4044471606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4044471606},{"type":"v1","addr":"172.21.15.44:6835","nonce":4044471606}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":31,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-19T00:10:53.196636+0000","modified":"2024-08-19T00:16:41.585517+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24473,"mds_1":24446,"mds_2":24439,"mds_3":24431,"mds_4":24418},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14529":{"gid":14529,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6837/1824829052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1824829052},{"type":"v1","addr":"172.21.15.44:6837","nonce":1824829052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14577":{"gid":14577,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6839/3591739042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":3591739042},{"type":"v1","addr":"172.21.15.44:6839","nonce":3591739042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14589":{"gid":14589,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6841/3667695717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6840","nonce":3667695717},{"type":"v1","addr":"172.21.15.44:6841","nonce":3667695717}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24388":{"gid":24388,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1183022838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1183022838},{"type":"v1","addr":"172.21.15.171:6833","nonce":1183022838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6835/2190623851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":2190623851},{"type":"v1","addr":"172.21.15.171:6835","nonce":2190623851}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.171:6837/316231795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":316231795},{"type":"v1","addr":"172.21.15.171:6837","nonce":316231795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":20,"addr":"172.21.15.116:6835/3507399322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3507399322},{"type":"v1","addr":"172.21.15.116:6835","nonce":3507399322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.171:6839/1466585795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":1466585795},{"type":"v1","addr":"172.21.15.171:6839","nonce":1466585795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":17,"addr":"172.21.15.116:6837/2764513846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":2764513846},{"type":"v1","addr":"172.21.15.116:6837","nonce":2764513846}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.116:6839/1032741033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":1032741033},{"type":"v1","addr":"172.21.15.116:6839","nonce":1032741033}]},"join_fscid":-1,"export_targets":[2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24446,24439,24431,24418]},"id":1}]} 2024-08-19T00:16:44.019 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 31 2024-08-19T00:16:44.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:44.019+0000 7f14f887f640 1 -- 172.21.15.44:0/1478910007 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f14e00a2cf0 msgr2=0x7f14e00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:44.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:44.019+0000 7f14f887f640 1 --2- 172.21.15.44:0/1478910007 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f14e00a2cf0 0x7f14e00a51b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f14e4009830 tx=0x7f14e40094d0 comp rx=0 tx=0).stop 2024-08-19T00:16:44.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:44.019+0000 7f14f887f640 1 -- 172.21.15.44:0/1478910007 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14f4103390 msgr2=0x7f14f4100c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:44.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:44.019+0000 7f14f887f640 1 --2- 172.21.15.44:0/1478910007 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14f4103390 0x7f14f4100c10 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f14dc00e790 tx=0x7f14dc00ec50 comp rx=0 tx=0).stop 2024-08-19T00:16:44.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:44.019+0000 7f14f887f640 1 -- 172.21.15.44:0/1478910007 shutdown_connections 2024-08-19T00:16:44.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:44.019+0000 7f14f887f640 1 --2- 172.21.15.44:0/1478910007 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f14e00a2cf0 0x7f14e00a51b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:44.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:44.019+0000 7f14f887f640 1 --2- 172.21.15.44:0/1478910007 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f14f410bea0 0x7f14f4101150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:44.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:44.019+0000 7f14f887f640 1 --2- 172.21.15.44:0/1478910007 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14f4103390 0x7f14f4100c10 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:44.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:44.019+0000 7f14f887f640 1 --2- 172.21.15.44:0/1478910007 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f14f4102a70 0x7f14f41006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:44.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:44.019+0000 7f14f887f640 1 -- 172.21.15.44:0/1478910007 >> 172.21.15.44:0/1478910007 conn(0x7f14f40fc4d0 msgr2=0x7f14f40fd1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:16:44.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:44.019+0000 7f14f887f640 1 -- 172.21.15.44:0/1478910007 shutdown_connections 2024-08-19T00:16:44.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:44.019+0000 7f14f887f640 1 -- 172.21.15.44:0/1478910007 wait complete. 2024-08-19T00:16:44.669 INFO:tasks.workunit.client.0.smithi044.stdout: 1 166186 0.00 MB/sec execute 9 sec latency 28811.343 ms 2024-08-19T00:16:44.706 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:16:44 smithi044 ceph-mon[18489]: pgmap v105: 129 pgs: 129 active+clean; 102 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 104 KiB/s wr, 32 op/s 2024-08-19T00:16:44.706 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:16:44 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/1478910007' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:16:44.734 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24473 quiesce db --set-id d96e3045 --release --await' 2024-08-19T00:16:44.735 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24473 quiesce db --set-id d96e3045 --release --await 2024-08-19T00:16:44.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:16:44 smithi171 ceph-mon[21810]: pgmap v105: 129 pgs: 129 active+clean; 102 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 104 KiB/s wr, 32 op/s 2024-08-19T00:16:44.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:16:44 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/1478910007' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:16:44.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:16:44 smithi116 ceph-mon[21873]: pgmap v105: 129 pgs: 129 active+clean; 102 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 104 KiB/s wr, 32 op/s 2024-08-19T00:16:44.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:16:44 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/1478910007' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:16:44.993 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:16:45.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.454+0000 7f0fe8346640 1 -- 172.21.15.44:0/4019177619 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0fe0102250 msgr2=0x7f0fe010e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:45.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.454+0000 7f0fe8346640 1 --2- 172.21.15.44:0/4019177619 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0fe0102250 0x7f0fe010e780 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f0fd8009cd0 tx=0x7f0fd802a8e0 comp rx=0 tx=0).stop 2024-08-19T00:16:45.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.454+0000 7f0fe8346640 1 -- 172.21.15.44:0/4019177619 shutdown_connections 2024-08-19T00:16:45.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.454+0000 7f0fe8346640 1 --2- 172.21.15.44:0/4019177619 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0fe0102250 0x7f0fe010e780 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:45.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.454+0000 7f0fe8346640 1 --2- 172.21.15.44:0/4019177619 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0fe01018b0 0x7f0fe0101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:45.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.454+0000 7f0fe8346640 1 --2- 172.21.15.44:0/4019177619 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0fe01078b0 0x7f0fe0107c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:45.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.454+0000 7f0fe8346640 1 -- 172.21.15.44:0/4019177619 >> 172.21.15.44:0/4019177619 conn(0x7f0fe00fd5f0 msgr2=0x7f0fe00ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:16:45.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.454+0000 7f0fe8346640 1 -- 172.21.15.44:0/4019177619 shutdown_connections 2024-08-19T00:16:45.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.454+0000 7f0fe8346640 1 -- 172.21.15.44:0/4019177619 wait complete. 2024-08-19T00:16:45.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.455+0000 7f0fe8346640 1 Processor -- start 2024-08-19T00:16:45.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.455+0000 7f0fe8346640 1 -- start start 2024-08-19T00:16:45.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.455+0000 7f0fe8346640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0fe01018b0 0x7f0fe0074220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:45.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.455+0000 7f0fe8346640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0fe0102250 0x7f0fe0074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:45.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.455+0000 7f0fe8346640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0fe01078b0 0x7f0fe0074ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:45.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.455+0000 7f0fe8346640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe0111cb0 con 0x7f0fe01078b0 2024-08-19T00:16:45.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.455+0000 7f0fe8346640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe0111b30 con 0x7f0fe0102250 2024-08-19T00:16:45.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.455+0000 7f0fe8346640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe0111e30 con 0x7f0fe01018b0 2024-08-19T00:16:45.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.455+0000 7f0fe68e3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0fe01078b0 0x7f0fe0074ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:45.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.455+0000 7f0fe68e3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0fe01078b0 0x7f0fe0074ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38744/0 (socket says 172.21.15.44:38744) 2024-08-19T00:16:45.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.455+0000 7f0fe68e3640 1 -- 172.21.15.44:0/1591586498 learned_addr learned my addr 172.21.15.44:0/1591586498 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:16:45.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.455+0000 7f0fe60e2640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0fe01018b0 0x7f0fe0074220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:45.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.456+0000 7f0fe58e1640 1 --2- 172.21.15.44:0/1591586498 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0fe0102250 0x7f0fe0074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:45.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.456+0000 7f0fe68e3640 1 -- 172.21.15.44:0/1591586498 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0fe01018b0 msgr2=0x7f0fe0074220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:45.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.456+0000 7f0fe68e3640 1 --2- 172.21.15.44:0/1591586498 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0fe01018b0 0x7f0fe0074220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:45.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.456+0000 7f0fe68e3640 1 -- 172.21.15.44:0/1591586498 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0fe0102250 msgr2=0x7f0fe0074760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:45.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.456+0000 7f0fe68e3640 1 --2- 172.21.15.44:0/1591586498 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0fe0102250 0x7f0fe0074760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:45.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.456+0000 7f0fe68e3640 1 -- 172.21.15.44:0/1591586498 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fe01a6610 con 0x7f0fe01078b0 2024-08-19T00:16:45.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.456+0000 7f0fe58e1640 1 --2- 172.21.15.44:0/1591586498 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0fe0102250 0x7f0fe0074760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:16:45.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.456+0000 7f0fe68e3640 1 --2- 172.21.15.44:0/1591586498 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0fe01078b0 0x7f0fe0074ca0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f0fd8005cc0 tx=0x7f0fd8003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:16:45.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.456+0000 7f0fd77fe640 1 -- 172.21.15.44:0/1591586498 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fd8004040 con 0x7f0fe01078b0 2024-08-19T00:16:45.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.456+0000 7f0fd77fe640 1 -- 172.21.15.44:0/1591586498 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0fd80046c0 con 0x7f0fe01078b0 2024-08-19T00:16:45.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.456+0000 7f0fd77fe640 1 -- 172.21.15.44:0/1591586498 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fd8046480 con 0x7f0fe01078b0 2024-08-19T00:16:45.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.456+0000 7f0fe8346640 1 -- 172.21.15.44:0/1591586498 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fe01a68a0 con 0x7f0fe01078b0 2024-08-19T00:16:45.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.456+0000 7f0fe8346640 1 -- 172.21.15.44:0/1591586498 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fe01a6e30 con 0x7f0fe01078b0 2024-08-19T00:16:45.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.458+0000 7f0fd77fe640 1 -- 172.21.15.44:0/1591586498 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f0fd80305a0 con 0x7f0fe01078b0 2024-08-19T00:16:45.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.459+0000 7f0fea744740 1 Processor -- start 2024-08-19T00:16:45.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.459+0000 7f0fea744740 1 -- start start 2024-08-19T00:16:45.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.459+0000 7f0fea744740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563e55a66990 0x563e55a66d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:45.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.459+0000 7f0fea744740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563e55a672b0 0x563e55a71630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:45.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.459+0000 7f0fea744740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e55a71b70 0x563e55a73f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:45.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.459+0000 7f0fea744740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x563e559ccc60 con 0x563e55a672b0 2024-08-19T00:16:45.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.459+0000 7f0fea744740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x563e55964b90 con 0x563e55a71b70 2024-08-19T00:16:45.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.459+0000 7f0fea744740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x563e559c8c20 con 0x563e55a66990 2024-08-19T00:16:45.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.459+0000 7f0fd77fe640 1 --2- 172.21.15.44:0/1591586498 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f0fcc0a2d70 0x7f0fcc0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:45.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.459+0000 7f0fe60e2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563e55a672b0 0x563e55a71630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:45.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.459+0000 7f0fe60e2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563e55a672b0 0x563e55a71630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38756/0 (socket says 172.21.15.44:38756) 2024-08-19T00:16:45.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.459+0000 7f0fe60e2640 1 -- 172.21.15.44:0/3995107045 learned_addr learned my addr 172.21.15.44:0/3995107045 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:16:45.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.459+0000 7f0fe58e1640 1 --2- 172.21.15.44:0/3995107045 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e55a71b70 0x563e55a73f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:45.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.459+0000 7f0fe68e3640 1 --2- 172.21.15.44:0/1591586498 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f0fcc0a2d70 0x7f0fcc0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:45.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.459+0000 7f0fe58e1640 1 --2- 172.21.15.44:0/3995107045 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563e55a66990 0x563e55a66d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:45.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.459+0000 7f0fd77fe640 1 -- 172.21.15.44:0/1591586498 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f0fd802e030 con 0x7f0fe01078b0 2024-08-19T00:16:45.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.459+0000 7f0fe60e2640 1 -- 172.21.15.44:0/3995107045 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563e55a66990 msgr2=0x563e55a66d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:16:45.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.460+0000 7f0fe60e2640 1 --2- 172.21.15.44:0/3995107045 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563e55a66990 0x563e55a66d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:45.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.460+0000 7f0fe60e2640 1 -- 172.21.15.44:0/3995107045 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e55a71b70 msgr2=0x563e55a73f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:16:45.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.460+0000 7f0fe60e2640 1 --2- 172.21.15.44:0/3995107045 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e55a71b70 0x563e55a73f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:45.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.460+0000 7f0fe60e2640 1 -- 172.21.15.44:0/3995107045 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e556dc580 con 0x563e55a672b0 2024-08-19T00:16:45.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.460+0000 7f0fe60e2640 1 --2- 172.21.15.44:0/3995107045 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563e55a672b0 0x563e55a71630 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc00b710 tx=0x7f0fdc004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dcadc92ab84c4c5 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:16:45.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.460+0000 7f0fe68e3640 1 --2- 172.21.15.44:0/1591586498 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f0fcc0a2d70 0x7f0fcc0a5230 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0fd80bd0e0 tx=0x7f0fd80dd040 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:16:45.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.460+0000 7f0fd4dea640 1 -- 172.21.15.44:0/3995107045 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc003b50 con 0x563e55a672b0 2024-08-19T00:16:45.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.460+0000 7f0fd4dea640 1 -- 172.21.15.44:0/3995107045 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0fdc015070 con 0x563e55a672b0 2024-08-19T00:16:45.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.460+0000 7f0fd4dea640 1 -- 172.21.15.44:0/3995107045 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc004d70 con 0x563e55a672b0 2024-08-19T00:16:45.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.461+0000 7f0fea744740 1 -- 172.21.15.44:0/3995107045 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563e55a672b0 msgr2=0x563e55a71630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:45.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.461+0000 7f0fea744740 1 --2- 172.21.15.44:0/3995107045 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563e55a672b0 0x563e55a71630 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc00b710 tx=0x7f0fdc004610 comp rx=0 tx=0).stop 2024-08-19T00:16:45.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.461+0000 7f0fea744740 1 -- 172.21.15.44:0/3995107045 shutdown_connections 2024-08-19T00:16:45.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.461+0000 7f0fea744740 1 --2- 172.21.15.44:0/3995107045 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e55a71b70 0x563e55a73f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:45.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.461+0000 7f0fea744740 1 --2- 172.21.15.44:0/3995107045 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563e55a672b0 0x563e55a71630 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:45.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.461+0000 7f0fea744740 1 --2- 172.21.15.44:0/3995107045 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563e55a66990 0x563e55a66d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:45.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.461+0000 7f0fea744740 1 -- 172.21.15.44:0/3995107045 >> 172.21.15.44:0/3995107045 conn(0x563e55a62f20 msgr2=0x563e55a63300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:16:45.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.461+0000 7f0fea744740 1 -- 172.21.15.44:0/3995107045 shutdown_connections 2024-08-19T00:16:45.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.461+0000 7f0fea744740 1 -- 172.21.15.44:0/3995107045 wait complete. 2024-08-19T00:16:45.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.461+0000 7f0fea744740 1 -- start start 2024-08-19T00:16:45.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.461+0000 7f0fea744740 1 Processor -- start 2024-08-19T00:16:45.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.462+0000 7f0fea744740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563e55a66990 0x563e55a6e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:45.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.462+0000 7f0fea744740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563e55a672b0 0x563e55a6eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:45.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.462+0000 7f0fea744740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e55a71b70 0x563e55a6f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:45.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.462+0000 7f0fea744740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x563e55a74740 con 0x563e55a672b0 2024-08-19T00:16:45.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.462+0000 7f0fea744740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x563e5596a7c0 con 0x563e55a71b70 2024-08-19T00:16:45.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.462+0000 7f0fea744740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x563e55a748c0 con 0x563e55a66990 2024-08-19T00:16:45.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.462+0000 7f0fea744740 10 client.0 _ll_register_callbacks cb 0x563e55973f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:16:45.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.462+0000 7f0fe60e2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563e55a672b0 0x563e55a6eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:45.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.462+0000 7f0fe60e2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563e55a672b0 0x563e55a6eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38762/0 (socket says 172.21.15.44:38762) 2024-08-19T00:16:45.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.462+0000 7f0fe60e2640 1 -- 172.21.15.44:0/2973875919 learned_addr learned my addr 172.21.15.44:0/2973875919 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:16:45.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.462+0000 7f0fe58e1640 1 --2- 172.21.15.44:0/2973875919 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563e55a66990 0x563e55a6e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:45.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.462+0000 7f0fe58e1640 1 --2- 172.21.15.44:0/2973875919 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e55a71b70 0x563e55a6f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:45.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.462+0000 7f0fe60e2640 1 -- 172.21.15.44:0/2973875919 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563e55a66990 msgr2=0x563e55a6e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:16:45.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.462+0000 7f0fe60e2640 1 --2- 172.21.15.44:0/2973875919 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563e55a66990 0x563e55a6e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:45.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.462+0000 7f0fe60e2640 1 -- 172.21.15.44:0/2973875919 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e55a71b70 msgr2=0x563e55a6f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:16:45.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.462+0000 7f0fe60e2640 1 --2- 172.21.15.44:0/2973875919 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e55a71b70 0x563e55a6f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:45.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.462+0000 7f0fe60e2640 1 -- 172.21.15.44:0/2973875919 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e557a6960 con 0x563e55a672b0 2024-08-19T00:16:45.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.462+0000 7f0fe58e1640 1 --2- 172.21.15.44:0/2973875919 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563e55a66990 0x563e55a6e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:16:45.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.462+0000 7f0fe60e2640 1 --2- 172.21.15.44:0/2973875919 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563e55a672b0 0x563e55a6eef0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc006010 tx=0x7f0fdc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=675fc08e61380553 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:16:45.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.462+0000 7f0fc9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:16:45.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.462+0000 7f0fc9ffb640 1 -- 172.21.15.44:0/2973875919 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc028060 con 0x563e55a672b0 2024-08-19T00:16:45.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.462+0000 7f0fc9ffb640 1 -- 172.21.15.44:0/2973875919 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f0fdc011440 con 0x563e55a672b0 2024-08-19T00:16:45.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.462+0000 7f0fea744740 1 -- 172.21.15.44:0/2973875919 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0fdc015070 con 0x563e55a672b0 2024-08-19T00:16:45.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.463+0000 7f0fc9ffb640 1 -- 172.21.15.44:0/2973875919 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f0fdc02f050 con 0x563e55a672b0 2024-08-19T00:16:45.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.463+0000 7f0fea744740 10 client.15954 fetch_fsmap learned FSMap version 31 2024-08-19T00:16:45.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.463+0000 7f0fea744740 1 -- 172.21.15.44:0/2973875919 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x563e55a80730 con 0x563e55a672b0 2024-08-19T00:16:45.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.463+0000 7f0fc9ffb640 1 -- 172.21.15.44:0/2973875919 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0fdc015070 con 0x563e55a672b0 2024-08-19T00:16:45.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.463+0000 7f0fc9ffb640 1 -- 172.21.15.44:0/2973875919 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f0fdc022070 con 0x563e55a672b0 2024-08-19T00:16:45.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.463+0000 7f0fea744740 10 client.15954 fetch_fsmap finished waiting for FSMap version 31 2024-08-19T00:16:45.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.463+0000 7f0fea744740 10 client.15954 resolve_mds: validated gid 24473 aka daemon mds.b 2024-08-19T00:16:45.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.463+0000 7f0fea744740 20 client.15954 populate_metadata read hostname 'smithi044' 2024-08-19T00:16:45.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.463+0000 7f0fea744740 1 --2- 172.21.15.44:0/2973875919 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x563e55a81bf0 0x563e55a83fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:45.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.463+0000 7f0fea744740 4 client.15954 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:16:45.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.463+0000 7f0fea744740 1 -- 172.21.15.44:0/2973875919 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563e559da1d0 con 0x563e55a81bf0 2024-08-19T00:16:45.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.463+0000 7f0fe58e1640 1 --2- 172.21.15.44:0/2973875919 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x563e55a81bf0 0x563e55a83fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:45.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.464+0000 7f0fe58e1640 1 --2- 172.21.15.44:0/2973875919 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x563e55a81bf0 0x563e55a83fe0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e21a1776b59025d0 server_cookie=75777f1c9a981479 in_seq=0 out_seq=0 2024-08-19T00:16:45.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.464+0000 7f0fc9ffb640 10 client.15954 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:16:45.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.465+0000 7f0fc9ffb640 1 -- 172.21.15.44:0/2973875919 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563e559da1d0 con 0x563e55a81bf0 2024-08-19T00:16:45.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.465+0000 7f0fc9ffb640 10 client.15954 handle_command_reply: tid=0 2024-08-19T00:16:45.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.465+0000 7f0fea744740 1 client.15954 shutdown 2024-08-19T00:16:45.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.465+0000 7f0fea744740 1 -- 172.21.15.44:0/2973875919 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563e55a672b0 msgr2=0x563e55a6eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:45.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.465+0000 7f0fea744740 1 --2- 172.21.15.44:0/2973875919 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563e55a672b0 0x563e55a6eef0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc006010 tx=0x7f0fdc004730 comp rx=0 tx=0).stop 2024-08-19T00:16:45.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.465+0000 7f0fea744740 1 -- 172.21.15.44:0/2973875919 shutdown_connections 2024-08-19T00:16:45.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.465+0000 7f0fea744740 1 --2- 172.21.15.44:0/2973875919 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x563e55a81bf0 0x563e55a83fe0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:45.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.465+0000 7f0fea744740 1 --2- 172.21.15.44:0/2973875919 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e55a71b70 0x563e55a6f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:45.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.465+0000 7f0fea744740 1 --2- 172.21.15.44:0/2973875919 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563e55a672b0 0x563e55a6eef0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:45.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.465+0000 7f0fc9ffb640 0 client.15954 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:16:45.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.465+0000 7f0fea744740 1 --2- 172.21.15.44:0/2973875919 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563e55a66990 0x563e55a6e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:45.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.465+0000 7f0fea744740 1 -- 172.21.15.44:0/2973875919 >> 172.21.15.44:0/2973875919 conn(0x563e55a62f20 msgr2=0x563e55a68c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:16:45.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.465+0000 7f0fea744740 1 -- 172.21.15.44:0/2973875919 shutdown_connections 2024-08-19T00:16:45.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.465+0000 7f0fea744740 1 -- 172.21.15.44:0/2973875919 wait complete. 2024-08-19T00:16:45.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.465+0000 7f0fea744740 20 client.15954 trim_cache size 0 max 16384 2024-08-19T00:16:45.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.482+0000 7f0fea744740 1 Processor -- start 2024-08-19T00:16:45.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.482+0000 7f0fea744740 1 -- start start 2024-08-19T00:16:45.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.482+0000 7f0fea744740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563e55a66990 0x563e55a693f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:45.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.482+0000 7f0fea744740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563e55a672b0 0x563e55a6d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:45.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.482+0000 7f0fea744740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e55a71b70 0x563e55a89610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:45.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.482+0000 7f0fea744740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe01b0ee0 con 0x563e55a66990 2024-08-19T00:16:45.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.482+0000 7f0fea744740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe01b2a80 con 0x563e55a71b70 2024-08-19T00:16:45.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.482+0000 7f0fea744740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe01b15b0 con 0x563e55a672b0 2024-08-19T00:16:45.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.482+0000 7f0fe58e1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563e55a66990 0x563e55a693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:45.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.482+0000 7f0fe58e1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563e55a66990 0x563e55a693f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38768/0 (socket says 172.21.15.44:38768) 2024-08-19T00:16:45.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.482+0000 7f0fe58e1640 1 -- 172.21.15.44:0/3601823087 learned_addr learned my addr 172.21.15.44:0/3601823087 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:16:45.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.483+0000 7f0fe58e1640 1 -- 172.21.15.44:0/3601823087 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563e55a672b0 msgr2=0x563e55a6d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:16:45.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.483+0000 7f0fe60e2640 1 --2- 172.21.15.44:0/3601823087 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563e55a672b0 0x563e55a6d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:45.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.483+0000 7f0fe58e1640 1 --2- 172.21.15.44:0/3601823087 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563e55a672b0 0x563e55a6d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:45.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.483+0000 7f0fe58e1640 1 -- 172.21.15.44:0/3601823087 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e55a71b70 msgr2=0x563e55a89610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:16:45.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.483+0000 7f0fe58e1640 1 --2- 172.21.15.44:0/3601823087 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e55a71b70 0x563e55a89610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:45.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.483+0000 7f0fe58e1640 1 -- 172.21.15.44:0/3601823087 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e55a748d0 con 0x563e55a66990 2024-08-19T00:16:45.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.483+0000 7f0fe60e2640 1 --2- 172.21.15.44:0/3601823087 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563e55a672b0 0x563e55a6d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:16:45.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.483+0000 7f0fe58e1640 1 --2- 172.21.15.44:0/3601823087 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563e55a66990 0x563e55a693f0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f0fd000c4c0 tx=0x7f0fd000cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aacbc1ad23043f64 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:16:45.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.483+0000 7f0fcbfff640 1 -- 172.21.15.44:0/3601823087 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fd0022070 con 0x563e55a66990 2024-08-19T00:16:45.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.483+0000 7f0fcbfff640 1 -- 172.21.15.44:0/3601823087 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0fd0003ad0 con 0x563e55a66990 2024-08-19T00:16:45.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.483+0000 7f0fcbfff640 1 -- 172.21.15.44:0/3601823087 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fd0011b80 con 0x563e55a66990 2024-08-19T00:16:45.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.484+0000 7f0fea744740 1 -- 172.21.15.44:0/3601823087 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563e55a66990 msgr2=0x563e55a693f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:45.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.484+0000 7f0fea744740 1 --2- 172.21.15.44:0/3601823087 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563e55a66990 0x563e55a693f0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f0fd000c4c0 tx=0x7f0fd000cc10 comp rx=0 tx=0).stop 2024-08-19T00:16:45.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.484+0000 7f0fea744740 1 -- 172.21.15.44:0/3601823087 shutdown_connections 2024-08-19T00:16:45.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.484+0000 7f0fea744740 1 --2- 172.21.15.44:0/3601823087 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563e55a672b0 0x563e55a6d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:45.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.484+0000 7f0fea744740 1 --2- 172.21.15.44:0/3601823087 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e55a71b70 0x563e55a89610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:45.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.484+0000 7f0fea744740 1 --2- 172.21.15.44:0/3601823087 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563e55a66990 0x563e55a693f0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:45.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.484+0000 7f0fea744740 1 -- 172.21.15.44:0/3601823087 >> 172.21.15.44:0/3601823087 conn(0x563e55a62f20 msgr2=0x563e55a70ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:16:45.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.484+0000 7f0fea744740 1 -- 172.21.15.44:0/3601823087 shutdown_connections 2024-08-19T00:16:45.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.484+0000 7f0fea744740 1 -- 172.21.15.44:0/3601823087 wait complete. 2024-08-19T00:16:45.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.484+0000 7f0fea744740 1 -- start start 2024-08-19T00:16:45.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.484+0000 7f0fea744740 1 Processor -- start 2024-08-19T00:16:45.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.484+0000 7f0fea744740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e55a66990 0x563e55a75890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:45.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.484+0000 7f0fea744740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563e55a672b0 0x563e55a75dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:45.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.484+0000 7f0fea744740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563e55a71b70 0x563e55a76310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:45.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.484+0000 7f0fea744740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe01b2350 con 0x563e55a71b70 2024-08-19T00:16:45.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.484+0000 7f0fea744740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe01b1c80 con 0x563e55a66990 2024-08-19T00:16:45.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.484+0000 7f0fea744740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe01aeec0 con 0x563e55a672b0 2024-08-19T00:16:45.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.485+0000 7f0fea744740 10 client.0 _ll_register_callbacks cb 0x7f0fdc0043a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:16:45.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.485+0000 7f0fe58e1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563e55a71b70 0x563e55a76310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:45.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.485+0000 7f0fe58e1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563e55a71b70 0x563e55a76310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38784/0 (socket says 172.21.15.44:38784) 2024-08-19T00:16:45.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.485+0000 7f0fe58e1640 1 -- 172.21.15.44:0/1735305011 learned_addr learned my addr 172.21.15.44:0/1735305011 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:16:45.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.485+0000 7f0fe58e1640 1 --2- 172.21.15.44:0/1735305011 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e55a66990 0x563e55a75890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:45.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.485+0000 7f0fe60e2640 1 --2- 172.21.15.44:0/1735305011 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563e55a672b0 0x563e55a75dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:45.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.485+0000 7f0fe58e1640 1 -- 172.21.15.44:0/1735305011 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563e55a672b0 msgr2=0x563e55a75dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:16:45.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.485+0000 7f0fe58e1640 1 --2- 172.21.15.44:0/1735305011 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563e55a672b0 0x563e55a75dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:45.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.485+0000 7f0fe58e1640 1 -- 172.21.15.44:0/1735305011 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e55a66990 msgr2=0x563e55a75890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:16:45.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.485+0000 7f0fe58e1640 1 --2- 172.21.15.44:0/1735305011 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e55a66990 0x563e55a75890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:45.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.485+0000 7f0fe58e1640 1 -- 172.21.15.44:0/1735305011 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e55aeb5e0 con 0x563e55a71b70 2024-08-19T00:16:45.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.485+0000 7f0fe58e1640 1 --2- 172.21.15.44:0/1735305011 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563e55a71b70 0x563e55a76310 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f0fd0013e30 tx=0x7f0fd0015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dabc41e39041578 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:16:45.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.485+0000 7f0fc9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:16:45.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.485+0000 7f0fc9ffb640 1 -- 172.21.15.44:0/1735305011 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fd0022030 con 0x563e55a71b70 2024-08-19T00:16:45.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.485+0000 7f0fea744740 1 -- 172.21.15.44:0/1735305011 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0fd0003ad0 con 0x563e55a71b70 2024-08-19T00:16:45.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.485+0000 7f0fc9ffb640 1 -- 172.21.15.44:0/1735305011 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f0fd0003c80 con 0x563e55a71b70 2024-08-19T00:16:45.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.486+0000 7f0fc9ffb640 1 -- 172.21.15.44:0/1735305011 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f0fd00035f0 con 0x563e55a71b70 2024-08-19T00:16:45.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.486+0000 7f0fea744740 10 client.15960 fetch_fsmap learned FSMap version 31 2024-08-19T00:16:45.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.486+0000 7f0fea744740 1 -- 172.21.15.44:0/1735305011 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x563e55aec840 con 0x563e55a71b70 2024-08-19T00:16:45.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.486+0000 7f0fc9ffb640 1 -- 172.21.15.44:0/1735305011 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0fd0003ad0 con 0x563e55a71b70 2024-08-19T00:16:45.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.486+0000 7f0fc9ffb640 1 -- 172.21.15.44:0/1735305011 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f0fd0011a30 con 0x563e55a71b70 2024-08-19T00:16:45.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.486+0000 7f0fea744740 10 client.15960 fetch_fsmap finished waiting for FSMap version 31 2024-08-19T00:16:45.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.486+0000 7f0fea744740 10 client.15960 resolve_mds: validated gid 24473 aka daemon mds.b 2024-08-19T00:16:45.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.486+0000 7f0fea744740 20 client.15960 populate_metadata read hostname 'smithi044' 2024-08-19T00:16:45.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.486+0000 7f0fea744740 1 --2- 172.21.15.44:0/1735305011 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x563e55aecf20 0x563e55aef340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:45.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.486+0000 7f0fea744740 4 client.15960 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "d96e3045", "release": true, "await": true}] 2024-08-19T00:16:45.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.486+0000 7f0fea744740 1 -- 172.21.15.44:0/1735305011 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "quiesce db", "set_id": "d96e3045", "release": true, "await": true}) -- 0x563e559d46e0 con 0x563e55aecf20 2024-08-19T00:16:45.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.486+0000 7f0fe60e2640 1 --2- 172.21.15.44:0/1735305011 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x563e55aecf20 0x563e55aef340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:45.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.487+0000 7f0fc9ffb640 10 client.15960 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:16:45.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.487+0000 7f0fe60e2640 1 --2- 172.21.15.44:0/1735305011 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x563e55aecf20 0x563e55aef340 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5af2f7639ed512cc server_cookie=f39ec40f2a3c255d in_seq=0 out_seq=0 2024-08-19T00:16:45.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.498+0000 7f0fc9ffb640 1 -- 172.21.15.44:0/1735305011 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x563e559d46e0 con 0x563e55aecf20 2024-08-19T00:16:45.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.498+0000 7f0fc9ffb640 10 client.15960 handle_command_reply: tid=0 2024-08-19T00:16:45.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.498+0000 7f0fea744740 1 client.15960 shutdown 2024-08-19T00:16:45.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.498+0000 7f0fea744740 1 -- 172.21.15.44:0/1735305011 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563e55a71b70 msgr2=0x563e55a76310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:45.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.498+0000 7f0fea744740 1 --2- 172.21.15.44:0/1735305011 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563e55a71b70 0x563e55a76310 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f0fd0013e30 tx=0x7f0fd0015040 comp rx=0 tx=0).stop 2024-08-19T00:16:45.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.498+0000 7f0fea744740 1 -- 172.21.15.44:0/1735305011 shutdown_connections 2024-08-19T00:16:45.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.498+0000 7f0fea744740 1 --2- 172.21.15.44:0/1735305011 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x563e55aecf20 0x563e55aef340 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:45.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.498+0000 7f0fea744740 1 --2- 172.21.15.44:0/1735305011 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563e55a672b0 0x563e55a75dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:45.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.498+0000 7f0fea744740 1 --2- 172.21.15.44:0/1735305011 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563e55a71b70 0x563e55a76310 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:45.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.498+0000 7f0fea744740 1 --2- 172.21.15.44:0/1735305011 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e55a66990 0x563e55a75890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:45.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.498+0000 7f0fea744740 1 -- 172.21.15.44:0/1735305011 >> 172.21.15.44:0/1735305011 conn(0x563e55a62f20 msgr2=0x563e55a6d970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:16:45.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.498+0000 7f0fc9ffb640 0 client.15960 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:16:45.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.498+0000 7f0fea744740 1 -- 172.21.15.44:0/1735305011 shutdown_connections 2024-08-19T00:16:45.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.499+0000 7f0fea744740 1 -- 172.21.15.44:0/1735305011 wait complete. 2024-08-19T00:16:45.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.499+0000 7f0fea744740 20 client.15960 trim_cache size 0 max 16384 2024-08-19T00:16:45.502 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-08-19T00:16:45.502 INFO:teuthology.orchestra.run.smithi044.stdout: "epoch": 31, 2024-08-19T00:16:45.502 INFO:teuthology.orchestra.run.smithi044.stdout: "leader": 24473, 2024-08-19T00:16:45.502 INFO:teuthology.orchestra.run.smithi044.stdout: "set_version": 12, 2024-08-19T00:16:45.502 INFO:teuthology.orchestra.run.smithi044.stdout: "sets": { 2024-08-19T00:16:45.502 INFO:teuthology.orchestra.run.smithi044.stdout: "d96e3045": { 2024-08-19T00:16:45.502 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 12, 2024-08-19T00:16:45.502 INFO:teuthology.orchestra.run.smithi044.stdout: "age_ref": 0.0, 2024-08-19T00:16:45.502 INFO:teuthology.orchestra.run.smithi044.stdout: "state": { 2024-08-19T00:16:45.502 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "RELEASED", 2024-08-19T00:16:45.503 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.0 2024-08-19T00:16:45.503 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:16:45.503 INFO:teuthology.orchestra.run.smithi044.stdout: "timeout": 90.0, 2024-08-19T00:16:45.503 INFO:teuthology.orchestra.run.smithi044.stdout: "expiration": 150.0, 2024-08-19T00:16:45.503 INFO:teuthology.orchestra.run.smithi044.stdout: "members": { 2024-08-19T00:16:45.503 INFO:teuthology.orchestra.run.smithi044.stdout: "file:/": { 2024-08-19T00:16:45.503 INFO:teuthology.orchestra.run.smithi044.stdout: "excluded": false, 2024-08-19T00:16:45.503 INFO:teuthology.orchestra.run.smithi044.stdout: "state": { 2024-08-19T00:16:45.503 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "RELEASED", 2024-08-19T00:16:45.503 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.0 2024-08-19T00:16:45.503 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:16:45.503 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:16:45.504 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:16:45.504 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:16:45.504 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:16:45.504 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-08-19T00:16:45.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.499+0000 7f0fe8346640 1 -- 172.21.15.44:0/1591586498 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f0fcc0a2d70 msgr2=0x7f0fcc0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:45.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.499+0000 7f0fe8346640 1 --2- 172.21.15.44:0/1591586498 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f0fcc0a2d70 0x7f0fcc0a5230 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0fd80bd0e0 tx=0x7f0fd80dd040 comp rx=0 tx=0).stop 2024-08-19T00:16:45.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.499+0000 7f0fe8346640 1 -- 172.21.15.44:0/1591586498 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0fe01078b0 msgr2=0x7f0fe0074ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:45.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.499+0000 7f0fe8346640 1 --2- 172.21.15.44:0/1591586498 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0fe01078b0 0x7f0fe0074ca0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f0fd8005cc0 tx=0x7f0fd8003970 comp rx=0 tx=0).stop 2024-08-19T00:16:45.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.499+0000 7f0fe8346640 1 -- 172.21.15.44:0/1591586498 shutdown_connections 2024-08-19T00:16:45.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.499+0000 7f0fe8346640 1 --2- 172.21.15.44:0/1591586498 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f0fcc0a2d70 0x7f0fcc0a5230 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:45.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.499+0000 7f0fe8346640 1 --2- 172.21.15.44:0/1591586498 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0fe01078b0 0x7f0fe0074ca0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:45.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.499+0000 7f0fe8346640 1 --2- 172.21.15.44:0/1591586498 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0fe0102250 0x7f0fe0074760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:45.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.499+0000 7f0fe8346640 1 --2- 172.21.15.44:0/1591586498 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0fe01018b0 0x7f0fe0074220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:45.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.499+0000 7f0fe8346640 1 -- 172.21.15.44:0/1591586498 >> 172.21.15.44:0/1591586498 conn(0x7f0fe00fd5f0 msgr2=0x7f0fe00fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:16:45.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.499+0000 7f0fe8346640 1 -- 172.21.15.44:0/1591586498 shutdown_connections 2024-08-19T00:16:45.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:45.499+0000 7f0fe8346640 1 -- 172.21.15.44:0/1591586498 wait complete. 2024-08-19T00:16:45.669 INFO:tasks.workunit.client.0.smithi044.stdout: 1 166746 0.49 MB/sec execute 10 sec latency 29644.982 ms 2024-08-19T00:16:46.528 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'd96e3045', total seconds elapsed: 33.6 2024-08-19T00:16:46.528 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-08-19T00:16:46.528 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-19T00:16:46.669 INFO:tasks.workunit.client.0.smithi044.stdout: 1 169029 1.21 MB/sec execute 11 sec latency 12.732 ms 2024-08-19T00:16:46.794 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:16:46.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:16:46 smithi171 ceph-mon[21810]: pgmap v106: 129 pgs: 129 active+clean; 102 MiB data, 925 MiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 107 KiB/s wr, 39 op/s 2024-08-19T00:16:46.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:16:46 smithi116 ceph-mon[21873]: pgmap v106: 129 pgs: 129 active+clean; 102 MiB data, 925 MiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 107 KiB/s wr, 39 op/s 2024-08-19T00:16:46.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:16:46 smithi044 ceph-mon[18489]: pgmap v106: 129 pgs: 129 active+clean; 102 MiB data, 925 MiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 107 KiB/s wr, 39 op/s 2024-08-19T00:16:47.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:47.269+0000 7fbcc7c29640 1 -- 172.21.15.44:0/406453278 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcc01078e0 msgr2=0x7fbcc0107cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:47.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:47.269+0000 7fbcc7c29640 1 --2- 172.21.15.44:0/406453278 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcc01078e0 0x7fbcc0107cc0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0009cd0 tx=0x7fbcb002a8e0 comp rx=0 tx=0).stop 2024-08-19T00:16:47.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:47.269+0000 7fbcc7c29640 1 -- 172.21.15.44:0/406453278 shutdown_connections 2024-08-19T00:16:47.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:47.269+0000 7fbcc7c29640 1 --2- 172.21.15.44:0/406453278 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbcc0102280 0x7fbcc010e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:47.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:47.269+0000 7fbcc7c29640 1 --2- 172.21.15.44:0/406453278 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbcc01018e0 0x7fbcc0101d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:47.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:47.269+0000 7fbcc7c29640 1 --2- 172.21.15.44:0/406453278 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcc01078e0 0x7fbcc0107cc0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:47.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:47.269+0000 7fbcc7c29640 1 -- 172.21.15.44:0/406453278 >> 172.21.15.44:0/406453278 conn(0x7fbcc00fd600 msgr2=0x7fbcc00ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:16:47.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:47.269+0000 7fbcc7c29640 1 -- 172.21.15.44:0/406453278 shutdown_connections 2024-08-19T00:16:47.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:47.269+0000 7fbcc7c29640 1 -- 172.21.15.44:0/406453278 wait complete. 2024-08-19T00:16:47.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:47.269+0000 7fbcc7c29640 1 Processor -- start 2024-08-19T00:16:47.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:47.269+0000 7fbcc7c29640 1 -- start start 2024-08-19T00:16:47.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:47.270+0000 7fbcc7c29640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcc01018e0 0x7fbcc01981a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:47.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:47.270+0000 7fbcc7c29640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbcc0102280 0x7fbcc01986e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:47.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:47.270+0000 7fbcc7c29640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbcc01078e0 0x7fbcc019ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:47.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:47.270+0000 7fbcc7c29640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc0111ce0 con 0x7fbcc01018e0 2024-08-19T00:16:47.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:47.270+0000 7fbcc7c29640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc0111b60 con 0x7fbcc0102280 2024-08-19T00:16:47.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:47.270+0000 7fbcc7c29640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc0111e60 con 0x7fbcc01078e0 2024-08-19T00:16:47.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:47.270+0000 7fbcc59c5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcc01018e0 0x7fbcc01981a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:47.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:47.270+0000 7fbcc59c5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcc01018e0 0x7fbcc01981a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38800/0 (socket says 172.21.15.44:38800) 2024-08-19T00:16:47.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:47.270+0000 7fbcc59c5640 1 -- 172.21.15.44:0/563231889 learned_addr learned my addr 172.21.15.44:0/563231889 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:16:47.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:47.270+0000 7fbcc61c6640 1 --2- 172.21.15.44:0/563231889 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbcc01078e0 0x7fbcc019ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:47.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:47.270+0000 7fbcc51c4640 1 --2- 172.21.15.44:0/563231889 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbcc0102280 0x7fbcc01986e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:47.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:47.270+0000 7fbcc59c5640 1 -- 172.21.15.44:0/563231889 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbcc01078e0 msgr2=0x7fbcc019ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:47.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:47.270+0000 7fbcc59c5640 1 --2- 172.21.15.44:0/563231889 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbcc01078e0 0x7fbcc019ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:47.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:47.270+0000 7fbcc59c5640 1 -- 172.21.15.44:0/563231889 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbcc0102280 msgr2=0x7fbcc01986e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:47.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:47.270+0000 7fbcc59c5640 1 --2- 172.21.15.44:0/563231889 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbcc0102280 0x7fbcc01986e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:47.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:47.270+0000 7fbcc59c5640 1 -- 172.21.15.44:0/563231889 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcc019d150 con 0x7fbcc01018e0 2024-08-19T00:16:47.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:47.270+0000 7fbcc59c5640 1 --2- 172.21.15.44:0/563231889 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcc01018e0 0x7fbcc01981a0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fbcb002ae00 tx=0x7fbcb0031e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:16:47.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:47.270+0000 7fbcbeffd640 1 -- 172.21.15.44:0/563231889 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb0003e00 con 0x7fbcc01018e0 2024-08-19T00:16:47.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:47.271+0000 7fbcbeffd640 1 -- 172.21.15.44:0/563231889 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbcb0004520 con 0x7fbcc01018e0 2024-08-19T00:16:47.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:47.271+0000 7fbcc7c29640 1 -- 172.21.15.44:0/563231889 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcc019d3e0 con 0x7fbcc01018e0 2024-08-19T00:16:47.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:47.271+0000 7fbcbeffd640 1 -- 172.21.15.44:0/563231889 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb0030de0 con 0x7fbcc01018e0 2024-08-19T00:16:47.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:47.271+0000 7fbcc7c29640 1 -- 172.21.15.44:0/563231889 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcc01a4d20 con 0x7fbcc01018e0 2024-08-19T00:16:47.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:47.272+0000 7fbcc7c29640 1 -- 172.21.15.44:0/563231889 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcc0101d40 con 0x7fbcc01018e0 2024-08-19T00:16:47.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:47.273+0000 7fbcbeffd640 1 -- 172.21.15.44:0/563231889 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fbcb00046d0 con 0x7fbcc01018e0 2024-08-19T00:16:47.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:47.274+0000 7fbcbeffd640 1 --2- 172.21.15.44:0/563231889 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fbca80a2d70 0x7fbca80a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:47.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:47.274+0000 7fbcc51c4640 1 --2- 172.21.15.44:0/563231889 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fbca80a2d70 0x7fbca80a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:47.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:47.274+0000 7fbcbeffd640 1 -- 172.21.15.44:0/563231889 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7fbcb002e030 con 0x7fbcc01018e0 2024-08-19T00:16:47.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:47.274+0000 7fbcc51c4640 1 --2- 172.21.15.44:0/563231889 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fbca80a2d70 0x7fbca80a5230 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbcc0106ec0 tx=0x7fbcb4005f90 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:16:47.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:47.277+0000 7fbcbeffd640 1 -- 172.21.15.44:0/563231889 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fbcb004b060 con 0x7fbcc01018e0 2024-08-19T00:16:47.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:47.494+0000 7fbcc7c29640 1 -- 172.21.15.44:0/563231889 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbcc0109e50 con 0x7fbcc01018e0 2024-08-19T00:16:47.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:47.495+0000 7fbcbeffd640 1 -- 172.21.15.44:0/563231889 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11992 (secure 0 0 0) 0x7fbcb00bd490 con 0x7fbcc01018e0 2024-08-19T00:16:47.496 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:16:47.496 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":31,"btime":"2024-08-19T00:16:42:359013+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14511,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1538841896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1538841896},{"type":"v1","addr":"172.21.15.116:6833","nonce":1538841896}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/4044471606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4044471606},{"type":"v1","addr":"172.21.15.44:6835","nonce":4044471606}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":31,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-19T00:10:53.196636+0000","modified":"2024-08-19T00:16:41.585517+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24473,"mds_1":24446,"mds_2":24439,"mds_3":24431,"mds_4":24418},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14529":{"gid":14529,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6837/1824829052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1824829052},{"type":"v1","addr":"172.21.15.44:6837","nonce":1824829052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14577":{"gid":14577,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6839/3591739042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":3591739042},{"type":"v1","addr":"172.21.15.44:6839","nonce":3591739042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14589":{"gid":14589,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6841/3667695717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6840","nonce":3667695717},{"type":"v1","addr":"172.21.15.44:6841","nonce":3667695717}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24388":{"gid":24388,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1183022838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1183022838},{"type":"v1","addr":"172.21.15.171:6833","nonce":1183022838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6835/2190623851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":2190623851},{"type":"v1","addr":"172.21.15.171:6835","nonce":2190623851}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.171:6837/316231795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":316231795},{"type":"v1","addr":"172.21.15.171:6837","nonce":316231795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":20,"addr":"172.21.15.116:6835/3507399322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3507399322},{"type":"v1","addr":"172.21.15.116:6835","nonce":3507399322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.171:6839/1466585795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":1466585795},{"type":"v1","addr":"172.21.15.171:6839","nonce":1466585795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":17,"addr":"172.21.15.116:6837/2764513846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":2764513846},{"type":"v1","addr":"172.21.15.116:6837","nonce":2764513846}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.116:6839/1032741033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":1032741033},{"type":"v1","addr":"172.21.15.116:6839","nonce":1032741033}]},"join_fscid":-1,"export_targets":[2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24446,24439,24431,24418]},"id":1}]} 2024-08-19T00:16:47.497 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 31 2024-08-19T00:16:47.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:47.497+0000 7fbcc7c29640 1 -- 172.21.15.44:0/563231889 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fbca80a2d70 msgr2=0x7fbca80a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:47.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:47.497+0000 7fbcc7c29640 1 --2- 172.21.15.44:0/563231889 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fbca80a2d70 0x7fbca80a5230 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbcc0106ec0 tx=0x7fbcb4005f90 comp rx=0 tx=0).stop 2024-08-19T00:16:47.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:47.497+0000 7fbcc7c29640 1 -- 172.21.15.44:0/563231889 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcc01018e0 msgr2=0x7fbcc01981a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:47.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:47.497+0000 7fbcc7c29640 1 --2- 172.21.15.44:0/563231889 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcc01018e0 0x7fbcc01981a0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fbcb002ae00 tx=0x7fbcb0031e60 comp rx=0 tx=0).stop 2024-08-19T00:16:47.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:47.498+0000 7fbcc7c29640 1 -- 172.21.15.44:0/563231889 shutdown_connections 2024-08-19T00:16:47.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:47.498+0000 7fbcc7c29640 1 --2- 172.21.15.44:0/563231889 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fbca80a2d70 0x7fbca80a5230 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:47.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:47.498+0000 7fbcc7c29640 1 --2- 172.21.15.44:0/563231889 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbcc01078e0 0x7fbcc019ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:47.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:47.498+0000 7fbcc7c29640 1 --2- 172.21.15.44:0/563231889 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbcc0102280 0x7fbcc01986e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:47.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:47.498+0000 7fbcc7c29640 1 --2- 172.21.15.44:0/563231889 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcc01018e0 0x7fbcc01981a0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:47.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:47.498+0000 7fbcc7c29640 1 -- 172.21.15.44:0/563231889 >> 172.21.15.44:0/563231889 conn(0x7fbcc00fd600 msgr2=0x7fbcc00feeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:16:47.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:47.498+0000 7fbcc7c29640 1 -- 172.21.15.44:0/563231889 shutdown_connections 2024-08-19T00:16:47.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:47.498+0000 7fbcc7c29640 1 -- 172.21.15.44:0/563231889 wait complete. 2024-08-19T00:16:47.669 INFO:tasks.workunit.client.0.smithi044.stdout: 1 171064 2.17 MB/sec execute 12 sec latency 49.649 ms 2024-08-19T00:16:48.336 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24473 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0' 2024-08-19T00:16:48.336 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24473 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0 2024-08-19T00:16:48.597 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:16:48.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:16:48 smithi044 ceph-mon[18489]: pgmap v107: 129 pgs: 129 active+clean; 102 MiB data, 925 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 12 op/s 2024-08-19T00:16:48.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:16:48 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/563231889' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:16:48.669 INFO:tasks.workunit.client.0.smithi044.stdout: 1 174099 3.42 MB/sec execute 13 sec latency 13.647 ms 2024-08-19T00:16:48.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:16:48 smithi171 ceph-mon[21810]: pgmap v107: 129 pgs: 129 active+clean; 102 MiB data, 925 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 12 op/s 2024-08-19T00:16:48.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:16:48 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/563231889' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:16:48.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:16:48 smithi116 ceph-mon[21873]: pgmap v107: 129 pgs: 129 active+clean; 102 MiB data, 925 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 12 op/s 2024-08-19T00:16:48.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:16:48 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/563231889' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:16:49.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.101+0000 7f54b9fe8640 1 -- 172.21.15.44:0/3924439942 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54b4103410 msgr2=0x7f54b41078c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:49.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.101+0000 7f54b9fe8640 1 --2- 172.21.15.44:0/3924439942 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54b4103410 0x7f54b41078c0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f549c009cd0 tx=0x7f549c02a8e0 comp rx=0 tx=0).stop 2024-08-19T00:16:49.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.101+0000 7f54b9fe8640 1 -- 172.21.15.44:0/3924439942 shutdown_connections 2024-08-19T00:16:49.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.101+0000 7f54b9fe8640 1 --2- 172.21.15.44:0/3924439942 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f54b4107fd0 0x7f54b410e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:49.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.101+0000 7f54b9fe8640 1 --2- 172.21.15.44:0/3924439942 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54b4103410 0x7f54b41078c0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:49.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.101+0000 7f54b9fe8640 1 --2- 172.21.15.44:0/3924439942 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f54b4102a60 0x7f54b4102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:49.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.101+0000 7f54b9fe8640 1 -- 172.21.15.44:0/3924439942 >> 172.21.15.44:0/3924439942 conn(0x7f54b40fc500 msgr2=0x7f54b40fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:16:49.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.101+0000 7f54b9fe8640 1 -- 172.21.15.44:0/3924439942 shutdown_connections 2024-08-19T00:16:49.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.101+0000 7f54b9fe8640 1 -- 172.21.15.44:0/3924439942 wait complete. 2024-08-19T00:16:49.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.101+0000 7f54b9fe8640 1 Processor -- start 2024-08-19T00:16:49.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.102+0000 7f54b9fe8640 1 -- start start 2024-08-19T00:16:49.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.102+0000 7f54b9fe8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f54b4102a60 0x7f54b41982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:49.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.102+0000 7f54b9fe8640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f54b4103410 0x7f54b4198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:49.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.102+0000 7f54b9fe8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54b4107fd0 0x7f54b419cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:49.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.102+0000 7f54b9fe8640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f54b4111e20 con 0x7f54b4107fd0 2024-08-19T00:16:49.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.102+0000 7f54b9fe8640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f54b4111ca0 con 0x7f54b4102a60 2024-08-19T00:16:49.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.102+0000 7f54b9fe8640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f54b4111fa0 con 0x7f54b4103410 2024-08-19T00:16:49.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.102+0000 7f54b3fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54b4107fd0 0x7f54b419cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:49.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.102+0000 7f54b2ffd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f54b4103410 0x7f54b4198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:49.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.102+0000 7f54b3fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54b4107fd0 0x7f54b419cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53334/0 (socket says 172.21.15.44:53334) 2024-08-19T00:16:49.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.102+0000 7f54b3fff640 1 -- 172.21.15.44:0/3631420401 learned_addr learned my addr 172.21.15.44:0/3631420401 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:16:49.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.102+0000 7f54b37fe640 1 --2- 172.21.15.44:0/3631420401 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f54b4102a60 0x7f54b41982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:49.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.102+0000 7f54b3fff640 1 -- 172.21.15.44:0/3631420401 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f54b4103410 msgr2=0x7f54b4198800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:49.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.102+0000 7f54b3fff640 1 --2- 172.21.15.44:0/3631420401 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f54b4103410 0x7f54b4198800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:49.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.102+0000 7f54b3fff640 1 -- 172.21.15.44:0/3631420401 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f54b4102a60 msgr2=0x7f54b41982c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:49.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.102+0000 7f54b3fff640 1 --2- 172.21.15.44:0/3631420401 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f54b4102a60 0x7f54b41982c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:49.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.102+0000 7f54b3fff640 1 -- 172.21.15.44:0/3631420401 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54b419d270 con 0x7f54b4107fd0 2024-08-19T00:16:49.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.102+0000 7f54b37fe640 1 --2- 172.21.15.44:0/3631420401 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f54b4102a60 0x7f54b41982c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:16:49.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.103+0000 7f54b3fff640 1 --2- 172.21.15.44:0/3631420401 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54b4107fd0 0x7f54b419cb90 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f54ac00e970 tx=0x7f54ac00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:16:49.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.103+0000 7f54b0ff9640 1 -- 172.21.15.44:0/3631420401 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54ac00ccc0 con 0x7f54b4107fd0 2024-08-19T00:16:49.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.103+0000 7f54b9fe8640 1 -- 172.21.15.44:0/3631420401 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54b419d560 con 0x7f54b4107fd0 2024-08-19T00:16:49.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.103+0000 7f54b0ff9640 1 -- 172.21.15.44:0/3631420401 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54ac00ce60 con 0x7f54b4107fd0 2024-08-19T00:16:49.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.103+0000 7f54b0ff9640 1 -- 172.21.15.44:0/3631420401 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54ac010490 con 0x7f54b4107fd0 2024-08-19T00:16:49.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.103+0000 7f54b9fe8640 1 -- 172.21.15.44:0/3631420401 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54b41a4e40 con 0x7f54b4107fd0 2024-08-19T00:16:49.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.105+0000 7f54b0ff9640 1 -- 172.21.15.44:0/3631420401 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f54ac005020 con 0x7f54b4107fd0 2024-08-19T00:16:49.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.106+0000 7f54bc3e6740 1 Processor -- start 2024-08-19T00:16:49.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.106+0000 7f54bc3e6740 1 -- start start 2024-08-19T00:16:49.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.106+0000 7f54bc3e6740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a7de19c130 0x55a7de19c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:49.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.106+0000 7f54b0ff9640 1 --2- 172.21.15.44:0/3631420401 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f54a00a2cf0 0x7f54a00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:49.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.106+0000 7f54bc3e6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a7de19ca50 0x55a7de1a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:49.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.106+0000 7f54bc3e6740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a7de1a7310 0x55a7de1a9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:49.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.106+0000 7f54bc3e6740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a7de101a70 con 0x55a7de19ca50 2024-08-19T00:16:49.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.106+0000 7f54bc3e6740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55a7de099780 con 0x55a7de1a7310 2024-08-19T00:16:49.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.106+0000 7f54bc3e6740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55a7de0fda30 con 0x55a7de19c130 2024-08-19T00:16:49.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.106+0000 7f54b37fe640 1 --2- 172.21.15.44:0/3631420401 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f54a00a2cf0 0x7f54a00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:49.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.106+0000 7f54b0ff9640 1 -- 172.21.15.44:0/3631420401 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f54ac0cfbd0 con 0x7f54b4107fd0 2024-08-19T00:16:49.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.106+0000 7f54b2ffd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a7de19c130 0x55a7de19c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:49.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.106+0000 7f54b2ffd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a7de19c130 0x55a7de19c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.44:33322/0 (socket says 172.21.15.44:33322) 2024-08-19T00:16:49.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.106+0000 7f54b2ffd640 1 -- 172.21.15.44:0/175939615 learned_addr learned my addr 172.21.15.44:0/175939615 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:16:49.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.106+0000 7f54b2ffd640 1 --2- 172.21.15.44:0/175939615 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a7de19ca50 0x55a7de1a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:49.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.107+0000 7f54b3fff640 1 --2- 172.21.15.44:0/175939615 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a7de1a7310 0x55a7de1a9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:49.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.107+0000 7f54b2ffd640 1 -- 172.21.15.44:0/175939615 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a7de1a7310 msgr2=0x55a7de1a9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:16:49.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.107+0000 7f54b2ffd640 1 --2- 172.21.15.44:0/175939615 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a7de1a7310 0x55a7de1a9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:49.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.107+0000 7f54b2ffd640 1 -- 172.21.15.44:0/175939615 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a7de19ca50 msgr2=0x55a7de1a6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:16:49.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.107+0000 7f54b2ffd640 1 --2- 172.21.15.44:0/175939615 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a7de19ca50 0x55a7de1a6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:49.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.107+0000 7f54b2ffd640 1 -- 172.21.15.44:0/175939615 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7dde73b90 con 0x55a7de19c130 2024-08-19T00:16:49.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.107+0000 7f54b3fff640 1 --2- 172.21.15.44:0/175939615 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a7de1a7310 0x55a7de1a9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:16:49.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.107+0000 7f54b37fe640 1 --2- 172.21.15.44:0/3631420401 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f54a00a2cf0 0x7f54a00a51b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f54a4005d00 tx=0x7f54a400b410 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:16:49.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.107+0000 7f54b2ffd640 1 --2- 172.21.15.44:0/175939615 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a7de19c130 0x55a7de19c510 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f549c009ca0 tx=0x7f549c009360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30a1e17c652e98ac server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:16:49.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.107+0000 7f54a9ffb640 1 -- 172.21.15.44:0/175939615 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f549c031430 con 0x55a7de19c130 2024-08-19T00:16:49.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.107+0000 7f54a9ffb640 1 -- 172.21.15.44:0/175939615 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f549c036050 con 0x55a7de19c130 2024-08-19T00:16:49.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.107+0000 7f54a9ffb640 1 -- 172.21.15.44:0/175939615 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f549c0044e0 con 0x55a7de19c130 2024-08-19T00:16:49.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.108+0000 7f54bc3e6740 1 -- 172.21.15.44:0/175939615 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a7de19c130 msgr2=0x55a7de19c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:49.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.108+0000 7f54bc3e6740 1 --2- 172.21.15.44:0/175939615 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a7de19c130 0x55a7de19c510 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f549c009ca0 tx=0x7f549c009360 comp rx=0 tx=0).stop 2024-08-19T00:16:49.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.108+0000 7f54bc3e6740 1 -- 172.21.15.44:0/175939615 shutdown_connections 2024-08-19T00:16:49.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.108+0000 7f54bc3e6740 1 --2- 172.21.15.44:0/175939615 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a7de1a7310 0x55a7de1a9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:49.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.108+0000 7f54bc3e6740 1 --2- 172.21.15.44:0/175939615 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a7de19ca50 0x55a7de1a6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:49.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.108+0000 7f54bc3e6740 1 --2- 172.21.15.44:0/175939615 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a7de19c130 0x55a7de19c510 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:49.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.108+0000 7f54bc3e6740 1 -- 172.21.15.44:0/175939615 >> 172.21.15.44:0/175939615 conn(0x55a7de1986c0 msgr2=0x55a7de198aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:16:49.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.108+0000 7f54bc3e6740 1 -- 172.21.15.44:0/175939615 shutdown_connections 2024-08-19T00:16:49.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.108+0000 7f54bc3e6740 1 -- 172.21.15.44:0/175939615 wait complete. 2024-08-19T00:16:49.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.109+0000 7f54bc3e6740 1 -- start start 2024-08-19T00:16:49.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.109+0000 7f54bc3e6740 1 Processor -- start 2024-08-19T00:16:49.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.109+0000 7f54bc3e6740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a7de19c130 0x55a7de1a4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:49.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.109+0000 7f54bc3e6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a7de19ca50 0x55a7de1a47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:49.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.109+0000 7f54bc3e6740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a7de1a7310 0x55a7de1a4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:49.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.109+0000 7f54b2ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a7de19ca50 0x55a7de1a47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:49.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.109+0000 7f54b37fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a7de19c130 0x55a7de1a4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:49.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.109+0000 7f54b2ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a7de19ca50 0x55a7de1a47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53358/0 (socket says 172.21.15.44:53358) 2024-08-19T00:16:49.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.109+0000 7f54b2ffd640 1 -- 172.21.15.44:0/4177528227 learned_addr learned my addr 172.21.15.44:0/4177528227 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:16:49.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.109+0000 7f54b3fff640 1 --2- 172.21.15.44:0/4177528227 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a7de1a7310 0x55a7de1a4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:49.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.109+0000 7f54bc3e6740 1 -- 172.21.15.44:0/4177528227 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a7de1a9ee0 con 0x55a7de19ca50 2024-08-19T00:16:49.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.109+0000 7f54bc3e6740 1 -- 172.21.15.44:0/4177528227 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55a7de0bc990 con 0x55a7de19c130 2024-08-19T00:16:49.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.109+0000 7f54bc3e6740 1 -- 172.21.15.44:0/4177528227 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55a7de1aa060 con 0x55a7de1a7310 2024-08-19T00:16:49.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.110+0000 7f54bc3e6740 10 client.0 _ll_register_callbacks cb 0x55a7dde11090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:16:49.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.110+0000 7f54b37fe640 1 -- 172.21.15.44:0/4177528227 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a7de1a7310 msgr2=0x55a7de1a4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:16:49.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.110+0000 7f54b37fe640 1 --2- 172.21.15.44:0/4177528227 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a7de1a7310 0x55a7de1a4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:49.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.110+0000 7f54b37fe640 1 -- 172.21.15.44:0/4177528227 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a7de19ca50 msgr2=0x55a7de1a47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:16:49.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.110+0000 7f54b37fe640 1 --2- 172.21.15.44:0/4177528227 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a7de19ca50 0x55a7de1a47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:49.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.110+0000 7f54b37fe640 1 -- 172.21.15.44:0/4177528227 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7de0bb6c0 con 0x55a7de19c130 2024-08-19T00:16:49.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.110+0000 7f54b2ffd640 1 --2- 172.21.15.44:0/4177528227 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a7de19ca50 0x55a7de1a47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:16:49.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.110+0000 7f54b37fe640 1 --2- 172.21.15.44:0/4177528227 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a7de19c130 0x55a7de1a4270 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f54a40119e0 tx=0x7f54a4004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad00d632efdcc264 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:16:49.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.110+0000 7f5492ffd640 10 client.0 ms_handle_connect on v2:172.21.15.116:3300/0 2024-08-19T00:16:49.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.110+0000 7f5492ffd640 1 -- 172.21.15.44:0/4177528227 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a401cc50 con 0x55a7de19c130 2024-08-19T00:16:49.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.110+0000 7f54bc3e6740 1 -- 172.21.15.44:0/4177528227 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f549c036050 con 0x55a7de19c130 2024-08-19T00:16:49.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.110+0000 7f5492ffd640 1 -- 172.21.15.44:0/4177528227 <== mon.2 v2:172.21.15.116:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f54a401cdf0 con 0x55a7de19c130 2024-08-19T00:16:49.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.110+0000 7f5492ffd640 1 -- 172.21.15.44:0/4177528227 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f54a4030050 con 0x55a7de19c130 2024-08-19T00:16:49.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.110+0000 7f54bc3e6740 10 client.25484 fetch_fsmap learned FSMap version 31 2024-08-19T00:16:49.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.110+0000 7f54bc3e6740 1 -- 172.21.15.44:0/4177528227 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a7de1b5c30 con 0x55a7de19c130 2024-08-19T00:16:49.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.111+0000 7f5492ffd640 1 -- 172.21.15.44:0/4177528227 <== mon.2 v2:172.21.15.116:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f549c036050 con 0x55a7de19c130 2024-08-19T00:16:49.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.111+0000 7f5492ffd640 1 -- 172.21.15.44:0/4177528227 <== mon.2 v2:172.21.15.116:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f54a401e6a0 con 0x55a7de19c130 2024-08-19T00:16:49.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.111+0000 7f54bc3e6740 10 client.25484 fetch_fsmap finished waiting for FSMap version 31 2024-08-19T00:16:49.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.111+0000 7f54bc3e6740 10 client.25484 resolve_mds: validated gid 24473 aka daemon mds.b 2024-08-19T00:16:49.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.111+0000 7f54bc3e6740 20 client.25484 populate_metadata read hostname 'smithi044' 2024-08-19T00:16:49.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.111+0000 7f54bc3e6740 1 --2- 172.21.15.44:0/4177528227 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55a7de1b71c0 0x55a7de1b9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:49.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.111+0000 7f54bc3e6740 4 client.25484 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:16:49.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.111+0000 7f54bc3e6740 1 -- 172.21.15.44:0/4177528227 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a7de10f1a0 con 0x55a7de1b71c0 2024-08-19T00:16:49.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.111+0000 7f54b2ffd640 1 --2- 172.21.15.44:0/4177528227 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55a7de1b71c0 0x55a7de1b9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:49.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.112+0000 7f54b2ffd640 1 --2- 172.21.15.44:0/4177528227 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55a7de1b71c0 0x55a7de1b9680 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26140d14c47defc8 server_cookie=800e2463c0b7be28 in_seq=0 out_seq=0 2024-08-19T00:16:49.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.112+0000 7f5492ffd640 10 client.25484 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:16:49.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.112+0000 7f5492ffd640 1 -- 172.21.15.44:0/4177528227 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a7de10f1a0 con 0x55a7de1b71c0 2024-08-19T00:16:49.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.112+0000 7f5492ffd640 10 client.25484 handle_command_reply: tid=0 2024-08-19T00:16:49.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.112+0000 7f54bc3e6740 1 client.25484 shutdown 2024-08-19T00:16:49.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.112+0000 7f54bc3e6740 1 -- 172.21.15.44:0/4177528227 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a7de19c130 msgr2=0x55a7de1a4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:49.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.112+0000 7f54bc3e6740 1 --2- 172.21.15.44:0/4177528227 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a7de19c130 0x55a7de1a4270 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f54a40119e0 tx=0x7f54a4004730 comp rx=0 tx=0).stop 2024-08-19T00:16:49.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.113+0000 7f54bc3e6740 1 -- 172.21.15.44:0/4177528227 shutdown_connections 2024-08-19T00:16:49.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.113+0000 7f54bc3e6740 1 --2- 172.21.15.44:0/4177528227 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55a7de1b71c0 0x55a7de1b9680 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:49.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.113+0000 7f54bc3e6740 1 --2- 172.21.15.44:0/4177528227 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a7de1a7310 0x55a7de1a4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:49.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.113+0000 7f54bc3e6740 1 --2- 172.21.15.44:0/4177528227 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a7de19ca50 0x55a7de1a47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:49.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.113+0000 7f54bc3e6740 1 --2- 172.21.15.44:0/4177528227 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a7de19c130 0x55a7de1a4270 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:49.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.113+0000 7f54bc3e6740 1 -- 172.21.15.44:0/4177528227 >> 172.21.15.44:0/4177528227 conn(0x55a7de1986c0 msgr2=0x55a7de19e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:16:49.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.113+0000 7f5492ffd640 0 client.25484 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:16:49.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.113+0000 7f54bc3e6740 1 -- 172.21.15.44:0/4177528227 shutdown_connections 2024-08-19T00:16:49.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.113+0000 7f54bc3e6740 1 -- 172.21.15.44:0/4177528227 wait complete. 2024-08-19T00:16:49.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.113+0000 7f54bc3e6740 20 client.25484 trim_cache size 0 max 16384 2024-08-19T00:16:49.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.133+0000 7f54bc3e6740 1 Processor -- start 2024-08-19T00:16:49.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.133+0000 7f54bc3e6740 1 -- start start 2024-08-19T00:16:49.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.133+0000 7f54bc3e6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a7de19c130 0x55a7de19ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:49.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.133+0000 7f54bc3e6740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a7de19ca50 0x55a7de1a2b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:49.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.133+0000 7f54bc3e6740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a7de1a7310 0x55a7de1bef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:49.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.133+0000 7f54bc3e6740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f54b41aec50 con 0x55a7de19c130 2024-08-19T00:16:49.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.133+0000 7f54bc3e6740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f54b41b07f0 con 0x55a7de19ca50 2024-08-19T00:16:49.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.133+0000 7f54bc3e6740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f54b41af320 con 0x55a7de1a7310 2024-08-19T00:16:49.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.133+0000 7f54b37fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a7de19c130 0x55a7de19ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:49.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.133+0000 7f54b37fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a7de19c130 0x55a7de19ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53362/0 (socket says 172.21.15.44:53362) 2024-08-19T00:16:49.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.133+0000 7f54b37fe640 1 -- 172.21.15.44:0/1351888987 learned_addr learned my addr 172.21.15.44:0/1351888987 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:16:49.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.134+0000 7f54b2ffd640 1 --2- 172.21.15.44:0/1351888987 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a7de19ca50 0x55a7de1a2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:49.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.134+0000 7f54b3fff640 1 --2- 172.21.15.44:0/1351888987 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a7de1a7310 0x55a7de1bef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:49.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.134+0000 7f54b37fe640 1 -- 172.21.15.44:0/1351888987 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a7de1a7310 msgr2=0x55a7de1bef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:16:49.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.134+0000 7f54b37fe640 1 --2- 172.21.15.44:0/1351888987 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a7de1a7310 0x55a7de1bef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:49.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.134+0000 7f54b37fe640 1 -- 172.21.15.44:0/1351888987 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a7de19ca50 msgr2=0x55a7de1a2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:16:49.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.134+0000 7f54b37fe640 1 --2- 172.21.15.44:0/1351888987 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a7de19ca50 0x55a7de1a2b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:49.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.134+0000 7f54b37fe640 1 -- 172.21.15.44:0/1351888987 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7de19fc30 con 0x55a7de19c130 2024-08-19T00:16:49.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.134+0000 7f54b3fff640 1 --2- 172.21.15.44:0/1351888987 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a7de1a7310 0x55a7de1bef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:16:49.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.134+0000 7f54b37fe640 1 --2- 172.21.15.44:0/1351888987 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a7de19c130 0x55a7de19ebe0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f54a401d450 tx=0x7f54a40058f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce3da38ba8850cdd server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:16:49.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.134+0000 7f54a97fa640 1 -- 172.21.15.44:0/1351888987 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a403a070 con 0x55a7de19c130 2024-08-19T00:16:49.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.134+0000 7f54a97fa640 1 -- 172.21.15.44:0/1351888987 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54a4010cd0 con 0x55a7de19c130 2024-08-19T00:16:49.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.134+0000 7f54a97fa640 1 -- 172.21.15.44:0/1351888987 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a4004280 con 0x55a7de19c130 2024-08-19T00:16:49.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.135+0000 7f54bc3e6740 1 -- 172.21.15.44:0/1351888987 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a7de19c130 msgr2=0x55a7de19ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:49.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.135+0000 7f54bc3e6740 1 --2- 172.21.15.44:0/1351888987 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a7de19c130 0x55a7de19ebe0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f54a401d450 tx=0x7f54a40058f0 comp rx=0 tx=0).stop 2024-08-19T00:16:49.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.135+0000 7f54bc3e6740 1 -- 172.21.15.44:0/1351888987 shutdown_connections 2024-08-19T00:16:49.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.135+0000 7f54bc3e6740 1 --2- 172.21.15.44:0/1351888987 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a7de1a7310 0x55a7de1bef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:49.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.135+0000 7f54bc3e6740 1 --2- 172.21.15.44:0/1351888987 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a7de19ca50 0x55a7de1a2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:49.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.135+0000 7f54bc3e6740 1 --2- 172.21.15.44:0/1351888987 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a7de19c130 0x55a7de19ebe0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:49.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.135+0000 7f54bc3e6740 1 -- 172.21.15.44:0/1351888987 >> 172.21.15.44:0/1351888987 conn(0x55a7de1986c0 msgr2=0x55a7de1a62f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:16:49.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.135+0000 7f54bc3e6740 1 -- 172.21.15.44:0/1351888987 shutdown_connections 2024-08-19T00:16:49.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.135+0000 7f54bc3e6740 1 -- 172.21.15.44:0/1351888987 wait complete. 2024-08-19T00:16:49.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.135+0000 7f54bc3e6740 1 -- start start 2024-08-19T00:16:49.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.136+0000 7f54bc3e6740 1 Processor -- start 2024-08-19T00:16:49.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.136+0000 7f54bc3e6740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a7de19c130 0x55a7de1afa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:49.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.136+0000 7f54bc3e6740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a7de19ca50 0x55a7de1aae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:49.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.136+0000 7f54bc3e6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a7de1a7310 0x55a7de1ab360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:49.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.136+0000 7f54bc3e6740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f54b41b00c0 con 0x55a7de1a7310 2024-08-19T00:16:49.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.136+0000 7f54bc3e6740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f54b41af9f0 con 0x55a7de19c130 2024-08-19T00:16:49.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.136+0000 7f54bc3e6740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f54b41acc30 con 0x55a7de19ca50 2024-08-19T00:16:49.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.136+0000 7f54bc3e6740 10 client.0 _ll_register_callbacks cb 0x7f54a400bc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:16:49.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.136+0000 7f54b3fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a7de1a7310 0x55a7de1ab360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:49.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.136+0000 7f54b2ffd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a7de19ca50 0x55a7de1aae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:49.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.136+0000 7f54b3fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a7de1a7310 0x55a7de1ab360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53380/0 (socket says 172.21.15.44:53380) 2024-08-19T00:16:49.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.136+0000 7f54b3fff640 1 -- 172.21.15.44:0/2229085596 learned_addr learned my addr 172.21.15.44:0/2229085596 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:16:49.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.136+0000 7f54b37fe640 1 --2- 172.21.15.44:0/2229085596 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a7de19c130 0x55a7de1afa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:49.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.136+0000 7f54b3fff640 1 -- 172.21.15.44:0/2229085596 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a7de19ca50 msgr2=0x55a7de1aae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:16:49.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.136+0000 7f54b3fff640 1 --2- 172.21.15.44:0/2229085596 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a7de19ca50 0x55a7de1aae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:49.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.136+0000 7f54b3fff640 1 -- 172.21.15.44:0/2229085596 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a7de19c130 msgr2=0x55a7de1afa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:16:49.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.136+0000 7f54b3fff640 1 --2- 172.21.15.44:0/2229085596 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a7de19c130 0x55a7de1afa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:49.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.136+0000 7f54b3fff640 1 -- 172.21.15.44:0/2229085596 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7de1a3220 con 0x55a7de1a7310 2024-08-19T00:16:49.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.136+0000 7f54b37fe640 1 --2- 172.21.15.44:0/2229085596 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a7de19c130 0x55a7de1afa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:16:49.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.136+0000 7f54b3fff640 1 --2- 172.21.15.44:0/2229085596 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a7de1a7310 0x55a7de1ab360 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f54ac00e940 tx=0x7f54ac067130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0147a726097c4ff server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:16:49.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.136+0000 7f5492ffd640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:16:49.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.137+0000 7f5492ffd640 1 -- 172.21.15.44:0/2229085596 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54ac0a49c0 con 0x55a7de1a7310 2024-08-19T00:16:49.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.137+0000 7f54bc3e6740 1 -- 172.21.15.44:0/2229085596 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54a4010cd0 con 0x55a7de1a7310 2024-08-19T00:16:49.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.137+0000 7f5492ffd640 1 -- 172.21.15.44:0/2229085596 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f54ac005310 con 0x55a7de1a7310 2024-08-19T00:16:49.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.137+0000 7f5492ffd640 1 -- 172.21.15.44:0/2229085596 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f54ac09bfb0 con 0x55a7de1a7310 2024-08-19T00:16:49.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.137+0000 7f54bc3e6740 10 client.15984 fetch_fsmap learned FSMap version 31 2024-08-19T00:16:49.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.137+0000 7f54bc3e6740 1 -- 172.21.15.44:0/2229085596 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a7de22a620 con 0x55a7de1a7310 2024-08-19T00:16:49.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.137+0000 7f5492ffd640 1 -- 172.21.15.44:0/2229085596 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54a4010cd0 con 0x55a7de1a7310 2024-08-19T00:16:49.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.137+0000 7f5492ffd640 1 -- 172.21.15.44:0/2229085596 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f54ac09b1a0 con 0x55a7de1a7310 2024-08-19T00:16:49.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.137+0000 7f54bc3e6740 10 client.15984 fetch_fsmap finished waiting for FSMap version 31 2024-08-19T00:16:49.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.137+0000 7f54bc3e6740 10 client.15984 resolve_mds: validated gid 24473 aka daemon mds.b 2024-08-19T00:16:49.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.137+0000 7f54bc3e6740 20 client.15984 populate_metadata read hostname 'smithi044' 2024-08-19T00:16:49.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.137+0000 7f54bc3e6740 1 --2- 172.21.15.44:0/2229085596 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55a7de22ade0 0x55a7de22d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:49.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.137+0000 7f54bc3e6740 4 client.15984 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}] 2024-08-19T00:16:49.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.137+0000 7f54bc3e6740 1 -- 172.21.15.44:0/2229085596 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}) -- 0x55a7de1094f0 con 0x55a7de22ade0 2024-08-19T00:16:49.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.137+0000 7f54b37fe640 1 --2- 172.21.15.44:0/2229085596 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55a7de22ade0 0x55a7de22d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:49.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.138+0000 7f5492ffd640 10 client.15984 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:16:49.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.138+0000 7f54b37fe640 1 --2- 172.21.15.44:0/2229085596 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55a7de22ade0 0x55a7de22d200 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d342812119509fba server_cookie=d2d56bbaa7d4fc29 in_seq=0 out_seq=0 2024-08-19T00:16:49.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.206+0000 7f5492ffd640 1 -- 172.21.15.44:0/2229085596 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55a7de1094f0 con 0x55a7de22ade0 2024-08-19T00:16:49.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.206+0000 7f5492ffd640 10 client.15984 handle_command_reply: tid=0 2024-08-19T00:16:49.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.206+0000 7f54bc3e6740 1 client.15984 shutdown 2024-08-19T00:16:49.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.206+0000 7f54bc3e6740 1 -- 172.21.15.44:0/2229085596 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a7de1a7310 msgr2=0x55a7de1ab360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:49.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.206+0000 7f54bc3e6740 1 --2- 172.21.15.44:0/2229085596 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a7de1a7310 0x55a7de1ab360 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f54ac00e940 tx=0x7f54ac067130 comp rx=0 tx=0).stop 2024-08-19T00:16:49.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.206+0000 7f54bc3e6740 1 -- 172.21.15.44:0/2229085596 shutdown_connections 2024-08-19T00:16:49.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.206+0000 7f54bc3e6740 1 --2- 172.21.15.44:0/2229085596 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55a7de22ade0 0x55a7de22d200 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:49.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.206+0000 7f54bc3e6740 1 --2- 172.21.15.44:0/2229085596 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a7de19ca50 0x55a7de1aae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:49.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.206+0000 7f54bc3e6740 1 --2- 172.21.15.44:0/2229085596 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a7de1a7310 0x55a7de1ab360 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:49.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.206+0000 7f54bc3e6740 1 --2- 172.21.15.44:0/2229085596 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a7de19c130 0x55a7de1afa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:49.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.206+0000 7f54bc3e6740 1 -- 172.21.15.44:0/2229085596 >> 172.21.15.44:0/2229085596 conn(0x55a7de1986c0 msgr2=0x55a7de196ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:16:49.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.206+0000 7f5492ffd640 0 client.15984 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:16:49.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.206+0000 7f54bc3e6740 1 -- 172.21.15.44:0/2229085596 shutdown_connections 2024-08-19T00:16:49.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.207+0000 7f54bc3e6740 1 -- 172.21.15.44:0/2229085596 wait complete. 2024-08-19T00:16:49.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.207+0000 7f54bc3e6740 20 client.15984 trim_cache size 0 max 16384 2024-08-19T00:16:49.209 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-08-19T00:16:49.209 INFO:teuthology.orchestra.run.smithi044.stdout: "epoch": 31, 2024-08-19T00:16:49.210 INFO:teuthology.orchestra.run.smithi044.stdout: "leader": 24473, 2024-08-19T00:16:49.210 INFO:teuthology.orchestra.run.smithi044.stdout: "set_version": 14, 2024-08-19T00:16:49.210 INFO:teuthology.orchestra.run.smithi044.stdout: "sets": { 2024-08-19T00:16:49.210 INFO:teuthology.orchestra.run.smithi044.stdout: "7b2a62c8": { 2024-08-19T00:16:49.210 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 14, 2024-08-19T00:16:49.210 INFO:teuthology.orchestra.run.smithi044.stdout: "age_ref": 0.0, 2024-08-19T00:16:49.210 INFO:teuthology.orchestra.run.smithi044.stdout: "state": { 2024-08-19T00:16:49.210 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "QUIESCED", 2024-08-19T00:16:49.210 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.0 2024-08-19T00:16:49.210 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:16:49.210 INFO:teuthology.orchestra.run.smithi044.stdout: "timeout": 90.0, 2024-08-19T00:16:49.210 INFO:teuthology.orchestra.run.smithi044.stdout: "expiration": 150.0, 2024-08-19T00:16:49.210 INFO:teuthology.orchestra.run.smithi044.stdout: "members": { 2024-08-19T00:16:49.211 INFO:teuthology.orchestra.run.smithi044.stdout: "file:/": { 2024-08-19T00:16:49.211 INFO:teuthology.orchestra.run.smithi044.stdout: "excluded": false, 2024-08-19T00:16:49.211 INFO:teuthology.orchestra.run.smithi044.stdout: "state": { 2024-08-19T00:16:49.211 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "QUIESCED", 2024-08-19T00:16:49.211 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.0 2024-08-19T00:16:49.211 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:16:49.211 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:16:49.211 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:16:49.211 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:16:49.211 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:16:49.211 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-08-19T00:16:49.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.208+0000 7f54b9fe8640 1 -- 172.21.15.44:0/3631420401 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f54a00a2cf0 msgr2=0x7f54a00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:49.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.208+0000 7f54b9fe8640 1 --2- 172.21.15.44:0/3631420401 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f54a00a2cf0 0x7f54a00a51b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f54a4005d00 tx=0x7f54a400b410 comp rx=0 tx=0).stop 2024-08-19T00:16:49.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.208+0000 7f54b9fe8640 1 -- 172.21.15.44:0/3631420401 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54b4107fd0 msgr2=0x7f54b419cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:49.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.208+0000 7f54b9fe8640 1 --2- 172.21.15.44:0/3631420401 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54b4107fd0 0x7f54b419cb90 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f54ac00e970 tx=0x7f54ac00ed70 comp rx=0 tx=0).stop 2024-08-19T00:16:49.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.209+0000 7f54b9fe8640 1 -- 172.21.15.44:0/3631420401 shutdown_connections 2024-08-19T00:16:49.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.209+0000 7f54b9fe8640 1 --2- 172.21.15.44:0/3631420401 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f54a00a2cf0 0x7f54a00a51b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:49.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.209+0000 7f54b9fe8640 1 --2- 172.21.15.44:0/3631420401 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f54b4103410 0x7f54b4198800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:49.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.209+0000 7f54b9fe8640 1 --2- 172.21.15.44:0/3631420401 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54b4107fd0 0x7f54b419cb90 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:49.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.209+0000 7f54b9fe8640 1 --2- 172.21.15.44:0/3631420401 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f54b4102a60 0x7f54b41982c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:49.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.209+0000 7f54b9fe8640 1 -- 172.21.15.44:0/3631420401 >> 172.21.15.44:0/3631420401 conn(0x7f54b40fc500 msgr2=0x7f54b4105ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:16:49.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.209+0000 7f54b9fe8640 1 -- 172.21.15.44:0/3631420401 shutdown_connections 2024-08-19T00:16:49.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:16:49.209+0000 7f54b9fe8640 1 -- 172.21.15.44:0/3631420401 wait complete. 2024-08-19T00:16:49.669 INFO:tasks.workunit.client.0.smithi044.stdout: 1 174803 3.26 MB/sec execute 14 sec latency 523.392 ms 2024-08-19T00:16:50.044 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '7b2a62c8', quiesce took 3.5 seconds. Will release after: 26.5 2024-08-19T00:16:50.644 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:16:50 smithi171 ceph-mon[21810]: pgmap v108: 129 pgs: 129 active+clean; 102 MiB data, 925 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 12 op/s 2024-08-19T00:16:50.669 INFO:tasks.workunit.client.0.smithi044.stdout: 1 174803 3.04 MB/sec execute 15 sec latency 1523.453 ms 2024-08-19T00:16:50.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:16:50 smithi116 ceph-mon[21873]: pgmap v108: 129 pgs: 129 active+clean; 102 MiB data, 925 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 12 op/s 2024-08-19T00:16:50.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:16:50 smithi044 ceph-mon[18489]: pgmap v108: 129 pgs: 129 active+clean; 102 MiB data, 925 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 12 op/s 2024-08-19T00:16:51.670 INFO:tasks.workunit.client.0.smithi044.stdout: 1 174803 2.85 MB/sec execute 16 sec latency 2523.588 ms 2024-08-19T00:16:52.668 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:16:52 smithi116 ceph-mon[21873]: pgmap v109: 129 pgs: 129 active+clean; 106 MiB data, 954 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 620 KiB/s wr, 89 op/s 2024-08-19T00:16:52.669 INFO:tasks.workunit.client.0.smithi044.stdout: 1 174803 2.68 MB/sec execute 17 sec latency 3523.669 ms 2024-08-19T00:16:52.762 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.760+0000 7f0fd894d640 1 -- 172.21.15.44:0/2965208722 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0fd41006e0 msgr2=0x7f0fd4100b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:52.762 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.760+0000 7f0fd894d640 1 --2- 172.21.15.44:0/2965208722 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0fd41006e0 0x7f0fd4100b40 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc009930 tx=0x7f0fbc02a420 comp rx=0 tx=0).stop 2024-08-19T00:16:52.762 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.761+0000 7f0fd894d640 1 -- 172.21.15.44:0/2965208722 shutdown_connections 2024-08-19T00:16:52.763 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.761+0000 7f0fd894d640 1 --2- 172.21.15.44:0/2965208722 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0fd4101080 0x7f0fd410d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:52.763 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.761+0000 7f0fd894d640 1 --2- 172.21.15.44:0/2965208722 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0fd41006e0 0x7f0fd4100b40 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:52.763 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.761+0000 7f0fd894d640 1 --2- 172.21.15.44:0/2965208722 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0fd41066f0 0x7f0fd4106ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:52.763 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.761+0000 7f0fd894d640 1 -- 172.21.15.44:0/2965208722 >> 172.21.15.44:0/2965208722 conn(0x7f0fd40776c0 msgr2=0x7f0fd40fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:16:52.763 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.761+0000 7f0fd894d640 1 -- 172.21.15.44:0/2965208722 shutdown_connections 2024-08-19T00:16:52.763 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.761+0000 7f0fd894d640 1 -- 172.21.15.44:0/2965208722 wait complete. 2024-08-19T00:16:52.765 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.762+0000 7f0fd894d640 1 Processor -- start 2024-08-19T00:16:52.765 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.762+0000 7f0fd894d640 1 -- start start 2024-08-19T00:16:52.765 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.762+0000 7f0fd894d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0fd41006e0 0x7f0fd4197030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:52.765 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.762+0000 7f0fd894d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0fd4101080 0x7f0fd4197570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:52.765 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.762+0000 7f0fd894d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0fd41066f0 0x7f0fd419b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:52.765 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.762+0000 7f0fd894d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd4110b40 con 0x7f0fd41006e0 2024-08-19T00:16:52.765 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.762+0000 7f0fd894d640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd41109c0 con 0x7f0fd41066f0 2024-08-19T00:16:52.765 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.762+0000 7f0fd894d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd4110cc0 con 0x7f0fd4101080 2024-08-19T00:16:52.765 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.762+0000 7f0fd259c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0fd41006e0 0x7f0fd4197030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:52.766 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.762+0000 7f0fd259c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0fd41006e0 0x7f0fd4197030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53392/0 (socket says 172.21.15.44:53392) 2024-08-19T00:16:52.766 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.762+0000 7f0fd259c640 1 -- 172.21.15.44:0/2531669171 learned_addr learned my addr 172.21.15.44:0/2531669171 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:16:52.766 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.762+0000 7f0fd1d9b640 1 --2- 172.21.15.44:0/2531669171 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0fd4101080 0x7f0fd4197570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:52.766 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.763+0000 7f0fd2d9d640 1 --2- 172.21.15.44:0/2531669171 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0fd41066f0 0x7f0fd419b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:52.766 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.763+0000 7f0fd259c640 1 -- 172.21.15.44:0/2531669171 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0fd4101080 msgr2=0x7f0fd4197570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:52.766 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.763+0000 7f0fd259c640 1 --2- 172.21.15.44:0/2531669171 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0fd4101080 0x7f0fd4197570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:52.766 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.763+0000 7f0fd259c640 1 -- 172.21.15.44:0/2531669171 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0fd41066f0 msgr2=0x7f0fd419b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:52.766 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.763+0000 7f0fd259c640 1 --2- 172.21.15.44:0/2531669171 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0fd41066f0 0x7f0fd419b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:52.766 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.763+0000 7f0fd259c640 1 -- 172.21.15.44:0/2531669171 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fd419c020 con 0x7f0fd41006e0 2024-08-19T00:16:52.766 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.763+0000 7f0fd259c640 1 --2- 172.21.15.44:0/2531669171 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0fd41006e0 0x7f0fd4197030 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f0fc400eab0 tx=0x7f0fc400ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:16:52.766 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.763+0000 7f0fcb7fe640 1 -- 172.21.15.44:0/2531669171 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fc400ce40 con 0x7f0fd41006e0 2024-08-19T00:16:52.766 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.763+0000 7f0fcb7fe640 1 -- 172.21.15.44:0/2531669171 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0fc4011950 con 0x7f0fd41006e0 2024-08-19T00:16:52.767 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.763+0000 7f0fd894d640 1 -- 172.21.15.44:0/2531669171 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fd419c310 con 0x7f0fd41006e0 2024-08-19T00:16:52.767 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.763+0000 7f0fcb7fe640 1 -- 172.21.15.44:0/2531669171 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fc4010ae0 con 0x7f0fd41006e0 2024-08-19T00:16:52.767 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.763+0000 7f0fd894d640 1 -- 172.21.15.44:0/2531669171 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fd41a3ba0 con 0x7f0fd41006e0 2024-08-19T00:16:52.767 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.766+0000 7f0fdb7ea740 1 Processor -- start 2024-08-19T00:16:52.769 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.767+0000 7f0fdb7ea740 1 -- start start 2024-08-19T00:16:52.769 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.767+0000 7f0fdb7ea740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5575e11e27d0 0x5575e11e2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:52.770 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.767+0000 7f0fdb7ea740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5575e11e30f0 0x5575e11ed450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:52.770 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.767+0000 7f0fdb7ea740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5575e11ed990 0x5575e11efd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:52.770 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.767+0000 7f0fdb7ea740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5575e11469d0 con 0x5575e11ed990 2024-08-19T00:16:52.770 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.767+0000 7f0fdb7ea740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5575e10ee820 con 0x5575e11e30f0 2024-08-19T00:16:52.770 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.767+0000 7f0fdb7ea740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5575e1142990 con 0x5575e11e27d0 2024-08-19T00:16:52.770 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.767+0000 7f0fd1d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5575e11ed990 0x5575e11efd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:52.770 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.767+0000 7f0fd1d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5575e11ed990 0x5575e11efd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53402/0 (socket says 172.21.15.44:53402) 2024-08-19T00:16:52.770 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.767+0000 7f0fd1d9b640 1 -- 172.21.15.44:0/1557241712 learned_addr learned my addr 172.21.15.44:0/1557241712 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:16:52.770 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.767+0000 7f0fd2d9d640 1 --2- 172.21.15.44:0/1557241712 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5575e11e27d0 0x5575e11e2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:52.770 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.768+0000 7f0fd1d9b640 1 -- 172.21.15.44:0/1557241712 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5575e11e27d0 msgr2=0x5575e11e2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:16:52.770 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.768+0000 7f0fd1d9b640 1 --2- 172.21.15.44:0/1557241712 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5575e11e27d0 0x5575e11e2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:52.770 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.768+0000 7f0fd1d9b640 1 -- 172.21.15.44:0/1557241712 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5575e11e30f0 msgr2=0x5575e11ed450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T00:16:52.771 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.768+0000 7f0fd1d9b640 1 --2- 172.21.15.44:0/1557241712 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5575e11e30f0 0x5575e11ed450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:52.771 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.768+0000 7f0fd1d9b640 1 -- 172.21.15.44:0/1557241712 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575e0e5a210 con 0x5575e11ed990 2024-08-19T00:16:52.771 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.768+0000 7f0fcb7fe640 1 -- 172.21.15.44:0/2531669171 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f0fc4011b00 con 0x7f0fd41006e0 2024-08-19T00:16:52.771 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.768+0000 7f0fd1d9b640 1 --2- 172.21.15.44:0/1557241712 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5575e11ed990 0x5575e11efd80 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc009930 tx=0x7f0fbc005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c61ed23c8a8116b3 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:16:52.771 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.768+0000 7f0fc8ff9640 1 -- 172.21.15.44:0/1557241712 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc035040 con 0x5575e11ed990 2024-08-19T00:16:52.771 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.768+0000 7f0fc8ff9640 1 -- 172.21.15.44:0/1557241712 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0fbc005520 con 0x5575e11ed990 2024-08-19T00:16:52.771 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.768+0000 7f0fc8ff9640 1 -- 172.21.15.44:0/1557241712 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc003830 con 0x5575e11ed990 2024-08-19T00:16:52.771 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.768+0000 7f0fcb7fe640 1 --2- 172.21.15.44:0/2531669171 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f0fc00a2da0 0x7f0fc00a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.769+0000 7f0fd2d9d640 1 --2- 172.21.15.44:0/2531669171 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f0fc00a2da0 0x7f0fc00a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.769+0000 7f0fcb7fe640 1 -- 172.21.15.44:0/2531669171 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f0fc40cfdc0 con 0x7f0fd41006e0 2024-08-19T00:16:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.769+0000 7f0fdb7ea740 1 -- 172.21.15.44:0/1557241712 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5575e11ed990 msgr2=0x5575e11efd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.769+0000 7f0fdb7ea740 1 --2- 172.21.15.44:0/1557241712 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5575e11ed990 0x5575e11efd80 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc009930 tx=0x7f0fbc005c00 comp rx=0 tx=0).stop 2024-08-19T00:16:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.769+0000 7f0fdb7ea740 1 -- 172.21.15.44:0/1557241712 shutdown_connections 2024-08-19T00:16:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.769+0000 7f0fdb7ea740 1 --2- 172.21.15.44:0/1557241712 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5575e11ed990 0x5575e11efd80 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.769+0000 7f0fdb7ea740 1 --2- 172.21.15.44:0/1557241712 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5575e11e30f0 0x5575e11ed450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.769+0000 7f0fdb7ea740 1 --2- 172.21.15.44:0/1557241712 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5575e11e27d0 0x5575e11e2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.769+0000 7f0fdb7ea740 1 -- 172.21.15.44:0/1557241712 >> 172.21.15.44:0/1557241712 conn(0x5575e11ded40 msgr2=0x5575e11df120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:16:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.769+0000 7f0fd2d9d640 1 --2- 172.21.15.44:0/2531669171 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f0fc00a2da0 0x7f0fc00a5260 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc005fd0 tx=0x7f0fcc005cc0 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:16:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.769+0000 7f0fdb7ea740 1 -- 172.21.15.44:0/1557241712 shutdown_connections 2024-08-19T00:16:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.769+0000 7f0fdb7ea740 1 -- 172.21.15.44:0/1557241712 wait complete. 2024-08-19T00:16:52.777 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.769+0000 7f0fdb7ea740 1 -- start start 2024-08-19T00:16:52.777 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.770+0000 7f0fdb7ea740 1 Processor -- start 2024-08-19T00:16:52.777 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.770+0000 7f0fdb7ea740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5575e11e27d0 0x5575e11f09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:52.777 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.770+0000 7f0fdb7ea740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5575e11e30f0 0x5575e11f0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:52.777 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.770+0000 7f0fdb7ea740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5575e11ed990 0x5575e11f1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:52.777 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.770+0000 7f0fdb7ea740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5575e11f0560 con 0x5575e11e30f0 2024-08-19T00:16:52.777 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.770+0000 7f0fdb7ea740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5575e1102520 con 0x5575e11ed990 2024-08-19T00:16:52.777 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.770+0000 7f0fdb7ea740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5575e11f06e0 con 0x5575e11e27d0 2024-08-19T00:16:52.777 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.770+0000 7f0fdb7ea740 10 client.0 _ll_register_callbacks cb 0x5575e0e59a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:16:52.777 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.770+0000 7f0fd1d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5575e11e30f0 0x5575e11f0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:52.777 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.770+0000 7f0fd1d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5575e11e30f0 0x5575e11f0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53416/0 (socket says 172.21.15.44:53416) 2024-08-19T00:16:52.777 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.770+0000 7f0fd1d9b640 1 -- 172.21.15.44:0/4241821197 learned_addr learned my addr 172.21.15.44:0/4241821197 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:16:52.778 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.770+0000 7f0fd2d9d640 1 --2- 172.21.15.44:0/4241821197 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5575e11ed990 0x5575e11f1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:52.778 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.770+0000 7f0fd259c640 1 --2- 172.21.15.44:0/4241821197 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5575e11e27d0 0x5575e11f09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:52.778 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.770+0000 7f0fd1d9b640 1 -- 172.21.15.44:0/4241821197 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5575e11e27d0 msgr2=0x5575e11f09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:16:52.778 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.770+0000 7f0fd1d9b640 1 --2- 172.21.15.44:0/4241821197 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5575e11e27d0 0x5575e11f09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:52.778 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.770+0000 7f0fd1d9b640 1 -- 172.21.15.44:0/4241821197 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5575e11ed990 msgr2=0x5575e11f1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:16:52.778 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.770+0000 7f0fd1d9b640 1 --2- 172.21.15.44:0/4241821197 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5575e11ed990 0x5575e11f1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:52.778 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.770+0000 7f0fd1d9b640 1 -- 172.21.15.44:0/4241821197 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575e0f26620 con 0x5575e11e30f0 2024-08-19T00:16:52.778 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.770+0000 7f0fd259c640 1 --2- 172.21.15.44:0/4241821197 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5575e11e27d0 0x5575e11f09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:16:52.778 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.770+0000 7f0fd1d9b640 1 --2- 172.21.15.44:0/4241821197 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5575e11e30f0 0x5575e11f0f20 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc02a940 tx=0x7f0fbc004bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c40fa2572c9acbbf server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:16:52.778 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.770+0000 7f0fb9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:16:52.778 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.771+0000 7f0fb9ffb640 1 -- 172.21.15.44:0/4241821197 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc053060 con 0x5575e11e30f0 2024-08-19T00:16:52.778 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.771+0000 7f0fb9ffb640 1 -- 172.21.15.44:0/4241821197 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f0fbc0048d0 con 0x5575e11e30f0 2024-08-19T00:16:52.778 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.771+0000 7f0fdb7ea740 1 -- 172.21.15.44:0/4241821197 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0fbc005520 con 0x5575e11e30f0 2024-08-19T00:16:52.779 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.771+0000 7f0fb9ffb640 1 -- 172.21.15.44:0/4241821197 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f0fbc035050 con 0x5575e11e30f0 2024-08-19T00:16:52.779 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.771+0000 7f0fdb7ea740 10 client.15996 fetch_fsmap learned FSMap version 32 2024-08-19T00:16:52.779 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.771+0000 7f0fdb7ea740 1 -- 172.21.15.44:0/4241821197 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5575e11fe4c0 con 0x5575e11e30f0 2024-08-19T00:16:52.779 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.771+0000 7f0fb9ffb640 1 -- 172.21.15.44:0/4241821197 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0fbc005520 con 0x5575e11e30f0 2024-08-19T00:16:52.779 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.771+0000 7f0fb9ffb640 1 -- 172.21.15.44:0/4241821197 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f0fbc031bb0 con 0x5575e11e30f0 2024-08-19T00:16:52.779 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.771+0000 7f0fdb7ea740 10 client.15996 fetch_fsmap finished waiting for FSMap version 32 2024-08-19T00:16:52.779 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.771+0000 7f0fdb7ea740 10 client.15996 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:16:52.779 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.771+0000 7f0fdb7ea740 20 client.15996 populate_metadata read hostname 'smithi044' 2024-08-19T00:16:52.779 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.771+0000 7f0fdb7ea740 1 --2- 172.21.15.44:0/4241821197 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5575e11ff810 0x5575e1201c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:52.779 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.771+0000 7f0fdb7ea740 4 client.15996 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:16:52.779 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.771+0000 7f0fdb7ea740 1 -- 172.21.15.44:0/4241821197 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5575e1154100 con 0x5575e11ff810 2024-08-19T00:16:52.779 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.772+0000 7f0fd259c640 1 --2- 172.21.15.44:0/4241821197 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5575e11ff810 0x5575e1201c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:52.779 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.772+0000 7f0fd259c640 1 --2- 172.21.15.44:0/4241821197 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5575e11ff810 0x5575e1201c00 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef640236600e4ef2 server_cookie=e6160f37cc2f14a in_seq=0 out_seq=0 2024-08-19T00:16:52.780 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.772+0000 7f0fb9ffb640 10 client.15996 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:16:52.780 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.773+0000 7f0fb9ffb640 1 -- 172.21.15.44:0/4241821197 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5575e1154100 con 0x5575e11ff810 2024-08-19T00:16:52.780 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.773+0000 7f0fb9ffb640 10 client.15996 handle_command_reply: tid=0 2024-08-19T00:16:52.780 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.773+0000 7f0fdb7ea740 1 client.15996 shutdown 2024-08-19T00:16:52.780 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.773+0000 7f0fdb7ea740 1 -- 172.21.15.44:0/4241821197 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5575e11e30f0 msgr2=0x5575e11f0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:52.780 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.773+0000 7f0fdb7ea740 1 --2- 172.21.15.44:0/4241821197 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5575e11e30f0 0x5575e11f0f20 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc02a940 tx=0x7f0fbc004bf0 comp rx=0 tx=0).stop 2024-08-19T00:16:52.780 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.773+0000 7f0fdb7ea740 1 -- 172.21.15.44:0/4241821197 shutdown_connections 2024-08-19T00:16:52.780 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.773+0000 7f0fdb7ea740 1 --2- 172.21.15.44:0/4241821197 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5575e11ff810 0x5575e1201c00 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:52.780 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.773+0000 7f0fdb7ea740 1 --2- 172.21.15.44:0/4241821197 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5575e11ed990 0x5575e11f1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:52.780 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.773+0000 7f0fdb7ea740 1 --2- 172.21.15.44:0/4241821197 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5575e11e30f0 0x5575e11f0f20 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:52.780 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.773+0000 7f0fdb7ea740 1 --2- 172.21.15.44:0/4241821197 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5575e11e27d0 0x5575e11f09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:52.780 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.773+0000 7f0fb9ffb640 0 client.15996 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:16:52.780 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.773+0000 7f0fdb7ea740 1 -- 172.21.15.44:0/4241821197 >> 172.21.15.44:0/4241821197 conn(0x5575e11ded40 msgr2=0x5575e11e4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:16:52.780 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.773+0000 7f0fdb7ea740 1 -- 172.21.15.44:0/4241821197 shutdown_connections 2024-08-19T00:16:52.781 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.773+0000 7f0fdb7ea740 1 -- 172.21.15.44:0/4241821197 wait complete. 2024-08-19T00:16:52.781 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.773+0000 7f0fdb7ea740 20 client.15996 trim_cache size 0 max 16384 2024-08-19T00:16:52.794 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.788+0000 7f0fdb7ea740 1 Processor -- start 2024-08-19T00:16:52.794 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.788+0000 7f0fdb7ea740 1 -- start start 2024-08-19T00:16:52.794 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.788+0000 7f0fdb7ea740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5575e11e27d0 0x5575e11ddd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:52.794 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.788+0000 7f0fdb7ea740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5575e11e30f0 0x5575e12071d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:52.794 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.788+0000 7f0fdb7ea740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5575e11ed990 0x5575e1207710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:52.794 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.788+0000 7f0fdb7ea740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd41aca40 con 0x5575e11ed990 2024-08-19T00:16:52.794 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.788+0000 7f0fdb7ea740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd41ae5b0 con 0x5575e11e30f0 2024-08-19T00:16:52.795 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.788+0000 7f0fdb7ea740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd41ad110 con 0x5575e11e27d0 2024-08-19T00:16:52.795 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.788+0000 7f0fd2d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5575e11ed990 0x5575e1207710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:52.795 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.788+0000 7f0fd2d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5575e11ed990 0x5575e1207710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53424/0 (socket says 172.21.15.44:53424) 2024-08-19T00:16:52.795 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.788+0000 7f0fd2d9d640 1 -- 172.21.15.44:0/2413275809 learned_addr learned my addr 172.21.15.44:0/2413275809 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:16:52.795 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.788+0000 7f0fd259c640 1 --2- 172.21.15.44:0/2413275809 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5575e11e27d0 0x5575e11ddd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:52.795 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.788+0000 7f0fd1d9b640 1 --2- 172.21.15.44:0/2413275809 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5575e11e30f0 0x5575e12071d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:52.795 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.788+0000 7f0fd2d9d640 1 -- 172.21.15.44:0/2413275809 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5575e11e27d0 msgr2=0x5575e11ddd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:16:52.795 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.788+0000 7f0fd2d9d640 1 --2- 172.21.15.44:0/2413275809 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5575e11e27d0 0x5575e11ddd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:52.795 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.788+0000 7f0fd2d9d640 1 -- 172.21.15.44:0/2413275809 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5575e11e30f0 msgr2=0x5575e12071d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:16:52.795 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.788+0000 7f0fd2d9d640 1 --2- 172.21.15.44:0/2413275809 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5575e11e30f0 0x5575e12071d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:52.795 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.788+0000 7f0fd2d9d640 1 -- 172.21.15.44:0/2413275809 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575e11dfa30 con 0x5575e11ed990 2024-08-19T00:16:52.795 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.789+0000 7f0fd2d9d640 1 --2- 172.21.15.44:0/2413275809 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5575e11ed990 0x5575e1207710 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc003e30 tx=0x7f0fcc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=538477aeed8a81da server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:16:52.795 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.789+0000 7f0fbbfff640 1 -- 172.21.15.44:0/2413275809 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fcc003e60 con 0x5575e11ed990 2024-08-19T00:16:52.796 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.789+0000 7f0fbbfff640 1 -- 172.21.15.44:0/2413275809 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0fcc005500 con 0x5575e11ed990 2024-08-19T00:16:52.796 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.789+0000 7f0fbbfff640 1 -- 172.21.15.44:0/2413275809 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fcc028680 con 0x5575e11ed990 2024-08-19T00:16:52.796 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.790+0000 7f0fdb7ea740 1 -- 172.21.15.44:0/2413275809 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5575e11ed990 msgr2=0x5575e1207710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:52.796 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.790+0000 7f0fdb7ea740 1 --2- 172.21.15.44:0/2413275809 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5575e11ed990 0x5575e1207710 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc003e30 tx=0x7f0fcc019000 comp rx=0 tx=0).stop 2024-08-19T00:16:52.796 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.790+0000 7f0fdb7ea740 1 -- 172.21.15.44:0/2413275809 shutdown_connections 2024-08-19T00:16:52.796 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.790+0000 7f0fdb7ea740 1 --2- 172.21.15.44:0/2413275809 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5575e11ed990 0x5575e1207710 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:52.796 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.790+0000 7f0fdb7ea740 1 --2- 172.21.15.44:0/2413275809 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5575e11e30f0 0x5575e12071d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:52.796 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.790+0000 7f0fdb7ea740 1 --2- 172.21.15.44:0/2413275809 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5575e11e27d0 0x5575e11ddd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:52.796 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.790+0000 7f0fdb7ea740 1 -- 172.21.15.44:0/2413275809 >> 172.21.15.44:0/2413275809 conn(0x5575e11ded40 msgr2=0x5575e11dd680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:16:52.796 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.790+0000 7f0fdb7ea740 1 -- 172.21.15.44:0/2413275809 shutdown_connections 2024-08-19T00:16:52.796 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.790+0000 7f0fdb7ea740 1 -- 172.21.15.44:0/2413275809 wait complete. 2024-08-19T00:16:52.796 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.790+0000 7f0fdb7ea740 1 -- start start 2024-08-19T00:16:52.796 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.790+0000 7f0fdb7ea740 1 Processor -- start 2024-08-19T00:16:52.797 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.790+0000 7f0fdb7ea740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5575e11e27d0 0x5575e11f6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:52.797 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.790+0000 7f0fdb7ea740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5575e11e30f0 0x5575e11f3390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:52.797 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.790+0000 7f0fdb7ea740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5575e11ed990 0x5575e11f38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:52.797 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.790+0000 7f0fdb7ea740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd41adeb0 con 0x5575e11e30f0 2024-08-19T00:16:52.797 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.790+0000 7f0fdb7ea740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd41ad7e0 con 0x5575e11ed990 2024-08-19T00:16:52.797 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.790+0000 7f0fdb7ea740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd41aaa20 con 0x5575e11e27d0 2024-08-19T00:16:52.797 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.790+0000 7f0fdb7ea740 10 client.0 _ll_register_callbacks cb 0x7f0fcc004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:16:52.797 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.791+0000 7f0fd1d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5575e11e30f0 0x5575e11f3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:52.797 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.791+0000 7f0fd1d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5575e11e30f0 0x5575e11f3390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53434/0 (socket says 172.21.15.44:53434) 2024-08-19T00:16:52.797 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.791+0000 7f0fd1d9b640 1 -- 172.21.15.44:0/1177764394 learned_addr learned my addr 172.21.15.44:0/1177764394 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:16:52.797 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.791+0000 7f0fd259c640 1 --2- 172.21.15.44:0/1177764394 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5575e11e27d0 0x5575e11f6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:52.797 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.791+0000 7f0fd2d9d640 1 --2- 172.21.15.44:0/1177764394 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5575e11ed990 0x5575e11f38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:52.797 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.791+0000 7f0fd1d9b640 1 -- 172.21.15.44:0/1177764394 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5575e11e27d0 msgr2=0x5575e11f6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:16:52.798 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.791+0000 7f0fd1d9b640 1 --2- 172.21.15.44:0/1177764394 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5575e11e27d0 0x5575e11f6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:52.798 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.791+0000 7f0fd1d9b640 1 -- 172.21.15.44:0/1177764394 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5575e11ed990 msgr2=0x5575e11f38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:16:52.798 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.791+0000 7f0fd1d9b640 1 --2- 172.21.15.44:0/1177764394 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5575e11ed990 0x5575e11f38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:52.798 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.791+0000 7f0fd1d9b640 1 -- 172.21.15.44:0/1177764394 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575e11f40d0 con 0x5575e11e30f0 2024-08-19T00:16:52.798 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.791+0000 7f0fd1d9b640 1 --2- 172.21.15.44:0/1177764394 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5575e11e30f0 0x5575e11f3390 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x5575e11ea140 tx=0x7f0fbc031860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84ec489b557766b server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:16:52.798 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.791+0000 7f0fb9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:16:52.798 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.791+0000 7f0fb9ffb640 1 -- 172.21.15.44:0/1177764394 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc053030 con 0x5575e11e30f0 2024-08-19T00:16:52.798 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.791+0000 7f0fb9ffb640 1 -- 172.21.15.44:0/1177764394 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f0fbc031c60 con 0x5575e11e30f0 2024-08-19T00:16:52.798 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.791+0000 7f0fdb7ea740 1 -- 172.21.15.44:0/1177764394 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0fcc005500 con 0x5575e11e30f0 2024-08-19T00:16:52.798 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.791+0000 7f0fb9ffb640 1 -- 172.21.15.44:0/1177764394 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f0fbc004da0 con 0x5575e11e30f0 2024-08-19T00:16:52.798 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.791+0000 7f0fdb7ea740 10 client.16002 fetch_fsmap learned FSMap version 32 2024-08-19T00:16:52.798 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.791+0000 7f0fdb7ea740 1 -- 172.21.15.44:0/1177764394 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5575e126a130 con 0x5575e11e30f0 2024-08-19T00:16:52.798 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.792+0000 7f0fb9ffb640 1 -- 172.21.15.44:0/1177764394 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0fcc005500 con 0x5575e11e30f0 2024-08-19T00:16:52.799 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.792+0000 7f0fb9ffb640 1 -- 172.21.15.44:0/1177764394 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f0fbc05c070 con 0x5575e11e30f0 2024-08-19T00:16:52.799 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.792+0000 7f0fdb7ea740 10 client.16002 fetch_fsmap finished waiting for FSMap version 32 2024-08-19T00:16:52.799 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.792+0000 7f0fdb7ea740 10 client.16002 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:16:52.799 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.792+0000 7f0fdb7ea740 20 client.16002 populate_metadata read hostname 'smithi044' 2024-08-19T00:16:52.799 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.792+0000 7f0fdb7ea740 1 --2- 172.21.15.44:0/1177764394 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5575e126a790 0x5575e126cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:16:52.799 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.792+0000 7f0fdb7ea740 4 client.16002 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-19T00:16:52.799 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.792+0000 7f0fdb7ea740 1 -- 172.21.15.44:0/1177764394 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5575e114e450 con 0x5575e126a790 2024-08-19T00:16:52.799 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.792+0000 7f0fd259c640 1 --2- 172.21.15.44:0/1177764394 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5575e126a790 0x5575e126cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:16:52.799 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.792+0000 7f0fd259c640 1 --2- 172.21.15.44:0/1177764394 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5575e126a790 0x5575e126cbb0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b0cbac8754346ea server_cookie=f6f8ca2733607563 in_seq=0 out_seq=0 2024-08-19T00:16:52.799 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.792+0000 7f0fb9ffb640 10 client.16002 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:16:52.802 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.800+0000 7f0fb9ffb640 1 -- 172.21.15.44:0/1177764394 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5575e114e450 con 0x5575e126a790 2024-08-19T00:16:52.802 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.800+0000 7f0fb9ffb640 10 client.16002 handle_command_reply: tid=0 2024-08-19T00:16:52.802 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.800+0000 7f0fdb7ea740 1 client.16002 shutdown 2024-08-19T00:16:52.803 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.800+0000 7f0fdb7ea740 1 -- 172.21.15.44:0/1177764394 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5575e11e30f0 msgr2=0x5575e11f3390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:52.803 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.800+0000 7f0fdb7ea740 1 --2- 172.21.15.44:0/1177764394 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5575e11e30f0 0x5575e11f3390 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x5575e11ea140 tx=0x7f0fbc031860 comp rx=0 tx=0).stop 2024-08-19T00:16:52.803 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.800+0000 7f0fdb7ea740 1 -- 172.21.15.44:0/1177764394 shutdown_connections 2024-08-19T00:16:52.803 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.800+0000 7f0fdb7ea740 1 --2- 172.21.15.44:0/1177764394 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5575e126a790 0x5575e126cbb0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:52.803 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.800+0000 7f0fdb7ea740 1 --2- 172.21.15.44:0/1177764394 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5575e11ed990 0x5575e11f38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:52.803 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.800+0000 7f0fb9ffb640 0 client.16002 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:16:52.803 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.800+0000 7f0fdb7ea740 1 --2- 172.21.15.44:0/1177764394 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5575e11e30f0 0x5575e11f3390 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:52.803 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.800+0000 7f0fdb7ea740 1 --2- 172.21.15.44:0/1177764394 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5575e11e27d0 0x5575e11f6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:52.803 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.800+0000 7f0fdb7ea740 1 -- 172.21.15.44:0/1177764394 >> 172.21.15.44:0/1177764394 conn(0x5575e11ded40 msgr2=0x5575e11ddea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:16:52.803 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.801+0000 7f0fdb7ea740 1 -- 172.21.15.44:0/1177764394 shutdown_connections 2024-08-19T00:16:52.803 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.801+0000 7f0fdb7ea740 1 -- 172.21.15.44:0/1177764394 wait complete. 2024-08-19T00:16:52.803 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.801+0000 7f0fdb7ea740 20 client.16002 trim_cache size 0 max 16384 2024-08-19T00:16:52.804 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:{ 2024-08-19T00:16:52.804 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "message": "", 2024-08-19T00:16:52.804 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "return_code": 0 2024-08-19T00:16:52.804 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:} 2024-08-19T00:16:52.805 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.801+0000 7f0fd894d640 1 -- 172.21.15.44:0/2531669171 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f0fc00a2da0 msgr2=0x7f0fc00a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:52.805 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.801+0000 7f0fd894d640 1 --2- 172.21.15.44:0/2531669171 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f0fc00a2da0 0x7f0fc00a5260 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc005fd0 tx=0x7f0fcc005cc0 comp rx=0 tx=0).stop 2024-08-19T00:16:52.805 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.801+0000 7f0fd894d640 1 -- 172.21.15.44:0/2531669171 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0fd41006e0 msgr2=0x7f0fd4197030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:16:52.805 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.801+0000 7f0fd894d640 1 --2- 172.21.15.44:0/2531669171 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0fd41006e0 0x7f0fd4197030 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f0fc400eab0 tx=0x7f0fc400ef70 comp rx=0 tx=0).stop 2024-08-19T00:16:52.805 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.801+0000 7f0fd894d640 1 -- 172.21.15.44:0/2531669171 shutdown_connections 2024-08-19T00:16:52.805 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.801+0000 7f0fd894d640 1 --2- 172.21.15.44:0/2531669171 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f0fc00a2da0 0x7f0fc00a5260 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:52.805 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.801+0000 7f0fd894d640 1 --2- 172.21.15.44:0/2531669171 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0fd4101080 0x7f0fd4197570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:52.805 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.801+0000 7f0fd894d640 1 --2- 172.21.15.44:0/2531669171 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0fd41066f0 0x7f0fd419b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:52.805 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.801+0000 7f0fd894d640 1 --2- 172.21.15.44:0/2531669171 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0fd41006e0 0x7f0fd4197030 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:16:52.805 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.801+0000 7f0fd894d640 1 -- 172.21.15.44:0/2531669171 >> 172.21.15.44:0/2531669171 conn(0x7f0fd40776c0 msgr2=0x7f0fd4103470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:16:52.806 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.801+0000 7f0fd894d640 1 -- 172.21.15.44:0/2531669171 shutdown_connections 2024-08-19T00:16:52.806 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:16:52.801+0000 7f0fd894d640 1 -- 172.21.15.44:0/2531669171 wait complete. 2024-08-19T00:16:52.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:16:52 smithi171 ceph-mon[21810]: pgmap v109: 129 pgs: 129 active+clean; 106 MiB data, 954 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 620 KiB/s wr, 89 op/s 2024-08-19T00:16:52.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:16:52 smithi044 ceph-mon[18489]: pgmap v109: 129 pgs: 129 active+clean; 106 MiB data, 954 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 620 KiB/s wr, 89 op/s 2024-08-19T00:16:53.670 INFO:tasks.workunit.client.0.smithi044.stdout: 1 174803 2.54 MB/sec execute 18 sec latency 4523.781 ms 2024-08-19T00:16:53.731 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:16:53 smithi044 ceph-mon[18489]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-19T00:16:53.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:16:53 smithi171 ceph-mon[21810]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-19T00:16:53.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:16:53 smithi116 ceph-mon[21873]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-19T00:16:54.670 INFO:tasks.workunit.client.0.smithi044.stdout: 1 174803 2.40 MB/sec execute 19 sec latency 5523.849 ms 2024-08-19T00:16:54.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:16:54 smithi171 ceph-mon[21810]: pgmap v110: 129 pgs: 129 active+clean; 106 MiB data, 954 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 605 KiB/s wr, 84 op/s 2024-08-19T00:16:54.866 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:16:54 smithi116 ceph-mon[21873]: pgmap v110: 129 pgs: 129 active+clean; 106 MiB data, 954 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 605 KiB/s wr, 84 op/s 2024-08-19T00:16:54.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:16:54 smithi044 ceph-mon[18489]: pgmap v110: 129 pgs: 129 active+clean; 106 MiB data, 954 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 605 KiB/s wr, 84 op/s 2024-08-19T00:16:55.670 INFO:tasks.workunit.client.0.smithi044.stdout: 1 174803 2.28 MB/sec execute 20 sec latency 6523.899 ms 2024-08-19T00:16:56.670 INFO:tasks.workunit.client.0.smithi044.stdout: 1 174803 2.17 MB/sec execute 21 sec latency 7523.962 ms 2024-08-19T00:16:56.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:16:56 smithi171 ceph-mon[21810]: pgmap v111: 129 pgs: 129 active+clean; 106 MiB data, 941 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 618 KiB/s wr, 94 op/s 2024-08-19T00:16:56.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:16:56 smithi116 ceph-mon[21873]: pgmap v111: 129 pgs: 129 active+clean; 106 MiB data, 941 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 618 KiB/s wr, 94 op/s 2024-08-19T00:16:56.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:16:56 smithi044 ceph-mon[18489]: pgmap v111: 129 pgs: 129 active+clean; 106 MiB data, 941 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 618 KiB/s wr, 94 op/s 2024-08-19T00:16:57.670 INFO:tasks.workunit.client.0.smithi044.stdout: 1 174803 2.07 MB/sec execute 22 sec latency 8524.073 ms 2024-08-19T00:16:58.670 INFO:tasks.workunit.client.0.smithi044.stdout: 1 174803 1.98 MB/sec execute 23 sec latency 9524.190 ms 2024-08-19T00:16:58.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:16:58 smithi171 ceph-mon[21810]: pgmap v112: 129 pgs: 129 active+clean; 106 MiB data, 941 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 615 KiB/s wr, 87 op/s 2024-08-19T00:16:58.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:16:58 smithi116 ceph-mon[21873]: pgmap v112: 129 pgs: 129 active+clean; 106 MiB data, 941 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 615 KiB/s wr, 87 op/s 2024-08-19T00:16:58.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:16:58 smithi044 ceph-mon[18489]: pgmap v112: 129 pgs: 129 active+clean; 106 MiB data, 941 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 615 KiB/s wr, 87 op/s 2024-08-19T00:16:59.670 INFO:tasks.workunit.client.0.smithi044.stdout: 1 174803 1.90 MB/sec execute 24 sec latency 10524.293 ms 2024-08-19T00:17:00.670 INFO:tasks.workunit.client.0.smithi044.stdout: 1 174803 1.83 MB/sec execute 25 sec latency 11524.373 ms 2024-08-19T00:17:00.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:17:00 smithi171 ceph-mon[21810]: pgmap v113: 129 pgs: 129 active+clean; 106 MiB data, 941 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 615 KiB/s wr, 87 op/s 2024-08-19T00:17:00.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:17:00 smithi116 ceph-mon[21873]: pgmap v113: 129 pgs: 129 active+clean; 106 MiB data, 941 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 615 KiB/s wr, 87 op/s 2024-08-19T00:17:00.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:17:00 smithi044 ceph-mon[18489]: pgmap v113: 129 pgs: 129 active+clean; 106 MiB data, 941 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 615 KiB/s wr, 87 op/s 2024-08-19T00:17:01.671 INFO:tasks.workunit.client.0.smithi044.stdout: 1 174803 1.76 MB/sec execute 26 sec latency 12524.489 ms 2024-08-19T00:17:01.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:17:01 smithi171 ceph-mon[21810]: pgmap v114: 129 pgs: 129 active+clean; 106 MiB data, 941 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 615 KiB/s wr, 92 op/s 2024-08-19T00:17:01.865 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:17:01 smithi116 ceph-mon[21873]: pgmap v114: 129 pgs: 129 active+clean; 106 MiB data, 941 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 615 KiB/s wr, 92 op/s 2024-08-19T00:17:01.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:17:01 smithi044 ceph-mon[18489]: pgmap v114: 129 pgs: 129 active+clean; 106 MiB data, 941 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 615 KiB/s wr, 92 op/s 2024-08-19T00:17:02.671 INFO:tasks.workunit.client.0.smithi044.stdout: 1 174803 1.69 MB/sec execute 27 sec latency 13524.566 ms 2024-08-19T00:17:03.671 INFO:tasks.workunit.client.0.smithi044.stdout: 1 174803 1.63 MB/sec execute 28 sec latency 14524.681 ms 2024-08-19T00:17:04.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:17:03 smithi171 ceph-mon[21810]: pgmap v115: 129 pgs: 129 active+clean; 106 MiB data, 941 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-08-19T00:17:04.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:17:03 smithi116 ceph-mon[21873]: pgmap v115: 129 pgs: 129 active+clean; 106 MiB data, 941 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-08-19T00:17:04.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:17:03 smithi044 ceph-mon[18489]: pgmap v115: 129 pgs: 129 active+clean; 106 MiB data, 941 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-08-19T00:17:04.671 INFO:tasks.workunit.client.0.smithi044.stdout: 1 174803 1.57 MB/sec execute 29 sec latency 15524.779 ms 2024-08-19T00:17:05.671 INFO:tasks.workunit.client.0.smithi044.stdout: 1 174803 1.52 MB/sec execute 30 sec latency 16524.896 ms 2024-08-19T00:17:05.901 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.899+0000 7f19f5279640 1 -- 172.21.15.44:0/389507752 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19f01010a0 msgr2=0x7f19f010d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:17:05.902 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.899+0000 7f19f5279640 1 --2- 172.21.15.44:0/389507752 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19f01010a0 0x7f19f010d5d0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f19e8009930 tx=0x7f19e802a420 comp rx=0 tx=0).stop 2024-08-19T00:17:05.902 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.900+0000 7f19f5279640 1 -- 172.21.15.44:0/389507752 shutdown_connections 2024-08-19T00:17:05.902 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.900+0000 7f19f5279640 1 --2- 172.21.15.44:0/389507752 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f19f0100700 0x7f19f0100b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:05.902 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.900+0000 7f19f5279640 1 --2- 172.21.15.44:0/389507752 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19f01010a0 0x7f19f010d5d0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:05.902 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.900+0000 7f19f5279640 1 --2- 172.21.15.44:0/389507752 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f19f0106710 0x7f19f0106af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:05.902 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.900+0000 7f19f5279640 1 -- 172.21.15.44:0/389507752 >> 172.21.15.44:0/389507752 conn(0x7f19f00fc420 msgr2=0x7f19f00fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:17:05.902 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.900+0000 7f19f5279640 1 -- 172.21.15.44:0/389507752 shutdown_connections 2024-08-19T00:17:05.902 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.900+0000 7f19f5279640 1 -- 172.21.15.44:0/389507752 wait complete. 2024-08-19T00:17:05.902 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.900+0000 7f19f5279640 1 Processor -- start 2024-08-19T00:17:05.902 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.900+0000 7f19f5279640 1 -- start start 2024-08-19T00:17:05.904 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.901+0000 7f19f5279640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f19f0100700 0x7f19f0197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:05.904 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.901+0000 7f19f5279640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19f01010a0 0x7f19f01984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:05.904 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.901+0000 7f19f5279640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f19f0106710 0x7f19f019c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:05.905 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.901+0000 7f19f5279640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f19f0110b50 con 0x7f19f01010a0 2024-08-19T00:17:05.905 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.901+0000 7f19f5279640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f19f01109d0 con 0x7f19f0100700 2024-08-19T00:17:05.905 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.901+0000 7f19f5279640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f19f0110cd0 con 0x7f19f0106710 2024-08-19T00:17:05.905 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.901+0000 7f19ee7fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19f01010a0 0x7f19f01984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:05.905 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.901+0000 7f19ee7fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19f01010a0 0x7f19f01984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45400/0 (socket says 172.21.15.44:45400) 2024-08-19T00:17:05.905 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.901+0000 7f19ee7fc640 1 -- 172.21.15.44:0/3837684075 learned_addr learned my addr 172.21.15.44:0/3837684075 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:17:05.905 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.901+0000 7f19eeffd640 1 --2- 172.21.15.44:0/3837684075 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f19f0100700 0x7f19f0197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:05.905 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.901+0000 7f19ee7fc640 1 -- 172.21.15.44:0/3837684075 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f19f0106710 msgr2=0x7f19f019c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:17:05.905 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.901+0000 7f19ef7fe640 1 --2- 172.21.15.44:0/3837684075 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f19f0106710 0x7f19f019c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:05.905 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.901+0000 7f19ee7fc640 1 --2- 172.21.15.44:0/3837684075 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f19f0106710 0x7f19f019c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:05.905 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.901+0000 7f19ee7fc640 1 -- 172.21.15.44:0/3837684075 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f19f0100700 msgr2=0x7f19f0197fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:17:05.905 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.901+0000 7f19ee7fc640 1 --2- 172.21.15.44:0/3837684075 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f19f0100700 0x7f19f0197fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:05.905 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.901+0000 7f19ee7fc640 1 -- 172.21.15.44:0/3837684075 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19f019cfa0 con 0x7f19f01010a0 2024-08-19T00:17:05.906 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.901+0000 7f19eeffd640 1 --2- 172.21.15.44:0/3837684075 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f19f0100700 0x7f19f0197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:17:05.906 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.901+0000 7f19ee7fc640 1 --2- 172.21.15.44:0/3837684075 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19f01010a0 0x7f19f01984f0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f19e400c920 tx=0x7f19e400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:17:05.906 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.902+0000 7f19d7fff640 1 -- 172.21.15.44:0/3837684075 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e4007c70 con 0x7f19f01010a0 2024-08-19T00:17:05.906 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.902+0000 7f19d7fff640 1 -- 172.21.15.44:0/3837684075 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19e4007e10 con 0x7f19f01010a0 2024-08-19T00:17:05.906 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.902+0000 7f19f5279640 1 -- 172.21.15.44:0/3837684075 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19f019d290 con 0x7f19f01010a0 2024-08-19T00:17:05.906 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.902+0000 7f19d7fff640 1 -- 172.21.15.44:0/3837684075 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e4018890 con 0x7f19f01010a0 2024-08-19T00:17:05.906 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.902+0000 7f19f5279640 1 -- 172.21.15.44:0/3837684075 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19f01a4b20 con 0x7f19f01010a0 2024-08-19T00:17:05.912 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.904+0000 7f19d7fff640 1 -- 172.21.15.44:0/3837684075 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f19e4018a70 con 0x7f19f01010a0 2024-08-19T00:17:05.912 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.904+0000 7f19f8035740 1 Processor -- start 2024-08-19T00:17:05.912 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.904+0000 7f19f8035740 1 -- start start 2024-08-19T00:17:05.912 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.905+0000 7f19f8035740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569b23ce7d0 0x5569b23cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:05.912 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.905+0000 7f19f8035740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5569b23cf0f0 0x5569b23d9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:05.912 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.905+0000 7f19d7fff640 1 --2- 172.21.15.44:0/3837684075 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f19d80a2e20 0x7f19d80a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:05.913 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.905+0000 7f19f8035740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5569b23d9990 0x5569b23dbd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:05.913 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.905+0000 7f19f8035740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5569b23329d0 con 0x5569b23d9990 2024-08-19T00:17:05.913 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.905+0000 7f19f8035740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5569b22da820 con 0x5569b23ce7d0 2024-08-19T00:17:05.913 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.905+0000 7f19f8035740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5569b232e990 con 0x5569b23cf0f0 2024-08-19T00:17:05.913 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.905+0000 7f19ef7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5569b23d9990 0x5569b23dbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:05.913 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.905+0000 7f19ee7fc640 1 --2- 172.21.15.44:0/3837684075 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f19d80a2e20 0x7f19d80a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:05.913 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.905+0000 7f19ef7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5569b23d9990 0x5569b23dbd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45410/0 (socket says 172.21.15.44:45410) 2024-08-19T00:17:05.913 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.905+0000 7f19ef7fe640 1 -- 172.21.15.44:0/441172058 learned_addr learned my addr 172.21.15.44:0/441172058 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:17:05.913 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.905+0000 7f19d7fff640 1 -- 172.21.15.44:0/3837684075 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f19e40cf950 con 0x7f19f01010a0 2024-08-19T00:17:05.913 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.905+0000 7f19eeffd640 1 --2- 172.21.15.44:0/441172058 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5569b23cf0f0 0x5569b23d9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:05.913 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.905+0000 7f19ef7fe640 1 --2- 172.21.15.44:0/441172058 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569b23ce7d0 0x5569b23cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:05.913 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.905+0000 7f19ef7fe640 1 -- 172.21.15.44:0/441172058 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5569b23cf0f0 msgr2=0x5569b23d9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:17:05.914 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.905+0000 7f19ef7fe640 1 --2- 172.21.15.44:0/441172058 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5569b23cf0f0 0x5569b23d9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:05.914 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.905+0000 7f19ef7fe640 1 -- 172.21.15.44:0/441172058 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569b23ce7d0 msgr2=0x5569b23cebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:17:05.914 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.905+0000 7f19ef7fe640 1 --2- 172.21.15.44:0/441172058 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569b23ce7d0 0x5569b23cebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:05.914 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.905+0000 7f19ef7fe640 1 -- 172.21.15.44:0/441172058 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569b2046210 con 0x5569b23d9990 2024-08-19T00:17:05.914 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.905+0000 7f19ee7fc640 1 --2- 172.21.15.44:0/3837684075 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f19d80a2e20 0x7f19d80a52e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f19e40cd300 tx=0x7f19e404b040 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:17:05.914 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.905+0000 7f19ef7fe640 1 --2- 172.21.15.44:0/441172058 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5569b23d9990 0x5569b23dbd80 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f19e8005c40 tx=0x7f19e80056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6883a4a5934ffbca server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:17:05.914 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.906+0000 7f19d57fa640 1 -- 172.21.15.44:0/441172058 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e8035040 con 0x5569b23d9990 2024-08-19T00:17:05.914 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.906+0000 7f19d57fa640 1 -- 172.21.15.44:0/441172058 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19e8045070 con 0x5569b23d9990 2024-08-19T00:17:05.914 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.906+0000 7f19d57fa640 1 -- 172.21.15.44:0/441172058 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e8003b90 con 0x5569b23d9990 2024-08-19T00:17:05.914 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.906+0000 7f19f8035740 1 -- 172.21.15.44:0/441172058 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5569b23d9990 msgr2=0x5569b23dbd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:17:05.914 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.906+0000 7f19f8035740 1 --2- 172.21.15.44:0/441172058 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5569b23d9990 0x5569b23dbd80 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f19e8005c40 tx=0x7f19e80056d0 comp rx=0 tx=0).stop 2024-08-19T00:17:05.914 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.906+0000 7f19f8035740 1 -- 172.21.15.44:0/441172058 shutdown_connections 2024-08-19T00:17:05.915 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.906+0000 7f19f8035740 1 --2- 172.21.15.44:0/441172058 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5569b23cf0f0 0x5569b23d9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:05.915 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.906+0000 7f19f8035740 1 --2- 172.21.15.44:0/441172058 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5569b23d9990 0x5569b23dbd80 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:05.915 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.906+0000 7f19f8035740 1 --2- 172.21.15.44:0/441172058 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569b23ce7d0 0x5569b23cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:05.915 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.906+0000 7f19f8035740 1 -- 172.21.15.44:0/441172058 >> 172.21.15.44:0/441172058 conn(0x5569b23cad40 msgr2=0x5569b23cb120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:17:05.915 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.906+0000 7f19f8035740 1 -- 172.21.15.44:0/441172058 shutdown_connections 2024-08-19T00:17:05.915 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.906+0000 7f19f8035740 1 -- 172.21.15.44:0/441172058 wait complete. 2024-08-19T00:17:05.915 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.907+0000 7f19f8035740 1 -- start start 2024-08-19T00:17:05.915 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.907+0000 7f19f8035740 1 Processor -- start 2024-08-19T00:17:05.915 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.907+0000 7f19f8035740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5569b23ce7d0 0x5569b23d68b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:05.915 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.907+0000 7f19f8035740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5569b23cf0f0 0x5569b23d6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:05.915 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.907+0000 7f19f8035740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569b23d9990 0x5569b23d7330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:05.915 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.907+0000 7f19f8035740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5569b23dc560 con 0x5569b23cf0f0 2024-08-19T00:17:05.915 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.907+0000 7f19f8035740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5569b22ee520 con 0x5569b23d9990 2024-08-19T00:17:05.916 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.907+0000 7f19f8035740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5569b23dc6e0 con 0x5569b23ce7d0 2024-08-19T00:17:05.916 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.907+0000 7f19f8035740 10 client.0 _ll_register_callbacks cb 0x5569b2045a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:17:05.916 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.907+0000 7f19eeffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5569b23cf0f0 0x5569b23d6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:05.916 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.907+0000 7f19eeffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5569b23cf0f0 0x5569b23d6df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45418/0 (socket says 172.21.15.44:45418) 2024-08-19T00:17:05.916 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.907+0000 7f19eeffd640 1 -- 172.21.15.44:0/2733597576 learned_addr learned my addr 172.21.15.44:0/2733597576 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:17:05.916 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.907+0000 7f19ef7fe640 1 --2- 172.21.15.44:0/2733597576 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5569b23ce7d0 0x5569b23d68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:05.916 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.907+0000 7f19eeffd640 1 -- 172.21.15.44:0/2733597576 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5569b23ce7d0 msgr2=0x5569b23d68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:17:05.916 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.908+0000 7f19eeffd640 1 --2- 172.21.15.44:0/2733597576 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5569b23ce7d0 0x5569b23d68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:05.916 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.908+0000 7f19eeffd640 1 -- 172.21.15.44:0/2733597576 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569b23d9990 msgr2=0x5569b23d7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:17:05.916 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.908+0000 7f19eeffd640 1 --2- 172.21.15.44:0/2733597576 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569b23d9990 0x5569b23d7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:05.916 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.908+0000 7f19eeffd640 1 -- 172.21.15.44:0/2733597576 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569b2112620 con 0x5569b23cf0f0 2024-08-19T00:17:05.916 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.908+0000 7f19ef7fe640 1 --2- 172.21.15.44:0/2733597576 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5569b23ce7d0 0x5569b23d68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:17:05.917 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.908+0000 7f19eeffd640 1 --2- 172.21.15.44:0/2733597576 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5569b23cf0f0 0x5569b23d6df0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f19e0011690 tx=0x7f19e0011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ebe4818a1e7be8b server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:17:05.917 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.908+0000 7f19d2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:17:05.917 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.908+0000 7f19d2ff5640 1 -- 172.21.15.44:0/2733597576 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e0003b70 con 0x5569b23cf0f0 2024-08-19T00:17:05.917 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.908+0000 7f19d2ff5640 1 -- 172.21.15.44:0/2733597576 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f19e0003d10 con 0x5569b23cf0f0 2024-08-19T00:17:05.917 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.908+0000 7f19f8035740 1 -- 172.21.15.44:0/2733597576 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f19e8045070 con 0x5569b23cf0f0 2024-08-19T00:17:05.917 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.908+0000 7f19d2ff5640 1 -- 172.21.15.44:0/2733597576 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f19e0024050 con 0x5569b23cf0f0 2024-08-19T00:17:05.917 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.908+0000 7f19f8035740 10 client.16014 fetch_fsmap learned FSMap version 32 2024-08-19T00:17:05.917 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.908+0000 7f19f8035740 1 -- 172.21.15.44:0/2733597576 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5569b23e8270 con 0x5569b23cf0f0 2024-08-19T00:17:05.917 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.908+0000 7f19d2ff5640 1 -- 172.21.15.44:0/2733597576 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19e8045070 con 0x5569b23cf0f0 2024-08-19T00:17:05.917 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.908+0000 7f19d2ff5640 1 -- 172.21.15.44:0/2733597576 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f19e000f040 con 0x5569b23cf0f0 2024-08-19T00:17:05.917 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.908+0000 7f19f8035740 10 client.16014 fetch_fsmap finished waiting for FSMap version 32 2024-08-19T00:17:05.917 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.908+0000 7f19f8035740 10 client.16014 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:17:05.917 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.908+0000 7f19f8035740 20 client.16014 populate_metadata read hostname 'smithi044' 2024-08-19T00:17:05.917 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.909+0000 7f19f8035740 1 --2- 172.21.15.44:0/2733597576 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5569b23e97a0 0x5569b23ebb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:05.918 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.909+0000 7f19f8035740 4 client.16014 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:17:05.918 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.909+0000 7f19f8035740 1 -- 172.21.15.44:0/2733597576 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5569b2340100 con 0x5569b23e97a0 2024-08-19T00:17:05.918 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.909+0000 7f19ef7fe640 1 --2- 172.21.15.44:0/2733597576 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5569b23e97a0 0x5569b23ebb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:05.918 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.909+0000 7f19d2ff5640 10 client.16014 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:17:05.918 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.909+0000 7f19ef7fe640 1 --2- 172.21.15.44:0/2733597576 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5569b23e97a0 0x5569b23ebb90 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd482737c2f01f99 server_cookie=618198f700be48a9 in_seq=0 out_seq=0 2024-08-19T00:17:05.918 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.910+0000 7f19d2ff5640 1 -- 172.21.15.44:0/2733597576 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5569b2340100 con 0x5569b23e97a0 2024-08-19T00:17:05.918 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.910+0000 7f19d2ff5640 10 client.16014 handle_command_reply: tid=0 2024-08-19T00:17:05.918 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.910+0000 7f19f8035740 1 client.16014 shutdown 2024-08-19T00:17:05.918 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.910+0000 7f19f8035740 1 -- 172.21.15.44:0/2733597576 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5569b23cf0f0 msgr2=0x5569b23d6df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:17:05.918 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.910+0000 7f19f8035740 1 --2- 172.21.15.44:0/2733597576 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5569b23cf0f0 0x5569b23d6df0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f19e0011690 tx=0x7f19e0011b50 comp rx=0 tx=0).stop 2024-08-19T00:17:05.918 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.910+0000 7f19f8035740 1 -- 172.21.15.44:0/2733597576 shutdown_connections 2024-08-19T00:17:05.918 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.910+0000 7f19f8035740 1 --2- 172.21.15.44:0/2733597576 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5569b23e97a0 0x5569b23ebb90 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:05.919 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.910+0000 7f19f8035740 1 --2- 172.21.15.44:0/2733597576 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569b23d9990 0x5569b23d7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:05.919 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.910+0000 7f19f8035740 1 --2- 172.21.15.44:0/2733597576 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5569b23cf0f0 0x5569b23d6df0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:05.919 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.910+0000 7f19f8035740 1 --2- 172.21.15.44:0/2733597576 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5569b23ce7d0 0x5569b23d68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:05.919 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.910+0000 7f19d2ff5640 0 client.16014 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:17:05.919 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.910+0000 7f19f8035740 1 -- 172.21.15.44:0/2733597576 >> 172.21.15.44:0/2733597576 conn(0x5569b23cad40 msgr2=0x5569b23d0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:17:05.919 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.911+0000 7f19f8035740 1 -- 172.21.15.44:0/2733597576 shutdown_connections 2024-08-19T00:17:05.919 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.911+0000 7f19f8035740 1 -- 172.21.15.44:0/2733597576 wait complete. 2024-08-19T00:17:05.919 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.911+0000 7f19f8035740 20 client.16014 trim_cache size 0 max 16384 2024-08-19T00:17:05.931 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.925+0000 7f19f8035740 1 Processor -- start 2024-08-19T00:17:05.931 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.925+0000 7f19f8035740 1 -- start start 2024-08-19T00:17:05.931 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.925+0000 7f19f8035740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5569b23ce7d0 0x5569b23d7160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:05.931 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.925+0000 7f19f8035740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5569b23cf0f0 0x5569b23f14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:05.931 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.925+0000 7f19f8035740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569b23d9990 0x5569b23f1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:05.931 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.926+0000 7f19f8035740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f19f01aeb70 con 0x5569b23ce7d0 2024-08-19T00:17:05.931 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.926+0000 7f19f8035740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f19f01b06e0 con 0x5569b23d9990 2024-08-19T00:17:05.932 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.926+0000 7f19f8035740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f19f01af240 con 0x5569b23cf0f0 2024-08-19T00:17:05.932 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.926+0000 7f19ef7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5569b23ce7d0 0x5569b23d7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:05.932 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.926+0000 7f19ef7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5569b23ce7d0 0x5569b23d7160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45434/0 (socket says 172.21.15.44:45434) 2024-08-19T00:17:05.932 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.926+0000 7f19ef7fe640 1 -- 172.21.15.44:0/3503426088 learned_addr learned my addr 172.21.15.44:0/3503426088 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:17:05.932 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.926+0000 7f19ef7fe640 1 --2- 172.21.15.44:0/3503426088 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569b23d9990 0x5569b23f1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:05.932 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.926+0000 7f19eeffd640 1 --2- 172.21.15.44:0/3503426088 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5569b23cf0f0 0x5569b23f14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:05.932 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.926+0000 7f19ef7fe640 1 -- 172.21.15.44:0/3503426088 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5569b23cf0f0 msgr2=0x5569b23f14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:17:05.932 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.926+0000 7f19ef7fe640 1 --2- 172.21.15.44:0/3503426088 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5569b23cf0f0 0x5569b23f14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:05.932 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.926+0000 7f19ef7fe640 1 -- 172.21.15.44:0/3503426088 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569b23d9990 msgr2=0x5569b23f1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:17:05.932 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.926+0000 7f19ef7fe640 1 --2- 172.21.15.44:0/3503426088 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569b23d9990 0x5569b23f1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:05.932 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.926+0000 7f19ef7fe640 1 -- 172.21.15.44:0/3503426088 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569b23ebf00 con 0x5569b23ce7d0 2024-08-19T00:17:05.932 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.926+0000 7f19eeffd640 1 --2- 172.21.15.44:0/3503426088 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5569b23cf0f0 0x5569b23f14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:17:05.932 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.926+0000 7f19ef7fe640 1 --2- 172.21.15.44:0/3503426088 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5569b23ce7d0 0x5569b23d7160 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f19e8009900 tx=0x7f19e8003690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4825f318c65f1f2f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:17:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.926+0000 7f19d4ff9640 1 -- 172.21.15.44:0/3503426088 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e8035040 con 0x5569b23ce7d0 2024-08-19T00:17:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.926+0000 7f19d4ff9640 1 -- 172.21.15.44:0/3503426088 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19e8045040 con 0x5569b23ce7d0 2024-08-19T00:17:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.926+0000 7f19d4ff9640 1 -- 172.21.15.44:0/3503426088 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e803c640 con 0x5569b23ce7d0 2024-08-19T00:17:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.927+0000 7f19f8035740 1 -- 172.21.15.44:0/3503426088 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5569b23ce7d0 msgr2=0x5569b23d7160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:17:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.927+0000 7f19f8035740 1 --2- 172.21.15.44:0/3503426088 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5569b23ce7d0 0x5569b23d7160 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f19e8009900 tx=0x7f19e8003690 comp rx=0 tx=0).stop 2024-08-19T00:17:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.927+0000 7f19f8035740 1 -- 172.21.15.44:0/3503426088 shutdown_connections 2024-08-19T00:17:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.927+0000 7f19f8035740 1 --2- 172.21.15.44:0/3503426088 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5569b23cf0f0 0x5569b23f14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.927+0000 7f19f8035740 1 --2- 172.21.15.44:0/3503426088 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569b23d9990 0x5569b23f1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.927+0000 7f19f8035740 1 --2- 172.21.15.44:0/3503426088 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5569b23ce7d0 0x5569b23d7160 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.927+0000 7f19f8035740 1 -- 172.21.15.44:0/3503426088 >> 172.21.15.44:0/3503426088 conn(0x5569b23cad40 msgr2=0x5569b23cb120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:17:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.927+0000 7f19f8035740 1 -- 172.21.15.44:0/3503426088 shutdown_connections 2024-08-19T00:17:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.927+0000 7f19f8035740 1 -- 172.21.15.44:0/3503426088 wait complete. 2024-08-19T00:17:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.927+0000 7f19f8035740 1 -- start start 2024-08-19T00:17:05.934 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.927+0000 7f19f8035740 1 Processor -- start 2024-08-19T00:17:05.934 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.928+0000 7f19f8035740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569b23ce7d0 0x5569b23dd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:05.934 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.928+0000 7f19f8035740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5569b23cf0f0 0x5569b23dd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:05.934 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.928+0000 7f19f8035740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5569b23d9990 0x5569b244c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:05.934 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.928+0000 7f19f8035740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f19f01affe0 con 0x5569b23cf0f0 2024-08-19T00:17:05.934 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.928+0000 7f19f8035740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f19f01af910 con 0x5569b23ce7d0 2024-08-19T00:17:05.934 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.928+0000 7f19f8035740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f19f01acb50 con 0x5569b23d9990 2024-08-19T00:17:05.934 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.928+0000 7f19f8035740 10 client.0 _ll_register_callbacks cb 0x7f19e0009e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:17:05.934 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.928+0000 7f19eeffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5569b23cf0f0 0x5569b23dd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:05.934 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.928+0000 7f19eeffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5569b23cf0f0 0x5569b23dd670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45438/0 (socket says 172.21.15.44:45438) 2024-08-19T00:17:05.934 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.928+0000 7f19eeffd640 1 -- 172.21.15.44:0/1450936590 learned_addr learned my addr 172.21.15.44:0/1450936590 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:17:05.934 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.928+0000 7f19ef7fe640 1 --2- 172.21.15.44:0/1450936590 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569b23ce7d0 0x5569b23dd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:05.934 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.928+0000 7f19ef7fe640 1 --2- 172.21.15.44:0/1450936590 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5569b23d9990 0x5569b244c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.928+0000 7f19eeffd640 1 -- 172.21.15.44:0/1450936590 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5569b23d9990 msgr2=0x5569b244c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:17:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.928+0000 7f19eeffd640 1 --2- 172.21.15.44:0/1450936590 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5569b23d9990 0x5569b244c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.928+0000 7f19eeffd640 1 -- 172.21.15.44:0/1450936590 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569b23ce7d0 msgr2=0x5569b23dd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:17:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.928+0000 7f19eeffd640 1 --2- 172.21.15.44:0/1450936590 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569b23ce7d0 0x5569b23dd130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.928+0000 7f19eeffd640 1 -- 172.21.15.44:0/1450936590 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569b244cb70 con 0x5569b23cf0f0 2024-08-19T00:17:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.928+0000 7f19ef7fe640 1 --2- 172.21.15.44:0/1450936590 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5569b23d9990 0x5569b244c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:17:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.928+0000 7f19eeffd640 1 --2- 172.21.15.44:0/1450936590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5569b23cf0f0 0x5569b23dd670 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f19e000a010 tx=0x7f19e000f2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2df9728b6fb93148 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:17:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.928+0000 7f19d2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:17:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.928+0000 7f19d2ff5640 1 -- 172.21.15.44:0/1450936590 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e000f730 con 0x5569b23cf0f0 2024-08-19T00:17:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.928+0000 7f19d2ff5640 1 -- 172.21.15.44:0/1450936590 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f19e0004c10 con 0x5569b23cf0f0 2024-08-19T00:17:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.928+0000 7f19f8035740 1 -- 172.21.15.44:0/1450936590 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f19e8045040 con 0x5569b23cf0f0 2024-08-19T00:17:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.929+0000 7f19d2ff5640 1 -- 172.21.15.44:0/1450936590 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f19e0038050 con 0x5569b23cf0f0 2024-08-19T00:17:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.929+0000 7f19f8035740 10 client.16020 fetch_fsmap learned FSMap version 32 2024-08-19T00:17:05.936 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.929+0000 7f19f8035740 1 -- 172.21.15.44:0/1450936590 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5569b2453e80 con 0x5569b23cf0f0 2024-08-19T00:17:05.936 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.929+0000 7f19d2ff5640 1 -- 172.21.15.44:0/1450936590 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19e8045040 con 0x5569b23cf0f0 2024-08-19T00:17:05.936 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.929+0000 7f19d2ff5640 1 -- 172.21.15.44:0/1450936590 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f19e0005610 con 0x5569b23cf0f0 2024-08-19T00:17:05.936 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.929+0000 7f19f8035740 10 client.16020 fetch_fsmap finished waiting for FSMap version 32 2024-08-19T00:17:05.936 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.929+0000 7f19f8035740 10 client.16020 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:17:05.936 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.929+0000 7f19f8035740 20 client.16020 populate_metadata read hostname 'smithi044' 2024-08-19T00:17:05.936 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.929+0000 7f19f8035740 1 --2- 172.21.15.44:0/1450936590 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5569b2454620 0x5569b2456a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:05.936 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.929+0000 7f19f8035740 4 client.16020 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-19T00:17:05.936 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.929+0000 7f19f8035740 1 -- 172.21.15.44:0/1450936590 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5569b233a450 con 0x5569b2454620 2024-08-19T00:17:05.936 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.929+0000 7f19ef7fe640 1 --2- 172.21.15.44:0/1450936590 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5569b2454620 0x5569b2456a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:05.936 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.930+0000 7f19d2ff5640 10 client.16020 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:17:05.936 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.930+0000 7f19ef7fe640 1 --2- 172.21.15.44:0/1450936590 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5569b2454620 0x5569b2456a40 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5f65d72eb0c4834 server_cookie=eda9eb26267630e7 in_seq=0 out_seq=0 2024-08-19T00:17:05.940 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.938+0000 7f19d2ff5640 1 -- 172.21.15.44:0/1450936590 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5569b233a450 con 0x5569b2454620 2024-08-19T00:17:05.940 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.938+0000 7f19d2ff5640 10 client.16020 handle_command_reply: tid=0 2024-08-19T00:17:05.941 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.938+0000 7f19f8035740 1 client.16020 shutdown 2024-08-19T00:17:05.941 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.938+0000 7f19f8035740 1 -- 172.21.15.44:0/1450936590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5569b23cf0f0 msgr2=0x5569b23dd670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:17:05.941 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.938+0000 7f19f8035740 1 --2- 172.21.15.44:0/1450936590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5569b23cf0f0 0x5569b23dd670 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f19e000a010 tx=0x7f19e000f2f0 comp rx=0 tx=0).stop 2024-08-19T00:17:05.941 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.938+0000 7f19f8035740 1 -- 172.21.15.44:0/1450936590 shutdown_connections 2024-08-19T00:17:05.941 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.939+0000 7f19f8035740 1 --2- 172.21.15.44:0/1450936590 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5569b2454620 0x5569b2456a40 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:05.941 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.939+0000 7f19f8035740 1 --2- 172.21.15.44:0/1450936590 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5569b23d9990 0x5569b244c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:05.941 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.939+0000 7f19d2ff5640 0 client.16020 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:17:05.941 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.939+0000 7f19f8035740 1 --2- 172.21.15.44:0/1450936590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5569b23cf0f0 0x5569b23dd670 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:05.941 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.939+0000 7f19f8035740 1 --2- 172.21.15.44:0/1450936590 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569b23ce7d0 0x5569b23dd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:05.941 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.939+0000 7f19f8035740 1 -- 172.21.15.44:0/1450936590 >> 172.21.15.44:0/1450936590 conn(0x5569b23cad40 msgr2=0x5569b23d7f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:17:05.941 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.939+0000 7f19f8035740 1 -- 172.21.15.44:0/1450936590 shutdown_connections 2024-08-19T00:17:05.941 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.939+0000 7f19f8035740 1 -- 172.21.15.44:0/1450936590 wait complete. 2024-08-19T00:17:05.941 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.939+0000 7f19f8035740 20 client.16020 trim_cache size 0 max 16384 2024-08-19T00:17:05.942 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:{ 2024-08-19T00:17:05.942 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "message": "", 2024-08-19T00:17:05.942 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "return_code": 0 2024-08-19T00:17:05.942 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:} 2024-08-19T00:17:05.943 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.939+0000 7f19f5279640 1 -- 172.21.15.44:0/3837684075 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f19d80a2e20 msgr2=0x7f19d80a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:17:05.943 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.939+0000 7f19f5279640 1 --2- 172.21.15.44:0/3837684075 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f19d80a2e20 0x7f19d80a52e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f19e40cd300 tx=0x7f19e404b040 comp rx=0 tx=0).stop 2024-08-19T00:17:05.943 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.939+0000 7f19f5279640 1 -- 172.21.15.44:0/3837684075 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19f01010a0 msgr2=0x7f19f01984f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:17:05.943 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.939+0000 7f19f5279640 1 --2- 172.21.15.44:0/3837684075 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19f01010a0 0x7f19f01984f0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f19e400c920 tx=0x7f19e400cde0 comp rx=0 tx=0).stop 2024-08-19T00:17:05.943 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.939+0000 7f19f5279640 1 -- 172.21.15.44:0/3837684075 shutdown_connections 2024-08-19T00:17:05.943 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.939+0000 7f19f5279640 1 --2- 172.21.15.44:0/3837684075 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f19d80a2e20 0x7f19d80a52e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:05.943 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.939+0000 7f19f5279640 1 --2- 172.21.15.44:0/3837684075 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f19f0106710 0x7f19f019c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:05.943 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.939+0000 7f19f5279640 1 --2- 172.21.15.44:0/3837684075 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19f01010a0 0x7f19f01984f0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:05.943 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.939+0000 7f19f5279640 1 --2- 172.21.15.44:0/3837684075 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f19f0100700 0x7f19f0197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:05.943 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.939+0000 7f19f5279640 1 -- 172.21.15.44:0/3837684075 >> 172.21.15.44:0/3837684075 conn(0x7f19f00fc420 msgr2=0x7f19f00fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:17:05.943 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.939+0000 7f19f5279640 1 -- 172.21.15.44:0/3837684075 shutdown_connections 2024-08-19T00:17:05.944 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:05.939+0000 7f19f5279640 1 -- 172.21.15.44:0/3837684075 wait complete. 2024-08-19T00:17:06.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:17:05 smithi171 ceph-mon[21810]: pgmap v116: 129 pgs: 129 active+clean; 105 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 683 KiB/s wr, 56 op/s 2024-08-19T00:17:06.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:17:05 smithi116 ceph-mon[21873]: pgmap v116: 129 pgs: 129 active+clean; 105 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 683 KiB/s wr, 56 op/s 2024-08-19T00:17:06.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:17:05 smithi044 ceph-mon[18489]: pgmap v116: 129 pgs: 129 active+clean; 105 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 683 KiB/s wr, 56 op/s 2024-08-19T00:17:06.671 INFO:tasks.workunit.client.0.smithi044.stdout: 1 174803 1.47 MB/sec execute 31 sec latency 17524.993 ms 2024-08-19T00:17:07.671 INFO:tasks.workunit.client.0.smithi044.stdout: 1 174803 1.43 MB/sec execute 32 sec latency 18525.095 ms 2024-08-19T00:17:08.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:17:07 smithi171 ceph-mon[21810]: pgmap v117: 129 pgs: 129 active+clean; 105 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 670 KiB/s wr, 46 op/s 2024-08-19T00:17:08.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:17:07 smithi116 ceph-mon[21873]: pgmap v117: 129 pgs: 129 active+clean; 105 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 670 KiB/s wr, 46 op/s 2024-08-19T00:17:08.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:17:07 smithi044 ceph-mon[18489]: pgmap v117: 129 pgs: 129 active+clean; 105 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 670 KiB/s wr, 46 op/s 2024-08-19T00:17:08.671 INFO:tasks.workunit.client.0.smithi044.stdout: 1 174803 1.38 MB/sec execute 33 sec latency 19525.206 ms 2024-08-19T00:17:09.671 INFO:tasks.workunit.client.0.smithi044.stdout: 1 174803 1.34 MB/sec execute 34 sec latency 20525.291 ms 2024-08-19T00:17:10.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:17:09 smithi171 ceph-mon[21810]: pgmap v118: 129 pgs: 129 active+clean; 105 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 670 KiB/s wr, 46 op/s 2024-08-19T00:17:10.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:17:09 smithi116 ceph-mon[21873]: pgmap v118: 129 pgs: 129 active+clean; 105 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 670 KiB/s wr, 46 op/s 2024-08-19T00:17:10.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:17:09 smithi044 ceph-mon[18489]: pgmap v118: 129 pgs: 129 active+clean; 105 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 670 KiB/s wr, 46 op/s 2024-08-19T00:17:10.671 INFO:tasks.workunit.client.0.smithi044.stdout: 1 174803 1.30 MB/sec execute 35 sec latency 21525.379 ms 2024-08-19T00:17:11.672 INFO:tasks.workunit.client.0.smithi044.stdout: 1 174803 1.27 MB/sec execute 36 sec latency 22525.489 ms 2024-08-19T00:17:12.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:17:11 smithi171 ceph-mon[21810]: pgmap v119: 129 pgs: 129 active+clean; 105 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 682 KiB/s wr, 53 op/s 2024-08-19T00:17:12.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:17:11 smithi116 ceph-mon[21873]: pgmap v119: 129 pgs: 129 active+clean; 105 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 682 KiB/s wr, 53 op/s 2024-08-19T00:17:12.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:17:11 smithi044 ceph-mon[18489]: pgmap v119: 129 pgs: 129 active+clean; 105 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 682 KiB/s wr, 53 op/s 2024-08-19T00:17:12.674 INFO:tasks.workunit.client.0.smithi044.stdout: 1 174803 1.23 MB/sec execute 37 sec latency 23525.557 ms 2024-08-19T00:17:13.021 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:17:12 smithi044 ceph-mon[18489]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-19T00:17:13.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:17:12 smithi171 ceph-mon[21810]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-19T00:17:13.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:17:12 smithi116 ceph-mon[21873]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-19T00:17:13.672 INFO:tasks.workunit.client.0.smithi044.stdout: 1 174803 1.20 MB/sec execute 38 sec latency 24525.639 ms 2024-08-19T00:17:14.042 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:17:13 smithi044 ceph-mon[18489]: pgmap v120: 129 pgs: 129 active+clean; 105 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 681 KiB/s wr, 48 op/s 2024-08-19T00:17:14.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:17:13 smithi171 ceph-mon[21810]: pgmap v120: 129 pgs: 129 active+clean; 105 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 681 KiB/s wr, 48 op/s 2024-08-19T00:17:14.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:17:13 smithi116 ceph-mon[21873]: pgmap v120: 129 pgs: 129 active+clean; 105 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 681 KiB/s wr, 48 op/s 2024-08-19T00:17:14.672 INFO:tasks.workunit.client.0.smithi044.stdout: 1 174803 1.17 MB/sec execute 39 sec latency 25525.692 ms 2024-08-19T00:17:15.672 INFO:tasks.workunit.client.0.smithi044.stdout: 1 174803 1.14 MB/sec execute 40 sec latency 26525.786 ms 2024-08-19T00:17:16.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:17:15 smithi171 ceph-mon[21810]: pgmap v121: 129 pgs: 129 active+clean; 105 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 683 KiB/s wr, 53 op/s 2024-08-19T00:17:16.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:17:15 smithi116 ceph-mon[21873]: pgmap v121: 129 pgs: 129 active+clean; 105 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 683 KiB/s wr, 53 op/s 2024-08-19T00:17:16.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:17:15 smithi044 ceph-mon[18489]: pgmap v121: 129 pgs: 129 active+clean; 105 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 683 KiB/s wr, 53 op/s 2024-08-19T00:17:16.546 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-19T00:17:16.672 INFO:tasks.workunit.client.0.smithi044.stdout: 1 174803 1.11 MB/sec execute 41 sec latency 27525.841 ms 2024-08-19T00:17:16.818 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:17:17.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:17.285+0000 7f0dd36f1640 1 -- 172.21.15.44:0/976616024 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0dcc1078b0 msgr2=0x7f0dcc107c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:17:17.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:17.285+0000 7f0dd36f1640 1 --2- 172.21.15.44:0/976616024 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0dcc1078b0 0x7f0dcc107c90 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8009930 tx=0x7f0dc802a420 comp rx=0 tx=0).stop 2024-08-19T00:17:17.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:17.285+0000 7f0dd36f1640 1 -- 172.21.15.44:0/976616024 shutdown_connections 2024-08-19T00:17:17.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:17.285+0000 7f0dd36f1640 1 --2- 172.21.15.44:0/976616024 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0dcc1018b0 0x7f0dcc101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:17.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:17.285+0000 7f0dd36f1640 1 --2- 172.21.15.44:0/976616024 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0dcc102250 0x7f0dcc10e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:17.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:17.285+0000 7f0dd36f1640 1 --2- 172.21.15.44:0/976616024 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0dcc1078b0 0x7f0dcc107c90 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:17.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:17.285+0000 7f0dd36f1640 1 -- 172.21.15.44:0/976616024 >> 172.21.15.44:0/976616024 conn(0x7f0dcc0fd5f0 msgr2=0x7f0dcc0ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:17:17.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:17.285+0000 7f0dd36f1640 1 -- 172.21.15.44:0/976616024 shutdown_connections 2024-08-19T00:17:17.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:17.285+0000 7f0dd36f1640 1 -- 172.21.15.44:0/976616024 wait complete. 2024-08-19T00:17:17.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:17.286+0000 7f0dd36f1640 1 Processor -- start 2024-08-19T00:17:17.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:17.286+0000 7f0dd36f1640 1 -- start start 2024-08-19T00:17:17.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:17.286+0000 7f0dd36f1640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0dcc1018b0 0x7f0dcc1981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:17.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:17.286+0000 7f0dd36f1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0dcc102250 0x7f0dcc198720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:17.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:17.286+0000 7f0dd36f1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0dcc1078b0 0x7f0dcc19cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:17.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:17.286+0000 7f0dd36f1640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0dcc111c70 con 0x7f0dcc102250 2024-08-19T00:17:17.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:17.286+0000 7f0dd36f1640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f0dcc111af0 con 0x7f0dcc1078b0 2024-08-19T00:17:17.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:17.286+0000 7f0dd36f1640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0dcc111df0 con 0x7f0dcc1018b0 2024-08-19T00:17:17.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:17.286+0000 7f0dd0c8c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0dcc102250 0x7f0dcc198720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:17.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:17.286+0000 7f0dd0c8c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0dcc102250 0x7f0dcc198720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54802/0 (socket says 172.21.15.44:54802) 2024-08-19T00:17:17.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:17.286+0000 7f0dd0c8c640 1 -- 172.21.15.44:0/1449346179 learned_addr learned my addr 172.21.15.44:0/1449346179 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:17:17.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:17.286+0000 7f0dd148d640 1 --2- 172.21.15.44:0/1449346179 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0dcc1018b0 0x7f0dcc1981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:17.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:17.286+0000 7f0dd1c8e640 1 --2- 172.21.15.44:0/1449346179 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0dcc1078b0 0x7f0dcc19cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:17.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:17.286+0000 7f0dd0c8c640 1 -- 172.21.15.44:0/1449346179 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0dcc1018b0 msgr2=0x7f0dcc1981e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:17:17.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:17.286+0000 7f0dd0c8c640 1 --2- 172.21.15.44:0/1449346179 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0dcc1018b0 0x7f0dcc1981e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:17.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:17.286+0000 7f0dd0c8c640 1 -- 172.21.15.44:0/1449346179 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0dcc1078b0 msgr2=0x7f0dcc19cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:17:17.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:17.286+0000 7f0dd0c8c640 1 --2- 172.21.15.44:0/1449346179 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0dcc1078b0 0x7f0dcc19cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:17.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:17.286+0000 7f0dd0c8c640 1 -- 172.21.15.44:0/1449346179 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dcc19d190 con 0x7f0dcc102250 2024-08-19T00:17:17.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:17.287+0000 7f0dd0c8c640 1 --2- 172.21.15.44:0/1449346179 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0dcc102250 0x7f0dcc198720 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc00d950 tx=0x7f0dbc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:17:17.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:17.287+0000 7f0dc27fc640 1 -- 172.21.15.44:0/1449346179 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc017030 con 0x7f0dcc102250 2024-08-19T00:17:17.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:17.287+0000 7f0dc27fc640 1 -- 172.21.15.44:0/1449346179 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0dbc004020 con 0x7f0dcc102250 2024-08-19T00:17:17.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:17.287+0000 7f0dd36f1640 1 -- 172.21.15.44:0/1449346179 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dcc19d480 con 0x7f0dcc102250 2024-08-19T00:17:17.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:17.287+0000 7f0dc27fc640 1 -- 172.21.15.44:0/1449346179 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc0047a0 con 0x7f0dcc102250 2024-08-19T00:17:17.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:17.287+0000 7f0dd36f1640 1 -- 172.21.15.44:0/1449346179 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dcc1a4d60 con 0x7f0dcc102250 2024-08-19T00:17:17.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:17.288+0000 7f0dd36f1640 1 -- 172.21.15.44:0/1449346179 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0dcc101d10 con 0x7f0dcc102250 2024-08-19T00:17:17.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:17.289+0000 7f0dc27fc640 1 -- 172.21.15.44:0/1449346179 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f0dbc0041d0 con 0x7f0dcc102250 2024-08-19T00:17:17.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:17.290+0000 7f0dc27fc640 1 --2- 172.21.15.44:0/1449346179 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f0db80a2cf0 0x7f0db80a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:17.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:17.290+0000 7f0dd148d640 1 --2- 172.21.15.44:0/1449346179 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f0db80a2cf0 0x7f0db80a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:17.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:17.290+0000 7f0dc27fc640 1 -- 172.21.15.44:0/1449346179 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f0dbc0cf120 con 0x7f0dcc102250 2024-08-19T00:17:17.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:17.290+0000 7f0dd148d640 1 --2- 172.21.15.44:0/1449346179 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f0db80a2cf0 0x7f0db80a51b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8009900 tx=0x7f0dc80058d0 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:17:17.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:17.294+0000 7f0dc27fc640 1 -- 172.21.15.44:0/1449346179 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f0dbc09b9a0 con 0x7f0dcc102250 2024-08-19T00:17:17.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:17.506+0000 7f0dd36f1640 1 -- 172.21.15.44:0/1449346179 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0dcc02d5e0 con 0x7f0dcc102250 2024-08-19T00:17:17.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:17.506+0000 7f0dc27fc640 1 -- 172.21.15.44:0/1449346179 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11989 (secure 0 0 0) 0x7f0dbc09b2a0 con 0x7f0dcc102250 2024-08-19T00:17:17.508 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:17:17.508 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":33,"btime":"2024-08-19T00:17:11:640526+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14511,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1538841896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1538841896},{"type":"v1","addr":"172.21.15.116:6833","nonce":1538841896}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/4044471606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4044471606},{"type":"v1","addr":"172.21.15.44:6835","nonce":4044471606}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":33,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-19T00:10:53.196636+0000","modified":"2024-08-19T00:17:11.586031+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24473,"mds_1":24446,"mds_2":24439,"mds_3":24431,"mds_4":24418},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14529":{"gid":14529,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6837/1824829052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1824829052},{"type":"v1","addr":"172.21.15.44:6837","nonce":1824829052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14577":{"gid":14577,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6839/3591739042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":3591739042},{"type":"v1","addr":"172.21.15.44:6839","nonce":3591739042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14589":{"gid":14589,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6841/3667695717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6840","nonce":3667695717},{"type":"v1","addr":"172.21.15.44:6841","nonce":3667695717}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24388":{"gid":24388,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1183022838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1183022838},{"type":"v1","addr":"172.21.15.171:6833","nonce":1183022838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6835/2190623851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":2190623851},{"type":"v1","addr":"172.21.15.171:6835","nonce":2190623851}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.171:6837/316231795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":316231795},{"type":"v1","addr":"172.21.15.171:6837","nonce":316231795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":20,"addr":"172.21.15.116:6835/3507399322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3507399322},{"type":"v1","addr":"172.21.15.116:6835","nonce":3507399322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.171:6839/1466585795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":1466585795},{"type":"v1","addr":"172.21.15.171:6839","nonce":1466585795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":17,"addr":"172.21.15.116:6837/2764513846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":2764513846},{"type":"v1","addr":"172.21.15.116:6837","nonce":2764513846}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.116:6839/1032741033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":1032741033},{"type":"v1","addr":"172.21.15.116:6839","nonce":1032741033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24446,24439,24431,24418]},"id":1}]} 2024-08-19T00:17:17.509 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 33 2024-08-19T00:17:17.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:17.508+0000 7f0dd36f1640 1 -- 172.21.15.44:0/1449346179 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f0db80a2cf0 msgr2=0x7f0db80a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:17:17.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:17.508+0000 7f0dd36f1640 1 --2- 172.21.15.44:0/1449346179 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f0db80a2cf0 0x7f0db80a51b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8009900 tx=0x7f0dc80058d0 comp rx=0 tx=0).stop 2024-08-19T00:17:17.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:17.508+0000 7f0dd36f1640 1 -- 172.21.15.44:0/1449346179 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0dcc102250 msgr2=0x7f0dcc198720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:17:17.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:17.508+0000 7f0dd36f1640 1 --2- 172.21.15.44:0/1449346179 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0dcc102250 0x7f0dcc198720 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc00d950 tx=0x7f0dbc00de10 comp rx=0 tx=0).stop 2024-08-19T00:17:17.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:17.509+0000 7f0dd36f1640 1 -- 172.21.15.44:0/1449346179 shutdown_connections 2024-08-19T00:17:17.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:17.509+0000 7f0dd36f1640 1 --2- 172.21.15.44:0/1449346179 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f0db80a2cf0 0x7f0db80a51b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:17.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:17.509+0000 7f0dd36f1640 1 --2- 172.21.15.44:0/1449346179 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0dcc1078b0 0x7f0dcc19cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:17.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:17.509+0000 7f0dd36f1640 1 --2- 172.21.15.44:0/1449346179 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0dcc102250 0x7f0dcc198720 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:17.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:17.509+0000 7f0dd36f1640 1 --2- 172.21.15.44:0/1449346179 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0dcc1018b0 0x7f0dcc1981e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:17.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:17.509+0000 7f0dd36f1640 1 -- 172.21.15.44:0/1449346179 >> 172.21.15.44:0/1449346179 conn(0x7f0dcc0fd5f0 msgr2=0x7f0dcc0fdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:17:17.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:17.509+0000 7f0dd36f1640 1 -- 172.21.15.44:0/1449346179 shutdown_connections 2024-08-19T00:17:17.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:17.509+0000 7f0dd36f1640 1 -- 172.21.15.44:0/1449346179 wait complete. 2024-08-19T00:17:17.672 INFO:tasks.workunit.client.0.smithi044.stdout: 1 174803 1.09 MB/sec execute 42 sec latency 28525.905 ms 2024-08-19T00:17:17.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:17:17 smithi044 ceph-mon[18489]: pgmap v122: 129 pgs: 129 active+clean; 105 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 11 op/s 2024-08-19T00:17:17.869 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:17:17 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/1449346179' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:17:18.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:17:17 smithi171 ceph-mon[21810]: pgmap v122: 129 pgs: 129 active+clean; 105 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 11 op/s 2024-08-19T00:17:18.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:17:17 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/1449346179' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:17:18.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:17:17 smithi116 ceph-mon[21873]: pgmap v122: 129 pgs: 129 active+clean; 105 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 11 op/s 2024-08-19T00:17:18.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:17:17 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/1449346179' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:17:18.269 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24473 quiesce db --set-id 7b2a62c8 --release --await' 2024-08-19T00:17:18.269 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24473 quiesce db --set-id 7b2a62c8 --release --await 2024-08-19T00:17:18.533 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:17:18.672 INFO:tasks.workunit.client.0.smithi044.stdout: 1 174803 1.06 MB/sec execute 43 sec latency 29525.946 ms 2024-08-19T00:17:19.040 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.032+0000 7f38b159d640 1 -- 172.21.15.44:0/3138227140 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f38ac101620 msgr2=0x7f38ac101a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:17:19.040 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.032+0000 7f38b159d640 1 --2- 172.21.15.44:0/3138227140 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f38ac101620 0x7f38ac101a80 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f38a0009930 tx=0x7f38a002a420 comp rx=0 tx=0).stop 2024-08-19T00:17:19.040 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.033+0000 7f38b159d640 1 -- 172.21.15.44:0/3138227140 shutdown_connections 2024-08-19T00:17:19.041 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.033+0000 7f38b159d640 1 --2- 172.21.15.44:0/3138227140 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f38ac101fc0 0x7f38ac10e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.041 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.033+0000 7f38b159d640 1 --2- 172.21.15.44:0/3138227140 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f38ac101620 0x7f38ac101a80 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.041 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.033+0000 7f38b159d640 1 --2- 172.21.15.44:0/3138227140 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38ac107630 0x7f38ac107a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.041 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.033+0000 7f38b159d640 1 -- 172.21.15.44:0/3138227140 >> 172.21.15.44:0/3138227140 conn(0x7f38ac0fd320 msgr2=0x7f38ac0ff740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:17:19.041 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.033+0000 7f38b159d640 1 -- 172.21.15.44:0/3138227140 shutdown_connections 2024-08-19T00:17:19.042 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.033+0000 7f38b159d640 1 -- 172.21.15.44:0/3138227140 wait complete. 2024-08-19T00:17:19.042 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.033+0000 7f38b159d640 1 Processor -- start 2024-08-19T00:17:19.042 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.033+0000 7f38b159d640 1 -- start start 2024-08-19T00:17:19.042 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.034+0000 7f38b159d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f38ac101620 0x7f38ac197fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:19.042 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.034+0000 7f38b159d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38ac101fc0 0x7f38ac1984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:19.043 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.034+0000 7f38b159d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f38ac107630 0x7f38ac19c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:19.043 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.034+0000 7f38b159d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f38ac111a70 con 0x7f38ac107630 2024-08-19T00:17:19.043 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.034+0000 7f38b159d640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f38ac1118f0 con 0x7f38ac101fc0 2024-08-19T00:17:19.043 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.034+0000 7f38b159d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f38ac111bf0 con 0x7f38ac101620 2024-08-19T00:17:19.043 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.034+0000 7f38ab7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38ac101fc0 0x7f38ac1984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:19.043 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.034+0000 7f38ab7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38ac101fc0 0x7f38ac1984e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.44:50144/0 (socket says 172.21.15.44:50144) 2024-08-19T00:17:19.044 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.034+0000 7f38ab7fe640 1 -- 172.21.15.44:0/1995525792 learned_addr learned my addr 172.21.15.44:0/1995525792 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:17:19.044 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.034+0000 7f38b0d9c640 1 --2- 172.21.15.44:0/1995525792 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f38ac107630 0x7f38ac19c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:19.044 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.034+0000 7f38abfff640 1 --2- 172.21.15.44:0/1995525792 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f38ac101620 0x7f38ac197fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:19.044 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.034+0000 7f38ab7fe640 1 -- 172.21.15.44:0/1995525792 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f38ac101620 msgr2=0x7f38ac197fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:17:19.044 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.034+0000 7f38ab7fe640 1 --2- 172.21.15.44:0/1995525792 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f38ac101620 0x7f38ac197fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.044 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.034+0000 7f38ab7fe640 1 -- 172.21.15.44:0/1995525792 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f38ac107630 msgr2=0x7f38ac19c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:17:19.045 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.034+0000 7f38ab7fe640 1 --2- 172.21.15.44:0/1995525792 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f38ac107630 0x7f38ac19c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.045 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.034+0000 7f38ab7fe640 1 -- 172.21.15.44:0/1995525792 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38ac19cf90 con 0x7f38ac101fc0 2024-08-19T00:17:19.045 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.034+0000 7f38b0d9c640 1 --2- 172.21.15.44:0/1995525792 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f38ac107630 0x7f38ac19c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:17:19.045 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.034+0000 7f38abfff640 1 --2- 172.21.15.44:0/1995525792 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f38ac101620 0x7f38ac197fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:17:19.045 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.035+0000 7f38ab7fe640 1 --2- 172.21.15.44:0/1995525792 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38ac101fc0 0x7f38ac1984e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f38a0009230 tx=0x7f38a0004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:17:19.045 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.035+0000 7f38a97fa640 1 -- 172.21.15.44:0/1995525792 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a003f030 con 0x7f38ac101fc0 2024-08-19T00:17:19.046 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.035+0000 7f38b159d640 1 -- 172.21.15.44:0/1995525792 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38ac19d220 con 0x7f38ac101fc0 2024-08-19T00:17:19.046 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.035+0000 7f38a97fa640 1 -- 172.21.15.44:0/1995525792 <== mon.2 v2:172.21.15.116:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38a0003ad0 con 0x7f38ac101fc0 2024-08-19T00:17:19.046 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.035+0000 7f38a97fa640 1 -- 172.21.15.44:0/1995525792 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a0035070 con 0x7f38ac101fc0 2024-08-19T00:17:19.046 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.035+0000 7f38b159d640 1 -- 172.21.15.44:0/1995525792 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38ac1a4b10 con 0x7f38ac101fc0 2024-08-19T00:17:19.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.025+0000 7f20913f5640 1 -- 172.21.15.44:0/735718136 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f208c102af0 msgr2=0x7f208c102ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:17:19.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.025+0000 7f20913f5640 1 --2- 172.21.15.44:0/735718136 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f208c102af0 0x7f208c102ed0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f207c009ca0 tx=0x7f207c02a950 comp rx=0 tx=0).stop 2024-08-19T00:17:19.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.025+0000 7f20913f5640 1 -- 172.21.15.44:0/735718136 shutdown_connections 2024-08-19T00:17:19.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.025+0000 7f20913f5640 1 --2- 172.21.15.44:0/735718136 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f208c103410 0x7f208c10b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.026+0000 7f20913f5640 1 --2- 172.21.15.44:0/735718136 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f208c10bed0 0x7f208c10e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.026+0000 7f20913f5640 1 --2- 172.21.15.44:0/735718136 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f208c102af0 0x7f208c102ed0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.026+0000 7f20913f5640 1 -- 172.21.15.44:0/735718136 >> 172.21.15.44:0/735718136 conn(0x7f208c0fc4f0 msgr2=0x7f208c0fe910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:17:19.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.026+0000 7f20913f5640 1 -- 172.21.15.44:0/735718136 shutdown_connections 2024-08-19T00:17:19.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.026+0000 7f20913f5640 1 -- 172.21.15.44:0/735718136 wait complete. 2024-08-19T00:17:19.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.026+0000 7f20913f5640 1 Processor -- start 2024-08-19T00:17:19.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.026+0000 7f20913f5640 1 -- start start 2024-08-19T00:17:19.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.027+0000 7f20913f5640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f208c102af0 0x7f208c198160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:19.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.027+0000 7f20913f5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f208c103410 0x7f208c1986a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:19.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.027+0000 7f20913f5640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f208c10bed0 0x7f208c19ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:19.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.027+0000 7f20913f5640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f208c111ce0 con 0x7f208c103410 2024-08-19T00:17:19.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.027+0000 7f20913f5640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f208c111b60 con 0x7f208c102af0 2024-08-19T00:17:19.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.027+0000 7f20913f5640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f208c111e60 con 0x7f208c10bed0 2024-08-19T00:17:19.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.027+0000 7f208a7fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f208c103410 0x7f208c1986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:19.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.027+0000 7f208a7fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f208c103410 0x7f208c1986a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48242/0 (socket says 172.21.15.44:48242) 2024-08-19T00:17:19.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.027+0000 7f208a7fc640 1 -- 172.21.15.44:0/3620225002 learned_addr learned my addr 172.21.15.44:0/3620225002 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:17:19.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.027+0000 7f208affd640 1 --2- 172.21.15.44:0/3620225002 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f208c102af0 0x7f208c198160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:19.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.027+0000 7f208b7fe640 1 --2- 172.21.15.44:0/3620225002 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f208c10bed0 0x7f208c19ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:19.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.027+0000 7f208a7fc640 1 -- 172.21.15.44:0/3620225002 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f208c10bed0 msgr2=0x7f208c19ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:17:19.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.027+0000 7f208a7fc640 1 --2- 172.21.15.44:0/3620225002 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f208c10bed0 0x7f208c19ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.027+0000 7f208a7fc640 1 -- 172.21.15.44:0/3620225002 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f208c102af0 msgr2=0x7f208c198160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:17:19.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.027+0000 7f208a7fc640 1 --2- 172.21.15.44:0/3620225002 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f208c102af0 0x7f208c198160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.027+0000 7f208a7fc640 1 -- 172.21.15.44:0/3620225002 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f208c19d110 con 0x7f208c103410 2024-08-19T00:17:19.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.027+0000 7f208a7fc640 1 --2- 172.21.15.44:0/3620225002 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f208c103410 0x7f208c1986a0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f207400b4a0 tx=0x7f207400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:17:19.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.027+0000 7f2083fff640 1 -- 172.21.15.44:0/3620225002 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2074014070 con 0x7f208c103410 2024-08-19T00:17:19.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.027+0000 7f20913f5640 1 -- 172.21.15.44:0/3620225002 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f208c19d400 con 0x7f208c103410 2024-08-19T00:17:19.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.027+0000 7f2083fff640 1 -- 172.21.15.44:0/3620225002 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2074010af0 con 0x7f208c103410 2024-08-19T00:17:19.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.027+0000 7f2083fff640 1 -- 172.21.15.44:0/3620225002 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2074017d10 con 0x7f208c103410 2024-08-19T00:17:19.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.028+0000 7f20913f5640 1 -- 172.21.15.44:0/3620225002 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f208c1a4ce0 con 0x7f208c103410 2024-08-19T00:17:19.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.030+0000 7f2083fff640 1 -- 172.21.15.44:0/3620225002 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f2074017070 con 0x7f208c103410 2024-08-19T00:17:19.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.030+0000 7f20937f3740 1 Processor -- start 2024-08-19T00:17:19.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.030+0000 7f20937f3740 1 -- start start 2024-08-19T00:17:19.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.030+0000 7f2083fff640 1 --2- 172.21.15.44:0/3620225002 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f20780a2cf0 0x7f20780a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:19.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.031+0000 7f208b7fe640 1 --2- 172.21.15.44:0/3620225002 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f20780a2cf0 0x7f20780a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:19.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.031+0000 7f2083fff640 1 -- 172.21.15.44:0/3620225002 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f20740ceb60 con 0x7f208c103410 2024-08-19T00:17:19.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.031+0000 7f20937f3740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fb6ca38830 0x55fb6ca38c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:19.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.031+0000 7f20937f3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb6ca39150 0x55fb6ca47a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:19.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.031+0000 7f20937f3740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fb6ca47f80 0x55fb6ca4a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:19.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.031+0000 7f20937f3740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55fb6c99ec60 con 0x55fb6ca39150 2024-08-19T00:17:19.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.031+0000 7f20937f3740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55fb6c936b90 con 0x55fb6ca47f80 2024-08-19T00:17:19.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.031+0000 7f20937f3740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55fb6c99ac20 con 0x55fb6ca38830 2024-08-19T00:17:19.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.031+0000 7f208a7fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb6ca39150 0x55fb6ca47a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:19.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.031+0000 7f208a7fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb6ca39150 0x55fb6ca47a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48260/0 (socket says 172.21.15.44:48260) 2024-08-19T00:17:19.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.031+0000 7f208a7fc640 1 -- 172.21.15.44:0/3281775353 learned_addr learned my addr 172.21.15.44:0/3281775353 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:17:19.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.031+0000 7f208b7fe640 1 --2- 172.21.15.44:0/3620225002 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f20780a2cf0 0x7f20780a51b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2084005fd0 tx=0x7f2084005da0 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:17:19.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.031+0000 7f208b7fe640 1 --2- 172.21.15.44:0/3281775353 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fb6ca47f80 0x55fb6ca4a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:19.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.031+0000 7f208a7fc640 1 -- 172.21.15.44:0/3281775353 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fb6ca38830 msgr2=0x55fb6ca38c10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-19T00:17:19.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.031+0000 7f208a7fc640 1 --2- 172.21.15.44:0/3281775353 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fb6ca38830 0x55fb6ca38c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.031+0000 7f208a7fc640 1 -- 172.21.15.44:0/3281775353 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fb6ca47f80 msgr2=0x55fb6ca4a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:17:19.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.031+0000 7f208a7fc640 1 --2- 172.21.15.44:0/3281775353 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fb6ca47f80 0x55fb6ca4a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.031+0000 7f208a7fc640 1 -- 172.21.15.44:0/3281775353 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb6c6ae580 con 0x55fb6ca39150 2024-08-19T00:17:19.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.032+0000 7f208a7fc640 1 --2- 172.21.15.44:0/3281775353 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb6ca39150 0x55fb6ca47a40 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f207409aaf0 tx=0x7f2074017730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e9b91713466e96c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:17:19.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.032+0000 7f20817fa640 1 -- 172.21.15.44:0/3281775353 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f207401e070 con 0x55fb6ca39150 2024-08-19T00:17:19.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.032+0000 7f20817fa640 1 -- 172.21.15.44:0/3281775353 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f207409f1a0 con 0x55fb6ca39150 2024-08-19T00:17:19.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.032+0000 7f20817fa640 1 -- 172.21.15.44:0/3281775353 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2074097460 con 0x55fb6ca39150 2024-08-19T00:17:19.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.032+0000 7f20937f3740 1 -- 172.21.15.44:0/3281775353 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb6ca39150 msgr2=0x55fb6ca47a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:17:19.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.032+0000 7f20937f3740 1 --2- 172.21.15.44:0/3281775353 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb6ca39150 0x55fb6ca47a40 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f207409aaf0 tx=0x7f2074017730 comp rx=0 tx=0).stop 2024-08-19T00:17:19.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.033+0000 7f20937f3740 1 -- 172.21.15.44:0/3281775353 shutdown_connections 2024-08-19T00:17:19.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.033+0000 7f20937f3740 1 --2- 172.21.15.44:0/3281775353 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fb6ca47f80 0x55fb6ca4a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.033+0000 7f20937f3740 1 --2- 172.21.15.44:0/3281775353 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb6ca39150 0x55fb6ca47a40 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.033+0000 7f20937f3740 1 --2- 172.21.15.44:0/3281775353 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fb6ca38830 0x55fb6ca38c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.033+0000 7f20937f3740 1 -- 172.21.15.44:0/3281775353 >> 172.21.15.44:0/3281775353 conn(0x55fb6ca34f20 msgr2=0x55fb6ca35300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:17:19.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.033+0000 7f20937f3740 1 -- 172.21.15.44:0/3281775353 shutdown_connections 2024-08-19T00:17:19.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.033+0000 7f20937f3740 1 -- 172.21.15.44:0/3281775353 wait complete. 2024-08-19T00:17:19.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.033+0000 7f20937f3740 1 -- start start 2024-08-19T00:17:19.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.033+0000 7f20937f3740 1 Processor -- start 2024-08-19T00:17:19.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.033+0000 7f20937f3740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fb6ca38830 0x55fb6ca44f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:19.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.033+0000 7f20937f3740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fb6ca39150 0x55fb6ca45440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:19.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.033+0000 7f20937f3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb6ca47f80 0x55fb6ca45980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:19.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.033+0000 7f20937f3740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55fb6ca4ab50 con 0x55fb6ca47f80 2024-08-19T00:17:19.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.034+0000 7f20937f3740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55fb6c93c7c0 con 0x55fb6ca38830 2024-08-19T00:17:19.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.034+0000 7f20937f3740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55fb6ca4acd0 con 0x55fb6ca39150 2024-08-19T00:17:19.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.034+0000 7f20937f3740 10 client.0 _ll_register_callbacks cb 0x55fb6c945f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:17:19.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.034+0000 7f208b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb6ca47f80 0x55fb6ca45980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:19.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.034+0000 7f208b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb6ca47f80 0x55fb6ca45980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48272/0 (socket says 172.21.15.44:48272) 2024-08-19T00:17:19.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.034+0000 7f208b7fe640 1 -- 172.21.15.44:0/3620757617 learned_addr learned my addr 172.21.15.44:0/3620757617 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:17:19.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.034+0000 7f208affd640 1 --2- 172.21.15.44:0/3620757617 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fb6ca38830 0x55fb6ca44f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:19.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.034+0000 7f208a7fc640 1 --2- 172.21.15.44:0/3620757617 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fb6ca39150 0x55fb6ca45440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:19.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.034+0000 7f208a7fc640 1 -- 172.21.15.44:0/3620757617 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fb6ca38830 msgr2=0x55fb6ca44f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:17:19.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.034+0000 7f208a7fc640 1 --2- 172.21.15.44:0/3620757617 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fb6ca38830 0x55fb6ca44f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.034+0000 7f208a7fc640 1 -- 172.21.15.44:0/3620757617 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb6ca47f80 msgr2=0x55fb6ca45980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:17:19.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.034+0000 7f208a7fc640 1 --2- 172.21.15.44:0/3620757617 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb6ca47f80 0x55fb6ca45980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.034+0000 7f208a7fc640 1 -- 172.21.15.44:0/3620757617 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb6c778960 con 0x55fb6ca39150 2024-08-19T00:17:19.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.034+0000 7f208affd640 1 --2- 172.21.15.44:0/3620757617 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fb6ca38830 0x55fb6ca44f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:17:19.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.034+0000 7f208b7fe640 1 --2- 172.21.15.44:0/3620757617 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb6ca47f80 0x55fb6ca45980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:17:19.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.035+0000 7f208a7fc640 1 --2- 172.21.15.44:0/3620757617 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fb6ca39150 0x55fb6ca45440 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x55fb6ca396a0 tx=0x7f20740a3ae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7d73a1c86f6cfa0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:17:19.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.035+0000 7f20727fc640 10 client.0 ms_handle_connect on v2:172.21.15.171:3300/0 2024-08-19T00:17:19.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.035+0000 7f20727fc640 1 -- 172.21.15.44:0/3620757617 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f207401e070 con 0x55fb6ca39150 2024-08-19T00:17:19.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.035+0000 7f20937f3740 1 -- 172.21.15.44:0/3620757617 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f207409f1a0 con 0x55fb6ca39150 2024-08-19T00:17:19.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.035+0000 7f20727fc640 1 -- 172.21.15.44:0/3620757617 <== mon.1 v2:172.21.15.171:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f2074097460 con 0x55fb6ca39150 2024-08-19T00:17:19.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.035+0000 7f20727fc640 1 -- 172.21.15.44:0/3620757617 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f207409a240 con 0x55fb6ca39150 2024-08-19T00:17:19.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.036+0000 7f20937f3740 10 client.25387 fetch_fsmap learned FSMap version 33 2024-08-19T00:17:19.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.036+0000 7f20937f3740 1 -- 172.21.15.44:0/3620757617 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55fb6ca4aba0 con 0x55fb6ca39150 2024-08-19T00:17:19.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.036+0000 7f20727fc640 1 -- 172.21.15.44:0/3620757617 <== mon.1 v2:172.21.15.171:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f207409f1a0 con 0x55fb6ca39150 2024-08-19T00:17:19.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.036+0000 7f20727fc640 1 -- 172.21.15.44:0/3620757617 <== mon.1 v2:172.21.15.171:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f2074061020 con 0x55fb6ca39150 2024-08-19T00:17:19.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.037+0000 7f20937f3740 10 client.25387 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:17:19.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.037+0000 7f20937f3740 10 client.25387 resolve_mds: validated gid 24473 aka daemon mds.b 2024-08-19T00:17:19.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.037+0000 7f20937f3740 20 client.25387 populate_metadata read hostname 'smithi044' 2024-08-19T00:17:19.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.037+0000 7f20937f3740 1 --2- 172.21.15.44:0/3620757617 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55fb6ca57e80 0x55fb6ca5a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:19.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.037+0000 7f20937f3740 4 client.25387 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:17:19.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.037+0000 7f20937f3740 1 -- 172.21.15.44:0/3620757617 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fb6c9ac1d0 con 0x55fb6ca57e80 2024-08-19T00:17:19.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.037+0000 7f208affd640 1 --2- 172.21.15.44:0/3620757617 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55fb6ca57e80 0x55fb6ca5a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:19.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.037+0000 7f208affd640 1 --2- 172.21.15.44:0/3620757617 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55fb6ca57e80 0x55fb6ca5a270 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c925cf3c7e1f58 server_cookie=feb68c170a785cb4 in_seq=0 out_seq=0 2024-08-19T00:17:19.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.037+0000 7f20727fc640 10 client.25387 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:17:19.071 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.038+0000 7f38a97fa640 1 -- 172.21.15.44:0/1995525792 <== mon.2 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f38a0042030 con 0x7f38ac101fc0 2024-08-19T00:17:19.071 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.038+0000 7f38b55c6740 1 Processor -- start 2024-08-19T00:17:19.071 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.038+0000 7f38b55c6740 1 -- start start 2024-08-19T00:17:19.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.038+0000 7f20727fc640 1 -- 172.21.15.44:0/3620757617 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fb6c9ac1d0 con 0x55fb6ca57e80 2024-08-19T00:17:19.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.038+0000 7f20727fc640 10 client.25387 handle_command_reply: tid=0 2024-08-19T00:17:19.072 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.038+0000 7f38b55c6740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564962ad49b0 0x564962ad4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:19.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.038+0000 7f20937f3740 1 client.25387 shutdown 2024-08-19T00:17:19.073 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.038+0000 7f38b55c6740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564962ad52d0 0x564962adf630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:19.074 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.038+0000 7f38b55c6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564962adfb70 0x564962ae1f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:19.074 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.038+0000 7f38b55c6740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564962a389d0 con 0x564962adfb70 2024-08-19T00:17:19.074 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.038+0000 7f38b55c6740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5649629e0820 con 0x564962ad52d0 2024-08-19T00:17:19.074 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.038+0000 7f38b55c6740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x564962a34990 con 0x564962ad49b0 2024-08-19T00:17:19.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.038+0000 7f20937f3740 1 -- 172.21.15.44:0/3620757617 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fb6ca39150 msgr2=0x55fb6ca45440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:17:19.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.038+0000 7f20937f3740 1 --2- 172.21.15.44:0/3620757617 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fb6ca39150 0x55fb6ca45440 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x55fb6ca396a0 tx=0x7f20740a3ae0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.038+0000 7f20937f3740 1 -- 172.21.15.44:0/3620757617 shutdown_connections 2024-08-19T00:17:19.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.038+0000 7f20937f3740 1 --2- 172.21.15.44:0/3620757617 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55fb6ca57e80 0x55fb6ca5a270 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.038+0000 7f20937f3740 1 --2- 172.21.15.44:0/3620757617 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fb6ca39150 0x55fb6ca45440 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.038+0000 7f20937f3740 1 --2- 172.21.15.44:0/3620757617 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb6ca47f80 0x55fb6ca45980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.038+0000 7f20937f3740 1 --2- 172.21.15.44:0/3620757617 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fb6ca38830 0x55fb6ca44f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.038+0000 7f20727fc640 0 client.25387 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:17:19.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.038+0000 7f20937f3740 1 -- 172.21.15.44:0/3620757617 >> 172.21.15.44:0/3620757617 conn(0x55fb6ca34f20 msgr2=0x55fb6ca3ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:17:19.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.038+0000 7f20937f3740 1 -- 172.21.15.44:0/3620757617 shutdown_connections 2024-08-19T00:17:19.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.039+0000 7f20937f3740 1 -- 172.21.15.44:0/3620757617 wait complete. 2024-08-19T00:17:19.078 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.038+0000 7f38ab7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564962adfb70 0x564962ae1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:19.079 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.038+0000 7f38b0d9c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564962ad49b0 0x564962ad4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:19.079 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.038+0000 7f38ab7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564962adfb70 0x564962ae1f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48292/0 (socket says 172.21.15.44:48292) 2024-08-19T00:17:19.079 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.038+0000 7f38ab7fe640 1 -- 172.21.15.44:0/3143732263 learned_addr learned my addr 172.21.15.44:0/3143732263 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:17:19.079 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.038+0000 7f38a97fa640 1 --2- 172.21.15.44:0/1995525792 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f38940a2cf0 0x7f38940a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:19.079 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.039+0000 7f38b0d9c640 1 --2- 172.21.15.44:0/1995525792 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f38940a2cf0 0x7f38940a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:19.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.039+0000 7f20937f3740 20 client.25387 trim_cache size 0 max 16384 2024-08-19T00:17:19.087 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.039+0000 7f38a97fa640 1 -- 172.21.15.44:0/1995525792 <== mon.2 v2:172.21.15.116:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f38a00efe30 con 0x7f38ac101fc0 2024-08-19T00:17:19.087 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.039+0000 7f38ab7fe640 1 -- 172.21.15.44:0/3143732263 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564962ad49b0 msgr2=0x564962ad4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:17:19.088 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.039+0000 7f38ab7fe640 1 --2- 172.21.15.44:0/3143732263 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564962ad49b0 0x564962ad4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.088 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.039+0000 7f38ab7fe640 1 -- 172.21.15.44:0/3143732263 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564962ad52d0 msgr2=0x564962adf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:17:19.088 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.039+0000 7f38ab7fe640 1 --2- 172.21.15.44:0/3143732263 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564962ad52d0 0x564962adf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.088 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.039+0000 7f38ab7fe640 1 -- 172.21.15.44:0/3143732263 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56496274c210 con 0x564962adfb70 2024-08-19T00:17:19.088 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.039+0000 7f38ab7fe640 1 --2- 172.21.15.44:0/3143732263 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564962adfb70 0x564962ae1f60 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f38a00bbcb0 tx=0x7f38a0009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebfb1e1bb7028aa4 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:17:19.088 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.039+0000 7f38927fc640 1 -- 172.21.15.44:0/3143732263 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a0049070 con 0x564962adfb70 2024-08-19T00:17:19.088 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.039+0000 7f38b0d9c640 1 --2- 172.21.15.44:0/1995525792 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f38940a2cf0 0x7f38940a51b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f38a4005fd0 tx=0x7f38a4004ab0 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:17:19.088 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.039+0000 7f38927fc640 1 -- 172.21.15.44:0/3143732263 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38a00bc6b0 con 0x564962adfb70 2024-08-19T00:17:19.088 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.039+0000 7f38927fc640 1 -- 172.21.15.44:0/3143732263 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a00ed460 con 0x564962adfb70 2024-08-19T00:17:19.089 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.040+0000 7f38b55c6740 1 -- 172.21.15.44:0/3143732263 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564962adfb70 msgr2=0x564962ae1f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:17:19.089 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.040+0000 7f38b55c6740 1 --2- 172.21.15.44:0/3143732263 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564962adfb70 0x564962ae1f60 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f38a00bbcb0 tx=0x7f38a0009260 comp rx=0 tx=0).stop 2024-08-19T00:17:19.089 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.040+0000 7f38b55c6740 1 -- 172.21.15.44:0/3143732263 shutdown_connections 2024-08-19T00:17:19.089 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.040+0000 7f38b55c6740 1 --2- 172.21.15.44:0/3143732263 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564962adfb70 0x564962ae1f60 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.089 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.040+0000 7f38b55c6740 1 --2- 172.21.15.44:0/3143732263 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564962ad52d0 0x564962adf630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.089 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.040+0000 7f38b55c6740 1 --2- 172.21.15.44:0/3143732263 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564962ad49b0 0x564962ad4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.089 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.040+0000 7f38b55c6740 1 -- 172.21.15.44:0/3143732263 >> 172.21.15.44:0/3143732263 conn(0x564962ad0f20 msgr2=0x564962ad1300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:17:19.089 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.040+0000 7f38b55c6740 1 -- 172.21.15.44:0/3143732263 shutdown_connections 2024-08-19T00:17:19.089 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.040+0000 7f38b55c6740 1 -- 172.21.15.44:0/3143732263 wait complete. 2024-08-19T00:17:19.089 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.040+0000 7f38b55c6740 1 -- start start 2024-08-19T00:17:19.089 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.041+0000 7f38b55c6740 1 Processor -- start 2024-08-19T00:17:19.090 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.041+0000 7f38b55c6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564962ad49b0 0x564962adc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:19.090 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.041+0000 7f38b55c6740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564962ad52d0 0x564962adcf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:19.090 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.041+0000 7f38b55c6740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564962adfb70 0x564962add450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:19.090 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.041+0000 7f38b55c6740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564962ae2500 con 0x564962ad49b0 2024-08-19T00:17:19.090 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.041+0000 7f38b55c6740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5649629f4520 con 0x564962ad52d0 2024-08-19T00:17:19.090 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.041+0000 7f38b55c6740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x564962ae2680 con 0x564962adfb70 2024-08-19T00:17:19.090 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.041+0000 7f38b55c6740 10 client.0 _ll_register_callbacks cb 0x56496274ba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:17:19.090 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.041+0000 7f38abfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564962ad49b0 0x564962adc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:19.090 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.041+0000 7f38abfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564962ad49b0 0x564962adc9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48296/0 (socket says 172.21.15.44:48296) 2024-08-19T00:17:19.090 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.041+0000 7f38abfff640 1 -- 172.21.15.44:0/932423149 learned_addr learned my addr 172.21.15.44:0/932423149 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:17:19.091 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.041+0000 7f38ab7fe640 1 --2- 172.21.15.44:0/932423149 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564962ad52d0 0x564962adcf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:19.091 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.041+0000 7f38b0d9c640 1 --2- 172.21.15.44:0/932423149 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564962adfb70 0x564962add450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:19.091 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.041+0000 7f38abfff640 1 -- 172.21.15.44:0/932423149 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564962adfb70 msgr2=0x564962add450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:17:19.091 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.041+0000 7f38abfff640 1 --2- 172.21.15.44:0/932423149 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564962adfb70 0x564962add450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.091 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.041+0000 7f38abfff640 1 -- 172.21.15.44:0/932423149 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564962ad52d0 msgr2=0x564962adcf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:17:19.091 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.041+0000 7f38abfff640 1 --2- 172.21.15.44:0/932423149 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564962ad52d0 0x564962adcf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.091 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.041+0000 7f38abfff640 1 -- 172.21.15.44:0/932423149 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564962818620 con 0x564962ad49b0 2024-08-19T00:17:19.091 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.041+0000 7f38abfff640 1 --2- 172.21.15.44:0/932423149 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564962ad49b0 0x564962adc9d0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f389c011660 tx=0x7f389c011b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6691fee25ba4d06 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:17:19.091 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.041+0000 7f388b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:17:19.092 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.042+0000 7f388b7fe640 1 -- 172.21.15.44:0/932423149 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f389c004250 con 0x564962ad49b0 2024-08-19T00:17:19.092 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.042+0000 7f388b7fe640 1 -- 172.21.15.44:0/932423149 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f389c0043f0 con 0x564962ad49b0 2024-08-19T00:17:19.092 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.042+0000 7f38b55c6740 1 -- 172.21.15.44:0/932423149 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38a00bc6b0 con 0x564962ad49b0 2024-08-19T00:17:19.092 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.042+0000 7f388b7fe640 1 -- 172.21.15.44:0/932423149 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f389c025050 con 0x564962ad49b0 2024-08-19T00:17:19.092 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.042+0000 7f38b55c6740 10 client.16050 fetch_fsmap learned FSMap version 33 2024-08-19T00:17:19.092 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.042+0000 7f38b55c6740 1 -- 172.21.15.44:0/932423149 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x564962aee070 con 0x564962ad49b0 2024-08-19T00:17:19.092 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.042+0000 7f388b7fe640 1 -- 172.21.15.44:0/932423149 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38a00bc6b0 con 0x564962ad49b0 2024-08-19T00:17:19.092 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.042+0000 7f388b7fe640 1 -- 172.21.15.44:0/932423149 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f389c003aa0 con 0x564962ad49b0 2024-08-19T00:17:19.092 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.042+0000 7f38b55c6740 10 client.16050 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:17:19.092 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.042+0000 7f38b55c6740 10 client.16050 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:17:19.093 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.042+0000 7f38b55c6740 20 client.16050 populate_metadata read hostname 'smithi044' 2024-08-19T00:17:19.093 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.042+0000 7f38b55c6740 1 --2- 172.21.15.44:0/932423149 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x564962aef530 0x564962af19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:19.093 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.042+0000 7f38b55c6740 4 client.16050 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:17:19.093 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.042+0000 7f38b55c6740 1 -- 172.21.15.44:0/932423149 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564962a46100 con 0x564962aef530 2024-08-19T00:17:19.093 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.043+0000 7f38ab7fe640 1 --2- 172.21.15.44:0/932423149 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x564962aef530 0x564962af19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:19.093 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.043+0000 7f38ab7fe640 1 --2- 172.21.15.44:0/932423149 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x564962aef530 0x564962af19c0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8493577bb88a6e9 server_cookie=e41ccb30ac5049a4 in_seq=0 out_seq=0 2024-08-19T00:17:19.093 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.043+0000 7f388b7fe640 10 client.16050 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:17:19.093 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.044+0000 7f388b7fe640 1 -- 172.21.15.44:0/932423149 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564962a46100 con 0x564962aef530 2024-08-19T00:17:19.093 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.044+0000 7f388b7fe640 10 client.16050 handle_command_reply: tid=0 2024-08-19T00:17:19.093 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.044+0000 7f38b55c6740 1 client.16050 shutdown 2024-08-19T00:17:19.093 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.044+0000 7f38b55c6740 1 -- 172.21.15.44:0/932423149 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564962ad49b0 msgr2=0x564962adc9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:17:19.093 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.044+0000 7f38b55c6740 1 --2- 172.21.15.44:0/932423149 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564962ad49b0 0x564962adc9d0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f389c011660 tx=0x7f389c011b20 comp rx=0 tx=0).stop 2024-08-19T00:17:19.094 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.044+0000 7f38b55c6740 1 -- 172.21.15.44:0/932423149 shutdown_connections 2024-08-19T00:17:19.094 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.044+0000 7f38b55c6740 1 --2- 172.21.15.44:0/932423149 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x564962aef530 0x564962af19c0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.094 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.044+0000 7f38b55c6740 1 --2- 172.21.15.44:0/932423149 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564962adfb70 0x564962add450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.094 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.044+0000 7f388b7fe640 0 client.16050 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:17:19.094 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.044+0000 7f38b55c6740 1 --2- 172.21.15.44:0/932423149 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564962ad52d0 0x564962adcf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.094 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.044+0000 7f38b55c6740 1 --2- 172.21.15.44:0/932423149 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564962ad49b0 0x564962adc9d0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.094 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.044+0000 7f38b55c6740 1 -- 172.21.15.44:0/932423149 >> 172.21.15.44:0/932423149 conn(0x564962ad0f20 msgr2=0x564962ad6c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:17:19.094 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.044+0000 7f38b55c6740 1 -- 172.21.15.44:0/932423149 shutdown_connections 2024-08-19T00:17:19.094 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.044+0000 7f38b55c6740 1 -- 172.21.15.44:0/932423149 wait complete. 2024-08-19T00:17:19.094 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.044+0000 7f38b55c6740 20 client.16050 trim_cache size 0 max 16384 2024-08-19T00:17:19.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.057+0000 7f20937f3740 1 Processor -- start 2024-08-19T00:17:19.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.057+0000 7f20937f3740 1 -- start start 2024-08-19T00:17:19.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.057+0000 7f20937f3740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fb6ca38830 0x55fb6ca5f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:19.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.057+0000 7f20937f3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb6ca39150 0x55fb6ca5fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:19.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.057+0000 7f20937f3740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fb6ca47f80 0x55fb6ca421c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:19.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.057+0000 7f20937f3740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f208c1acbc0 con 0x55fb6ca39150 2024-08-19T00:17:19.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.057+0000 7f20937f3740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f208c1ae700 con 0x55fb6ca38830 2024-08-19T00:17:19.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.057+0000 7f20937f3740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f208c1ad290 con 0x55fb6ca47f80 2024-08-19T00:17:19.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.057+0000 7f208a7fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb6ca39150 0x55fb6ca5fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:19.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.057+0000 7f208a7fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb6ca39150 0x55fb6ca5fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48310/0 (socket says 172.21.15.44:48310) 2024-08-19T00:17:19.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.057+0000 7f208a7fc640 1 -- 172.21.15.44:0/3160552993 learned_addr learned my addr 172.21.15.44:0/3160552993 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:17:19.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.057+0000 7f208affd640 1 --2- 172.21.15.44:0/3160552993 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fb6ca38830 0x55fb6ca5f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:19.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.058+0000 7f208b7fe640 1 --2- 172.21.15.44:0/3160552993 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fb6ca47f80 0x55fb6ca421c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:19.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.058+0000 7f208a7fc640 1 -- 172.21.15.44:0/3160552993 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fb6ca47f80 msgr2=0x55fb6ca421c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:17:19.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.058+0000 7f208a7fc640 1 --2- 172.21.15.44:0/3160552993 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fb6ca47f80 0x55fb6ca421c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.058+0000 7f208a7fc640 1 -- 172.21.15.44:0/3160552993 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fb6ca38830 msgr2=0x55fb6ca5f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:17:19.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.058+0000 7f208a7fc640 1 --2- 172.21.15.44:0/3160552993 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fb6ca38830 0x55fb6ca5f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.058+0000 7f208a7fc640 1 -- 172.21.15.44:0/3160552993 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb6ca54930 con 0x55fb6ca39150 2024-08-19T00:17:19.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.058+0000 7f208b7fe640 1 --2- 172.21.15.44:0/3160552993 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fb6ca47f80 0x55fb6ca421c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:17:19.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.058+0000 7f208a7fc640 1 --2- 172.21.15.44:0/3160552993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb6ca39150 0x55fb6ca5fe40 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f2074009420 tx=0x7f2074017730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddb194df7486daff server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:17:19.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.058+0000 7f2080ff9640 1 -- 172.21.15.44:0/3160552993 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f207401e030 con 0x55fb6ca39150 2024-08-19T00:17:19.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.058+0000 7f2080ff9640 1 -- 172.21.15.44:0/3160552993 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2074097460 con 0x55fb6ca39150 2024-08-19T00:17:19.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.058+0000 7f2080ff9640 1 -- 172.21.15.44:0/3160552993 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2074096b40 con 0x55fb6ca39150 2024-08-19T00:17:19.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.059+0000 7f20937f3740 1 -- 172.21.15.44:0/3160552993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb6ca39150 msgr2=0x55fb6ca5fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:17:19.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.059+0000 7f20937f3740 1 --2- 172.21.15.44:0/3160552993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb6ca39150 0x55fb6ca5fe40 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f2074009420 tx=0x7f2074017730 comp rx=0 tx=0).stop 2024-08-19T00:17:19.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.059+0000 7f20937f3740 1 -- 172.21.15.44:0/3160552993 shutdown_connections 2024-08-19T00:17:19.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.059+0000 7f20937f3740 1 --2- 172.21.15.44:0/3160552993 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fb6ca47f80 0x55fb6ca421c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.059+0000 7f20937f3740 1 --2- 172.21.15.44:0/3160552993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb6ca39150 0x55fb6ca5fe40 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.059+0000 7f20937f3740 1 --2- 172.21.15.44:0/3160552993 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fb6ca38830 0x55fb6ca5f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.059+0000 7f20937f3740 1 -- 172.21.15.44:0/3160552993 >> 172.21.15.44:0/3160552993 conn(0x55fb6ca34f20 msgr2=0x55fb6ca34080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:17:19.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.059+0000 7f20937f3740 1 -- 172.21.15.44:0/3160552993 shutdown_connections 2024-08-19T00:17:19.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.059+0000 7f20937f3740 1 -- 172.21.15.44:0/3160552993 wait complete. 2024-08-19T00:17:19.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.060+0000 7f20937f3740 1 -- start start 2024-08-19T00:17:19.099 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.060+0000 7f38b55c6740 1 Processor -- start 2024-08-19T00:17:19.099 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.060+0000 7f38b55c6740 1 -- start start 2024-08-19T00:17:19.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.060+0000 7f20937f3740 1 Processor -- start 2024-08-19T00:17:19.100 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.060+0000 7f38b55c6740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564962ad49b0 0x564962acfe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:19.100 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.060+0000 7f38b55c6740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564962ad52d0 0x564962af7320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:19.100 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.060+0000 7f38b55c6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564962adfb70 0x564962af7860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:19.100 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.060+0000 7f38b55c6740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f38ac1aca10 con 0x564962adfb70 2024-08-19T00:17:19.100 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.060+0000 7f38b55c6740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f38ac1ae550 con 0x564962ad52d0 2024-08-19T00:17:19.100 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.060+0000 7f38b55c6740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f38ac1ad0e0 con 0x564962ad49b0 2024-08-19T00:17:19.100 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.060+0000 7f38b0d9c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564962adfb70 0x564962af7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:19.100 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.060+0000 7f38b0d9c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564962adfb70 0x564962af7860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48320/0 (socket says 172.21.15.44:48320) 2024-08-19T00:17:19.100 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.060+0000 7f38b0d9c640 1 -- 172.21.15.44:0/3410574789 learned_addr learned my addr 172.21.15.44:0/3410574789 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:17:19.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.060+0000 7f20937f3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb6ca38830 0x55fb6ca41e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:19.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.060+0000 7f20937f3740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fb6ca39150 0x55fb6ca423c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:19.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.060+0000 7f208affd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb6ca38830 0x55fb6ca41e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:19.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.060+0000 7f208affd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb6ca38830 0x55fb6ca41e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48334/0 (socket says 172.21.15.44:48334) 2024-08-19T00:17:19.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.060+0000 7f208affd640 1 -- 172.21.15.44:0/2793885556 learned_addr learned my addr 172.21.15.44:0/2793885556 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:17:19.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.060+0000 7f208a7fc640 1 --2- 172.21.15.44:0/2793885556 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fb6ca39150 0x55fb6ca423c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:19.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.060+0000 7f20937f3740 1 --2- 172.21.15.44:0/2793885556 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fb6ca47f80 0x55fb6ca42900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:19.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.060+0000 7f20937f3740 1 -- 172.21.15.44:0/2793885556 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f208c1ae030 con 0x55fb6ca38830 2024-08-19T00:17:19.102 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.060+0000 7f38ab7fe640 1 --2- 172.21.15.44:0/3410574789 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564962ad52d0 0x564962af7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:19.102 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.060+0000 7f38abfff640 1 --2- 172.21.15.44:0/3410574789 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564962ad49b0 0x564962acfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:19.102 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.061+0000 7f38abfff640 1 -- 172.21.15.44:0/3410574789 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564962ad52d0 msgr2=0x564962af7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:17:19.102 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.061+0000 7f38abfff640 1 --2- 172.21.15.44:0/3410574789 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564962ad52d0 0x564962af7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.102 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.061+0000 7f38abfff640 1 -- 172.21.15.44:0/3410574789 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564962adfb70 msgr2=0x564962af7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:17:19.103 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.061+0000 7f38abfff640 1 --2- 172.21.15.44:0/3410574789 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564962adfb70 0x564962af7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.060+0000 7f20937f3740 1 -- 172.21.15.44:0/2793885556 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f208c1ad960 con 0x55fb6ca47f80 2024-08-19T00:17:19.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.060+0000 7f20937f3740 1 -- 172.21.15.44:0/2793885556 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f208c1aaba0 con 0x55fb6ca39150 2024-08-19T00:17:19.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.061+0000 7f20937f3740 10 client.0 _ll_register_callbacks cb 0x7f2074017ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:17:19.103 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.061+0000 7f38abfff640 1 -- 172.21.15.44:0/3410574789 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564962addd50 con 0x564962ad49b0 2024-08-19T00:17:19.104 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.061+0000 7f38b0d9c640 1 --2- 172.21.15.44:0/3410574789 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564962adfb70 0x564962af7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:17:19.104 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.061+0000 7f38ab7fe640 1 --2- 172.21.15.44:0/3410574789 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564962ad52d0 0x564962af7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:17:19.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.061+0000 7f208b7fe640 1 --2- 172.21.15.44:0/2793885556 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fb6ca47f80 0x55fb6ca42900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:19.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.061+0000 7f208affd640 1 -- 172.21.15.44:0/2793885556 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fb6ca39150 msgr2=0x55fb6ca423c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:17:19.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.061+0000 7f208affd640 1 --2- 172.21.15.44:0/2793885556 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fb6ca39150 0x55fb6ca423c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.061+0000 7f208affd640 1 -- 172.21.15.44:0/2793885556 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fb6ca47f80 msgr2=0x55fb6ca42900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:17:19.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.061+0000 7f208affd640 1 --2- 172.21.15.44:0/2793885556 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fb6ca47f80 0x55fb6ca42900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.061+0000 7f208affd640 1 -- 172.21.15.44:0/2793885556 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb6cac18d0 con 0x55fb6ca38830 2024-08-19T00:17:19.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.061+0000 7f208a7fc640 1 --2- 172.21.15.44:0/2793885556 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fb6ca39150 0x55fb6ca423c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:17:19.105 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.061+0000 7f38abfff640 1 --2- 172.21.15.44:0/3410574789 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564962ad49b0 0x564962acfe40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f389c0124f0 tx=0x7f389c009f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c21fab2451be3c04 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:17:19.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.061+0000 7f208b7fe640 1 --2- 172.21.15.44:0/2793885556 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fb6ca47f80 0x55fb6ca42900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:17:19.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.061+0000 7f208affd640 1 --2- 172.21.15.44:0/2793885556 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb6ca38830 0x55fb6ca41e80 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f207c030040 tx=0x7f207c02f500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cd1638f5a7a8b60 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:17:19.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.061+0000 7f20727fc640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:17:19.106 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.061+0000 7f3891ffb640 1 -- 172.21.15.44:0/3410574789 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f389c02d070 con 0x564962ad49b0 2024-08-19T00:17:19.106 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.061+0000 7f3891ffb640 1 -- 172.21.15.44:0/3410574789 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f389c016070 con 0x564962ad49b0 2024-08-19T00:17:19.106 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.061+0000 7f3891ffb640 1 -- 172.21.15.44:0/3410574789 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f389c003960 con 0x564962ad49b0 2024-08-19T00:17:19.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.061+0000 7f20727fc640 1 -- 172.21.15.44:0/2793885556 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f207c049070 con 0x55fb6ca38830 2024-08-19T00:17:19.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.061+0000 7f20937f3740 1 -- 172.21.15.44:0/2793885556 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2074097460 con 0x55fb6ca38830 2024-08-19T00:17:19.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.061+0000 7f20727fc640 1 -- 172.21.15.44:0/2793885556 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f207c003d80 con 0x55fb6ca38830 2024-08-19T00:17:19.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.062+0000 7f20727fc640 1 -- 172.21.15.44:0/2793885556 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f207c055050 con 0x55fb6ca38830 2024-08-19T00:17:19.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.062+0000 7f20937f3740 10 client.16059 fetch_fsmap learned FSMap version 33 2024-08-19T00:17:19.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.062+0000 7f20937f3740 1 -- 172.21.15.44:0/2793885556 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55fb6cac2b30 con 0x55fb6ca38830 2024-08-19T00:17:19.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.062+0000 7f20727fc640 1 -- 172.21.15.44:0/2793885556 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2074097460 con 0x55fb6ca38830 2024-08-19T00:17:19.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.062+0000 7f20727fc640 1 -- 172.21.15.44:0/2793885556 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f207c045550 con 0x55fb6ca38830 2024-08-19T00:17:19.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.062+0000 7f20937f3740 10 client.16059 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:17:19.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.062+0000 7f20937f3740 10 client.16059 resolve_mds: validated gid 24473 aka daemon mds.b 2024-08-19T00:17:19.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.062+0000 7f20937f3740 20 client.16059 populate_metadata read hostname 'smithi044' 2024-08-19T00:17:19.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.062+0000 7f20937f3740 1 --2- 172.21.15.44:0/2793885556 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55fb6cac3200 0x55fb6cac55f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:19.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.062+0000 7f20937f3740 4 client.16059 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "7b2a62c8", "release": true, "await": true}] 2024-08-19T00:17:19.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.062+0000 7f20937f3740 1 -- 172.21.15.44:0/2793885556 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "quiesce db", "set_id": "7b2a62c8", "release": true, "await": true}) -- 0x55fb6c9a66e0 con 0x55fb6cac3200 2024-08-19T00:17:19.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.062+0000 7f208a7fc640 1 --2- 172.21.15.44:0/2793885556 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55fb6cac3200 0x55fb6cac55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:19.109 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.062+0000 7f38b55c6740 1 -- 172.21.15.44:0/3410574789 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564962ad49b0 msgr2=0x564962acfe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:17:19.109 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.062+0000 7f38b55c6740 1 --2- 172.21.15.44:0/3410574789 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564962ad49b0 0x564962acfe40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f389c0124f0 tx=0x7f389c009f50 comp rx=0 tx=0).stop 2024-08-19T00:17:19.109 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.062+0000 7f38b55c6740 1 -- 172.21.15.44:0/3410574789 shutdown_connections 2024-08-19T00:17:19.109 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.062+0000 7f38b55c6740 1 --2- 172.21.15.44:0/3410574789 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564962adfb70 0x564962af7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.109 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.062+0000 7f38b55c6740 1 --2- 172.21.15.44:0/3410574789 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564962ad52d0 0x564962af7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.109 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.062+0000 7f38b55c6740 1 --2- 172.21.15.44:0/3410574789 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564962ad49b0 0x564962acfe40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.110 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.062+0000 7f38b55c6740 1 -- 172.21.15.44:0/3410574789 >> 172.21.15.44:0/3410574789 conn(0x564962ad0f20 msgr2=0x564962acf730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:17:19.110 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.062+0000 7f38b55c6740 1 -- 172.21.15.44:0/3410574789 shutdown_connections 2024-08-19T00:17:19.110 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.062+0000 7f38b55c6740 1 -- 172.21.15.44:0/3410574789 wait complete. 2024-08-19T00:17:19.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.063+0000 7f208a7fc640 1 --2- 172.21.15.44:0/2793885556 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55fb6cac3200 0x55fb6cac55f0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d76c9f4f5aef28f1 server_cookie=a4e7765e9c7d4928 in_seq=0 out_seq=0 2024-08-19T00:17:19.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.063+0000 7f20727fc640 10 client.16059 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:17:19.113 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.063+0000 7f38b55c6740 1 -- start start 2024-08-19T00:17:19.113 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.063+0000 7f38b55c6740 1 Processor -- start 2024-08-19T00:17:19.113 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.063+0000 7f38b55c6740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564962ad49b0 0x564962ae78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:19.113 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.063+0000 7f38b55c6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564962ad52d0 0x564962ae7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:19.113 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.063+0000 7f38b55c6740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564962adfb70 0x564962ae2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:19.113 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.063+0000 7f38b55c6740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f38ac1ade80 con 0x564962ad52d0 2024-08-19T00:17:19.113 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.063+0000 7f38b55c6740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f38ac1ad7b0 con 0x564962adfb70 2024-08-19T00:17:19.113 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.063+0000 7f38b55c6740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f38ac1aa9f0 con 0x564962ad49b0 2024-08-19T00:17:19.113 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.063+0000 7f38ab7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564962ad52d0 0x564962ae7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:19.114 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.063+0000 7f38b55c6740 10 client.0 _ll_register_callbacks cb 0x7f389c009550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:17:19.114 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.063+0000 7f38ab7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564962ad52d0 0x564962ae7e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48336/0 (socket says 172.21.15.44:48336) 2024-08-19T00:17:19.114 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.063+0000 7f38ab7fe640 1 -- 172.21.15.44:0/1576527792 learned_addr learned my addr 172.21.15.44:0/1576527792 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:17:19.114 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.064+0000 7f38abfff640 1 --2- 172.21.15.44:0/1576527792 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564962ad49b0 0x564962ae78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:19.114 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.064+0000 7f38b0d9c640 1 --2- 172.21.15.44:0/1576527792 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564962adfb70 0x564962ae2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:19.114 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.064+0000 7f38ab7fe640 1 -- 172.21.15.44:0/1576527792 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564962ad49b0 msgr2=0x564962ae78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:17:19.114 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.064+0000 7f38ab7fe640 1 --2- 172.21.15.44:0/1576527792 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564962ad49b0 0x564962ae78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.114 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.064+0000 7f38ab7fe640 1 -- 172.21.15.44:0/1576527792 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564962adfb70 msgr2=0x564962ae2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:17:19.114 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.064+0000 7f38ab7fe640 1 --2- 172.21.15.44:0/1576527792 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564962adfb70 0x564962ae2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.114 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.064+0000 7f38ab7fe640 1 -- 172.21.15.44:0/1576527792 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564962ae2dd0 con 0x564962ad52d0 2024-08-19T00:17:19.114 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.064+0000 7f38ab7fe640 1 --2- 172.21.15.44:0/1576527792 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564962ad52d0 0x564962ae7e20 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f38a00b8980 tx=0x7f38a002a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe8df05937091d9e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:17:19.114 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.064+0000 7f388b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:17:19.115 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.064+0000 7f388b7fe640 1 -- 172.21.15.44:0/1576527792 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a0049040 con 0x564962ad52d0 2024-08-19T00:17:19.115 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.064+0000 7f388b7fe640 1 -- 172.21.15.44:0/1576527792 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f38a00ed460 con 0x564962ad52d0 2024-08-19T00:17:19.115 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.064+0000 7f38b55c6740 1 -- 172.21.15.44:0/1576527792 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f389c016070 con 0x564962ad52d0 2024-08-19T00:17:19.115 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.064+0000 7f388b7fe640 1 -- 172.21.15.44:0/1576527792 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f38a00bc6b0 con 0x564962ad52d0 2024-08-19T00:17:19.115 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.064+0000 7f38b55c6740 10 client.16062 fetch_fsmap learned FSMap version 33 2024-08-19T00:17:19.115 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.064+0000 7f38b55c6740 1 -- 172.21.15.44:0/1576527792 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x564962b5aa40 con 0x564962ad52d0 2024-08-19T00:17:19.115 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.064+0000 7f388b7fe640 1 -- 172.21.15.44:0/1576527792 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f389c016070 con 0x564962ad52d0 2024-08-19T00:17:19.115 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.064+0000 7f388b7fe640 1 -- 172.21.15.44:0/1576527792 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f38a0003c80 con 0x564962ad52d0 2024-08-19T00:17:19.115 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.064+0000 7f38b55c6740 10 client.16062 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:17:19.115 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.065+0000 7f38b55c6740 10 client.16062 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:17:19.115 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.065+0000 7f38b55c6740 20 client.16062 populate_metadata read hostname 'smithi044' 2024-08-19T00:17:19.115 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.065+0000 7f38b55c6740 1 --2- 172.21.15.44:0/1576527792 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x564962b5ae40 0x564962b5d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:19.115 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.065+0000 7f38b55c6740 4 client.16062 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-19T00:17:19.115 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.065+0000 7f38b55c6740 1 -- 172.21.15.44:0/1576527792 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564962a40450 con 0x564962b5ae40 2024-08-19T00:17:19.116 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.065+0000 7f38abfff640 1 --2- 172.21.15.44:0/1576527792 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x564962b5ae40 0x564962b5d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:19.116 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.065+0000 7f38abfff640 1 --2- 172.21.15.44:0/1576527792 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x564962b5ae40 0x564962b5d260 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0d4f184752814e9 server_cookie=f2943e6aface96e4 in_seq=0 out_seq=0 2024-08-19T00:17:19.116 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.065+0000 7f388b7fe640 10 client.16062 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:17:19.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.074+0000 7f20727fc640 1 -- 172.21.15.44:0/2793885556 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55fb6c9a66e0 con 0x55fb6cac3200 2024-08-19T00:17:19.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.074+0000 7f20727fc640 10 client.16059 handle_command_reply: tid=0 2024-08-19T00:17:19.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.074+0000 7f20937f3740 1 client.16059 shutdown 2024-08-19T00:17:19.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.074+0000 7f20937f3740 1 -- 172.21.15.44:0/2793885556 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb6ca38830 msgr2=0x55fb6ca41e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:17:19.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.074+0000 7f20937f3740 1 --2- 172.21.15.44:0/2793885556 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb6ca38830 0x55fb6ca41e80 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f207c030040 tx=0x7f207c02f500 comp rx=0 tx=0).stop 2024-08-19T00:17:19.117 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.074+0000 7f388b7fe640 1 -- 172.21.15.44:0/1576527792 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564962a40450 con 0x564962b5ae40 2024-08-19T00:17:19.117 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.074+0000 7f388b7fe640 10 client.16062 handle_command_reply: tid=0 2024-08-19T00:17:19.117 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.074+0000 7f38b55c6740 1 client.16062 shutdown 2024-08-19T00:17:19.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.074+0000 7f20937f3740 1 -- 172.21.15.44:0/2793885556 shutdown_connections 2024-08-19T00:17:19.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.074+0000 7f20937f3740 1 --2- 172.21.15.44:0/2793885556 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55fb6cac3200 0x55fb6cac55f0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.074+0000 7f20727fc640 0 client.16059 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:17:19.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.074+0000 7f20937f3740 1 --2- 172.21.15.44:0/2793885556 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fb6ca39150 0x55fb6ca423c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.074+0000 7f20937f3740 1 --2- 172.21.15.44:0/2793885556 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fb6ca47f80 0x55fb6ca42900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.074+0000 7f20937f3740 1 --2- 172.21.15.44:0/2793885556 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb6ca38830 0x55fb6ca41e80 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.074+0000 7f20937f3740 1 -- 172.21.15.44:0/2793885556 >> 172.21.15.44:0/2793885556 conn(0x55fb6ca34f20 msgr2=0x55fb6ca436e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:17:19.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.075+0000 7f20937f3740 1 -- 172.21.15.44:0/2793885556 shutdown_connections 2024-08-19T00:17:19.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.075+0000 7f20937f3740 1 -- 172.21.15.44:0/2793885556 wait complete. 2024-08-19T00:17:19.119 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.075+0000 7f38b55c6740 1 -- 172.21.15.44:0/1576527792 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564962ad52d0 msgr2=0x564962ae7e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:17:19.119 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.075+0000 7f38b55c6740 1 --2- 172.21.15.44:0/1576527792 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564962ad52d0 0x564962ae7e20 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f38a00b8980 tx=0x7f38a002a420 comp rx=0 tx=0).stop 2024-08-19T00:17:19.119 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.075+0000 7f38b55c6740 1 -- 172.21.15.44:0/1576527792 shutdown_connections 2024-08-19T00:17:19.119 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.075+0000 7f38b55c6740 1 --2- 172.21.15.44:0/1576527792 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x564962b5ae40 0x564962b5d260 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.119 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.075+0000 7f38b55c6740 1 --2- 172.21.15.44:0/1576527792 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564962adfb70 0x564962ae2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.119 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.075+0000 7f38b55c6740 1 --2- 172.21.15.44:0/1576527792 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564962ad52d0 0x564962ae7e20 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.120 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.075+0000 7f38b55c6740 1 --2- 172.21.15.44:0/1576527792 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564962ad49b0 0x564962ae78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.075+0000 7f20937f3740 20 client.16059 trim_cache size 0 max 16384 2024-08-19T00:17:19.120 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.075+0000 7f38b55c6740 1 -- 172.21.15.44:0/1576527792 >> 172.21.15.44:0/1576527792 conn(0x564962ad0f20 msgr2=0x564962acff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:17:19.120 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.075+0000 7f388b7fe640 0 client.16062 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:17:19.121 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.075+0000 7f38b55c6740 1 -- 172.21.15.44:0/1576527792 shutdown_connections 2024-08-19T00:17:19.121 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.075+0000 7f38b55c6740 1 -- 172.21.15.44:0/1576527792 wait complete. 2024-08-19T00:17:19.121 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.075+0000 7f38b55c6740 20 client.16062 trim_cache size 0 max 16384 2024-08-19T00:17:19.121 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-08-19T00:17:19.121 INFO:teuthology.orchestra.run.smithi044.stdout: "epoch": 33, 2024-08-19T00:17:19.121 INFO:teuthology.orchestra.run.smithi044.stdout: "leader": 24473, 2024-08-19T00:17:19.121 INFO:teuthology.orchestra.run.smithi044.stdout: "set_version": 16, 2024-08-19T00:17:19.121 INFO:teuthology.orchestra.run.smithi044.stdout: "sets": { 2024-08-19T00:17:19.121 INFO:teuthology.orchestra.run.smithi044.stdout: "7b2a62c8": { 2024-08-19T00:17:19.121 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 16, 2024-08-19T00:17:19.122 INFO:teuthology.orchestra.run.smithi044.stdout: "age_ref": 0.0, 2024-08-19T00:17:19.122 INFO:teuthology.orchestra.run.smithi044.stdout: "state": { 2024-08-19T00:17:19.122 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "RELEASED", 2024-08-19T00:17:19.122 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.0 2024-08-19T00:17:19.122 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:17:19.122 INFO:teuthology.orchestra.run.smithi044.stdout: "timeout": 90.0, 2024-08-19T00:17:19.122 INFO:teuthology.orchestra.run.smithi044.stdout: "expiration": 150.0, 2024-08-19T00:17:19.122 INFO:teuthology.orchestra.run.smithi044.stdout: "members": { 2024-08-19T00:17:19.122 INFO:teuthology.orchestra.run.smithi044.stdout: "file:/": { 2024-08-19T00:17:19.122 INFO:teuthology.orchestra.run.smithi044.stdout: "excluded": false, 2024-08-19T00:17:19.122 INFO:teuthology.orchestra.run.smithi044.stdout: "state": { 2024-08-19T00:17:19.122 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "RELEASED", 2024-08-19T00:17:19.122 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.0 2024-08-19T00:17:19.123 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:17:19.123 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:17:19.123 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:17:19.123 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:17:19.123 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:17:19.123 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-08-19T00:17:19.123 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:{ 2024-08-19T00:17:19.123 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "message": "", 2024-08-19T00:17:19.123 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "return_code": 0 2024-08-19T00:17:19.123 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:} 2024-08-19T00:17:19.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.075+0000 7f20913f5640 1 -- 172.21.15.44:0/3620225002 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f20780a2cf0 msgr2=0x7f20780a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:17:19.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.075+0000 7f20913f5640 1 --2- 172.21.15.44:0/3620225002 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f20780a2cf0 0x7f20780a51b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2084005fd0 tx=0x7f2084005da0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.075+0000 7f20913f5640 1 -- 172.21.15.44:0/3620225002 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f208c103410 msgr2=0x7f208c1986a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:17:19.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.075+0000 7f20913f5640 1 --2- 172.21.15.44:0/3620225002 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f208c103410 0x7f208c1986a0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f207400b4a0 tx=0x7f207400b960 comp rx=0 tx=0).stop 2024-08-19T00:17:19.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.075+0000 7f20913f5640 1 -- 172.21.15.44:0/3620225002 shutdown_connections 2024-08-19T00:17:19.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.075+0000 7f20913f5640 1 --2- 172.21.15.44:0/3620225002 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f20780a2cf0 0x7f20780a51b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.125 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.076+0000 7f38b159d640 1 -- 172.21.15.44:0/1995525792 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f38940a2cf0 msgr2=0x7f38940a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:17:19.125 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.076+0000 7f38b159d640 1 --2- 172.21.15.44:0/1995525792 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f38940a2cf0 0x7f38940a51b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f38a4005fd0 tx=0x7f38a4004ab0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.125 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.076+0000 7f38b159d640 1 -- 172.21.15.44:0/1995525792 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38ac101fc0 msgr2=0x7f38ac1984e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:17:19.125 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.076+0000 7f38b159d640 1 --2- 172.21.15.44:0/1995525792 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38ac101fc0 0x7f38ac1984e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f38a0009230 tx=0x7f38a0004270 comp rx=0 tx=0).stop 2024-08-19T00:17:19.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.075+0000 7f20913f5640 1 --2- 172.21.15.44:0/3620225002 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f208c10bed0 0x7f208c19ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.075+0000 7f20913f5640 1 --2- 172.21.15.44:0/3620225002 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f208c103410 0x7f208c1986a0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.075+0000 7f20913f5640 1 --2- 172.21.15.44:0/3620225002 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f208c102af0 0x7f208c198160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.075+0000 7f20913f5640 1 -- 172.21.15.44:0/3620225002 >> 172.21.15.44:0/3620225002 conn(0x7f208c0fc4f0 msgr2=0x7f208c0fd150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:17:19.126 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.076+0000 7f38b159d640 1 -- 172.21.15.44:0/1995525792 shutdown_connections 2024-08-19T00:17:19.126 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.076+0000 7f38b159d640 1 --2- 172.21.15.44:0/1995525792 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f38940a2cf0 0x7f38940a51b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.126 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.076+0000 7f38b159d640 1 --2- 172.21.15.44:0/1995525792 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f38ac107630 0x7f38ac19c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.076+0000 7f20913f5640 1 -- 172.21.15.44:0/3620225002 shutdown_connections 2024-08-19T00:17:19.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:17:19.076+0000 7f20913f5640 1 -- 172.21.15.44:0/3620225002 wait complete. 2024-08-19T00:17:19.127 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.076+0000 7f38b159d640 1 --2- 172.21.15.44:0/1995525792 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38ac101fc0 0x7f38ac1984e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.127 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.076+0000 7f38b159d640 1 --2- 172.21.15.44:0/1995525792 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f38ac101620 0x7f38ac197fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:19.127 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.076+0000 7f38b159d640 1 -- 172.21.15.44:0/1995525792 >> 172.21.15.44:0/1995525792 conn(0x7f38ac0fd320 msgr2=0x7f38ac0fdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:17:19.127 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.076+0000 7f38b159d640 1 -- 172.21.15.44:0/1995525792 shutdown_connections 2024-08-19T00:17:19.127 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:19.076+0000 7f38b159d640 1 -- 172.21.15.44:0/1995525792 wait complete. 2024-08-19T00:17:19.672 INFO:tasks.workunit.client.0.smithi044.stdout: 1 176722 1.29 MB/sec execute 44 sec latency 29932.134 ms 2024-08-19T00:17:20.017 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:17:19 smithi044 ceph-mon[18489]: pgmap v123: 129 pgs: 129 active+clean; 105 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 11 op/s 2024-08-19T00:17:20.047 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '7b2a62c8', total seconds elapsed: 33.5 2024-08-19T00:17:20.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:17:19 smithi171 ceph-mon[21810]: pgmap v123: 129 pgs: 129 active+clean; 105 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 11 op/s 2024-08-19T00:17:20.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:17:19 smithi116 ceph-mon[21873]: pgmap v123: 129 pgs: 129 active+clean; 105 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 11 op/s 2024-08-19T00:17:20.672 INFO:tasks.workunit.client.0.smithi044.stdout: 1 178944 1.53 MB/sec execute 45 sec latency 20.937 ms 2024-08-19T00:17:21.672 INFO:tasks.workunit.client.0.smithi044.stdout: 1 181652 1.81 MB/sec execute 46 sec latency 11.534 ms 2024-08-19T00:17:22.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:17:21 smithi171 ceph-mon[21810]: pgmap v124: 129 pgs: 129 active+clean; 106 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 95 KiB/s wr, 26 op/s 2024-08-19T00:17:22.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:17:21 smithi116 ceph-mon[21873]: pgmap v124: 129 pgs: 129 active+clean; 106 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 95 KiB/s wr, 26 op/s 2024-08-19T00:17:22.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:17:21 smithi044 ceph-mon[18489]: pgmap v124: 129 pgs: 129 active+clean; 106 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 95 KiB/s wr, 26 op/s 2024-08-19T00:17:22.672 INFO:tasks.workunit.client.0.smithi044.stdout: 1 184727 2.17 MB/sec execute 47 sec latency 18.378 ms 2024-08-19T00:17:23.672 INFO:tasks.workunit.client.0.smithi044.stdout: 1 187384 2.39 MB/sec execute 48 sec latency 13.318 ms 2024-08-19T00:17:23.917 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:17:23 smithi116 ceph-mon[21873]: pgmap v125: 129 pgs: 129 active+clean; 106 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 84 KiB/s wr, 19 op/s 2024-08-19T00:17:24.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:17:23 smithi171 ceph-mon[21810]: pgmap v125: 129 pgs: 129 active+clean; 106 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 84 KiB/s wr, 19 op/s 2024-08-19T00:17:24.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:17:23 smithi044 ceph-mon[18489]: pgmap v125: 129 pgs: 129 active+clean; 106 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 84 KiB/s wr, 19 op/s 2024-08-19T00:17:24.672 INFO:tasks.workunit.client.0.smithi044.stdout: 1 189665 2.58 MB/sec execute 49 sec latency 27.927 ms 2024-08-19T00:17:25.672 INFO:tasks.workunit.client.0.smithi044.stdout: 1 192268 2.81 MB/sec execute 50 sec latency 11.676 ms 2024-08-19T00:17:26.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:17:25 smithi171 ceph-mon[21810]: pgmap v126: 129 pgs: 129 active+clean; 115 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 996 KiB/s wr, 120 op/s 2024-08-19T00:17:26.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:17:25 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:17:26.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:17:25 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:17:26.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:17:25 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:17:26.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:17:25 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:17:26.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:17:25 smithi116 ceph-mon[21873]: pgmap v126: 129 pgs: 129 active+clean; 115 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 996 KiB/s wr, 120 op/s 2024-08-19T00:17:26.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:17:25 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:17:26.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:17:25 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:17:26.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:17:25 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:17:26.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:17:25 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:17:26.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:17:25 smithi044 ceph-mon[18489]: pgmap v126: 129 pgs: 129 active+clean; 115 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 996 KiB/s wr, 120 op/s 2024-08-19T00:17:26.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:17:25 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:17:26.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:17:25 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:17:26.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:17:25 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:17:26.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:17:25 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:17:26.672 INFO:tasks.workunit.client.0.smithi044.stdout: 1 195357 3.12 MB/sec execute 51 sec latency 14.643 ms 2024-08-19T00:17:27.672 INFO:tasks.workunit.client.0.smithi044.stdout: 1 198026 3.31 MB/sec execute 52 sec latency 19.597 ms 2024-08-19T00:17:28.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:17:27 smithi171 ceph-mon[21810]: pgmap v127: 129 pgs: 129 active+clean; 115 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 994 KiB/s wr, 116 op/s 2024-08-19T00:17:28.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:17:27 smithi116 ceph-mon[21873]: pgmap v127: 129 pgs: 129 active+clean; 115 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 994 KiB/s wr, 116 op/s 2024-08-19T00:17:28.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:17:27 smithi044 ceph-mon[18489]: pgmap v127: 129 pgs: 129 active+clean; 115 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 994 KiB/s wr, 116 op/s 2024-08-19T00:17:28.675 INFO:tasks.workunit.client.0.smithi044.stdout: 1 200198 3.47 MB/sec execute 53 sec latency 21.281 ms 2024-08-19T00:17:29.672 INFO:tasks.workunit.client.0.smithi044.stdout: 1 202852 3.66 MB/sec execute 54 sec latency 11.154 ms 2024-08-19T00:17:30.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:17:29 smithi171 ceph-mon[21810]: pgmap v128: 129 pgs: 129 active+clean; 115 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 994 KiB/s wr, 116 op/s 2024-08-19T00:17:30.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:17:29 smithi116 ceph-mon[21873]: pgmap v128: 129 pgs: 129 active+clean; 115 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 994 KiB/s wr, 116 op/s 2024-08-19T00:17:30.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:17:29 smithi044 ceph-mon[18489]: pgmap v128: 129 pgs: 129 active+clean; 115 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 994 KiB/s wr, 116 op/s 2024-08-19T00:17:30.672 INFO:tasks.workunit.client.0.smithi044.stdout: 1 205724 3.91 MB/sec execute 55 sec latency 19.722 ms 2024-08-19T00:17:31.672 INFO:tasks.workunit.client.0.smithi044.stdout: 1 208083 4.00 MB/sec execute 56 sec latency 12.569 ms 2024-08-19T00:17:32.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:17:31 smithi171 ceph-mon[21810]: pgmap v129: 129 pgs: 129 active+clean; 124 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 1.8 MiB/s wr, 213 op/s 2024-08-19T00:17:32.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:17:31 smithi116 ceph-mon[21873]: pgmap v129: 129 pgs: 129 active+clean; 124 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 1.8 MiB/s wr, 213 op/s 2024-08-19T00:17:32.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:17:31 smithi044 ceph-mon[18489]: pgmap v129: 129 pgs: 129 active+clean; 124 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 1.8 MiB/s wr, 213 op/s 2024-08-19T00:17:32.169 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.167+0000 7f9400447640 1 -- 172.21.15.44:0/2870183554 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93f81032d0 msgr2=0x7f93f810b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:17:32.170 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.167+0000 7f9400447640 1 --2- 172.21.15.44:0/2870183554 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93f81032d0 0x7f93f810b7b0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f93e8009900 tx=0x7f93e802a480 comp rx=0 tx=0).stop 2024-08-19T00:17:32.170 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.168+0000 7f9400447640 1 -- 172.21.15.44:0/2870183554 shutdown_connections 2024-08-19T00:17:32.170 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.168+0000 7f9400447640 1 --2- 172.21.15.44:0/2870183554 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f93f810be00 0x7f93f810e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:32.170 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.168+0000 7f9400447640 1 --2- 172.21.15.44:0/2870183554 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93f81032d0 0x7f93f810b7b0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:32.170 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.168+0000 7f9400447640 1 --2- 172.21.15.44:0/2870183554 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f93f81029b0 0x7f93f8102d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:32.170 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.168+0000 7f9400447640 1 -- 172.21.15.44:0/2870183554 >> 172.21.15.44:0/2870183554 conn(0x7f93f80776c0 msgr2=0x7f93f80fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:17:32.170 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.168+0000 7f9400447640 1 -- 172.21.15.44:0/2870183554 shutdown_connections 2024-08-19T00:17:32.170 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.168+0000 7f9400447640 1 -- 172.21.15.44:0/2870183554 wait complete. 2024-08-19T00:17:32.170 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.168+0000 7f9400447640 1 Processor -- start 2024-08-19T00:17:32.170 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.168+0000 7f9400447640 1 -- start start 2024-08-19T00:17:32.172 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.169+0000 7f9400447640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f93f81029b0 0x7f93f81980b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:32.172 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.169+0000 7f9400447640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93f81032d0 0x7f93f81985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:32.172 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.169+0000 7f9400447640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f93f810be00 0x7f93f819c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:32.172 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.169+0000 7f9400447640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f93f8111be0 con 0x7f93f81032d0 2024-08-19T00:17:32.172 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.169+0000 7f9400447640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f93f8111a60 con 0x7f93f81029b0 2024-08-19T00:17:32.173 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.169+0000 7f9400447640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f93f8111d60 con 0x7f93f810be00 2024-08-19T00:17:32.173 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.169+0000 7f93fd9e2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93f81032d0 0x7f93f81985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:32.173 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.169+0000 7f93fd9e2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93f81032d0 0x7f93f81985f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52930/0 (socket says 172.21.15.44:52930) 2024-08-19T00:17:32.173 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.169+0000 7f93fe9e4640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f93f810be00 0x7f93f819c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:32.173 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.169+0000 7f93fd9e2640 1 -- 172.21.15.44:0/1123138956 learned_addr learned my addr 172.21.15.44:0/1123138956 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:17:32.173 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.169+0000 7f93fe1e3640 1 --2- 172.21.15.44:0/1123138956 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f93f81029b0 0x7f93f81980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:32.173 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.169+0000 7f93fd9e2640 1 -- 172.21.15.44:0/1123138956 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f93f810be00 msgr2=0x7f93f819c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:17:32.173 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.169+0000 7f93fd9e2640 1 --2- 172.21.15.44:0/1123138956 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f93f810be00 0x7f93f819c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:32.173 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.169+0000 7f93fd9e2640 1 -- 172.21.15.44:0/1123138956 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f93f81029b0 msgr2=0x7f93f81980b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:17:32.173 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.169+0000 7f93fd9e2640 1 --2- 172.21.15.44:0/1123138956 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f93f81029b0 0x7f93f81980b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:32.173 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.169+0000 7f93fd9e2640 1 -- 172.21.15.44:0/1123138956 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93f819d0a0 con 0x7f93f81032d0 2024-08-19T00:17:32.173 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.169+0000 7f93fe9e4640 1 --2- 172.21.15.44:0/1123138956 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f93f810be00 0x7f93f819c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:17:32.173 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.169+0000 7f93fd9e2640 1 --2- 172.21.15.44:0/1123138956 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93f81032d0 0x7f93f81985f0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f93e8006010 tx=0x7f93e8031b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:17:32.173 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.169+0000 7f93ef7fe640 1 -- 172.21.15.44:0/1123138956 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e803f030 con 0x7f93f81032d0 2024-08-19T00:17:32.174 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.170+0000 7f9400447640 1 -- 172.21.15.44:0/1123138956 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93f819d330 con 0x7f93f81032d0 2024-08-19T00:17:32.174 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.170+0000 7f9400447640 1 -- 172.21.15.44:0/1123138956 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93f81a4c20 con 0x7f93f81032d0 2024-08-19T00:17:32.174 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.170+0000 7f93ef7fe640 1 -- 172.21.15.44:0/1123138956 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93e80043d0 con 0x7f93f81032d0 2024-08-19T00:17:32.174 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.170+0000 7f93ef7fe640 1 -- 172.21.15.44:0/1123138956 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e8035070 con 0x7f93f81032d0 2024-08-19T00:17:32.180 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.172+0000 7f93ef7fe640 1 -- 172.21.15.44:0/1123138956 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f93e8042030 con 0x7f93f81032d0 2024-08-19T00:17:32.180 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.172+0000 7f940320a740 1 Processor -- start 2024-08-19T00:17:32.180 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.173+0000 7f940320a740 1 -- start start 2024-08-19T00:17:32.181 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.173+0000 7f940320a740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55da16e377d0 0x55da16e37bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:32.181 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.173+0000 7f940320a740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55da16e380f0 0x55da16e42450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:32.181 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.173+0000 7f940320a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55da16e42990 0x55da16e44d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:32.181 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.173+0000 7f940320a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55da16d9b9d0 con 0x55da16e42990 2024-08-19T00:17:32.181 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.173+0000 7f940320a740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55da16d43820 con 0x55da16e380f0 2024-08-19T00:17:32.181 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.173+0000 7f940320a740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55da16d97990 con 0x55da16e377d0 2024-08-19T00:17:32.181 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.173+0000 7f93fe1e3640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55da16e380f0 0x55da16e42450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:32.181 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.173+0000 7f93fd9e2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55da16e42990 0x55da16e44d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:32.181 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.173+0000 7f93fe1e3640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55da16e380f0 0x55da16e42450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.44:37062/0 (socket says 172.21.15.44:37062) 2024-08-19T00:17:32.181 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.173+0000 7f93fe9e4640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55da16e377d0 0x55da16e37bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:32.181 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.173+0000 7f93fe1e3640 1 -- 172.21.15.44:0/3488846563 learned_addr learned my addr 172.21.15.44:0/3488846563 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:17:32.181 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.173+0000 7f93fe1e3640 1 -- 172.21.15.44:0/3488846563 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55da16e377d0 msgr2=0x55da16e37bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:17:32.182 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.173+0000 7f93fe1e3640 1 --2- 172.21.15.44:0/3488846563 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55da16e377d0 0x55da16e37bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:32.182 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.173+0000 7f93ef7fe640 1 --2- 172.21.15.44:0/1123138956 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f93e40a2e20 0x7f93e40a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:32.182 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.173+0000 7f93fe1e3640 1 -- 172.21.15.44:0/3488846563 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55da16e42990 msgr2=0x55da16e44d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:17:32.182 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.173+0000 7f93fe1e3640 1 --2- 172.21.15.44:0/3488846563 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55da16e42990 0x55da16e44d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:32.182 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.173+0000 7f93fe1e3640 1 -- 172.21.15.44:0/3488846563 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da16aaf210 con 0x55da16e380f0 2024-08-19T00:17:32.182 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.173+0000 7f93fe9e4640 1 --2- 172.21.15.44:0/1123138956 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f93e40a2e20 0x7f93e40a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:32.182 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.173+0000 7f93ef7fe640 1 -- 172.21.15.44:0/1123138956 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f93e80ef860 con 0x7f93f81032d0 2024-08-19T00:17:32.182 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.173+0000 7f93fe1e3640 1 --2- 172.21.15.44:0/3488846563 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55da16e380f0 0x55da16e42450 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f93f4009d20 tx=0x7f93f4011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b7640ed5369a128 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:17:32.182 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.174+0000 7f93ecbfe640 1 -- 172.21.15.44:0/3488846563 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f401e070 con 0x55da16e380f0 2024-08-19T00:17:32.182 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.174+0000 7f93ecbfe640 1 -- 172.21.15.44:0/3488846563 <== mon.2 v2:172.21.15.116:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93f4019b10 con 0x55da16e380f0 2024-08-19T00:17:32.182 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.174+0000 7f93ecbfe640 1 -- 172.21.15.44:0/3488846563 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f400ebf0 con 0x55da16e380f0 2024-08-19T00:17:32.182 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.174+0000 7f940320a740 1 -- 172.21.15.44:0/3488846563 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55da16e380f0 msgr2=0x55da16e42450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:17:32.182 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.174+0000 7f93fe9e4640 1 --2- 172.21.15.44:0/1123138956 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f93e40a2e20 0x7f93e40a52e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f93f0005c40 tx=0x7f93f0009500 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:17:32.183 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.174+0000 7f940320a740 1 --2- 172.21.15.44:0/3488846563 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55da16e380f0 0x55da16e42450 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f93f4009d20 tx=0x7f93f4011810 comp rx=0 tx=0).stop 2024-08-19T00:17:32.183 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.174+0000 7f940320a740 1 -- 172.21.15.44:0/3488846563 shutdown_connections 2024-08-19T00:17:32.183 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.174+0000 7f940320a740 1 --2- 172.21.15.44:0/3488846563 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55da16e42990 0x55da16e44d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:32.183 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.174+0000 7f940320a740 1 --2- 172.21.15.44:0/3488846563 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55da16e380f0 0x55da16e42450 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:32.183 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.174+0000 7f940320a740 1 --2- 172.21.15.44:0/3488846563 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55da16e377d0 0x55da16e37bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:32.183 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.174+0000 7f940320a740 1 -- 172.21.15.44:0/3488846563 >> 172.21.15.44:0/3488846563 conn(0x55da16e33d40 msgr2=0x55da16e34120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:17:32.183 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.175+0000 7f940320a740 1 -- 172.21.15.44:0/3488846563 shutdown_connections 2024-08-19T00:17:32.183 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.175+0000 7f940320a740 1 -- 172.21.15.44:0/3488846563 wait complete. 2024-08-19T00:17:32.183 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.175+0000 7f940320a740 1 -- start start 2024-08-19T00:17:32.183 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.175+0000 7f940320a740 1 Processor -- start 2024-08-19T00:17:32.183 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.175+0000 7f940320a740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55da16e377d0 0x55da16e3f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:32.183 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.175+0000 7f940320a740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55da16e380f0 0x55da16e3fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:32.183 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.175+0000 7f940320a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55da16e42990 0x55da16e40280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:32.184 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.175+0000 7f940320a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55da16e45560 con 0x55da16e42990 2024-08-19T00:17:32.184 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.175+0000 7f940320a740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55da16d57520 con 0x55da16e377d0 2024-08-19T00:17:32.184 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.175+0000 7f940320a740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55da16e456e0 con 0x55da16e380f0 2024-08-19T00:17:32.184 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.175+0000 7f940320a740 10 client.0 _ll_register_callbacks cb 0x55da16aaea00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:17:32.184 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.175+0000 7f93fe9e4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55da16e42990 0x55da16e40280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:32.184 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.175+0000 7f93fe1e3640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55da16e377d0 0x55da16e3f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:32.184 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.175+0000 7f93fd9e2640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55da16e380f0 0x55da16e3fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:32.184 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.175+0000 7f93fe1e3640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55da16e377d0 0x55da16e3f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.44:37076/0 (socket says 172.21.15.44:37076) 2024-08-19T00:17:32.184 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.175+0000 7f93fe1e3640 1 -- 172.21.15.44:0/649029693 learned_addr learned my addr 172.21.15.44:0/649029693 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:17:32.184 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.175+0000 7f93fd9e2640 1 --2- 172.21.15.44:0/649029693 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55da16e380f0 0x55da16e3fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.44:39396/0 (socket says 172.21.15.44:39396) 2024-08-19T00:17:32.184 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.176+0000 7f93fe1e3640 1 -- 172.21.15.44:0/649029693 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55da16e380f0 msgr2=0x55da16e3fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:17:32.184 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.176+0000 7f93fe1e3640 1 --2- 172.21.15.44:0/649029693 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55da16e380f0 0x55da16e3fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:32.184 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.176+0000 7f93fe1e3640 1 -- 172.21.15.44:0/649029693 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55da16e42990 msgr2=0x55da16e40280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:17:32.185 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.176+0000 7f93fe1e3640 1 --2- 172.21.15.44:0/649029693 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55da16e42990 0x55da16e40280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:32.185 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.176+0000 7f93fe1e3640 1 -- 172.21.15.44:0/649029693 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da16b7b620 con 0x55da16e377d0 2024-08-19T00:17:32.185 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.176+0000 7f93fe1e3640 1 --2- 172.21.15.44:0/649029693 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55da16e377d0 0x55da16e3f800 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f93f400e790 tx=0x7f93f4019660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fd196d392c58e94 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:17:32.185 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.176+0000 7f93e1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.116:3300/0 2024-08-19T00:17:32.185 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.176+0000 7f93e1ffb640 1 -- 172.21.15.44:0/649029693 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f4027020 con 0x55da16e377d0 2024-08-19T00:17:32.185 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.176+0000 7f93e1ffb640 1 -- 172.21.15.44:0/649029693 <== mon.2 v2:172.21.15.116:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f93f400eaf0 con 0x55da16e377d0 2024-08-19T00:17:32.185 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.176+0000 7f940320a740 1 -- 172.21.15.44:0/649029693 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93f4019b10 con 0x55da16e377d0 2024-08-19T00:17:32.185 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.176+0000 7f93e1ffb640 1 -- 172.21.15.44:0/649029693 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f93f4032050 con 0x55da16e377d0 2024-08-19T00:17:32.185 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.176+0000 7f940320a740 10 client.25559 fetch_fsmap learned FSMap version 33 2024-08-19T00:17:32.185 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.176+0000 7f940320a740 1 -- 172.21.15.44:0/649029693 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55da16e51180 con 0x55da16e377d0 2024-08-19T00:17:32.185 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.176+0000 7f93e1ffb640 1 -- 172.21.15.44:0/649029693 <== mon.2 v2:172.21.15.116:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93f4019b10 con 0x55da16e377d0 2024-08-19T00:17:32.185 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.177+0000 7f93e1ffb640 1 -- 172.21.15.44:0/649029693 <== mon.2 v2:172.21.15.116:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f93f40046c0 con 0x55da16e377d0 2024-08-19T00:17:32.185 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.177+0000 7f940320a740 10 client.25559 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:17:32.186 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.177+0000 7f940320a740 10 client.25559 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:17:32.186 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.177+0000 7f940320a740 20 client.25559 populate_metadata read hostname 'smithi044' 2024-08-19T00:17:32.186 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.177+0000 7f940320a740 1 --2- 172.21.15.44:0/649029693 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55da16e52590 0x55da16e54980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:32.186 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.177+0000 7f940320a740 4 client.25559 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:17:32.186 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.177+0000 7f940320a740 1 -- 172.21.15.44:0/649029693 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55da16da9100 con 0x55da16e52590 2024-08-19T00:17:32.186 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.177+0000 7f93fd9e2640 1 --2- 172.21.15.44:0/649029693 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55da16e52590 0x55da16e54980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:32.186 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.177+0000 7f93e1ffb640 10 client.25559 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:17:32.186 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.177+0000 7f93fd9e2640 1 --2- 172.21.15.44:0/649029693 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55da16e52590 0x55da16e54980 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0ae3e2cfc32668d server_cookie=98c141de8c944e0c in_seq=0 out_seq=0 2024-08-19T00:17:32.186 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.178+0000 7f93e1ffb640 1 -- 172.21.15.44:0/649029693 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55da16da9100 con 0x55da16e52590 2024-08-19T00:17:32.186 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.178+0000 7f93e1ffb640 10 client.25559 handle_command_reply: tid=0 2024-08-19T00:17:32.186 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.178+0000 7f940320a740 1 client.25559 shutdown 2024-08-19T00:17:32.186 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.178+0000 7f940320a740 1 -- 172.21.15.44:0/649029693 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55da16e377d0 msgr2=0x55da16e3f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:17:32.186 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.178+0000 7f940320a740 1 --2- 172.21.15.44:0/649029693 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55da16e377d0 0x55da16e3f800 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f93f400e790 tx=0x7f93f4019660 comp rx=0 tx=0).stop 2024-08-19T00:17:32.187 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.178+0000 7f940320a740 1 -- 172.21.15.44:0/649029693 shutdown_connections 2024-08-19T00:17:32.187 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.178+0000 7f940320a740 1 --2- 172.21.15.44:0/649029693 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55da16e52590 0x55da16e54980 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:32.187 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.178+0000 7f940320a740 1 --2- 172.21.15.44:0/649029693 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55da16e380f0 0x55da16e3fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:32.187 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.178+0000 7f93e1ffb640 0 client.25559 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:17:32.187 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.178+0000 7f940320a740 1 --2- 172.21.15.44:0/649029693 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55da16e42990 0x55da16e40280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:32.187 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.178+0000 7f940320a740 1 --2- 172.21.15.44:0/649029693 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55da16e377d0 0x55da16e3f800 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:32.187 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.178+0000 7f940320a740 1 -- 172.21.15.44:0/649029693 >> 172.21.15.44:0/649029693 conn(0x55da16e33d40 msgr2=0x55da16e39a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:17:32.187 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.178+0000 7f940320a740 1 -- 172.21.15.44:0/649029693 shutdown_connections 2024-08-19T00:17:32.187 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.178+0000 7f940320a740 1 -- 172.21.15.44:0/649029693 wait complete. 2024-08-19T00:17:32.187 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.178+0000 7f940320a740 20 client.25559 trim_cache size 0 max 16384 2024-08-19T00:17:32.199 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.193+0000 7f940320a740 1 Processor -- start 2024-08-19T00:17:32.199 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.193+0000 7f940320a740 1 -- start start 2024-08-19T00:17:32.199 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.194+0000 7f940320a740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55da16e377d0 0x55da16e3e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:32.199 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.194+0000 7f940320a740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55da16e380f0 0x55da16e5a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:32.199 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.194+0000 7f940320a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55da16e42990 0x55da16e5a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:32.199 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.194+0000 7f940320a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f93dc00fef0 con 0x55da16e42990 2024-08-19T00:17:32.199 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.194+0000 7f940320a740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f93dc011a30 con 0x55da16e380f0 2024-08-19T00:17:32.199 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.194+0000 7f940320a740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f93dc0105c0 con 0x55da16e377d0 2024-08-19T00:17:32.199 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.194+0000 7f93fe9e4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55da16e42990 0x55da16e5a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:32.200 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.194+0000 7f93fe9e4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55da16e42990 0x55da16e5a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52952/0 (socket says 172.21.15.44:52952) 2024-08-19T00:17:32.200 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.194+0000 7f93fe9e4640 1 -- 172.21.15.44:0/1679757114 learned_addr learned my addr 172.21.15.44:0/1679757114 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:17:32.200 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.194+0000 7f93fd9e2640 1 --2- 172.21.15.44:0/1679757114 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55da16e380f0 0x55da16e5a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:32.200 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.194+0000 7f93fe1e3640 1 --2- 172.21.15.44:0/1679757114 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55da16e377d0 0x55da16e3e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:32.200 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.194+0000 7f93fe9e4640 1 -- 172.21.15.44:0/1679757114 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55da16e377d0 msgr2=0x55da16e3e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:17:32.200 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.194+0000 7f93fe9e4640 1 --2- 172.21.15.44:0/1679757114 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55da16e377d0 0x55da16e3e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:32.200 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.194+0000 7f93fe9e4640 1 -- 172.21.15.44:0/1679757114 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55da16e380f0 msgr2=0x55da16e5a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:17:32.200 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.194+0000 7f93fe9e4640 1 --2- 172.21.15.44:0/1679757114 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55da16e380f0 0x55da16e5a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:32.200 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.194+0000 7f93fe9e4640 1 -- 172.21.15.44:0/1679757114 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da16e37f20 con 0x55da16e42990 2024-08-19T00:17:32.200 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.194+0000 7f93fe1e3640 1 --2- 172.21.15.44:0/1679757114 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55da16e377d0 0x55da16e3e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:17:32.200 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.194+0000 7f93fe9e4640 1 --2- 172.21.15.44:0/1679757114 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55da16e42990 0x55da16e5a6c0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f93f000f910 tx=0x7f93f001b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dbafb9846ce30eb server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:17:32.200 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.194+0000 7f93e3fff640 1 -- 172.21.15.44:0/1679757114 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f00119c0 con 0x55da16e42990 2024-08-19T00:17:32.201 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.195+0000 7f93e3fff640 1 -- 172.21.15.44:0/1679757114 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93f0003e50 con 0x55da16e42990 2024-08-19T00:17:32.201 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.195+0000 7f93e3fff640 1 -- 172.21.15.44:0/1679757114 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f0004630 con 0x55da16e42990 2024-08-19T00:17:32.201 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.195+0000 7f940320a740 1 -- 172.21.15.44:0/1679757114 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55da16e42990 msgr2=0x55da16e5a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:17:32.201 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.195+0000 7f940320a740 1 --2- 172.21.15.44:0/1679757114 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55da16e42990 0x55da16e5a6c0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f93f000f910 tx=0x7f93f001b000 comp rx=0 tx=0).stop 2024-08-19T00:17:32.201 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.195+0000 7f940320a740 1 -- 172.21.15.44:0/1679757114 shutdown_connections 2024-08-19T00:17:32.201 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.195+0000 7f940320a740 1 --2- 172.21.15.44:0/1679757114 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55da16e42990 0x55da16e5a6c0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:32.201 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.195+0000 7f940320a740 1 --2- 172.21.15.44:0/1679757114 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55da16e380f0 0x55da16e5a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:32.201 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.195+0000 7f940320a740 1 --2- 172.21.15.44:0/1679757114 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55da16e377d0 0x55da16e3e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:32.201 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.195+0000 7f940320a740 1 -- 172.21.15.44:0/1679757114 >> 172.21.15.44:0/1679757114 conn(0x55da16e33d40 msgr2=0x55da16e41770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:17:32.201 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.195+0000 7f940320a740 1 -- 172.21.15.44:0/1679757114 shutdown_connections 2024-08-19T00:17:32.201 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.195+0000 7f940320a740 1 -- 172.21.15.44:0/1679757114 wait complete. 2024-08-19T00:17:32.201 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.196+0000 7f940320a740 1 -- start start 2024-08-19T00:17:32.201 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.196+0000 7f940320a740 1 Processor -- start 2024-08-19T00:17:32.201 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.196+0000 7f940320a740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55da16e377d0 0x55da16e466c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:32.202 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.196+0000 7f940320a740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55da16e380f0 0x55da16e46c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:32.202 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.196+0000 7f940320a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55da16e42990 0x55da16e47140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:32.202 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.196+0000 7f940320a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f93dc011360 con 0x55da16e42990 2024-08-19T00:17:32.202 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.196+0000 7f940320a740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f93dc010c90 con 0x55da16e377d0 2024-08-19T00:17:32.202 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.196+0000 7f940320a740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f93dc00ded0 con 0x55da16e380f0 2024-08-19T00:17:32.202 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.196+0000 7f940320a740 10 client.0 _ll_register_callbacks cb 0x7f93f401c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:17:32.202 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.196+0000 7f93fe9e4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55da16e42990 0x55da16e47140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:32.202 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.196+0000 7f93fe9e4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55da16e42990 0x55da16e47140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52968/0 (socket says 172.21.15.44:52968) 2024-08-19T00:17:32.202 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.196+0000 7f93fe9e4640 1 -- 172.21.15.44:0/2242256191 learned_addr learned my addr 172.21.15.44:0/2242256191 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:17:32.202 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.196+0000 7f93fd9e2640 1 --2- 172.21.15.44:0/2242256191 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55da16e380f0 0x55da16e46c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:32.202 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.196+0000 7f93fe1e3640 1 --2- 172.21.15.44:0/2242256191 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55da16e377d0 0x55da16e466c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:32.202 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.196+0000 7f93fe9e4640 1 -- 172.21.15.44:0/2242256191 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55da16e380f0 msgr2=0x55da16e46c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:17:32.202 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.196+0000 7f93fe9e4640 1 --2- 172.21.15.44:0/2242256191 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55da16e380f0 0x55da16e46c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:32.203 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.196+0000 7f93fe9e4640 1 -- 172.21.15.44:0/2242256191 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55da16e377d0 msgr2=0x55da16e466c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:17:32.203 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.196+0000 7f93fe9e4640 1 --2- 172.21.15.44:0/2242256191 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55da16e377d0 0x55da16e466c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:32.203 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.196+0000 7f93fe9e4640 1 -- 172.21.15.44:0/2242256191 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da16ebc150 con 0x55da16e42990 2024-08-19T00:17:32.203 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.196+0000 7f93fe9e4640 1 --2- 172.21.15.44:0/2242256191 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55da16e42990 0x55da16e47140 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f93f00120e0 tx=0x7f93f0005aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc88c3409b75d46f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:17:32.203 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.196+0000 7f93e1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:17:32.203 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.197+0000 7f93e1ffb640 1 -- 172.21.15.44:0/2242256191 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f0003b80 con 0x55da16e42990 2024-08-19T00:17:32.203 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.197+0000 7f93e1ffb640 1 -- 172.21.15.44:0/2242256191 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f93f00119c0 con 0x55da16e42990 2024-08-19T00:17:32.203 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.197+0000 7f940320a740 1 -- 172.21.15.44:0/2242256191 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93f0003e50 con 0x55da16e42990 2024-08-19T00:17:32.203 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.197+0000 7f93e1ffb640 1 -- 172.21.15.44:0/2242256191 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f93f0011bc0 con 0x55da16e42990 2024-08-19T00:17:32.203 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.197+0000 7f940320a740 10 client.16080 fetch_fsmap learned FSMap version 33 2024-08-19T00:17:32.203 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.197+0000 7f940320a740 1 -- 172.21.15.44:0/2242256191 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55da16ebd410 con 0x55da16e42990 2024-08-19T00:17:32.203 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.197+0000 7f93e1ffb640 1 -- 172.21.15.44:0/2242256191 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93f0003e50 con 0x55da16e42990 2024-08-19T00:17:32.203 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.197+0000 7f93e1ffb640 1 -- 172.21.15.44:0/2242256191 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f93f0032020 con 0x55da16e42990 2024-08-19T00:17:32.204 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.197+0000 7f940320a740 10 client.16080 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:17:32.204 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.197+0000 7f940320a740 10 client.16080 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:17:32.204 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.197+0000 7f940320a740 20 client.16080 populate_metadata read hostname 'smithi044' 2024-08-19T00:17:32.204 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.197+0000 7f940320a740 1 --2- 172.21.15.44:0/2242256191 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55da16ebda70 0x55da16ebfe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:32.204 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.197+0000 7f940320a740 4 client.16080 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-19T00:17:32.204 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.197+0000 7f940320a740 1 -- 172.21.15.44:0/2242256191 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55da16da3450 con 0x55da16ebda70 2024-08-19T00:17:32.204 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.197+0000 7f93fe1e3640 1 --2- 172.21.15.44:0/2242256191 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55da16ebda70 0x55da16ebfe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:32.204 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.198+0000 7f93e1ffb640 10 client.16080 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:17:32.204 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.198+0000 7f93fe1e3640 1 --2- 172.21.15.44:0/2242256191 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55da16ebda70 0x55da16ebfe90 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5fafe91ead25a8b6 server_cookie=a00ed48a5b0ebf42 in_seq=0 out_seq=0 2024-08-19T00:17:32.208 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.207+0000 7f93e1ffb640 1 -- 172.21.15.44:0/2242256191 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55da16da3450 con 0x55da16ebda70 2024-08-19T00:17:32.209 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.207+0000 7f93e1ffb640 10 client.16080 handle_command_reply: tid=0 2024-08-19T00:17:32.209 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.207+0000 7f940320a740 1 client.16080 shutdown 2024-08-19T00:17:32.209 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.207+0000 7f940320a740 1 -- 172.21.15.44:0/2242256191 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55da16e42990 msgr2=0x55da16e47140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:17:32.209 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.207+0000 7f940320a740 1 --2- 172.21.15.44:0/2242256191 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55da16e42990 0x55da16e47140 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f93f00120e0 tx=0x7f93f0005aa0 comp rx=0 tx=0).stop 2024-08-19T00:17:32.209 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.207+0000 7f940320a740 1 -- 172.21.15.44:0/2242256191 shutdown_connections 2024-08-19T00:17:32.209 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.207+0000 7f940320a740 1 --2- 172.21.15.44:0/2242256191 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55da16ebda70 0x55da16ebfe90 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:32.209 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.207+0000 7f940320a740 1 --2- 172.21.15.44:0/2242256191 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55da16e380f0 0x55da16e46c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:32.209 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.207+0000 7f940320a740 1 --2- 172.21.15.44:0/2242256191 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55da16e42990 0x55da16e47140 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:32.209 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.207+0000 7f940320a740 1 --2- 172.21.15.44:0/2242256191 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55da16e377d0 0x55da16e466c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:32.209 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.207+0000 7f93e1ffb640 0 client.16080 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:17:32.209 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.207+0000 7f940320a740 1 -- 172.21.15.44:0/2242256191 >> 172.21.15.44:0/2242256191 conn(0x55da16e33d40 msgr2=0x55da16e39230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:17:32.209 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.207+0000 7f940320a740 1 -- 172.21.15.44:0/2242256191 shutdown_connections 2024-08-19T00:17:32.209 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.207+0000 7f940320a740 1 -- 172.21.15.44:0/2242256191 wait complete. 2024-08-19T00:17:32.210 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.207+0000 7f940320a740 20 client.16080 trim_cache size 0 max 16384 2024-08-19T00:17:32.210 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:{ 2024-08-19T00:17:32.210 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "message": "", 2024-08-19T00:17:32.210 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "return_code": 0 2024-08-19T00:17:32.210 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:} 2024-08-19T00:17:32.211 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.208+0000 7f9400447640 1 -- 172.21.15.44:0/1123138956 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f93e40a2e20 msgr2=0x7f93e40a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:17:32.211 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.208+0000 7f9400447640 1 --2- 172.21.15.44:0/1123138956 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f93e40a2e20 0x7f93e40a52e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f93f0005c40 tx=0x7f93f0009500 comp rx=0 tx=0).stop 2024-08-19T00:17:32.211 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.208+0000 7f9400447640 1 -- 172.21.15.44:0/1123138956 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93f81032d0 msgr2=0x7f93f81985f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:17:32.211 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.208+0000 7f9400447640 1 --2- 172.21.15.44:0/1123138956 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93f81032d0 0x7f93f81985f0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f93e8006010 tx=0x7f93e8031b20 comp rx=0 tx=0).stop 2024-08-19T00:17:32.211 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.208+0000 7f9400447640 1 -- 172.21.15.44:0/1123138956 shutdown_connections 2024-08-19T00:17:32.211 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.208+0000 7f9400447640 1 --2- 172.21.15.44:0/1123138956 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f93e40a2e20 0x7f93e40a52e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:32.211 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.208+0000 7f9400447640 1 --2- 172.21.15.44:0/1123138956 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f93f810be00 0x7f93f819c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:32.211 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.208+0000 7f9400447640 1 --2- 172.21.15.44:0/1123138956 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93f81032d0 0x7f93f81985f0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:32.211 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.208+0000 7f9400447640 1 --2- 172.21.15.44:0/1123138956 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f93f81029b0 0x7f93f81980b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:32.212 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.208+0000 7f9400447640 1 -- 172.21.15.44:0/1123138956 >> 172.21.15.44:0/1123138956 conn(0x7f93f80776c0 msgr2=0x7f93f80fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:17:32.212 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.208+0000 7f9400447640 1 -- 172.21.15.44:0/1123138956 shutdown_connections 2024-08-19T00:17:32.212 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:32.208+0000 7f9400447640 1 -- 172.21.15.44:0/1123138956 wait complete. 2024-08-19T00:17:32.672 INFO:tasks.workunit.client.0.smithi044.stdout: 1 210165 4.15 MB/sec execute 57 sec latency 11.259 ms 2024-08-19T00:17:33.672 INFO:tasks.workunit.client.0.smithi044.stdout: 1 213143 4.39 MB/sec execute 58 sec latency 12.875 ms 2024-08-19T00:17:34.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:17:33 smithi171 ceph-mon[21810]: pgmap v130: 129 pgs: 129 active+clean; 124 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 1.7 MiB/s wr, 199 op/s 2024-08-19T00:17:34.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:17:33 smithi116 ceph-mon[21873]: pgmap v130: 129 pgs: 129 active+clean; 124 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 1.7 MiB/s wr, 199 op/s 2024-08-19T00:17:34.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:17:33 smithi044 ceph-mon[18489]: pgmap v130: 129 pgs: 129 active+clean; 124 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 1.7 MiB/s wr, 199 op/s 2024-08-19T00:17:34.673 INFO:tasks.workunit.client.0.smithi044.stdout: 1 215887 4.54 MB/sec execute 59 sec latency 15.773 ms 2024-08-19T00:17:35.672 INFO:tasks.workunit.client.0.smithi044.stdout: 1 218007 4.66 MB/sec execute 60 sec latency 28.288 ms 2024-08-19T00:17:36.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:17:35 smithi171 ceph-mon[21810]: pgmap v131: 129 pgs: 129 active+clean; 134 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 2.7 MiB/s wr, 302 op/s 2024-08-19T00:17:36.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:17:35 smithi116 ceph-mon[21873]: pgmap v131: 129 pgs: 129 active+clean; 134 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 2.7 MiB/s wr, 302 op/s 2024-08-19T00:17:36.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:17:35 smithi044 ceph-mon[18489]: pgmap v131: 129 pgs: 129 active+clean; 134 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 2.7 MiB/s wr, 302 op/s 2024-08-19T00:17:36.673 INFO:tasks.workunit.client.0.smithi044.stdout: 1 220632 4.81 MB/sec execute 61 sec latency 12.826 ms 2024-08-19T00:17:37.673 INFO:tasks.workunit.client.0.smithi044.stdout: 1 223618 5.02 MB/sec execute 62 sec latency 17.898 ms 2024-08-19T00:17:38.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:17:37 smithi171 ceph-mon[21810]: pgmap v132: 129 pgs: 129 active+clean; 134 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 1.8 MiB/s wr, 201 op/s 2024-08-19T00:17:38.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:17:37 smithi116 ceph-mon[21873]: pgmap v132: 129 pgs: 129 active+clean; 134 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 1.8 MiB/s wr, 201 op/s 2024-08-19T00:17:38.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:17:37 smithi044 ceph-mon[18489]: pgmap v132: 129 pgs: 129 active+clean; 134 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 1.8 MiB/s wr, 201 op/s 2024-08-19T00:17:38.673 INFO:tasks.workunit.client.0.smithi044.stdout: 1 225943 5.07 MB/sec execute 63 sec latency 12.696 ms 2024-08-19T00:17:39.673 INFO:tasks.workunit.client.0.smithi044.stdout: 1 228115 5.21 MB/sec execute 64 sec latency 15.626 ms 2024-08-19T00:17:40.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:17:39 smithi171 ceph-mon[21810]: pgmap v133: 129 pgs: 129 active+clean; 134 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 1.8 MiB/s wr, 201 op/s 2024-08-19T00:17:40.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:17:39 smithi116 ceph-mon[21873]: pgmap v133: 129 pgs: 129 active+clean; 134 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 1.8 MiB/s wr, 201 op/s 2024-08-19T00:17:40.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:17:39 smithi044 ceph-mon[18489]: pgmap v133: 129 pgs: 129 active+clean; 134 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 1.8 MiB/s wr, 201 op/s 2024-08-19T00:17:40.673 INFO:tasks.workunit.client.0.smithi044.stdout: 1 231050 5.40 MB/sec execute 65 sec latency 12.877 ms 2024-08-19T00:17:41.673 INFO:tasks.workunit.client.0.smithi044.stdout: 1 233943 5.53 MB/sec execute 66 sec latency 18.071 ms 2024-08-19T00:17:42.093 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:17:41 smithi171 ceph-mon[21810]: pgmap v134: 129 pgs: 129 active+clean; 142 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 2.7 MiB/s wr, 299 op/s 2024-08-19T00:17:42.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:17:41 smithi116 ceph-mon[21873]: pgmap v134: 129 pgs: 129 active+clean; 142 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 2.7 MiB/s wr, 299 op/s 2024-08-19T00:17:42.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:17:41 smithi044 ceph-mon[18489]: pgmap v134: 129 pgs: 129 active+clean; 142 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 2.7 MiB/s wr, 299 op/s 2024-08-19T00:17:42.673 INFO:tasks.workunit.client.0.smithi044.stdout: 1 236549 5.63 MB/sec execute 67 sec latency 12.364 ms 2024-08-19T00:17:43.673 INFO:tasks.workunit.client.0.smithi044.stdout: 1 238746 5.75 MB/sec execute 68 sec latency 14.649 ms 2024-08-19T00:17:43.937 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:17:43 smithi044 ceph-mon[18489]: pgmap v135: 129 pgs: 129 active+clean; 142 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 1.8 MiB/s wr, 201 op/s 2024-08-19T00:17:44.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:17:43 smithi171 ceph-mon[21810]: pgmap v135: 129 pgs: 129 active+clean; 142 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 1.8 MiB/s wr, 201 op/s 2024-08-19T00:17:44.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:17:43 smithi116 ceph-mon[21873]: pgmap v135: 129 pgs: 129 active+clean; 142 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 1.8 MiB/s wr, 201 op/s 2024-08-19T00:17:44.673 INFO:tasks.workunit.client.0.smithi044.stdout: 1 241764 5.91 MB/sec execute 69 sec latency 11.047 ms 2024-08-19T00:17:45.319 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.315+0000 7f792ec96640 1 -- 172.21.15.44:0/3604082211 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f79281066f0 msgr2=0x7f7928106ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:17:45.319 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.315+0000 7f792ec96640 1 --2- 172.21.15.44:0/3604082211 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f79281066f0 0x7f7928106ad0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f791c009860 tx=0x7f791c02a340 comp rx=0 tx=0).stop 2024-08-19T00:17:45.319 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.315+0000 7f792ec96640 1 -- 172.21.15.44:0/3604082211 shutdown_connections 2024-08-19T00:17:45.319 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.315+0000 7f792ec96640 1 --2- 172.21.15.44:0/3604082211 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f79281006e0 0x7f7928100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:45.319 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.315+0000 7f792ec96640 1 --2- 172.21.15.44:0/3604082211 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7928101080 0x7f792810d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:45.319 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.315+0000 7f792ec96640 1 --2- 172.21.15.44:0/3604082211 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f79281066f0 0x7f7928106ad0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:45.319 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.315+0000 7f792ec96640 1 -- 172.21.15.44:0/3604082211 >> 172.21.15.44:0/3604082211 conn(0x7f79280776c0 msgr2=0x7f79280fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:17:45.319 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.315+0000 7f792ec96640 1 -- 172.21.15.44:0/3604082211 shutdown_connections 2024-08-19T00:17:45.319 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.315+0000 7f792ec96640 1 -- 172.21.15.44:0/3604082211 wait complete. 2024-08-19T00:17:45.320 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.316+0000 7f792ec96640 1 Processor -- start 2024-08-19T00:17:45.320 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.316+0000 7f792ec96640 1 -- start start 2024-08-19T00:17:45.320 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.316+0000 7f792ec96640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f79281006e0 0x7f79281980b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:45.320 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.316+0000 7f792ec96640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7928101080 0x7f79281985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:45.320 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.316+0000 7f792ec96640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f79281066f0 0x7f792819c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:45.320 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.316+0000 7f792ec96640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7928111c20 con 0x7f7928101080 2024-08-19T00:17:45.320 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.316+0000 7f792ec96640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f7928111aa0 con 0x7f79281066f0 2024-08-19T00:17:45.320 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.316+0000 7f792ec96640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7928111da0 con 0x7f79281006e0 2024-08-19T00:17:45.320 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.316+0000 7f7927fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7928101080 0x7f79281985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:45.320 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.316+0000 7f7927fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7928101080 0x7f79281985f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37002/0 (socket says 172.21.15.44:37002) 2024-08-19T00:17:45.320 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.316+0000 7f792ca32640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f79281006e0 0x7f79281980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:45.320 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.316+0000 7f7927fff640 1 -- 172.21.15.44:0/2657771813 learned_addr learned my addr 172.21.15.44:0/2657771813 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:17:45.320 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.316+0000 7f792d233640 1 --2- 172.21.15.44:0/2657771813 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f79281066f0 0x7f792819c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:45.321 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.316+0000 7f7927fff640 1 -- 172.21.15.44:0/2657771813 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f79281006e0 msgr2=0x7f79281980b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:17:45.321 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.316+0000 7f7927fff640 1 --2- 172.21.15.44:0/2657771813 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f79281006e0 0x7f79281980b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:45.321 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.316+0000 7f7927fff640 1 -- 172.21.15.44:0/2657771813 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f79281066f0 msgr2=0x7f792819c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:17:45.321 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.316+0000 7f7927fff640 1 --2- 172.21.15.44:0/2657771813 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f79281066f0 0x7f792819c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:45.321 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.316+0000 7f7927fff640 1 -- 172.21.15.44:0/2657771813 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f792819d0a0 con 0x7f7928101080 2024-08-19T00:17:45.321 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.317+0000 7f7927fff640 1 --2- 172.21.15.44:0/2657771813 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7928101080 0x7f79281985f0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f791400e9f0 tx=0x7f791400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:17:45.321 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.317+0000 7f7925ffb640 1 -- 172.21.15.44:0/2657771813 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f791400cd80 con 0x7f7928101080 2024-08-19T00:17:45.321 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.317+0000 7f792ec96640 1 -- 172.21.15.44:0/2657771813 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f792819d390 con 0x7f7928101080 2024-08-19T00:17:45.321 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.317+0000 7f7925ffb640 1 -- 172.21.15.44:0/2657771813 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7914005500 con 0x7f7928101080 2024-08-19T00:17:45.321 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.317+0000 7f7925ffb640 1 -- 172.21.15.44:0/2657771813 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7914010690 con 0x7f7928101080 2024-08-19T00:17:45.321 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.317+0000 7f792ec96640 1 -- 172.21.15.44:0/2657771813 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79281a4c20 con 0x7f7928101080 2024-08-19T00:17:45.327 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.319+0000 7f7925ffb640 1 -- 172.21.15.44:0/2657771813 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f79140046c0 con 0x7f7928101080 2024-08-19T00:17:45.327 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.320+0000 7f7931a57740 1 Processor -- start 2024-08-19T00:17:45.327 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.320+0000 7f7931a57740 1 -- start start 2024-08-19T00:17:45.328 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.320+0000 7f7925ffb640 1 --2- 172.21.15.44:0/2657771813 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f79180a2da0 0x7f79180a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:45.328 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.320+0000 7f7931a57740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594d01886b0 0x5594d0188a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:45.328 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.320+0000 7f7931a57740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5594d0188fd0 0x5594d0197860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:45.328 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.320+0000 7f7931a57740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5594d0197da0 0x5594d019a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:45.328 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.320+0000 7f7931a57740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5594d00ec9d0 con 0x5594d01886b0 2024-08-19T00:17:45.328 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.320+0000 7f7931a57740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5594d0094820 con 0x5594d0197da0 2024-08-19T00:17:45.328 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.320+0000 7f7931a57740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5594d00e8990 con 0x5594d0188fd0 2024-08-19T00:17:45.328 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.320+0000 7f7925ffb640 1 -- 172.21.15.44:0/2657771813 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f79140cfc10 con 0x7f7928101080 2024-08-19T00:17:45.328 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.320+0000 7f792d233640 1 --2- 172.21.15.44:0/2657771813 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f79180a2da0 0x7f79180a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:45.328 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.320+0000 7f7927fff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5594d0188fd0 0x5594d0197860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:45.328 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.320+0000 7f792ca32640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594d01886b0 0x5594d0188a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:45.328 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.320+0000 7f7927fff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5594d0188fd0 0x5594d0197860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.44:47836/0 (socket says 172.21.15.44:47836) 2024-08-19T00:17:45.328 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.320+0000 7f7927fff640 1 -- 172.21.15.44:0/869052747 learned_addr learned my addr 172.21.15.44:0/869052747 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:17:45.329 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.320+0000 7f792ca32640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594d01886b0 0x5594d0188a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37016/0 (socket says 172.21.15.44:37016) 2024-08-19T00:17:45.329 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.320+0000 7f792d233640 1 --2- 172.21.15.44:0/869052747 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5594d0197da0 0x5594d019a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:45.329 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.321+0000 7f7927fff640 1 -- 172.21.15.44:0/869052747 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5594d0197da0 msgr2=0x5594d019a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:17:45.329 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.321+0000 7f7927fff640 1 --2- 172.21.15.44:0/869052747 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5594d0197da0 0x5594d019a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:45.329 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.321+0000 7f7927fff640 1 -- 172.21.15.44:0/869052747 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594d01886b0 msgr2=0x5594d0188a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:17:45.329 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.321+0000 7f7927fff640 1 --2- 172.21.15.44:0/869052747 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594d01886b0 0x5594d0188a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:45.329 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.321+0000 7f7927fff640 1 -- 172.21.15.44:0/869052747 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594cfe00210 con 0x5594d0188fd0 2024-08-19T00:17:45.329 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.321+0000 7f792d233640 1 --2- 172.21.15.44:0/869052747 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5594d0197da0 0x5594d019a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:17:45.329 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.321+0000 7f792ca32640 1 --2- 172.21.15.44:0/869052747 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594d01886b0 0x5594d0188a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:17:45.329 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.321+0000 7f792d233640 1 --2- 172.21.15.44:0/2657771813 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f79180a2da0 0x7f79180a5260 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7920005fd0 tx=0x7f792000eab0 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:17:45.329 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.321+0000 7f7927fff640 1 --2- 172.21.15.44:0/869052747 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5594d0188fd0 0x5594d0197860 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7914009380 tx=0x7f791409b6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30e2db7337dffdaf server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:17:45.329 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.321+0000 7f7912ffd640 1 -- 172.21.15.44:0/869052747 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79140a0140 con 0x5594d0188fd0 2024-08-19T00:17:45.330 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.321+0000 7f7912ffd640 1 -- 172.21.15.44:0/869052747 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79140a4a00 con 0x5594d0188fd0 2024-08-19T00:17:45.330 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.321+0000 7f7912ffd640 1 -- 172.21.15.44:0/869052747 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f791409b1e0 con 0x5594d0188fd0 2024-08-19T00:17:45.330 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.322+0000 7f7931a57740 1 -- 172.21.15.44:0/869052747 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5594d0188fd0 msgr2=0x5594d0197860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:17:45.330 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.322+0000 7f7931a57740 1 --2- 172.21.15.44:0/869052747 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5594d0188fd0 0x5594d0197860 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7914009380 tx=0x7f791409b6f0 comp rx=0 tx=0).stop 2024-08-19T00:17:45.330 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.322+0000 7f7931a57740 1 -- 172.21.15.44:0/869052747 shutdown_connections 2024-08-19T00:17:45.330 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.322+0000 7f7931a57740 1 --2- 172.21.15.44:0/869052747 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5594d0188fd0 0x5594d0197860 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:45.330 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.322+0000 7f7931a57740 1 --2- 172.21.15.44:0/869052747 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5594d0197da0 0x5594d019a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:45.330 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.322+0000 7f7931a57740 1 --2- 172.21.15.44:0/869052747 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594d01886b0 0x5594d0188a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:45.330 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.322+0000 7f7931a57740 1 -- 172.21.15.44:0/869052747 >> 172.21.15.44:0/869052747 conn(0x5594d0184d40 msgr2=0x5594d0185120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:17:45.330 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.322+0000 7f7931a57740 1 -- 172.21.15.44:0/869052747 shutdown_connections 2024-08-19T00:17:45.330 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.322+0000 7f7931a57740 1 -- 172.21.15.44:0/869052747 wait complete. 2024-08-19T00:17:45.330 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.323+0000 7f7931a57740 1 -- start start 2024-08-19T00:17:45.331 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.323+0000 7f7931a57740 1 Processor -- start 2024-08-19T00:17:45.331 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.323+0000 7f7931a57740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5594d01886b0 0x5594d0194cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:45.331 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.323+0000 7f7931a57740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5594d0188fd0 0x5594d0195200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:45.331 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.323+0000 7f7931a57740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594d0197da0 0x5594d0195740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:45.331 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.323+0000 7f7931a57740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5594d019a9d0 con 0x5594d0197da0 2024-08-19T00:17:45.331 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.323+0000 7f7931a57740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5594d00a8520 con 0x5594d01886b0 2024-08-19T00:17:45.331 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.323+0000 7f7931a57740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5594d019ab50 con 0x5594d0188fd0 2024-08-19T00:17:45.331 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.323+0000 7f7931a57740 10 client.0 _ll_register_callbacks cb 0x5594cfdffa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:17:45.331 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.323+0000 7f792d233640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594d0197da0 0x5594d0195740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:45.331 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.323+0000 7f792ca32640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5594d01886b0 0x5594d0194cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:45.331 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.323+0000 7f792d233640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594d0197da0 0x5594d0195740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37022/0 (socket says 172.21.15.44:37022) 2024-08-19T00:17:45.331 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.323+0000 7f792d233640 1 -- 172.21.15.44:0/789805330 learned_addr learned my addr 172.21.15.44:0/789805330 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:17:45.331 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.323+0000 7f7927fff640 1 --2- 172.21.15.44:0/789805330 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5594d0188fd0 0x5594d0195200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:45.332 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.324+0000 7f792d233640 1 -- 172.21.15.44:0/789805330 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5594d0188fd0 msgr2=0x5594d0195200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:17:45.332 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.324+0000 7f792d233640 1 --2- 172.21.15.44:0/789805330 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5594d0188fd0 0x5594d0195200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:45.332 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.324+0000 7f792d233640 1 -- 172.21.15.44:0/789805330 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5594d01886b0 msgr2=0x5594d0194cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:17:45.332 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.324+0000 7f792d233640 1 --2- 172.21.15.44:0/789805330 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5594d01886b0 0x5594d0194cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:45.332 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.324+0000 7f792d233640 1 -- 172.21.15.44:0/789805330 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594cfecc620 con 0x5594d0197da0 2024-08-19T00:17:45.332 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.324+0000 7f792ca32640 1 --2- 172.21.15.44:0/789805330 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5594d01886b0 0x5594d0194cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:17:45.332 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.324+0000 7f792d233640 1 --2- 172.21.15.44:0/789805330 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594d0197da0 0x5594d0195740 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f792001e6d0 tx=0x7f7920004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=662b2e1a2114528f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:17:45.332 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.324+0000 7f7907fff640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:17:45.332 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.324+0000 7f7907fff640 1 -- 172.21.15.44:0/789805330 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f792002c060 con 0x5594d0197da0 2024-08-19T00:17:45.332 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.324+0000 7f7931a57740 1 -- 172.21.15.44:0/789805330 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79140a4a00 con 0x5594d0197da0 2024-08-19T00:17:45.332 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.324+0000 7f7907fff640 1 -- 172.21.15.44:0/789805330 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f7920024070 con 0x5594d0197da0 2024-08-19T00:17:45.332 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.324+0000 7f7907fff640 1 -- 172.21.15.44:0/789805330 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f7920033050 con 0x5594d0197da0 2024-08-19T00:17:45.332 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.324+0000 7f7931a57740 10 client.16092 fetch_fsmap learned FSMap version 33 2024-08-19T00:17:45.333 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.324+0000 7f7931a57740 1 -- 172.21.15.44:0/789805330 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5594d01a6670 con 0x5594d0197da0 2024-08-19T00:17:45.333 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.324+0000 7f7907fff640 1 -- 172.21.15.44:0/789805330 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79140a4a00 con 0x5594d0197da0 2024-08-19T00:17:45.333 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.324+0000 7f7907fff640 1 -- 172.21.15.44:0/789805330 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f792000b040 con 0x5594d0197da0 2024-08-19T00:17:45.333 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.324+0000 7f7931a57740 10 client.16092 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:17:45.333 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.324+0000 7f7931a57740 10 client.16092 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:17:45.333 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.324+0000 7f7931a57740 20 client.16092 populate_metadata read hostname 'smithi044' 2024-08-19T00:17:45.333 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.325+0000 7f7931a57740 1 --2- 172.21.15.44:0/789805330 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5594d01a7b30 0x5594d01a9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:45.333 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.325+0000 7f7931a57740 4 client.16092 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:17:45.333 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.325+0000 7f7931a57740 1 -- 172.21.15.44:0/789805330 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5594d00fa100 con 0x5594d01a7b30 2024-08-19T00:17:45.333 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.325+0000 7f792ca32640 1 --2- 172.21.15.44:0/789805330 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5594d01a7b30 0x5594d01a9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:45.333 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.325+0000 7f792ca32640 1 --2- 172.21.15.44:0/789805330 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5594d01a7b30 0x5594d01a9f40 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f858d098bc6e681b server_cookie=cdd4611a2d17c322 in_seq=0 out_seq=0 2024-08-19T00:17:45.333 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.325+0000 7f7907fff640 10 client.16092 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:17:45.333 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.326+0000 7f7907fff640 1 -- 172.21.15.44:0/789805330 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5594d00fa100 con 0x5594d01a7b30 2024-08-19T00:17:45.334 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.326+0000 7f7907fff640 10 client.16092 handle_command_reply: tid=0 2024-08-19T00:17:45.334 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.326+0000 7f7931a57740 1 client.16092 shutdown 2024-08-19T00:17:45.334 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.326+0000 7f7931a57740 1 -- 172.21.15.44:0/789805330 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594d0197da0 msgr2=0x5594d0195740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:17:45.334 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.326+0000 7f7931a57740 1 --2- 172.21.15.44:0/789805330 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594d0197da0 0x5594d0195740 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f792001e6d0 tx=0x7f7920004ab0 comp rx=0 tx=0).stop 2024-08-19T00:17:45.334 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.326+0000 7f7931a57740 1 -- 172.21.15.44:0/789805330 shutdown_connections 2024-08-19T00:17:45.334 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.326+0000 7f7931a57740 1 --2- 172.21.15.44:0/789805330 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5594d01a7b30 0x5594d01a9f40 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:45.334 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.326+0000 7f7931a57740 1 --2- 172.21.15.44:0/789805330 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5594d0188fd0 0x5594d0195200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:45.334 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.326+0000 7f7931a57740 1 --2- 172.21.15.44:0/789805330 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594d0197da0 0x5594d0195740 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:45.334 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.326+0000 7f7931a57740 1 --2- 172.21.15.44:0/789805330 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5594d01886b0 0x5594d0194cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:45.334 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.326+0000 7f7907fff640 0 client.16092 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:17:45.334 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.326+0000 7f7931a57740 1 -- 172.21.15.44:0/789805330 >> 172.21.15.44:0/789805330 conn(0x5594d0184d40 msgr2=0x5594d018aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:17:45.334 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.326+0000 7f7931a57740 1 -- 172.21.15.44:0/789805330 shutdown_connections 2024-08-19T00:17:45.334 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.326+0000 7f7931a57740 1 -- 172.21.15.44:0/789805330 wait complete. 2024-08-19T00:17:45.335 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.326+0000 7f7931a57740 20 client.16092 trim_cache size 0 max 16384 2024-08-19T00:17:45.348 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.342+0000 7f7931a57740 1 Processor -- start 2024-08-19T00:17:45.348 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.343+0000 7f7931a57740 1 -- start start 2024-08-19T00:17:45.348 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.343+0000 7f7931a57740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5594d01886b0 0x5594d0196b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:45.348 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.343+0000 7f7931a57740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5594d0188fd0 0x5594d01af850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:45.348 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.343+0000 7f7931a57740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594d0197da0 0x5594d01afd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:45.349 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.343+0000 7f7931a57740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f79281ac9d0 con 0x5594d0197da0 2024-08-19T00:17:45.349 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.343+0000 7f7931a57740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f79281ae510 con 0x5594d0188fd0 2024-08-19T00:17:45.349 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.343+0000 7f7931a57740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f79281ad0a0 con 0x5594d01886b0 2024-08-19T00:17:45.349 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.343+0000 7f792d233640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594d0197da0 0x5594d01afd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:45.349 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.343+0000 7f792ca32640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5594d01886b0 0x5594d0196b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:45.349 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.343+0000 7f792d233640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594d0197da0 0x5594d01afd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37026/0 (socket says 172.21.15.44:37026) 2024-08-19T00:17:45.349 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.343+0000 7f792d233640 1 -- 172.21.15.44:0/97832158 learned_addr learned my addr 172.21.15.44:0/97832158 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:17:45.349 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.343+0000 7f7927fff640 1 --2- 172.21.15.44:0/97832158 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5594d0188fd0 0x5594d01af850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:45.349 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.343+0000 7f792d233640 1 -- 172.21.15.44:0/97832158 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5594d01886b0 msgr2=0x5594d0196b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:17:45.349 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.343+0000 7f792d233640 1 --2- 172.21.15.44:0/97832158 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5594d01886b0 0x5594d0196b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:45.349 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.343+0000 7f792d233640 1 -- 172.21.15.44:0/97832158 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5594d0188fd0 msgr2=0x5594d01af850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:17:45.349 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.343+0000 7f792d233640 1 --2- 172.21.15.44:0/97832158 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5594d0188fd0 0x5594d01af850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:45.349 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.343+0000 7f792d233640 1 -- 172.21.15.44:0/97832158 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594d0188e00 con 0x5594d0197da0 2024-08-19T00:17:45.350 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.343+0000 7f792ca32640 1 --2- 172.21.15.44:0/97832158 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5594d01886b0 0x5594d0196b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:17:45.350 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.343+0000 7f792d233640 1 --2- 172.21.15.44:0/97832158 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594d0197da0 0x5594d01afd90 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f792000efd0 tx=0x7f7920009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a00a35fcfc9681d6 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:17:45.350 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.343+0000 7f79127fc640 1 -- 172.21.15.44:0/97832158 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f792002c040 con 0x5594d0197da0 2024-08-19T00:17:45.350 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.344+0000 7f79127fc640 1 -- 172.21.15.44:0/97832158 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f792000d430 con 0x5594d0197da0 2024-08-19T00:17:45.350 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.344+0000 7f79127fc640 1 -- 172.21.15.44:0/97832158 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f792001cb00 con 0x5594d0197da0 2024-08-19T00:17:45.350 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.344+0000 7f7931a57740 1 -- 172.21.15.44:0/97832158 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594d0197da0 msgr2=0x5594d01afd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:17:45.350 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.344+0000 7f7931a57740 1 --2- 172.21.15.44:0/97832158 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594d0197da0 0x5594d01afd90 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f792000efd0 tx=0x7f7920009f60 comp rx=0 tx=0).stop 2024-08-19T00:17:45.350 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.344+0000 7f7931a57740 1 -- 172.21.15.44:0/97832158 shutdown_connections 2024-08-19T00:17:45.350 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.344+0000 7f7931a57740 1 --2- 172.21.15.44:0/97832158 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594d0197da0 0x5594d01afd90 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:45.350 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.344+0000 7f7931a57740 1 --2- 172.21.15.44:0/97832158 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5594d0188fd0 0x5594d01af850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:45.350 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.344+0000 7f7931a57740 1 --2- 172.21.15.44:0/97832158 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5594d01886b0 0x5594d0196b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:45.350 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.344+0000 7f7931a57740 1 -- 172.21.15.44:0/97832158 >> 172.21.15.44:0/97832158 conn(0x5594d0184d40 msgr2=0x5594d0196410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:17:45.350 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.344+0000 7f7931a57740 1 -- 172.21.15.44:0/97832158 shutdown_connections 2024-08-19T00:17:45.351 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.344+0000 7f7931a57740 1 -- 172.21.15.44:0/97832158 wait complete. 2024-08-19T00:17:45.351 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.345+0000 7f7931a57740 1 -- start start 2024-08-19T00:17:45.351 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.345+0000 7f7931a57740 1 Processor -- start 2024-08-19T00:17:45.351 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.345+0000 7f7931a57740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5594d01886b0 0x5594d019fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:45.351 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.345+0000 7f7931a57740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5594d0188fd0 0x5594d01a03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:45.351 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.345+0000 7f7931a57740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594d0197da0 0x5594d019b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:45.351 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.345+0000 7f7931a57740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f79281ade40 con 0x5594d0197da0 2024-08-19T00:17:45.351 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.345+0000 7f7931a57740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f79281ad770 con 0x5594d0188fd0 2024-08-19T00:17:45.351 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.345+0000 7f7931a57740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f79281aa9b0 con 0x5594d01886b0 2024-08-19T00:17:45.351 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.345+0000 7f7931a57740 10 client.0 _ll_register_callbacks cb 0x7f79200098e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:17:45.351 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.345+0000 7f792d233640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594d0197da0 0x5594d019b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:45.351 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.345+0000 7f792d233640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594d0197da0 0x5594d019b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37032/0 (socket says 172.21.15.44:37032) 2024-08-19T00:17:45.351 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.345+0000 7f792d233640 1 -- 172.21.15.44:0/1335212498 learned_addr learned my addr 172.21.15.44:0/1335212498 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:17:45.352 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.345+0000 7f7927fff640 1 --2- 172.21.15.44:0/1335212498 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5594d0188fd0 0x5594d01a03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:45.352 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.345+0000 7f792ca32640 1 --2- 172.21.15.44:0/1335212498 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5594d01886b0 0x5594d019fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:45.352 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.345+0000 7f792d233640 1 -- 172.21.15.44:0/1335212498 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5594d01886b0 msgr2=0x5594d019fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:17:45.352 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.345+0000 7f792d233640 1 --2- 172.21.15.44:0/1335212498 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5594d01886b0 0x5594d019fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:45.352 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.345+0000 7f792d233640 1 -- 172.21.15.44:0/1335212498 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5594d0188fd0 msgr2=0x5594d01a03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:17:45.352 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.345+0000 7f792d233640 1 --2- 172.21.15.44:0/1335212498 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5594d0188fd0 0x5594d01a03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:45.352 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.345+0000 7f792d233640 1 -- 172.21.15.44:0/1335212498 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594d019bbe0 con 0x5594d0197da0 2024-08-19T00:17:45.352 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.346+0000 7f792d233640 1 --2- 172.21.15.44:0/1335212498 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594d0197da0 0x5594d019b3e0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f7920009600 tx=0x7f792000ddd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1f540a890ff89f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:17:45.352 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.346+0000 7f7907fff640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:17:45.352 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.346+0000 7f7907fff640 1 -- 172.21.15.44:0/1335212498 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f792002c040 con 0x5594d0197da0 2024-08-19T00:17:45.352 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.346+0000 7f7907fff640 1 -- 172.21.15.44:0/1335212498 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f7920004a00 con 0x5594d0197da0 2024-08-19T00:17:45.352 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.346+0000 7f7931a57740 1 -- 172.21.15.44:0/1335212498 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f792000d430 con 0x5594d0197da0 2024-08-19T00:17:45.352 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.346+0000 7f7907fff640 1 -- 172.21.15.44:0/1335212498 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f7920045050 con 0x5594d0197da0 2024-08-19T00:17:45.353 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.346+0000 7f7931a57740 10 client.16098 fetch_fsmap learned FSMap version 33 2024-08-19T00:17:45.353 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.346+0000 7f7931a57740 1 -- 172.21.15.44:0/1335212498 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5594d0212230 con 0x5594d0197da0 2024-08-19T00:17:45.353 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.346+0000 7f7907fff640 1 -- 172.21.15.44:0/1335212498 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f792000d430 con 0x5594d0197da0 2024-08-19T00:17:45.353 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.346+0000 7f7907fff640 1 -- 172.21.15.44:0/1335212498 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f792000b040 con 0x5594d0197da0 2024-08-19T00:17:45.353 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.346+0000 7f7931a57740 10 client.16098 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:17:45.353 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.346+0000 7f7931a57740 10 client.16098 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:17:45.353 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.346+0000 7f7931a57740 20 client.16098 populate_metadata read hostname 'smithi044' 2024-08-19T00:17:45.353 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.346+0000 7f7931a57740 1 --2- 172.21.15.44:0/1335212498 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5594d0212880 0x5594d0214c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:45.353 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.346+0000 7f7931a57740 4 client.16098 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-19T00:17:45.353 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.346+0000 7f7931a57740 1 -- 172.21.15.44:0/1335212498 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5594d00f4450 con 0x5594d0212880 2024-08-19T00:17:45.353 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.347+0000 7f792ca32640 1 --2- 172.21.15.44:0/1335212498 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5594d0212880 0x5594d0214c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:45.353 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.347+0000 7f7907fff640 10 client.16098 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:17:45.353 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.347+0000 7f792ca32640 1 --2- 172.21.15.44:0/1335212498 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5594d0212880 0x5594d0214c70 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7bb2b372337d3dba server_cookie=92f6cbafc594532b in_seq=0 out_seq=0 2024-08-19T00:17:45.356 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.354+0000 7f7907fff640 1 -- 172.21.15.44:0/1335212498 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5594d00f4450 con 0x5594d0212880 2024-08-19T00:17:45.356 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.354+0000 7f7907fff640 10 client.16098 handle_command_reply: tid=0 2024-08-19T00:17:45.356 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.354+0000 7f7931a57740 1 client.16098 shutdown 2024-08-19T00:17:45.356 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.354+0000 7f7931a57740 1 -- 172.21.15.44:0/1335212498 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594d0197da0 msgr2=0x5594d019b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:17:45.356 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.354+0000 7f7931a57740 1 --2- 172.21.15.44:0/1335212498 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594d0197da0 0x5594d019b3e0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f7920009600 tx=0x7f792000ddd0 comp rx=0 tx=0).stop 2024-08-19T00:17:45.357 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.354+0000 7f7931a57740 1 -- 172.21.15.44:0/1335212498 shutdown_connections 2024-08-19T00:17:45.357 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.354+0000 7f7931a57740 1 --2- 172.21.15.44:0/1335212498 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5594d0212880 0x5594d0214c70 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:45.357 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.354+0000 7f7931a57740 1 --2- 172.21.15.44:0/1335212498 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594d0197da0 0x5594d019b3e0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:45.357 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.354+0000 7f7907fff640 0 client.16098 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:17:45.357 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.354+0000 7f7931a57740 1 --2- 172.21.15.44:0/1335212498 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5594d0188fd0 0x5594d01a03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:45.357 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.354+0000 7f7931a57740 1 --2- 172.21.15.44:0/1335212498 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5594d01886b0 0x5594d019fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:45.357 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.354+0000 7f7931a57740 1 -- 172.21.15.44:0/1335212498 >> 172.21.15.44:0/1335212498 conn(0x5594d0184d40 msgr2=0x5594d0183ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:17:45.357 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.355+0000 7f7931a57740 1 -- 172.21.15.44:0/1335212498 shutdown_connections 2024-08-19T00:17:45.357 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.355+0000 7f7931a57740 1 -- 172.21.15.44:0/1335212498 wait complete. 2024-08-19T00:17:45.357 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.355+0000 7f7931a57740 20 client.16098 trim_cache size 0 max 16384 2024-08-19T00:17:45.358 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:{ 2024-08-19T00:17:45.358 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "message": "", 2024-08-19T00:17:45.358 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "return_code": 0 2024-08-19T00:17:45.358 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:} 2024-08-19T00:17:45.358 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.355+0000 7f792ec96640 1 -- 172.21.15.44:0/2657771813 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f79180a2da0 msgr2=0x7f79180a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:17:45.359 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.355+0000 7f792ec96640 1 --2- 172.21.15.44:0/2657771813 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f79180a2da0 0x7f79180a5260 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7920005fd0 tx=0x7f792000eab0 comp rx=0 tx=0).stop 2024-08-19T00:17:45.359 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.355+0000 7f792ec96640 1 -- 172.21.15.44:0/2657771813 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7928101080 msgr2=0x7f79281985f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:17:45.359 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.355+0000 7f792ec96640 1 --2- 172.21.15.44:0/2657771813 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7928101080 0x7f79281985f0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f791400e9f0 tx=0x7f791400edf0 comp rx=0 tx=0).stop 2024-08-19T00:17:45.359 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.355+0000 7f792ec96640 1 -- 172.21.15.44:0/2657771813 shutdown_connections 2024-08-19T00:17:45.359 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.355+0000 7f792ec96640 1 --2- 172.21.15.44:0/2657771813 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f79180a2da0 0x7f79180a5260 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:45.359 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.355+0000 7f792ec96640 1 --2- 172.21.15.44:0/2657771813 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f79281066f0 0x7f792819c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:45.359 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.355+0000 7f792ec96640 1 --2- 172.21.15.44:0/2657771813 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7928101080 0x7f79281985f0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:45.359 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.355+0000 7f792ec96640 1 --2- 172.21.15.44:0/2657771813 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f79281006e0 0x7f79281980b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:45.359 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.355+0000 7f792ec96640 1 -- 172.21.15.44:0/2657771813 >> 172.21.15.44:0/2657771813 conn(0x7f79280776c0 msgr2=0x7f7928103530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:17:45.359 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.355+0000 7f792ec96640 1 -- 172.21.15.44:0/2657771813 shutdown_connections 2024-08-19T00:17:45.359 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:45.355+0000 7f792ec96640 1 -- 172.21.15.44:0/2657771813 wait complete. 2024-08-19T00:17:45.673 INFO:tasks.workunit.client.0.smithi044.stdout: 1 244608 6.04 MB/sec execute 70 sec latency 24.831 ms 2024-08-19T00:17:46.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:17:45 smithi171 ceph-mon[21810]: pgmap v136: 129 pgs: 129 active+clean; 151 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 2.7 MiB/s wr, 304 op/s 2024-08-19T00:17:46.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:17:45 smithi116 ceph-mon[21873]: pgmap v136: 129 pgs: 129 active+clean; 151 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 2.7 MiB/s wr, 304 op/s 2024-08-19T00:17:46.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:17:45 smithi044 ceph-mon[18489]: pgmap v136: 129 pgs: 129 active+clean; 151 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 2.7 MiB/s wr, 304 op/s 2024-08-19T00:17:46.673 INFO:tasks.workunit.client.0.smithi044.stdout: 1 247122 6.11 MB/sec execute 71 sec latency 17.315 ms 2024-08-19T00:17:47.673 INFO:tasks.workunit.client.0.smithi044.stdout: 1 249132 6.21 MB/sec execute 72 sec latency 12.689 ms 2024-08-19T00:17:48.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:17:47 smithi171 ceph-mon[21810]: pgmap v137: 129 pgs: 129 active+clean; 151 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 1.7 MiB/s wr, 201 op/s 2024-08-19T00:17:48.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:17:47 smithi116 ceph-mon[21873]: pgmap v137: 129 pgs: 129 active+clean; 151 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 1.7 MiB/s wr, 201 op/s 2024-08-19T00:17:48.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:17:47 smithi044 ceph-mon[18489]: pgmap v137: 129 pgs: 129 active+clean; 151 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 1.7 MiB/s wr, 201 op/s 2024-08-19T00:17:48.673 INFO:tasks.workunit.client.0.smithi044.stdout: 1 252106 6.37 MB/sec execute 73 sec latency 16.206 ms 2024-08-19T00:17:49.673 INFO:tasks.workunit.client.0.smithi044.stdout: 1 254370 6.40 MB/sec execute 74 sec latency 16.386 ms 2024-08-19T00:17:50.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:17:49 smithi171 ceph-mon[21810]: pgmap v138: 129 pgs: 129 active+clean; 151 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 1.7 MiB/s wr, 201 op/s 2024-08-19T00:17:50.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:17:49 smithi116 ceph-mon[21873]: pgmap v138: 129 pgs: 129 active+clean; 151 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 1.7 MiB/s wr, 201 op/s 2024-08-19T00:17:50.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:17:49 smithi044 ceph-mon[18489]: pgmap v138: 129 pgs: 129 active+clean; 151 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 1.7 MiB/s wr, 201 op/s 2024-08-19T00:17:50.674 INFO:tasks.workunit.client.0.smithi044.stdout: 1 256243 6.47 MB/sec execute 75 sec latency 35.121 ms 2024-08-19T00:17:51.674 INFO:tasks.workunit.client.0.smithi044.stdout: 1 259255 6.62 MB/sec execute 76 sec latency 9.663 ms 2024-08-19T00:17:52.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:17:51 smithi171 ceph-mon[21810]: pgmap v139: 129 pgs: 129 active+clean; 160 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 2.6 MiB/s wr, 303 op/s 2024-08-19T00:17:52.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:17:51 smithi116 ceph-mon[21873]: pgmap v139: 129 pgs: 129 active+clean; 160 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 2.6 MiB/s wr, 303 op/s 2024-08-19T00:17:52.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:17:51 smithi044 ceph-mon[18489]: pgmap v139: 129 pgs: 129 active+clean; 160 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 2.6 MiB/s wr, 303 op/s 2024-08-19T00:17:52.674 INFO:tasks.workunit.client.0.smithi044.stdout: 1 261898 6.70 MB/sec execute 77 sec latency 12.727 ms 2024-08-19T00:17:53.674 INFO:tasks.workunit.client.0.smithi044.stdout: 1 264042 6.77 MB/sec execute 78 sec latency 33.201 ms 2024-08-19T00:17:54.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:17:53 smithi171 ceph-mon[21810]: pgmap v140: 129 pgs: 129 active+clean; 160 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 1.8 MiB/s wr, 205 op/s 2024-08-19T00:17:54.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:17:53 smithi116 ceph-mon[21873]: pgmap v140: 129 pgs: 129 active+clean; 160 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 1.8 MiB/s wr, 205 op/s 2024-08-19T00:17:54.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:17:53 smithi044 ceph-mon[18489]: pgmap v140: 129 pgs: 129 active+clean; 160 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 1.8 MiB/s wr, 205 op/s 2024-08-19T00:17:54.674 INFO:tasks.workunit.client.0.smithi044.stdout: 1 266726 6.86 MB/sec execute 79 sec latency 11.409 ms 2024-08-19T00:17:55.674 INFO:tasks.workunit.client.0.smithi044.stdout: 1 269409 6.95 MB/sec execute 80 sec latency 93.148 ms 2024-08-19T00:17:56.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:17:55 smithi171 ceph-mon[21810]: pgmap v141: 129 pgs: 129 active+clean; 168 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 2.9 MiB/s wr, 309 op/s 2024-08-19T00:17:56.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:17:55 smithi116 ceph-mon[21873]: pgmap v141: 129 pgs: 129 active+clean; 168 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 2.9 MiB/s wr, 309 op/s 2024-08-19T00:17:56.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:17:55 smithi044 ceph-mon[18489]: pgmap v141: 129 pgs: 129 active+clean; 168 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 2.9 MiB/s wr, 309 op/s 2024-08-19T00:17:56.674 INFO:tasks.workunit.client.0.smithi044.stdout: 1 271270 6.99 MB/sec execute 81 sec latency 13.880 ms 2024-08-19T00:17:57.674 INFO:tasks.workunit.client.0.smithi044.stdout: 1 273884 7.08 MB/sec execute 82 sec latency 11.693 ms 2024-08-19T00:17:58.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:17:57 smithi171 ceph-mon[21810]: pgmap v142: 129 pgs: 129 active+clean; 168 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 2.0 MiB/s wr, 206 op/s 2024-08-19T00:17:58.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:17:57 smithi116 ceph-mon[21873]: pgmap v142: 129 pgs: 129 active+clean; 168 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 2.0 MiB/s wr, 206 op/s 2024-08-19T00:17:58.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:17:57 smithi044 ceph-mon[18489]: pgmap v142: 129 pgs: 129 active+clean; 168 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 2.0 MiB/s wr, 206 op/s 2024-08-19T00:17:58.450 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.447+0000 7f94c9865640 1 -- 172.21.15.44:0/809140913 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94c41032d0 msgr2=0x7f94c410b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:17:58.450 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.447+0000 7f94c9865640 1 --2- 172.21.15.44:0/809140913 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94c41032d0 0x7f94c410b7b0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f94b8009900 tx=0x7f94b802a480 comp rx=0 tx=0).stop 2024-08-19T00:17:58.450 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.447+0000 7f94c9865640 1 -- 172.21.15.44:0/809140913 shutdown_connections 2024-08-19T00:17:58.450 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.447+0000 7f94c9865640 1 --2- 172.21.15.44:0/809140913 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94c410be00 0x7f94c410e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:58.451 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.447+0000 7f94c9865640 1 --2- 172.21.15.44:0/809140913 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94c41032d0 0x7f94c410b7b0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:58.451 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.447+0000 7f94c9865640 1 --2- 172.21.15.44:0/809140913 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f94c41029b0 0x7f94c4102d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:58.451 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.447+0000 7f94c9865640 1 -- 172.21.15.44:0/809140913 >> 172.21.15.44:0/809140913 conn(0x7f94c40776c0 msgr2=0x7f94c40fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:17:58.451 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.447+0000 7f94c9865640 1 -- 172.21.15.44:0/809140913 shutdown_connections 2024-08-19T00:17:58.451 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.447+0000 7f94c9865640 1 -- 172.21.15.44:0/809140913 wait complete. 2024-08-19T00:17:58.451 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.447+0000 7f94c9865640 1 Processor -- start 2024-08-19T00:17:58.451 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.447+0000 7f94c9865640 1 -- start start 2024-08-19T00:17:58.451 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.448+0000 7f94c9865640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94c41029b0 0x7f94c41980b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:58.451 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.448+0000 7f94c9865640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f94c41032d0 0x7f94c41985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:58.451 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.448+0000 7f94c9865640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94c410be00 0x7f94c419c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:58.451 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.448+0000 7f94c9865640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f94c4111be0 con 0x7f94c410be00 2024-08-19T00:17:58.451 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.448+0000 7f94c9865640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f94c4111a60 con 0x7f94c41029b0 2024-08-19T00:17:58.451 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.448+0000 7f94c9865640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f94c4111d60 con 0x7f94c41032d0 2024-08-19T00:17:58.452 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.448+0000 7f94c37fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94c410be00 0x7f94c419c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:58.452 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.448+0000 7f94c37fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94c410be00 0x7f94c419c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34744/0 (socket says 172.21.15.44:34744) 2024-08-19T00:17:58.452 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.448+0000 7f94c37fe640 1 -- 172.21.15.44:0/217465417 learned_addr learned my addr 172.21.15.44:0/217465417 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:17:58.452 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.448+0000 7f94c2ffd640 1 --2- 172.21.15.44:0/217465417 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94c41029b0 0x7f94c41980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:58.452 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.448+0000 7f94c27fc640 1 --2- 172.21.15.44:0/217465417 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f94c41032d0 0x7f94c41985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:58.452 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.448+0000 7f94c37fe640 1 -- 172.21.15.44:0/217465417 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f94c41032d0 msgr2=0x7f94c41985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:17:58.452 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.448+0000 7f94c37fe640 1 --2- 172.21.15.44:0/217465417 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f94c41032d0 0x7f94c41985f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:58.452 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.448+0000 7f94c37fe640 1 -- 172.21.15.44:0/217465417 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94c41029b0 msgr2=0x7f94c41980b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:17:58.452 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.448+0000 7f94c37fe640 1 --2- 172.21.15.44:0/217465417 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94c41029b0 0x7f94c41980b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:58.452 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.448+0000 7f94c37fe640 1 -- 172.21.15.44:0/217465417 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94c419d0a0 con 0x7f94c410be00 2024-08-19T00:17:58.452 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.448+0000 7f94c2ffd640 1 --2- 172.21.15.44:0/217465417 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94c41029b0 0x7f94c41980b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:17:58.452 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.448+0000 7f94c37fe640 1 --2- 172.21.15.44:0/217465417 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94c410be00 0x7f94c419c970 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f94bc00eb10 tx=0x7f94bc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:17:58.452 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.448+0000 7f94c8863640 1 -- 172.21.15.44:0/217465417 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94bc004b20 con 0x7f94c410be00 2024-08-19T00:17:58.453 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.448+0000 7f94c8863640 1 -- 172.21.15.44:0/217465417 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94bc004cc0 con 0x7f94c410be00 2024-08-19T00:17:58.453 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.448+0000 7f94c9865640 1 -- 172.21.15.44:0/217465417 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94c419d390 con 0x7f94c410be00 2024-08-19T00:17:58.453 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.448+0000 7f94c8863640 1 -- 172.21.15.44:0/217465417 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94bc010760 con 0x7f94c410be00 2024-08-19T00:17:58.453 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.449+0000 7f94c9865640 1 -- 172.21.15.44:0/217465417 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94c41a4c20 con 0x7f94c410be00 2024-08-19T00:17:58.459 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.451+0000 7f94c8863640 1 -- 172.21.15.44:0/217465417 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f94bc005020 con 0x7f94c410be00 2024-08-19T00:17:58.459 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.451+0000 7f94cc61d740 1 Processor -- start 2024-08-19T00:17:58.459 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.451+0000 7f94cc61d740 1 -- start start 2024-08-19T00:17:58.459 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.451+0000 7f94cc61d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55af4c8906b0 0x55af4c890a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:58.459 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.451+0000 7f94cc61d740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af4c890fd0 0x55af4c89f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:58.459 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.451+0000 7f94cc61d740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55af4c89fda0 0x55af4c8a2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:58.460 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.451+0000 7f94cc61d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55af4c7f49d0 con 0x55af4c8906b0 2024-08-19T00:17:58.460 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.451+0000 7f94cc61d740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55af4c79c820 con 0x55af4c890fd0 2024-08-19T00:17:58.460 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.451+0000 7f94cc61d740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55af4c7f0990 con 0x55af4c89fda0 2024-08-19T00:17:58.460 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.451+0000 7f94c27fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55af4c8906b0 0x55af4c890a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:58.460 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.451+0000 7f94c27fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55af4c8906b0 0x55af4c890a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34754/0 (socket says 172.21.15.44:34754) 2024-08-19T00:17:58.460 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.451+0000 7f94c27fc640 1 -- 172.21.15.44:0/1366666491 learned_addr learned my addr 172.21.15.44:0/1366666491 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:17:58.460 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.451+0000 7f94c2ffd640 1 --2- 172.21.15.44:0/1366666491 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af4c890fd0 0x55af4c89f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:58.460 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.452+0000 7f94c8863640 1 --2- 172.21.15.44:0/217465417 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f94ac0a2e20 0x7f94ac0a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:58.460 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.452+0000 7f94c27fc640 1 --2- 172.21.15.44:0/1366666491 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55af4c89fda0 0x55af4c8a2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:58.460 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.452+0000 7f94c27fc640 1 -- 172.21.15.44:0/1366666491 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55af4c89fda0 msgr2=0x55af4c8a2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:17:58.460 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.452+0000 7f94c27fc640 1 --2- 172.21.15.44:0/1366666491 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55af4c89fda0 0x55af4c8a2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:58.460 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.452+0000 7f94c27fc640 1 -- 172.21.15.44:0/1366666491 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af4c890fd0 msgr2=0x55af4c89f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:17:58.460 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.452+0000 7f94c27fc640 1 --2- 172.21.15.44:0/1366666491 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af4c890fd0 0x55af4c89f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:58.461 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.452+0000 7f94c27fc640 1 -- 172.21.15.44:0/1366666491 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af4c508210 con 0x55af4c8906b0 2024-08-19T00:17:58.461 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.452+0000 7f94c37fe640 1 --2- 172.21.15.44:0/217465417 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f94ac0a2e20 0x7f94ac0a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:58.461 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.452+0000 7f94c8863640 1 -- 172.21.15.44:0/217465417 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f94bc0cfd40 con 0x7f94c410be00 2024-08-19T00:17:58.461 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.452+0000 7f94c27fc640 1 --2- 172.21.15.44:0/1366666491 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55af4c8906b0 0x55af4c890a90 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f94b8005c40 tx=0x7f94b8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8139e02c7873a0d0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:17:58.461 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.452+0000 7f94a9ffb640 1 -- 172.21.15.44:0/1366666491 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b8044030 con 0x55af4c8906b0 2024-08-19T00:17:58.461 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.452+0000 7f94a9ffb640 1 -- 172.21.15.44:0/1366666491 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94b80319d0 con 0x55af4c8906b0 2024-08-19T00:17:58.461 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.452+0000 7f94a9ffb640 1 -- 172.21.15.44:0/1366666491 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b8035040 con 0x55af4c8906b0 2024-08-19T00:17:58.461 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.453+0000 7f94cc61d740 1 -- 172.21.15.44:0/1366666491 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55af4c8906b0 msgr2=0x55af4c890a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:17:58.461 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.453+0000 7f94c37fe640 1 --2- 172.21.15.44:0/217465417 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f94ac0a2e20 0x7f94ac0a52e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f94bc09bdf0 tx=0x7f94bc01bb30 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:17:58.461 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.453+0000 7f94cc61d740 1 --2- 172.21.15.44:0/1366666491 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55af4c8906b0 0x55af4c890a90 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f94b8005c40 tx=0x7f94b8000bc0 comp rx=0 tx=0).stop 2024-08-19T00:17:58.461 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.453+0000 7f94cc61d740 1 -- 172.21.15.44:0/1366666491 shutdown_connections 2024-08-19T00:17:58.461 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.453+0000 7f94cc61d740 1 --2- 172.21.15.44:0/1366666491 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55af4c89fda0 0x55af4c8a2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:58.461 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.453+0000 7f94cc61d740 1 --2- 172.21.15.44:0/1366666491 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af4c890fd0 0x55af4c89f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:58.462 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.453+0000 7f94cc61d740 1 --2- 172.21.15.44:0/1366666491 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55af4c8906b0 0x55af4c890a90 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:58.462 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.453+0000 7f94cc61d740 1 -- 172.21.15.44:0/1366666491 >> 172.21.15.44:0/1366666491 conn(0x55af4c88cd40 msgr2=0x55af4c88d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:17:58.462 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.453+0000 7f94cc61d740 1 -- 172.21.15.44:0/1366666491 shutdown_connections 2024-08-19T00:17:58.462 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.453+0000 7f94cc61d740 1 -- 172.21.15.44:0/1366666491 wait complete. 2024-08-19T00:17:58.462 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.453+0000 7f94cc61d740 1 -- start start 2024-08-19T00:17:58.462 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.453+0000 7f94cc61d740 1 Processor -- start 2024-08-19T00:17:58.462 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.454+0000 7f94cc61d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55af4c8906b0 0x55af4c89ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:58.462 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.454+0000 7f94cc61d740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55af4c890fd0 0x55af4c89d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:58.462 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.454+0000 7f94cc61d740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af4c89fda0 0x55af4c89d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:58.462 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.454+0000 7f94cc61d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55af4c8a2970 con 0x55af4c8906b0 2024-08-19T00:17:58.463 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.454+0000 7f94cc61d740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55af4c7b0520 con 0x55af4c89fda0 2024-08-19T00:17:58.463 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.454+0000 7f94cc61d740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55af4c8a2af0 con 0x55af4c890fd0 2024-08-19T00:17:58.463 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.454+0000 7f94cc61d740 10 client.0 _ll_register_callbacks cb 0x55af4c507a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:17:58.463 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.454+0000 7f94c27fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55af4c8906b0 0x55af4c89ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:58.463 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.454+0000 7f94c27fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55af4c8906b0 0x55af4c89ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34758/0 (socket says 172.21.15.44:34758) 2024-08-19T00:17:58.463 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.454+0000 7f94c27fc640 1 -- 172.21.15.44:0/1571052965 learned_addr learned my addr 172.21.15.44:0/1571052965 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:17:58.463 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.454+0000 7f94c2ffd640 1 --2- 172.21.15.44:0/1571052965 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55af4c890fd0 0x55af4c89d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:58.463 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.454+0000 7f94c27fc640 1 --2- 172.21.15.44:0/1571052965 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af4c89fda0 0x55af4c89d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:58.463 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.454+0000 7f94c27fc640 1 -- 172.21.15.44:0/1571052965 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55af4c890fd0 msgr2=0x55af4c89d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:17:58.463 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.454+0000 7f94c27fc640 1 --2- 172.21.15.44:0/1571052965 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55af4c890fd0 0x55af4c89d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:58.463 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.454+0000 7f94c27fc640 1 -- 172.21.15.44:0/1571052965 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af4c89fda0 msgr2=0x55af4c89d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:17:58.464 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.454+0000 7f94c27fc640 1 --2- 172.21.15.44:0/1571052965 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af4c89fda0 0x55af4c89d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:58.464 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.454+0000 7f94c27fc640 1 -- 172.21.15.44:0/1571052965 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af4c5d4620 con 0x55af4c8906b0 2024-08-19T00:17:58.464 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.454+0000 7f94c27fc640 1 --2- 172.21.15.44:0/1571052965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55af4c8906b0 0x55af4c89ccf0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f94b8006010 tx=0x7f94b8005590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e49d480011528ca3 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:17:58.464 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.454+0000 7f94a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:17:58.464 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.454+0000 7f94a2ffd640 1 -- 172.21.15.44:0/1571052965 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b8035070 con 0x55af4c8906b0 2024-08-19T00:17:58.464 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.454+0000 7f94a2ffd640 1 -- 172.21.15.44:0/1571052965 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f94b8004ad0 con 0x55af4c8906b0 2024-08-19T00:17:58.464 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.454+0000 7f94cc61d740 1 -- 172.21.15.44:0/1571052965 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94b80319d0 con 0x55af4c8906b0 2024-08-19T00:17:58.464 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.455+0000 7f94a2ffd640 1 -- 172.21.15.44:0/1571052965 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f94b80052e0 con 0x55af4c8906b0 2024-08-19T00:17:58.464 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.455+0000 7f94cc61d740 10 client.16110 fetch_fsmap learned FSMap version 33 2024-08-19T00:17:58.464 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.455+0000 7f94cc61d740 1 -- 172.21.15.44:0/1571052965 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55af4c8ae630 con 0x55af4c8906b0 2024-08-19T00:17:58.464 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.455+0000 7f94a2ffd640 1 -- 172.21.15.44:0/1571052965 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94b80319d0 con 0x55af4c8906b0 2024-08-19T00:17:58.464 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.455+0000 7f94a2ffd640 1 -- 172.21.15.44:0/1571052965 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f94b8055030 con 0x55af4c8906b0 2024-08-19T00:17:58.464 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.455+0000 7f94cc61d740 10 client.16110 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:17:58.464 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.455+0000 7f94cc61d740 10 client.16110 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:17:58.465 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.455+0000 7f94cc61d740 20 client.16110 populate_metadata read hostname 'smithi044' 2024-08-19T00:17:58.465 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.455+0000 7f94cc61d740 1 --2- 172.21.15.44:0/1571052965 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55af4c8af980 0x55af4c8b1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:58.465 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.455+0000 7f94cc61d740 4 client.16110 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:17:58.465 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.455+0000 7f94cc61d740 1 -- 172.21.15.44:0/1571052965 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55af4c802100 con 0x55af4c8af980 2024-08-19T00:17:58.465 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.455+0000 7f94c2ffd640 1 --2- 172.21.15.44:0/1571052965 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55af4c8af980 0x55af4c8b1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:58.465 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.455+0000 7f94a2ffd640 10 client.16110 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:17:58.465 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.455+0000 7f94c2ffd640 1 --2- 172.21.15.44:0/1571052965 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55af4c8af980 0x55af4c8b1d70 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6178fb20157ba37a server_cookie=406bc138c3070c82 in_seq=0 out_seq=0 2024-08-19T00:17:58.465 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.456+0000 7f94a2ffd640 1 -- 172.21.15.44:0/1571052965 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55af4c802100 con 0x55af4c8af980 2024-08-19T00:17:58.465 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.456+0000 7f94a2ffd640 10 client.16110 handle_command_reply: tid=0 2024-08-19T00:17:58.465 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.456+0000 7f94cc61d740 1 client.16110 shutdown 2024-08-19T00:17:58.465 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.456+0000 7f94cc61d740 1 -- 172.21.15.44:0/1571052965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55af4c8906b0 msgr2=0x55af4c89ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:17:58.465 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.456+0000 7f94cc61d740 1 --2- 172.21.15.44:0/1571052965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55af4c8906b0 0x55af4c89ccf0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f94b8006010 tx=0x7f94b8005590 comp rx=0 tx=0).stop 2024-08-19T00:17:58.465 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.456+0000 7f94cc61d740 1 -- 172.21.15.44:0/1571052965 shutdown_connections 2024-08-19T00:17:58.466 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.456+0000 7f94cc61d740 1 --2- 172.21.15.44:0/1571052965 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55af4c8af980 0x55af4c8b1d70 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:58.466 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.456+0000 7f94cc61d740 1 --2- 172.21.15.44:0/1571052965 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55af4c890fd0 0x55af4c89d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:58.466 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.456+0000 7f94cc61d740 1 --2- 172.21.15.44:0/1571052965 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af4c89fda0 0x55af4c89d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:58.466 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.456+0000 7f94a2ffd640 0 client.16110 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:17:58.466 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.456+0000 7f94cc61d740 1 --2- 172.21.15.44:0/1571052965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55af4c8906b0 0x55af4c89ccf0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:58.466 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.456+0000 7f94cc61d740 1 -- 172.21.15.44:0/1571052965 >> 172.21.15.44:0/1571052965 conn(0x55af4c88cd40 msgr2=0x55af4c892aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:17:58.466 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.456+0000 7f94cc61d740 1 -- 172.21.15.44:0/1571052965 shutdown_connections 2024-08-19T00:17:58.466 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.456+0000 7f94cc61d740 1 -- 172.21.15.44:0/1571052965 wait complete. 2024-08-19T00:17:58.466 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.456+0000 7f94cc61d740 20 client.16110 trim_cache size 0 max 16384 2024-08-19T00:17:58.478 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.471+0000 7f94cc61d740 1 Processor -- start 2024-08-19T00:17:58.478 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.472+0000 7f94cc61d740 1 -- start start 2024-08-19T00:17:58.478 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.472+0000 7f94cc61d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55af4c8906b0 0x55af4c89eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:58.478 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.472+0000 7f94cc61d740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af4c890fd0 0x55af4c8b7400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:58.478 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.472+0000 7f94cc61d740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55af4c89fda0 0x55af4c8b7940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:58.478 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.472+0000 7f94cc61d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f94c41aca10 con 0x55af4c8906b0 2024-08-19T00:17:58.478 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.472+0000 7f94cc61d740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f94c41ae550 con 0x55af4c890fd0 2024-08-19T00:17:58.478 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.472+0000 7f94cc61d740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f94c41ad0e0 con 0x55af4c89fda0 2024-08-19T00:17:58.478 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.472+0000 7f94c27fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55af4c8906b0 0x55af4c89eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:58.478 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.472+0000 7f94c27fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55af4c8906b0 0x55af4c89eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34766/0 (socket says 172.21.15.44:34766) 2024-08-19T00:17:58.478 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.472+0000 7f94c27fc640 1 -- 172.21.15.44:0/1154210826 learned_addr learned my addr 172.21.15.44:0/1154210826 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:17:58.479 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.472+0000 7f94c2ffd640 1 --2- 172.21.15.44:0/1154210826 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af4c890fd0 0x55af4c8b7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:58.479 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.472+0000 7f94c27fc640 1 --2- 172.21.15.44:0/1154210826 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55af4c89fda0 0x55af4c8b7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:58.479 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.472+0000 7f94c27fc640 1 -- 172.21.15.44:0/1154210826 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55af4c89fda0 msgr2=0x55af4c8b7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:17:58.479 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.472+0000 7f94c27fc640 1 --2- 172.21.15.44:0/1154210826 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55af4c89fda0 0x55af4c8b7940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:58.479 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.472+0000 7f94c27fc640 1 -- 172.21.15.44:0/1154210826 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af4c890fd0 msgr2=0x55af4c8b7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:17:58.479 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.472+0000 7f94c27fc640 1 --2- 172.21.15.44:0/1154210826 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af4c890fd0 0x55af4c8b7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:58.479 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.472+0000 7f94c27fc640 1 -- 172.21.15.44:0/1154210826 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af4c88cb70 con 0x55af4c8906b0 2024-08-19T00:17:58.479 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.472+0000 7f94c2ffd640 1 --2- 172.21.15.44:0/1154210826 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af4c890fd0 0x55af4c8b7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:17:58.479 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.472+0000 7f94c27fc640 1 --2- 172.21.15.44:0/1154210826 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55af4c8906b0 0x55af4c89eb50 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f94b804afb0 tx=0x7f94b802a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23e9d0eb078990 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:17:58.479 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.472+0000 7f94a97fa640 1 -- 172.21.15.44:0/1154210826 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b805c020 con 0x55af4c8906b0 2024-08-19T00:17:58.479 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.472+0000 7f94a97fa640 1 -- 172.21.15.44:0/1154210826 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94b8045040 con 0x55af4c8906b0 2024-08-19T00:17:58.479 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.472+0000 7f94a97fa640 1 -- 172.21.15.44:0/1154210826 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b804e070 con 0x55af4c8906b0 2024-08-19T00:17:58.479 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.473+0000 7f94cc61d740 1 -- 172.21.15.44:0/1154210826 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55af4c8906b0 msgr2=0x55af4c89eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:17:58.480 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.473+0000 7f94cc61d740 1 --2- 172.21.15.44:0/1154210826 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55af4c8906b0 0x55af4c89eb50 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f94b804afb0 tx=0x7f94b802a480 comp rx=0 tx=0).stop 2024-08-19T00:17:58.480 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.473+0000 7f94cc61d740 1 -- 172.21.15.44:0/1154210826 shutdown_connections 2024-08-19T00:17:58.480 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.473+0000 7f94cc61d740 1 --2- 172.21.15.44:0/1154210826 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55af4c89fda0 0x55af4c8b7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:58.480 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.473+0000 7f94cc61d740 1 --2- 172.21.15.44:0/1154210826 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af4c890fd0 0x55af4c8b7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:58.480 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.473+0000 7f94cc61d740 1 --2- 172.21.15.44:0/1154210826 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55af4c8906b0 0x55af4c89eb50 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:58.480 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.473+0000 7f94cc61d740 1 -- 172.21.15.44:0/1154210826 >> 172.21.15.44:0/1154210826 conn(0x55af4c88cd40 msgr2=0x55af4c89e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:17:58.480 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.473+0000 7f94cc61d740 1 -- 172.21.15.44:0/1154210826 shutdown_connections 2024-08-19T00:17:58.480 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.473+0000 7f94cc61d740 1 -- 172.21.15.44:0/1154210826 wait complete. 2024-08-19T00:17:58.480 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.473+0000 7f94cc61d740 1 -- start start 2024-08-19T00:17:58.480 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.474+0000 7f94cc61d740 1 Processor -- start 2024-08-19T00:17:58.480 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.474+0000 7f94cc61d740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55af4c8906b0 0x55af4c8a3c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:58.480 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.474+0000 7f94cc61d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55af4c890fd0 0x55af4c8a4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:58.481 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.474+0000 7f94cc61d740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af4c89fda0 0x55af4c8a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:58.481 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.474+0000 7f94cc61d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f94c41ade80 con 0x55af4c890fd0 2024-08-19T00:17:58.481 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.474+0000 7f94cc61d740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f94c41ad7b0 con 0x55af4c89fda0 2024-08-19T00:17:58.481 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.474+0000 7f94cc61d740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f94c41aa9f0 con 0x55af4c8906b0 2024-08-19T00:17:58.481 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.474+0000 7f94cc61d740 10 client.0 _ll_register_callbacks cb 0x7f94b4009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:17:58.481 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.474+0000 7f94c2ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55af4c890fd0 0x55af4c8a4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:58.481 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.474+0000 7f94c2ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55af4c890fd0 0x55af4c8a4190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34768/0 (socket says 172.21.15.44:34768) 2024-08-19T00:17:58.481 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.474+0000 7f94c2ffd640 1 -- 172.21.15.44:0/500930318 learned_addr learned my addr 172.21.15.44:0/500930318 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:17:58.481 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.474+0000 7f94c27fc640 1 --2- 172.21.15.44:0/500930318 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55af4c8906b0 0x55af4c8a3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:58.481 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.474+0000 7f94c27fc640 1 --2- 172.21.15.44:0/500930318 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af4c89fda0 0x55af4c8a46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:58.481 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.474+0000 7f94c2ffd640 1 -- 172.21.15.44:0/500930318 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55af4c8906b0 msgr2=0x55af4c8a3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:17:58.481 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.474+0000 7f94c2ffd640 1 --2- 172.21.15.44:0/500930318 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55af4c8906b0 0x55af4c8a3c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:58.482 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.474+0000 7f94c2ffd640 1 -- 172.21.15.44:0/500930318 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af4c89fda0 msgr2=0x55af4c8a46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:17:58.482 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.474+0000 7f94c2ffd640 1 --2- 172.21.15.44:0/500930318 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af4c89fda0 0x55af4c8a46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:58.482 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.474+0000 7f94c2ffd640 1 -- 172.21.15.44:0/500930318 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af4c919530 con 0x55af4c890fd0 2024-08-19T00:17:58.482 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.474+0000 7f94c2ffd640 1 --2- 172.21.15.44:0/500930318 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55af4c890fd0 0x55af4c8a4190 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f94b40126a0 tx=0x7f94b4012b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea8643227f2dd22c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:17:58.482 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.474+0000 7f94a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:17:58.482 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.475+0000 7f94a2ffd640 1 -- 172.21.15.44:0/500930318 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b4004230 con 0x55af4c890fd0 2024-08-19T00:17:58.482 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.475+0000 7f94a2ffd640 1 -- 172.21.15.44:0/500930318 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f94b40043d0 con 0x55af4c890fd0 2024-08-19T00:17:58.482 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.475+0000 7f94cc61d740 1 -- 172.21.15.44:0/500930318 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94b8045040 con 0x55af4c890fd0 2024-08-19T00:17:58.482 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.475+0000 7f94a2ffd640 1 -- 172.21.15.44:0/500930318 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f94b4010880 con 0x55af4c890fd0 2024-08-19T00:17:58.482 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.475+0000 7f94cc61d740 10 client.16116 fetch_fsmap learned FSMap version 33 2024-08-19T00:17:58.482 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.475+0000 7f94cc61d740 1 -- 172.21.15.44:0/500930318 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55af4c91a870 con 0x55af4c890fd0 2024-08-19T00:17:58.482 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.475+0000 7f94a2ffd640 1 -- 172.21.15.44:0/500930318 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94b8045040 con 0x55af4c890fd0 2024-08-19T00:17:58.482 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.475+0000 7f94a2ffd640 1 -- 172.21.15.44:0/500930318 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f94b4027400 con 0x55af4c890fd0 2024-08-19T00:17:58.483 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.475+0000 7f94cc61d740 10 client.16116 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:17:58.483 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.475+0000 7f94cc61d740 10 client.16116 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:17:58.483 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.475+0000 7f94cc61d740 20 client.16116 populate_metadata read hostname 'smithi044' 2024-08-19T00:17:58.483 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.475+0000 7f94cc61d740 1 --2- 172.21.15.44:0/500930318 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55af4c91b070 0x55af4c91d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:17:58.483 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.475+0000 7f94cc61d740 4 client.16116 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-19T00:17:58.483 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.475+0000 7f94cc61d740 1 -- 172.21.15.44:0/500930318 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55af4c7fc450 con 0x55af4c91b070 2024-08-19T00:17:58.483 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.475+0000 7f94c27fc640 1 --2- 172.21.15.44:0/500930318 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55af4c91b070 0x55af4c91d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:17:58.483 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.476+0000 7f94c27fc640 1 --2- 172.21.15.44:0/500930318 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55af4c91b070 0x55af4c91d490 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8cef605f3b87a6c server_cookie=2a8da8eaca65d12 in_seq=0 out_seq=0 2024-08-19T00:17:58.483 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.476+0000 7f94a2ffd640 10 client.16116 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:17:58.485 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.483+0000 7f94a2ffd640 1 -- 172.21.15.44:0/500930318 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55af4c7fc450 con 0x55af4c91b070 2024-08-19T00:17:58.485 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.483+0000 7f94a2ffd640 10 client.16116 handle_command_reply: tid=0 2024-08-19T00:17:58.485 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.483+0000 7f94cc61d740 1 client.16116 shutdown 2024-08-19T00:17:58.485 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.483+0000 7f94cc61d740 1 -- 172.21.15.44:0/500930318 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55af4c890fd0 msgr2=0x55af4c8a4190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:17:58.485 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.483+0000 7f94cc61d740 1 --2- 172.21.15.44:0/500930318 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55af4c890fd0 0x55af4c8a4190 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f94b40126a0 tx=0x7f94b4012b80 comp rx=0 tx=0).stop 2024-08-19T00:17:58.485 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.483+0000 7f94cc61d740 1 -- 172.21.15.44:0/500930318 shutdown_connections 2024-08-19T00:17:58.485 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.483+0000 7f94cc61d740 1 --2- 172.21.15.44:0/500930318 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55af4c91b070 0x55af4c91d490 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:58.485 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.483+0000 7f94cc61d740 1 --2- 172.21.15.44:0/500930318 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af4c89fda0 0x55af4c8a46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:58.485 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.483+0000 7f94cc61d740 1 --2- 172.21.15.44:0/500930318 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55af4c890fd0 0x55af4c8a4190 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:58.486 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.483+0000 7f94cc61d740 1 --2- 172.21.15.44:0/500930318 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55af4c8906b0 0x55af4c8a3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:58.486 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.483+0000 7f94cc61d740 1 -- 172.21.15.44:0/500930318 >> 172.21.15.44:0/500930318 conn(0x55af4c88cd40 msgr2=0x55af4c8929c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:17:58.486 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.483+0000 7f94a2ffd640 0 client.16116 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:17:58.486 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.483+0000 7f94cc61d740 1 -- 172.21.15.44:0/500930318 shutdown_connections 2024-08-19T00:17:58.486 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.483+0000 7f94cc61d740 1 -- 172.21.15.44:0/500930318 wait complete. 2024-08-19T00:17:58.486 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.483+0000 7f94cc61d740 20 client.16116 trim_cache size 0 max 16384 2024-08-19T00:17:58.486 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:{ 2024-08-19T00:17:58.486 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "message": "", 2024-08-19T00:17:58.486 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "return_code": 0 2024-08-19T00:17:58.487 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:} 2024-08-19T00:17:58.487 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.484+0000 7f94c9865640 1 -- 172.21.15.44:0/217465417 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f94ac0a2e20 msgr2=0x7f94ac0a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:17:58.487 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.484+0000 7f94c9865640 1 --2- 172.21.15.44:0/217465417 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f94ac0a2e20 0x7f94ac0a52e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f94bc09bdf0 tx=0x7f94bc01bb30 comp rx=0 tx=0).stop 2024-08-19T00:17:58.487 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.484+0000 7f94c9865640 1 -- 172.21.15.44:0/217465417 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94c410be00 msgr2=0x7f94c419c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:17:58.488 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.484+0000 7f94c9865640 1 --2- 172.21.15.44:0/217465417 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94c410be00 0x7f94c419c970 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f94bc00eb10 tx=0x7f94bc00c2d0 comp rx=0 tx=0).stop 2024-08-19T00:17:58.488 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.484+0000 7f94c9865640 1 -- 172.21.15.44:0/217465417 shutdown_connections 2024-08-19T00:17:58.488 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.484+0000 7f94c9865640 1 --2- 172.21.15.44:0/217465417 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f94ac0a2e20 0x7f94ac0a52e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:58.488 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.484+0000 7f94c9865640 1 --2- 172.21.15.44:0/217465417 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f94c41032d0 0x7f94c41985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:58.488 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.484+0000 7f94c9865640 1 --2- 172.21.15.44:0/217465417 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94c410be00 0x7f94c419c970 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:58.488 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.484+0000 7f94c9865640 1 --2- 172.21.15.44:0/217465417 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94c41029b0 0x7f94c41980b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:17:58.488 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.484+0000 7f94c9865640 1 -- 172.21.15.44:0/217465417 >> 172.21.15.44:0/217465417 conn(0x7f94c40776c0 msgr2=0x7f94c40fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:17:58.488 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.484+0000 7f94c9865640 1 -- 172.21.15.44:0/217465417 shutdown_connections 2024-08-19T00:17:58.488 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:17:58.484+0000 7f94c9865640 1 -- 172.21.15.44:0/217465417 wait complete. 2024-08-19T00:17:58.674 INFO:tasks.workunit.client.0.smithi044.stdout: 1 276804 7.20 MB/sec execute 83 sec latency 14.158 ms 2024-08-19T00:17:59.674 INFO:tasks.workunit.client.0.smithi044.stdout: 1 279191 7.23 MB/sec execute 84 sec latency 10.403 ms 2024-08-19T00:18:00.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:17:59 smithi171 ceph-mon[21810]: pgmap v143: 129 pgs: 129 active+clean; 168 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 2.0 MiB/s wr, 206 op/s 2024-08-19T00:18:00.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:17:59 smithi116 ceph-mon[21873]: pgmap v143: 129 pgs: 129 active+clean; 168 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 2.0 MiB/s wr, 206 op/s 2024-08-19T00:18:00.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:17:59 smithi044 ceph-mon[18489]: pgmap v143: 129 pgs: 129 active+clean; 168 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 2.0 MiB/s wr, 206 op/s 2024-08-19T00:18:00.674 INFO:tasks.workunit.client.0.smithi044.stdout: 1 281126 7.28 MB/sec execute 85 sec latency 33.299 ms 2024-08-19T00:18:01.674 INFO:tasks.workunit.client.0.smithi044.stdout: 1 282530 7.27 MB/sec execute 86 sec latency 81.774 ms 2024-08-19T00:18:02.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:18:01 smithi171 ceph-mon[21810]: pgmap v144: 129 pgs: 129 active+clean; 175 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 3.8 MiB/s wr, 339 op/s 2024-08-19T00:18:02.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:18:01 smithi116 ceph-mon[21873]: pgmap v144: 129 pgs: 129 active+clean; 175 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 3.8 MiB/s wr, 339 op/s 2024-08-19T00:18:02.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:18:01 smithi044 ceph-mon[18489]: pgmap v144: 129 pgs: 129 active+clean; 175 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 3.8 MiB/s wr, 339 op/s 2024-08-19T00:18:02.674 INFO:tasks.workunit.client.0.smithi044.stdout: 1 284289 7.33 MB/sec execute 87 sec latency 62.915 ms 2024-08-19T00:18:03.674 INFO:tasks.workunit.client.0.smithi044.stdout: 1 287154 7.41 MB/sec execute 88 sec latency 27.653 ms 2024-08-19T00:18:04.094 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:18:03 smithi171 ceph-mon[21810]: pgmap v145: 129 pgs: 129 active+clean; 175 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.9 MiB/s wr, 237 op/s 2024-08-19T00:18:04.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:18:03 smithi116 ceph-mon[21873]: pgmap v145: 129 pgs: 129 active+clean; 175 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.9 MiB/s wr, 237 op/s 2024-08-19T00:18:04.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:18:03 smithi044 ceph-mon[18489]: pgmap v145: 129 pgs: 129 active+clean; 175 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.9 MiB/s wr, 237 op/s 2024-08-19T00:18:04.674 INFO:tasks.workunit.client.0.smithi044.stdout: 1 289661 7.46 MB/sec execute 89 sec latency 13.044 ms 2024-08-19T00:18:05.674 INFO:tasks.workunit.client.0.smithi044.stdout: 1 291559 7.51 MB/sec execute 90 sec latency 31.016 ms 2024-08-19T00:18:06.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:18:05 smithi171 ceph-mon[21810]: pgmap v146: 129 pgs: 129 active+clean; 182 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 4.6 MiB/s wr, 388 op/s 2024-08-19T00:18:06.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:18:05 smithi116 ceph-mon[21873]: pgmap v146: 129 pgs: 129 active+clean; 182 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 4.6 MiB/s wr, 388 op/s 2024-08-19T00:18:06.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:18:05 smithi044 ceph-mon[18489]: pgmap v146: 129 pgs: 129 active+clean; 182 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 4.6 MiB/s wr, 388 op/s 2024-08-19T00:18:06.674 INFO:tasks.workunit.client.0.smithi044.stdout: 1 294438 7.62 MB/sec execute 91 sec latency 19.749 ms 2024-08-19T00:18:07.674 INFO:tasks.workunit.client.0.smithi044.stdout: 1 296130 7.61 MB/sec execute 92 sec latency 22.357 ms 2024-08-19T00:18:08.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:18:07 smithi171 ceph-mon[21810]: pgmap v147: 129 pgs: 129 active+clean; 182 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.5 MiB/s wr, 284 op/s 2024-08-19T00:18:08.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:18:07 smithi116 ceph-mon[21873]: pgmap v147: 129 pgs: 129 active+clean; 182 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.5 MiB/s wr, 284 op/s 2024-08-19T00:18:08.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:18:07 smithi044 ceph-mon[18489]: pgmap v147: 129 pgs: 129 active+clean; 182 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.5 MiB/s wr, 284 op/s 2024-08-19T00:18:08.674 INFO:tasks.workunit.client.0.smithi044.stdout: 1 298531 7.68 MB/sec execute 93 sec latency 11.579 ms 2024-08-19T00:18:09.674 INFO:tasks.workunit.client.0.smithi044.stdout: 1 300570 7.68 MB/sec execute 94 sec latency 24.073 ms 2024-08-19T00:18:10.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:18:09 smithi171 ceph-mon[21810]: pgmap v148: 129 pgs: 129 active+clean; 182 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.5 MiB/s wr, 284 op/s 2024-08-19T00:18:10.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:18:09 smithi116 ceph-mon[21873]: pgmap v148: 129 pgs: 129 active+clean; 182 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.5 MiB/s wr, 284 op/s 2024-08-19T00:18:10.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:18:09 smithi044 ceph-mon[18489]: pgmap v148: 129 pgs: 129 active+clean; 182 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.5 MiB/s wr, 284 op/s 2024-08-19T00:18:10.674 INFO:tasks.workunit.client.0.smithi044.stdout: 1 302616 7.74 MB/sec execute 95 sec latency 29.759 ms 2024-08-19T00:18:11.581 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.577+0000 7f3047161640 1 -- 172.21.15.44:0/3401141416 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3040100700 msgr2=0x7f3040100b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:18:11.581 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.577+0000 7f3047161640 1 --2- 172.21.15.44:0/3401141416 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3040100700 0x7f3040100b60 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f302c009930 tx=0x7f302c02a420 comp rx=0 tx=0).stop 2024-08-19T00:18:11.581 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.577+0000 7f3047161640 1 -- 172.21.15.44:0/3401141416 shutdown_connections 2024-08-19T00:18:11.581 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.577+0000 7f3047161640 1 --2- 172.21.15.44:0/3401141416 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f30401010a0 0x7f304010d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:11.581 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.577+0000 7f3047161640 1 --2- 172.21.15.44:0/3401141416 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3040100700 0x7f3040100b60 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:11.581 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.577+0000 7f3047161640 1 --2- 172.21.15.44:0/3401141416 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3040106710 0x7f3040106af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:11.581 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.577+0000 7f3047161640 1 -- 172.21.15.44:0/3401141416 >> 172.21.15.44:0/3401141416 conn(0x7f30400fc420 msgr2=0x7f30400fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:18:11.581 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.577+0000 7f3047161640 1 -- 172.21.15.44:0/3401141416 shutdown_connections 2024-08-19T00:18:11.582 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.578+0000 7f3047161640 1 -- 172.21.15.44:0/3401141416 wait complete. 2024-08-19T00:18:11.582 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.578+0000 7f3047161640 1 Processor -- start 2024-08-19T00:18:11.582 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.578+0000 7f3047161640 1 -- start start 2024-08-19T00:18:11.582 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.578+0000 7f3047161640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3040100700 0x7f30400fc970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:11.582 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.578+0000 7f3047161640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f30401010a0 0x7f30400fceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:11.582 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.578+0000 7f3047161640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3040106710 0x7f30400fd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:11.582 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.578+0000 7f3047161640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3040110ba0 con 0x7f3040106710 2024-08-19T00:18:11.582 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.578+0000 7f3047161640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f3040110a20 con 0x7f3040100700 2024-08-19T00:18:11.582 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.578+0000 7f3047161640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f3040110d20 con 0x7f30401010a0 2024-08-19T00:18:11.582 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.578+0000 7f30456fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3040106710 0x7f30400fd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:11.582 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.579+0000 7f3044efd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3040100700 0x7f30400fc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:11.583 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.579+0000 7f303ffff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f30401010a0 0x7f30400fceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:11.583 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.579+0000 7f3044efd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3040100700 0x7f30400fc970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.44:39716/0 (socket says 172.21.15.44:39716) 2024-08-19T00:18:11.583 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.579+0000 7f303ffff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f30401010a0 0x7f30400fceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.44:32840/0 (socket says 172.21.15.44:32840) 2024-08-19T00:18:11.583 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.579+0000 7f30456fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3040106710 0x7f30400fd3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54174/0 (socket says 172.21.15.44:54174) 2024-08-19T00:18:11.583 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.579+0000 7f3044efd640 1 -- 172.21.15.44:0/955909947 learned_addr learned my addr 172.21.15.44:0/955909947 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:18:11.583 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.579+0000 7f3044efd640 1 -- 172.21.15.44:0/955909947 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f30401010a0 msgr2=0x7f30400fceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:18:11.583 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.579+0000 7f3044efd640 1 --2- 172.21.15.44:0/955909947 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f30401010a0 0x7f30400fceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:11.583 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.579+0000 7f3044efd640 1 -- 172.21.15.44:0/955909947 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3040106710 msgr2=0x7f30400fd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:18:11.583 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.579+0000 7f3044efd640 1 --2- 172.21.15.44:0/955909947 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3040106710 0x7f30400fd3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:11.583 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.579+0000 7f3044efd640 1 -- 172.21.15.44:0/955909947 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30401a65a0 con 0x7f3040100700 2024-08-19T00:18:11.583 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.579+0000 7f3044efd640 1 --2- 172.21.15.44:0/955909947 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3040100700 0x7f30400fc970 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f303400e9f0 tx=0x7f303400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:18:11.583 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.579+0000 7f303dffb640 1 -- 172.21.15.44:0/955909947 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f303400cd80 con 0x7f3040100700 2024-08-19T00:18:11.583 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.579+0000 7f303dffb640 1 -- 172.21.15.44:0/955909947 <== mon.2 v2:172.21.15.116:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3034010910 con 0x7f3040100700 2024-08-19T00:18:11.584 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.579+0000 7f3047161640 1 -- 172.21.15.44:0/955909947 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30401a6890 con 0x7f3040100700 2024-08-19T00:18:11.584 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.579+0000 7f303dffb640 1 -- 172.21.15.44:0/955909947 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3034018990 con 0x7f3040100700 2024-08-19T00:18:11.584 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.580+0000 7f3047161640 1 -- 172.21.15.44:0/955909947 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30401a6db0 con 0x7f3040100700 2024-08-19T00:18:11.590 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.582+0000 7f303dffb640 1 -- 172.21.15.44:0/955909947 <== mon.2 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f3034010ac0 con 0x7f3040100700 2024-08-19T00:18:11.590 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.582+0000 7f3049ffe740 1 Processor -- start 2024-08-19T00:18:11.590 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.582+0000 7f3049ffe740 1 -- start start 2024-08-19T00:18:11.591 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.582+0000 7f3049ffe740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f08fbb17d0 0x55f08fbb1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:11.591 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.582+0000 7f3049ffe740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f08fbb20f0 0x55f08fbbc450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:11.591 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.582+0000 7f3049ffe740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f08fbbc990 0x55f08fbbed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:11.591 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.582+0000 7f3049ffe740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55f08fb159d0 con 0x55f08fbbc990 2024-08-19T00:18:11.591 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.582+0000 7f3049ffe740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55f08fabd820 con 0x55f08fbb20f0 2024-08-19T00:18:11.591 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.582+0000 7f3049ffe740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55f08fb11990 con 0x55f08fbb17d0 2024-08-19T00:18:11.591 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.582+0000 7f3044efd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f08fbb20f0 0x55f08fbbc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:11.591 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.582+0000 7f30456fe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f08fbb17d0 0x55f08fbb1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:11.591 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.582+0000 7f30456fe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f08fbb17d0 0x55f08fbb1bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.44:32844/0 (socket says 172.21.15.44:32844) 2024-08-19T00:18:11.591 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.583+0000 7f30456fe640 1 -- 172.21.15.44:0/2848931152 learned_addr learned my addr 172.21.15.44:0/2848931152 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:18:11.591 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.582+0000 7f3044efd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f08fbb20f0 0x55f08fbbc450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.44:39720/0 (socket says 172.21.15.44:39720) 2024-08-19T00:18:11.591 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.582+0000 7f303ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f08fbbc990 0x55f08fbbed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:11.592 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.583+0000 7f303dffb640 1 --2- 172.21.15.44:0/955909947 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f30300a2da0 0x7f30300a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:11.592 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.583+0000 7f30456fe640 1 -- 172.21.15.44:0/2848931152 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f08fbb20f0 msgr2=0x55f08fbbc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:18:11.592 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.583+0000 7f30456fe640 1 --2- 172.21.15.44:0/2848931152 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f08fbb20f0 0x55f08fbbc450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:11.592 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.583+0000 7f30456fe640 1 -- 172.21.15.44:0/2848931152 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f08fbbc990 msgr2=0x55f08fbbed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:18:11.592 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.583+0000 7f30456fe640 1 --2- 172.21.15.44:0/2848931152 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f08fbbc990 0x55f08fbbed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:11.592 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.583+0000 7f30456fe640 1 -- 172.21.15.44:0/2848931152 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f08f829210 con 0x55f08fbb17d0 2024-08-19T00:18:11.592 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.583+0000 7f3044efd640 1 --2- 172.21.15.44:0/2848931152 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f08fbb20f0 0x55f08fbbc450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:18:11.592 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.583+0000 7f303dffb640 1 -- 172.21.15.44:0/955909947 <== mon.2 v2:172.21.15.116:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f30340cfa80 con 0x7f3040100700 2024-08-19T00:18:11.592 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.583+0000 7f30456fe640 1 --2- 172.21.15.44:0/955909947 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f30300a2da0 0x7f30300a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:11.592 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.583+0000 7f30456fe640 1 --2- 172.21.15.44:0/2848931152 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f08fbb17d0 0x55f08fbb1bb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3038011590 tx=0x7f3038011a50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de15a8a3c7921fb3 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:18:11.592 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.583+0000 7f302affd640 1 -- 172.21.15.44:0/2848931152 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3038017050 con 0x55f08fbb17d0 2024-08-19T00:18:11.592 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.583+0000 7f30456fe640 1 --2- 172.21.15.44:0/955909947 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f30300a2da0 0x7f30300a5260 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3038022000 tx=0x7f3038023000 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:18:11.593 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.583+0000 7f302affd640 1 -- 172.21.15.44:0/2848931152 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f303800fde0 con 0x55f08fbb17d0 2024-08-19T00:18:11.593 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.583+0000 7f302affd640 1 -- 172.21.15.44:0/2848931152 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f303801bba0 con 0x55f08fbb17d0 2024-08-19T00:18:11.593 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.584+0000 7f3049ffe740 1 -- 172.21.15.44:0/2848931152 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f08fbb17d0 msgr2=0x55f08fbb1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:18:11.593 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.584+0000 7f3049ffe740 1 --2- 172.21.15.44:0/2848931152 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f08fbb17d0 0x55f08fbb1bb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3038011590 tx=0x7f3038011a50 comp rx=0 tx=0).stop 2024-08-19T00:18:11.593 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.584+0000 7f3049ffe740 1 -- 172.21.15.44:0/2848931152 shutdown_connections 2024-08-19T00:18:11.593 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.584+0000 7f3049ffe740 1 --2- 172.21.15.44:0/2848931152 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f08fbbc990 0x55f08fbbed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:11.593 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.584+0000 7f3049ffe740 1 --2- 172.21.15.44:0/2848931152 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f08fbb20f0 0x55f08fbbc450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:11.593 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.584+0000 7f3049ffe740 1 --2- 172.21.15.44:0/2848931152 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f08fbb17d0 0x55f08fbb1bb0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:11.593 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.584+0000 7f3049ffe740 1 -- 172.21.15.44:0/2848931152 >> 172.21.15.44:0/2848931152 conn(0x55f08fbadd40 msgr2=0x55f08fbae120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:18:11.593 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.584+0000 7f3049ffe740 1 -- 172.21.15.44:0/2848931152 shutdown_connections 2024-08-19T00:18:11.593 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.584+0000 7f3049ffe740 1 -- 172.21.15.44:0/2848931152 wait complete. 2024-08-19T00:18:11.593 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.584+0000 7f3049ffe740 1 -- start start 2024-08-19T00:18:11.593 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.584+0000 7f3049ffe740 1 Processor -- start 2024-08-19T00:18:11.593 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.585+0000 7f3049ffe740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f08fbb17d0 0x55f08fbb98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:11.594 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.585+0000 7f3049ffe740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f08fbb20f0 0x55f08fbb9de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:11.594 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.585+0000 7f3049ffe740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f08fbbc990 0x55f08fbba320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:11.594 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.585+0000 7f3049ffe740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55f08fbbf560 con 0x55f08fbbc990 2024-08-19T00:18:11.594 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.585+0000 7f3049ffe740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55f08fad1520 con 0x55f08fbb17d0 2024-08-19T00:18:11.594 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.585+0000 7f3049ffe740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55f08fbbf6e0 con 0x55f08fbb20f0 2024-08-19T00:18:11.594 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.585+0000 7f3049ffe740 10 client.0 _ll_register_callbacks cb 0x55f08f828a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:18:11.594 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.585+0000 7f30456fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f08fbbc990 0x55f08fbba320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:11.594 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.585+0000 7f30456fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f08fbbc990 0x55f08fbba320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54198/0 (socket says 172.21.15.44:54198) 2024-08-19T00:18:11.594 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.585+0000 7f3044efd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f08fbb17d0 0x55f08fbb98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:11.594 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.585+0000 7f30456fe640 1 -- 172.21.15.44:0/3761556441 learned_addr learned my addr 172.21.15.44:0/3761556441 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:18:11.594 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.585+0000 7f303ffff640 1 --2- 172.21.15.44:0/3761556441 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f08fbb20f0 0x55f08fbb9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:11.594 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.585+0000 7f3044efd640 1 -- 172.21.15.44:0/3761556441 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f08fbb20f0 msgr2=0x55f08fbb9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:18:11.595 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.585+0000 7f3044efd640 1 --2- 172.21.15.44:0/3761556441 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f08fbb20f0 0x55f08fbb9de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:11.595 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.585+0000 7f3044efd640 1 -- 172.21.15.44:0/3761556441 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f08fbbc990 msgr2=0x55f08fbba320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:18:11.595 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.585+0000 7f3044efd640 1 --2- 172.21.15.44:0/3761556441 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f08fbbc990 0x55f08fbba320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:11.595 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.585+0000 7f3044efd640 1 -- 172.21.15.44:0/3761556441 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f08f8f5620 con 0x55f08fbb17d0 2024-08-19T00:18:11.595 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.586+0000 7f3044efd640 1 --2- 172.21.15.44:0/3761556441 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f08fbb17d0 0x55f08fbb98a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f30340cce30 tx=0x7f3034009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c550457f9cc7b03d server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:18:11.595 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.586+0000 7f301ffff640 10 client.0 ms_handle_connect on v2:172.21.15.116:3300/0 2024-08-19T00:18:11.595 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.586+0000 7f301ffff640 1 -- 172.21.15.44:0/3761556441 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30340d7040 con 0x55f08fbb17d0 2024-08-19T00:18:11.595 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.586+0000 7f301ffff640 1 -- 172.21.15.44:0/3761556441 <== mon.2 v2:172.21.15.116:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f3034097a00 con 0x55f08fbb17d0 2024-08-19T00:18:11.595 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.586+0000 7f3049ffe740 1 -- 172.21.15.44:0/3761556441 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f303800fde0 con 0x55f08fbb17d0 2024-08-19T00:18:11.595 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.586+0000 7f301ffff640 1 -- 172.21.15.44:0/3761556441 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f303409b7f0 con 0x55f08fbb17d0 2024-08-19T00:18:11.595 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.586+0000 7f3049ffe740 10 client.25613 fetch_fsmap learned FSMap version 33 2024-08-19T00:18:11.595 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.586+0000 7f3049ffe740 1 -- 172.21.15.44:0/3761556441 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55f08fbcb230 con 0x55f08fbb17d0 2024-08-19T00:18:11.595 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.586+0000 7f301ffff640 1 -- 172.21.15.44:0/3761556441 <== mon.2 v2:172.21.15.116:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f303800fde0 con 0x55f08fbb17d0 2024-08-19T00:18:11.596 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.586+0000 7f301ffff640 1 -- 172.21.15.44:0/3761556441 <== mon.2 v2:172.21.15.116:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f3034018b30 con 0x55f08fbb17d0 2024-08-19T00:18:11.596 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.586+0000 7f3049ffe740 10 client.25613 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:18:11.596 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.586+0000 7f3049ffe740 10 client.25613 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:18:11.596 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.586+0000 7f3049ffe740 20 client.25613 populate_metadata read hostname 'smithi044' 2024-08-19T00:18:11.596 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.586+0000 7f3049ffe740 1 --2- 172.21.15.44:0/3761556441 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55f08fbcc690 0x55f08fbceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:11.596 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.586+0000 7f3049ffe740 4 client.25613 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:18:11.596 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.586+0000 7f3049ffe740 1 -- 172.21.15.44:0/3761556441 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f08fb23100 con 0x55f08fbcc690 2024-08-19T00:18:11.596 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.587+0000 7f303ffff640 1 --2- 172.21.15.44:0/3761556441 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55f08fbcc690 0x55f08fbceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:11.596 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.587+0000 7f303ffff640 1 --2- 172.21.15.44:0/3761556441 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55f08fbcc690 0x55f08fbceaa0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ede302f3ee2adf5 server_cookie=9234cc1d47b87a8b in_seq=0 out_seq=0 2024-08-19T00:18:11.596 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.587+0000 7f301ffff640 10 client.25613 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:18:11.596 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.588+0000 7f301ffff640 1 -- 172.21.15.44:0/3761556441 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f08fb23100 con 0x55f08fbcc690 2024-08-19T00:18:11.596 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.588+0000 7f301ffff640 10 client.25613 handle_command_reply: tid=0 2024-08-19T00:18:11.596 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.588+0000 7f3049ffe740 1 client.25613 shutdown 2024-08-19T00:18:11.597 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.588+0000 7f3049ffe740 1 -- 172.21.15.44:0/3761556441 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f08fbb17d0 msgr2=0x55f08fbb98a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:18:11.597 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.588+0000 7f3049ffe740 1 --2- 172.21.15.44:0/3761556441 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f08fbb17d0 0x55f08fbb98a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f30340cce30 tx=0x7f3034009310 comp rx=0 tx=0).stop 2024-08-19T00:18:11.597 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.588+0000 7f3049ffe740 1 -- 172.21.15.44:0/3761556441 shutdown_connections 2024-08-19T00:18:11.597 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.588+0000 7f3049ffe740 1 --2- 172.21.15.44:0/3761556441 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55f08fbcc690 0x55f08fbceaa0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:11.597 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.588+0000 7f3049ffe740 1 --2- 172.21.15.44:0/3761556441 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f08fbb20f0 0x55f08fbb9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:11.597 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.588+0000 7f3049ffe740 1 --2- 172.21.15.44:0/3761556441 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f08fbbc990 0x55f08fbba320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:11.597 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.588+0000 7f301ffff640 0 client.25613 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:18:11.597 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.588+0000 7f3049ffe740 1 --2- 172.21.15.44:0/3761556441 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f08fbb17d0 0x55f08fbb98a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:11.597 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.588+0000 7f3049ffe740 1 -- 172.21.15.44:0/3761556441 >> 172.21.15.44:0/3761556441 conn(0x55f08fbadd40 msgr2=0x55f08fbb3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:18:11.597 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.588+0000 7f3049ffe740 1 -- 172.21.15.44:0/3761556441 shutdown_connections 2024-08-19T00:18:11.597 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.588+0000 7f3049ffe740 1 -- 172.21.15.44:0/3761556441 wait complete. 2024-08-19T00:18:11.597 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.588+0000 7f3049ffe740 20 client.25613 trim_cache size 0 max 16384 2024-08-19T00:18:11.609 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.607+0000 7f3049ffe740 1 Processor -- start 2024-08-19T00:18:11.609 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.608+0000 7f3049ffe740 1 -- start start 2024-08-19T00:18:11.609 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.608+0000 7f3049ffe740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f08fbb17d0 0x55f08fbad7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:11.609 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.608+0000 7f3049ffe740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f08fbb20f0 0x55f08fbb3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:11.610 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.608+0000 7f3049ffe740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f08fbbc990 0x55f08fbd4400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:11.610 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.608+0000 7f3049ffe740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f30401b0ea0 con 0x55f08fbb17d0 2024-08-19T00:18:11.610 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.608+0000 7f3049ffe740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f30401b29e0 con 0x55f08fbb20f0 2024-08-19T00:18:11.610 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.608+0000 7f3049ffe740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f30401b1570 con 0x55f08fbbc990 2024-08-19T00:18:11.610 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.608+0000 7f3044efd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f08fbb17d0 0x55f08fbad7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:11.610 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.608+0000 7f30456fe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f08fbbc990 0x55f08fbd4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:11.610 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.608+0000 7f3044efd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f08fbb17d0 0x55f08fbad7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54204/0 (socket says 172.21.15.44:54204) 2024-08-19T00:18:11.610 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.608+0000 7f3044efd640 1 -- 172.21.15.44:0/622322579 learned_addr learned my addr 172.21.15.44:0/622322579 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:18:11.610 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.608+0000 7f303ffff640 1 --2- 172.21.15.44:0/622322579 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f08fbb20f0 0x55f08fbb3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:11.611 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.608+0000 7f3044efd640 1 -- 172.21.15.44:0/622322579 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f08fbbc990 msgr2=0x55f08fbd4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:18:11.611 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.608+0000 7f3044efd640 1 --2- 172.21.15.44:0/622322579 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f08fbbc990 0x55f08fbd4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:11.611 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.608+0000 7f3044efd640 1 -- 172.21.15.44:0/622322579 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f08fbb20f0 msgr2=0x55f08fbb3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:18:11.611 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.608+0000 7f3044efd640 1 --2- 172.21.15.44:0/622322579 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f08fbb20f0 0x55f08fbb3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:11.611 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.608+0000 7f3044efd640 1 -- 172.21.15.44:0/622322579 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f08fba8f90 con 0x55f08fbb17d0 2024-08-19T00:18:11.611 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.609+0000 7f3044efd640 1 --2- 172.21.15.44:0/622322579 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f08fbb17d0 0x55f08fbad7e0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f303400c6a0 tx=0x7f303409bb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=109021b00ae71f84 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:18:11.611 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.609+0000 7f302a7fc640 1 -- 172.21.15.44:0/622322579 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30340b8020 con 0x55f08fbb17d0 2024-08-19T00:18:11.611 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.609+0000 7f302a7fc640 1 -- 172.21.15.44:0/622322579 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f303409bcb0 con 0x55f08fbb17d0 2024-08-19T00:18:11.611 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.609+0000 7f302a7fc640 1 -- 172.21.15.44:0/622322579 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f303409b610 con 0x55f08fbb17d0 2024-08-19T00:18:11.613 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.610+0000 7f3049ffe740 1 -- 172.21.15.44:0/622322579 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f08fbb17d0 msgr2=0x55f08fbad7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:18:11.613 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.610+0000 7f3049ffe740 1 --2- 172.21.15.44:0/622322579 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f08fbb17d0 0x55f08fbad7e0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f303400c6a0 tx=0x7f303409bb40 comp rx=0 tx=0).stop 2024-08-19T00:18:11.613 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.610+0000 7f3049ffe740 1 -- 172.21.15.44:0/622322579 shutdown_connections 2024-08-19T00:18:11.614 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.610+0000 7f3049ffe740 1 --2- 172.21.15.44:0/622322579 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f08fbbc990 0x55f08fbd4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:11.614 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.610+0000 7f3049ffe740 1 --2- 172.21.15.44:0/622322579 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f08fbb20f0 0x55f08fbb3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:11.614 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.610+0000 7f3049ffe740 1 --2- 172.21.15.44:0/622322579 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f08fbb17d0 0x55f08fbad7e0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:11.614 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.610+0000 7f3049ffe740 1 -- 172.21.15.44:0/622322579 >> 172.21.15.44:0/622322579 conn(0x55f08fbadd40 msgr2=0x55f08fbb3230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:18:11.614 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.610+0000 7f3049ffe740 1 -- 172.21.15.44:0/622322579 shutdown_connections 2024-08-19T00:18:11.614 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.610+0000 7f3049ffe740 1 -- 172.21.15.44:0/622322579 wait complete. 2024-08-19T00:18:11.614 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.611+0000 7f3049ffe740 1 -- start start 2024-08-19T00:18:11.614 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.611+0000 7f3049ffe740 1 Processor -- start 2024-08-19T00:18:11.614 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.611+0000 7f3049ffe740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f08fbb17d0 0x55f08fbc0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:11.614 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.611+0000 7f3049ffe740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f08fbb20f0 0x55f08fbc1380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:11.614 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.611+0000 7f3049ffe740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f08fbbc990 0x55f08fc3ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:11.614 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.611+0000 7f3049ffe740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f30401b2310 con 0x55f08fbbc990 2024-08-19T00:18:11.614 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.611+0000 7f3049ffe740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f30401b1c40 con 0x55f08fbb20f0 2024-08-19T00:18:11.615 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.611+0000 7f3049ffe740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f30401aee80 con 0x55f08fbb17d0 2024-08-19T00:18:11.615 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.612+0000 7f3044efd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f08fbb17d0 0x55f08fbc0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:11.615 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.612+0000 7f30456fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f08fbbc990 0x55f08fc3ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:11.615 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.612+0000 7f3044efd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f08fbb17d0 0x55f08fbc0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.44:32868/0 (socket says 172.21.15.44:32868) 2024-08-19T00:18:11.615 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.612+0000 7f3044efd640 1 -- 172.21.15.44:0/4277078406 learned_addr learned my addr 172.21.15.44:0/4277078406 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:18:11.615 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.612+0000 7f3049ffe740 10 client.0 _ll_register_callbacks cb 0x7f303400e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:18:11.615 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.612+0000 7f303ffff640 1 --2- 172.21.15.44:0/4277078406 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f08fbb20f0 0x55f08fbc1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:11.615 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.612+0000 7f3044efd640 1 -- 172.21.15.44:0/4277078406 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f08fbb20f0 msgr2=0x55f08fbc1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:18:11.615 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.612+0000 7f3044efd640 1 --2- 172.21.15.44:0/4277078406 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f08fbb20f0 0x55f08fbc1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:11.615 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.612+0000 7f3044efd640 1 -- 172.21.15.44:0/4277078406 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f08fbbc990 msgr2=0x55f08fc3ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:18:11.615 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.612+0000 7f3044efd640 1 --2- 172.21.15.44:0/4277078406 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f08fbbc990 0x55f08fc3ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:11.615 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.612+0000 7f3044efd640 1 -- 172.21.15.44:0/4277078406 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f08fc3f150 con 0x55f08fbb17d0 2024-08-19T00:18:11.615 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.612+0000 7f3044efd640 1 --2- 172.21.15.44:0/4277078406 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f08fbb17d0 0x55f08fbc0e40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f30340cd430 tx=0x7f3034018f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=490e09514cd475f2 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:18:11.615 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.612+0000 7f301ffff640 10 client.0 ms_handle_connect on v2:172.21.15.171:3300/0 2024-08-19T00:18:11.617 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.612+0000 7f301ffff640 1 -- 172.21.15.44:0/4277078406 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30340ac060 con 0x55f08fbb17d0 2024-08-19T00:18:11.617 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.613+0000 7f301ffff640 1 -- 172.21.15.44:0/4277078406 <== mon.1 v2:172.21.15.171:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f303409b360 con 0x55f08fbb17d0 2024-08-19T00:18:11.617 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.613+0000 7f3049ffe740 1 -- 172.21.15.44:0/4277078406 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f303409bcb0 con 0x55f08fbb17d0 2024-08-19T00:18:11.617 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.613+0000 7f301ffff640 1 -- 172.21.15.44:0/4277078406 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f30340b8050 con 0x55f08fbb17d0 2024-08-19T00:18:11.617 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.613+0000 7f3049ffe740 10 client.25477 fetch_fsmap learned FSMap version 33 2024-08-19T00:18:11.617 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.613+0000 7f3049ffe740 1 -- 172.21.15.44:0/4277078406 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55f08fc40440 con 0x55f08fbb17d0 2024-08-19T00:18:11.617 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.614+0000 7f301ffff640 1 -- 172.21.15.44:0/4277078406 <== mon.1 v2:172.21.15.171:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f303409bcb0 con 0x55f08fbb17d0 2024-08-19T00:18:11.617 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.614+0000 7f301ffff640 1 -- 172.21.15.44:0/4277078406 <== mon.1 v2:172.21.15.171:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f30340ba3e0 con 0x55f08fbb17d0 2024-08-19T00:18:11.617 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.614+0000 7f3049ffe740 10 client.25477 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:18:11.617 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.614+0000 7f3049ffe740 10 client.25477 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:18:11.617 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.614+0000 7f3049ffe740 20 client.25477 populate_metadata read hostname 'smithi044' 2024-08-19T00:18:11.618 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.614+0000 7f3049ffe740 1 --2- 172.21.15.44:0/4277078406 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55f08fc40820 0x55f08fc42c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:11.618 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.614+0000 7f3049ffe740 4 client.25477 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-19T00:18:11.618 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.614+0000 7f3049ffe740 1 -- 172.21.15.44:0/4277078406 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f08fb1d450 con 0x55f08fc40820 2024-08-19T00:18:11.618 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.614+0000 7f303ffff640 1 --2- 172.21.15.44:0/4277078406 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55f08fc40820 0x55f08fc42c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:11.618 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.614+0000 7f301ffff640 10 client.25477 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:18:11.618 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.614+0000 7f303ffff640 1 --2- 172.21.15.44:0/4277078406 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55f08fc40820 0x55f08fc42c40 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6a270fb4ac8d843 server_cookie=a1f799f8055f1d04 in_seq=0 out_seq=0 2024-08-19T00:18:11.624 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.623+0000 7f301ffff640 1 -- 172.21.15.44:0/4277078406 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f08fb1d450 con 0x55f08fc40820 2024-08-19T00:18:11.625 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.623+0000 7f301ffff640 10 client.25477 handle_command_reply: tid=0 2024-08-19T00:18:11.625 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.623+0000 7f3049ffe740 1 client.25477 shutdown 2024-08-19T00:18:11.625 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.623+0000 7f3049ffe740 1 -- 172.21.15.44:0/4277078406 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f08fbb17d0 msgr2=0x55f08fbc0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:18:11.625 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.623+0000 7f3049ffe740 1 --2- 172.21.15.44:0/4277078406 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f08fbb17d0 0x55f08fbc0e40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f30340cd430 tx=0x7f3034018f90 comp rx=0 tx=0).stop 2024-08-19T00:18:11.625 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.623+0000 7f3049ffe740 1 -- 172.21.15.44:0/4277078406 shutdown_connections 2024-08-19T00:18:11.625 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.623+0000 7f3049ffe740 1 --2- 172.21.15.44:0/4277078406 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55f08fc40820 0x55f08fc42c40 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:11.625 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.623+0000 7f3049ffe740 1 --2- 172.21.15.44:0/4277078406 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f08fbbc990 0x55f08fc3ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:11.625 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.623+0000 7f301ffff640 0 client.25477 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:18:11.625 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.623+0000 7f3049ffe740 1 --2- 172.21.15.44:0/4277078406 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f08fbb20f0 0x55f08fbc1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:11.625 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.623+0000 7f3049ffe740 1 --2- 172.21.15.44:0/4277078406 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f08fbb17d0 0x55f08fbc0e40 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:11.625 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.623+0000 7f3049ffe740 1 -- 172.21.15.44:0/4277078406 >> 172.21.15.44:0/4277078406 conn(0x55f08fbadd40 msgr2=0x55f08fbb3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:18:11.625 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.623+0000 7f3049ffe740 1 -- 172.21.15.44:0/4277078406 shutdown_connections 2024-08-19T00:18:11.626 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.623+0000 7f3049ffe740 1 -- 172.21.15.44:0/4277078406 wait complete. 2024-08-19T00:18:11.626 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.623+0000 7f3049ffe740 20 client.25477 trim_cache size 0 max 16384 2024-08-19T00:18:11.626 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:{ 2024-08-19T00:18:11.626 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "message": "", 2024-08-19T00:18:11.626 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "return_code": 0 2024-08-19T00:18:11.626 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:} 2024-08-19T00:18:11.627 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.624+0000 7f3047161640 1 -- 172.21.15.44:0/955909947 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f30300a2da0 msgr2=0x7f30300a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:18:11.627 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.624+0000 7f3047161640 1 --2- 172.21.15.44:0/955909947 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f30300a2da0 0x7f30300a5260 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3038022000 tx=0x7f3038023000 comp rx=0 tx=0).stop 2024-08-19T00:18:11.627 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.624+0000 7f3047161640 1 -- 172.21.15.44:0/955909947 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3040100700 msgr2=0x7f30400fc970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:18:11.627 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.624+0000 7f3047161640 1 --2- 172.21.15.44:0/955909947 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3040100700 0x7f30400fc970 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f303400e9f0 tx=0x7f303400eeb0 comp rx=0 tx=0).stop 2024-08-19T00:18:11.627 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.624+0000 7f3047161640 1 -- 172.21.15.44:0/955909947 shutdown_connections 2024-08-19T00:18:11.627 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.624+0000 7f3047161640 1 --2- 172.21.15.44:0/955909947 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f30300a2da0 0x7f30300a5260 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:11.628 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.624+0000 7f3047161640 1 --2- 172.21.15.44:0/955909947 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f30401010a0 0x7f30400fceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:11.628 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.624+0000 7f3047161640 1 --2- 172.21.15.44:0/955909947 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3040106710 0x7f30400fd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:11.628 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.624+0000 7f3047161640 1 --2- 172.21.15.44:0/955909947 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3040100700 0x7f30400fc970 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:11.628 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.624+0000 7f3047161640 1 -- 172.21.15.44:0/955909947 >> 172.21.15.44:0/955909947 conn(0x7f30400fc420 msgr2=0x7f304006a230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:18:11.628 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.624+0000 7f3047161640 1 -- 172.21.15.44:0/955909947 shutdown_connections 2024-08-19T00:18:11.628 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:11.624+0000 7f3047161640 1 -- 172.21.15.44:0/955909947 wait complete. 2024-08-19T00:18:11.674 INFO:tasks.workunit.client.0.smithi044.stdout: 1 305059 7.82 MB/sec execute 96 sec latency 36.999 ms 2024-08-19T00:18:12.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:18:11 smithi171 ceph-mon[21810]: pgmap v149: 129 pgs: 129 active+clean; 189 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 5.3 MiB/s wr, 406 op/s 2024-08-19T00:18:12.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:18:11 smithi116 ceph-mon[21873]: pgmap v149: 129 pgs: 129 active+clean; 189 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 5.3 MiB/s wr, 406 op/s 2024-08-19T00:18:12.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:18:11 smithi044 ceph-mon[18489]: pgmap v149: 129 pgs: 129 active+clean; 189 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 5.3 MiB/s wr, 406 op/s 2024-08-19T00:18:12.674 INFO:tasks.workunit.client.0.smithi044.stdout: 1 306714 7.81 MB/sec execute 97 sec latency 19.999 ms 2024-08-19T00:18:13.674 INFO:tasks.workunit.client.0.smithi044.stdout: 1 309147 7.87 MB/sec execute 98 sec latency 15.109 ms 2024-08-19T00:18:14.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:18:13 smithi171 ceph-mon[21810]: pgmap v150: 129 pgs: 129 active+clean; 189 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.5 MiB/s wr, 273 op/s 2024-08-19T00:18:14.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:18:13 smithi116 ceph-mon[21873]: pgmap v150: 129 pgs: 129 active+clean; 189 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.5 MiB/s wr, 273 op/s 2024-08-19T00:18:14.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:18:13 smithi044 ceph-mon[18489]: pgmap v150: 129 pgs: 129 active+clean; 189 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.5 MiB/s wr, 273 op/s 2024-08-19T00:18:14.674 INFO:tasks.workunit.client.0.smithi044.stdout: 1 311209 7.87 MB/sec execute 99 sec latency 53.239 ms 2024-08-19T00:18:15.674 INFO:tasks.workunit.client.0.smithi044.stdout: 1 313158 7.91 MB/sec execute 100 sec latency 52.122 ms 2024-08-19T00:18:16.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:18:15 smithi171 ceph-mon[21810]: pgmap v151: 129 pgs: 129 active+clean; 196 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.2 MiB/s wr, 393 op/s 2024-08-19T00:18:16.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:18:15 smithi116 ceph-mon[21873]: pgmap v151: 129 pgs: 129 active+clean; 196 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.2 MiB/s wr, 393 op/s 2024-08-19T00:18:16.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:18:15 smithi044 ceph-mon[18489]: pgmap v151: 129 pgs: 129 active+clean; 196 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.2 MiB/s wr, 393 op/s 2024-08-19T00:18:16.674 INFO:tasks.workunit.client.0.smithi044.stdout: 1 315149 7.95 MB/sec execute 101 sec latency 50.137 ms 2024-08-19T00:18:17.675 INFO:tasks.workunit.client.0.smithi044.stdout: 1 317129 7.99 MB/sec execute 102 sec latency 16.782 ms 2024-08-19T00:18:18.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:18:17 smithi171 ceph-mon[21810]: pgmap v152: 129 pgs: 129 active+clean; 196 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.5 MiB/s wr, 242 op/s 2024-08-19T00:18:18.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:18:17 smithi116 ceph-mon[21873]: pgmap v152: 129 pgs: 129 active+clean; 196 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.5 MiB/s wr, 242 op/s 2024-08-19T00:18:18.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:18:17 smithi044 ceph-mon[18489]: pgmap v152: 129 pgs: 129 active+clean; 196 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.5 MiB/s wr, 242 op/s 2024-08-19T00:18:18.675 INFO:tasks.workunit.client.0.smithi044.stdout: 1 319634 8.05 MB/sec execute 103 sec latency 13.632 ms 2024-08-19T00:18:19.675 INFO:tasks.workunit.client.0.smithi044.stdout: 1 321636 8.04 MB/sec execute 104 sec latency 24.177 ms 2024-08-19T00:18:20.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:18:19 smithi171 ceph-mon[21810]: pgmap v153: 129 pgs: 129 active+clean; 196 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.5 MiB/s wr, 242 op/s 2024-08-19T00:18:20.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:18:19 smithi116 ceph-mon[21873]: pgmap v153: 129 pgs: 129 active+clean; 196 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.5 MiB/s wr, 242 op/s 2024-08-19T00:18:20.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:18:19 smithi044 ceph-mon[18489]: pgmap v153: 129 pgs: 129 active+clean; 196 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.5 MiB/s wr, 242 op/s 2024-08-19T00:18:20.675 INFO:tasks.workunit.client.0.smithi044.stdout: 1 323678 8.08 MB/sec execute 105 sec latency 16.159 ms 2024-08-19T00:18:21.675 INFO:tasks.workunit.client.0.smithi044.stdout: 1 325788 8.12 MB/sec execute 106 sec latency 84.491 ms 2024-08-19T00:18:22.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:18:21 smithi171 ceph-mon[21810]: pgmap v154: 129 pgs: 129 active+clean; 202 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.2 MiB/s wr, 358 op/s 2024-08-19T00:18:22.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:18:21 smithi116 ceph-mon[21873]: pgmap v154: 129 pgs: 129 active+clean; 202 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.2 MiB/s wr, 358 op/s 2024-08-19T00:18:22.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:18:21 smithi044 ceph-mon[18489]: pgmap v154: 129 pgs: 129 active+clean; 202 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.2 MiB/s wr, 358 op/s 2024-08-19T00:18:22.675 INFO:tasks.workunit.client.0.smithi044.stdout: 1 327843 8.15 MB/sec execute 107 sec latency 12.565 ms 2024-08-19T00:18:23.675 INFO:tasks.workunit.client.0.smithi044.stdout: 1 330331 8.20 MB/sec execute 108 sec latency 13.632 ms 2024-08-19T00:18:24.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:18:23 smithi171 ceph-mon[21810]: pgmap v155: 129 pgs: 129 active+clean; 202 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.5 MiB/s wr, 235 op/s 2024-08-19T00:18:24.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:18:23 smithi116 ceph-mon[21873]: pgmap v155: 129 pgs: 129 active+clean; 202 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.5 MiB/s wr, 235 op/s 2024-08-19T00:18:24.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:18:23 smithi044 ceph-mon[18489]: pgmap v155: 129 pgs: 129 active+clean; 202 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.5 MiB/s wr, 235 op/s 2024-08-19T00:18:24.675 INFO:tasks.workunit.client.0.smithi044.stdout: 1 332462 8.20 MB/sec execute 109 sec latency 21.742 ms 2024-08-19T00:18:24.720 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.717+0000 7fb0ff41e640 1 -- 172.21.15.44:0/125303927 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0f81029c0 msgr2=0x7fb0f8102da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:18:24.720 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.717+0000 7fb0ff41e640 1 --2- 172.21.15.44:0/125303927 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0f81029c0 0x7fb0f8102da0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4009900 tx=0x7fb0f402a480 comp rx=0 tx=0).stop 2024-08-19T00:18:24.720 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.717+0000 7fb0ff41e640 1 -- 172.21.15.44:0/125303927 shutdown_connections 2024-08-19T00:18:24.720 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.717+0000 7fb0ff41e640 1 --2- 172.21.15.44:0/125303927 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb0f81032e0 0x7fb0f810b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:24.721 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.717+0000 7fb0ff41e640 1 --2- 172.21.15.44:0/125303927 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb0f810be10 0x7fb0f810e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:24.721 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.717+0000 7fb0ff41e640 1 --2- 172.21.15.44:0/125303927 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0f81029c0 0x7fb0f8102da0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:24.721 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.717+0000 7fb0ff41e640 1 -- 172.21.15.44:0/125303927 >> 172.21.15.44:0/125303927 conn(0x7fb0f80fc430 msgr2=0x7fb0f80fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:18:24.721 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.717+0000 7fb0ff41e640 1 -- 172.21.15.44:0/125303927 shutdown_connections 2024-08-19T00:18:24.721 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.717+0000 7fb0ff41e640 1 -- 172.21.15.44:0/125303927 wait complete. 2024-08-19T00:18:24.721 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.717+0000 7fb0ff41e640 1 Processor -- start 2024-08-19T00:18:24.721 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.718+0000 7fb0ff41e640 1 -- start start 2024-08-19T00:18:24.721 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.718+0000 7fb0ff41e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb0f81029c0 0x7fb0f8100610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:24.721 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.718+0000 7fb0ff41e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0f81032e0 0x7fb0f8100b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:24.721 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.718+0000 7fb0ff41e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb0f810be10 0x7fb0f8101090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:24.721 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.718+0000 7fb0ff41e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb0f8111bf0 con 0x7fb0f81032e0 2024-08-19T00:18:24.721 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.718+0000 7fb0ff41e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fb0f8111a70 con 0x7fb0f810be10 2024-08-19T00:18:24.722 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.718+0000 7fb0ff41e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb0f8111d70 con 0x7fb0f81029c0 2024-08-19T00:18:24.722 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.718+0000 7fb0fc9b9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0f81032e0 0x7fb0f8100b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:24.722 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.718+0000 7fb0fd1ba640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb0f81029c0 0x7fb0f8100610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:24.722 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.718+0000 7fb0fc9b9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0f81032e0 0x7fb0f8100b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47780/0 (socket says 172.21.15.44:47780) 2024-08-19T00:18:24.722 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.718+0000 7fb0fc9b9640 1 -- 172.21.15.44:0/2910079390 learned_addr learned my addr 172.21.15.44:0/2910079390 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:18:24.722 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.718+0000 7fb0fd9bb640 1 --2- 172.21.15.44:0/2910079390 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb0f810be10 0x7fb0f8101090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:24.722 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.718+0000 7fb0fc9b9640 1 -- 172.21.15.44:0/2910079390 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb0f81029c0 msgr2=0x7fb0f8100610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:18:24.722 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.718+0000 7fb0fc9b9640 1 --2- 172.21.15.44:0/2910079390 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb0f81029c0 0x7fb0f8100610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:24.722 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.718+0000 7fb0fc9b9640 1 -- 172.21.15.44:0/2910079390 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb0f810be10 msgr2=0x7fb0f8101090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:18:24.722 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.718+0000 7fb0fc9b9640 1 --2- 172.21.15.44:0/2910079390 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb0f810be10 0x7fb0f8101090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:24.722 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.718+0000 7fb0fc9b9640 1 -- 172.21.15.44:0/2910079390 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0f81a65e0 con 0x7fb0f81032e0 2024-08-19T00:18:24.722 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.718+0000 7fb0fc9b9640 1 --2- 172.21.15.44:0/2910079390 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0f81032e0 0x7fb0f8100b50 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fb0e800e9f0 tx=0x7fb0e800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:18:24.723 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.718+0000 7fb0ee7fc640 1 -- 172.21.15.44:0/2910079390 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0e800ccc0 con 0x7fb0f81032e0 2024-08-19T00:18:24.723 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.718+0000 7fb0ee7fc640 1 -- 172.21.15.44:0/2910079390 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0e800ce60 con 0x7fb0f81032e0 2024-08-19T00:18:24.723 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.718+0000 7fb0ee7fc640 1 -- 172.21.15.44:0/2910079390 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0e8010690 con 0x7fb0f81032e0 2024-08-19T00:18:24.723 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.718+0000 7fb0ff41e640 1 -- 172.21.15.44:0/2910079390 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0f81a68d0 con 0x7fb0f81032e0 2024-08-19T00:18:24.723 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.719+0000 7fb0ff41e640 1 -- 172.21.15.44:0/2910079390 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0f81a6e20 con 0x7fb0f81032e0 2024-08-19T00:18:24.727 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.721+0000 7fb0ee7fc640 1 -- 172.21.15.44:0/2910079390 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fb0e80046c0 con 0x7fb0f81032e0 2024-08-19T00:18:24.727 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.721+0000 7fb1021de740 1 Processor -- start 2024-08-19T00:18:24.727 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.721+0000 7fb1021de740 1 -- start start 2024-08-19T00:18:24.727 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.722+0000 7fb1021de740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5617afc717d0 0x5617afc71bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:24.727 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.722+0000 7fb1021de740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5617afc720f0 0x5617afc7c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:24.727 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.722+0000 7fb1021de740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617afc7c990 0x5617afc7ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:24.727 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.722+0000 7fb1021de740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5617afbd59d0 con 0x5617afc7c990 2024-08-19T00:18:24.727 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.722+0000 7fb1021de740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5617afb7d820 con 0x5617afc720f0 2024-08-19T00:18:24.727 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.722+0000 7fb1021de740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5617afbd1990 con 0x5617afc717d0 2024-08-19T00:18:24.727 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.722+0000 7fb0ee7fc640 1 --2- 172.21.15.44:0/2910079390 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fb0e40a2e20 0x7fb0e40a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:24.727 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.722+0000 7fb0fd1ba640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5617afc720f0 0x5617afc7c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:24.728 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.722+0000 7fb0fd9bb640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5617afc717d0 0x5617afc71bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:24.728 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.722+0000 7fb0fc9b9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617afc7c990 0x5617afc7ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:24.728 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.722+0000 7fb0fd1ba640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5617afc720f0 0x5617afc7c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.44:52402/0 (socket says 172.21.15.44:52402) 2024-08-19T00:18:24.728 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.722+0000 7fb0fd1ba640 1 -- 172.21.15.44:0/3371661874 learned_addr learned my addr 172.21.15.44:0/3371661874 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:18:24.728 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.722+0000 7fb0fd9bb640 1 --2- 172.21.15.44:0/2910079390 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fb0e40a2e20 0x7fb0e40a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:24.728 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.722+0000 7fb0ee7fc640 1 -- 172.21.15.44:0/2910079390 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7fb0e80cfad0 con 0x7fb0f81032e0 2024-08-19T00:18:24.728 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.722+0000 7fb0fd1ba640 1 -- 172.21.15.44:0/3371661874 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5617afc717d0 msgr2=0x5617afc71bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:18:24.728 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.722+0000 7fb0fd1ba640 1 --2- 172.21.15.44:0/3371661874 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5617afc717d0 0x5617afc71bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:24.728 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.722+0000 7fb0fd1ba640 1 -- 172.21.15.44:0/3371661874 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617afc7c990 msgr2=0x5617afc7ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:18:24.728 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.722+0000 7fb0fd1ba640 1 --2- 172.21.15.44:0/3371661874 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617afc7c990 0x5617afc7ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:24.728 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.722+0000 7fb0fd1ba640 1 -- 172.21.15.44:0/3371661874 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617af8e9210 con 0x5617afc720f0 2024-08-19T00:18:24.728 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.722+0000 7fb0fd9bb640 1 --2- 172.21.15.44:0/2910079390 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fb0e40a2e20 0x7fb0e40a52e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb0f0009fd0 tx=0x7fb0f0009e00 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:18:24.729 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.722+0000 7fb0fd1ba640 1 --2- 172.21.15.44:0/3371661874 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5617afc720f0 0x5617afc7c450 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4009900 tx=0x7fb0f4005be0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=260f1b1fbb3f9ff1 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:18:24.729 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.723+0000 7fb0e37fe640 1 -- 172.21.15.44:0/3371661874 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0f4040070 con 0x5617afc720f0 2024-08-19T00:18:24.729 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.723+0000 7fb0e37fe640 1 -- 172.21.15.44:0/3371661874 <== mon.2 v2:172.21.15.116:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0f4031870 con 0x5617afc720f0 2024-08-19T00:18:24.729 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.723+0000 7fb0e37fe640 1 -- 172.21.15.44:0/3371661874 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0f4035040 con 0x5617afc720f0 2024-08-19T00:18:24.729 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.723+0000 7fb1021de740 1 -- 172.21.15.44:0/3371661874 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5617afc720f0 msgr2=0x5617afc7c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:18:24.729 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.723+0000 7fb1021de740 1 --2- 172.21.15.44:0/3371661874 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5617afc720f0 0x5617afc7c450 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4009900 tx=0x7fb0f4005be0 comp rx=0 tx=0).stop 2024-08-19T00:18:24.729 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.723+0000 7fb1021de740 1 -- 172.21.15.44:0/3371661874 shutdown_connections 2024-08-19T00:18:24.729 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.723+0000 7fb1021de740 1 --2- 172.21.15.44:0/3371661874 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617afc7c990 0x5617afc7ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:24.729 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.723+0000 7fb1021de740 1 --2- 172.21.15.44:0/3371661874 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5617afc720f0 0x5617afc7c450 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:24.729 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.723+0000 7fb1021de740 1 --2- 172.21.15.44:0/3371661874 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5617afc717d0 0x5617afc71bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:24.729 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.723+0000 7fb1021de740 1 -- 172.21.15.44:0/3371661874 >> 172.21.15.44:0/3371661874 conn(0x5617afc6dd40 msgr2=0x5617afc6e120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:18:24.729 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.724+0000 7fb1021de740 1 -- 172.21.15.44:0/3371661874 shutdown_connections 2024-08-19T00:18:24.729 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.724+0000 7fb1021de740 1 -- 172.21.15.44:0/3371661874 wait complete. 2024-08-19T00:18:24.730 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.724+0000 7fb1021de740 1 -- start start 2024-08-19T00:18:24.730 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.724+0000 7fb1021de740 1 Processor -- start 2024-08-19T00:18:24.730 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.724+0000 7fb1021de740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5617afc717d0 0x5617afc79820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:24.730 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.724+0000 7fb1021de740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5617afc720f0 0x5617afc79d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:24.730 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.724+0000 7fb1021de740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617afc7c990 0x5617afc7a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:24.730 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.724+0000 7fb1021de740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5617afc7f560 con 0x5617afc7c990 2024-08-19T00:18:24.730 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.724+0000 7fb1021de740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5617afb91520 con 0x5617afc720f0 2024-08-19T00:18:24.730 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.724+0000 7fb1021de740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5617afc7f6e0 con 0x5617afc717d0 2024-08-19T00:18:24.730 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.725+0000 7fb1021de740 10 client.0 _ll_register_callbacks cb 0x5617af8e8a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:18:24.730 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.725+0000 7fb0fd9bb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617afc7c990 0x5617afc7a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:24.730 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.725+0000 7fb0fc9b9640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5617afc720f0 0x5617afc79d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:24.730 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.725+0000 7fb0fd1ba640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5617afc717d0 0x5617afc79820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:24.730 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.725+0000 7fb0fd9bb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617afc7c990 0x5617afc7a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47794/0 (socket says 172.21.15.44:47794) 2024-08-19T00:18:24.731 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.725+0000 7fb0fd9bb640 1 -- 172.21.15.44:0/2893180744 learned_addr learned my addr 172.21.15.44:0/2893180744 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:18:24.731 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.725+0000 7fb0fc9b9640 1 -- 172.21.15.44:0/2893180744 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5617afc717d0 msgr2=0x5617afc79820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:18:24.731 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.725+0000 7fb0fc9b9640 1 --2- 172.21.15.44:0/2893180744 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5617afc717d0 0x5617afc79820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:24.731 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.725+0000 7fb0fc9b9640 1 -- 172.21.15.44:0/2893180744 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617afc7c990 msgr2=0x5617afc7a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:18:24.731 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.725+0000 7fb0fc9b9640 1 --2- 172.21.15.44:0/2893180744 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617afc7c990 0x5617afc7a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:24.731 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.725+0000 7fb0fc9b9640 1 -- 172.21.15.44:0/2893180744 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617af9b5620 con 0x5617afc720f0 2024-08-19T00:18:24.731 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.725+0000 7fb0fd9bb640 1 --2- 172.21.15.44:0/2893180744 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617afc7c990 0x5617afc7a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:18:24.731 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.725+0000 7fb0fc9b9640 1 --2- 172.21.15.44:0/2893180744 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5617afc720f0 0x5617afc79d60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb0e80cce80 tx=0x7fb0e806ab80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cda7330d81780dd7 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:18:24.731 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.725+0000 7fb0e0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.116:3300/0 2024-08-19T00:18:24.733 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.726+0000 7fb0e0ff9640 1 -- 172.21.15.44:0/2893180744 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0e80a4630 con 0x5617afc720f0 2024-08-19T00:18:24.733 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.726+0000 7fb1021de740 1 -- 172.21.15.44:0/2893180744 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb0f4031870 con 0x5617afc720f0 2024-08-19T00:18:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.726+0000 7fb0e0ff9640 1 -- 172.21.15.44:0/2893180744 <== mon.2 v2:172.21.15.116:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7fb0e809b0a0 con 0x5617afc720f0 2024-08-19T00:18:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.726+0000 7fb0e0ff9640 1 -- 172.21.15.44:0/2893180744 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fb0e80b1070 con 0x5617afc720f0 2024-08-19T00:18:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.726+0000 7fb1021de740 10 client.25631 fetch_fsmap learned FSMap version 33 2024-08-19T00:18:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.726+0000 7fb1021de740 1 -- 172.21.15.44:0/2893180744 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5617afc8b170 con 0x5617afc720f0 2024-08-19T00:18:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.726+0000 7fb0e0ff9640 1 -- 172.21.15.44:0/2893180744 <== mon.2 v2:172.21.15.116:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0f4031870 con 0x5617afc720f0 2024-08-19T00:18:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.727+0000 7fb0e0ff9640 1 -- 172.21.15.44:0/2893180744 <== mon.2 v2:172.21.15.116:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7fb0e80979a0 con 0x5617afc720f0 2024-08-19T00:18:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.727+0000 7fb1021de740 10 client.25631 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:18:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.727+0000 7fb1021de740 10 client.25631 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:18:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.727+0000 7fb1021de740 20 client.25631 populate_metadata read hostname 'smithi044' 2024-08-19T00:18:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.727+0000 7fb1021de740 1 --2- 172.21.15.44:0/2893180744 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5617afc8c680 0x5617afc8ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.727+0000 7fb1021de740 4 client.25631 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:18:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.727+0000 7fb1021de740 1 -- 172.21.15.44:0/2893180744 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5617afbe3100 con 0x5617afc8c680 2024-08-19T00:18:24.735 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.727+0000 7fb0fd1ba640 1 --2- 172.21.15.44:0/2893180744 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5617afc8c680 0x5617afc8ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:24.735 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.727+0000 7fb0e0ff9640 10 client.25631 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:18:24.735 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.727+0000 7fb0fd1ba640 1 --2- 172.21.15.44:0/2893180744 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5617afc8c680 0x5617afc8ea70 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13d9cef731ded00f server_cookie=b3dcf4ca0f24e613 in_seq=0 out_seq=0 2024-08-19T00:18:24.735 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.728+0000 7fb0e0ff9640 1 -- 172.21.15.44:0/2893180744 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5617afbe3100 con 0x5617afc8c680 2024-08-19T00:18:24.735 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.728+0000 7fb0e0ff9640 10 client.25631 handle_command_reply: tid=0 2024-08-19T00:18:24.735 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.728+0000 7fb1021de740 1 client.25631 shutdown 2024-08-19T00:18:24.735 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.728+0000 7fb1021de740 1 -- 172.21.15.44:0/2893180744 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5617afc720f0 msgr2=0x5617afc79d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:18:24.735 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.728+0000 7fb1021de740 1 --2- 172.21.15.44:0/2893180744 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5617afc720f0 0x5617afc79d60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb0e80cce80 tx=0x7fb0e806ab80 comp rx=0 tx=0).stop 2024-08-19T00:18:24.735 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.728+0000 7fb1021de740 1 -- 172.21.15.44:0/2893180744 shutdown_connections 2024-08-19T00:18:24.735 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.728+0000 7fb1021de740 1 --2- 172.21.15.44:0/2893180744 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5617afc8c680 0x5617afc8ea70 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:24.735 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.728+0000 7fb1021de740 1 --2- 172.21.15.44:0/2893180744 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617afc7c990 0x5617afc7a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:24.735 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.728+0000 7fb1021de740 1 --2- 172.21.15.44:0/2893180744 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5617afc720f0 0x5617afc79d60 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:24.735 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.728+0000 7fb1021de740 1 --2- 172.21.15.44:0/2893180744 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5617afc717d0 0x5617afc79820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:24.736 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.728+0000 7fb1021de740 1 -- 172.21.15.44:0/2893180744 >> 172.21.15.44:0/2893180744 conn(0x5617afc6dd40 msgr2=0x5617afc73a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:18:24.736 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.728+0000 7fb0e0ff9640 0 client.25631 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:18:24.736 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.728+0000 7fb1021de740 1 -- 172.21.15.44:0/2893180744 shutdown_connections 2024-08-19T00:18:24.736 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.728+0000 7fb1021de740 1 -- 172.21.15.44:0/2893180744 wait complete. 2024-08-19T00:18:24.736 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.728+0000 7fb1021de740 20 client.25631 trim_cache size 0 max 16384 2024-08-19T00:18:24.749 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.743+0000 7fb1021de740 1 Processor -- start 2024-08-19T00:18:24.749 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.743+0000 7fb1021de740 1 -- start start 2024-08-19T00:18:24.749 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.743+0000 7fb1021de740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617afc717d0 0x5617afc74240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:24.749 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.743+0000 7fb1021de740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5617afc720f0 0x5617afc68920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:24.750 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.743+0000 7fb1021de740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5617afc7c990 0x5617afc94340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:24.750 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.743+0000 7fb1021de740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb0f81b0e20 con 0x5617afc717d0 2024-08-19T00:18:24.750 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.743+0000 7fb1021de740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fb0f81b2960 con 0x5617afc720f0 2024-08-19T00:18:24.750 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.743+0000 7fb1021de740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb0f81b14f0 con 0x5617afc7c990 2024-08-19T00:18:24.750 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.743+0000 7fb0fd1ba640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617afc717d0 0x5617afc74240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:24.750 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.743+0000 7fb0fd1ba640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617afc717d0 0x5617afc74240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47810/0 (socket says 172.21.15.44:47810) 2024-08-19T00:18:24.750 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.743+0000 7fb0fd1ba640 1 -- 172.21.15.44:0/2086860153 learned_addr learned my addr 172.21.15.44:0/2086860153 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:18:24.750 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.743+0000 7fb0fc9b9640 1 --2- 172.21.15.44:0/2086860153 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5617afc720f0 0x5617afc68920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:24.750 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.743+0000 7fb0fd9bb640 1 --2- 172.21.15.44:0/2086860153 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5617afc7c990 0x5617afc94340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:24.750 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.744+0000 7fb0fd1ba640 1 -- 172.21.15.44:0/2086860153 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5617afc7c990 msgr2=0x5617afc94340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:18:24.750 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.744+0000 7fb0fd1ba640 1 --2- 172.21.15.44:0/2086860153 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5617afc7c990 0x5617afc94340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:24.750 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.744+0000 7fb0fd1ba640 1 -- 172.21.15.44:0/2086860153 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5617afc720f0 msgr2=0x5617afc68920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:18:24.750 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.744+0000 7fb0fd1ba640 1 --2- 172.21.15.44:0/2086860153 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5617afc720f0 0x5617afc68920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:24.751 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.744+0000 7fb0fd1ba640 1 -- 172.21.15.44:0/2086860153 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617afc6db70 con 0x5617afc717d0 2024-08-19T00:18:24.751 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.744+0000 7fb0fd1ba640 1 --2- 172.21.15.44:0/2086860153 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617afc717d0 0x5617afc74240 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4006010 tx=0x7fb0f4047040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a9197266e702a99 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:18:24.751 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.744+0000 7fb0e2ffd640 1 -- 172.21.15.44:0/2086860153 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0f4040040 con 0x5617afc717d0 2024-08-19T00:18:24.751 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.744+0000 7fb0e2ffd640 1 -- 172.21.15.44:0/2086860153 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0f40055d0 con 0x5617afc717d0 2024-08-19T00:18:24.751 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.744+0000 7fb0e2ffd640 1 -- 172.21.15.44:0/2086860153 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0f4035040 con 0x5617afc717d0 2024-08-19T00:18:24.751 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.745+0000 7fb1021de740 1 -- 172.21.15.44:0/2086860153 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617afc717d0 msgr2=0x5617afc74240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:18:24.751 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.745+0000 7fb1021de740 1 --2- 172.21.15.44:0/2086860153 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617afc717d0 0x5617afc74240 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4006010 tx=0x7fb0f4047040 comp rx=0 tx=0).stop 2024-08-19T00:18:24.751 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.745+0000 7fb1021de740 1 -- 172.21.15.44:0/2086860153 shutdown_connections 2024-08-19T00:18:24.751 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.745+0000 7fb1021de740 1 --2- 172.21.15.44:0/2086860153 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5617afc7c990 0x5617afc94340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:24.751 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.745+0000 7fb1021de740 1 --2- 172.21.15.44:0/2086860153 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5617afc720f0 0x5617afc68920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:24.751 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.745+0000 7fb1021de740 1 --2- 172.21.15.44:0/2086860153 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617afc717d0 0x5617afc74240 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:24.751 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.745+0000 7fb1021de740 1 -- 172.21.15.44:0/2086860153 >> 172.21.15.44:0/2086860153 conn(0x5617afc6dd40 msgr2=0x5617afc78930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:18:24.751 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.745+0000 7fb1021de740 1 -- 172.21.15.44:0/2086860153 shutdown_connections 2024-08-19T00:18:24.752 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.745+0000 7fb1021de740 1 -- 172.21.15.44:0/2086860153 wait complete. 2024-08-19T00:18:24.752 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.745+0000 7fb1021de740 1 -- start start 2024-08-19T00:18:24.752 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.745+0000 7fb1021de740 1 Processor -- start 2024-08-19T00:18:24.752 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.745+0000 7fb1021de740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617afc717d0 0x5617afc84970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:24.752 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.745+0000 7fb1021de740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5617afc720f0 0x5617afc84eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:24.752 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.745+0000 7fb1021de740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5617afc7c990 0x5617afc75ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:24.752 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.745+0000 7fb1021de740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb0f81b2290 con 0x5617afc717d0 2024-08-19T00:18:24.752 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.745+0000 7fb1021de740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fb0f81b1bc0 con 0x5617afc7c990 2024-08-19T00:18:24.752 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.745+0000 7fb1021de740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb0f81aee00 con 0x5617afc720f0 2024-08-19T00:18:24.752 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.746+0000 7fb1021de740 10 client.0 _ll_register_callbacks cb 0x7fb0e800e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:18:24.752 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.746+0000 7fb0fd1ba640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617afc717d0 0x5617afc84970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:24.752 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.746+0000 7fb0fd1ba640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617afc717d0 0x5617afc84970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47816/0 (socket says 172.21.15.44:47816) 2024-08-19T00:18:24.752 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.746+0000 7fb0fd1ba640 1 -- 172.21.15.44:0/4186436706 learned_addr learned my addr 172.21.15.44:0/4186436706 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:18:24.753 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.746+0000 7fb0fc9b9640 1 --2- 172.21.15.44:0/4186436706 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5617afc720f0 0x5617afc84eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:24.753 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.746+0000 7fb0fd9bb640 1 --2- 172.21.15.44:0/4186436706 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5617afc7c990 0x5617afc75ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:24.753 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.746+0000 7fb0fd1ba640 1 -- 172.21.15.44:0/4186436706 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5617afc720f0 msgr2=0x5617afc84eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:18:24.753 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.746+0000 7fb0fd1ba640 1 --2- 172.21.15.44:0/4186436706 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5617afc720f0 0x5617afc84eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:24.753 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.746+0000 7fb0fd1ba640 1 -- 172.21.15.44:0/4186436706 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5617afc7c990 msgr2=0x5617afc75ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:18:24.753 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.746+0000 7fb0fd1ba640 1 --2- 172.21.15.44:0/4186436706 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5617afc7c990 0x5617afc75ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:24.753 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.746+0000 7fb0fd1ba640 1 -- 172.21.15.44:0/4186436706 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617afc763e0 con 0x5617afc717d0 2024-08-19T00:18:24.753 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.746+0000 7fb0fd1ba640 1 --2- 172.21.15.44:0/4186436706 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617afc717d0 0x5617afc84970 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4000c00 tx=0x7fb0f4031900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e436b66bf752ea8 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:18:24.753 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.746+0000 7fb0e0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:18:24.753 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.746+0000 7fb0e0ff9640 1 -- 172.21.15.44:0/4186436706 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0f4035030 con 0x5617afc717d0 2024-08-19T00:18:24.753 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.746+0000 7fb0e0ff9640 1 -- 172.21.15.44:0/4186436706 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7fb0f4004240 con 0x5617afc717d0 2024-08-19T00:18:24.753 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.746+0000 7fb1021de740 1 -- 172.21.15.44:0/4186436706 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb0f40055d0 con 0x5617afc717d0 2024-08-19T00:18:24.753 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.746+0000 7fb0e0ff9640 1 -- 172.21.15.44:0/4186436706 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fb0f4066050 con 0x5617afc717d0 2024-08-19T00:18:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.746+0000 7fb1021de740 10 client.16152 fetch_fsmap learned FSMap version 33 2024-08-19T00:18:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.746+0000 7fb1021de740 1 -- 172.21.15.44:0/4186436706 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5617afcf6aa0 con 0x5617afc717d0 2024-08-19T00:18:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.747+0000 7fb0e0ff9640 1 -- 172.21.15.44:0/4186436706 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0f40055d0 con 0x5617afc717d0 2024-08-19T00:18:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.747+0000 7fb0e0ff9640 1 -- 172.21.15.44:0/4186436706 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7fb0f4061030 con 0x5617afc717d0 2024-08-19T00:18:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.747+0000 7fb1021de740 10 client.16152 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:18:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.747+0000 7fb1021de740 10 client.16152 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:18:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.747+0000 7fb1021de740 20 client.16152 populate_metadata read hostname 'smithi044' 2024-08-19T00:18:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.747+0000 7fb1021de740 1 --2- 172.21.15.44:0/4186436706 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5617afcf6d20 0x5617afcf9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.747+0000 7fb1021de740 4 client.16152 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-19T00:18:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.747+0000 7fb1021de740 1 -- 172.21.15.44:0/4186436706 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5617afbdd450 con 0x5617afcf6d20 2024-08-19T00:18:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.747+0000 7fb0fc9b9640 1 --2- 172.21.15.44:0/4186436706 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5617afcf6d20 0x5617afcf9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.747+0000 7fb0fc9b9640 1 --2- 172.21.15.44:0/4186436706 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5617afcf6d20 0x5617afcf9110 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=826550fe89bdf65d server_cookie=fc74d114c0c6042a in_seq=0 out_seq=0 2024-08-19T00:18:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.747+0000 7fb0e0ff9640 10 client.16152 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:18:24.756 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.754+0000 7fb0e0ff9640 1 -- 172.21.15.44:0/4186436706 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5617afbdd450 con 0x5617afcf6d20 2024-08-19T00:18:24.756 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.754+0000 7fb0e0ff9640 10 client.16152 handle_command_reply: tid=0 2024-08-19T00:18:24.757 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.754+0000 7fb1021de740 1 client.16152 shutdown 2024-08-19T00:18:24.757 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.755+0000 7fb1021de740 1 -- 172.21.15.44:0/4186436706 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617afc717d0 msgr2=0x5617afc84970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:18:24.757 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.755+0000 7fb1021de740 1 --2- 172.21.15.44:0/4186436706 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617afc717d0 0x5617afc84970 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4000c00 tx=0x7fb0f4031900 comp rx=0 tx=0).stop 2024-08-19T00:18:24.757 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.755+0000 7fb1021de740 1 -- 172.21.15.44:0/4186436706 shutdown_connections 2024-08-19T00:18:24.757 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.755+0000 7fb1021de740 1 --2- 172.21.15.44:0/4186436706 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5617afcf6d20 0x5617afcf9110 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:24.757 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.755+0000 7fb1021de740 1 --2- 172.21.15.44:0/4186436706 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5617afc720f0 0x5617afc84eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:24.757 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.755+0000 7fb1021de740 1 --2- 172.21.15.44:0/4186436706 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5617afc7c990 0x5617afc75ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:24.757 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.755+0000 7fb0e0ff9640 0 client.16152 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:18:24.757 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.755+0000 7fb1021de740 1 --2- 172.21.15.44:0/4186436706 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617afc717d0 0x5617afc84970 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:24.757 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.755+0000 7fb1021de740 1 -- 172.21.15.44:0/4186436706 >> 172.21.15.44:0/4186436706 conn(0x5617afc6dd40 msgr2=0x5617afc6c680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:18:24.757 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.755+0000 7fb1021de740 1 -- 172.21.15.44:0/4186436706 shutdown_connections 2024-08-19T00:18:24.757 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.755+0000 7fb1021de740 1 -- 172.21.15.44:0/4186436706 wait complete. 2024-08-19T00:18:24.757 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.755+0000 7fb1021de740 20 client.16152 trim_cache size 0 max 16384 2024-08-19T00:18:24.758 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:{ 2024-08-19T00:18:24.758 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "message": "", 2024-08-19T00:18:24.758 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "return_code": 0 2024-08-19T00:18:24.758 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:} 2024-08-19T00:18:24.759 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.755+0000 7fb0ff41e640 1 -- 172.21.15.44:0/2910079390 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fb0e40a2e20 msgr2=0x7fb0e40a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:18:24.759 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.755+0000 7fb0ff41e640 1 --2- 172.21.15.44:0/2910079390 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fb0e40a2e20 0x7fb0e40a52e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb0f0009fd0 tx=0x7fb0f0009e00 comp rx=0 tx=0).stop 2024-08-19T00:18:24.759 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.755+0000 7fb0ff41e640 1 -- 172.21.15.44:0/2910079390 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0f81032e0 msgr2=0x7fb0f8100b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:18:24.759 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.755+0000 7fb0ff41e640 1 --2- 172.21.15.44:0/2910079390 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0f81032e0 0x7fb0f8100b50 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fb0e800e9f0 tx=0x7fb0e800eeb0 comp rx=0 tx=0).stop 2024-08-19T00:18:24.759 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.755+0000 7fb0ff41e640 1 -- 172.21.15.44:0/2910079390 shutdown_connections 2024-08-19T00:18:24.759 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.755+0000 7fb0ff41e640 1 --2- 172.21.15.44:0/2910079390 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fb0e40a2e20 0x7fb0e40a52e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:24.759 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.755+0000 7fb0ff41e640 1 --2- 172.21.15.44:0/2910079390 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb0f810be10 0x7fb0f8101090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:24.759 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.755+0000 7fb0ff41e640 1 --2- 172.21.15.44:0/2910079390 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0f81032e0 0x7fb0f8100b50 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:24.759 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.755+0000 7fb0ff41e640 1 --2- 172.21.15.44:0/2910079390 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb0f81029c0 0x7fb0f8100610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:24.760 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.755+0000 7fb0ff41e640 1 -- 172.21.15.44:0/2910079390 >> 172.21.15.44:0/2910079390 conn(0x7fb0f80fc430 msgr2=0x7fb0f80fd030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:18:24.760 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.756+0000 7fb0ff41e640 1 -- 172.21.15.44:0/2910079390 shutdown_connections 2024-08-19T00:18:24.760 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:24.756+0000 7fb0ff41e640 1 -- 172.21.15.44:0/2910079390 wait complete. 2024-08-19T00:18:25.675 INFO:tasks.workunit.client.0.smithi044.stdout: 1 334584 8.25 MB/sec execute 110 sec latency 15.624 ms 2024-08-19T00:18:26.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:18:25 smithi171 ceph-mon[21810]: pgmap v156: 129 pgs: 129 active+clean; 210 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.1 MiB/s wr, 349 op/s 2024-08-19T00:18:26.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:18:25 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:18:26.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:18:25 smithi116 ceph-mon[21873]: pgmap v156: 129 pgs: 129 active+clean; 210 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.1 MiB/s wr, 349 op/s 2024-08-19T00:18:26.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:18:25 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:18:26.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:18:25 smithi044 ceph-mon[18489]: pgmap v156: 129 pgs: 129 active+clean; 210 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.1 MiB/s wr, 349 op/s 2024-08-19T00:18:26.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:18:25 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:18:26.675 INFO:tasks.workunit.client.0.smithi044.stdout: 1 336440 8.27 MB/sec execute 111 sec latency 146.032 ms 2024-08-19T00:18:27.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:18:26 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:18:27.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:18:26 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:18:27.092 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:18:26 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:18:27.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:18:26 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:18:27.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:18:26 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:18:27.115 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:18:26 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:18:27.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:18:26 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:18:27.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:18:26 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:18:27.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:18:26 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:18:27.675 INFO:tasks.workunit.client.0.smithi044.stdout: 1 338536 8.30 MB/sec execute 112 sec latency 14.983 ms 2024-08-19T00:18:28.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:18:27 smithi171 ceph-mon[21810]: pgmap v157: 129 pgs: 129 active+clean; 210 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.4 MiB/s wr, 229 op/s 2024-08-19T00:18:28.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:18:27 smithi116 ceph-mon[21873]: pgmap v157: 129 pgs: 129 active+clean; 210 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.4 MiB/s wr, 229 op/s 2024-08-19T00:18:28.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:18:27 smithi044 ceph-mon[18489]: pgmap v157: 129 pgs: 129 active+clean; 210 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.4 MiB/s wr, 229 op/s 2024-08-19T00:18:28.675 INFO:tasks.workunit.client.0.smithi044.stdout: 1 340990 8.35 MB/sec execute 113 sec latency 12.786 ms 2024-08-19T00:18:29.675 INFO:tasks.workunit.client.0.smithi044.stdout: 1 343116 8.35 MB/sec execute 114 sec latency 14.684 ms 2024-08-19T00:18:30.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:18:29 smithi171 ceph-mon[21810]: pgmap v158: 129 pgs: 129 active+clean; 210 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.4 MiB/s wr, 229 op/s 2024-08-19T00:18:30.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:18:29 smithi116 ceph-mon[21873]: pgmap v158: 129 pgs: 129 active+clean; 210 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.4 MiB/s wr, 229 op/s 2024-08-19T00:18:30.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:18:29 smithi044 ceph-mon[18489]: pgmap v158: 129 pgs: 129 active+clean; 210 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.4 MiB/s wr, 229 op/s 2024-08-19T00:18:30.675 INFO:tasks.workunit.client.0.smithi044.stdout: 1 345477 8.41 MB/sec execute 115 sec latency 14.257 ms 2024-08-19T00:18:31.675 INFO:tasks.workunit.client.0.smithi044.stdout: 1 347708 8.45 MB/sec execute 116 sec latency 47.459 ms 2024-08-19T00:18:32.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:18:31 smithi171 ceph-mon[21810]: pgmap v159: 129 pgs: 129 active+clean; 217 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 5.2 MiB/s wr, 352 op/s 2024-08-19T00:18:32.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:18:31 smithi116 ceph-mon[21873]: pgmap v159: 129 pgs: 129 active+clean; 217 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 5.2 MiB/s wr, 352 op/s 2024-08-19T00:18:32.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:18:31 smithi044 ceph-mon[18489]: pgmap v159: 129 pgs: 129 active+clean; 217 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 5.2 MiB/s wr, 352 op/s 2024-08-19T00:18:32.675 INFO:tasks.workunit.client.0.smithi044.stdout: 1 349386 8.44 MB/sec execute 117 sec latency 18.991 ms 2024-08-19T00:18:33.676 INFO:tasks.workunit.client.0.smithi044.stdout: 1 351824 8.48 MB/sec execute 118 sec latency 12.083 ms 2024-08-19T00:18:34.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:18:33 smithi171 ceph-mon[21810]: pgmap v160: 129 pgs: 129 active+clean; 217 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.5 MiB/s wr, 236 op/s 2024-08-19T00:18:34.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:18:33 smithi116 ceph-mon[21873]: pgmap v160: 129 pgs: 129 active+clean; 217 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.5 MiB/s wr, 236 op/s 2024-08-19T00:18:34.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:18:33 smithi044 ceph-mon[18489]: pgmap v160: 129 pgs: 129 active+clean; 217 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.5 MiB/s wr, 236 op/s 2024-08-19T00:18:34.675 INFO:tasks.workunit.client.0.smithi044.stdout: 1 354345 8.52 MB/sec execute 119 sec latency 17.411 ms 2024-08-19T00:18:35.675 INFO:tasks.workunit.client.0.smithi044.stdout: 1 356262 8.54 MB/sec execute 120 sec latency 13.216 ms 2024-08-19T00:18:36.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:18:35 smithi171 ceph-mon[21810]: pgmap v161: 129 pgs: 129 active+clean; 224 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.0 MiB/s wr, 351 op/s 2024-08-19T00:18:36.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:18:35 smithi116 ceph-mon[21873]: pgmap v161: 129 pgs: 129 active+clean; 224 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.0 MiB/s wr, 351 op/s 2024-08-19T00:18:36.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:18:35 smithi044 ceph-mon[18489]: pgmap v161: 129 pgs: 129 active+clean; 224 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.0 MiB/s wr, 351 op/s 2024-08-19T00:18:36.675 INFO:tasks.workunit.client.0.smithi044.stdout: 1 358501 8.58 MB/sec execute 121 sec latency 72.261 ms 2024-08-19T00:18:37.675 INFO:tasks.workunit.client.0.smithi044.stdout: 1 360645 8.57 MB/sec execute 122 sec latency 20.650 ms 2024-08-19T00:18:37.850 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.848+0000 7faea52cb640 1 -- 172.21.15.44:0/3471943262 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faea0101080 msgr2=0x7faea010d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:18:37.850 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.848+0000 7faea52cb640 1 --2- 172.21.15.44:0/3471943262 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faea0101080 0x7faea010d5b0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fae9800d940 tx=0x7fae9802a1b0 comp rx=0 tx=0).stop 2024-08-19T00:18:37.850 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.848+0000 7faea52cb640 1 -- 172.21.15.44:0/3471943262 shutdown_connections 2024-08-19T00:18:37.850 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.848+0000 7faea52cb640 1 --2- 172.21.15.44:0/3471943262 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faea01006e0 0x7faea0100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:37.850 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.848+0000 7faea52cb640 1 --2- 172.21.15.44:0/3471943262 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faea0101080 0x7faea010d5b0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:37.850 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.848+0000 7faea52cb640 1 --2- 172.21.15.44:0/3471943262 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faea01066f0 0x7faea0106ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:37.851 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.848+0000 7faea52cb640 1 -- 172.21.15.44:0/3471943262 >> 172.21.15.44:0/3471943262 conn(0x7faea00776c0 msgr2=0x7faea00fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:18:37.851 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.848+0000 7faea52cb640 1 -- 172.21.15.44:0/3471943262 shutdown_connections 2024-08-19T00:18:37.851 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.848+0000 7faea52cb640 1 -- 172.21.15.44:0/3471943262 wait complete. 2024-08-19T00:18:37.851 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.849+0000 7faea52cb640 1 Processor -- start 2024-08-19T00:18:37.851 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.849+0000 7faea52cb640 1 -- start start 2024-08-19T00:18:37.852 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.849+0000 7faea52cb640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faea01006e0 0x7faea0195ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:37.853 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.849+0000 7faea52cb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faea0101080 0x7faea01963e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:37.853 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.849+0000 7faea52cb640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faea01066f0 0x7faea019a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:37.853 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.849+0000 7faea52cb640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7faea010fa70 con 0x7faea0101080 2024-08-19T00:18:37.853 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.849+0000 7faea52cb640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7faea010f8f0 con 0x7faea01066f0 2024-08-19T00:18:37.853 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.849+0000 7faea52cb640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7faea010fbf0 con 0x7faea01006e0 2024-08-19T00:18:37.853 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.849+0000 7fae9e7fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faea0101080 0x7faea01963e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:37.853 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.849+0000 7fae9e7fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faea0101080 0x7faea01963e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43916/0 (socket says 172.21.15.44:43916) 2024-08-19T00:18:37.853 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.849+0000 7fae9e7fc640 1 -- 172.21.15.44:0/3324111742 learned_addr learned my addr 172.21.15.44:0/3324111742 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:18:37.853 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.849+0000 7fae9effd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faea01006e0 0x7faea0195ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:37.853 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.849+0000 7fae9f7fe640 1 --2- 172.21.15.44:0/3324111742 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faea01066f0 0x7faea019a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:37.853 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.850+0000 7fae9e7fc640 1 -- 172.21.15.44:0/3324111742 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faea01006e0 msgr2=0x7faea0195ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:18:37.853 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.850+0000 7fae9e7fc640 1 --2- 172.21.15.44:0/3324111742 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faea01006e0 0x7faea0195ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:37.854 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.850+0000 7fae9e7fc640 1 -- 172.21.15.44:0/3324111742 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faea01066f0 msgr2=0x7faea019a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:18:37.854 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.850+0000 7fae9e7fc640 1 --2- 172.21.15.44:0/3324111742 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faea01066f0 0x7faea019a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:37.854 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.850+0000 7fae9e7fc640 1 -- 172.21.15.44:0/3324111742 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faea019ae90 con 0x7faea0101080 2024-08-19T00:18:37.854 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.850+0000 7fae9effd640 1 --2- 172.21.15.44:0/3324111742 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faea01006e0 0x7faea0195ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:18:37.854 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.850+0000 7fae9e7fc640 1 --2- 172.21.15.44:0/3324111742 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faea0101080 0x7faea01963e0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fae94009be0 tx=0x7fae940071c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:18:37.854 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.850+0000 7fae87fff640 1 -- 172.21.15.44:0/3324111742 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae94007e00 con 0x7faea0101080 2024-08-19T00:18:37.854 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.850+0000 7faea52cb640 1 -- 172.21.15.44:0/3324111742 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faea019b180 con 0x7faea0101080 2024-08-19T00:18:37.854 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.850+0000 7fae87fff640 1 -- 172.21.15.44:0/3324111742 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae9401e070 con 0x7faea0101080 2024-08-19T00:18:37.854 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.850+0000 7fae87fff640 1 -- 172.21.15.44:0/3324111742 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae94018890 con 0x7faea0101080 2024-08-19T00:18:37.854 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.850+0000 7faea52cb640 1 -- 172.21.15.44:0/3324111742 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faea01a2a10 con 0x7faea0101080 2024-08-19T00:18:37.861 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.853+0000 7fae87fff640 1 -- 172.21.15.44:0/3324111742 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fae94019b60 con 0x7faea0101080 2024-08-19T00:18:37.861 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.853+0000 7faea808f740 1 Processor -- start 2024-08-19T00:18:37.861 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.853+0000 7fae87fff640 1 --2- 172.21.15.44:0/3324111742 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fae880a2da0 0x7fae880a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:37.861 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.853+0000 7faea808f740 1 -- start start 2024-08-19T00:18:37.861 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.853+0000 7faea808f740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c8f66e47d0 0x55c8f66e4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:37.861 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.853+0000 7fae87fff640 1 -- 172.21.15.44:0/3324111742 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7fae940d3090 con 0x7faea0101080 2024-08-19T00:18:37.861 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.854+0000 7faea808f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8f66e50f0 0x55c8f66ef450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:37.862 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.854+0000 7faea808f740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c8f66ef990 0x55c8f66f1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:37.862 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.854+0000 7fae9f7fe640 1 --2- 172.21.15.44:0/3324111742 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fae880a2da0 0x7fae880a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:37.862 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.854+0000 7faea808f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55c8f66489d0 con 0x55c8f66e50f0 2024-08-19T00:18:37.862 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.854+0000 7faea808f740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55c8f65f0820 con 0x55c8f66ef990 2024-08-19T00:18:37.862 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.854+0000 7faea808f740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55c8f6644990 con 0x55c8f66e47d0 2024-08-19T00:18:37.862 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.854+0000 7fae9e7fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8f66e50f0 0x55c8f66ef450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:37.862 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.854+0000 7fae9effd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c8f66e47d0 0x55c8f66e4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:37.862 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.854+0000 7fae9e7fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8f66e50f0 0x55c8f66ef450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43930/0 (socket says 172.21.15.44:43930) 2024-08-19T00:18:37.862 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.854+0000 7fae9e7fc640 1 -- 172.21.15.44:0/384935750 learned_addr learned my addr 172.21.15.44:0/384935750 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:18:37.862 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.854+0000 7fae9f7fe640 1 --2- 172.21.15.44:0/384935750 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c8f66ef990 0x55c8f66f1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:37.862 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.854+0000 7fae9e7fc640 1 -- 172.21.15.44:0/384935750 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c8f66e47d0 msgr2=0x55c8f66e4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:18:37.862 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.854+0000 7fae9e7fc640 1 --2- 172.21.15.44:0/384935750 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c8f66e47d0 0x55c8f66e4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:37.863 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.854+0000 7fae9e7fc640 1 -- 172.21.15.44:0/384935750 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c8f66ef990 msgr2=0x55c8f66f1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:18:37.863 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.854+0000 7fae9e7fc640 1 --2- 172.21.15.44:0/384935750 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c8f66ef990 0x55c8f66f1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:37.863 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.854+0000 7fae9e7fc640 1 -- 172.21.15.44:0/384935750 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8f635c210 con 0x55c8f66e50f0 2024-08-19T00:18:37.863 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.854+0000 7fae9effd640 1 --2- 172.21.15.44:0/384935750 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c8f66e47d0 0x55c8f66e4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:18:37.863 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.854+0000 7fae9f7fe640 1 --2- 172.21.15.44:0/384935750 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c8f66ef990 0x55c8f66f1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:18:37.863 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.854+0000 7fae9f7fe640 1 --2- 172.21.15.44:0/3324111742 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fae880a2da0 0x7fae880a5260 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fae9800d910 tx=0x7fae9802bd80 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:18:37.863 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.854+0000 7fae9e7fc640 1 --2- 172.21.15.44:0/384935750 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8f66e50f0 0x55c8f66ef450 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fae9409b670 tx=0x7fae9409fa50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab9eabe64dd71fb6 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:18:37.863 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.854+0000 7fae857fa640 1 -- 172.21.15.44:0/384935750 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae940d06c0 con 0x55c8f66e50f0 2024-08-19T00:18:37.863 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.854+0000 7fae857fa640 1 -- 172.21.15.44:0/384935750 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae940bde50 con 0x55c8f66e50f0 2024-08-19T00:18:37.863 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.854+0000 7fae857fa640 1 -- 172.21.15.44:0/384935750 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae940a3120 con 0x55c8f66e50f0 2024-08-19T00:18:37.863 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.855+0000 7faea808f740 1 -- 172.21.15.44:0/384935750 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8f66e50f0 msgr2=0x55c8f66ef450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:18:37.863 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.855+0000 7faea808f740 1 --2- 172.21.15.44:0/384935750 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8f66e50f0 0x55c8f66ef450 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fae9409b670 tx=0x7fae9409fa50 comp rx=0 tx=0).stop 2024-08-19T00:18:37.863 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.855+0000 7faea808f740 1 -- 172.21.15.44:0/384935750 shutdown_connections 2024-08-19T00:18:37.863 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.855+0000 7faea808f740 1 --2- 172.21.15.44:0/384935750 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c8f66ef990 0x55c8f66f1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:37.864 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.855+0000 7faea808f740 1 --2- 172.21.15.44:0/384935750 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8f66e50f0 0x55c8f66ef450 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:37.864 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.855+0000 7faea808f740 1 --2- 172.21.15.44:0/384935750 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c8f66e47d0 0x55c8f66e4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:37.864 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.855+0000 7faea808f740 1 -- 172.21.15.44:0/384935750 >> 172.21.15.44:0/384935750 conn(0x55c8f66e0d40 msgr2=0x55c8f66e1120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:18:37.864 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.855+0000 7faea808f740 1 -- 172.21.15.44:0/384935750 shutdown_connections 2024-08-19T00:18:37.864 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.855+0000 7faea808f740 1 -- 172.21.15.44:0/384935750 wait complete. 2024-08-19T00:18:37.864 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.856+0000 7faea808f740 1 -- start start 2024-08-19T00:18:37.864 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.856+0000 7faea808f740 1 Processor -- start 2024-08-19T00:18:37.864 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.856+0000 7faea808f740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c8f66e47d0 0x55c8f66ec930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:37.864 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.856+0000 7faea808f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8f66e50f0 0x55c8f66ece70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:37.864 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.856+0000 7faea808f740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c8f66ef990 0x55c8f66ed3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:37.864 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.856+0000 7faea808f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55c8f66f2560 con 0x55c8f66e50f0 2024-08-19T00:18:37.864 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.856+0000 7faea808f740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55c8f6604520 con 0x55c8f66e47d0 2024-08-19T00:18:37.865 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.856+0000 7faea808f740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55c8f66f26e0 con 0x55c8f66ef990 2024-08-19T00:18:37.865 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.856+0000 7faea808f740 10 client.0 _ll_register_callbacks cb 0x55c8f635ba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:18:37.865 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.856+0000 7fae9e7fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8f66e50f0 0x55c8f66ece70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:37.865 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.856+0000 7fae9e7fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8f66e50f0 0x55c8f66ece70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43940/0 (socket says 172.21.15.44:43940) 2024-08-19T00:18:37.865 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.856+0000 7fae9e7fc640 1 -- 172.21.15.44:0/292746691 learned_addr learned my addr 172.21.15.44:0/292746691 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:18:37.865 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.856+0000 7fae9effd640 1 --2- 172.21.15.44:0/292746691 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c8f66e47d0 0x55c8f66ec930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:37.865 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.856+0000 7fae9f7fe640 1 --2- 172.21.15.44:0/292746691 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c8f66ef990 0x55c8f66ed3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:37.865 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.856+0000 7fae9e7fc640 1 -- 172.21.15.44:0/292746691 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c8f66ef990 msgr2=0x55c8f66ed3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:18:37.865 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.856+0000 7fae9e7fc640 1 --2- 172.21.15.44:0/292746691 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c8f66ef990 0x55c8f66ed3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:37.865 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.856+0000 7fae9e7fc640 1 -- 172.21.15.44:0/292746691 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c8f66e47d0 msgr2=0x55c8f66ec930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:18:37.866 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.856+0000 7fae9e7fc640 1 --2- 172.21.15.44:0/292746691 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c8f66e47d0 0x55c8f66ec930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:37.866 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.856+0000 7fae9e7fc640 1 -- 172.21.15.44:0/292746691 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8f6428620 con 0x55c8f66e50f0 2024-08-19T00:18:37.866 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.856+0000 7fae9effd640 1 --2- 172.21.15.44:0/292746691 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c8f66e47d0 0x55c8f66ec930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:18:37.866 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.856+0000 7fae9e7fc640 1 --2- 172.21.15.44:0/292746691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8f66e50f0 0x55c8f66ece70 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fae940d04f0 tx=0x7fae9409b5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f44d7eebc65d40f3 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:18:37.866 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.856+0000 7fae82ff5640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:18:37.866 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.857+0000 7fae82ff5640 1 -- 172.21.15.44:0/292746691 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae940a3120 con 0x55c8f66e50f0 2024-08-19T00:18:37.866 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.857+0000 7fae82ff5640 1 -- 172.21.15.44:0/292746691 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7fae940a32c0 con 0x55c8f66e50f0 2024-08-19T00:18:37.866 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.857+0000 7faea808f740 1 -- 172.21.15.44:0/292746691 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae940bde50 con 0x55c8f66e50f0 2024-08-19T00:18:37.866 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.857+0000 7fae82ff5640 1 -- 172.21.15.44:0/292746691 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fae940d0b90 con 0x55c8f66e50f0 2024-08-19T00:18:37.866 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.857+0000 7faea808f740 10 client.16164 fetch_fsmap learned FSMap version 33 2024-08-19T00:18:37.867 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.857+0000 7faea808f740 1 -- 172.21.15.44:0/292746691 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55c8f66fe1f0 con 0x55c8f66e50f0 2024-08-19T00:18:37.867 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.857+0000 7fae82ff5640 1 -- 172.21.15.44:0/292746691 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae940bde50 con 0x55c8f66e50f0 2024-08-19T00:18:37.867 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.857+0000 7fae82ff5640 1 -- 172.21.15.44:0/292746691 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7fae9409e780 con 0x55c8f66e50f0 2024-08-19T00:18:37.867 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.857+0000 7faea808f740 10 client.16164 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:18:37.867 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.857+0000 7faea808f740 10 client.16164 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:18:37.867 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.857+0000 7faea808f740 20 client.16164 populate_metadata read hostname 'smithi044' 2024-08-19T00:18:37.867 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.857+0000 7faea808f740 1 --2- 172.21.15.44:0/292746691 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55c8f66ff540 0x55c8f6701930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:37.867 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.857+0000 7faea808f740 4 client.16164 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:18:37.867 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.857+0000 7faea808f740 1 -- 172.21.15.44:0/292746691 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c8f6656100 con 0x55c8f66ff540 2024-08-19T00:18:37.867 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.857+0000 7fae9effd640 1 --2- 172.21.15.44:0/292746691 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55c8f66ff540 0x55c8f6701930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:37.867 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.858+0000 7fae82ff5640 10 client.16164 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:18:37.868 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.858+0000 7fae9effd640 1 --2- 172.21.15.44:0/292746691 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55c8f66ff540 0x55c8f6701930 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c507526bb35e581 server_cookie=cb5ebead44f9061a in_seq=0 out_seq=0 2024-08-19T00:18:37.868 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.858+0000 7fae82ff5640 1 -- 172.21.15.44:0/292746691 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c8f6656100 con 0x55c8f66ff540 2024-08-19T00:18:37.868 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.858+0000 7fae82ff5640 10 client.16164 handle_command_reply: tid=0 2024-08-19T00:18:37.868 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.858+0000 7faea808f740 1 client.16164 shutdown 2024-08-19T00:18:37.868 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.859+0000 7faea808f740 1 -- 172.21.15.44:0/292746691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8f66e50f0 msgr2=0x55c8f66ece70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:18:37.868 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.859+0000 7faea808f740 1 --2- 172.21.15.44:0/292746691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8f66e50f0 0x55c8f66ece70 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fae940d04f0 tx=0x7fae9409b5e0 comp rx=0 tx=0).stop 2024-08-19T00:18:37.868 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.859+0000 7faea808f740 1 -- 172.21.15.44:0/292746691 shutdown_connections 2024-08-19T00:18:37.868 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.859+0000 7faea808f740 1 --2- 172.21.15.44:0/292746691 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55c8f66ff540 0x55c8f6701930 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:37.868 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.859+0000 7faea808f740 1 --2- 172.21.15.44:0/292746691 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c8f66ef990 0x55c8f66ed3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:37.869 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.859+0000 7faea808f740 1 --2- 172.21.15.44:0/292746691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8f66e50f0 0x55c8f66ece70 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:37.869 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.859+0000 7faea808f740 1 --2- 172.21.15.44:0/292746691 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c8f66e47d0 0x55c8f66ec930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:37.869 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.859+0000 7faea808f740 1 -- 172.21.15.44:0/292746691 >> 172.21.15.44:0/292746691 conn(0x55c8f66e0d40 msgr2=0x55c8f66e6a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:18:37.869 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.859+0000 7fae82ff5640 0 client.16164 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:18:37.869 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.859+0000 7faea808f740 1 -- 172.21.15.44:0/292746691 shutdown_connections 2024-08-19T00:18:37.869 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.859+0000 7faea808f740 1 -- 172.21.15.44:0/292746691 wait complete. 2024-08-19T00:18:37.869 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.859+0000 7faea808f740 20 client.16164 trim_cache size 0 max 16384 2024-08-19T00:18:37.878 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.875+0000 7faea808f740 1 Processor -- start 2024-08-19T00:18:37.878 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.875+0000 7faea808f740 1 -- start start 2024-08-19T00:18:37.878 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.876+0000 7faea808f740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c8f66e47d0 0x55c8f66ed1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:37.878 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.876+0000 7faea808f740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c8f66e50f0 0x55c8f66eb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:37.878 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.876+0000 7faea808f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8f66ef990 0x55c8f66eb720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:37.878 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.876+0000 7faea808f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7faea01acb80 con 0x55c8f66ef990 2024-08-19T00:18:37.878 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.876+0000 7faea808f740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7faea01ae6c0 con 0x55c8f66e47d0 2024-08-19T00:18:37.878 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.876+0000 7faea808f740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7faea01ad250 con 0x55c8f66e50f0 2024-08-19T00:18:37.878 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.876+0000 7fae9f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8f66ef990 0x55c8f66eb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:37.878 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.876+0000 7fae9effd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c8f66e47d0 0x55c8f66ed1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:37.879 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.876+0000 7fae9f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8f66ef990 0x55c8f66eb720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43942/0 (socket says 172.21.15.44:43942) 2024-08-19T00:18:37.879 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.876+0000 7fae9f7fe640 1 -- 172.21.15.44:0/1931983369 learned_addr learned my addr 172.21.15.44:0/1931983369 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:18:37.879 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.876+0000 7fae9e7fc640 1 --2- 172.21.15.44:0/1931983369 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c8f66e50f0 0x55c8f66eb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:37.879 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.876+0000 7fae9f7fe640 1 -- 172.21.15.44:0/1931983369 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c8f66e50f0 msgr2=0x55c8f66eb1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:18:37.879 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.876+0000 7fae9f7fe640 1 --2- 172.21.15.44:0/1931983369 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c8f66e50f0 0x55c8f66eb1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:37.879 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.876+0000 7fae9f7fe640 1 -- 172.21.15.44:0/1931983369 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c8f66e47d0 msgr2=0x55c8f66ed1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:18:37.879 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.876+0000 7fae9f7fe640 1 --2- 172.21.15.44:0/1931983369 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c8f66e47d0 0x55c8f66ed1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:37.879 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.876+0000 7fae9f7fe640 1 -- 172.21.15.44:0/1931983369 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8f66e76c0 con 0x55c8f66ef990 2024-08-19T00:18:37.879 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.876+0000 7fae9effd640 1 --2- 172.21.15.44:0/1931983369 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c8f66e47d0 0x55c8f66ed1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:18:37.879 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.876+0000 7fae9f7fe640 1 --2- 172.21.15.44:0/1931983369 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8f66ef990 0x55c8f66eb720 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fae9802a7a0 tx=0x7fae9803f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc9cbc1bf993a3a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:18:37.879 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.876+0000 7fae84ff9640 1 -- 172.21.15.44:0/1931983369 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae98003a40 con 0x55c8f66ef990 2024-08-19T00:18:37.879 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.876+0000 7fae84ff9640 1 -- 172.21.15.44:0/1931983369 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae9804e070 con 0x55c8f66ef990 2024-08-19T00:18:37.879 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.876+0000 7fae84ff9640 1 -- 172.21.15.44:0/1931983369 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae9803f430 con 0x55c8f66ef990 2024-08-19T00:18:37.883 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.877+0000 7faea808f740 1 -- 172.21.15.44:0/1931983369 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8f66ef990 msgr2=0x55c8f66eb720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:18:37.883 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.877+0000 7faea808f740 1 --2- 172.21.15.44:0/1931983369 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8f66ef990 0x55c8f66eb720 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fae9802a7a0 tx=0x7fae9803f000 comp rx=0 tx=0).stop 2024-08-19T00:18:37.883 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.877+0000 7faea808f740 1 -- 172.21.15.44:0/1931983369 shutdown_connections 2024-08-19T00:18:37.883 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.877+0000 7faea808f740 1 --2- 172.21.15.44:0/1931983369 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c8f66e50f0 0x55c8f66eb1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:37.883 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.877+0000 7faea808f740 1 --2- 172.21.15.44:0/1931983369 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8f66ef990 0x55c8f66eb720 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:37.883 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.877+0000 7faea808f740 1 --2- 172.21.15.44:0/1931983369 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c8f66e47d0 0x55c8f66ed1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:37.884 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.877+0000 7faea808f740 1 -- 172.21.15.44:0/1931983369 >> 172.21.15.44:0/1931983369 conn(0x55c8f66e0d40 msgr2=0x55c8f66e7bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:18:37.884 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.877+0000 7faea808f740 1 -- 172.21.15.44:0/1931983369 shutdown_connections 2024-08-19T00:18:37.884 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.877+0000 7faea808f740 1 -- 172.21.15.44:0/1931983369 wait complete. 2024-08-19T00:18:37.884 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.878+0000 7faea808f740 1 -- start start 2024-08-19T00:18:37.884 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.878+0000 7faea808f740 1 Processor -- start 2024-08-19T00:18:37.884 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.878+0000 7faea808f740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c8f66e47d0 0x55c8f6704c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:37.884 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.878+0000 7faea808f740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c8f66e50f0 0x55c8f6700f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:37.884 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.878+0000 7faea808f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8f66ef990 0x55c8f6701490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:37.884 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.878+0000 7faea808f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7faea01adff0 con 0x55c8f66ef990 2024-08-19T00:18:37.884 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.878+0000 7faea808f740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7faea01ad920 con 0x55c8f66e50f0 2024-08-19T00:18:37.884 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.878+0000 7faea808f740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7faea01aab60 con 0x55c8f66e47d0 2024-08-19T00:18:37.884 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.878+0000 7faea808f740 10 client.0 _ll_register_callbacks cb 0x7fae90009e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:18:37.884 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.878+0000 7fae9f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8f66ef990 0x55c8f6701490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:37.885 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.878+0000 7fae9e7fc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c8f66e50f0 0x55c8f6700f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:37.885 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.878+0000 7fae9f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8f66ef990 0x55c8f6701490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43952/0 (socket says 172.21.15.44:43952) 2024-08-19T00:18:37.885 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.878+0000 7fae9f7fe640 1 -- 172.21.15.44:0/3596199617 learned_addr learned my addr 172.21.15.44:0/3596199617 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:18:37.885 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.878+0000 7fae9effd640 1 --2- 172.21.15.44:0/3596199617 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c8f66e47d0 0x55c8f6704c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:37.885 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.878+0000 7fae9f7fe640 1 -- 172.21.15.44:0/3596199617 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c8f66e47d0 msgr2=0x55c8f6704c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:18:37.885 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.878+0000 7fae9f7fe640 1 --2- 172.21.15.44:0/3596199617 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c8f66e47d0 0x55c8f6704c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:37.885 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.878+0000 7fae9f7fe640 1 -- 172.21.15.44:0/3596199617 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c8f66e50f0 msgr2=0x55c8f6700f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:18:37.885 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.878+0000 7fae9f7fe640 1 --2- 172.21.15.44:0/3596199617 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c8f66e50f0 0x55c8f6700f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:37.885 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.878+0000 7fae9f7fe640 1 -- 172.21.15.44:0/3596199617 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8f6701cc0 con 0x55c8f66ef990 2024-08-19T00:18:37.885 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.878+0000 7fae9e7fc640 1 --2- 172.21.15.44:0/3596199617 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c8f66e50f0 0x55c8f6700f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:18:37.885 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.879+0000 7fae9f7fe640 1 --2- 172.21.15.44:0/3596199617 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8f66ef990 0x55c8f6701490 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fae9800cc00 tx=0x7fae98036150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ebb452636861866 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:18:37.885 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.879+0000 7fae82ff5640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:18:37.885 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.879+0000 7fae82ff5640 1 -- 172.21.15.44:0/3596199617 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae98003c40 con 0x55c8f66ef990 2024-08-19T00:18:37.886 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.879+0000 7fae82ff5640 1 -- 172.21.15.44:0/3596199617 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7fae98003de0 con 0x55c8f66ef990 2024-08-19T00:18:37.886 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.879+0000 7faea808f740 1 -- 172.21.15.44:0/3596199617 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae9804e070 con 0x55c8f66ef990 2024-08-19T00:18:37.886 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.879+0000 7fae82ff5640 1 -- 172.21.15.44:0/3596199617 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fae98063050 con 0x55c8f66ef990 2024-08-19T00:18:37.886 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.879+0000 7faea808f740 10 client.16170 fetch_fsmap learned FSMap version 33 2024-08-19T00:18:37.886 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.879+0000 7faea808f740 1 -- 172.21.15.44:0/3596199617 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55c8f6768df0 con 0x55c8f66ef990 2024-08-19T00:18:37.886 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.879+0000 7fae82ff5640 1 -- 172.21.15.44:0/3596199617 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae9804e070 con 0x55c8f66ef990 2024-08-19T00:18:37.886 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.879+0000 7fae82ff5640 1 -- 172.21.15.44:0/3596199617 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7fae9803a050 con 0x55c8f66ef990 2024-08-19T00:18:37.886 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.880+0000 7faea808f740 10 client.16170 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:18:37.886 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.880+0000 7faea808f740 10 client.16170 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:18:37.886 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.880+0000 7faea808f740 20 client.16170 populate_metadata read hostname 'smithi044' 2024-08-19T00:18:37.886 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.880+0000 7faea808f740 1 --2- 172.21.15.44:0/3596199617 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55c8f6769540 0x55c8f676b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:37.886 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.880+0000 7faea808f740 4 client.16170 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-19T00:18:37.886 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.880+0000 7faea808f740 1 -- 172.21.15.44:0/3596199617 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c8f6650450 con 0x55c8f6769540 2024-08-19T00:18:37.887 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.880+0000 7fae9effd640 1 --2- 172.21.15.44:0/3596199617 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55c8f6769540 0x55c8f676b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:37.887 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.880+0000 7fae9effd640 1 --2- 172.21.15.44:0/3596199617 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55c8f6769540 0x55c8f676b960 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2d9a4b6b236589c server_cookie=76581ff9cdd7ede7 in_seq=0 out_seq=0 2024-08-19T00:18:37.887 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.880+0000 7fae82ff5640 10 client.16170 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:18:37.890 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.888+0000 7fae82ff5640 1 -- 172.21.15.44:0/3596199617 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c8f6650450 con 0x55c8f6769540 2024-08-19T00:18:37.890 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.888+0000 7fae82ff5640 10 client.16170 handle_command_reply: tid=0 2024-08-19T00:18:37.890 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.888+0000 7faea808f740 1 client.16170 shutdown 2024-08-19T00:18:37.890 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.888+0000 7faea808f740 1 -- 172.21.15.44:0/3596199617 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8f66ef990 msgr2=0x55c8f6701490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:18:37.890 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.888+0000 7faea808f740 1 --2- 172.21.15.44:0/3596199617 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8f66ef990 0x55c8f6701490 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fae9800cc00 tx=0x7fae98036150 comp rx=0 tx=0).stop 2024-08-19T00:18:37.890 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.888+0000 7faea808f740 1 -- 172.21.15.44:0/3596199617 shutdown_connections 2024-08-19T00:18:37.890 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.888+0000 7faea808f740 1 --2- 172.21.15.44:0/3596199617 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55c8f6769540 0x55c8f676b960 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:37.890 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.888+0000 7faea808f740 1 --2- 172.21.15.44:0/3596199617 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8f66ef990 0x55c8f6701490 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:37.890 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.888+0000 7fae82ff5640 0 client.16170 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:18:37.890 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.888+0000 7faea808f740 1 --2- 172.21.15.44:0/3596199617 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c8f66e50f0 0x55c8f6700f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:37.890 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.888+0000 7faea808f740 1 --2- 172.21.15.44:0/3596199617 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c8f66e47d0 0x55c8f6704c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:37.891 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.888+0000 7faea808f740 1 -- 172.21.15.44:0/3596199617 >> 172.21.15.44:0/3596199617 conn(0x55c8f66e0d40 msgr2=0x55c8f66eada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:18:37.891 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.888+0000 7faea808f740 1 -- 172.21.15.44:0/3596199617 shutdown_connections 2024-08-19T00:18:37.891 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.888+0000 7faea808f740 1 -- 172.21.15.44:0/3596199617 wait complete. 2024-08-19T00:18:37.891 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.888+0000 7faea808f740 20 client.16170 trim_cache size 0 max 16384 2024-08-19T00:18:37.891 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:{ 2024-08-19T00:18:37.891 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "message": "", 2024-08-19T00:18:37.891 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "return_code": 0 2024-08-19T00:18:37.891 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:} 2024-08-19T00:18:37.892 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.889+0000 7faea52cb640 1 -- 172.21.15.44:0/3324111742 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fae880a2da0 msgr2=0x7fae880a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:18:37.892 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.889+0000 7faea52cb640 1 --2- 172.21.15.44:0/3324111742 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fae880a2da0 0x7fae880a5260 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fae9800d910 tx=0x7fae9802bd80 comp rx=0 tx=0).stop 2024-08-19T00:18:37.892 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.889+0000 7faea52cb640 1 -- 172.21.15.44:0/3324111742 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faea0101080 msgr2=0x7faea01963e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:18:37.892 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.889+0000 7faea52cb640 1 --2- 172.21.15.44:0/3324111742 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faea0101080 0x7faea01963e0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fae94009be0 tx=0x7fae940071c0 comp rx=0 tx=0).stop 2024-08-19T00:18:37.893 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.889+0000 7faea52cb640 1 -- 172.21.15.44:0/3324111742 shutdown_connections 2024-08-19T00:18:37.893 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.889+0000 7faea52cb640 1 --2- 172.21.15.44:0/3324111742 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fae880a2da0 0x7fae880a5260 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:37.893 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.890+0000 7faea52cb640 1 --2- 172.21.15.44:0/3324111742 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faea01066f0 0x7faea019a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:37.893 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.890+0000 7faea52cb640 1 --2- 172.21.15.44:0/3324111742 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faea0101080 0x7faea01963e0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:37.893 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.890+0000 7faea52cb640 1 --2- 172.21.15.44:0/3324111742 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faea01006e0 0x7faea0195ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:37.893 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.890+0000 7faea52cb640 1 -- 172.21.15.44:0/3324111742 >> 172.21.15.44:0/3324111742 conn(0x7faea00776c0 msgr2=0x7faea00fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:18:37.893 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.890+0000 7faea52cb640 1 -- 172.21.15.44:0/3324111742 shutdown_connections 2024-08-19T00:18:37.893 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:37.890+0000 7faea52cb640 1 -- 172.21.15.44:0/3324111742 wait complete. 2024-08-19T00:18:38.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:18:37 smithi171 ceph-mon[21810]: pgmap v162: 129 pgs: 129 active+clean; 224 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.4 MiB/s wr, 237 op/s 2024-08-19T00:18:38.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:18:37 smithi116 ceph-mon[21873]: pgmap v162: 129 pgs: 129 active+clean; 224 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.4 MiB/s wr, 237 op/s 2024-08-19T00:18:38.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:18:37 smithi044 ceph-mon[18489]: pgmap v162: 129 pgs: 129 active+clean; 224 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.4 MiB/s wr, 237 op/s 2024-08-19T00:18:38.675 INFO:tasks.workunit.client.0.smithi044.stdout: 1 362705 8.61 MB/sec execute 123 sec latency 15.096 ms 2024-08-19T00:18:39.676 INFO:tasks.workunit.client.0.smithi044.stdout: 1 365319 8.67 MB/sec execute 124 sec latency 16.658 ms 2024-08-19T00:18:40.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:18:39 smithi171 ceph-mon[21810]: pgmap v163: 129 pgs: 129 active+clean; 224 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.4 MiB/s wr, 237 op/s 2024-08-19T00:18:40.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:18:39 smithi116 ceph-mon[21873]: pgmap v163: 129 pgs: 129 active+clean; 224 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.4 MiB/s wr, 237 op/s 2024-08-19T00:18:40.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:18:39 smithi044 ceph-mon[18489]: pgmap v163: 129 pgs: 129 active+clean; 224 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.4 MiB/s wr, 237 op/s 2024-08-19T00:18:40.675 INFO:tasks.workunit.client.0.smithi044.stdout: 1 367166 8.66 MB/sec execute 125 sec latency 31.040 ms 2024-08-19T00:18:41.676 INFO:tasks.workunit.client.0.smithi044.stdout: 1 369429 8.70 MB/sec execute 126 sec latency 51.360 ms 2024-08-19T00:18:42.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:18:41 smithi171 ceph-mon[21810]: pgmap v164: 129 pgs: 129 active+clean; 231 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 4.9 MiB/s wr, 349 op/s 2024-08-19T00:18:42.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:18:41 smithi116 ceph-mon[21873]: pgmap v164: 129 pgs: 129 active+clean; 231 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 4.9 MiB/s wr, 349 op/s 2024-08-19T00:18:42.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:18:41 smithi044 ceph-mon[18489]: pgmap v164: 129 pgs: 129 active+clean; 231 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 4.9 MiB/s wr, 349 op/s 2024-08-19T00:18:42.676 INFO:tasks.workunit.client.0.smithi044.stdout: 1 371450 8.70 MB/sec execute 127 sec latency 22.718 ms 2024-08-19T00:18:43.676 INFO:tasks.workunit.client.0.smithi044.stdout: 1 373619 8.73 MB/sec execute 128 sec latency 12.982 ms 2024-08-19T00:18:44.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:18:43 smithi171 ceph-mon[21810]: pgmap v165: 129 pgs: 129 active+clean; 231 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.1 MiB/s wr, 226 op/s 2024-08-19T00:18:44.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:18:43 smithi116 ceph-mon[21873]: pgmap v165: 129 pgs: 129 active+clean; 231 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.1 MiB/s wr, 226 op/s 2024-08-19T00:18:44.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:18:43 smithi044 ceph-mon[18489]: pgmap v165: 129 pgs: 129 active+clean; 231 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.1 MiB/s wr, 226 op/s 2024-08-19T00:18:44.676 INFO:tasks.workunit.client.0.smithi044.stdout: 1 376199 8.79 MB/sec execute 129 sec latency 58.440 ms 2024-08-19T00:18:45.676 INFO:tasks.workunit.client.0.smithi044.stdout: 1 378214 8.77 MB/sec execute 130 sec latency 17.755 ms 2024-08-19T00:18:46.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:18:45 smithi171 ceph-mon[21810]: pgmap v166: 129 pgs: 129 active+clean; 238 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 4.7 MiB/s wr, 337 op/s 2024-08-19T00:18:46.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:18:45 smithi116 ceph-mon[21873]: pgmap v166: 129 pgs: 129 active+clean; 238 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 4.7 MiB/s wr, 337 op/s 2024-08-19T00:18:46.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:18:45 smithi044 ceph-mon[18489]: pgmap v166: 129 pgs: 129 active+clean; 238 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 4.7 MiB/s wr, 337 op/s 2024-08-19T00:18:46.676 INFO:tasks.workunit.client.0.smithi044.stdout: 1 380139 8.81 MB/sec execute 131 sec latency 68.628 ms 2024-08-19T00:18:47.676 INFO:tasks.workunit.client.0.smithi044.stdout: 1 382331 8.82 MB/sec execute 132 sec latency 25.562 ms 2024-08-19T00:18:48.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:18:47 smithi171 ceph-mon[21810]: pgmap v167: 129 pgs: 129 active+clean; 238 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.1 MiB/s wr, 222 op/s 2024-08-19T00:18:48.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:18:47 smithi116 ceph-mon[21873]: pgmap v167: 129 pgs: 129 active+clean; 238 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.1 MiB/s wr, 222 op/s 2024-08-19T00:18:48.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:18:47 smithi044 ceph-mon[18489]: pgmap v167: 129 pgs: 129 active+clean; 238 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.1 MiB/s wr, 222 op/s 2024-08-19T00:18:48.676 INFO:tasks.workunit.client.0.smithi044.stdout: 1 384514 8.86 MB/sec execute 133 sec latency 11.640 ms 2024-08-19T00:18:49.676 INFO:tasks.workunit.client.0.smithi044.stdout: 1 386978 8.89 MB/sec execute 134 sec latency 15.166 ms 2024-08-19T00:18:50.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:18:49 smithi171 ceph-mon[21810]: pgmap v168: 129 pgs: 129 active+clean; 238 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.1 MiB/s wr, 222 op/s 2024-08-19T00:18:50.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:18:49 smithi116 ceph-mon[21873]: pgmap v168: 129 pgs: 129 active+clean; 238 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.1 MiB/s wr, 222 op/s 2024-08-19T00:18:50.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:18:49 smithi044 ceph-mon[18489]: pgmap v168: 129 pgs: 129 active+clean; 238 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.1 MiB/s wr, 222 op/s 2024-08-19T00:18:50.676 INFO:tasks.workunit.client.0.smithi044.stdout: 1 389083 8.88 MB/sec execute 135 sec latency 20.279 ms 2024-08-19T00:18:50.984 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.982+0000 7f9a1748f640 1 -- 172.21.15.44:0/4284020434 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a101006e0 msgr2=0x7f9a10100b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:18:50.984 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.982+0000 7f9a1748f640 1 --2- 172.21.15.44:0/4284020434 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a101006e0 0x7f9a10100b40 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f9a00009930 tx=0x7f9a0002a420 comp rx=0 tx=0).stop 2024-08-19T00:18:50.984 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.982+0000 7f9a1748f640 1 -- 172.21.15.44:0/4284020434 shutdown_connections 2024-08-19T00:18:50.985 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.982+0000 7f9a1748f640 1 --2- 172.21.15.44:0/4284020434 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9a10101080 0x7f9a1010d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:50.985 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.982+0000 7f9a1748f640 1 --2- 172.21.15.44:0/4284020434 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a101006e0 0x7f9a10100b40 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:50.985 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.982+0000 7f9a1748f640 1 --2- 172.21.15.44:0/4284020434 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9a101066f0 0x7f9a10106ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:50.985 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.982+0000 7f9a1748f640 1 -- 172.21.15.44:0/4284020434 >> 172.21.15.44:0/4284020434 conn(0x7f9a100776c0 msgr2=0x7f9a100fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:18:50.985 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.983+0000 7f9a1748f640 1 -- 172.21.15.44:0/4284020434 shutdown_connections 2024-08-19T00:18:50.985 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.983+0000 7f9a1748f640 1 -- 172.21.15.44:0/4284020434 wait complete. 2024-08-19T00:18:50.985 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.983+0000 7f9a1748f640 1 Processor -- start 2024-08-19T00:18:50.985 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.983+0000 7f9a1748f640 1 -- start start 2024-08-19T00:18:50.987 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.983+0000 7f9a1748f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a101006e0 0x7f9a10197050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:50.987 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.983+0000 7f9a1748f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9a10101080 0x7f9a10197590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:50.987 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.983+0000 7f9a1748f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9a101066f0 0x7f9a1019b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:50.987 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.983+0000 7f9a1748f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9a10110b80 con 0x7f9a101006e0 2024-08-19T00:18:50.987 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.983+0000 7f9a1748f640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f9a10110a00 con 0x7f9a10101080 2024-08-19T00:18:50.987 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.983+0000 7f9a1748f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9a10110d00 con 0x7f9a101066f0 2024-08-19T00:18:50.987 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.984+0000 7f9a1522b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a101006e0 0x7f9a10197050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:50.988 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.984+0000 7f9a1522b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a101006e0 0x7f9a10197050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48724/0 (socket says 172.21.15.44:48724) 2024-08-19T00:18:50.988 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.984+0000 7f9a1522b640 1 -- 172.21.15.44:0/247360969 learned_addr learned my addr 172.21.15.44:0/247360969 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:18:50.988 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.984+0000 7f9a15a2c640 1 --2- 172.21.15.44:0/247360969 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9a101066f0 0x7f9a1019b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:50.988 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.984+0000 7f9a14a2a640 1 --2- 172.21.15.44:0/247360969 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9a10101080 0x7f9a10197590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:50.988 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.984+0000 7f9a1522b640 1 -- 172.21.15.44:0/247360969 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9a101066f0 msgr2=0x7f9a1019b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:18:50.988 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.984+0000 7f9a1522b640 1 --2- 172.21.15.44:0/247360969 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9a101066f0 0x7f9a1019b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:50.988 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.984+0000 7f9a1522b640 1 -- 172.21.15.44:0/247360969 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9a10101080 msgr2=0x7f9a10197590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:18:50.988 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.984+0000 7f9a1522b640 1 --2- 172.21.15.44:0/247360969 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9a10101080 0x7f9a10197590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:50.988 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.984+0000 7f9a1522b640 1 -- 172.21.15.44:0/247360969 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a1019c040 con 0x7f9a101006e0 2024-08-19T00:18:50.988 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.984+0000 7f9a1522b640 1 --2- 172.21.15.44:0/247360969 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a101006e0 0x7f9a10197050 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c00e9f0 tx=0x7f9a0c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:18:50.988 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.984+0000 7f9a067fc640 1 -- 172.21.15.44:0/247360969 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c00cd80 con 0x7f9a101006e0 2024-08-19T00:18:50.988 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.984+0000 7f9a067fc640 1 -- 172.21.15.44:0/247360969 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a0c005500 con 0x7f9a101006e0 2024-08-19T00:18:50.988 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.984+0000 7f9a1748f640 1 -- 172.21.15.44:0/247360969 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a1019c330 con 0x7f9a101006e0 2024-08-19T00:18:50.989 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.984+0000 7f9a067fc640 1 -- 172.21.15.44:0/247360969 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c010690 con 0x7f9a101006e0 2024-08-19T00:18:50.989 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.984+0000 7f9a1748f640 1 -- 172.21.15.44:0/247360969 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a101a3bc0 con 0x7f9a101006e0 2024-08-19T00:18:50.995 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.987+0000 7f9a067fc640 1 -- 172.21.15.44:0/247360969 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f9a0c0046c0 con 0x7f9a101006e0 2024-08-19T00:18:50.995 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.987+0000 7f9a1a252740 1 Processor -- start 2024-08-19T00:18:50.995 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.987+0000 7f9a1a252740 1 -- start start 2024-08-19T00:18:50.995 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.987+0000 7f9a1a252740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5616437127d0 0x561643712bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:50.995 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.987+0000 7f9a1a252740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5616437130f0 0x56164371d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:50.995 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.987+0000 7f9a1a252740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56164371d990 0x56164371fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:50.995 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.987+0000 7f9a1a252740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5616436769d0 con 0x56164371d990 2024-08-19T00:18:50.995 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.987+0000 7f9a1a252740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x56164361e820 con 0x5616437127d0 2024-08-19T00:18:50.995 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.987+0000 7f9a1a252740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x561643672990 con 0x5616437130f0 2024-08-19T00:18:50.995 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.988+0000 7f9a14a2a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56164371d990 0x56164371fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:50.996 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.988+0000 7f9a14a2a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56164371d990 0x56164371fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48730/0 (socket says 172.21.15.44:48730) 2024-08-19T00:18:50.996 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.988+0000 7f9a1522b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5616437130f0 0x56164371d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:50.996 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.988+0000 7f9a14a2a640 1 -- 172.21.15.44:0/3554923388 learned_addr learned my addr 172.21.15.44:0/3554923388 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:18:50.996 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.988+0000 7f9a15a2c640 1 --2- 172.21.15.44:0/3554923388 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5616437127d0 0x561643712bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:50.996 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.988+0000 7f9a067fc640 1 --2- 172.21.15.44:0/247360969 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f99fc0a2e20 0x7f99fc0a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:50.996 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.988+0000 7f9a15a2c640 1 -- 172.21.15.44:0/3554923388 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5616437130f0 msgr2=0x56164371d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:18:50.996 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.988+0000 7f9a15a2c640 1 --2- 172.21.15.44:0/3554923388 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5616437130f0 0x56164371d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:50.996 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.988+0000 7f9a15a2c640 1 -- 172.21.15.44:0/3554923388 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56164371d990 msgr2=0x56164371fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:18:50.996 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.988+0000 7f9a15a2c640 1 --2- 172.21.15.44:0/3554923388 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56164371d990 0x56164371fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:50.996 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.988+0000 7f9a15a2c640 1 -- 172.21.15.44:0/3554923388 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56164338a210 con 0x5616437127d0 2024-08-19T00:18:50.996 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.988+0000 7f9a14a2a640 1 --2- 172.21.15.44:0/3554923388 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56164371d990 0x56164371fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:18:50.996 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.988+0000 7f9a067fc640 1 -- 172.21.15.44:0/247360969 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f9a0c0cfae0 con 0x7f9a101006e0 2024-08-19T00:18:50.996 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.988+0000 7f9a15a2c640 1 --2- 172.21.15.44:0/3554923388 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5616437127d0 0x561643712bb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9a08009f00 tx=0x7f9a08011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d2c0ef69a662efb server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:18:50.997 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.988+0000 7f9a15a2c640 1 --2- 172.21.15.44:0/247360969 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f99fc0a2e20 0x7f99fc0a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:50.997 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.988+0000 7f99fb7fe640 1 -- 172.21.15.44:0/3554923388 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a08003af0 con 0x5616437127d0 2024-08-19T00:18:50.997 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.988+0000 7f99fb7fe640 1 -- 172.21.15.44:0/3554923388 <== mon.2 v2:172.21.15.116:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a08004590 con 0x5616437127d0 2024-08-19T00:18:50.997 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.988+0000 7f99fb7fe640 1 -- 172.21.15.44:0/3554923388 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a0800fea0 con 0x5616437127d0 2024-08-19T00:18:50.997 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.989+0000 7f9a1a252740 1 -- 172.21.15.44:0/3554923388 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5616437127d0 msgr2=0x561643712bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:18:50.997 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.989+0000 7f9a15a2c640 1 --2- 172.21.15.44:0/247360969 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f99fc0a2e20 0x7f99fc0a52e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9a0801c040 tx=0x7f9a0801a580 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:18:50.997 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.989+0000 7f9a1a252740 1 --2- 172.21.15.44:0/3554923388 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5616437127d0 0x561643712bb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9a08009f00 tx=0x7f9a08011810 comp rx=0 tx=0).stop 2024-08-19T00:18:50.997 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.989+0000 7f9a1a252740 1 -- 172.21.15.44:0/3554923388 shutdown_connections 2024-08-19T00:18:50.997 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.989+0000 7f9a1a252740 1 --2- 172.21.15.44:0/3554923388 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5616437130f0 0x56164371d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:50.997 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.989+0000 7f9a1a252740 1 --2- 172.21.15.44:0/3554923388 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56164371d990 0x56164371fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:50.997 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.989+0000 7f9a1a252740 1 --2- 172.21.15.44:0/3554923388 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5616437127d0 0x561643712bb0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:50.997 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.989+0000 7f9a1a252740 1 -- 172.21.15.44:0/3554923388 >> 172.21.15.44:0/3554923388 conn(0x56164370ed40 msgr2=0x56164370f120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:18:50.997 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.989+0000 7f9a1a252740 1 -- 172.21.15.44:0/3554923388 shutdown_connections 2024-08-19T00:18:50.998 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.989+0000 7f9a1a252740 1 -- 172.21.15.44:0/3554923388 wait complete. 2024-08-19T00:18:50.998 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.989+0000 7f9a1a252740 1 -- start start 2024-08-19T00:18:50.998 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.990+0000 7f9a1a252740 1 Processor -- start 2024-08-19T00:18:50.999 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.990+0000 7f9a1a252740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5616437127d0 0x5616437209b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:50.999 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.990+0000 7f9a1a252740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5616437130f0 0x561643720ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:50.999 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.990+0000 7f9a1a252740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56164371d990 0x561643721430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:50.999 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.990+0000 7f9a1a252740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561643720560 con 0x56164371d990 2024-08-19T00:18:50.999 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.990+0000 7f9a1a252740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x561643632520 con 0x5616437127d0 2024-08-19T00:18:50.999 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.990+0000 7f9a1a252740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5616437206e0 con 0x5616437130f0 2024-08-19T00:18:50.999 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.990+0000 7f9a1a252740 10 client.0 _ll_register_callbacks cb 0x561643389a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:18:50.999 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.990+0000 7f9a15a2c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56164371d990 0x561643721430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:50.999 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.990+0000 7f9a1522b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5616437127d0 0x5616437209b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:51.000 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.990+0000 7f9a15a2c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56164371d990 0x561643721430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48738/0 (socket says 172.21.15.44:48738) 2024-08-19T00:18:51.000 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.990+0000 7f9a15a2c640 1 -- 172.21.15.44:0/981804782 learned_addr learned my addr 172.21.15.44:0/981804782 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:18:51.000 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.990+0000 7f9a1522b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5616437127d0 0x5616437209b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.44:34974/0 (socket says 172.21.15.44:34974) 2024-08-19T00:18:51.000 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.990+0000 7f9a14a2a640 1 --2- 172.21.15.44:0/981804782 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5616437130f0 0x561643720ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:51.000 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.990+0000 7f9a1522b640 1 -- 172.21.15.44:0/981804782 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5616437130f0 msgr2=0x561643720ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:18:51.000 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.990+0000 7f9a1522b640 1 --2- 172.21.15.44:0/981804782 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5616437130f0 0x561643720ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:51.000 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.990+0000 7f9a1522b640 1 -- 172.21.15.44:0/981804782 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56164371d990 msgr2=0x561643721430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:18:51.000 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.990+0000 7f9a1522b640 1 --2- 172.21.15.44:0/981804782 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56164371d990 0x561643721430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:51.000 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.990+0000 7f9a1522b640 1 -- 172.21.15.44:0/981804782 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561643456620 con 0x5616437127d0 2024-08-19T00:18:51.000 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.991+0000 7f9a1522b640 1 --2- 172.21.15.44:0/981804782 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5616437127d0 0x5616437209b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c0cce90 tx=0x7f9a0c0d3220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c391982588f4846f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:18:51.000 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.991+0000 7f99f8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.116:3300/0 2024-08-19T00:18:51.001 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.991+0000 7f99f8ff9640 1 -- 172.21.15.44:0/981804782 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c09ba30 con 0x5616437127d0 2024-08-19T00:18:51.001 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.991+0000 7f99f8ff9640 1 -- 172.21.15.44:0/981804782 <== mon.2 v2:172.21.15.116:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f9a0c0a4440 con 0x5616437127d0 2024-08-19T00:18:51.001 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.991+0000 7f9a1a252740 1 -- 172.21.15.44:0/981804782 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9a08004590 con 0x5616437127d0 2024-08-19T00:18:51.001 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.991+0000 7f99f8ff9640 1 -- 172.21.15.44:0/981804782 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f9a0c0b4e60 con 0x5616437127d0 2024-08-19T00:18:51.001 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.991+0000 7f9a1a252740 10 client.25664 fetch_fsmap learned FSMap version 33 2024-08-19T00:18:51.001 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.991+0000 7f9a1a252740 1 -- 172.21.15.44:0/981804782 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x56164372e390 con 0x5616437127d0 2024-08-19T00:18:51.001 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.991+0000 7f99f8ff9640 1 -- 172.21.15.44:0/981804782 <== mon.2 v2:172.21.15.116:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a08004590 con 0x5616437127d0 2024-08-19T00:18:51.001 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.991+0000 7f99f8ff9640 1 -- 172.21.15.44:0/981804782 <== mon.2 v2:172.21.15.116:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f9a0c09b0b0 con 0x5616437127d0 2024-08-19T00:18:51.001 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.991+0000 7f9a1a252740 10 client.25664 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:18:51.001 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.991+0000 7f9a1a252740 10 client.25664 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:18:51.001 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.991+0000 7f9a1a252740 20 client.25664 populate_metadata read hostname 'smithi044' 2024-08-19T00:18:51.002 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.991+0000 7f9a1a252740 1 --2- 172.21.15.44:0/981804782 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x56164372fcd0 0x561643732120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:51.002 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.991+0000 7f9a1a252740 4 client.25664 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:18:51.002 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.991+0000 7f9a1a252740 1 -- 172.21.15.44:0/981804782 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561643684100 con 0x56164372fcd0 2024-08-19T00:18:51.002 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.992+0000 7f9a14a2a640 1 --2- 172.21.15.44:0/981804782 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x56164372fcd0 0x561643732120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:51.002 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.992+0000 7f9a14a2a640 1 --2- 172.21.15.44:0/981804782 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x56164372fcd0 0x561643732120 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee1bec239dec3323 server_cookie=47ff061bcfd926e5 in_seq=0 out_seq=0 2024-08-19T00:18:51.002 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.992+0000 7f99f8ff9640 10 client.25664 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:18:51.002 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.992+0000 7f99f8ff9640 1 -- 172.21.15.44:0/981804782 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561643684100 con 0x56164372fcd0 2024-08-19T00:18:51.002 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.993+0000 7f99f8ff9640 10 client.25664 handle_command_reply: tid=0 2024-08-19T00:18:51.002 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.993+0000 7f9a1a252740 1 client.25664 shutdown 2024-08-19T00:18:51.002 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.993+0000 7f9a1a252740 1 -- 172.21.15.44:0/981804782 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5616437127d0 msgr2=0x5616437209b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:18:51.002 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.993+0000 7f9a1a252740 1 --2- 172.21.15.44:0/981804782 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5616437127d0 0x5616437209b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c0cce90 tx=0x7f9a0c0d3220 comp rx=0 tx=0).stop 2024-08-19T00:18:51.003 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.993+0000 7f9a1a252740 1 -- 172.21.15.44:0/981804782 shutdown_connections 2024-08-19T00:18:51.003 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.993+0000 7f9a1a252740 1 --2- 172.21.15.44:0/981804782 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x56164372fcd0 0x561643732120 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:51.003 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.993+0000 7f9a1a252740 1 --2- 172.21.15.44:0/981804782 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5616437130f0 0x561643720ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:51.003 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.993+0000 7f9a1a252740 1 --2- 172.21.15.44:0/981804782 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56164371d990 0x561643721430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:51.003 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.993+0000 7f99f8ff9640 0 client.25664 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:18:51.003 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.993+0000 7f9a1a252740 1 --2- 172.21.15.44:0/981804782 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5616437127d0 0x5616437209b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:51.003 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.993+0000 7f9a1a252740 1 -- 172.21.15.44:0/981804782 >> 172.21.15.44:0/981804782 conn(0x56164370ed40 msgr2=0x561643714aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:18:51.003 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.993+0000 7f9a1a252740 1 -- 172.21.15.44:0/981804782 shutdown_connections 2024-08-19T00:18:51.003 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.993+0000 7f9a1a252740 1 -- 172.21.15.44:0/981804782 wait complete. 2024-08-19T00:18:51.003 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:50.993+0000 7f9a1a252740 20 client.25664 trim_cache size 0 max 16384 2024-08-19T00:18:51.011 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.008+0000 7f9a1a252740 1 Processor -- start 2024-08-19T00:18:51.011 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.008+0000 7f9a1a252740 1 -- start start 2024-08-19T00:18:51.011 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.008+0000 7f9a1a252740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5616437127d0 0x561643737a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:51.011 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.008+0000 7f9a1a252740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616437130f0 0x561643737f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:51.011 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.008+0000 7f9a1a252740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56164371d990 0x561643717a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:51.011 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.008+0000 7f9a1a252740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9a101aca50 con 0x5616437130f0 2024-08-19T00:18:51.011 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.008+0000 7f9a1a252740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f9a101ae590 con 0x5616437127d0 2024-08-19T00:18:51.011 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.008+0000 7f9a1a252740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9a101ad120 con 0x56164371d990 2024-08-19T00:18:51.011 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.008+0000 7f9a14a2a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616437130f0 0x561643737f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:51.012 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.008+0000 7f9a1522b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5616437127d0 0x561643737a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:51.012 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.008+0000 7f9a1522b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5616437127d0 0x561643737a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.44:34990/0 (socket says 172.21.15.44:34990) 2024-08-19T00:18:51.012 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.008+0000 7f9a14a2a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616437130f0 0x561643737f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48740/0 (socket says 172.21.15.44:48740) 2024-08-19T00:18:51.012 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.008+0000 7f9a1522b640 1 -- 172.21.15.44:0/2270448251 learned_addr learned my addr 172.21.15.44:0/2270448251 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:18:51.012 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.008+0000 7f9a15a2c640 1 --2- 172.21.15.44:0/2270448251 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56164371d990 0x561643717a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:51.012 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.008+0000 7f9a1522b640 1 -- 172.21.15.44:0/2270448251 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56164371d990 msgr2=0x561643717a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:18:51.012 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.008+0000 7f9a1522b640 1 --2- 172.21.15.44:0/2270448251 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56164371d990 0x561643717a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:51.012 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.008+0000 7f9a1522b640 1 -- 172.21.15.44:0/2270448251 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616437130f0 msgr2=0x561643737f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:18:51.012 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.008+0000 7f9a1522b640 1 --2- 172.21.15.44:0/2270448251 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616437130f0 0x561643737f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:51.012 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.008+0000 7f9a1522b640 1 -- 172.21.15.44:0/2270448251 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561643712f20 con 0x5616437127d0 2024-08-19T00:18:51.012 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.008+0000 7f9a14a2a640 1 --2- 172.21.15.44:0/2270448251 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616437130f0 0x561643737f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:18:51.013 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.009+0000 7f9a1522b640 1 --2- 172.21.15.44:0/2270448251 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5616437127d0 0x561643737a00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c0cd490 tx=0x7f9a0c0ccf40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1296bca6821c1059 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:18:51.013 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.009+0000 7f99faffd640 1 -- 172.21.15.44:0/2270448251 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c09b5c0 con 0x5616437127d0 2024-08-19T00:18:51.013 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.009+0000 7f99faffd640 1 -- 172.21.15.44:0/2270448251 <== mon.2 v2:172.21.15.116:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a0c0b1060 con 0x5616437127d0 2024-08-19T00:18:51.013 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.009+0000 7f99faffd640 1 -- 172.21.15.44:0/2270448251 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c09b7a0 con 0x5616437127d0 2024-08-19T00:18:51.016 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.010+0000 7f9a1a252740 1 -- 172.21.15.44:0/2270448251 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5616437127d0 msgr2=0x561643737a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:18:51.016 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.010+0000 7f9a1a252740 1 --2- 172.21.15.44:0/2270448251 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5616437127d0 0x561643737a00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c0cd490 tx=0x7f9a0c0ccf40 comp rx=0 tx=0).stop 2024-08-19T00:18:51.016 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.010+0000 7f9a1a252740 1 -- 172.21.15.44:0/2270448251 shutdown_connections 2024-08-19T00:18:51.016 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.010+0000 7f9a1a252740 1 --2- 172.21.15.44:0/2270448251 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56164371d990 0x561643717a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:51.017 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.010+0000 7f9a1a252740 1 --2- 172.21.15.44:0/2270448251 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616437130f0 0x561643737f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:51.017 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.010+0000 7f9a1a252740 1 --2- 172.21.15.44:0/2270448251 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5616437127d0 0x561643737a00 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:51.017 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.010+0000 7f9a1a252740 1 -- 172.21.15.44:0/2270448251 >> 172.21.15.44:0/2270448251 conn(0x56164370ed40 msgr2=0x56164370f120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:18:51.017 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.010+0000 7f9a1a252740 1 -- 172.21.15.44:0/2270448251 shutdown_connections 2024-08-19T00:18:51.017 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.010+0000 7f9a1a252740 1 -- 172.21.15.44:0/2270448251 wait complete. 2024-08-19T00:18:51.017 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.010+0000 7f9a1a252740 1 -- start start 2024-08-19T00:18:51.017 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.011+0000 7f9a1a252740 1 Processor -- start 2024-08-19T00:18:51.017 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.011+0000 7f9a1a252740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5616437127d0 0x56164371aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:51.017 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.011+0000 7f9a1a252740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616437130f0 0x56164371b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:51.017 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.011+0000 7f9a1a252740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56164371d990 0x561643724970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:51.018 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.011+0000 7f9a1a252740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9a101adec0 con 0x5616437130f0 2024-08-19T00:18:51.018 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.011+0000 7f9a1a252740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f9a101ad7f0 con 0x56164371d990 2024-08-19T00:18:51.018 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.011+0000 7f9a1a252740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9a101aaa30 con 0x5616437127d0 2024-08-19T00:18:51.018 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.011+0000 7f9a1a252740 10 client.0 _ll_register_callbacks cb 0x7f9a0c0d3320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:18:51.018 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.011+0000 7f9a14a2a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616437130f0 0x56164371b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:51.018 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.011+0000 7f9a14a2a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616437130f0 0x56164371b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48748/0 (socket says 172.21.15.44:48748) 2024-08-19T00:18:51.018 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.011+0000 7f9a14a2a640 1 -- 172.21.15.44:0/288448975 learned_addr learned my addr 172.21.15.44:0/288448975 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:18:51.018 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.011+0000 7f9a15a2c640 1 --2- 172.21.15.44:0/288448975 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56164371d990 0x561643724970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:51.018 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.011+0000 7f9a1522b640 1 --2- 172.21.15.44:0/288448975 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5616437127d0 0x56164371aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:51.018 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.012+0000 7f9a14a2a640 1 -- 172.21.15.44:0/288448975 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5616437127d0 msgr2=0x56164371aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:18:51.018 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.012+0000 7f9a14a2a640 1 --2- 172.21.15.44:0/288448975 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5616437127d0 0x56164371aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:51.019 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.012+0000 7f9a14a2a640 1 -- 172.21.15.44:0/288448975 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56164371d990 msgr2=0x561643724970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:18:51.019 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.012+0000 7f9a14a2a640 1 --2- 172.21.15.44:0/288448975 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56164371d990 0x561643724970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:51.019 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.012+0000 7f9a14a2a640 1 -- 172.21.15.44:0/288448975 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561643724eb0 con 0x5616437130f0 2024-08-19T00:18:51.019 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.012+0000 7f9a15a2c640 1 --2- 172.21.15.44:0/288448975 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56164371d990 0x561643724970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:18:51.019 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.012+0000 7f9a14a2a640 1 --2- 172.21.15.44:0/288448975 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616437130f0 0x56164371b0e0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f9a0002aa10 tx=0x7f9a00004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34a3496745c3e7b6 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:18:51.019 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.012+0000 7f99f8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:18:51.019 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.012+0000 7f99f8ff9640 1 -- 172.21.15.44:0/288448975 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a00035040 con 0x5616437130f0 2024-08-19T00:18:51.019 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.012+0000 7f99f8ff9640 1 -- 172.21.15.44:0/288448975 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f9a00005250 con 0x5616437130f0 2024-08-19T00:18:51.019 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.012+0000 7f9a1a252740 1 -- 172.21.15.44:0/288448975 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9a0c0b1060 con 0x5616437130f0 2024-08-19T00:18:51.019 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.012+0000 7f99f8ff9640 1 -- 172.21.15.44:0/288448975 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f9a00005450 con 0x5616437130f0 2024-08-19T00:18:51.019 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.012+0000 7f9a1a252740 10 client.16188 fetch_fsmap learned FSMap version 33 2024-08-19T00:18:51.019 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.012+0000 7f9a1a252740 1 -- 172.21.15.44:0/288448975 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5616437261f0 con 0x5616437130f0 2024-08-19T00:18:51.020 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.013+0000 7f99f8ff9640 1 -- 172.21.15.44:0/288448975 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a0c0b1060 con 0x5616437130f0 2024-08-19T00:18:51.020 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.013+0000 7f99f8ff9640 1 -- 172.21.15.44:0/288448975 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f9a000317c0 con 0x5616437130f0 2024-08-19T00:18:51.020 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.013+0000 7f9a1a252740 10 client.16188 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:18:51.020 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.013+0000 7f9a1a252740 10 client.16188 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:18:51.020 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.013+0000 7f9a1a252740 20 client.16188 populate_metadata read hostname 'smithi044' 2024-08-19T00:18:51.020 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.013+0000 7f9a1a252740 1 --2- 172.21.15.44:0/288448975 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5616437989c0 0x56164379adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:18:51.020 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.013+0000 7f9a1a252740 4 client.16188 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-19T00:18:51.020 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.013+0000 7f9a1a252740 1 -- 172.21.15.44:0/288448975 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56164367e450 con 0x5616437989c0 2024-08-19T00:18:51.020 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.013+0000 7f9a1522b640 1 --2- 172.21.15.44:0/288448975 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5616437989c0 0x56164379adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:18:51.020 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.013+0000 7f9a1522b640 1 --2- 172.21.15.44:0/288448975 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5616437989c0 0x56164379adb0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a632968dedace6b7 server_cookie=4c5156b3aee3879 in_seq=0 out_seq=0 2024-08-19T00:18:51.020 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.013+0000 7f99f8ff9640 10 client.16188 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:18:51.023 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.021+0000 7f99f8ff9640 1 -- 172.21.15.44:0/288448975 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56164367e450 con 0x5616437989c0 2024-08-19T00:18:51.024 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.021+0000 7f99f8ff9640 10 client.16188 handle_command_reply: tid=0 2024-08-19T00:18:51.024 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.021+0000 7f9a1a252740 1 client.16188 shutdown 2024-08-19T00:18:51.024 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.021+0000 7f9a1a252740 1 -- 172.21.15.44:0/288448975 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616437130f0 msgr2=0x56164371b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:18:51.024 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.021+0000 7f9a1a252740 1 --2- 172.21.15.44:0/288448975 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616437130f0 0x56164371b0e0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f9a0002aa10 tx=0x7f9a00004430 comp rx=0 tx=0).stop 2024-08-19T00:18:51.024 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.021+0000 7f9a1a252740 1 -- 172.21.15.44:0/288448975 shutdown_connections 2024-08-19T00:18:51.024 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.021+0000 7f9a1a252740 1 --2- 172.21.15.44:0/288448975 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5616437989c0 0x56164379adb0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:51.024 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.021+0000 7f9a1a252740 1 --2- 172.21.15.44:0/288448975 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56164371d990 0x561643724970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:51.024 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.021+0000 7f9a1a252740 1 --2- 172.21.15.44:0/288448975 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616437130f0 0x56164371b0e0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:51.024 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.021+0000 7f9a1a252740 1 --2- 172.21.15.44:0/288448975 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5616437127d0 0x56164371aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:51.024 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.021+0000 7f9a1a252740 1 -- 172.21.15.44:0/288448975 >> 172.21.15.44:0/288448975 conn(0x56164370ed40 msgr2=0x561643714280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:18:51.024 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.021+0000 7f99f8ff9640 0 client.16188 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:18:51.024 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.022+0000 7f9a1a252740 1 -- 172.21.15.44:0/288448975 shutdown_connections 2024-08-19T00:18:51.024 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.022+0000 7f9a1a252740 1 -- 172.21.15.44:0/288448975 wait complete. 2024-08-19T00:18:51.025 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.022+0000 7f9a1a252740 20 client.16188 trim_cache size 0 max 16384 2024-08-19T00:18:51.025 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:{ 2024-08-19T00:18:51.025 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "message": "", 2024-08-19T00:18:51.025 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "return_code": 0 2024-08-19T00:18:51.025 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:} 2024-08-19T00:18:51.026 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.022+0000 7f9a1748f640 1 -- 172.21.15.44:0/247360969 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f99fc0a2e20 msgr2=0x7f99fc0a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:18:51.026 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.022+0000 7f9a1748f640 1 --2- 172.21.15.44:0/247360969 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f99fc0a2e20 0x7f99fc0a52e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9a0801c040 tx=0x7f9a0801a580 comp rx=0 tx=0).stop 2024-08-19T00:18:51.026 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.022+0000 7f9a1748f640 1 -- 172.21.15.44:0/247360969 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a101006e0 msgr2=0x7f9a10197050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:18:51.027 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.022+0000 7f9a1748f640 1 --2- 172.21.15.44:0/247360969 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a101006e0 0x7f9a10197050 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c00e9f0 tx=0x7f9a0c00edf0 comp rx=0 tx=0).stop 2024-08-19T00:18:51.027 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.022+0000 7f9a1748f640 1 -- 172.21.15.44:0/247360969 shutdown_connections 2024-08-19T00:18:51.027 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.022+0000 7f9a1748f640 1 --2- 172.21.15.44:0/247360969 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f99fc0a2e20 0x7f99fc0a52e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:51.027 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.022+0000 7f9a1748f640 1 --2- 172.21.15.44:0/247360969 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9a101066f0 0x7f9a1019b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:51.027 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.022+0000 7f9a1748f640 1 --2- 172.21.15.44:0/247360969 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9a10101080 0x7f9a10197590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:51.027 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.022+0000 7f9a1748f640 1 --2- 172.21.15.44:0/247360969 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a101006e0 0x7f9a10197050 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:18:51.027 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.022+0000 7f9a1748f640 1 -- 172.21.15.44:0/247360969 >> 172.21.15.44:0/247360969 conn(0x7f9a100776c0 msgr2=0x7f9a10103520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:18:51.027 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.022+0000 7f9a1748f640 1 -- 172.21.15.44:0/247360969 shutdown_connections 2024-08-19T00:18:51.027 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:18:51.022+0000 7f9a1748f640 1 -- 172.21.15.44:0/247360969 wait complete. 2024-08-19T00:18:51.676 INFO:tasks.workunit.client.0.smithi044.stdout: 1 390957 8.91 MB/sec execute 136 sec latency 49.903 ms 2024-08-19T00:18:52.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:18:51 smithi171 ceph-mon[21810]: pgmap v169: 129 pgs: 129 active+clean; 245 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 4.6 MiB/s wr, 335 op/s 2024-08-19T00:18:52.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:18:51 smithi116 ceph-mon[21873]: pgmap v169: 129 pgs: 129 active+clean; 245 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 4.6 MiB/s wr, 335 op/s 2024-08-19T00:18:52.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:18:51 smithi044 ceph-mon[18489]: pgmap v169: 129 pgs: 129 active+clean; 245 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 4.6 MiB/s wr, 335 op/s 2024-08-19T00:18:52.676 INFO:tasks.workunit.client.0.smithi044.stdout: 1 393240 8.93 MB/sec execute 137 sec latency 23.587 ms 2024-08-19T00:18:53.680 INFO:tasks.workunit.client.0.smithi044.stdout: 1 395029 8.93 MB/sec execute 138 sec latency 13.057 ms 2024-08-19T00:18:54.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:18:53 smithi171 ceph-mon[21810]: pgmap v170: 129 pgs: 129 active+clean; 245 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.1 MiB/s wr, 223 op/s 2024-08-19T00:18:54.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:18:53 smithi116 ceph-mon[21873]: pgmap v170: 129 pgs: 129 active+clean; 245 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.1 MiB/s wr, 223 op/s 2024-08-19T00:18:54.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:18:53 smithi044 ceph-mon[18489]: pgmap v170: 129 pgs: 129 active+clean; 245 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.1 MiB/s wr, 223 op/s 2024-08-19T00:18:54.676 INFO:tasks.workunit.client.0.smithi044.stdout: 1 397627 8.99 MB/sec execute 139 sec latency 13.103 ms 2024-08-19T00:18:55.676 INFO:tasks.workunit.client.0.smithi044.stdout: 1 399711 8.97 MB/sec execute 140 sec latency 20.277 ms 2024-08-19T00:18:56.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:18:55 smithi171 ceph-mon[21810]: pgmap v171: 129 pgs: 129 active+clean; 252 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 4.8 MiB/s wr, 337 op/s 2024-08-19T00:18:56.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:18:55 smithi116 ceph-mon[21873]: pgmap v171: 129 pgs: 129 active+clean; 252 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 4.8 MiB/s wr, 337 op/s 2024-08-19T00:18:56.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:18:55 smithi044 ceph-mon[18489]: pgmap v171: 129 pgs: 129 active+clean; 252 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 4.8 MiB/s wr, 337 op/s 2024-08-19T00:18:56.676 INFO:tasks.workunit.client.0.smithi044.stdout: 1 401761 9.00 MB/sec execute 141 sec latency 17.360 ms 2024-08-19T00:18:57.676 INFO:tasks.workunit.client.0.smithi044.stdout: 1 403834 9.02 MB/sec execute 142 sec latency 61.985 ms 2024-08-19T00:18:58.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:18:57 smithi171 ceph-mon[21810]: pgmap v172: 129 pgs: 129 active+clean; 252 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.2 MiB/s wr, 226 op/s 2024-08-19T00:18:58.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:18:57 smithi116 ceph-mon[21873]: pgmap v172: 129 pgs: 129 active+clean; 252 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.2 MiB/s wr, 226 op/s 2024-08-19T00:18:58.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:18:57 smithi044 ceph-mon[18489]: pgmap v172: 129 pgs: 129 active+clean; 252 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.2 MiB/s wr, 226 op/s 2024-08-19T00:18:58.676 INFO:tasks.workunit.client.0.smithi044.stdout: 1 405888 9.04 MB/sec execute 143 sec latency 13.094 ms 2024-08-19T00:18:59.676 INFO:tasks.workunit.client.0.smithi044.stdout: 1 408309 9.08 MB/sec execute 144 sec latency 14.613 ms 2024-08-19T00:19:00.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:18:59 smithi171 ceph-mon[21810]: pgmap v173: 129 pgs: 129 active+clean; 252 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.2 MiB/s wr, 226 op/s 2024-08-19T00:19:00.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:18:59 smithi116 ceph-mon[21873]: pgmap v173: 129 pgs: 129 active+clean; 252 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.2 MiB/s wr, 226 op/s 2024-08-19T00:19:00.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:18:59 smithi044 ceph-mon[18489]: pgmap v173: 129 pgs: 129 active+clean; 252 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.2 MiB/s wr, 226 op/s 2024-08-19T00:19:00.676 INFO:tasks.workunit.client.0.smithi044.stdout: 1 410386 9.06 MB/sec execute 145 sec latency 24.652 ms 2024-08-19T00:19:01.676 INFO:tasks.workunit.client.0.smithi044.stdout: 1 411296 9.05 MB/sec execute 146 sec latency 60.045 ms 2024-08-19T00:19:02.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:19:01 smithi171 ceph-mon[21810]: pgmap v174: 129 pgs: 129 active+clean; 259 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.8 MiB/s wr, 336 op/s 2024-08-19T00:19:02.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:19:01 smithi116 ceph-mon[21873]: pgmap v174: 129 pgs: 129 active+clean; 259 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.8 MiB/s wr, 336 op/s 2024-08-19T00:19:02.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:19:01 smithi044 ceph-mon[18489]: pgmap v174: 129 pgs: 129 active+clean; 259 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.8 MiB/s wr, 336 op/s 2024-08-19T00:19:02.676 INFO:tasks.workunit.client.0.smithi044.stdout: 1 412775 9.03 MB/sec execute 147 sec latency 36.184 ms 2024-08-19T00:19:03.676 INFO:tasks.workunit.client.0.smithi044.stdout: 1 415278 9.09 MB/sec execute 148 sec latency 13.638 ms 2024-08-19T00:19:04.127 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.125+0000 7fb034a96640 1 -- 172.21.15.44:0/2823311020 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0301010b0 msgr2=0x7fb03010d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:04.127 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.125+0000 7fb034a96640 1 --2- 172.21.15.44:0/2823311020 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0301010b0 0x7fb03010d5e0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fb028009930 tx=0x7fb02802a420 comp rx=0 tx=0).stop 2024-08-19T00:19:04.127 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.125+0000 7fb034a96640 1 -- 172.21.15.44:0/2823311020 shutdown_connections 2024-08-19T00:19:04.127 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.125+0000 7fb034a96640 1 --2- 172.21.15.44:0/2823311020 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb030100710 0x7fb030100b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:04.127 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.125+0000 7fb034a96640 1 --2- 172.21.15.44:0/2823311020 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0301010b0 0x7fb03010d5e0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:04.127 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.125+0000 7fb034a96640 1 --2- 172.21.15.44:0/2823311020 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb030106720 0x7fb030106b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:04.127 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.125+0000 7fb034a96640 1 -- 172.21.15.44:0/2823311020 >> 172.21.15.44:0/2823311020 conn(0x7fb0300fc3d0 msgr2=0x7fb0300fe7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:19:04.127 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.125+0000 7fb034a96640 1 -- 172.21.15.44:0/2823311020 shutdown_connections 2024-08-19T00:19:04.127 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.125+0000 7fb034a96640 1 -- 172.21.15.44:0/2823311020 wait complete. 2024-08-19T00:19:04.127 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.125+0000 7fb034a96640 1 Processor -- start 2024-08-19T00:19:04.127 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.126+0000 7fb034a96640 1 -- start start 2024-08-19T00:19:04.129 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.126+0000 7fb034a96640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb030100710 0x7fb030196f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:04.129 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.126+0000 7fb034a96640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb0301010b0 0x7fb030197490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:04.129 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.126+0000 7fb034a96640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb030106720 0x7fb03019b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:04.130 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.126+0000 7fb034a96640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb030110b60 con 0x7fb030100710 2024-08-19T00:19:04.130 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.126+0000 7fb034a96640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fb0301109e0 con 0x7fb030106720 2024-08-19T00:19:04.130 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.126+0000 7fb034a96640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb030110ce0 con 0x7fb0301010b0 2024-08-19T00:19:04.130 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.126+0000 7fb02e59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb030100710 0x7fb030196f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:04.130 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.126+0000 7fb02dd9b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb0301010b0 0x7fb030197490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:04.130 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.126+0000 7fb02e59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb030100710 0x7fb030196f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50990/0 (socket says 172.21.15.44:50990) 2024-08-19T00:19:04.130 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.126+0000 7fb02e59c640 1 -- 172.21.15.44:0/2937402605 learned_addr learned my addr 172.21.15.44:0/2937402605 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:19:04.130 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.126+0000 7fb02ed9d640 1 --2- 172.21.15.44:0/2937402605 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb030106720 0x7fb03019b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:04.130 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.126+0000 7fb02e59c640 1 -- 172.21.15.44:0/2937402605 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb0301010b0 msgr2=0x7fb030197490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:04.130 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.126+0000 7fb02e59c640 1 --2- 172.21.15.44:0/2937402605 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb0301010b0 0x7fb030197490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:04.130 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.126+0000 7fb02e59c640 1 -- 172.21.15.44:0/2937402605 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb030106720 msgr2=0x7fb03019b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:04.130 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.126+0000 7fb02e59c640 1 --2- 172.21.15.44:0/2937402605 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb030106720 0x7fb03019b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:04.130 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.126+0000 7fb02e59c640 1 -- 172.21.15.44:0/2937402605 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb03019bf40 con 0x7fb030100710 2024-08-19T00:19:04.131 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.126+0000 7fb02dd9b640 1 --2- 172.21.15.44:0/2937402605 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb0301010b0 0x7fb030197490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:19:04.131 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.127+0000 7fb02e59c640 1 --2- 172.21.15.44:0/2937402605 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb030100710 0x7fb030196f50 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fb02000ebc0 tx=0x7fb02000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:19:04.131 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.127+0000 7fb0277fe640 1 -- 172.21.15.44:0/2937402605 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb020010630 con 0x7fb030100710 2024-08-19T00:19:04.131 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.127+0000 7fb0277fe640 1 -- 172.21.15.44:0/2937402605 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb020010cb0 con 0x7fb030100710 2024-08-19T00:19:04.131 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.127+0000 7fb0277fe640 1 -- 172.21.15.44:0/2937402605 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb020018bd0 con 0x7fb030100710 2024-08-19T00:19:04.131 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.127+0000 7fb034a96640 1 -- 172.21.15.44:0/2937402605 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb03019c230 con 0x7fb030100710 2024-08-19T00:19:04.131 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.127+0000 7fb034a96640 1 -- 172.21.15.44:0/2937402605 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb03006a010 con 0x7fb030100710 2024-08-19T00:19:04.132 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.131+0000 7fb0277fe640 1 -- 172.21.15.44:0/2937402605 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fb0200107d0 con 0x7fb030100710 2024-08-19T00:19:04.132 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.131+0000 7fb037856740 1 Processor -- start 2024-08-19T00:19:04.132 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.131+0000 7fb037856740 1 -- start start 2024-08-19T00:19:04.134 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.131+0000 7fb037856740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556ce8367d0 0x5556ce836bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:04.134 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.132+0000 7fb037856740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5556ce8370f0 0x5556ce841450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:04.134 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.132+0000 7fb037856740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556ce841990 0x5556ce843d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:04.134 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.132+0000 7fb037856740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5556ce79a9d0 con 0x5556ce841990 2024-08-19T00:19:04.134 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.132+0000 7fb037856740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5556ce742820 con 0x5556ce8370f0 2024-08-19T00:19:04.134 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.132+0000 7fb037856740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5556ce796990 con 0x5556ce8367d0 2024-08-19T00:19:04.135 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.132+0000 7fb02ed9d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556ce8367d0 0x5556ce836bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:04.135 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.132+0000 7fb02e59c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5556ce8370f0 0x5556ce841450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:04.135 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.132+0000 7fb02ed9d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556ce8367d0 0x5556ce836bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.44:34340/0 (socket says 172.21.15.44:34340) 2024-08-19T00:19:04.135 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.132+0000 7fb02ed9d640 1 -- 172.21.15.44:0/2627313163 learned_addr learned my addr 172.21.15.44:0/2627313163 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:19:04.135 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.132+0000 7fb02dd9b640 1 --2- 172.21.15.44:0/2627313163 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556ce841990 0x5556ce843d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:04.135 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.132+0000 7fb0277fe640 1 --2- 172.21.15.44:0/2937402605 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fb01c0a2f80 0x7fb01c0a5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:04.135 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.132+0000 7fb02ed9d640 1 -- 172.21.15.44:0/2627313163 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5556ce8370f0 msgr2=0x5556ce841450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:04.135 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.132+0000 7fb02ed9d640 1 --2- 172.21.15.44:0/2627313163 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5556ce8370f0 0x5556ce841450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:04.135 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.132+0000 7fb02ed9d640 1 -- 172.21.15.44:0/2627313163 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556ce841990 msgr2=0x5556ce843d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:04.135 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.132+0000 7fb02ed9d640 1 --2- 172.21.15.44:0/2627313163 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556ce841990 0x5556ce843d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:04.135 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.132+0000 7fb02ed9d640 1 -- 172.21.15.44:0/2627313163 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556ce4ae210 con 0x5556ce8367d0 2024-08-19T00:19:04.135 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.132+0000 7fb02dd9b640 1 --2- 172.21.15.44:0/2627313163 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556ce841990 0x5556ce843d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:19:04.136 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.132+0000 7fb02e59c640 1 --2- 172.21.15.44:0/2627313163 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5556ce8370f0 0x5556ce841450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:19:04.136 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.132+0000 7fb0277fe640 1 -- 172.21.15.44:0/2937402605 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7fb0200cfc90 con 0x7fb030100710 2024-08-19T00:19:04.136 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.132+0000 7fb02ed9d640 1 --2- 172.21.15.44:0/2937402605 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fb01c0a2f80 0x7fb01c0a5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:04.136 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.133+0000 7fb02ed9d640 1 --2- 172.21.15.44:0/2627313163 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556ce8367d0 0x5556ce836bb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb028009930 tx=0x7fb028005e20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=778b9e780074f98e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:19:04.139 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.133+0000 7fb024ff9640 1 -- 172.21.15.44:0/2627313163 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb02804d070 con 0x5556ce8367d0 2024-08-19T00:19:04.139 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.133+0000 7fb02ed9d640 1 --2- 172.21.15.44:0/2937402605 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fb01c0a2f80 0x7fb01c0a5440 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb02804a000 tx=0x7fb028046030 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:19:04.139 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.133+0000 7fb024ff9640 1 -- 172.21.15.44:0/2627313163 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb028044b40 con 0x5556ce8367d0 2024-08-19T00:19:04.139 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.133+0000 7fb024ff9640 1 -- 172.21.15.44:0/2627313163 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb028035040 con 0x5556ce8367d0 2024-08-19T00:19:04.139 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.134+0000 7fb037856740 1 -- 172.21.15.44:0/2627313163 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556ce8367d0 msgr2=0x5556ce836bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:04.139 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.134+0000 7fb037856740 1 --2- 172.21.15.44:0/2627313163 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556ce8367d0 0x5556ce836bb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb028009930 tx=0x7fb028005e20 comp rx=0 tx=0).stop 2024-08-19T00:19:04.139 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.134+0000 7fb037856740 1 -- 172.21.15.44:0/2627313163 shutdown_connections 2024-08-19T00:19:04.139 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.134+0000 7fb037856740 1 --2- 172.21.15.44:0/2627313163 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556ce841990 0x5556ce843d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:04.139 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.134+0000 7fb037856740 1 --2- 172.21.15.44:0/2627313163 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5556ce8370f0 0x5556ce841450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:04.140 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.134+0000 7fb037856740 1 --2- 172.21.15.44:0/2627313163 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556ce8367d0 0x5556ce836bb0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:04.140 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.134+0000 7fb037856740 1 -- 172.21.15.44:0/2627313163 >> 172.21.15.44:0/2627313163 conn(0x5556ce832d40 msgr2=0x5556ce833120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:19:04.140 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.134+0000 7fb037856740 1 -- 172.21.15.44:0/2627313163 shutdown_connections 2024-08-19T00:19:04.140 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.134+0000 7fb037856740 1 -- 172.21.15.44:0/2627313163 wait complete. 2024-08-19T00:19:04.140 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.135+0000 7fb037856740 1 -- start start 2024-08-19T00:19:04.140 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.135+0000 7fb037856740 1 Processor -- start 2024-08-19T00:19:04.140 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.135+0000 7fb037856740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556ce8367d0 0x5556ce83e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:04.140 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.135+0000 7fb037856740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5556ce8370f0 0x5556ce83ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:04.140 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.135+0000 7fb037856740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556ce841990 0x5556ce83f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:04.140 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.135+0000 7fb037856740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5556ce844560 con 0x5556ce8367d0 2024-08-19T00:19:04.140 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.135+0000 7fb037856740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5556ce756520 con 0x5556ce8370f0 2024-08-19T00:19:04.140 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.135+0000 7fb037856740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5556ce8446e0 con 0x5556ce841990 2024-08-19T00:19:04.140 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.135+0000 7fb037856740 10 client.0 _ll_register_callbacks cb 0x5556ce4ada00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:19:04.140 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.135+0000 7fb02e59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556ce8367d0 0x5556ce83e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:04.141 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.135+0000 7fb02e59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556ce8367d0 0x5556ce83e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51000/0 (socket says 172.21.15.44:51000) 2024-08-19T00:19:04.141 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.135+0000 7fb02e59c640 1 -- 172.21.15.44:0/982242581 learned_addr learned my addr 172.21.15.44:0/982242581 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:19:04.141 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.135+0000 7fb02dd9b640 1 --2- 172.21.15.44:0/982242581 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5556ce8370f0 0x5556ce83ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:04.141 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.135+0000 7fb02ed9d640 1 --2- 172.21.15.44:0/982242581 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556ce841990 0x5556ce83f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:04.141 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.136+0000 7fb02ed9d640 1 -- 172.21.15.44:0/982242581 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5556ce8370f0 msgr2=0x5556ce83ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:04.141 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.136+0000 7fb02ed9d640 1 --2- 172.21.15.44:0/982242581 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5556ce8370f0 0x5556ce83ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:04.141 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.136+0000 7fb02ed9d640 1 -- 172.21.15.44:0/982242581 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556ce8367d0 msgr2=0x5556ce83e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:04.141 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.136+0000 7fb02ed9d640 1 --2- 172.21.15.44:0/982242581 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556ce8367d0 0x5556ce83e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:04.141 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.136+0000 7fb02ed9d640 1 -- 172.21.15.44:0/982242581 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556ce57a620 con 0x5556ce841990 2024-08-19T00:19:04.141 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.136+0000 7fb02e59c640 1 --2- 172.21.15.44:0/982242581 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556ce8367d0 0x5556ce83e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:19:04.141 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.136+0000 7fb02ed9d640 1 --2- 172.21.15.44:0/982242581 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556ce841990 0x5556ce83f380 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb028004770 tx=0x7fb028031b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8114123a9523845b server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:19:04.141 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.136+0000 7fb015ffb640 10 client.0 ms_handle_connect on v2:172.21.15.171:3300/0 2024-08-19T00:19:04.141 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.136+0000 7fb015ffb640 1 -- 172.21.15.44:0/982242581 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb02804d040 con 0x5556ce841990 2024-08-19T00:19:04.141 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.136+0000 7fb015ffb640 1 -- 172.21.15.44:0/982242581 <== mon.1 v2:172.21.15.171:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7fb0280433d0 con 0x5556ce841990 2024-08-19T00:19:04.141 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.136+0000 7fb037856740 1 -- 172.21.15.44:0/982242581 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb028044b40 con 0x5556ce841990 2024-08-19T00:19:04.142 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.136+0000 7fb015ffb640 1 -- 172.21.15.44:0/982242581 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fb028062050 con 0x5556ce841990 2024-08-19T00:19:04.142 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.136+0000 7fb037856740 10 client.25543 fetch_fsmap learned FSMap version 33 2024-08-19T00:19:04.142 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.136+0000 7fb037856740 1 -- 172.21.15.44:0/982242581 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5556ce844560 con 0x5556ce841990 2024-08-19T00:19:04.142 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.137+0000 7fb015ffb640 1 -- 172.21.15.44:0/982242581 <== mon.1 v2:172.21.15.171:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb028044b40 con 0x5556ce841990 2024-08-19T00:19:04.142 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.137+0000 7fb015ffb640 1 -- 172.21.15.44:0/982242581 <== mon.1 v2:172.21.15.171:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7fb028050b30 con 0x5556ce841990 2024-08-19T00:19:04.142 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.137+0000 7fb037856740 10 client.25543 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:19:04.142 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.137+0000 7fb037856740 10 client.25543 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:19:04.142 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.137+0000 7fb037856740 20 client.25543 populate_metadata read hostname 'smithi044' 2024-08-19T00:19:04.142 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.137+0000 7fb037856740 1 --2- 172.21.15.44:0/982242581 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5556ce8513d0 0x5556ce8537c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:04.142 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.137+0000 7fb037856740 4 client.25543 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:19:04.142 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.137+0000 7fb037856740 1 -- 172.21.15.44:0/982242581 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5556ce7a8100 con 0x5556ce8513d0 2024-08-19T00:19:04.142 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.137+0000 7fb02e59c640 1 --2- 172.21.15.44:0/982242581 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5556ce8513d0 0x5556ce8537c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:04.142 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.137+0000 7fb015ffb640 10 client.25543 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:19:04.143 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.137+0000 7fb02e59c640 1 --2- 172.21.15.44:0/982242581 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5556ce8513d0 0x5556ce8537c0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8867b75480cd9363 server_cookie=18e68a64ab760b64 in_seq=0 out_seq=0 2024-08-19T00:19:04.144 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.138+0000 7fb015ffb640 1 -- 172.21.15.44:0/982242581 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5556ce7a8100 con 0x5556ce8513d0 2024-08-19T00:19:04.144 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.138+0000 7fb015ffb640 10 client.25543 handle_command_reply: tid=0 2024-08-19T00:19:04.144 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.138+0000 7fb037856740 1 client.25543 shutdown 2024-08-19T00:19:04.144 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.138+0000 7fb037856740 1 -- 172.21.15.44:0/982242581 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556ce841990 msgr2=0x5556ce83f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:04.144 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.138+0000 7fb037856740 1 --2- 172.21.15.44:0/982242581 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556ce841990 0x5556ce83f380 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb028004770 tx=0x7fb028031b60 comp rx=0 tx=0).stop 2024-08-19T00:19:04.144 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.138+0000 7fb037856740 1 -- 172.21.15.44:0/982242581 shutdown_connections 2024-08-19T00:19:04.144 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.138+0000 7fb037856740 1 --2- 172.21.15.44:0/982242581 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5556ce8513d0 0x5556ce8537c0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:04.144 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.138+0000 7fb037856740 1 --2- 172.21.15.44:0/982242581 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556ce841990 0x5556ce83f380 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:04.144 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.138+0000 7fb037856740 1 --2- 172.21.15.44:0/982242581 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5556ce8370f0 0x5556ce83ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:04.144 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.138+0000 7fb037856740 1 --2- 172.21.15.44:0/982242581 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556ce8367d0 0x5556ce83e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:04.144 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.138+0000 7fb037856740 1 -- 172.21.15.44:0/982242581 >> 172.21.15.44:0/982242581 conn(0x5556ce832d40 msgr2=0x5556ce838a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:19:04.144 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.138+0000 7fb015ffb640 0 client.25543 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:19:04.144 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.138+0000 7fb037856740 1 -- 172.21.15.44:0/982242581 shutdown_connections 2024-08-19T00:19:04.145 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.138+0000 7fb037856740 1 -- 172.21.15.44:0/982242581 wait complete. 2024-08-19T00:19:04.145 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.139+0000 7fb037856740 20 client.25543 trim_cache size 0 max 16384 2024-08-19T00:19:04.160 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.155+0000 7fb037856740 1 Processor -- start 2024-08-19T00:19:04.161 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.155+0000 7fb037856740 1 -- start start 2024-08-19T00:19:04.161 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.155+0000 7fb037856740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556ce8367d0 0x5556ce83f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:04.161 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.155+0000 7fb037856740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556ce8370f0 0x5556ce858f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:04.161 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.155+0000 7fb037856740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5556ce841990 0x5556ce8594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:04.161 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.155+0000 7fb037856740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb0301acb30 con 0x5556ce8367d0 2024-08-19T00:19:04.161 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.155+0000 7fb037856740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fb0301ae670 con 0x5556ce841990 2024-08-19T00:19:04.161 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.155+0000 7fb037856740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb0301ad200 con 0x5556ce8370f0 2024-08-19T00:19:04.161 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.155+0000 7fb02e59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556ce8367d0 0x5556ce83f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:04.161 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.155+0000 7fb02e59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556ce8367d0 0x5556ce83f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51004/0 (socket says 172.21.15.44:51004) 2024-08-19T00:19:04.161 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.155+0000 7fb02e59c640 1 -- 172.21.15.44:0/2865028374 learned_addr learned my addr 172.21.15.44:0/2865028374 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:19:04.161 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.155+0000 7fb02dd9b640 1 --2- 172.21.15.44:0/2865028374 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556ce8370f0 0x5556ce858f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:04.161 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.155+0000 7fb02ed9d640 1 --2- 172.21.15.44:0/2865028374 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5556ce841990 0x5556ce8594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:04.161 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.155+0000 7fb02e59c640 1 -- 172.21.15.44:0/2865028374 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556ce8370f0 msgr2=0x5556ce858f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:04.162 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.155+0000 7fb02e59c640 1 --2- 172.21.15.44:0/2865028374 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556ce8370f0 0x5556ce858f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:04.162 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.155+0000 7fb02e59c640 1 -- 172.21.15.44:0/2865028374 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5556ce841990 msgr2=0x5556ce8594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:04.162 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.155+0000 7fb02e59c640 1 --2- 172.21.15.44:0/2865028374 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5556ce841990 0x5556ce8594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:04.162 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.155+0000 7fb02e59c640 1 -- 172.21.15.44:0/2865028374 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556ce83a510 con 0x5556ce8367d0 2024-08-19T00:19:04.162 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.155+0000 7fb02ed9d640 1 --2- 172.21.15.44:0/2865028374 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5556ce841990 0x5556ce8594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:19:04.162 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.155+0000 7fb02e59c640 1 --2- 172.21.15.44:0/2865028374 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556ce8367d0 0x5556ce83f1b0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fb02009bb60 tx=0x7fb020000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aabc4b2bb4ee22a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:19:04.162 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.156+0000 7fb017fff640 1 -- 172.21.15.44:0/2865028374 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb020010e60 con 0x5556ce8367d0 2024-08-19T00:19:04.162 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.156+0000 7fb017fff640 1 -- 172.21.15.44:0/2865028374 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb020010ac0 con 0x5556ce8367d0 2024-08-19T00:19:04.162 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.156+0000 7fb017fff640 1 -- 172.21.15.44:0/2865028374 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb02009b2b0 con 0x5556ce8367d0 2024-08-19T00:19:04.162 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.156+0000 7fb037856740 1 -- 172.21.15.44:0/2865028374 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556ce8367d0 msgr2=0x5556ce83f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:04.162 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.156+0000 7fb037856740 1 --2- 172.21.15.44:0/2865028374 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556ce8367d0 0x5556ce83f1b0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fb02009bb60 tx=0x7fb020000f40 comp rx=0 tx=0).stop 2024-08-19T00:19:04.162 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.156+0000 7fb037856740 1 -- 172.21.15.44:0/2865028374 shutdown_connections 2024-08-19T00:19:04.162 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.156+0000 7fb037856740 1 --2- 172.21.15.44:0/2865028374 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556ce8370f0 0x5556ce858f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:04.162 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.156+0000 7fb037856740 1 --2- 172.21.15.44:0/2865028374 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5556ce841990 0x5556ce8594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:04.163 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.156+0000 7fb037856740 1 --2- 172.21.15.44:0/2865028374 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556ce8367d0 0x5556ce83f1b0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:04.163 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.156+0000 7fb037856740 1 -- 172.21.15.44:0/2865028374 >> 172.21.15.44:0/2865028374 conn(0x5556ce832d40 msgr2=0x5556ce8533e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:19:04.163 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.156+0000 7fb037856740 1 -- 172.21.15.44:0/2865028374 shutdown_connections 2024-08-19T00:19:04.163 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.157+0000 7fb037856740 1 -- 172.21.15.44:0/2865028374 wait complete. 2024-08-19T00:19:04.163 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.157+0000 7fb037856740 1 -- start start 2024-08-19T00:19:04.163 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.157+0000 7fb037856740 1 Processor -- start 2024-08-19T00:19:04.163 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.157+0000 7fb037856740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556ce8367d0 0x5556ce844ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:04.163 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.157+0000 7fb037856740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5556ce8370f0 0x5556ce845430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:04.163 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.157+0000 7fb037856740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556ce841990 0x5556ce8b9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:04.163 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.157+0000 7fb037856740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb0301adfa0 con 0x5556ce841990 2024-08-19T00:19:04.163 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.157+0000 7fb037856740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fb0301ad8d0 con 0x5556ce8370f0 2024-08-19T00:19:04.163 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.157+0000 7fb037856740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb0301aab10 con 0x5556ce8367d0 2024-08-19T00:19:04.163 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.157+0000 7fb037856740 10 client.0 _ll_register_callbacks cb 0x7fb02804b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:19:04.164 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.157+0000 7fb02ed9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556ce841990 0x5556ce8b9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:04.164 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.157+0000 7fb02e59c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556ce8367d0 0x5556ce844ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:04.164 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.157+0000 7fb02ed9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556ce841990 0x5556ce8b9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51014/0 (socket says 172.21.15.44:51014) 2024-08-19T00:19:04.164 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.157+0000 7fb02dd9b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5556ce8370f0 0x5556ce845430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:04.164 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.157+0000 7fb02ed9d640 1 -- 172.21.15.44:0/264079325 learned_addr learned my addr 172.21.15.44:0/264079325 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:19:04.164 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.158+0000 7fb02e59c640 1 -- 172.21.15.44:0/264079325 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5556ce8370f0 msgr2=0x5556ce845430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:04.164 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.158+0000 7fb02e59c640 1 --2- 172.21.15.44:0/264079325 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5556ce8370f0 0x5556ce845430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:04.164 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.158+0000 7fb02e59c640 1 -- 172.21.15.44:0/264079325 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556ce841990 msgr2=0x5556ce8b9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:04.164 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.158+0000 7fb02e59c640 1 --2- 172.21.15.44:0/264079325 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556ce841990 0x5556ce8b9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:04.164 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.158+0000 7fb02e59c640 1 -- 172.21.15.44:0/264079325 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556ce8ba480 con 0x5556ce8367d0 2024-08-19T00:19:04.164 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.158+0000 7fb02ed9d640 1 --2- 172.21.15.44:0/264079325 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556ce841990 0x5556ce8b9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:19:04.164 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.158+0000 7fb02e59c640 1 --2- 172.21.15.44:0/264079325 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556ce8367d0 0x5556ce844ef0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb0200982c0 tx=0x7fb0200a4ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a33f633aa01c530d server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:19:04.164 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.158+0000 7fb015ffb640 10 client.0 ms_handle_connect on v2:172.21.15.171:3300/0 2024-08-19T00:19:04.164 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.158+0000 7fb015ffb640 1 -- 172.21.15.44:0/264079325 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb020010e60 con 0x5556ce8367d0 2024-08-19T00:19:04.165 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.158+0000 7fb015ffb640 1 -- 172.21.15.44:0/264079325 <== mon.1 v2:172.21.15.171:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7fb02009b2b0 con 0x5556ce8367d0 2024-08-19T00:19:04.165 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.158+0000 7fb037856740 1 -- 172.21.15.44:0/264079325 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb020010ac0 con 0x5556ce8367d0 2024-08-19T00:19:04.165 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.158+0000 7fb015ffb640 1 -- 172.21.15.44:0/264079325 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fb020099f00 con 0x5556ce8367d0 2024-08-19T00:19:04.165 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.158+0000 7fb037856740 10 client.25549 fetch_fsmap learned FSMap version 33 2024-08-19T00:19:04.165 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.158+0000 7fb037856740 1 -- 172.21.15.44:0/264079325 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5556ce8bb6a0 con 0x5556ce8367d0 2024-08-19T00:19:04.165 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.158+0000 7fb015ffb640 1 -- 172.21.15.44:0/264079325 <== mon.1 v2:172.21.15.171:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb020010ac0 con 0x5556ce8367d0 2024-08-19T00:19:04.165 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.158+0000 7fb015ffb640 1 -- 172.21.15.44:0/264079325 <== mon.1 v2:172.21.15.171:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7fb0200a1380 con 0x5556ce8367d0 2024-08-19T00:19:04.165 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.159+0000 7fb037856740 10 client.25549 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:19:04.165 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.159+0000 7fb037856740 10 client.25549 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:19:04.165 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.159+0000 7fb037856740 20 client.25549 populate_metadata read hostname 'smithi044' 2024-08-19T00:19:04.165 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.159+0000 7fb037856740 1 --2- 172.21.15.44:0/264079325 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5556ce8bbd20 0x5556ce8be110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:04.165 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.159+0000 7fb037856740 4 client.25549 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-19T00:19:04.165 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.159+0000 7fb037856740 1 -- 172.21.15.44:0/264079325 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5556ce7a2450 con 0x5556ce8bbd20 2024-08-19T00:19:04.165 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.159+0000 7fb02dd9b640 1 --2- 172.21.15.44:0/264079325 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5556ce8bbd20 0x5556ce8be110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:04.165 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.159+0000 7fb015ffb640 10 client.25549 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:19:04.166 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.159+0000 7fb02dd9b640 1 --2- 172.21.15.44:0/264079325 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5556ce8bbd20 0x5556ce8be110 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3a144caf2d58fb8 server_cookie=32b27b837cccb5d0 in_seq=0 out_seq=0 2024-08-19T00:19:04.169 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.167+0000 7fb015ffb640 1 -- 172.21.15.44:0/264079325 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5556ce7a2450 con 0x5556ce8bbd20 2024-08-19T00:19:04.169 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.167+0000 7fb015ffb640 10 client.25549 handle_command_reply: tid=0 2024-08-19T00:19:04.169 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.167+0000 7fb037856740 1 client.25549 shutdown 2024-08-19T00:19:04.170 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.167+0000 7fb037856740 1 -- 172.21.15.44:0/264079325 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556ce8367d0 msgr2=0x5556ce844ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:04.170 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.167+0000 7fb037856740 1 --2- 172.21.15.44:0/264079325 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556ce8367d0 0x5556ce844ef0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb0200982c0 tx=0x7fb0200a4ba0 comp rx=0 tx=0).stop 2024-08-19T00:19:04.170 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.168+0000 7fb037856740 1 -- 172.21.15.44:0/264079325 shutdown_connections 2024-08-19T00:19:04.170 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.168+0000 7fb037856740 1 --2- 172.21.15.44:0/264079325 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5556ce8bbd20 0x5556ce8be110 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:04.170 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.168+0000 7fb037856740 1 --2- 172.21.15.44:0/264079325 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556ce841990 0x5556ce8b9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:04.170 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.168+0000 7fb015ffb640 0 client.25549 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:19:04.170 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.168+0000 7fb037856740 1 --2- 172.21.15.44:0/264079325 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5556ce8370f0 0x5556ce845430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:04.170 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.168+0000 7fb037856740 1 --2- 172.21.15.44:0/264079325 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5556ce8367d0 0x5556ce844ef0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:04.170 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.168+0000 7fb037856740 1 -- 172.21.15.44:0/264079325 >> 172.21.15.44:0/264079325 conn(0x5556ce832d40 msgr2=0x5556ce838230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:19:04.170 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.168+0000 7fb037856740 1 -- 172.21.15.44:0/264079325 shutdown_connections 2024-08-19T00:19:04.170 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.168+0000 7fb037856740 1 -- 172.21.15.44:0/264079325 wait complete. 2024-08-19T00:19:04.170 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.168+0000 7fb037856740 20 client.25549 trim_cache size 0 max 16384 2024-08-19T00:19:04.171 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:{ 2024-08-19T00:19:04.171 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "message": "", 2024-08-19T00:19:04.171 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "return_code": 0 2024-08-19T00:19:04.171 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:} 2024-08-19T00:19:04.171 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.168+0000 7fb034a96640 1 -- 172.21.15.44:0/2937402605 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fb01c0a2f80 msgr2=0x7fb01c0a5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:04.171 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.168+0000 7fb034a96640 1 --2- 172.21.15.44:0/2937402605 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fb01c0a2f80 0x7fb01c0a5440 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb02804a000 tx=0x7fb028046030 comp rx=0 tx=0).stop 2024-08-19T00:19:04.172 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.168+0000 7fb034a96640 1 -- 172.21.15.44:0/2937402605 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb030100710 msgr2=0x7fb030196f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:04.172 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.168+0000 7fb034a96640 1 --2- 172.21.15.44:0/2937402605 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb030100710 0x7fb030196f50 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fb02000ebc0 tx=0x7fb02000c6a0 comp rx=0 tx=0).stop 2024-08-19T00:19:04.172 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.169+0000 7fb034a96640 1 -- 172.21.15.44:0/2937402605 shutdown_connections 2024-08-19T00:19:04.172 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.169+0000 7fb034a96640 1 --2- 172.21.15.44:0/2937402605 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fb01c0a2f80 0x7fb01c0a5440 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:04.172 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.169+0000 7fb034a96640 1 --2- 172.21.15.44:0/2937402605 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb0301010b0 0x7fb030197490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:04.172 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.169+0000 7fb034a96640 1 --2- 172.21.15.44:0/2937402605 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb030106720 0x7fb03019b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:04.172 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.169+0000 7fb034a96640 1 --2- 172.21.15.44:0/2937402605 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb030100710 0x7fb030196f50 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:04.172 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.169+0000 7fb034a96640 1 -- 172.21.15.44:0/2937402605 >> 172.21.15.44:0/2937402605 conn(0x7fb0300fc3d0 msgr2=0x7fb0300fc980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:19:04.172 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.169+0000 7fb034a96640 1 -- 172.21.15.44:0/2937402605 shutdown_connections 2024-08-19T00:19:04.172 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:04.169+0000 7fb034a96640 1 -- 172.21.15.44:0/2937402605 wait complete. 2024-08-19T00:19:04.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:19:03 smithi171 ceph-mon[21810]: pgmap v175: 129 pgs: 129 active+clean; 259 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.3 MiB/s wr, 224 op/s 2024-08-19T00:19:04.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:19:03 smithi116 ceph-mon[21873]: pgmap v175: 129 pgs: 129 active+clean; 259 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.3 MiB/s wr, 224 op/s 2024-08-19T00:19:04.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:19:03 smithi044 ceph-mon[18489]: pgmap v175: 129 pgs: 129 active+clean; 259 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.3 MiB/s wr, 224 op/s 2024-08-19T00:19:04.676 INFO:tasks.workunit.client.0.smithi044.stdout: 1 417131 9.07 MB/sec execute 149 sec latency 19.714 ms 2024-08-19T00:19:05.676 INFO:tasks.workunit.client.0.smithi044.stdout: 1 419364 9.10 MB/sec execute 150 sec latency 14.313 ms 2024-08-19T00:19:06.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:19:05 smithi171 ceph-mon[21810]: pgmap v176: 129 pgs: 129 active+clean; 266 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 4.9 MiB/s wr, 361 op/s 2024-08-19T00:19:06.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:19:05 smithi116 ceph-mon[21873]: pgmap v176: 129 pgs: 129 active+clean; 266 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 4.9 MiB/s wr, 361 op/s 2024-08-19T00:19:06.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:19:05 smithi044 ceph-mon[18489]: pgmap v176: 129 pgs: 129 active+clean; 266 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 4.9 MiB/s wr, 361 op/s 2024-08-19T00:19:06.677 INFO:tasks.workunit.client.0.smithi044.stdout: 1 422080 9.15 MB/sec execute 151 sec latency 15.780 ms 2024-08-19T00:19:07.677 INFO:tasks.workunit.client.0.smithi044.stdout: 1 423444 9.12 MB/sec execute 152 sec latency 53.372 ms 2024-08-19T00:19:08.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:19:07 smithi171 ceph-mon[21810]: pgmap v177: 129 pgs: 129 active+clean; 266 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.2 MiB/s wr, 248 op/s 2024-08-19T00:19:08.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:19:07 smithi116 ceph-mon[21873]: pgmap v177: 129 pgs: 129 active+clean; 266 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.2 MiB/s wr, 248 op/s 2024-08-19T00:19:08.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:19:07 smithi044 ceph-mon[18489]: pgmap v177: 129 pgs: 129 active+clean; 266 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.2 MiB/s wr, 248 op/s 2024-08-19T00:19:08.677 INFO:tasks.workunit.client.0.smithi044.stdout: 1 425929 9.16 MB/sec execute 153 sec latency 18.189 ms 2024-08-19T00:19:09.677 INFO:tasks.workunit.client.0.smithi044.stdout: 1 428013 9.15 MB/sec execute 154 sec latency 29.127 ms 2024-08-19T00:19:10.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:19:09 smithi171 ceph-mon[21810]: pgmap v178: 129 pgs: 129 active+clean; 266 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.2 MiB/s wr, 248 op/s 2024-08-19T00:19:10.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:19:09 smithi116 ceph-mon[21873]: pgmap v178: 129 pgs: 129 active+clean; 266 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.2 MiB/s wr, 248 op/s 2024-08-19T00:19:10.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:19:09 smithi044 ceph-mon[18489]: pgmap v178: 129 pgs: 129 active+clean; 266 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.2 MiB/s wr, 248 op/s 2024-08-19T00:19:10.677 INFO:tasks.workunit.client.0.smithi044.stdout: 1 430023 9.17 MB/sec execute 155 sec latency 12.960 ms 2024-08-19T00:19:11.476 INFO:tasks.quiescer.fs.[cephfs]:Total duration (38.4) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-08-19T00:19:11.477 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 19.2 2024-08-19T00:19:11.477 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-19T00:19:11.677 INFO:tasks.workunit.client.0.smithi044.stdout: 1 432571 9.20 MB/sec execute 156 sec latency 80.644 ms 2024-08-19T00:19:11.753 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:19:12.164 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:19:11 smithi044 ceph-mon[18489]: pgmap v179: 129 pgs: 129 active+clean; 273 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.8 MiB/s wr, 359 op/s 2024-08-19T00:19:12.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:12.249+0000 7fe7cbbdf640 1 -- 172.21.15.44:0/3336340667 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7c410e1b0 msgr2=0x7fe7c41105a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:12.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:12.249+0000 7fe7cbbdf640 1 --2- 172.21.15.44:0/3336340667 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7c410e1b0 0x7fe7c41105a0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc009ca0 tx=0x7fe7bc02a8c0 comp rx=0 tx=0).stop 2024-08-19T00:19:12.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:12.249+0000 7fe7cbbdf640 1 -- 172.21.15.44:0/3336340667 shutdown_connections 2024-08-19T00:19:12.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:12.249+0000 7fe7cbbdf640 1 --2- 172.21.15.44:0/3336340667 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe7c4100fb0 0x7fe7c410dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:12.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:12.249+0000 7fe7cbbdf640 1 --2- 172.21.15.44:0/3336340667 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7c410e1b0 0x7fe7c41105a0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:12.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:12.249+0000 7fe7cbbdf640 1 --2- 172.21.15.44:0/3336340667 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7c4100600 0x7fe7c41009e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:12.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:12.249+0000 7fe7cbbdf640 1 -- 172.21.15.44:0/3336340667 >> 172.21.15.44:0/3336340667 conn(0x7fe7c40fc4d0 msgr2=0x7fe7c40fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:19:12.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:12.249+0000 7fe7cbbdf640 1 -- 172.21.15.44:0/3336340667 shutdown_connections 2024-08-19T00:19:12.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:12.249+0000 7fe7cbbdf640 1 -- 172.21.15.44:0/3336340667 wait complete. 2024-08-19T00:19:12.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:12.250+0000 7fe7cbbdf640 1 Processor -- start 2024-08-19T00:19:12.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:12.250+0000 7fe7cbbdf640 1 -- start start 2024-08-19T00:19:12.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:12.250+0000 7fe7cbbdf640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7c4100600 0x7fe7c419a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:12.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:12.250+0000 7fe7cbbdf640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe7c4100fb0 0x7fe7c419a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:12.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:12.250+0000 7fe7cbbdf640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7c410e1b0 0x7fe7c419ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:12.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:12.250+0000 7fe7cbbdf640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c4113eb0 con 0x7fe7c4100600 2024-08-19T00:19:12.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:12.250+0000 7fe7cbbdf640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c4113d30 con 0x7fe7c410e1b0 2024-08-19T00:19:12.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:12.250+0000 7fe7cbbdf640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c4114030 con 0x7fe7c4100fb0 2024-08-19T00:19:12.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:12.250+0000 7fe7c997b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7c4100600 0x7fe7c419a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:12.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:12.250+0000 7fe7c917a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe7c4100fb0 0x7fe7c419a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:12.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:12.250+0000 7fe7c997b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7c4100600 0x7fe7c419a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60382/0 (socket says 172.21.15.44:60382) 2024-08-19T00:19:12.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:12.250+0000 7fe7c997b640 1 -- 172.21.15.44:0/658949418 learned_addr learned my addr 172.21.15.44:0/658949418 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:19:12.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:12.250+0000 7fe7ca17c640 1 --2- 172.21.15.44:0/658949418 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7c410e1b0 0x7fe7c419ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:12.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:12.250+0000 7fe7c917a640 1 -- 172.21.15.44:0/658949418 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7c410e1b0 msgr2=0x7fe7c419ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:12.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:12.250+0000 7fe7c917a640 1 --2- 172.21.15.44:0/658949418 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7c410e1b0 0x7fe7c419ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:12.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:12.250+0000 7fe7c917a640 1 -- 172.21.15.44:0/658949418 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7c4100600 msgr2=0x7fe7c419a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:12.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:12.250+0000 7fe7c917a640 1 --2- 172.21.15.44:0/658949418 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7c4100600 0x7fe7c419a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:12.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:12.250+0000 7fe7c917a640 1 -- 172.21.15.44:0/658949418 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7c419f340 con 0x7fe7c4100fb0 2024-08-19T00:19:12.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:12.250+0000 7fe7c997b640 1 --2- 172.21.15.44:0/658949418 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7c4100600 0x7fe7c419a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:19:12.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:12.251+0000 7fe7c917a640 1 --2- 172.21.15.44:0/658949418 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe7c4100fb0 0x7fe7c419a8d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe7b400e9f0 tx=0x7fe7b400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:19:12.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:12.251+0000 7fe7baffd640 1 -- 172.21.15.44:0/658949418 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7b400ccc0 con 0x7fe7c4100fb0 2024-08-19T00:19:12.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:12.251+0000 7fe7cbbdf640 1 -- 172.21.15.44:0/658949418 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7c419f630 con 0x7fe7c4100fb0 2024-08-19T00:19:12.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:12.251+0000 7fe7baffd640 1 -- 172.21.15.44:0/658949418 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe7b4005020 con 0x7fe7c4100fb0 2024-08-19T00:19:12.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:12.251+0000 7fe7baffd640 1 -- 172.21.15.44:0/658949418 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7b40049e0 con 0x7fe7c4100fb0 2024-08-19T00:19:12.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:12.251+0000 7fe7cbbdf640 1 -- 172.21.15.44:0/658949418 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7c41a6f10 con 0x7fe7c4100fb0 2024-08-19T00:19:12.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:12.252+0000 7fe7cbbdf640 1 -- 172.21.15.44:0/658949418 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7c41009e0 con 0x7fe7c4100fb0 2024-08-19T00:19:12.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:12.253+0000 7fe7baffd640 1 -- 172.21.15.44:0/658949418 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fe7b4005560 con 0x7fe7c4100fb0 2024-08-19T00:19:12.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:12.254+0000 7fe7baffd640 1 --2- 172.21.15.44:0/658949418 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fe7b00a2cf0 0x7fe7b00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:12.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:12.254+0000 7fe7baffd640 1 -- 172.21.15.44:0/658949418 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7fe7b40cf7f0 con 0x7fe7c4100fb0 2024-08-19T00:19:12.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:12.254+0000 7fe7c997b640 1 --2- 172.21.15.44:0/658949418 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fe7b00a2cf0 0x7fe7b00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:12.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:12.254+0000 7fe7c997b640 1 --2- 172.21.15.44:0/658949418 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fe7b00a2cf0 0x7fe7b00a51b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe7c0011550 tx=0x7fe7c0005f90 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:19:12.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:12.258+0000 7fe7baffd640 1 -- 172.21.15.44:0/658949418 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fe7b40051d0 con 0x7fe7c4100fb0 2024-08-19T00:19:12.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:19:11 smithi171 ceph-mon[21810]: pgmap v179: 129 pgs: 129 active+clean; 273 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.8 MiB/s wr, 359 op/s 2024-08-19T00:19:12.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:19:11 smithi116 ceph-mon[21873]: pgmap v179: 129 pgs: 129 active+clean; 273 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.8 MiB/s wr, 359 op/s 2024-08-19T00:19:12.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:12.503+0000 7fe7cbbdf640 1 -- 172.21.15.44:0/658949418 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe7c41093a0 con 0x7fe7c4100fb0 2024-08-19T00:19:12.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:12.505+0000 7fe7baffd640 1 -- 172.21.15.44:0/658949418 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11989 (secure 0 0 0) 0x7fe7b409c010 con 0x7fe7c4100fb0 2024-08-19T00:19:12.511 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:19:12.511 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":33,"btime":"2024-08-19T00:17:11:640526+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14511,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1538841896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1538841896},{"type":"v1","addr":"172.21.15.116:6833","nonce":1538841896}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/4044471606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4044471606},{"type":"v1","addr":"172.21.15.44:6835","nonce":4044471606}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":33,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-19T00:10:53.196636+0000","modified":"2024-08-19T00:17:11.586031+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24473,"mds_1":24446,"mds_2":24439,"mds_3":24431,"mds_4":24418},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14529":{"gid":14529,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6837/1824829052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1824829052},{"type":"v1","addr":"172.21.15.44:6837","nonce":1824829052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14577":{"gid":14577,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6839/3591739042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":3591739042},{"type":"v1","addr":"172.21.15.44:6839","nonce":3591739042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14589":{"gid":14589,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6841/3667695717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6840","nonce":3667695717},{"type":"v1","addr":"172.21.15.44:6841","nonce":3667695717}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24388":{"gid":24388,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1183022838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1183022838},{"type":"v1","addr":"172.21.15.171:6833","nonce":1183022838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6835/2190623851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":2190623851},{"type":"v1","addr":"172.21.15.171:6835","nonce":2190623851}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.171:6837/316231795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":316231795},{"type":"v1","addr":"172.21.15.171:6837","nonce":316231795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":20,"addr":"172.21.15.116:6835/3507399322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3507399322},{"type":"v1","addr":"172.21.15.116:6835","nonce":3507399322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.171:6839/1466585795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":1466585795},{"type":"v1","addr":"172.21.15.171:6839","nonce":1466585795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":17,"addr":"172.21.15.116:6837/2764513846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":2764513846},{"type":"v1","addr":"172.21.15.116:6837","nonce":2764513846}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.116:6839/1032741033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":1032741033},{"type":"v1","addr":"172.21.15.116:6839","nonce":1032741033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24446,24439,24431,24418]},"id":1}]} 2024-08-19T00:19:12.512 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 33 2024-08-19T00:19:12.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:12.509+0000 7fe7cbbdf640 1 -- 172.21.15.44:0/658949418 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fe7b00a2cf0 msgr2=0x7fe7b00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:12.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:12.509+0000 7fe7cbbdf640 1 --2- 172.21.15.44:0/658949418 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fe7b00a2cf0 0x7fe7b00a51b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe7c0011550 tx=0x7fe7c0005f90 comp rx=0 tx=0).stop 2024-08-19T00:19:12.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:12.509+0000 7fe7cbbdf640 1 -- 172.21.15.44:0/658949418 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe7c4100fb0 msgr2=0x7fe7c419a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:12.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:12.509+0000 7fe7cbbdf640 1 --2- 172.21.15.44:0/658949418 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe7c4100fb0 0x7fe7c419a8d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe7b400e9f0 tx=0x7fe7b400eeb0 comp rx=0 tx=0).stop 2024-08-19T00:19:12.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:12.509+0000 7fe7cbbdf640 1 -- 172.21.15.44:0/658949418 shutdown_connections 2024-08-19T00:19:12.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:12.509+0000 7fe7cbbdf640 1 --2- 172.21.15.44:0/658949418 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fe7b00a2cf0 0x7fe7b00a51b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:12.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:12.509+0000 7fe7cbbdf640 1 --2- 172.21.15.44:0/658949418 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe7c4100fb0 0x7fe7c419a8d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:12.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:12.509+0000 7fe7cbbdf640 1 --2- 172.21.15.44:0/658949418 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7c410e1b0 0x7fe7c419ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:12.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:12.509+0000 7fe7cbbdf640 1 --2- 172.21.15.44:0/658949418 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7c4100600 0x7fe7c419a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:12.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:12.509+0000 7fe7cbbdf640 1 -- 172.21.15.44:0/658949418 >> 172.21.15.44:0/658949418 conn(0x7fe7c40fc4d0 msgr2=0x7fe7c40fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:19:12.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:12.510+0000 7fe7cbbdf640 1 -- 172.21.15.44:0/658949418 shutdown_connections 2024-08-19T00:19:12.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:12.510+0000 7fe7cbbdf640 1 -- 172.21.15.44:0/658949418 wait complete. 2024-08-19T00:19:12.677 INFO:tasks.workunit.client.0.smithi044.stdout: 1 433929 9.19 MB/sec execute 157 sec latency 75.715 ms 2024-08-19T00:19:13.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:19:13 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/658949418' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:19:13.361 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:19:13 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/658949418' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:19:13.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:19:13 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/658949418' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:19:13.389 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24473 quiesce db / --timeout 90 --expiration 139.2 --await-for 45.0' 2024-08-19T00:19:13.390 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24473 quiesce db / --timeout 90 --expiration 139.2 --await-for 45.0 2024-08-19T00:19:13.670 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:19:13.677 INFO:tasks.workunit.client.0.smithi044.stdout: 1 436545 9.24 MB/sec execute 158 sec latency 18.464 ms 2024-08-19T00:19:14.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:19:14 smithi044 ceph-mon[18489]: pgmap v180: 129 pgs: 129 active+clean; 273 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.2 MiB/s wr, 248 op/s 2024-08-19T00:19:14.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.262+0000 7fcd67a30640 1 -- 172.21.15.44:0/2553473215 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcd601018b0 msgr2=0x7fcd60101d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:14.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.262+0000 7fcd67a30640 1 --2- 172.21.15.44:0/2553473215 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcd601018b0 0x7fcd60101d10 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fcd50009930 tx=0x7fcd5002a420 comp rx=0 tx=0).stop 2024-08-19T00:19:14.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.262+0000 7fcd67a30640 1 -- 172.21.15.44:0/2553473215 shutdown_connections 2024-08-19T00:19:14.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.262+0000 7fcd67a30640 1 --2- 172.21.15.44:0/2553473215 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcd60102250 0x7fcd6010e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:14.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.262+0000 7fcd67a30640 1 --2- 172.21.15.44:0/2553473215 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcd601018b0 0x7fcd60101d10 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:14.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.262+0000 7fcd67a30640 1 --2- 172.21.15.44:0/2553473215 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcd601078b0 0x7fcd60107c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:14.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.262+0000 7fcd67a30640 1 -- 172.21.15.44:0/2553473215 >> 172.21.15.44:0/2553473215 conn(0x7fcd600fd5f0 msgr2=0x7fcd600ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:19:14.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.262+0000 7fcd67a30640 1 -- 172.21.15.44:0/2553473215 shutdown_connections 2024-08-19T00:19:14.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.262+0000 7fcd67a30640 1 -- 172.21.15.44:0/2553473215 wait complete. 2024-08-19T00:19:14.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.263+0000 7fcd67a30640 1 Processor -- start 2024-08-19T00:19:14.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.263+0000 7fcd67a30640 1 -- start start 2024-08-19T00:19:14.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.263+0000 7fcd67a30640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcd601018b0 0x7fcd601981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:14.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.263+0000 7fcd67a30640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcd60102250 0x7fcd60198730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:14.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.263+0000 7fcd67a30640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcd601078b0 0x7fcd6019cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:14.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.263+0000 7fcd67a30640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fcd60111cb0 con 0x7fcd601018b0 2024-08-19T00:19:14.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.263+0000 7fcd67a30640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fcd60111b30 con 0x7fcd601078b0 2024-08-19T00:19:14.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.263+0000 7fcd67a30640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fcd60111e30 con 0x7fcd60102250 2024-08-19T00:19:14.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.263+0000 7fcd657cc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcd601018b0 0x7fcd601981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:14.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.263+0000 7fcd657cc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcd601018b0 0x7fcd601981f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60398/0 (socket says 172.21.15.44:60398) 2024-08-19T00:19:14.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.263+0000 7fcd657cc640 1 -- 172.21.15.44:0/1724065206 learned_addr learned my addr 172.21.15.44:0/1724065206 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:19:14.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.263+0000 7fcd64fcb640 1 --2- 172.21.15.44:0/1724065206 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcd60102250 0x7fcd60198730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:14.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.263+0000 7fcd65fcd640 1 --2- 172.21.15.44:0/1724065206 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcd601078b0 0x7fcd6019cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:14.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.264+0000 7fcd657cc640 1 -- 172.21.15.44:0/1724065206 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcd60102250 msgr2=0x7fcd60198730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:14.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.264+0000 7fcd657cc640 1 --2- 172.21.15.44:0/1724065206 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcd60102250 0x7fcd60198730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:14.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.264+0000 7fcd657cc640 1 -- 172.21.15.44:0/1724065206 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcd601078b0 msgr2=0x7fcd6019cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:14.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.264+0000 7fcd657cc640 1 --2- 172.21.15.44:0/1724065206 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcd601078b0 0x7fcd6019cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:14.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.264+0000 7fcd657cc640 1 -- 172.21.15.44:0/1724065206 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd6019d1a0 con 0x7fcd601018b0 2024-08-19T00:19:14.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.264+0000 7fcd657cc640 1 --2- 172.21.15.44:0/1724065206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcd601018b0 0x7fcd601981f0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c00e9f0 tx=0x7fcd5c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:19:14.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.264+0000 7fcd567fc640 1 -- 172.21.15.44:0/1724065206 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd5c00ccc0 con 0x7fcd601018b0 2024-08-19T00:19:14.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.264+0000 7fcd67a30640 1 -- 172.21.15.44:0/1724065206 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd6019d490 con 0x7fcd601018b0 2024-08-19T00:19:14.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.264+0000 7fcd567fc640 1 -- 172.21.15.44:0/1724065206 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd5c00ce60 con 0x7fcd601018b0 2024-08-19T00:19:14.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.264+0000 7fcd567fc640 1 -- 172.21.15.44:0/1724065206 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd5c010690 con 0x7fcd601018b0 2024-08-19T00:19:14.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.264+0000 7fcd67a30640 1 -- 172.21.15.44:0/1724065206 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd601a4d70 con 0x7fcd601018b0 2024-08-19T00:19:14.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.267+0000 7fcd567fc640 1 -- 172.21.15.44:0/1724065206 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fcd5c0046c0 con 0x7fcd601018b0 2024-08-19T00:19:14.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.267+0000 7fcd69e2e740 1 Processor -- start 2024-08-19T00:19:14.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.267+0000 7fcd69e2e740 1 -- start start 2024-08-19T00:19:14.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.267+0000 7fcd69e2e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aa1c727ff0 0x55aa1c7283d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:14.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.267+0000 7fcd69e2e740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55aa1c728910 0x55aa1c7371e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:14.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.267+0000 7fcd567fc640 1 --2- 172.21.15.44:0/1724065206 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fcd4c0a2cf0 0x7fcd4c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:14.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.267+0000 7fcd69e2e740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aa1c737720 0x55aa1c739b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:14.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.267+0000 7fcd69e2e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55aa1c68da70 con 0x55aa1c727ff0 2024-08-19T00:19:14.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.267+0000 7fcd69e2e740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55aa1c625780 con 0x55aa1c728910 2024-08-19T00:19:14.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.267+0000 7fcd69e2e740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55aa1c689a30 con 0x55aa1c737720 2024-08-19T00:19:14.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.267+0000 7fcd65fcd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aa1c727ff0 0x55aa1c7283d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:14.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.267+0000 7fcd65fcd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aa1c727ff0 0x55aa1c7283d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60402/0 (socket says 172.21.15.44:60402) 2024-08-19T00:19:14.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.268+0000 7fcd64fcb640 1 --2- 172.21.15.44:0/1724065206 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fcd4c0a2cf0 0x7fcd4c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:14.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.268+0000 7fcd65fcd640 1 -- 172.21.15.44:0/3855220970 learned_addr learned my addr 172.21.15.44:0/3855220970 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:19:14.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.268+0000 7fcd657cc640 1 --2- 172.21.15.44:0/3855220970 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55aa1c728910 0x55aa1c7371e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:14.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.268+0000 7fcd65fcd640 1 --2- 172.21.15.44:0/3855220970 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aa1c737720 0x55aa1c739b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:14.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.268+0000 7fcd567fc640 1 -- 172.21.15.44:0/1724065206 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7fcd5c0cfbe0 con 0x7fcd601018b0 2024-08-19T00:19:14.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.268+0000 7fcd65fcd640 1 -- 172.21.15.44:0/3855220970 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aa1c737720 msgr2=0x55aa1c739b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:14.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.268+0000 7fcd65fcd640 1 --2- 172.21.15.44:0/3855220970 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aa1c737720 0x55aa1c739b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:14.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.268+0000 7fcd65fcd640 1 -- 172.21.15.44:0/3855220970 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55aa1c728910 msgr2=0x55aa1c7371e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:14.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.268+0000 7fcd65fcd640 1 --2- 172.21.15.44:0/3855220970 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55aa1c728910 0x55aa1c7371e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:14.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.268+0000 7fcd65fcd640 1 -- 172.21.15.44:0/3855220970 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa1c3ffb90 con 0x55aa1c727ff0 2024-08-19T00:19:14.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.268+0000 7fcd64fcb640 1 --2- 172.21.15.44:0/1724065206 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fcd4c0a2cf0 0x7fcd4c0a51b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcd50009900 tx=0x7fcd500058d0 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:19:14.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.268+0000 7fcd65fcd640 1 --2- 172.21.15.44:0/3855220970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aa1c727ff0 0x55aa1c7283d0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fcd58013b70 tx=0x7fcd58009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af2fc76b96de6876 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:19:14.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.269+0000 7fcd4b7fe640 1 -- 172.21.15.44:0/3855220970 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd58013130 con 0x55aa1c727ff0 2024-08-19T00:19:14.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.269+0000 7fcd4b7fe640 1 -- 172.21.15.44:0/3855220970 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd58013c60 con 0x55aa1c727ff0 2024-08-19T00:19:14.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.269+0000 7fcd4b7fe640 1 -- 172.21.15.44:0/3855220970 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd58003cf0 con 0x55aa1c727ff0 2024-08-19T00:19:14.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.269+0000 7fcd69e2e740 1 -- 172.21.15.44:0/3855220970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aa1c727ff0 msgr2=0x55aa1c7283d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:14.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.269+0000 7fcd69e2e740 1 --2- 172.21.15.44:0/3855220970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aa1c727ff0 0x55aa1c7283d0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fcd58013b70 tx=0x7fcd58009900 comp rx=0 tx=0).stop 2024-08-19T00:19:14.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.270+0000 7fcd69e2e740 1 -- 172.21.15.44:0/3855220970 shutdown_connections 2024-08-19T00:19:14.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.270+0000 7fcd69e2e740 1 --2- 172.21.15.44:0/3855220970 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aa1c737720 0x55aa1c739b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:14.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.270+0000 7fcd69e2e740 1 --2- 172.21.15.44:0/3855220970 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55aa1c728910 0x55aa1c7371e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:14.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.270+0000 7fcd69e2e740 1 --2- 172.21.15.44:0/3855220970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aa1c727ff0 0x55aa1c7283d0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:14.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.270+0000 7fcd69e2e740 1 -- 172.21.15.44:0/3855220970 >> 172.21.15.44:0/3855220970 conn(0x55aa1c7246c0 msgr2=0x55aa1c724aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:19:14.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.270+0000 7fcd69e2e740 1 -- 172.21.15.44:0/3855220970 shutdown_connections 2024-08-19T00:19:14.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.270+0000 7fcd69e2e740 1 -- 172.21.15.44:0/3855220970 wait complete. 2024-08-19T00:19:14.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.270+0000 7fcd69e2e740 1 -- start start 2024-08-19T00:19:14.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.270+0000 7fcd69e2e740 1 Processor -- start 2024-08-19T00:19:14.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.271+0000 7fcd69e2e740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aa1c727ff0 0x55aa1c734680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:14.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.271+0000 7fcd69e2e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aa1c728910 0x55aa1c734bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:14.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.271+0000 7fcd69e2e740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55aa1c737720 0x55aa1c735100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:14.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.271+0000 7fcd69e2e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55aa1c73a290 con 0x55aa1c728910 2024-08-19T00:19:14.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.271+0000 7fcd69e2e740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55aa1c648990 con 0x55aa1c737720 2024-08-19T00:19:14.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.271+0000 7fcd69e2e740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55aa1c73a410 con 0x55aa1c727ff0 2024-08-19T00:19:14.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.271+0000 7fcd69e2e740 10 client.0 _ll_register_callbacks cb 0x55aa1c39d090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:19:14.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.271+0000 7fcd64fcb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aa1c728910 0x55aa1c734bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:14.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.271+0000 7fcd64fcb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aa1c728910 0x55aa1c734bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60404/0 (socket says 172.21.15.44:60404) 2024-08-19T00:19:14.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.271+0000 7fcd64fcb640 1 -- 172.21.15.44:0/3884486010 learned_addr learned my addr 172.21.15.44:0/3884486010 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:19:14.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.271+0000 7fcd657cc640 1 --2- 172.21.15.44:0/3884486010 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aa1c727ff0 0x55aa1c734680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:14.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.271+0000 7fcd65fcd640 1 --2- 172.21.15.44:0/3884486010 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55aa1c737720 0x55aa1c735100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:14.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.271+0000 7fcd64fcb640 1 -- 172.21.15.44:0/3884486010 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aa1c727ff0 msgr2=0x55aa1c734680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:14.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.271+0000 7fcd64fcb640 1 --2- 172.21.15.44:0/3884486010 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aa1c727ff0 0x55aa1c734680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:14.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.271+0000 7fcd64fcb640 1 -- 172.21.15.44:0/3884486010 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55aa1c737720 msgr2=0x55aa1c735100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:14.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.271+0000 7fcd64fcb640 1 --2- 172.21.15.44:0/3884486010 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55aa1c737720 0x55aa1c735100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:14.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.271+0000 7fcd64fcb640 1 -- 172.21.15.44:0/3884486010 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa1c6476c0 con 0x55aa1c728910 2024-08-19T00:19:14.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.271+0000 7fcd64fcb640 1 --2- 172.21.15.44:0/3884486010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aa1c728910 0x55aa1c734bc0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fcd50009930 tx=0x7fcd50009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c94ee64790cc2b5 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:19:14.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.271+0000 7fcd48ff9640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:19:14.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.272+0000 7fcd48ff9640 1 -- 172.21.15.44:0/3884486010 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd5004d020 con 0x55aa1c728910 2024-08-19T00:19:14.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.272+0000 7fcd69e2e740 1 -- 172.21.15.44:0/3884486010 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd58013c60 con 0x55aa1c728910 2024-08-19T00:19:14.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.272+0000 7fcd48ff9640 1 -- 172.21.15.44:0/3884486010 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7fcd500035f0 con 0x55aa1c728910 2024-08-19T00:19:14.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.272+0000 7fcd48ff9640 1 -- 172.21.15.44:0/3884486010 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fcd50058050 con 0x55aa1c728910 2024-08-19T00:19:14.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.272+0000 7fcd69e2e740 10 client.16224 fetch_fsmap learned FSMap version 33 2024-08-19T00:19:14.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.272+0000 7fcd69e2e740 1 -- 172.21.15.44:0/3884486010 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55aa1c746050 con 0x55aa1c728910 2024-08-19T00:19:14.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.272+0000 7fcd48ff9640 1 -- 172.21.15.44:0/3884486010 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd58013c60 con 0x55aa1c728910 2024-08-19T00:19:14.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.272+0000 7fcd48ff9640 1 -- 172.21.15.44:0/3884486010 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7fcd50049ab0 con 0x55aa1c728910 2024-08-19T00:19:14.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.272+0000 7fcd69e2e740 10 client.16224 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:19:14.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.272+0000 7fcd69e2e740 10 client.16224 resolve_mds: validated gid 24473 aka daemon mds.b 2024-08-19T00:19:14.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.272+0000 7fcd69e2e740 20 client.16224 populate_metadata read hostname 'smithi044' 2024-08-19T00:19:14.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.272+0000 7fcd69e2e740 1 --2- 172.21.15.44:0/3884486010 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55aa1c7474b0 0x55aa1c7498f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:14.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.272+0000 7fcd69e2e740 4 client.16224 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:19:14.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.272+0000 7fcd69e2e740 1 -- 172.21.15.44:0/3884486010 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aa1c69b1a0 con 0x55aa1c7474b0 2024-08-19T00:19:14.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.273+0000 7fcd657cc640 1 --2- 172.21.15.44:0/3884486010 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55aa1c7474b0 0x55aa1c7498f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:14.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.273+0000 7fcd48ff9640 10 client.16224 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:19:14.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.273+0000 7fcd657cc640 1 --2- 172.21.15.44:0/3884486010 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55aa1c7474b0 0x55aa1c7498f0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e67c3eb1b402b25d server_cookie=864d7364f4725f80 in_seq=0 out_seq=0 2024-08-19T00:19:14.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.274+0000 7fcd48ff9640 1 -- 172.21.15.44:0/3884486010 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55aa1c69b1a0 con 0x55aa1c7474b0 2024-08-19T00:19:14.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.274+0000 7fcd48ff9640 10 client.16224 handle_command_reply: tid=0 2024-08-19T00:19:14.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.274+0000 7fcd69e2e740 1 client.16224 shutdown 2024-08-19T00:19:14.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.274+0000 7fcd69e2e740 1 -- 172.21.15.44:0/3884486010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aa1c728910 msgr2=0x55aa1c734bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:14.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.274+0000 7fcd69e2e740 1 --2- 172.21.15.44:0/3884486010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aa1c728910 0x55aa1c734bc0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fcd50009930 tx=0x7fcd50009260 comp rx=0 tx=0).stop 2024-08-19T00:19:14.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.274+0000 7fcd69e2e740 1 -- 172.21.15.44:0/3884486010 shutdown_connections 2024-08-19T00:19:14.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.274+0000 7fcd69e2e740 1 --2- 172.21.15.44:0/3884486010 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55aa1c7474b0 0x55aa1c7498f0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:14.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.274+0000 7fcd69e2e740 1 --2- 172.21.15.44:0/3884486010 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55aa1c737720 0x55aa1c735100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:14.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.274+0000 7fcd48ff9640 0 client.16224 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:19:14.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.274+0000 7fcd69e2e740 1 --2- 172.21.15.44:0/3884486010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aa1c728910 0x55aa1c734bc0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:14.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.274+0000 7fcd69e2e740 1 --2- 172.21.15.44:0/3884486010 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aa1c727ff0 0x55aa1c734680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:14.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.274+0000 7fcd69e2e740 1 -- 172.21.15.44:0/3884486010 >> 172.21.15.44:0/3884486010 conn(0x55aa1c7246c0 msgr2=0x55aa1c72a420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:19:14.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.274+0000 7fcd69e2e740 1 -- 172.21.15.44:0/3884486010 shutdown_connections 2024-08-19T00:19:14.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.274+0000 7fcd69e2e740 1 -- 172.21.15.44:0/3884486010 wait complete. 2024-08-19T00:19:14.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.274+0000 7fcd69e2e740 20 client.16224 trim_cache size 0 max 16384 2024-08-19T00:19:14.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.293+0000 7fcd69e2e740 1 Processor -- start 2024-08-19T00:19:14.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.293+0000 7fcd69e2e740 1 -- start start 2024-08-19T00:19:14.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.294+0000 7fcd69e2e740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55aa1c727ff0 0x55aa1c734f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:14.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.294+0000 7fcd69e2e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aa1c728910 0x55aa1c7235e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:14.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.294+0000 7fcd69e2e740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aa1c737720 0x55aa1c723b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:14.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.294+0000 7fcd69e2e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fcd601acbf0 con 0x55aa1c728910 2024-08-19T00:19:14.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.294+0000 7fcd69e2e740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fcd601ae730 con 0x55aa1c727ff0 2024-08-19T00:19:14.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.294+0000 7fcd69e2e740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fcd601ad2c0 con 0x55aa1c737720 2024-08-19T00:19:14.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.294+0000 7fcd64fcb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aa1c728910 0x55aa1c7235e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:14.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.294+0000 7fcd64fcb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aa1c728910 0x55aa1c7235e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60408/0 (socket says 172.21.15.44:60408) 2024-08-19T00:19:14.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.294+0000 7fcd64fcb640 1 -- 172.21.15.44:0/2321183285 learned_addr learned my addr 172.21.15.44:0/2321183285 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:19:14.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.294+0000 7fcd657cc640 1 --2- 172.21.15.44:0/2321183285 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55aa1c727ff0 0x55aa1c734f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:14.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.294+0000 7fcd65fcd640 1 --2- 172.21.15.44:0/2321183285 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aa1c737720 0x55aa1c723b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:14.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.294+0000 7fcd657cc640 1 -- 172.21.15.44:0/2321183285 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aa1c737720 msgr2=0x55aa1c723b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:14.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.294+0000 7fcd657cc640 1 --2- 172.21.15.44:0/2321183285 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aa1c737720 0x55aa1c723b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:14.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.294+0000 7fcd657cc640 1 -- 172.21.15.44:0/2321183285 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aa1c728910 msgr2=0x55aa1c7235e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:14.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.294+0000 7fcd657cc640 1 --2- 172.21.15.44:0/2321183285 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aa1c728910 0x55aa1c7235e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:14.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.294+0000 7fcd657cc640 1 -- 172.21.15.44:0/2321183285 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa1c722c70 con 0x55aa1c727ff0 2024-08-19T00:19:14.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.294+0000 7fcd64fcb640 1 --2- 172.21.15.44:0/2321183285 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aa1c728910 0x55aa1c7235e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:19:14.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.294+0000 7fcd657cc640 1 --2- 172.21.15.44:0/2321183285 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55aa1c727ff0 0x55aa1c734f50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c0ccf00 tx=0x7fcd5c005720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fda58ef48a068823 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:19:14.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.294+0000 7fcd4affd640 1 -- 172.21.15.44:0/2321183285 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd5c09bd00 con 0x55aa1c727ff0 2024-08-19T00:19:14.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.295+0000 7fcd4affd640 1 -- 172.21.15.44:0/2321183285 <== mon.2 v2:172.21.15.116:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd5c0b8030 con 0x55aa1c727ff0 2024-08-19T00:19:14.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.295+0000 7fcd4affd640 1 -- 172.21.15.44:0/2321183285 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd5c0a44e0 con 0x55aa1c727ff0 2024-08-19T00:19:14.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.295+0000 7fcd69e2e740 1 -- 172.21.15.44:0/2321183285 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55aa1c727ff0 msgr2=0x55aa1c734f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:14.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.295+0000 7fcd69e2e740 1 --2- 172.21.15.44:0/2321183285 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55aa1c727ff0 0x55aa1c734f50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c0ccf00 tx=0x7fcd5c005720 comp rx=0 tx=0).stop 2024-08-19T00:19:14.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.295+0000 7fcd69e2e740 1 -- 172.21.15.44:0/2321183285 shutdown_connections 2024-08-19T00:19:14.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.295+0000 7fcd69e2e740 1 --2- 172.21.15.44:0/2321183285 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aa1c737720 0x55aa1c723b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:14.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.295+0000 7fcd69e2e740 1 --2- 172.21.15.44:0/2321183285 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aa1c728910 0x55aa1c7235e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:14.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.295+0000 7fcd69e2e740 1 --2- 172.21.15.44:0/2321183285 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55aa1c727ff0 0x55aa1c734f50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:14.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.295+0000 7fcd69e2e740 1 -- 172.21.15.44:0/2321183285 >> 172.21.15.44:0/2321183285 conn(0x55aa1c7246c0 msgr2=0x55aa1c722ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:19:14.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.295+0000 7fcd69e2e740 1 -- 172.21.15.44:0/2321183285 shutdown_connections 2024-08-19T00:19:14.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.295+0000 7fcd69e2e740 1 -- 172.21.15.44:0/2321183285 wait complete. 2024-08-19T00:19:14.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.296+0000 7fcd69e2e740 1 -- start start 2024-08-19T00:19:14.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.296+0000 7fcd69e2e740 1 Processor -- start 2024-08-19T00:19:14.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.296+0000 7fcd69e2e740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55aa1c727ff0 0x55aa1c73b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:14.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.296+0000 7fcd69e2e740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aa1c728910 0x55aa1c73bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:14.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.296+0000 7fcd69e2e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aa1c737720 0x55aa1c7b1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:14.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.296+0000 7fcd69e2e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fcd601ae060 con 0x55aa1c737720 2024-08-19T00:19:14.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.296+0000 7fcd69e2e740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fcd601ad990 con 0x55aa1c727ff0 2024-08-19T00:19:14.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.296+0000 7fcd69e2e740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fcd601aabd0 con 0x55aa1c728910 2024-08-19T00:19:14.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.296+0000 7fcd69e2e740 10 client.0 _ll_register_callbacks cb 0x7fcd50040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:19:14.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.296+0000 7fcd657cc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55aa1c727ff0 0x55aa1c73b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:14.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.296+0000 7fcd64fcb640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aa1c728910 0x55aa1c73bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:14.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.296+0000 7fcd657cc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55aa1c727ff0 0x55aa1c73b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.44:49192/0 (socket says 172.21.15.44:49192) 2024-08-19T00:19:14.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.296+0000 7fcd65fcd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aa1c737720 0x55aa1c7b1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:14.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.296+0000 7fcd657cc640 1 -- 172.21.15.44:0/912551691 learned_addr learned my addr 172.21.15.44:0/912551691 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:19:14.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.297+0000 7fcd64fcb640 1 -- 172.21.15.44:0/912551691 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55aa1c727ff0 msgr2=0x55aa1c73b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:14.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.297+0000 7fcd64fcb640 1 --2- 172.21.15.44:0/912551691 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55aa1c727ff0 0x55aa1c73b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:14.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.297+0000 7fcd64fcb640 1 -- 172.21.15.44:0/912551691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aa1c737720 msgr2=0x55aa1c7b1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:14.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.297+0000 7fcd64fcb640 1 --2- 172.21.15.44:0/912551691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aa1c737720 0x55aa1c7b1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:14.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.297+0000 7fcd64fcb640 1 -- 172.21.15.44:0/912551691 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa1c7b16d0 con 0x55aa1c728910 2024-08-19T00:19:14.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.297+0000 7fcd657cc640 1 --2- 172.21.15.44:0/912551691 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55aa1c727ff0 0x55aa1c73b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:19:14.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.297+0000 7fcd64fcb640 1 --2- 172.21.15.44:0/912551691 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aa1c728910 0x55aa1c73bd80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcd50049f00 tx=0x7fcd500045c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46f7f5456630c5fc server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:19:14.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.297+0000 7fcd48ff9640 10 client.0 ms_handle_connect on v2:172.21.15.171:3300/0 2024-08-19T00:19:14.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.297+0000 7fcd48ff9640 1 -- 172.21.15.44:0/912551691 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd50062070 con 0x55aa1c728910 2024-08-19T00:19:14.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.297+0000 7fcd69e2e740 1 -- 172.21.15.44:0/912551691 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd5c0b8030 con 0x55aa1c728910 2024-08-19T00:19:14.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.297+0000 7fcd48ff9640 1 -- 172.21.15.44:0/912551691 <== mon.1 v2:172.21.15.171:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7fcd5003ca30 con 0x55aa1c728910 2024-08-19T00:19:14.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.297+0000 7fcd48ff9640 1 -- 172.21.15.44:0/912551691 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fcd5006e050 con 0x55aa1c728910 2024-08-19T00:19:14.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.297+0000 7fcd69e2e740 10 client.25573 fetch_fsmap learned FSMap version 33 2024-08-19T00:19:14.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.297+0000 7fcd69e2e740 1 -- 172.21.15.44:0/912551691 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55aa1c7b2850 con 0x55aa1c728910 2024-08-19T00:19:14.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.298+0000 7fcd48ff9640 1 -- 172.21.15.44:0/912551691 <== mon.1 v2:172.21.15.171:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd5c0b8030 con 0x55aa1c728910 2024-08-19T00:19:14.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.298+0000 7fcd48ff9640 1 -- 172.21.15.44:0/912551691 <== mon.1 v2:172.21.15.171:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7fcd500035f0 con 0x55aa1c728910 2024-08-19T00:19:14.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.298+0000 7fcd69e2e740 10 client.25573 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:19:14.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.298+0000 7fcd69e2e740 10 client.25573 resolve_mds: validated gid 24473 aka daemon mds.b 2024-08-19T00:19:14.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.298+0000 7fcd69e2e740 20 client.25573 populate_metadata read hostname 'smithi044' 2024-08-19T00:19:14.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.298+0000 7fcd69e2e740 1 --2- 172.21.15.44:0/912551691 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55aa1c7474b0 0x55aa1c7b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:14.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.298+0000 7fcd69e2e740 4 client.25573 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.2, "await_for": 45.0}] 2024-08-19T00:19:14.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.298+0000 7fcd69e2e740 1 -- 172.21.15.44:0/912551691 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.2, "await_for": 45.0}) -- 0x55aa1c6954f0 con 0x55aa1c7474b0 2024-08-19T00:19:14.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.298+0000 7fcd657cc640 1 --2- 172.21.15.44:0/912551691 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55aa1c7474b0 0x55aa1c7b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:14.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.298+0000 7fcd48ff9640 10 client.25573 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:19:14.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.298+0000 7fcd657cc640 1 --2- 172.21.15.44:0/912551691 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55aa1c7474b0 0x55aa1c7b5080 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c81d1452b9e7414 server_cookie=765f583701b56690 in_seq=0 out_seq=0 2024-08-19T00:19:14.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:19:14 smithi171 ceph-mon[21810]: pgmap v180: 129 pgs: 129 active+clean; 273 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.2 MiB/s wr, 248 op/s 2024-08-19T00:19:14.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:19:14 smithi116 ceph-mon[21873]: pgmap v180: 129 pgs: 129 active+clean; 273 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.2 MiB/s wr, 248 op/s 2024-08-19T00:19:14.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.369+0000 7fcd48ff9640 1 -- 172.21.15.44:0/912551691 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55aa1c6954f0 con 0x55aa1c7474b0 2024-08-19T00:19:14.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.369+0000 7fcd48ff9640 10 client.25573 handle_command_reply: tid=0 2024-08-19T00:19:14.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.369+0000 7fcd69e2e740 1 client.25573 shutdown 2024-08-19T00:19:14.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.369+0000 7fcd69e2e740 1 -- 172.21.15.44:0/912551691 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aa1c728910 msgr2=0x55aa1c73bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:14.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.369+0000 7fcd69e2e740 1 --2- 172.21.15.44:0/912551691 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aa1c728910 0x55aa1c73bd80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcd50049f00 tx=0x7fcd500045c0 comp rx=0 tx=0).stop 2024-08-19T00:19:14.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.369+0000 7fcd69e2e740 1 -- 172.21.15.44:0/912551691 shutdown_connections 2024-08-19T00:19:14.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.369+0000 7fcd69e2e740 1 --2- 172.21.15.44:0/912551691 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55aa1c7474b0 0x55aa1c7b5080 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:14.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.369+0000 7fcd69e2e740 1 --2- 172.21.15.44:0/912551691 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aa1c728910 0x55aa1c73bd80 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:14.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.369+0000 7fcd69e2e740 1 --2- 172.21.15.44:0/912551691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aa1c737720 0x55aa1c7b1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:14.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.369+0000 7fcd48ff9640 0 client.25573 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:19:14.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.369+0000 7fcd69e2e740 1 --2- 172.21.15.44:0/912551691 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55aa1c727ff0 0x55aa1c73b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:14.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.369+0000 7fcd69e2e740 1 -- 172.21.15.44:0/912551691 >> 172.21.15.44:0/912551691 conn(0x55aa1c7246c0 msgr2=0x55aa1c7236f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:19:14.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.369+0000 7fcd69e2e740 1 -- 172.21.15.44:0/912551691 shutdown_connections 2024-08-19T00:19:14.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.369+0000 7fcd69e2e740 1 -- 172.21.15.44:0/912551691 wait complete. 2024-08-19T00:19:14.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.370+0000 7fcd69e2e740 20 client.25573 trim_cache size 0 max 16384 2024-08-19T00:19:14.372 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-08-19T00:19:14.373 INFO:teuthology.orchestra.run.smithi044.stdout: "epoch": 33, 2024-08-19T00:19:14.373 INFO:teuthology.orchestra.run.smithi044.stdout: "leader": 24473, 2024-08-19T00:19:14.373 INFO:teuthology.orchestra.run.smithi044.stdout: "set_version": 18, 2024-08-19T00:19:14.373 INFO:teuthology.orchestra.run.smithi044.stdout: "sets": { 2024-08-19T00:19:14.373 INFO:teuthology.orchestra.run.smithi044.stdout: "47fffa16": { 2024-08-19T00:19:14.373 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 18, 2024-08-19T00:19:14.373 INFO:teuthology.orchestra.run.smithi044.stdout: "age_ref": 0.0, 2024-08-19T00:19:14.373 INFO:teuthology.orchestra.run.smithi044.stdout: "state": { 2024-08-19T00:19:14.373 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "QUIESCED", 2024-08-19T00:19:14.373 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.0 2024-08-19T00:19:14.373 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:19:14.373 INFO:teuthology.orchestra.run.smithi044.stdout: "timeout": 90.0, 2024-08-19T00:19:14.373 INFO:teuthology.orchestra.run.smithi044.stdout: "expiration": 139.2, 2024-08-19T00:19:14.374 INFO:teuthology.orchestra.run.smithi044.stdout: "members": { 2024-08-19T00:19:14.374 INFO:teuthology.orchestra.run.smithi044.stdout: "file:/": { 2024-08-19T00:19:14.374 INFO:teuthology.orchestra.run.smithi044.stdout: "excluded": false, 2024-08-19T00:19:14.374 INFO:teuthology.orchestra.run.smithi044.stdout: "state": { 2024-08-19T00:19:14.374 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "QUIESCED", 2024-08-19T00:19:14.374 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.0 2024-08-19T00:19:14.374 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:19:14.374 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:19:14.374 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:19:14.374 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:19:14.374 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:19:14.374 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-08-19T00:19:14.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.370+0000 7fcd67a30640 1 -- 172.21.15.44:0/1724065206 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fcd4c0a2cf0 msgr2=0x7fcd4c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:14.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.370+0000 7fcd67a30640 1 --2- 172.21.15.44:0/1724065206 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fcd4c0a2cf0 0x7fcd4c0a51b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcd50009900 tx=0x7fcd500058d0 comp rx=0 tx=0).stop 2024-08-19T00:19:14.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.370+0000 7fcd67a30640 1 -- 172.21.15.44:0/1724065206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcd601018b0 msgr2=0x7fcd601981f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:14.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.370+0000 7fcd67a30640 1 --2- 172.21.15.44:0/1724065206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcd601018b0 0x7fcd601981f0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c00e9f0 tx=0x7fcd5c00edf0 comp rx=0 tx=0).stop 2024-08-19T00:19:14.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.370+0000 7fcd67a30640 1 -- 172.21.15.44:0/1724065206 shutdown_connections 2024-08-19T00:19:14.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.370+0000 7fcd67a30640 1 --2- 172.21.15.44:0/1724065206 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fcd4c0a2cf0 0x7fcd4c0a51b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:14.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.370+0000 7fcd67a30640 1 --2- 172.21.15.44:0/1724065206 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcd60102250 0x7fcd60198730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:14.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.370+0000 7fcd67a30640 1 --2- 172.21.15.44:0/1724065206 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcd601078b0 0x7fcd6019cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:14.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.370+0000 7fcd67a30640 1 --2- 172.21.15.44:0/1724065206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcd601018b0 0x7fcd601981f0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:14.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.370+0000 7fcd67a30640 1 -- 172.21.15.44:0/1724065206 >> 172.21.15.44:0/1724065206 conn(0x7fcd600fd5f0 msgr2=0x7fcd600fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:19:14.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.370+0000 7fcd67a30640 1 -- 172.21.15.44:0/1724065206 shutdown_connections 2024-08-19T00:19:14.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:14.371+0000 7fcd67a30640 1 -- 172.21.15.44:0/1724065206 wait complete. 2024-08-19T00:19:14.677 INFO:tasks.workunit.client.0.smithi044.stdout: 1 437417 9.19 MB/sec execute 159 sec latency 309.682 ms 2024-08-19T00:19:15.066 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '47fffa16', quiesce took 3.6 seconds. Will release after: 15.6 2024-08-19T00:19:15.678 INFO:tasks.workunit.client.0.smithi044.stdout: 1 437417 9.14 MB/sec execute 160 sec latency 1309.767 ms 2024-08-19T00:19:16.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:19:16 smithi171 ceph-mon[21810]: pgmap v181: 129 pgs: 129 active+clean; 282 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 4.9 MiB/s wr, 357 op/s 2024-08-19T00:19:16.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:19:16 smithi116 ceph-mon[21873]: pgmap v181: 129 pgs: 129 active+clean; 282 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 4.9 MiB/s wr, 357 op/s 2024-08-19T00:19:16.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:19:16 smithi044 ceph-mon[18489]: pgmap v181: 129 pgs: 129 active+clean; 282 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 4.9 MiB/s wr, 357 op/s 2024-08-19T00:19:16.678 INFO:tasks.workunit.client.0.smithi044.stdout: 1 437417 9.08 MB/sec execute 161 sec latency 2309.918 ms 2024-08-19T00:19:17.303 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.299+0000 7f1493f68640 1 -- 172.21.15.44:0/3068817581 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f148c101080 msgr2=0x7f148c10d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:17.303 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.299+0000 7f1493f68640 1 --2- 172.21.15.44:0/3068817581 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f148c101080 0x7f148c10d5b0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f1484009cd0 tx=0x7f148402a8e0 comp rx=0 tx=0).stop 2024-08-19T00:19:17.303 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.299+0000 7f1493f68640 1 -- 172.21.15.44:0/3068817581 shutdown_connections 2024-08-19T00:19:17.303 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.299+0000 7f1493f68640 1 --2- 172.21.15.44:0/3068817581 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f148c101080 0x7f148c10d5b0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:17.303 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.299+0000 7f1493f68640 1 --2- 172.21.15.44:0/3068817581 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f148c1006e0 0x7f148c100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:17.303 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.299+0000 7f1493f68640 1 --2- 172.21.15.44:0/3068817581 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f148c1066f0 0x7f148c106ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:17.303 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.299+0000 7f1493f68640 1 -- 172.21.15.44:0/3068817581 >> 172.21.15.44:0/3068817581 conn(0x7f148c0776c0 msgr2=0x7f148c0fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:19:17.303 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.299+0000 7f1493f68640 1 -- 172.21.15.44:0/3068817581 shutdown_connections 2024-08-19T00:19:17.303 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.299+0000 7f1493f68640 1 -- 172.21.15.44:0/3068817581 wait complete. 2024-08-19T00:19:17.303 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.300+0000 7f1493f68640 1 Processor -- start 2024-08-19T00:19:17.304 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.300+0000 7f1493f68640 1 -- start start 2024-08-19T00:19:17.304 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.300+0000 7f1493f68640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f148c1006e0 0x7f148c198e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:17.304 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.300+0000 7f1493f68640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f148c101080 0x7f148c1993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:17.304 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.300+0000 7f1493f68640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f148c1066f0 0x7f148c1a3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:17.304 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.300+0000 7f1493f68640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f148c110b30 con 0x7f148c1006e0 2024-08-19T00:19:17.304 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.300+0000 7f1493f68640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f148c1109b0 con 0x7f148c1066f0 2024-08-19T00:19:17.304 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.300+0000 7f1493f68640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f148c110cb0 con 0x7f148c101080 2024-08-19T00:19:17.304 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.300+0000 7f1491d04640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f148c1006e0 0x7f148c198e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:17.304 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.300+0000 7f1491d04640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f148c1006e0 0x7f148c198e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60444/0 (socket says 172.21.15.44:60444) 2024-08-19T00:19:17.304 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.300+0000 7f1491d04640 1 -- 172.21.15.44:0/2060730300 learned_addr learned my addr 172.21.15.44:0/2060730300 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:19:17.304 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.300+0000 7f1491503640 1 --2- 172.21.15.44:0/2060730300 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f148c101080 0x7f148c1993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:17.304 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.300+0000 7f1492505640 1 --2- 172.21.15.44:0/2060730300 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f148c1066f0 0x7f148c1a3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:17.304 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.300+0000 7f1491d04640 1 -- 172.21.15.44:0/2060730300 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f148c101080 msgr2=0x7f148c1993c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:17.304 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.300+0000 7f1491d04640 1 --2- 172.21.15.44:0/2060730300 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f148c101080 0x7f148c1993c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:17.305 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.300+0000 7f1491d04640 1 -- 172.21.15.44:0/2060730300 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f148c1066f0 msgr2=0x7f148c1a3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:17.305 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.300+0000 7f1491d04640 1 --2- 172.21.15.44:0/2060730300 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f148c1066f0 0x7f148c1a3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:17.305 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.300+0000 7f1491d04640 1 -- 172.21.15.44:0/2060730300 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f148c1a4440 con 0x7f148c1006e0 2024-08-19T00:19:17.305 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.301+0000 7f1491d04640 1 --2- 172.21.15.44:0/2060730300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f148c1006e0 0x7f148c198e80 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f148800e9f0 tx=0x7f148800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:19:17.305 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.301+0000 7f1482ffd640 1 -- 172.21.15.44:0/2060730300 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f148800cd80 con 0x7f148c1006e0 2024-08-19T00:19:17.305 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.301+0000 7f1482ffd640 1 -- 172.21.15.44:0/2060730300 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1488010910 con 0x7f148c1006e0 2024-08-19T00:19:17.305 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.301+0000 7f1493f68640 1 -- 172.21.15.44:0/2060730300 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f148c1a4610 con 0x7f148c1006e0 2024-08-19T00:19:17.305 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.301+0000 7f1482ffd640 1 -- 172.21.15.44:0/2060730300 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1488018990 con 0x7f148c1006e0 2024-08-19T00:19:17.305 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.301+0000 7f1493f68640 1 -- 172.21.15.44:0/2060730300 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f148c1a4b30 con 0x7f148c1006e0 2024-08-19T00:19:17.311 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.303+0000 7f1496e00740 1 Processor -- start 2024-08-19T00:19:17.311 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.303+0000 7f1482ffd640 1 -- 172.21.15.44:0/2060730300 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f1488010ac0 con 0x7f148c1006e0 2024-08-19T00:19:17.311 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.304+0000 7f1496e00740 1 -- start start 2024-08-19T00:19:17.311 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.304+0000 7f1496e00740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a3ae1a17d0 0x55a3ae1a1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:17.311 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.304+0000 7f1496e00740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a3ae1a20f0 0x55a3ae1ac450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:17.312 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.304+0000 7f1496e00740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a3ae1ac990 0x55a3ae1aed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:17.312 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.304+0000 7f1496e00740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a3ae1059d0 con 0x55a3ae1a20f0 2024-08-19T00:19:17.312 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.304+0000 7f1496e00740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55a3ae0ad820 con 0x55a3ae1a17d0 2024-08-19T00:19:17.312 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.304+0000 7f1496e00740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55a3ae101990 con 0x55a3ae1ac990 2024-08-19T00:19:17.312 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.304+0000 7f1491d04640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a3ae1a20f0 0x55a3ae1ac450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:17.312 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.304+0000 7f1491d04640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a3ae1a20f0 0x55a3ae1ac450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60452/0 (socket says 172.21.15.44:60452) 2024-08-19T00:19:17.312 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.304+0000 7f1491d04640 1 -- 172.21.15.44:0/278667352 learned_addr learned my addr 172.21.15.44:0/278667352 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:19:17.312 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.304+0000 7f1492505640 1 --2- 172.21.15.44:0/278667352 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a3ae1a17d0 0x55a3ae1a1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:17.312 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.304+0000 7f1482ffd640 1 --2- 172.21.15.44:0/2060730300 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f14780a2da0 0x7f14780a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:17.312 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.304+0000 7f1491503640 1 --2- 172.21.15.44:0/278667352 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a3ae1ac990 0x55a3ae1aed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:17.312 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.304+0000 7f1492505640 1 --2- 172.21.15.44:0/2060730300 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f14780a2da0 0x7f14780a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:17.312 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.304+0000 7f1482ffd640 1 -- 172.21.15.44:0/2060730300 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f14880cfa80 con 0x7f148c1006e0 2024-08-19T00:19:17.312 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.305+0000 7f1491d04640 1 -- 172.21.15.44:0/278667352 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a3ae1ac990 msgr2=0x55a3ae1aed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:17.313 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.305+0000 7f1491d04640 1 --2- 172.21.15.44:0/278667352 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a3ae1ac990 0x55a3ae1aed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:17.313 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.305+0000 7f1491d04640 1 -- 172.21.15.44:0/278667352 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a3ae1a17d0 msgr2=0x55a3ae1a1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:17.313 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.305+0000 7f1491d04640 1 --2- 172.21.15.44:0/278667352 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a3ae1a17d0 0x55a3ae1a1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:17.313 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.305+0000 7f1491d04640 1 -- 172.21.15.44:0/278667352 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3ade19210 con 0x55a3ae1a20f0 2024-08-19T00:19:17.313 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.305+0000 7f1492505640 1 --2- 172.21.15.44:0/278667352 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a3ae1a17d0 0x55a3ae1a1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:19:17.313 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.305+0000 7f1491d04640 1 --2- 172.21.15.44:0/278667352 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a3ae1a20f0 0x55a3ae1ac450 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f14880ccda0 tx=0x7f1488018420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ae2e5f6e1454239 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:19:17.313 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.305+0000 7f1492505640 1 --2- 172.21.15.44:0/2060730300 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f14780a2da0 0x7f14780a5260 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1484004ab0 tx=0x7f148402a8e0 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:19:17.313 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.305+0000 7f1477fff640 1 -- 172.21.15.44:0/278667352 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14880d7040 con 0x55a3ae1a20f0 2024-08-19T00:19:17.313 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.305+0000 7f1477fff640 1 -- 172.21.15.44:0/278667352 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f148809bcb0 con 0x55a3ae1a20f0 2024-08-19T00:19:17.313 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.305+0000 7f1477fff640 1 -- 172.21.15.44:0/278667352 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1488098320 con 0x55a3ae1a20f0 2024-08-19T00:19:17.313 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.306+0000 7f1496e00740 1 -- 172.21.15.44:0/278667352 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a3ae1a20f0 msgr2=0x55a3ae1ac450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:17.313 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.306+0000 7f1496e00740 1 --2- 172.21.15.44:0/278667352 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a3ae1a20f0 0x55a3ae1ac450 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f14880ccda0 tx=0x7f1488018420 comp rx=0 tx=0).stop 2024-08-19T00:19:17.313 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.306+0000 7f1496e00740 1 -- 172.21.15.44:0/278667352 shutdown_connections 2024-08-19T00:19:17.314 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.306+0000 7f1496e00740 1 --2- 172.21.15.44:0/278667352 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a3ae1ac990 0x55a3ae1aed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:17.314 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.306+0000 7f1496e00740 1 --2- 172.21.15.44:0/278667352 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a3ae1a20f0 0x55a3ae1ac450 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:17.314 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.306+0000 7f1496e00740 1 --2- 172.21.15.44:0/278667352 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a3ae1a17d0 0x55a3ae1a1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:17.314 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.306+0000 7f1496e00740 1 -- 172.21.15.44:0/278667352 >> 172.21.15.44:0/278667352 conn(0x55a3ae19dd40 msgr2=0x55a3ae19e120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:19:17.314 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.306+0000 7f1496e00740 1 -- 172.21.15.44:0/278667352 shutdown_connections 2024-08-19T00:19:17.314 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.306+0000 7f1496e00740 1 -- 172.21.15.44:0/278667352 wait complete. 2024-08-19T00:19:17.314 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.306+0000 7f1496e00740 1 -- start start 2024-08-19T00:19:17.314 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.306+0000 7f1496e00740 1 Processor -- start 2024-08-19T00:19:17.314 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.307+0000 7f1496e00740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a3ae1a17d0 0x55a3ae1a9880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:17.314 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.307+0000 7f1496e00740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a3ae1a20f0 0x55a3ae1a9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:17.314 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.307+0000 7f1496e00740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a3ae1ac990 0x55a3ae1aa300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:17.314 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.307+0000 7f1496e00740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a3ae1af500 con 0x55a3ae1ac990 2024-08-19T00:19:17.314 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.307+0000 7f1496e00740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55a3ae0c1520 con 0x55a3ae1a20f0 2024-08-19T00:19:17.314 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.307+0000 7f1496e00740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55a3ae1af680 con 0x55a3ae1a17d0 2024-08-19T00:19:17.315 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.307+0000 7f1496e00740 10 client.0 _ll_register_callbacks cb 0x55a3ade18a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:19:17.315 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.307+0000 7f1492505640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a3ae1ac990 0x55a3ae1aa300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:17.315 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.307+0000 7f1492505640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a3ae1ac990 0x55a3ae1aa300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60460/0 (socket says 172.21.15.44:60460) 2024-08-19T00:19:17.315 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.307+0000 7f1492505640 1 -- 172.21.15.44:0/1583003650 learned_addr learned my addr 172.21.15.44:0/1583003650 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:19:17.315 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.307+0000 7f1491d04640 1 --2- 172.21.15.44:0/1583003650 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a3ae1a17d0 0x55a3ae1a9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:17.315 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.307+0000 7f1491503640 1 --2- 172.21.15.44:0/1583003650 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a3ae1a20f0 0x55a3ae1a9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:17.315 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.307+0000 7f1492505640 1 -- 172.21.15.44:0/1583003650 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a3ae1a17d0 msgr2=0x55a3ae1a9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:17.315 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.307+0000 7f1492505640 1 --2- 172.21.15.44:0/1583003650 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a3ae1a17d0 0x55a3ae1a9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:17.315 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.307+0000 7f1492505640 1 -- 172.21.15.44:0/1583003650 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a3ae1a20f0 msgr2=0x55a3ae1a9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:17.315 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.307+0000 7f1492505640 1 --2- 172.21.15.44:0/1583003650 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a3ae1a20f0 0x55a3ae1a9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:17.315 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.307+0000 7f1492505640 1 -- 172.21.15.44:0/1583003650 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3adee5620 con 0x55a3ae1ac990 2024-08-19T00:19:17.315 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.307+0000 7f1491503640 1 --2- 172.21.15.44:0/1583003650 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a3ae1a20f0 0x55a3ae1a9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:19:17.315 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.307+0000 7f1492505640 1 --2- 172.21.15.44:0/1583003650 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a3ae1ac990 0x55a3ae1aa300 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f1484009cd0 tx=0x7f14840095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a76e27ebc463b93 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:19:17.316 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.307+0000 7f14757fa640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:19:17.316 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.307+0000 7f14757fa640 1 -- 172.21.15.44:0/1583003650 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f148404e030 con 0x55a3ae1ac990 2024-08-19T00:19:17.316 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.307+0000 7f1496e00740 1 -- 172.21.15.44:0/1583003650 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f148809bcb0 con 0x55a3ae1ac990 2024-08-19T00:19:17.316 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.307+0000 7f14757fa640 1 -- 172.21.15.44:0/1583003650 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f1484003e00 con 0x55a3ae1ac990 2024-08-19T00:19:17.316 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.308+0000 7f14757fa640 1 -- 172.21.15.44:0/1583003650 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f148405a050 con 0x55a3ae1ac990 2024-08-19T00:19:17.316 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.308+0000 7f1496e00740 10 client.16242 fetch_fsmap learned FSMap version 33 2024-08-19T00:19:17.316 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.308+0000 7f1496e00740 1 -- 172.21.15.44:0/1583003650 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55a3ae1bb170 con 0x55a3ae1ac990 2024-08-19T00:19:17.316 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.308+0000 7f14757fa640 1 -- 172.21.15.44:0/1583003650 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f148809bcb0 con 0x55a3ae1ac990 2024-08-19T00:19:17.316 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.308+0000 7f14757fa640 1 -- 172.21.15.44:0/1583003650 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f1484030070 con 0x55a3ae1ac990 2024-08-19T00:19:17.316 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.308+0000 7f1496e00740 10 client.16242 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:19:17.316 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.308+0000 7f1496e00740 10 client.16242 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:19:17.316 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.308+0000 7f1496e00740 20 client.16242 populate_metadata read hostname 'smithi044' 2024-08-19T00:19:17.316 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.308+0000 7f1496e00740 1 --2- 172.21.15.44:0/1583003650 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55a3ae1bc720 0x55a3ae1beb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:17.317 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.308+0000 7f1496e00740 4 client.16242 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:19:17.317 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.308+0000 7f1496e00740 1 -- 172.21.15.44:0/1583003650 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a3ae113100 con 0x55a3ae1bc720 2024-08-19T00:19:17.317 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.308+0000 7f1491d04640 1 --2- 172.21.15.44:0/1583003650 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55a3ae1bc720 0x55a3ae1beb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:17.317 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.309+0000 7f1491d04640 1 --2- 172.21.15.44:0/1583003650 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55a3ae1bc720 0x55a3ae1beb80 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ecd634ca92f2a71b server_cookie=e0a4490b00e176be in_seq=0 out_seq=0 2024-08-19T00:19:17.317 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.309+0000 7f14757fa640 10 client.16242 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:19:17.317 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.309+0000 7f14757fa640 1 -- 172.21.15.44:0/1583003650 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a3ae113100 con 0x55a3ae1bc720 2024-08-19T00:19:17.317 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.309+0000 7f14757fa640 10 client.16242 handle_command_reply: tid=0 2024-08-19T00:19:17.317 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.309+0000 7f1496e00740 1 client.16242 shutdown 2024-08-19T00:19:17.317 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.309+0000 7f1496e00740 1 -- 172.21.15.44:0/1583003650 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a3ae1ac990 msgr2=0x55a3ae1aa300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:17.317 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.309+0000 7f1496e00740 1 --2- 172.21.15.44:0/1583003650 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a3ae1ac990 0x55a3ae1aa300 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f1484009cd0 tx=0x7f14840095c0 comp rx=0 tx=0).stop 2024-08-19T00:19:17.317 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.310+0000 7f1496e00740 1 -- 172.21.15.44:0/1583003650 shutdown_connections 2024-08-19T00:19:17.317 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.310+0000 7f1496e00740 1 --2- 172.21.15.44:0/1583003650 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55a3ae1bc720 0x55a3ae1beb80 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:17.317 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.310+0000 7f1496e00740 1 --2- 172.21.15.44:0/1583003650 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a3ae1ac990 0x55a3ae1aa300 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:17.318 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.310+0000 7f1496e00740 1 --2- 172.21.15.44:0/1583003650 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a3ae1a20f0 0x55a3ae1a9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:17.318 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.310+0000 7f1496e00740 1 --2- 172.21.15.44:0/1583003650 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a3ae1a17d0 0x55a3ae1a9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:17.318 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.310+0000 7f14757fa640 0 client.16242 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:19:17.318 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.310+0000 7f1496e00740 1 -- 172.21.15.44:0/1583003650 >> 172.21.15.44:0/1583003650 conn(0x55a3ae19dd40 msgr2=0x55a3ae1a3aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:19:17.318 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.310+0000 7f1496e00740 1 -- 172.21.15.44:0/1583003650 shutdown_connections 2024-08-19T00:19:17.318 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.310+0000 7f1496e00740 1 -- 172.21.15.44:0/1583003650 wait complete. 2024-08-19T00:19:17.318 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.310+0000 7f1496e00740 20 client.16242 trim_cache size 0 max 16384 2024-08-19T00:19:17.330 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.324+0000 7f1496e00740 1 Processor -- start 2024-08-19T00:19:17.330 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.324+0000 7f1496e00740 1 -- start start 2024-08-19T00:19:17.330 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.324+0000 7f1496e00740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a3ae1a17d0 0x55a3ae1c4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:17.330 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.324+0000 7f1496e00740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a3ae1a20f0 0x55a3ae1c4990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:17.330 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.324+0000 7f1496e00740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a3ae1ac990 0x55a3ae1a3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:17.330 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.324+0000 7f1496e00740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f148c1aed00 con 0x55a3ae1a20f0 2024-08-19T00:19:17.330 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.324+0000 7f1496e00740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f148c1b0840 con 0x55a3ae1a17d0 2024-08-19T00:19:17.330 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.324+0000 7f1496e00740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f148c1af3d0 con 0x55a3ae1ac990 2024-08-19T00:19:17.330 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.324+0000 7f1491503640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a3ae1a20f0 0x55a3ae1c4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:17.331 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.324+0000 7f1491503640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a3ae1a20f0 0x55a3ae1c4990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60472/0 (socket says 172.21.15.44:60472) 2024-08-19T00:19:17.331 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.324+0000 7f1491503640 1 -- 172.21.15.44:0/3136467908 learned_addr learned my addr 172.21.15.44:0/3136467908 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:19:17.331 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.325+0000 7f1491d04640 1 --2- 172.21.15.44:0/3136467908 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a3ae1a17d0 0x55a3ae1c4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:17.331 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.325+0000 7f1492505640 1 --2- 172.21.15.44:0/3136467908 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a3ae1ac990 0x55a3ae1a3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:17.331 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.325+0000 7f1491503640 1 -- 172.21.15.44:0/3136467908 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a3ae1ac990 msgr2=0x55a3ae1a3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:17.331 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.325+0000 7f1491503640 1 --2- 172.21.15.44:0/3136467908 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a3ae1ac990 0x55a3ae1a3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:17.331 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.325+0000 7f1491503640 1 -- 172.21.15.44:0/3136467908 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a3ae1a17d0 msgr2=0x55a3ae1c4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:17.331 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.325+0000 7f1491503640 1 --2- 172.21.15.44:0/3136467908 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a3ae1a17d0 0x55a3ae1c4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:17.331 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.325+0000 7f1491503640 1 -- 172.21.15.44:0/3136467908 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3ae1a1550 con 0x55a3ae1a20f0 2024-08-19T00:19:17.331 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.325+0000 7f1492505640 1 --2- 172.21.15.44:0/3136467908 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a3ae1ac990 0x55a3ae1a3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:19:17.331 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.325+0000 7f1491503640 1 --2- 172.21.15.44:0/3136467908 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a3ae1a20f0 0x55a3ae1c4990 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f148c06a120 tx=0x7f147c00bb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11c06f179a797727 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:19:17.331 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.325+0000 7f14777fe640 1 -- 172.21.15.44:0/3136467908 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f147c00bd30 con 0x55a3ae1a20f0 2024-08-19T00:19:17.331 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.325+0000 7f14777fe640 1 -- 172.21.15.44:0/3136467908 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f147c005020 con 0x55a3ae1a20f0 2024-08-19T00:19:17.332 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.325+0000 7f14777fe640 1 -- 172.21.15.44:0/3136467908 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f147c004bb0 con 0x55a3ae1a20f0 2024-08-19T00:19:17.332 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.326+0000 7f1496e00740 1 -- 172.21.15.44:0/3136467908 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a3ae1a20f0 msgr2=0x55a3ae1c4990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:17.332 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.326+0000 7f1496e00740 1 --2- 172.21.15.44:0/3136467908 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a3ae1a20f0 0x55a3ae1c4990 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f148c06a120 tx=0x7f147c00bb40 comp rx=0 tx=0).stop 2024-08-19T00:19:17.332 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.326+0000 7f1496e00740 1 -- 172.21.15.44:0/3136467908 shutdown_connections 2024-08-19T00:19:17.332 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.326+0000 7f1496e00740 1 --2- 172.21.15.44:0/3136467908 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a3ae1ac990 0x55a3ae1a3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:17.332 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.326+0000 7f1496e00740 1 --2- 172.21.15.44:0/3136467908 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a3ae1a20f0 0x55a3ae1c4990 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:17.332 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.326+0000 7f1496e00740 1 --2- 172.21.15.44:0/3136467908 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a3ae1a17d0 0x55a3ae1c4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:17.332 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.326+0000 7f1496e00740 1 -- 172.21.15.44:0/3136467908 >> 172.21.15.44:0/3136467908 conn(0x55a3ae19dd40 msgr2=0x55a3ae1a4bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:19:17.332 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.326+0000 7f1496e00740 1 -- 172.21.15.44:0/3136467908 shutdown_connections 2024-08-19T00:19:17.332 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.326+0000 7f1496e00740 1 -- 172.21.15.44:0/3136467908 wait complete. 2024-08-19T00:19:17.332 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.326+0000 7f1496e00740 1 -- start start 2024-08-19T00:19:17.332 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.326+0000 7f1496e00740 1 Processor -- start 2024-08-19T00:19:17.332 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.326+0000 7f1496e00740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a3ae1a17d0 0x55a3ae1b5170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:17.333 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.326+0000 7f1496e00740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a3ae1a20f0 0x55a3ae1a66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:17.333 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.326+0000 7f1496e00740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a3ae1ac990 0x55a3ae1a6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:17.333 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.326+0000 7f1496e00740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f148c1b0170 con 0x55a3ae1ac990 2024-08-19T00:19:17.333 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.326+0000 7f1496e00740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f148c1afaa0 con 0x55a3ae1a17d0 2024-08-19T00:19:17.333 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.326+0000 7f1496e00740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f148c1acce0 con 0x55a3ae1a20f0 2024-08-19T00:19:17.333 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.326+0000 7f1496e00740 10 client.0 _ll_register_callbacks cb 0x7f1484031490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:19:17.333 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.327+0000 7f1492505640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a3ae1ac990 0x55a3ae1a6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:17.333 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.327+0000 7f1491d04640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a3ae1a17d0 0x55a3ae1b5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:17.333 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.327+0000 7f1492505640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a3ae1ac990 0x55a3ae1a6cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60488/0 (socket says 172.21.15.44:60488) 2024-08-19T00:19:17.333 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.327+0000 7f1491d04640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a3ae1a17d0 0x55a3ae1b5170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.44:49254/0 (socket says 172.21.15.44:49254) 2024-08-19T00:19:17.333 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.327+0000 7f1492505640 1 -- 172.21.15.44:0/3961338547 learned_addr learned my addr 172.21.15.44:0/3961338547 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:19:17.333 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.327+0000 7f1491503640 1 --2- 172.21.15.44:0/3961338547 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a3ae1a20f0 0x55a3ae1a66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:17.333 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.327+0000 7f1491d04640 1 -- 172.21.15.44:0/3961338547 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a3ae1a20f0 msgr2=0x55a3ae1a66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:17.333 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.327+0000 7f1491d04640 1 --2- 172.21.15.44:0/3961338547 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a3ae1a20f0 0x55a3ae1a66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:17.334 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.327+0000 7f1491d04640 1 -- 172.21.15.44:0/3961338547 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a3ae1ac990 msgr2=0x55a3ae1a6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:17.334 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.327+0000 7f1491d04640 1 --2- 172.21.15.44:0/3961338547 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a3ae1ac990 0x55a3ae1a6cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:17.334 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.327+0000 7f1491d04640 1 -- 172.21.15.44:0/3961338547 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3ae1a74e0 con 0x55a3ae1a17d0 2024-08-19T00:19:17.334 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.327+0000 7f1492505640 1 --2- 172.21.15.44:0/3961338547 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a3ae1ac990 0x55a3ae1a6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:19:17.334 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.327+0000 7f1491d04640 1 --2- 172.21.15.44:0/3961338547 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a3ae1a17d0 0x55a3ae1b5170 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x55a3ae19eba0 tx=0x7f148809b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29391b70238cebf5 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:19:17.334 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.327+0000 7f14757fa640 10 client.0 ms_handle_connect on v2:172.21.15.116:3300/0 2024-08-19T00:19:17.334 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.327+0000 7f14757fa640 1 -- 172.21.15.44:0/3961338547 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f148809bcb0 con 0x55a3ae1a17d0 2024-08-19T00:19:17.334 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.327+0000 7f1496e00740 1 -- 172.21.15.44:0/3961338547 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f147c005020 con 0x55a3ae1a17d0 2024-08-19T00:19:17.334 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.327+0000 7f14757fa640 1 -- 172.21.15.44:0/3961338547 <== mon.2 v2:172.21.15.116:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f1488098320 con 0x55a3ae1a17d0 2024-08-19T00:19:17.334 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.327+0000 7f14757fa640 1 -- 172.21.15.44:0/3961338547 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f14880d31b0 con 0x55a3ae1a17d0 2024-08-19T00:19:17.334 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.327+0000 7f1496e00740 10 client.25727 fetch_fsmap learned FSMap version 33 2024-08-19T00:19:17.334 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.328+0000 7f1496e00740 1 -- 172.21.15.44:0/3961338547 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55a3ae2274b0 con 0x55a3ae1a17d0 2024-08-19T00:19:17.334 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.328+0000 7f14757fa640 1 -- 172.21.15.44:0/3961338547 <== mon.2 v2:172.21.15.116:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f147c005020 con 0x55a3ae1a17d0 2024-08-19T00:19:17.335 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.328+0000 7f14757fa640 1 -- 172.21.15.44:0/3961338547 <== mon.2 v2:172.21.15.116:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f148809b100 con 0x55a3ae1a17d0 2024-08-19T00:19:17.335 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.328+0000 7f1496e00740 10 client.25727 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:19:17.335 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.328+0000 7f1496e00740 10 client.25727 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:19:17.335 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.328+0000 7f1496e00740 20 client.25727 populate_metadata read hostname 'smithi044' 2024-08-19T00:19:17.335 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.328+0000 7f1496e00740 1 --2- 172.21.15.44:0/3961338547 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55a3ae2277a0 0x55a3ae229b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:17.335 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.328+0000 7f1496e00740 4 client.25727 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-19T00:19:17.335 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.328+0000 7f1496e00740 1 -- 172.21.15.44:0/3961338547 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a3ae10d450 con 0x55a3ae2277a0 2024-08-19T00:19:17.335 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.328+0000 7f1491503640 1 --2- 172.21.15.44:0/3961338547 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55a3ae2277a0 0x55a3ae229b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:17.335 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.329+0000 7f1491503640 1 --2- 172.21.15.44:0/3961338547 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55a3ae2277a0 0x55a3ae229b90 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b6446687b0493ed server_cookie=e0e215fd329e8af1 in_seq=0 out_seq=0 2024-08-19T00:19:17.335 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.329+0000 7f14757fa640 10 client.25727 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:19:17.338 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.336+0000 7f14757fa640 1 -- 172.21.15.44:0/3961338547 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a3ae10d450 con 0x55a3ae2277a0 2024-08-19T00:19:17.338 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.336+0000 7f14757fa640 10 client.25727 handle_command_reply: tid=0 2024-08-19T00:19:17.339 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.336+0000 7f1496e00740 1 client.25727 shutdown 2024-08-19T00:19:17.339 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.337+0000 7f1496e00740 1 -- 172.21.15.44:0/3961338547 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a3ae1a17d0 msgr2=0x55a3ae1b5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:17.339 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.337+0000 7f1496e00740 1 --2- 172.21.15.44:0/3961338547 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a3ae1a17d0 0x55a3ae1b5170 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x55a3ae19eba0 tx=0x7f148809b8f0 comp rx=0 tx=0).stop 2024-08-19T00:19:17.339 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.337+0000 7f1496e00740 1 -- 172.21.15.44:0/3961338547 shutdown_connections 2024-08-19T00:19:17.339 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.337+0000 7f1496e00740 1 --2- 172.21.15.44:0/3961338547 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55a3ae2277a0 0x55a3ae229b90 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:17.339 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.337+0000 7f1496e00740 1 --2- 172.21.15.44:0/3961338547 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a3ae1a20f0 0x55a3ae1a66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:17.339 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.337+0000 7f1496e00740 1 --2- 172.21.15.44:0/3961338547 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a3ae1ac990 0x55a3ae1a6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:17.339 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.337+0000 7f1496e00740 1 --2- 172.21.15.44:0/3961338547 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a3ae1a17d0 0x55a3ae1b5170 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:17.339 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.337+0000 7f14757fa640 0 client.25727 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:19:17.339 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.337+0000 7f1496e00740 1 -- 172.21.15.44:0/3961338547 >> 172.21.15.44:0/3961338547 conn(0x55a3ae19dd40 msgr2=0x55a3ae1a3280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:19:17.339 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.337+0000 7f1496e00740 1 -- 172.21.15.44:0/3961338547 shutdown_connections 2024-08-19T00:19:17.339 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.337+0000 7f1496e00740 1 -- 172.21.15.44:0/3961338547 wait complete. 2024-08-19T00:19:17.339 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.337+0000 7f1496e00740 20 client.25727 trim_cache size 0 max 16384 2024-08-19T00:19:17.340 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:{ 2024-08-19T00:19:17.340 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "message": "", 2024-08-19T00:19:17.340 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "return_code": 0 2024-08-19T00:19:17.340 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:} 2024-08-19T00:19:17.341 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.337+0000 7f1493f68640 1 -- 172.21.15.44:0/2060730300 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f14780a2da0 msgr2=0x7f14780a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:17.341 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.337+0000 7f1493f68640 1 --2- 172.21.15.44:0/2060730300 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f14780a2da0 0x7f14780a5260 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1484004ab0 tx=0x7f148402a8e0 comp rx=0 tx=0).stop 2024-08-19T00:19:17.341 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.337+0000 7f1493f68640 1 -- 172.21.15.44:0/2060730300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f148c1006e0 msgr2=0x7f148c198e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:17.341 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.337+0000 7f1493f68640 1 --2- 172.21.15.44:0/2060730300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f148c1006e0 0x7f148c198e80 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f148800e9f0 tx=0x7f148800eeb0 comp rx=0 tx=0).stop 2024-08-19T00:19:17.341 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.337+0000 7f1493f68640 1 -- 172.21.15.44:0/2060730300 shutdown_connections 2024-08-19T00:19:17.341 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.337+0000 7f1493f68640 1 --2- 172.21.15.44:0/2060730300 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f14780a2da0 0x7f14780a5260 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:17.341 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.337+0000 7f1493f68640 1 --2- 172.21.15.44:0/2060730300 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f148c101080 0x7f148c1993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:17.341 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.337+0000 7f1493f68640 1 --2- 172.21.15.44:0/2060730300 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f148c1066f0 0x7f148c1a3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:17.341 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.337+0000 7f1493f68640 1 --2- 172.21.15.44:0/2060730300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f148c1006e0 0x7f148c198e80 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:17.341 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.337+0000 7f1493f68640 1 -- 172.21.15.44:0/2060730300 >> 172.21.15.44:0/2060730300 conn(0x7f148c0776c0 msgr2=0x7f148c103390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:19:17.341 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.338+0000 7f1493f68640 1 -- 172.21.15.44:0/2060730300 shutdown_connections 2024-08-19T00:19:17.342 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:17.338+0000 7f1493f68640 1 -- 172.21.15.44:0/2060730300 wait complete. 2024-08-19T00:19:17.678 INFO:tasks.workunit.client.0.smithi044.stdout: 1 437417 9.02 MB/sec execute 162 sec latency 3309.949 ms 2024-08-19T00:19:18.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:19:18 smithi171 ceph-mon[21810]: pgmap v182: 129 pgs: 129 active+clean; 282 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.3 MiB/s wr, 220 op/s 2024-08-19T00:19:18.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:19:18 smithi116 ceph-mon[21873]: pgmap v182: 129 pgs: 129 active+clean; 282 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.3 MiB/s wr, 220 op/s 2024-08-19T00:19:18.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:19:18 smithi044 ceph-mon[18489]: pgmap v182: 129 pgs: 129 active+clean; 282 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.3 MiB/s wr, 220 op/s 2024-08-19T00:19:18.678 INFO:tasks.workunit.client.0.smithi044.stdout: 1 437417 8.97 MB/sec execute 163 sec latency 4310.038 ms 2024-08-19T00:19:19.678 INFO:tasks.workunit.client.0.smithi044.stdout: 1 437417 8.91 MB/sec execute 164 sec latency 5310.138 ms 2024-08-19T00:19:20.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:19:20 smithi171 ceph-mon[21810]: pgmap v183: 129 pgs: 129 active+clean; 282 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.3 MiB/s wr, 220 op/s 2024-08-19T00:19:20.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:19:20 smithi116 ceph-mon[21873]: pgmap v183: 129 pgs: 129 active+clean; 282 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.3 MiB/s wr, 220 op/s 2024-08-19T00:19:20.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:19:20 smithi044 ceph-mon[18489]: pgmap v183: 129 pgs: 129 active+clean; 282 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.3 MiB/s wr, 220 op/s 2024-08-19T00:19:20.678 INFO:tasks.workunit.client.0.smithi044.stdout: 1 437417 8.86 MB/sec execute 165 sec latency 6310.264 ms 2024-08-19T00:19:21.678 INFO:tasks.workunit.client.0.smithi044.stdout: 1 437417 8.81 MB/sec execute 166 sec latency 7310.361 ms 2024-08-19T00:19:22.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:19:22 smithi171 ceph-mon[21810]: pgmap v184: 129 pgs: 129 active+clean; 284 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.1 MiB/s wr, 254 op/s 2024-08-19T00:19:22.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:19:22 smithi116 ceph-mon[21873]: pgmap v184: 129 pgs: 129 active+clean; 284 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.1 MiB/s wr, 254 op/s 2024-08-19T00:19:22.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:19:22 smithi044 ceph-mon[18489]: pgmap v184: 129 pgs: 129 active+clean; 284 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.1 MiB/s wr, 254 op/s 2024-08-19T00:19:22.678 INFO:tasks.workunit.client.0.smithi044.stdout: 1 437417 8.75 MB/sec execute 167 sec latency 8310.442 ms 2024-08-19T00:19:23.678 INFO:tasks.workunit.client.0.smithi044.stdout: 1 437417 8.70 MB/sec execute 168 sec latency 9310.569 ms 2024-08-19T00:19:24.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:19:24 smithi171 ceph-mon[21810]: pgmap v185: 129 pgs: 129 active+clean; 284 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.5 MiB/s wr, 143 op/s 2024-08-19T00:19:24.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:19:24 smithi116 ceph-mon[21873]: pgmap v185: 129 pgs: 129 active+clean; 284 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.5 MiB/s wr, 143 op/s 2024-08-19T00:19:24.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:19:24 smithi044 ceph-mon[18489]: pgmap v185: 129 pgs: 129 active+clean; 284 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.5 MiB/s wr, 143 op/s 2024-08-19T00:19:24.678 INFO:tasks.workunit.client.0.smithi044.stdout: 1 437417 8.65 MB/sec execute 169 sec latency 10310.678 ms 2024-08-19T00:19:25.678 INFO:tasks.workunit.client.0.smithi044.stdout: 1 437417 8.60 MB/sec execute 170 sec latency 11310.782 ms 2024-08-19T00:19:26.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:19:26 smithi171 ceph-mon[21810]: pgmap v186: 129 pgs: 129 active+clean; 284 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.3 MiB/s wr, 176 op/s 2024-08-19T00:19:26.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:19:26 smithi116 ceph-mon[21873]: pgmap v186: 129 pgs: 129 active+clean; 284 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.3 MiB/s wr, 176 op/s 2024-08-19T00:19:26.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:19:26 smithi044 ceph-mon[18489]: pgmap v186: 129 pgs: 129 active+clean; 284 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.3 MiB/s wr, 176 op/s 2024-08-19T00:19:26.678 INFO:tasks.workunit.client.0.smithi044.stdout: 1 437417 8.55 MB/sec execute 171 sec latency 12310.831 ms 2024-08-19T00:19:27.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:19:27 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:19:27.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:19:27 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:19:27.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:19:27 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:19:27.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:19:27 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:19:27.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:19:27 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:19:27.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:19:27 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:19:27.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:19:27 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:19:27.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:19:27 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:19:27.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:19:27 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:19:27.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:19:27 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:19:27.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:19:27 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:19:27.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:19:27 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:19:27.679 INFO:tasks.workunit.client.0.smithi044.stdout: 1 437417 8.50 MB/sec execute 172 sec latency 13310.910 ms 2024-08-19T00:19:28.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:19:28 smithi171 ceph-mon[21810]: pgmap v187: 129 pgs: 129 active+clean; 284 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 1.6 MiB/s wr, 67 op/s 2024-08-19T00:19:28.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:19:28 smithi116 ceph-mon[21873]: pgmap v187: 129 pgs: 129 active+clean; 284 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 1.6 MiB/s wr, 67 op/s 2024-08-19T00:19:28.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:19:28 smithi044 ceph-mon[18489]: pgmap v187: 129 pgs: 129 active+clean; 284 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 1.6 MiB/s wr, 67 op/s 2024-08-19T00:19:28.679 INFO:tasks.workunit.client.0.smithi044.stdout: 1 437417 8.45 MB/sec execute 173 sec latency 14311.020 ms 2024-08-19T00:19:29.679 INFO:tasks.workunit.client.0.smithi044.stdout: 1 437417 8.40 MB/sec execute 174 sec latency 15311.119 ms 2024-08-19T00:19:30.344 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:19:30 smithi171 ceph-mon[21810]: pgmap v188: 129 pgs: 129 active+clean; 284 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 1.6 MiB/s wr, 67 op/s 2024-08-19T00:19:30.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:19:30 smithi116 ceph-mon[21873]: pgmap v188: 129 pgs: 129 active+clean; 284 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 1.6 MiB/s wr, 67 op/s 2024-08-19T00:19:30.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:19:30 smithi044 ceph-mon[18489]: pgmap v188: 129 pgs: 129 active+clean; 284 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 1.6 MiB/s wr, 67 op/s 2024-08-19T00:19:30.442 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.436+0000 7f001c73d640 1 -- 172.21.15.44:0/3152995524 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0014103350 msgr2=0x7f001410b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:30.442 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.436+0000 7f001c73d640 1 --2- 172.21.15.44:0/3152995524 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0014103350 0x7f001410b830 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f0004009900 tx=0x7f000402a410 comp rx=0 tx=0).stop 2024-08-19T00:19:30.442 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.436+0000 7f001c73d640 1 -- 172.21.15.44:0/3152995524 shutdown_connections 2024-08-19T00:19:30.442 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.436+0000 7f001c73d640 1 --2- 172.21.15.44:0/3152995524 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f001410be50 0x7f001410e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:30.442 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.436+0000 7f001c73d640 1 --2- 172.21.15.44:0/3152995524 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0014103350 0x7f001410b830 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:30.442 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.436+0000 7f001c73d640 1 --2- 172.21.15.44:0/3152995524 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0014102a30 0x7f0014102e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:30.443 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.436+0000 7f001c73d640 1 -- 172.21.15.44:0/3152995524 >> 172.21.15.44:0/3152995524 conn(0x7f00140fc3e0 msgr2=0x7f00140fe800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:19:30.443 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.436+0000 7f001c73d640 1 -- 172.21.15.44:0/3152995524 shutdown_connections 2024-08-19T00:19:30.443 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.436+0000 7f001c73d640 1 -- 172.21.15.44:0/3152995524 wait complete. 2024-08-19T00:19:30.443 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.437+0000 7f001c73d640 1 Processor -- start 2024-08-19T00:19:30.443 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.437+0000 7f001c73d640 1 -- start start 2024-08-19T00:19:30.443 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.437+0000 7f001c73d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0014102a30 0x7f0014100680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:30.443 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.437+0000 7f001c73d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0014103350 0x7f0014100bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:30.443 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.437+0000 7f001c73d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f001410be50 0x7f0014101100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:30.443 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.437+0000 7f001c73d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0014111c30 con 0x7f001410be50 2024-08-19T00:19:30.443 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.437+0000 7f001c73d640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f0014111ab0 con 0x7f0014103350 2024-08-19T00:19:30.443 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.437+0000 7f001c73d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0014111db0 con 0x7f0014102a30 2024-08-19T00:19:30.443 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.437+0000 7f001acda640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f001410be50 0x7f0014101100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:30.452 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.437+0000 7f001acda640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f001410be50 0x7f0014101100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42766/0 (socket says 172.21.15.44:42766) 2024-08-19T00:19:30.452 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.437+0000 7f001acda640 1 -- 172.21.15.44:0/601954658 learned_addr learned my addr 172.21.15.44:0/601954658 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:19:30.452 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.437+0000 7f001a4d9640 1 --2- 172.21.15.44:0/601954658 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0014102a30 0x7f0014100680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:30.453 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.437+0000 7f0019cd8640 1 --2- 172.21.15.44:0/601954658 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0014103350 0x7f0014100bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:30.453 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.437+0000 7f001acda640 1 -- 172.21.15.44:0/601954658 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0014102a30 msgr2=0x7f0014100680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:30.453 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.437+0000 7f001acda640 1 --2- 172.21.15.44:0/601954658 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0014102a30 0x7f0014100680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:30.453 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.437+0000 7f001acda640 1 -- 172.21.15.44:0/601954658 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0014103350 msgr2=0x7f0014100bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:30.453 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.437+0000 7f001acda640 1 --2- 172.21.15.44:0/601954658 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0014103350 0x7f0014100bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:30.453 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.437+0000 7f001acda640 1 -- 172.21.15.44:0/601954658 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00141a65e0 con 0x7f001410be50 2024-08-19T00:19:30.453 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.438+0000 7f001acda640 1 --2- 172.21.15.44:0/601954658 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f001410be50 0x7f0014101100 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f000c00cad0 tx=0x7f000c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:19:30.454 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.438+0000 7f000b7fe640 1 -- 172.21.15.44:0/601954658 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f000c00ae20 con 0x7f001410be50 2024-08-19T00:19:30.454 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.438+0000 7f000b7fe640 1 -- 172.21.15.44:0/601954658 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f000c005020 con 0x7f001410be50 2024-08-19T00:19:30.454 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.438+0000 7f001c73d640 1 -- 172.21.15.44:0/601954658 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00141a68d0 con 0x7f001410be50 2024-08-19T00:19:30.454 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.438+0000 7f000b7fe640 1 -- 172.21.15.44:0/601954658 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f000c00f6f0 con 0x7f001410be50 2024-08-19T00:19:30.454 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.438+0000 7f001c73d640 1 -- 172.21.15.44:0/601954658 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00141a6df0 con 0x7f001410be50 2024-08-19T00:19:30.454 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.440+0000 7f000b7fe640 1 -- 172.21.15.44:0/601954658 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f000c0051d0 con 0x7f001410be50 2024-08-19T00:19:30.454 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.441+0000 7f001f5d1740 1 Processor -- start 2024-08-19T00:19:30.455 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.441+0000 7f001f5d1740 1 -- start start 2024-08-19T00:19:30.455 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.441+0000 7f001f5d1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558d9f6f07d0 0x558d9f6f0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:30.455 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.441+0000 7f001f5d1740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558d9f6f10f0 0x558d9f6fb450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:30.455 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.441+0000 7f001f5d1740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558d9f6fb990 0x558d9f6fdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:30.455 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.441+0000 7f001f5d1740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x558d9f6549d0 con 0x558d9f6f07d0 2024-08-19T00:19:30.455 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.441+0000 7f001f5d1740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x558d9f5fc820 con 0x558d9f6fb990 2024-08-19T00:19:30.455 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.441+0000 7f001f5d1740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x558d9f650990 con 0x558d9f6f10f0 2024-08-19T00:19:30.456 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.441+0000 7f000b7fe640 1 --2- 172.21.15.44:0/601954658 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f00000a2e20 0x7f00000a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:30.456 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.441+0000 7f0019cd8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558d9f6f07d0 0x558d9f6f0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:30.456 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.441+0000 7f0019cd8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558d9f6f07d0 0x558d9f6f0bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42782/0 (socket says 172.21.15.44:42782) 2024-08-19T00:19:30.456 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.441+0000 7f0019cd8640 1 -- 172.21.15.44:0/2972507158 learned_addr learned my addr 172.21.15.44:0/2972507158 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:19:30.457 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.441+0000 7f000b7fe640 1 -- 172.21.15.44:0/601954658 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f000c0cf770 con 0x7f001410be50 2024-08-19T00:19:30.457 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.441+0000 7f001acda640 1 --2- 172.21.15.44:0/601954658 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f00000a2e20 0x7f00000a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:30.457 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.442+0000 7f001a4d9640 1 --2- 172.21.15.44:0/2972507158 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558d9f6f10f0 0x558d9f6fb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:30.457 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.442+0000 7f0019cd8640 1 --2- 172.21.15.44:0/2972507158 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558d9f6fb990 0x558d9f6fdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:30.457 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.442+0000 7f0019cd8640 1 -- 172.21.15.44:0/2972507158 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558d9f6f10f0 msgr2=0x558d9f6fb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:30.457 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.442+0000 7f0019cd8640 1 --2- 172.21.15.44:0/2972507158 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558d9f6f10f0 0x558d9f6fb450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:30.457 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.442+0000 7f0019cd8640 1 -- 172.21.15.44:0/2972507158 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558d9f6fb990 msgr2=0x558d9f6fdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:30.458 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.442+0000 7f0019cd8640 1 --2- 172.21.15.44:0/2972507158 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558d9f6fb990 0x558d9f6fdd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:30.458 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.442+0000 7f0019cd8640 1 -- 172.21.15.44:0/2972507158 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d9f368210 con 0x558d9f6f07d0 2024-08-19T00:19:30.458 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.442+0000 7f001a4d9640 1 --2- 172.21.15.44:0/2972507158 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558d9f6f10f0 0x558d9f6fb450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:19:30.458 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.442+0000 7f0019cd8640 1 --2- 172.21.15.44:0/2972507158 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558d9f6f07d0 0x558d9f6f0bb0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f0004009230 tx=0x7f00040314a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea09d681afa00822 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:19:30.458 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.442+0000 7f001acda640 1 --2- 172.21.15.44:0/601954658 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f00000a2e20 0x7f00000a52e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f000c00caa0 tx=0x7f000c01c7e0 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:19:30.458 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.442+0000 7f0008ff9640 1 -- 172.21.15.44:0/2972507158 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0004043020 con 0x558d9f6f07d0 2024-08-19T00:19:30.459 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.442+0000 7f0008ff9640 1 -- 172.21.15.44:0/2972507158 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f00040046c0 con 0x558d9f6f07d0 2024-08-19T00:19:30.459 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.442+0000 7f0008ff9640 1 -- 172.21.15.44:0/2972507158 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0004035070 con 0x558d9f6f07d0 2024-08-19T00:19:30.459 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.443+0000 7f001f5d1740 1 -- 172.21.15.44:0/2972507158 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558d9f6f07d0 msgr2=0x558d9f6f0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:30.459 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.443+0000 7f001f5d1740 1 --2- 172.21.15.44:0/2972507158 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558d9f6f07d0 0x558d9f6f0bb0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f0004009230 tx=0x7f00040314a0 comp rx=0 tx=0).stop 2024-08-19T00:19:30.459 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.443+0000 7f001f5d1740 1 -- 172.21.15.44:0/2972507158 shutdown_connections 2024-08-19T00:19:30.459 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.443+0000 7f001f5d1740 1 --2- 172.21.15.44:0/2972507158 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558d9f6f10f0 0x558d9f6fb450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:30.460 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.443+0000 7f001f5d1740 1 --2- 172.21.15.44:0/2972507158 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558d9f6fb990 0x558d9f6fdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:30.460 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.443+0000 7f001f5d1740 1 --2- 172.21.15.44:0/2972507158 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558d9f6f07d0 0x558d9f6f0bb0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:30.460 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.443+0000 7f001f5d1740 1 -- 172.21.15.44:0/2972507158 >> 172.21.15.44:0/2972507158 conn(0x558d9f6ecd40 msgr2=0x558d9f6ed120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:19:30.460 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.443+0000 7f001f5d1740 1 -- 172.21.15.44:0/2972507158 shutdown_connections 2024-08-19T00:19:30.460 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.443+0000 7f001f5d1740 1 -- 172.21.15.44:0/2972507158 wait complete. 2024-08-19T00:19:30.460 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.443+0000 7f001f5d1740 1 -- start start 2024-08-19T00:19:30.461 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.444+0000 7f001f5d1740 1 Processor -- start 2024-08-19T00:19:30.461 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.444+0000 7f001f5d1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558d9f6f07d0 0x558d9f6f87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:30.461 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.444+0000 7f001f5d1740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558d9f6f10f0 0x558d9f6f8d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:30.461 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.444+0000 7f001f5d1740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558d9f6fb990 0x558d9f6f9270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:30.461 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.444+0000 7f001f5d1740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x558d9f6fe560 con 0x558d9f6f07d0 2024-08-19T00:19:30.461 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.444+0000 7f001f5d1740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x558d9f610520 con 0x558d9f6f10f0 2024-08-19T00:19:30.461 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.444+0000 7f001f5d1740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x558d9f6fe6e0 con 0x558d9f6fb990 2024-08-19T00:19:30.462 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.444+0000 7f001f5d1740 10 client.0 _ll_register_callbacks cb 0x558d9f367a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:19:30.462 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.444+0000 7f0019cd8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558d9f6f07d0 0x558d9f6f87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:30.462 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.444+0000 7f0019cd8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558d9f6f07d0 0x558d9f6f87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42796/0 (socket says 172.21.15.44:42796) 2024-08-19T00:19:30.462 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.444+0000 7f0019cd8640 1 -- 172.21.15.44:0/626161831 learned_addr learned my addr 172.21.15.44:0/626161831 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:19:30.462 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.444+0000 7f001a4d9640 1 --2- 172.21.15.44:0/626161831 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558d9f6f10f0 0x558d9f6f8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:30.462 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.444+0000 7f0019cd8640 1 -- 172.21.15.44:0/626161831 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558d9f6fb990 msgr2=0x558d9f6f9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:30.462 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.444+0000 7f0019cd8640 1 --2- 172.21.15.44:0/626161831 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558d9f6fb990 0x558d9f6f9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:30.463 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.444+0000 7f0019cd8640 1 -- 172.21.15.44:0/626161831 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558d9f6f10f0 msgr2=0x558d9f6f8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:30.463 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.444+0000 7f0019cd8640 1 --2- 172.21.15.44:0/626161831 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558d9f6f10f0 0x558d9f6f8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:30.463 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.444+0000 7f0019cd8640 1 -- 172.21.15.44:0/626161831 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d9f434620 con 0x558d9f6f07d0 2024-08-19T00:19:30.463 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.444+0000 7f001a4d9640 1 --2- 172.21.15.44:0/626161831 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558d9f6f10f0 0x558d9f6f8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:19:30.463 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.444+0000 7f0019cd8640 1 --2- 172.21.15.44:0/626161831 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558d9f6f07d0 0x558d9f6f87f0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f00040092a0 tx=0x7f00040051c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36c73ee0cac60b87 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:19:30.463 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.444+0000 7efffdffb640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:19:30.463 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.444+0000 7efffdffb640 1 -- 172.21.15.44:0/626161831 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0004043030 con 0x558d9f6f07d0 2024-08-19T00:19:30.464 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.445+0000 7efffdffb640 1 -- 172.21.15.44:0/626161831 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f00040317b0 con 0x558d9f6f07d0 2024-08-19T00:19:30.464 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.445+0000 7f001f5d1740 1 -- 172.21.15.44:0/626161831 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00040046c0 con 0x558d9f6f07d0 2024-08-19T00:19:30.464 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.445+0000 7efffdffb640 1 -- 172.21.15.44:0/626161831 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f0004059050 con 0x558d9f6f07d0 2024-08-19T00:19:30.464 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.445+0000 7f001f5d1740 10 client.16260 fetch_fsmap learned FSMap version 33 2024-08-19T00:19:30.464 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.445+0000 7f001f5d1740 1 -- 172.21.15.44:0/626161831 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x558d9f70a160 con 0x558d9f6f07d0 2024-08-19T00:19:30.464 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.445+0000 7efffdffb640 1 -- 172.21.15.44:0/626161831 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f00040046c0 con 0x558d9f6f07d0 2024-08-19T00:19:30.465 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.445+0000 7efffdffb640 1 -- 172.21.15.44:0/626161831 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f000403a040 con 0x558d9f6f07d0 2024-08-19T00:19:30.465 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.445+0000 7f001f5d1740 10 client.16260 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:19:30.465 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.445+0000 7f001f5d1740 10 client.16260 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:19:30.465 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.445+0000 7f001f5d1740 20 client.16260 populate_metadata read hostname 'smithi044' 2024-08-19T00:19:30.465 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.445+0000 7f001f5d1740 1 --2- 172.21.15.44:0/626161831 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x558d9f70b4b0 0x558d9f70d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:30.465 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.445+0000 7f001f5d1740 4 client.16260 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:19:30.466 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.445+0000 7f001f5d1740 1 -- 172.21.15.44:0/626161831 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558d9f662100 con 0x558d9f70b4b0 2024-08-19T00:19:30.466 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.445+0000 7f001a4d9640 1 --2- 172.21.15.44:0/626161831 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x558d9f70b4b0 0x558d9f70d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:30.466 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.446+0000 7efffdffb640 10 client.16260 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:19:30.466 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.446+0000 7f001a4d9640 1 --2- 172.21.15.44:0/626161831 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x558d9f70b4b0 0x558d9f70d8a0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fff8c3824a0eb50 server_cookie=5c2419871b811cc8 in_seq=0 out_seq=0 2024-08-19T00:19:30.466 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.447+0000 7efffdffb640 1 -- 172.21.15.44:0/626161831 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558d9f662100 con 0x558d9f70b4b0 2024-08-19T00:19:30.466 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.447+0000 7efffdffb640 10 client.16260 handle_command_reply: tid=0 2024-08-19T00:19:30.467 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.447+0000 7f001f5d1740 1 client.16260 shutdown 2024-08-19T00:19:30.467 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.447+0000 7f001f5d1740 1 -- 172.21.15.44:0/626161831 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558d9f6f07d0 msgr2=0x558d9f6f87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:30.467 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.447+0000 7f001f5d1740 1 --2- 172.21.15.44:0/626161831 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558d9f6f07d0 0x558d9f6f87f0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f00040092a0 tx=0x7f00040051c0 comp rx=0 tx=0).stop 2024-08-19T00:19:30.467 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.447+0000 7f001f5d1740 1 -- 172.21.15.44:0/626161831 shutdown_connections 2024-08-19T00:19:30.467 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.447+0000 7f001f5d1740 1 --2- 172.21.15.44:0/626161831 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x558d9f70b4b0 0x558d9f70d8a0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:30.467 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.447+0000 7f001f5d1740 1 --2- 172.21.15.44:0/626161831 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558d9f6fb990 0x558d9f6f9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:30.467 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.447+0000 7f001f5d1740 1 --2- 172.21.15.44:0/626161831 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558d9f6f10f0 0x558d9f6f8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:30.468 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.447+0000 7efffdffb640 0 client.16260 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:19:30.468 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.447+0000 7f001f5d1740 1 --2- 172.21.15.44:0/626161831 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558d9f6f07d0 0x558d9f6f87f0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:30.468 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.447+0000 7f001f5d1740 1 -- 172.21.15.44:0/626161831 >> 172.21.15.44:0/626161831 conn(0x558d9f6ecd40 msgr2=0x558d9f6f2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:19:30.468 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.447+0000 7f001f5d1740 1 -- 172.21.15.44:0/626161831 shutdown_connections 2024-08-19T00:19:30.468 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.447+0000 7f001f5d1740 1 -- 172.21.15.44:0/626161831 wait complete. 2024-08-19T00:19:30.468 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.447+0000 7f001f5d1740 20 client.16260 trim_cache size 0 max 16384 2024-08-19T00:19:30.476 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.462+0000 7f001f5d1740 1 Processor -- start 2024-08-19T00:19:30.476 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.462+0000 7f001f5d1740 1 -- start start 2024-08-19T00:19:30.476 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.462+0000 7f001f5d1740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558d9f6f07d0 0x558d9f6f3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:30.476 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.462+0000 7f001f5d1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558d9f6f10f0 0x558d9f712ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:30.476 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.462+0000 7f001f5d1740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558d9f6fb990 0x558d9f7133e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:30.476 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.462+0000 7f001f5d1740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f00141b0de0 con 0x558d9f6f10f0 2024-08-19T00:19:30.476 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.462+0000 7f001f5d1740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f00141b2920 con 0x558d9f6f07d0 2024-08-19T00:19:30.477 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.462+0000 7f001f5d1740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f00141b14b0 con 0x558d9f6fb990 2024-08-19T00:19:30.477 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.462+0000 7f001a4d9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558d9f6f10f0 0x558d9f712ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:30.477 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.462+0000 7f001a4d9640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558d9f6f10f0 0x558d9f712ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42802/0 (socket says 172.21.15.44:42802) 2024-08-19T00:19:30.477 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.462+0000 7f001a4d9640 1 -- 172.21.15.44:0/1031892601 learned_addr learned my addr 172.21.15.44:0/1031892601 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:19:30.477 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.462+0000 7f0019cd8640 1 --2- 172.21.15.44:0/1031892601 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558d9f6f07d0 0x558d9f6f3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:30.477 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.463+0000 7f001a4d9640 1 -- 172.21.15.44:0/1031892601 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558d9f6fb990 msgr2=0x558d9f7133e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:30.477 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.463+0000 7f001a4d9640 1 --2- 172.21.15.44:0/1031892601 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558d9f6fb990 0x558d9f7133e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:30.477 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.463+0000 7f001a4d9640 1 -- 172.21.15.44:0/1031892601 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558d9f6f07d0 msgr2=0x558d9f6f3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:30.477 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.463+0000 7f001a4d9640 1 --2- 172.21.15.44:0/1031892601 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558d9f6f07d0 0x558d9f6f3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:30.477 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.463+0000 7f001a4d9640 1 -- 172.21.15.44:0/1031892601 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d9f70dc10 con 0x558d9f6f10f0 2024-08-19T00:19:30.478 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.463+0000 7f001a4d9640 1 --2- 172.21.15.44:0/1031892601 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558d9f6f10f0 0x558d9f712ea0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x558d9f6f8060 tx=0x7f0010004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4f444c2adcf24b5 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:19:30.478 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.463+0000 7efffffff640 1 -- 172.21.15.44:0/1031892601 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0010003d20 con 0x558d9f6f10f0 2024-08-19T00:19:30.478 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.463+0000 7efffffff640 1 -- 172.21.15.44:0/1031892601 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0010010910 con 0x558d9f6f10f0 2024-08-19T00:19:30.478 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.463+0000 7efffffff640 1 -- 172.21.15.44:0/1031892601 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f001001d9c0 con 0x558d9f6f10f0 2024-08-19T00:19:30.478 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.463+0000 7f001f5d1740 1 -- 172.21.15.44:0/1031892601 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558d9f6f10f0 msgr2=0x558d9f712ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:30.478 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.463+0000 7f001f5d1740 1 --2- 172.21.15.44:0/1031892601 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558d9f6f10f0 0x558d9f712ea0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x558d9f6f8060 tx=0x7f0010004410 comp rx=0 tx=0).stop 2024-08-19T00:19:30.478 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.464+0000 7f001f5d1740 1 -- 172.21.15.44:0/1031892601 shutdown_connections 2024-08-19T00:19:30.478 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.464+0000 7f001f5d1740 1 --2- 172.21.15.44:0/1031892601 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558d9f6fb990 0x558d9f7133e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:30.478 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.464+0000 7f001f5d1740 1 --2- 172.21.15.44:0/1031892601 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558d9f6f10f0 0x558d9f712ea0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:30.478 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.464+0000 7f001f5d1740 1 --2- 172.21.15.44:0/1031892601 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558d9f6f07d0 0x558d9f6f3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:30.478 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.464+0000 7f001f5d1740 1 -- 172.21.15.44:0/1031892601 >> 172.21.15.44:0/1031892601 conn(0x558d9f6ecd40 msgr2=0x558d9f6f78c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:19:30.478 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.464+0000 7f001f5d1740 1 -- 172.21.15.44:0/1031892601 shutdown_connections 2024-08-19T00:19:30.479 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.464+0000 7f001f5d1740 1 -- 172.21.15.44:0/1031892601 wait complete. 2024-08-19T00:19:30.479 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.464+0000 7f001f5d1740 1 -- start start 2024-08-19T00:19:30.479 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.464+0000 7f001f5d1740 1 Processor -- start 2024-08-19T00:19:30.479 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.464+0000 7f001f5d1740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558d9f6f07d0 0x558d9f703b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:30.479 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.464+0000 7f001f5d1740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558d9f6f10f0 0x558d9f7040d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:30.479 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.464+0000 7f001f5d1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558d9f6fb990 0x558d9f6f5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:30.479 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.464+0000 7f001f5d1740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f00141b2250 con 0x558d9f6fb990 2024-08-19T00:19:30.479 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.464+0000 7f001f5d1740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f00141b1b80 con 0x558d9f6f10f0 2024-08-19T00:19:30.479 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.464+0000 7f001f5d1740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f00141aedc0 con 0x558d9f6f07d0 2024-08-19T00:19:30.479 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.464+0000 7f001f5d1740 10 client.0 _ll_register_callbacks cb 0x7f0004009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:19:30.479 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.464+0000 7f0019cd8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558d9f6fb990 0x558d9f6f5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:30.479 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.464+0000 7f0019cd8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558d9f6fb990 0x558d9f6f5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42814/0 (socket says 172.21.15.44:42814) 2024-08-19T00:19:30.480 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.464+0000 7f0019cd8640 1 -- 172.21.15.44:0/2061667227 learned_addr learned my addr 172.21.15.44:0/2061667227 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:19:30.480 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.464+0000 7f0019cd8640 1 --2- 172.21.15.44:0/2061667227 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558d9f6f07d0 0x558d9f703b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:30.480 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.465+0000 7f001a4d9640 1 --2- 172.21.15.44:0/2061667227 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558d9f6f10f0 0x558d9f7040d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:30.480 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.465+0000 7f0019cd8640 1 -- 172.21.15.44:0/2061667227 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558d9f6f07d0 msgr2=0x558d9f703b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:30.480 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.465+0000 7f0019cd8640 1 --2- 172.21.15.44:0/2061667227 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558d9f6f07d0 0x558d9f703b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:30.480 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.465+0000 7f0019cd8640 1 -- 172.21.15.44:0/2061667227 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558d9f6f10f0 msgr2=0x558d9f7040d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:30.480 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.465+0000 7f0019cd8640 1 --2- 172.21.15.44:0/2061667227 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558d9f6f10f0 0x558d9f7040d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:30.481 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.465+0000 7f0019cd8640 1 -- 172.21.15.44:0/2061667227 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d9f6f5740 con 0x558d9f6fb990 2024-08-19T00:19:30.481 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.465+0000 7f001a4d9640 1 --2- 172.21.15.44:0/2061667227 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558d9f6f10f0 0x558d9f7040d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:19:30.481 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.465+0000 7f0019cd8640 1 --2- 172.21.15.44:0/2061667227 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558d9f6fb990 0x558d9f6f5000 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f0004009900 tx=0x7f0004031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec6ce3da10162faa server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:19:30.481 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.465+0000 7efffdffb640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:19:30.481 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.465+0000 7efffdffb640 1 -- 172.21.15.44:0/2061667227 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0004043070 con 0x558d9f6fb990 2024-08-19T00:19:30.481 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.465+0000 7efffdffb640 1 -- 172.21.15.44:0/2061667227 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f0004003c80 con 0x558d9f6fb990 2024-08-19T00:19:30.481 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.465+0000 7f001f5d1740 1 -- 172.21.15.44:0/2061667227 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0010010910 con 0x558d9f6fb990 2024-08-19T00:19:30.481 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.465+0000 7efffdffb640 1 -- 172.21.15.44:0/2061667227 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f0004067050 con 0x558d9f6fb990 2024-08-19T00:19:30.481 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.465+0000 7f001f5d1740 10 client.16266 fetch_fsmap learned FSMap version 33 2024-08-19T00:19:30.481 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.465+0000 7f001f5d1740 1 -- 172.21.15.44:0/2061667227 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x558d9f775880 con 0x558d9f6fb990 2024-08-19T00:19:30.481 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.465+0000 7efffdffb640 1 -- 172.21.15.44:0/2061667227 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0010010910 con 0x558d9f6fb990 2024-08-19T00:19:30.482 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.465+0000 7efffdffb640 1 -- 172.21.15.44:0/2061667227 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f0004031b00 con 0x558d9f6fb990 2024-08-19T00:19:30.482 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.465+0000 7f001f5d1740 10 client.16266 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:19:30.482 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.465+0000 7f001f5d1740 10 client.16266 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:19:30.482 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.465+0000 7f001f5d1740 20 client.16266 populate_metadata read hostname 'smithi044' 2024-08-19T00:19:30.482 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.465+0000 7f001f5d1740 1 --2- 172.21.15.44:0/2061667227 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x558d9f775ef0 0x558d9f778310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:30.482 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.465+0000 7f001f5d1740 4 client.16266 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-19T00:19:30.482 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.465+0000 7f001f5d1740 1 -- 172.21.15.44:0/2061667227 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558d9f65c450 con 0x558d9f775ef0 2024-08-19T00:19:30.482 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.466+0000 7f001a4d9640 1 --2- 172.21.15.44:0/2061667227 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x558d9f775ef0 0x558d9f778310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:30.482 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.466+0000 7efffdffb640 10 client.16266 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:19:30.482 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.466+0000 7f001a4d9640 1 --2- 172.21.15.44:0/2061667227 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x558d9f775ef0 0x558d9f778310 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a57897d60a911cc8 server_cookie=f2abd2b7128258f4 in_seq=0 out_seq=0 2024-08-19T00:19:30.484 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.475+0000 7efffdffb640 1 -- 172.21.15.44:0/2061667227 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558d9f65c450 con 0x558d9f775ef0 2024-08-19T00:19:30.484 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.475+0000 7efffdffb640 10 client.16266 handle_command_reply: tid=0 2024-08-19T00:19:30.484 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.475+0000 7f001f5d1740 1 client.16266 shutdown 2024-08-19T00:19:30.484 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.476+0000 7f001f5d1740 1 -- 172.21.15.44:0/2061667227 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558d9f6fb990 msgr2=0x558d9f6f5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:30.484 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.476+0000 7f001f5d1740 1 --2- 172.21.15.44:0/2061667227 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558d9f6fb990 0x558d9f6f5000 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f0004009900 tx=0x7f0004031400 comp rx=0 tx=0).stop 2024-08-19T00:19:30.484 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.476+0000 7f001f5d1740 1 -- 172.21.15.44:0/2061667227 shutdown_connections 2024-08-19T00:19:30.485 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.476+0000 7f001f5d1740 1 --2- 172.21.15.44:0/2061667227 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x558d9f775ef0 0x558d9f778310 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:30.485 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.476+0000 7f001f5d1740 1 --2- 172.21.15.44:0/2061667227 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558d9f6fb990 0x558d9f6f5000 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:30.485 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.476+0000 7efffdffb640 0 client.16266 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:19:30.485 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.476+0000 7f001f5d1740 1 --2- 172.21.15.44:0/2061667227 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558d9f6f10f0 0x558d9f7040d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:30.485 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.476+0000 7f001f5d1740 1 --2- 172.21.15.44:0/2061667227 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558d9f6f07d0 0x558d9f703b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:30.485 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.476+0000 7f001f5d1740 1 -- 172.21.15.44:0/2061667227 >> 172.21.15.44:0/2061667227 conn(0x558d9f6ecd40 msgr2=0x558d9f6f87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:19:30.485 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.476+0000 7f001f5d1740 1 -- 172.21.15.44:0/2061667227 shutdown_connections 2024-08-19T00:19:30.485 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.476+0000 7f001f5d1740 1 -- 172.21.15.44:0/2061667227 wait complete. 2024-08-19T00:19:30.485 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.476+0000 7f001f5d1740 20 client.16266 trim_cache size 0 max 16384 2024-08-19T00:19:30.486 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:{ 2024-08-19T00:19:30.486 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "message": "", 2024-08-19T00:19:30.486 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "return_code": 0 2024-08-19T00:19:30.486 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:} 2024-08-19T00:19:30.487 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.476+0000 7f001c73d640 1 -- 172.21.15.44:0/601954658 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f00000a2e20 msgr2=0x7f00000a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:30.487 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.476+0000 7f001c73d640 1 --2- 172.21.15.44:0/601954658 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f00000a2e20 0x7f00000a52e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f000c00caa0 tx=0x7f000c01c7e0 comp rx=0 tx=0).stop 2024-08-19T00:19:30.487 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.476+0000 7f001c73d640 1 -- 172.21.15.44:0/601954658 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f001410be50 msgr2=0x7f0014101100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:30.487 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.476+0000 7f001c73d640 1 --2- 172.21.15.44:0/601954658 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f001410be50 0x7f0014101100 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f000c00cad0 tx=0x7f000c00cf90 comp rx=0 tx=0).stop 2024-08-19T00:19:30.487 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.476+0000 7f001c73d640 1 -- 172.21.15.44:0/601954658 shutdown_connections 2024-08-19T00:19:30.488 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.476+0000 7f001c73d640 1 --2- 172.21.15.44:0/601954658 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f00000a2e20 0x7f00000a52e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:30.488 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.476+0000 7f001c73d640 1 --2- 172.21.15.44:0/601954658 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f001410be50 0x7f0014101100 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:30.488 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.476+0000 7f001c73d640 1 --2- 172.21.15.44:0/601954658 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0014103350 0x7f0014100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:30.488 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.476+0000 7f001c73d640 1 --2- 172.21.15.44:0/601954658 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0014102a30 0x7f0014100680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:30.488 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.476+0000 7f001c73d640 1 -- 172.21.15.44:0/601954658 >> 172.21.15.44:0/601954658 conn(0x7f00140fc3e0 msgr2=0x7f00140fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:19:30.488 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.477+0000 7f001c73d640 1 -- 172.21.15.44:0/601954658 shutdown_connections 2024-08-19T00:19:30.488 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:30.477+0000 7f001c73d640 1 -- 172.21.15.44:0/601954658 wait complete. 2024-08-19T00:19:30.667 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-19T00:19:30.679 INFO:tasks.workunit.client.0.smithi044.stdout: 1 437417 8.35 MB/sec execute 175 sec latency 16311.169 ms 2024-08-19T00:19:30.924 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:19:31.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:31.405+0000 7f6e73f67640 1 -- 172.21.15.44:0/2994904980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6e6c1007b0 msgr2=0x7f6e6c100c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:31.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:31.405+0000 7f6e73f67640 1 --2- 172.21.15.44:0/2994904980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6e6c1007b0 0x7f6e6c100c10 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c009930 tx=0x7f6e5c02a420 comp rx=0 tx=0).stop 2024-08-19T00:19:31.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:31.405+0000 7f6e73f67640 1 -- 172.21.15.44:0/2994904980 shutdown_connections 2024-08-19T00:19:31.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:31.405+0000 7f6e73f67640 1 --2- 172.21.15.44:0/2994904980 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6e6c101150 0x7f6e6c10d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:31.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:31.405+0000 7f6e73f67640 1 --2- 172.21.15.44:0/2994904980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6e6c1007b0 0x7f6e6c100c10 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:31.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:31.405+0000 7f6e73f67640 1 --2- 172.21.15.44:0/2994904980 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6e6c1067b0 0x7f6e6c106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:31.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:31.405+0000 7f6e73f67640 1 -- 172.21.15.44:0/2994904980 >> 172.21.15.44:0/2994904980 conn(0x7f6e6c0fc4d0 msgr2=0x7f6e6c0fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:19:31.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:31.406+0000 7f6e73f67640 1 -- 172.21.15.44:0/2994904980 shutdown_connections 2024-08-19T00:19:31.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:31.406+0000 7f6e73f67640 1 -- 172.21.15.44:0/2994904980 wait complete. 2024-08-19T00:19:31.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:31.406+0000 7f6e73f67640 1 Processor -- start 2024-08-19T00:19:31.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:31.406+0000 7f6e73f67640 1 -- start start 2024-08-19T00:19:31.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:31.406+0000 7f6e73f67640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6e6c1007b0 0x7f6e6c10df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:31.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:31.406+0000 7f6e73f67640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6e6c101150 0x7f6e6c10e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:31.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:31.406+0000 7f6e73f67640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6e6c1067b0 0x7f6e6c10ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:31.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:31.406+0000 7f6e73f67640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6e6c111cc0 con 0x7f6e6c1007b0 2024-08-19T00:19:31.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:31.406+0000 7f6e73f67640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f6e6c111b40 con 0x7f6e6c1067b0 2024-08-19T00:19:31.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:31.406+0000 7f6e73f67640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6e6c111e40 con 0x7f6e6c101150 2024-08-19T00:19:31.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:31.406+0000 7f6e71d03640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6e6c1007b0 0x7f6e6c10df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:31.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:31.407+0000 7f6e71d03640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6e6c1007b0 0x7f6e6c10df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42824/0 (socket says 172.21.15.44:42824) 2024-08-19T00:19:31.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:31.407+0000 7f6e71d03640 1 -- 172.21.15.44:0/1718752115 learned_addr learned my addr 172.21.15.44:0/1718752115 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:19:31.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:31.407+0000 7f6e71502640 1 --2- 172.21.15.44:0/1718752115 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6e6c101150 0x7f6e6c10e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:31.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:31.407+0000 7f6e72504640 1 --2- 172.21.15.44:0/1718752115 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6e6c1067b0 0x7f6e6c10ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:31.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:31.407+0000 7f6e71d03640 1 -- 172.21.15.44:0/1718752115 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6e6c101150 msgr2=0x7f6e6c10e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:31.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:31.407+0000 7f6e71d03640 1 --2- 172.21.15.44:0/1718752115 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6e6c101150 0x7f6e6c10e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:31.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:31.407+0000 7f6e71d03640 1 -- 172.21.15.44:0/1718752115 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6e6c1067b0 msgr2=0x7f6e6c10ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:31.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:31.407+0000 7f6e71d03640 1 --2- 172.21.15.44:0/1718752115 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6e6c1067b0 0x7f6e6c10ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:31.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:31.407+0000 7f6e71d03640 1 -- 172.21.15.44:0/1718752115 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e6c1a6630 con 0x7f6e6c1007b0 2024-08-19T00:19:31.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:31.407+0000 7f6e71d03640 1 --2- 172.21.15.44:0/1718752115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6e6c1007b0 0x7f6e6c10df90 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f6e6800d950 tx=0x7f6e6800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:19:31.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:31.407+0000 7f6e62ffd640 1 -- 172.21.15.44:0/1718752115 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e68017070 con 0x7f6e6c1007b0 2024-08-19T00:19:31.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:31.407+0000 7f6e62ffd640 1 -- 172.21.15.44:0/1718752115 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e68009c30 con 0x7f6e6c1007b0 2024-08-19T00:19:31.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:31.407+0000 7f6e73f67640 1 -- 172.21.15.44:0/1718752115 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e6c1a6920 con 0x7f6e6c1007b0 2024-08-19T00:19:31.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:31.407+0000 7f6e62ffd640 1 -- 172.21.15.44:0/1718752115 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e6800f6b0 con 0x7f6e6c1007b0 2024-08-19T00:19:31.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:31.407+0000 7f6e73f67640 1 -- 172.21.15.44:0/1718752115 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e6c1a6e80 con 0x7f6e6c1007b0 2024-08-19T00:19:31.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:31.408+0000 7f6e73f67640 1 -- 172.21.15.44:0/1718752115 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e6c100c10 con 0x7f6e6c1007b0 2024-08-19T00:19:31.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:31.409+0000 7f6e62ffd640 1 -- 172.21.15.44:0/1718752115 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f6e680109d0 con 0x7f6e6c1007b0 2024-08-19T00:19:31.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:31.410+0000 7f6e62ffd640 1 --2- 172.21.15.44:0/1718752115 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f6e580a2d70 0x7f6e580a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:31.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:31.410+0000 7f6e71502640 1 --2- 172.21.15.44:0/1718752115 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f6e580a2d70 0x7f6e580a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:31.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:31.410+0000 7f6e62ffd640 1 -- 172.21.15.44:0/1718752115 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f6e680cf340 con 0x7f6e6c1007b0 2024-08-19T00:19:31.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:31.411+0000 7f6e71502640 1 --2- 172.21.15.44:0/1718752115 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f6e580a2d70 0x7f6e580a5230 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c000c00 tx=0x7f6e5c005a20 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:19:31.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:31.414+0000 7f6e62ffd640 1 -- 172.21.15.44:0/1718752115 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f6e68009de0 con 0x7f6e6c1007b0 2024-08-19T00:19:31.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:31.625+0000 7f6e73f67640 1 -- 172.21.15.44:0/1718752115 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6e6c108da0 con 0x7f6e6c1007b0 2024-08-19T00:19:31.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:31.625+0000 7f6e62ffd640 1 -- 172.21.15.44:0/1718752115 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11989 (secure 0 0 0) 0x7f6e6809bbc0 con 0x7f6e6c1007b0 2024-08-19T00:19:31.627 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:19:31.627 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":33,"btime":"2024-08-19T00:17:11:640526+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14511,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1538841896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1538841896},{"type":"v1","addr":"172.21.15.116:6833","nonce":1538841896}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/4044471606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4044471606},{"type":"v1","addr":"172.21.15.44:6835","nonce":4044471606}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":33,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-19T00:10:53.196636+0000","modified":"2024-08-19T00:17:11.586031+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24473,"mds_1":24446,"mds_2":24439,"mds_3":24431,"mds_4":24418},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14529":{"gid":14529,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6837/1824829052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1824829052},{"type":"v1","addr":"172.21.15.44:6837","nonce":1824829052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14577":{"gid":14577,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6839/3591739042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":3591739042},{"type":"v1","addr":"172.21.15.44:6839","nonce":3591739042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14589":{"gid":14589,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6841/3667695717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6840","nonce":3667695717},{"type":"v1","addr":"172.21.15.44:6841","nonce":3667695717}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24388":{"gid":24388,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1183022838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1183022838},{"type":"v1","addr":"172.21.15.171:6833","nonce":1183022838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6835/2190623851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":2190623851},{"type":"v1","addr":"172.21.15.171:6835","nonce":2190623851}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.171:6837/316231795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":316231795},{"type":"v1","addr":"172.21.15.171:6837","nonce":316231795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":20,"addr":"172.21.15.116:6835/3507399322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3507399322},{"type":"v1","addr":"172.21.15.116:6835","nonce":3507399322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.171:6839/1466585795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":1466585795},{"type":"v1","addr":"172.21.15.171:6839","nonce":1466585795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":17,"addr":"172.21.15.116:6837/2764513846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":2764513846},{"type":"v1","addr":"172.21.15.116:6837","nonce":2764513846}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.116:6839/1032741033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":1032741033},{"type":"v1","addr":"172.21.15.116:6839","nonce":1032741033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24446,24439,24431,24418]},"id":1}]} 2024-08-19T00:19:31.628 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 33 2024-08-19T00:19:31.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:31.627+0000 7f6e73f67640 1 -- 172.21.15.44:0/1718752115 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f6e580a2d70 msgr2=0x7f6e580a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:31.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:31.627+0000 7f6e73f67640 1 --2- 172.21.15.44:0/1718752115 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f6e580a2d70 0x7f6e580a5230 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c000c00 tx=0x7f6e5c005a20 comp rx=0 tx=0).stop 2024-08-19T00:19:31.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:31.627+0000 7f6e73f67640 1 -- 172.21.15.44:0/1718752115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6e6c1007b0 msgr2=0x7f6e6c10df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:31.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:31.627+0000 7f6e73f67640 1 --2- 172.21.15.44:0/1718752115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6e6c1007b0 0x7f6e6c10df90 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f6e6800d950 tx=0x7f6e6800de10 comp rx=0 tx=0).stop 2024-08-19T00:19:31.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:31.627+0000 7f6e73f67640 1 -- 172.21.15.44:0/1718752115 shutdown_connections 2024-08-19T00:19:31.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:31.627+0000 7f6e73f67640 1 --2- 172.21.15.44:0/1718752115 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f6e580a2d70 0x7f6e580a5230 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:31.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:31.627+0000 7f6e73f67640 1 --2- 172.21.15.44:0/1718752115 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6e6c101150 0x7f6e6c10e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:31.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:31.627+0000 7f6e73f67640 1 --2- 172.21.15.44:0/1718752115 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6e6c1067b0 0x7f6e6c10ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:31.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:31.627+0000 7f6e73f67640 1 --2- 172.21.15.44:0/1718752115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6e6c1007b0 0x7f6e6c10df90 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:31.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:31.627+0000 7f6e73f67640 1 -- 172.21.15.44:0/1718752115 >> 172.21.15.44:0/1718752115 conn(0x7f6e6c0fc4d0 msgr2=0x7f6e6c0fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:19:31.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:31.628+0000 7f6e73f67640 1 -- 172.21.15.44:0/1718752115 shutdown_connections 2024-08-19T00:19:31.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:31.628+0000 7f6e73f67640 1 -- 172.21.15.44:0/1718752115 wait complete. 2024-08-19T00:19:31.679 INFO:tasks.workunit.client.0.smithi044.stdout: 1 437417 8.31 MB/sec execute 176 sec latency 17311.241 ms 2024-08-19T00:19:32.297 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:19:32 smithi044 ceph-mon[18489]: pgmap v189: 129 pgs: 129 active+clean; 283 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 2.4 MiB/s wr, 100 op/s 2024-08-19T00:19:32.297 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:19:32 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/1718752115' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:19:32.326 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24473 quiesce db --set-id 47fffa16 --release --await' 2024-08-19T00:19:32.326 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24473 quiesce db --set-id 47fffa16 --release --await 2024-08-19T00:19:32.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:19:32 smithi171 ceph-mon[21810]: pgmap v189: 129 pgs: 129 active+clean; 283 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 2.4 MiB/s wr, 100 op/s 2024-08-19T00:19:32.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:19:32 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/1718752115' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:19:32.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:19:32 smithi116 ceph-mon[21873]: pgmap v189: 129 pgs: 129 active+clean; 283 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 2.4 MiB/s wr, 100 op/s 2024-08-19T00:19:32.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:19:32 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/1718752115' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:19:32.655 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:19:32.679 INFO:tasks.workunit.client.0.smithi044.stdout: 1 437417 8.26 MB/sec execute 177 sec latency 18311.268 ms 2024-08-19T00:19:33.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.136+0000 7f0490758640 1 -- 172.21.15.44:0/3718295563 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0488102250 msgr2=0x7f048810e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:33.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.136+0000 7f0490758640 1 --2- 172.21.15.44:0/3718295563 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0488102250 0x7f048810e780 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f0480009cd0 tx=0x7f048002a8e0 comp rx=0 tx=0).stop 2024-08-19T00:19:33.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.136+0000 7f0490758640 1 -- 172.21.15.44:0/3718295563 shutdown_connections 2024-08-19T00:19:33.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.136+0000 7f0490758640 1 --2- 172.21.15.44:0/3718295563 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04881018b0 0x7f0488101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:33.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.136+0000 7f0490758640 1 --2- 172.21.15.44:0/3718295563 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0488102250 0x7f048810e780 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:33.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.136+0000 7f0490758640 1 --2- 172.21.15.44:0/3718295563 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f04881078b0 0x7f0488107c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:33.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.136+0000 7f0490758640 1 -- 172.21.15.44:0/3718295563 >> 172.21.15.44:0/3718295563 conn(0x7f04880fd5f0 msgr2=0x7f04880ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:19:33.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.136+0000 7f0490758640 1 -- 172.21.15.44:0/3718295563 shutdown_connections 2024-08-19T00:19:33.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.136+0000 7f0490758640 1 -- 172.21.15.44:0/3718295563 wait complete. 2024-08-19T00:19:33.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.137+0000 7f0490758640 1 Processor -- start 2024-08-19T00:19:33.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.137+0000 7f0490758640 1 -- start start 2024-08-19T00:19:33.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.137+0000 7f0490758640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f04881018b0 0x7f04881982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:33.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.137+0000 7f0490758640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0488102250 0x7f0488198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:33.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.137+0000 7f0490758640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04881078b0 0x7f048819cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:33.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.137+0000 7f0490758640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0488111d50 con 0x7f0488102250 2024-08-19T00:19:33.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.137+0000 7f0490758640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f0488111bd0 con 0x7f04881018b0 2024-08-19T00:19:33.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.137+0000 7f0490758640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0488111ed0 con 0x7f04881078b0 2024-08-19T00:19:33.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.137+0000 7f048dcf3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0488102250 0x7f0488198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:33.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.137+0000 7f048dcf3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0488102250 0x7f0488198810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42836/0 (socket says 172.21.15.44:42836) 2024-08-19T00:19:33.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.137+0000 7f048dcf3640 1 -- 172.21.15.44:0/3356297131 learned_addr learned my addr 172.21.15.44:0/3356297131 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:19:33.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.137+0000 7f048e4f4640 1 --2- 172.21.15.44:0/3356297131 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f04881018b0 0x7f04881982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:33.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.137+0000 7f048ecf5640 1 --2- 172.21.15.44:0/3356297131 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04881078b0 0x7f048819cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:33.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.137+0000 7f048dcf3640 1 -- 172.21.15.44:0/3356297131 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04881078b0 msgr2=0x7f048819cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:33.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.137+0000 7f048dcf3640 1 --2- 172.21.15.44:0/3356297131 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04881078b0 0x7f048819cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:33.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.137+0000 7f048dcf3640 1 -- 172.21.15.44:0/3356297131 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f04881018b0 msgr2=0x7f04881982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:33.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.137+0000 7f048dcf3640 1 --2- 172.21.15.44:0/3356297131 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f04881018b0 0x7f04881982d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:33.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.137+0000 7f048dcf3640 1 -- 172.21.15.44:0/3356297131 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f048819d280 con 0x7f0488102250 2024-08-19T00:19:33.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.137+0000 7f048dcf3640 1 --2- 172.21.15.44:0/3356297131 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0488102250 0x7f0488198810 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f047800b4a0 tx=0x7f047800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:19:33.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.138+0000 7f047f7fe640 1 -- 172.21.15.44:0/3356297131 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0478015020 con 0x7f0488102250 2024-08-19T00:19:33.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.138+0000 7f0490758640 1 -- 172.21.15.44:0/3356297131 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f048819d570 con 0x7f0488102250 2024-08-19T00:19:33.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.138+0000 7f047f7fe640 1 -- 172.21.15.44:0/3356297131 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0478011d10 con 0x7f0488102250 2024-08-19T00:19:33.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.138+0000 7f047f7fe640 1 -- 172.21.15.44:0/3356297131 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f047800f2e0 con 0x7f0488102250 2024-08-19T00:19:33.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.138+0000 7f0490758640 1 -- 172.21.15.44:0/3356297131 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04881a4e50 con 0x7f0488102250 2024-08-19T00:19:33.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.140+0000 7f047f7fe640 1 -- 172.21.15.44:0/3356297131 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f0478018020 con 0x7f0488102250 2024-08-19T00:19:33.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.140+0000 7f0492b56740 1 Processor -- start 2024-08-19T00:19:33.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.140+0000 7f0492b56740 1 -- start start 2024-08-19T00:19:33.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.141+0000 7f047f7fe640 1 --2- 172.21.15.44:0/3356297131 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f04740a2cf0 0x7f04740a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:33.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.141+0000 7f0492b56740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a76a2eb990 0x55a76a2ebd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:33.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.141+0000 7f0492b56740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a76a2ec2b0 0x55a76a2f6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:33.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.141+0000 7f0492b56740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a76a2f6b70 0x55a76a2f8f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:33.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.141+0000 7f0492b56740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a76a251c60 con 0x55a76a2f6b70 2024-08-19T00:19:33.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.141+0000 7f0492b56740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55a76a1e9b90 con 0x55a76a2eb990 2024-08-19T00:19:33.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.141+0000 7f0492b56740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55a76a24dc20 con 0x55a76a2ec2b0 2024-08-19T00:19:33.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.141+0000 7f048ecf5640 1 --2- 172.21.15.44:0/3356297131 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f04740a2cf0 0x7f04740a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:33.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.141+0000 7f047f7fe640 1 -- 172.21.15.44:0/3356297131 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f04780cefb0 con 0x7f0488102250 2024-08-19T00:19:33.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.141+0000 7f048ecf5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a76a2f6b70 0x55a76a2f8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:33.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.141+0000 7f048ecf5640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a76a2f6b70 0x55a76a2f8f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42838/0 (socket says 172.21.15.44:42838) 2024-08-19T00:19:33.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.141+0000 7f048ecf5640 1 -- 172.21.15.44:0/3431616888 learned_addr learned my addr 172.21.15.44:0/3431616888 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:19:33.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.141+0000 7f048e4f4640 1 --2- 172.21.15.44:0/3431616888 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a76a2eb990 0x55a76a2ebd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:33.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.141+0000 7f048dcf3640 1 --2- 172.21.15.44:0/3431616888 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a76a2ec2b0 0x55a76a2f6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:33.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.141+0000 7f048ecf5640 1 -- 172.21.15.44:0/3431616888 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a76a2ec2b0 msgr2=0x55a76a2f6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:33.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.141+0000 7f048ecf5640 1 --2- 172.21.15.44:0/3431616888 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a76a2ec2b0 0x55a76a2f6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:33.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.141+0000 7f048ecf5640 1 -- 172.21.15.44:0/3431616888 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a76a2eb990 msgr2=0x55a76a2ebd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:33.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.141+0000 7f048ecf5640 1 --2- 172.21.15.44:0/3431616888 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a76a2eb990 0x55a76a2ebd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:33.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.141+0000 7f048ecf5640 1 -- 172.21.15.44:0/3431616888 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a769f61580 con 0x55a76a2f6b70 2024-08-19T00:19:33.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.141+0000 7f048ecf5640 1 --2- 172.21.15.44:0/3431616888 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a76a2f6b70 0x55a76a2f8f60 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f0480009a60 tx=0x7f0480031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d81c923b971a25dd server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:19:33.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.142+0000 7f048ecf5640 1 --2- 172.21.15.44:0/3356297131 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f04740a2cf0 0x7f04740a51b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0480035000 tx=0x7f0480042000 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:19:33.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.142+0000 7f047cff9640 1 -- 172.21.15.44:0/3431616888 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f048004e070 con 0x55a76a2f6b70 2024-08-19T00:19:33.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.142+0000 7f047cff9640 1 -- 172.21.15.44:0/3431616888 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0480036040 con 0x55a76a2f6b70 2024-08-19T00:19:33.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.142+0000 7f047cff9640 1 -- 172.21.15.44:0/3431616888 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0480030c00 con 0x55a76a2f6b70 2024-08-19T00:19:33.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.142+0000 7f0492b56740 1 -- 172.21.15.44:0/3431616888 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a76a2f6b70 msgr2=0x55a76a2f8f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:33.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.142+0000 7f0492b56740 1 --2- 172.21.15.44:0/3431616888 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a76a2f6b70 0x55a76a2f8f60 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f0480009a60 tx=0x7f0480031ca0 comp rx=0 tx=0).stop 2024-08-19T00:19:33.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.142+0000 7f0492b56740 1 -- 172.21.15.44:0/3431616888 shutdown_connections 2024-08-19T00:19:33.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.142+0000 7f0492b56740 1 --2- 172.21.15.44:0/3431616888 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a76a2ec2b0 0x55a76a2f6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:33.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.142+0000 7f0492b56740 1 --2- 172.21.15.44:0/3431616888 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a76a2f6b70 0x55a76a2f8f60 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:33.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.142+0000 7f0492b56740 1 --2- 172.21.15.44:0/3431616888 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a76a2eb990 0x55a76a2ebd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:33.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.142+0000 7f0492b56740 1 -- 172.21.15.44:0/3431616888 >> 172.21.15.44:0/3431616888 conn(0x55a76a2e7f20 msgr2=0x55a76a2e8300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:19:33.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.143+0000 7f0492b56740 1 -- 172.21.15.44:0/3431616888 shutdown_connections 2024-08-19T00:19:33.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.143+0000 7f0492b56740 1 -- 172.21.15.44:0/3431616888 wait complete. 2024-08-19T00:19:33.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.143+0000 7f0492b56740 1 -- start start 2024-08-19T00:19:33.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.143+0000 7f0492b56740 1 Processor -- start 2024-08-19T00:19:33.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.143+0000 7f0492b56740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a76a2eb990 0x55a76a2f3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:33.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.143+0000 7f0492b56740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a76a2ec2b0 0x55a76a2f3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:33.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.143+0000 7f0492b56740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a76a2f6b70 0x55a76a2f4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:33.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.143+0000 7f0492b56740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a76a2f9740 con 0x55a76a2eb990 2024-08-19T00:19:33.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.143+0000 7f0492b56740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55a76a1ef7c0 con 0x55a76a2ec2b0 2024-08-19T00:19:33.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.143+0000 7f0492b56740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55a76a2f98c0 con 0x55a76a2f6b70 2024-08-19T00:19:33.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.143+0000 7f0492b56740 10 client.0 _ll_register_callbacks cb 0x55a76a1f8f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:19:33.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.143+0000 7f048e4f4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a76a2eb990 0x55a76a2f3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:33.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.143+0000 7f048e4f4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a76a2eb990 0x55a76a2f3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42850/0 (socket says 172.21.15.44:42850) 2024-08-19T00:19:33.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.143+0000 7f048e4f4640 1 -- 172.21.15.44:0/1615830081 learned_addr learned my addr 172.21.15.44:0/1615830081 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:19:33.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.143+0000 7f048dcf3640 1 --2- 172.21.15.44:0/1615830081 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a76a2ec2b0 0x55a76a2f3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:33.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.144+0000 7f048ecf5640 1 --2- 172.21.15.44:0/1615830081 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a76a2f6b70 0x55a76a2f4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:33.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.144+0000 7f048e4f4640 1 -- 172.21.15.44:0/1615830081 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a76a2f6b70 msgr2=0x55a76a2f4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:33.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.144+0000 7f048e4f4640 1 --2- 172.21.15.44:0/1615830081 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a76a2f6b70 0x55a76a2f4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:33.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.144+0000 7f048e4f4640 1 -- 172.21.15.44:0/1615830081 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a76a2ec2b0 msgr2=0x55a76a2f3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:33.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.144+0000 7f048e4f4640 1 --2- 172.21.15.44:0/1615830081 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a76a2ec2b0 0x55a76a2f3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:33.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.144+0000 7f048e4f4640 1 -- 172.21.15.44:0/1615830081 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a76a02b960 con 0x55a76a2eb990 2024-08-19T00:19:33.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.144+0000 7f048e4f4640 1 --2- 172.21.15.44:0/1615830081 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a76a2eb990 0x55a76a2f3ab0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f04840115c0 tx=0x7f0484011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f44947821cc9fe4a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:19:33.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.144+0000 7f0471ffb640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:19:33.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.144+0000 7f0471ffb640 1 -- 172.21.15.44:0/1615830081 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f048400f750 con 0x55a76a2eb990 2024-08-19T00:19:33.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.144+0000 7f0471ffb640 1 -- 172.21.15.44:0/1615830081 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f048400f8f0 con 0x55a76a2eb990 2024-08-19T00:19:33.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.144+0000 7f0492b56740 1 -- 172.21.15.44:0/1615830081 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0480036040 con 0x55a76a2eb990 2024-08-19T00:19:33.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.144+0000 7f0471ffb640 1 -- 172.21.15.44:0/1615830081 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f048400faf0 con 0x55a76a2eb990 2024-08-19T00:19:33.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.144+0000 7f0492b56740 10 client.16284 fetch_fsmap learned FSMap version 33 2024-08-19T00:19:33.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.144+0000 7f0492b56740 1 -- 172.21.15.44:0/1615830081 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55a76a3057a0 con 0x55a76a2eb990 2024-08-19T00:19:33.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.144+0000 7f0471ffb640 1 -- 172.21.15.44:0/1615830081 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0480036040 con 0x55a76a2eb990 2024-08-19T00:19:33.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.145+0000 7f0471ffb640 1 -- 172.21.15.44:0/1615830081 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f048401d400 con 0x55a76a2eb990 2024-08-19T00:19:33.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.145+0000 7f0492b56740 10 client.16284 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:19:33.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.145+0000 7f0492b56740 10 client.16284 resolve_mds: validated gid 24473 aka daemon mds.b 2024-08-19T00:19:33.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.145+0000 7f0492b56740 20 client.16284 populate_metadata read hostname 'smithi044' 2024-08-19T00:19:33.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.145+0000 7f0492b56740 1 --2- 172.21.15.44:0/1615830081 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55a76a306c60 0x55a76a3090b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:33.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.145+0000 7f0492b56740 4 client.16284 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:19:33.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.145+0000 7f0492b56740 1 -- 172.21.15.44:0/1615830081 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a76a25f1d0 con 0x55a76a306c60 2024-08-19T00:19:33.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.145+0000 7f048dcf3640 1 --2- 172.21.15.44:0/1615830081 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55a76a306c60 0x55a76a3090b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:33.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.145+0000 7f0471ffb640 10 client.16284 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:19:33.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.145+0000 7f048dcf3640 1 --2- 172.21.15.44:0/1615830081 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55a76a306c60 0x55a76a3090b0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a836ddc6b380146 server_cookie=f158df293de68832 in_seq=0 out_seq=0 2024-08-19T00:19:33.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.146+0000 7f0471ffb640 1 -- 172.21.15.44:0/1615830081 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a76a25f1d0 con 0x55a76a306c60 2024-08-19T00:19:33.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.146+0000 7f0471ffb640 10 client.16284 handle_command_reply: tid=0 2024-08-19T00:19:33.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.146+0000 7f0492b56740 1 client.16284 shutdown 2024-08-19T00:19:33.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.146+0000 7f0492b56740 1 -- 172.21.15.44:0/1615830081 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a76a2eb990 msgr2=0x55a76a2f3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:33.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.146+0000 7f0492b56740 1 --2- 172.21.15.44:0/1615830081 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a76a2eb990 0x55a76a2f3ab0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f04840115c0 tx=0x7f0484011a80 comp rx=0 tx=0).stop 2024-08-19T00:19:33.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.146+0000 7f0492b56740 1 -- 172.21.15.44:0/1615830081 shutdown_connections 2024-08-19T00:19:33.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.146+0000 7f0492b56740 1 --2- 172.21.15.44:0/1615830081 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55a76a306c60 0x55a76a3090b0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:33.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.146+0000 7f0492b56740 1 --2- 172.21.15.44:0/1615830081 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a76a2f6b70 0x55a76a2f4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:33.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.146+0000 7f0492b56740 1 --2- 172.21.15.44:0/1615830081 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a76a2ec2b0 0x55a76a2f3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:33.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.146+0000 7f0492b56740 1 --2- 172.21.15.44:0/1615830081 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a76a2eb990 0x55a76a2f3ab0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:33.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.146+0000 7f0492b56740 1 -- 172.21.15.44:0/1615830081 >> 172.21.15.44:0/1615830081 conn(0x55a76a2e7f20 msgr2=0x55a76a2edc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:19:33.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.146+0000 7f0471ffb640 0 client.16284 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:19:33.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.146+0000 7f0492b56740 1 -- 172.21.15.44:0/1615830081 shutdown_connections 2024-08-19T00:19:33.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.146+0000 7f0492b56740 1 -- 172.21.15.44:0/1615830081 wait complete. 2024-08-19T00:19:33.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.147+0000 7f0492b56740 20 client.16284 trim_cache size 0 max 16384 2024-08-19T00:19:33.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.179+0000 7f0492b56740 1 Processor -- start 2024-08-19T00:19:33.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.179+0000 7f0492b56740 1 -- start start 2024-08-19T00:19:33.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.179+0000 7f0492b56740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a76a2eb990 0x55a76a30e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:33.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.179+0000 7f0492b56740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a76a2ec2b0 0x55a76a30eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:33.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.179+0000 7f0492b56740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a76a2f6b70 0x55a76a2f0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:33.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.179+0000 7f0492b56740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f04881aeec0 con 0x55a76a2ec2b0 2024-08-19T00:19:33.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.179+0000 7f0492b56740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f04881b0a00 con 0x55a76a2f6b70 2024-08-19T00:19:33.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.179+0000 7f0492b56740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f04881af590 con 0x55a76a2eb990 2024-08-19T00:19:33.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.179+0000 7f048dcf3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a76a2ec2b0 0x55a76a30eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:33.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.179+0000 7f048dcf3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a76a2ec2b0 0x55a76a30eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42858/0 (socket says 172.21.15.44:42858) 2024-08-19T00:19:33.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.179+0000 7f048ecf5640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a76a2f6b70 0x55a76a2f0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:33.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.179+0000 7f048dcf3640 1 -- 172.21.15.44:0/1823394838 learned_addr learned my addr 172.21.15.44:0/1823394838 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:19:33.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.179+0000 7f048e4f4640 1 --2- 172.21.15.44:0/1823394838 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a76a2eb990 0x55a76a30e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:33.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.180+0000 7f048dcf3640 1 -- 172.21.15.44:0/1823394838 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a76a2eb990 msgr2=0x55a76a30e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:33.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.180+0000 7f048dcf3640 1 --2- 172.21.15.44:0/1823394838 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a76a2eb990 0x55a76a30e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:33.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.180+0000 7f048dcf3640 1 -- 172.21.15.44:0/1823394838 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a76a2f6b70 msgr2=0x55a76a2f0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:33.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.180+0000 7f048dcf3640 1 --2- 172.21.15.44:0/1823394838 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a76a2f6b70 0x55a76a2f0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:33.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.180+0000 7f048dcf3640 1 -- 172.21.15.44:0/1823394838 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a76a2f92d0 con 0x55a76a2ec2b0 2024-08-19T00:19:33.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.180+0000 7f048ecf5640 1 --2- 172.21.15.44:0/1823394838 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a76a2f6b70 0x55a76a2f0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:19:33.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.180+0000 7f048dcf3640 1 --2- 172.21.15.44:0/1823394838 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a76a2ec2b0 0x55a76a30eec0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f04780cc4d0 tx=0x7f04780047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17539d4b07a93242 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:19:33.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.180+0000 7f0473fff640 1 -- 172.21.15.44:0/1823394838 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f047809b240 con 0x55a76a2ec2b0 2024-08-19T00:19:33.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.180+0000 7f0473fff640 1 -- 172.21.15.44:0/1823394838 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0478074070 con 0x55a76a2ec2b0 2024-08-19T00:19:33.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.180+0000 7f0473fff640 1 -- 172.21.15.44:0/1823394838 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04780cc5e0 con 0x55a76a2ec2b0 2024-08-19T00:19:33.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.181+0000 7f0492b56740 1 -- 172.21.15.44:0/1823394838 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a76a2ec2b0 msgr2=0x55a76a30eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:33.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.181+0000 7f0492b56740 1 --2- 172.21.15.44:0/1823394838 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a76a2ec2b0 0x55a76a30eec0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f04780cc4d0 tx=0x7f04780047d0 comp rx=0 tx=0).stop 2024-08-19T00:19:33.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.181+0000 7f0492b56740 1 -- 172.21.15.44:0/1823394838 shutdown_connections 2024-08-19T00:19:33.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.181+0000 7f0492b56740 1 --2- 172.21.15.44:0/1823394838 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a76a2f6b70 0x55a76a2f0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:33.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.181+0000 7f0492b56740 1 --2- 172.21.15.44:0/1823394838 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a76a2ec2b0 0x55a76a30eec0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:33.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.181+0000 7f0492b56740 1 --2- 172.21.15.44:0/1823394838 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a76a2eb990 0x55a76a30e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:33.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.181+0000 7f0492b56740 1 -- 172.21.15.44:0/1823394838 >> 172.21.15.44:0/1823394838 conn(0x55a76a2e7f20 msgr2=0x55a76a2f5b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:19:33.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.181+0000 7f0492b56740 1 -- 172.21.15.44:0/1823394838 shutdown_connections 2024-08-19T00:19:33.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.181+0000 7f0492b56740 1 -- 172.21.15.44:0/1823394838 wait complete. 2024-08-19T00:19:33.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.182+0000 7f0492b56740 1 -- start start 2024-08-19T00:19:33.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.182+0000 7f0492b56740 1 Processor -- start 2024-08-19T00:19:33.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.182+0000 7f0492b56740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a76a2eb990 0x55a76a2fee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:33.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.182+0000 7f0492b56740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a76a2ec2b0 0x55a76a2ff3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:33.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.182+0000 7f048e4f4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a76a2eb990 0x55a76a2fee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:33.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.182+0000 7f0492b56740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a76a2f6b70 0x55a76a2fbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:33.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.182+0000 7f048e4f4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a76a2eb990 0x55a76a2fee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42866/0 (socket says 172.21.15.44:42866) 2024-08-19T00:19:33.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.182+0000 7f048e4f4640 1 -- 172.21.15.44:0/3793558136 learned_addr learned my addr 172.21.15.44:0/3793558136 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:19:33.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.182+0000 7f0492b56740 1 -- 172.21.15.44:0/3793558136 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f04881b0330 con 0x55a76a2eb990 2024-08-19T00:19:33.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.182+0000 7f0492b56740 1 -- 172.21.15.44:0/3793558136 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f04881afc60 con 0x55a76a2f6b70 2024-08-19T00:19:33.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.182+0000 7f0492b56740 1 -- 172.21.15.44:0/3793558136 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f04881acea0 con 0x55a76a2ec2b0 2024-08-19T00:19:33.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.182+0000 7f0492b56740 10 client.0 _ll_register_callbacks cb 0x7f0484009f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:19:33.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.182+0000 7f048dcf3640 1 --2- 172.21.15.44:0/3793558136 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a76a2ec2b0 0x55a76a2ff3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:33.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.183+0000 7f048ecf5640 1 --2- 172.21.15.44:0/3793558136 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a76a2f6b70 0x55a76a2fbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:33.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.183+0000 7f048e4f4640 1 -- 172.21.15.44:0/3793558136 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a76a2ec2b0 msgr2=0x55a76a2ff3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:33.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.183+0000 7f048e4f4640 1 --2- 172.21.15.44:0/3793558136 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a76a2ec2b0 0x55a76a2ff3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:33.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.183+0000 7f048e4f4640 1 -- 172.21.15.44:0/3793558136 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a76a2f6b70 msgr2=0x55a76a2fbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:33.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.183+0000 7f048e4f4640 1 --2- 172.21.15.44:0/3793558136 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a76a2f6b70 0x55a76a2fbd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:33.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.183+0000 7f048e4f4640 1 -- 172.21.15.44:0/3793558136 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a76a2fc560 con 0x55a76a2eb990 2024-08-19T00:19:33.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.183+0000 7f048e4f4640 1 --2- 172.21.15.44:0/3793558136 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a76a2eb990 0x55a76a2fee80 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f048401d7f0 tx=0x7f048400f980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb551217cedca259 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:19:33.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.183+0000 7f0471ffb640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:19:33.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.183+0000 7f0471ffb640 1 -- 172.21.15.44:0/3793558136 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f048400fe90 con 0x55a76a2eb990 2024-08-19T00:19:33.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.183+0000 7f0471ffb640 1 -- 172.21.15.44:0/3793558136 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f048401da60 con 0x55a76a2eb990 2024-08-19T00:19:33.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.183+0000 7f0492b56740 1 -- 172.21.15.44:0/3793558136 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0478074070 con 0x55a76a2eb990 2024-08-19T00:19:33.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.183+0000 7f0471ffb640 1 -- 172.21.15.44:0/3793558136 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f048401dc60 con 0x55a76a2eb990 2024-08-19T00:19:33.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.183+0000 7f0492b56740 10 client.16290 fetch_fsmap learned FSMap version 33 2024-08-19T00:19:33.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.183+0000 7f0492b56740 1 -- 172.21.15.44:0/3793558136 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55a76a372670 con 0x55a76a2eb990 2024-08-19T00:19:33.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.184+0000 7f0471ffb640 1 -- 172.21.15.44:0/3793558136 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0478074070 con 0x55a76a2eb990 2024-08-19T00:19:33.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.184+0000 7f0471ffb640 1 -- 172.21.15.44:0/3793558136 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f048402a420 con 0x55a76a2eb990 2024-08-19T00:19:33.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.184+0000 7f0492b56740 10 client.16290 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:19:33.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.184+0000 7f0492b56740 10 client.16290 resolve_mds: validated gid 24473 aka daemon mds.b 2024-08-19T00:19:33.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.184+0000 7f0492b56740 20 client.16290 populate_metadata read hostname 'smithi044' 2024-08-19T00:19:33.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.184+0000 7f0492b56740 1 --2- 172.21.15.44:0/3793558136 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55a76a372e10 0x55a76a375250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:33.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.184+0000 7f0492b56740 4 client.16290 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "47fffa16", "release": true, "await": true}] 2024-08-19T00:19:33.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.184+0000 7f0492b56740 1 -- 172.21.15.44:0/3793558136 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "quiesce db", "set_id": "47fffa16", "release": true, "await": true}) -- 0x55a76a2596e0 con 0x55a76a372e10 2024-08-19T00:19:33.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.184+0000 7f048dcf3640 1 --2- 172.21.15.44:0/3793558136 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55a76a372e10 0x55a76a375250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:33.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.185+0000 7f048dcf3640 1 --2- 172.21.15.44:0/3793558136 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55a76a372e10 0x55a76a375250 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6425b82bc0272e0b server_cookie=8b3fe372f1ddf29f in_seq=0 out_seq=0 2024-08-19T00:19:33.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.185+0000 7f0471ffb640 10 client.16290 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:19:33.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.193+0000 7f0471ffb640 1 -- 172.21.15.44:0/3793558136 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55a76a2596e0 con 0x55a76a372e10 2024-08-19T00:19:33.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.193+0000 7f0471ffb640 10 client.16290 handle_command_reply: tid=0 2024-08-19T00:19:33.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.193+0000 7f0492b56740 1 client.16290 shutdown 2024-08-19T00:19:33.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.193+0000 7f0492b56740 1 -- 172.21.15.44:0/3793558136 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a76a2eb990 msgr2=0x55a76a2fee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:33.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.193+0000 7f0492b56740 1 --2- 172.21.15.44:0/3793558136 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a76a2eb990 0x55a76a2fee80 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f048401d7f0 tx=0x7f048400f980 comp rx=0 tx=0).stop 2024-08-19T00:19:33.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.193+0000 7f0492b56740 1 -- 172.21.15.44:0/3793558136 shutdown_connections 2024-08-19T00:19:33.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.193+0000 7f0492b56740 1 --2- 172.21.15.44:0/3793558136 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55a76a372e10 0x55a76a375250 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:33.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.193+0000 7f0492b56740 1 --2- 172.21.15.44:0/3793558136 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a76a2ec2b0 0x55a76a2ff3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:33.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.193+0000 7f0492b56740 1 --2- 172.21.15.44:0/3793558136 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a76a2f6b70 0x55a76a2fbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:33.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.193+0000 7f0471ffb640 0 client.16290 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:19:33.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.193+0000 7f0492b56740 1 --2- 172.21.15.44:0/3793558136 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a76a2eb990 0x55a76a2fee80 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:33.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.193+0000 7f0492b56740 1 -- 172.21.15.44:0/3793558136 >> 172.21.15.44:0/3793558136 conn(0x55a76a2e7f20 msgr2=0x55a76a2e6860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:19:33.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.193+0000 7f0492b56740 1 -- 172.21.15.44:0/3793558136 shutdown_connections 2024-08-19T00:19:33.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.193+0000 7f0492b56740 1 -- 172.21.15.44:0/3793558136 wait complete. 2024-08-19T00:19:33.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.193+0000 7f0492b56740 20 client.16290 trim_cache size 0 max 16384 2024-08-19T00:19:33.197 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-08-19T00:19:33.197 INFO:teuthology.orchestra.run.smithi044.stdout: "epoch": 33, 2024-08-19T00:19:33.197 INFO:teuthology.orchestra.run.smithi044.stdout: "leader": 24473, 2024-08-19T00:19:33.197 INFO:teuthology.orchestra.run.smithi044.stdout: "set_version": 20, 2024-08-19T00:19:33.197 INFO:teuthology.orchestra.run.smithi044.stdout: "sets": { 2024-08-19T00:19:33.197 INFO:teuthology.orchestra.run.smithi044.stdout: "47fffa16": { 2024-08-19T00:19:33.197 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 20, 2024-08-19T00:19:33.197 INFO:teuthology.orchestra.run.smithi044.stdout: "age_ref": 0.0, 2024-08-19T00:19:33.198 INFO:teuthology.orchestra.run.smithi044.stdout: "state": { 2024-08-19T00:19:33.198 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "RELEASED", 2024-08-19T00:19:33.198 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.0 2024-08-19T00:19:33.198 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:19:33.198 INFO:teuthology.orchestra.run.smithi044.stdout: "timeout": 90.0, 2024-08-19T00:19:33.198 INFO:teuthology.orchestra.run.smithi044.stdout: "expiration": 139.2, 2024-08-19T00:19:33.198 INFO:teuthology.orchestra.run.smithi044.stdout: "members": { 2024-08-19T00:19:33.198 INFO:teuthology.orchestra.run.smithi044.stdout: "file:/": { 2024-08-19T00:19:33.198 INFO:teuthology.orchestra.run.smithi044.stdout: "excluded": false, 2024-08-19T00:19:33.198 INFO:teuthology.orchestra.run.smithi044.stdout: "state": { 2024-08-19T00:19:33.198 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "RELEASED", 2024-08-19T00:19:33.199 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.0 2024-08-19T00:19:33.199 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:19:33.199 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:19:33.199 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:19:33.199 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:19:33.199 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:19:33.199 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-08-19T00:19:33.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.194+0000 7f0490758640 1 -- 172.21.15.44:0/3356297131 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f04740a2cf0 msgr2=0x7f04740a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:33.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.194+0000 7f0490758640 1 --2- 172.21.15.44:0/3356297131 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f04740a2cf0 0x7f04740a51b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0480035000 tx=0x7f0480042000 comp rx=0 tx=0).stop 2024-08-19T00:19:33.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.194+0000 7f0490758640 1 -- 172.21.15.44:0/3356297131 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0488102250 msgr2=0x7f0488198810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:33.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.194+0000 7f0490758640 1 --2- 172.21.15.44:0/3356297131 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0488102250 0x7f0488198810 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f047800b4a0 tx=0x7f047800b8a0 comp rx=0 tx=0).stop 2024-08-19T00:19:33.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.194+0000 7f0490758640 1 -- 172.21.15.44:0/3356297131 shutdown_connections 2024-08-19T00:19:33.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.194+0000 7f0490758640 1 --2- 172.21.15.44:0/3356297131 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f04740a2cf0 0x7f04740a51b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:33.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.194+0000 7f0490758640 1 --2- 172.21.15.44:0/3356297131 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04881078b0 0x7f048819cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:33.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.194+0000 7f0490758640 1 --2- 172.21.15.44:0/3356297131 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0488102250 0x7f0488198810 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:33.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.194+0000 7f0490758640 1 --2- 172.21.15.44:0/3356297131 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f04881018b0 0x7f04881982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:33.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.194+0000 7f0490758640 1 -- 172.21.15.44:0/3356297131 >> 172.21.15.44:0/3356297131 conn(0x7f04880fd5f0 msgr2=0x7f04880fde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:19:33.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.194+0000 7f0490758640 1 -- 172.21.15.44:0/3356297131 shutdown_connections 2024-08-19T00:19:33.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:33.194+0000 7f0490758640 1 -- 172.21.15.44:0/3356297131 wait complete. 2024-08-19T00:19:33.679 INFO:tasks.workunit.client.0.smithi044.stdout: 1 438513 8.23 MB/sec execute 178 sec latency 18827.945 ms 2024-08-19T00:19:34.064 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:19:34 smithi044 ceph-mon[18489]: pgmap v190: 129 pgs: 129 active+clean; 283 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 1.6 MiB/s wr, 66 op/s 2024-08-19T00:19:34.097 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '47fffa16', total seconds elapsed: 22.6 2024-08-19T00:19:34.098 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 19.2 2024-08-19T00:19:34.098 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-19T00:19:34.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:19:34 smithi171 ceph-mon[21810]: pgmap v190: 129 pgs: 129 active+clean; 283 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 1.6 MiB/s wr, 66 op/s 2024-08-19T00:19:34.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:19:34 smithi116 ceph-mon[21873]: pgmap v190: 129 pgs: 129 active+clean; 283 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 1.6 MiB/s wr, 66 op/s 2024-08-19T00:19:34.376 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:19:34.679 INFO:tasks.workunit.client.0.smithi044.stdout: 1 440554 8.26 MB/sec execute 179 sec latency 26.944 ms 2024-08-19T00:19:34.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:34.879+0000 7fabfb5f0640 1 -- 172.21.15.44:0/1955089681 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fabf4102c20 msgr2=0x7fabf410d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:34.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:34.879+0000 7fabfb5f0640 1 --2- 172.21.15.44:0/1955089681 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fabf4102c20 0x7fabf410d770 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fabec009ca0 tx=0x7fabec02a950 comp rx=0 tx=0).stop 2024-08-19T00:19:34.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:34.879+0000 7fabfb5f0640 1 -- 172.21.15.44:0/1955089681 shutdown_connections 2024-08-19T00:19:34.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:34.879+0000 7fabfb5f0640 1 --2- 172.21.15.44:0/1955089681 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fabf41022a0 0x7fabf41026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:34.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:34.879+0000 7fabfb5f0640 1 --2- 172.21.15.44:0/1955089681 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fabf4102c20 0x7fabf410d770 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:34.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:34.879+0000 7fabfb5f0640 1 --2- 172.21.15.44:0/1955089681 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fabf4100b50 0x7fabf4100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:34.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:34.879+0000 7fabfb5f0640 1 -- 172.21.15.44:0/1955089681 >> 172.21.15.44:0/1955089681 conn(0x7fabf40fc500 msgr2=0x7fabf40fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:19:34.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:34.879+0000 7fabfb5f0640 1 -- 172.21.15.44:0/1955089681 shutdown_connections 2024-08-19T00:19:34.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:34.879+0000 7fabfb5f0640 1 -- 172.21.15.44:0/1955089681 wait complete. 2024-08-19T00:19:34.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:34.880+0000 7fabfb5f0640 1 Processor -- start 2024-08-19T00:19:34.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:34.880+0000 7fabfb5f0640 1 -- start start 2024-08-19T00:19:34.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:34.880+0000 7fabfb5f0640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fabf4100b50 0x7fabf4198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:34.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:34.880+0000 7fabfb5f0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fabf41022a0 0x7fabf4198770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:34.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:34.880+0000 7fabfb5f0640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fabf4102c20 0x7fabf419cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:34.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:34.880+0000 7fabfb5f0640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fabf4110cb0 con 0x7fabf41022a0 2024-08-19T00:19:34.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:34.880+0000 7fabfb5f0640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fabf4110b30 con 0x7fabf4100b50 2024-08-19T00:19:34.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:34.880+0000 7fabfb5f0640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fabf4110e30 con 0x7fabf4102c20 2024-08-19T00:19:34.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:34.880+0000 7fabf8b8b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fabf41022a0 0x7fabf4198770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:34.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:34.880+0000 7fabf8b8b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fabf41022a0 0x7fabf4198770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42882/0 (socket says 172.21.15.44:42882) 2024-08-19T00:19:34.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:34.880+0000 7fabf8b8b640 1 -- 172.21.15.44:0/2239723395 learned_addr learned my addr 172.21.15.44:0/2239723395 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:19:34.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:34.880+0000 7fabf9b8d640 1 --2- 172.21.15.44:0/2239723395 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fabf4102c20 0x7fabf419cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:34.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:34.880+0000 7fabf938c640 1 --2- 172.21.15.44:0/2239723395 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fabf4100b50 0x7fabf4198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:34.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:34.880+0000 7fabf8b8b640 1 -- 172.21.15.44:0/2239723395 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fabf4102c20 msgr2=0x7fabf419cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:34.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:34.880+0000 7fabf8b8b640 1 --2- 172.21.15.44:0/2239723395 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fabf4102c20 0x7fabf419cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:34.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:34.880+0000 7fabf8b8b640 1 -- 172.21.15.44:0/2239723395 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fabf4100b50 msgr2=0x7fabf4198230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:34.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:34.880+0000 7fabf8b8b640 1 --2- 172.21.15.44:0/2239723395 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fabf4100b50 0x7fabf4198230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:34.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:34.880+0000 7fabf8b8b640 1 -- 172.21.15.44:0/2239723395 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabf419d1e0 con 0x7fabf41022a0 2024-08-19T00:19:34.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:34.881+0000 7fabf8b8b640 1 --2- 172.21.15.44:0/2239723395 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fabf41022a0 0x7fabf4198770 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fabe400e9f0 tx=0x7fabe400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:19:34.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:34.881+0000 7fabea7fc640 1 -- 172.21.15.44:0/2239723395 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe400cd80 con 0x7fabf41022a0 2024-08-19T00:19:34.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:34.881+0000 7fabea7fc640 1 -- 172.21.15.44:0/2239723395 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fabe4005500 con 0x7fabf41022a0 2024-08-19T00:19:34.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:34.881+0000 7fabfb5f0640 1 -- 172.21.15.44:0/2239723395 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabf419d4d0 con 0x7fabf41022a0 2024-08-19T00:19:34.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:34.881+0000 7fabea7fc640 1 -- 172.21.15.44:0/2239723395 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe4010690 con 0x7fabf41022a0 2024-08-19T00:19:34.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:34.881+0000 7fabfb5f0640 1 -- 172.21.15.44:0/2239723395 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabf41a4db0 con 0x7fabf41022a0 2024-08-19T00:19:34.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:34.882+0000 7fabfb5f0640 1 -- 172.21.15.44:0/2239723395 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabf4100f30 con 0x7fabf41022a0 2024-08-19T00:19:34.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:34.883+0000 7fabea7fc640 1 -- 172.21.15.44:0/2239723395 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fabe40046c0 con 0x7fabf41022a0 2024-08-19T00:19:34.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:34.884+0000 7fabea7fc640 1 --2- 172.21.15.44:0/2239723395 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fabe00a2cf0 0x7fabe00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:34.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:34.884+0000 7fabf938c640 1 --2- 172.21.15.44:0/2239723395 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fabe00a2cf0 0x7fabe00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:34.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:34.884+0000 7fabea7fc640 1 -- 172.21.15.44:0/2239723395 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7fabe40cfbd0 con 0x7fabf41022a0 2024-08-19T00:19:34.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:34.884+0000 7fabf938c640 1 --2- 172.21.15.44:0/2239723395 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fabe00a2cf0 0x7fabe00a51b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fabf00095f0 tx=0x7fabf0005f90 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:19:34.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:34.888+0000 7fabea7fc640 1 -- 172.21.15.44:0/2239723395 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fabe409c450 con 0x7fabf41022a0 2024-08-19T00:19:35.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:35.106+0000 7fabfb5f0640 1 -- 172.21.15.44:0/2239723395 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fabf4109e00 con 0x7fabf41022a0 2024-08-19T00:19:35.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:35.107+0000 7fabea7fc640 1 -- 172.21.15.44:0/2239723395 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11989 (secure 0 0 0) 0x7fabe409bd50 con 0x7fabf41022a0 2024-08-19T00:19:35.109 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:19:35.109 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":33,"btime":"2024-08-19T00:17:11:640526+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14511,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1538841896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1538841896},{"type":"v1","addr":"172.21.15.116:6833","nonce":1538841896}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/4044471606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4044471606},{"type":"v1","addr":"172.21.15.44:6835","nonce":4044471606}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":33,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-19T00:10:53.196636+0000","modified":"2024-08-19T00:17:11.586031+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24473,"mds_1":24446,"mds_2":24439,"mds_3":24431,"mds_4":24418},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14529":{"gid":14529,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6837/1824829052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1824829052},{"type":"v1","addr":"172.21.15.44:6837","nonce":1824829052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14577":{"gid":14577,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6839/3591739042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":3591739042},{"type":"v1","addr":"172.21.15.44:6839","nonce":3591739042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14589":{"gid":14589,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6841/3667695717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6840","nonce":3667695717},{"type":"v1","addr":"172.21.15.44:6841","nonce":3667695717}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24388":{"gid":24388,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1183022838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1183022838},{"type":"v1","addr":"172.21.15.171:6833","nonce":1183022838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6835/2190623851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":2190623851},{"type":"v1","addr":"172.21.15.171:6835","nonce":2190623851}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.171:6837/316231795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":316231795},{"type":"v1","addr":"172.21.15.171:6837","nonce":316231795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":20,"addr":"172.21.15.116:6835/3507399322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3507399322},{"type":"v1","addr":"172.21.15.116:6835","nonce":3507399322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.171:6839/1466585795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":1466585795},{"type":"v1","addr":"172.21.15.171:6839","nonce":1466585795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":17,"addr":"172.21.15.116:6837/2764513846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":2764513846},{"type":"v1","addr":"172.21.15.116:6837","nonce":2764513846}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.116:6839/1032741033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":1032741033},{"type":"v1","addr":"172.21.15.116:6839","nonce":1032741033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24446,24439,24431,24418]},"id":1}]} 2024-08-19T00:19:35.109 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 33 2024-08-19T00:19:35.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:35.110+0000 7fabfb5f0640 1 -- 172.21.15.44:0/2239723395 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fabe00a2cf0 msgr2=0x7fabe00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:35.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:35.110+0000 7fabfb5f0640 1 --2- 172.21.15.44:0/2239723395 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fabe00a2cf0 0x7fabe00a51b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fabf00095f0 tx=0x7fabf0005f90 comp rx=0 tx=0).stop 2024-08-19T00:19:35.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:35.110+0000 7fabfb5f0640 1 -- 172.21.15.44:0/2239723395 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fabf41022a0 msgr2=0x7fabf4198770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:35.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:35.110+0000 7fabfb5f0640 1 --2- 172.21.15.44:0/2239723395 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fabf41022a0 0x7fabf4198770 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fabe400e9f0 tx=0x7fabe400edf0 comp rx=0 tx=0).stop 2024-08-19T00:19:35.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:35.110+0000 7fabfb5f0640 1 -- 172.21.15.44:0/2239723395 shutdown_connections 2024-08-19T00:19:35.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:35.110+0000 7fabfb5f0640 1 --2- 172.21.15.44:0/2239723395 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fabe00a2cf0 0x7fabe00a51b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:35.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:35.110+0000 7fabfb5f0640 1 --2- 172.21.15.44:0/2239723395 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fabf4102c20 0x7fabf419cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:35.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:35.110+0000 7fabfb5f0640 1 --2- 172.21.15.44:0/2239723395 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fabf41022a0 0x7fabf4198770 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:35.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:35.110+0000 7fabfb5f0640 1 --2- 172.21.15.44:0/2239723395 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fabf4100b50 0x7fabf4198230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:35.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:35.110+0000 7fabfb5f0640 1 -- 172.21.15.44:0/2239723395 >> 172.21.15.44:0/2239723395 conn(0x7fabf40fc500 msgr2=0x7fabf4069f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:19:35.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:35.110+0000 7fabfb5f0640 1 -- 172.21.15.44:0/2239723395 shutdown_connections 2024-08-19T00:19:35.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:35.110+0000 7fabfb5f0640 1 -- 172.21.15.44:0/2239723395 wait complete. 2024-08-19T00:19:35.679 INFO:tasks.workunit.client.0.smithi044.stdout: 1 442784 8.29 MB/sec execute 180 sec latency 57.152 ms 2024-08-19T00:19:35.860 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24473 quiesce db / --timeout 90 --expiration 139.2 --await-for 45.0' 2024-08-19T00:19:35.861 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24473 quiesce db / --timeout 90 --expiration 139.2 --await-for 45.0 2024-08-19T00:19:36.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:19:36 smithi044 ceph-mon[18489]: pgmap v191: 129 pgs: 129 active+clean; 282 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 775 KiB/s rd, 2.4 MiB/s wr, 117 op/s 2024-08-19T00:19:36.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:19:36 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/2239723395' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:19:36.127 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:19:36.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:19:36 smithi171 ceph-mon[21810]: pgmap v191: 129 pgs: 129 active+clean; 282 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 775 KiB/s rd, 2.4 MiB/s wr, 117 op/s 2024-08-19T00:19:36.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:19:36 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/2239723395' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:19:36.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:19:36 smithi116 ceph-mon[21873]: pgmap v191: 129 pgs: 129 active+clean; 282 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 775 KiB/s rd, 2.4 MiB/s wr, 117 op/s 2024-08-19T00:19:36.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:19:36 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/2239723395' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:19:36.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.651+0000 7f1173406640 1 -- 172.21.15.44:0/3422777610 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f116c1007b0 msgr2=0x7f116c100c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:36.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.651+0000 7f1173406640 1 --2- 172.21.15.44:0/3422777610 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f116c1007b0 0x7f116c100c10 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f115c009930 tx=0x7f115c02a420 comp rx=0 tx=0).stop 2024-08-19T00:19:36.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.651+0000 7f1173406640 1 -- 172.21.15.44:0/3422777610 shutdown_connections 2024-08-19T00:19:36.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.651+0000 7f1173406640 1 --2- 172.21.15.44:0/3422777610 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f116c101150 0x7f116c10d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:36.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.651+0000 7f1173406640 1 --2- 172.21.15.44:0/3422777610 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f116c1007b0 0x7f116c100c10 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:36.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.651+0000 7f1173406640 1 --2- 172.21.15.44:0/3422777610 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f116c1067b0 0x7f116c106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:36.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.651+0000 7f1173406640 1 -- 172.21.15.44:0/3422777610 >> 172.21.15.44:0/3422777610 conn(0x7f116c0fc4d0 msgr2=0x7f116c0fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:19:36.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.651+0000 7f1173406640 1 -- 172.21.15.44:0/3422777610 shutdown_connections 2024-08-19T00:19:36.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.651+0000 7f1173406640 1 -- 172.21.15.44:0/3422777610 wait complete. 2024-08-19T00:19:36.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.652+0000 7f1173406640 1 Processor -- start 2024-08-19T00:19:36.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.652+0000 7f1173406640 1 -- start start 2024-08-19T00:19:36.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.652+0000 7f1173406640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f116c1007b0 0x7f116c19a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:36.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.652+0000 7f1173406640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f116c101150 0x7f116c19a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:36.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.652+0000 7f1173406640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f116c1067b0 0x7f116c19ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:36.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.652+0000 7f1173406640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f116c110bb0 con 0x7f116c1007b0 2024-08-19T00:19:36.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.652+0000 7f1173406640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f116c110a30 con 0x7f116c1067b0 2024-08-19T00:19:36.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.652+0000 7f1173406640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f116c110d30 con 0x7f116c101150 2024-08-19T00:19:36.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.652+0000 7f11711a2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f116c1007b0 0x7f116c19a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:36.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.652+0000 7f11711a2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f116c1007b0 0x7f116c19a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42888/0 (socket says 172.21.15.44:42888) 2024-08-19T00:19:36.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.652+0000 7f11711a2640 1 -- 172.21.15.44:0/1547635117 learned_addr learned my addr 172.21.15.44:0/1547635117 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:19:36.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.652+0000 7f11709a1640 1 --2- 172.21.15.44:0/1547635117 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f116c101150 0x7f116c19a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:36.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.653+0000 7f11719a3640 1 --2- 172.21.15.44:0/1547635117 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f116c1067b0 0x7f116c19ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:36.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.653+0000 7f11711a2640 1 -- 172.21.15.44:0/1547635117 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f116c101150 msgr2=0x7f116c19a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:36.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.653+0000 7f11711a2640 1 --2- 172.21.15.44:0/1547635117 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f116c101150 0x7f116c19a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:36.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.653+0000 7f11711a2640 1 -- 172.21.15.44:0/1547635117 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f116c1067b0 msgr2=0x7f116c19ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:36.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.653+0000 7f11711a2640 1 --2- 172.21.15.44:0/1547635117 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f116c1067b0 0x7f116c19ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:36.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.653+0000 7f11711a2640 1 -- 172.21.15.44:0/1547635117 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f116c19f320 con 0x7f116c1007b0 2024-08-19T00:19:36.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.653+0000 7f11711a2640 1 --2- 172.21.15.44:0/1547635117 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f116c1007b0 0x7f116c19a370 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f116800e9f0 tx=0x7f116800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:19:36.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.653+0000 7f11627fc640 1 -- 172.21.15.44:0/1547635117 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f116800cd80 con 0x7f116c1007b0 2024-08-19T00:19:36.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.653+0000 7f11627fc640 1 -- 172.21.15.44:0/1547635117 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1168005500 con 0x7f116c1007b0 2024-08-19T00:19:36.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.653+0000 7f11627fc640 1 -- 172.21.15.44:0/1547635117 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1168010690 con 0x7f116c1007b0 2024-08-19T00:19:36.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.653+0000 7f1173406640 1 -- 172.21.15.44:0/1547635117 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f116c19f610 con 0x7f116c1007b0 2024-08-19T00:19:36.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.653+0000 7f1173406640 1 -- 172.21.15.44:0/1547635117 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f116c1a6ef0 con 0x7f116c1007b0 2024-08-19T00:19:36.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.656+0000 7f11627fc640 1 -- 172.21.15.44:0/1547635117 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f11680046c0 con 0x7f116c1007b0 2024-08-19T00:19:36.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.656+0000 7f1175804740 1 Processor -- start 2024-08-19T00:19:36.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.656+0000 7f1175804740 1 -- start start 2024-08-19T00:19:36.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.657+0000 7f1175804740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a156a39130 0x55a156a39510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:36.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.657+0000 7f1175804740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a156a39a50 0x55a156a43dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:36.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.657+0000 7f1175804740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a156a44310 0x55a156a46700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:36.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.657+0000 7f1175804740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a15699ea70 con 0x55a156a39130 2024-08-19T00:19:36.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.657+0000 7f11627fc640 1 --2- 172.21.15.44:0/1547635117 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f11580a2d70 0x7f11580a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:36.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.657+0000 7f1175804740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55a156936780 con 0x55a156a44310 2024-08-19T00:19:36.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.657+0000 7f1175804740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55a15699aa30 con 0x55a156a39a50 2024-08-19T00:19:36.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.657+0000 7f11719a3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a156a39130 0x55a156a39510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:36.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.657+0000 7f11711a2640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a156a39a50 0x55a156a43dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:36.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.657+0000 7f11719a3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a156a39130 0x55a156a39510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42892/0 (socket says 172.21.15.44:42892) 2024-08-19T00:19:36.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.657+0000 7f11719a3640 1 -- 172.21.15.44:0/1440574033 learned_addr learned my addr 172.21.15.44:0/1440574033 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:19:36.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.657+0000 7f11719a3640 1 --2- 172.21.15.44:0/1547635117 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f11580a2d70 0x7f11580a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:36.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.657+0000 7f11709a1640 1 --2- 172.21.15.44:0/1440574033 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a156a44310 0x55a156a46700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:36.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.657+0000 7f11627fc640 1 -- 172.21.15.44:0/1547635117 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f11680cfae0 con 0x7f116c1007b0 2024-08-19T00:19:36.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.657+0000 7f11719a3640 1 -- 172.21.15.44:0/1440574033 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a156a39a50 msgr2=0x55a156a43dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:36.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.657+0000 7f11719a3640 1 --2- 172.21.15.44:0/1440574033 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a156a39a50 0x55a156a43dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:36.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.657+0000 7f11719a3640 1 -- 172.21.15.44:0/1440574033 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a156a44310 msgr2=0x55a156a46700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:36.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.657+0000 7f11719a3640 1 --2- 172.21.15.44:0/1440574033 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a156a44310 0x55a156a46700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:36.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.657+0000 7f11719a3640 1 -- 172.21.15.44:0/1440574033 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a156710b90 con 0x55a156a39130 2024-08-19T00:19:36.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.657+0000 7f11711a2640 1 --2- 172.21.15.44:0/1440574033 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a156a39a50 0x55a156a43dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:19:36.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.657+0000 7f11709a1640 1 --2- 172.21.15.44:0/1440574033 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a156a44310 0x55a156a46700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:19:36.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.657+0000 7f11719a3640 1 --2- 172.21.15.44:0/1440574033 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a156a39130 0x55a156a39510 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f1164011e20 tx=0x7f116400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87699b6c2f1187a9 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:19:36.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.658+0000 7f11719a3640 1 --2- 172.21.15.44:0/1547635117 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f11580a2d70 0x7f11580a5230 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f116400fc90 tx=0x7f116401e000 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:19:36.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.658+0000 7f11577fe640 1 -- 172.21.15.44:0/1440574033 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f116401dcb0 con 0x55a156a39130 2024-08-19T00:19:36.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.658+0000 7f11577fe640 1 -- 172.21.15.44:0/1440574033 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f116401de50 con 0x55a156a39130 2024-08-19T00:19:36.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.658+0000 7f11577fe640 1 -- 172.21.15.44:0/1440574033 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1164004280 con 0x55a156a39130 2024-08-19T00:19:36.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.658+0000 7f1175804740 1 -- 172.21.15.44:0/1440574033 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a156a39130 msgr2=0x55a156a39510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:36.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.658+0000 7f1175804740 1 --2- 172.21.15.44:0/1440574033 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a156a39130 0x55a156a39510 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f1164011e20 tx=0x7f116400f790 comp rx=0 tx=0).stop 2024-08-19T00:19:36.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.658+0000 7f1175804740 1 -- 172.21.15.44:0/1440574033 shutdown_connections 2024-08-19T00:19:36.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.658+0000 7f1175804740 1 --2- 172.21.15.44:0/1440574033 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a156a39a50 0x55a156a43dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:36.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.659+0000 7f1175804740 1 --2- 172.21.15.44:0/1440574033 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a156a44310 0x55a156a46700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:36.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.659+0000 7f1175804740 1 --2- 172.21.15.44:0/1440574033 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a156a39130 0x55a156a39510 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:36.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.659+0000 7f1175804740 1 -- 172.21.15.44:0/1440574033 >> 172.21.15.44:0/1440574033 conn(0x55a156a356c0 msgr2=0x55a156a35aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:19:36.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.659+0000 7f1175804740 1 -- 172.21.15.44:0/1440574033 shutdown_connections 2024-08-19T00:19:36.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.659+0000 7f1175804740 1 -- 172.21.15.44:0/1440574033 wait complete. 2024-08-19T00:19:36.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.659+0000 7f1175804740 1 -- start start 2024-08-19T00:19:36.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.659+0000 7f1175804740 1 Processor -- start 2024-08-19T00:19:36.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.659+0000 7f1175804740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a156a39130 0x55a156a412a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:36.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.659+0000 7f1175804740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a156a39a50 0x55a156a417e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:36.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.659+0000 7f1175804740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a156a44310 0x55a156a41d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:36.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.659+0000 7f1175804740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a156a46e80 con 0x55a156a39130 2024-08-19T00:19:36.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.659+0000 7f1175804740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55a156959990 con 0x55a156a39a50 2024-08-19T00:19:36.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.659+0000 7f1175804740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55a156a47000 con 0x55a156a44310 2024-08-19T00:19:36.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.659+0000 7f1175804740 10 client.0 _ll_register_callbacks cb 0x55a1566ae090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:19:36.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.659+0000 7f11711a2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a156a39130 0x55a156a412a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:36.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.660+0000 7f11711a2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a156a39130 0x55a156a412a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42908/0 (socket says 172.21.15.44:42908) 2024-08-19T00:19:36.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.660+0000 7f11719a3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a156a44310 0x55a156a41d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:36.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.660+0000 7f11711a2640 1 -- 172.21.15.44:0/35827762 learned_addr learned my addr 172.21.15.44:0/35827762 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:19:36.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.660+0000 7f11709a1640 1 --2- 172.21.15.44:0/35827762 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a156a39a50 0x55a156a417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:36.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.660+0000 7f11711a2640 1 -- 172.21.15.44:0/35827762 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a156a44310 msgr2=0x55a156a41d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:36.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.660+0000 7f11711a2640 1 --2- 172.21.15.44:0/35827762 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a156a44310 0x55a156a41d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:36.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.660+0000 7f11711a2640 1 -- 172.21.15.44:0/35827762 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a156a39a50 msgr2=0x55a156a417e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:36.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.660+0000 7f11711a2640 1 --2- 172.21.15.44:0/35827762 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a156a39a50 0x55a156a417e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:36.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.660+0000 7f11711a2640 1 -- 172.21.15.44:0/35827762 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1569586c0 con 0x55a156a39130 2024-08-19T00:19:36.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.660+0000 7f11711a2640 1 --2- 172.21.15.44:0/35827762 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a156a39130 0x55a156a412a0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f11680980c0 tx=0x7f116800a440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a65491535aee682 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:19:36.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.660+0000 7f1154ff9640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:19:36.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.660+0000 7f1154ff9640 1 -- 172.21.15.44:0/35827762 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f116809b7a0 con 0x55a156a39130 2024-08-19T00:19:36.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.660+0000 7f1154ff9640 1 -- 172.21.15.44:0/35827762 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f116809bec0 con 0x55a156a39130 2024-08-19T00:19:36.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.660+0000 7f1175804740 1 -- 172.21.15.44:0/35827762 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f116401de50 con 0x55a156a39130 2024-08-19T00:19:36.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.660+0000 7f1154ff9640 1 -- 172.21.15.44:0/35827762 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f11680cd320 con 0x55a156a39130 2024-08-19T00:19:36.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.660+0000 7f1175804740 10 client.16308 fetch_fsmap learned FSMap version 33 2024-08-19T00:19:36.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.660+0000 7f1175804740 1 -- 172.21.15.44:0/35827762 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55a156a52ba0 con 0x55a156a39130 2024-08-19T00:19:36.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.661+0000 7f1154ff9640 1 -- 172.21.15.44:0/35827762 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f116401de50 con 0x55a156a39130 2024-08-19T00:19:36.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.661+0000 7f1154ff9640 1 -- 172.21.15.44:0/35827762 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f11680a4440 con 0x55a156a39130 2024-08-19T00:19:36.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.661+0000 7f1175804740 10 client.16308 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:19:36.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.661+0000 7f1175804740 10 client.16308 resolve_mds: validated gid 24473 aka daemon mds.b 2024-08-19T00:19:36.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.661+0000 7f1175804740 20 client.16308 populate_metadata read hostname 'smithi044' 2024-08-19T00:19:36.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.661+0000 7f1175804740 1 --2- 172.21.15.44:0/35827762 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55a156a54000 0x55a156a56450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:36.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.661+0000 7f1175804740 4 client.16308 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:19:36.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.661+0000 7f1175804740 1 -- 172.21.15.44:0/35827762 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a1569ac1a0 con 0x55a156a54000 2024-08-19T00:19:36.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.661+0000 7f11709a1640 1 --2- 172.21.15.44:0/35827762 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55a156a54000 0x55a156a56450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:36.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.662+0000 7f11709a1640 1 --2- 172.21.15.44:0/35827762 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55a156a54000 0x55a156a56450 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e735b0734ed357f server_cookie=e8e8a965e1f3ea87 in_seq=0 out_seq=0 2024-08-19T00:19:36.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.662+0000 7f1154ff9640 10 client.16308 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:19:36.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.662+0000 7f1154ff9640 1 -- 172.21.15.44:0/35827762 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a1569ac1a0 con 0x55a156a54000 2024-08-19T00:19:36.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.662+0000 7f1154ff9640 10 client.16308 handle_command_reply: tid=0 2024-08-19T00:19:36.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.662+0000 7f1175804740 1 client.16308 shutdown 2024-08-19T00:19:36.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.662+0000 7f1175804740 1 -- 172.21.15.44:0/35827762 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a156a39130 msgr2=0x55a156a412a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:36.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.662+0000 7f1175804740 1 --2- 172.21.15.44:0/35827762 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a156a39130 0x55a156a412a0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f11680980c0 tx=0x7f116800a440 comp rx=0 tx=0).stop 2024-08-19T00:19:36.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.662+0000 7f1175804740 1 -- 172.21.15.44:0/35827762 shutdown_connections 2024-08-19T00:19:36.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.662+0000 7f1175804740 1 --2- 172.21.15.44:0/35827762 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55a156a54000 0x55a156a56450 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:36.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.662+0000 7f1175804740 1 --2- 172.21.15.44:0/35827762 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a156a44310 0x55a156a41d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:36.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.662+0000 7f1175804740 1 --2- 172.21.15.44:0/35827762 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a156a39a50 0x55a156a417e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:36.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.662+0000 7f1154ff9640 0 client.16308 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:19:36.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.662+0000 7f1175804740 1 --2- 172.21.15.44:0/35827762 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a156a39130 0x55a156a412a0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:36.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.662+0000 7f1175804740 1 -- 172.21.15.44:0/35827762 >> 172.21.15.44:0/35827762 conn(0x55a156a356c0 msgr2=0x55a156a3b3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:19:36.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.663+0000 7f1175804740 1 -- 172.21.15.44:0/35827762 shutdown_connections 2024-08-19T00:19:36.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.663+0000 7f1175804740 1 -- 172.21.15.44:0/35827762 wait complete. 2024-08-19T00:19:36.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.663+0000 7f1175804740 20 client.16308 trim_cache size 0 max 16384 2024-08-19T00:19:36.679 INFO:tasks.workunit.client.0.smithi044.stdout: 1 444540 8.29 MB/sec execute 181 sec latency 22.937 ms 2024-08-19T00:19:36.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.680+0000 7f1175804740 1 Processor -- start 2024-08-19T00:19:36.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.680+0000 7f1175804740 1 -- start start 2024-08-19T00:19:36.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.681+0000 7f1175804740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a156a39a50 0x55a156a43170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:36.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.681+0000 7f1175804740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a156a44310 0x55a156a3fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:36.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.681+0000 7f1175804740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a156a54000 0x55a156a3bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:36.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.681+0000 7f1175804740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f116c1b0ee0 con 0x55a156a39a50 2024-08-19T00:19:36.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.681+0000 7f1175804740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f116c1b2a20 con 0x55a156a44310 2024-08-19T00:19:36.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.681+0000 7f1175804740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f116c1b15b0 con 0x55a156a54000 2024-08-19T00:19:36.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.681+0000 7f11711a2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a156a39a50 0x55a156a43170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:36.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.681+0000 7f11711a2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a156a39a50 0x55a156a43170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42920/0 (socket says 172.21.15.44:42920) 2024-08-19T00:19:36.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.681+0000 7f11711a2640 1 -- 172.21.15.44:0/2415739318 learned_addr learned my addr 172.21.15.44:0/2415739318 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:19:36.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.681+0000 7f11709a1640 1 --2- 172.21.15.44:0/2415739318 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a156a44310 0x55a156a3fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:36.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.681+0000 7f11719a3640 1 --2- 172.21.15.44:0/2415739318 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a156a54000 0x55a156a3bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:36.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.681+0000 7f11711a2640 1 -- 172.21.15.44:0/2415739318 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a156a54000 msgr2=0x55a156a3bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:36.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.681+0000 7f11711a2640 1 --2- 172.21.15.44:0/2415739318 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a156a54000 0x55a156a3bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:36.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.681+0000 7f11711a2640 1 -- 172.21.15.44:0/2415739318 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a156a44310 msgr2=0x55a156a3fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:36.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.681+0000 7f11711a2640 1 --2- 172.21.15.44:0/2415739318 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a156a44310 0x55a156a3fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:36.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.681+0000 7f11711a2640 1 -- 172.21.15.44:0/2415739318 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a156a36770 con 0x55a156a39a50 2024-08-19T00:19:36.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.681+0000 7f11711a2640 1 --2- 172.21.15.44:0/2415739318 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a156a39a50 0x55a156a43170 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f116800c6a0 tx=0x7f1168004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0bc40aa2b8515bd server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:19:36.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.682+0000 7f1156ffd640 1 -- 172.21.15.44:0/2415739318 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11680b4e60 con 0x55a156a39a50 2024-08-19T00:19:36.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.682+0000 7f1156ffd640 1 -- 172.21.15.44:0/2415739318 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f11680b1070 con 0x55a156a39a50 2024-08-19T00:19:36.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.682+0000 7f1156ffd640 1 -- 172.21.15.44:0/2415739318 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f116809b5c0 con 0x55a156a39a50 2024-08-19T00:19:36.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.682+0000 7f1175804740 1 -- 172.21.15.44:0/2415739318 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a156a39a50 msgr2=0x55a156a43170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:36.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.682+0000 7f1175804740 1 --2- 172.21.15.44:0/2415739318 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a156a39a50 0x55a156a43170 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f116800c6a0 tx=0x7f1168004a40 comp rx=0 tx=0).stop 2024-08-19T00:19:36.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.682+0000 7f1175804740 1 -- 172.21.15.44:0/2415739318 shutdown_connections 2024-08-19T00:19:36.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.682+0000 7f1175804740 1 --2- 172.21.15.44:0/2415739318 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a156a54000 0x55a156a3bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:36.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.682+0000 7f1175804740 1 --2- 172.21.15.44:0/2415739318 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a156a44310 0x55a156a3fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:36.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.682+0000 7f1175804740 1 --2- 172.21.15.44:0/2415739318 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a156a39a50 0x55a156a43170 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:36.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.682+0000 7f1175804740 1 -- 172.21.15.44:0/2415739318 >> 172.21.15.44:0/2415739318 conn(0x55a156a356c0 msgr2=0x55a156a41a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:19:36.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.682+0000 7f1175804740 1 -- 172.21.15.44:0/2415739318 shutdown_connections 2024-08-19T00:19:36.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.682+0000 7f1175804740 1 -- 172.21.15.44:0/2415739318 wait complete. 2024-08-19T00:19:36.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.683+0000 7f1175804740 1 -- start start 2024-08-19T00:19:36.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.683+0000 7f1175804740 1 Processor -- start 2024-08-19T00:19:36.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.683+0000 7f1175804740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a156a39a50 0x55a156a4c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:36.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.683+0000 7f1175804740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a156a44310 0x55a156a4c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:36.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.683+0000 7f1175804740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a156a54000 0x55a156a49220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:36.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.683+0000 7f1175804740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f116c1b2350 con 0x55a156a54000 2024-08-19T00:19:36.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.683+0000 7f1175804740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f116c1b1c80 con 0x55a156a39a50 2024-08-19T00:19:36.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.683+0000 7f1175804740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f116c1aeec0 con 0x55a156a44310 2024-08-19T00:19:36.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.683+0000 7f1175804740 10 client.0 _ll_register_callbacks cb 0x7f116800e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:19:36.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.683+0000 7f11709a1640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a156a44310 0x55a156a4c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:36.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.683+0000 7f11711a2640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a156a39a50 0x55a156a4c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:36.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.683+0000 7f11709a1640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a156a44310 0x55a156a4c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.44:45232/0 (socket says 172.21.15.44:45232) 2024-08-19T00:19:36.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.683+0000 7f11709a1640 1 -- 172.21.15.44:0/3017088454 learned_addr learned my addr 172.21.15.44:0/3017088454 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:19:36.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.683+0000 7f11719a3640 1 --2- 172.21.15.44:0/3017088454 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a156a54000 0x55a156a49220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:36.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.684+0000 7f11711a2640 1 -- 172.21.15.44:0/3017088454 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a156a44310 msgr2=0x55a156a4c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:36.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.684+0000 7f11711a2640 1 --2- 172.21.15.44:0/3017088454 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a156a44310 0x55a156a4c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:36.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.684+0000 7f11711a2640 1 -- 172.21.15.44:0/3017088454 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a156a54000 msgr2=0x55a156a49220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:36.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.684+0000 7f11711a2640 1 --2- 172.21.15.44:0/3017088454 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a156a54000 0x55a156a49220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:36.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.684+0000 7f11711a2640 1 -- 172.21.15.44:0/3017088454 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a156a49910 con 0x55a156a39a50 2024-08-19T00:19:36.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.684+0000 7f11711a2640 1 --2- 172.21.15.44:0/3017088454 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a156a39a50 0x55a156a4c430 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f116809bbf0 tx=0x7f11680056b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7f5ea7304116821 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:19:36.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.684+0000 7f1154ff9640 10 client.0 ms_handle_connect on v2:172.21.15.116:3300/0 2024-08-19T00:19:36.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.684+0000 7f1154ff9640 1 -- 172.21.15.44:0/3017088454 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11680b4e60 con 0x55a156a39a50 2024-08-19T00:19:36.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.684+0000 7f1175804740 1 -- 172.21.15.44:0/3017088454 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11680b1070 con 0x55a156a39a50 2024-08-19T00:19:36.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.684+0000 7f1154ff9640 1 -- 172.21.15.44:0/3017088454 <== mon.2 v2:172.21.15.116:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f11680a4440 con 0x55a156a39a50 2024-08-19T00:19:36.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.684+0000 7f1154ff9640 1 -- 172.21.15.44:0/3017088454 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f116809b5c0 con 0x55a156a39a50 2024-08-19T00:19:36.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.684+0000 7f1175804740 10 client.25781 fetch_fsmap learned FSMap version 33 2024-08-19T00:19:36.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.684+0000 7f1175804740 1 -- 172.21.15.44:0/3017088454 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55a156a49910 con 0x55a156a39a50 2024-08-19T00:19:36.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.684+0000 7f1154ff9640 1 -- 172.21.15.44:0/3017088454 <== mon.2 v2:172.21.15.116:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f11680b1070 con 0x55a156a39a50 2024-08-19T00:19:36.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.685+0000 7f1154ff9640 1 -- 172.21.15.44:0/3017088454 <== mon.2 v2:172.21.15.116:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f11680a11a0 con 0x55a156a39a50 2024-08-19T00:19:36.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.685+0000 7f1175804740 10 client.25781 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:19:36.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.685+0000 7f1175804740 10 client.25781 resolve_mds: validated gid 24473 aka daemon mds.b 2024-08-19T00:19:36.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.685+0000 7f1175804740 20 client.25781 populate_metadata read hostname 'smithi044' 2024-08-19T00:19:36.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.685+0000 7f1175804740 1 --2- 172.21.15.44:0/3017088454 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55a156abf930 0x55a156ac1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:36.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.685+0000 7f1175804740 4 client.25781 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.2, "await_for": 45.0}] 2024-08-19T00:19:36.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.685+0000 7f1175804740 1 -- 172.21.15.44:0/3017088454 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.2, "await_for": 45.0}) -- 0x55a1569a64f0 con 0x55a156abf930 2024-08-19T00:19:36.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.685+0000 7f11709a1640 1 --2- 172.21.15.44:0/3017088454 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55a156abf930 0x55a156ac1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:36.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.685+0000 7f1154ff9640 10 client.25781 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:19:36.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.685+0000 7f11709a1640 1 --2- 172.21.15.44:0/3017088454 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55a156abf930 0x55a156ac1d20 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a3a3659dea42092 server_cookie=dae10c506e5e31c6 in_seq=0 out_seq=0 2024-08-19T00:19:36.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.752+0000 7f1154ff9640 1 -- 172.21.15.44:0/3017088454 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55a1569a64f0 con 0x55a156abf930 2024-08-19T00:19:36.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.752+0000 7f1154ff9640 10 client.25781 handle_command_reply: tid=0 2024-08-19T00:19:36.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.752+0000 7f1175804740 1 client.25781 shutdown 2024-08-19T00:19:36.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.752+0000 7f1175804740 1 -- 172.21.15.44:0/3017088454 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a156a39a50 msgr2=0x55a156a4c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:36.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.752+0000 7f1175804740 1 --2- 172.21.15.44:0/3017088454 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a156a39a50 0x55a156a4c430 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f116809bbf0 tx=0x7f11680056b0 comp rx=0 tx=0).stop 2024-08-19T00:19:36.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.753+0000 7f1175804740 1 -- 172.21.15.44:0/3017088454 shutdown_connections 2024-08-19T00:19:36.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.753+0000 7f1175804740 1 --2- 172.21.15.44:0/3017088454 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55a156abf930 0x55a156ac1d20 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:36.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.753+0000 7f1175804740 1 --2- 172.21.15.44:0/3017088454 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a156a44310 0x55a156a4c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:36.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.753+0000 7f1175804740 1 --2- 172.21.15.44:0/3017088454 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a156a54000 0x55a156a49220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:36.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.753+0000 7f1175804740 1 --2- 172.21.15.44:0/3017088454 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a156a39a50 0x55a156a4c430 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:36.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.753+0000 7f1175804740 1 -- 172.21.15.44:0/3017088454 >> 172.21.15.44:0/3017088454 conn(0x55a156a356c0 msgr2=0x55a156a33ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:19:36.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.753+0000 7f1154ff9640 0 client.25781 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:19:36.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.753+0000 7f1175804740 1 -- 172.21.15.44:0/3017088454 shutdown_connections 2024-08-19T00:19:36.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.753+0000 7f1175804740 1 -- 172.21.15.44:0/3017088454 wait complete. 2024-08-19T00:19:36.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.753+0000 7f1175804740 20 client.25781 trim_cache size 0 max 16384 2024-08-19T00:19:36.756 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-08-19T00:19:36.756 INFO:teuthology.orchestra.run.smithi044.stdout: "epoch": 33, 2024-08-19T00:19:36.756 INFO:teuthology.orchestra.run.smithi044.stdout: "leader": 24473, 2024-08-19T00:19:36.756 INFO:teuthology.orchestra.run.smithi044.stdout: "set_version": 22, 2024-08-19T00:19:36.756 INFO:teuthology.orchestra.run.smithi044.stdout: "sets": { 2024-08-19T00:19:36.756 INFO:teuthology.orchestra.run.smithi044.stdout: "f61c6c1f": { 2024-08-19T00:19:36.756 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 22, 2024-08-19T00:19:36.756 INFO:teuthology.orchestra.run.smithi044.stdout: "age_ref": 0.0, 2024-08-19T00:19:36.756 INFO:teuthology.orchestra.run.smithi044.stdout: "state": { 2024-08-19T00:19:36.756 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "QUIESCED", 2024-08-19T00:19:36.756 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.0 2024-08-19T00:19:36.757 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:19:36.757 INFO:teuthology.orchestra.run.smithi044.stdout: "timeout": 90.0, 2024-08-19T00:19:36.757 INFO:teuthology.orchestra.run.smithi044.stdout: "expiration": 139.2, 2024-08-19T00:19:36.757 INFO:teuthology.orchestra.run.smithi044.stdout: "members": { 2024-08-19T00:19:36.757 INFO:teuthology.orchestra.run.smithi044.stdout: "file:/": { 2024-08-19T00:19:36.757 INFO:teuthology.orchestra.run.smithi044.stdout: "excluded": false, 2024-08-19T00:19:36.757 INFO:teuthology.orchestra.run.smithi044.stdout: "state": { 2024-08-19T00:19:36.757 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "QUIESCED", 2024-08-19T00:19:36.757 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.0 2024-08-19T00:19:36.757 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:19:36.757 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:19:36.757 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:19:36.757 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:19:36.757 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:19:36.758 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-08-19T00:19:36.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.754+0000 7f1173406640 1 -- 172.21.15.44:0/1547635117 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f11580a2d70 msgr2=0x7f11580a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:36.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.754+0000 7f1173406640 1 --2- 172.21.15.44:0/1547635117 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f11580a2d70 0x7f11580a5230 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f116400fc90 tx=0x7f116401e000 comp rx=0 tx=0).stop 2024-08-19T00:19:36.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.754+0000 7f1173406640 1 -- 172.21.15.44:0/1547635117 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f116c1007b0 msgr2=0x7f116c19a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:36.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.754+0000 7f1173406640 1 --2- 172.21.15.44:0/1547635117 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f116c1007b0 0x7f116c19a370 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f116800e9f0 tx=0x7f116800edf0 comp rx=0 tx=0).stop 2024-08-19T00:19:36.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.754+0000 7f1173406640 1 -- 172.21.15.44:0/1547635117 shutdown_connections 2024-08-19T00:19:36.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.754+0000 7f1173406640 1 --2- 172.21.15.44:0/1547635117 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f11580a2d70 0x7f11580a5230 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:36.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.754+0000 7f1173406640 1 --2- 172.21.15.44:0/1547635117 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f116c101150 0x7f116c19a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:36.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.754+0000 7f1173406640 1 --2- 172.21.15.44:0/1547635117 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f116c1067b0 0x7f116c19ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:36.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.754+0000 7f1173406640 1 --2- 172.21.15.44:0/1547635117 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f116c1007b0 0x7f116c19a370 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:36.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.754+0000 7f1173406640 1 -- 172.21.15.44:0/1547635117 >> 172.21.15.44:0/1547635117 conn(0x7f116c0fc4d0 msgr2=0x7f116c06a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:19:36.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.754+0000 7f1173406640 1 -- 172.21.15.44:0/1547635117 shutdown_connections 2024-08-19T00:19:36.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:36.754+0000 7f1173406640 1 -- 172.21.15.44:0/1547635117 wait complete. 2024-08-19T00:19:37.571 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'f61c6c1f', quiesce took 3.5 seconds. Will release after: 15.7 2024-08-19T00:19:37.679 INFO:tasks.workunit.client.0.smithi044.stdout: 1 444574 8.24 MB/sec execute 182 sec latency 924.868 ms 2024-08-19T00:19:38.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:19:38 smithi171 ceph-mon[21810]: pgmap v192: 129 pgs: 129 active+clean; 282 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 697 KiB/s rd, 1.5 MiB/s wr, 83 op/s 2024-08-19T00:19:38.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:19:38 smithi116 ceph-mon[21873]: pgmap v192: 129 pgs: 129 active+clean; 282 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 697 KiB/s rd, 1.5 MiB/s wr, 83 op/s 2024-08-19T00:19:38.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:19:38 smithi044 ceph-mon[18489]: pgmap v192: 129 pgs: 129 active+clean; 282 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 697 KiB/s rd, 1.5 MiB/s wr, 83 op/s 2024-08-19T00:19:38.679 INFO:tasks.workunit.client.0.smithi044.stdout: 1 444574 8.20 MB/sec execute 183 sec latency 1924.979 ms 2024-08-19T00:19:39.680 INFO:tasks.workunit.client.0.smithi044.stdout: 1 444574 8.15 MB/sec execute 184 sec latency 2925.090 ms 2024-08-19T00:19:40.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:19:40 smithi171 ceph-mon[21810]: pgmap v193: 129 pgs: 129 active+clean; 282 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 697 KiB/s rd, 1.5 MiB/s wr, 83 op/s 2024-08-19T00:19:40.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:19:40 smithi116 ceph-mon[21873]: pgmap v193: 129 pgs: 129 active+clean; 282 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 697 KiB/s rd, 1.5 MiB/s wr, 83 op/s 2024-08-19T00:19:40.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:19:40 smithi044 ceph-mon[18489]: pgmap v193: 129 pgs: 129 active+clean; 282 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 697 KiB/s rd, 1.5 MiB/s wr, 83 op/s 2024-08-19T00:19:40.680 INFO:tasks.workunit.client.0.smithi044.stdout: 1 444574 8.11 MB/sec execute 185 sec latency 3925.226 ms 2024-08-19T00:19:41.680 INFO:tasks.workunit.client.0.smithi044.stdout: 1 444574 8.06 MB/sec execute 186 sec latency 4925.347 ms 2024-08-19T00:19:42.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:19:42 smithi171 ceph-mon[21810]: pgmap v194: 129 pgs: 129 active+clean; 292 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.6 MiB/s wr, 143 op/s 2024-08-19T00:19:42.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:19:42 smithi116 ceph-mon[21873]: pgmap v194: 129 pgs: 129 active+clean; 292 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.6 MiB/s wr, 143 op/s 2024-08-19T00:19:42.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:19:42 smithi044 ceph-mon[18489]: pgmap v194: 129 pgs: 129 active+clean; 292 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.6 MiB/s wr, 143 op/s 2024-08-19T00:19:42.680 INFO:tasks.workunit.client.0.smithi044.stdout: 1 444574 8.02 MB/sec execute 187 sec latency 5925.442 ms 2024-08-19T00:19:43.598 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.596+0000 7faac23d1640 1 -- 172.21.15.44:0/711700688 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faabc101080 msgr2=0x7faabc10d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:43.599 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.596+0000 7faac23d1640 1 --2- 172.21.15.44:0/711700688 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faabc101080 0x7faabc10d5b0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7faab4009c10 tx=0x7faab402a6e0 comp rx=0 tx=0).stop 2024-08-19T00:19:43.599 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.596+0000 7faac23d1640 1 -- 172.21.15.44:0/711700688 shutdown_connections 2024-08-19T00:19:43.599 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.596+0000 7faac23d1640 1 --2- 172.21.15.44:0/711700688 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faabc1006e0 0x7faabc100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:43.599 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.596+0000 7faac23d1640 1 --2- 172.21.15.44:0/711700688 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faabc101080 0x7faabc10d5b0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:43.599 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.596+0000 7faac23d1640 1 --2- 172.21.15.44:0/711700688 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faabc1066f0 0x7faabc106ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:43.599 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.596+0000 7faac23d1640 1 -- 172.21.15.44:0/711700688 >> 172.21.15.44:0/711700688 conn(0x7faabc0776c0 msgr2=0x7faabc0fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:19:43.599 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.597+0000 7faac23d1640 1 -- 172.21.15.44:0/711700688 shutdown_connections 2024-08-19T00:19:43.599 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.597+0000 7faac23d1640 1 -- 172.21.15.44:0/711700688 wait complete. 2024-08-19T00:19:43.601 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.598+0000 7faac23d1640 1 Processor -- start 2024-08-19T00:19:43.601 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.598+0000 7faac23d1640 1 -- start start 2024-08-19T00:19:43.601 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.598+0000 7faac23d1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faabc1006e0 0x7faabc19a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:43.601 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.598+0000 7faac23d1640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faabc101080 0x7faabc19a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:43.602 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.598+0000 7faac23d1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faabc1066f0 0x7faabc19eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:43.602 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.598+0000 7faac23d1640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7faabc110b30 con 0x7faabc1066f0 2024-08-19T00:19:43.602 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.599+0000 7faac23d1640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7faabc1109b0 con 0x7faabc1006e0 2024-08-19T00:19:43.602 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.599+0000 7faac23d1640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7faabc110cb0 con 0x7faabc101080 2024-08-19T00:19:43.602 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.599+0000 7faabbfff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faabc1006e0 0x7faabc19a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:43.602 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.599+0000 7faac096e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faabc1066f0 0x7faabc19eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:43.602 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.599+0000 7faabbfff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faabc1006e0 0x7faabc19a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.44:54588/0 (socket says 172.21.15.44:54588) 2024-08-19T00:19:43.602 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.599+0000 7faabbfff640 1 -- 172.21.15.44:0/458480788 learned_addr learned my addr 172.21.15.44:0/458480788 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:19:43.602 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.599+0000 7faabb7fe640 1 --2- 172.21.15.44:0/458480788 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faabc101080 0x7faabc19a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:43.602 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.599+0000 7faac096e640 1 -- 172.21.15.44:0/458480788 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faabc101080 msgr2=0x7faabc19a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:43.602 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.599+0000 7faac096e640 1 --2- 172.21.15.44:0/458480788 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faabc101080 0x7faabc19a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:43.603 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.599+0000 7faac096e640 1 -- 172.21.15.44:0/458480788 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faabc1006e0 msgr2=0x7faabc19a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:43.603 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.599+0000 7faac096e640 1 --2- 172.21.15.44:0/458480788 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faabc1006e0 0x7faabc19a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:43.603 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.599+0000 7faac096e640 1 -- 172.21.15.44:0/458480788 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faabc19f230 con 0x7faabc1066f0 2024-08-19T00:19:43.603 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.599+0000 7faabb7fe640 1 --2- 172.21.15.44:0/458480788 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faabc101080 0x7faabc19a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:19:43.603 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.599+0000 7faac096e640 1 --2- 172.21.15.44:0/458480788 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faabc1066f0 0x7faabc19eb00 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7faab4034040 tx=0x7faab40305d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:19:43.603 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.600+0000 7faab97fa640 1 -- 172.21.15.44:0/458480788 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab4041020 con 0x7faabc1066f0 2024-08-19T00:19:43.603 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.600+0000 7faac23d1640 1 -- 172.21.15.44:0/458480788 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faabc19f4c0 con 0x7faabc1066f0 2024-08-19T00:19:43.603 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.600+0000 7faab97fa640 1 -- 172.21.15.44:0/458480788 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faab4003e50 con 0x7faabc1066f0 2024-08-19T00:19:43.603 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.600+0000 7faab97fa640 1 -- 172.21.15.44:0/458480788 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab4036040 con 0x7faabc1066f0 2024-08-19T00:19:43.603 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.600+0000 7faac23d1640 1 -- 172.21.15.44:0/458480788 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faabc1a6db0 con 0x7faabc1066f0 2024-08-19T00:19:43.605 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.603+0000 7faab97fa640 1 -- 172.21.15.44:0/458480788 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7faab4044020 con 0x7faabc1066f0 2024-08-19T00:19:43.605 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.603+0000 7faac526a740 1 Processor -- start 2024-08-19T00:19:43.605 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.603+0000 7faac526a740 1 -- start start 2024-08-19T00:19:43.605 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.603+0000 7faac526a740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c177fc66f0 0x55c177fc6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:43.605 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.603+0000 7faac526a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c177fc7010 0x55c177fd9c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:43.606 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.603+0000 7faac526a740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c177fda1a0 0x55c177fdc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:43.606 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.603+0000 7faac526a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55c177f2a9d0 con 0x55c177fc7010 2024-08-19T00:19:43.606 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.603+0000 7faac526a740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55c177ed2820 con 0x55c177fda1a0 2024-08-19T00:19:43.606 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.603+0000 7faac526a740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55c177f26990 con 0x55c177fc66f0 2024-08-19T00:19:43.606 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.604+0000 7faabbfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c177fc7010 0x55c177fd9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:43.606 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.604+0000 7faabbfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c177fc7010 0x55c177fd9c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43884/0 (socket says 172.21.15.44:43884) 2024-08-19T00:19:43.606 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.604+0000 7faabbfff640 1 -- 172.21.15.44:0/1117421027 learned_addr learned my addr 172.21.15.44:0/1117421027 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:19:43.606 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.604+0000 7faabb7fe640 1 --2- 172.21.15.44:0/1117421027 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c177fda1a0 0x55c177fdc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:43.607 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.604+0000 7faabb7fe640 1 --2- 172.21.15.44:0/1117421027 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c177fc66f0 0x55c177fc6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:43.607 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.604+0000 7faabbfff640 1 -- 172.21.15.44:0/1117421027 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c177fc66f0 msgr2=0x55c177fc6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:43.607 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.604+0000 7faabbfff640 1 --2- 172.21.15.44:0/1117421027 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c177fc66f0 0x55c177fc6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:43.607 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.604+0000 7faabbfff640 1 -- 172.21.15.44:0/1117421027 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c177fda1a0 msgr2=0x55c177fdc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:43.607 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.604+0000 7faabbfff640 1 --2- 172.21.15.44:0/1117421027 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c177fda1a0 0x55c177fdc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:43.607 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.604+0000 7faabbfff640 1 -- 172.21.15.44:0/1117421027 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c177c3e210 con 0x55c177fc7010 2024-08-19T00:19:43.609 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.604+0000 7faabbfff640 1 --2- 172.21.15.44:0/1117421027 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c177fc7010 0x55c177fd9c60 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7faaac009d40 tx=0x7faaac011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4499727c5a1efaf server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:19:43.610 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.604+0000 7faab97fa640 1 --2- 172.21.15.44:0/458480788 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7faaa40a2da0 0x7faaa40a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:43.610 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.605+0000 7faaa27fc640 1 -- 172.21.15.44:0/1117421027 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaac004220 con 0x55c177fc7010 2024-08-19T00:19:43.610 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.605+0000 7faabb7fe640 1 --2- 172.21.15.44:0/458480788 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7faaa40a2da0 0x7faaa40a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:43.610 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.605+0000 7faaa27fc640 1 -- 172.21.15.44:0/1117421027 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faaac0043c0 con 0x55c177fc7010 2024-08-19T00:19:43.610 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.605+0000 7faaa27fc640 1 -- 172.21.15.44:0/1117421027 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaac0035f0 con 0x55c177fc7010 2024-08-19T00:19:43.610 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.605+0000 7faab97fa640 1 -- 172.21.15.44:0/458480788 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7faab40f0460 con 0x7faabc1066f0 2024-08-19T00:19:43.610 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.605+0000 7faac526a740 1 -- 172.21.15.44:0/1117421027 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c177fc7010 msgr2=0x55c177fd9c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:43.610 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.605+0000 7faac526a740 1 --2- 172.21.15.44:0/1117421027 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c177fc7010 0x55c177fd9c60 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7faaac009d40 tx=0x7faaac011810 comp rx=0 tx=0).stop 2024-08-19T00:19:43.610 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.605+0000 7faabb7fe640 1 --2- 172.21.15.44:0/458480788 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7faaa40a2da0 0x7faaa40a5260 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7faab0009fd0 tx=0x7faab00096e0 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:19:43.610 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.606+0000 7faac526a740 1 -- 172.21.15.44:0/1117421027 shutdown_connections 2024-08-19T00:19:43.610 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.606+0000 7faac526a740 1 --2- 172.21.15.44:0/1117421027 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c177fda1a0 0x55c177fdc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:43.611 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.606+0000 7faac526a740 1 --2- 172.21.15.44:0/1117421027 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c177fc7010 0x55c177fd9c60 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:43.611 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.606+0000 7faac526a740 1 --2- 172.21.15.44:0/1117421027 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c177fc66f0 0x55c177fc6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:43.611 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.606+0000 7faac526a740 1 -- 172.21.15.44:0/1117421027 >> 172.21.15.44:0/1117421027 conn(0x55c177fc2d40 msgr2=0x55c177fc3120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:19:43.611 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.606+0000 7faac526a740 1 -- 172.21.15.44:0/1117421027 shutdown_connections 2024-08-19T00:19:43.611 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.606+0000 7faac526a740 1 -- 172.21.15.44:0/1117421027 wait complete. 2024-08-19T00:19:43.611 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.606+0000 7faac526a740 1 -- start start 2024-08-19T00:19:43.611 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.607+0000 7faac526a740 1 Processor -- start 2024-08-19T00:19:43.611 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.607+0000 7faac526a740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c177fc66f0 0x55c177fd7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:43.611 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.607+0000 7faac526a740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c177fc7010 0x55c177fd7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:43.611 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.607+0000 7faac526a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c177fda1a0 0x55c177fd7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:43.611 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.607+0000 7faac526a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55c177fdcdc0 con 0x55c177fda1a0 2024-08-19T00:19:43.611 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.607+0000 7faac526a740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55c177ee6520 con 0x55c177fc7010 2024-08-19T00:19:43.612 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.607+0000 7faac526a740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55c177fdcf40 con 0x55c177fc66f0 2024-08-19T00:19:43.612 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.607+0000 7faac526a740 10 client.0 _ll_register_callbacks cb 0x55c177c3da00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:19:43.612 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.607+0000 7faac096e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c177fda1a0 0x55c177fd7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:43.612 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.607+0000 7faabb7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c177fc7010 0x55c177fd7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:43.612 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.607+0000 7faac096e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c177fda1a0 0x55c177fd7ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43890/0 (socket says 172.21.15.44:43890) 2024-08-19T00:19:43.612 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.607+0000 7faac096e640 1 -- 172.21.15.44:0/3484569851 learned_addr learned my addr 172.21.15.44:0/3484569851 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:19:43.612 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.607+0000 7faabbfff640 1 --2- 172.21.15.44:0/3484569851 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c177fc66f0 0x55c177fd7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:43.612 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.607+0000 7faac096e640 1 -- 172.21.15.44:0/3484569851 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c177fc66f0 msgr2=0x55c177fd7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:43.612 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.607+0000 7faac096e640 1 --2- 172.21.15.44:0/3484569851 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c177fc66f0 0x55c177fd7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:43.613 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.607+0000 7faac096e640 1 -- 172.21.15.44:0/3484569851 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c177fc7010 msgr2=0x55c177fd7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:43.613 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.607+0000 7faac096e640 1 --2- 172.21.15.44:0/3484569851 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c177fc7010 0x55c177fd7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:43.613 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.607+0000 7faac096e640 1 -- 172.21.15.44:0/3484569851 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c177d0a620 con 0x55c177fda1a0 2024-08-19T00:19:43.613 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.608+0000 7faac096e640 1 --2- 172.21.15.44:0/3484569851 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c177fda1a0 0x55c177fd7ac0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7faab40b8ae0 tx=0x7faab40bc1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9d60fa761e69c71 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:19:43.613 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.608+0000 7faa9b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:19:43.613 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.608+0000 7faa9b7fe640 1 -- 172.21.15.44:0/3484569851 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab40bc680 con 0x55c177fda1a0 2024-08-19T00:19:43.613 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.608+0000 7faac526a740 1 -- 172.21.15.44:0/3484569851 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faaac0043c0 con 0x55c177fda1a0 2024-08-19T00:19:43.613 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.608+0000 7faa9b7fe640 1 -- 172.21.15.44:0/3484569851 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7faab40b8cf0 con 0x55c177fda1a0 2024-08-19T00:19:43.615 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.609+0000 7faa9b7fe640 1 -- 172.21.15.44:0/3484569851 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7faab40c0a30 con 0x55c177fda1a0 2024-08-19T00:19:43.615 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.609+0000 7faac526a740 10 client.16326 fetch_fsmap learned FSMap version 33 2024-08-19T00:19:43.615 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.609+0000 7faac526a740 1 -- 172.21.15.44:0/3484569851 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55c177fe8a00 con 0x55c177fda1a0 2024-08-19T00:19:43.615 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.609+0000 7faa9b7fe640 1 -- 172.21.15.44:0/3484569851 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faaac0043c0 con 0x55c177fda1a0 2024-08-19T00:19:43.615 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.609+0000 7faa9b7fe640 1 -- 172.21.15.44:0/3484569851 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7faab40c4e60 con 0x55c177fda1a0 2024-08-19T00:19:43.616 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.609+0000 7faac526a740 10 client.16326 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:19:43.616 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.609+0000 7faac526a740 10 client.16326 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:19:43.616 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.609+0000 7faac526a740 20 client.16326 populate_metadata read hostname 'smithi044' 2024-08-19T00:19:43.616 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.609+0000 7faac526a740 1 --2- 172.21.15.44:0/3484569851 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55c177fe9eb0 0x55c177fec310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:43.616 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.609+0000 7faac526a740 4 client.16326 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:19:43.616 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.609+0000 7faac526a740 1 -- 172.21.15.44:0/3484569851 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c177f38100 con 0x55c177fe9eb0 2024-08-19T00:19:43.616 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.610+0000 7faabbfff640 1 --2- 172.21.15.44:0/3484569851 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55c177fe9eb0 0x55c177fec310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:43.616 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.610+0000 7faa9b7fe640 10 client.16326 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:19:43.616 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.610+0000 7faabbfff640 1 --2- 172.21.15.44:0/3484569851 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55c177fe9eb0 0x55c177fec310 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6bb5305cda52c6d server_cookie=438e4509d4751d23 in_seq=0 out_seq=0 2024-08-19T00:19:43.616 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.611+0000 7faa9b7fe640 1 -- 172.21.15.44:0/3484569851 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c177f38100 con 0x55c177fe9eb0 2024-08-19T00:19:43.616 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.611+0000 7faa9b7fe640 10 client.16326 handle_command_reply: tid=0 2024-08-19T00:19:43.616 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.611+0000 7faac526a740 1 client.16326 shutdown 2024-08-19T00:19:43.616 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.612+0000 7faac526a740 1 -- 172.21.15.44:0/3484569851 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c177fda1a0 msgr2=0x55c177fd7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:43.617 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.612+0000 7faac526a740 1 --2- 172.21.15.44:0/3484569851 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c177fda1a0 0x55c177fd7ac0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7faab40b8ae0 tx=0x7faab40bc1c0 comp rx=0 tx=0).stop 2024-08-19T00:19:43.617 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.612+0000 7faac526a740 1 -- 172.21.15.44:0/3484569851 shutdown_connections 2024-08-19T00:19:43.617 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.612+0000 7faac526a740 1 --2- 172.21.15.44:0/3484569851 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55c177fe9eb0 0x55c177fec310 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:43.617 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.612+0000 7faac526a740 1 --2- 172.21.15.44:0/3484569851 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c177fda1a0 0x55c177fd7ac0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:43.617 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.612+0000 7faac526a740 1 --2- 172.21.15.44:0/3484569851 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c177fc7010 0x55c177fd7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:43.617 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.612+0000 7faac526a740 1 --2- 172.21.15.44:0/3484569851 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c177fc66f0 0x55c177fd7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:43.617 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.612+0000 7faac526a740 1 -- 172.21.15.44:0/3484569851 >> 172.21.15.44:0/3484569851 conn(0x55c177fc2d40 msgr2=0x55c177fc1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:19:43.617 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.612+0000 7faa9b7fe640 0 client.16326 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:19:43.617 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.612+0000 7faac526a740 1 -- 172.21.15.44:0/3484569851 shutdown_connections 2024-08-19T00:19:43.617 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.612+0000 7faac526a740 1 -- 172.21.15.44:0/3484569851 wait complete. 2024-08-19T00:19:43.617 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.612+0000 7faac526a740 20 client.16326 trim_cache size 0 max 16384 2024-08-19T00:19:43.639 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.636+0000 7faac526a740 1 Processor -- start 2024-08-19T00:19:43.639 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.636+0000 7faac526a740 1 -- start start 2024-08-19T00:19:43.639 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.636+0000 7faac526a740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c177fc66f0 0x55c177fd8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:43.639 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.636+0000 7faac526a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c177fc7010 0x55c177ff1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:43.640 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.636+0000 7faac526a740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c177fda1a0 0x55c177ff2160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:43.640 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.637+0000 7faac526a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7faabc1ac970 con 0x55c177fc7010 2024-08-19T00:19:43.640 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.637+0000 7faac526a740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7faabc1ae4b0 con 0x55c177fda1a0 2024-08-19T00:19:43.640 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.637+0000 7faac526a740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7faabc1ad040 con 0x55c177fc66f0 2024-08-19T00:19:43.640 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.637+0000 7faabb7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c177fc7010 0x55c177ff1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:43.640 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.637+0000 7faabb7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c177fc7010 0x55c177ff1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43904/0 (socket says 172.21.15.44:43904) 2024-08-19T00:19:43.640 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.637+0000 7faabb7fe640 1 -- 172.21.15.44:0/901729899 learned_addr learned my addr 172.21.15.44:0/901729899 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:19:43.640 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.637+0000 7faabbfff640 1 --2- 172.21.15.44:0/901729899 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c177fc66f0 0x55c177fd8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:43.640 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.637+0000 7faac096e640 1 --2- 172.21.15.44:0/901729899 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c177fda1a0 0x55c177ff2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:43.640 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.637+0000 7faabb7fe640 1 -- 172.21.15.44:0/901729899 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c177fc66f0 msgr2=0x55c177fd8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:43.640 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.637+0000 7faabb7fe640 1 --2- 172.21.15.44:0/901729899 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c177fc66f0 0x55c177fd8ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:43.640 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.637+0000 7faabb7fe640 1 -- 172.21.15.44:0/901729899 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c177fda1a0 msgr2=0x55c177ff2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:43.640 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.637+0000 7faabb7fe640 1 --2- 172.21.15.44:0/901729899 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c177fda1a0 0x55c177ff2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:43.641 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.637+0000 7faabb7fe640 1 -- 172.21.15.44:0/901729899 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c177fdcc50 con 0x55c177fc7010 2024-08-19T00:19:43.641 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.637+0000 7faac096e640 1 --2- 172.21.15.44:0/901729899 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c177fda1a0 0x55c177ff2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:19:43.641 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.637+0000 7faabb7fe640 1 --2- 172.21.15.44:0/901729899 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c177fc7010 0x55c177ff1c20 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7faab0005fd0 tx=0x7faab0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c51527e5cb8b537c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:19:43.641 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.637+0000 7faaa1ffb640 1 -- 172.21.15.44:0/901729899 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab002a630 con 0x55c177fc7010 2024-08-19T00:19:43.641 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.638+0000 7faaa1ffb640 1 -- 172.21.15.44:0/901729899 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faab000fe50 con 0x55c177fc7010 2024-08-19T00:19:43.641 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.638+0000 7faaa1ffb640 1 -- 172.21.15.44:0/901729899 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab00298a0 con 0x55c177fc7010 2024-08-19T00:19:43.644 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.638+0000 7faac526a740 1 -- 172.21.15.44:0/901729899 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c177fc7010 msgr2=0x55c177ff1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:43.644 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.638+0000 7faac526a740 1 --2- 172.21.15.44:0/901729899 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c177fc7010 0x55c177ff1c20 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7faab0005fd0 tx=0x7faab0004730 comp rx=0 tx=0).stop 2024-08-19T00:19:43.645 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.638+0000 7faac526a740 1 -- 172.21.15.44:0/901729899 shutdown_connections 2024-08-19T00:19:43.645 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.638+0000 7faac526a740 1 --2- 172.21.15.44:0/901729899 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c177fda1a0 0x55c177ff2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:43.645 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.638+0000 7faac526a740 1 --2- 172.21.15.44:0/901729899 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c177fc7010 0x55c177ff1c20 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:43.645 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.638+0000 7faac526a740 1 --2- 172.21.15.44:0/901729899 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c177fc66f0 0x55c177fd8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:43.645 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.638+0000 7faac526a740 1 -- 172.21.15.44:0/901729899 >> 172.21.15.44:0/901729899 conn(0x55c177fc2d40 msgr2=0x55c177fd8790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:19:43.645 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.638+0000 7faac526a740 1 -- 172.21.15.44:0/901729899 shutdown_connections 2024-08-19T00:19:43.645 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.638+0000 7faac526a740 1 -- 172.21.15.44:0/901729899 wait complete. 2024-08-19T00:19:43.645 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.639+0000 7faac526a740 1 -- start start 2024-08-19T00:19:43.645 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.639+0000 7faac526a740 1 Processor -- start 2024-08-19T00:19:43.645 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.639+0000 7faac526a740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c177fc66f0 0x55c177fe27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:43.645 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.639+0000 7faac526a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c177fc7010 0x55c177fd3b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:43.645 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.639+0000 7faac526a740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c177fda1a0 0x55c177fd4070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:43.646 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.639+0000 7faac526a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7faabc1adde0 con 0x55c177fc7010 2024-08-19T00:19:43.646 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.639+0000 7faac526a740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7faabc1ad710 con 0x55c177fc66f0 2024-08-19T00:19:43.646 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.639+0000 7faac526a740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7faabc1aa950 con 0x55c177fda1a0 2024-08-19T00:19:43.646 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.639+0000 7faac526a740 10 client.0 _ll_register_callbacks cb 0x7faab4031440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:19:43.646 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.639+0000 7faabb7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c177fc7010 0x55c177fd3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:43.646 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.639+0000 7faabb7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c177fc7010 0x55c177fd3b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43918/0 (socket says 172.21.15.44:43918) 2024-08-19T00:19:43.646 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.639+0000 7faabb7fe640 1 -- 172.21.15.44:0/3260627903 learned_addr learned my addr 172.21.15.44:0/3260627903 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:19:43.646 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.639+0000 7faac096e640 1 --2- 172.21.15.44:0/3260627903 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c177fda1a0 0x55c177fd4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:43.646 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.639+0000 7faabbfff640 1 --2- 172.21.15.44:0/3260627903 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c177fc66f0 0x55c177fe27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:43.646 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.639+0000 7faabb7fe640 1 -- 172.21.15.44:0/3260627903 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c177fda1a0 msgr2=0x55c177fd4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:43.646 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.639+0000 7faabb7fe640 1 --2- 172.21.15.44:0/3260627903 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c177fda1a0 0x55c177fd4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:43.647 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.639+0000 7faabb7fe640 1 -- 172.21.15.44:0/3260627903 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c177fc66f0 msgr2=0x55c177fe27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:43.647 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.639+0000 7faabb7fe640 1 --2- 172.21.15.44:0/3260627903 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c177fc66f0 0x55c177fe27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:43.647 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.639+0000 7faabb7fe640 1 -- 172.21.15.44:0/3260627903 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c177fd46e0 con 0x55c177fc7010 2024-08-19T00:19:43.647 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.640+0000 7faabb7fe640 1 --2- 172.21.15.44:0/3260627903 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c177fc7010 0x55c177fd3b30 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7faab000fba0 tx=0x7faab00092e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4af4373722da6e61 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:19:43.647 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.640+0000 7faa9b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:19:43.647 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.640+0000 7faa9b7fe640 1 -- 172.21.15.44:0/3260627903 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab0021610 con 0x55c177fc7010 2024-08-19T00:19:43.647 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.640+0000 7faa9b7fe640 1 -- 172.21.15.44:0/3260627903 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7faab00217b0 con 0x55c177fc7010 2024-08-19T00:19:43.647 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.640+0000 7faac526a740 1 -- 172.21.15.44:0/3260627903 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faab000fe50 con 0x55c177fc7010 2024-08-19T00:19:43.647 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.640+0000 7faa9b7fe640 1 -- 172.21.15.44:0/3260627903 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7faab00219b0 con 0x55c177fc7010 2024-08-19T00:19:43.647 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.640+0000 7faac526a740 10 client.16332 fetch_fsmap learned FSMap version 33 2024-08-19T00:19:43.647 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.640+0000 7faac526a740 1 -- 172.21.15.44:0/3260627903 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55c178054bf0 con 0x55c177fc7010 2024-08-19T00:19:43.647 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.640+0000 7faa9b7fe640 1 -- 172.21.15.44:0/3260627903 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faab000fe50 con 0x55c177fc7010 2024-08-19T00:19:43.647 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.640+0000 7faa9b7fe640 1 -- 172.21.15.44:0/3260627903 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7faab0003730 con 0x55c177fc7010 2024-08-19T00:19:43.648 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.640+0000 7faac526a740 10 client.16332 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:19:43.648 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.640+0000 7faac526a740 10 client.16332 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:19:43.648 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.640+0000 7faac526a740 20 client.16332 populate_metadata read hostname 'smithi044' 2024-08-19T00:19:43.648 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.640+0000 7faac526a740 1 --2- 172.21.15.44:0/3260627903 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55c178055150 0x55c178057570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:43.648 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.640+0000 7faac526a740 4 client.16332 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-19T00:19:43.648 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.640+0000 7faac526a740 1 -- 172.21.15.44:0/3260627903 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c177f32450 con 0x55c178055150 2024-08-19T00:19:43.648 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.641+0000 7faabbfff640 1 --2- 172.21.15.44:0/3260627903 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55c178055150 0x55c178057570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:43.648 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.641+0000 7faabbfff640 1 --2- 172.21.15.44:0/3260627903 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55c178055150 0x55c178057570 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19ef20d4dcee212 server_cookie=78406525366130ef in_seq=0 out_seq=0 2024-08-19T00:19:43.648 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.641+0000 7faa9b7fe640 10 client.16332 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:19:43.651 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.649+0000 7faa9b7fe640 1 -- 172.21.15.44:0/3260627903 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c177f32450 con 0x55c178055150 2024-08-19T00:19:43.651 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.649+0000 7faa9b7fe640 10 client.16332 handle_command_reply: tid=0 2024-08-19T00:19:43.651 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.649+0000 7faac526a740 1 client.16332 shutdown 2024-08-19T00:19:43.651 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.649+0000 7faac526a740 1 -- 172.21.15.44:0/3260627903 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c177fc7010 msgr2=0x55c177fd3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:43.651 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.649+0000 7faac526a740 1 --2- 172.21.15.44:0/3260627903 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c177fc7010 0x55c177fd3b30 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7faab000fba0 tx=0x7faab00092e0 comp rx=0 tx=0).stop 2024-08-19T00:19:43.651 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.649+0000 7faac526a740 1 -- 172.21.15.44:0/3260627903 shutdown_connections 2024-08-19T00:19:43.651 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.649+0000 7faac526a740 1 --2- 172.21.15.44:0/3260627903 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55c178055150 0x55c178057570 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:43.651 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.649+0000 7faac526a740 1 --2- 172.21.15.44:0/3260627903 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c177fda1a0 0x55c177fd4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:43.651 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.649+0000 7faa9b7fe640 0 client.16332 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:19:43.652 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.649+0000 7faac526a740 1 --2- 172.21.15.44:0/3260627903 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c177fc7010 0x55c177fd3b30 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:43.652 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.649+0000 7faac526a740 1 --2- 172.21.15.44:0/3260627903 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c177fc66f0 0x55c177fe27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:43.652 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.649+0000 7faac526a740 1 -- 172.21.15.44:0/3260627903 >> 172.21.15.44:0/3260627903 conn(0x55c177fc2d40 msgr2=0x55c177fc1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:19:43.652 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.649+0000 7faac526a740 1 -- 172.21.15.44:0/3260627903 shutdown_connections 2024-08-19T00:19:43.652 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.649+0000 7faac526a740 1 -- 172.21.15.44:0/3260627903 wait complete. 2024-08-19T00:19:43.652 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.649+0000 7faac526a740 20 client.16332 trim_cache size 0 max 16384 2024-08-19T00:19:43.652 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:{ 2024-08-19T00:19:43.653 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "message": "", 2024-08-19T00:19:43.653 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "return_code": 0 2024-08-19T00:19:43.654 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:} 2024-08-19T00:19:43.655 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.650+0000 7faac23d1640 1 -- 172.21.15.44:0/458480788 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7faaa40a2da0 msgr2=0x7faaa40a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:43.655 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.650+0000 7faac23d1640 1 --2- 172.21.15.44:0/458480788 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7faaa40a2da0 0x7faaa40a5260 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7faab0009fd0 tx=0x7faab00096e0 comp rx=0 tx=0).stop 2024-08-19T00:19:43.656 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.650+0000 7faac23d1640 1 -- 172.21.15.44:0/458480788 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faabc1066f0 msgr2=0x7faabc19eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:43.656 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.650+0000 7faac23d1640 1 --2- 172.21.15.44:0/458480788 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faabc1066f0 0x7faabc19eb00 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7faab4034040 tx=0x7faab40305d0 comp rx=0 tx=0).stop 2024-08-19T00:19:43.656 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.650+0000 7faac23d1640 1 -- 172.21.15.44:0/458480788 shutdown_connections 2024-08-19T00:19:43.656 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.650+0000 7faac23d1640 1 --2- 172.21.15.44:0/458480788 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7faaa40a2da0 0x7faaa40a5260 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:43.656 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.650+0000 7faac23d1640 1 --2- 172.21.15.44:0/458480788 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faabc101080 0x7faabc19a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:43.656 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.650+0000 7faac23d1640 1 --2- 172.21.15.44:0/458480788 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faabc1066f0 0x7faabc19eb00 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:43.656 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.650+0000 7faac23d1640 1 --2- 172.21.15.44:0/458480788 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faabc1006e0 0x7faabc19a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:43.656 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.650+0000 7faac23d1640 1 -- 172.21.15.44:0/458480788 >> 172.21.15.44:0/458480788 conn(0x7faabc0776c0 msgr2=0x7faabc104540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:19:43.656 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.650+0000 7faac23d1640 1 -- 172.21.15.44:0/458480788 shutdown_connections 2024-08-19T00:19:43.656 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:43.650+0000 7faac23d1640 1 -- 172.21.15.44:0/458480788 wait complete. 2024-08-19T00:19:43.680 INFO:tasks.workunit.client.0.smithi044.stdout: 1 444574 7.98 MB/sec execute 188 sec latency 6925.482 ms 2024-08-19T00:19:44.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:19:44 smithi171 ceph-mon[21810]: pgmap v195: 129 pgs: 129 active+clean; 292 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 110 op/s 2024-08-19T00:19:44.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:19:44 smithi116 ceph-mon[21873]: pgmap v195: 129 pgs: 129 active+clean; 292 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 110 op/s 2024-08-19T00:19:44.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:19:44 smithi044 ceph-mon[18489]: pgmap v195: 129 pgs: 129 active+clean; 292 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 110 op/s 2024-08-19T00:19:44.680 INFO:tasks.workunit.client.0.smithi044.stdout: 1 444574 7.94 MB/sec execute 189 sec latency 7925.586 ms 2024-08-19T00:19:45.681 INFO:tasks.workunit.client.0.smithi044.stdout: 1 444574 7.90 MB/sec execute 190 sec latency 8925.635 ms 2024-08-19T00:19:46.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:19:46 smithi171 ceph-mon[21810]: pgmap v196: 129 pgs: 129 active+clean; 293 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.6 MiB/s wr, 144 op/s 2024-08-19T00:19:46.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:19:46 smithi116 ceph-mon[21873]: pgmap v196: 129 pgs: 129 active+clean; 293 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.6 MiB/s wr, 144 op/s 2024-08-19T00:19:46.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:19:46 smithi044 ceph-mon[18489]: pgmap v196: 129 pgs: 129 active+clean; 293 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.6 MiB/s wr, 144 op/s 2024-08-19T00:19:46.681 INFO:tasks.workunit.client.0.smithi044.stdout: 1 444574 7.85 MB/sec execute 191 sec latency 9925.678 ms 2024-08-19T00:19:47.681 INFO:tasks.workunit.client.0.smithi044.stdout: 1 444574 7.81 MB/sec execute 192 sec latency 10926.110 ms 2024-08-19T00:19:48.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:19:48 smithi171 ceph-mon[21810]: pgmap v197: 129 pgs: 129 active+clean; 293 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 970 KiB/s rd, 1.9 MiB/s wr, 92 op/s 2024-08-19T00:19:48.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:19:48 smithi116 ceph-mon[21873]: pgmap v197: 129 pgs: 129 active+clean; 293 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 970 KiB/s rd, 1.9 MiB/s wr, 92 op/s 2024-08-19T00:19:48.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:19:48 smithi044 ceph-mon[18489]: pgmap v197: 129 pgs: 129 active+clean; 293 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 970 KiB/s rd, 1.9 MiB/s wr, 92 op/s 2024-08-19T00:19:48.681 INFO:tasks.workunit.client.0.smithi044.stdout: 1 444574 7.77 MB/sec execute 193 sec latency 11926.195 ms 2024-08-19T00:19:49.681 INFO:tasks.workunit.client.0.smithi044.stdout: 1 444574 7.73 MB/sec execute 194 sec latency 12926.297 ms 2024-08-19T00:19:50.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:19:50 smithi171 ceph-mon[21810]: pgmap v198: 129 pgs: 129 active+clean; 293 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 970 KiB/s rd, 1.9 MiB/s wr, 92 op/s 2024-08-19T00:19:50.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:19:50 smithi116 ceph-mon[21873]: pgmap v198: 129 pgs: 129 active+clean; 293 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 970 KiB/s rd, 1.9 MiB/s wr, 92 op/s 2024-08-19T00:19:50.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:19:50 smithi044 ceph-mon[18489]: pgmap v198: 129 pgs: 129 active+clean; 293 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 970 KiB/s rd, 1.9 MiB/s wr, 92 op/s 2024-08-19T00:19:50.681 INFO:tasks.workunit.client.0.smithi044.stdout: 1 444574 7.69 MB/sec execute 195 sec latency 13926.382 ms 2024-08-19T00:19:51.681 INFO:tasks.workunit.client.0.smithi044.stdout: 1 444574 7.65 MB/sec execute 196 sec latency 14926.477 ms 2024-08-19T00:19:52.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:19:52 smithi171 ceph-mon[21810]: pgmap v199: 129 pgs: 129 active+clean; 287 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.1 MiB/s wr, 113 op/s 2024-08-19T00:19:52.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:19:52 smithi116 ceph-mon[21873]: pgmap v199: 129 pgs: 129 active+clean; 287 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.1 MiB/s wr, 113 op/s 2024-08-19T00:19:52.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:19:52 smithi044 ceph-mon[18489]: pgmap v199: 129 pgs: 129 active+clean; 287 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.1 MiB/s wr, 113 op/s 2024-08-19T00:19:52.681 INFO:tasks.workunit.client.0.smithi044.stdout: 1 444574 7.61 MB/sec execute 197 sec latency 15926.581 ms 2024-08-19T00:19:53.272 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-19T00:19:53.549 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:19:53.681 INFO:tasks.workunit.client.0.smithi044.stdout: 1 444574 7.58 MB/sec execute 198 sec latency 16926.623 ms 2024-08-19T00:19:54.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:54.086+0000 7fea91f4a640 1 -- 172.21.15.44:0/4162104439 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fea8c1018c0 msgr2=0x7fea8c101d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:54.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:54.086+0000 7fea91f4a640 1 --2- 172.21.15.44:0/4162104439 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fea8c1018c0 0x7fea8c101d20 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fea80009930 tx=0x7fea8002a420 comp rx=0 tx=0).stop 2024-08-19T00:19:54.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:54.086+0000 7fea91f4a640 1 -- 172.21.15.44:0/4162104439 shutdown_connections 2024-08-19T00:19:54.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:54.086+0000 7fea91f4a640 1 --2- 172.21.15.44:0/4162104439 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fea8c102260 0x7fea8c10e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:54.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:54.086+0000 7fea91f4a640 1 --2- 172.21.15.44:0/4162104439 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fea8c1018c0 0x7fea8c101d20 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:54.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:54.086+0000 7fea91f4a640 1 --2- 172.21.15.44:0/4162104439 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fea8c1078c0 0x7fea8c107ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:54.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:54.086+0000 7fea91f4a640 1 -- 172.21.15.44:0/4162104439 >> 172.21.15.44:0/4162104439 conn(0x7fea8c0fd5e0 msgr2=0x7fea8c0ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:19:54.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:54.086+0000 7fea91f4a640 1 -- 172.21.15.44:0/4162104439 shutdown_connections 2024-08-19T00:19:54.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:54.086+0000 7fea91f4a640 1 -- 172.21.15.44:0/4162104439 wait complete. 2024-08-19T00:19:54.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:54.087+0000 7fea91f4a640 1 Processor -- start 2024-08-19T00:19:54.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:54.087+0000 7fea91f4a640 1 -- start start 2024-08-19T00:19:54.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:54.087+0000 7fea91f4a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fea8c1018c0 0x7fea8c198200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:54.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:54.087+0000 7fea91f4a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fea8c102260 0x7fea8c198740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:54.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:54.087+0000 7fea91f4a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fea8c1078c0 0x7fea8c19cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:54.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:54.087+0000 7fea91f4a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fea8c111d00 con 0x7fea8c1018c0 2024-08-19T00:19:54.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:54.087+0000 7fea91f4a640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fea8c111b80 con 0x7fea8c102260 2024-08-19T00:19:54.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:54.087+0000 7fea91f4a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fea8c111e80 con 0x7fea8c1078c0 2024-08-19T00:19:54.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:54.087+0000 7fea8b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fea8c1018c0 0x7fea8c198200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:54.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:54.088+0000 7fea8b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fea8c1018c0 0x7fea8c198200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45854/0 (socket says 172.21.15.44:45854) 2024-08-19T00:19:54.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:54.088+0000 7fea8b7fe640 1 -- 172.21.15.44:0/3329217846 learned_addr learned my addr 172.21.15.44:0/3329217846 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:19:54.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:54.088+0000 7fea8affd640 1 --2- 172.21.15.44:0/3329217846 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fea8c102260 0x7fea8c198740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:54.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:54.088+0000 7fea8bfff640 1 --2- 172.21.15.44:0/3329217846 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fea8c1078c0 0x7fea8c19cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:54.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:54.088+0000 7fea8b7fe640 1 -- 172.21.15.44:0/3329217846 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fea8c1078c0 msgr2=0x7fea8c19cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:54.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:54.088+0000 7fea8b7fe640 1 --2- 172.21.15.44:0/3329217846 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fea8c1078c0 0x7fea8c19cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:54.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:54.088+0000 7fea8b7fe640 1 -- 172.21.15.44:0/3329217846 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fea8c102260 msgr2=0x7fea8c198740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:54.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:54.088+0000 7fea8b7fe640 1 --2- 172.21.15.44:0/3329217846 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fea8c102260 0x7fea8c198740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:54.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:54.088+0000 7fea8b7fe640 1 -- 172.21.15.44:0/3329217846 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea8c19d1b0 con 0x7fea8c1018c0 2024-08-19T00:19:54.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:54.088+0000 7fea8affd640 1 --2- 172.21.15.44:0/3329217846 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fea8c102260 0x7fea8c198740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:19:54.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:54.088+0000 7fea8b7fe640 1 --2- 172.21.15.44:0/3329217846 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fea8c1018c0 0x7fea8c198200 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fea7c00d770 tx=0x7fea7c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:19:54.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:54.088+0000 7fea88ff9640 1 -- 172.21.15.44:0/3329217846 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea7c017070 con 0x7fea8c1018c0 2024-08-19T00:19:54.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:54.088+0000 7fea88ff9640 1 -- 172.21.15.44:0/3329217846 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea7c005500 con 0x7fea8c1018c0 2024-08-19T00:19:54.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:54.088+0000 7fea91f4a640 1 -- 172.21.15.44:0/3329217846 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea8c19d4a0 con 0x7fea8c1018c0 2024-08-19T00:19:54.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:54.088+0000 7fea88ff9640 1 -- 172.21.15.44:0/3329217846 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea7c004e00 con 0x7fea8c1018c0 2024-08-19T00:19:54.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:54.088+0000 7fea91f4a640 1 -- 172.21.15.44:0/3329217846 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea8c1a4d80 con 0x7fea8c1018c0 2024-08-19T00:19:54.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:54.089+0000 7fea91f4a640 1 -- 172.21.15.44:0/3329217846 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea8c101d20 con 0x7fea8c1018c0 2024-08-19T00:19:54.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:54.090+0000 7fea88ff9640 1 -- 172.21.15.44:0/3329217846 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fea7c004fa0 con 0x7fea8c1018c0 2024-08-19T00:19:54.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:54.091+0000 7fea88ff9640 1 --2- 172.21.15.44:0/3329217846 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fea740a2cf0 0x7fea740a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:54.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:54.091+0000 7fea88ff9640 1 -- 172.21.15.44:0/3329217846 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7fea7c0cf320 con 0x7fea8c1018c0 2024-08-19T00:19:54.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:54.091+0000 7fea8affd640 1 --2- 172.21.15.44:0/3329217846 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fea740a2cf0 0x7fea740a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:54.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:54.092+0000 7fea8affd640 1 --2- 172.21.15.44:0/3329217846 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fea740a2cf0 0x7fea740a51b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fea80000c00 tx=0x7fea80005a20 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:19:54.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:54.095+0000 7fea88ff9640 1 -- 172.21.15.44:0/3329217846 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fea7c09bba0 con 0x7fea8c1018c0 2024-08-19T00:19:54.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:54.306+0000 7fea91f4a640 1 -- 172.21.15.44:0/3329217846 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fea8c109e50 con 0x7fea8c1018c0 2024-08-19T00:19:54.308 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:19:54 smithi044 ceph-mon[18489]: pgmap v200: 129 pgs: 129 active+clean; 287 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 1.0 MiB/s wr, 54 op/s 2024-08-19T00:19:54.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:54.307+0000 7fea88ff9640 1 -- 172.21.15.44:0/3329217846 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11989 (secure 0 0 0) 0x7fea7c09b4a0 con 0x7fea8c1018c0 2024-08-19T00:19:54.309 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:19:54.310 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":33,"btime":"2024-08-19T00:17:11:640526+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14511,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1538841896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1538841896},{"type":"v1","addr":"172.21.15.116:6833","nonce":1538841896}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/4044471606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4044471606},{"type":"v1","addr":"172.21.15.44:6835","nonce":4044471606}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":33,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-19T00:10:53.196636+0000","modified":"2024-08-19T00:17:11.586031+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24473,"mds_1":24446,"mds_2":24439,"mds_3":24431,"mds_4":24418},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14529":{"gid":14529,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6837/1824829052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1824829052},{"type":"v1","addr":"172.21.15.44:6837","nonce":1824829052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14577":{"gid":14577,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6839/3591739042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":3591739042},{"type":"v1","addr":"172.21.15.44:6839","nonce":3591739042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14589":{"gid":14589,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6841/3667695717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6840","nonce":3667695717},{"type":"v1","addr":"172.21.15.44:6841","nonce":3667695717}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24388":{"gid":24388,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1183022838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1183022838},{"type":"v1","addr":"172.21.15.171:6833","nonce":1183022838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6835/2190623851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":2190623851},{"type":"v1","addr":"172.21.15.171:6835","nonce":2190623851}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.171:6837/316231795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":316231795},{"type":"v1","addr":"172.21.15.171:6837","nonce":316231795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":20,"addr":"172.21.15.116:6835/3507399322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3507399322},{"type":"v1","addr":"172.21.15.116:6835","nonce":3507399322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.171:6839/1466585795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":1466585795},{"type":"v1","addr":"172.21.15.171:6839","nonce":1466585795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":17,"addr":"172.21.15.116:6837/2764513846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":2764513846},{"type":"v1","addr":"172.21.15.116:6837","nonce":2764513846}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.116:6839/1032741033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":1032741033},{"type":"v1","addr":"172.21.15.116:6839","nonce":1032741033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24446,24439,24431,24418]},"id":1}]} 2024-08-19T00:19:54.310 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 33 2024-08-19T00:19:54.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:54.310+0000 7fea91f4a640 1 -- 172.21.15.44:0/3329217846 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fea740a2cf0 msgr2=0x7fea740a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:54.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:54.310+0000 7fea91f4a640 1 --2- 172.21.15.44:0/3329217846 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fea740a2cf0 0x7fea740a51b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fea80000c00 tx=0x7fea80005a20 comp rx=0 tx=0).stop 2024-08-19T00:19:54.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:54.310+0000 7fea91f4a640 1 -- 172.21.15.44:0/3329217846 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fea8c1018c0 msgr2=0x7fea8c198200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:54.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:54.310+0000 7fea91f4a640 1 --2- 172.21.15.44:0/3329217846 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fea8c1018c0 0x7fea8c198200 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fea7c00d770 tx=0x7fea7c00dc30 comp rx=0 tx=0).stop 2024-08-19T00:19:54.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:54.310+0000 7fea91f4a640 1 -- 172.21.15.44:0/3329217846 shutdown_connections 2024-08-19T00:19:54.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:54.310+0000 7fea91f4a640 1 --2- 172.21.15.44:0/3329217846 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fea740a2cf0 0x7fea740a51b0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:54.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:54.310+0000 7fea91f4a640 1 --2- 172.21.15.44:0/3329217846 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fea8c1078c0 0x7fea8c19cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:54.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:54.310+0000 7fea91f4a640 1 --2- 172.21.15.44:0/3329217846 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fea8c102260 0x7fea8c198740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:54.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:54.310+0000 7fea91f4a640 1 --2- 172.21.15.44:0/3329217846 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fea8c1018c0 0x7fea8c198200 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:54.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:54.310+0000 7fea91f4a640 1 -- 172.21.15.44:0/3329217846 >> 172.21.15.44:0/3329217846 conn(0x7fea8c0fd5e0 msgr2=0x7fea8c0fdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:19:54.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:54.310+0000 7fea91f4a640 1 -- 172.21.15.44:0/3329217846 shutdown_connections 2024-08-19T00:19:54.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:54.310+0000 7fea91f4a640 1 -- 172.21.15.44:0/3329217846 wait complete. 2024-08-19T00:19:54.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:19:54 smithi171 ceph-mon[21810]: pgmap v200: 129 pgs: 129 active+clean; 287 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 1.0 MiB/s wr, 54 op/s 2024-08-19T00:19:54.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:19:54 smithi116 ceph-mon[21873]: pgmap v200: 129 pgs: 129 active+clean; 287 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 1.0 MiB/s wr, 54 op/s 2024-08-19T00:19:54.681 INFO:tasks.workunit.client.0.smithi044.stdout: 1 444574 7.54 MB/sec execute 199 sec latency 17926.660 ms 2024-08-19T00:19:54.980 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24473 quiesce db --set-id f61c6c1f --release --await' 2024-08-19T00:19:54.980 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24473 quiesce db --set-id f61c6c1f --release --await 2024-08-19T00:19:55.236 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:19:55.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:19:55 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/3329217846' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:19:55.358 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:19:55 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/3329217846' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:19:55.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:19:55 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/3329217846' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:19:55.681 INFO:tasks.workunit.client.0.smithi044.stdout: 1 444574 7.50 MB/sec execute 200 sec latency 18926.717 ms 2024-08-19T00:19:55.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.725+0000 7f47716df640 1 -- 172.21.15.44:0/1509442409 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f476c102250 msgr2=0x7f476c10e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:55.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.725+0000 7f47716df640 1 --2- 172.21.15.44:0/1509442409 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f476c102250 0x7f476c10e780 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f4764009cd0 tx=0x7f476402a8e0 comp rx=0 tx=0).stop 2024-08-19T00:19:55.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.725+0000 7f47716df640 1 -- 172.21.15.44:0/1509442409 shutdown_connections 2024-08-19T00:19:55.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.725+0000 7f47716df640 1 --2- 172.21.15.44:0/1509442409 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f476c102250 0x7f476c10e780 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:55.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.725+0000 7f47716df640 1 --2- 172.21.15.44:0/1509442409 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f476c1018b0 0x7f476c101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:55.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.725+0000 7f47716df640 1 --2- 172.21.15.44:0/1509442409 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f476c1078b0 0x7f476c107c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:55.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.725+0000 7f47716df640 1 -- 172.21.15.44:0/1509442409 >> 172.21.15.44:0/1509442409 conn(0x7f476c0fd5f0 msgr2=0x7f476c0ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:19:55.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.725+0000 7f47716df640 1 -- 172.21.15.44:0/1509442409 shutdown_connections 2024-08-19T00:19:55.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.725+0000 7f47716df640 1 -- 172.21.15.44:0/1509442409 wait complete. 2024-08-19T00:19:55.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.726+0000 7f47716df640 1 Processor -- start 2024-08-19T00:19:55.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.726+0000 7f47716df640 1 -- start start 2024-08-19T00:19:55.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.726+0000 7f47716df640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f476c1018b0 0x7f476c198130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:55.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.726+0000 7f47716df640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f476c102250 0x7f476c198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:55.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.726+0000 7f47716df640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f476c1078b0 0x7f476c19ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:55.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.726+0000 7f47716df640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f476c111cb0 con 0x7f476c102250 2024-08-19T00:19:55.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.726+0000 7f47716df640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f476c111b30 con 0x7f476c1078b0 2024-08-19T00:19:55.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.726+0000 7f47716df640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f476c111e30 con 0x7f476c1018b0 2024-08-19T00:19:55.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.726+0000 7f476a7fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f476c102250 0x7f476c198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:55.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.726+0000 7f476a7fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f476c102250 0x7f476c198670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45874/0 (socket says 172.21.15.44:45874) 2024-08-19T00:19:55.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.727+0000 7f476a7fc640 1 -- 172.21.15.44:0/1069564683 learned_addr learned my addr 172.21.15.44:0/1069564683 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:19:55.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.727+0000 7f476affd640 1 --2- 172.21.15.44:0/1069564683 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f476c1018b0 0x7f476c198130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:55.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.727+0000 7f476b7fe640 1 --2- 172.21.15.44:0/1069564683 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f476c1078b0 0x7f476c19ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:55.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.727+0000 7f476a7fc640 1 -- 172.21.15.44:0/1069564683 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f476c1018b0 msgr2=0x7f476c198130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:55.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.727+0000 7f476a7fc640 1 --2- 172.21.15.44:0/1069564683 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f476c1018b0 0x7f476c198130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:55.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.727+0000 7f476a7fc640 1 -- 172.21.15.44:0/1069564683 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f476c1078b0 msgr2=0x7f476c19ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:55.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.727+0000 7f476a7fc640 1 --2- 172.21.15.44:0/1069564683 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f476c1078b0 0x7f476c19ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:55.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.727+0000 7f476a7fc640 1 -- 172.21.15.44:0/1069564683 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f476c19d0e0 con 0x7f476c102250 2024-08-19T00:19:55.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.727+0000 7f476b7fe640 1 --2- 172.21.15.44:0/1069564683 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f476c1078b0 0x7f476c19ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:19:55.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.727+0000 7f476a7fc640 1 --2- 172.21.15.44:0/1069564683 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f476c102250 0x7f476c198670 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f475400c890 tx=0x7f475400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:19:55.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.727+0000 7f4763fff640 1 -- 172.21.15.44:0/1069564683 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4754004220 con 0x7f476c102250 2024-08-19T00:19:55.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.727+0000 7f47716df640 1 -- 172.21.15.44:0/1069564683 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f476c19d3d0 con 0x7f476c102250 2024-08-19T00:19:55.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.727+0000 7f4763fff640 1 -- 172.21.15.44:0/1069564683 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47540043c0 con 0x7f476c102250 2024-08-19T00:19:55.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.727+0000 7f4763fff640 1 -- 172.21.15.44:0/1069564683 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4754004a00 con 0x7f476c102250 2024-08-19T00:19:55.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.727+0000 7f47716df640 1 -- 172.21.15.44:0/1069564683 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f476c1a4cb0 con 0x7f476c102250 2024-08-19T00:19:55.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.730+0000 7f4763fff640 1 -- 172.21.15.44:0/1069564683 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f47540079b0 con 0x7f476c102250 2024-08-19T00:19:55.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.730+0000 7f4773add740 1 Processor -- start 2024-08-19T00:19:55.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.730+0000 7f4773add740 1 -- start start 2024-08-19T00:19:55.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.731+0000 7f4773add740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562495b0b870 0x562495b0bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:55.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.731+0000 7f4773add740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562495b0c190 0x562495b1aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:55.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.731+0000 7f4773add740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562495b1af80 0x562495b1d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:55.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.731+0000 7f4773add740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562495a71c60 con 0x562495b0b870 2024-08-19T00:19:55.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.731+0000 7f4773add740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x562495a09b90 con 0x562495b0c190 2024-08-19T00:19:55.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.731+0000 7f4773add740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x562495a6dc20 con 0x562495b1af80 2024-08-19T00:19:55.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.731+0000 7f476b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562495b0b870 0x562495b0bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:55.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.731+0000 7f476b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562495b0b870 0x562495b0bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45886/0 (socket says 172.21.15.44:45886) 2024-08-19T00:19:55.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.731+0000 7f476b7fe640 1 -- 172.21.15.44:0/3291935621 learned_addr learned my addr 172.21.15.44:0/3291935621 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:19:55.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.731+0000 7f476b7fe640 1 -- 172.21.15.44:0/3291935621 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562495b1af80 msgr2=0x562495b1d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:55.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.731+0000 7f476b7fe640 1 --2- 172.21.15.44:0/3291935621 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562495b1af80 0x562495b1d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:55.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.731+0000 7f476b7fe640 1 -- 172.21.15.44:0/3291935621 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562495b0c190 msgr2=0x562495b1aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:55.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.731+0000 7f476b7fe640 1 --2- 172.21.15.44:0/3291935621 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562495b0c190 0x562495b1aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:55.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.731+0000 7f476b7fe640 1 -- 172.21.15.44:0/3291935621 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562495781580 con 0x562495b0b870 2024-08-19T00:19:55.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.731+0000 7f4763fff640 1 --2- 172.21.15.44:0/1069564683 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f47580a2cf0 0x7f47580a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:55.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.731+0000 7f476b7fe640 1 --2- 172.21.15.44:0/3291935621 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562495b0b870 0x562495b0bc50 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f47640315f0 tx=0x7f4764009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d04acdd77cf82cf0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:19:55.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.731+0000 7f476affd640 1 --2- 172.21.15.44:0/1069564683 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f47580a2cf0 0x7f47580a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:55.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.732+0000 7f4763fff640 1 -- 172.21.15.44:0/1069564683 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f47540cf4f0 con 0x7f476c102250 2024-08-19T00:19:55.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.732+0000 7f47617fa640 1 -- 172.21.15.44:0/3291935621 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4764031ac0 con 0x562495b0b870 2024-08-19T00:19:55.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.732+0000 7f47617fa640 1 -- 172.21.15.44:0/3291935621 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4764036040 con 0x562495b0b870 2024-08-19T00:19:55.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.732+0000 7f47617fa640 1 -- 172.21.15.44:0/3291935621 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4764004800 con 0x562495b0b870 2024-08-19T00:19:55.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.732+0000 7f4773add740 1 -- 172.21.15.44:0/3291935621 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562495b0b870 msgr2=0x562495b0bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:55.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.732+0000 7f476affd640 1 --2- 172.21.15.44:0/1069564683 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f47580a2cf0 0x7f47580a51b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x562495b0e580 tx=0x7f475c00b6f0 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:19:55.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.732+0000 7f4773add740 1 --2- 172.21.15.44:0/3291935621 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562495b0b870 0x562495b0bc50 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f47640315f0 tx=0x7f4764009a20 comp rx=0 tx=0).stop 2024-08-19T00:19:55.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.732+0000 7f4773add740 1 -- 172.21.15.44:0/3291935621 shutdown_connections 2024-08-19T00:19:55.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.732+0000 7f4773add740 1 --2- 172.21.15.44:0/3291935621 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562495b1af80 0x562495b1d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:55.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.732+0000 7f4773add740 1 --2- 172.21.15.44:0/3291935621 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562495b0c190 0x562495b1aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:55.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.732+0000 7f4773add740 1 --2- 172.21.15.44:0/3291935621 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562495b0b870 0x562495b0bc50 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:55.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.732+0000 7f4773add740 1 -- 172.21.15.44:0/3291935621 >> 172.21.15.44:0/3291935621 conn(0x562495b07f20 msgr2=0x562495b08300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:19:55.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.733+0000 7f4773add740 1 -- 172.21.15.44:0/3291935621 shutdown_connections 2024-08-19T00:19:55.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.733+0000 7f4773add740 1 -- 172.21.15.44:0/3291935621 wait complete. 2024-08-19T00:19:55.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.733+0000 7f4773add740 1 -- start start 2024-08-19T00:19:55.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.733+0000 7f4773add740 1 Processor -- start 2024-08-19T00:19:55.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.733+0000 7f4773add740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562495b0b870 0x562495b17f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:55.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.733+0000 7f4773add740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562495b0c190 0x562495b184c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:55.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.733+0000 7f4773add740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562495b1af80 0x562495b18a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:55.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.733+0000 7f4773add740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562495b1db50 con 0x562495b0b870 2024-08-19T00:19:55.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.733+0000 7f4773add740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x562495a0f7c0 con 0x562495b1af80 2024-08-19T00:19:55.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.733+0000 7f4773add740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x562495b1dcd0 con 0x562495b0c190 2024-08-19T00:19:55.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.733+0000 7f4773add740 10 client.0 _ll_register_callbacks cb 0x562495a18f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:19:55.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.733+0000 7f476affd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562495b0b870 0x562495b17f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:55.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.733+0000 7f476affd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562495b0b870 0x562495b17f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45898/0 (socket says 172.21.15.44:45898) 2024-08-19T00:19:55.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.733+0000 7f476affd640 1 -- 172.21.15.44:0/3138175054 learned_addr learned my addr 172.21.15.44:0/3138175054 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:19:55.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.733+0000 7f476b7fe640 1 --2- 172.21.15.44:0/3138175054 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562495b1af80 0x562495b18a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:55.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.734+0000 7f476a7fc640 1 --2- 172.21.15.44:0/3138175054 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562495b0c190 0x562495b184c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:55.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.734+0000 7f476affd640 1 -- 172.21.15.44:0/3138175054 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562495b0c190 msgr2=0x562495b184c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:55.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.734+0000 7f476affd640 1 --2- 172.21.15.44:0/3138175054 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562495b0c190 0x562495b184c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:55.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.734+0000 7f476affd640 1 -- 172.21.15.44:0/3138175054 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562495b1af80 msgr2=0x562495b18a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:55.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.734+0000 7f476affd640 1 --2- 172.21.15.44:0/3138175054 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562495b1af80 0x562495b18a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:55.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.734+0000 7f476affd640 1 -- 172.21.15.44:0/3138175054 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56249584b960 con 0x562495b0b870 2024-08-19T00:19:55.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.734+0000 7f476a7fc640 1 --2- 172.21.15.44:0/3138175054 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562495b0c190 0x562495b184c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:19:55.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.734+0000 7f476affd640 1 --2- 172.21.15.44:0/3138175054 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562495b0b870 0x562495b17f80 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f475c004700 tx=0x7f475c00b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8937826891c98400 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:19:55.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.734+0000 7f47527fc640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:19:55.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.734+0000 7f47527fc640 1 -- 172.21.15.44:0/3138175054 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f475c01e830 con 0x562495b0b870 2024-08-19T00:19:55.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.734+0000 7f47527fc640 1 -- 172.21.15.44:0/3138175054 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f475c01e9d0 con 0x562495b0b870 2024-08-19T00:19:55.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.734+0000 7f4773add740 1 -- 172.21.15.44:0/3138175054 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4764036040 con 0x562495b0b870 2024-08-19T00:19:55.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.734+0000 7f47527fc640 1 -- 172.21.15.44:0/3138175054 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f475c01ebd0 con 0x562495b0b870 2024-08-19T00:19:55.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.734+0000 7f4773add740 10 client.16350 fetch_fsmap learned FSMap version 33 2024-08-19T00:19:55.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.734+0000 7f4773add740 1 -- 172.21.15.44:0/3138175054 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x562495b29d50 con 0x562495b0b870 2024-08-19T00:19:55.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.734+0000 7f47527fc640 1 -- 172.21.15.44:0/3138175054 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4764036040 con 0x562495b0b870 2024-08-19T00:19:55.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.735+0000 7f47527fc640 1 -- 172.21.15.44:0/3138175054 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f475c01c3b0 con 0x562495b0b870 2024-08-19T00:19:55.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.735+0000 7f4773add740 10 client.16350 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:19:55.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.735+0000 7f4773add740 10 client.16350 resolve_mds: validated gid 24473 aka daemon mds.b 2024-08-19T00:19:55.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.735+0000 7f4773add740 20 client.16350 populate_metadata read hostname 'smithi044' 2024-08-19T00:19:55.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.735+0000 7f4773add740 1 --2- 172.21.15.44:0/3138175054 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x562495b2b210 0x562495b2d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:55.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.735+0000 7f4773add740 4 client.16350 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:19:55.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.735+0000 7f4773add740 1 -- 172.21.15.44:0/3138175054 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562495a7f1d0 con 0x562495b2b210 2024-08-19T00:19:55.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.735+0000 7f476a7fc640 1 --2- 172.21.15.44:0/3138175054 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x562495b2b210 0x562495b2d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:55.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.735+0000 7f476a7fc640 1 --2- 172.21.15.44:0/3138175054 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x562495b2b210 0x562495b2d600 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14f042e5ffaf5f9d server_cookie=dd017932a37594ee in_seq=0 out_seq=0 2024-08-19T00:19:55.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.735+0000 7f47527fc640 10 client.16350 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:19:55.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.736+0000 7f47527fc640 1 -- 172.21.15.44:0/3138175054 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562495a7f1d0 con 0x562495b2b210 2024-08-19T00:19:55.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.736+0000 7f47527fc640 10 client.16350 handle_command_reply: tid=0 2024-08-19T00:19:55.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.736+0000 7f4773add740 1 client.16350 shutdown 2024-08-19T00:19:55.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.736+0000 7f4773add740 1 -- 172.21.15.44:0/3138175054 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562495b0b870 msgr2=0x562495b17f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:55.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.736+0000 7f4773add740 1 --2- 172.21.15.44:0/3138175054 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562495b0b870 0x562495b17f80 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f475c004700 tx=0x7f475c00b390 comp rx=0 tx=0).stop 2024-08-19T00:19:55.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.736+0000 7f4773add740 1 -- 172.21.15.44:0/3138175054 shutdown_connections 2024-08-19T00:19:55.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.736+0000 7f4773add740 1 --2- 172.21.15.44:0/3138175054 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x562495b2b210 0x562495b2d600 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:55.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.736+0000 7f4773add740 1 --2- 172.21.15.44:0/3138175054 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562495b0c190 0x562495b184c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:55.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.736+0000 7f4773add740 1 --2- 172.21.15.44:0/3138175054 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562495b1af80 0x562495b18a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:55.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.736+0000 7f47527fc640 0 client.16350 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:19:55.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.736+0000 7f4773add740 1 --2- 172.21.15.44:0/3138175054 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562495b0b870 0x562495b17f80 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:55.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.736+0000 7f4773add740 1 -- 172.21.15.44:0/3138175054 >> 172.21.15.44:0/3138175054 conn(0x562495b07f20 msgr2=0x562495b0dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:19:55.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.736+0000 7f4773add740 1 -- 172.21.15.44:0/3138175054 shutdown_connections 2024-08-19T00:19:55.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.736+0000 7f4773add740 1 -- 172.21.15.44:0/3138175054 wait complete. 2024-08-19T00:19:55.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.736+0000 7f4773add740 20 client.16350 trim_cache size 0 max 16384 2024-08-19T00:19:55.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.753+0000 7f4773add740 1 Processor -- start 2024-08-19T00:19:55.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.754+0000 7f4773add740 1 -- start start 2024-08-19T00:19:55.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.754+0000 7f4773add740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562495b0b870 0x562495b32eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:55.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.754+0000 7f4773add740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562495b0c190 0x562495b333f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:55.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.754+0000 7f4773add740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562495b1af80 0x562495b15220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:55.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.754+0000 7f4773add740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f476c1acc40 con 0x562495b0b870 2024-08-19T00:19:55.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.754+0000 7f4773add740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f476c1ae780 con 0x562495b1af80 2024-08-19T00:19:55.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.754+0000 7f4773add740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f476c1ad310 con 0x562495b0c190 2024-08-19T00:19:55.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.754+0000 7f476affd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562495b0b870 0x562495b32eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:55.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.754+0000 7f476affd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562495b0b870 0x562495b32eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45902/0 (socket says 172.21.15.44:45902) 2024-08-19T00:19:55.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.754+0000 7f476affd640 1 -- 172.21.15.44:0/3254017195 learned_addr learned my addr 172.21.15.44:0/3254017195 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:19:55.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.754+0000 7f476a7fc640 1 --2- 172.21.15.44:0/3254017195 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562495b0c190 0x562495b333f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:55.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.754+0000 7f476affd640 1 -- 172.21.15.44:0/3254017195 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562495b0c190 msgr2=0x562495b333f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:55.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.754+0000 7f476affd640 1 --2- 172.21.15.44:0/3254017195 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562495b0c190 0x562495b333f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:55.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.754+0000 7f476affd640 1 -- 172.21.15.44:0/3254017195 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562495b1af80 msgr2=0x562495b15220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:55.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.754+0000 7f476affd640 1 --2- 172.21.15.44:0/3254017195 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562495b1af80 0x562495b15220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:55.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.754+0000 7f476affd640 1 -- 172.21.15.44:0/3254017195 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562495b16f50 con 0x562495b0b870 2024-08-19T00:19:55.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.754+0000 7f476affd640 1 --2- 172.21.15.44:0/3254017195 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562495b0b870 0x562495b32eb0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f475c01c7d0 tx=0x7f475c010e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35015a0983779cea server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:19:55.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.755+0000 7f4760ff9640 1 -- 172.21.15.44:0/3254017195 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f475c01c5b0 con 0x562495b0b870 2024-08-19T00:19:55.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.755+0000 7f4760ff9640 1 -- 172.21.15.44:0/3254017195 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f475c01ca40 con 0x562495b0b870 2024-08-19T00:19:55.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.755+0000 7f4760ff9640 1 -- 172.21.15.44:0/3254017195 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f475c0055e0 con 0x562495b0b870 2024-08-19T00:19:55.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.755+0000 7f4773add740 1 -- 172.21.15.44:0/3254017195 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562495b0b870 msgr2=0x562495b32eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:55.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.755+0000 7f4773add740 1 --2- 172.21.15.44:0/3254017195 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562495b0b870 0x562495b32eb0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f475c01c7d0 tx=0x7f475c010e60 comp rx=0 tx=0).stop 2024-08-19T00:19:55.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.755+0000 7f4773add740 1 -- 172.21.15.44:0/3254017195 shutdown_connections 2024-08-19T00:19:55.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.755+0000 7f4773add740 1 --2- 172.21.15.44:0/3254017195 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562495b0c190 0x562495b333f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:55.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.755+0000 7f4773add740 1 --2- 172.21.15.44:0/3254017195 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562495b1af80 0x562495b15220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:55.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.755+0000 7f4773add740 1 --2- 172.21.15.44:0/3254017195 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562495b0b870 0x562495b32eb0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:55.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.755+0000 7f4773add740 1 -- 172.21.15.44:0/3254017195 >> 172.21.15.44:0/3254017195 conn(0x562495b07f20 msgr2=0x562495b1a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:19:55.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.756+0000 7f4773add740 1 -- 172.21.15.44:0/3254017195 shutdown_connections 2024-08-19T00:19:55.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.756+0000 7f4773add740 1 -- 172.21.15.44:0/3254017195 wait complete. 2024-08-19T00:19:55.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.756+0000 7f4773add740 1 -- start start 2024-08-19T00:19:55.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.756+0000 7f4773add740 1 Processor -- start 2024-08-19T00:19:55.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.756+0000 7f4773add740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562495b0b870 0x562495b23430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:55.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.756+0000 7f4773add740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562495b0c190 0x562495b1ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:55.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.756+0000 7f4773add740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562495b1af80 0x562495b20470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:55.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.756+0000 7f4773add740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f476c1ae0b0 con 0x562495b0c190 2024-08-19T00:19:55.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.756+0000 7f4773add740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f476c1ad9e0 con 0x562495b1af80 2024-08-19T00:19:55.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.756+0000 7f4773add740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f476c1aac20 con 0x562495b0b870 2024-08-19T00:19:55.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.756+0000 7f4773add740 10 client.0 _ll_register_callbacks cb 0x7f475c010d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:19:55.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.756+0000 7f476a7fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562495b0c190 0x562495b1ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:55.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.756+0000 7f476a7fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562495b0c190 0x562495b1ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45916/0 (socket says 172.21.15.44:45916) 2024-08-19T00:19:55.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.756+0000 7f476a7fc640 1 -- 172.21.15.44:0/3698124538 learned_addr learned my addr 172.21.15.44:0/3698124538 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:19:55.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.756+0000 7f476b7fe640 1 --2- 172.21.15.44:0/3698124538 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562495b1af80 0x562495b20470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:55.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.756+0000 7f476affd640 1 --2- 172.21.15.44:0/3698124538 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562495b0b870 0x562495b23430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:55.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.757+0000 7f476a7fc640 1 -- 172.21.15.44:0/3698124538 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562495b0b870 msgr2=0x562495b23430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:55.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.757+0000 7f476a7fc640 1 --2- 172.21.15.44:0/3698124538 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562495b0b870 0x562495b23430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:55.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.757+0000 7f476a7fc640 1 -- 172.21.15.44:0/3698124538 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562495b1af80 msgr2=0x562495b20470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:55.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.757+0000 7f476a7fc640 1 --2- 172.21.15.44:0/3698124538 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562495b1af80 0x562495b20470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:55.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.757+0000 7f476a7fc640 1 -- 172.21.15.44:0/3698124538 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562495b20a30 con 0x562495b0c190 2024-08-19T00:19:55.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.757+0000 7f476a7fc640 1 --2- 172.21.15.44:0/3698124538 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562495b0c190 0x562495b1ff30 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f475409b600 tx=0x7f475409b560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e23df9b71cd92cb server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:19:55.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.757+0000 7f47527fc640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:19:55.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.757+0000 7f47527fc640 1 -- 172.21.15.44:0/3698124538 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f475401d040 con 0x562495b0c190 2024-08-19T00:19:55.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.757+0000 7f47527fc640 1 -- 172.21.15.44:0/3698124538 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7f47540ccb20 con 0x562495b0c190 2024-08-19T00:19:55.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.757+0000 7f4773add740 1 -- 172.21.15.44:0/3698124538 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f475c01ca40 con 0x562495b0c190 2024-08-19T00:19:55.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.757+0000 7f47527fc640 1 -- 172.21.15.44:0/3698124538 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f475409afd0 con 0x562495b0c190 2024-08-19T00:19:55.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.757+0000 7f4773add740 10 client.16356 fetch_fsmap learned FSMap version 33 2024-08-19T00:19:55.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.757+0000 7f4773add740 1 -- 172.21.15.44:0/3698124538 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x562495b96ca0 con 0x562495b0c190 2024-08-19T00:19:55.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.757+0000 7f47527fc640 1 -- 172.21.15.44:0/3698124538 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f475c01ca40 con 0x562495b0c190 2024-08-19T00:19:55.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.757+0000 7f47527fc640 1 -- 172.21.15.44:0/3698124538 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f4754097ce0 con 0x562495b0c190 2024-08-19T00:19:55.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.757+0000 7f4773add740 10 client.16356 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:19:55.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.757+0000 7f4773add740 10 client.16356 resolve_mds: validated gid 24473 aka daemon mds.b 2024-08-19T00:19:55.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.757+0000 7f4773add740 20 client.16356 populate_metadata read hostname 'smithi044' 2024-08-19T00:19:55.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.758+0000 7f4773add740 1 --2- 172.21.15.44:0/3698124538 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x562495b973d0 0x562495b997f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:55.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.758+0000 7f4773add740 4 client.16356 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "f61c6c1f", "release": true, "await": true}] 2024-08-19T00:19:55.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.758+0000 7f4773add740 1 -- 172.21.15.44:0/3698124538 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "quiesce db", "set_id": "f61c6c1f", "release": true, "await": true}) -- 0x562495a796e0 con 0x562495b973d0 2024-08-19T00:19:55.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.758+0000 7f476affd640 1 --2- 172.21.15.44:0/3698124538 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x562495b973d0 0x562495b997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:55.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.758+0000 7f47527fc640 10 client.16356 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:19:55.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.758+0000 7f476affd640 1 --2- 172.21.15.44:0/3698124538 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x562495b973d0 0x562495b997f0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d956b8f033ba455 server_cookie=61b79dec34e516b2 in_seq=0 out_seq=0 2024-08-19T00:19:55.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.768+0000 7f47527fc640 1 -- 172.21.15.44:0/3698124538 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x562495a796e0 con 0x562495b973d0 2024-08-19T00:19:55.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.768+0000 7f47527fc640 10 client.16356 handle_command_reply: tid=0 2024-08-19T00:19:55.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.768+0000 7f4773add740 1 client.16356 shutdown 2024-08-19T00:19:55.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.768+0000 7f4773add740 1 -- 172.21.15.44:0/3698124538 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562495b0c190 msgr2=0x562495b1ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:55.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.768+0000 7f4773add740 1 --2- 172.21.15.44:0/3698124538 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562495b0c190 0x562495b1ff30 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f475409b600 tx=0x7f475409b560 comp rx=0 tx=0).stop 2024-08-19T00:19:55.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.768+0000 7f4773add740 1 -- 172.21.15.44:0/3698124538 shutdown_connections 2024-08-19T00:19:55.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.768+0000 7f4773add740 1 --2- 172.21.15.44:0/3698124538 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x562495b973d0 0x562495b997f0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:55.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.768+0000 7f4773add740 1 --2- 172.21.15.44:0/3698124538 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562495b1af80 0x562495b20470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:55.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.768+0000 7f4773add740 1 --2- 172.21.15.44:0/3698124538 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562495b0c190 0x562495b1ff30 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:55.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.768+0000 7f4773add740 1 --2- 172.21.15.44:0/3698124538 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562495b0b870 0x562495b23430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:55.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.768+0000 7f4773add740 1 -- 172.21.15.44:0/3698124538 >> 172.21.15.44:0/3698124538 conn(0x562495b07f20 msgr2=0x562495b17f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:19:55.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.768+0000 7f47527fc640 0 client.16356 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:19:55.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.768+0000 7f4773add740 1 -- 172.21.15.44:0/3698124538 shutdown_connections 2024-08-19T00:19:55.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.768+0000 7f4773add740 1 -- 172.21.15.44:0/3698124538 wait complete. 2024-08-19T00:19:55.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.768+0000 7f4773add740 20 client.16356 trim_cache size 0 max 16384 2024-08-19T00:19:55.771 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-08-19T00:19:55.771 INFO:teuthology.orchestra.run.smithi044.stdout: "epoch": 33, 2024-08-19T00:19:55.771 INFO:teuthology.orchestra.run.smithi044.stdout: "leader": 24473, 2024-08-19T00:19:55.771 INFO:teuthology.orchestra.run.smithi044.stdout: "set_version": 24, 2024-08-19T00:19:55.771 INFO:teuthology.orchestra.run.smithi044.stdout: "sets": { 2024-08-19T00:19:55.771 INFO:teuthology.orchestra.run.smithi044.stdout: "f61c6c1f": { 2024-08-19T00:19:55.771 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 24, 2024-08-19T00:19:55.771 INFO:teuthology.orchestra.run.smithi044.stdout: "age_ref": 0.0, 2024-08-19T00:19:55.771 INFO:teuthology.orchestra.run.smithi044.stdout: "state": { 2024-08-19T00:19:55.771 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "RELEASED", 2024-08-19T00:19:55.772 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.0 2024-08-19T00:19:55.772 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:19:55.772 INFO:teuthology.orchestra.run.smithi044.stdout: "timeout": 90.0, 2024-08-19T00:19:55.772 INFO:teuthology.orchestra.run.smithi044.stdout: "expiration": 139.2, 2024-08-19T00:19:55.772 INFO:teuthology.orchestra.run.smithi044.stdout: "members": { 2024-08-19T00:19:55.772 INFO:teuthology.orchestra.run.smithi044.stdout: "file:/": { 2024-08-19T00:19:55.772 INFO:teuthology.orchestra.run.smithi044.stdout: "excluded": false, 2024-08-19T00:19:55.772 INFO:teuthology.orchestra.run.smithi044.stdout: "state": { 2024-08-19T00:19:55.772 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "RELEASED", 2024-08-19T00:19:55.772 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.0 2024-08-19T00:19:55.772 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:19:55.772 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:19:55.772 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:19:55.773 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:19:55.773 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:19:55.773 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-08-19T00:19:55.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.768+0000 7f47716df640 1 -- 172.21.15.44:0/1069564683 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f47580a2cf0 msgr2=0x7f47580a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:55.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.768+0000 7f47716df640 1 --2- 172.21.15.44:0/1069564683 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f47580a2cf0 0x7f47580a51b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x562495b0e580 tx=0x7f475c00b6f0 comp rx=0 tx=0).stop 2024-08-19T00:19:55.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.768+0000 7f47716df640 1 -- 172.21.15.44:0/1069564683 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f476c102250 msgr2=0x7f476c198670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:55.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.768+0000 7f47716df640 1 --2- 172.21.15.44:0/1069564683 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f476c102250 0x7f476c198670 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f475400c890 tx=0x7f475400cd50 comp rx=0 tx=0).stop 2024-08-19T00:19:55.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.769+0000 7f47716df640 1 -- 172.21.15.44:0/1069564683 shutdown_connections 2024-08-19T00:19:55.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.769+0000 7f47716df640 1 --2- 172.21.15.44:0/1069564683 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f47580a2cf0 0x7f47580a51b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:55.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.769+0000 7f47716df640 1 --2- 172.21.15.44:0/1069564683 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f476c1078b0 0x7f476c19ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:55.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.769+0000 7f47716df640 1 --2- 172.21.15.44:0/1069564683 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f476c102250 0x7f476c198670 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:55.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.769+0000 7f47716df640 1 --2- 172.21.15.44:0/1069564683 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f476c1018b0 0x7f476c198130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:55.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.769+0000 7f47716df640 1 -- 172.21.15.44:0/1069564683 >> 172.21.15.44:0/1069564683 conn(0x7f476c0fd5f0 msgr2=0x7f476c0fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:19:55.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.769+0000 7f47716df640 1 -- 172.21.15.44:0/1069564683 shutdown_connections 2024-08-19T00:19:55.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:19:55.769+0000 7f47716df640 1 -- 172.21.15.44:0/1069564683 wait complete. 2024-08-19T00:19:56.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:19:56 smithi171 ceph-mon[21810]: pgmap v201: 129 pgs: 129 active+clean; 284 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 1.1 MiB/s wr, 64 op/s 2024-08-19T00:19:56.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:19:56 smithi116 ceph-mon[21873]: pgmap v201: 129 pgs: 129 active+clean; 284 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 1.1 MiB/s wr, 64 op/s 2024-08-19T00:19:56.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:19:56 smithi044 ceph-mon[18489]: pgmap v201: 129 pgs: 129 active+clean; 284 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 1.1 MiB/s wr, 64 op/s 2024-08-19T00:19:56.557 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'f61c6c1f', total seconds elapsed: 22.5 2024-08-19T00:19:56.681 INFO:tasks.workunit.client.0.smithi044.stdout: 1 447069 7.54 MB/sec execute 201 sec latency 19015.678 ms 2024-08-19T00:19:56.743 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.739+0000 7ff1fbefc640 1 -- 172.21.15.44:0/3492847548 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1f4103330 msgr2=0x7ff1f410b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:56.743 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.739+0000 7ff1fbefc640 1 --2- 172.21.15.44:0/3492847548 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1f4103330 0x7ff1f410b810 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4009900 tx=0x7ff1e402a480 comp rx=0 tx=0).stop 2024-08-19T00:19:56.743 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.739+0000 7ff1fbefc640 1 -- 172.21.15.44:0/3492847548 shutdown_connections 2024-08-19T00:19:56.743 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.739+0000 7ff1fbefc640 1 --2- 172.21.15.44:0/3492847548 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1f410bde0 0x7ff1f410e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:56.743 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.739+0000 7ff1fbefc640 1 --2- 172.21.15.44:0/3492847548 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1f4103330 0x7ff1f410b810 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:56.743 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.739+0000 7ff1fbefc640 1 --2- 172.21.15.44:0/3492847548 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff1f4102a10 0x7ff1f4102df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:56.744 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.739+0000 7ff1fbefc640 1 -- 172.21.15.44:0/3492847548 >> 172.21.15.44:0/3492847548 conn(0x7ff1f40776c0 msgr2=0x7ff1f40fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:19:56.744 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.740+0000 7ff1fbefc640 1 -- 172.21.15.44:0/3492847548 shutdown_connections 2024-08-19T00:19:56.744 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.740+0000 7ff1fbefc640 1 -- 172.21.15.44:0/3492847548 wait complete. 2024-08-19T00:19:56.744 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.740+0000 7ff1fbefc640 1 Processor -- start 2024-08-19T00:19:56.744 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.740+0000 7ff1fbefc640 1 -- start start 2024-08-19T00:19:56.744 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.740+0000 7ff1fbefc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1f4102a10 0x7ff1f4100660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:56.744 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.740+0000 7ff1fbefc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff1f4103330 0x7ff1f4100ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:56.744 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.740+0000 7ff1fbefc640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1f410bde0 0x7ff1f41010e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:56.744 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.740+0000 7ff1fbefc640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f4111be0 con 0x7ff1f4102a10 2024-08-19T00:19:56.744 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.740+0000 7ff1fbefc640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f4111a60 con 0x7ff1f4103330 2024-08-19T00:19:56.744 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.740+0000 7ff1fbefc640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f4111d60 con 0x7ff1f410bde0 2024-08-19T00:19:56.744 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.741+0000 7ff1f9c98640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1f4102a10 0x7ff1f4100660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:56.744 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.741+0000 7ff1f9c98640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1f4102a10 0x7ff1f4100660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45926/0 (socket says 172.21.15.44:45926) 2024-08-19T00:19:56.745 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.741+0000 7ff1fa499640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1f410bde0 0x7ff1f41010e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:56.745 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.741+0000 7ff1f9c98640 1 -- 172.21.15.44:0/2853186641 learned_addr learned my addr 172.21.15.44:0/2853186641 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:19:56.745 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.741+0000 7ff1f9497640 1 --2- 172.21.15.44:0/2853186641 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff1f4103330 0x7ff1f4100ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:56.745 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.741+0000 7ff1f9c98640 1 -- 172.21.15.44:0/2853186641 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1f410bde0 msgr2=0x7ff1f41010e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:56.745 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.741+0000 7ff1f9c98640 1 --2- 172.21.15.44:0/2853186641 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1f410bde0 0x7ff1f41010e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:56.745 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.741+0000 7ff1f9c98640 1 -- 172.21.15.44:0/2853186641 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff1f4103330 msgr2=0x7ff1f4100ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:56.745 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.741+0000 7ff1f9c98640 1 --2- 172.21.15.44:0/2853186641 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff1f4103330 0x7ff1f4100ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:56.745 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.741+0000 7ff1f9c98640 1 -- 172.21.15.44:0/2853186641 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1f41a6570 con 0x7ff1f4102a10 2024-08-19T00:19:56.745 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.741+0000 7ff1f9c98640 1 --2- 172.21.15.44:0/2853186641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1f4102a10 0x7ff1f4100660 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7ff1f000e9f0 tx=0x7ff1f000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:19:56.745 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.741+0000 7ff1eaffd640 1 -- 172.21.15.44:0/2853186641 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f000cd80 con 0x7ff1f4102a10 2024-08-19T00:19:56.745 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.741+0000 7ff1eaffd640 1 -- 172.21.15.44:0/2853186641 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1f0010910 con 0x7ff1f4102a10 2024-08-19T00:19:56.745 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.741+0000 7ff1fbefc640 1 -- 172.21.15.44:0/2853186641 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1f41a6860 con 0x7ff1f4102a10 2024-08-19T00:19:56.745 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.741+0000 7ff1eaffd640 1 -- 172.21.15.44:0/2853186641 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f0018990 con 0x7ff1f4102a10 2024-08-19T00:19:56.746 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.741+0000 7ff1fbefc640 1 -- 172.21.15.44:0/2853186641 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1f41a6db0 con 0x7ff1f4102a10 2024-08-19T00:19:56.751 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.744+0000 7ff1eaffd640 1 -- 172.21.15.44:0/2853186641 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7ff1f0010ac0 con 0x7ff1f4102a10 2024-08-19T00:19:56.752 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.744+0000 7ff1fecb3740 1 Processor -- start 2024-08-19T00:19:56.752 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.744+0000 7ff1fecb3740 1 -- start start 2024-08-19T00:19:56.752 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.744+0000 7ff1fecb3740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556cd3b6c7d0 0x556cd3b6cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:56.752 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.744+0000 7ff1fecb3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cd3b6d0f0 0x556cd3b77450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:56.752 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.744+0000 7ff1fecb3740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556cd3b77990 0x556cd3b79d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:56.752 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.744+0000 7ff1fecb3740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556cd3ad09d0 con 0x556cd3b6d0f0 2024-08-19T00:19:56.752 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.744+0000 7ff1fecb3740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x556cd3a78820 con 0x556cd3b6c7d0 2024-08-19T00:19:56.752 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.744+0000 7ff1fecb3740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x556cd3acc990 con 0x556cd3b77990 2024-08-19T00:19:56.752 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.745+0000 7ff1f9c98640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cd3b6d0f0 0x556cd3b77450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:56.752 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.745+0000 7ff1f9c98640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cd3b6d0f0 0x556cd3b77450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45928/0 (socket says 172.21.15.44:45928) 2024-08-19T00:19:56.752 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.745+0000 7ff1f9497640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556cd3b77990 0x556cd3b79d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:56.752 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.745+0000 7ff1f9c98640 1 -- 172.21.15.44:0/1751952938 learned_addr learned my addr 172.21.15.44:0/1751952938 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:19:56.753 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.745+0000 7ff1fa499640 1 --2- 172.21.15.44:0/1751952938 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556cd3b6c7d0 0x556cd3b6cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:56.753 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.745+0000 7ff1eaffd640 1 --2- 172.21.15.44:0/2853186641 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7ff1e00a2da0 0x7ff1e00a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:56.753 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.745+0000 7ff1f9c98640 1 -- 172.21.15.44:0/1751952938 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556cd3b77990 msgr2=0x556cd3b79d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:56.753 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.745+0000 7ff1f9c98640 1 --2- 172.21.15.44:0/1751952938 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556cd3b77990 0x556cd3b79d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:56.753 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.745+0000 7ff1f9c98640 1 -- 172.21.15.44:0/1751952938 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556cd3b6c7d0 msgr2=0x556cd3b6cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:56.753 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.745+0000 7ff1f9c98640 1 --2- 172.21.15.44:0/1751952938 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556cd3b6c7d0 0x556cd3b6cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:56.753 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.745+0000 7ff1f9c98640 1 -- 172.21.15.44:0/1751952938 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556cd37e4210 con 0x556cd3b6d0f0 2024-08-19T00:19:56.753 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.745+0000 7ff1fa499640 1 --2- 172.21.15.44:0/1751952938 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556cd3b6c7d0 0x556cd3b6cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:19:56.753 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.745+0000 7ff1fa499640 1 --2- 172.21.15.44:0/2853186641 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7ff1e00a2da0 0x7ff1e00a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:56.753 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.745+0000 7ff1eaffd640 1 -- 172.21.15.44:0/2853186641 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7ff1f00cfbb0 con 0x7ff1f4102a10 2024-08-19T00:19:56.753 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.745+0000 7ff1f9c98640 1 --2- 172.21.15.44:0/1751952938 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cd3b6d0f0 0x556cd3b77450 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7ff1f00cced0 tx=0x7ff1f0024000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d69750e5762911a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:19:56.753 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.746+0000 7ff1dffff640 1 -- 172.21.15.44:0/1751952938 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f009b870 con 0x556cd3b6d0f0 2024-08-19T00:19:56.753 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.746+0000 7ff1fa499640 1 --2- 172.21.15.44:0/2853186641 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7ff1e00a2da0 0x7ff1e00a5260 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec009fd0 tx=0x7ff1ec004a40 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:19:56.754 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.746+0000 7ff1dffff640 1 -- 172.21.15.44:0/1751952938 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1f009c430 con 0x556cd3b6d0f0 2024-08-19T00:19:56.754 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.746+0000 7ff1dffff640 1 -- 172.21.15.44:0/1751952938 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f009b690 con 0x556cd3b6d0f0 2024-08-19T00:19:56.754 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.746+0000 7ff1fecb3740 1 -- 172.21.15.44:0/1751952938 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cd3b6d0f0 msgr2=0x556cd3b77450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:56.754 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.746+0000 7ff1fecb3740 1 --2- 172.21.15.44:0/1751952938 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cd3b6d0f0 0x556cd3b77450 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7ff1f00cced0 tx=0x7ff1f0024000 comp rx=0 tx=0).stop 2024-08-19T00:19:56.754 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.746+0000 7ff1fecb3740 1 -- 172.21.15.44:0/1751952938 shutdown_connections 2024-08-19T00:19:56.754 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.746+0000 7ff1fecb3740 1 --2- 172.21.15.44:0/1751952938 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556cd3b77990 0x556cd3b79d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:56.754 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.746+0000 7ff1fecb3740 1 --2- 172.21.15.44:0/1751952938 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cd3b6d0f0 0x556cd3b77450 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:56.754 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.746+0000 7ff1fecb3740 1 --2- 172.21.15.44:0/1751952938 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556cd3b6c7d0 0x556cd3b6cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:56.754 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.746+0000 7ff1fecb3740 1 -- 172.21.15.44:0/1751952938 >> 172.21.15.44:0/1751952938 conn(0x556cd3b68d40 msgr2=0x556cd3b69120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:19:56.754 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.746+0000 7ff1fecb3740 1 -- 172.21.15.44:0/1751952938 shutdown_connections 2024-08-19T00:19:56.754 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.746+0000 7ff1fecb3740 1 -- 172.21.15.44:0/1751952938 wait complete. 2024-08-19T00:19:56.754 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.747+0000 7ff1fecb3740 1 -- start start 2024-08-19T00:19:56.754 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.747+0000 7ff1fecb3740 1 Processor -- start 2024-08-19T00:19:56.755 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.747+0000 7ff1fecb3740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556cd3b6c7d0 0x556cd3b74870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:56.755 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.747+0000 7ff1fecb3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cd3b6d0f0 0x556cd3b74db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:56.755 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.747+0000 7ff1fecb3740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556cd3b77990 0x556cd3b752f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:56.755 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.747+0000 7ff1fecb3740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556cd3b7a560 con 0x556cd3b6d0f0 2024-08-19T00:19:56.755 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.747+0000 7ff1fecb3740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x556cd3a8c520 con 0x556cd3b77990 2024-08-19T00:19:56.756 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.747+0000 7ff1fecb3740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x556cd3b7a6e0 con 0x556cd3b6c7d0 2024-08-19T00:19:56.756 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.747+0000 7ff1fecb3740 10 client.0 _ll_register_callbacks cb 0x556cd37e3a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:19:56.756 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.747+0000 7ff1f9497640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cd3b6d0f0 0x556cd3b74db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:56.756 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.747+0000 7ff1f9497640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cd3b6d0f0 0x556cd3b74db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45932/0 (socket says 172.21.15.44:45932) 2024-08-19T00:19:56.756 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.747+0000 7ff1f9497640 1 -- 172.21.15.44:0/1412593189 learned_addr learned my addr 172.21.15.44:0/1412593189 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:19:56.756 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.747+0000 7ff1fa499640 1 --2- 172.21.15.44:0/1412593189 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556cd3b77990 0x556cd3b752f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:56.756 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.747+0000 7ff1f9c98640 1 --2- 172.21.15.44:0/1412593189 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556cd3b6c7d0 0x556cd3b74870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:56.756 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.748+0000 7ff1f9497640 1 -- 172.21.15.44:0/1412593189 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556cd3b6c7d0 msgr2=0x556cd3b74870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:56.756 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.748+0000 7ff1f9497640 1 --2- 172.21.15.44:0/1412593189 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556cd3b6c7d0 0x556cd3b74870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:56.756 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.748+0000 7ff1f9497640 1 -- 172.21.15.44:0/1412593189 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556cd3b77990 msgr2=0x556cd3b752f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:56.756 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.748+0000 7ff1f9497640 1 --2- 172.21.15.44:0/1412593189 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556cd3b77990 0x556cd3b752f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:56.757 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.748+0000 7ff1f9497640 1 -- 172.21.15.44:0/1412593189 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556cd38b0620 con 0x556cd3b6d0f0 2024-08-19T00:19:56.757 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.748+0000 7ff1fa499640 1 --2- 172.21.15.44:0/1412593189 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556cd3b77990 0x556cd3b752f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:19:56.757 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.748+0000 7ff1f9497640 1 --2- 172.21.15.44:0/1412593189 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cd3b6d0f0 0x556cd3b74db0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4009900 tx=0x7ff1e40317c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12da5d8530fa6c6f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:19:56.757 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.748+0000 7ff1dd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:19:56.757 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.748+0000 7ff1dd7fa640 1 -- 172.21.15.44:0/1412593189 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e4035040 con 0x556cd3b6d0f0 2024-08-19T00:19:56.757 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.748+0000 7ff1dd7fa640 1 -- 172.21.15.44:0/1412593189 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7ff1e4004460 con 0x556cd3b6d0f0 2024-08-19T00:19:56.757 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.748+0000 7ff1fecb3740 1 -- 172.21.15.44:0/1412593189 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1f009c430 con 0x556cd3b6d0f0 2024-08-19T00:19:56.757 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.748+0000 7ff1dd7fa640 1 -- 172.21.15.44:0/1412593189 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7ff1e404d050 con 0x556cd3b6d0f0 2024-08-19T00:19:56.757 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.748+0000 7ff1fecb3740 10 client.16368 fetch_fsmap learned FSMap version 33 2024-08-19T00:19:56.757 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.748+0000 7ff1fecb3740 1 -- 172.21.15.44:0/1412593189 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x556cd3b8e9c0 con 0x556cd3b6d0f0 2024-08-19T00:19:56.757 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.748+0000 7ff1dd7fa640 1 -- 172.21.15.44:0/1412593189 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1f009c430 con 0x556cd3b6d0f0 2024-08-19T00:19:56.757 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.749+0000 7ff1dd7fa640 1 -- 172.21.15.44:0/1412593189 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7ff1e4004b00 con 0x556cd3b6d0f0 2024-08-19T00:19:56.757 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.749+0000 7ff1fecb3740 10 client.16368 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:19:56.757 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.749+0000 7ff1fecb3740 10 client.16368 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:19:56.758 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.749+0000 7ff1fecb3740 20 client.16368 populate_metadata read hostname 'smithi044' 2024-08-19T00:19:56.758 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.749+0000 7ff1fecb3740 1 --2- 172.21.15.44:0/1412593189 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x556cd3b8fed0 0x556cd3b922c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:56.758 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.749+0000 7ff1fecb3740 4 client.16368 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:19:56.758 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.749+0000 7ff1fecb3740 1 -- 172.21.15.44:0/1412593189 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556cd3ade100 con 0x556cd3b8fed0 2024-08-19T00:19:56.758 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.749+0000 7ff1f9c98640 1 --2- 172.21.15.44:0/1412593189 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x556cd3b8fed0 0x556cd3b922c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:56.758 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.749+0000 7ff1dd7fa640 10 client.16368 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:19:56.758 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.749+0000 7ff1f9c98640 1 --2- 172.21.15.44:0/1412593189 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x556cd3b8fed0 0x556cd3b922c0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad5c032c323b2dbb server_cookie=52148c133d9fd2ee in_seq=0 out_seq=0 2024-08-19T00:19:56.758 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.750+0000 7ff1dd7fa640 1 -- 172.21.15.44:0/1412593189 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556cd3ade100 con 0x556cd3b8fed0 2024-08-19T00:19:56.758 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.750+0000 7ff1dd7fa640 10 client.16368 handle_command_reply: tid=0 2024-08-19T00:19:56.758 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.750+0000 7ff1fecb3740 1 client.16368 shutdown 2024-08-19T00:19:56.758 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.750+0000 7ff1fecb3740 1 -- 172.21.15.44:0/1412593189 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cd3b6d0f0 msgr2=0x556cd3b74db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:56.758 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.750+0000 7ff1fecb3740 1 --2- 172.21.15.44:0/1412593189 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cd3b6d0f0 0x556cd3b74db0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4009900 tx=0x7ff1e40317c0 comp rx=0 tx=0).stop 2024-08-19T00:19:56.759 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.750+0000 7ff1fecb3740 1 -- 172.21.15.44:0/1412593189 shutdown_connections 2024-08-19T00:19:56.759 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.750+0000 7ff1fecb3740 1 --2- 172.21.15.44:0/1412593189 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x556cd3b8fed0 0x556cd3b922c0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:56.759 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.750+0000 7ff1fecb3740 1 --2- 172.21.15.44:0/1412593189 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556cd3b77990 0x556cd3b752f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:56.759 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.750+0000 7ff1fecb3740 1 --2- 172.21.15.44:0/1412593189 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cd3b6d0f0 0x556cd3b74db0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:56.759 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.750+0000 7ff1dd7fa640 0 client.16368 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:19:56.759 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.750+0000 7ff1fecb3740 1 --2- 172.21.15.44:0/1412593189 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556cd3b6c7d0 0x556cd3b74870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:56.759 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.750+0000 7ff1fecb3740 1 -- 172.21.15.44:0/1412593189 >> 172.21.15.44:0/1412593189 conn(0x556cd3b68d40 msgr2=0x556cd3b6eaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:19:56.759 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.750+0000 7ff1fecb3740 1 -- 172.21.15.44:0/1412593189 shutdown_connections 2024-08-19T00:19:56.759 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.750+0000 7ff1fecb3740 1 -- 172.21.15.44:0/1412593189 wait complete. 2024-08-19T00:19:56.759 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.750+0000 7ff1fecb3740 20 client.16368 trim_cache size 0 max 16384 2024-08-19T00:19:56.767 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.765+0000 7ff1fecb3740 1 Processor -- start 2024-08-19T00:19:56.767 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.765+0000 7ff1fecb3740 1 -- start start 2024-08-19T00:19:56.767 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.765+0000 7ff1fecb3740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556cd3b6c7d0 0x556cd3b6f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:56.768 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.765+0000 7ff1fecb3740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556cd3b6d0f0 0x556cd3b766d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:56.768 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.765+0000 7ff1fecb3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cd3b77990 0x556cd3b97bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:56.768 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.765+0000 7ff1fecb3740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f41acb00 con 0x556cd3b77990 2024-08-19T00:19:56.768 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.765+0000 7ff1fecb3740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f41ae640 con 0x556cd3b6d0f0 2024-08-19T00:19:56.768 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.765+0000 7ff1fecb3740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f41ad1d0 con 0x556cd3b6c7d0 2024-08-19T00:19:56.768 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.765+0000 7ff1fa499640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cd3b77990 0x556cd3b97bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:56.768 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.765+0000 7ff1fa499640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cd3b77990 0x556cd3b97bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45938/0 (socket says 172.21.15.44:45938) 2024-08-19T00:19:56.768 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.765+0000 7ff1fa499640 1 -- 172.21.15.44:0/319548246 learned_addr learned my addr 172.21.15.44:0/319548246 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:19:56.768 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.765+0000 7ff1f9c98640 1 --2- 172.21.15.44:0/319548246 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556cd3b6c7d0 0x556cd3b6f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:56.768 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.765+0000 7ff1f9497640 1 --2- 172.21.15.44:0/319548246 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556cd3b6d0f0 0x556cd3b766d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:56.768 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.765+0000 7ff1fa499640 1 -- 172.21.15.44:0/319548246 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556cd3b6c7d0 msgr2=0x556cd3b6f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:56.768 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.765+0000 7ff1fa499640 1 --2- 172.21.15.44:0/319548246 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556cd3b6c7d0 0x556cd3b6f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:56.768 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.765+0000 7ff1fa499640 1 -- 172.21.15.44:0/319548246 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556cd3b6d0f0 msgr2=0x556cd3b766d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:56.768 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.765+0000 7ff1fa499640 1 --2- 172.21.15.44:0/319548246 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556cd3b6d0f0 0x556cd3b766d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:56.769 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.765+0000 7ff1fa499640 1 -- 172.21.15.44:0/319548246 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556cd3b72da0 con 0x556cd3b77990 2024-08-19T00:19:56.769 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.766+0000 7ff1fa499640 1 --2- 172.21.15.44:0/319548246 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cd3b77990 0x556cd3b97bb0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec00fd40 tx=0x7ff1ec013030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=599d785c7c1d82c2 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:19:56.769 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.766+0000 7ff1df7fe640 1 -- 172.21.15.44:0/319548246 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1ec01d930 con 0x556cd3b77990 2024-08-19T00:19:56.769 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.766+0000 7ff1df7fe640 1 -- 172.21.15.44:0/319548246 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1ec02c070 con 0x556cd3b77990 2024-08-19T00:19:56.769 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.766+0000 7ff1df7fe640 1 -- 172.21.15.44:0/319548246 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1ec01bdf0 con 0x556cd3b77990 2024-08-19T00:19:56.772 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.766+0000 7ff1fecb3740 1 -- 172.21.15.44:0/319548246 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cd3b77990 msgr2=0x556cd3b97bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:56.772 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.766+0000 7ff1fecb3740 1 --2- 172.21.15.44:0/319548246 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cd3b77990 0x556cd3b97bb0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec00fd40 tx=0x7ff1ec013030 comp rx=0 tx=0).stop 2024-08-19T00:19:56.772 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.767+0000 7ff1fecb3740 1 -- 172.21.15.44:0/319548246 shutdown_connections 2024-08-19T00:19:56.773 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.767+0000 7ff1fecb3740 1 --2- 172.21.15.44:0/319548246 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cd3b77990 0x556cd3b97bb0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:56.773 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.767+0000 7ff1fecb3740 1 --2- 172.21.15.44:0/319548246 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556cd3b6d0f0 0x556cd3b766d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:56.773 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.767+0000 7ff1fecb3740 1 --2- 172.21.15.44:0/319548246 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556cd3b6c7d0 0x556cd3b6f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:56.773 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.767+0000 7ff1fecb3740 1 -- 172.21.15.44:0/319548246 >> 172.21.15.44:0/319548246 conn(0x556cd3b68d40 msgr2=0x556cd3b75fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:19:56.773 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.767+0000 7ff1fecb3740 1 -- 172.21.15.44:0/319548246 shutdown_connections 2024-08-19T00:19:56.773 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.767+0000 7ff1fecb3740 1 -- 172.21.15.44:0/319548246 wait complete. 2024-08-19T00:19:56.773 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.767+0000 7ff1fecb3740 1 -- start start 2024-08-19T00:19:56.773 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.767+0000 7ff1fecb3740 1 Processor -- start 2024-08-19T00:19:56.773 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.767+0000 7ff1fecb3740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556cd3b6c7d0 0x556cd3b84000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:56.773 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.767+0000 7ff1fecb3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cd3b6d0f0 0x556cd3b84540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:56.773 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.767+0000 7ff1fecb3740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556cd3b77990 0x556cd3b84a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:56.773 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.767+0000 7ff1fecb3740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f41adf70 con 0x556cd3b6d0f0 2024-08-19T00:19:56.773 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.767+0000 7ff1fecb3740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f41ad8a0 con 0x556cd3b6c7d0 2024-08-19T00:19:56.774 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.767+0000 7ff1fecb3740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f41aab00 con 0x556cd3b77990 2024-08-19T00:19:56.774 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.767+0000 7ff1fecb3740 10 client.0 _ll_register_callbacks cb 0x7ff1ec0093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:19:56.774 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.767+0000 7ff1f9497640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cd3b6d0f0 0x556cd3b84540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:56.774 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.767+0000 7ff1f9497640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cd3b6d0f0 0x556cd3b84540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45950/0 (socket says 172.21.15.44:45950) 2024-08-19T00:19:56.774 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.767+0000 7ff1f9497640 1 -- 172.21.15.44:0/2333134647 learned_addr learned my addr 172.21.15.44:0/2333134647 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:19:56.774 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.767+0000 7ff1f9c98640 1 --2- 172.21.15.44:0/2333134647 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556cd3b6c7d0 0x556cd3b84000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:56.774 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.767+0000 7ff1fa499640 1 --2- 172.21.15.44:0/2333134647 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556cd3b77990 0x556cd3b84a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:56.774 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.768+0000 7ff1f9497640 1 -- 172.21.15.44:0/2333134647 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556cd3b77990 msgr2=0x556cd3b84a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:56.774 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.768+0000 7ff1f9497640 1 --2- 172.21.15.44:0/2333134647 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556cd3b77990 0x556cd3b84a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:56.774 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.768+0000 7ff1f9497640 1 -- 172.21.15.44:0/2333134647 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556cd3b6c7d0 msgr2=0x556cd3b84000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:19:56.774 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.768+0000 7ff1f9497640 1 --2- 172.21.15.44:0/2333134647 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556cd3b6c7d0 0x556cd3b84000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:56.774 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.768+0000 7ff1f9497640 1 -- 172.21.15.44:0/2333134647 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556cd3bf9c30 con 0x556cd3b6d0f0 2024-08-19T00:19:56.775 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.768+0000 7ff1f9497640 1 --2- 172.21.15.44:0/2333134647 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cd3b6d0f0 0x556cd3b84540 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4033000 tx=0x7ff1e402a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1d904c2762eb1ef server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:19:56.775 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.768+0000 7ff1dd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:19:56.775 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.768+0000 7ff1dd7fa640 1 -- 172.21.15.44:0/2333134647 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e4055030 con 0x556cd3b6d0f0 2024-08-19T00:19:56.775 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.768+0000 7ff1dd7fa640 1 -- 172.21.15.44:0/2333134647 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9445+0+0 (secure 0 0 0) 0x7ff1e404a070 con 0x556cd3b6d0f0 2024-08-19T00:19:56.775 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.768+0000 7ff1fecb3740 1 -- 172.21.15.44:0/2333134647 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1ec02c070 con 0x556cd3b6d0f0 2024-08-19T00:19:56.775 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.768+0000 7ff1dd7fa640 1 -- 172.21.15.44:0/2333134647 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7ff1e4062050 con 0x556cd3b6d0f0 2024-08-19T00:19:56.775 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.768+0000 7ff1fecb3740 10 client.16374 fetch_fsmap learned FSMap version 33 2024-08-19T00:19:56.775 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.768+0000 7ff1fecb3740 1 -- 172.21.15.44:0/2333134647 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x556cd3bfaf50 con 0x556cd3b6d0f0 2024-08-19T00:19:56.775 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.769+0000 7ff1dd7fa640 1 -- 172.21.15.44:0/2333134647 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1ec02c070 con 0x556cd3b6d0f0 2024-08-19T00:19:56.775 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.769+0000 7ff1dd7fa640 1 -- 172.21.15.44:0/2333134647 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7ff1e40046c0 con 0x556cd3b6d0f0 2024-08-19T00:19:56.775 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.769+0000 7ff1fecb3740 10 client.16374 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:19:56.775 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.769+0000 7ff1fecb3740 10 client.16374 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:19:56.776 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.769+0000 7ff1fecb3740 20 client.16374 populate_metadata read hostname 'smithi044' 2024-08-19T00:19:56.776 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.769+0000 7ff1fecb3740 1 --2- 172.21.15.44:0/2333134647 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x556cd3bfb6a0 0x556cd3bfdac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:19:56.776 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.769+0000 7ff1fecb3740 4 client.16374 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-19T00:19:56.776 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.769+0000 7ff1fecb3740 1 -- 172.21.15.44:0/2333134647 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556cd3ad8450 con 0x556cd3bfb6a0 2024-08-19T00:19:56.776 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.769+0000 7ff1f9c98640 1 --2- 172.21.15.44:0/2333134647 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x556cd3bfb6a0 0x556cd3bfdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:19:56.776 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.769+0000 7ff1dd7fa640 10 client.16374 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:19:56.776 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.769+0000 7ff1f9c98640 1 --2- 172.21.15.44:0/2333134647 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x556cd3bfb6a0 0x556cd3bfdac0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dffdd45ea30f76b6 server_cookie=d2ece17aafde45c1 in_seq=0 out_seq=0 2024-08-19T00:19:56.777 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.773+0000 7ff1dd7fa640 1 -- 172.21.15.44:0/2333134647 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556cd3ad8450 con 0x556cd3bfb6a0 2024-08-19T00:19:56.777 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.773+0000 7ff1dd7fa640 10 client.16374 handle_command_reply: tid=0 2024-08-19T00:19:56.777 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.773+0000 7ff1fecb3740 1 client.16374 shutdown 2024-08-19T00:19:56.777 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.773+0000 7ff1fecb3740 1 -- 172.21.15.44:0/2333134647 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cd3b6d0f0 msgr2=0x556cd3b84540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:56.778 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.773+0000 7ff1fecb3740 1 --2- 172.21.15.44:0/2333134647 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cd3b6d0f0 0x556cd3b84540 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4033000 tx=0x7ff1e402a480 comp rx=0 tx=0).stop 2024-08-19T00:19:56.778 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.773+0000 7ff1fecb3740 1 -- 172.21.15.44:0/2333134647 shutdown_connections 2024-08-19T00:19:56.778 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.773+0000 7ff1fecb3740 1 --2- 172.21.15.44:0/2333134647 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x556cd3bfb6a0 0x556cd3bfdac0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:56.778 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.773+0000 7ff1fecb3740 1 --2- 172.21.15.44:0/2333134647 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556cd3b77990 0x556cd3b84a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:56.778 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.773+0000 7ff1fecb3740 1 --2- 172.21.15.44:0/2333134647 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556cd3b6d0f0 0x556cd3b84540 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:56.778 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.773+0000 7ff1fecb3740 1 --2- 172.21.15.44:0/2333134647 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556cd3b6c7d0 0x556cd3b84000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:56.778 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.773+0000 7ff1dd7fa640 0 client.16374 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:19:56.778 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.773+0000 7ff1fecb3740 1 -- 172.21.15.44:0/2333134647 >> 172.21.15.44:0/2333134647 conn(0x556cd3b68d40 msgr2=0x556cd3b67ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:19:56.778 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.773+0000 7ff1fecb3740 1 -- 172.21.15.44:0/2333134647 shutdown_connections 2024-08-19T00:19:56.779 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.773+0000 7ff1fecb3740 1 -- 172.21.15.44:0/2333134647 wait complete. 2024-08-19T00:19:56.779 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.773+0000 7ff1fecb3740 20 client.16374 trim_cache size 0 max 16384 2024-08-19T00:19:56.779 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:{ 2024-08-19T00:19:56.779 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "message": "", 2024-08-19T00:19:56.779 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "return_code": 0 2024-08-19T00:19:56.779 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:} 2024-08-19T00:19:56.780 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.774+0000 7ff1fbefc640 1 -- 172.21.15.44:0/2853186641 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7ff1e00a2da0 msgr2=0x7ff1e00a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:56.780 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.774+0000 7ff1fbefc640 1 --2- 172.21.15.44:0/2853186641 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7ff1e00a2da0 0x7ff1e00a5260 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec009fd0 tx=0x7ff1ec004a40 comp rx=0 tx=0).stop 2024-08-19T00:19:56.780 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.774+0000 7ff1fbefc640 1 -- 172.21.15.44:0/2853186641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1f4102a10 msgr2=0x7ff1f4100660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:19:56.780 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.774+0000 7ff1fbefc640 1 --2- 172.21.15.44:0/2853186641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1f4102a10 0x7ff1f4100660 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7ff1f000e9f0 tx=0x7ff1f000eeb0 comp rx=0 tx=0).stop 2024-08-19T00:19:56.780 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.774+0000 7ff1fbefc640 1 -- 172.21.15.44:0/2853186641 shutdown_connections 2024-08-19T00:19:56.781 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.774+0000 7ff1fbefc640 1 --2- 172.21.15.44:0/2853186641 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7ff1e00a2da0 0x7ff1e00a5260 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:56.781 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.774+0000 7ff1fbefc640 1 --2- 172.21.15.44:0/2853186641 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff1f410bde0 0x7ff1f41010e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:56.781 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.774+0000 7ff1fbefc640 1 --2- 172.21.15.44:0/2853186641 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff1f4103330 0x7ff1f4100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:56.781 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.774+0000 7ff1fbefc640 1 --2- 172.21.15.44:0/2853186641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1f4102a10 0x7ff1f4100660 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:19:56.781 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.774+0000 7ff1fbefc640 1 -- 172.21.15.44:0/2853186641 >> 172.21.15.44:0/2853186641 conn(0x7ff1f40776c0 msgr2=0x7ff1f40fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:19:56.781 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.774+0000 7ff1fbefc640 1 -- 172.21.15.44:0/2853186641 shutdown_connections 2024-08-19T00:19:56.781 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:19:56.774+0000 7ff1fbefc640 1 -- 172.21.15.44:0/2853186641 wait complete. 2024-08-19T00:19:57.681 INFO:tasks.workunit.client.0.smithi044.stdout: 1 448861 7.54 MB/sec execute 202 sec latency 26.162 ms 2024-08-19T00:19:58.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:19:58 smithi171 ceph-mon[21810]: pgmap v202: 129 pgs: 129 active+clean; 284 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 313 KiB/s wr, 30 op/s 2024-08-19T00:19:58.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:19:58 smithi116 ceph-mon[21873]: pgmap v202: 129 pgs: 129 active+clean; 284 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 313 KiB/s wr, 30 op/s 2024-08-19T00:19:58.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:19:58 smithi044 ceph-mon[18489]: pgmap v202: 129 pgs: 129 active+clean; 284 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 313 KiB/s wr, 30 op/s 2024-08-19T00:19:58.681 INFO:tasks.workunit.client.0.smithi044.stdout: 1 451171 7.57 MB/sec execute 203 sec latency 13.250 ms 2024-08-19T00:19:59.681 INFO:tasks.workunit.client.0.smithi044.stdout: 1 453701 7.60 MB/sec execute 204 sec latency 14.233 ms 2024-08-19T00:20:00.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:20:00 smithi171 ceph-mon[21810]: pgmap v203: 129 pgs: 129 active+clean; 284 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 313 KiB/s wr, 30 op/s 2024-08-19T00:20:00.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:20:00 smithi171 ceph-mon[21810]: overall HEALTH_OK 2024-08-19T00:20:00.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:20:00 smithi116 ceph-mon[21873]: pgmap v203: 129 pgs: 129 active+clean; 284 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 313 KiB/s wr, 30 op/s 2024-08-19T00:20:00.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:20:00 smithi116 ceph-mon[21873]: overall HEALTH_OK 2024-08-19T00:20:00.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:20:00 smithi044 ceph-mon[18489]: pgmap v203: 129 pgs: 129 active+clean; 284 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 313 KiB/s wr, 30 op/s 2024-08-19T00:20:00.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:20:00 smithi044 ceph-mon[18489]: overall HEALTH_OK 2024-08-19T00:20:00.681 INFO:tasks.workunit.client.0.smithi044.stdout: 1 455599 7.61 MB/sec execute 205 sec latency 21.529 ms 2024-08-19T00:20:01.682 INFO:tasks.workunit.client.0.smithi044.stdout: 1 457291 7.62 MB/sec execute 206 sec latency 60.385 ms 2024-08-19T00:20:02.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:20:02 smithi171 ceph-mon[21810]: pgmap v204: 129 pgs: 129 active+clean; 291 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1006 KiB/s rd, 962 KiB/s wr, 94 op/s 2024-08-19T00:20:02.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:20:02 smithi116 ceph-mon[21873]: pgmap v204: 129 pgs: 129 active+clean; 291 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1006 KiB/s rd, 962 KiB/s wr, 94 op/s 2024-08-19T00:20:02.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:20:02 smithi044 ceph-mon[18489]: pgmap v204: 129 pgs: 129 active+clean; 291 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1006 KiB/s rd, 962 KiB/s wr, 94 op/s 2024-08-19T00:20:02.682 INFO:tasks.workunit.client.0.smithi044.stdout: 1 458344 7.61 MB/sec execute 207 sec latency 61.622 ms 2024-08-19T00:20:03.682 INFO:tasks.workunit.client.0.smithi044.stdout: 1 460030 7.70 MB/sec execute 208 sec latency 29.274 ms 2024-08-19T00:20:04.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:20:04 smithi171 ceph-mon[21810]: pgmap v205: 129 pgs: 129 active+clean; 291 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 943 KiB/s rd, 671 KiB/s wr, 73 op/s 2024-08-19T00:20:04.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:20:04 smithi116 ceph-mon[21873]: pgmap v205: 129 pgs: 129 active+clean; 291 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 943 KiB/s rd, 671 KiB/s wr, 73 op/s 2024-08-19T00:20:04.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:20:04 smithi044 ceph-mon[18489]: pgmap v205: 129 pgs: 129 active+clean; 291 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 943 KiB/s rd, 671 KiB/s wr, 73 op/s 2024-08-19T00:20:04.682 INFO:tasks.workunit.client.0.smithi044.stdout: 1 462585 7.73 MB/sec execute 209 sec latency 20.308 ms 2024-08-19T00:20:05.682 INFO:tasks.workunit.client.0.smithi044.stdout: 1 465088 7.75 MB/sec execute 210 sec latency 15.257 ms 2024-08-19T00:20:06.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:20:06 smithi171 ceph-mon[21810]: pgmap v206: 129 pgs: 129 active+clean; 300 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.6 MiB/s wr, 186 op/s 2024-08-19T00:20:06.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:20:06 smithi116 ceph-mon[21873]: pgmap v206: 129 pgs: 129 active+clean; 300 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.6 MiB/s wr, 186 op/s 2024-08-19T00:20:06.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:20:06 smithi044 ceph-mon[18489]: pgmap v206: 129 pgs: 129 active+clean; 300 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.6 MiB/s wr, 186 op/s 2024-08-19T00:20:06.682 INFO:tasks.workunit.client.0.smithi044.stdout: 1 467150 7.77 MB/sec execute 211 sec latency 14.766 ms 2024-08-19T00:20:07.682 INFO:tasks.workunit.client.0.smithi044.stdout: 1 469715 7.80 MB/sec execute 212 sec latency 15.858 ms 2024-08-19T00:20:08.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:20:08 smithi171 ceph-mon[21810]: pgmap v207: 129 pgs: 129 active+clean; 300 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.6 MiB/s wr, 176 op/s 2024-08-19T00:20:08.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:20:08 smithi171 ceph-mon[21810]: osdmap e96: 12 total, 12 up, 12 in 2024-08-19T00:20:08.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:20:08 smithi116 ceph-mon[21873]: pgmap v207: 129 pgs: 129 active+clean; 300 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.6 MiB/s wr, 176 op/s 2024-08-19T00:20:08.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:20:08 smithi116 ceph-mon[21873]: osdmap e96: 12 total, 12 up, 12 in 2024-08-19T00:20:08.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:20:08 smithi044 ceph-mon[18489]: pgmap v207: 129 pgs: 129 active+clean; 300 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.6 MiB/s wr, 176 op/s 2024-08-19T00:20:08.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:20:08 smithi044 ceph-mon[18489]: osdmap e96: 12 total, 12 up, 12 in 2024-08-19T00:20:08.682 INFO:tasks.workunit.client.0.smithi044.stdout: 1 471592 7.80 MB/sec execute 213 sec latency 52.027 ms 2024-08-19T00:20:09.682 INFO:tasks.workunit.client.0.smithi044.stdout: 1 473964 7.84 MB/sec execute 214 sec latency 19.067 ms 2024-08-19T00:20:09.871 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.867+0000 7f7a5690c640 1 -- 172.21.15.44:0/3661140272 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7a501066f0 msgr2=0x7f7a50106ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:20:09.871 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.867+0000 7f7a5690c640 1 --2- 172.21.15.44:0/3661140272 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7a501066f0 0x7f7a50106ad0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f7a40009930 tx=0x7f7a4002a420 comp rx=0 tx=0).stop 2024-08-19T00:20:09.871 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.867+0000 7f7a5690c640 1 -- 172.21.15.44:0/3661140272 shutdown_connections 2024-08-19T00:20:09.871 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.867+0000 7f7a5690c640 1 --2- 172.21.15.44:0/3661140272 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a501006e0 0x7f7a50100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:09.871 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.867+0000 7f7a5690c640 1 --2- 172.21.15.44:0/3661140272 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7a50101080 0x7f7a5010d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:09.871 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.867+0000 7f7a5690c640 1 --2- 172.21.15.44:0/3661140272 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7a501066f0 0x7f7a50106ad0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:09.871 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.867+0000 7f7a5690c640 1 -- 172.21.15.44:0/3661140272 >> 172.21.15.44:0/3661140272 conn(0x7f7a500776c0 msgr2=0x7f7a500fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:20:09.871 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.867+0000 7f7a5690c640 1 -- 172.21.15.44:0/3661140272 shutdown_connections 2024-08-19T00:20:09.871 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.867+0000 7f7a5690c640 1 -- 172.21.15.44:0/3661140272 wait complete. 2024-08-19T00:20:09.872 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.868+0000 7f7a5690c640 1 Processor -- start 2024-08-19T00:20:09.872 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.868+0000 7f7a5690c640 1 -- start start 2024-08-19T00:20:09.872 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.868+0000 7f7a5690c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7a501006e0 0x7f7a501022b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:09.872 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.868+0000 7f7a5690c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7a50101080 0x7f7a501027f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:09.872 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.868+0000 7f7a5690c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a501066f0 0x7f7a50102d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:09.872 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.868+0000 7f7a5690c640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7a50110b80 con 0x7f7a501006e0 2024-08-19T00:20:09.872 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.868+0000 7f7a5690c640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f7a50110a00 con 0x7f7a50101080 2024-08-19T00:20:09.872 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.868+0000 7f7a5690c640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7a50110d00 con 0x7f7a501066f0 2024-08-19T00:20:09.872 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.869+0000 7f7a4ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7a501006e0 0x7f7a501022b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:09.872 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.869+0000 7f7a4ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7a501006e0 0x7f7a501022b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50976/0 (socket says 172.21.15.44:50976) 2024-08-19T00:20:09.872 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.869+0000 7f7a4ffff640 1 -- 172.21.15.44:0/1918940031 learned_addr learned my addr 172.21.15.44:0/1918940031 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:20:09.872 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.869+0000 7f7a4f7fe640 1 --2- 172.21.15.44:0/1918940031 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7a50101080 0x7f7a501027f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:09.872 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.869+0000 7f7a54ea9640 1 --2- 172.21.15.44:0/1918940031 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a501066f0 0x7f7a50102d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:09.873 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.869+0000 7f7a4ffff640 1 -- 172.21.15.44:0/1918940031 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a501066f0 msgr2=0x7f7a50102d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:20:09.873 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.869+0000 7f7a4ffff640 1 --2- 172.21.15.44:0/1918940031 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a501066f0 0x7f7a50102d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:09.873 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.869+0000 7f7a4ffff640 1 -- 172.21.15.44:0/1918940031 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7a50101080 msgr2=0x7f7a501027f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:20:09.873 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.869+0000 7f7a4ffff640 1 --2- 172.21.15.44:0/1918940031 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7a50101080 0x7f7a501027f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:09.873 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.869+0000 7f7a4ffff640 1 -- 172.21.15.44:0/1918940031 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a501a6580 con 0x7f7a501006e0 2024-08-19T00:20:09.873 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.869+0000 7f7a4ffff640 1 --2- 172.21.15.44:0/1918940031 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7a501006e0 0x7f7a501022b0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f7a4002a940 tx=0x7f7a40003b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:20:09.873 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.869+0000 7f7a4d7fa640 1 -- 172.21.15.44:0/1918940031 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a4003f070 con 0x7f7a501006e0 2024-08-19T00:20:09.873 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.869+0000 7f7a5690c640 1 -- 172.21.15.44:0/1918940031 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a501a6810 con 0x7f7a501006e0 2024-08-19T00:20:09.873 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.869+0000 7f7a4d7fa640 1 -- 172.21.15.44:0/1918940031 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a40031c90 con 0x7f7a501006e0 2024-08-19T00:20:09.873 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.869+0000 7f7a4d7fa640 1 -- 172.21.15.44:0/1918940031 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a40035030 con 0x7f7a501006e0 2024-08-19T00:20:09.873 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.869+0000 7f7a5690c640 1 -- 172.21.15.44:0/1918940031 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a501a6d00 con 0x7f7a501006e0 2024-08-19T00:20:09.879 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.871+0000 7f7a4d7fa640 1 -- 172.21.15.44:0/1918940031 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f7a40042070 con 0x7f7a501006e0 2024-08-19T00:20:09.879 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.872+0000 7f7a596cf740 1 Processor -- start 2024-08-19T00:20:09.879 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.872+0000 7f7a596cf740 1 -- start start 2024-08-19T00:20:09.879 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.872+0000 7f7a4d7fa640 1 --2- 172.21.15.44:0/1918940031 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f7a380a2da0 0x7f7a380a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:09.879 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.872+0000 7f7a596cf740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55beba5397d0 0x55beba539bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:09.879 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.872+0000 7f7a596cf740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55beba53a0f0 0x55beba544450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:09.879 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.872+0000 7f7a596cf740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55beba544990 0x55beba546d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:09.879 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.872+0000 7f7a596cf740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55beba49d9d0 con 0x55beba5397d0 2024-08-19T00:20:09.879 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.872+0000 7f7a596cf740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55beba445820 con 0x55beba53a0f0 2024-08-19T00:20:09.879 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.872+0000 7f7a596cf740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55beba499990 con 0x55beba544990 2024-08-19T00:20:09.879 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.872+0000 7f7a54ea9640 1 --2- 172.21.15.44:0/1918940031 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f7a380a2da0 0x7f7a380a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:09.880 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.872+0000 7f7a4d7fa640 1 -- 172.21.15.44:0/1918940031 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9621+0+0 (secure 0 0 0) 0x7f7a400eff00 con 0x7f7a501006e0 2024-08-19T00:20:09.880 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.872+0000 7f7a4ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55beba5397d0 0x55beba539bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:09.880 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.872+0000 7f7a4f7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55beba53a0f0 0x55beba544450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:09.880 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.872+0000 7f7a4ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55beba5397d0 0x55beba539bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50992/0 (socket says 172.21.15.44:50992) 2024-08-19T00:20:09.880 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.872+0000 7f7a4ffff640 1 -- 172.21.15.44:0/2523229021 learned_addr learned my addr 172.21.15.44:0/2523229021 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:20:09.880 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.872+0000 7f7a54ea9640 1 --2- 172.21.15.44:0/2523229021 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55beba544990 0x55beba546d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:09.880 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.873+0000 7f7a4f7fe640 1 -- 172.21.15.44:0/2523229021 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55beba544990 msgr2=0x55beba546d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:20:09.880 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.873+0000 7f7a4f7fe640 1 --2- 172.21.15.44:0/2523229021 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55beba544990 0x55beba546d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:09.880 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.873+0000 7f7a4f7fe640 1 -- 172.21.15.44:0/2523229021 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55beba5397d0 msgr2=0x55beba539bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:20:09.880 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.873+0000 7f7a4f7fe640 1 --2- 172.21.15.44:0/2523229021 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55beba5397d0 0x55beba539bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:09.880 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.873+0000 7f7a4f7fe640 1 -- 172.21.15.44:0/2523229021 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55beba1b1210 con 0x55beba53a0f0 2024-08-19T00:20:09.880 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.873+0000 7f7a54ea9640 1 --2- 172.21.15.44:0/1918940031 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f7a380a2da0 0x7f7a380a5260 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7a48009fd0 tx=0x7f7a48009d80 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:20:09.880 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.873+0000 7f7a4f7fe640 1 --2- 172.21.15.44:0/2523229021 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55beba53a0f0 0x55beba544450 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7a44009bf0 tx=0x7f7a44011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=743f68d18cf9408b server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:20:09.881 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.873+0000 7f7a367fc640 1 -- 172.21.15.44:0/2523229021 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a44004050 con 0x55beba53a0f0 2024-08-19T00:20:09.881 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.873+0000 7f7a367fc640 1 -- 172.21.15.44:0/2523229021 <== mon.2 v2:172.21.15.116:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a440041f0 con 0x55beba53a0f0 2024-08-19T00:20:09.881 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.873+0000 7f7a367fc640 1 -- 172.21.15.44:0/2523229021 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a44019780 con 0x55beba53a0f0 2024-08-19T00:20:09.881 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.874+0000 7f7a596cf740 1 -- 172.21.15.44:0/2523229021 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55beba53a0f0 msgr2=0x55beba544450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:20:09.881 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.874+0000 7f7a596cf740 1 --2- 172.21.15.44:0/2523229021 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55beba53a0f0 0x55beba544450 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7a44009bf0 tx=0x7f7a44011810 comp rx=0 tx=0).stop 2024-08-19T00:20:09.881 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.874+0000 7f7a596cf740 1 -- 172.21.15.44:0/2523229021 shutdown_connections 2024-08-19T00:20:09.881 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.874+0000 7f7a596cf740 1 --2- 172.21.15.44:0/2523229021 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55beba544990 0x55beba546d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:09.881 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.874+0000 7f7a596cf740 1 --2- 172.21.15.44:0/2523229021 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55beba53a0f0 0x55beba544450 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:09.881 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.874+0000 7f7a596cf740 1 --2- 172.21.15.44:0/2523229021 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55beba5397d0 0x55beba539bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:09.881 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.874+0000 7f7a596cf740 1 -- 172.21.15.44:0/2523229021 >> 172.21.15.44:0/2523229021 conn(0x55beba535d40 msgr2=0x55beba536120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:20:09.881 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.874+0000 7f7a596cf740 1 -- 172.21.15.44:0/2523229021 shutdown_connections 2024-08-19T00:20:09.881 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.874+0000 7f7a596cf740 1 -- 172.21.15.44:0/2523229021 wait complete. 2024-08-19T00:20:09.881 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.874+0000 7f7a596cf740 1 -- start start 2024-08-19T00:20:09.881 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.874+0000 7f7a596cf740 1 Processor -- start 2024-08-19T00:20:09.882 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.875+0000 7f7a596cf740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55beba5397d0 0x55beba5417f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:09.882 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.875+0000 7f7a596cf740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55beba53a0f0 0x55beba541d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:09.882 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.875+0000 7f7a596cf740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55beba544990 0x55beba542270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:09.882 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.875+0000 7f7a596cf740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55beba547560 con 0x55beba53a0f0 2024-08-19T00:20:09.882 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.875+0000 7f7a596cf740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55beba459520 con 0x55beba544990 2024-08-19T00:20:09.882 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.875+0000 7f7a596cf740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55beba5476e0 con 0x55beba5397d0 2024-08-19T00:20:09.882 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.875+0000 7f7a596cf740 10 client.0 _ll_register_callbacks cb 0x55beba1b0a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:20:09.882 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.875+0000 7f7a54ea9640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55beba544990 0x55beba542270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:09.882 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.875+0000 7f7a54ea9640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55beba544990 0x55beba542270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.44:55168/0 (socket says 172.21.15.44:55168) 2024-08-19T00:20:09.882 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.875+0000 7f7a4ffff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55beba5397d0 0x55beba5417f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:09.882 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.875+0000 7f7a54ea9640 1 -- 172.21.15.44:0/204711048 learned_addr learned my addr 172.21.15.44:0/204711048 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:20:09.882 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.875+0000 7f7a4f7fe640 1 --2- 172.21.15.44:0/204711048 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55beba53a0f0 0x55beba541d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:09.882 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.875+0000 7f7a54ea9640 1 -- 172.21.15.44:0/204711048 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55beba5397d0 msgr2=0x55beba5417f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:20:09.883 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.875+0000 7f7a54ea9640 1 --2- 172.21.15.44:0/204711048 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55beba5397d0 0x55beba5417f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:09.883 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.875+0000 7f7a54ea9640 1 -- 172.21.15.44:0/204711048 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55beba53a0f0 msgr2=0x55beba541d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:20:09.883 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.875+0000 7f7a54ea9640 1 --2- 172.21.15.44:0/204711048 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55beba53a0f0 0x55beba541d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:09.883 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.875+0000 7f7a54ea9640 1 -- 172.21.15.44:0/204711048 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55beba27d620 con 0x55beba544990 2024-08-19T00:20:09.883 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.875+0000 7f7a54ea9640 1 --2- 172.21.15.44:0/204711048 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55beba544990 0x55beba542270 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7a4800fdf0 tx=0x7f7a4801d000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=883ac3ce73319c79 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:20:09.883 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.875+0000 7f7a2f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.116:3300/0 2024-08-19T00:20:09.883 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.876+0000 7f7a2f7fe640 1 -- 172.21.15.44:0/204711048 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a48013120 con 0x55beba544990 2024-08-19T00:20:09.883 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.876+0000 7f7a596cf740 1 -- 172.21.15.44:0/204711048 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a440041f0 con 0x55beba544990 2024-08-19T00:20:09.883 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.876+0000 7f7a2f7fe640 1 -- 172.21.15.44:0/204711048 <== mon.2 v2:172.21.15.116:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9621+0+0 (secure 0 0 0) 0x7f7a480132c0 con 0x55beba544990 2024-08-19T00:20:09.883 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.876+0000 7f7a2f7fe640 1 -- 172.21.15.44:0/204711048 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f7a480045b0 con 0x55beba544990 2024-08-19T00:20:09.883 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.876+0000 7f7a596cf740 10 client.25841 fetch_fsmap learned FSMap version 33 2024-08-19T00:20:09.883 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.876+0000 7f7a596cf740 1 -- 172.21.15.44:0/204711048 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55beba553160 con 0x55beba544990 2024-08-19T00:20:09.883 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.876+0000 7f7a2f7fe640 1 -- 172.21.15.44:0/204711048 <== mon.2 v2:172.21.15.116:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a440041f0 con 0x55beba544990 2024-08-19T00:20:09.884 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.876+0000 7f7a2f7fe640 1 -- 172.21.15.44:0/204711048 <== mon.2 v2:172.21.15.116:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f7a48020050 con 0x55beba544990 2024-08-19T00:20:09.884 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.876+0000 7f7a596cf740 10 client.25841 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:20:09.884 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.876+0000 7f7a596cf740 10 client.25841 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:20:09.884 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.876+0000 7f7a596cf740 20 client.25841 populate_metadata read hostname 'smithi044' 2024-08-19T00:20:09.884 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.876+0000 7f7a596cf740 1 --2- 172.21.15.44:0/204711048 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55beba5545d0 0x55beba556a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:09.884 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.876+0000 7f7a596cf740 4 client.25841 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:20:09.884 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.876+0000 7f7a596cf740 1 -- 172.21.15.44:0/204711048 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55beba4ab100 con 0x55beba5545d0 2024-08-19T00:20:09.884 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.876+0000 7f7a4ffff640 1 --2- 172.21.15.44:0/204711048 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55beba5545d0 0x55beba556a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:09.884 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.877+0000 7f7a2f7fe640 10 client.25841 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:20:09.884 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.877+0000 7f7a4ffff640 1 --2- 172.21.15.44:0/204711048 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55beba5545d0 0x55beba556a40 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c09c08fe85b82b20 server_cookie=53d1a3b0015dbd73 in_seq=0 out_seq=0 2024-08-19T00:20:09.884 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.877+0000 7f7a2f7fe640 1 -- 172.21.15.44:0/204711048 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55beba4ab100 con 0x55beba5545d0 2024-08-19T00:20:09.884 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.877+0000 7f7a2f7fe640 10 client.25841 handle_command_reply: tid=0 2024-08-19T00:20:09.884 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.877+0000 7f7a596cf740 1 client.25841 shutdown 2024-08-19T00:20:09.885 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.878+0000 7f7a596cf740 1 -- 172.21.15.44:0/204711048 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55beba544990 msgr2=0x55beba542270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:20:09.886 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.878+0000 7f7a596cf740 1 --2- 172.21.15.44:0/204711048 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55beba544990 0x55beba542270 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7a4800fdf0 tx=0x7f7a4801d000 comp rx=0 tx=0).stop 2024-08-19T00:20:09.886 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.878+0000 7f7a596cf740 1 -- 172.21.15.44:0/204711048 shutdown_connections 2024-08-19T00:20:09.886 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.878+0000 7f7a596cf740 1 --2- 172.21.15.44:0/204711048 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55beba5545d0 0x55beba556a40 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:09.886 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.878+0000 7f7a596cf740 1 --2- 172.21.15.44:0/204711048 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55beba544990 0x55beba542270 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:09.886 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.878+0000 7f7a2f7fe640 0 client.25841 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:20:09.886 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.878+0000 7f7a596cf740 1 --2- 172.21.15.44:0/204711048 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55beba53a0f0 0x55beba541d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:09.886 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.878+0000 7f7a596cf740 1 --2- 172.21.15.44:0/204711048 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55beba5397d0 0x55beba5417f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:09.886 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.878+0000 7f7a596cf740 1 -- 172.21.15.44:0/204711048 >> 172.21.15.44:0/204711048 conn(0x55beba535d40 msgr2=0x55beba53baa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:20:09.886 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.878+0000 7f7a596cf740 1 -- 172.21.15.44:0/204711048 shutdown_connections 2024-08-19T00:20:09.886 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.878+0000 7f7a596cf740 1 -- 172.21.15.44:0/204711048 wait complete. 2024-08-19T00:20:09.886 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.878+0000 7f7a596cf740 20 client.25841 trim_cache size 0 max 16384 2024-08-19T00:20:09.895 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.893+0000 7f7a596cf740 1 Processor -- start 2024-08-19T00:20:09.895 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.893+0000 7f7a596cf740 1 -- start start 2024-08-19T00:20:09.895 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.893+0000 7f7a596cf740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55beba5397d0 0x55beba53c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:09.895 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.893+0000 7f7a596cf740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55beba53a0f0 0x55beba55c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:09.895 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.893+0000 7f7a596cf740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55beba544990 0x55beba55c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:09.896 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.893+0000 7f7a596cf740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7a501b10b0 con 0x55beba5397d0 2024-08-19T00:20:09.896 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.893+0000 7f7a596cf740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f7a501b2bf0 con 0x55beba53a0f0 2024-08-19T00:20:09.896 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.893+0000 7f7a596cf740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7a501b1780 con 0x55beba544990 2024-08-19T00:20:09.896 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.893+0000 7f7a4ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55beba5397d0 0x55beba53c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:09.896 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.893+0000 7f7a4f7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55beba53a0f0 0x55beba55c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:09.896 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.893+0000 7f7a4f7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55beba53a0f0 0x55beba55c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.44:55170/0 (socket says 172.21.15.44:55170) 2024-08-19T00:20:09.896 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.893+0000 7f7a4ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55beba5397d0 0x55beba53c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51018/0 (socket says 172.21.15.44:51018) 2024-08-19T00:20:09.896 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.893+0000 7f7a4f7fe640 1 -- 172.21.15.44:0/1771394178 learned_addr learned my addr 172.21.15.44:0/1771394178 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:20:09.896 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.893+0000 7f7a54ea9640 1 --2- 172.21.15.44:0/1771394178 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55beba544990 0x55beba55c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:09.896 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.893+0000 7f7a4ffff640 1 -- 172.21.15.44:0/1771394178 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55beba544990 msgr2=0x55beba55c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:20:09.896 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.893+0000 7f7a4ffff640 1 --2- 172.21.15.44:0/1771394178 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55beba544990 0x55beba55c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:09.896 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.893+0000 7f7a4ffff640 1 -- 172.21.15.44:0/1771394178 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55beba53a0f0 msgr2=0x55beba55c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:20:09.897 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.893+0000 7f7a4ffff640 1 --2- 172.21.15.44:0/1771394178 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55beba53a0f0 0x55beba55c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:09.897 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.893+0000 7f7a4ffff640 1 -- 172.21.15.44:0/1771394178 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55beba535b70 con 0x55beba5397d0 2024-08-19T00:20:09.897 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.894+0000 7f7a4ffff640 1 --2- 172.21.15.44:0/1771394178 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55beba5397d0 0x55beba53c240 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f7a400ed200 tx=0x7f7a400dc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbd57835483b91f3 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:20:09.897 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.894+0000 7f7a35ffb640 1 -- 172.21.15.44:0/1771394178 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a40049040 con 0x55beba5397d0 2024-08-19T00:20:09.897 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.894+0000 7f7a35ffb640 1 -- 172.21.15.44:0/1771394178 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a40031e40 con 0x55beba5397d0 2024-08-19T00:20:09.897 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.894+0000 7f7a35ffb640 1 -- 172.21.15.44:0/1771394178 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a400ba320 con 0x55beba5397d0 2024-08-19T00:20:09.900 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.894+0000 7f7a596cf740 1 -- 172.21.15.44:0/1771394178 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55beba5397d0 msgr2=0x55beba53c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:20:09.900 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.894+0000 7f7a596cf740 1 --2- 172.21.15.44:0/1771394178 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55beba5397d0 0x55beba53c240 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f7a400ed200 tx=0x7f7a400dc040 comp rx=0 tx=0).stop 2024-08-19T00:20:09.901 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.894+0000 7f7a596cf740 1 -- 172.21.15.44:0/1771394178 shutdown_connections 2024-08-19T00:20:09.901 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.894+0000 7f7a596cf740 1 --2- 172.21.15.44:0/1771394178 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55beba544990 0x55beba55c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:09.901 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.894+0000 7f7a596cf740 1 --2- 172.21.15.44:0/1771394178 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55beba53a0f0 0x55beba55c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:09.901 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.894+0000 7f7a596cf740 1 --2- 172.21.15.44:0/1771394178 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55beba5397d0 0x55beba53c240 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:09.901 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.894+0000 7f7a596cf740 1 -- 172.21.15.44:0/1771394178 >> 172.21.15.44:0/1771394178 conn(0x55beba535d40 msgr2=0x55beba543760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:20:09.901 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.894+0000 7f7a596cf740 1 -- 172.21.15.44:0/1771394178 shutdown_connections 2024-08-19T00:20:09.901 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.894+0000 7f7a596cf740 1 -- 172.21.15.44:0/1771394178 wait complete. 2024-08-19T00:20:09.901 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.895+0000 7f7a596cf740 1 -- start start 2024-08-19T00:20:09.902 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.895+0000 7f7a596cf740 1 Processor -- start 2024-08-19T00:20:09.902 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.895+0000 7f7a596cf740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55beba5397d0 0x55beba53e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:09.902 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.895+0000 7f7a596cf740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55beba53a0f0 0x55beba53ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:09.902 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.895+0000 7f7a596cf740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55beba544990 0x55beba53f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:09.902 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.895+0000 7f7a596cf740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7a501b2520 con 0x55beba53a0f0 2024-08-19T00:20:09.902 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.895+0000 7f7a596cf740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f7a501b1e50 con 0x55beba544990 2024-08-19T00:20:09.902 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.895+0000 7f7a596cf740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7a501af0b0 con 0x55beba5397d0 2024-08-19T00:20:09.902 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.895+0000 7f7a596cf740 10 client.0 _ll_register_callbacks cb 0x7f7a48013630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:20:09.902 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.895+0000 7f7a4f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55beba53a0f0 0x55beba53ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:09.902 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.895+0000 7f7a4f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55beba53a0f0 0x55beba53ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51024/0 (socket says 172.21.15.44:51024) 2024-08-19T00:20:09.903 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.895+0000 7f7a4f7fe640 1 -- 172.21.15.44:0/2819342784 learned_addr learned my addr 172.21.15.44:0/2819342784 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:20:09.903 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.895+0000 7f7a4ffff640 1 --2- 172.21.15.44:0/2819342784 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55beba5397d0 0x55beba53e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:09.903 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.895+0000 7f7a54ea9640 1 --2- 172.21.15.44:0/2819342784 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55beba544990 0x55beba53f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:09.903 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.896+0000 7f7a4f7fe640 1 -- 172.21.15.44:0/2819342784 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55beba5397d0 msgr2=0x55beba53e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:20:09.903 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.896+0000 7f7a4f7fe640 1 --2- 172.21.15.44:0/2819342784 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55beba5397d0 0x55beba53e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:09.903 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.896+0000 7f7a4f7fe640 1 -- 172.21.15.44:0/2819342784 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55beba544990 msgr2=0x55beba53f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:20:09.903 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.896+0000 7f7a4f7fe640 1 --2- 172.21.15.44:0/2819342784 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55beba544990 0x55beba53f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:09.903 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.896+0000 7f7a4f7fe640 1 -- 172.21.15.44:0/2819342784 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55beba5be420 con 0x55beba53a0f0 2024-08-19T00:20:09.903 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.896+0000 7f7a4f7fe640 1 --2- 172.21.15.44:0/2819342784 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55beba53a0f0 0x55beba53ee20 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f7a44009bf0 tx=0x7f7a44003b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c1cbf9f765eb327 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:20:09.903 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.896+0000 7f7a2f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:20:09.903 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.896+0000 7f7a2f7fe640 1 -- 172.21.15.44:0/2819342784 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a44005040 con 0x55beba53a0f0 2024-08-19T00:20:09.903 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.896+0000 7f7a2f7fe640 1 -- 172.21.15.44:0/2819342784 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9621+0+0 (secure 0 0 0) 0x7f7a440051e0 con 0x55beba53a0f0 2024-08-19T00:20:09.903 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.896+0000 7f7a596cf740 1 -- 172.21.15.44:0/2819342784 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55beba4a5450 con 0x55beba53a0f0 2024-08-19T00:20:09.904 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.896+0000 7f7a2f7fe640 1 -- 172.21.15.44:0/2819342784 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f7a44036050 con 0x55beba53a0f0 2024-08-19T00:20:09.904 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.896+0000 7f7a596cf740 10 client.16392 fetch_fsmap learned FSMap version 33 2024-08-19T00:20:09.904 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.896+0000 7f7a596cf740 1 -- 172.21.15.44:0/2819342784 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55beba5bf710 con 0x55beba53a0f0 2024-08-19T00:20:09.904 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.896+0000 7f7a2f7fe640 1 -- 172.21.15.44:0/2819342784 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55beba4a5450 con 0x55beba53a0f0 2024-08-19T00:20:09.904 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.896+0000 7f7a2f7fe640 1 -- 172.21.15.44:0/2819342784 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f7a4402b020 con 0x55beba53a0f0 2024-08-19T00:20:09.904 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.897+0000 7f7a596cf740 10 client.16392 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:20:09.904 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.897+0000 7f7a596cf740 10 client.16392 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:20:09.904 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.897+0000 7f7a596cf740 20 client.16392 populate_metadata read hostname 'smithi044' 2024-08-19T00:20:09.904 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.897+0000 7f7a596cf740 1 --2- 172.21.15.44:0/2819342784 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55beba5bfc70 0x55beba5c2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:09.904 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.897+0000 7f7a596cf740 4 client.16392 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-19T00:20:09.904 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.897+0000 7f7a596cf740 1 -- 172.21.15.44:0/2819342784 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55beba422900 con 0x55beba5bfc70 2024-08-19T00:20:09.904 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.897+0000 7f7a4ffff640 1 --2- 172.21.15.44:0/2819342784 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55beba5bfc70 0x55beba5c2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:09.904 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.897+0000 7f7a4ffff640 1 --2- 172.21.15.44:0/2819342784 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55beba5bfc70 0x55beba5c2090 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e798a25e8d390a83 server_cookie=ea42db886dae1163 in_seq=0 out_seq=0 2024-08-19T00:20:09.905 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.897+0000 7f7a2f7fe640 10 client.16392 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:20:09.907 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.905+0000 7f7a2f7fe640 1 -- 172.21.15.44:0/2819342784 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55beba422900 con 0x55beba5bfc70 2024-08-19T00:20:09.907 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.905+0000 7f7a2f7fe640 10 client.16392 handle_command_reply: tid=0 2024-08-19T00:20:09.907 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.905+0000 7f7a596cf740 1 client.16392 shutdown 2024-08-19T00:20:09.907 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.905+0000 7f7a596cf740 1 -- 172.21.15.44:0/2819342784 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55beba53a0f0 msgr2=0x55beba53ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:20:09.908 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.905+0000 7f7a596cf740 1 --2- 172.21.15.44:0/2819342784 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55beba53a0f0 0x55beba53ee20 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f7a44009bf0 tx=0x7f7a44003b80 comp rx=0 tx=0).stop 2024-08-19T00:20:09.908 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.906+0000 7f7a596cf740 1 -- 172.21.15.44:0/2819342784 shutdown_connections 2024-08-19T00:20:09.908 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.906+0000 7f7a596cf740 1 --2- 172.21.15.44:0/2819342784 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55beba5bfc70 0x55beba5c2090 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:09.908 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.906+0000 7f7a596cf740 1 --2- 172.21.15.44:0/2819342784 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55beba544990 0x55beba53f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:09.908 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.906+0000 7f7a596cf740 1 --2- 172.21.15.44:0/2819342784 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55beba53a0f0 0x55beba53ee20 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:09.908 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.906+0000 7f7a2f7fe640 0 client.16392 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:20:09.908 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.906+0000 7f7a596cf740 1 --2- 172.21.15.44:0/2819342784 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55beba5397d0 0x55beba53e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:09.908 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.906+0000 7f7a596cf740 1 -- 172.21.15.44:0/2819342784 >> 172.21.15.44:0/2819342784 conn(0x55beba535d40 msgr2=0x55beba542d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:20:09.908 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.906+0000 7f7a596cf740 1 -- 172.21.15.44:0/2819342784 shutdown_connections 2024-08-19T00:20:09.908 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.906+0000 7f7a596cf740 1 -- 172.21.15.44:0/2819342784 wait complete. 2024-08-19T00:20:09.908 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.906+0000 7f7a596cf740 20 client.16392 trim_cache size 0 max 16384 2024-08-19T00:20:09.909 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:{ 2024-08-19T00:20:09.909 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "message": "", 2024-08-19T00:20:09.909 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "return_code": 0 2024-08-19T00:20:09.909 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:} 2024-08-19T00:20:09.909 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.906+0000 7f7a5690c640 1 -- 172.21.15.44:0/1918940031 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f7a380a2da0 msgr2=0x7f7a380a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:20:09.910 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.906+0000 7f7a5690c640 1 --2- 172.21.15.44:0/1918940031 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f7a380a2da0 0x7f7a380a5260 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7a48009fd0 tx=0x7f7a48009d80 comp rx=0 tx=0).stop 2024-08-19T00:20:09.910 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.906+0000 7f7a5690c640 1 -- 172.21.15.44:0/1918940031 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7a501006e0 msgr2=0x7f7a501022b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:20:09.910 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.906+0000 7f7a5690c640 1 --2- 172.21.15.44:0/1918940031 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7a501006e0 0x7f7a501022b0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f7a4002a940 tx=0x7f7a40003b20 comp rx=0 tx=0).stop 2024-08-19T00:20:09.910 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.906+0000 7f7a5690c640 1 -- 172.21.15.44:0/1918940031 shutdown_connections 2024-08-19T00:20:09.910 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.906+0000 7f7a5690c640 1 --2- 172.21.15.44:0/1918940031 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f7a380a2da0 0x7f7a380a5260 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:09.910 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.906+0000 7f7a5690c640 1 --2- 172.21.15.44:0/1918940031 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a501066f0 0x7f7a50102d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:09.910 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.906+0000 7f7a5690c640 1 --2- 172.21.15.44:0/1918940031 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7a50101080 0x7f7a501027f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:09.910 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.906+0000 7f7a5690c640 1 --2- 172.21.15.44:0/1918940031 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7a501006e0 0x7f7a501022b0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:09.910 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.906+0000 7f7a5690c640 1 -- 172.21.15.44:0/1918940031 >> 172.21.15.44:0/1918940031 conn(0x7f7a500776c0 msgr2=0x7f7a500ff2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:20:09.910 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.907+0000 7f7a5690c640 1 -- 172.21.15.44:0/1918940031 shutdown_connections 2024-08-19T00:20:09.910 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:09.907+0000 7f7a5690c640 1 -- 172.21.15.44:0/1918940031 wait complete. 2024-08-19T00:20:10.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:20:10 smithi171 ceph-mon[21810]: pgmap v209: 129 pgs: 129 active+clean; 300 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.9 MiB/s wr, 211 op/s 2024-08-19T00:20:10.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:20:10 smithi116 ceph-mon[21873]: pgmap v209: 129 pgs: 129 active+clean; 300 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.9 MiB/s wr, 211 op/s 2024-08-19T00:20:10.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:20:10 smithi044 ceph-mon[18489]: pgmap v209: 129 pgs: 129 active+clean; 300 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.9 MiB/s wr, 211 op/s 2024-08-19T00:20:10.682 INFO:tasks.workunit.client.0.smithi044.stdout: 1 476450 7.87 MB/sec execute 215 sec latency 19.101 ms 2024-08-19T00:20:11.682 INFO:tasks.workunit.client.0.smithi044.stdout: 1 478517 7.86 MB/sec execute 216 sec latency 50.763 ms 2024-08-19T00:20:12.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:20:12 smithi171 ceph-mon[21810]: pgmap v210: 129 pgs: 129 active+clean; 310 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.1 MiB/s wr, 257 op/s 2024-08-19T00:20:12.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:20:12 smithi116 ceph-mon[21873]: pgmap v210: 129 pgs: 129 active+clean; 310 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.1 MiB/s wr, 257 op/s 2024-08-19T00:20:12.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:20:12 smithi044 ceph-mon[18489]: pgmap v210: 129 pgs: 129 active+clean; 310 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.1 MiB/s wr, 257 op/s 2024-08-19T00:20:12.682 INFO:tasks.workunit.client.0.smithi044.stdout: 1 480776 7.89 MB/sec execute 217 sec latency 11.936 ms 2024-08-19T00:20:13.682 INFO:tasks.workunit.client.0.smithi044.stdout: 1 483304 7.93 MB/sec execute 218 sec latency 44.004 ms 2024-08-19T00:20:14.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:20:14 smithi171 ceph-mon[21810]: pgmap v211: 129 pgs: 129 active+clean; 310 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.1 MiB/s wr, 257 op/s 2024-08-19T00:20:14.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:20:14 smithi171 ceph-mon[21810]: osdmap e97: 12 total, 12 up, 12 in 2024-08-19T00:20:14.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:20:14 smithi116 ceph-mon[21873]: pgmap v211: 129 pgs: 129 active+clean; 310 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.1 MiB/s wr, 257 op/s 2024-08-19T00:20:14.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:20:14 smithi116 ceph-mon[21873]: osdmap e97: 12 total, 12 up, 12 in 2024-08-19T00:20:14.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:20:14 smithi044 ceph-mon[18489]: pgmap v211: 129 pgs: 129 active+clean; 310 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.1 MiB/s wr, 257 op/s 2024-08-19T00:20:14.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:20:14 smithi044 ceph-mon[18489]: osdmap e97: 12 total, 12 up, 12 in 2024-08-19T00:20:14.682 INFO:tasks.workunit.client.0.smithi044.stdout: 1 485198 7.92 MB/sec execute 219 sec latency 22.210 ms 2024-08-19T00:20:15.682 INFO:tasks.workunit.client.0.smithi044.stdout: 1 487570 7.95 MB/sec execute 220 sec latency 13.057 ms 2024-08-19T00:20:16.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:20:16 smithi116 ceph-mon[21873]: pgmap v213: 129 pgs: 129 active+clean; 319 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.8 MiB/s wr, 275 op/s 2024-08-19T00:20:16.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:20:16 smithi044 ceph-mon[18489]: pgmap v213: 129 pgs: 129 active+clean; 319 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.8 MiB/s wr, 275 op/s 2024-08-19T00:20:16.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:20:16 smithi171 ceph-mon[21810]: pgmap v213: 129 pgs: 129 active+clean; 319 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.8 MiB/s wr, 275 op/s 2024-08-19T00:20:16.682 INFO:tasks.workunit.client.0.smithi044.stdout: 1 489956 7.97 MB/sec execute 221 sec latency 45.719 ms 2024-08-19T00:20:17.682 INFO:tasks.workunit.client.0.smithi044.stdout: 1 491976 7.99 MB/sec execute 222 sec latency 13.946 ms 2024-08-19T00:20:18.367 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:20:18 smithi116 ceph-mon[21873]: pgmap v214: 129 pgs: 129 active+clean; 319 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.2 MiB/s wr, 231 op/s 2024-08-19T00:20:18.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:20:18 smithi044 ceph-mon[18489]: pgmap v214: 129 pgs: 129 active+clean; 319 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.2 MiB/s wr, 231 op/s 2024-08-19T00:20:18.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:20:18 smithi171 ceph-mon[21810]: pgmap v214: 129 pgs: 129 active+clean; 319 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.2 MiB/s wr, 231 op/s 2024-08-19T00:20:18.682 INFO:tasks.workunit.client.0.smithi044.stdout: 1 494409 8.01 MB/sec execute 223 sec latency 14.054 ms 2024-08-19T00:20:19.682 INFO:tasks.workunit.client.0.smithi044.stdout: 1 496632 8.03 MB/sec execute 224 sec latency 17.009 ms 2024-08-19T00:20:20.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:20:20 smithi116 ceph-mon[21873]: pgmap v215: 129 pgs: 129 active+clean; 319 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.0 MiB/s wr, 220 op/s 2024-08-19T00:20:20.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:20:20 smithi044 ceph-mon[18489]: pgmap v215: 129 pgs: 129 active+clean; 319 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.0 MiB/s wr, 220 op/s 2024-08-19T00:20:20.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:20:20 smithi171 ceph-mon[21810]: pgmap v215: 129 pgs: 129 active+clean; 319 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.0 MiB/s wr, 220 op/s 2024-08-19T00:20:20.683 INFO:tasks.workunit.client.0.smithi044.stdout: 1 498853 8.05 MB/sec execute 225 sec latency 13.460 ms 2024-08-19T00:20:21.683 INFO:tasks.workunit.client.0.smithi044.stdout: 1 501288 8.08 MB/sec execute 226 sec latency 17.923 ms 2024-08-19T00:20:22.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:20:22 smithi116 ceph-mon[21873]: pgmap v216: 129 pgs: 129 active+clean; 329 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.2 MiB/s wr, 197 op/s 2024-08-19T00:20:22.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:20:22 smithi044 ceph-mon[18489]: pgmap v216: 129 pgs: 129 active+clean; 329 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.2 MiB/s wr, 197 op/s 2024-08-19T00:20:22.434 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:20:22 smithi171 ceph-mon[21810]: pgmap v216: 129 pgs: 129 active+clean; 329 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.2 MiB/s wr, 197 op/s 2024-08-19T00:20:22.684 INFO:tasks.workunit.client.0.smithi044.stdout: 1 503384 8.07 MB/sec execute 227 sec latency 15.337 ms 2024-08-19T00:20:23.003 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:22.999+0000 7f9e06e20640 1 -- 172.21.15.44:0/2441000496 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9e001006e0 msgr2=0x7f9e00100b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:20:23.003 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:22.999+0000 7f9e06e20640 1 --2- 172.21.15.44:0/2441000496 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9e001006e0 0x7f9e00100b40 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f9dec009930 tx=0x7f9dec02a420 comp rx=0 tx=0).stop 2024-08-19T00:20:23.003 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:22.999+0000 7f9e06e20640 1 -- 172.21.15.44:0/2441000496 shutdown_connections 2024-08-19T00:20:23.003 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:22.999+0000 7f9e06e20640 1 --2- 172.21.15.44:0/2441000496 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9e00101080 0x7f9e0010d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:23.003 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:22.999+0000 7f9e06e20640 1 --2- 172.21.15.44:0/2441000496 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9e001006e0 0x7f9e00100b40 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:23.003 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:22.999+0000 7f9e06e20640 1 --2- 172.21.15.44:0/2441000496 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9e001066f0 0x7f9e00106ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:23.003 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:22.999+0000 7f9e06e20640 1 -- 172.21.15.44:0/2441000496 >> 172.21.15.44:0/2441000496 conn(0x7f9e000776c0 msgr2=0x7f9e000fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:20:23.004 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:22.999+0000 7f9e06e20640 1 -- 172.21.15.44:0/2441000496 shutdown_connections 2024-08-19T00:20:23.004 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:22.999+0000 7f9e06e20640 1 -- 172.21.15.44:0/2441000496 wait complete. 2024-08-19T00:20:23.004 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.000+0000 7f9e06e20640 1 Processor -- start 2024-08-19T00:20:23.004 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.000+0000 7f9e06e20640 1 -- start start 2024-08-19T00:20:23.004 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.000+0000 7f9e06e20640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9e001006e0 0x7f9e00198030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:23.004 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.000+0000 7f9e06e20640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9e00101080 0x7f9e00198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:23.004 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.000+0000 7f9e06e20640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9e001066f0 0x7f9e0019c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:23.004 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.000+0000 7f9e06e20640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9e00110b30 con 0x7f9e001006e0 2024-08-19T00:20:23.004 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.000+0000 7f9e06e20640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f9e001109b0 con 0x7f9e001066f0 2024-08-19T00:20:23.004 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.000+0000 7f9e06e20640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9e00110cb0 con 0x7f9e00101080 2024-08-19T00:20:23.004 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.000+0000 7f9e04bbc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9e001006e0 0x7f9e00198030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:23.004 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.000+0000 7f9e04bbc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9e001006e0 0x7f9e00198030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53454/0 (socket says 172.21.15.44:53454) 2024-08-19T00:20:23.005 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.000+0000 7f9e04bbc640 1 -- 172.21.15.44:0/1604396360 learned_addr learned my addr 172.21.15.44:0/1604396360 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:20:23.005 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.000+0000 7f9e053bd640 1 --2- 172.21.15.44:0/1604396360 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9e001066f0 0x7f9e0019c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:23.005 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.000+0000 7f9dfffff640 1 --2- 172.21.15.44:0/1604396360 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9e00101080 0x7f9e00198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:23.005 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.000+0000 7f9e04bbc640 1 -- 172.21.15.44:0/1604396360 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9e00101080 msgr2=0x7f9e00198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:20:23.005 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.000+0000 7f9e04bbc640 1 --2- 172.21.15.44:0/1604396360 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9e00101080 0x7f9e00198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:23.005 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.000+0000 7f9e04bbc640 1 -- 172.21.15.44:0/1604396360 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9e001066f0 msgr2=0x7f9e0019c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:20:23.005 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.000+0000 7f9e04bbc640 1 --2- 172.21.15.44:0/1604396360 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9e001066f0 0x7f9e0019c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:23.005 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.000+0000 7f9e04bbc640 1 -- 172.21.15.44:0/1604396360 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e0019d020 con 0x7f9e001006e0 2024-08-19T00:20:23.005 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.000+0000 7f9e053bd640 1 --2- 172.21.15.44:0/1604396360 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9e001066f0 0x7f9e0019c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:20:23.005 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.001+0000 7f9e04bbc640 1 --2- 172.21.15.44:0/1604396360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9e001006e0 0x7f9e00198030 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f9df400e9f0 tx=0x7f9df400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:20:23.005 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.001+0000 7f9dfdffb640 1 -- 172.21.15.44:0/1604396360 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df400cd80 con 0x7f9e001006e0 2024-08-19T00:20:23.005 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.001+0000 7f9e06e20640 1 -- 172.21.15.44:0/1604396360 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e0019d310 con 0x7f9e001006e0 2024-08-19T00:20:23.005 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.001+0000 7f9dfdffb640 1 -- 172.21.15.44:0/1604396360 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9df4010910 con 0x7f9e001006e0 2024-08-19T00:20:23.006 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.001+0000 7f9dfdffb640 1 -- 172.21.15.44:0/1604396360 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df40188f0 con 0x7f9e001006e0 2024-08-19T00:20:23.006 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.001+0000 7f9e06e20640 1 -- 172.21.15.44:0/1604396360 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e001a4ba0 con 0x7f9e001006e0 2024-08-19T00:20:23.012 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.003+0000 7f9dfdffb640 1 -- 172.21.15.44:0/1604396360 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f9df4010ac0 con 0x7f9e001006e0 2024-08-19T00:20:23.012 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.004+0000 7f9e09bd9740 1 Processor -- start 2024-08-19T00:20:23.012 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.004+0000 7f9e09bd9740 1 -- start start 2024-08-19T00:20:23.013 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.004+0000 7f9e09bd9740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5603279347d0 0x560327934bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:23.013 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.004+0000 7f9e09bd9740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5603279350f0 0x56032793f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:23.013 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.004+0000 7f9e09bd9740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56032793f990 0x560327941d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:23.013 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.004+0000 7f9e09bd9740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5603278989d0 con 0x5603279350f0 2024-08-19T00:20:23.013 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.005+0000 7f9e09bd9740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x560327840820 con 0x5603279347d0 2024-08-19T00:20:23.013 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.005+0000 7f9e09bd9740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x560327894990 con 0x56032793f990 2024-08-19T00:20:23.013 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.005+0000 7f9dfdffb640 1 --2- 172.21.15.44:0/1604396360 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f9df00a2da0 0x7f9df00a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:23.013 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.005+0000 7f9e04bbc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5603279350f0 0x56032793f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:23.013 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.005+0000 7f9e04bbc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5603279350f0 0x56032793f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53458/0 (socket says 172.21.15.44:53458) 2024-08-19T00:20:23.013 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.005+0000 7f9e04bbc640 1 -- 172.21.15.44:0/2659732598 learned_addr learned my addr 172.21.15.44:0/2659732598 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:20:23.013 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.005+0000 7f9dfffff640 1 --2- 172.21.15.44:0/2659732598 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56032793f990 0x560327941d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:23.013 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.005+0000 7f9e053bd640 1 --2- 172.21.15.44:0/1604396360 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f9df00a2da0 0x7f9df00a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:23.014 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.005+0000 7f9e053bd640 1 --2- 172.21.15.44:0/2659732598 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5603279347d0 0x560327934bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:23.014 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.005+0000 7f9dfdffb640 1 -- 172.21.15.44:0/1604396360 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9533+0+0 (secure 0 0 0) 0x7f9df40cfbe0 con 0x7f9e001006e0 2024-08-19T00:20:23.014 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.005+0000 7f9dfffff640 1 -- 172.21.15.44:0/2659732598 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5603279347d0 msgr2=0x560327934bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:20:23.014 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.005+0000 7f9dfffff640 1 --2- 172.21.15.44:0/2659732598 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5603279347d0 0x560327934bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:23.014 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.005+0000 7f9dfffff640 1 -- 172.21.15.44:0/2659732598 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5603279350f0 msgr2=0x56032793f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:20:23.014 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.005+0000 7f9dfffff640 1 --2- 172.21.15.44:0/2659732598 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5603279350f0 0x56032793f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:23.014 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.005+0000 7f9dfffff640 1 -- 172.21.15.44:0/2659732598 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603275ac210 con 0x56032793f990 2024-08-19T00:20:23.014 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.005+0000 7f9e04bbc640 1 --2- 172.21.15.44:0/2659732598 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5603279350f0 0x56032793f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:20:23.014 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.005+0000 7f9e053bd640 1 --2- 172.21.15.44:0/1604396360 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f9df00a2da0 0x7f9df00a5260 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9df8009fd0 tx=0x7f9df8011440 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:20:23.014 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.005+0000 7f9dfffff640 1 --2- 172.21.15.44:0/2659732598 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56032793f990 0x560327941d80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9dec005940 tx=0x7f9dec005bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca66d99a2318149e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:20:23.014 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.005+0000 7f9deaffd640 1 -- 172.21.15.44:0/2659732598 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dec040070 con 0x56032793f990 2024-08-19T00:20:23.014 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.006+0000 7f9deaffd640 1 -- 172.21.15.44:0/2659732598 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9dec031870 con 0x56032793f990 2024-08-19T00:20:23.014 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.006+0000 7f9deaffd640 1 -- 172.21.15.44:0/2659732598 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dec035040 con 0x56032793f990 2024-08-19T00:20:23.015 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.006+0000 7f9e09bd9740 1 -- 172.21.15.44:0/2659732598 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56032793f990 msgr2=0x560327941d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:20:23.015 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.006+0000 7f9e09bd9740 1 --2- 172.21.15.44:0/2659732598 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56032793f990 0x560327941d80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9dec005940 tx=0x7f9dec005bd0 comp rx=0 tx=0).stop 2024-08-19T00:20:23.015 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.006+0000 7f9e09bd9740 1 -- 172.21.15.44:0/2659732598 shutdown_connections 2024-08-19T00:20:23.015 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.006+0000 7f9e09bd9740 1 --2- 172.21.15.44:0/2659732598 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56032793f990 0x560327941d80 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:23.015 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.006+0000 7f9e09bd9740 1 --2- 172.21.15.44:0/2659732598 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5603279350f0 0x56032793f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:23.015 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.006+0000 7f9e09bd9740 1 --2- 172.21.15.44:0/2659732598 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5603279347d0 0x560327934bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:23.015 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.006+0000 7f9e09bd9740 1 -- 172.21.15.44:0/2659732598 >> 172.21.15.44:0/2659732598 conn(0x560327930d40 msgr2=0x560327931120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:20:23.015 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.006+0000 7f9e09bd9740 1 -- 172.21.15.44:0/2659732598 shutdown_connections 2024-08-19T00:20:23.015 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.006+0000 7f9e09bd9740 1 -- 172.21.15.44:0/2659732598 wait complete. 2024-08-19T00:20:23.015 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.007+0000 7f9e09bd9740 1 -- start start 2024-08-19T00:20:23.015 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.007+0000 7f9e09bd9740 1 Processor -- start 2024-08-19T00:20:23.015 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.007+0000 7f9e09bd9740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5603279347d0 0x56032793c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:23.015 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.007+0000 7f9e09bd9740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5603279350f0 0x56032793cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:23.015 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.007+0000 7f9e09bd9740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56032793f990 0x56032793d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:23.016 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.007+0000 7f9e09bd9740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x560327942560 con 0x56032793f990 2024-08-19T00:20:23.016 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.007+0000 7f9e09bd9740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x560327854520 con 0x5603279347d0 2024-08-19T00:20:23.016 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.007+0000 7f9e09bd9740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5603279426e0 con 0x5603279350f0 2024-08-19T00:20:23.016 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.007+0000 7f9e09bd9740 10 client.0 _ll_register_callbacks cb 0x5603275aba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:20:23.016 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.007+0000 7f9e053bd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56032793f990 0x56032793d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:23.016 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.007+0000 7f9e04bbc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5603279347d0 0x56032793c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:23.016 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.007+0000 7f9e04bbc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5603279347d0 0x56032793c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.44:46824/0 (socket says 172.21.15.44:46824) 2024-08-19T00:20:23.016 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.007+0000 7f9e04bbc640 1 -- 172.21.15.44:0/3381723322 learned_addr learned my addr 172.21.15.44:0/3381723322 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:20:23.016 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.007+0000 7f9e053bd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56032793f990 0x56032793d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53472/0 (socket says 172.21.15.44:53472) 2024-08-19T00:20:23.016 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.007+0000 7f9dfffff640 1 --2- 172.21.15.44:0/3381723322 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5603279350f0 0x56032793cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:23.016 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.008+0000 7f9e04bbc640 1 -- 172.21.15.44:0/3381723322 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5603279350f0 msgr2=0x56032793cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:20:23.016 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.008+0000 7f9e04bbc640 1 --2- 172.21.15.44:0/3381723322 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5603279350f0 0x56032793cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:23.016 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.008+0000 7f9e04bbc640 1 -- 172.21.15.44:0/3381723322 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56032793f990 msgr2=0x56032793d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:20:23.017 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.008+0000 7f9e04bbc640 1 --2- 172.21.15.44:0/3381723322 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56032793f990 0x56032793d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:23.017 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.008+0000 7f9e04bbc640 1 -- 172.21.15.44:0/3381723322 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560327678620 con 0x5603279347d0 2024-08-19T00:20:23.017 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.008+0000 7f9e04bbc640 1 --2- 172.21.15.44:0/3381723322 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5603279347d0 0x56032793c7d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9df40097b0 tx=0x7f9df40a49e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32d8e52faffa45af server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:20:23.017 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.008+0000 7f9ddffff640 10 client.0 ms_handle_connect on v2:172.21.15.116:3300/0 2024-08-19T00:20:23.017 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.008+0000 7f9ddffff640 1 -- 172.21.15.44:0/3381723322 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df409b3c0 con 0x5603279347d0 2024-08-19T00:20:23.017 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.008+0000 7f9e09bd9740 1 -- 172.21.15.44:0/3381723322 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9dec031870 con 0x5603279347d0 2024-08-19T00:20:23.017 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.008+0000 7f9ddffff640 1 -- 172.21.15.44:0/3381723322 <== mon.2 v2:172.21.15.116:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9533+0+0 (secure 0 0 0) 0x7f9df4010430 con 0x5603279347d0 2024-08-19T00:20:23.017 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.008+0000 7f9ddffff640 1 -- 172.21.15.44:0/3381723322 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f9df4010630 con 0x5603279347d0 2024-08-19T00:20:23.017 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.008+0000 7f9e09bd9740 10 client.25859 fetch_fsmap learned FSMap version 33 2024-08-19T00:20:23.017 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.008+0000 7f9e09bd9740 1 -- 172.21.15.44:0/3381723322 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x56032794e180 con 0x5603279347d0 2024-08-19T00:20:23.017 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.008+0000 7f9ddffff640 1 -- 172.21.15.44:0/3381723322 <== mon.2 v2:172.21.15.116:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9dec031870 con 0x5603279347d0 2024-08-19T00:20:23.017 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.008+0000 7f9ddffff640 1 -- 172.21.15.44:0/3381723322 <== mon.2 v2:172.21.15.116:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f9df409ac20 con 0x5603279347d0 2024-08-19T00:20:23.017 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.008+0000 7f9e09bd9740 10 client.25859 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:20:23.017 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.008+0000 7f9e09bd9740 10 client.25859 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:20:23.018 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.008+0000 7f9e09bd9740 20 client.25859 populate_metadata read hostname 'smithi044' 2024-08-19T00:20:23.018 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.009+0000 7f9e09bd9740 1 --2- 172.21.15.44:0/3381723322 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x56032794f5f0 0x560327951a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:23.018 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.009+0000 7f9e09bd9740 4 client.25859 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:20:23.018 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.009+0000 7f9e09bd9740 1 -- 172.21.15.44:0/3381723322 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5603278a6100 con 0x56032794f5f0 2024-08-19T00:20:23.018 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.009+0000 7f9dfffff640 1 --2- 172.21.15.44:0/3381723322 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x56032794f5f0 0x560327951a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:23.018 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.009+0000 7f9dfffff640 1 --2- 172.21.15.44:0/3381723322 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x56032794f5f0 0x560327951a20 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9fb6c093af61d627 server_cookie=bbe2822c38193447 in_seq=0 out_seq=0 2024-08-19T00:20:23.018 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.009+0000 7f9ddffff640 10 client.25859 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:20:23.018 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.010+0000 7f9ddffff640 1 -- 172.21.15.44:0/3381723322 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5603278a6100 con 0x56032794f5f0 2024-08-19T00:20:23.018 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.010+0000 7f9ddffff640 10 client.25859 handle_command_reply: tid=0 2024-08-19T00:20:23.018 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.010+0000 7f9e09bd9740 1 client.25859 shutdown 2024-08-19T00:20:23.018 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.010+0000 7f9e09bd9740 1 -- 172.21.15.44:0/3381723322 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5603279347d0 msgr2=0x56032793c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:20:23.018 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.010+0000 7f9e09bd9740 1 --2- 172.21.15.44:0/3381723322 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5603279347d0 0x56032793c7d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9df40097b0 tx=0x7f9df40a49e0 comp rx=0 tx=0).stop 2024-08-19T00:20:23.018 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.010+0000 7f9e09bd9740 1 -- 172.21.15.44:0/3381723322 shutdown_connections 2024-08-19T00:20:23.019 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.010+0000 7f9e09bd9740 1 --2- 172.21.15.44:0/3381723322 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x56032794f5f0 0x560327951a20 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:23.019 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.010+0000 7f9e09bd9740 1 --2- 172.21.15.44:0/3381723322 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5603279350f0 0x56032793cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:23.019 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.010+0000 7f9e09bd9740 1 --2- 172.21.15.44:0/3381723322 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56032793f990 0x56032793d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:23.019 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.010+0000 7f9ddffff640 0 client.25859 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:20:23.019 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.010+0000 7f9e09bd9740 1 --2- 172.21.15.44:0/3381723322 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5603279347d0 0x56032793c7d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:23.019 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.010+0000 7f9e09bd9740 1 -- 172.21.15.44:0/3381723322 >> 172.21.15.44:0/3381723322 conn(0x560327930d40 msgr2=0x560327936aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:20:23.019 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.010+0000 7f9e09bd9740 1 -- 172.21.15.44:0/3381723322 shutdown_connections 2024-08-19T00:20:23.019 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.010+0000 7f9e09bd9740 1 -- 172.21.15.44:0/3381723322 wait complete. 2024-08-19T00:20:23.019 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.010+0000 7f9e09bd9740 20 client.25859 trim_cache size 0 max 16384 2024-08-19T00:20:23.032 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.026+0000 7f9e09bd9740 1 Processor -- start 2024-08-19T00:20:23.032 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.026+0000 7f9e09bd9740 1 -- start start 2024-08-19T00:20:23.032 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.026+0000 7f9e09bd9740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5603279347d0 0x56032793b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:23.032 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.026+0000 7f9e09bd9740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5603279350f0 0x560327957380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:23.032 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.026+0000 7f9e09bd9740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56032793f990 0x5603279578c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:23.032 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.026+0000 7f9e09bd9740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9e001aedc0 con 0x5603279347d0 2024-08-19T00:20:23.032 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.026+0000 7f9e09bd9740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f9e001b0900 con 0x56032793f990 2024-08-19T00:20:23.032 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.026+0000 7f9e09bd9740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9e001af490 con 0x5603279350f0 2024-08-19T00:20:23.032 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.026+0000 7f9e04bbc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5603279347d0 0x56032793b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:23.032 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.026+0000 7f9e04bbc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5603279347d0 0x56032793b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53474/0 (socket says 172.21.15.44:53474) 2024-08-19T00:20:23.032 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.026+0000 7f9e04bbc640 1 -- 172.21.15.44:0/10803656 learned_addr learned my addr 172.21.15.44:0/10803656 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:20:23.033 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.026+0000 7f9e053bd640 1 --2- 172.21.15.44:0/10803656 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56032793f990 0x5603279578c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:23.033 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.026+0000 7f9dfffff640 1 --2- 172.21.15.44:0/10803656 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5603279350f0 0x560327957380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:23.033 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.026+0000 7f9e04bbc640 1 -- 172.21.15.44:0/10803656 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5603279350f0 msgr2=0x560327957380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:20:23.033 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.026+0000 7f9e04bbc640 1 --2- 172.21.15.44:0/10803656 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5603279350f0 0x560327957380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:23.033 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.026+0000 7f9e04bbc640 1 -- 172.21.15.44:0/10803656 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56032793f990 msgr2=0x5603279578c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:20:23.033 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.026+0000 7f9e04bbc640 1 --2- 172.21.15.44:0/10803656 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56032793f990 0x5603279578c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:23.033 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.026+0000 7f9e04bbc640 1 -- 172.21.15.44:0/10803656 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560327930b70 con 0x5603279347d0 2024-08-19T00:20:23.033 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.027+0000 7f9e04bbc640 1 --2- 172.21.15.44:0/10803656 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5603279347d0 0x56032793b790 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f9df400e9c0 tx=0x7f9df409bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4529509ba2322cfd server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:20:23.033 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.027+0000 7f9dea7fc640 1 -- 172.21.15.44:0/10803656 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df4010430 con 0x5603279347d0 2024-08-19T00:20:23.033 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.027+0000 7f9dea7fc640 1 -- 172.21.15.44:0/10803656 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9df4018be0 con 0x5603279347d0 2024-08-19T00:20:23.033 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.027+0000 7f9dea7fc640 1 -- 172.21.15.44:0/10803656 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df40a1450 con 0x5603279347d0 2024-08-19T00:20:23.033 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.027+0000 7f9e09bd9740 1 -- 172.21.15.44:0/10803656 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5603279347d0 msgr2=0x56032793b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:20:23.033 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.027+0000 7f9e09bd9740 1 --2- 172.21.15.44:0/10803656 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5603279347d0 0x56032793b790 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f9df400e9c0 tx=0x7f9df409bdf0 comp rx=0 tx=0).stop 2024-08-19T00:20:23.033 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.027+0000 7f9e09bd9740 1 -- 172.21.15.44:0/10803656 shutdown_connections 2024-08-19T00:20:23.034 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.027+0000 7f9e09bd9740 1 --2- 172.21.15.44:0/10803656 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5603279350f0 0x560327957380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:23.034 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.027+0000 7f9e09bd9740 1 --2- 172.21.15.44:0/10803656 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56032793f990 0x5603279578c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:23.034 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.027+0000 7f9e09bd9740 1 --2- 172.21.15.44:0/10803656 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5603279347d0 0x56032793b790 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:23.034 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.027+0000 7f9e09bd9740 1 -- 172.21.15.44:0/10803656 >> 172.21.15.44:0/10803656 conn(0x560327930d40 msgr2=0x56032793b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:20:23.034 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.027+0000 7f9e09bd9740 1 -- 172.21.15.44:0/10803656 shutdown_connections 2024-08-19T00:20:23.034 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.027+0000 7f9e09bd9740 1 -- 172.21.15.44:0/10803656 wait complete. 2024-08-19T00:20:23.034 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.028+0000 7f9e09bd9740 1 -- start start 2024-08-19T00:20:23.034 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.028+0000 7f9e09bd9740 1 Processor -- start 2024-08-19T00:20:23.034 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.028+0000 7f9e09bd9740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5603279347d0 0x560327948170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:23.034 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.028+0000 7f9e09bd9740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5603279350f0 0x560327940850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:23.034 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.028+0000 7f9e09bd9740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56032793f990 0x560327940e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:23.034 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.028+0000 7f9e09bd9740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9e001b0230 con 0x5603279350f0 2024-08-19T00:20:23.034 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.028+0000 7f9e09bd9740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f9e001afb60 con 0x5603279347d0 2024-08-19T00:20:23.035 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.028+0000 7f9e09bd9740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9e001acdc0 con 0x56032793f990 2024-08-19T00:20:23.035 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.028+0000 7f9e09bd9740 10 client.0 _ll_register_callbacks cb 0x7f9df40cce80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:20:23.035 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.028+0000 7f9dfffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5603279350f0 0x560327940850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:23.035 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.028+0000 7f9dfffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5603279350f0 0x560327940850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53486/0 (socket says 172.21.15.44:53486) 2024-08-19T00:20:23.035 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.028+0000 7f9dfffff640 1 -- 172.21.15.44:0/3090513240 learned_addr learned my addr 172.21.15.44:0/3090513240 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:20:23.035 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.028+0000 7f9e04bbc640 1 --2- 172.21.15.44:0/3090513240 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5603279347d0 0x560327948170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:23.035 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.028+0000 7f9e053bd640 1 --2- 172.21.15.44:0/3090513240 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56032793f990 0x560327940e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:23.035 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.028+0000 7f9dfffff640 1 -- 172.21.15.44:0/3090513240 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56032793f990 msgr2=0x560327940e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:20:23.035 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.028+0000 7f9dfffff640 1 --2- 172.21.15.44:0/3090513240 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56032793f990 0x560327940e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:23.036 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.029+0000 7f9dfffff640 1 -- 172.21.15.44:0/3090513240 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5603279347d0 msgr2=0x560327948170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:20:23.036 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.029+0000 7f9dfffff640 1 --2- 172.21.15.44:0/3090513240 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5603279347d0 0x560327948170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:23.036 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.029+0000 7f9dfffff640 1 -- 172.21.15.44:0/3090513240 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560327935660 con 0x5603279350f0 2024-08-19T00:20:23.036 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.029+0000 7f9dfffff640 1 --2- 172.21.15.44:0/3090513240 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5603279350f0 0x560327940850 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f9dec005c40 tx=0x7f9dec005460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df4d010473cb0e57 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:20:23.036 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.029+0000 7f9ddffff640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:20:23.036 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.029+0000 7f9ddffff640 1 -- 172.21.15.44:0/3090513240 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dec054020 con 0x5603279350f0 2024-08-19T00:20:23.036 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.029+0000 7f9ddffff640 1 -- 172.21.15.44:0/3090513240 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9533+0+0 (secure 0 0 0) 0x7f9dec004030 con 0x5603279350f0 2024-08-19T00:20:23.037 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.029+0000 7f9e09bd9740 1 -- 172.21.15.44:0/3090513240 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9df4018be0 con 0x5603279350f0 2024-08-19T00:20:23.037 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.029+0000 7f9ddffff640 1 -- 172.21.15.44:0/3090513240 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f9dec05f050 con 0x5603279350f0 2024-08-19T00:20:23.037 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.029+0000 7f9e09bd9740 10 client.16410 fetch_fsmap learned FSMap version 33 2024-08-19T00:20:23.037 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.029+0000 7f9e09bd9740 1 -- 172.21.15.44:0/3090513240 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5603279ba350 con 0x5603279350f0 2024-08-19T00:20:23.037 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.029+0000 7f9ddffff640 1 -- 172.21.15.44:0/3090513240 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9df4018be0 con 0x5603279350f0 2024-08-19T00:20:23.037 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.029+0000 7f9ddffff640 1 -- 172.21.15.44:0/3090513240 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f9dec003c60 con 0x5603279350f0 2024-08-19T00:20:23.037 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.029+0000 7f9e09bd9740 10 client.16410 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:20:23.037 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.029+0000 7f9e09bd9740 10 client.16410 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:20:23.037 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.029+0000 7f9e09bd9740 20 client.16410 populate_metadata read hostname 'smithi044' 2024-08-19T00:20:23.037 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.029+0000 7f9e09bd9740 1 --2- 172.21.15.44:0/3090513240 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5603279ba650 0x5603279bca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:23.037 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.029+0000 7f9e09bd9740 4 client.16410 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-19T00:20:23.037 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.029+0000 7f9e09bd9740 1 -- 172.21.15.44:0/3090513240 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5603278a0450 con 0x5603279ba650 2024-08-19T00:20:23.037 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.030+0000 7f9e04bbc640 1 --2- 172.21.15.44:0/3090513240 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5603279ba650 0x5603279bca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:23.037 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.030+0000 7f9ddffff640 10 client.16410 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:20:23.038 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.030+0000 7f9e04bbc640 1 --2- 172.21.15.44:0/3090513240 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5603279ba650 0x5603279bca70 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47aa893cfb8732be server_cookie=c11bee489d055107 in_seq=0 out_seq=0 2024-08-19T00:20:23.040 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.038+0000 7f9ddffff640 1 -- 172.21.15.44:0/3090513240 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5603278a0450 con 0x5603279ba650 2024-08-19T00:20:23.040 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.038+0000 7f9ddffff640 10 client.16410 handle_command_reply: tid=0 2024-08-19T00:20:23.040 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.038+0000 7f9e09bd9740 1 client.16410 shutdown 2024-08-19T00:20:23.041 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.038+0000 7f9e09bd9740 1 -- 172.21.15.44:0/3090513240 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5603279350f0 msgr2=0x560327940850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:20:23.041 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.038+0000 7f9e09bd9740 1 --2- 172.21.15.44:0/3090513240 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5603279350f0 0x560327940850 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f9dec005c40 tx=0x7f9dec005460 comp rx=0 tx=0).stop 2024-08-19T00:20:23.041 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.038+0000 7f9e09bd9740 1 -- 172.21.15.44:0/3090513240 shutdown_connections 2024-08-19T00:20:23.041 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.038+0000 7f9e09bd9740 1 --2- 172.21.15.44:0/3090513240 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5603279ba650 0x5603279bca70 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:23.041 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.038+0000 7f9e09bd9740 1 --2- 172.21.15.44:0/3090513240 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56032793f990 0x560327940e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:23.041 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.038+0000 7f9e09bd9740 1 --2- 172.21.15.44:0/3090513240 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5603279350f0 0x560327940850 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:23.041 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.038+0000 7f9e09bd9740 1 --2- 172.21.15.44:0/3090513240 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5603279347d0 0x560327948170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:23.041 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.038+0000 7f9ddffff640 0 client.16410 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:20:23.041 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.038+0000 7f9e09bd9740 1 -- 172.21.15.44:0/3090513240 >> 172.21.15.44:0/3090513240 conn(0x560327930d40 msgr2=0x56032793b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:20:23.041 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.039+0000 7f9e09bd9740 1 -- 172.21.15.44:0/3090513240 shutdown_connections 2024-08-19T00:20:23.042 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.039+0000 7f9e09bd9740 1 -- 172.21.15.44:0/3090513240 wait complete. 2024-08-19T00:20:23.042 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.039+0000 7f9e09bd9740 20 client.16410 trim_cache size 0 max 16384 2024-08-19T00:20:23.042 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:{ 2024-08-19T00:20:23.042 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "message": "", 2024-08-19T00:20:23.042 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "return_code": 0 2024-08-19T00:20:23.042 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:} 2024-08-19T00:20:23.043 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.039+0000 7f9e06e20640 1 -- 172.21.15.44:0/1604396360 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f9df00a2da0 msgr2=0x7f9df00a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:20:23.043 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.039+0000 7f9e06e20640 1 --2- 172.21.15.44:0/1604396360 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f9df00a2da0 0x7f9df00a5260 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9df8009fd0 tx=0x7f9df8011440 comp rx=0 tx=0).stop 2024-08-19T00:20:23.043 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.039+0000 7f9e06e20640 1 -- 172.21.15.44:0/1604396360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9e001006e0 msgr2=0x7f9e00198030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:20:23.043 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.039+0000 7f9e06e20640 1 --2- 172.21.15.44:0/1604396360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9e001006e0 0x7f9e00198030 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f9df400e9f0 tx=0x7f9df400eeb0 comp rx=0 tx=0).stop 2024-08-19T00:20:23.043 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.039+0000 7f9e06e20640 1 -- 172.21.15.44:0/1604396360 shutdown_connections 2024-08-19T00:20:23.043 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.039+0000 7f9e06e20640 1 --2- 172.21.15.44:0/1604396360 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f9df00a2da0 0x7f9df00a5260 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:23.043 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.039+0000 7f9e06e20640 1 --2- 172.21.15.44:0/1604396360 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9e00101080 0x7f9e00198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:23.044 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.039+0000 7f9e06e20640 1 --2- 172.21.15.44:0/1604396360 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9e001066f0 0x7f9e0019c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:23.044 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.039+0000 7f9e06e20640 1 --2- 172.21.15.44:0/1604396360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9e001006e0 0x7f9e00198030 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:23.044 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.039+0000 7f9e06e20640 1 -- 172.21.15.44:0/1604396360 >> 172.21.15.44:0/1604396360 conn(0x7f9e000776c0 msgr2=0x7f9e00069710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:20:23.044 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.039+0000 7f9e06e20640 1 -- 172.21.15.44:0/1604396360 shutdown_connections 2024-08-19T00:20:23.044 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:23.039+0000 7f9e06e20640 1 -- 172.21.15.44:0/1604396360 wait complete. 2024-08-19T00:20:23.683 INFO:tasks.workunit.client.0.smithi044.stdout: 1 505634 8.10 MB/sec execute 228 sec latency 12.082 ms 2024-08-19T00:20:24.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:20:24 smithi116 ceph-mon[21873]: pgmap v217: 129 pgs: 129 active+clean; 329 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.2 MiB/s wr, 197 op/s 2024-08-19T00:20:24.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:20:24 smithi044 ceph-mon[18489]: pgmap v217: 129 pgs: 129 active+clean; 329 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.2 MiB/s wr, 197 op/s 2024-08-19T00:20:24.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:20:24 smithi171 ceph-mon[21810]: pgmap v217: 129 pgs: 129 active+clean; 329 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.2 MiB/s wr, 197 op/s 2024-08-19T00:20:24.683 INFO:tasks.workunit.client.0.smithi044.stdout: 1 508295 8.14 MB/sec execute 229 sec latency 16.737 ms 2024-08-19T00:20:25.683 INFO:tasks.workunit.client.0.smithi044.stdout: 1 510443 8.13 MB/sec execute 230 sec latency 15.888 ms 2024-08-19T00:20:26.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:20:26 smithi116 ceph-mon[21873]: pgmap v218: 129 pgs: 129 active+clean; 339 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.1 MiB/s wr, 276 op/s 2024-08-19T00:20:26.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:20:26 smithi044 ceph-mon[18489]: pgmap v218: 129 pgs: 129 active+clean; 339 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.1 MiB/s wr, 276 op/s 2024-08-19T00:20:26.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:20:26 smithi171 ceph-mon[21810]: pgmap v218: 129 pgs: 129 active+clean; 339 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.1 MiB/s wr, 276 op/s 2024-08-19T00:20:26.683 INFO:tasks.workunit.client.0.smithi044.stdout: 1 512648 8.16 MB/sec execute 231 sec latency 17.689 ms 2024-08-19T00:20:27.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:20:27 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:20:27.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:20:27 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:20:27.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:20:27 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:20:27.683 INFO:tasks.workunit.client.0.smithi044.stdout: 1 515236 8.19 MB/sec execute 232 sec latency 23.920 ms 2024-08-19T00:20:28.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:20:28 smithi116 ceph-mon[21873]: pgmap v219: 129 pgs: 129 active+clean; 339 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.9 MiB/s wr, 164 op/s 2024-08-19T00:20:28.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:20:28 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:20:28.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:20:28 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:20:28.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:20:28 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:20:28.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:20:28 smithi044 ceph-mon[18489]: pgmap v219: 129 pgs: 129 active+clean; 339 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.9 MiB/s wr, 164 op/s 2024-08-19T00:20:28.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:20:28 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:20:28.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:20:28 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:20:28.370 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:20:28 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:20:28.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:20:28 smithi171 ceph-mon[21810]: pgmap v219: 129 pgs: 129 active+clean; 339 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.9 MiB/s wr, 164 op/s 2024-08-19T00:20:28.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:20:28 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:20:28.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:20:28 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:20:28.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:20:28 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:20:28.683 INFO:tasks.workunit.client.0.smithi044.stdout: 1 517106 8.19 MB/sec execute 233 sec latency 14.976 ms 2024-08-19T00:20:29.683 INFO:tasks.workunit.client.0.smithi044.stdout: 1 519339 8.21 MB/sec execute 234 sec latency 35.998 ms 2024-08-19T00:20:30.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:20:30 smithi116 ceph-mon[21873]: pgmap v220: 129 pgs: 129 active+clean; 339 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.9 MiB/s wr, 164 op/s 2024-08-19T00:20:30.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:20:30 smithi044 ceph-mon[18489]: pgmap v220: 129 pgs: 129 active+clean; 339 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.9 MiB/s wr, 164 op/s 2024-08-19T00:20:30.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:20:30 smithi171 ceph-mon[21810]: pgmap v220: 129 pgs: 129 active+clean; 339 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.9 MiB/s wr, 164 op/s 2024-08-19T00:20:30.683 INFO:tasks.workunit.client.0.smithi044.stdout: 1 521867 8.23 MB/sec execute 235 sec latency 36.026 ms 2024-08-19T00:20:31.683 INFO:tasks.workunit.client.0.smithi044.stdout: 1 523882 8.24 MB/sec execute 236 sec latency 16.280 ms 2024-08-19T00:20:32.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:20:32 smithi116 ceph-mon[21873]: pgmap v221: 129 pgs: 129 active+clean; 353 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.3 MiB/s wr, 256 op/s 2024-08-19T00:20:32.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:20:32 smithi044 ceph-mon[18489]: pgmap v221: 129 pgs: 129 active+clean; 353 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.3 MiB/s wr, 256 op/s 2024-08-19T00:20:32.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:20:32 smithi171 ceph-mon[21810]: pgmap v221: 129 pgs: 129 active+clean; 353 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.3 MiB/s wr, 256 op/s 2024-08-19T00:20:32.683 INFO:tasks.workunit.client.0.smithi044.stdout: 1 526270 8.27 MB/sec execute 237 sec latency 52.745 ms 2024-08-19T00:20:33.683 INFO:tasks.workunit.client.0.smithi044.stdout: 1 528678 8.28 MB/sec execute 238 sec latency 16.686 ms 2024-08-19T00:20:34.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:20:34 smithi044 ceph-mon[18489]: pgmap v222: 129 pgs: 129 active+clean; 353 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.4 MiB/s wr, 175 op/s 2024-08-19T00:20:34.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:20:34 smithi171 ceph-mon[21810]: pgmap v222: 129 pgs: 129 active+clean; 353 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.4 MiB/s wr, 175 op/s 2024-08-19T00:20:34.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:20:34 smithi116 ceph-mon[21873]: pgmap v222: 129 pgs: 129 active+clean; 353 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.4 MiB/s wr, 175 op/s 2024-08-19T00:20:34.683 INFO:tasks.workunit.client.0.smithi044.stdout: 1 530485 8.29 MB/sec execute 239 sec latency 41.373 ms 2024-08-19T00:20:35.683 INFO:tasks.workunit.client.0.smithi044.stdout: 1 533037 8.32 MB/sec execute 240 sec latency 13.744 ms 2024-08-19T00:20:36.141 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.136+0000 7fab16ae6640 1 -- 172.21.15.44:0/3182372583 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab101066f0 msgr2=0x7fab10106ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:20:36.141 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.136+0000 7fab16ae6640 1 --2- 172.21.15.44:0/3182372583 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab101066f0 0x7fab10106ad0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fab04009860 tx=0x7fab0402a340 comp rx=0 tx=0).stop 2024-08-19T00:20:36.141 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.136+0000 7fab16ae6640 1 -- 172.21.15.44:0/3182372583 shutdown_connections 2024-08-19T00:20:36.141 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.136+0000 7fab16ae6640 1 --2- 172.21.15.44:0/3182372583 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fab101006e0 0x7fab10100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:36.141 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.136+0000 7fab16ae6640 1 --2- 172.21.15.44:0/3182372583 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fab10101080 0x7fab1010d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:36.141 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.136+0000 7fab16ae6640 1 --2- 172.21.15.44:0/3182372583 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab101066f0 0x7fab10106ad0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:36.141 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.136+0000 7fab16ae6640 1 -- 172.21.15.44:0/3182372583 >> 172.21.15.44:0/3182372583 conn(0x7fab100776c0 msgr2=0x7fab100fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:20:36.141 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.136+0000 7fab16ae6640 1 -- 172.21.15.44:0/3182372583 shutdown_connections 2024-08-19T00:20:36.142 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.136+0000 7fab16ae6640 1 -- 172.21.15.44:0/3182372583 wait complete. 2024-08-19T00:20:36.142 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.137+0000 7fab16ae6640 1 Processor -- start 2024-08-19T00:20:36.142 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.137+0000 7fab16ae6640 1 -- start start 2024-08-19T00:20:36.142 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.137+0000 7fab16ae6640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab101006e0 0x7fab1019a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:36.142 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.137+0000 7fab16ae6640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fab10101080 0x7fab1019a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:36.142 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.137+0000 7fab16ae6640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fab101066f0 0x7fab1019eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:36.142 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.137+0000 7fab16ae6640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fab10111c20 con 0x7fab10101080 2024-08-19T00:20:36.142 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.137+0000 7fab16ae6640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fab10111aa0 con 0x7fab101006e0 2024-08-19T00:20:36.142 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.137+0000 7fab16ae6640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fab10111da0 con 0x7fab101066f0 2024-08-19T00:20:36.142 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.137+0000 7fab0ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fab10101080 0x7fab1019a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:36.142 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.137+0000 7fab0ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fab10101080 0x7fab1019a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43680/0 (socket says 172.21.15.44:43680) 2024-08-19T00:20:36.143 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.137+0000 7fab14882640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab101006e0 0x7fab1019a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:36.143 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.137+0000 7fab0ffff640 1 -- 172.21.15.44:0/786627343 learned_addr learned my addr 172.21.15.44:0/786627343 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:20:36.143 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.137+0000 7fab15083640 1 --2- 172.21.15.44:0/786627343 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fab101066f0 0x7fab1019eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:36.143 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.137+0000 7fab0ffff640 1 -- 172.21.15.44:0/786627343 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fab101066f0 msgr2=0x7fab1019eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:20:36.143 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.137+0000 7fab0ffff640 1 --2- 172.21.15.44:0/786627343 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fab101066f0 0x7fab1019eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:36.143 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.137+0000 7fab0ffff640 1 -- 172.21.15.44:0/786627343 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab101006e0 msgr2=0x7fab1019a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:20:36.143 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.137+0000 7fab0ffff640 1 --2- 172.21.15.44:0/786627343 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab101006e0 0x7fab1019a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:36.143 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.138+0000 7fab0ffff640 1 -- 172.21.15.44:0/786627343 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab1019f2d0 con 0x7fab10101080 2024-08-19T00:20:36.143 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.138+0000 7fab14882640 1 --2- 172.21.15.44:0/786627343 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab101006e0 0x7fab1019a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:20:36.143 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.138+0000 7fab0ffff640 1 --2- 172.21.15.44:0/786627343 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fab10101080 0x7fab1019a820 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7faafc00e9f0 tx=0x7faafc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:20:36.143 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.138+0000 7fab0dffb640 1 -- 172.21.15.44:0/786627343 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faafc00cd80 con 0x7fab10101080 2024-08-19T00:20:36.144 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.138+0000 7fab0dffb640 1 -- 172.21.15.44:0/786627343 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faafc010910 con 0x7fab10101080 2024-08-19T00:20:36.144 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.138+0000 7fab0dffb640 1 -- 172.21.15.44:0/786627343 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faafc018990 con 0x7fab10101080 2024-08-19T00:20:36.144 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.138+0000 7fab16ae6640 1 -- 172.21.15.44:0/786627343 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab1019f5c0 con 0x7fab10101080 2024-08-19T00:20:36.144 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.138+0000 7fab16ae6640 1 -- 172.21.15.44:0/786627343 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab101a6e50 con 0x7fab10101080 2024-08-19T00:20:36.150 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.141+0000 7fab0dffb640 1 -- 172.21.15.44:0/786627343 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7faafc010ac0 con 0x7fab10101080 2024-08-19T00:20:36.151 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.141+0000 7fab198a1740 1 Processor -- start 2024-08-19T00:20:36.151 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.141+0000 7fab198a1740 1 -- start start 2024-08-19T00:20:36.151 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.141+0000 7fab198a1740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564be87a47d0 0x564be87a4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:36.151 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.141+0000 7fab198a1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564be87a50f0 0x564be87af450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:36.151 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.141+0000 7fab198a1740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564be87af990 0x564be87b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:36.151 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.141+0000 7fab198a1740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564be87089d0 con 0x564be87a50f0 2024-08-19T00:20:36.151 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.141+0000 7fab198a1740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x564be86b0820 con 0x564be87a47d0 2024-08-19T00:20:36.151 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.141+0000 7fab198a1740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x564be8704990 con 0x564be87af990 2024-08-19T00:20:36.151 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.141+0000 7fab0dffb640 1 --2- 172.21.15.44:0/786627343 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fab000a2da0 0x7fab000a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:36.151 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.141+0000 7fab14882640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564be87a50f0 0x564be87af450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:36.152 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.141+0000 7fab14882640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564be87a50f0 0x564be87af450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43688/0 (socket says 172.21.15.44:43688) 2024-08-19T00:20:36.152 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.142+0000 7fab14882640 1 -- 172.21.15.44:0/3320203270 learned_addr learned my addr 172.21.15.44:0/3320203270 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:20:36.152 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.142+0000 7fab0ffff640 1 --2- 172.21.15.44:0/3320203270 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564be87af990 0x564be87b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:36.152 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.142+0000 7fab0dffb640 1 -- 172.21.15.44:0/786627343 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9533+0+0 (secure 0 0 0) 0x7faafc0cfb30 con 0x7fab10101080 2024-08-19T00:20:36.152 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.142+0000 7fab15083640 1 --2- 172.21.15.44:0/786627343 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fab000a2da0 0x7fab000a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:36.152 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.142+0000 7fab15083640 1 --2- 172.21.15.44:0/3320203270 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564be87a47d0 0x564be87a4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:36.152 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.142+0000 7fab14882640 1 -- 172.21.15.44:0/3320203270 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564be87af990 msgr2=0x564be87b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:20:36.152 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.142+0000 7fab14882640 1 --2- 172.21.15.44:0/3320203270 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564be87af990 0x564be87b1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:36.152 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.142+0000 7fab14882640 1 -- 172.21.15.44:0/3320203270 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564be87a47d0 msgr2=0x564be87a4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:20:36.152 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.142+0000 7fab14882640 1 --2- 172.21.15.44:0/3320203270 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564be87a47d0 0x564be87a4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:36.152 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.142+0000 7fab14882640 1 -- 172.21.15.44:0/3320203270 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564be841c210 con 0x564be87a50f0 2024-08-19T00:20:36.152 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.142+0000 7fab0ffff640 1 --2- 172.21.15.44:0/3320203270 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564be87af990 0x564be87b1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:20:36.153 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.142+0000 7fab14882640 1 --2- 172.21.15.44:0/3320203270 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564be87a50f0 0x564be87af450 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fab04009780 tx=0x7fab04009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85cb60e3bf60c10b server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:20:36.153 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.142+0000 7fab15083640 1 --2- 172.21.15.44:0/786627343 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fab000a2da0 0x7fab000a5260 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fab08009fd0 tx=0x7fab08010040 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:20:36.153 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.142+0000 7faafaffd640 1 -- 172.21.15.44:0/3320203270 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab04041020 con 0x564be87a50f0 2024-08-19T00:20:36.153 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.142+0000 7faafaffd640 1 -- 172.21.15.44:0/3320203270 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab04030780 con 0x564be87a50f0 2024-08-19T00:20:36.153 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.142+0000 7faafaffd640 1 -- 172.21.15.44:0/3320203270 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab04037040 con 0x564be87a50f0 2024-08-19T00:20:36.153 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.143+0000 7fab198a1740 1 -- 172.21.15.44:0/3320203270 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564be87a50f0 msgr2=0x564be87af450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:20:36.153 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.143+0000 7fab198a1740 1 --2- 172.21.15.44:0/3320203270 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564be87a50f0 0x564be87af450 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fab04009780 tx=0x7fab04009510 comp rx=0 tx=0).stop 2024-08-19T00:20:36.153 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.143+0000 7fab198a1740 1 -- 172.21.15.44:0/3320203270 shutdown_connections 2024-08-19T00:20:36.153 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.143+0000 7fab198a1740 1 --2- 172.21.15.44:0/3320203270 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564be87af990 0x564be87b1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:36.153 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.143+0000 7fab198a1740 1 --2- 172.21.15.44:0/3320203270 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564be87a50f0 0x564be87af450 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:36.153 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.143+0000 7fab198a1740 1 --2- 172.21.15.44:0/3320203270 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564be87a47d0 0x564be87a4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:36.154 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.143+0000 7fab198a1740 1 -- 172.21.15.44:0/3320203270 >> 172.21.15.44:0/3320203270 conn(0x564be87a0d40 msgr2=0x564be87a1120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:20:36.154 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.143+0000 7fab198a1740 1 -- 172.21.15.44:0/3320203270 shutdown_connections 2024-08-19T00:20:36.154 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.143+0000 7fab198a1740 1 -- 172.21.15.44:0/3320203270 wait complete. 2024-08-19T00:20:36.154 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.144+0000 7fab198a1740 1 -- start start 2024-08-19T00:20:36.154 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.144+0000 7fab198a1740 1 Processor -- start 2024-08-19T00:20:36.154 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.144+0000 7fab198a1740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564be87a47d0 0x564be87ac840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:36.154 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.144+0000 7fab198a1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564be87a50f0 0x564be87acd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:36.154 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.144+0000 7fab198a1740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564be87af990 0x564be87ad2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:36.154 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.144+0000 7fab198a1740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564be87b2560 con 0x564be87a50f0 2024-08-19T00:20:36.154 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.144+0000 7fab198a1740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x564be86c4520 con 0x564be87a47d0 2024-08-19T00:20:36.155 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.144+0000 7fab198a1740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x564be87b26e0 con 0x564be87af990 2024-08-19T00:20:36.155 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.144+0000 7fab198a1740 10 client.0 _ll_register_callbacks cb 0x564be841ba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:20:36.155 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.144+0000 7fab0ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564be87a50f0 0x564be87acd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:36.155 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.144+0000 7fab14882640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564be87a47d0 0x564be87ac840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:36.155 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.144+0000 7fab0ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564be87a50f0 0x564be87acd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43702/0 (socket says 172.21.15.44:43702) 2024-08-19T00:20:36.155 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.144+0000 7fab0ffff640 1 -- 172.21.15.44:0/150629353 learned_addr learned my addr 172.21.15.44:0/150629353 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:20:36.155 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.144+0000 7fab15083640 1 --2- 172.21.15.44:0/150629353 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564be87af990 0x564be87ad2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:36.155 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.145+0000 7fab14882640 1 -- 172.21.15.44:0/150629353 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564be87af990 msgr2=0x564be87ad2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:20:36.155 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.145+0000 7fab14882640 1 --2- 172.21.15.44:0/150629353 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564be87af990 0x564be87ad2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:36.155 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.145+0000 7fab14882640 1 -- 172.21.15.44:0/150629353 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564be87a50f0 msgr2=0x564be87acd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:20:36.155 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.145+0000 7fab14882640 1 --2- 172.21.15.44:0/150629353 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564be87a50f0 0x564be87acd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:36.156 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.145+0000 7fab14882640 1 -- 172.21.15.44:0/150629353 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564be84e8620 con 0x564be87a47d0 2024-08-19T00:20:36.156 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.145+0000 7fab14882640 1 --2- 172.21.15.44:0/150629353 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564be87a47d0 0x564be87ac840 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fab04005e00 tx=0x7fab04030580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e1e11e197d831e0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:20:36.156 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.145+0000 7faaeffff640 10 client.0 ms_handle_connect on v2:172.21.15.116:3300/0 2024-08-19T00:20:36.156 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.145+0000 7faaeffff640 1 -- 172.21.15.44:0/150629353 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab0404a070 con 0x564be87a47d0 2024-08-19T00:20:36.156 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.145+0000 7faaeffff640 1 -- 172.21.15.44:0/150629353 <== mon.2 v2:172.21.15.116:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9533+0+0 (secure 0 0 0) 0x7fab04003f30 con 0x564be87a47d0 2024-08-19T00:20:36.156 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.145+0000 7fab198a1740 1 -- 172.21.15.44:0/150629353 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab04030780 con 0x564be87a47d0 2024-08-19T00:20:36.156 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.145+0000 7faaeffff640 1 -- 172.21.15.44:0/150629353 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fab04056050 con 0x564be87a47d0 2024-08-19T00:20:36.156 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.145+0000 7fab198a1740 10 client.25877 fetch_fsmap learned FSMap version 33 2024-08-19T00:20:36.156 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.145+0000 7fab198a1740 1 -- 172.21.15.44:0/150629353 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x564be87be0f0 con 0x564be87a47d0 2024-08-19T00:20:36.156 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.146+0000 7faaeffff640 1 -- 172.21.15.44:0/150629353 <== mon.2 v2:172.21.15.116:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab04030780 con 0x564be87a47d0 2024-08-19T00:20:36.156 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.146+0000 7faaeffff640 1 -- 172.21.15.44:0/150629353 <== mon.2 v2:172.21.15.116:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7fab0403dc40 con 0x564be87a47d0 2024-08-19T00:20:36.157 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.146+0000 7fab198a1740 10 client.25877 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:20:36.157 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.146+0000 7fab198a1740 10 client.25877 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:20:36.157 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.146+0000 7fab198a1740 20 client.25877 populate_metadata read hostname 'smithi044' 2024-08-19T00:20:36.157 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.146+0000 7fab198a1740 1 --2- 172.21.15.44:0/150629353 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x564be87bf440 0x564be87c1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:36.157 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.146+0000 7fab198a1740 4 client.25877 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:20:36.157 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.146+0000 7fab198a1740 1 -- 172.21.15.44:0/150629353 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564be8716100 con 0x564be87bf440 2024-08-19T00:20:36.157 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.146+0000 7fab0ffff640 1 --2- 172.21.15.44:0/150629353 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x564be87bf440 0x564be87c1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:36.157 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.146+0000 7fab0ffff640 1 --2- 172.21.15.44:0/150629353 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x564be87bf440 0x564be87c1830 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fbb9d1f4da44476 server_cookie=30199f1f03d59099 in_seq=0 out_seq=0 2024-08-19T00:20:36.157 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.146+0000 7faaeffff640 10 client.25877 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:20:36.157 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.147+0000 7faaeffff640 1 -- 172.21.15.44:0/150629353 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564be8716100 con 0x564be87bf440 2024-08-19T00:20:36.157 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.147+0000 7faaeffff640 10 client.25877 handle_command_reply: tid=0 2024-08-19T00:20:36.158 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.147+0000 7fab198a1740 1 client.25877 shutdown 2024-08-19T00:20:36.158 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.147+0000 7fab198a1740 1 -- 172.21.15.44:0/150629353 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564be87a47d0 msgr2=0x564be87ac840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:20:36.158 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.147+0000 7fab198a1740 1 --2- 172.21.15.44:0/150629353 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564be87a47d0 0x564be87ac840 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fab04005e00 tx=0x7fab04030580 comp rx=0 tx=0).stop 2024-08-19T00:20:36.158 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.147+0000 7fab198a1740 1 -- 172.21.15.44:0/150629353 shutdown_connections 2024-08-19T00:20:36.158 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.147+0000 7fab198a1740 1 --2- 172.21.15.44:0/150629353 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x564be87bf440 0x564be87c1830 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:36.158 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.147+0000 7fab198a1740 1 --2- 172.21.15.44:0/150629353 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564be87af990 0x564be87ad2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:36.158 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.147+0000 7fab198a1740 1 --2- 172.21.15.44:0/150629353 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564be87a50f0 0x564be87acd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:36.158 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.147+0000 7faaeffff640 0 client.25877 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:20:36.158 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.147+0000 7fab198a1740 1 --2- 172.21.15.44:0/150629353 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564be87a47d0 0x564be87ac840 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:36.158 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.147+0000 7fab198a1740 1 -- 172.21.15.44:0/150629353 >> 172.21.15.44:0/150629353 conn(0x564be87a0d40 msgr2=0x564be87a6aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:20:36.158 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.147+0000 7fab198a1740 1 -- 172.21.15.44:0/150629353 shutdown_connections 2024-08-19T00:20:36.159 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.147+0000 7fab198a1740 1 -- 172.21.15.44:0/150629353 wait complete. 2024-08-19T00:20:36.159 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.148+0000 7fab198a1740 20 client.25877 trim_cache size 0 max 16384 2024-08-19T00:20:36.165 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.162+0000 7fab198a1740 1 Processor -- start 2024-08-19T00:20:36.165 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.162+0000 7fab198a1740 1 -- start start 2024-08-19T00:20:36.165 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.162+0000 7fab198a1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564be87a47d0 0x564be87a9a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:36.165 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.162+0000 7fab198a1740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564be87a50f0 0x564be87a9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:36.165 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.162+0000 7fab198a1740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564be87af990 0x564be87a6230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:36.165 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.162+0000 7fab198a1740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fab101b0ec0 con 0x564be87a47d0 2024-08-19T00:20:36.165 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.162+0000 7fab198a1740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fab101b2a00 con 0x564be87af990 2024-08-19T00:20:36.165 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.162+0000 7fab198a1740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fab101b1590 con 0x564be87a50f0 2024-08-19T00:20:36.165 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.162+0000 7fab14882640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564be87a47d0 0x564be87a9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:36.165 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.162+0000 7fab14882640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564be87a47d0 0x564be87a9a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43710/0 (socket says 172.21.15.44:43710) 2024-08-19T00:20:36.165 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.162+0000 7fab14882640 1 -- 172.21.15.44:0/2158535676 learned_addr learned my addr 172.21.15.44:0/2158535676 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:20:36.166 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.162+0000 7fab0ffff640 1 --2- 172.21.15.44:0/2158535676 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564be87a50f0 0x564be87a9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:36.166 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.162+0000 7fab15083640 1 --2- 172.21.15.44:0/2158535676 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564be87af990 0x564be87a6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:36.166 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.163+0000 7fab14882640 1 -- 172.21.15.44:0/2158535676 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564be87a50f0 msgr2=0x564be87a9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:20:36.166 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.163+0000 7fab14882640 1 --2- 172.21.15.44:0/2158535676 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564be87a50f0 0x564be87a9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:36.166 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.163+0000 7fab14882640 1 -- 172.21.15.44:0/2158535676 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564be87af990 msgr2=0x564be87a6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:20:36.166 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.163+0000 7fab14882640 1 --2- 172.21.15.44:0/2158535676 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564be87af990 0x564be87a6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:36.166 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.163+0000 7fab14882640 1 -- 172.21.15.44:0/2158535676 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564be87a0b70 con 0x564be87a47d0 2024-08-19T00:20:36.166 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.163+0000 7fab15083640 1 --2- 172.21.15.44:0/2158535676 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564be87af990 0x564be87a6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:20:36.166 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.163+0000 7fab14882640 1 --2- 172.21.15.44:0/2158535676 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564be87a47d0 0x564be87a9a80 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fab04030520 tx=0x7fab040056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daa00ab997c3b883 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:20:36.166 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.163+0000 7faafa7fc640 1 -- 172.21.15.44:0/2158535676 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab0404a070 con 0x564be87a47d0 2024-08-19T00:20:36.167 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.163+0000 7faafa7fc640 1 -- 172.21.15.44:0/2158535676 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab04046890 con 0x564be87a47d0 2024-08-19T00:20:36.167 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.163+0000 7faafa7fc640 1 -- 172.21.15.44:0/2158535676 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab04041030 con 0x564be87a47d0 2024-08-19T00:20:36.170 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.164+0000 7fab198a1740 1 -- 172.21.15.44:0/2158535676 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564be87a47d0 msgr2=0x564be87a9a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:20:36.170 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.164+0000 7fab198a1740 1 --2- 172.21.15.44:0/2158535676 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564be87a47d0 0x564be87a9a80 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fab04030520 tx=0x7fab040056d0 comp rx=0 tx=0).stop 2024-08-19T00:20:36.170 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.164+0000 7fab198a1740 1 -- 172.21.15.44:0/2158535676 shutdown_connections 2024-08-19T00:20:36.170 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.164+0000 7fab198a1740 1 --2- 172.21.15.44:0/2158535676 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564be87a50f0 0x564be87a9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:36.170 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.164+0000 7fab198a1740 1 --2- 172.21.15.44:0/2158535676 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564be87af990 0x564be87a6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:36.171 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.164+0000 7fab198a1740 1 --2- 172.21.15.44:0/2158535676 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564be87a47d0 0x564be87a9a80 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:36.171 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.164+0000 7fab198a1740 1 -- 172.21.15.44:0/2158535676 >> 172.21.15.44:0/2158535676 conn(0x564be87a0d40 msgr2=0x564be87ab910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:20:36.171 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.164+0000 7fab198a1740 1 -- 172.21.15.44:0/2158535676 shutdown_connections 2024-08-19T00:20:36.171 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.164+0000 7fab198a1740 1 -- 172.21.15.44:0/2158535676 wait complete. 2024-08-19T00:20:36.171 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.164+0000 7fab198a1740 1 -- start start 2024-08-19T00:20:36.171 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.164+0000 7fab198a1740 1 Processor -- start 2024-08-19T00:20:36.171 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.165+0000 7fab198a1740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564be87a47d0 0x564be87c1950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:36.171 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.165+0000 7fab198a1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564be87a50f0 0x564be87c1e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:36.171 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.165+0000 7fab198a1740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564be87af990 0x564be8827d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:36.171 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.165+0000 7fab198a1740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fab101b2330 con 0x564be87a50f0 2024-08-19T00:20:36.171 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.165+0000 7fab198a1740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fab101b1c60 con 0x564be87af990 2024-08-19T00:20:36.171 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.165+0000 7fab198a1740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fab101aeec0 con 0x564be87a47d0 2024-08-19T00:20:36.171 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.165+0000 7fab198a1740 10 client.0 _ll_register_callbacks cb 0x7faafc005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:20:36.171 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.165+0000 7fab0ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564be87a50f0 0x564be87c1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:36.172 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.165+0000 7fab14882640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564be87a47d0 0x564be87c1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:36.172 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.165+0000 7fab0ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564be87a50f0 0x564be87c1e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43720/0 (socket says 172.21.15.44:43720) 2024-08-19T00:20:36.172 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.165+0000 7fab0ffff640 1 -- 172.21.15.44:0/1287145908 learned_addr learned my addr 172.21.15.44:0/1287145908 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:20:36.172 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.165+0000 7fab15083640 1 --2- 172.21.15.44:0/1287145908 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564be87af990 0x564be8827d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:36.172 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.165+0000 7fab14882640 1 -- 172.21.15.44:0/1287145908 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564be87af990 msgr2=0x564be8827d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:20:36.172 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.165+0000 7fab14882640 1 --2- 172.21.15.44:0/1287145908 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564be87af990 0x564be8827d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:36.172 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.165+0000 7fab14882640 1 -- 172.21.15.44:0/1287145908 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564be87a50f0 msgr2=0x564be87c1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:20:36.172 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.165+0000 7fab14882640 1 --2- 172.21.15.44:0/1287145908 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564be87a50f0 0x564be87c1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:36.172 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.165+0000 7fab14882640 1 -- 172.21.15.44:0/1287145908 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564be87c2790 con 0x564be87a47d0 2024-08-19T00:20:36.172 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.165+0000 7fab0ffff640 1 --2- 172.21.15.44:0/1287145908 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564be87a50f0 0x564be87c1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:20:36.172 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.165+0000 7fab14882640 1 --2- 172.21.15.44:0/1287145908 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564be87a47d0 0x564be87c1950 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fab040464a0 tx=0x7fab040097f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea87c2b9c3e6f8d3 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:20:36.172 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.166+0000 7faaeffff640 10 client.0 ms_handle_connect on v2:172.21.15.171:3300/0 2024-08-19T00:20:36.172 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.166+0000 7faaeffff640 1 -- 172.21.15.44:0/1287145908 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab0404a050 con 0x564be87a47d0 2024-08-19T00:20:36.173 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.166+0000 7faaeffff640 1 -- 172.21.15.44:0/1287145908 <== mon.1 v2:172.21.15.171:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9533+0+0 (secure 0 0 0) 0x7fab04030790 con 0x564be87a47d0 2024-08-19T00:20:36.173 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.166+0000 7fab198a1740 1 -- 172.21.15.44:0/1287145908 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab04046890 con 0x564be87a47d0 2024-08-19T00:20:36.173 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.166+0000 7faaeffff640 1 -- 172.21.15.44:0/1287145908 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fab04068050 con 0x564be87a47d0 2024-08-19T00:20:36.173 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.166+0000 7fab198a1740 10 client.25756 fetch_fsmap learned FSMap version 33 2024-08-19T00:20:36.173 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.166+0000 7fab198a1740 1 -- 172.21.15.44:0/1287145908 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x564be88293f0 con 0x564be87a47d0 2024-08-19T00:20:36.173 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.166+0000 7faaeffff640 1 -- 172.21.15.44:0/1287145908 <== mon.1 v2:172.21.15.171:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab04046890 con 0x564be87a47d0 2024-08-19T00:20:36.173 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.166+0000 7faaeffff640 1 -- 172.21.15.44:0/1287145908 <== mon.1 v2:172.21.15.171:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7fab040327d0 con 0x564be87a47d0 2024-08-19T00:20:36.173 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.166+0000 7fab198a1740 10 client.25756 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:20:36.173 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.166+0000 7fab198a1740 10 client.25756 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:20:36.173 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.166+0000 7fab198a1740 20 client.25756 populate_metadata read hostname 'smithi044' 2024-08-19T00:20:36.173 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.166+0000 7fab198a1740 1 --2- 172.21.15.44:0/1287145908 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x564be88299f0 0x564be882bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:36.173 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.166+0000 7fab198a1740 4 client.25756 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-19T00:20:36.173 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.166+0000 7fab198a1740 1 -- 172.21.15.44:0/1287145908 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564be8710450 con 0x564be88299f0 2024-08-19T00:20:36.173 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.167+0000 7fab0ffff640 1 --2- 172.21.15.44:0/1287145908 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x564be88299f0 0x564be882bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:36.174 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.167+0000 7faaeffff640 10 client.25756 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:20:36.174 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.167+0000 7fab0ffff640 1 --2- 172.21.15.44:0/1287145908 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x564be88299f0 0x564be882bde0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1d8ef332b1fa57b server_cookie=a0d99f08db4c0423 in_seq=0 out_seq=0 2024-08-19T00:20:36.178 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.175+0000 7faaeffff640 1 -- 172.21.15.44:0/1287145908 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564be8710450 con 0x564be88299f0 2024-08-19T00:20:36.178 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.175+0000 7faaeffff640 10 client.25756 handle_command_reply: tid=0 2024-08-19T00:20:36.179 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.175+0000 7fab198a1740 1 client.25756 shutdown 2024-08-19T00:20:36.179 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.175+0000 7fab198a1740 1 -- 172.21.15.44:0/1287145908 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564be87a47d0 msgr2=0x564be87c1950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:20:36.179 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.175+0000 7fab198a1740 1 --2- 172.21.15.44:0/1287145908 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564be87a47d0 0x564be87c1950 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fab040464a0 tx=0x7fab040097f0 comp rx=0 tx=0).stop 2024-08-19T00:20:36.179 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.176+0000 7fab198a1740 1 -- 172.21.15.44:0/1287145908 shutdown_connections 2024-08-19T00:20:36.179 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.176+0000 7fab198a1740 1 --2- 172.21.15.44:0/1287145908 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x564be88299f0 0x564be882bde0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:36.179 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.176+0000 7fab198a1740 1 --2- 172.21.15.44:0/1287145908 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564be87af990 0x564be8827d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:36.179 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.176+0000 7faaeffff640 0 client.25756 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:20:36.179 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.176+0000 7fab198a1740 1 --2- 172.21.15.44:0/1287145908 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564be87a50f0 0x564be87c1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:36.179 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.176+0000 7fab198a1740 1 --2- 172.21.15.44:0/1287145908 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564be87a47d0 0x564be87c1950 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:36.179 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.176+0000 7fab198a1740 1 -- 172.21.15.44:0/1287145908 >> 172.21.15.44:0/1287145908 conn(0x564be87a0d40 msgr2=0x564be87a6230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:20:36.179 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.176+0000 7fab198a1740 1 -- 172.21.15.44:0/1287145908 shutdown_connections 2024-08-19T00:20:36.179 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.176+0000 7fab198a1740 1 -- 172.21.15.44:0/1287145908 wait complete. 2024-08-19T00:20:36.179 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.176+0000 7fab198a1740 20 client.25756 trim_cache size 0 max 16384 2024-08-19T00:20:36.180 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:{ 2024-08-19T00:20:36.180 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "message": "", 2024-08-19T00:20:36.180 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "return_code": 0 2024-08-19T00:20:36.180 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:} 2024-08-19T00:20:36.181 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.176+0000 7fab16ae6640 1 -- 172.21.15.44:0/786627343 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fab000a2da0 msgr2=0x7fab000a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:20:36.181 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.176+0000 7fab16ae6640 1 --2- 172.21.15.44:0/786627343 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fab000a2da0 0x7fab000a5260 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fab08009fd0 tx=0x7fab08010040 comp rx=0 tx=0).stop 2024-08-19T00:20:36.181 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.176+0000 7fab16ae6640 1 -- 172.21.15.44:0/786627343 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fab10101080 msgr2=0x7fab1019a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:20:36.181 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.176+0000 7fab16ae6640 1 --2- 172.21.15.44:0/786627343 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fab10101080 0x7fab1019a820 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7faafc00e9f0 tx=0x7faafc00eeb0 comp rx=0 tx=0).stop 2024-08-19T00:20:36.181 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.177+0000 7fab16ae6640 1 -- 172.21.15.44:0/786627343 shutdown_connections 2024-08-19T00:20:36.181 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.177+0000 7fab16ae6640 1 --2- 172.21.15.44:0/786627343 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fab000a2da0 0x7fab000a5260 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:36.181 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.177+0000 7fab16ae6640 1 --2- 172.21.15.44:0/786627343 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fab101066f0 0x7fab1019eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:36.181 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.177+0000 7fab16ae6640 1 --2- 172.21.15.44:0/786627343 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fab10101080 0x7fab1019a820 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:36.181 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.177+0000 7fab16ae6640 1 --2- 172.21.15.44:0/786627343 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab101006e0 0x7fab1019a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:36.181 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.177+0000 7fab16ae6640 1 -- 172.21.15.44:0/786627343 >> 172.21.15.44:0/786627343 conn(0x7fab100776c0 msgr2=0x7fab100feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:20:36.181 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.177+0000 7fab16ae6640 1 -- 172.21.15.44:0/786627343 shutdown_connections 2024-08-19T00:20:36.182 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:36.177+0000 7fab16ae6640 1 -- 172.21.15.44:0/786627343 wait complete. 2024-08-19T00:20:36.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:20:36 smithi044 ceph-mon[18489]: pgmap v223: 129 pgs: 129 active+clean; 385 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.6 MiB/s wr, 278 op/s 2024-08-19T00:20:36.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:20:36 smithi171 ceph-mon[21810]: pgmap v223: 129 pgs: 129 active+clean; 385 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.6 MiB/s wr, 278 op/s 2024-08-19T00:20:36.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:20:36 smithi116 ceph-mon[21873]: pgmap v223: 129 pgs: 129 active+clean; 385 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.6 MiB/s wr, 278 op/s 2024-08-19T00:20:36.683 INFO:tasks.workunit.client.0.smithi044.stdout: 1 535027 8.31 MB/sec execute 241 sec latency 16.346 ms 2024-08-19T00:20:37.683 INFO:tasks.workunit.client.0.smithi044.stdout: 1 537163 8.33 MB/sec execute 242 sec latency 18.754 ms 2024-08-19T00:20:38.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:20:38 smithi171 ceph-mon[21810]: pgmap v224: 129 pgs: 129 active+clean; 385 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.6 MiB/s wr, 194 op/s 2024-08-19T00:20:38.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:20:38 smithi116 ceph-mon[21873]: pgmap v224: 129 pgs: 129 active+clean; 385 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.6 MiB/s wr, 194 op/s 2024-08-19T00:20:38.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:20:38 smithi044 ceph-mon[18489]: pgmap v224: 129 pgs: 129 active+clean; 385 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.6 MiB/s wr, 194 op/s 2024-08-19T00:20:38.683 INFO:tasks.workunit.client.0.smithi044.stdout: 1 539596 8.35 MB/sec execute 243 sec latency 14.663 ms 2024-08-19T00:20:39.683 INFO:tasks.workunit.client.0.smithi044.stdout: 1 541236 8.35 MB/sec execute 244 sec latency 44.186 ms 2024-08-19T00:20:40.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:20:40 smithi171 ceph-mon[21810]: pgmap v225: 129 pgs: 129 active+clean; 385 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.6 MiB/s wr, 194 op/s 2024-08-19T00:20:40.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:20:40 smithi116 ceph-mon[21873]: pgmap v225: 129 pgs: 129 active+clean; 385 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.6 MiB/s wr, 194 op/s 2024-08-19T00:20:40.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:20:40 smithi044 ceph-mon[18489]: pgmap v225: 129 pgs: 129 active+clean; 385 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.6 MiB/s wr, 194 op/s 2024-08-19T00:20:40.683 INFO:tasks.workunit.client.0.smithi044.stdout: 1 543640 8.38 MB/sec execute 245 sec latency 25.858 ms 2024-08-19T00:20:41.683 INFO:tasks.workunit.client.0.smithi044.stdout: 1 545224 8.37 MB/sec execute 246 sec latency 25.710 ms 2024-08-19T00:20:42.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:20:42 smithi171 ceph-mon[21810]: pgmap v226: 129 pgs: 129 active+clean; 398 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 6.5 MiB/s wr, 306 op/s 2024-08-19T00:20:42.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:20:42 smithi116 ceph-mon[21873]: pgmap v226: 129 pgs: 129 active+clean; 398 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 6.5 MiB/s wr, 306 op/s 2024-08-19T00:20:42.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:20:42 smithi044 ceph-mon[18489]: pgmap v226: 129 pgs: 129 active+clean; 398 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 6.5 MiB/s wr, 306 op/s 2024-08-19T00:20:42.683 INFO:tasks.workunit.client.0.smithi044.stdout: 1 547458 8.40 MB/sec execute 247 sec latency 166.249 ms 2024-08-19T00:20:43.684 INFO:tasks.workunit.client.0.smithi044.stdout: 1 549556 8.39 MB/sec execute 248 sec latency 14.886 ms 2024-08-19T00:20:44.421 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:20:44 smithi044 ceph-mon[18489]: pgmap v227: 129 pgs: 129 active+clean; 398 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.1 MiB/s wr, 214 op/s 2024-08-19T00:20:44.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:20:44 smithi171 ceph-mon[21810]: pgmap v227: 129 pgs: 129 active+clean; 398 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.1 MiB/s wr, 214 op/s 2024-08-19T00:20:44.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:20:44 smithi116 ceph-mon[21873]: pgmap v227: 129 pgs: 129 active+clean; 398 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.1 MiB/s wr, 214 op/s 2024-08-19T00:20:44.684 INFO:tasks.workunit.client.0.smithi044.stdout: 1 551426 8.41 MB/sec execute 249 sec latency 98.760 ms 2024-08-19T00:20:45.684 INFO:tasks.workunit.client.0.smithi044.stdout: 1 553820 8.42 MB/sec execute 250 sec latency 32.894 ms 2024-08-19T00:20:46.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:20:46 smithi171 ceph-mon[21810]: pgmap v228: 129 pgs: 129 active+clean; 405 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 6.7 MiB/s wr, 319 op/s 2024-08-19T00:20:46.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:20:46 smithi116 ceph-mon[21873]: pgmap v228: 129 pgs: 129 active+clean; 405 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 6.7 MiB/s wr, 319 op/s 2024-08-19T00:20:46.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:20:46 smithi044 ceph-mon[18489]: pgmap v228: 129 pgs: 129 active+clean; 405 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 6.7 MiB/s wr, 319 op/s 2024-08-19T00:20:46.684 INFO:tasks.workunit.client.0.smithi044.stdout: 1 555690 8.43 MB/sec execute 251 sec latency 20.498 ms 2024-08-19T00:20:47.684 INFO:tasks.workunit.client.0.smithi044.stdout: 1 558100 8.46 MB/sec execute 252 sec latency 24.564 ms 2024-08-19T00:20:48.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:20:48 smithi171 ceph-mon[21810]: pgmap v229: 129 pgs: 129 active+clean; 405 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.5 MiB/s wr, 216 op/s 2024-08-19T00:20:48.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:20:48 smithi116 ceph-mon[21873]: pgmap v229: 129 pgs: 129 active+clean; 405 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.5 MiB/s wr, 216 op/s 2024-08-19T00:20:48.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:20:48 smithi044 ceph-mon[18489]: pgmap v229: 129 pgs: 129 active+clean; 405 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.5 MiB/s wr, 216 op/s 2024-08-19T00:20:48.684 INFO:tasks.workunit.client.0.smithi044.stdout: 1 560140 8.45 MB/sec execute 253 sec latency 13.242 ms 2024-08-19T00:20:49.278 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.273+0000 7f94099a3640 1 -- 172.21.15.44:0/3990009851 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94041010a0 msgr2=0x7f940410d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:20:49.279 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.273+0000 7f94099a3640 1 --2- 172.21.15.44:0/3990009851 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94041010a0 0x7f940410d5d0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f93fc009cd0 tx=0x7f93fc02a8e0 comp rx=0 tx=0).stop 2024-08-19T00:20:49.279 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.273+0000 7f94099a3640 1 -- 172.21.15.44:0/3990009851 shutdown_connections 2024-08-19T00:20:49.279 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.273+0000 7f94099a3640 1 --2- 172.21.15.44:0/3990009851 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94041010a0 0x7f940410d5d0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:49.279 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.273+0000 7f94099a3640 1 --2- 172.21.15.44:0/3990009851 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9404100700 0x7f9404100b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:49.279 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.273+0000 7f94099a3640 1 --2- 172.21.15.44:0/3990009851 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9404106710 0x7f9404106af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:49.279 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.273+0000 7f94099a3640 1 -- 172.21.15.44:0/3990009851 >> 172.21.15.44:0/3990009851 conn(0x7f94040fc420 msgr2=0x7f94040fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:20:49.279 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.273+0000 7f94099a3640 1 -- 172.21.15.44:0/3990009851 shutdown_connections 2024-08-19T00:20:49.279 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.273+0000 7f94099a3640 1 -- 172.21.15.44:0/3990009851 wait complete. 2024-08-19T00:20:49.279 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.274+0000 7f94099a3640 1 Processor -- start 2024-08-19T00:20:49.280 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.274+0000 7f94099a3640 1 -- start start 2024-08-19T00:20:49.280 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.274+0000 7f94099a3640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9404100700 0x7f9404198e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:49.280 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.274+0000 7f94099a3640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94041010a0 0x7f94041993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:49.280 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.274+0000 7f94099a3640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9404106710 0x7f94041a3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:49.280 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.274+0000 7f94099a3640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9404110b50 con 0x7f94041010a0 2024-08-19T00:20:49.281 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.274+0000 7f94099a3640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f94041109d0 con 0x7f9404106710 2024-08-19T00:20:49.281 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.274+0000 7f94099a3640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9404110cd0 con 0x7f9404100700 2024-08-19T00:20:49.281 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.274+0000 7f94027fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94041010a0 0x7f94041993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:49.281 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.274+0000 7f94027fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94041010a0 0x7f94041993d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48472/0 (socket says 172.21.15.44:48472) 2024-08-19T00:20:49.281 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.274+0000 7f9402ffd640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9404100700 0x7f9404198e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:49.282 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.274+0000 7f94027fc640 1 -- 172.21.15.44:0/1582640191 learned_addr learned my addr 172.21.15.44:0/1582640191 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:20:49.282 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.274+0000 7f94037fe640 1 --2- 172.21.15.44:0/1582640191 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9404106710 0x7f94041a3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:49.282 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.275+0000 7f9402ffd640 1 -- 172.21.15.44:0/1582640191 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9404106710 msgr2=0x7f94041a3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:20:49.282 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.275+0000 7f9402ffd640 1 --2- 172.21.15.44:0/1582640191 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9404106710 0x7f94041a3f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:49.282 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.275+0000 7f9402ffd640 1 -- 172.21.15.44:0/1582640191 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94041010a0 msgr2=0x7f94041993d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:20:49.282 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.275+0000 7f9402ffd640 1 --2- 172.21.15.44:0/1582640191 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94041010a0 0x7f94041993d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:49.282 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.275+0000 7f9402ffd640 1 -- 172.21.15.44:0/1582640191 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94041a4450 con 0x7f9404100700 2024-08-19T00:20:49.283 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.275+0000 7f94027fc640 1 --2- 172.21.15.44:0/1582640191 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94041010a0 0x7f94041993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:20:49.283 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.275+0000 7f94037fe640 1 --2- 172.21.15.44:0/1582640191 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9404106710 0x7f94041a3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:20:49.283 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.275+0000 7f9402ffd640 1 --2- 172.21.15.44:0/1582640191 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9404100700 0x7f9404198e90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f93f400e9f0 tx=0x7f93f400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:20:49.283 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.275+0000 7f94089a1640 1 -- 172.21.15.44:0/1582640191 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f400ccc0 con 0x7f9404100700 2024-08-19T00:20:49.283 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.275+0000 7f94089a1640 1 -- 172.21.15.44:0/1582640191 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93f4005020 con 0x7f9404100700 2024-08-19T00:20:49.283 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.275+0000 7f94099a3640 1 -- 172.21.15.44:0/1582640191 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94041a4620 con 0x7f9404100700 2024-08-19T00:20:49.283 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.275+0000 7f94089a1640 1 -- 172.21.15.44:0/1582640191 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f40049e0 con 0x7f9404100700 2024-08-19T00:20:49.283 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.275+0000 7f94099a3640 1 -- 172.21.15.44:0/1582640191 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94041a4b20 con 0x7f9404100700 2024-08-19T00:20:49.283 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.277+0000 7f94089a1640 1 -- 172.21.15.44:0/1582640191 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f93f4005560 con 0x7f9404100700 2024-08-19T00:20:49.292 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.278+0000 7f940c838740 1 Processor -- start 2024-08-19T00:20:49.293 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.278+0000 7f940c838740 1 -- start start 2024-08-19T00:20:49.293 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.278+0000 7f940c838740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f27ee046b0 0x55f27ee04a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:49.293 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.278+0000 7f940c838740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f27ee04fd0 0x55f27ee13860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:49.293 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.278+0000 7f940c838740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f27ee13da0 0x55f27ee16190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:49.293 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.278+0000 7f940c838740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55f27ed689d0 con 0x55f27ee13da0 2024-08-19T00:20:49.293 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.278+0000 7f940c838740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55f27ed10820 con 0x55f27ee04fd0 2024-08-19T00:20:49.293 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.278+0000 7f940c838740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55f27ed64990 con 0x55f27ee046b0 2024-08-19T00:20:49.293 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.278+0000 7f94027fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f27ee13da0 0x55f27ee16190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:49.293 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.278+0000 7f94037fe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f27ee046b0 0x55f27ee04a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:49.293 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.278+0000 7f9402ffd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f27ee04fd0 0x55f27ee13860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:49.293 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.278+0000 7f94027fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f27ee13da0 0x55f27ee16190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48476/0 (socket says 172.21.15.44:48476) 2024-08-19T00:20:49.293 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.278+0000 7f94027fc640 1 -- 172.21.15.44:0/2337936293 learned_addr learned my addr 172.21.15.44:0/2337936293 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:20:49.294 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.278+0000 7f94089a1640 1 --2- 172.21.15.44:0/1582640191 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f93ec0a2da0 0x7f93ec0a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:49.294 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.278+0000 7f94027fc640 1 -- 172.21.15.44:0/2337936293 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f27ee046b0 msgr2=0x55f27ee04a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:20:49.294 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.278+0000 7f94027fc640 1 --2- 172.21.15.44:0/2337936293 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f27ee046b0 0x55f27ee04a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:49.294 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.278+0000 7f94027fc640 1 -- 172.21.15.44:0/2337936293 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f27ee04fd0 msgr2=0x55f27ee13860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:20:49.294 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.278+0000 7f94027fc640 1 --2- 172.21.15.44:0/2337936293 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f27ee04fd0 0x55f27ee13860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:49.294 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.278+0000 7f94027fc640 1 -- 172.21.15.44:0/2337936293 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f27ea7c210 con 0x55f27ee13da0 2024-08-19T00:20:49.294 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.279+0000 7f94037fe640 1 --2- 172.21.15.44:0/1582640191 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f93ec0a2da0 0x7f93ec0a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:49.294 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.279+0000 7f94089a1640 1 -- 172.21.15.44:0/1582640191 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9533+0+0 (secure 0 0 0) 0x7f93f40cf840 con 0x7f9404100700 2024-08-19T00:20:49.294 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.279+0000 7f94027fc640 1 --2- 172.21.15.44:0/2337936293 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f27ee13da0 0x55f27ee16190 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f93f8011620 tx=0x7f93f8011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceece42b093f5a2c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:20:49.294 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.279+0000 7f93e9ffb640 1 -- 172.21.15.44:0/2337936293 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f801e070 con 0x55f27ee13da0 2024-08-19T00:20:49.294 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.279+0000 7f93e9ffb640 1 -- 172.21.15.44:0/2337936293 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93f800fbd0 con 0x55f27ee13da0 2024-08-19T00:20:49.294 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.279+0000 7f93e9ffb640 1 -- 172.21.15.44:0/2337936293 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f8019ca0 con 0x55f27ee13da0 2024-08-19T00:20:49.294 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.280+0000 7f940c838740 1 -- 172.21.15.44:0/2337936293 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f27ee13da0 msgr2=0x55f27ee16190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:20:49.295 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.280+0000 7f940c838740 1 --2- 172.21.15.44:0/2337936293 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f27ee13da0 0x55f27ee16190 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f93f8011620 tx=0x7f93f8011ae0 comp rx=0 tx=0).stop 2024-08-19T00:20:49.295 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.280+0000 7f94037fe640 1 --2- 172.21.15.44:0/1582640191 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f93ec0a2da0 0x7f93ec0a5260 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f93fc009430 tx=0x7f93fc03f040 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:20:49.295 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.280+0000 7f940c838740 1 -- 172.21.15.44:0/2337936293 shutdown_connections 2024-08-19T00:20:49.295 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.280+0000 7f940c838740 1 --2- 172.21.15.44:0/2337936293 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f27ee13da0 0x55f27ee16190 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:49.295 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.280+0000 7f940c838740 1 --2- 172.21.15.44:0/2337936293 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f27ee04fd0 0x55f27ee13860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:49.295 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.280+0000 7f940c838740 1 --2- 172.21.15.44:0/2337936293 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f27ee046b0 0x55f27ee04a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:49.295 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.280+0000 7f940c838740 1 -- 172.21.15.44:0/2337936293 >> 172.21.15.44:0/2337936293 conn(0x55f27ee00d40 msgr2=0x55f27ee01120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:20:49.295 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.280+0000 7f940c838740 1 -- 172.21.15.44:0/2337936293 shutdown_connections 2024-08-19T00:20:49.295 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.280+0000 7f940c838740 1 -- 172.21.15.44:0/2337936293 wait complete. 2024-08-19T00:20:49.295 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.280+0000 7f940c838740 1 -- start start 2024-08-19T00:20:49.295 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.280+0000 7f940c838740 1 Processor -- start 2024-08-19T00:20:49.295 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.281+0000 7f940c838740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f27ee046b0 0x55f27ee10d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:49.295 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.281+0000 7f940c838740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f27ee04fd0 0x55f27ee112c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:49.296 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.281+0000 7f940c838740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f27ee13da0 0x55f27ee11800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:49.296 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.281+0000 7f940c838740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55f27ee169d0 con 0x55f27ee046b0 2024-08-19T00:20:49.296 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.281+0000 7f940c838740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55f27ed24520 con 0x55f27ee04fd0 2024-08-19T00:20:49.296 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.281+0000 7f940c838740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55f27ee16b50 con 0x55f27ee13da0 2024-08-19T00:20:49.296 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.281+0000 7f940c838740 10 client.0 _ll_register_callbacks cb 0x55f27ea7ba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:20:49.296 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.281+0000 7f9402ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f27ee046b0 0x55f27ee10d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:49.296 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.281+0000 7f9402ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f27ee046b0 0x55f27ee10d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48490/0 (socket says 172.21.15.44:48490) 2024-08-19T00:20:49.296 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.281+0000 7f9402ffd640 1 -- 172.21.15.44:0/3456690137 learned_addr learned my addr 172.21.15.44:0/3456690137 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:20:49.296 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.281+0000 7f94027fc640 1 --2- 172.21.15.44:0/3456690137 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f27ee04fd0 0x55f27ee112c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:49.296 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.281+0000 7f94037fe640 1 --2- 172.21.15.44:0/3456690137 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f27ee13da0 0x55f27ee11800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:49.296 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.281+0000 7f9402ffd640 1 -- 172.21.15.44:0/3456690137 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f27ee13da0 msgr2=0x55f27ee11800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:20:49.296 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.281+0000 7f9402ffd640 1 --2- 172.21.15.44:0/3456690137 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f27ee13da0 0x55f27ee11800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:49.296 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.281+0000 7f9402ffd640 1 -- 172.21.15.44:0/3456690137 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f27ee04fd0 msgr2=0x55f27ee112c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:20:49.297 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.281+0000 7f9402ffd640 1 --2- 172.21.15.44:0/3456690137 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f27ee04fd0 0x55f27ee112c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:49.297 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.281+0000 7f9402ffd640 1 -- 172.21.15.44:0/3456690137 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f27eb48620 con 0x55f27ee046b0 2024-08-19T00:20:49.297 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.281+0000 7f94027fc640 1 --2- 172.21.15.44:0/3456690137 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f27ee04fd0 0x55f27ee112c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:20:49.297 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.281+0000 7f9402ffd640 1 --2- 172.21.15.44:0/3456690137 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f27ee046b0 0x55f27ee10d80 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f93f409b8a0 tx=0x7f93f40d5290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90726c224e6b492f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:20:49.297 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.281+0000 7f93e2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:20:49.297 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.281+0000 7f93e2ffd640 1 -- 172.21.15.44:0/3456690137 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f401c070 con 0x55f27ee046b0 2024-08-19T00:20:49.297 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.281+0000 7f93e2ffd640 1 -- 172.21.15.44:0/3456690137 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9533+0+0 (secure 0 0 0) 0x7f93f40cc820 con 0x55f27ee046b0 2024-08-19T00:20:49.297 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.281+0000 7f940c838740 1 -- 172.21.15.44:0/3456690137 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93f800fbd0 con 0x55f27ee046b0 2024-08-19T00:20:49.297 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.281+0000 7f93e2ffd640 1 -- 172.21.15.44:0/3456690137 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f93f40ccfc0 con 0x55f27ee046b0 2024-08-19T00:20:49.297 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.282+0000 7f940c838740 10 client.16440 fetch_fsmap learned FSMap version 33 2024-08-19T00:20:49.297 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.282+0000 7f940c838740 1 -- 172.21.15.44:0/3456690137 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55f27ee22710 con 0x55f27ee046b0 2024-08-19T00:20:49.297 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.282+0000 7f93e2ffd640 1 -- 172.21.15.44:0/3456690137 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93f800fbd0 con 0x55f27ee046b0 2024-08-19T00:20:49.297 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.282+0000 7f93e2ffd640 1 -- 172.21.15.44:0/3456690137 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f93f40cf3c0 con 0x55f27ee046b0 2024-08-19T00:20:49.297 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.282+0000 7f940c838740 10 client.16440 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:20:49.298 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.282+0000 7f940c838740 10 client.16440 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:20:49.298 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.282+0000 7f940c838740 20 client.16440 populate_metadata read hostname 'smithi044' 2024-08-19T00:20:49.298 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.282+0000 7f940c838740 1 --2- 172.21.15.44:0/3456690137 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55f27ee23bd0 0x55f27ee25fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:49.298 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.282+0000 7f940c838740 4 client.16440 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:20:49.298 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.282+0000 7f940c838740 1 -- 172.21.15.44:0/3456690137 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f27ed76100 con 0x55f27ee23bd0 2024-08-19T00:20:49.298 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.282+0000 7f94027fc640 1 --2- 172.21.15.44:0/3456690137 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55f27ee23bd0 0x55f27ee25fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:49.298 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.282+0000 7f93e2ffd640 10 client.16440 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:20:49.298 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.282+0000 7f94027fc640 1 --2- 172.21.15.44:0/3456690137 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55f27ee23bd0 0x55f27ee25fc0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29d20c3312f64df0 server_cookie=2acdbf3828539d64 in_seq=0 out_seq=0 2024-08-19T00:20:49.298 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.283+0000 7f93e2ffd640 1 -- 172.21.15.44:0/3456690137 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f27ed76100 con 0x55f27ee23bd0 2024-08-19T00:20:49.298 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.283+0000 7f93e2ffd640 10 client.16440 handle_command_reply: tid=0 2024-08-19T00:20:49.298 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.283+0000 7f940c838740 1 client.16440 shutdown 2024-08-19T00:20:49.298 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.283+0000 7f940c838740 1 -- 172.21.15.44:0/3456690137 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f27ee046b0 msgr2=0x55f27ee10d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:20:49.298 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.283+0000 7f940c838740 1 --2- 172.21.15.44:0/3456690137 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f27ee046b0 0x55f27ee10d80 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f93f409b8a0 tx=0x7f93f40d5290 comp rx=0 tx=0).stop 2024-08-19T00:20:49.299 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.283+0000 7f940c838740 1 -- 172.21.15.44:0/3456690137 shutdown_connections 2024-08-19T00:20:49.299 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.283+0000 7f940c838740 1 --2- 172.21.15.44:0/3456690137 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55f27ee23bd0 0x55f27ee25fc0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:49.299 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.283+0000 7f940c838740 1 --2- 172.21.15.44:0/3456690137 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f27ee13da0 0x55f27ee11800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:49.299 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.283+0000 7f940c838740 1 --2- 172.21.15.44:0/3456690137 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f27ee04fd0 0x55f27ee112c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:49.299 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.283+0000 7f93e2ffd640 0 client.16440 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:20:49.299 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.283+0000 7f940c838740 1 --2- 172.21.15.44:0/3456690137 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f27ee046b0 0x55f27ee10d80 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:49.299 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.283+0000 7f940c838740 1 -- 172.21.15.44:0/3456690137 >> 172.21.15.44:0/3456690137 conn(0x55f27ee00d40 msgr2=0x55f27ee06a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:20:49.299 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.283+0000 7f940c838740 1 -- 172.21.15.44:0/3456690137 shutdown_connections 2024-08-19T00:20:49.299 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.283+0000 7f940c838740 1 -- 172.21.15.44:0/3456690137 wait complete. 2024-08-19T00:20:49.299 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.284+0000 7f940c838740 20 client.16440 trim_cache size 0 max 16384 2024-08-19T00:20:49.302 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.299+0000 7f940c838740 1 Processor -- start 2024-08-19T00:20:49.302 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.299+0000 7f940c838740 1 -- start start 2024-08-19T00:20:49.302 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.299+0000 7f940c838740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f27ee046b0 0x55f27ee12be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:49.302 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.299+0000 7f940c838740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f27ee04fd0 0x55f27ee2b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:49.302 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.299+0000 7f940c838740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f27ee13da0 0x55f27ee2bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:49.302 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.299+0000 7f940c838740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f94041acbe0 con 0x55f27ee046b0 2024-08-19T00:20:49.302 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.299+0000 7f940c838740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f94041ae720 con 0x55f27ee13da0 2024-08-19T00:20:49.302 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.299+0000 7f940c838740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f94041ad2b0 con 0x55f27ee04fd0 2024-08-19T00:20:49.302 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.299+0000 7f9402ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f27ee046b0 0x55f27ee12be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.299+0000 7f9402ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f27ee046b0 0x55f27ee12be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48506/0 (socket says 172.21.15.44:48506) 2024-08-19T00:20:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.299+0000 7f9402ffd640 1 -- 172.21.15.44:0/2400465903 learned_addr learned my addr 172.21.15.44:0/2400465903 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:20:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.299+0000 7f94037fe640 1 --2- 172.21.15.44:0/2400465903 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f27ee13da0 0x55f27ee2bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.299+0000 7f94027fc640 1 --2- 172.21.15.44:0/2400465903 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f27ee04fd0 0x55f27ee2b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.299+0000 7f9402ffd640 1 -- 172.21.15.44:0/2400465903 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f27ee04fd0 msgr2=0x55f27ee2b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:20:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.299+0000 7f9402ffd640 1 --2- 172.21.15.44:0/2400465903 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f27ee04fd0 0x55f27ee2b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.299+0000 7f9402ffd640 1 -- 172.21.15.44:0/2400465903 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f27ee13da0 msgr2=0x55f27ee2bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:20:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.299+0000 7f9402ffd640 1 --2- 172.21.15.44:0/2400465903 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f27ee13da0 0x55f27ee2bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.299+0000 7f9402ffd640 1 -- 172.21.15.44:0/2400465903 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f27ee04e00 con 0x55f27ee046b0 2024-08-19T00:20:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.299+0000 7f9402ffd640 1 --2- 172.21.15.44:0/2400465903 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f27ee046b0 0x55f27ee12be0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f93f4086460 tx=0x7f93f40ca050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb61fc54ce753cf8 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:20:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.300+0000 7f93e97fa640 1 -- 172.21.15.44:0/2400465903 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f40b9070 con 0x55f27ee046b0 2024-08-19T00:20:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.300+0000 7f93e97fa640 1 -- 172.21.15.44:0/2400465903 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93f4084e50 con 0x55f27ee046b0 2024-08-19T00:20:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.300+0000 7f93e97fa640 1 -- 172.21.15.44:0/2400465903 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f40a4580 con 0x55f27ee046b0 2024-08-19T00:20:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.300+0000 7f940c838740 1 -- 172.21.15.44:0/2400465903 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f27ee046b0 msgr2=0x55f27ee12be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:20:49.304 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.300+0000 7f940c838740 1 --2- 172.21.15.44:0/2400465903 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f27ee046b0 0x55f27ee12be0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f93f4086460 tx=0x7f93f40ca050 comp rx=0 tx=0).stop 2024-08-19T00:20:49.304 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.300+0000 7f940c838740 1 -- 172.21.15.44:0/2400465903 shutdown_connections 2024-08-19T00:20:49.304 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.300+0000 7f940c838740 1 --2- 172.21.15.44:0/2400465903 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f27ee04fd0 0x55f27ee2b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:49.304 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.300+0000 7f940c838740 1 --2- 172.21.15.44:0/2400465903 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f27ee13da0 0x55f27ee2bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:49.304 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.300+0000 7f940c838740 1 --2- 172.21.15.44:0/2400465903 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f27ee046b0 0x55f27ee12be0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:49.304 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.300+0000 7f940c838740 1 -- 172.21.15.44:0/2400465903 >> 172.21.15.44:0/2400465903 conn(0x55f27ee00d40 msgr2=0x55f27ee124d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:20:49.304 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.300+0000 7f940c838740 1 -- 172.21.15.44:0/2400465903 shutdown_connections 2024-08-19T00:20:49.304 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.300+0000 7f940c838740 1 -- 172.21.15.44:0/2400465903 wait complete. 2024-08-19T00:20:49.304 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.301+0000 7f940c838740 1 -- start start 2024-08-19T00:20:49.307 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.301+0000 7f940c838740 1 Processor -- start 2024-08-19T00:20:49.307 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.301+0000 7f940c838740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f27ee046b0 0x55f27ee1c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:49.307 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.301+0000 7f940c838740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f27ee04fd0 0x55f27ee17820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:49.307 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.301+0000 7f940c838740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f27ee13da0 0x55f27ee17d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:49.307 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.301+0000 7f940c838740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f94041ae050 con 0x55f27ee046b0 2024-08-19T00:20:49.307 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.301+0000 7f940c838740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f94041ad980 con 0x55f27ee04fd0 2024-08-19T00:20:49.307 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.301+0000 7f940c838740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f94041aabe0 con 0x55f27ee13da0 2024-08-19T00:20:49.307 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.301+0000 7f940c838740 10 client.0 _ll_register_callbacks cb 0x7f93f409b7d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:20:49.307 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.301+0000 7f9402ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f27ee046b0 0x55f27ee1c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:49.308 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.301+0000 7f9402ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f27ee046b0 0x55f27ee1c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48508/0 (socket says 172.21.15.44:48508) 2024-08-19T00:20:49.308 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.301+0000 7f9402ffd640 1 -- 172.21.15.44:0/3694587877 learned_addr learned my addr 172.21.15.44:0/3694587877 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:20:49.308 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.301+0000 7f94027fc640 1 --2- 172.21.15.44:0/3694587877 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f27ee04fd0 0x55f27ee17820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:49.308 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.301+0000 7f94037fe640 1 --2- 172.21.15.44:0/3694587877 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f27ee13da0 0x55f27ee17d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:49.308 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.302+0000 7f9402ffd640 1 -- 172.21.15.44:0/3694587877 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f27ee13da0 msgr2=0x55f27ee17d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:20:49.308 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.302+0000 7f9402ffd640 1 --2- 172.21.15.44:0/3694587877 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f27ee13da0 0x55f27ee17d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:49.308 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.302+0000 7f9402ffd640 1 -- 172.21.15.44:0/3694587877 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f27ee04fd0 msgr2=0x55f27ee17820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:20:49.308 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.302+0000 7f9402ffd640 1 --2- 172.21.15.44:0/3694587877 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f27ee04fd0 0x55f27ee17820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:49.308 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.302+0000 7f9402ffd640 1 -- 172.21.15.44:0/3694587877 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f27ee26330 con 0x55f27ee046b0 2024-08-19T00:20:49.308 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.302+0000 7f94027fc640 1 --2- 172.21.15.44:0/3694587877 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f27ee04fd0 0x55f27ee17820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:20:49.308 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.302+0000 7f9402ffd640 1 --2- 172.21.15.44:0/3694587877 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f27ee046b0 0x55f27ee1c4b0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f93f409b8a0 tx=0x7f93f40cf5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3de9a2c773d5e6f9 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:20:49.308 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.302+0000 7f93e2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:20:49.308 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.302+0000 7f93e2ffd640 1 -- 172.21.15.44:0/3694587877 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f40b9070 con 0x55f27ee046b0 2024-08-19T00:20:49.309 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.302+0000 7f93e2ffd640 1 -- 172.21.15.44:0/3694587877 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9533+0+0 (secure 0 0 0) 0x7f93f40a4140 con 0x55f27ee046b0 2024-08-19T00:20:49.309 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.302+0000 7f940c838740 1 -- 172.21.15.44:0/3694587877 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93f4084e50 con 0x55f27ee046b0 2024-08-19T00:20:49.309 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.302+0000 7f93e2ffd640 1 -- 172.21.15.44:0/3694587877 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f93f40a4380 con 0x55f27ee046b0 2024-08-19T00:20:49.309 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.302+0000 7f940c838740 10 client.16446 fetch_fsmap learned FSMap version 33 2024-08-19T00:20:49.309 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.302+0000 7f940c838740 1 -- 172.21.15.44:0/3694587877 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55f27ee26330 con 0x55f27ee046b0 2024-08-19T00:20:49.309 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.302+0000 7f93e2ffd640 1 -- 172.21.15.44:0/3694587877 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93f4084e50 con 0x55f27ee046b0 2024-08-19T00:20:49.309 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.302+0000 7f93e2ffd640 1 -- 172.21.15.44:0/3694587877 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f93f409ad60 con 0x55f27ee046b0 2024-08-19T00:20:49.309 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.302+0000 7f940c838740 10 client.16446 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:20:49.309 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.302+0000 7f940c838740 10 client.16446 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:20:49.309 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.302+0000 7f940c838740 20 client.16446 populate_metadata read hostname 'smithi044' 2024-08-19T00:20:49.309 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.302+0000 7f940c838740 1 --2- 172.21.15.44:0/3694587877 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55f27ee8e860 0x55f27ee90c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:20:49.309 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.303+0000 7f940c838740 4 client.16446 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-19T00:20:49.309 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.303+0000 7f940c838740 1 -- 172.21.15.44:0/3694587877 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f27ed70450 con 0x55f27ee8e860 2024-08-19T00:20:49.310 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.303+0000 7f94027fc640 1 --2- 172.21.15.44:0/3694587877 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55f27ee8e860 0x55f27ee90c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:20:49.310 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.303+0000 7f93e2ffd640 10 client.16446 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:20:49.310 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.303+0000 7f94027fc640 1 --2- 172.21.15.44:0/3694587877 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55f27ee8e860 0x55f27ee90c50 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=abfb51fdd19d6b06 server_cookie=76f81eacdb6d2749 in_seq=0 out_seq=0 2024-08-19T00:20:49.313 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.311+0000 7f93e2ffd640 1 -- 172.21.15.44:0/3694587877 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f27ed70450 con 0x55f27ee8e860 2024-08-19T00:20:49.313 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.311+0000 7f93e2ffd640 10 client.16446 handle_command_reply: tid=0 2024-08-19T00:20:49.313 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.311+0000 7f940c838740 1 client.16446 shutdown 2024-08-19T00:20:49.313 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.311+0000 7f940c838740 1 -- 172.21.15.44:0/3694587877 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f27ee046b0 msgr2=0x55f27ee1c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:20:49.313 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.311+0000 7f940c838740 1 --2- 172.21.15.44:0/3694587877 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f27ee046b0 0x55f27ee1c4b0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f93f409b8a0 tx=0x7f93f40cf5d0 comp rx=0 tx=0).stop 2024-08-19T00:20:49.314 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.311+0000 7f940c838740 1 -- 172.21.15.44:0/3694587877 shutdown_connections 2024-08-19T00:20:49.314 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.311+0000 7f940c838740 1 --2- 172.21.15.44:0/3694587877 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55f27ee8e860 0x55f27ee90c50 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:49.314 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.311+0000 7f940c838740 1 --2- 172.21.15.44:0/3694587877 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f27ee13da0 0x55f27ee17d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:49.314 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.312+0000 7f93e2ffd640 0 client.16446 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:20:49.314 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.312+0000 7f940c838740 1 --2- 172.21.15.44:0/3694587877 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f27ee04fd0 0x55f27ee17820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:49.314 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.312+0000 7f940c838740 1 --2- 172.21.15.44:0/3694587877 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f27ee046b0 0x55f27ee1c4b0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:49.314 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.312+0000 7f940c838740 1 -- 172.21.15.44:0/3694587877 >> 172.21.15.44:0/3694587877 conn(0x55f27ee00d40 msgr2=0x55f27edffea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:20:49.314 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.312+0000 7f940c838740 1 -- 172.21.15.44:0/3694587877 shutdown_connections 2024-08-19T00:20:49.314 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.312+0000 7f940c838740 1 -- 172.21.15.44:0/3694587877 wait complete. 2024-08-19T00:20:49.314 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.312+0000 7f940c838740 20 client.16446 trim_cache size 0 max 16384 2024-08-19T00:20:49.315 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:{ 2024-08-19T00:20:49.315 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "message": "", 2024-08-19T00:20:49.315 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "return_code": 0 2024-08-19T00:20:49.315 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:} 2024-08-19T00:20:49.315 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.312+0000 7f94099a3640 1 -- 172.21.15.44:0/1582640191 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f93ec0a2da0 msgr2=0x7f93ec0a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:20:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.312+0000 7f94099a3640 1 --2- 172.21.15.44:0/1582640191 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f93ec0a2da0 0x7f93ec0a5260 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f93fc009430 tx=0x7f93fc03f040 comp rx=0 tx=0).stop 2024-08-19T00:20:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.312+0000 7f94099a3640 1 -- 172.21.15.44:0/1582640191 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9404100700 msgr2=0x7f9404198e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:20:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.312+0000 7f94099a3640 1 --2- 172.21.15.44:0/1582640191 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9404100700 0x7f9404198e90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f93f400e9f0 tx=0x7f93f400eeb0 comp rx=0 tx=0).stop 2024-08-19T00:20:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.312+0000 7f94099a3640 1 -- 172.21.15.44:0/1582640191 shutdown_connections 2024-08-19T00:20:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.312+0000 7f94099a3640 1 --2- 172.21.15.44:0/1582640191 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f93ec0a2da0 0x7f93ec0a5260 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.312+0000 7f94099a3640 1 --2- 172.21.15.44:0/1582640191 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9404106710 0x7f94041a3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.312+0000 7f94099a3640 1 --2- 172.21.15.44:0/1582640191 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94041010a0 0x7f94041993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.312+0000 7f94099a3640 1 --2- 172.21.15.44:0/1582640191 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9404100700 0x7f9404198e90 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:20:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.312+0000 7f94099a3640 1 -- 172.21.15.44:0/1582640191 >> 172.21.15.44:0/1582640191 conn(0x7f94040fc420 msgr2=0x7f94040fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:20:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.312+0000 7f94099a3640 1 -- 172.21.15.44:0/1582640191 shutdown_connections 2024-08-19T00:20:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:20:49.312+0000 7f94099a3640 1 -- 172.21.15.44:0/1582640191 wait complete. 2024-08-19T00:20:49.684 INFO:tasks.workunit.client.0.smithi044.stdout: 1 562038 8.47 MB/sec execute 254 sec latency 46.134 ms 2024-08-19T00:20:50.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:20:50 smithi171 ceph-mon[21810]: pgmap v230: 129 pgs: 129 active+clean; 405 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.5 MiB/s wr, 216 op/s 2024-08-19T00:20:50.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:20:50 smithi116 ceph-mon[21873]: pgmap v230: 129 pgs: 129 active+clean; 405 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.5 MiB/s wr, 216 op/s 2024-08-19T00:20:50.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:20:50 smithi044 ceph-mon[18489]: pgmap v230: 129 pgs: 129 active+clean; 405 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.5 MiB/s wr, 216 op/s 2024-08-19T00:20:50.684 INFO:tasks.workunit.client.0.smithi044.stdout: 1 564169 8.48 MB/sec execute 255 sec latency 20.613 ms 2024-08-19T00:20:51.684 INFO:tasks.workunit.client.0.smithi044.stdout: 1 566219 8.49 MB/sec execute 256 sec latency 19.211 ms 2024-08-19T00:20:52.394 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:20:52 smithi171 ceph-mon[21810]: pgmap v231: 129 pgs: 129 active+clean; 413 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.1 MiB/s wr, 330 op/s 2024-08-19T00:20:52.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:20:52 smithi116 ceph-mon[21873]: pgmap v231: 129 pgs: 129 active+clean; 413 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.1 MiB/s wr, 330 op/s 2024-08-19T00:20:52.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:20:52 smithi044 ceph-mon[18489]: pgmap v231: 129 pgs: 129 active+clean; 413 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.1 MiB/s wr, 330 op/s 2024-08-19T00:20:52.684 INFO:tasks.workunit.client.0.smithi044.stdout: 1 568590 8.51 MB/sec execute 257 sec latency 18.387 ms 2024-08-19T00:20:53.684 INFO:tasks.workunit.client.0.smithi044.stdout: 1 570703 8.51 MB/sec execute 258 sec latency 19.779 ms 2024-08-19T00:20:54.417 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:20:54 smithi116 ceph-mon[21873]: pgmap v232: 129 pgs: 129 active+clean; 413 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.3 MiB/s wr, 218 op/s 2024-08-19T00:20:54.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:20:54 smithi171 ceph-mon[21810]: pgmap v232: 129 pgs: 129 active+clean; 413 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.3 MiB/s wr, 218 op/s 2024-08-19T00:20:54.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:20:54 smithi044 ceph-mon[18489]: pgmap v232: 129 pgs: 129 active+clean; 413 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.3 MiB/s wr, 218 op/s 2024-08-19T00:20:54.684 INFO:tasks.workunit.client.0.smithi044.stdout: 1 572481 8.52 MB/sec execute 259 sec latency 25.106 ms 2024-08-19T00:20:55.684 INFO:tasks.workunit.client.0.smithi044.stdout: 1 574385 8.52 MB/sec execute 260 sec latency 29.622 ms 2024-08-19T00:20:56.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:20:56 smithi171 ceph-mon[21810]: pgmap v233: 129 pgs: 129 active+clean; 423 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.1 MiB/s wr, 327 op/s 2024-08-19T00:20:56.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:20:56 smithi116 ceph-mon[21873]: pgmap v233: 129 pgs: 129 active+clean; 423 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.1 MiB/s wr, 327 op/s 2024-08-19T00:20:56.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:20:56 smithi044 ceph-mon[18489]: pgmap v233: 129 pgs: 129 active+clean; 423 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.1 MiB/s wr, 327 op/s 2024-08-19T00:20:56.684 INFO:tasks.workunit.client.0.smithi044.stdout: 1 576620 8.54 MB/sec execute 261 sec latency 13.743 ms 2024-08-19T00:20:57.686 INFO:tasks.workunit.client.0.smithi044.stdout: 1 579222 8.57 MB/sec execute 262 sec latency 15.683 ms 2024-08-19T00:20:58.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:20:58 smithi171 ceph-mon[21810]: pgmap v234: 129 pgs: 129 active+clean; 423 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.5 MiB/s wr, 222 op/s 2024-08-19T00:20:58.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:20:58 smithi116 ceph-mon[21873]: pgmap v234: 129 pgs: 129 active+clean; 423 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.5 MiB/s wr, 222 op/s 2024-08-19T00:20:58.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:20:58 smithi044 ceph-mon[18489]: pgmap v234: 129 pgs: 129 active+clean; 423 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.5 MiB/s wr, 222 op/s 2024-08-19T00:20:58.684 INFO:tasks.workunit.client.0.smithi044.stdout: 1 581305 8.57 MB/sec execute 263 sec latency 13.755 ms 2024-08-19T00:20:59.684 INFO:tasks.workunit.client.0.smithi044.stdout: 1 583243 8.58 MB/sec execute 264 sec latency 63.212 ms 2024-08-19T00:21:00.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:21:00 smithi171 ceph-mon[21810]: pgmap v235: 129 pgs: 129 active+clean; 423 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.5 MiB/s wr, 222 op/s 2024-08-19T00:21:00.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:21:00 smithi116 ceph-mon[21873]: pgmap v235: 129 pgs: 129 active+clean; 423 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.5 MiB/s wr, 222 op/s 2024-08-19T00:21:00.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:21:00 smithi044 ceph-mon[18489]: pgmap v235: 129 pgs: 129 active+clean; 423 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.5 MiB/s wr, 222 op/s 2024-08-19T00:21:00.684 INFO:tasks.workunit.client.0.smithi044.stdout: 1 584804 8.57 MB/sec execute 265 sec latency 62.405 ms 2024-08-19T00:21:01.684 INFO:tasks.workunit.client.0.smithi044.stdout: 1 586070 8.58 MB/sec execute 266 sec latency 88.228 ms 2024-08-19T00:21:02.412 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.407+0000 7f764ad54640 1 -- 172.21.15.44:0/1092372993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f764410be00 msgr2=0x7f764410e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:02.412 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.407+0000 7f764ad54640 1 --2- 172.21.15.44:0/1092372993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f764410be00 0x7f764410e280 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f763c009ca0 tx=0x7f763c02a950 comp rx=0 tx=0).stop 2024-08-19T00:21:02.412 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.407+0000 7f764ad54640 1 -- 172.21.15.44:0/1092372993 shutdown_connections 2024-08-19T00:21:02.412 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.407+0000 7f764ad54640 1 --2- 172.21.15.44:0/1092372993 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76441032d0 0x7f764410b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:02.412 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.407+0000 7f764ad54640 1 --2- 172.21.15.44:0/1092372993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f764410be00 0x7f764410e280 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:02.412 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.407+0000 7f764ad54640 1 --2- 172.21.15.44:0/1092372993 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f76441029b0 0x7f7644102d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:02.412 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.407+0000 7f764ad54640 1 -- 172.21.15.44:0/1092372993 >> 172.21.15.44:0/1092372993 conn(0x7f76440776c0 msgr2=0x7f76440fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:21:02.412 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.407+0000 7f764ad54640 1 -- 172.21.15.44:0/1092372993 shutdown_connections 2024-08-19T00:21:02.412 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.408+0000 7f764ad54640 1 -- 172.21.15.44:0/1092372993 wait complete. 2024-08-19T00:21:02.412 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.408+0000 7f764ad54640 1 Processor -- start 2024-08-19T00:21:02.413 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.408+0000 7f764ad54640 1 -- start start 2024-08-19T00:21:02.413 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.408+0000 7f764ad54640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76441029b0 0x7f7644197ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:02.413 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.408+0000 7f764ad54640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f76441032d0 0x7f7644198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:02.413 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.408+0000 7f764ad54640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f764410be00 0x7f764419c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:02.413 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.408+0000 7f764ad54640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7644111c10 con 0x7f76441032d0 2024-08-19T00:21:02.413 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.408+0000 7f764ad54640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f7644111a90 con 0x7f764410be00 2024-08-19T00:21:02.413 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.408+0000 7f764ad54640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7644111d90 con 0x7f76441029b0 2024-08-19T00:21:02.413 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.408+0000 7f7643fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f76441032d0 0x7f7644198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:02.413 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.408+0000 7f7648af0640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76441029b0 0x7f7644197ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:02.413 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.408+0000 7f7643fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f76441032d0 0x7f7644198530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34726/0 (socket says 172.21.15.44:34726) 2024-08-19T00:21:02.413 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.408+0000 7f7643fff640 1 -- 172.21.15.44:0/3815787580 learned_addr learned my addr 172.21.15.44:0/3815787580 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:21:02.413 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.408+0000 7f7648af0640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76441029b0 0x7f7644197ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.44:39260/0 (socket says 172.21.15.44:39260) 2024-08-19T00:21:02.413 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.408+0000 7f76492f1640 1 --2- 172.21.15.44:0/3815787580 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f764410be00 0x7f764419c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:02.414 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.409+0000 7f7643fff640 1 -- 172.21.15.44:0/3815787580 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76441029b0 msgr2=0x7f7644197ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:02.414 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.409+0000 7f7643fff640 1 --2- 172.21.15.44:0/3815787580 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76441029b0 0x7f7644197ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:02.414 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.409+0000 7f7643fff640 1 -- 172.21.15.44:0/3815787580 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f764410be00 msgr2=0x7f764419c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:02.414 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.409+0000 7f7643fff640 1 --2- 172.21.15.44:0/3815787580 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f764410be00 0x7f764419c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:02.414 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.409+0000 7f7643fff640 1 -- 172.21.15.44:0/3815787580 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f764419cfe0 con 0x7f76441032d0 2024-08-19T00:21:02.414 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.409+0000 7f7643fff640 1 --2- 172.21.15.44:0/3815787580 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f76441032d0 0x7f7644198530 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f763000e9f0 tx=0x7f763000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:21:02.414 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.409+0000 7f7641ffb640 1 -- 172.21.15.44:0/3815787580 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f763000ccc0 con 0x7f76441032d0 2024-08-19T00:21:02.414 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.409+0000 7f7641ffb640 1 -- 172.21.15.44:0/3815787580 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f763000ce60 con 0x7f76441032d0 2024-08-19T00:21:02.414 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.409+0000 7f7641ffb640 1 -- 172.21.15.44:0/3815787580 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7630010690 con 0x7f76441032d0 2024-08-19T00:21:02.414 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.409+0000 7f764ad54640 1 -- 172.21.15.44:0/3815787580 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f764419d2d0 con 0x7f76441032d0 2024-08-19T00:21:02.414 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.409+0000 7f764ad54640 1 -- 172.21.15.44:0/3815787580 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76441a4b60 con 0x7f76441032d0 2024-08-19T00:21:02.421 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.412+0000 7f7641ffb640 1 -- 172.21.15.44:0/3815787580 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f76300046c0 con 0x7f76441032d0 2024-08-19T00:21:02.421 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.412+0000 7f764dbf1740 1 Processor -- start 2024-08-19T00:21:02.422 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.412+0000 7f764dbf1740 1 -- start start 2024-08-19T00:21:02.422 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.413+0000 7f764dbf1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560bcb8077d0 0x560bcb807bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:02.422 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.413+0000 7f764dbf1740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560bcb8080f0 0x560bcb812450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:02.422 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.413+0000 7f764dbf1740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560bcb812990 0x560bcb814d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:02.422 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.413+0000 7f764dbf1740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x560bcb76b9d0 con 0x560bcb8077d0 2024-08-19T00:21:02.422 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.413+0000 7f764dbf1740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x560bcb713820 con 0x560bcb812990 2024-08-19T00:21:02.422 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.413+0000 7f764dbf1740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x560bcb767990 con 0x560bcb8080f0 2024-08-19T00:21:02.422 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.413+0000 7f7641ffb640 1 --2- 172.21.15.44:0/3815787580 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f76340a2da0 0x7f76340a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:02.422 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.413+0000 7f76492f1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560bcb8077d0 0x560bcb807bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:02.422 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.413+0000 7f76492f1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560bcb8077d0 0x560bcb807bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34730/0 (socket says 172.21.15.44:34730) 2024-08-19T00:21:02.422 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.413+0000 7f7648af0640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560bcb8080f0 0x560bcb812450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:02.422 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.413+0000 7f76492f1640 1 -- 172.21.15.44:0/805954487 learned_addr learned my addr 172.21.15.44:0/805954487 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:21:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.413+0000 7f7643fff640 1 --2- 172.21.15.44:0/805954487 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560bcb812990 0x560bcb814d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.413+0000 7f76492f1640 1 --2- 172.21.15.44:0/3815787580 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f76340a2da0 0x7f76340a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.413+0000 7f7641ffb640 1 -- 172.21.15.44:0/3815787580 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9533+0+0 (secure 0 0 0) 0x7f76300cfb30 con 0x7f76441032d0 2024-08-19T00:21:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.413+0000 7f7648af0640 1 -- 172.21.15.44:0/805954487 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560bcb812990 msgr2=0x560bcb814d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.413+0000 7f7648af0640 1 --2- 172.21.15.44:0/805954487 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560bcb812990 0x560bcb814d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.413+0000 7f7648af0640 1 -- 172.21.15.44:0/805954487 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560bcb8077d0 msgr2=0x560bcb807bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.413+0000 7f7648af0640 1 --2- 172.21.15.44:0/805954487 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560bcb8077d0 0x560bcb807bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.413+0000 7f7648af0640 1 -- 172.21.15.44:0/805954487 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560bcb47f210 con 0x560bcb8080f0 2024-08-19T00:21:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.413+0000 7f76492f1640 1 --2- 172.21.15.44:0/805954487 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560bcb8077d0 0x560bcb807bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:21:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.414+0000 7f7648af0640 1 --2- 172.21.15.44:0/805954487 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560bcb8080f0 0x560bcb812450 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7638009c20 tx=0x7f7638011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6a17d972df640f1 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:21:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.414+0000 7f76492f1640 1 --2- 172.21.15.44:0/3815787580 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f76340a2da0 0x7f76340a5260 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f763c005fe0 tx=0x7f763c005d80 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:21:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.414+0000 7f762effd640 1 -- 172.21.15.44:0/805954487 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7638004050 con 0x560bcb8080f0 2024-08-19T00:21:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.414+0000 7f762effd640 1 -- 172.21.15.44:0/805954487 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7638005500 con 0x560bcb8080f0 2024-08-19T00:21:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.414+0000 7f762effd640 1 -- 172.21.15.44:0/805954487 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76380035f0 con 0x560bcb8080f0 2024-08-19T00:21:02.424 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.414+0000 7f764dbf1740 1 -- 172.21.15.44:0/805954487 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560bcb8080f0 msgr2=0x560bcb812450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:02.424 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.414+0000 7f764dbf1740 1 --2- 172.21.15.44:0/805954487 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560bcb8080f0 0x560bcb812450 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7638009c20 tx=0x7f7638011810 comp rx=0 tx=0).stop 2024-08-19T00:21:02.424 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.415+0000 7f764dbf1740 1 -- 172.21.15.44:0/805954487 shutdown_connections 2024-08-19T00:21:02.424 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.415+0000 7f764dbf1740 1 --2- 172.21.15.44:0/805954487 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560bcb8080f0 0x560bcb812450 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:02.424 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.415+0000 7f764dbf1740 1 --2- 172.21.15.44:0/805954487 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560bcb812990 0x560bcb814d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:02.424 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.415+0000 7f764dbf1740 1 --2- 172.21.15.44:0/805954487 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560bcb8077d0 0x560bcb807bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:02.424 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.415+0000 7f764dbf1740 1 -- 172.21.15.44:0/805954487 >> 172.21.15.44:0/805954487 conn(0x560bcb803d40 msgr2=0x560bcb804120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:21:02.424 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.415+0000 7f764dbf1740 1 -- 172.21.15.44:0/805954487 shutdown_connections 2024-08-19T00:21:02.424 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.415+0000 7f764dbf1740 1 -- 172.21.15.44:0/805954487 wait complete. 2024-08-19T00:21:02.424 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.415+0000 7f764dbf1740 1 -- start start 2024-08-19T00:21:02.424 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.415+0000 7f764dbf1740 1 Processor -- start 2024-08-19T00:21:02.424 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.415+0000 7f764dbf1740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560bcb8077d0 0x560bcb80f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:02.425 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.415+0000 7f764dbf1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560bcb8080f0 0x560bcb80fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:02.425 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.415+0000 7f764dbf1740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560bcb812990 0x560bcb810320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:02.425 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.415+0000 7f764dbf1740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x560bcb815560 con 0x560bcb8080f0 2024-08-19T00:21:02.425 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.415+0000 7f764dbf1740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x560bcb727520 con 0x560bcb8077d0 2024-08-19T00:21:02.425 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.415+0000 7f764dbf1740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x560bcb8156e0 con 0x560bcb812990 2024-08-19T00:21:02.425 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.416+0000 7f764dbf1740 10 client.0 _ll_register_callbacks cb 0x560bcb47ea00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:21:02.425 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.416+0000 7f7643fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560bcb8080f0 0x560bcb80fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:02.425 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.416+0000 7f7643fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560bcb8080f0 0x560bcb80fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34738/0 (socket says 172.21.15.44:34738) 2024-08-19T00:21:02.425 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.416+0000 7f7643fff640 1 -- 172.21.15.44:0/2819553856 learned_addr learned my addr 172.21.15.44:0/2819553856 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:21:02.425 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.416+0000 7f7648af0640 1 --2- 172.21.15.44:0/2819553856 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560bcb8077d0 0x560bcb80f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:02.425 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.416+0000 7f76492f1640 1 --2- 172.21.15.44:0/2819553856 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560bcb812990 0x560bcb810320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:02.425 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.416+0000 7f7643fff640 1 -- 172.21.15.44:0/2819553856 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560bcb812990 msgr2=0x560bcb810320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:02.426 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.416+0000 7f7643fff640 1 --2- 172.21.15.44:0/2819553856 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560bcb812990 0x560bcb810320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:02.426 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.416+0000 7f7643fff640 1 -- 172.21.15.44:0/2819553856 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560bcb8077d0 msgr2=0x560bcb80f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:02.426 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.416+0000 7f7643fff640 1 --2- 172.21.15.44:0/2819553856 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560bcb8077d0 0x560bcb80f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:02.426 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.416+0000 7f7643fff640 1 -- 172.21.15.44:0/2819553856 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560bcb54b620 con 0x560bcb8080f0 2024-08-19T00:21:02.426 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.416+0000 7f7648af0640 1 --2- 172.21.15.44:0/2819553856 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560bcb8077d0 0x560bcb80f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:21:02.426 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.416+0000 7f7643fff640 1 --2- 172.21.15.44:0/2819553856 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560bcb8080f0 0x560bcb80fde0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f763000d010 tx=0x7f763009b5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfc06ee486626124 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:21:02.426 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.416+0000 7f7623fff640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:21:02.426 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.416+0000 7f7623fff640 1 -- 172.21.15.44:0/2819553856 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76300b9060 con 0x560bcb8080f0 2024-08-19T00:21:02.427 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.416+0000 7f764dbf1740 1 -- 172.21.15.44:0/2819553856 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7638005500 con 0x560bcb8080f0 2024-08-19T00:21:02.427 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.416+0000 7f7623fff640 1 -- 172.21.15.44:0/2819553856 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9533+0+0 (secure 0 0 0) 0x7f76300a4640 con 0x560bcb8080f0 2024-08-19T00:21:02.427 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.416+0000 7f7623fff640 1 -- 172.21.15.44:0/2819553856 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f76300b4e60 con 0x560bcb8080f0 2024-08-19T00:21:02.427 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.416+0000 7f764dbf1740 10 client.16458 fetch_fsmap learned FSMap version 33 2024-08-19T00:21:02.427 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.416+0000 7f764dbf1740 1 -- 172.21.15.44:0/2819553856 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x560bcb8211e0 con 0x560bcb8080f0 2024-08-19T00:21:02.427 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.417+0000 7f7623fff640 1 -- 172.21.15.44:0/2819553856 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7638005500 con 0x560bcb8080f0 2024-08-19T00:21:02.427 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.417+0000 7f7623fff640 1 -- 172.21.15.44:0/2819553856 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f763009ab20 con 0x560bcb8080f0 2024-08-19T00:21:02.427 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.417+0000 7f764dbf1740 10 client.16458 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:21:02.427 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.417+0000 7f764dbf1740 10 client.16458 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:21:02.427 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.417+0000 7f764dbf1740 20 client.16458 populate_metadata read hostname 'smithi044' 2024-08-19T00:21:02.427 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.417+0000 7f764dbf1740 1 --2- 172.21.15.44:0/2819553856 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x560bcb822650 0x560bcb824a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:02.427 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.417+0000 7f764dbf1740 4 client.16458 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:21:02.427 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.417+0000 7f764dbf1740 1 -- 172.21.15.44:0/2819553856 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560bcb779100 con 0x560bcb822650 2024-08-19T00:21:02.428 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.417+0000 7f7648af0640 1 --2- 172.21.15.44:0/2819553856 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x560bcb822650 0x560bcb824a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:02.428 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.418+0000 7f7623fff640 10 client.16458 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:21:02.428 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.418+0000 7f7648af0640 1 --2- 172.21.15.44:0/2819553856 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x560bcb822650 0x560bcb824a40 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63582fd657fa0401 server_cookie=a6493b258a720119 in_seq=0 out_seq=0 2024-08-19T00:21:02.428 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.418+0000 7f7623fff640 1 -- 172.21.15.44:0/2819553856 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560bcb779100 con 0x560bcb822650 2024-08-19T00:21:02.428 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.418+0000 7f7623fff640 10 client.16458 handle_command_reply: tid=0 2024-08-19T00:21:02.428 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.418+0000 7f764dbf1740 1 client.16458 shutdown 2024-08-19T00:21:02.428 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.419+0000 7f764dbf1740 1 -- 172.21.15.44:0/2819553856 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560bcb8080f0 msgr2=0x560bcb80fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:02.428 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.419+0000 7f764dbf1740 1 --2- 172.21.15.44:0/2819553856 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560bcb8080f0 0x560bcb80fde0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f763000d010 tx=0x7f763009b5c0 comp rx=0 tx=0).stop 2024-08-19T00:21:02.428 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.419+0000 7f764dbf1740 1 -- 172.21.15.44:0/2819553856 shutdown_connections 2024-08-19T00:21:02.429 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.419+0000 7f764dbf1740 1 --2- 172.21.15.44:0/2819553856 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x560bcb822650 0x560bcb824a40 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:02.429 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.419+0000 7f764dbf1740 1 --2- 172.21.15.44:0/2819553856 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560bcb812990 0x560bcb810320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:02.429 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.419+0000 7f764dbf1740 1 --2- 172.21.15.44:0/2819553856 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560bcb8080f0 0x560bcb80fde0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:02.429 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.419+0000 7f7623fff640 0 client.16458 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:21:02.429 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.419+0000 7f764dbf1740 1 --2- 172.21.15.44:0/2819553856 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560bcb8077d0 0x560bcb80f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:02.429 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.419+0000 7f764dbf1740 1 -- 172.21.15.44:0/2819553856 >> 172.21.15.44:0/2819553856 conn(0x560bcb803d40 msgr2=0x560bcb809aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:21:02.429 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.419+0000 7f764dbf1740 1 -- 172.21.15.44:0/2819553856 shutdown_connections 2024-08-19T00:21:02.429 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.419+0000 7f764dbf1740 1 -- 172.21.15.44:0/2819553856 wait complete. 2024-08-19T00:21:02.429 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.419+0000 7f764dbf1740 20 client.16458 trim_cache size 0 max 16384 2024-08-19T00:21:02.440 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.433+0000 7f764dbf1740 1 Processor -- start 2024-08-19T00:21:02.440 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.433+0000 7f764dbf1740 1 -- start start 2024-08-19T00:21:02.440 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.433+0000 7f764dbf1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560bcb8077d0 0x560bcb811700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:02.440 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.433+0000 7f764dbf1740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560bcb8080f0 0x560bcb82a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:02.441 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.433+0000 7f764dbf1740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560bcb812990 0x560bcb82a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:02.441 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.433+0000 7f764dbf1740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f76441aed80 con 0x560bcb8077d0 2024-08-19T00:21:02.441 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.433+0000 7f764dbf1740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f76441b08c0 con 0x560bcb8080f0 2024-08-19T00:21:02.441 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.434+0000 7f764dbf1740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f76441af450 con 0x560bcb812990 2024-08-19T00:21:02.441 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.434+0000 7f7648af0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560bcb8077d0 0x560bcb811700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:02.441 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.434+0000 7f7648af0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560bcb8077d0 0x560bcb811700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34746/0 (socket says 172.21.15.44:34746) 2024-08-19T00:21:02.441 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.434+0000 7f7648af0640 1 -- 172.21.15.44:0/543474649 learned_addr learned my addr 172.21.15.44:0/543474649 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:21:02.441 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.434+0000 7f7643fff640 1 --2- 172.21.15.44:0/543474649 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560bcb8080f0 0x560bcb82a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:02.441 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.434+0000 7f76492f1640 1 --2- 172.21.15.44:0/543474649 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560bcb812990 0x560bcb82a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:02.441 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.434+0000 7f7648af0640 1 -- 172.21.15.44:0/543474649 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560bcb812990 msgr2=0x560bcb82a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:02.441 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.434+0000 7f7648af0640 1 --2- 172.21.15.44:0/543474649 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560bcb812990 0x560bcb82a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:02.441 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.434+0000 7f7648af0640 1 -- 172.21.15.44:0/543474649 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560bcb8080f0 msgr2=0x560bcb82a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:02.441 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.434+0000 7f7648af0640 1 --2- 172.21.15.44:0/543474649 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560bcb8080f0 0x560bcb82a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:02.442 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.434+0000 7f7648af0640 1 -- 172.21.15.44:0/543474649 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560bcb807f20 con 0x560bcb8077d0 2024-08-19T00:21:02.442 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.434+0000 7f7643fff640 1 --2- 172.21.15.44:0/543474649 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560bcb8080f0 0x560bcb82a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:21:02.442 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.434+0000 7f7648af0640 1 --2- 172.21.15.44:0/543474649 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560bcb8077d0 0x560bcb811700 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f7638009250 tx=0x7f7638005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98775a8625d56651 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:21:02.442 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.434+0000 7f762e7fc640 1 -- 172.21.15.44:0/543474649 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7638033070 con 0x560bcb8077d0 2024-08-19T00:21:02.442 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.434+0000 7f762e7fc640 1 -- 172.21.15.44:0/543474649 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7638004360 con 0x560bcb8077d0 2024-08-19T00:21:02.442 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.434+0000 7f762e7fc640 1 -- 172.21.15.44:0/543474649 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f763802e650 con 0x560bcb8077d0 2024-08-19T00:21:02.442 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.435+0000 7f764dbf1740 1 -- 172.21.15.44:0/543474649 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560bcb8077d0 msgr2=0x560bcb811700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:02.442 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.435+0000 7f764dbf1740 1 --2- 172.21.15.44:0/543474649 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560bcb8077d0 0x560bcb811700 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f7638009250 tx=0x7f7638005f90 comp rx=0 tx=0).stop 2024-08-19T00:21:02.442 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.435+0000 7f764dbf1740 1 -- 172.21.15.44:0/543474649 shutdown_connections 2024-08-19T00:21:02.443 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.435+0000 7f764dbf1740 1 --2- 172.21.15.44:0/543474649 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560bcb812990 0x560bcb82a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:02.443 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.435+0000 7f764dbf1740 1 --2- 172.21.15.44:0/543474649 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560bcb8080f0 0x560bcb82a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:02.443 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.435+0000 7f764dbf1740 1 --2- 172.21.15.44:0/543474649 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560bcb8077d0 0x560bcb811700 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:02.443 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.435+0000 7f764dbf1740 1 -- 172.21.15.44:0/543474649 >> 172.21.15.44:0/543474649 conn(0x560bcb803d40 msgr2=0x560bcb810ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:21:02.443 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.435+0000 7f764dbf1740 1 -- 172.21.15.44:0/543474649 shutdown_connections 2024-08-19T00:21:02.443 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.435+0000 7f764dbf1740 1 -- 172.21.15.44:0/543474649 wait complete. 2024-08-19T00:21:02.443 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.435+0000 7f764dbf1740 1 -- start start 2024-08-19T00:21:02.443 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.435+0000 7f764dbf1740 1 Processor -- start 2024-08-19T00:21:02.443 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.436+0000 7f764dbf1740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560bcb8077d0 0x560bcb81b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:02.443 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.436+0000 7f764dbf1740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560bcb8080f0 0x560bcb816550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:02.443 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.436+0000 7f764dbf1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560bcb812990 0x560bcb816ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:02.443 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.436+0000 7f764dbf1740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f76441b01f0 con 0x560bcb812990 2024-08-19T00:21:02.444 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.436+0000 7f764dbf1740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f76441afb20 con 0x560bcb8077d0 2024-08-19T00:21:02.444 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.436+0000 7f764dbf1740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f76441acd80 con 0x560bcb8080f0 2024-08-19T00:21:02.444 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.436+0000 7f764dbf1740 10 client.0 _ll_register_callbacks cb 0x7f7630097f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:21:02.444 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.436+0000 7f7643fff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560bcb8080f0 0x560bcb816550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:02.444 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.436+0000 7f7648af0640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560bcb8077d0 0x560bcb81b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:02.444 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.436+0000 7f76492f1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560bcb812990 0x560bcb816ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:02.444 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.436+0000 7f7643fff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560bcb8080f0 0x560bcb816550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.44:39312/0 (socket says 172.21.15.44:39312) 2024-08-19T00:21:02.444 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.436+0000 7f7648af0640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560bcb8077d0 0x560bcb81b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.44:46526/0 (socket says 172.21.15.44:46526) 2024-08-19T00:21:02.444 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.436+0000 7f7643fff640 1 -- 172.21.15.44:0/4141202670 learned_addr learned my addr 172.21.15.44:0/4141202670 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:21:02.444 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.436+0000 7f76492f1640 1 -- 172.21.15.44:0/4141202670 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560bcb8080f0 msgr2=0x560bcb816550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:02.444 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.436+0000 7f76492f1640 1 --2- 172.21.15.44:0/4141202670 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560bcb8080f0 0x560bcb816550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:02.444 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.436+0000 7f76492f1640 1 -- 172.21.15.44:0/4141202670 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560bcb8077d0 msgr2=0x560bcb81b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:02.444 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.436+0000 7f76492f1640 1 --2- 172.21.15.44:0/4141202670 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560bcb8077d0 0x560bcb81b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:02.445 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.436+0000 7f76492f1640 1 -- 172.21.15.44:0/4141202670 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560bcb88c2b0 con 0x560bcb812990 2024-08-19T00:21:02.445 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.436+0000 7f7648af0640 1 --2- 172.21.15.44:0/4141202670 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560bcb8077d0 0x560bcb81b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:21:02.445 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.436+0000 7f7643fff640 1 --2- 172.21.15.44:0/4141202670 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560bcb8080f0 0x560bcb816550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:21:02.445 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.436+0000 7f76492f1640 1 --2- 172.21.15.44:0/4141202670 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560bcb812990 0x560bcb816ce0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f763c009a60 tx=0x7f763c0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb855754f03f91b4 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:21:02.445 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.436+0000 7f7623fff640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:21:02.445 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.437+0000 7f7623fff640 1 -- 172.21.15.44:0/4141202670 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f763c059060 con 0x560bcb812990 2024-08-19T00:21:02.445 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.437+0000 7f7623fff640 1 -- 172.21.15.44:0/4141202670 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9533+0+0 (secure 0 0 0) 0x7f763c045070 con 0x560bcb812990 2024-08-19T00:21:02.445 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.437+0000 7f764dbf1740 1 -- 172.21.15.44:0/4141202670 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7638004360 con 0x560bcb812990 2024-08-19T00:21:02.445 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.437+0000 7f7623fff640 1 -- 172.21.15.44:0/4141202670 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f763c034040 con 0x560bcb812990 2024-08-19T00:21:02.445 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.437+0000 7f764dbf1740 10 client.16464 fetch_fsmap learned FSMap version 33 2024-08-19T00:21:02.445 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.437+0000 7f764dbf1740 1 -- 172.21.15.44:0/4141202670 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x560bcb88d440 con 0x560bcb812990 2024-08-19T00:21:02.445 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.437+0000 7f7623fff640 1 -- 172.21.15.44:0/4141202670 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7638004360 con 0x560bcb812990 2024-08-19T00:21:02.445 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.437+0000 7f7623fff640 1 -- 172.21.15.44:0/4141202670 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f763c048040 con 0x560bcb812990 2024-08-19T00:21:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.437+0000 7f764dbf1740 10 client.16464 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:21:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.437+0000 7f764dbf1740 10 client.16464 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:21:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.437+0000 7f764dbf1740 20 client.16464 populate_metadata read hostname 'smithi044' 2024-08-19T00:21:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.437+0000 7f764dbf1740 1 --2- 172.21.15.44:0/4141202670 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x560bcb88db60 0x560bcb88ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.437+0000 7f764dbf1740 4 client.16464 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-19T00:21:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.437+0000 7f764dbf1740 1 -- 172.21.15.44:0/4141202670 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560bcb80b480 con 0x560bcb88db60 2024-08-19T00:21:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.437+0000 7f7648af0640 1 --2- 172.21.15.44:0/4141202670 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x560bcb88db60 0x560bcb88ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.438+0000 7f7623fff640 10 client.16464 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:21:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.438+0000 7f7648af0640 1 --2- 172.21.15.44:0/4141202670 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x560bcb88db60 0x560bcb88ff50 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b98db12aa4a102f4 server_cookie=2311cc7c3ecac2 in_seq=0 out_seq=0 2024-08-19T00:21:02.449 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.447+0000 7f7623fff640 1 -- 172.21.15.44:0/4141202670 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560bcb80b480 con 0x560bcb88db60 2024-08-19T00:21:02.450 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.447+0000 7f7623fff640 10 client.16464 handle_command_reply: tid=0 2024-08-19T00:21:02.450 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.447+0000 7f764dbf1740 1 client.16464 shutdown 2024-08-19T00:21:02.450 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.448+0000 7f764dbf1740 1 -- 172.21.15.44:0/4141202670 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560bcb812990 msgr2=0x560bcb816ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:02.450 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.448+0000 7f764dbf1740 1 --2- 172.21.15.44:0/4141202670 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560bcb812990 0x560bcb816ce0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f763c009a60 tx=0x7f763c0095c0 comp rx=0 tx=0).stop 2024-08-19T00:21:02.450 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.448+0000 7f764dbf1740 1 -- 172.21.15.44:0/4141202670 shutdown_connections 2024-08-19T00:21:02.450 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.448+0000 7f764dbf1740 1 --2- 172.21.15.44:0/4141202670 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x560bcb88db60 0x560bcb88ff50 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:02.450 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.448+0000 7f764dbf1740 1 --2- 172.21.15.44:0/4141202670 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560bcb8080f0 0x560bcb816550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:02.450 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.448+0000 7f764dbf1740 1 --2- 172.21.15.44:0/4141202670 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560bcb812990 0x560bcb816ce0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:02.450 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.448+0000 7f7623fff640 0 client.16464 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:21:02.450 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.448+0000 7f764dbf1740 1 --2- 172.21.15.44:0/4141202670 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560bcb8077d0 0x560bcb81b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:02.450 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.448+0000 7f764dbf1740 1 -- 172.21.15.44:0/4141202670 >> 172.21.15.44:0/4141202670 conn(0x560bcb803d40 msgr2=0x560bcb802ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:21:02.450 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.448+0000 7f764dbf1740 1 -- 172.21.15.44:0/4141202670 shutdown_connections 2024-08-19T00:21:02.451 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.448+0000 7f764dbf1740 1 -- 172.21.15.44:0/4141202670 wait complete. 2024-08-19T00:21:02.451 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.448+0000 7f764dbf1740 20 client.16464 trim_cache size 0 max 16384 2024-08-19T00:21:02.451 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:{ 2024-08-19T00:21:02.451 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "message": "", 2024-08-19T00:21:02.451 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "return_code": 0 2024-08-19T00:21:02.451 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:} 2024-08-19T00:21:02.452 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.448+0000 7f764ad54640 1 -- 172.21.15.44:0/3815787580 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f76340a2da0 msgr2=0x7f76340a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:02.452 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.448+0000 7f764ad54640 1 --2- 172.21.15.44:0/3815787580 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f76340a2da0 0x7f76340a5260 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f763c005fe0 tx=0x7f763c005d80 comp rx=0 tx=0).stop 2024-08-19T00:21:02.452 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.448+0000 7f764ad54640 1 -- 172.21.15.44:0/3815787580 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f76441032d0 msgr2=0x7f7644198530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:02.452 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.448+0000 7f764ad54640 1 --2- 172.21.15.44:0/3815787580 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f76441032d0 0x7f7644198530 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f763000e9f0 tx=0x7f763000eeb0 comp rx=0 tx=0).stop 2024-08-19T00:21:02.452 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.448+0000 7f764ad54640 1 -- 172.21.15.44:0/3815787580 shutdown_connections 2024-08-19T00:21:02.452 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.448+0000 7f764ad54640 1 --2- 172.21.15.44:0/3815787580 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f76340a2da0 0x7f76340a5260 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:02.452 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.448+0000 7f764ad54640 1 --2- 172.21.15.44:0/3815787580 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f764410be00 0x7f764419c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:02.453 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.449+0000 7f764ad54640 1 --2- 172.21.15.44:0/3815787580 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f76441032d0 0x7f7644198530 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:02.453 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.449+0000 7f764ad54640 1 --2- 172.21.15.44:0/3815787580 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76441029b0 0x7f7644197ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:02.453 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.449+0000 7f764ad54640 1 -- 172.21.15.44:0/3815787580 >> 172.21.15.44:0/3815787580 conn(0x7f76440776c0 msgr2=0x7f76440fca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:21:02.453 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.449+0000 7f764ad54640 1 -- 172.21.15.44:0/3815787580 shutdown_connections 2024-08-19T00:21:02.453 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:02.449+0000 7f764ad54640 1 -- 172.21.15.44:0/3815787580 wait complete. 2024-08-19T00:21:02.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:21:02 smithi171 ceph-mon[21810]: pgmap v236: 129 pgs: 129 active+clean; 422 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 4.5 MiB/s wr, 318 op/s 2024-08-19T00:21:02.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:21:02 smithi116 ceph-mon[21873]: pgmap v236: 129 pgs: 129 active+clean; 422 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 4.5 MiB/s wr, 318 op/s 2024-08-19T00:21:02.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:21:02 smithi044 ceph-mon[18489]: pgmap v236: 129 pgs: 129 active+clean; 422 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 4.5 MiB/s wr, 318 op/s 2024-08-19T00:21:02.684 INFO:tasks.workunit.client.0.smithi044.stdout: 1 587763 8.57 MB/sec execute 267 sec latency 13.293 ms 2024-08-19T00:21:03.684 INFO:tasks.workunit.client.0.smithi044.stdout: 1 590191 8.59 MB/sec execute 268 sec latency 22.003 ms 2024-08-19T00:21:04.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:21:04 smithi171 ceph-mon[21810]: pgmap v237: 129 pgs: 129 active+clean; 422 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.8 MiB/s wr, 205 op/s 2024-08-19T00:21:04.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:21:04 smithi116 ceph-mon[21873]: pgmap v237: 129 pgs: 129 active+clean; 422 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.8 MiB/s wr, 205 op/s 2024-08-19T00:21:04.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:21:04 smithi044 ceph-mon[18489]: pgmap v237: 129 pgs: 129 active+clean; 422 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.8 MiB/s wr, 205 op/s 2024-08-19T00:21:04.684 INFO:tasks.workunit.client.0.smithi044.stdout: 1 592380 8.60 MB/sec execute 269 sec latency 17.665 ms 2024-08-19T00:21:05.684 INFO:tasks.workunit.client.0.smithi044.stdout: 1 594167 8.60 MB/sec execute 270 sec latency 83.631 ms 2024-08-19T00:21:06.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:21:06 smithi171 ceph-mon[21810]: pgmap v238: 129 pgs: 129 active+clean; 430 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 4.5 MiB/s wr, 342 op/s 2024-08-19T00:21:06.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:21:06 smithi116 ceph-mon[21873]: pgmap v238: 129 pgs: 129 active+clean; 430 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 4.5 MiB/s wr, 342 op/s 2024-08-19T00:21:06.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:21:06 smithi044 ceph-mon[18489]: pgmap v238: 129 pgs: 129 active+clean; 430 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 4.5 MiB/s wr, 342 op/s 2024-08-19T00:21:06.684 INFO:tasks.workunit.client.0.smithi044.stdout: 1 595632 8.60 MB/sec execute 271 sec latency 19.681 ms 2024-08-19T00:21:07.687 INFO:tasks.workunit.client.0.smithi044.stdout: 1 597685 8.61 MB/sec execute 272 sec latency 19.800 ms 2024-08-19T00:21:07.872 INFO:tasks.quiescer.fs.[cephfs]:Total duration (47.5) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-08-19T00:21:07.872 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 23.75 2024-08-19T00:21:07.873 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-19T00:21:08.143 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:21:08.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:21:08 smithi171 ceph-mon[21810]: pgmap v239: 129 pgs: 129 active+clean; 430 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.8 MiB/s wr, 233 op/s 2024-08-19T00:21:08.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:21:08 smithi171 ceph-mon[21810]: osdmap e98: 12 total, 12 up, 12 in 2024-08-19T00:21:08.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:21:08 smithi116 ceph-mon[21873]: pgmap v239: 129 pgs: 129 active+clean; 430 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.8 MiB/s wr, 233 op/s 2024-08-19T00:21:08.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:21:08 smithi116 ceph-mon[21873]: osdmap e98: 12 total, 12 up, 12 in 2024-08-19T00:21:08.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:21:08 smithi044 ceph-mon[18489]: pgmap v239: 129 pgs: 129 active+clean; 430 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.8 MiB/s wr, 233 op/s 2024-08-19T00:21:08.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:21:08 smithi044 ceph-mon[18489]: osdmap e98: 12 total, 12 up, 12 in 2024-08-19T00:21:08.685 INFO:tasks.workunit.client.0.smithi044.stdout: 1 600074 8.63 MB/sec execute 273 sec latency 51.906 ms 2024-08-19T00:21:09.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:09.326+0000 7fde94e34640 1 -- 172.21.15.44:0/792209599 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde90103390 msgr2=0x7fde9010b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:09.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:09.326+0000 7fde94e34640 1 --2- 172.21.15.44:0/792209599 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde90103390 0x7fde9010b880 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fde84009900 tx=0x7fde8402a480 comp rx=0 tx=0).stop 2024-08-19T00:21:09.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:09.326+0000 7fde94e34640 1 -- 172.21.15.44:0/792209599 shutdown_connections 2024-08-19T00:21:09.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:09.326+0000 7fde94e34640 1 --2- 172.21.15.44:0/792209599 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde9010bea0 0x7fde9010e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:09.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:09.326+0000 7fde94e34640 1 --2- 172.21.15.44:0/792209599 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde90103390 0x7fde9010b880 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:09.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:09.326+0000 7fde94e34640 1 --2- 172.21.15.44:0/792209599 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde90102a70 0x7fde90102e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:09.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:09.326+0000 7fde94e34640 1 -- 172.21.15.44:0/792209599 >> 172.21.15.44:0/792209599 conn(0x7fde900fc4d0 msgr2=0x7fde900fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:21:09.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:09.326+0000 7fde94e34640 1 -- 172.21.15.44:0/792209599 shutdown_connections 2024-08-19T00:21:09.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:09.327+0000 7fde94e34640 1 -- 172.21.15.44:0/792209599 wait complete. 2024-08-19T00:21:09.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:09.327+0000 7fde94e34640 1 Processor -- start 2024-08-19T00:21:09.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:09.327+0000 7fde94e34640 1 -- start start 2024-08-19T00:21:09.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:09.328+0000 7fde94e34640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde90102a70 0x7fde90198180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:09.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:09.328+0000 7fde94e34640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde90103390 0x7fde901986c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:09.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:09.328+0000 7fde94e34640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde9010bea0 0x7fde9019ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:09.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:09.328+0000 7fde94e34640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fde90111ca0 con 0x7fde90102a70 2024-08-19T00:21:09.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:09.328+0000 7fde94e34640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fde90111b20 con 0x7fde9010bea0 2024-08-19T00:21:09.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:09.328+0000 7fde94e34640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fde90111e20 con 0x7fde90103390 2024-08-19T00:21:09.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:09.328+0000 7fde8e59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde90102a70 0x7fde90198180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:09.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:09.328+0000 7fde8e59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde90102a70 0x7fde90198180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54018/0 (socket says 172.21.15.44:54018) 2024-08-19T00:21:09.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:09.328+0000 7fde8dd9b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde90103390 0x7fde901986c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:09.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:09.328+0000 7fde8e59c640 1 -- 172.21.15.44:0/1255544127 learned_addr learned my addr 172.21.15.44:0/1255544127 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:21:09.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:09.328+0000 7fde8ed9d640 1 --2- 172.21.15.44:0/1255544127 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde9010bea0 0x7fde9019ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:09.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:09.328+0000 7fde8e59c640 1 -- 172.21.15.44:0/1255544127 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde90103390 msgr2=0x7fde901986c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:09.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:09.328+0000 7fde8e59c640 1 --2- 172.21.15.44:0/1255544127 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde90103390 0x7fde901986c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:09.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:09.328+0000 7fde8e59c640 1 -- 172.21.15.44:0/1255544127 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde9010bea0 msgr2=0x7fde9019ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:09.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:09.328+0000 7fde8e59c640 1 --2- 172.21.15.44:0/1255544127 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde9010bea0 0x7fde9019ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:09.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:09.328+0000 7fde8e59c640 1 -- 172.21.15.44:0/1255544127 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde9019d130 con 0x7fde90102a70 2024-08-19T00:21:09.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:09.328+0000 7fde8e59c640 1 --2- 172.21.15.44:0/1255544127 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde90102a70 0x7fde90198180 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fde8000c890 tx=0x7fde8000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:21:09.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:09.328+0000 7fde7f7fe640 1 -- 172.21.15.44:0/1255544127 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde80004220 con 0x7fde90102a70 2024-08-19T00:21:09.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:09.329+0000 7fde94e34640 1 -- 172.21.15.44:0/1255544127 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde9019d420 con 0x7fde90102a70 2024-08-19T00:21:09.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:09.329+0000 7fde94e34640 1 -- 172.21.15.44:0/1255544127 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde901a4d00 con 0x7fde90102a70 2024-08-19T00:21:09.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:09.329+0000 7fde7f7fe640 1 -- 172.21.15.44:0/1255544127 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde800043c0 con 0x7fde90102a70 2024-08-19T00:21:09.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:09.329+0000 7fde7f7fe640 1 -- 172.21.15.44:0/1255544127 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde80004a00 con 0x7fde90102a70 2024-08-19T00:21:09.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:09.330+0000 7fde94e34640 1 -- 172.21.15.44:0/1255544127 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde70005290 con 0x7fde90102a70 2024-08-19T00:21:09.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:09.331+0000 7fde7f7fe640 1 -- 172.21.15.44:0/1255544127 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fde800079b0 con 0x7fde90102a70 2024-08-19T00:21:09.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:09.332+0000 7fde7f7fe640 1 --2- 172.21.15.44:0/1255544127 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fde780a2cf0 0x7fde780a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:09.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:09.332+0000 7fde8dd9b640 1 --2- 172.21.15.44:0/1255544127 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fde780a2cf0 0x7fde780a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:09.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:09.332+0000 7fde7f7fe640 1 -- 172.21.15.44:0/1255544127 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9621+0+0 (secure 0 0 0) 0x7fde800cf360 con 0x7fde90102a70 2024-08-19T00:21:09.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:09.332+0000 7fde8dd9b640 1 --2- 172.21.15.44:0/1255544127 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fde780a2cf0 0x7fde780a51b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fde84009230 tx=0x7fde840058d0 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:21:09.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:09.337+0000 7fde7f7fe640 1 -- 172.21.15.44:0/1255544127 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fde80014030 con 0x7fde90102a70 2024-08-19T00:21:09.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:09.584+0000 7fde94e34640 1 -- 172.21.15.44:0/1255544127 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fde70005850 con 0x7fde90102a70 2024-08-19T00:21:09.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:09.585+0000 7fde7f7fe640 1 -- 172.21.15.44:0/1255544127 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11989 (secure 0 0 0) 0x7fde8009b4e0 con 0x7fde90102a70 2024-08-19T00:21:09.587 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:21:09.587 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":33,"btime":"2024-08-19T00:17:11:640526+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14511,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1538841896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1538841896},{"type":"v1","addr":"172.21.15.116:6833","nonce":1538841896}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/4044471606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4044471606},{"type":"v1","addr":"172.21.15.44:6835","nonce":4044471606}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":33,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-19T00:10:53.196636+0000","modified":"2024-08-19T00:17:11.586031+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24473,"mds_1":24446,"mds_2":24439,"mds_3":24431,"mds_4":24418},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14529":{"gid":14529,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6837/1824829052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1824829052},{"type":"v1","addr":"172.21.15.44:6837","nonce":1824829052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14577":{"gid":14577,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6839/3591739042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":3591739042},{"type":"v1","addr":"172.21.15.44:6839","nonce":3591739042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14589":{"gid":14589,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6841/3667695717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6840","nonce":3667695717},{"type":"v1","addr":"172.21.15.44:6841","nonce":3667695717}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24388":{"gid":24388,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1183022838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1183022838},{"type":"v1","addr":"172.21.15.171:6833","nonce":1183022838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6835/2190623851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":2190623851},{"type":"v1","addr":"172.21.15.171:6835","nonce":2190623851}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.171:6837/316231795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":316231795},{"type":"v1","addr":"172.21.15.171:6837","nonce":316231795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":20,"addr":"172.21.15.116:6835/3507399322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3507399322},{"type":"v1","addr":"172.21.15.116:6835","nonce":3507399322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.171:6839/1466585795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":1466585795},{"type":"v1","addr":"172.21.15.171:6839","nonce":1466585795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":17,"addr":"172.21.15.116:6837/2764513846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":2764513846},{"type":"v1","addr":"172.21.15.116:6837","nonce":2764513846}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.116:6839/1032741033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":1032741033},{"type":"v1","addr":"172.21.15.116:6839","nonce":1032741033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24446,24439,24431,24418]},"id":1}]} 2024-08-19T00:21:09.587 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 33 2024-08-19T00:21:09.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:09.587+0000 7fde94e34640 1 -- 172.21.15.44:0/1255544127 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fde780a2cf0 msgr2=0x7fde780a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:09.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:09.587+0000 7fde94e34640 1 --2- 172.21.15.44:0/1255544127 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fde780a2cf0 0x7fde780a51b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fde84009230 tx=0x7fde840058d0 comp rx=0 tx=0).stop 2024-08-19T00:21:09.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:09.587+0000 7fde94e34640 1 -- 172.21.15.44:0/1255544127 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde90102a70 msgr2=0x7fde90198180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:09.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:09.587+0000 7fde94e34640 1 --2- 172.21.15.44:0/1255544127 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde90102a70 0x7fde90198180 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fde8000c890 tx=0x7fde8000cd50 comp rx=0 tx=0).stop 2024-08-19T00:21:09.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:09.587+0000 7fde94e34640 1 -- 172.21.15.44:0/1255544127 shutdown_connections 2024-08-19T00:21:09.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:09.587+0000 7fde94e34640 1 --2- 172.21.15.44:0/1255544127 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fde780a2cf0 0x7fde780a51b0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:09.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:09.587+0000 7fde94e34640 1 --2- 172.21.15.44:0/1255544127 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde90103390 0x7fde901986c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:09.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:09.587+0000 7fde94e34640 1 --2- 172.21.15.44:0/1255544127 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde9010bea0 0x7fde9019ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:09.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:09.587+0000 7fde94e34640 1 --2- 172.21.15.44:0/1255544127 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde90102a70 0x7fde90198180 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:09.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:09.587+0000 7fde94e34640 1 -- 172.21.15.44:0/1255544127 >> 172.21.15.44:0/1255544127 conn(0x7fde900fc4d0 msgr2=0x7fde900fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:21:09.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:09.587+0000 7fde94e34640 1 -- 172.21.15.44:0/1255544127 shutdown_connections 2024-08-19T00:21:09.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:09.587+0000 7fde94e34640 1 -- 172.21.15.44:0/1255544127 wait complete. 2024-08-19T00:21:09.685 INFO:tasks.workunit.client.0.smithi044.stdout: 1 601761 8.63 MB/sec execute 274 sec latency 41.244 ms 2024-08-19T00:21:10.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:21:10 smithi044 ceph-mon[18489]: pgmap v241: 129 pgs: 129 active+clean; 430 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.3 MiB/s wr, 280 op/s 2024-08-19T00:21:10.488 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:21:10 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/1255544127' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:21:10.518 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24473 quiesce db / --timeout 90 --expiration 143.75 --await-for 45.0' 2024-08-19T00:21:10.518 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24473 quiesce db / --timeout 90 --expiration 143.75 --await-for 45.0 2024-08-19T00:21:10.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:21:10 smithi171 ceph-mon[21810]: pgmap v241: 129 pgs: 129 active+clean; 430 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.3 MiB/s wr, 280 op/s 2024-08-19T00:21:10.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:21:10 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/1255544127' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:21:10.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:21:10 smithi116 ceph-mon[21873]: pgmap v241: 129 pgs: 129 active+clean; 430 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.3 MiB/s wr, 280 op/s 2024-08-19T00:21:10.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:21:10 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/1255544127' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:21:10.685 INFO:tasks.workunit.client.0.smithi044.stdout: 1 603931 8.65 MB/sec execute 275 sec latency 93.477 ms 2024-08-19T00:21:10.798 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:21:11.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.328+0000 7f6664cde640 1 -- 172.21.15.44:0/563717923 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6660102c20 msgr2=0x7f666010d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:11.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.328+0000 7f6664cde640 1 --2- 172.21.15.44:0/563717923 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6660102c20 0x7f666010d770 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f6658009ca0 tx=0x7f665802a950 comp rx=0 tx=0).stop 2024-08-19T00:21:11.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.328+0000 7f6664cde640 1 -- 172.21.15.44:0/563717923 shutdown_connections 2024-08-19T00:21:11.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.328+0000 7f6664cde640 1 --2- 172.21.15.44:0/563717923 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f66601022a0 0x7f66601026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:11.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.328+0000 7f6664cde640 1 --2- 172.21.15.44:0/563717923 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6660102c20 0x7f666010d770 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:11.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.328+0000 7f6664cde640 1 --2- 172.21.15.44:0/563717923 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6660100b50 0x7f6660100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:11.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.328+0000 7f6664cde640 1 -- 172.21.15.44:0/563717923 >> 172.21.15.44:0/563717923 conn(0x7f66600fc500 msgr2=0x7f66600fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:21:11.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.328+0000 7f6664cde640 1 -- 172.21.15.44:0/563717923 shutdown_connections 2024-08-19T00:21:11.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.328+0000 7f6664cde640 1 -- 172.21.15.44:0/563717923 wait complete. 2024-08-19T00:21:11.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.329+0000 7f6664cde640 1 Processor -- start 2024-08-19T00:21:11.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.329+0000 7f6664cde640 1 -- start start 2024-08-19T00:21:11.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.329+0000 7f6664cde640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6660100b50 0x7f66601981a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:11.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.329+0000 7f6664cde640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66601022a0 0x7f66601986e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:11.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.329+0000 7f6664cde640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6660102c20 0x7f666019ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:11.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.329+0000 7f665dd9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66601022a0 0x7f66601986e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:11.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.329+0000 7f6664cde640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6660111dc0 con 0x7f66601022a0 2024-08-19T00:21:11.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.329+0000 7f6664cde640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f6660111c40 con 0x7f6660102c20 2024-08-19T00:21:11.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.329+0000 7f6664cde640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6660111f40 con 0x7f6660100b50 2024-08-19T00:21:11.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.329+0000 7f665ed9d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6660102c20 0x7f666019ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:11.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.329+0000 7f665e59c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6660100b50 0x7f66601981a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:11.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.329+0000 7f665ed9d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6660102c20 0x7f666019ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.44:46880/0 (socket says 172.21.15.44:46880) 2024-08-19T00:21:11.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.329+0000 7f665e59c640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6660100b50 0x7f66601981a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.44:37640/0 (socket says 172.21.15.44:37640) 2024-08-19T00:21:11.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.329+0000 7f665ed9d640 1 -- 172.21.15.44:0/600171666 learned_addr learned my addr 172.21.15.44:0/600171666 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:21:11.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.330+0000 7f665e59c640 1 -- 172.21.15.44:0/600171666 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6660102c20 msgr2=0x7f666019ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:11.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.330+0000 7f665e59c640 1 --2- 172.21.15.44:0/600171666 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6660102c20 0x7f666019ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:11.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.330+0000 7f665e59c640 1 -- 172.21.15.44:0/600171666 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66601022a0 msgr2=0x7f66601986e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:11.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.330+0000 7f665e59c640 1 --2- 172.21.15.44:0/600171666 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66601022a0 0x7f66601986e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:11.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.330+0000 7f665e59c640 1 -- 172.21.15.44:0/600171666 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f666019d150 con 0x7f6660100b50 2024-08-19T00:21:11.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.330+0000 7f665dd9b640 1 --2- 172.21.15.44:0/600171666 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66601022a0 0x7f66601986e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:21:11.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.330+0000 7f665e59c640 1 --2- 172.21.15.44:0/600171666 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6660100b50 0x7f66601981a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f665000e9f0 tx=0x7f665000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:21:11.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.330+0000 7f664f7fe640 1 -- 172.21.15.44:0/600171666 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f665000cd80 con 0x7f6660100b50 2024-08-19T00:21:11.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.330+0000 7f664f7fe640 1 -- 172.21.15.44:0/600171666 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f66500035f0 con 0x7f6660100b50 2024-08-19T00:21:11.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.330+0000 7f664f7fe640 1 -- 172.21.15.44:0/600171666 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6650010690 con 0x7f6660100b50 2024-08-19T00:21:11.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.330+0000 7f6664cde640 1 -- 172.21.15.44:0/600171666 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f666019d440 con 0x7f6660100b50 2024-08-19T00:21:11.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.331+0000 7f6664cde640 1 -- 172.21.15.44:0/600171666 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66601a4d20 con 0x7f6660100b50 2024-08-19T00:21:11.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.334+0000 7f66670dc740 1 Processor -- start 2024-08-19T00:21:11.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.334+0000 7f664f7fe640 1 -- 172.21.15.44:0/600171666 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f6650003b30 con 0x7f6660100b50 2024-08-19T00:21:11.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.334+0000 7f66670dc740 1 -- start start 2024-08-19T00:21:11.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.335+0000 7f66670dc740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d4453c2c0 0x561d4453c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:11.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.335+0000 7f66670dc740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561d4453cbe0 0x561d44546f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:11.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.335+0000 7f66670dc740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561d445474a0 0x561d44549890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:11.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.335+0000 7f66670dc740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561d444a1810 con 0x561d4453c2c0 2024-08-19T00:21:11.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.335+0000 7f66670dc740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x561d44448c70 con 0x561d445474a0 2024-08-19T00:21:11.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.335+0000 7f66670dc740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x561d4449d7d0 con 0x561d4453cbe0 2024-08-19T00:21:11.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.335+0000 7f665dd9b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561d445474a0 0x561d44549890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:11.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.335+0000 7f665dd9b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561d445474a0 0x561d44549890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.44:46894/0 (socket says 172.21.15.44:46894) 2024-08-19T00:21:11.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.335+0000 7f665dd9b640 1 -- 172.21.15.44:0/523842062 learned_addr learned my addr 172.21.15.44:0/523842062 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:21:11.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.335+0000 7f665ed9d640 1 --2- 172.21.15.44:0/523842062 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d4453c2c0 0x561d4453c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:11.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.335+0000 7f665e59c640 1 --2- 172.21.15.44:0/523842062 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561d4453cbe0 0x561d44546f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:11.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.336+0000 7f664f7fe640 1 --2- 172.21.15.44:0/600171666 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f66480a2d70 0x7f66480a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:11.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.336+0000 7f665dd9b640 1 -- 172.21.15.44:0/523842062 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561d4453cbe0 msgr2=0x561d44546f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:11.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.336+0000 7f665dd9b640 1 --2- 172.21.15.44:0/523842062 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561d4453cbe0 0x561d44546f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:11.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.336+0000 7f665dd9b640 1 -- 172.21.15.44:0/523842062 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d4453c2c0 msgr2=0x561d4453c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:11.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.336+0000 7f665dd9b640 1 --2- 172.21.15.44:0/523842062 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d4453c2c0 0x561d4453c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:11.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.336+0000 7f665dd9b640 1 -- 172.21.15.44:0/523842062 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d44213ba0 con 0x561d445474a0 2024-08-19T00:21:11.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.336+0000 7f664f7fe640 1 -- 172.21.15.44:0/600171666 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9621+0+0 (secure 0 0 0) 0x7f66500cfbe0 con 0x7f6660100b50 2024-08-19T00:21:11.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.336+0000 7f665dd9b640 1 --2- 172.21.15.44:0/523842062 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561d445474a0 0x561d44549890 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6654009c00 tx=0x7f6654010740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79c0add34aa73ec5 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:21:11.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.336+0000 7f665ed9d640 1 --2- 172.21.15.44:0/600171666 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f66480a2d70 0x7f66480a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:11.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.336+0000 7f664cff9640 1 -- 172.21.15.44:0/523842062 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6654005020 con 0x561d445474a0 2024-08-19T00:21:11.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.336+0000 7f664cff9640 1 -- 172.21.15.44:0/523842062 <== mon.2 v2:172.21.15.116:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f66540047a0 con 0x561d445474a0 2024-08-19T00:21:11.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.336+0000 7f664cff9640 1 -- 172.21.15.44:0/523842062 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66540126b0 con 0x561d445474a0 2024-08-19T00:21:11.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.337+0000 7f66670dc740 1 -- 172.21.15.44:0/523842062 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561d445474a0 msgr2=0x561d44549890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:11.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.337+0000 7f66670dc740 1 --2- 172.21.15.44:0/523842062 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561d445474a0 0x561d44549890 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6654009c00 tx=0x7f6654010740 comp rx=0 tx=0).stop 2024-08-19T00:21:11.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.337+0000 7f665ed9d640 1 --2- 172.21.15.44:0/600171666 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f66480a2d70 0x7f66480a5230 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6658009a60 tx=0x7f665803c040 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:21:11.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.337+0000 7f66670dc740 1 -- 172.21.15.44:0/523842062 shutdown_connections 2024-08-19T00:21:11.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.337+0000 7f66670dc740 1 --2- 172.21.15.44:0/523842062 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561d4453cbe0 0x561d44546f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:11.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.337+0000 7f66670dc740 1 --2- 172.21.15.44:0/523842062 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561d445474a0 0x561d44549890 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:11.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.337+0000 7f66670dc740 1 --2- 172.21.15.44:0/523842062 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d4453c2c0 0x561d4453c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:11.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.337+0000 7f66670dc740 1 -- 172.21.15.44:0/523842062 >> 172.21.15.44:0/523842062 conn(0x561d44538850 msgr2=0x561d44538c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:21:11.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.338+0000 7f66670dc740 1 -- 172.21.15.44:0/523842062 shutdown_connections 2024-08-19T00:21:11.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.338+0000 7f66670dc740 1 -- 172.21.15.44:0/523842062 wait complete. 2024-08-19T00:21:11.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.338+0000 7f66670dc740 1 -- start start 2024-08-19T00:21:11.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.338+0000 7f66670dc740 1 Processor -- start 2024-08-19T00:21:11.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.338+0000 7f66670dc740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d4453c2c0 0x561d44544550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:11.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.338+0000 7f66670dc740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561d4453cbe0 0x561d44544a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:11.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.339+0000 7f66670dc740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561d445474a0 0x561d44544fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:11.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.339+0000 7f66670dc740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561d44549fb0 con 0x561d4453c2c0 2024-08-19T00:21:11.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.339+0000 7f66670dc740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x561d4445c9a0 con 0x561d445474a0 2024-08-19T00:21:11.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.339+0000 7f66670dc740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x561d4454a130 con 0x561d4453cbe0 2024-08-19T00:21:11.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.339+0000 7f66670dc740 10 client.0 _ll_register_callbacks cb 0x561d4444ac90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:21:11.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.339+0000 7f665e59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d4453c2c0 0x561d44544550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:11.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.339+0000 7f665ed9d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561d445474a0 0x561d44544fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:11.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.339+0000 7f665e59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d4453c2c0 0x561d44544550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54046/0 (socket says 172.21.15.44:54046) 2024-08-19T00:21:11.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.339+0000 7f665e59c640 1 -- 172.21.15.44:0/3183995852 learned_addr learned my addr 172.21.15.44:0/3183995852 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:21:11.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.339+0000 7f665dd9b640 1 --2- 172.21.15.44:0/3183995852 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561d4453cbe0 0x561d44544a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:11.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.339+0000 7f665e59c640 1 -- 172.21.15.44:0/3183995852 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561d4453cbe0 msgr2=0x561d44544a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:11.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.339+0000 7f665e59c640 1 --2- 172.21.15.44:0/3183995852 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561d4453cbe0 0x561d44544a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:11.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.339+0000 7f665e59c640 1 -- 172.21.15.44:0/3183995852 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561d445474a0 msgr2=0x561d44544fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:11.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.339+0000 7f665e59c640 1 --2- 172.21.15.44:0/3183995852 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561d445474a0 0x561d44544fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:11.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.339+0000 7f665e59c640 1 -- 172.21.15.44:0/3183995852 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d44468220 con 0x561d4453c2c0 2024-08-19T00:21:11.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.339+0000 7f665e59c640 1 --2- 172.21.15.44:0/3183995852 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d4453c2c0 0x561d44544550 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f665001f000 tx=0x7f6650005bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee136b7f41a2d60d server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:21:11.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.339+0000 7f6645ffb640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:21:11.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.340+0000 7f6645ffb640 1 -- 172.21.15.44:0/3183995852 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f665009b610 con 0x561d4453c2c0 2024-08-19T00:21:11.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.340+0000 7f6645ffb640 1 -- 172.21.15.44:0/3183995852 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9621+0+0 (secure 0 0 0) 0x7f66500cd160 con 0x561d4453c2c0 2024-08-19T00:21:11.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.340+0000 7f66670dc740 1 -- 172.21.15.44:0/3183995852 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66540047a0 con 0x561d4453c2c0 2024-08-19T00:21:11.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.340+0000 7f6645ffb640 1 -- 172.21.15.44:0/3183995852 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f665009c3b0 con 0x561d4453c2c0 2024-08-19T00:21:11.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.340+0000 7f66670dc740 10 client.16479 fetch_fsmap learned FSMap version 33 2024-08-19T00:21:11.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.340+0000 7f66670dc740 1 -- 172.21.15.44:0/3183995852 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x561d44555e10 con 0x561d4453c2c0 2024-08-19T00:21:11.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.341+0000 7f6645ffb640 1 -- 172.21.15.44:0/3183995852 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f66540047a0 con 0x561d4453c2c0 2024-08-19T00:21:11.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.341+0000 7f6645ffb640 1 -- 172.21.15.44:0/3183995852 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f6650098320 con 0x561d4453c2c0 2024-08-19T00:21:11.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.341+0000 7f66670dc740 10 client.16479 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:21:11.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.341+0000 7f66670dc740 10 client.16479 resolve_mds: validated gid 24473 aka daemon mds.b 2024-08-19T00:21:11.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.341+0000 7f66670dc740 20 client.16479 populate_metadata read hostname 'smithi044' 2024-08-19T00:21:11.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.341+0000 7f66670dc740 1 --2- 172.21.15.44:0/3183995852 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x561d445572d0 0x561d445596e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:11.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.341+0000 7f66670dc740 4 client.16479 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:21:11.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.341+0000 7f66670dc740 1 -- 172.21.15.44:0/3183995852 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561d444aef40 con 0x561d445572d0 2024-08-19T00:21:11.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.341+0000 7f665dd9b640 1 --2- 172.21.15.44:0/3183995852 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x561d445572d0 0x561d445596e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:11.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.342+0000 7f665dd9b640 1 --2- 172.21.15.44:0/3183995852 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x561d445572d0 0x561d445596e0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c83cb652f2dc8ae0 server_cookie=5dbf68698bc3d367 in_seq=0 out_seq=0 2024-08-19T00:21:11.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.342+0000 7f6645ffb640 10 client.16479 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:21:11.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.343+0000 7f6645ffb640 1 -- 172.21.15.44:0/3183995852 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561d444aef40 con 0x561d445572d0 2024-08-19T00:21:11.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.343+0000 7f6645ffb640 10 client.16479 handle_command_reply: tid=0 2024-08-19T00:21:11.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.343+0000 7f66670dc740 1 client.16479 shutdown 2024-08-19T00:21:11.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.343+0000 7f66670dc740 1 -- 172.21.15.44:0/3183995852 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d4453c2c0 msgr2=0x561d44544550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:11.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.343+0000 7f66670dc740 1 --2- 172.21.15.44:0/3183995852 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d4453c2c0 0x561d44544550 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f665001f000 tx=0x7f6650005bb0 comp rx=0 tx=0).stop 2024-08-19T00:21:11.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.343+0000 7f66670dc740 1 -- 172.21.15.44:0/3183995852 shutdown_connections 2024-08-19T00:21:11.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.343+0000 7f66670dc740 1 --2- 172.21.15.44:0/3183995852 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x561d445572d0 0x561d445596e0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:11.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.343+0000 7f66670dc740 1 --2- 172.21.15.44:0/3183995852 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561d4453cbe0 0x561d44544a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:11.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.343+0000 7f66670dc740 1 --2- 172.21.15.44:0/3183995852 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561d445474a0 0x561d44544fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:11.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.343+0000 7f66670dc740 1 --2- 172.21.15.44:0/3183995852 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d4453c2c0 0x561d44544550 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:11.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.343+0000 7f66670dc740 1 -- 172.21.15.44:0/3183995852 >> 172.21.15.44:0/3183995852 conn(0x561d44538850 msgr2=0x561d44537b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:21:11.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.343+0000 7f6645ffb640 0 client.16479 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:21:11.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.343+0000 7f66670dc740 1 -- 172.21.15.44:0/3183995852 shutdown_connections 2024-08-19T00:21:11.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.343+0000 7f66670dc740 1 -- 172.21.15.44:0/3183995852 wait complete. 2024-08-19T00:21:11.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.343+0000 7f66670dc740 20 client.16479 trim_cache size 0 max 16384 2024-08-19T00:21:11.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.361+0000 7f66670dc740 1 Processor -- start 2024-08-19T00:21:11.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.361+0000 7f66670dc740 1 -- start start 2024-08-19T00:21:11.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.361+0000 7f66670dc740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d4453c2c0 0x561d44537a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:11.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.361+0000 7f66670dc740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561d4453cbe0 0x561d4455ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:11.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.361+0000 7f66670dc740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561d445474a0 0x561d4455f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:11.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.361+0000 7f66670dc740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f66601af0a0 con 0x561d4453c2c0 2024-08-19T00:21:11.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.361+0000 7f66670dc740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f66601b0be0 con 0x561d4453cbe0 2024-08-19T00:21:11.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.361+0000 7f66670dc740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f66601af770 con 0x561d445474a0 2024-08-19T00:21:11.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.362+0000 7f665e59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d4453c2c0 0x561d44537a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:11.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.362+0000 7f665ed9d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561d445474a0 0x561d4455f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:11.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.362+0000 7f665dd9b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561d4453cbe0 0x561d4455ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:11.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.362+0000 7f665e59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d4453c2c0 0x561d44537a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54058/0 (socket says 172.21.15.44:54058) 2024-08-19T00:21:11.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.362+0000 7f665e59c640 1 -- 172.21.15.44:0/2901880416 learned_addr learned my addr 172.21.15.44:0/2901880416 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:21:11.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.362+0000 7f665e59c640 1 -- 172.21.15.44:0/2901880416 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561d445474a0 msgr2=0x561d4455f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:11.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.362+0000 7f665e59c640 1 --2- 172.21.15.44:0/2901880416 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561d445474a0 0x561d4455f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:11.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.362+0000 7f665e59c640 1 -- 172.21.15.44:0/2901880416 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561d4453cbe0 msgr2=0x561d4455ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:11.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.362+0000 7f665e59c640 1 --2- 172.21.15.44:0/2901880416 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561d4453cbe0 0x561d4455ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:11.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.362+0000 7f665e59c640 1 -- 172.21.15.44:0/2901880416 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d445392c0 con 0x561d4453c2c0 2024-08-19T00:21:11.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.362+0000 7f665dd9b640 1 --2- 172.21.15.44:0/2901880416 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561d4453cbe0 0x561d4455ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:21:11.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.362+0000 7f665e59c640 1 --2- 172.21.15.44:0/2901880416 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d4453c2c0 0x561d44537a20 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f665000c6a0 tx=0x7f66500039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ff6d3dbcbc49d19 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:21:11.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.362+0000 7f6647fff640 1 -- 172.21.15.44:0/2901880416 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f665009b610 con 0x561d4453c2c0 2024-08-19T00:21:11.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.362+0000 7f6647fff640 1 -- 172.21.15.44:0/2901880416 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f665007e070 con 0x561d4453c2c0 2024-08-19T00:21:11.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.362+0000 7f6647fff640 1 -- 172.21.15.44:0/2901880416 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66500a0060 con 0x561d4453c2c0 2024-08-19T00:21:11.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.363+0000 7f66670dc740 1 -- 172.21.15.44:0/2901880416 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d4453c2c0 msgr2=0x561d44537a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:11.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.363+0000 7f66670dc740 1 --2- 172.21.15.44:0/2901880416 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d4453c2c0 0x561d44537a20 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f665000c6a0 tx=0x7f66500039b0 comp rx=0 tx=0).stop 2024-08-19T00:21:11.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.363+0000 7f66670dc740 1 -- 172.21.15.44:0/2901880416 shutdown_connections 2024-08-19T00:21:11.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.363+0000 7f66670dc740 1 --2- 172.21.15.44:0/2901880416 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561d445474a0 0x561d4455f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:11.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.363+0000 7f66670dc740 1 --2- 172.21.15.44:0/2901880416 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561d4453cbe0 0x561d4455ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:11.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.363+0000 7f66670dc740 1 --2- 172.21.15.44:0/2901880416 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d4453c2c0 0x561d44537a20 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:11.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.363+0000 7f66670dc740 1 -- 172.21.15.44:0/2901880416 >> 172.21.15.44:0/2901880416 conn(0x561d44538850 msgr2=0x561d44537310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:21:11.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.363+0000 7f66670dc740 1 -- 172.21.15.44:0/2901880416 shutdown_connections 2024-08-19T00:21:11.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.363+0000 7f66670dc740 1 -- 172.21.15.44:0/2901880416 wait complete. 2024-08-19T00:21:11.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.364+0000 7f66670dc740 1 -- start start 2024-08-19T00:21:11.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.364+0000 7f66670dc740 1 Processor -- start 2024-08-19T00:21:11.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.364+0000 7f66670dc740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561d4453c2c0 0x561d4454f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:11.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.364+0000 7f66670dc740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561d4453cbe0 0x561d4454f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:11.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.364+0000 7f66670dc740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d445474a0 0x561d445bb030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:11.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.364+0000 7f66670dc740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f66601b0510 con 0x561d445474a0 2024-08-19T00:21:11.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.364+0000 7f66670dc740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f66601afe40 con 0x561d4453c2c0 2024-08-19T00:21:11.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.364+0000 7f66670dc740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f66601ad0a0 con 0x561d4453cbe0 2024-08-19T00:21:11.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.364+0000 7f66670dc740 10 client.0 _ll_register_callbacks cb 0x7f6650003e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:21:11.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.364+0000 7f665ed9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d445474a0 0x561d445bb030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:11.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.364+0000 7f665e59c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561d4453c2c0 0x561d4454f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:11.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.364+0000 7f665dd9b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561d4453cbe0 0x561d4454f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:11.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.364+0000 7f665e59c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561d4453c2c0 0x561d4454f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.44:46928/0 (socket says 172.21.15.44:46928) 2024-08-19T00:21:11.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.364+0000 7f665e59c640 1 -- 172.21.15.44:0/792544350 learned_addr learned my addr 172.21.15.44:0/792544350 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:21:11.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.364+0000 7f665ed9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d445474a0 0x561d445bb030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54074/0 (socket says 172.21.15.44:54074) 2024-08-19T00:21:11.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.364+0000 7f665dd9b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561d4453cbe0 0x561d4454f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.44:37666/0 (socket says 172.21.15.44:37666) 2024-08-19T00:21:11.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.365+0000 7f665e59c640 1 -- 172.21.15.44:0/792544350 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561d4453cbe0 msgr2=0x561d4454f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:11.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.365+0000 7f665e59c640 1 --2- 172.21.15.44:0/792544350 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561d4453cbe0 0x561d4454f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:11.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.365+0000 7f665e59c640 1 -- 172.21.15.44:0/792544350 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d445474a0 msgr2=0x561d445bb030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:11.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.365+0000 7f665e59c640 1 --2- 172.21.15.44:0/792544350 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d445474a0 0x561d445bb030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:11.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.365+0000 7f665e59c640 1 -- 172.21.15.44:0/792544350 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d445bb570 con 0x561d4453c2c0 2024-08-19T00:21:11.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.365+0000 7f665e59c640 1 --2- 172.21.15.44:0/792544350 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561d4453c2c0 0x561d4454f380 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6650099f60 tx=0x7f665000c7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=405931003e1d13 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:21:11.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.365+0000 7f6645ffb640 10 client.0 ms_handle_connect on v2:172.21.15.116:3300/0 2024-08-19T00:21:11.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.365+0000 7f6645ffb640 1 -- 172.21.15.44:0/792544350 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f665009b610 con 0x561d4453c2c0 2024-08-19T00:21:11.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.365+0000 7f66670dc740 1 -- 172.21.15.44:0/792544350 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f665007e070 con 0x561d4453c2c0 2024-08-19T00:21:11.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.365+0000 7f6645ffb640 1 -- 172.21.15.44:0/792544350 <== mon.2 v2:172.21.15.116:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9621+0+0 (secure 0 0 0) 0x7f6650097c10 con 0x561d4453c2c0 2024-08-19T00:21:11.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.365+0000 7f6645ffb640 1 -- 172.21.15.44:0/792544350 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f665009b390 con 0x561d4453c2c0 2024-08-19T00:21:11.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.366+0000 7f66670dc740 10 client.25940 fetch_fsmap learned FSMap version 33 2024-08-19T00:21:11.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.366+0000 7f66670dc740 1 -- 172.21.15.44:0/792544350 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x561d445c6970 con 0x561d4453c2c0 2024-08-19T00:21:11.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.366+0000 7f6645ffb640 1 -- 172.21.15.44:0/792544350 <== mon.2 v2:172.21.15.116:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f665007e070 con 0x561d4453c2c0 2024-08-19T00:21:11.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.366+0000 7f6645ffb640 1 -- 172.21.15.44:0/792544350 <== mon.2 v2:172.21.15.116:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f66500a4c90 con 0x561d4453c2c0 2024-08-19T00:21:11.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.366+0000 7f66670dc740 10 client.25940 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:21:11.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.366+0000 7f66670dc740 10 client.25940 resolve_mds: validated gid 24473 aka daemon mds.b 2024-08-19T00:21:11.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.366+0000 7f66670dc740 20 client.25940 populate_metadata read hostname 'smithi044' 2024-08-19T00:21:11.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.366+0000 7f66670dc740 1 --2- 172.21.15.44:0/792544350 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x561d445c6dc0 0x561d445c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:11.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.366+0000 7f66670dc740 4 client.25940 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 143.75, "await_for": 45.0}] 2024-08-19T00:21:11.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.366+0000 7f66670dc740 1 -- 172.21.15.44:0/792544350 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 143.75, "await_for": 45.0}) -- 0x561d444a9290 con 0x561d445c6dc0 2024-08-19T00:21:11.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.366+0000 7f665dd9b640 1 --2- 172.21.15.44:0/792544350 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x561d445c6dc0 0x561d445c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:11.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.367+0000 7f665dd9b640 1 --2- 172.21.15.44:0/792544350 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x561d445c6dc0 0x561d445c91b0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3aeb18bbd59e1a14 server_cookie=4d7653fbf12f90e6 in_seq=0 out_seq=0 2024-08-19T00:21:11.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.367+0000 7f6645ffb640 10 client.25940 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:21:11.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.432+0000 7f6645ffb640 1 -- 172.21.15.44:0/792544350 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x561d444a9290 con 0x561d445c6dc0 2024-08-19T00:21:11.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.432+0000 7f6645ffb640 10 client.25940 handle_command_reply: tid=0 2024-08-19T00:21:11.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.432+0000 7f66670dc740 1 client.25940 shutdown 2024-08-19T00:21:11.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.432+0000 7f66670dc740 1 -- 172.21.15.44:0/792544350 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561d4453c2c0 msgr2=0x561d4454f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:11.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.432+0000 7f66670dc740 1 --2- 172.21.15.44:0/792544350 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561d4453c2c0 0x561d4454f380 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6650099f60 tx=0x7f665000c7d0 comp rx=0 tx=0).stop 2024-08-19T00:21:11.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.432+0000 7f66670dc740 1 -- 172.21.15.44:0/792544350 shutdown_connections 2024-08-19T00:21:11.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.432+0000 7f66670dc740 1 --2- 172.21.15.44:0/792544350 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x561d445c6dc0 0x561d445c91b0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:11.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.432+0000 7f66670dc740 1 --2- 172.21.15.44:0/792544350 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561d4453cbe0 0x561d4454f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:11.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.432+0000 7f66670dc740 1 --2- 172.21.15.44:0/792544350 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d445474a0 0x561d445bb030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:11.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.432+0000 7f66670dc740 1 --2- 172.21.15.44:0/792544350 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561d4453c2c0 0x561d4454f380 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:11.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.432+0000 7f6645ffb640 0 client.25940 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:21:11.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.432+0000 7f66670dc740 1 -- 172.21.15.44:0/792544350 >> 172.21.15.44:0/792544350 conn(0x561d44538850 msgr2=0x561d44537b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:21:11.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.432+0000 7f66670dc740 1 -- 172.21.15.44:0/792544350 shutdown_connections 2024-08-19T00:21:11.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.432+0000 7f66670dc740 1 -- 172.21.15.44:0/792544350 wait complete. 2024-08-19T00:21:11.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.432+0000 7f66670dc740 20 client.25940 trim_cache size 0 max 16384 2024-08-19T00:21:11.435 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-08-19T00:21:11.436 INFO:teuthology.orchestra.run.smithi044.stdout: "epoch": 33, 2024-08-19T00:21:11.436 INFO:teuthology.orchestra.run.smithi044.stdout: "leader": 24473, 2024-08-19T00:21:11.436 INFO:teuthology.orchestra.run.smithi044.stdout: "set_version": 26, 2024-08-19T00:21:11.436 INFO:teuthology.orchestra.run.smithi044.stdout: "sets": { 2024-08-19T00:21:11.436 INFO:teuthology.orchestra.run.smithi044.stdout: "9b539fbd": { 2024-08-19T00:21:11.436 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 26, 2024-08-19T00:21:11.436 INFO:teuthology.orchestra.run.smithi044.stdout: "age_ref": 0.0, 2024-08-19T00:21:11.436 INFO:teuthology.orchestra.run.smithi044.stdout: "state": { 2024-08-19T00:21:11.436 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "QUIESCED", 2024-08-19T00:21:11.436 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.0 2024-08-19T00:21:11.436 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:21:11.436 INFO:teuthology.orchestra.run.smithi044.stdout: "timeout": 90.0, 2024-08-19T00:21:11.436 INFO:teuthology.orchestra.run.smithi044.stdout: "expiration": 143.8, 2024-08-19T00:21:11.437 INFO:teuthology.orchestra.run.smithi044.stdout: "members": { 2024-08-19T00:21:11.437 INFO:teuthology.orchestra.run.smithi044.stdout: "file:/": { 2024-08-19T00:21:11.437 INFO:teuthology.orchestra.run.smithi044.stdout: "excluded": false, 2024-08-19T00:21:11.437 INFO:teuthology.orchestra.run.smithi044.stdout: "state": { 2024-08-19T00:21:11.437 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "QUIESCED", 2024-08-19T00:21:11.437 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.0 2024-08-19T00:21:11.437 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:21:11.437 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:21:11.437 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:21:11.437 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:21:11.437 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:21:11.437 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-08-19T00:21:11.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.433+0000 7f6664cde640 1 -- 172.21.15.44:0/600171666 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f66480a2d70 msgr2=0x7f66480a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:11.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.433+0000 7f6664cde640 1 --2- 172.21.15.44:0/600171666 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f66480a2d70 0x7f66480a5230 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6658009a60 tx=0x7f665803c040 comp rx=0 tx=0).stop 2024-08-19T00:21:11.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.433+0000 7f6664cde640 1 -- 172.21.15.44:0/600171666 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6660100b50 msgr2=0x7f66601981a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:11.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.433+0000 7f6664cde640 1 --2- 172.21.15.44:0/600171666 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6660100b50 0x7f66601981a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f665000e9f0 tx=0x7f665000eeb0 comp rx=0 tx=0).stop 2024-08-19T00:21:11.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.433+0000 7f6664cde640 1 -- 172.21.15.44:0/600171666 shutdown_connections 2024-08-19T00:21:11.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.433+0000 7f6664cde640 1 --2- 172.21.15.44:0/600171666 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f66480a2d70 0x7f66480a5230 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:11.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.433+0000 7f6664cde640 1 --2- 172.21.15.44:0/600171666 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6660102c20 0x7f666019ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:11.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.433+0000 7f6664cde640 1 --2- 172.21.15.44:0/600171666 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66601022a0 0x7f66601986e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:11.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.433+0000 7f6664cde640 1 --2- 172.21.15.44:0/600171666 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6660100b50 0x7f66601981a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:11.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.433+0000 7f6664cde640 1 -- 172.21.15.44:0/600171666 >> 172.21.15.44:0/600171666 conn(0x7f66600fc500 msgr2=0x7f6660106570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:21:11.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.433+0000 7f6664cde640 1 -- 172.21.15.44:0/600171666 shutdown_connections 2024-08-19T00:21:11.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:11.433+0000 7f6664cde640 1 -- 172.21.15.44:0/600171666 wait complete. 2024-08-19T00:21:11.685 INFO:tasks.workunit.client.0.smithi044.stdout: 1 604558 8.62 MB/sec execute 276 sec latency 250.404 ms 2024-08-19T00:21:12.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:21:12 smithi171 ceph-mon[21810]: pgmap v242: 129 pgs: 129 active+clean; 438 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.2 MiB/s wr, 289 op/s 2024-08-19T00:21:12.610 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:21:12 smithi044 ceph-mon[18489]: pgmap v242: 129 pgs: 129 active+clean; 438 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.2 MiB/s wr, 289 op/s 2024-08-19T00:21:12.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:21:12 smithi116 ceph-mon[21873]: pgmap v242: 129 pgs: 129 active+clean; 438 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.2 MiB/s wr, 289 op/s 2024-08-19T00:21:12.645 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '9b539fbd', quiesce took 4.8 seconds. Will release after: 18.95 2024-08-19T00:21:12.685 INFO:tasks.workunit.client.0.smithi044.stdout: 1 604558 8.59 MB/sec execute 277 sec latency 1250.476 ms 2024-08-19T00:21:13.685 INFO:tasks.workunit.client.0.smithi044.stdout: 1 604558 8.56 MB/sec execute 278 sec latency 2250.569 ms 2024-08-19T00:21:14.594 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:21:14 smithi171 ceph-mon[21810]: pgmap v243: 129 pgs: 129 active+clean; 438 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.2 MiB/s wr, 289 op/s 2024-08-19T00:21:14.594 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:21:14 smithi171 ceph-mon[21810]: osdmap e99: 12 total, 12 up, 12 in 2024-08-19T00:21:14.628 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:21:14 smithi044 ceph-mon[18489]: pgmap v243: 129 pgs: 129 active+clean; 438 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.2 MiB/s wr, 289 op/s 2024-08-19T00:21:14.629 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:21:14 smithi044 ceph-mon[18489]: osdmap e99: 12 total, 12 up, 12 in 2024-08-19T00:21:14.629 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:21:14 smithi116 ceph-mon[21873]: pgmap v243: 129 pgs: 129 active+clean; 438 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.2 MiB/s wr, 289 op/s 2024-08-19T00:21:14.629 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:21:14 smithi116 ceph-mon[21873]: osdmap e99: 12 total, 12 up, 12 in 2024-08-19T00:21:14.685 INFO:tasks.workunit.client.0.smithi044.stdout: 1 604558 8.53 MB/sec execute 279 sec latency 3250.636 ms 2024-08-19T00:21:15.539 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.537+0000 7f032081e640 1 -- 172.21.15.44:0/3906777865 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f031c1006e0 msgr2=0x7f031c100b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:15.539 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.537+0000 7f032081e640 1 --2- 172.21.15.44:0/3906777865 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f031c1006e0 0x7f031c100b40 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f0310009930 tx=0x7f031002a420 comp rx=0 tx=0).stop 2024-08-19T00:21:15.540 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.538+0000 7f032081e640 1 -- 172.21.15.44:0/3906777865 shutdown_connections 2024-08-19T00:21:15.540 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.538+0000 7f032081e640 1 --2- 172.21.15.44:0/3906777865 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f031c101080 0x7f031c10d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:15.540 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.538+0000 7f032081e640 1 --2- 172.21.15.44:0/3906777865 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f031c1006e0 0x7f031c100b40 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:15.540 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.538+0000 7f032081e640 1 --2- 172.21.15.44:0/3906777865 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f031c1066f0 0x7f031c106ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:15.540 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.538+0000 7f032081e640 1 -- 172.21.15.44:0/3906777865 >> 172.21.15.44:0/3906777865 conn(0x7f031c0776c0 msgr2=0x7f031c0fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:21:15.540 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.538+0000 7f032081e640 1 -- 172.21.15.44:0/3906777865 shutdown_connections 2024-08-19T00:21:15.540 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.538+0000 7f032081e640 1 -- 172.21.15.44:0/3906777865 wait complete. 2024-08-19T00:21:15.542 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.538+0000 7f032081e640 1 Processor -- start 2024-08-19T00:21:15.542 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.538+0000 7f032081e640 1 -- start start 2024-08-19T00:21:15.542 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.538+0000 7f032081e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f031c1006e0 0x7f031c198100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:15.542 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.539+0000 7f032081e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f031c101080 0x7f031c198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:15.542 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.539+0000 7f032081e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f031c1066f0 0x7f031c19c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:15.542 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.539+0000 7f032081e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f031c110b40 con 0x7f031c1066f0 2024-08-19T00:21:15.543 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.539+0000 7f032081e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f031c1109c0 con 0x7f031c101080 2024-08-19T00:21:15.543 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.539+0000 7f032081e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f031c110cc0 con 0x7f031c1006e0 2024-08-19T00:21:15.543 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.539+0000 7f031ad9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f031c1066f0 0x7f031c19c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:15.543 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.539+0000 7f031ad9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f031c1066f0 0x7f031c19c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54088/0 (socket says 172.21.15.44:54088) 2024-08-19T00:21:15.543 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.539+0000 7f031ad9d640 1 -- 172.21.15.44:0/774135985 learned_addr learned my addr 172.21.15.44:0/774135985 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:21:15.543 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.539+0000 7f0319d9b640 1 --2- 172.21.15.44:0/774135985 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f031c101080 0x7f031c198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:15.543 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.539+0000 7f031a59c640 1 --2- 172.21.15.44:0/774135985 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f031c1006e0 0x7f031c198100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:15.543 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.539+0000 7f031ad9d640 1 -- 172.21.15.44:0/774135985 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f031c1006e0 msgr2=0x7f031c198100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:15.543 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.539+0000 7f031ad9d640 1 --2- 172.21.15.44:0/774135985 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f031c1006e0 0x7f031c198100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:15.543 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.539+0000 7f031ad9d640 1 -- 172.21.15.44:0/774135985 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f031c101080 msgr2=0x7f031c198640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:15.543 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.539+0000 7f031ad9d640 1 --2- 172.21.15.44:0/774135985 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f031c101080 0x7f031c198640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:15.543 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.539+0000 7f031ad9d640 1 -- 172.21.15.44:0/774135985 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f031c19d0f0 con 0x7f031c1066f0 2024-08-19T00:21:15.543 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.539+0000 7f031a59c640 1 --2- 172.21.15.44:0/774135985 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f031c1006e0 0x7f031c198100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:21:15.544 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.539+0000 7f031ad9d640 1 --2- 172.21.15.44:0/774135985 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f031c1066f0 0x7f031c19c9c0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f031400eaa0 tx=0x7f031400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:21:15.544 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.539+0000 7f030b7fe640 1 -- 172.21.15.44:0/774135985 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f031400cdb0 con 0x7f031c1066f0 2024-08-19T00:21:15.544 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.539+0000 7f032081e640 1 -- 172.21.15.44:0/774135985 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f031c19d3e0 con 0x7f031c1066f0 2024-08-19T00:21:15.544 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.539+0000 7f030b7fe640 1 -- 172.21.15.44:0/774135985 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0314005020 con 0x7f031c1066f0 2024-08-19T00:21:15.544 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.539+0000 7f030b7fe640 1 -- 172.21.15.44:0/774135985 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03140116b0 con 0x7f031c1066f0 2024-08-19T00:21:15.544 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.539+0000 7f032081e640 1 -- 172.21.15.44:0/774135985 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f031c1a4c70 con 0x7f031c1066f0 2024-08-19T00:21:15.550 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.542+0000 7f030b7fe640 1 -- 172.21.15.44:0/774135985 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f0314005560 con 0x7f031c1066f0 2024-08-19T00:21:15.550 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.542+0000 7f03235e1740 1 Processor -- start 2024-08-19T00:21:15.550 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.542+0000 7f03235e1740 1 -- start start 2024-08-19T00:21:15.550 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.542+0000 7f03235e1740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d3b5d1b670 0x55d3b5d1ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:15.550 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.542+0000 7f03235e1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d3b5d1bf90 0x55d3b5d2a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:15.550 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.542+0000 7f03235e1740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3b5d2ada0 0x55d3b5d2d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:15.550 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.542+0000 7f03235e1740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55d3b5c7f9d0 con 0x55d3b5d1bf90 2024-08-19T00:21:15.550 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.542+0000 7f03235e1740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55d3b5c27820 con 0x55d3b5d1b670 2024-08-19T00:21:15.550 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.543+0000 7f03235e1740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55d3b5c7b990 con 0x55d3b5d2ada0 2024-08-19T00:21:15.551 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.543+0000 7f031a59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d3b5d1bf90 0x55d3b5d2a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:15.551 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.543+0000 7f031a59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d3b5d1bf90 0x55d3b5d2a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54094/0 (socket says 172.21.15.44:54094) 2024-08-19T00:21:15.551 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.543+0000 7f031a59c640 1 -- 172.21.15.44:0/1273568535 learned_addr learned my addr 172.21.15.44:0/1273568535 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:21:15.551 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.543+0000 7f0319d9b640 1 --2- 172.21.15.44:0/1273568535 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3b5d2ada0 0x55d3b5d2d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:15.551 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.543+0000 7f030b7fe640 1 --2- 172.21.15.44:0/774135985 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f03040a2da0 0x7f03040a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:15.551 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.543+0000 7f0319d9b640 1 --2- 172.21.15.44:0/1273568535 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d3b5d1b670 0x55d3b5d1ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:15.551 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.543+0000 7f031a59c640 1 -- 172.21.15.44:0/1273568535 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3b5d2ada0 msgr2=0x55d3b5d2d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:15.551 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.543+0000 7f031a59c640 1 --2- 172.21.15.44:0/1273568535 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3b5d2ada0 0x55d3b5d2d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:15.551 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.543+0000 7f031a59c640 1 -- 172.21.15.44:0/1273568535 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d3b5d1b670 msgr2=0x55d3b5d1ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:15.551 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.543+0000 7f031a59c640 1 --2- 172.21.15.44:0/1273568535 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d3b5d1b670 0x55d3b5d1ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:15.551 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.543+0000 7f031ad9d640 1 --2- 172.21.15.44:0/774135985 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f03040a2da0 0x7f03040a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:15.551 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.543+0000 7f031a59c640 1 -- 172.21.15.44:0/1273568535 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3b5993210 con 0x55d3b5d1bf90 2024-08-19T00:21:15.551 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.543+0000 7f0319d9b640 1 --2- 172.21.15.44:0/1273568535 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d3b5d1b670 0x55d3b5d1ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:21:15.552 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.543+0000 7f030b7fe640 1 -- 172.21.15.44:0/774135985 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9533+0+0 (secure 0 0 0) 0x7f03140cfa90 con 0x7f031c1066f0 2024-08-19T00:21:15.552 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.543+0000 7f031a59c640 1 --2- 172.21.15.44:0/1273568535 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d3b5d1bf90 0x55d3b5d2a860 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f030c00dc40 tx=0x7f030c00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df7799f7cc5fdf66 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:21:15.552 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.543+0000 7f0308ff9640 1 -- 172.21.15.44:0/1273568535 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f030c005020 con 0x55d3b5d1bf90 2024-08-19T00:21:15.552 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.543+0000 7f0308ff9640 1 -- 172.21.15.44:0/1273568535 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f030c0047a0 con 0x55d3b5d1bf90 2024-08-19T00:21:15.552 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.544+0000 7f0308ff9640 1 -- 172.21.15.44:0/1273568535 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f030c0116a0 con 0x55d3b5d1bf90 2024-08-19T00:21:15.552 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.544+0000 7f03235e1740 1 -- 172.21.15.44:0/1273568535 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d3b5d1bf90 msgr2=0x55d3b5d2a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:15.552 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.544+0000 7f03235e1740 1 --2- 172.21.15.44:0/1273568535 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d3b5d1bf90 0x55d3b5d2a860 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f030c00dc40 tx=0x7f030c00f730 comp rx=0 tx=0).stop 2024-08-19T00:21:15.552 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.544+0000 7f031ad9d640 1 --2- 172.21.15.44:0/774135985 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f03040a2da0 0x7f03040a5260 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0314009270 tx=0x7f03140054d0 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:21:15.552 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.544+0000 7f03235e1740 1 -- 172.21.15.44:0/1273568535 shutdown_connections 2024-08-19T00:21:15.552 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.544+0000 7f03235e1740 1 --2- 172.21.15.44:0/1273568535 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3b5d2ada0 0x55d3b5d2d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:15.552 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.544+0000 7f03235e1740 1 --2- 172.21.15.44:0/1273568535 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d3b5d1bf90 0x55d3b5d2a860 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:15.552 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.544+0000 7f03235e1740 1 --2- 172.21.15.44:0/1273568535 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d3b5d1b670 0x55d3b5d1ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:15.552 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.544+0000 7f03235e1740 1 -- 172.21.15.44:0/1273568535 >> 172.21.15.44:0/1273568535 conn(0x55d3b5d17d40 msgr2=0x55d3b5d18120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:21:15.553 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.544+0000 7f03235e1740 1 -- 172.21.15.44:0/1273568535 shutdown_connections 2024-08-19T00:21:15.553 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.544+0000 7f03235e1740 1 -- 172.21.15.44:0/1273568535 wait complete. 2024-08-19T00:21:15.553 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.545+0000 7f03235e1740 1 -- start start 2024-08-19T00:21:15.553 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.545+0000 7f03235e1740 1 Processor -- start 2024-08-19T00:21:15.553 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.545+0000 7f03235e1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d3b5d1b670 0x55d3b5d27d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:15.553 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.545+0000 7f03235e1740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d3b5d1bf90 0x55d3b5d28240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:15.553 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.545+0000 7f03235e1740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3b5d2ada0 0x55d3b5d28780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:15.553 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.545+0000 7f03235e1740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55d3b5d2d9d0 con 0x55d3b5d1b670 2024-08-19T00:21:15.553 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.545+0000 7f03235e1740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55d3b5c3b520 con 0x55d3b5d1bf90 2024-08-19T00:21:15.553 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.545+0000 7f03235e1740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55d3b5d2db50 con 0x55d3b5d2ada0 2024-08-19T00:21:15.553 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.545+0000 7f03235e1740 10 client.0 _ll_register_callbacks cb 0x55d3b5992a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:21:15.553 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.545+0000 7f0319d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d3b5d1b670 0x55d3b5d27d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:15.553 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.545+0000 7f0319d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d3b5d1b670 0x55d3b5d27d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54100/0 (socket says 172.21.15.44:54100) 2024-08-19T00:21:15.553 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.545+0000 7f0319d9b640 1 -- 172.21.15.44:0/4063149921 learned_addr learned my addr 172.21.15.44:0/4063149921 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:21:15.554 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.545+0000 7f031a59c640 1 --2- 172.21.15.44:0/4063149921 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d3b5d1bf90 0x55d3b5d28240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:15.554 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.545+0000 7f0319d9b640 1 --2- 172.21.15.44:0/4063149921 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3b5d2ada0 0x55d3b5d28780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:15.554 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.545+0000 7f0319d9b640 1 -- 172.21.15.44:0/4063149921 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3b5d2ada0 msgr2=0x55d3b5d28780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:15.554 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.545+0000 7f0319d9b640 1 --2- 172.21.15.44:0/4063149921 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3b5d2ada0 0x55d3b5d28780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:15.554 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.545+0000 7f0319d9b640 1 -- 172.21.15.44:0/4063149921 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d3b5d1bf90 msgr2=0x55d3b5d28240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:15.554 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.545+0000 7f0319d9b640 1 --2- 172.21.15.44:0/4063149921 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d3b5d1bf90 0x55d3b5d28240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:15.554 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.545+0000 7f0319d9b640 1 -- 172.21.15.44:0/4063149921 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3b5a5f620 con 0x55d3b5d1b670 2024-08-19T00:21:15.554 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.545+0000 7f031a59c640 1 --2- 172.21.15.44:0/4063149921 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d3b5d1bf90 0x55d3b5d28240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:21:15.554 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.546+0000 7f0319d9b640 1 --2- 172.21.15.44:0/4063149921 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d3b5d1b670 0x55d3b5d27d00 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f0310033000 tx=0x7f0310005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c419d5c367dded01 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:21:15.554 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.546+0000 7f0301ffb640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:21:15.554 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.546+0000 7f0301ffb640 1 -- 172.21.15.44:0/4063149921 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0310035040 con 0x55d3b5d1b670 2024-08-19T00:21:15.554 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.546+0000 7f03235e1740 1 -- 172.21.15.44:0/4063149921 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f030c0047a0 con 0x55d3b5d1b670 2024-08-19T00:21:15.554 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.546+0000 7f0301ffb640 1 -- 172.21.15.44:0/4063149921 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9533+0+0 (secure 0 0 0) 0x7f03100048c0 con 0x55d3b5d1b670 2024-08-19T00:21:15.555 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.546+0000 7f0301ffb640 1 -- 172.21.15.44:0/4063149921 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f0310004ac0 con 0x55d3b5d1b670 2024-08-19T00:21:15.555 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.546+0000 7f03235e1740 10 client.16497 fetch_fsmap learned FSMap version 33 2024-08-19T00:21:15.555 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.546+0000 7f03235e1740 1 -- 172.21.15.44:0/4063149921 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55d3b5d396f0 con 0x55d3b5d1b670 2024-08-19T00:21:15.555 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.546+0000 7f0301ffb640 1 -- 172.21.15.44:0/4063149921 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f030c0047a0 con 0x55d3b5d1b670 2024-08-19T00:21:15.555 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.546+0000 7f0301ffb640 1 -- 172.21.15.44:0/4063149921 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f03100035f0 con 0x55d3b5d1b670 2024-08-19T00:21:15.555 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.546+0000 7f03235e1740 10 client.16497 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:21:15.555 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.546+0000 7f03235e1740 10 client.16497 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:21:15.555 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.546+0000 7f03235e1740 20 client.16497 populate_metadata read hostname 'smithi044' 2024-08-19T00:21:15.555 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.546+0000 7f03235e1740 1 --2- 172.21.15.44:0/4063149921 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55d3b5d3ab60 0x55d3b5d3cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:15.555 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.546+0000 7f03235e1740 4 client.16497 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:21:15.555 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.546+0000 7f03235e1740 1 -- 172.21.15.44:0/4063149921 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d3b5c8d100 con 0x55d3b5d3ab60 2024-08-19T00:21:15.555 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.547+0000 7f031a59c640 1 --2- 172.21.15.44:0/4063149921 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55d3b5d3ab60 0x55d3b5d3cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:15.555 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.547+0000 7f0301ffb640 10 client.16497 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:21:15.556 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.547+0000 7f031a59c640 1 --2- 172.21.15.44:0/4063149921 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55d3b5d3ab60 0x55d3b5d3cf50 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a48ce1b0a839447f server_cookie=aed5c10deb96b893 in_seq=0 out_seq=0 2024-08-19T00:21:15.556 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.548+0000 7f0301ffb640 1 -- 172.21.15.44:0/4063149921 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d3b5c8d100 con 0x55d3b5d3ab60 2024-08-19T00:21:15.556 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.548+0000 7f0301ffb640 10 client.16497 handle_command_reply: tid=0 2024-08-19T00:21:15.556 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.548+0000 7f03235e1740 1 client.16497 shutdown 2024-08-19T00:21:15.556 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.548+0000 7f03235e1740 1 -- 172.21.15.44:0/4063149921 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d3b5d1b670 msgr2=0x55d3b5d27d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:15.556 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.548+0000 7f03235e1740 1 --2- 172.21.15.44:0/4063149921 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d3b5d1b670 0x55d3b5d27d00 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f0310033000 tx=0x7f0310005d50 comp rx=0 tx=0).stop 2024-08-19T00:21:15.556 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.548+0000 7f03235e1740 1 -- 172.21.15.44:0/4063149921 shutdown_connections 2024-08-19T00:21:15.556 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.548+0000 7f03235e1740 1 --2- 172.21.15.44:0/4063149921 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55d3b5d3ab60 0x55d3b5d3cf50 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:15.556 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.548+0000 7f03235e1740 1 --2- 172.21.15.44:0/4063149921 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3b5d2ada0 0x55d3b5d28780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:15.556 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.548+0000 7f03235e1740 1 --2- 172.21.15.44:0/4063149921 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d3b5d1bf90 0x55d3b5d28240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:15.556 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.548+0000 7f0301ffb640 0 client.16497 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:21:15.556 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.548+0000 7f03235e1740 1 --2- 172.21.15.44:0/4063149921 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d3b5d1b670 0x55d3b5d27d00 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:15.556 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.548+0000 7f03235e1740 1 -- 172.21.15.44:0/4063149921 >> 172.21.15.44:0/4063149921 conn(0x55d3b5d17d40 msgr2=0x55d3b5d1da40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:21:15.557 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.548+0000 7f03235e1740 1 -- 172.21.15.44:0/4063149921 shutdown_connections 2024-08-19T00:21:15.557 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.548+0000 7f03235e1740 1 -- 172.21.15.44:0/4063149921 wait complete. 2024-08-19T00:21:15.557 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.548+0000 7f03235e1740 20 client.16497 trim_cache size 0 max 16384 2024-08-19T00:21:15.568 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.562+0000 7f03235e1740 1 Processor -- start 2024-08-19T00:21:15.568 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.562+0000 7f03235e1740 1 -- start start 2024-08-19T00:21:15.568 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.562+0000 7f03235e1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d3b5d1b670 0x55d3b5d29b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:15.568 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.562+0000 7f03235e1740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3b5d1bf90 0x55d3b5d427f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:15.568 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.562+0000 7f03235e1740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d3b5d2ada0 0x55d3b5d42d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:15.568 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.562+0000 7f03235e1740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f031c1acbf0 con 0x55d3b5d1b670 2024-08-19T00:21:15.568 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.562+0000 7f03235e1740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f031c1ae730 con 0x55d3b5d2ada0 2024-08-19T00:21:15.568 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.562+0000 7f03235e1740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f031c1ad2c0 con 0x55d3b5d1bf90 2024-08-19T00:21:15.569 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.563+0000 7f0319d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d3b5d1b670 0x55d3b5d29b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:15.569 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.563+0000 7f0319d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d3b5d1b670 0x55d3b5d29b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54112/0 (socket says 172.21.15.44:54112) 2024-08-19T00:21:15.569 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.563+0000 7f0319d9b640 1 -- 172.21.15.44:0/4020669780 learned_addr learned my addr 172.21.15.44:0/4020669780 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:21:15.569 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.563+0000 7f031a59c640 1 --2- 172.21.15.44:0/4020669780 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3b5d1bf90 0x55d3b5d427f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:15.569 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.563+0000 7f0319d9b640 1 -- 172.21.15.44:0/4020669780 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3b5d1bf90 msgr2=0x55d3b5d427f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:15.569 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.563+0000 7f0319d9b640 1 --2- 172.21.15.44:0/4020669780 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3b5d1bf90 0x55d3b5d427f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:15.569 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.563+0000 7f0319d9b640 1 -- 172.21.15.44:0/4020669780 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d3b5d2ada0 msgr2=0x55d3b5d42d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:15.569 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.563+0000 7f0319d9b640 1 --2- 172.21.15.44:0/4020669780 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d3b5d2ada0 0x55d3b5d42d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:15.569 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.563+0000 7f0319d9b640 1 -- 172.21.15.44:0/4020669780 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3b5d1bdc0 con 0x55d3b5d1b670 2024-08-19T00:21:15.569 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.563+0000 7f031a59c640 1 --2- 172.21.15.44:0/4020669780 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3b5d1bf90 0x55d3b5d427f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:21:15.569 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.563+0000 7f0319d9b640 1 --2- 172.21.15.44:0/4020669780 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d3b5d1b670 0x55d3b5d29b60 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f0310009850 tx=0x7f0310000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1db7b685998279e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:21:15.569 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.563+0000 7f0303fff640 1 -- 172.21.15.44:0/4020669780 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f031005a070 con 0x55d3b5d1b670 2024-08-19T00:21:15.569 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.563+0000 7f0303fff640 1 -- 172.21.15.44:0/4020669780 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f03100037f0 con 0x55d3b5d1b670 2024-08-19T00:21:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.563+0000 7f0303fff640 1 -- 172.21.15.44:0/4020669780 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0310035070 con 0x55d3b5d1b670 2024-08-19T00:21:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.564+0000 7f03235e1740 1 -- 172.21.15.44:0/4020669780 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d3b5d1b670 msgr2=0x55d3b5d29b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.564+0000 7f03235e1740 1 --2- 172.21.15.44:0/4020669780 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d3b5d1b670 0x55d3b5d29b60 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f0310009850 tx=0x7f0310000bc0 comp rx=0 tx=0).stop 2024-08-19T00:21:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.564+0000 7f03235e1740 1 -- 172.21.15.44:0/4020669780 shutdown_connections 2024-08-19T00:21:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.564+0000 7f03235e1740 1 --2- 172.21.15.44:0/4020669780 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3b5d1bf90 0x55d3b5d427f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.564+0000 7f03235e1740 1 --2- 172.21.15.44:0/4020669780 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d3b5d2ada0 0x55d3b5d42d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.564+0000 7f03235e1740 1 --2- 172.21.15.44:0/4020669780 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d3b5d1b670 0x55d3b5d29b60 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.564+0000 7f03235e1740 1 -- 172.21.15.44:0/4020669780 >> 172.21.15.44:0/4020669780 conn(0x55d3b5d17d40 msgr2=0x55d3b5d29450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:21:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.564+0000 7f03235e1740 1 -- 172.21.15.44:0/4020669780 shutdown_connections 2024-08-19T00:21:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.564+0000 7f03235e1740 1 -- 172.21.15.44:0/4020669780 wait complete. 2024-08-19T00:21:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.564+0000 7f03235e1740 1 -- start start 2024-08-19T00:21:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.564+0000 7f03235e1740 1 Processor -- start 2024-08-19T00:21:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.564+0000 7f03235e1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d3b5d1b670 0x55d3b5d33040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:15.571 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.564+0000 7f03235e1740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d3b5d1bf90 0x55d3b5d33580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:15.571 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.564+0000 7f03235e1740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3b5d2ada0 0x55d3b5d245b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:15.571 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.564+0000 7f03235e1740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f031c1ae060 con 0x55d3b5d1b670 2024-08-19T00:21:15.571 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.564+0000 7f03235e1740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f031c1ad990 con 0x55d3b5d1bf90 2024-08-19T00:21:15.571 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.564+0000 7f03235e1740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f031c1aabf0 con 0x55d3b5d2ada0 2024-08-19T00:21:15.571 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.564+0000 7f03235e1740 10 client.0 _ll_register_callbacks cb 0x7f0310004590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:21:15.571 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.565+0000 7f0319d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d3b5d1b670 0x55d3b5d33040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:15.571 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.565+0000 7f0319d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d3b5d1b670 0x55d3b5d33040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54128/0 (socket says 172.21.15.44:54128) 2024-08-19T00:21:15.571 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.565+0000 7f0319d9b640 1 -- 172.21.15.44:0/478144816 learned_addr learned my addr 172.21.15.44:0/478144816 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:21:15.571 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.565+0000 7f031a59c640 1 --2- 172.21.15.44:0/478144816 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d3b5d1bf90 0x55d3b5d33580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:15.571 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.565+0000 7f0319d9b640 1 --2- 172.21.15.44:0/478144816 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3b5d2ada0 0x55d3b5d245b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:15.571 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.565+0000 7f0319d9b640 1 -- 172.21.15.44:0/478144816 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3b5d2ada0 msgr2=0x55d3b5d245b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:15.571 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.565+0000 7f0319d9b640 1 --2- 172.21.15.44:0/478144816 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3b5d2ada0 0x55d3b5d245b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:15.572 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.565+0000 7f0319d9b640 1 -- 172.21.15.44:0/478144816 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d3b5d1bf90 msgr2=0x55d3b5d33580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:15.572 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.565+0000 7f0319d9b640 1 --2- 172.21.15.44:0/478144816 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d3b5d1bf90 0x55d3b5d33580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:15.572 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.565+0000 7f0319d9b640 1 -- 172.21.15.44:0/478144816 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3b5d24de0 con 0x55d3b5d1b670 2024-08-19T00:21:15.572 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.565+0000 7f031a59c640 1 --2- 172.21.15.44:0/478144816 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d3b5d1bf90 0x55d3b5d33580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:21:15.572 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.565+0000 7f0319d9b640 1 --2- 172.21.15.44:0/478144816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d3b5d1b670 0x55d3b5d33040 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f0310031550 tx=0x7f0310004ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfd867e251ba54a9 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:21:15.572 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.565+0000 7f0301ffb640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:21:15.572 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.565+0000 7f0301ffb640 1 -- 172.21.15.44:0/478144816 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f031005a070 con 0x55d3b5d1b670 2024-08-19T00:21:15.572 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.565+0000 7f0301ffb640 1 -- 172.21.15.44:0/478144816 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9533+0+0 (secure 0 0 0) 0x7f03100315b0 con 0x55d3b5d1b670 2024-08-19T00:21:15.572 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.565+0000 7f03235e1740 1 -- 172.21.15.44:0/478144816 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f03100037f0 con 0x55d3b5d1b670 2024-08-19T00:21:15.572 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.565+0000 7f0301ffb640 1 -- 172.21.15.44:0/478144816 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f0310035040 con 0x55d3b5d1b670 2024-08-19T00:21:15.572 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.565+0000 7f03235e1740 10 client.16503 fetch_fsmap learned FSMap version 33 2024-08-19T00:21:15.572 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.565+0000 7f03235e1740 1 -- 172.21.15.44:0/478144816 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55d3b5da5280 con 0x55d3b5d1b670 2024-08-19T00:21:15.572 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.566+0000 7f0301ffb640 1 -- 172.21.15.44:0/478144816 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f03100037f0 con 0x55d3b5d1b670 2024-08-19T00:21:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.566+0000 7f0301ffb640 1 -- 172.21.15.44:0/478144816 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f03100638c0 con 0x55d3b5d1b670 2024-08-19T00:21:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.566+0000 7f03235e1740 10 client.16503 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:21:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.566+0000 7f03235e1740 10 client.16503 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:21:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.566+0000 7f03235e1740 20 client.16503 populate_metadata read hostname 'smithi044' 2024-08-19T00:21:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.566+0000 7f03235e1740 1 --2- 172.21.15.44:0/478144816 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55d3b5da58e0 0x55d3b5da7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.566+0000 7f03235e1740 4 client.16503 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-19T00:21:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.566+0000 7f03235e1740 1 -- 172.21.15.44:0/478144816 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d3b5c87450 con 0x55d3b5da58e0 2024-08-19T00:21:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.566+0000 7f031a59c640 1 --2- 172.21.15.44:0/478144816 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55d3b5da58e0 0x55d3b5da7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.566+0000 7f031a59c640 1 --2- 172.21.15.44:0/478144816 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55d3b5da58e0 0x55d3b5da7cd0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3286ab3e048ef10c server_cookie=98e1f2bd50898ba4 in_seq=0 out_seq=0 2024-08-19T00:21:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.566+0000 7f0301ffb640 10 client.16503 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:21:15.579 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.577+0000 7f0301ffb640 1 -- 172.21.15.44:0/478144816 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d3b5c87450 con 0x55d3b5da58e0 2024-08-19T00:21:15.579 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.577+0000 7f0301ffb640 10 client.16503 handle_command_reply: tid=0 2024-08-19T00:21:15.579 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.577+0000 7f03235e1740 1 client.16503 shutdown 2024-08-19T00:21:15.579 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.577+0000 7f03235e1740 1 -- 172.21.15.44:0/478144816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d3b5d1b670 msgr2=0x55d3b5d33040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:15.579 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.577+0000 7f03235e1740 1 --2- 172.21.15.44:0/478144816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d3b5d1b670 0x55d3b5d33040 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f0310031550 tx=0x7f0310004ee0 comp rx=0 tx=0).stop 2024-08-19T00:21:15.579 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.577+0000 7f03235e1740 1 -- 172.21.15.44:0/478144816 shutdown_connections 2024-08-19T00:21:15.579 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.577+0000 7f03235e1740 1 --2- 172.21.15.44:0/478144816 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55d3b5da58e0 0x55d3b5da7cd0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:15.579 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.577+0000 7f03235e1740 1 --2- 172.21.15.44:0/478144816 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3b5d2ada0 0x55d3b5d245b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:15.579 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.577+0000 7f03235e1740 1 --2- 172.21.15.44:0/478144816 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d3b5d1bf90 0x55d3b5d33580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:15.579 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.577+0000 7f0301ffb640 0 client.16503 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:21:15.580 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.577+0000 7f03235e1740 1 --2- 172.21.15.44:0/478144816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d3b5d1b670 0x55d3b5d33040 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:15.580 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.577+0000 7f03235e1740 1 -- 172.21.15.44:0/478144816 >> 172.21.15.44:0/478144816 conn(0x55d3b5d17d40 msgr2=0x55d3b5d1d190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:21:15.580 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.577+0000 7f03235e1740 1 -- 172.21.15.44:0/478144816 shutdown_connections 2024-08-19T00:21:15.580 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.577+0000 7f03235e1740 1 -- 172.21.15.44:0/478144816 wait complete. 2024-08-19T00:21:15.580 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.577+0000 7f03235e1740 20 client.16503 trim_cache size 0 max 16384 2024-08-19T00:21:15.580 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:{ 2024-08-19T00:21:15.580 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "message": "", 2024-08-19T00:21:15.580 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "return_code": 0 2024-08-19T00:21:15.580 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:} 2024-08-19T00:21:15.581 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.578+0000 7f032081e640 1 -- 172.21.15.44:0/774135985 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f03040a2da0 msgr2=0x7f03040a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:15.581 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.578+0000 7f032081e640 1 --2- 172.21.15.44:0/774135985 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f03040a2da0 0x7f03040a5260 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0314009270 tx=0x7f03140054d0 comp rx=0 tx=0).stop 2024-08-19T00:21:15.581 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.578+0000 7f032081e640 1 -- 172.21.15.44:0/774135985 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f031c1066f0 msgr2=0x7f031c19c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:15.581 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.578+0000 7f032081e640 1 --2- 172.21.15.44:0/774135985 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f031c1066f0 0x7f031c19c9c0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f031400eaa0 tx=0x7f031400ef60 comp rx=0 tx=0).stop 2024-08-19T00:21:15.581 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.578+0000 7f032081e640 1 -- 172.21.15.44:0/774135985 shutdown_connections 2024-08-19T00:21:15.582 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.578+0000 7f032081e640 1 --2- 172.21.15.44:0/774135985 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f03040a2da0 0x7f03040a5260 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:15.582 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.578+0000 7f032081e640 1 --2- 172.21.15.44:0/774135985 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f031c1066f0 0x7f031c19c9c0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:15.582 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.578+0000 7f032081e640 1 --2- 172.21.15.44:0/774135985 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f031c101080 0x7f031c198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:15.582 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.578+0000 7f032081e640 1 --2- 172.21.15.44:0/774135985 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f031c1006e0 0x7f031c198100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:15.582 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.578+0000 7f032081e640 1 -- 172.21.15.44:0/774135985 >> 172.21.15.44:0/774135985 conn(0x7f031c0776c0 msgr2=0x7f031c069710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:21:15.582 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.578+0000 7f032081e640 1 -- 172.21.15.44:0/774135985 shutdown_connections 2024-08-19T00:21:15.582 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:15.578+0000 7f032081e640 1 -- 172.21.15.44:0/774135985 wait complete. 2024-08-19T00:21:15.685 INFO:tasks.workunit.client.0.smithi044.stdout: 1 604558 8.50 MB/sec execute 280 sec latency 4250.678 ms 2024-08-19T00:21:16.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:21:16 smithi171 ceph-mon[21810]: pgmap v245: 129 pgs: 129 active+clean; 440 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.3 MiB/s wr, 245 op/s 2024-08-19T00:21:16.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:21:16 smithi116 ceph-mon[21873]: pgmap v245: 129 pgs: 129 active+clean; 440 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.3 MiB/s wr, 245 op/s 2024-08-19T00:21:16.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:21:16 smithi044 ceph-mon[18489]: pgmap v245: 129 pgs: 129 active+clean; 440 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.3 MiB/s wr, 245 op/s 2024-08-19T00:21:16.685 INFO:tasks.workunit.client.0.smithi044.stdout: 1 604558 8.47 MB/sec execute 281 sec latency 5250.790 ms 2024-08-19T00:21:17.685 INFO:tasks.workunit.client.0.smithi044.stdout: 1 604558 8.44 MB/sec execute 282 sec latency 6250.898 ms 2024-08-19T00:21:18.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:21:18 smithi171 ceph-mon[21810]: pgmap v246: 129 pgs: 129 active+clean; 440 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.6 MiB/s wr, 207 op/s 2024-08-19T00:21:18.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:21:18 smithi116 ceph-mon[21873]: pgmap v246: 129 pgs: 129 active+clean; 440 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.6 MiB/s wr, 207 op/s 2024-08-19T00:21:18.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:21:18 smithi044 ceph-mon[18489]: pgmap v246: 129 pgs: 129 active+clean; 440 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.6 MiB/s wr, 207 op/s 2024-08-19T00:21:18.685 INFO:tasks.workunit.client.0.smithi044.stdout: 1 604558 8.41 MB/sec execute 283 sec latency 7250.943 ms 2024-08-19T00:21:19.685 INFO:tasks.workunit.client.0.smithi044.stdout: 1 604558 8.38 MB/sec execute 284 sec latency 8251.041 ms 2024-08-19T00:21:20.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:21:20 smithi171 ceph-mon[21810]: pgmap v247: 129 pgs: 129 active+clean; 440 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.4 MiB/s wr, 196 op/s 2024-08-19T00:21:20.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:21:20 smithi116 ceph-mon[21873]: pgmap v247: 129 pgs: 129 active+clean; 440 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.4 MiB/s wr, 196 op/s 2024-08-19T00:21:20.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:21:20 smithi044 ceph-mon[18489]: pgmap v247: 129 pgs: 129 active+clean; 440 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.4 MiB/s wr, 196 op/s 2024-08-19T00:21:20.685 INFO:tasks.workunit.client.0.smithi044.stdout: 1 604558 8.35 MB/sec execute 285 sec latency 9251.168 ms 2024-08-19T00:21:21.685 INFO:tasks.workunit.client.0.smithi044.stdout: 1 604558 8.32 MB/sec execute 286 sec latency 10251.220 ms 2024-08-19T00:21:22.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:21:22 smithi171 ceph-mon[21810]: pgmap v248: 129 pgs: 129 active+clean; 439 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 2.3 MiB/s wr, 115 op/s 2024-08-19T00:21:22.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:21:22 smithi116 ceph-mon[21873]: pgmap v248: 129 pgs: 129 active+clean; 439 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 2.3 MiB/s wr, 115 op/s 2024-08-19T00:21:22.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:21:22 smithi044 ceph-mon[18489]: pgmap v248: 129 pgs: 129 active+clean; 439 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 2.3 MiB/s wr, 115 op/s 2024-08-19T00:21:22.686 INFO:tasks.workunit.client.0.smithi044.stdout: 1 604558 8.29 MB/sec execute 287 sec latency 11251.323 ms 2024-08-19T00:21:23.686 INFO:tasks.workunit.client.0.smithi044.stdout: 1 604558 8.26 MB/sec execute 288 sec latency 12251.414 ms 2024-08-19T00:21:24.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:21:24 smithi171 ceph-mon[21810]: pgmap v249: 129 pgs: 129 active+clean; 439 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 2.3 MiB/s wr, 115 op/s 2024-08-19T00:21:24.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:21:24 smithi116 ceph-mon[21873]: pgmap v249: 129 pgs: 129 active+clean; 439 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 2.3 MiB/s wr, 115 op/s 2024-08-19T00:21:24.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:21:24 smithi044 ceph-mon[18489]: pgmap v249: 129 pgs: 129 active+clean; 439 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 2.3 MiB/s wr, 115 op/s 2024-08-19T00:21:24.686 INFO:tasks.workunit.client.0.smithi044.stdout: 1 604558 8.24 MB/sec execute 289 sec latency 13251.505 ms 2024-08-19T00:21:25.686 INFO:tasks.workunit.client.0.smithi044.stdout: 1 604558 8.21 MB/sec execute 290 sec latency 14251.599 ms 2024-08-19T00:21:26.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:21:26 smithi044 ceph-mon[18489]: pgmap v250: 129 pgs: 129 active+clean; 438 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 793 KiB/s rd, 3.0 MiB/s wr, 144 op/s 2024-08-19T00:21:26.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:21:26 smithi171 ceph-mon[21810]: pgmap v250: 129 pgs: 129 active+clean; 438 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 793 KiB/s rd, 3.0 MiB/s wr, 144 op/s 2024-08-19T00:21:26.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:21:26 smithi116 ceph-mon[21873]: pgmap v250: 129 pgs: 129 active+clean; 438 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 793 KiB/s rd, 3.0 MiB/s wr, 144 op/s 2024-08-19T00:21:26.686 INFO:tasks.workunit.client.0.smithi044.stdout: 1 604558 8.18 MB/sec execute 291 sec latency 15251.736 ms 2024-08-19T00:21:27.686 INFO:tasks.workunit.client.0.smithi044.stdout: 1 604558 8.15 MB/sec execute 292 sec latency 16251.794 ms 2024-08-19T00:21:28.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:21:28 smithi171 ceph-mon[21810]: pgmap v251: 129 pgs: 129 active+clean; 438 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 1.6 MiB/s wr, 70 op/s 2024-08-19T00:21:28.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:21:28 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:21:28.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:21:28 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:21:28.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:21:28 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:21:28.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:21:28 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:21:28.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:21:28 smithi116 ceph-mon[21873]: pgmap v251: 129 pgs: 129 active+clean; 438 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 1.6 MiB/s wr, 70 op/s 2024-08-19T00:21:28.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:21:28 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:21:28.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:21:28 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:21:28.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:21:28 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:21:28.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:21:28 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:21:28.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:21:28 smithi044 ceph-mon[18489]: pgmap v251: 129 pgs: 129 active+clean; 438 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 1.6 MiB/s wr, 70 op/s 2024-08-19T00:21:28.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:21:28 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:21:28.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:21:28 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:21:28.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:21:28 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:21:28.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:21:28 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:21:28.678 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.675+0000 7f6e2d1df640 1 -- 172.21.15.44:0/1370111800 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6e28106720 msgr2=0x7f6e28106b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:28.679 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.675+0000 7f6e2d1df640 1 --2- 172.21.15.44:0/1370111800 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6e28106720 0x7f6e28106b00 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f6e18009930 tx=0x7f6e1802a420 comp rx=0 tx=0).stop 2024-08-19T00:21:28.679 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.675+0000 7f6e2d1df640 1 -- 172.21.15.44:0/1370111800 shutdown_connections 2024-08-19T00:21:28.679 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.675+0000 7f6e2d1df640 1 --2- 172.21.15.44:0/1370111800 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6e28100710 0x7f6e28100b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:28.679 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.675+0000 7f6e2d1df640 1 --2- 172.21.15.44:0/1370111800 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6e281010b0 0x7f6e2810d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:28.679 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.675+0000 7f6e2d1df640 1 --2- 172.21.15.44:0/1370111800 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6e28106720 0x7f6e28106b00 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:28.679 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.675+0000 7f6e2d1df640 1 -- 172.21.15.44:0/1370111800 >> 172.21.15.44:0/1370111800 conn(0x7f6e280fc3f0 msgr2=0x7f6e280fe810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:21:28.679 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.675+0000 7f6e2d1df640 1 -- 172.21.15.44:0/1370111800 shutdown_connections 2024-08-19T00:21:28.679 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.675+0000 7f6e2d1df640 1 -- 172.21.15.44:0/1370111800 wait complete. 2024-08-19T00:21:28.679 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.676+0000 7f6e2d1df640 1 Processor -- start 2024-08-19T00:21:28.681 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.676+0000 7f6e2d1df640 1 -- start start 2024-08-19T00:21:28.681 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.677+0000 7f6e2d1df640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6e28100710 0x7f6e28198ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:28.681 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.677+0000 7f6e2d1df640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6e281010b0 0x7f6e28199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:28.682 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.677+0000 7f6e2d1df640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6e28106720 0x7f6e281a3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:28.682 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.677+0000 7f6e2d1df640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6e28110b60 con 0x7f6e28100710 2024-08-19T00:21:28.682 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.677+0000 7f6e2d1df640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f6e281109e0 con 0x7f6e281010b0 2024-08-19T00:21:28.682 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.677+0000 7f6e2d1df640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6e28110ce0 con 0x7f6e28106720 2024-08-19T00:21:28.682 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.677+0000 7f6e26d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6e28100710 0x7f6e28198ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:28.682 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.677+0000 7f6e26d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6e28100710 0x7f6e28198ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52034/0 (socket says 172.21.15.44:52034) 2024-08-19T00:21:28.682 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.677+0000 7f6e26d9d640 1 -- 172.21.15.44:0/3802245174 learned_addr learned my addr 172.21.15.44:0/3802245174 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:21:28.682 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.677+0000 7f6e2759e640 1 --2- 172.21.15.44:0/3802245174 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6e28106720 0x7f6e281a3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:28.682 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.677+0000 7f6e2659c640 1 --2- 172.21.15.44:0/3802245174 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6e281010b0 0x7f6e28199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:28.682 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.677+0000 7f6e26d9d640 1 -- 172.21.15.44:0/3802245174 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6e28106720 msgr2=0x7f6e281a3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:28.682 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.677+0000 7f6e26d9d640 1 --2- 172.21.15.44:0/3802245174 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6e28106720 0x7f6e281a3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:28.682 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.677+0000 7f6e26d9d640 1 -- 172.21.15.44:0/3802245174 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6e281010b0 msgr2=0x7f6e28199430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:28.682 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.677+0000 7f6e26d9d640 1 --2- 172.21.15.44:0/3802245174 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6e281010b0 0x7f6e28199430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:28.683 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.677+0000 7f6e26d9d640 1 -- 172.21.15.44:0/3802245174 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e281a44b0 con 0x7f6e28100710 2024-08-19T00:21:28.683 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.678+0000 7f6e26d9d640 1 --2- 172.21.15.44:0/3802245174 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6e28100710 0x7f6e28198ef0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f6e18009230 tx=0x7f6e18004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:21:28.683 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.678+0000 7f6e0ffff640 1 -- 172.21.15.44:0/3802245174 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e1803f030 con 0x7f6e28100710 2024-08-19T00:21:28.683 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.678+0000 7f6e0ffff640 1 -- 172.21.15.44:0/3802245174 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e18003ad0 con 0x7f6e28100710 2024-08-19T00:21:28.683 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.678+0000 7f6e2d1df640 1 -- 172.21.15.44:0/3802245174 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e281a4680 con 0x7f6e28100710 2024-08-19T00:21:28.683 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.678+0000 7f6e0ffff640 1 -- 172.21.15.44:0/3802245174 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e18035070 con 0x7f6e28100710 2024-08-19T00:21:28.683 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.678+0000 7f6e2d1df640 1 -- 172.21.15.44:0/3802245174 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e281a4ae0 con 0x7f6e28100710 2024-08-19T00:21:28.686 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.681+0000 7f6e0ffff640 1 -- 172.21.15.44:0/3802245174 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f6e18042030 con 0x7f6e28100710 2024-08-19T00:21:28.687 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.681+0000 7f6e3007d740 1 Processor -- start 2024-08-19T00:21:28.687 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.681+0000 7f6e3007d740 1 -- start start 2024-08-19T00:21:28.687 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.681+0000 7f6e3007d740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a41b8fa6b0 0x55a41b8faa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:28.687 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.681+0000 7f6e3007d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a41b8fafd0 0x55a41b909860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:28.687 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.681+0000 7f6e3007d740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a41b909da0 0x55a41b90c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:28.687 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.681+0000 7f6e3007d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a41b85e9d0 con 0x55a41b8fafd0 2024-08-19T00:21:28.687 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.681+0000 7f6e3007d740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55a41b806820 con 0x55a41b909da0 2024-08-19T00:21:28.687 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.681+0000 7f6e3007d740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55a41b85a990 con 0x55a41b8fa6b0 2024-08-19T00:21:28.687 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.681+0000 7f6e26d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a41b8fafd0 0x55a41b909860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:28.687 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.681+0000 7f6e26d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a41b8fafd0 0x55a41b909860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52036/0 (socket says 172.21.15.44:52036) 2024-08-19T00:21:28.687 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.681+0000 7f6e26d9d640 1 -- 172.21.15.44:0/4095918491 learned_addr learned my addr 172.21.15.44:0/4095918491 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:21:28.687 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.681+0000 7f6e2659c640 1 --2- 172.21.15.44:0/4095918491 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a41b909da0 0x55a41b90c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:28.688 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.681+0000 7f6e0ffff640 1 --2- 172.21.15.44:0/3802245174 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f6e100a2da0 0x7f6e100a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:28.688 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.681+0000 7f6e2759e640 1 --2- 172.21.15.44:0/4095918491 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a41b8fa6b0 0x55a41b8faa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:28.688 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.682+0000 7f6e2759e640 1 --2- 172.21.15.44:0/3802245174 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f6e100a2da0 0x7f6e100a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:28.688 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.682+0000 7f6e2659c640 1 -- 172.21.15.44:0/4095918491 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a41b8fa6b0 msgr2=0x55a41b8faa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:28.688 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.682+0000 7f6e2659c640 1 --2- 172.21.15.44:0/4095918491 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a41b8fa6b0 0x55a41b8faa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:28.688 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.682+0000 7f6e2659c640 1 -- 172.21.15.44:0/4095918491 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a41b8fafd0 msgr2=0x55a41b909860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:28.688 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.682+0000 7f6e2659c640 1 --2- 172.21.15.44:0/4095918491 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a41b8fafd0 0x55a41b909860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:28.688 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.682+0000 7f6e2659c640 1 -- 172.21.15.44:0/4095918491 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a41b572210 con 0x55a41b909da0 2024-08-19T00:21:28.688 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.682+0000 7f6e26d9d640 1 --2- 172.21.15.44:0/4095918491 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a41b8fafd0 0x55a41b909860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:21:28.688 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.682+0000 7f6e0ffff640 1 -- 172.21.15.44:0/3802245174 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9533+0+0 (secure 0 0 0) 0x7f6e180efd90 con 0x7f6e28100710 2024-08-19T00:21:28.688 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.682+0000 7f6e2659c640 1 --2- 172.21.15.44:0/4095918491 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a41b909da0 0x55a41b90c190 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c00bbe0 tx=0x7f6e1c00f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cfe4c97e2b411e28 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:21:28.688 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.682+0000 7f6e2759e640 1 --2- 172.21.15.44:0/3802245174 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f6e100a2da0 0x7f6e100a5260 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6e200077f0 tx=0x7f6e20007520 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:21:28.688 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.682+0000 7f6e0d7fa640 1 -- 172.21.15.44:0/4095918491 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c015070 con 0x55a41b909da0 2024-08-19T00:21:28.689 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.682+0000 7f6e0d7fa640 1 -- 172.21.15.44:0/4095918491 <== mon.2 v2:172.21.15.116:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e1c0035f0 con 0x55a41b909da0 2024-08-19T00:21:28.689 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.682+0000 7f6e0d7fa640 1 -- 172.21.15.44:0/4095918491 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c0116a0 con 0x55a41b909da0 2024-08-19T00:21:28.689 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.683+0000 7f6e3007d740 1 -- 172.21.15.44:0/4095918491 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a41b909da0 msgr2=0x55a41b90c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:28.689 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.683+0000 7f6e3007d740 1 --2- 172.21.15.44:0/4095918491 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a41b909da0 0x55a41b90c190 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c00bbe0 tx=0x7f6e1c00f730 comp rx=0 tx=0).stop 2024-08-19T00:21:28.689 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.683+0000 7f6e3007d740 1 -- 172.21.15.44:0/4095918491 shutdown_connections 2024-08-19T00:21:28.689 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.683+0000 7f6e3007d740 1 --2- 172.21.15.44:0/4095918491 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a41b909da0 0x55a41b90c190 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:28.689 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.683+0000 7f6e3007d740 1 --2- 172.21.15.44:0/4095918491 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a41b8fafd0 0x55a41b909860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:28.689 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.683+0000 7f6e3007d740 1 --2- 172.21.15.44:0/4095918491 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a41b8fa6b0 0x55a41b8faa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:28.689 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.683+0000 7f6e3007d740 1 -- 172.21.15.44:0/4095918491 >> 172.21.15.44:0/4095918491 conn(0x55a41b8f6d40 msgr2=0x55a41b8f7120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:21:28.689 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.683+0000 7f6e3007d740 1 -- 172.21.15.44:0/4095918491 shutdown_connections 2024-08-19T00:21:28.689 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.683+0000 7f6e3007d740 1 -- 172.21.15.44:0/4095918491 wait complete. 2024-08-19T00:21:28.689 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.683+0000 7f6e3007d740 1 -- start start 2024-08-19T00:21:28.689 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.683+0000 7f6e3007d740 1 Processor -- start 2024-08-19T00:21:28.690 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.684+0000 7f6e3007d740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a41b8fa6b0 0x55a41b906d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:28.690 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.684+0000 7f6e3007d740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a41b8fafd0 0x55a41b9072b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:28.690 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.684+0000 7f6e3007d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a41b909da0 0x55a41b9077f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:28.690 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.684+0000 7f6e3007d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a41b90c9d0 con 0x55a41b909da0 2024-08-19T00:21:28.690 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.684+0000 7f6e3007d740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55a41b81a520 con 0x55a41b8fafd0 2024-08-19T00:21:28.690 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.684+0000 7f6e3007d740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55a41b90cb50 con 0x55a41b8fa6b0 2024-08-19T00:21:28.690 INFO:tasks.workunit.client.0.smithi044.stdout: 1 604558 8.12 MB/sec execute 293 sec latency 17251.826 ms 2024-08-19T00:21:28.694 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.684+0000 7f6e3007d740 10 client.0 _ll_register_callbacks cb 0x55a41b571a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:21:28.694 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.684+0000 7f6e2759e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a41b909da0 0x55a41b9077f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:28.694 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.684+0000 7f6e2759e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a41b909da0 0x55a41b9077f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52050/0 (socket says 172.21.15.44:52050) 2024-08-19T00:21:28.694 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.684+0000 7f6e2659c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a41b8fafd0 0x55a41b9072b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:28.694 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.684+0000 7f6e2759e640 1 -- 172.21.15.44:0/3742139449 learned_addr learned my addr 172.21.15.44:0/3742139449 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:21:28.694 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.684+0000 7f6e26d9d640 1 --2- 172.21.15.44:0/3742139449 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a41b8fa6b0 0x55a41b906d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:28.694 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.684+0000 7f6e2759e640 1 -- 172.21.15.44:0/3742139449 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a41b8fa6b0 msgr2=0x55a41b906d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:28.695 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.684+0000 7f6e2759e640 1 --2- 172.21.15.44:0/3742139449 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a41b8fa6b0 0x55a41b906d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:28.695 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.684+0000 7f6e2759e640 1 -- 172.21.15.44:0/3742139449 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a41b8fafd0 msgr2=0x55a41b9072b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:28.695 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.684+0000 7f6e2759e640 1 --2- 172.21.15.44:0/3742139449 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a41b8fafd0 0x55a41b9072b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:28.695 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.684+0000 7f6e2759e640 1 -- 172.21.15.44:0/3742139449 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a41b63e620 con 0x55a41b909da0 2024-08-19T00:21:28.695 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.684+0000 7f6e26d9d640 1 --2- 172.21.15.44:0/3742139449 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a41b8fa6b0 0x55a41b906d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:21:28.695 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.684+0000 7f6e2659c640 1 --2- 172.21.15.44:0/3742139449 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a41b8fafd0 0x55a41b9072b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:21:28.695 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.684+0000 7f6e2759e640 1 --2- 172.21.15.44:0/3742139449 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a41b909da0 0x55a41b9077f0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f6e200045c0 tx=0x7f6e20004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da46e9c262218a1c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:21:28.695 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.684+0000 7f6e0aff5640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:21:28.695 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.684+0000 7f6e0aff5640 1 -- 172.21.15.44:0/3742139449 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e2001a070 con 0x55a41b909da0 2024-08-19T00:21:28.695 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.684+0000 7f6e0aff5640 1 -- 172.21.15.44:0/3742139449 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9533+0+0 (secure 0 0 0) 0x7f6e20011d30 con 0x55a41b909da0 2024-08-19T00:21:28.695 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.684+0000 7f6e3007d740 1 -- 172.21.15.44:0/3742139449 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e1c0035f0 con 0x55a41b909da0 2024-08-19T00:21:28.695 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.685+0000 7f6e0aff5640 1 -- 172.21.15.44:0/3742139449 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f6e2002e050 con 0x55a41b909da0 2024-08-19T00:21:28.696 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.685+0000 7f6e3007d740 10 client.16515 fetch_fsmap learned FSMap version 33 2024-08-19T00:21:28.696 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.685+0000 7f6e3007d740 1 -- 172.21.15.44:0/3742139449 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55a41b918740 con 0x55a41b909da0 2024-08-19T00:21:28.696 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.685+0000 7f6e0aff5640 1 -- 172.21.15.44:0/3742139449 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e1c0035f0 con 0x55a41b909da0 2024-08-19T00:21:28.696 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.685+0000 7f6e0aff5640 1 -- 172.21.15.44:0/3742139449 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f6e20021470 con 0x55a41b909da0 2024-08-19T00:21:28.696 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.685+0000 7f6e3007d740 10 client.16515 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:21:28.696 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.685+0000 7f6e3007d740 10 client.16515 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:21:28.696 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.685+0000 7f6e3007d740 20 client.16515 populate_metadata read hostname 'smithi044' 2024-08-19T00:21:28.696 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.685+0000 7f6e3007d740 1 --2- 172.21.15.44:0/3742139449 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55a41b919c50 0x55a41b91c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:28.696 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.685+0000 7f6e3007d740 4 client.16515 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:21:28.696 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.685+0000 7f6e3007d740 1 -- 172.21.15.44:0/3742139449 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a41b86c100 con 0x55a41b919c50 2024-08-19T00:21:28.696 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.685+0000 7f6e26d9d640 1 --2- 172.21.15.44:0/3742139449 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55a41b919c50 0x55a41b91c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:28.696 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.686+0000 7f6e0aff5640 10 client.16515 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:21:28.696 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.686+0000 7f6e26d9d640 1 --2- 172.21.15.44:0/3742139449 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55a41b919c50 0x55a41b91c060 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0dff9f35da8ef92 server_cookie=c21c4920159bdad9 in_seq=0 out_seq=0 2024-08-19T00:21:28.697 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.686+0000 7f6e0aff5640 1 -- 172.21.15.44:0/3742139449 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a41b86c100 con 0x55a41b919c50 2024-08-19T00:21:28.697 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.686+0000 7f6e0aff5640 10 client.16515 handle_command_reply: tid=0 2024-08-19T00:21:28.697 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.687+0000 7f6e3007d740 1 client.16515 shutdown 2024-08-19T00:21:28.697 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.687+0000 7f6e3007d740 1 -- 172.21.15.44:0/3742139449 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a41b909da0 msgr2=0x55a41b9077f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:28.697 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.687+0000 7f6e3007d740 1 --2- 172.21.15.44:0/3742139449 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a41b909da0 0x55a41b9077f0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f6e200045c0 tx=0x7f6e20004a40 comp rx=0 tx=0).stop 2024-08-19T00:21:28.697 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.687+0000 7f6e3007d740 1 -- 172.21.15.44:0/3742139449 shutdown_connections 2024-08-19T00:21:28.697 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.687+0000 7f6e3007d740 1 --2- 172.21.15.44:0/3742139449 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55a41b919c50 0x55a41b91c060 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:28.697 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.687+0000 7f6e3007d740 1 --2- 172.21.15.44:0/3742139449 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a41b909da0 0x55a41b9077f0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:28.697 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.687+0000 7f6e3007d740 1 --2- 172.21.15.44:0/3742139449 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a41b8fafd0 0x55a41b9072b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:28.697 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.687+0000 7f6e0aff5640 0 client.16515 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:21:28.697 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.687+0000 7f6e3007d740 1 --2- 172.21.15.44:0/3742139449 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a41b8fa6b0 0x55a41b906d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:28.697 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.687+0000 7f6e3007d740 1 -- 172.21.15.44:0/3742139449 >> 172.21.15.44:0/3742139449 conn(0x55a41b8f6d40 msgr2=0x55a41b8f5ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:21:28.697 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.687+0000 7f6e3007d740 1 -- 172.21.15.44:0/3742139449 shutdown_connections 2024-08-19T00:21:28.698 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.687+0000 7f6e3007d740 1 -- 172.21.15.44:0/3742139449 wait complete. 2024-08-19T00:21:28.698 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.687+0000 7f6e3007d740 20 client.16515 trim_cache size 0 max 16384 2024-08-19T00:21:28.710 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.701+0000 7f6e3007d740 1 Processor -- start 2024-08-19T00:21:28.711 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.701+0000 7f6e3007d740 1 -- start start 2024-08-19T00:21:28.711 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.702+0000 7f6e3007d740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a41b8fa6b0 0x55a41b91c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:28.711 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.702+0000 7f6e3007d740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a41b8fafd0 0x55a41b921970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:28.711 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.702+0000 7f6e3007d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a41b909da0 0x55a41b921eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:28.711 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.702+0000 7f6e3007d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6e281acb00 con 0x55a41b909da0 2024-08-19T00:21:28.711 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.702+0000 7f6e3007d740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f6e281ae640 con 0x55a41b8fafd0 2024-08-19T00:21:28.711 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.702+0000 7f6e3007d740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6e281ad1d0 con 0x55a41b8fa6b0 2024-08-19T00:21:28.711 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.702+0000 7f6e2759e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a41b909da0 0x55a41b921eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:28.711 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.702+0000 7f6e2759e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a41b909da0 0x55a41b921eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59096/0 (socket says 172.21.15.44:59096) 2024-08-19T00:21:28.711 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.702+0000 7f6e2759e640 1 -- 172.21.15.44:0/1128409141 learned_addr learned my addr 172.21.15.44:0/1128409141 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:21:28.711 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.702+0000 7f6e2759e640 1 -- 172.21.15.44:0/1128409141 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a41b8fa6b0 msgr2=0x55a41b91c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:28.712 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.702+0000 7f6e26d9d640 1 --2- 172.21.15.44:0/1128409141 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a41b8fa6b0 0x55a41b91c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:28.712 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.702+0000 7f6e2759e640 1 --2- 172.21.15.44:0/1128409141 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a41b8fa6b0 0x55a41b91c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:28.712 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.702+0000 7f6e2759e640 1 -- 172.21.15.44:0/1128409141 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a41b8fafd0 msgr2=0x55a41b921970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:28.712 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.702+0000 7f6e2759e640 1 --2- 172.21.15.44:0/1128409141 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a41b8fafd0 0x55a41b921970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:28.712 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.702+0000 7f6e2759e640 1 -- 172.21.15.44:0/1128409141 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a41b905d00 con 0x55a41b909da0 2024-08-19T00:21:28.713 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.702+0000 7f6e26d9d640 1 --2- 172.21.15.44:0/1128409141 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a41b8fa6b0 0x55a41b91c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:21:28.713 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.702+0000 7f6e2759e640 1 --2- 172.21.15.44:0/1128409141 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a41b909da0 0x55a41b921eb0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f6e20021890 tx=0x7f6e20014470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=937b06c29608e53 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:21:28.713 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.702+0000 7f6e0cff9640 1 -- 172.21.15.44:0/1128409141 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e2001a070 con 0x55a41b909da0 2024-08-19T00:21:28.713 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.702+0000 7f6e0cff9640 1 -- 172.21.15.44:0/1128409141 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e20037070 con 0x55a41b909da0 2024-08-19T00:21:28.713 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.702+0000 7f6e0cff9640 1 -- 172.21.15.44:0/1128409141 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e20005070 con 0x55a41b909da0 2024-08-19T00:21:28.713 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.703+0000 7f6e3007d740 1 -- 172.21.15.44:0/1128409141 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a41b909da0 msgr2=0x55a41b921eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:28.713 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.703+0000 7f6e3007d740 1 --2- 172.21.15.44:0/1128409141 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a41b909da0 0x55a41b921eb0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f6e20021890 tx=0x7f6e20014470 comp rx=0 tx=0).stop 2024-08-19T00:21:28.713 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.703+0000 7f6e3007d740 1 -- 172.21.15.44:0/1128409141 shutdown_connections 2024-08-19T00:21:28.713 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.703+0000 7f6e3007d740 1 --2- 172.21.15.44:0/1128409141 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a41b909da0 0x55a41b921eb0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:28.713 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.703+0000 7f6e3007d740 1 --2- 172.21.15.44:0/1128409141 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a41b8fafd0 0x55a41b921970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:28.713 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.703+0000 7f6e3007d740 1 --2- 172.21.15.44:0/1128409141 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a41b8fa6b0 0x55a41b91c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:28.713 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.703+0000 7f6e3007d740 1 -- 172.21.15.44:0/1128409141 >> 172.21.15.44:0/1128409141 conn(0x55a41b8f6d40 msgr2=0x55a41b908ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:21:28.713 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.703+0000 7f6e3007d740 1 -- 172.21.15.44:0/1128409141 shutdown_connections 2024-08-19T00:21:28.714 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.703+0000 7f6e3007d740 1 -- 172.21.15.44:0/1128409141 wait complete. 2024-08-19T00:21:28.714 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.703+0000 7f6e3007d740 1 -- start start 2024-08-19T00:21:28.714 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.703+0000 7f6e3007d740 1 Processor -- start 2024-08-19T00:21:28.714 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.704+0000 7f6e3007d740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a41b8fa6b0 0x55a41b903ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:28.714 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.704+0000 7f6e3007d740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a41b8fafd0 0x55a41b904410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:28.714 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.704+0000 7f6e3007d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a41b909da0 0x55a41b904950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:28.714 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.704+0000 7f6e3007d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6e281adf70 con 0x55a41b909da0 2024-08-19T00:21:28.714 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.704+0000 7f6e3007d740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f6e281ad8a0 con 0x55a41b8fafd0 2024-08-19T00:21:28.714 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.704+0000 7f6e3007d740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6e281aab00 con 0x55a41b8fa6b0 2024-08-19T00:21:28.714 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.704+0000 7f6e3007d740 10 client.0 _ll_register_callbacks cb 0x7f6e20007c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:21:28.714 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.704+0000 7f6e2759e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a41b909da0 0x55a41b904950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:28.714 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.704+0000 7f6e2759e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a41b909da0 0x55a41b904950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59098/0 (socket says 172.21.15.44:59098) 2024-08-19T00:21:28.715 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.704+0000 7f6e2759e640 1 -- 172.21.15.44:0/1664512578 learned_addr learned my addr 172.21.15.44:0/1664512578 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:21:28.715 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.704+0000 7f6e2659c640 1 --2- 172.21.15.44:0/1664512578 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a41b8fafd0 0x55a41b904410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:28.715 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.704+0000 7f6e26d9d640 1 --2- 172.21.15.44:0/1664512578 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a41b8fa6b0 0x55a41b903ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:28.715 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.704+0000 7f6e2759e640 1 -- 172.21.15.44:0/1664512578 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a41b8fa6b0 msgr2=0x55a41b903ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:28.715 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.704+0000 7f6e2759e640 1 --2- 172.21.15.44:0/1664512578 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a41b8fa6b0 0x55a41b903ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:28.715 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.704+0000 7f6e2759e640 1 -- 172.21.15.44:0/1664512578 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a41b8fafd0 msgr2=0x55a41b904410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:28.715 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.704+0000 7f6e2759e640 1 --2- 172.21.15.44:0/1664512578 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a41b8fafd0 0x55a41b904410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:28.715 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.704+0000 7f6e2759e640 1 -- 172.21.15.44:0/1664512578 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a41b983ae0 con 0x55a41b909da0 2024-08-19T00:21:28.715 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.704+0000 7f6e2759e640 1 --2- 172.21.15.44:0/1664512578 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a41b909da0 0x55a41b904950 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f6e20004310 tx=0x7f6e20011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=624de6b647957fb0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:21:28.715 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.704+0000 7f6e0aff5640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:21:28.715 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.704+0000 7f6e0aff5640 1 -- 172.21.15.44:0/1664512578 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e2001a040 con 0x55a41b909da0 2024-08-19T00:21:28.715 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.704+0000 7f6e3007d740 1 -- 172.21.15.44:0/1664512578 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e20037070 con 0x55a41b909da0 2024-08-19T00:21:28.716 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.704+0000 7f6e0aff5640 1 -- 172.21.15.44:0/1664512578 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9533+0+0 (secure 0 0 0) 0x7f6e20021c90 con 0x55a41b909da0 2024-08-19T00:21:28.716 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.705+0000 7f6e0aff5640 1 -- 172.21.15.44:0/1664512578 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f6e2004c050 con 0x55a41b909da0 2024-08-19T00:21:28.716 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.705+0000 7f6e3007d740 10 client.16521 fetch_fsmap learned FSMap version 33 2024-08-19T00:21:28.716 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.705+0000 7f6e3007d740 1 -- 172.21.15.44:0/1664512578 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55a41b984d40 con 0x55a41b909da0 2024-08-19T00:21:28.716 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.705+0000 7f6e0aff5640 1 -- 172.21.15.44:0/1664512578 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e20037070 con 0x55a41b909da0 2024-08-19T00:21:28.716 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.705+0000 7f6e0aff5640 1 -- 172.21.15.44:0/1664512578 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f6e200464f0 con 0x55a41b909da0 2024-08-19T00:21:28.716 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.705+0000 7f6e3007d740 10 client.16521 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:21:28.716 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.705+0000 7f6e3007d740 10 client.16521 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:21:28.716 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.705+0000 7f6e3007d740 20 client.16521 populate_metadata read hostname 'smithi044' 2024-08-19T00:21:28.716 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.705+0000 7f6e3007d740 1 --2- 172.21.15.44:0/1664512578 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55a41b985350 0x55a41b987740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:28.716 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.705+0000 7f6e3007d740 4 client.16521 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-19T00:21:28.716 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.705+0000 7f6e3007d740 1 -- 172.21.15.44:0/1664512578 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a41b866450 con 0x55a41b985350 2024-08-19T00:21:28.716 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.705+0000 7f6e26d9d640 1 --2- 172.21.15.44:0/1664512578 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55a41b985350 0x55a41b987740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:28.716 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.706+0000 7f6e26d9d640 1 --2- 172.21.15.44:0/1664512578 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55a41b985350 0x55a41b987740 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cfe3cc92a98b7f94 server_cookie=862603bfbaea6900 in_seq=0 out_seq=0 2024-08-19T00:21:28.717 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.706+0000 7f6e0aff5640 10 client.16521 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:21:28.719 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.715+0000 7f6e0aff5640 1 -- 172.21.15.44:0/1664512578 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a41b866450 con 0x55a41b985350 2024-08-19T00:21:28.719 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.715+0000 7f6e0aff5640 10 client.16521 handle_command_reply: tid=0 2024-08-19T00:21:28.719 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.715+0000 7f6e3007d740 1 client.16521 shutdown 2024-08-19T00:21:28.719 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.716+0000 7f6e3007d740 1 -- 172.21.15.44:0/1664512578 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a41b909da0 msgr2=0x55a41b904950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:28.719 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.716+0000 7f6e3007d740 1 --2- 172.21.15.44:0/1664512578 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a41b909da0 0x55a41b904950 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f6e20004310 tx=0x7f6e20011f60 comp rx=0 tx=0).stop 2024-08-19T00:21:28.719 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.716+0000 7f6e3007d740 1 -- 172.21.15.44:0/1664512578 shutdown_connections 2024-08-19T00:21:28.719 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.716+0000 7f6e3007d740 1 --2- 172.21.15.44:0/1664512578 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55a41b985350 0x55a41b987740 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:28.719 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.716+0000 7f6e3007d740 1 --2- 172.21.15.44:0/1664512578 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a41b909da0 0x55a41b904950 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:28.719 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.716+0000 7f6e3007d740 1 --2- 172.21.15.44:0/1664512578 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a41b8fafd0 0x55a41b904410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:28.719 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.716+0000 7f6e0aff5640 0 client.16521 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:21:28.719 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.716+0000 7f6e3007d740 1 --2- 172.21.15.44:0/1664512578 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a41b8fa6b0 0x55a41b903ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:28.719 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.716+0000 7f6e3007d740 1 -- 172.21.15.44:0/1664512578 >> 172.21.15.44:0/1664512578 conn(0x55a41b8f6d40 msgr2=0x55a41b8f5680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:21:28.720 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.716+0000 7f6e3007d740 1 -- 172.21.15.44:0/1664512578 shutdown_connections 2024-08-19T00:21:28.720 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.716+0000 7f6e3007d740 1 -- 172.21.15.44:0/1664512578 wait complete. 2024-08-19T00:21:28.720 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.716+0000 7f6e3007d740 20 client.16521 trim_cache size 0 max 16384 2024-08-19T00:21:28.720 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:{ 2024-08-19T00:21:28.720 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "message": "", 2024-08-19T00:21:28.720 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "return_code": 0 2024-08-19T00:21:28.720 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:} 2024-08-19T00:21:28.721 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.716+0000 7f6e2d1df640 1 -- 172.21.15.44:0/3802245174 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f6e100a2da0 msgr2=0x7f6e100a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:28.721 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.716+0000 7f6e2d1df640 1 --2- 172.21.15.44:0/3802245174 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f6e100a2da0 0x7f6e100a5260 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6e200077f0 tx=0x7f6e20007520 comp rx=0 tx=0).stop 2024-08-19T00:21:28.721 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.716+0000 7f6e2d1df640 1 -- 172.21.15.44:0/3802245174 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6e28100710 msgr2=0x7f6e28198ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:28.721 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.716+0000 7f6e2d1df640 1 --2- 172.21.15.44:0/3802245174 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6e28100710 0x7f6e28198ef0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f6e18009230 tx=0x7f6e18004270 comp rx=0 tx=0).stop 2024-08-19T00:21:28.721 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.716+0000 7f6e2d1df640 1 -- 172.21.15.44:0/3802245174 shutdown_connections 2024-08-19T00:21:28.721 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.716+0000 7f6e2d1df640 1 --2- 172.21.15.44:0/3802245174 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f6e100a2da0 0x7f6e100a5260 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:28.722 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.717+0000 7f6e2d1df640 1 --2- 172.21.15.44:0/3802245174 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6e28106720 0x7f6e281a3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:28.722 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.717+0000 7f6e2d1df640 1 --2- 172.21.15.44:0/3802245174 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6e281010b0 0x7f6e28199430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:28.722 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.717+0000 7f6e2d1df640 1 --2- 172.21.15.44:0/3802245174 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6e28100710 0x7f6e28198ef0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:28.722 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.717+0000 7f6e2d1df640 1 -- 172.21.15.44:0/3802245174 >> 172.21.15.44:0/3802245174 conn(0x7f6e280fc3f0 msgr2=0x7f6e280fda60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:21:28.722 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.717+0000 7f6e2d1df640 1 -- 172.21.15.44:0/3802245174 shutdown_connections 2024-08-19T00:21:28.722 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:28.717+0000 7f6e2d1df640 1 -- 172.21.15.44:0/3802245174 wait complete. 2024-08-19T00:21:29.686 INFO:tasks.workunit.client.0.smithi044.stdout: 1 604558 8.10 MB/sec execute 294 sec latency 18251.932 ms 2024-08-19T00:21:30.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:21:30 smithi171 ceph-mon[21810]: pgmap v252: 129 pgs: 129 active+clean; 438 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 1.6 MiB/s wr, 70 op/s 2024-08-19T00:21:30.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:21:30 smithi116 ceph-mon[21873]: pgmap v252: 129 pgs: 129 active+clean; 438 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 1.6 MiB/s wr, 70 op/s 2024-08-19T00:21:30.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:21:30 smithi044 ceph-mon[18489]: pgmap v252: 129 pgs: 129 active+clean; 438 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 1.6 MiB/s wr, 70 op/s 2024-08-19T00:21:30.686 INFO:tasks.workunit.client.0.smithi044.stdout: 1 604558 8.07 MB/sec execute 295 sec latency 19252.033 ms 2024-08-19T00:21:31.597 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-19T00:21:31.686 INFO:tasks.workunit.client.0.smithi044.stdout: 1 604558 8.04 MB/sec execute 296 sec latency 20252.095 ms 2024-08-19T00:21:31.870 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:21:32.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:21:32 smithi044 ceph-mon[18489]: pgmap v253: 129 pgs: 129 active+clean; 437 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 2.4 MiB/s wr, 103 op/s 2024-08-19T00:21:32.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:32.330+0000 7fa3a84df640 1 -- 172.21.15.44:0/3494842798 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa3a010bea0 msgr2=0x7fa3a010e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:32.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:32.330+0000 7fa3a84df640 1 --2- 172.21.15.44:0/3494842798 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa3a010bea0 0x7fa3a010e340 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fa398009ca0 tx=0x7fa39802a950 comp rx=0 tx=0).stop 2024-08-19T00:21:32.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:32.330+0000 7fa3a84df640 1 -- 172.21.15.44:0/3494842798 shutdown_connections 2024-08-19T00:21:32.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:32.330+0000 7fa3a84df640 1 --2- 172.21.15.44:0/3494842798 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa3a010bea0 0x7fa3a010e340 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:32.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:32.330+0000 7fa3a84df640 1 --2- 172.21.15.44:0/3494842798 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa3a0103390 0x7fa3a010b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:32.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:32.330+0000 7fa3a84df640 1 --2- 172.21.15.44:0/3494842798 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3a0102a70 0x7fa3a0102e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:32.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:32.330+0000 7fa3a84df640 1 -- 172.21.15.44:0/3494842798 >> 172.21.15.44:0/3494842798 conn(0x7fa3a00fc4d0 msgr2=0x7fa3a00fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:21:32.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:32.331+0000 7fa3a84df640 1 -- 172.21.15.44:0/3494842798 shutdown_connections 2024-08-19T00:21:32.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:32.331+0000 7fa3a84df640 1 -- 172.21.15.44:0/3494842798 wait complete. 2024-08-19T00:21:32.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:32.331+0000 7fa3a84df640 1 Processor -- start 2024-08-19T00:21:32.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:32.331+0000 7fa3a84df640 1 -- start start 2024-08-19T00:21:32.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:32.331+0000 7fa3a84df640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa3a0102a70 0x7fa3a01980e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:32.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:32.331+0000 7fa3a84df640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa3a0103390 0x7fa3a0198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:32.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:32.331+0000 7fa3a84df640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3a010bea0 0x7fa3a019c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:32.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:32.331+0000 7fa3a84df640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a0111c60 con 0x7fa3a0102a70 2024-08-19T00:21:32.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:32.331+0000 7fa3a84df640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a0111ae0 con 0x7fa3a0103390 2024-08-19T00:21:32.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:32.331+0000 7fa3a84df640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a0111de0 con 0x7fa3a010bea0 2024-08-19T00:21:32.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:32.331+0000 7fa3a627b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa3a0102a70 0x7fa3a01980e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:32.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:32.331+0000 7fa3a627b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa3a0102a70 0x7fa3a01980e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59126/0 (socket says 172.21.15.44:59126) 2024-08-19T00:21:32.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:32.331+0000 7fa3a627b640 1 -- 172.21.15.44:0/3045427865 learned_addr learned my addr 172.21.15.44:0/3045427865 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:21:32.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:32.332+0000 7fa3a5a7a640 1 --2- 172.21.15.44:0/3045427865 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa3a0103390 0x7fa3a0198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:32.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:32.332+0000 7fa3a6a7c640 1 --2- 172.21.15.44:0/3045427865 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3a010bea0 0x7fa3a019c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:32.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:32.332+0000 7fa3a627b640 1 -- 172.21.15.44:0/3045427865 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3a010bea0 msgr2=0x7fa3a019c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:32.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:32.332+0000 7fa3a627b640 1 --2- 172.21.15.44:0/3045427865 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3a010bea0 0x7fa3a019c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:32.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:32.332+0000 7fa3a627b640 1 -- 172.21.15.44:0/3045427865 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa3a0103390 msgr2=0x7fa3a0198620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:32.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:32.332+0000 7fa3a627b640 1 --2- 172.21.15.44:0/3045427865 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa3a0103390 0x7fa3a0198620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:32.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:32.332+0000 7fa3a627b640 1 -- 172.21.15.44:0/3045427865 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3a019d090 con 0x7fa3a0102a70 2024-08-19T00:21:32.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:32.332+0000 7fa3a627b640 1 --2- 172.21.15.44:0/3045427865 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa3a0102a70 0x7fa3a01980e0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fa39c00d950 tx=0x7fa39c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:21:32.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:32.332+0000 7fa3977fe640 1 -- 172.21.15.44:0/3045427865 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa39c017030 con 0x7fa3a0102a70 2024-08-19T00:21:32.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:32.332+0000 7fa3a84df640 1 -- 172.21.15.44:0/3045427865 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3a019d380 con 0x7fa3a0102a70 2024-08-19T00:21:32.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:32.332+0000 7fa3977fe640 1 -- 172.21.15.44:0/3045427865 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa39c004020 con 0x7fa3a0102a70 2024-08-19T00:21:32.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:32.332+0000 7fa3977fe640 1 -- 172.21.15.44:0/3045427865 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa39c0047a0 con 0x7fa3a0102a70 2024-08-19T00:21:32.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:32.332+0000 7fa3a84df640 1 -- 172.21.15.44:0/3045427865 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3a01a4c60 con 0x7fa3a0102a70 2024-08-19T00:21:32.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:32.333+0000 7fa3a84df640 1 -- 172.21.15.44:0/3045427865 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3a0102e50 con 0x7fa3a0102a70 2024-08-19T00:21:32.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:32.334+0000 7fa3977fe640 1 -- 172.21.15.44:0/3045427865 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fa39c0041d0 con 0x7fa3a0102a70 2024-08-19T00:21:32.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:32.335+0000 7fa3977fe640 1 --2- 172.21.15.44:0/3045427865 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fa38c0a2cf0 0x7fa38c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:32.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:32.335+0000 7fa3977fe640 1 -- 172.21.15.44:0/3045427865 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9533+0+0 (secure 0 0 0) 0x7fa39c0cf870 con 0x7fa3a0102a70 2024-08-19T00:21:32.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:32.335+0000 7fa3a5a7a640 1 --2- 172.21.15.44:0/3045427865 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fa38c0a2cf0 0x7fa38c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:32.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:32.335+0000 7fa3a5a7a640 1 --2- 172.21.15.44:0/3045427865 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fa38c0a2cf0 0x7fa38c0a51b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa3a010d1c0 tx=0x7fa39000b2e0 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:21:32.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:32.338+0000 7fa3977fe640 1 -- 172.21.15.44:0/3045427865 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fa39c09c040 con 0x7fa3a0102a70 2024-08-19T00:21:32.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:32.550+0000 7fa3a84df640 1 -- 172.21.15.44:0/3045427865 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa3a0199440 con 0x7fa3a0102a70 2024-08-19T00:21:32.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:32.551+0000 7fa3977fe640 1 -- 172.21.15.44:0/3045427865 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11989 (secure 0 0 0) 0x7fa39c09b940 con 0x7fa3a0102a70 2024-08-19T00:21:32.552 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:21:32.553 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":33,"btime":"2024-08-19T00:17:11:640526+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14511,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1538841896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1538841896},{"type":"v1","addr":"172.21.15.116:6833","nonce":1538841896}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/4044471606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4044471606},{"type":"v1","addr":"172.21.15.44:6835","nonce":4044471606}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":33,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-19T00:10:53.196636+0000","modified":"2024-08-19T00:17:11.586031+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24473,"mds_1":24446,"mds_2":24439,"mds_3":24431,"mds_4":24418},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14529":{"gid":14529,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6837/1824829052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1824829052},{"type":"v1","addr":"172.21.15.44:6837","nonce":1824829052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14577":{"gid":14577,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6839/3591739042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":3591739042},{"type":"v1","addr":"172.21.15.44:6839","nonce":3591739042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14589":{"gid":14589,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6841/3667695717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6840","nonce":3667695717},{"type":"v1","addr":"172.21.15.44:6841","nonce":3667695717}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24388":{"gid":24388,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1183022838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1183022838},{"type":"v1","addr":"172.21.15.171:6833","nonce":1183022838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6835/2190623851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":2190623851},{"type":"v1","addr":"172.21.15.171:6835","nonce":2190623851}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.171:6837/316231795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":316231795},{"type":"v1","addr":"172.21.15.171:6837","nonce":316231795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":20,"addr":"172.21.15.116:6835/3507399322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3507399322},{"type":"v1","addr":"172.21.15.116:6835","nonce":3507399322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.171:6839/1466585795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":1466585795},{"type":"v1","addr":"172.21.15.171:6839","nonce":1466585795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":17,"addr":"172.21.15.116:6837/2764513846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":2764513846},{"type":"v1","addr":"172.21.15.116:6837","nonce":2764513846}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.116:6839/1032741033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":1032741033},{"type":"v1","addr":"172.21.15.116:6839","nonce":1032741033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24446,24439,24431,24418]},"id":1}]} 2024-08-19T00:21:32.553 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 33 2024-08-19T00:21:32.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:32.553+0000 7fa3a84df640 1 -- 172.21.15.44:0/3045427865 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fa38c0a2cf0 msgr2=0x7fa38c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:32.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:32.553+0000 7fa3a84df640 1 --2- 172.21.15.44:0/3045427865 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fa38c0a2cf0 0x7fa38c0a51b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa3a010d1c0 tx=0x7fa39000b2e0 comp rx=0 tx=0).stop 2024-08-19T00:21:32.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:32.553+0000 7fa3a84df640 1 -- 172.21.15.44:0/3045427865 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa3a0102a70 msgr2=0x7fa3a01980e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:32.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:32.553+0000 7fa3a84df640 1 --2- 172.21.15.44:0/3045427865 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa3a0102a70 0x7fa3a01980e0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fa39c00d950 tx=0x7fa39c00de10 comp rx=0 tx=0).stop 2024-08-19T00:21:32.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:32.553+0000 7fa3a84df640 1 -- 172.21.15.44:0/3045427865 shutdown_connections 2024-08-19T00:21:32.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:32.553+0000 7fa3a84df640 1 --2- 172.21.15.44:0/3045427865 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fa38c0a2cf0 0x7fa38c0a51b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:32.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:32.553+0000 7fa3a84df640 1 --2- 172.21.15.44:0/3045427865 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3a010bea0 0x7fa3a019c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:32.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:32.553+0000 7fa3a84df640 1 --2- 172.21.15.44:0/3045427865 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa3a0103390 0x7fa3a0198620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:32.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:32.553+0000 7fa3a84df640 1 --2- 172.21.15.44:0/3045427865 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa3a0102a70 0x7fa3a01980e0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:32.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:32.553+0000 7fa3a84df640 1 -- 172.21.15.44:0/3045427865 >> 172.21.15.44:0/3045427865 conn(0x7fa3a00fc4d0 msgr2=0x7fa3a00fd130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:21:32.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:32.553+0000 7fa3a84df640 1 -- 172.21.15.44:0/3045427865 shutdown_connections 2024-08-19T00:21:32.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:32.553+0000 7fa3a84df640 1 -- 172.21.15.44:0/3045427865 wait complete. 2024-08-19T00:21:32.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:21:32 smithi171 ceph-mon[21810]: pgmap v253: 129 pgs: 129 active+clean; 437 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 2.4 MiB/s wr, 103 op/s 2024-08-19T00:21:32.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:21:32 smithi116 ceph-mon[21873]: pgmap v253: 129 pgs: 129 active+clean; 437 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 2.4 MiB/s wr, 103 op/s 2024-08-19T00:21:32.686 INFO:tasks.workunit.client.0.smithi044.stdout: 1 604558 8.01 MB/sec execute 297 sec latency 21252.171 ms 2024-08-19T00:21:33.337 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:21:33 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/3045427865' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:21:33.366 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24473 quiesce db --set-id 9b539fbd --release --await' 2024-08-19T00:21:33.367 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24473 quiesce db --set-id 9b539fbd --release --await 2024-08-19T00:21:33.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:21:33 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/3045427865' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:21:33.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:21:33 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/3045427865' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:21:33.624 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:21:33.687 INFO:tasks.workunit.client.0.smithi044.stdout: 1 604558 7.99 MB/sec execute 298 sec latency 22252.261 ms 2024-08-19T00:21:34.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.226+0000 7f82c2d95640 1 -- 172.21.15.44:0/1150611400 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82bc102250 msgr2=0x7f82bc10e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:34.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.226+0000 7f82c2d95640 1 --2- 172.21.15.44:0/1150611400 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82bc102250 0x7f82bc10e780 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f82b4009cd0 tx=0x7f82b402a8e0 comp rx=0 tx=0).stop 2024-08-19T00:21:34.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.226+0000 7f82c2d95640 1 -- 172.21.15.44:0/1150611400 shutdown_connections 2024-08-19T00:21:34.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.226+0000 7f82c2d95640 1 --2- 172.21.15.44:0/1150611400 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82bc102250 0x7f82bc10e780 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:34.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.226+0000 7f82c2d95640 1 --2- 172.21.15.44:0/1150611400 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f82bc1018b0 0x7f82bc101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:34.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.226+0000 7f82c2d95640 1 --2- 172.21.15.44:0/1150611400 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f82bc1078b0 0x7f82bc107c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:34.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.226+0000 7f82c2d95640 1 -- 172.21.15.44:0/1150611400 >> 172.21.15.44:0/1150611400 conn(0x7f82bc0fd5f0 msgr2=0x7f82bc0ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:21:34.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.226+0000 7f82c2d95640 1 -- 172.21.15.44:0/1150611400 shutdown_connections 2024-08-19T00:21:34.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.226+0000 7f82c2d95640 1 -- 172.21.15.44:0/1150611400 wait complete. 2024-08-19T00:21:34.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.227+0000 7f82c2d95640 1 Processor -- start 2024-08-19T00:21:34.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.227+0000 7f82c2d95640 1 -- start start 2024-08-19T00:21:34.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.227+0000 7f82c2d95640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f82bc1018b0 0x7f82bc19a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:34.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.227+0000 7f82c2d95640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82bc102250 0x7f82bc19a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:34.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.227+0000 7f82c2d95640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f82bc1078b0 0x7f82bc19ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:34.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.227+0000 7f82c2d95640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f82bc111cb0 con 0x7f82bc102250 2024-08-19T00:21:34.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.227+0000 7f82c2d95640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f82bc111b30 con 0x7f82bc1078b0 2024-08-19T00:21:34.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.227+0000 7f82c2d95640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f82bc111e30 con 0x7f82bc1018b0 2024-08-19T00:21:34.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.227+0000 7f82bbfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82bc102250 0x7f82bc19a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:34.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.227+0000 7f82bbfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82bc102250 0x7f82bc19a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59134/0 (socket says 172.21.15.44:59134) 2024-08-19T00:21:34.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.227+0000 7f82bbfff640 1 -- 172.21.15.44:0/181776604 learned_addr learned my addr 172.21.15.44:0/181776604 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:21:34.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.227+0000 7f82c1332640 1 --2- 172.21.15.44:0/181776604 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f82bc1078b0 0x7f82bc19ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:34.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.227+0000 7f82c0b31640 1 --2- 172.21.15.44:0/181776604 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f82bc1018b0 0x7f82bc19a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:34.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.228+0000 7f82bbfff640 1 -- 172.21.15.44:0/181776604 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f82bc1018b0 msgr2=0x7f82bc19a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:34.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.228+0000 7f82bbfff640 1 --2- 172.21.15.44:0/181776604 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f82bc1018b0 0x7f82bc19a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:34.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.228+0000 7f82bbfff640 1 -- 172.21.15.44:0/181776604 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f82bc1078b0 msgr2=0x7f82bc19ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:34.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.228+0000 7f82bbfff640 1 --2- 172.21.15.44:0/181776604 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f82bc1078b0 0x7f82bc19ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:34.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.228+0000 7f82bbfff640 1 -- 172.21.15.44:0/181776604 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82bc19f320 con 0x7f82bc102250 2024-08-19T00:21:34.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.228+0000 7f82bbfff640 1 --2- 172.21.15.44:0/181776604 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82bc102250 0x7f82bc19a8b0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f82a800d950 tx=0x7f82a800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:21:34.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.228+0000 7f82b9ffb640 1 -- 172.21.15.44:0/181776604 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82a8017030 con 0x7f82bc102250 2024-08-19T00:21:34.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.228+0000 7f82b9ffb640 1 -- 172.21.15.44:0/181776604 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f82a8004020 con 0x7f82bc102250 2024-08-19T00:21:34.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.228+0000 7f82c2d95640 1 -- 172.21.15.44:0/181776604 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82bc19f610 con 0x7f82bc102250 2024-08-19T00:21:34.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.228+0000 7f82b9ffb640 1 -- 172.21.15.44:0/181776604 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82a80047a0 con 0x7f82bc102250 2024-08-19T00:21:34.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.228+0000 7f82c2d95640 1 -- 172.21.15.44:0/181776604 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82bc1a6ef0 con 0x7f82bc102250 2024-08-19T00:21:34.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.230+0000 7f82b9ffb640 1 -- 172.21.15.44:0/181776604 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f82a80041d0 con 0x7f82bc102250 2024-08-19T00:21:34.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.231+0000 7f82c5193740 1 Processor -- start 2024-08-19T00:21:34.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.231+0000 7f82c5193740 1 -- start start 2024-08-19T00:21:34.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.231+0000 7f82c5193740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55be13e5f990 0x55be13e5fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:34.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.231+0000 7f82c5193740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55be13e602b0 0x55be13e6a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:34.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.231+0000 7f82b9ffb640 1 --2- 172.21.15.44:0/181776604 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f82ac0a2cf0 0x7f82ac0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:34.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.231+0000 7f82c5193740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be13e6ab70 0x55be13e6cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:34.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.231+0000 7f82c5193740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55be13dc5c60 con 0x55be13e6ab70 2024-08-19T00:21:34.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.231+0000 7f82c5193740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55be13d5db90 con 0x55be13e5f990 2024-08-19T00:21:34.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.231+0000 7f82c5193740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55be13dc1c20 con 0x55be13e602b0 2024-08-19T00:21:34.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.231+0000 7f82c1332640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be13e6ab70 0x55be13e6cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:34.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.231+0000 7f82c0b31640 1 --2- 172.21.15.44:0/181776604 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f82ac0a2cf0 0x7f82ac0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:34.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.231+0000 7f82c1332640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be13e6ab70 0x55be13e6cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59138/0 (socket says 172.21.15.44:59138) 2024-08-19T00:21:34.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.231+0000 7f82b9ffb640 1 -- 172.21.15.44:0/181776604 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9533+0+0 (secure 0 0 0) 0x7f82a80cf2e0 con 0x7f82bc102250 2024-08-19T00:21:34.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.231+0000 7f82c1332640 1 -- 172.21.15.44:0/2088438824 learned_addr learned my addr 172.21.15.44:0/2088438824 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:21:34.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.231+0000 7f82bbfff640 1 --2- 172.21.15.44:0/2088438824 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55be13e602b0 0x55be13e6a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:34.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.231+0000 7f82c1332640 1 --2- 172.21.15.44:0/2088438824 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55be13e5f990 0x55be13e5fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:34.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.232+0000 7f82c1332640 1 -- 172.21.15.44:0/2088438824 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55be13e602b0 msgr2=0x55be13e6a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:34.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.232+0000 7f82c1332640 1 --2- 172.21.15.44:0/2088438824 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55be13e602b0 0x55be13e6a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:34.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.232+0000 7f82c1332640 1 -- 172.21.15.44:0/2088438824 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55be13e5f990 msgr2=0x55be13e5fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:34.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.232+0000 7f82c1332640 1 --2- 172.21.15.44:0/2088438824 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55be13e5f990 0x55be13e5fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:34.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.232+0000 7f82c1332640 1 -- 172.21.15.44:0/2088438824 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be13ad5580 con 0x55be13e6ab70 2024-08-19T00:21:34.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.232+0000 7f82c0b31640 1 --2- 172.21.15.44:0/181776604 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f82ac0a2cf0 0x7f82ac0a51b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f82b0005d70 tx=0x7f82b0005d00 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:21:34.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.232+0000 7f82c1332640 1 --2- 172.21.15.44:0/2088438824 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be13e6ab70 0x55be13e6cf60 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f82b4005fe0 tx=0x7f82b40093c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb405f41b15d6e68 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:21:34.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.232+0000 7f82a6ffd640 1 -- 172.21.15.44:0/2088438824 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b4031ac0 con 0x55be13e6ab70 2024-08-19T00:21:34.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.232+0000 7f82a6ffd640 1 -- 172.21.15.44:0/2088438824 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f82b4036040 con 0x55be13e6ab70 2024-08-19T00:21:34.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.232+0000 7f82a6ffd640 1 -- 172.21.15.44:0/2088438824 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b40046d0 con 0x55be13e6ab70 2024-08-19T00:21:34.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.233+0000 7f82c5193740 1 -- 172.21.15.44:0/2088438824 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be13e6ab70 msgr2=0x55be13e6cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:34.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.233+0000 7f82c5193740 1 --2- 172.21.15.44:0/2088438824 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be13e6ab70 0x55be13e6cf60 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f82b4005fe0 tx=0x7f82b40093c0 comp rx=0 tx=0).stop 2024-08-19T00:21:34.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.233+0000 7f82c5193740 1 -- 172.21.15.44:0/2088438824 shutdown_connections 2024-08-19T00:21:34.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.233+0000 7f82c5193740 1 --2- 172.21.15.44:0/2088438824 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55be13e602b0 0x55be13e6a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:34.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.233+0000 7f82c5193740 1 --2- 172.21.15.44:0/2088438824 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be13e6ab70 0x55be13e6cf60 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:34.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.233+0000 7f82c5193740 1 --2- 172.21.15.44:0/2088438824 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55be13e5f990 0x55be13e5fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:34.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.233+0000 7f82c5193740 1 -- 172.21.15.44:0/2088438824 >> 172.21.15.44:0/2088438824 conn(0x55be13e5bf20 msgr2=0x55be13e5c300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:21:34.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.233+0000 7f82c5193740 1 -- 172.21.15.44:0/2088438824 shutdown_connections 2024-08-19T00:21:34.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.233+0000 7f82c5193740 1 -- 172.21.15.44:0/2088438824 wait complete. 2024-08-19T00:21:34.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.233+0000 7f82c5193740 1 -- start start 2024-08-19T00:21:34.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.233+0000 7f82c5193740 1 Processor -- start 2024-08-19T00:21:34.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.233+0000 7f82c5193740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be13e5f990 0x55be13e67a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:34.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.233+0000 7f82c5193740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55be13e602b0 0x55be13e67f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:34.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.234+0000 7f82c5193740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55be13e6ab70 0x55be13e684b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:34.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.234+0000 7f82c5193740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55be13e6d740 con 0x55be13e5f990 2024-08-19T00:21:34.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.234+0000 7f82c5193740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55be13d637c0 con 0x55be13e602b0 2024-08-19T00:21:34.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.234+0000 7f82c5193740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55be13e6d8c0 con 0x55be13e6ab70 2024-08-19T00:21:34.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.234+0000 7f82c5193740 10 client.0 _ll_register_callbacks cb 0x55be13d6cf50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:21:34.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.234+0000 7f82c0b31640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be13e5f990 0x55be13e67a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:34.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.234+0000 7f82c0b31640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be13e5f990 0x55be13e67a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59154/0 (socket says 172.21.15.44:59154) 2024-08-19T00:21:34.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.234+0000 7f82c0b31640 1 -- 172.21.15.44:0/4159854223 learned_addr learned my addr 172.21.15.44:0/4159854223 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:21:34.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.234+0000 7f82c1332640 1 --2- 172.21.15.44:0/4159854223 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55be13e6ab70 0x55be13e684b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:34.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.234+0000 7f82bbfff640 1 --2- 172.21.15.44:0/4159854223 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55be13e602b0 0x55be13e67f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:34.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.234+0000 7f82c0b31640 1 -- 172.21.15.44:0/4159854223 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55be13e6ab70 msgr2=0x55be13e684b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:34.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.234+0000 7f82c0b31640 1 --2- 172.21.15.44:0/4159854223 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55be13e6ab70 0x55be13e684b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:34.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.234+0000 7f82c0b31640 1 -- 172.21.15.44:0/4159854223 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55be13e602b0 msgr2=0x55be13e67f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:34.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.234+0000 7f82c0b31640 1 --2- 172.21.15.44:0/4159854223 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55be13e602b0 0x55be13e67f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:34.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.234+0000 7f82c0b31640 1 -- 172.21.15.44:0/4159854223 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be13b9f960 con 0x55be13e5f990 2024-08-19T00:21:34.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.234+0000 7f82c1332640 1 --2- 172.21.15.44:0/4159854223 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55be13e6ab70 0x55be13e684b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:21:34.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.234+0000 7f82bbfff640 1 --2- 172.21.15.44:0/4159854223 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55be13e602b0 0x55be13e67f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:21:34.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.234+0000 7f82c0b31640 1 --2- 172.21.15.44:0/4159854223 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be13e5f990 0x55be13e67a30 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f82b00109e0 tx=0x7f82b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60bced02a3e675b2 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:21:34.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.234+0000 7f829bfff640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:21:34.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.234+0000 7f829bfff640 1 -- 172.21.15.44:0/4159854223 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b0021070 con 0x55be13e5f990 2024-08-19T00:21:34.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.234+0000 7f82c5193740 1 -- 172.21.15.44:0/4159854223 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82b4036040 con 0x55be13e5f990 2024-08-19T00:21:34.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.234+0000 7f829bfff640 1 -- 172.21.15.44:0/4159854223 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9533+0+0 (secure 0 0 0) 0x7f82b000fcd0 con 0x55be13e5f990 2024-08-19T00:21:34.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.235+0000 7f829bfff640 1 -- 172.21.15.44:0/4159854223 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f82b002d050 con 0x55be13e5f990 2024-08-19T00:21:34.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.235+0000 7f82c5193740 10 client.16539 fetch_fsmap learned FSMap version 33 2024-08-19T00:21:34.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.235+0000 7f82c5193740 1 -- 172.21.15.44:0/4159854223 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55be13e797b0 con 0x55be13e5f990 2024-08-19T00:21:34.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.235+0000 7f829bfff640 1 -- 172.21.15.44:0/4159854223 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f82b4036040 con 0x55be13e5f990 2024-08-19T00:21:34.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.235+0000 7f829bfff640 1 -- 172.21.15.44:0/4159854223 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f82b00253d0 con 0x55be13e5f990 2024-08-19T00:21:34.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.235+0000 7f82c5193740 10 client.16539 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:21:34.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.235+0000 7f82c5193740 10 client.16539 resolve_mds: validated gid 24473 aka daemon mds.b 2024-08-19T00:21:34.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.235+0000 7f82c5193740 20 client.16539 populate_metadata read hostname 'smithi044' 2024-08-19T00:21:34.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.235+0000 7f82c5193740 1 --2- 172.21.15.44:0/4159854223 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55be13e7ac10 0x55be13e7d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:34.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.235+0000 7f82c5193740 4 client.16539 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:21:34.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.235+0000 7f82c5193740 1 -- 172.21.15.44:0/4159854223 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55be13dd31d0 con 0x55be13e7ac10 2024-08-19T00:21:34.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.235+0000 7f82bbfff640 1 --2- 172.21.15.44:0/4159854223 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55be13e7ac10 0x55be13e7d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:34.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.236+0000 7f829bfff640 10 client.16539 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:21:34.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.236+0000 7f82bbfff640 1 --2- 172.21.15.44:0/4159854223 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55be13e7ac10 0x55be13e7d080 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ecae2ad28a45dd42 server_cookie=7682369a639699f7 in_seq=0 out_seq=0 2024-08-19T00:21:34.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.236+0000 7f829bfff640 1 -- 172.21.15.44:0/4159854223 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55be13dd31d0 con 0x55be13e7ac10 2024-08-19T00:21:34.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.236+0000 7f829bfff640 10 client.16539 handle_command_reply: tid=0 2024-08-19T00:21:34.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.236+0000 7f82c5193740 1 client.16539 shutdown 2024-08-19T00:21:34.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.237+0000 7f82c5193740 1 -- 172.21.15.44:0/4159854223 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be13e5f990 msgr2=0x55be13e67a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:34.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.237+0000 7f82c5193740 1 --2- 172.21.15.44:0/4159854223 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be13e5f990 0x55be13e67a30 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f82b00109e0 tx=0x7f82b00046c0 comp rx=0 tx=0).stop 2024-08-19T00:21:34.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.237+0000 7f82c5193740 1 -- 172.21.15.44:0/4159854223 shutdown_connections 2024-08-19T00:21:34.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.237+0000 7f82c5193740 1 --2- 172.21.15.44:0/4159854223 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55be13e7ac10 0x55be13e7d080 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:34.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.237+0000 7f82c5193740 1 --2- 172.21.15.44:0/4159854223 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55be13e6ab70 0x55be13e684b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:34.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.237+0000 7f82c5193740 1 --2- 172.21.15.44:0/4159854223 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55be13e602b0 0x55be13e67f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:34.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.237+0000 7f829bfff640 0 client.16539 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:21:34.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.237+0000 7f82c5193740 1 --2- 172.21.15.44:0/4159854223 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be13e5f990 0x55be13e67a30 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:34.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.237+0000 7f82c5193740 1 -- 172.21.15.44:0/4159854223 >> 172.21.15.44:0/4159854223 conn(0x55be13e5bf20 msgr2=0x55be13e61c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:21:34.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.237+0000 7f82c5193740 1 -- 172.21.15.44:0/4159854223 shutdown_connections 2024-08-19T00:21:34.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.237+0000 7f82c5193740 1 -- 172.21.15.44:0/4159854223 wait complete. 2024-08-19T00:21:34.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.237+0000 7f82c5193740 20 client.16539 trim_cache size 0 max 16384 2024-08-19T00:21:34.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.254+0000 7f82c5193740 1 Processor -- start 2024-08-19T00:21:34.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.254+0000 7f82c5193740 1 -- start start 2024-08-19T00:21:34.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.254+0000 7f82c5193740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be13e5f990 0x55be13e69900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:34.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.254+0000 7f82c5193740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55be13e602b0 0x55be13e671e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:34.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.254+0000 7f82c5193740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55be13e6ab70 0x55be13e82950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:34.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.254+0000 7f82c5193740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f82bc1b1090 con 0x55be13e5f990 2024-08-19T00:21:34.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.254+0000 7f82c5193740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f82bc1b2bd0 con 0x55be13e6ab70 2024-08-19T00:21:34.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.254+0000 7f82c5193740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f82bc1b1760 con 0x55be13e602b0 2024-08-19T00:21:34.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.254+0000 7f82c0b31640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be13e5f990 0x55be13e69900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:34.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.254+0000 7f82c0b31640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be13e5f990 0x55be13e69900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59164/0 (socket says 172.21.15.44:59164) 2024-08-19T00:21:34.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.254+0000 7f82c0b31640 1 -- 172.21.15.44:0/3026753697 learned_addr learned my addr 172.21.15.44:0/3026753697 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:21:34.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.254+0000 7f82c0b31640 1 -- 172.21.15.44:0/3026753697 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55be13e602b0 msgr2=0x55be13e671e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:34.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.254+0000 7f82bbfff640 1 --2- 172.21.15.44:0/3026753697 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55be13e602b0 0x55be13e671e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:34.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.254+0000 7f82c0b31640 1 --2- 172.21.15.44:0/3026753697 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55be13e602b0 0x55be13e671e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:34.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.254+0000 7f82c0b31640 1 -- 172.21.15.44:0/3026753697 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55be13e6ab70 msgr2=0x55be13e82950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:34.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.254+0000 7f82c0b31640 1 --2- 172.21.15.44:0/3026753697 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55be13e6ab70 0x55be13e82950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:34.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.254+0000 7f82c0b31640 1 -- 172.21.15.44:0/3026753697 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be13e5a470 con 0x55be13e5f990 2024-08-19T00:21:34.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.254+0000 7f82c0b31640 1 --2- 172.21.15.44:0/3026753697 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be13e5f990 0x55be13e69900 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f82b000c3c0 tx=0x7f82b000f830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64bbeff24a1de186 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:21:34.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.255+0000 7f82a67fc640 1 -- 172.21.15.44:0/3026753697 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b0035030 con 0x55be13e5f990 2024-08-19T00:21:34.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.255+0000 7f82a67fc640 1 -- 172.21.15.44:0/3026753697 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f82b0025ea0 con 0x55be13e5f990 2024-08-19T00:21:34.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.255+0000 7f82a67fc640 1 -- 172.21.15.44:0/3026753697 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b0021050 con 0x55be13e5f990 2024-08-19T00:21:34.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.255+0000 7f82c5193740 1 -- 172.21.15.44:0/3026753697 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be13e5f990 msgr2=0x55be13e69900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:34.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.255+0000 7f82c5193740 1 --2- 172.21.15.44:0/3026753697 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be13e5f990 0x55be13e69900 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f82b000c3c0 tx=0x7f82b000f830 comp rx=0 tx=0).stop 2024-08-19T00:21:34.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.255+0000 7f82c5193740 1 -- 172.21.15.44:0/3026753697 shutdown_connections 2024-08-19T00:21:34.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.255+0000 7f82c5193740 1 --2- 172.21.15.44:0/3026753697 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55be13e602b0 0x55be13e671e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:34.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.255+0000 7f82c5193740 1 --2- 172.21.15.44:0/3026753697 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55be13e6ab70 0x55be13e82950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:34.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.255+0000 7f82c5193740 1 --2- 172.21.15.44:0/3026753697 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be13e5f990 0x55be13e69900 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:34.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.255+0000 7f82c5193740 1 -- 172.21.15.44:0/3026753697 >> 172.21.15.44:0/3026753697 conn(0x55be13e5bf20 msgr2=0x55be13e61c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:21:34.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.255+0000 7f82c5193740 1 -- 172.21.15.44:0/3026753697 shutdown_connections 2024-08-19T00:21:34.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.255+0000 7f82c5193740 1 -- 172.21.15.44:0/3026753697 wait complete. 2024-08-19T00:21:34.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.256+0000 7f82c5193740 1 -- start start 2024-08-19T00:21:34.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.256+0000 7f82c5193740 1 Processor -- start 2024-08-19T00:21:34.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.256+0000 7f82c5193740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be13e5f990 0x55be13e6e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:34.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.256+0000 7f82c5193740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55be13e602b0 0x55be13e6ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:34.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.256+0000 7f82c5193740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55be13e6ab70 0x55be13e6f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:34.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.256+0000 7f82c5193740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f82bc1b2500 con 0x55be13e5f990 2024-08-19T00:21:34.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.256+0000 7f82c5193740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f82bc1b1e30 con 0x55be13e602b0 2024-08-19T00:21:34.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.256+0000 7f82c5193740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f82bc1af090 con 0x55be13e6ab70 2024-08-19T00:21:34.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.256+0000 7f82c5193740 10 client.0 _ll_register_callbacks cb 0x7f82b0010660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:21:34.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.257+0000 7f82c0b31640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be13e5f990 0x55be13e6e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:34.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.257+0000 7f82c0b31640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be13e5f990 0x55be13e6e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59180/0 (socket says 172.21.15.44:59180) 2024-08-19T00:21:34.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.257+0000 7f82c0b31640 1 -- 172.21.15.44:0/2490816924 learned_addr learned my addr 172.21.15.44:0/2490816924 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:21:34.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.257+0000 7f82bbfff640 1 --2- 172.21.15.44:0/2490816924 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55be13e602b0 0x55be13e6ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:34.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.257+0000 7f82c1332640 1 --2- 172.21.15.44:0/2490816924 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55be13e6ab70 0x55be13e6f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:34.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.257+0000 7f82c0b31640 1 -- 172.21.15.44:0/2490816924 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55be13e6ab70 msgr2=0x55be13e6f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:34.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.257+0000 7f82c0b31640 1 --2- 172.21.15.44:0/2490816924 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55be13e6ab70 0x55be13e6f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:34.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.257+0000 7f82c0b31640 1 -- 172.21.15.44:0/2490816924 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55be13e602b0 msgr2=0x55be13e6ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:34.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.257+0000 7f82c0b31640 1 --2- 172.21.15.44:0/2490816924 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55be13e602b0 0x55be13e6ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:34.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.257+0000 7f82c0b31640 1 -- 172.21.15.44:0/2490816924 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be13ee49a0 con 0x55be13e5f990 2024-08-19T00:21:34.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.257+0000 7f82c1332640 1 --2- 172.21.15.44:0/2490816924 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55be13e6ab70 0x55be13e6f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:21:34.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.257+0000 7f82c0b31640 1 --2- 172.21.15.44:0/2490816924 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be13e5f990 0x55be13e6e930 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f82b0005ab0 tx=0x7f82b000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70f32d7b1692d2a8 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:21:34.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.257+0000 7f829bfff640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:21:34.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.257+0000 7f829bfff640 1 -- 172.21.15.44:0/2490816924 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b003e070 con 0x55be13e5f990 2024-08-19T00:21:34.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.257+0000 7f82c5193740 1 -- 172.21.15.44:0/2490816924 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55be13dcd6e0 con 0x55be13e5f990 2024-08-19T00:21:34.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.257+0000 7f829bfff640 1 -- 172.21.15.44:0/2490816924 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9533+0+0 (secure 0 0 0) 0x7f82b000fad0 con 0x55be13e5f990 2024-08-19T00:21:34.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.257+0000 7f829bfff640 1 -- 172.21.15.44:0/2490816924 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f82b004a050 con 0x55be13e5f990 2024-08-19T00:21:34.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.257+0000 7f82c5193740 10 client.16545 fetch_fsmap learned FSMap version 33 2024-08-19T00:21:34.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.257+0000 7f82c5193740 1 -- 172.21.15.44:0/2490816924 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55be13ee5cc0 con 0x55be13e5f990 2024-08-19T00:21:34.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.258+0000 7f829bfff640 1 -- 172.21.15.44:0/2490816924 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55be13dcd6e0 con 0x55be13e5f990 2024-08-19T00:21:34.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.258+0000 7f829bfff640 1 -- 172.21.15.44:0/2490816924 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f82b00049d0 con 0x55be13e5f990 2024-08-19T00:21:34.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.258+0000 7f82c5193740 10 client.16545 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:21:34.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.258+0000 7f82c5193740 10 client.16545 resolve_mds: validated gid 24473 aka daemon mds.b 2024-08-19T00:21:34.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.258+0000 7f82c5193740 20 client.16545 populate_metadata read hostname 'smithi044' 2024-08-19T00:21:34.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.258+0000 7f82c5193740 1 --2- 172.21.15.44:0/2490816924 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55be13ee62d0 0x55be13ee86c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:34.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.258+0000 7f82c5193740 4 client.16545 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "9b539fbd", "release": true, "await": true}] 2024-08-19T00:21:34.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.258+0000 7f82c5193740 1 -- 172.21.15.44:0/2490816924 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "quiesce db", "set_id": "9b539fbd", "release": true, "await": true}) -- 0x55be13d4a5a0 con 0x55be13ee62d0 2024-08-19T00:21:34.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.258+0000 7f82bbfff640 1 --2- 172.21.15.44:0/2490816924 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55be13ee62d0 0x55be13ee86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:34.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.259+0000 7f82bbfff640 1 --2- 172.21.15.44:0/2490816924 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55be13ee62d0 0x55be13ee86c0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3834a12b2db09607 server_cookie=74d87e3a0f2deadd in_seq=0 out_seq=0 2024-08-19T00:21:34.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.259+0000 7f829bfff640 10 client.16545 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:21:34.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.269+0000 7f829bfff640 1 -- 172.21.15.44:0/2490816924 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55be13d4a5a0 con 0x55be13ee62d0 2024-08-19T00:21:34.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.269+0000 7f829bfff640 10 client.16545 handle_command_reply: tid=0 2024-08-19T00:21:34.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.269+0000 7f82c5193740 1 client.16545 shutdown 2024-08-19T00:21:34.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.269+0000 7f82c5193740 1 -- 172.21.15.44:0/2490816924 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be13e5f990 msgr2=0x55be13e6e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:34.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.269+0000 7f82c5193740 1 --2- 172.21.15.44:0/2490816924 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be13e5f990 0x55be13e6e930 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f82b0005ab0 tx=0x7f82b000ee70 comp rx=0 tx=0).stop 2024-08-19T00:21:34.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.269+0000 7f82c5193740 1 -- 172.21.15.44:0/2490816924 shutdown_connections 2024-08-19T00:21:34.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.269+0000 7f82c5193740 1 --2- 172.21.15.44:0/2490816924 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55be13ee62d0 0x55be13ee86c0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:34.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.269+0000 7f82c5193740 1 --2- 172.21.15.44:0/2490816924 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55be13e6ab70 0x55be13e6f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:34.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.269+0000 7f82c5193740 1 --2- 172.21.15.44:0/2490816924 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55be13e602b0 0x55be13e6ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:34.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.269+0000 7f82c5193740 1 --2- 172.21.15.44:0/2490816924 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be13e5f990 0x55be13e6e930 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:34.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.269+0000 7f82c5193740 1 -- 172.21.15.44:0/2490816924 >> 172.21.15.44:0/2490816924 conn(0x55be13e5bf20 msgr2=0x55be13e681e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:21:34.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.269+0000 7f829bfff640 0 client.16545 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:21:34.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.270+0000 7f82c5193740 1 -- 172.21.15.44:0/2490816924 shutdown_connections 2024-08-19T00:21:34.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.270+0000 7f82c5193740 1 -- 172.21.15.44:0/2490816924 wait complete. 2024-08-19T00:21:34.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.270+0000 7f82c5193740 20 client.16545 trim_cache size 0 max 16384 2024-08-19T00:21:34.281 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-08-19T00:21:34.281 INFO:teuthology.orchestra.run.smithi044.stdout: "epoch": 33, 2024-08-19T00:21:34.281 INFO:teuthology.orchestra.run.smithi044.stdout: "leader": 24473, 2024-08-19T00:21:34.281 INFO:teuthology.orchestra.run.smithi044.stdout: "set_version": 28, 2024-08-19T00:21:34.281 INFO:teuthology.orchestra.run.smithi044.stdout: "sets": { 2024-08-19T00:21:34.281 INFO:teuthology.orchestra.run.smithi044.stdout: "9b539fbd": { 2024-08-19T00:21:34.282 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 28, 2024-08-19T00:21:34.282 INFO:teuthology.orchestra.run.smithi044.stdout: "age_ref": 0.0, 2024-08-19T00:21:34.282 INFO:teuthology.orchestra.run.smithi044.stdout: "state": { 2024-08-19T00:21:34.282 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "RELEASED", 2024-08-19T00:21:34.282 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.0 2024-08-19T00:21:34.282 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:21:34.282 INFO:teuthology.orchestra.run.smithi044.stdout: "timeout": 90.0, 2024-08-19T00:21:34.282 INFO:teuthology.orchestra.run.smithi044.stdout: "expiration": 143.8, 2024-08-19T00:21:34.282 INFO:teuthology.orchestra.run.smithi044.stdout: "members": { 2024-08-19T00:21:34.282 INFO:teuthology.orchestra.run.smithi044.stdout: "file:/": { 2024-08-19T00:21:34.282 INFO:teuthology.orchestra.run.smithi044.stdout: "excluded": false, 2024-08-19T00:21:34.283 INFO:teuthology.orchestra.run.smithi044.stdout: "state": { 2024-08-19T00:21:34.283 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "RELEASED", 2024-08-19T00:21:34.283 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.0 2024-08-19T00:21:34.283 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:21:34.283 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:21:34.283 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:21:34.283 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:21:34.283 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:21:34.283 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-08-19T00:21:34.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.270+0000 7f82c2d95640 1 -- 172.21.15.44:0/181776604 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f82ac0a2cf0 msgr2=0x7f82ac0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:34.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.270+0000 7f82c2d95640 1 --2- 172.21.15.44:0/181776604 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f82ac0a2cf0 0x7f82ac0a51b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f82b0005d70 tx=0x7f82b0005d00 comp rx=0 tx=0).stop 2024-08-19T00:21:34.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.270+0000 7f82c2d95640 1 -- 172.21.15.44:0/181776604 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82bc102250 msgr2=0x7f82bc19a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:34.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.270+0000 7f82c2d95640 1 --2- 172.21.15.44:0/181776604 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82bc102250 0x7f82bc19a8b0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f82a800d950 tx=0x7f82a800de10 comp rx=0 tx=0).stop 2024-08-19T00:21:34.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.270+0000 7f82c2d95640 1 -- 172.21.15.44:0/181776604 shutdown_connections 2024-08-19T00:21:34.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.270+0000 7f82c2d95640 1 --2- 172.21.15.44:0/181776604 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f82ac0a2cf0 0x7f82ac0a51b0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:34.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.270+0000 7f82c2d95640 1 --2- 172.21.15.44:0/181776604 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f82bc1078b0 0x7f82bc19ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:34.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.270+0000 7f82c2d95640 1 --2- 172.21.15.44:0/181776604 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82bc102250 0x7f82bc19a8b0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:34.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.270+0000 7f82c2d95640 1 --2- 172.21.15.44:0/181776604 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f82bc1018b0 0x7f82bc19a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:34.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.270+0000 7f82c2d95640 1 -- 172.21.15.44:0/181776604 >> 172.21.15.44:0/181776604 conn(0x7f82bc0fd5f0 msgr2=0x7f82bc0fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:21:34.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.270+0000 7f82c2d95640 1 -- 172.21.15.44:0/181776604 shutdown_connections 2024-08-19T00:21:34.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:34.270+0000 7f82c2d95640 1 -- 172.21.15.44:0/181776604 wait complete. 2024-08-19T00:21:34.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:21:34 smithi171 ceph-mon[21810]: pgmap v254: 129 pgs: 129 active+clean; 437 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 1.5 MiB/s wr, 67 op/s 2024-08-19T00:21:34.596 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:21:34 smithi044 ceph-mon[18489]: pgmap v254: 129 pgs: 129 active+clean; 437 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 1.5 MiB/s wr, 67 op/s 2024-08-19T00:21:34.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:21:34 smithi116 ceph-mon[21873]: pgmap v254: 129 pgs: 129 active+clean; 437 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 1.5 MiB/s wr, 67 op/s 2024-08-19T00:21:34.687 INFO:tasks.workunit.client.0.smithi044.stdout: 1 605394 7.98 MB/sec execute 299 sec latency 22837.834 ms 2024-08-19T00:21:35.024 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '9b539fbd', total seconds elapsed: 27.2 2024-08-19T00:21:35.024 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 23.75 2024-08-19T00:21:35.025 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-19T00:21:35.289 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:21:35.687 INFO:tasks.workunit.client.0.smithi044.stdout: 1 607741 8.00 MB/sec execute 300 sec latency 33.990 ms 2024-08-19T00:21:35.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:35.750+0000 7f21642ff640 1 -- 172.21.15.44:0/1074022949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f215c102c20 msgr2=0x7f215c10d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:35.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:35.750+0000 7f21642ff640 1 --2- 172.21.15.44:0/1074022949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f215c102c20 0x7f215c10d770 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f2154009ca0 tx=0x7f215402a950 comp rx=0 tx=0).stop 2024-08-19T00:21:35.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:35.750+0000 7f21642ff640 1 -- 172.21.15.44:0/1074022949 shutdown_connections 2024-08-19T00:21:35.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:35.750+0000 7f21642ff640 1 --2- 172.21.15.44:0/1074022949 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f215c1022a0 0x7f215c1026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:35.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:35.750+0000 7f21642ff640 1 --2- 172.21.15.44:0/1074022949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f215c102c20 0x7f215c10d770 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:35.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:35.750+0000 7f21642ff640 1 --2- 172.21.15.44:0/1074022949 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f215c100b50 0x7f215c100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:35.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:35.750+0000 7f21642ff640 1 -- 172.21.15.44:0/1074022949 >> 172.21.15.44:0/1074022949 conn(0x7f215c0fc500 msgr2=0x7f215c0fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:21:35.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:35.750+0000 7f21642ff640 1 -- 172.21.15.44:0/1074022949 shutdown_connections 2024-08-19T00:21:35.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:35.750+0000 7f21642ff640 1 -- 172.21.15.44:0/1074022949 wait complete. 2024-08-19T00:21:35.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:35.751+0000 7f21642ff640 1 Processor -- start 2024-08-19T00:21:35.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:35.751+0000 7f21642ff640 1 -- start start 2024-08-19T00:21:35.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:35.751+0000 7f21642ff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f215c100b50 0x7f215c199050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:35.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:35.751+0000 7f21642ff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f215c1022a0 0x7f215c199590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:35.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:35.751+0000 7f21642ff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f215c102c20 0x7f215c1a40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:35.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:35.751+0000 7f21642ff640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f215c110d00 con 0x7f215c102c20 2024-08-19T00:21:35.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:35.751+0000 7f21642ff640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f215c110b80 con 0x7f215c1022a0 2024-08-19T00:21:35.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:35.751+0000 7f21642ff640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f215c110e80 con 0x7f215c100b50 2024-08-19T00:21:35.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:35.751+0000 7f216289c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f215c102c20 0x7f215c1a40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:35.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:35.751+0000 7f216289c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f215c102c20 0x7f215c1a40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59192/0 (socket says 172.21.15.44:59192) 2024-08-19T00:21:35.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:35.751+0000 7f216289c640 1 -- 172.21.15.44:0/3486561779 learned_addr learned my addr 172.21.15.44:0/3486561779 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:21:35.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:35.751+0000 7f216209b640 1 --2- 172.21.15.44:0/3486561779 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f215c100b50 0x7f215c199050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:35.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:35.751+0000 7f216189a640 1 --2- 172.21.15.44:0/3486561779 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f215c1022a0 0x7f215c199590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:35.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:35.751+0000 7f216289c640 1 -- 172.21.15.44:0/3486561779 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f215c100b50 msgr2=0x7f215c199050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:35.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:35.751+0000 7f216289c640 1 --2- 172.21.15.44:0/3486561779 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f215c100b50 0x7f215c199050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:35.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:35.751+0000 7f216289c640 1 -- 172.21.15.44:0/3486561779 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f215c1022a0 msgr2=0x7f215c199590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:35.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:35.751+0000 7f216289c640 1 --2- 172.21.15.44:0/3486561779 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f215c1022a0 0x7f215c199590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:35.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:35.752+0000 7f216289c640 1 -- 172.21.15.44:0/3486561779 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f215c1a4610 con 0x7f215c102c20 2024-08-19T00:21:35.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:35.752+0000 7f216289c640 1 --2- 172.21.15.44:0/3486561779 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f215c102c20 0x7f215c1a40d0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f2154009dc0 tx=0x7f2154003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:21:35.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:35.752+0000 7f21537fe640 1 -- 172.21.15.44:0/3486561779 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2154034040 con 0x7f215c102c20 2024-08-19T00:21:35.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:35.752+0000 7f21537fe640 1 -- 172.21.15.44:0/3486561779 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2154003e50 con 0x7f215c102c20 2024-08-19T00:21:35.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:35.752+0000 7f21537fe640 1 -- 172.21.15.44:0/3486561779 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21540046c0 con 0x7f215c102c20 2024-08-19T00:21:35.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:35.752+0000 7f21642ff640 1 -- 172.21.15.44:0/3486561779 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f215c1a47e0 con 0x7f215c102c20 2024-08-19T00:21:35.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:35.752+0000 7f21642ff640 1 -- 172.21.15.44:0/3486561779 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f215c1a4c90 con 0x7f215c102c20 2024-08-19T00:21:35.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:35.753+0000 7f21642ff640 1 -- 172.21.15.44:0/3486561779 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f215c100f30 con 0x7f215c102c20 2024-08-19T00:21:35.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:35.755+0000 7f21537fe640 1 -- 172.21.15.44:0/3486561779 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f2154037020 con 0x7f215c102c20 2024-08-19T00:21:35.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:35.756+0000 7f21537fe640 1 --2- 172.21.15.44:0/3486561779 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f21480a2d70 0x7f21480a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:35.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:35.756+0000 7f216209b640 1 --2- 172.21.15.44:0/3486561779 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f21480a2d70 0x7f21480a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:35.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:35.756+0000 7f21537fe640 1 -- 172.21.15.44:0/3486561779 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9533+0+0 (secure 0 0 0) 0x7f21540f0500 con 0x7f215c102c20 2024-08-19T00:21:35.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:35.757+0000 7f216209b640 1 --2- 172.21.15.44:0/3486561779 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f21480a2d70 0x7f21480a5230 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2158009bd0 tx=0x7f2158005f90 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:21:35.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:35.761+0000 7f21537fe640 1 -- 172.21.15.44:0/3486561779 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f21540bce40 con 0x7f215c102c20 2024-08-19T00:21:36.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:36.046+0000 7f21642ff640 1 -- 172.21.15.44:0/3486561779 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f215c1a4ec0 con 0x7f215c102c20 2024-08-19T00:21:36.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:36.047+0000 7f21537fe640 1 -- 172.21.15.44:0/3486561779 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11989 (secure 0 0 0) 0x7f21540bc740 con 0x7f215c102c20 2024-08-19T00:21:36.049 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:21:36.049 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":33,"btime":"2024-08-19T00:17:11:640526+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14511,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1538841896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1538841896},{"type":"v1","addr":"172.21.15.116:6833","nonce":1538841896}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/4044471606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4044471606},{"type":"v1","addr":"172.21.15.44:6835","nonce":4044471606}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":33,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-19T00:10:53.196636+0000","modified":"2024-08-19T00:17:11.586031+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24473,"mds_1":24446,"mds_2":24439,"mds_3":24431,"mds_4":24418},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14529":{"gid":14529,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6837/1824829052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1824829052},{"type":"v1","addr":"172.21.15.44:6837","nonce":1824829052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14577":{"gid":14577,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6839/3591739042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":3591739042},{"type":"v1","addr":"172.21.15.44:6839","nonce":3591739042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14589":{"gid":14589,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6841/3667695717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6840","nonce":3667695717},{"type":"v1","addr":"172.21.15.44:6841","nonce":3667695717}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24388":{"gid":24388,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1183022838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1183022838},{"type":"v1","addr":"172.21.15.171:6833","nonce":1183022838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6835/2190623851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":2190623851},{"type":"v1","addr":"172.21.15.171:6835","nonce":2190623851}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.171:6837/316231795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":316231795},{"type":"v1","addr":"172.21.15.171:6837","nonce":316231795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":20,"addr":"172.21.15.116:6835/3507399322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3507399322},{"type":"v1","addr":"172.21.15.116:6835","nonce":3507399322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.171:6839/1466585795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":1466585795},{"type":"v1","addr":"172.21.15.171:6839","nonce":1466585795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":17,"addr":"172.21.15.116:6837/2764513846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":2764513846},{"type":"v1","addr":"172.21.15.116:6837","nonce":2764513846}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.116:6839/1032741033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":1032741033},{"type":"v1","addr":"172.21.15.116:6839","nonce":1032741033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24446,24439,24431,24418]},"id":1}]} 2024-08-19T00:21:36.049 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 33 2024-08-19T00:21:36.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:36.050+0000 7f21642ff640 1 -- 172.21.15.44:0/3486561779 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f21480a2d70 msgr2=0x7f21480a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:36.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:36.050+0000 7f21642ff640 1 --2- 172.21.15.44:0/3486561779 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f21480a2d70 0x7f21480a5230 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2158009bd0 tx=0x7f2158005f90 comp rx=0 tx=0).stop 2024-08-19T00:21:36.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:36.050+0000 7f21642ff640 1 -- 172.21.15.44:0/3486561779 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f215c102c20 msgr2=0x7f215c1a40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:36.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:36.050+0000 7f21642ff640 1 --2- 172.21.15.44:0/3486561779 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f215c102c20 0x7f215c1a40d0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f2154009dc0 tx=0x7f2154003ce0 comp rx=0 tx=0).stop 2024-08-19T00:21:36.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:36.050+0000 7f21642ff640 1 -- 172.21.15.44:0/3486561779 shutdown_connections 2024-08-19T00:21:36.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:36.050+0000 7f21642ff640 1 --2- 172.21.15.44:0/3486561779 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f21480a2d70 0x7f21480a5230 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:36.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:36.050+0000 7f21642ff640 1 --2- 172.21.15.44:0/3486561779 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f215c102c20 0x7f215c1a40d0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:36.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:36.050+0000 7f21642ff640 1 --2- 172.21.15.44:0/3486561779 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f215c1022a0 0x7f215c199590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:36.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:36.050+0000 7f21642ff640 1 --2- 172.21.15.44:0/3486561779 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f215c100b50 0x7f215c199050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:36.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:36.050+0000 7f21642ff640 1 -- 172.21.15.44:0/3486561779 >> 172.21.15.44:0/3486561779 conn(0x7f215c0fc500 msgr2=0x7f215c106560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:21:36.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:36.050+0000 7f21642ff640 1 -- 172.21.15.44:0/3486561779 shutdown_connections 2024-08-19T00:21:36.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:36.050+0000 7f21642ff640 1 -- 172.21.15.44:0/3486561779 wait complete. 2024-08-19T00:21:36.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:21:36 smithi044 ceph-mon[18489]: pgmap v255: 129 pgs: 129 active+clean; 437 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 2.4 MiB/s wr, 104 op/s 2024-08-19T00:21:36.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:21:36 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/3486561779' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:21:36.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:21:36 smithi171 ceph-mon[21810]: pgmap v255: 129 pgs: 129 active+clean; 437 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 2.4 MiB/s wr, 104 op/s 2024-08-19T00:21:36.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:21:36 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/3486561779' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:21:36.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:21:36 smithi116 ceph-mon[21873]: pgmap v255: 129 pgs: 129 active+clean; 437 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 2.4 MiB/s wr, 104 op/s 2024-08-19T00:21:36.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:21:36 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/3486561779' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:21:36.686 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24473 quiesce db / --timeout 90 --expiration 143.75 --await-for 45.0' 2024-08-19T00:21:36.687 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24473 quiesce db / --timeout 90 --expiration 143.75 --await-for 45.0 2024-08-19T00:21:36.687 INFO:tasks.workunit.client.0.smithi044.stdout: 1 609745 7.99 MB/sec execute 301 sec latency 21.421 ms 2024-08-19T00:21:36.960 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:21:37.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.478+0000 7f93e4475640 1 -- 172.21.15.44:0/2714514377 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93dc1018a0 msgr2=0x7f93dc101d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:37.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.478+0000 7f93e4475640 1 --2- 172.21.15.44:0/2714514377 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93dc1018a0 0x7f93dc101d00 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f93d0009930 tx=0x7f93d002a420 comp rx=0 tx=0).stop 2024-08-19T00:21:37.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.479+0000 7f93e4475640 1 -- 172.21.15.44:0/2714514377 shutdown_connections 2024-08-19T00:21:37.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.479+0000 7f93e4475640 1 --2- 172.21.15.44:0/2714514377 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f93dc102240 0x7f93dc10e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:37.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.479+0000 7f93e4475640 1 --2- 172.21.15.44:0/2714514377 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93dc1018a0 0x7f93dc101d00 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:37.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.479+0000 7f93e4475640 1 --2- 172.21.15.44:0/2714514377 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f93dc1078a0 0x7f93dc107c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:37.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.479+0000 7f93e4475640 1 -- 172.21.15.44:0/2714514377 >> 172.21.15.44:0/2714514377 conn(0x7f93dc0fd5e0 msgr2=0x7f93dc0ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:21:37.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.479+0000 7f93e4475640 1 -- 172.21.15.44:0/2714514377 shutdown_connections 2024-08-19T00:21:37.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.479+0000 7f93e4475640 1 -- 172.21.15.44:0/2714514377 wait complete. 2024-08-19T00:21:37.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.479+0000 7f93e4475640 1 Processor -- start 2024-08-19T00:21:37.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.479+0000 7f93e4475640 1 -- start start 2024-08-19T00:21:37.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.479+0000 7f93e4475640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93dc1018a0 0x7f93dc074220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:37.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.479+0000 7f93e4475640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f93dc102240 0x7f93dc074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:37.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.480+0000 7f93e4475640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f93dc1078a0 0x7f93dc074ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:37.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.480+0000 7f93e4475640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f93dc111ca0 con 0x7f93dc1018a0 2024-08-19T00:21:37.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.480+0000 7f93e4475640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f93dc111b20 con 0x7f93dc1078a0 2024-08-19T00:21:37.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.480+0000 7f93e4475640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f93dc111e20 con 0x7f93dc102240 2024-08-19T00:21:37.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.480+0000 7f93e2211640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93dc1018a0 0x7f93dc074220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:37.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.480+0000 7f93e2211640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93dc1018a0 0x7f93dc074220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59218/0 (socket says 172.21.15.44:59218) 2024-08-19T00:21:37.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.480+0000 7f93e2211640 1 -- 172.21.15.44:0/1297560616 learned_addr learned my addr 172.21.15.44:0/1297560616 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:21:37.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.480+0000 7f93e1a10640 1 --2- 172.21.15.44:0/1297560616 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f93dc102240 0x7f93dc074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:37.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.480+0000 7f93e2a12640 1 --2- 172.21.15.44:0/1297560616 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f93dc1078a0 0x7f93dc074ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:37.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.480+0000 7f93e2211640 1 -- 172.21.15.44:0/1297560616 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f93dc102240 msgr2=0x7f93dc074760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:37.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.480+0000 7f93e2211640 1 --2- 172.21.15.44:0/1297560616 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f93dc102240 0x7f93dc074760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:37.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.480+0000 7f93e2211640 1 -- 172.21.15.44:0/1297560616 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f93dc1078a0 msgr2=0x7f93dc074ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:37.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.480+0000 7f93e2211640 1 --2- 172.21.15.44:0/1297560616 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f93dc1078a0 0x7f93dc074ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:37.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.480+0000 7f93e2211640 1 -- 172.21.15.44:0/1297560616 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93dc1a6700 con 0x7f93dc1018a0 2024-08-19T00:21:37.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.480+0000 7f93e2a12640 1 --2- 172.21.15.44:0/1297560616 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f93dc1078a0 0x7f93dc074ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:21:37.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.480+0000 7f93e2211640 1 --2- 172.21.15.44:0/1297560616 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93dc1018a0 0x7f93dc074220 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f93d400e9f0 tx=0x7f93d400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:21:37.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.480+0000 7f93db7fe640 1 -- 172.21.15.44:0/1297560616 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d400cd80 con 0x7f93dc1018a0 2024-08-19T00:21:37.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.480+0000 7f93db7fe640 1 -- 172.21.15.44:0/1297560616 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93d4005500 con 0x7f93dc1018a0 2024-08-19T00:21:37.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.480+0000 7f93e4475640 1 -- 172.21.15.44:0/1297560616 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93dc1a69f0 con 0x7f93dc1018a0 2024-08-19T00:21:37.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.480+0000 7f93db7fe640 1 -- 172.21.15.44:0/1297560616 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d4010690 con 0x7f93dc1018a0 2024-08-19T00:21:37.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.481+0000 7f93e4475640 1 -- 172.21.15.44:0/1297560616 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93dc1a6eb0 con 0x7f93dc1018a0 2024-08-19T00:21:37.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.483+0000 7f93db7fe640 1 -- 172.21.15.44:0/1297560616 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f93d40046c0 con 0x7f93dc1018a0 2024-08-19T00:21:37.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.483+0000 7f93e6873740 1 Processor -- start 2024-08-19T00:21:37.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.484+0000 7f93e6873740 1 -- start start 2024-08-19T00:21:37.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.484+0000 7f93db7fe640 1 --2- 172.21.15.44:0/1297560616 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f93c40a2cf0 0x7f93c40a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:37.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.484+0000 7f93e6873740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f52eb952c0 0x55f52eb956a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:37.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.484+0000 7f93e6873740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f52eb95be0 0x55f52eb9ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:37.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.484+0000 7f93e6873740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f52eba04a0 0x55f52eba2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:37.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.484+0000 7f93e6873740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55f52eafa810 con 0x55f52eb95be0 2024-08-19T00:21:37.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.484+0000 7f93e6873740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55f52eaa1c70 con 0x55f52eba04a0 2024-08-19T00:21:37.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.484+0000 7f93e6873740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55f52eaf67d0 con 0x55f52eb952c0 2024-08-19T00:21:37.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.484+0000 7f93e2211640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f52eb952c0 0x55f52eb956a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:37.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.484+0000 7f93e2a12640 1 --2- 172.21.15.44:0/1297560616 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f93c40a2cf0 0x7f93c40a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:37.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.484+0000 7f93e1a10640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f52eb95be0 0x55f52eb9ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:37.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.484+0000 7f93e2211640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f52eb952c0 0x55f52eb956a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.44:46474/0 (socket says 172.21.15.44:46474) 2024-08-19T00:21:37.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.484+0000 7f93e2211640 1 -- 172.21.15.44:0/3265894976 learned_addr learned my addr 172.21.15.44:0/3265894976 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:21:37.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.484+0000 7f93e2a12640 1 --2- 172.21.15.44:0/3265894976 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f52eba04a0 0x55f52eba2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:37.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.484+0000 7f93e2211640 1 -- 172.21.15.44:0/3265894976 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f52eba04a0 msgr2=0x55f52eba2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:37.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.484+0000 7f93e2211640 1 --2- 172.21.15.44:0/3265894976 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f52eba04a0 0x55f52eba2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:37.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.484+0000 7f93e2211640 1 -- 172.21.15.44:0/3265894976 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f52eb95be0 msgr2=0x55f52eb9ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:37.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.484+0000 7f93e2211640 1 --2- 172.21.15.44:0/3265894976 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f52eb95be0 0x55f52eb9ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:37.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.484+0000 7f93e2211640 1 -- 172.21.15.44:0/3265894976 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f52e86cba0 con 0x55f52eb952c0 2024-08-19T00:21:37.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.485+0000 7f93db7fe640 1 -- 172.21.15.44:0/1297560616 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9533+0+0 (secure 0 0 0) 0x7f93d40cfca0 con 0x7f93dc1018a0 2024-08-19T00:21:37.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.485+0000 7f93e2a12640 1 --2- 172.21.15.44:0/1297560616 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f93c40a2cf0 0x7f93c40a51b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f93cc005fd0 tx=0x7f93cc00ac90 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:21:37.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.485+0000 7f93e2211640 1 --2- 172.21.15.44:0/3265894976 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f52eb952c0 0x55f52eb956a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f93d40987a0 tx=0x7f93d409bc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bed17280d625ed36 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:21:37.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.485+0000 7f93d8dea640 1 -- 172.21.15.44:0/3265894976 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d409c4d0 con 0x55f52eb952c0 2024-08-19T00:21:37.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.485+0000 7f93d8dea640 1 -- 172.21.15.44:0/3265894976 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93d404e0d0 con 0x55f52eb952c0 2024-08-19T00:21:37.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.485+0000 7f93d8dea640 1 -- 172.21.15.44:0/3265894976 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d409a160 con 0x55f52eb952c0 2024-08-19T00:21:37.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.486+0000 7f93e6873740 1 -- 172.21.15.44:0/3265894976 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f52eb952c0 msgr2=0x55f52eb956a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:37.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.486+0000 7f93e6873740 1 --2- 172.21.15.44:0/3265894976 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f52eb952c0 0x55f52eb956a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f93d40987a0 tx=0x7f93d409bc60 comp rx=0 tx=0).stop 2024-08-19T00:21:37.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.486+0000 7f93e6873740 1 -- 172.21.15.44:0/3265894976 shutdown_connections 2024-08-19T00:21:37.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.486+0000 7f93e6873740 1 --2- 172.21.15.44:0/3265894976 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f52eba04a0 0x55f52eba2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:37.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.486+0000 7f93e6873740 1 --2- 172.21.15.44:0/3265894976 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f52eb95be0 0x55f52eb9ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:37.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.486+0000 7f93e6873740 1 --2- 172.21.15.44:0/3265894976 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f52eb952c0 0x55f52eb956a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:37.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.486+0000 7f93e6873740 1 -- 172.21.15.44:0/3265894976 >> 172.21.15.44:0/3265894976 conn(0x55f52eb91850 msgr2=0x55f52eb91c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:21:37.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.486+0000 7f93e6873740 1 -- 172.21.15.44:0/3265894976 shutdown_connections 2024-08-19T00:21:37.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.486+0000 7f93e6873740 1 -- 172.21.15.44:0/3265894976 wait complete. 2024-08-19T00:21:37.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.486+0000 7f93e6873740 1 -- start start 2024-08-19T00:21:37.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.486+0000 7f93e6873740 1 Processor -- start 2024-08-19T00:21:37.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.486+0000 7f93e6873740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f52eb952c0 0x55f52eb9d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:37.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.486+0000 7f93e6873740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f52eb95be0 0x55f52eb9da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:37.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.486+0000 7f93e6873740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f52eba04a0 0x55f52eb9df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:37.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.486+0000 7f93e6873740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55f52eba2fb0 con 0x55f52eba04a0 2024-08-19T00:21:37.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.487+0000 7f93e6873740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55f52eab59a0 con 0x55f52eb95be0 2024-08-19T00:21:37.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.487+0000 7f93e6873740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55f52eba3130 con 0x55f52eb952c0 2024-08-19T00:21:37.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.487+0000 7f93e2a12640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f52eba04a0 0x55f52eb9df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:37.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.487+0000 7f93e2211640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f52eb952c0 0x55f52eb9d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:37.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.487+0000 7f93e6873740 10 client.0 _ll_register_callbacks cb 0x55f52eaa3c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:21:37.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.487+0000 7f93e2a12640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f52eba04a0 0x55f52eb9df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59226/0 (socket says 172.21.15.44:59226) 2024-08-19T00:21:37.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.487+0000 7f93e2a12640 1 -- 172.21.15.44:0/2934281824 learned_addr learned my addr 172.21.15.44:0/2934281824 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:21:37.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.487+0000 7f93e1a10640 1 --2- 172.21.15.44:0/2934281824 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f52eb95be0 0x55f52eb9da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:37.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.487+0000 7f93e2a12640 1 -- 172.21.15.44:0/2934281824 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f52eb952c0 msgr2=0x55f52eb9d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:37.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.487+0000 7f93e2a12640 1 --2- 172.21.15.44:0/2934281824 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f52eb952c0 0x55f52eb9d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:37.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.487+0000 7f93e2a12640 1 -- 172.21.15.44:0/2934281824 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f52eb95be0 msgr2=0x55f52eb9da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:37.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.487+0000 7f93e2a12640 1 --2- 172.21.15.44:0/2934281824 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f52eb95be0 0x55f52eb9da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:37.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.487+0000 7f93e2a12640 1 -- 172.21.15.44:0/2934281824 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f52eac1220 con 0x55f52eba04a0 2024-08-19T00:21:37.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.487+0000 7f93e2211640 1 --2- 172.21.15.44:0/2934281824 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f52eb952c0 0x55f52eb9d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:21:37.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.487+0000 7f93e1a10640 1 --2- 172.21.15.44:0/2934281824 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f52eb95be0 0x55f52eb9da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:21:37.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.487+0000 7f93e2a12640 1 --2- 172.21.15.44:0/2934281824 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f52eba04a0 0x55f52eb9df70 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f93cc00af30 tx=0x7f93cc005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeacd3606e223bc2 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:21:37.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.487+0000 7f93c1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:21:37.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.487+0000 7f93c1ffb640 1 -- 172.21.15.44:0/2934281824 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93cc023070 con 0x55f52eba04a0 2024-08-19T00:21:37.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.487+0000 7f93c1ffb640 1 -- 172.21.15.44:0/2934281824 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9533+0+0 (secure 0 0 0) 0x7f93cc011e00 con 0x55f52eba04a0 2024-08-19T00:21:37.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.487+0000 7f93e6873740 1 -- 172.21.15.44:0/2934281824 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93d404e0d0 con 0x55f52eba04a0 2024-08-19T00:21:37.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.488+0000 7f93c1ffb640 1 -- 172.21.15.44:0/2934281824 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f93cc031050 con 0x55f52eba04a0 2024-08-19T00:21:37.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.488+0000 7f93e6873740 10 client.16563 fetch_fsmap learned FSMap version 33 2024-08-19T00:21:37.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.488+0000 7f93e6873740 1 -- 172.21.15.44:0/2934281824 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55f52ebaece0 con 0x55f52eba04a0 2024-08-19T00:21:37.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.488+0000 7f93c1ffb640 1 -- 172.21.15.44:0/2934281824 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93d404e0d0 con 0x55f52eba04a0 2024-08-19T00:21:37.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.488+0000 7f93c1ffb640 1 -- 172.21.15.44:0/2934281824 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f93cc0104f0 con 0x55f52eba04a0 2024-08-19T00:21:37.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.488+0000 7f93e6873740 10 client.16563 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:21:37.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.488+0000 7f93e6873740 10 client.16563 resolve_mds: validated gid 24473 aka daemon mds.b 2024-08-19T00:21:37.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.488+0000 7f93e6873740 20 client.16563 populate_metadata read hostname 'smithi044' 2024-08-19T00:21:37.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.488+0000 7f93e6873740 1 --2- 172.21.15.44:0/2934281824 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55f52ebb01a0 0x55f52ebb2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:37.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.488+0000 7f93e6873740 4 client.16563 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:21:37.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.488+0000 7f93e6873740 1 -- 172.21.15.44:0/2934281824 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f52eb07f40 con 0x55f52ebb01a0 2024-08-19T00:21:37.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.488+0000 7f93e2211640 1 --2- 172.21.15.44:0/2934281824 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55f52ebb01a0 0x55f52ebb2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:37.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.489+0000 7f93e2211640 1 --2- 172.21.15.44:0/2934281824 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55f52ebb01a0 0x55f52ebb2590 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51597781cc056b9f server_cookie=c5dd313de2260fb9 in_seq=0 out_seq=0 2024-08-19T00:21:37.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.489+0000 7f93c1ffb640 10 client.16563 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:21:37.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.489+0000 7f93c1ffb640 1 -- 172.21.15.44:0/2934281824 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f52eb07f40 con 0x55f52ebb01a0 2024-08-19T00:21:37.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.489+0000 7f93c1ffb640 10 client.16563 handle_command_reply: tid=0 2024-08-19T00:21:37.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.489+0000 7f93e6873740 1 client.16563 shutdown 2024-08-19T00:21:37.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.489+0000 7f93e6873740 1 -- 172.21.15.44:0/2934281824 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f52eba04a0 msgr2=0x55f52eb9df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:37.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.489+0000 7f93e6873740 1 --2- 172.21.15.44:0/2934281824 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f52eba04a0 0x55f52eb9df70 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f93cc00af30 tx=0x7f93cc005e80 comp rx=0 tx=0).stop 2024-08-19T00:21:37.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.489+0000 7f93e6873740 1 -- 172.21.15.44:0/2934281824 shutdown_connections 2024-08-19T00:21:37.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.489+0000 7f93e6873740 1 --2- 172.21.15.44:0/2934281824 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55f52ebb01a0 0x55f52ebb2590 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:37.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.489+0000 7f93e6873740 1 --2- 172.21.15.44:0/2934281824 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f52eba04a0 0x55f52eb9df70 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:37.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.490+0000 7f93e6873740 1 --2- 172.21.15.44:0/2934281824 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f52eb95be0 0x55f52eb9da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:37.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.490+0000 7f93e6873740 1 --2- 172.21.15.44:0/2934281824 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f52eb952c0 0x55f52eb9d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:37.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.490+0000 7f93e6873740 1 -- 172.21.15.44:0/2934281824 >> 172.21.15.44:0/2934281824 conn(0x55f52eb91850 msgr2=0x55f52eb90b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:21:37.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.490+0000 7f93c1ffb640 0 client.16563 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:21:37.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.490+0000 7f93e6873740 1 -- 172.21.15.44:0/2934281824 shutdown_connections 2024-08-19T00:21:37.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.490+0000 7f93e6873740 1 -- 172.21.15.44:0/2934281824 wait complete. 2024-08-19T00:21:37.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.490+0000 7f93e6873740 20 client.16563 trim_cache size 0 max 16384 2024-08-19T00:21:37.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.507+0000 7f93e6873740 1 Processor -- start 2024-08-19T00:21:37.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.507+0000 7f93e6873740 1 -- start start 2024-08-19T00:21:37.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.507+0000 7f93e6873740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f52eb952c0 0x55f52eb8cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:37.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.507+0000 7f93e6873740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f52eb95be0 0x55f52ebb7e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:37.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.507+0000 7f93e6873740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f52eba04a0 0x55f52ebb8380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:37.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.507+0000 7f93e6873740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f93dc1b1100 con 0x55f52eb95be0 2024-08-19T00:21:37.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.507+0000 7f93e6873740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f93dc1b2c40 con 0x55f52eba04a0 2024-08-19T00:21:37.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.507+0000 7f93e6873740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f93dc1b17d0 con 0x55f52eb952c0 2024-08-19T00:21:37.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.507+0000 7f93e1a10640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f52eb95be0 0x55f52ebb7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:37.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.507+0000 7f93e1a10640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f52eb95be0 0x55f52ebb7e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59238/0 (socket says 172.21.15.44:59238) 2024-08-19T00:21:37.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.507+0000 7f93e1a10640 1 -- 172.21.15.44:0/1027563547 learned_addr learned my addr 172.21.15.44:0/1027563547 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:21:37.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.507+0000 7f93e2211640 1 --2- 172.21.15.44:0/1027563547 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f52eb952c0 0x55f52eb8cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:37.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.507+0000 7f93e2a12640 1 --2- 172.21.15.44:0/1027563547 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f52eba04a0 0x55f52ebb8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:37.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.507+0000 7f93e2211640 1 -- 172.21.15.44:0/1027563547 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f52eba04a0 msgr2=0x55f52ebb8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:37.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.507+0000 7f93e2211640 1 --2- 172.21.15.44:0/1027563547 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f52eba04a0 0x55f52ebb8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:37.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.507+0000 7f93e2211640 1 -- 172.21.15.44:0/1027563547 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f52eb95be0 msgr2=0x55f52ebb7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:37.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.507+0000 7f93e2211640 1 --2- 172.21.15.44:0/1027563547 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f52eb95be0 0x55f52ebb7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:37.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.507+0000 7f93e2211640 1 -- 172.21.15.44:0/1027563547 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f52ebac210 con 0x55f52eb952c0 2024-08-19T00:21:37.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.507+0000 7f93e2a12640 1 --2- 172.21.15.44:0/1027563547 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f52eba04a0 0x55f52ebb8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:21:37.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.508+0000 7f93e2211640 1 --2- 172.21.15.44:0/1027563547 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f52eb952c0 0x55f52eb8cc60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f93d40a0340 tx=0x7f93d4004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c93b47db810c084 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:21:37.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.508+0000 7f93c3fff640 1 -- 172.21.15.44:0/1027563547 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d404e0d0 con 0x55f52eb952c0 2024-08-19T00:21:37.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.508+0000 7f93c3fff640 1 -- 172.21.15.44:0/1027563547 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93d409c4d0 con 0x55f52eb952c0 2024-08-19T00:21:37.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.508+0000 7f93c3fff640 1 -- 172.21.15.44:0/1027563547 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d40a4810 con 0x55f52eb952c0 2024-08-19T00:21:37.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.508+0000 7f93e6873740 1 -- 172.21.15.44:0/1027563547 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f52eb952c0 msgr2=0x55f52eb8cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:37.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.508+0000 7f93e6873740 1 --2- 172.21.15.44:0/1027563547 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f52eb952c0 0x55f52eb8cc60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f93d40a0340 tx=0x7f93d4004a40 comp rx=0 tx=0).stop 2024-08-19T00:21:37.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.508+0000 7f93e6873740 1 -- 172.21.15.44:0/1027563547 shutdown_connections 2024-08-19T00:21:37.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.508+0000 7f93e6873740 1 --2- 172.21.15.44:0/1027563547 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f52eba04a0 0x55f52ebb8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:37.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.508+0000 7f93e6873740 1 --2- 172.21.15.44:0/1027563547 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f52eb95be0 0x55f52ebb7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:37.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.508+0000 7f93e6873740 1 --2- 172.21.15.44:0/1027563547 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f52eb952c0 0x55f52eb8cc60 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:37.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.508+0000 7f93e6873740 1 -- 172.21.15.44:0/1027563547 >> 172.21.15.44:0/1027563547 conn(0x55f52eb91850 msgr2=0x55f52eb9bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:21:37.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.509+0000 7f93e6873740 1 -- 172.21.15.44:0/1027563547 shutdown_connections 2024-08-19T00:21:37.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.509+0000 7f93e6873740 1 -- 172.21.15.44:0/1027563547 wait complete. 2024-08-19T00:21:37.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.509+0000 7f93e6873740 1 -- start start 2024-08-19T00:21:37.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.509+0000 7f93e6873740 1 Processor -- start 2024-08-19T00:21:37.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.509+0000 7f93e6873740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f52eb952c0 0x55f52eba3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:37.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.509+0000 7f93e6873740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f52eb95be0 0x55f52eba3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:37.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.509+0000 7f93e6873740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f52eba04a0 0x55f52eba3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:37.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.509+0000 7f93e6873740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f93dc1b2570 con 0x55f52eb952c0 2024-08-19T00:21:37.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.509+0000 7f93e6873740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f93dc1b1ea0 con 0x55f52eba04a0 2024-08-19T00:21:37.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.509+0000 7f93e6873740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f93dc1af100 con 0x55f52eb95be0 2024-08-19T00:21:37.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.509+0000 7f93e6873740 10 client.0 _ll_register_callbacks cb 0x7f93cc012270 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:21:37.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.509+0000 7f93e2211640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f52eb952c0 0x55f52eba3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:37.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.510+0000 7f93e2211640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f52eb952c0 0x55f52eba3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59254/0 (socket says 172.21.15.44:59254) 2024-08-19T00:21:37.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.510+0000 7f93e1a10640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f52eb95be0 0x55f52eba3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:37.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.510+0000 7f93e2211640 1 -- 172.21.15.44:0/967984585 learned_addr learned my addr 172.21.15.44:0/967984585 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:21:37.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.510+0000 7f93e2a12640 1 --2- 172.21.15.44:0/967984585 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f52eba04a0 0x55f52eba3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:37.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.510+0000 7f93e2211640 1 -- 172.21.15.44:0/967984585 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f52eb95be0 msgr2=0x55f52eba3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:37.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.510+0000 7f93e2211640 1 --2- 172.21.15.44:0/967984585 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f52eb95be0 0x55f52eba3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:37.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.510+0000 7f93e2211640 1 -- 172.21.15.44:0/967984585 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f52eba04a0 msgr2=0x55f52eba3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:37.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.510+0000 7f93e2211640 1 --2- 172.21.15.44:0/967984585 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f52eba04a0 0x55f52eba3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:37.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.510+0000 7f93e2211640 1 -- 172.21.15.44:0/967984585 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f52ec18fd0 con 0x55f52eb952c0 2024-08-19T00:21:37.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.510+0000 7f93e2a12640 1 --2- 172.21.15.44:0/967984585 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f52eba04a0 0x55f52eba3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:21:37.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.510+0000 7f93e1a10640 1 --2- 172.21.15.44:0/967984585 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f52eb95be0 0x55f52eba3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:21:37.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.510+0000 7f93e2211640 1 --2- 172.21.15.44:0/967984585 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f52eb952c0 0x55f52eba3340 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f93d409bf90 tx=0x7f93d409ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50e8b5757820ee0e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:21:37.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.510+0000 7f93c1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:21:37.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.510+0000 7f93c1ffb640 1 -- 172.21.15.44:0/967984585 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d40cc070 con 0x55f52eb952c0 2024-08-19T00:21:37.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.510+0000 7f93c1ffb640 1 -- 172.21.15.44:0/967984585 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9533+0+0 (secure 0 0 0) 0x7f93d40a47b0 con 0x55f52eb952c0 2024-08-19T00:21:37.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.510+0000 7f93e6873740 1 -- 172.21.15.44:0/967984585 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93d409c4d0 con 0x55f52eb952c0 2024-08-19T00:21:37.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.510+0000 7f93c1ffb640 1 -- 172.21.15.44:0/967984585 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f93d40a4a40 con 0x55f52eb952c0 2024-08-19T00:21:37.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.510+0000 7f93e6873740 10 client.16569 fetch_fsmap learned FSMap version 33 2024-08-19T00:21:37.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.511+0000 7f93e6873740 1 -- 172.21.15.44:0/967984585 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55f52ec1a270 con 0x55f52eb952c0 2024-08-19T00:21:37.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.511+0000 7f93c1ffb640 1 -- 172.21.15.44:0/967984585 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93d409c4d0 con 0x55f52eb952c0 2024-08-19T00:21:37.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.511+0000 7f93c1ffb640 1 -- 172.21.15.44:0/967984585 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f93d40b1020 con 0x55f52eb952c0 2024-08-19T00:21:37.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.511+0000 7f93e6873740 10 client.16569 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:21:37.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.511+0000 7f93e6873740 10 client.16569 resolve_mds: validated gid 24473 aka daemon mds.b 2024-08-19T00:21:37.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.511+0000 7f93e6873740 20 client.16569 populate_metadata read hostname 'smithi044' 2024-08-19T00:21:37.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.511+0000 7f93e6873740 1 --2- 172.21.15.44:0/967984585 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55f52ec1a540 0x55f52ec1c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:37.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.511+0000 7f93e6873740 4 client.16569 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 143.75, "await_for": 45.0}] 2024-08-19T00:21:37.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.511+0000 7f93e6873740 1 -- 172.21.15.44:0/967984585 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 143.75, "await_for": 45.0}) -- 0x55f52eb02290 con 0x55f52ec1a540 2024-08-19T00:21:37.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.511+0000 7f93e1a10640 1 --2- 172.21.15.44:0/967984585 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55f52ec1a540 0x55f52ec1c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:37.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.512+0000 7f93e1a10640 1 --2- 172.21.15.44:0/967984585 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55f52ec1a540 0x55f52ec1c930 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fefcc4cd0dcc742 server_cookie=51a2c1bbe2308eae in_seq=0 out_seq=0 2024-08-19T00:21:37.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.512+0000 7f93c1ffb640 10 client.16569 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:21:37.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.589+0000 7f93c1ffb640 1 -- 172.21.15.44:0/967984585 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55f52eb02290 con 0x55f52ec1a540 2024-08-19T00:21:37.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.589+0000 7f93c1ffb640 10 client.16569 handle_command_reply: tid=0 2024-08-19T00:21:37.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.589+0000 7f93e6873740 1 client.16569 shutdown 2024-08-19T00:21:37.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.589+0000 7f93e6873740 1 -- 172.21.15.44:0/967984585 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f52eb952c0 msgr2=0x55f52eba3340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:37.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.589+0000 7f93e6873740 1 --2- 172.21.15.44:0/967984585 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f52eb952c0 0x55f52eba3340 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f93d409bf90 tx=0x7f93d409ba40 comp rx=0 tx=0).stop 2024-08-19T00:21:37.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.589+0000 7f93e6873740 1 -- 172.21.15.44:0/967984585 shutdown_connections 2024-08-19T00:21:37.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.589+0000 7f93e6873740 1 --2- 172.21.15.44:0/967984585 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55f52ec1a540 0x55f52ec1c930 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:37.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.589+0000 7f93e6873740 1 --2- 172.21.15.44:0/967984585 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f52eb95be0 0x55f52eba3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:37.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.589+0000 7f93e6873740 1 --2- 172.21.15.44:0/967984585 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f52eba04a0 0x55f52eba3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:37.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.589+0000 7f93c1ffb640 0 client.16569 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:21:37.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.589+0000 7f93e6873740 1 --2- 172.21.15.44:0/967984585 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f52eb952c0 0x55f52eba3340 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:37.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.589+0000 7f93e6873740 1 -- 172.21.15.44:0/967984585 >> 172.21.15.44:0/967984585 conn(0x55f52eb91850 msgr2=0x55f52eb90310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:21:37.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.589+0000 7f93e6873740 1 -- 172.21.15.44:0/967984585 shutdown_connections 2024-08-19T00:21:37.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.589+0000 7f93e6873740 1 -- 172.21.15.44:0/967984585 wait complete. 2024-08-19T00:21:37.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.589+0000 7f93e6873740 20 client.16569 trim_cache size 0 max 16384 2024-08-19T00:21:37.592 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-08-19T00:21:37.592 INFO:teuthology.orchestra.run.smithi044.stdout: "epoch": 33, 2024-08-19T00:21:37.592 INFO:teuthology.orchestra.run.smithi044.stdout: "leader": 24473, 2024-08-19T00:21:37.593 INFO:teuthology.orchestra.run.smithi044.stdout: "set_version": 30, 2024-08-19T00:21:37.593 INFO:teuthology.orchestra.run.smithi044.stdout: "sets": { 2024-08-19T00:21:37.593 INFO:teuthology.orchestra.run.smithi044.stdout: "7ac065e8": { 2024-08-19T00:21:37.593 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 30, 2024-08-19T00:21:37.593 INFO:teuthology.orchestra.run.smithi044.stdout: "age_ref": 0.0, 2024-08-19T00:21:37.593 INFO:teuthology.orchestra.run.smithi044.stdout: "state": { 2024-08-19T00:21:37.593 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "QUIESCED", 2024-08-19T00:21:37.593 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.0 2024-08-19T00:21:37.593 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:21:37.593 INFO:teuthology.orchestra.run.smithi044.stdout: "timeout": 90.0, 2024-08-19T00:21:37.593 INFO:teuthology.orchestra.run.smithi044.stdout: "expiration": 143.8, 2024-08-19T00:21:37.593 INFO:teuthology.orchestra.run.smithi044.stdout: "members": { 2024-08-19T00:21:37.593 INFO:teuthology.orchestra.run.smithi044.stdout: "file:/": { 2024-08-19T00:21:37.593 INFO:teuthology.orchestra.run.smithi044.stdout: "excluded": false, 2024-08-19T00:21:37.594 INFO:teuthology.orchestra.run.smithi044.stdout: "state": { 2024-08-19T00:21:37.594 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "QUIESCED", 2024-08-19T00:21:37.594 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.0 2024-08-19T00:21:37.594 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:21:37.594 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:21:37.594 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:21:37.594 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:21:37.594 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:21:37.594 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-08-19T00:21:37.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.590+0000 7f93e4475640 1 -- 172.21.15.44:0/1297560616 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f93c40a2cf0 msgr2=0x7f93c40a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:37.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.590+0000 7f93e4475640 1 --2- 172.21.15.44:0/1297560616 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f93c40a2cf0 0x7f93c40a51b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f93cc005fd0 tx=0x7f93cc00ac90 comp rx=0 tx=0).stop 2024-08-19T00:21:37.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.590+0000 7f93e4475640 1 -- 172.21.15.44:0/1297560616 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93dc1018a0 msgr2=0x7f93dc074220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:37.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.590+0000 7f93e4475640 1 --2- 172.21.15.44:0/1297560616 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93dc1018a0 0x7f93dc074220 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f93d400e9f0 tx=0x7f93d400edf0 comp rx=0 tx=0).stop 2024-08-19T00:21:37.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.590+0000 7f93e4475640 1 -- 172.21.15.44:0/1297560616 shutdown_connections 2024-08-19T00:21:37.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.590+0000 7f93e4475640 1 --2- 172.21.15.44:0/1297560616 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f93c40a2cf0 0x7f93c40a51b0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:37.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.590+0000 7f93e4475640 1 --2- 172.21.15.44:0/1297560616 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f93dc102240 0x7f93dc074760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:37.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.590+0000 7f93e4475640 1 --2- 172.21.15.44:0/1297560616 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f93dc1078a0 0x7f93dc074ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:37.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.590+0000 7f93e4475640 1 --2- 172.21.15.44:0/1297560616 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93dc1018a0 0x7f93dc074220 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:37.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.590+0000 7f93e4475640 1 -- 172.21.15.44:0/1297560616 >> 172.21.15.44:0/1297560616 conn(0x7f93dc0fd5e0 msgr2=0x7f93dc0fdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:21:37.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.590+0000 7f93e4475640 1 -- 172.21.15.44:0/1297560616 shutdown_connections 2024-08-19T00:21:37.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:37.590+0000 7f93e4475640 1 -- 172.21.15.44:0/1297560616 wait complete. 2024-08-19T00:21:37.687 INFO:tasks.workunit.client.0.smithi044.stdout: 1 611559 8.01 MB/sec execute 302 sec latency 124.045 ms 2024-08-19T00:21:38.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:21:38 smithi044 ceph-mon[18489]: pgmap v256: 129 pgs: 129 active+clean; 437 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 1.6 MiB/s wr, 70 op/s 2024-08-19T00:21:38.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:21:38 smithi171 ceph-mon[21810]: pgmap v256: 129 pgs: 129 active+clean; 437 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 1.6 MiB/s wr, 70 op/s 2024-08-19T00:21:38.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:21:38 smithi116 ceph-mon[21873]: pgmap v256: 129 pgs: 129 active+clean; 437 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 1.6 MiB/s wr, 70 op/s 2024-08-19T00:21:38.687 INFO:tasks.workunit.client.0.smithi044.stdout: 1 611559 7.98 MB/sec execute 303 sec latency 1124.136 ms 2024-08-19T00:21:38.766 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '7ac065e8', quiesce took 3.7 seconds. Will release after: 20.05 2024-08-19T00:21:39.687 INFO:tasks.workunit.client.0.smithi044.stdout: 1 611559 7.95 MB/sec execute 304 sec latency 2124.235 ms 2024-08-19T00:21:40.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:21:40 smithi171 ceph-mon[21810]: pgmap v257: 129 pgs: 129 active+clean; 437 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 1.6 MiB/s wr, 70 op/s 2024-08-19T00:21:40.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:21:40 smithi116 ceph-mon[21873]: pgmap v257: 129 pgs: 129 active+clean; 437 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 1.6 MiB/s wr, 70 op/s 2024-08-19T00:21:40.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:21:40 smithi044 ceph-mon[18489]: pgmap v257: 129 pgs: 129 active+clean; 437 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 1.6 MiB/s wr, 70 op/s 2024-08-19T00:21:40.687 INFO:tasks.workunit.client.0.smithi044.stdout: 1 611559 7.93 MB/sec execute 305 sec latency 3124.318 ms 2024-08-19T00:21:41.687 INFO:tasks.workunit.client.0.smithi044.stdout: 1 611559 7.90 MB/sec execute 306 sec latency 4124.428 ms 2024-08-19T00:21:41.822 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.820+0000 7fc4eca0a640 1 -- 172.21.15.44:0/3906274018 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4e8102a30 msgr2=0x7fc4e8102e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:41.822 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.820+0000 7fc4eca0a640 1 --2- 172.21.15.44:0/3906274018 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4e8102a30 0x7fc4e8102e10 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fc4d8009900 tx=0x7fc4d802a480 comp rx=0 tx=0).stop 2024-08-19T00:21:41.822 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.820+0000 7fc4eca0a640 1 -- 172.21.15.44:0/3906274018 shutdown_connections 2024-08-19T00:21:41.822 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.820+0000 7fc4eca0a640 1 --2- 172.21.15.44:0/3906274018 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc4e8103350 0x7fc4e810b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:41.822 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.820+0000 7fc4eca0a640 1 --2- 172.21.15.44:0/3906274018 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc4e810be00 0x7fc4e810e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:41.822 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.820+0000 7fc4eca0a640 1 --2- 172.21.15.44:0/3906274018 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4e8102a30 0x7fc4e8102e10 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:41.822 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.820+0000 7fc4eca0a640 1 -- 172.21.15.44:0/3906274018 >> 172.21.15.44:0/3906274018 conn(0x7fc4e80fc420 msgr2=0x7fc4e80fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:21:41.822 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.820+0000 7fc4eca0a640 1 -- 172.21.15.44:0/3906274018 shutdown_connections 2024-08-19T00:21:41.823 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.820+0000 7fc4eca0a640 1 -- 172.21.15.44:0/3906274018 wait complete. 2024-08-19T00:21:41.824 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.821+0000 7fc4eca0a640 1 Processor -- start 2024-08-19T00:21:41.824 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.821+0000 7fc4eca0a640 1 -- start start 2024-08-19T00:21:41.824 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.821+0000 7fc4eca0a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc4e8102a30 0x7fc4e8100680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:41.824 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.821+0000 7fc4eca0a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4e8103350 0x7fc4e8100bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:41.825 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.821+0000 7fc4eca0a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc4e810be00 0x7fc4e8101100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:41.825 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.821+0000 7fc4eca0a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e8111c00 con 0x7fc4e8103350 2024-08-19T00:21:41.825 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.821+0000 7fc4eca0a640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e8111a80 con 0x7fc4e810be00 2024-08-19T00:21:41.825 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.821+0000 7fc4eca0a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e8111d80 con 0x7fc4e8102a30 2024-08-19T00:21:41.825 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.821+0000 7fc4e5d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4e8103350 0x7fc4e8100bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:41.825 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.821+0000 7fc4e5d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4e8103350 0x7fc4e8100bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40214/0 (socket says 172.21.15.44:40214) 2024-08-19T00:21:41.825 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.821+0000 7fc4e5d9b640 1 -- 172.21.15.44:0/1853905173 learned_addr learned my addr 172.21.15.44:0/1853905173 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:21:41.825 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.821+0000 7fc4e659c640 1 --2- 172.21.15.44:0/1853905173 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc4e8102a30 0x7fc4e8100680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:41.825 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.822+0000 7fc4e6d9d640 1 --2- 172.21.15.44:0/1853905173 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc4e810be00 0x7fc4e8101100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:41.825 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.822+0000 7fc4e5d9b640 1 -- 172.21.15.44:0/1853905173 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc4e8102a30 msgr2=0x7fc4e8100680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:41.825 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.822+0000 7fc4e5d9b640 1 --2- 172.21.15.44:0/1853905173 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc4e8102a30 0x7fc4e8100680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:41.825 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.822+0000 7fc4e5d9b640 1 -- 172.21.15.44:0/1853905173 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc4e810be00 msgr2=0x7fc4e8101100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:41.825 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.822+0000 7fc4e5d9b640 1 --2- 172.21.15.44:0/1853905173 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc4e810be00 0x7fc4e8101100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:41.826 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.822+0000 7fc4e5d9b640 1 -- 172.21.15.44:0/1853905173 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4e81a6560 con 0x7fc4e8103350 2024-08-19T00:21:41.826 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.822+0000 7fc4e5d9b640 1 --2- 172.21.15.44:0/1853905173 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4e8103350 0x7fc4e8100bc0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc00d770 tx=0x7fc4dc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:21:41.826 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.822+0000 7fc4d77fe640 1 -- 172.21.15.44:0/1853905173 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4dc017070 con 0x7fc4e8103350 2024-08-19T00:21:41.826 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.822+0000 7fc4d77fe640 1 -- 172.21.15.44:0/1853905173 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4dc005500 con 0x7fc4e8103350 2024-08-19T00:21:41.826 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.822+0000 7fc4eca0a640 1 -- 172.21.15.44:0/1853905173 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4e81a6850 con 0x7fc4e8103350 2024-08-19T00:21:41.826 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.822+0000 7fc4d77fe640 1 -- 172.21.15.44:0/1853905173 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4dc004e00 con 0x7fc4e8103350 2024-08-19T00:21:41.826 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.822+0000 7fc4eca0a640 1 -- 172.21.15.44:0/1853905173 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4e81a6d50 con 0x7fc4e8103350 2024-08-19T00:21:41.829 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.824+0000 7fc4d77fe640 1 -- 172.21.15.44:0/1853905173 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fc4dc004fa0 con 0x7fc4e8103350 2024-08-19T00:21:41.829 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.825+0000 7fc4ef7cb740 1 Processor -- start 2024-08-19T00:21:41.829 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.825+0000 7fc4ef7cb740 1 -- start start 2024-08-19T00:21:41.829 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.825+0000 7fc4ef7cb740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5568e15607d0 0x5568e1560bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:41.829 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.825+0000 7fc4ef7cb740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5568e15610f0 0x5568e156b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:41.829 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.825+0000 7fc4ef7cb740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568e156b990 0x5568e156dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:41.829 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.825+0000 7fc4ef7cb740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5568e14c49d0 con 0x5568e156b990 2024-08-19T00:21:41.829 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.825+0000 7fc4ef7cb740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5568e146c820 con 0x5568e15610f0 2024-08-19T00:21:41.830 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.825+0000 7fc4ef7cb740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5568e14c0990 con 0x5568e15607d0 2024-08-19T00:21:41.830 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.825+0000 7fc4e5d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568e156b990 0x5568e156dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:41.830 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.826+0000 7fc4e6d9d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5568e15607d0 0x5568e1560bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:41.830 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.826+0000 7fc4d77fe640 1 --2- 172.21.15.44:0/1853905173 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fc4d00a2da0 0x7fc4d00a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:41.830 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.826+0000 7fc4e5d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568e156b990 0x5568e156dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40230/0 (socket says 172.21.15.44:40230) 2024-08-19T00:21:41.830 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.826+0000 7fc4e6d9d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5568e15607d0 0x5568e1560bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.44:44222/0 (socket says 172.21.15.44:44222) 2024-08-19T00:21:41.830 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.826+0000 7fc4e5d9b640 1 -- 172.21.15.44:0/944290309 learned_addr learned my addr 172.21.15.44:0/944290309 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:21:41.830 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.826+0000 7fc4e659c640 1 --2- 172.21.15.44:0/944290309 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5568e15610f0 0x5568e156b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:41.830 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.826+0000 7fc4e6d9d640 1 --2- 172.21.15.44:0/1853905173 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fc4d00a2da0 0x7fc4d00a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:41.830 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.826+0000 7fc4d77fe640 1 -- 172.21.15.44:0/1853905173 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9533+0+0 (secure 0 0 0) 0x7fc4dc0cf320 con 0x7fc4e8103350 2024-08-19T00:21:41.830 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.826+0000 7fc4e5d9b640 1 -- 172.21.15.44:0/944290309 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5568e15607d0 msgr2=0x5568e1560bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:41.830 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.826+0000 7fc4e5d9b640 1 --2- 172.21.15.44:0/944290309 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5568e15607d0 0x5568e1560bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:41.830 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.826+0000 7fc4e5d9b640 1 -- 172.21.15.44:0/944290309 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5568e15610f0 msgr2=0x5568e156b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:41.831 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.826+0000 7fc4e5d9b640 1 --2- 172.21.15.44:0/944290309 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5568e15610f0 0x5568e156b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:41.831 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.826+0000 7fc4e5d9b640 1 -- 172.21.15.44:0/944290309 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568e11d8210 con 0x5568e156b990 2024-08-19T00:21:41.831 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.826+0000 7fc4e5d9b640 1 --2- 172.21.15.44:0/944290309 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568e156b990 0x5568e156dd80 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc0cc590 tx=0x7fc4dc009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26d23892cbb7fcf7 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:21:41.831 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.826+0000 7fc4e6d9d640 1 --2- 172.21.15.44:0/1853905173 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fc4d00a2da0 0x7fc4d00a5260 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc4e0005fd0 tx=0x7fc4e0004ab0 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:21:41.831 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.826+0000 7fc4d4ff9640 1 -- 172.21.15.44:0/944290309 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4dc020070 con 0x5568e156b990 2024-08-19T00:21:41.831 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.826+0000 7fc4d4ff9640 1 -- 172.21.15.44:0/944290309 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4dc09baf0 con 0x5568e156b990 2024-08-19T00:21:41.831 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.826+0000 7fc4d4ff9640 1 -- 172.21.15.44:0/944290309 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4dc009cc0 con 0x5568e156b990 2024-08-19T00:21:41.831 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.827+0000 7fc4ef7cb740 1 -- 172.21.15.44:0/944290309 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568e156b990 msgr2=0x5568e156dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:41.831 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.827+0000 7fc4ef7cb740 1 --2- 172.21.15.44:0/944290309 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568e156b990 0x5568e156dd80 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc0cc590 tx=0x7fc4dc009c30 comp rx=0 tx=0).stop 2024-08-19T00:21:41.831 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.827+0000 7fc4ef7cb740 1 -- 172.21.15.44:0/944290309 shutdown_connections 2024-08-19T00:21:41.831 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.827+0000 7fc4ef7cb740 1 --2- 172.21.15.44:0/944290309 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568e156b990 0x5568e156dd80 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:41.832 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.827+0000 7fc4ef7cb740 1 --2- 172.21.15.44:0/944290309 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5568e15610f0 0x5568e156b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:41.832 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.827+0000 7fc4ef7cb740 1 --2- 172.21.15.44:0/944290309 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5568e15607d0 0x5568e1560bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:41.832 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.827+0000 7fc4ef7cb740 1 -- 172.21.15.44:0/944290309 >> 172.21.15.44:0/944290309 conn(0x5568e155cd40 msgr2=0x5568e155d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:21:41.832 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.827+0000 7fc4ef7cb740 1 -- 172.21.15.44:0/944290309 shutdown_connections 2024-08-19T00:21:41.832 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.827+0000 7fc4ef7cb740 1 -- 172.21.15.44:0/944290309 wait complete. 2024-08-19T00:21:41.832 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.828+0000 7fc4ef7cb740 1 -- start start 2024-08-19T00:21:41.832 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.828+0000 7fc4ef7cb740 1 Processor -- start 2024-08-19T00:21:41.835 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.828+0000 7fc4ef7cb740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5568e15607d0 0x5568e15688b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:41.835 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.828+0000 7fc4ef7cb740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568e15610f0 0x5568e1568df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:41.835 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.828+0000 7fc4ef7cb740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5568e156b990 0x5568e1569330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:41.835 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.828+0000 7fc4ef7cb740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5568e156e560 con 0x5568e15610f0 2024-08-19T00:21:41.835 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.828+0000 7fc4ef7cb740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5568e1480520 con 0x5568e156b990 2024-08-19T00:21:41.836 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.828+0000 7fc4ef7cb740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5568e156e6e0 con 0x5568e15607d0 2024-08-19T00:21:41.836 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.828+0000 7fc4ef7cb740 10 client.0 _ll_register_callbacks cb 0x5568e11d7a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:21:41.836 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.828+0000 7fc4e5d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568e15610f0 0x5568e1568df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:41.836 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.828+0000 7fc4e5d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568e15610f0 0x5568e1568df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40238/0 (socket says 172.21.15.44:40238) 2024-08-19T00:21:41.836 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.828+0000 7fc4e5d9b640 1 -- 172.21.15.44:0/2242853860 learned_addr learned my addr 172.21.15.44:0/2242853860 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:21:41.836 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.828+0000 7fc4e6d9d640 1 --2- 172.21.15.44:0/2242853860 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5568e156b990 0x5568e1569330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:41.836 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.828+0000 7fc4e659c640 1 --2- 172.21.15.44:0/2242853860 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5568e15607d0 0x5568e15688b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:41.836 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.828+0000 7fc4e5d9b640 1 -- 172.21.15.44:0/2242853860 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5568e15607d0 msgr2=0x5568e15688b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:41.836 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.828+0000 7fc4e5d9b640 1 --2- 172.21.15.44:0/2242853860 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5568e15607d0 0x5568e15688b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:41.836 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.828+0000 7fc4e5d9b640 1 -- 172.21.15.44:0/2242853860 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5568e156b990 msgr2=0x5568e1569330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:41.836 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.828+0000 7fc4e5d9b640 1 --2- 172.21.15.44:0/2242853860 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5568e156b990 0x5568e1569330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:41.836 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.828+0000 7fc4e5d9b640 1 -- 172.21.15.44:0/2242853860 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568e12a4620 con 0x5568e15610f0 2024-08-19T00:21:41.836 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.828+0000 7fc4e6d9d640 1 --2- 172.21.15.44:0/2242853860 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5568e156b990 0x5568e1569330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:21:41.837 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.828+0000 7fc4e659c640 1 --2- 172.21.15.44:0/2242853860 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5568e15607d0 0x5568e15688b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:21:41.837 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.829+0000 7fc4e5d9b640 1 --2- 172.21.15.44:0/2242853860 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568e15610f0 0x5568e1568df0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc0a4220 tx=0x7fc4dc0a40e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9648197e560f8e2 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:21:41.837 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.829+0000 7fc4cdffb640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:21:41.837 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.829+0000 7fc4cdffb640 1 -- 172.21.15.44:0/2242853860 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4dc020040 con 0x5568e15610f0 2024-08-19T00:21:41.837 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.829+0000 7fc4cdffb640 1 -- 172.21.15.44:0/2242853860 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9533+0+0 (secure 0 0 0) 0x7fc4dc097a60 con 0x5568e15610f0 2024-08-19T00:21:41.837 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.829+0000 7fc4ef7cb740 1 -- 172.21.15.44:0/2242853860 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4dc09baf0 con 0x5568e15610f0 2024-08-19T00:21:41.837 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.829+0000 7fc4cdffb640 1 -- 172.21.15.44:0/2242853860 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fc4dc09f7a0 con 0x5568e15610f0 2024-08-19T00:21:41.837 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.829+0000 7fc4ef7cb740 10 client.16581 fetch_fsmap learned FSMap version 33 2024-08-19T00:21:41.837 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.829+0000 7fc4ef7cb740 1 -- 172.21.15.44:0/2242853860 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5568e157a1e0 con 0x5568e15610f0 2024-08-19T00:21:41.837 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.829+0000 7fc4cdffb640 1 -- 172.21.15.44:0/2242853860 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4dc09baf0 con 0x5568e15610f0 2024-08-19T00:21:41.837 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.829+0000 7fc4cdffb640 1 -- 172.21.15.44:0/2242853860 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7fc4dc09a840 con 0x5568e15610f0 2024-08-19T00:21:41.837 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.829+0000 7fc4ef7cb740 10 client.16581 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:21:41.837 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.829+0000 7fc4ef7cb740 10 client.16581 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:21:41.837 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.829+0000 7fc4ef7cb740 20 client.16581 populate_metadata read hostname 'smithi044' 2024-08-19T00:21:41.838 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.829+0000 7fc4ef7cb740 1 --2- 172.21.15.44:0/2242853860 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5568e157b530 0x5568e157d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:41.838 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.829+0000 7fc4ef7cb740 4 client.16581 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:21:41.838 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.829+0000 7fc4ef7cb740 1 -- 172.21.15.44:0/2242853860 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5568e14d2100 con 0x5568e157b530 2024-08-19T00:21:41.838 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.830+0000 7fc4e659c640 1 --2- 172.21.15.44:0/2242853860 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5568e157b530 0x5568e157d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:41.838 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.830+0000 7fc4cdffb640 10 client.16581 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:21:41.838 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.830+0000 7fc4e659c640 1 --2- 172.21.15.44:0/2242853860 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5568e157b530 0x5568e157d920 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e38b2911fc62e57 server_cookie=89a31846be93709a in_seq=0 out_seq=0 2024-08-19T00:21:41.838 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.831+0000 7fc4cdffb640 1 -- 172.21.15.44:0/2242853860 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5568e14d2100 con 0x5568e157b530 2024-08-19T00:21:41.838 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.831+0000 7fc4cdffb640 10 client.16581 handle_command_reply: tid=0 2024-08-19T00:21:41.838 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.831+0000 7fc4ef7cb740 1 client.16581 shutdown 2024-08-19T00:21:41.838 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.831+0000 7fc4ef7cb740 1 -- 172.21.15.44:0/2242853860 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568e15610f0 msgr2=0x5568e1568df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:41.838 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.831+0000 7fc4ef7cb740 1 --2- 172.21.15.44:0/2242853860 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568e15610f0 0x5568e1568df0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc0a4220 tx=0x7fc4dc0a40e0 comp rx=0 tx=0).stop 2024-08-19T00:21:41.838 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.831+0000 7fc4ef7cb740 1 -- 172.21.15.44:0/2242853860 shutdown_connections 2024-08-19T00:21:41.839 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.831+0000 7fc4ef7cb740 1 --2- 172.21.15.44:0/2242853860 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5568e157b530 0x5568e157d920 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:41.839 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.831+0000 7fc4ef7cb740 1 --2- 172.21.15.44:0/2242853860 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5568e156b990 0x5568e1569330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:41.839 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.831+0000 7fc4cdffb640 0 client.16581 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:21:41.839 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.831+0000 7fc4ef7cb740 1 --2- 172.21.15.44:0/2242853860 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568e15610f0 0x5568e1568df0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:41.839 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.831+0000 7fc4ef7cb740 1 --2- 172.21.15.44:0/2242853860 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5568e15607d0 0x5568e15688b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:41.839 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.831+0000 7fc4ef7cb740 1 -- 172.21.15.44:0/2242853860 >> 172.21.15.44:0/2242853860 conn(0x5568e155cd40 msgr2=0x5568e1562a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:21:41.839 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.831+0000 7fc4ef7cb740 1 -- 172.21.15.44:0/2242853860 shutdown_connections 2024-08-19T00:21:41.839 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.831+0000 7fc4ef7cb740 1 -- 172.21.15.44:0/2242853860 wait complete. 2024-08-19T00:21:41.839 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.831+0000 7fc4ef7cb740 20 client.16581 trim_cache size 0 max 16384 2024-08-19T00:21:41.851 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.845+0000 7fc4ef7cb740 1 Processor -- start 2024-08-19T00:21:41.851 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.845+0000 7fc4ef7cb740 1 -- start start 2024-08-19T00:21:41.851 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.846+0000 7fc4ef7cb740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5568e15607d0 0x5568e156a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:41.851 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.846+0000 7fc4ef7cb740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568e15610f0 0x5568e1580940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:41.852 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.846+0000 7fc4ef7cb740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5568e156b990 0x5568e1580e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:41.852 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.846+0000 7fc4ef7cb740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e81b0f00 con 0x5568e15610f0 2024-08-19T00:21:41.852 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.846+0000 7fc4ef7cb740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e81b2a40 con 0x5568e15607d0 2024-08-19T00:21:41.852 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.846+0000 7fc4ef7cb740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e81b15d0 con 0x5568e156b990 2024-08-19T00:21:41.852 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.846+0000 7fc4e5d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568e15610f0 0x5568e1580940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:41.852 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.846+0000 7fc4e5d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568e15610f0 0x5568e1580940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40246/0 (socket says 172.21.15.44:40246) 2024-08-19T00:21:41.852 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.846+0000 7fc4e5d9b640 1 -- 172.21.15.44:0/2550338942 learned_addr learned my addr 172.21.15.44:0/2550338942 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:21:41.852 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.846+0000 7fc4e5d9b640 1 -- 172.21.15.44:0/2550338942 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5568e156b990 msgr2=0x5568e1580e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:41.852 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.846+0000 7fc4e5d9b640 1 --2- 172.21.15.44:0/2550338942 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5568e156b990 0x5568e1580e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:41.852 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.846+0000 7fc4e5d9b640 1 -- 172.21.15.44:0/2550338942 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5568e15607d0 msgr2=0x5568e156a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:41.853 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.846+0000 7fc4e5d9b640 1 --2- 172.21.15.44:0/2550338942 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5568e15607d0 0x5568e156a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:41.853 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.846+0000 7fc4e5d9b640 1 -- 172.21.15.44:0/2550338942 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568e1560f20 con 0x5568e15610f0 2024-08-19T00:21:41.853 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.846+0000 7fc4e5d9b640 1 --2- 172.21.15.44:0/2550338942 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568e15610f0 0x5568e1580940 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc097850 tx=0x7fc4dc099900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5d1b6e1bf36f8f6 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:21:41.853 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.846+0000 7fc4cffff640 1 -- 172.21.15.44:0/2550338942 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4dc020070 con 0x5568e15610f0 2024-08-19T00:21:41.853 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.846+0000 7fc4cffff640 1 -- 172.21.15.44:0/2550338942 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4dc09baf0 con 0x5568e15610f0 2024-08-19T00:21:41.853 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.846+0000 7fc4cffff640 1 -- 172.21.15.44:0/2550338942 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4dc0cc8a0 con 0x5568e15610f0 2024-08-19T00:21:41.853 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.847+0000 7fc4ef7cb740 1 -- 172.21.15.44:0/2550338942 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568e15610f0 msgr2=0x5568e1580940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:41.853 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.847+0000 7fc4ef7cb740 1 --2- 172.21.15.44:0/2550338942 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568e15610f0 0x5568e1580940 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc097850 tx=0x7fc4dc099900 comp rx=0 tx=0).stop 2024-08-19T00:21:41.853 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.847+0000 7fc4ef7cb740 1 -- 172.21.15.44:0/2550338942 shutdown_connections 2024-08-19T00:21:41.853 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.847+0000 7fc4ef7cb740 1 --2- 172.21.15.44:0/2550338942 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5568e156b990 0x5568e1580e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:41.853 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.847+0000 7fc4ef7cb740 1 --2- 172.21.15.44:0/2550338942 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568e15610f0 0x5568e1580940 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:41.853 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.847+0000 7fc4ef7cb740 1 --2- 172.21.15.44:0/2550338942 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5568e15607d0 0x5568e156a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:41.853 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.847+0000 7fc4ef7cb740 1 -- 172.21.15.44:0/2550338942 >> 172.21.15.44:0/2550338942 conn(0x5568e155cd40 msgr2=0x5568e156a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:21:41.854 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.847+0000 7fc4ef7cb740 1 -- 172.21.15.44:0/2550338942 shutdown_connections 2024-08-19T00:21:41.854 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.847+0000 7fc4ef7cb740 1 -- 172.21.15.44:0/2550338942 wait complete. 2024-08-19T00:21:41.854 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.847+0000 7fc4ef7cb740 1 -- start start 2024-08-19T00:21:41.854 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.847+0000 7fc4ef7cb740 1 Processor -- start 2024-08-19T00:21:41.854 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.848+0000 7fc4ef7cb740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5568e15607d0 0x5568e157e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:41.854 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.848+0000 7fc4ef7cb740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5568e15610f0 0x5568e157ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:41.854 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.848+0000 7fc4ef7cb740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568e156b990 0x5568e157f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:41.854 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.848+0000 7fc4ef7cb740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e81b2370 con 0x5568e156b990 2024-08-19T00:21:41.854 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.848+0000 7fc4ef7cb740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e81b1ca0 con 0x5568e15607d0 2024-08-19T00:21:41.854 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.848+0000 7fc4ef7cb740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e81aef00 con 0x5568e15610f0 2024-08-19T00:21:41.854 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.848+0000 7fc4ef7cb740 10 client.0 _ll_register_callbacks cb 0x7fc4dc0cf070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:21:41.854 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.848+0000 7fc4e6d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568e156b990 0x5568e157f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:41.854 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.848+0000 7fc4e6d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568e156b990 0x5568e157f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40248/0 (socket says 172.21.15.44:40248) 2024-08-19T00:21:41.855 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.848+0000 7fc4e6d9d640 1 -- 172.21.15.44:0/4196245046 learned_addr learned my addr 172.21.15.44:0/4196245046 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:21:41.855 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.848+0000 7fc4e659c640 1 --2- 172.21.15.44:0/4196245046 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5568e15607d0 0x5568e157e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:41.855 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.848+0000 7fc4e5d9b640 1 --2- 172.21.15.44:0/4196245046 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5568e15610f0 0x5568e157ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:41.855 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.848+0000 7fc4e6d9d640 1 -- 172.21.15.44:0/4196245046 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5568e15610f0 msgr2=0x5568e157ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:41.855 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.848+0000 7fc4e6d9d640 1 --2- 172.21.15.44:0/4196245046 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5568e15610f0 0x5568e157ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:41.855 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.848+0000 7fc4e6d9d640 1 -- 172.21.15.44:0/4196245046 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5568e15607d0 msgr2=0x5568e157e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:41.855 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.848+0000 7fc4e6d9d640 1 --2- 172.21.15.44:0/4196245046 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5568e15607d0 0x5568e157e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:41.855 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.848+0000 7fc4e6d9d640 1 -- 172.21.15.44:0/4196245046 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568e15e4fd0 con 0x5568e156b990 2024-08-19T00:21:41.855 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.848+0000 7fc4e5d9b640 1 --2- 172.21.15.44:0/4196245046 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5568e15610f0 0x5568e157ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:21:41.855 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.848+0000 7fc4e6d9d640 1 --2- 172.21.15.44:0/4196245046 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568e156b990 0x5568e157f270 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fc4e0014300 tx=0x7fc4e0009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3fea7f53792a7d2 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:21:41.855 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.848+0000 7fc4cdffb640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:21:41.856 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.848+0000 7fc4cdffb640 1 -- 172.21.15.44:0/4196245046 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e0026070 con 0x5568e156b990 2024-08-19T00:21:41.856 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.848+0000 7fc4cdffb640 1 -- 172.21.15.44:0/4196245046 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9533+0+0 (secure 0 0 0) 0x7fc4e0004b20 con 0x5568e156b990 2024-08-19T00:21:41.856 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.848+0000 7fc4ef7cb740 1 -- 172.21.15.44:0/4196245046 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4dc09baf0 con 0x5568e156b990 2024-08-19T00:21:41.856 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.849+0000 7fc4cdffb640 1 -- 172.21.15.44:0/4196245046 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fc4e0031050 con 0x5568e156b990 2024-08-19T00:21:41.856 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.849+0000 7fc4ef7cb740 10 client.16587 fetch_fsmap learned FSMap version 33 2024-08-19T00:21:41.856 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.849+0000 7fc4ef7cb740 1 -- 172.21.15.44:0/4196245046 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5568e15e62e0 con 0x5568e156b990 2024-08-19T00:21:41.856 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.849+0000 7fc4cdffb640 1 -- 172.21.15.44:0/4196245046 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4dc09baf0 con 0x5568e156b990 2024-08-19T00:21:41.856 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.849+0000 7fc4cdffb640 1 -- 172.21.15.44:0/4196245046 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7fc4e0020040 con 0x5568e156b990 2024-08-19T00:21:41.856 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.849+0000 7fc4ef7cb740 10 client.16587 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:21:41.856 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.849+0000 7fc4ef7cb740 10 client.16587 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:21:41.856 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.849+0000 7fc4ef7cb740 20 client.16587 populate_metadata read hostname 'smithi044' 2024-08-19T00:21:41.856 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.849+0000 7fc4ef7cb740 1 --2- 172.21.15.44:0/4196245046 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5568e15e6a60 0x5568e15e8e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:41.857 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.849+0000 7fc4ef7cb740 4 client.16587 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-19T00:21:41.857 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.849+0000 7fc4ef7cb740 1 -- 172.21.15.44:0/4196245046 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5568e14cc450 con 0x5568e15e6a60 2024-08-19T00:21:41.857 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.849+0000 7fc4e659c640 1 --2- 172.21.15.44:0/4196245046 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5568e15e6a60 0x5568e15e8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:41.857 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.850+0000 7fc4e659c640 1 --2- 172.21.15.44:0/4196245046 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5568e15e6a60 0x5568e15e8e80 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0fcfdcc9f04cbf1 server_cookie=47721fb40d389c9 in_seq=0 out_seq=0 2024-08-19T00:21:41.857 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.850+0000 7fc4cdffb640 10 client.16587 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:21:41.862 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.860+0000 7fc4cdffb640 1 -- 172.21.15.44:0/4196245046 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5568e14cc450 con 0x5568e15e6a60 2024-08-19T00:21:41.862 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.860+0000 7fc4cdffb640 10 client.16587 handle_command_reply: tid=0 2024-08-19T00:21:41.862 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.860+0000 7fc4ef7cb740 1 client.16587 shutdown 2024-08-19T00:21:41.862 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.860+0000 7fc4ef7cb740 1 -- 172.21.15.44:0/4196245046 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568e156b990 msgr2=0x5568e157f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:41.862 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.860+0000 7fc4ef7cb740 1 --2- 172.21.15.44:0/4196245046 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568e156b990 0x5568e157f270 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fc4e0014300 tx=0x7fc4e0009cd0 comp rx=0 tx=0).stop 2024-08-19T00:21:41.863 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.860+0000 7fc4ef7cb740 1 -- 172.21.15.44:0/4196245046 shutdown_connections 2024-08-19T00:21:41.863 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.860+0000 7fc4ef7cb740 1 --2- 172.21.15.44:0/4196245046 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5568e15e6a60 0x5568e15e8e80 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:41.863 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.860+0000 7fc4ef7cb740 1 --2- 172.21.15.44:0/4196245046 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5568e15610f0 0x5568e157ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:41.863 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.860+0000 7fc4cdffb640 0 client.16587 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:21:41.863 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.860+0000 7fc4ef7cb740 1 --2- 172.21.15.44:0/4196245046 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568e156b990 0x5568e157f270 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:41.863 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.860+0000 7fc4ef7cb740 1 --2- 172.21.15.44:0/4196245046 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5568e15607d0 0x5568e157e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:41.863 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.860+0000 7fc4ef7cb740 1 -- 172.21.15.44:0/4196245046 >> 172.21.15.44:0/4196245046 conn(0x5568e155cd40 msgr2=0x5568e1566d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:21:41.863 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.860+0000 7fc4ef7cb740 1 -- 172.21.15.44:0/4196245046 shutdown_connections 2024-08-19T00:21:41.863 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.860+0000 7fc4ef7cb740 1 -- 172.21.15.44:0/4196245046 wait complete. 2024-08-19T00:21:41.863 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.860+0000 7fc4ef7cb740 20 client.16587 trim_cache size 0 max 16384 2024-08-19T00:21:41.864 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:{ 2024-08-19T00:21:41.864 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "message": "", 2024-08-19T00:21:41.864 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "return_code": 0 2024-08-19T00:21:41.864 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:} 2024-08-19T00:21:41.865 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.861+0000 7fc4eca0a640 1 -- 172.21.15.44:0/1853905173 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fc4d00a2da0 msgr2=0x7fc4d00a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:41.865 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.861+0000 7fc4eca0a640 1 --2- 172.21.15.44:0/1853905173 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fc4d00a2da0 0x7fc4d00a5260 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc4e0005fd0 tx=0x7fc4e0004ab0 comp rx=0 tx=0).stop 2024-08-19T00:21:41.865 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.861+0000 7fc4eca0a640 1 -- 172.21.15.44:0/1853905173 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4e8103350 msgr2=0x7fc4e8100bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:41.865 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.861+0000 7fc4eca0a640 1 --2- 172.21.15.44:0/1853905173 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4e8103350 0x7fc4e8100bc0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc00d770 tx=0x7fc4dc00dc30 comp rx=0 tx=0).stop 2024-08-19T00:21:41.865 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.861+0000 7fc4eca0a640 1 -- 172.21.15.44:0/1853905173 shutdown_connections 2024-08-19T00:21:41.865 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.861+0000 7fc4eca0a640 1 --2- 172.21.15.44:0/1853905173 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fc4d00a2da0 0x7fc4d00a5260 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:41.865 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.861+0000 7fc4eca0a640 1 --2- 172.21.15.44:0/1853905173 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc4e810be00 0x7fc4e8101100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:41.865 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.861+0000 7fc4eca0a640 1 --2- 172.21.15.44:0/1853905173 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4e8103350 0x7fc4e8100bc0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:41.865 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.861+0000 7fc4eca0a640 1 --2- 172.21.15.44:0/1853905173 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc4e8102a30 0x7fc4e8100680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:41.865 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.861+0000 7fc4eca0a640 1 -- 172.21.15.44:0/1853905173 >> 172.21.15.44:0/1853905173 conn(0x7fc4e80fc420 msgr2=0x7fc4e80fd060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:21:41.865 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.861+0000 7fc4eca0a640 1 -- 172.21.15.44:0/1853905173 shutdown_connections 2024-08-19T00:21:41.866 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:41.861+0000 7fc4eca0a640 1 -- 172.21.15.44:0/1853905173 wait complete. 2024-08-19T00:21:42.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:21:42 smithi171 ceph-mon[21810]: pgmap v258: 129 pgs: 129 active+clean; 443 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.0 MiB/s wr, 142 op/s 2024-08-19T00:21:42.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:21:42 smithi116 ceph-mon[21873]: pgmap v258: 129 pgs: 129 active+clean; 443 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.0 MiB/s wr, 142 op/s 2024-08-19T00:21:42.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:21:42 smithi044 ceph-mon[18489]: pgmap v258: 129 pgs: 129 active+clean; 443 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.0 MiB/s wr, 142 op/s 2024-08-19T00:21:42.687 INFO:tasks.workunit.client.0.smithi044.stdout: 1 611559 7.88 MB/sec execute 307 sec latency 5124.533 ms 2024-08-19T00:21:43.688 INFO:tasks.workunit.client.0.smithi044.stdout: 1 611559 7.85 MB/sec execute 308 sec latency 6124.617 ms 2024-08-19T00:21:44.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:21:44 smithi171 ceph-mon[21810]: pgmap v259: 129 pgs: 129 active+clean; 443 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.2 MiB/s wr, 109 op/s 2024-08-19T00:21:44.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:21:44 smithi116 ceph-mon[21873]: pgmap v259: 129 pgs: 129 active+clean; 443 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.2 MiB/s wr, 109 op/s 2024-08-19T00:21:44.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:21:44 smithi044 ceph-mon[18489]: pgmap v259: 129 pgs: 129 active+clean; 443 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.2 MiB/s wr, 109 op/s 2024-08-19T00:21:44.687 INFO:tasks.workunit.client.0.smithi044.stdout: 1 611559 7.83 MB/sec execute 309 sec latency 7124.710 ms 2024-08-19T00:21:45.688 INFO:tasks.workunit.client.0.smithi044.stdout: 1 611559 7.80 MB/sec execute 310 sec latency 8124.752 ms 2024-08-19T00:21:46.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:21:46 smithi171 ceph-mon[21810]: pgmap v260: 129 pgs: 129 active+clean; 442 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.9 MiB/s wr, 142 op/s 2024-08-19T00:21:46.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:21:46 smithi116 ceph-mon[21873]: pgmap v260: 129 pgs: 129 active+clean; 442 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.9 MiB/s wr, 142 op/s 2024-08-19T00:21:46.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:21:46 smithi044 ceph-mon[18489]: pgmap v260: 129 pgs: 129 active+clean; 442 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.9 MiB/s wr, 142 op/s 2024-08-19T00:21:46.688 INFO:tasks.workunit.client.0.smithi044.stdout: 1 611559 7.78 MB/sec execute 311 sec latency 9125.076 ms 2024-08-19T00:21:47.688 INFO:tasks.workunit.client.0.smithi044.stdout: 1 611559 7.75 MB/sec execute 312 sec latency 10125.153 ms 2024-08-19T00:21:48.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:21:48 smithi171 ceph-mon[21810]: pgmap v261: 129 pgs: 129 active+clean; 442 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.1 MiB/s wr, 105 op/s 2024-08-19T00:21:48.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:21:48 smithi116 ceph-mon[21873]: pgmap v261: 129 pgs: 129 active+clean; 442 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.1 MiB/s wr, 105 op/s 2024-08-19T00:21:48.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:21:48 smithi044 ceph-mon[18489]: pgmap v261: 129 pgs: 129 active+clean; 442 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.1 MiB/s wr, 105 op/s 2024-08-19T00:21:48.688 INFO:tasks.workunit.client.0.smithi044.stdout: 1 611559 7.73 MB/sec execute 313 sec latency 11125.248 ms 2024-08-19T00:21:49.688 INFO:tasks.workunit.client.0.smithi044.stdout: 1 611559 7.70 MB/sec execute 314 sec latency 12125.364 ms 2024-08-19T00:21:50.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:21:50 smithi171 ceph-mon[21810]: pgmap v262: 129 pgs: 129 active+clean; 442 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.1 MiB/s wr, 105 op/s 2024-08-19T00:21:50.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:21:50 smithi116 ceph-mon[21873]: pgmap v262: 129 pgs: 129 active+clean; 442 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.1 MiB/s wr, 105 op/s 2024-08-19T00:21:50.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:21:50 smithi044 ceph-mon[18489]: pgmap v262: 129 pgs: 129 active+clean; 442 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.1 MiB/s wr, 105 op/s 2024-08-19T00:21:50.688 INFO:tasks.workunit.client.0.smithi044.stdout: 1 611559 7.68 MB/sec execute 315 sec latency 13125.475 ms 2024-08-19T00:21:51.688 INFO:tasks.workunit.client.0.smithi044.stdout: 1 611559 7.65 MB/sec execute 316 sec latency 14125.562 ms 2024-08-19T00:21:52.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:21:52 smithi171 ceph-mon[21810]: pgmap v263: 129 pgs: 129 active+clean; 442 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.2 MiB/s wr, 112 op/s 2024-08-19T00:21:52.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:21:52 smithi116 ceph-mon[21873]: pgmap v263: 129 pgs: 129 active+clean; 442 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.2 MiB/s wr, 112 op/s 2024-08-19T00:21:52.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:21:52 smithi044 ceph-mon[18489]: pgmap v263: 129 pgs: 129 active+clean; 442 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.2 MiB/s wr, 112 op/s 2024-08-19T00:21:52.688 INFO:tasks.workunit.client.0.smithi044.stdout: 1 611559 7.63 MB/sec execute 317 sec latency 15125.678 ms 2024-08-19T00:21:53.689 INFO:tasks.workunit.client.0.smithi044.stdout: 1 611559 7.60 MB/sec execute 318 sec latency 16125.798 ms 2024-08-19T00:21:54.594 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:21:54 smithi171 ceph-mon[21810]: pgmap v264: 129 pgs: 129 active+clean; 442 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 798 KiB/s wr, 40 op/s 2024-08-19T00:21:54.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:21:54 smithi116 ceph-mon[21873]: pgmap v264: 129 pgs: 129 active+clean; 442 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 798 KiB/s wr, 40 op/s 2024-08-19T00:21:54.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:21:54 smithi044 ceph-mon[18489]: pgmap v264: 129 pgs: 129 active+clean; 442 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 798 KiB/s wr, 40 op/s 2024-08-19T00:21:54.689 INFO:tasks.workunit.client.0.smithi044.stdout: 1 611559 7.58 MB/sec execute 319 sec latency 17125.912 ms 2024-08-19T00:21:54.965 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.961+0000 7f49d9e84640 1 -- 172.21.15.44:0/4033989707 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49d4100700 msgr2=0x7f49d4100b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:54.965 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.961+0000 7f49d9e84640 1 --2- 172.21.15.44:0/4033989707 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49d4100700 0x7f49d4100b60 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f49bc009930 tx=0x7f49bc02a420 comp rx=0 tx=0).stop 2024-08-19T00:21:54.965 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.961+0000 7f49d9e84640 1 -- 172.21.15.44:0/4033989707 shutdown_connections 2024-08-19T00:21:54.965 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.961+0000 7f49d9e84640 1 --2- 172.21.15.44:0/4033989707 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f49d41010a0 0x7f49d410d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:54.965 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.961+0000 7f49d9e84640 1 --2- 172.21.15.44:0/4033989707 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49d4100700 0x7f49d4100b60 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:54.965 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.961+0000 7f49d9e84640 1 --2- 172.21.15.44:0/4033989707 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f49d4106710 0x7f49d4106af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:54.965 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.961+0000 7f49d9e84640 1 -- 172.21.15.44:0/4033989707 >> 172.21.15.44:0/4033989707 conn(0x7f49d40fc420 msgr2=0x7f49d40fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:21:54.966 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.961+0000 7f49d9e84640 1 -- 172.21.15.44:0/4033989707 shutdown_connections 2024-08-19T00:21:54.966 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.961+0000 7f49d9e84640 1 -- 172.21.15.44:0/4033989707 wait complete. 2024-08-19T00:21:54.966 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.961+0000 7f49d9e84640 1 Processor -- start 2024-08-19T00:21:54.966 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.962+0000 7f49d9e84640 1 -- start start 2024-08-19T00:21:54.966 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.962+0000 7f49d9e84640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f49d4100700 0x7f49d41980a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:54.966 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.962+0000 7f49d9e84640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f49d41010a0 0x7f49d41985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:54.966 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.962+0000 7f49d9e84640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49d4106710 0x7f49d419c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:54.966 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.962+0000 7f49d9e84640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f49d4110ba0 con 0x7f49d4106710 2024-08-19T00:21:54.966 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.962+0000 7f49d9e84640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f49d4110a20 con 0x7f49d4100700 2024-08-19T00:21:54.966 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.962+0000 7f49d9e84640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f49d4110d20 con 0x7f49d41010a0 2024-08-19T00:21:54.966 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.962+0000 7f49d3fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49d4106710 0x7f49d419c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:54.967 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.962+0000 7f49d3fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49d4106710 0x7f49d419c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56104/0 (socket says 172.21.15.44:56104) 2024-08-19T00:21:54.967 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.962+0000 7f49d37fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f49d4100700 0x7f49d41980a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:54.967 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.962+0000 7f49d3fff640 1 -- 172.21.15.44:0/4294850112 learned_addr learned my addr 172.21.15.44:0/4294850112 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:21:54.967 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.962+0000 7f49cbfff640 1 --2- 172.21.15.44:0/4294850112 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f49d41010a0 0x7f49d41985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:54.967 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.962+0000 7f49d3fff640 1 -- 172.21.15.44:0/4294850112 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f49d41010a0 msgr2=0x7f49d41985e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:54.967 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.962+0000 7f49d3fff640 1 --2- 172.21.15.44:0/4294850112 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f49d41010a0 0x7f49d41985e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:54.967 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.962+0000 7f49d3fff640 1 -- 172.21.15.44:0/4294850112 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f49d4100700 msgr2=0x7f49d41980a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:54.967 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.962+0000 7f49d3fff640 1 --2- 172.21.15.44:0/4294850112 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f49d4100700 0x7f49d41980a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:54.967 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.962+0000 7f49d3fff640 1 -- 172.21.15.44:0/4294850112 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49d419d090 con 0x7f49d4106710 2024-08-19T00:21:54.967 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.962+0000 7f49d3fff640 1 --2- 172.21.15.44:0/4294850112 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49d4106710 0x7f49d419c960 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f49cc00d750 tx=0x7f49cc00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:21:54.967 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.963+0000 7f49d17fa640 1 -- 172.21.15.44:0/4294850112 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49cc017070 con 0x7f49d4106710 2024-08-19T00:21:54.967 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.963+0000 7f49d17fa640 1 -- 172.21.15.44:0/4294850112 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f49cc005500 con 0x7f49d4106710 2024-08-19T00:21:54.968 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.963+0000 7f49d9e84640 1 -- 172.21.15.44:0/4294850112 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49d419d380 con 0x7f49d4106710 2024-08-19T00:21:54.968 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.963+0000 7f49d17fa640 1 -- 172.21.15.44:0/4294850112 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49cc004d90 con 0x7f49d4106710 2024-08-19T00:21:54.968 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.963+0000 7f49d9e84640 1 -- 172.21.15.44:0/4294850112 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49d41a4c10 con 0x7f49d4106710 2024-08-19T00:21:54.975 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.966+0000 7f49dcc46740 1 Processor -- start 2024-08-19T00:21:54.975 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.966+0000 7f49d17fa640 1 -- 172.21.15.44:0/4294850112 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f49cc004f30 con 0x7f49d4106710 2024-08-19T00:21:54.975 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.966+0000 7f49dcc46740 1 -- start start 2024-08-19T00:21:54.975 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.966+0000 7f49dcc46740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ca1a3b7d0 0x564ca1a3bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:54.975 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.966+0000 7f49dcc46740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ca1a3c0f0 0x564ca1a46450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:54.975 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.966+0000 7f49dcc46740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ca1a46990 0x564ca1a48d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:54.976 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.966+0000 7f49dcc46740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564ca199f9d0 con 0x564ca1a3c0f0 2024-08-19T00:21:54.976 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.966+0000 7f49dcc46740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x564ca1947820 con 0x564ca1a46990 2024-08-19T00:21:54.976 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.966+0000 7f49dcc46740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x564ca199b990 con 0x564ca1a3b7d0 2024-08-19T00:21:54.976 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.966+0000 7f49d37fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ca1a3c0f0 0x564ca1a46450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:54.976 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.966+0000 7f49d37fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ca1a3c0f0 0x564ca1a46450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56118/0 (socket says 172.21.15.44:56118) 2024-08-19T00:21:54.976 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.966+0000 7f49d37fe640 1 -- 172.21.15.44:0/1709837800 learned_addr learned my addr 172.21.15.44:0/1709837800 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:21:54.976 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.966+0000 7f49cbfff640 1 --2- 172.21.15.44:0/1709837800 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ca1a46990 0x564ca1a48d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:54.976 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.967+0000 7f49cbfff640 1 --2- 172.21.15.44:0/1709837800 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ca1a3b7d0 0x564ca1a3bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:54.976 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.967+0000 7f49d37fe640 1 -- 172.21.15.44:0/1709837800 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ca1a3b7d0 msgr2=0x564ca1a3bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:54.976 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.967+0000 7f49d37fe640 1 --2- 172.21.15.44:0/1709837800 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ca1a3b7d0 0x564ca1a3bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:54.976 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.967+0000 7f49d37fe640 1 -- 172.21.15.44:0/1709837800 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ca1a46990 msgr2=0x564ca1a48d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:54.977 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.967+0000 7f49d37fe640 1 --2- 172.21.15.44:0/1709837800 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ca1a46990 0x564ca1a48d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:54.977 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.967+0000 7f49d37fe640 1 -- 172.21.15.44:0/1709837800 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ca16b3210 con 0x564ca1a3c0f0 2024-08-19T00:21:54.977 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.967+0000 7f49cbfff640 1 --2- 172.21.15.44:0/1709837800 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ca1a3b7d0 0x564ca1a3bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:21:54.977 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.967+0000 7f49d17fa640 1 --2- 172.21.15.44:0/4294850112 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f49c00a2da0 0x7f49c00a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:54.977 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.967+0000 7f49d37fe640 1 --2- 172.21.15.44:0/1709837800 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ca1a3c0f0 0x564ca1a46450 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f49c4009fd0 tx=0x7f49c40118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=562d73a12b50702e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:21:54.977 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.967+0000 7f49cbfff640 1 --2- 172.21.15.44:0/4294850112 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f49c00a2da0 0x7f49c00a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:54.977 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.967+0000 7f49d17fa640 1 -- 172.21.15.44:0/4294850112 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9533+0+0 (secure 0 0 0) 0x7f49cc0cf260 con 0x7f49d4106710 2024-08-19T00:21:54.977 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.967+0000 7f49c9ffb640 1 -- 172.21.15.44:0/1709837800 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c401e070 con 0x564ca1a3c0f0 2024-08-19T00:21:54.977 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.967+0000 7f49c9ffb640 1 -- 172.21.15.44:0/1709837800 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f49c4003c30 con 0x564ca1a3c0f0 2024-08-19T00:21:54.977 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.967+0000 7f49c9ffb640 1 -- 172.21.15.44:0/1709837800 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c400f9f0 con 0x564ca1a3c0f0 2024-08-19T00:21:54.977 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.968+0000 7f49dcc46740 1 -- 172.21.15.44:0/1709837800 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ca1a3c0f0 msgr2=0x564ca1a46450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:54.977 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.968+0000 7f49cbfff640 1 --2- 172.21.15.44:0/4294850112 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f49c00a2da0 0x7f49c00a5260 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f49bc006010 tx=0x7f49bc02a420 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:21:54.977 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.968+0000 7f49dcc46740 1 --2- 172.21.15.44:0/1709837800 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ca1a3c0f0 0x564ca1a46450 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f49c4009fd0 tx=0x7f49c40118d0 comp rx=0 tx=0).stop 2024-08-19T00:21:54.977 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.968+0000 7f49dcc46740 1 -- 172.21.15.44:0/1709837800 shutdown_connections 2024-08-19T00:21:54.978 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.968+0000 7f49dcc46740 1 --2- 172.21.15.44:0/1709837800 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ca1a46990 0x564ca1a48d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:54.978 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.968+0000 7f49dcc46740 1 --2- 172.21.15.44:0/1709837800 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ca1a3c0f0 0x564ca1a46450 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:54.978 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.968+0000 7f49dcc46740 1 --2- 172.21.15.44:0/1709837800 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ca1a3b7d0 0x564ca1a3bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:54.978 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.968+0000 7f49dcc46740 1 -- 172.21.15.44:0/1709837800 >> 172.21.15.44:0/1709837800 conn(0x564ca1a37d40 msgr2=0x564ca1a38120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:21:54.978 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.968+0000 7f49dcc46740 1 -- 172.21.15.44:0/1709837800 shutdown_connections 2024-08-19T00:21:54.978 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.968+0000 7f49dcc46740 1 -- 172.21.15.44:0/1709837800 wait complete. 2024-08-19T00:21:54.978 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.968+0000 7f49dcc46740 1 -- start start 2024-08-19T00:21:54.978 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.969+0000 7f49dcc46740 1 Processor -- start 2024-08-19T00:21:54.978 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.969+0000 7f49dcc46740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ca1a3b7d0 0x564ca1a43910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:54.978 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.969+0000 7f49dcc46740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ca1a3c0f0 0x564ca1a43e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:54.978 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.969+0000 7f49dcc46740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ca1a46990 0x564ca1a44390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:54.978 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.969+0000 7f49dcc46740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564ca1a49560 con 0x564ca1a3c0f0 2024-08-19T00:21:54.978 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.969+0000 7f49dcc46740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x564ca195b520 con 0x564ca1a46990 2024-08-19T00:21:54.979 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.969+0000 7f49dcc46740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x564ca1a496e0 con 0x564ca1a3b7d0 2024-08-19T00:21:54.979 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.969+0000 7f49dcc46740 10 client.0 _ll_register_callbacks cb 0x564ca16b2a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:21:54.979 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.969+0000 7f49cbfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ca1a3c0f0 0x564ca1a43e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:54.979 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.969+0000 7f49cbfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ca1a3c0f0 0x564ca1a43e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56130/0 (socket says 172.21.15.44:56130) 2024-08-19T00:21:54.979 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.969+0000 7f49cbfff640 1 -- 172.21.15.44:0/1032960099 learned_addr learned my addr 172.21.15.44:0/1032960099 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:21:54.979 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.969+0000 7f49d3fff640 1 --2- 172.21.15.44:0/1032960099 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ca1a46990 0x564ca1a44390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:54.979 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.969+0000 7f49d37fe640 1 --2- 172.21.15.44:0/1032960099 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ca1a3b7d0 0x564ca1a43910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:54.979 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.969+0000 7f49cbfff640 1 -- 172.21.15.44:0/1032960099 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ca1a3b7d0 msgr2=0x564ca1a43910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:54.979 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.969+0000 7f49cbfff640 1 --2- 172.21.15.44:0/1032960099 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ca1a3b7d0 0x564ca1a43910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:54.979 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.969+0000 7f49cbfff640 1 -- 172.21.15.44:0/1032960099 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ca1a46990 msgr2=0x564ca1a44390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:54.979 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.969+0000 7f49cbfff640 1 --2- 172.21.15.44:0/1032960099 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ca1a46990 0x564ca1a44390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:54.979 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.969+0000 7f49cbfff640 1 -- 172.21.15.44:0/1032960099 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ca177f620 con 0x564ca1a3c0f0 2024-08-19T00:21:54.980 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.969+0000 7f49d37fe640 1 --2- 172.21.15.44:0/1032960099 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ca1a3b7d0 0x564ca1a43910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:21:54.980 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.969+0000 7f49d3fff640 1 --2- 172.21.15.44:0/1032960099 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ca1a46990 0x564ca1a44390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:21:54.980 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.969+0000 7f49cbfff640 1 --2- 172.21.15.44:0/1032960099 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ca1a3c0f0 0x564ca1a43e50 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f49bc004650 tx=0x7f49bc009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cca6766a56d6106 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:21:54.980 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.969+0000 7f49b2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:21:54.980 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.970+0000 7f49b2ffd640 1 -- 172.21.15.44:0/1032960099 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49bc04e070 con 0x564ca1a3c0f0 2024-08-19T00:21:54.980 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.970+0000 7f49b2ffd640 1 -- 172.21.15.44:0/1032960099 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9533+0+0 (secure 0 0 0) 0x7f49bc003a00 con 0x564ca1a3c0f0 2024-08-19T00:21:54.980 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.970+0000 7f49dcc46740 1 -- 172.21.15.44:0/1032960099 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f49c4003c30 con 0x564ca1a3c0f0 2024-08-19T00:21:54.980 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.970+0000 7f49b2ffd640 1 -- 172.21.15.44:0/1032960099 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f49bc05a050 con 0x564ca1a3c0f0 2024-08-19T00:21:54.980 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.970+0000 7f49dcc46740 10 client.16599 fetch_fsmap learned FSMap version 33 2024-08-19T00:21:54.980 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.970+0000 7f49dcc46740 1 -- 172.21.15.44:0/1032960099 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x564ca1a551c0 con 0x564ca1a3c0f0 2024-08-19T00:21:54.980 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.970+0000 7f49b2ffd640 1 -- 172.21.15.44:0/1032960099 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f49c4003c30 con 0x564ca1a3c0f0 2024-08-19T00:21:54.980 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.970+0000 7f49b2ffd640 1 -- 172.21.15.44:0/1032960099 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f49bc03a040 con 0x564ca1a3c0f0 2024-08-19T00:21:54.980 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.970+0000 7f49dcc46740 10 client.16599 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:21:54.980 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.970+0000 7f49dcc46740 10 client.16599 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:21:54.980 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.970+0000 7f49dcc46740 20 client.16599 populate_metadata read hostname 'smithi044' 2024-08-19T00:21:54.981 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.970+0000 7f49dcc46740 1 --2- 172.21.15.44:0/1032960099 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x564ca1a566f0 0x564ca1a58ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:54.981 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.970+0000 7f49dcc46740 4 client.16599 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:21:54.981 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.970+0000 7f49dcc46740 1 -- 172.21.15.44:0/1032960099 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564ca19ad100 con 0x564ca1a566f0 2024-08-19T00:21:54.981 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.971+0000 7f49d37fe640 1 --2- 172.21.15.44:0/1032960099 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x564ca1a566f0 0x564ca1a58ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:54.981 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.971+0000 7f49d37fe640 1 --2- 172.21.15.44:0/1032960099 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x564ca1a566f0 0x564ca1a58ae0 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91371fa8af24c0b4 server_cookie=71f90a02e21e2b05 in_seq=0 out_seq=0 2024-08-19T00:21:54.981 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.971+0000 7f49b2ffd640 10 client.16599 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:21:54.981 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.972+0000 7f49b2ffd640 1 -- 172.21.15.44:0/1032960099 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564ca19ad100 con 0x564ca1a566f0 2024-08-19T00:21:54.981 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.972+0000 7f49b2ffd640 10 client.16599 handle_command_reply: tid=0 2024-08-19T00:21:54.981 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.972+0000 7f49dcc46740 1 client.16599 shutdown 2024-08-19T00:21:54.981 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.972+0000 7f49dcc46740 1 -- 172.21.15.44:0/1032960099 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ca1a3c0f0 msgr2=0x564ca1a43e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:54.981 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.972+0000 7f49dcc46740 1 --2- 172.21.15.44:0/1032960099 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ca1a3c0f0 0x564ca1a43e50 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f49bc004650 tx=0x7f49bc009260 comp rx=0 tx=0).stop 2024-08-19T00:21:54.981 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.972+0000 7f49dcc46740 1 -- 172.21.15.44:0/1032960099 shutdown_connections 2024-08-19T00:21:54.981 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.972+0000 7f49dcc46740 1 --2- 172.21.15.44:0/1032960099 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x564ca1a566f0 0x564ca1a58ae0 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:54.982 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.972+0000 7f49dcc46740 1 --2- 172.21.15.44:0/1032960099 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ca1a46990 0x564ca1a44390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:54.982 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.972+0000 7f49dcc46740 1 --2- 172.21.15.44:0/1032960099 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ca1a3c0f0 0x564ca1a43e50 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:54.982 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.972+0000 7f49b2ffd640 0 client.16599 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:21:54.982 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.972+0000 7f49dcc46740 1 --2- 172.21.15.44:0/1032960099 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ca1a3b7d0 0x564ca1a43910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:54.982 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.972+0000 7f49dcc46740 1 -- 172.21.15.44:0/1032960099 >> 172.21.15.44:0/1032960099 conn(0x564ca1a37d40 msgr2=0x564ca1a3daa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:21:54.982 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.972+0000 7f49dcc46740 1 -- 172.21.15.44:0/1032960099 shutdown_connections 2024-08-19T00:21:54.982 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.972+0000 7f49dcc46740 1 -- 172.21.15.44:0/1032960099 wait complete. 2024-08-19T00:21:54.982 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.972+0000 7f49dcc46740 20 client.16599 trim_cache size 0 max 16384 2024-08-19T00:21:54.990 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.987+0000 7f49dcc46740 1 Processor -- start 2024-08-19T00:21:54.990 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.987+0000 7f49dcc46740 1 -- start start 2024-08-19T00:21:54.990 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.987+0000 7f49dcc46740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ca1a3b7d0 0x564ca1a5e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:54.990 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.987+0000 7f49dcc46740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ca1a3c0f0 0x564ca1a5e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:54.990 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.987+0000 7f49dcc46740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ca1a46990 0x564ca1a40b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:54.990 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.987+0000 7f49dcc46740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f49d41aee30 con 0x564ca1a46990 2024-08-19T00:21:54.990 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.987+0000 7f49dcc46740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f49d41b0970 con 0x564ca1a3c0f0 2024-08-19T00:21:54.990 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.987+0000 7f49dcc46740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f49d41af500 con 0x564ca1a3b7d0 2024-08-19T00:21:54.991 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.987+0000 7f49d3fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ca1a46990 0x564ca1a40b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:54.991 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.987+0000 7f49d3fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ca1a46990 0x564ca1a40b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56134/0 (socket says 172.21.15.44:56134) 2024-08-19T00:21:54.991 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.987+0000 7f49d3fff640 1 -- 172.21.15.44:0/4098038282 learned_addr learned my addr 172.21.15.44:0/4098038282 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:21:54.991 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.987+0000 7f49d37fe640 1 --2- 172.21.15.44:0/4098038282 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ca1a3b7d0 0x564ca1a5e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:54.991 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.987+0000 7f49cbfff640 1 --2- 172.21.15.44:0/4098038282 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ca1a3c0f0 0x564ca1a5e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:54.991 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.987+0000 7f49d3fff640 1 -- 172.21.15.44:0/4098038282 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ca1a3b7d0 msgr2=0x564ca1a5e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:54.991 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.987+0000 7f49d3fff640 1 --2- 172.21.15.44:0/4098038282 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ca1a3b7d0 0x564ca1a5e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:54.991 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.987+0000 7f49d3fff640 1 -- 172.21.15.44:0/4098038282 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ca1a3c0f0 msgr2=0x564ca1a5e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:54.991 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.987+0000 7f49d3fff640 1 --2- 172.21.15.44:0/4098038282 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ca1a3c0f0 0x564ca1a5e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:54.991 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.987+0000 7f49d3fff640 1 -- 172.21.15.44:0/4098038282 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ca1a3bf20 con 0x564ca1a46990 2024-08-19T00:21:54.991 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.987+0000 7f49d37fe640 1 --2- 172.21.15.44:0/4098038282 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ca1a3b7d0 0x564ca1a5e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:21:54.991 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.987+0000 7f49cbfff640 1 --2- 172.21.15.44:0/4098038282 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ca1a3c0f0 0x564ca1a5e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:21:54.991 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.987+0000 7f49d3fff640 1 --2- 172.21.15.44:0/4098038282 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ca1a46990 0x564ca1a40b50 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f49cc0cc620 tx=0x7f49cc09b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ee4709613a652d1 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:21:54.992 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.988+0000 7f49c97fa640 1 -- 172.21.15.44:0/4098038282 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49cc020040 con 0x564ca1a46990 2024-08-19T00:21:54.992 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.988+0000 7f49c97fa640 1 -- 172.21.15.44:0/4098038282 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f49cc09f740 con 0x564ca1a46990 2024-08-19T00:21:54.992 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.988+0000 7f49c97fa640 1 -- 172.21.15.44:0/4098038282 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49cc097a00 con 0x564ca1a46990 2024-08-19T00:21:54.992 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.988+0000 7f49dcc46740 1 -- 172.21.15.44:0/4098038282 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ca1a46990 msgr2=0x564ca1a40b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:54.992 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.988+0000 7f49dcc46740 1 --2- 172.21.15.44:0/4098038282 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ca1a46990 0x564ca1a40b50 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f49cc0cc620 tx=0x7f49cc09b000 comp rx=0 tx=0).stop 2024-08-19T00:21:54.992 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.988+0000 7f49dcc46740 1 -- 172.21.15.44:0/4098038282 shutdown_connections 2024-08-19T00:21:54.992 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.988+0000 7f49dcc46740 1 --2- 172.21.15.44:0/4098038282 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ca1a46990 0x564ca1a40b50 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:54.992 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.988+0000 7f49dcc46740 1 --2- 172.21.15.44:0/4098038282 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ca1a3c0f0 0x564ca1a5e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:54.992 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.988+0000 7f49dcc46740 1 --2- 172.21.15.44:0/4098038282 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ca1a3b7d0 0x564ca1a5e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:54.992 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.988+0000 7f49dcc46740 1 -- 172.21.15.44:0/4098038282 >> 172.21.15.44:0/4098038282 conn(0x564ca1a37d40 msgr2=0x564ca1a45880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:21:54.993 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.988+0000 7f49dcc46740 1 -- 172.21.15.44:0/4098038282 shutdown_connections 2024-08-19T00:21:54.993 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.988+0000 7f49dcc46740 1 -- 172.21.15.44:0/4098038282 wait complete. 2024-08-19T00:21:54.993 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.989+0000 7f49dcc46740 1 -- start start 2024-08-19T00:21:54.995 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.989+0000 7f49dcc46740 1 Processor -- start 2024-08-19T00:21:54.995 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.989+0000 7f49dcc46740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ca1a3b7d0 0x564ca1a4aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:54.996 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.989+0000 7f49dcc46740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ca1a3c0f0 0x564ca1a4afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:54.996 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.989+0000 7f49dcc46740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ca1a46990 0x564ca1ac03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:54.996 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.989+0000 7f49dcc46740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f49d41b02a0 con 0x564ca1a46990 2024-08-19T00:21:54.996 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.989+0000 7f49dcc46740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f49d41afbd0 con 0x564ca1a3c0f0 2024-08-19T00:21:54.996 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.989+0000 7f49dcc46740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f49d41ace30 con 0x564ca1a3b7d0 2024-08-19T00:21:54.996 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.989+0000 7f49dcc46740 10 client.0 _ll_register_callbacks cb 0x7f49c40093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:21:54.996 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.989+0000 7f49d3fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ca1a46990 0x564ca1ac03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:54.996 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.989+0000 7f49d3fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ca1a46990 0x564ca1ac03a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56142/0 (socket says 172.21.15.44:56142) 2024-08-19T00:21:54.996 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.989+0000 7f49d3fff640 1 -- 172.21.15.44:0/2895893047 learned_addr learned my addr 172.21.15.44:0/2895893047 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:21:54.996 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.989+0000 7f49cbfff640 1 --2- 172.21.15.44:0/2895893047 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ca1a3c0f0 0x564ca1a4afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:54.996 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.989+0000 7f49d37fe640 1 --2- 172.21.15.44:0/2895893047 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ca1a3b7d0 0x564ca1a4aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:54.996 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.990+0000 7f49d3fff640 1 -- 172.21.15.44:0/2895893047 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ca1a3b7d0 msgr2=0x564ca1a4aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:54.997 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.990+0000 7f49d3fff640 1 --2- 172.21.15.44:0/2895893047 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ca1a3b7d0 0x564ca1a4aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:54.997 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.990+0000 7f49d3fff640 1 -- 172.21.15.44:0/2895893047 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ca1a3c0f0 msgr2=0x564ca1a4afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:21:54.997 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.990+0000 7f49d3fff640 1 --2- 172.21.15.44:0/2895893047 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ca1a3c0f0 0x564ca1a4afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:54.997 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.990+0000 7f49d3fff640 1 -- 172.21.15.44:0/2895893047 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ca1a4b8a0 con 0x564ca1a46990 2024-08-19T00:21:54.997 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.990+0000 7f49d3fff640 1 --2- 172.21.15.44:0/2895893047 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ca1a46990 0x564ca1ac03a0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f49cc099640 tx=0x7f49cc004830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edab502a5d8eb1b6 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:21:54.997 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.990+0000 7f49b2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:21:54.997 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.990+0000 7f49b2ffd640 1 -- 172.21.15.44:0/2895893047 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49cc0b4020 con 0x564ca1a46990 2024-08-19T00:21:54.997 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.990+0000 7f49b2ffd640 1 -- 172.21.15.44:0/2895893047 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9533+0+0 (secure 0 0 0) 0x7f49cc097a00 con 0x564ca1a46990 2024-08-19T00:21:54.997 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.990+0000 7f49dcc46740 1 -- 172.21.15.44:0/2895893047 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f49cc09f740 con 0x564ca1a46990 2024-08-19T00:21:54.997 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.990+0000 7f49b2ffd640 1 -- 172.21.15.44:0/2895893047 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f49cc020040 con 0x564ca1a46990 2024-08-19T00:21:54.997 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.990+0000 7f49dcc46740 10 client.16605 fetch_fsmap learned FSMap version 33 2024-08-19T00:21:54.997 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.990+0000 7f49dcc46740 1 -- 172.21.15.44:0/2895893047 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x564ca1ac1990 con 0x564ca1a46990 2024-08-19T00:21:54.997 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.990+0000 7f49b2ffd640 1 -- 172.21.15.44:0/2895893047 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f49cc09f740 con 0x564ca1a46990 2024-08-19T00:21:54.997 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.990+0000 7f49b2ffd640 1 -- 172.21.15.44:0/2895893047 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f49cc09a870 con 0x564ca1a46990 2024-08-19T00:21:54.997 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.990+0000 7f49dcc46740 10 client.16605 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:21:54.998 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.990+0000 7f49dcc46740 10 client.16605 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:21:54.998 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.990+0000 7f49dcc46740 20 client.16605 populate_metadata read hostname 'smithi044' 2024-08-19T00:21:54.998 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.991+0000 7f49dcc46740 1 --2- 172.21.15.44:0/2895893047 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x564ca1ac1ff0 0x564ca1ac43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:54.998 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.991+0000 7f49dcc46740 4 client.16605 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-19T00:21:54.998 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.991+0000 7f49dcc46740 1 -- 172.21.15.44:0/2895893047 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564ca19a7450 con 0x564ca1ac1ff0 2024-08-19T00:21:54.998 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.991+0000 7f49d37fe640 1 --2- 172.21.15.44:0/2895893047 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x564ca1ac1ff0 0x564ca1ac43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:54.998 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.991+0000 7f49d37fe640 1 --2- 172.21.15.44:0/2895893047 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x564ca1ac1ff0 0x564ca1ac43e0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43f59e4a5502f8f server_cookie=c467175386bfd296 in_seq=0 out_seq=0 2024-08-19T00:21:54.998 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:54.991+0000 7f49b2ffd640 10 client.16605 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:21:55.003 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:55.001+0000 7f49b2ffd640 1 -- 172.21.15.44:0/2895893047 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564ca19a7450 con 0x564ca1ac1ff0 2024-08-19T00:21:55.003 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:55.001+0000 7f49b2ffd640 10 client.16605 handle_command_reply: tid=0 2024-08-19T00:21:55.004 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:55.001+0000 7f49dcc46740 1 client.16605 shutdown 2024-08-19T00:21:55.004 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:55.001+0000 7f49dcc46740 1 -- 172.21.15.44:0/2895893047 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ca1a46990 msgr2=0x564ca1ac03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:55.004 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:55.001+0000 7f49dcc46740 1 --2- 172.21.15.44:0/2895893047 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ca1a46990 0x564ca1ac03a0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f49cc099640 tx=0x7f49cc004830 comp rx=0 tx=0).stop 2024-08-19T00:21:55.004 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:55.001+0000 7f49dcc46740 1 -- 172.21.15.44:0/2895893047 shutdown_connections 2024-08-19T00:21:55.004 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:55.001+0000 7f49dcc46740 1 --2- 172.21.15.44:0/2895893047 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x564ca1ac1ff0 0x564ca1ac43e0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:55.004 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:55.001+0000 7f49dcc46740 1 --2- 172.21.15.44:0/2895893047 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ca1a46990 0x564ca1ac03a0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:55.004 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:55.001+0000 7f49dcc46740 1 --2- 172.21.15.44:0/2895893047 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564ca1a3c0f0 0x564ca1a4afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:55.004 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:55.001+0000 7f49dcc46740 1 --2- 172.21.15.44:0/2895893047 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564ca1a3b7d0 0x564ca1a4aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:55.004 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:55.001+0000 7f49b2ffd640 0 client.16605 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:21:55.004 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:55.001+0000 7f49dcc46740 1 -- 172.21.15.44:0/2895893047 >> 172.21.15.44:0/2895893047 conn(0x564ca1a37d40 msgr2=0x564ca1a3d230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:21:55.004 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:55.001+0000 7f49dcc46740 1 -- 172.21.15.44:0/2895893047 shutdown_connections 2024-08-19T00:21:55.004 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:55.001+0000 7f49dcc46740 1 -- 172.21.15.44:0/2895893047 wait complete. 2024-08-19T00:21:55.004 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:55.002+0000 7f49dcc46740 20 client.16605 trim_cache size 0 max 16384 2024-08-19T00:21:55.005 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:{ 2024-08-19T00:21:55.005 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "message": "", 2024-08-19T00:21:55.005 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "return_code": 0 2024-08-19T00:21:55.005 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:} 2024-08-19T00:21:55.006 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:55.002+0000 7f49d9e84640 1 -- 172.21.15.44:0/4294850112 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f49c00a2da0 msgr2=0x7f49c00a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:55.006 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:55.002+0000 7f49d9e84640 1 --2- 172.21.15.44:0/4294850112 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f49c00a2da0 0x7f49c00a5260 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f49bc006010 tx=0x7f49bc02a420 comp rx=0 tx=0).stop 2024-08-19T00:21:55.006 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:55.002+0000 7f49d9e84640 1 -- 172.21.15.44:0/4294850112 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49d4106710 msgr2=0x7f49d419c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:55.006 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:55.002+0000 7f49d9e84640 1 --2- 172.21.15.44:0/4294850112 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49d4106710 0x7f49d419c960 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f49cc00d750 tx=0x7f49cc00dc10 comp rx=0 tx=0).stop 2024-08-19T00:21:55.006 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:55.002+0000 7f49d9e84640 1 -- 172.21.15.44:0/4294850112 shutdown_connections 2024-08-19T00:21:55.006 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:55.002+0000 7f49d9e84640 1 --2- 172.21.15.44:0/4294850112 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f49c00a2da0 0x7f49c00a5260 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:55.006 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:55.002+0000 7f49d9e84640 1 --2- 172.21.15.44:0/4294850112 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f49d41010a0 0x7f49d41985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:55.007 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:55.002+0000 7f49d9e84640 1 --2- 172.21.15.44:0/4294850112 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f49d4106710 0x7f49d419c960 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:55.007 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:55.002+0000 7f49d9e84640 1 --2- 172.21.15.44:0/4294850112 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f49d4100700 0x7f49d41980a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:55.007 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:55.002+0000 7f49d9e84640 1 -- 172.21.15.44:0/4294850112 >> 172.21.15.44:0/4294850112 conn(0x7f49d40fc420 msgr2=0x7f49d4104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:21:55.007 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:55.002+0000 7f49d9e84640 1 -- 172.21.15.44:0/4294850112 shutdown_connections 2024-08-19T00:21:55.007 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:21:55.002+0000 7f49d9e84640 1 -- 172.21.15.44:0/4294850112 wait complete. 2024-08-19T00:21:55.689 INFO:tasks.workunit.client.0.smithi044.stdout: 1 611559 7.56 MB/sec execute 320 sec latency 18126.028 ms 2024-08-19T00:21:56.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:21:56 smithi171 ceph-mon[21810]: pgmap v265: 129 pgs: 129 active+clean; 442 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 799 KiB/s wr, 44 op/s 2024-08-19T00:21:56.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:21:56 smithi116 ceph-mon[21873]: pgmap v265: 129 pgs: 129 active+clean; 442 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 799 KiB/s wr, 44 op/s 2024-08-19T00:21:56.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:21:56 smithi044 ceph-mon[18489]: pgmap v265: 129 pgs: 129 active+clean; 442 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 799 KiB/s wr, 44 op/s 2024-08-19T00:21:56.689 INFO:tasks.workunit.client.0.smithi044.stdout: 1 611559 7.53 MB/sec execute 321 sec latency 19126.102 ms 2024-08-19T00:21:57.689 INFO:tasks.workunit.client.0.smithi044.stdout: 1 611559 7.51 MB/sec execute 322 sec latency 20126.182 ms 2024-08-19T00:21:58.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:21:58 smithi171 ceph-mon[21810]: pgmap v266: 129 pgs: 129 active+clean; 442 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 54 KiB/s wr, 11 op/s 2024-08-19T00:21:58.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:21:58 smithi116 ceph-mon[21873]: pgmap v266: 129 pgs: 129 active+clean; 442 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 54 KiB/s wr, 11 op/s 2024-08-19T00:21:58.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:21:58 smithi044 ceph-mon[18489]: pgmap v266: 129 pgs: 129 active+clean; 442 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 54 KiB/s wr, 11 op/s 2024-08-19T00:21:58.689 INFO:tasks.workunit.client.0.smithi044.stdout: 1 611559 7.49 MB/sec execute 323 sec latency 21126.306 ms 2024-08-19T00:21:58.817 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-19T00:21:59.092 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:21:59.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:59.548+0000 7f88e3e15640 1 -- 172.21.15.44:0/1405214106 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88dc102250 msgr2=0x7f88dc10e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:59.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:59.548+0000 7f88e3e15640 1 --2- 172.21.15.44:0/1405214106 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88dc102250 0x7f88dc10e780 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f88d4009cd0 tx=0x7f88d402a8e0 comp rx=0 tx=0).stop 2024-08-19T00:21:59.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:59.548+0000 7f88e3e15640 1 -- 172.21.15.44:0/1405214106 shutdown_connections 2024-08-19T00:21:59.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:59.548+0000 7f88e3e15640 1 --2- 172.21.15.44:0/1405214106 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88dc102250 0x7f88dc10e780 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:59.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:59.548+0000 7f88e3e15640 1 --2- 172.21.15.44:0/1405214106 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f88dc1018b0 0x7f88dc101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:59.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:59.548+0000 7f88e3e15640 1 --2- 172.21.15.44:0/1405214106 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88dc1078b0 0x7f88dc107c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:59.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:59.548+0000 7f88e3e15640 1 -- 172.21.15.44:0/1405214106 >> 172.21.15.44:0/1405214106 conn(0x7f88dc0fd5f0 msgr2=0x7f88dc0ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:21:59.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:59.548+0000 7f88e3e15640 1 -- 172.21.15.44:0/1405214106 shutdown_connections 2024-08-19T00:21:59.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:59.548+0000 7f88e3e15640 1 -- 172.21.15.44:0/1405214106 wait complete. 2024-08-19T00:21:59.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:59.548+0000 7f88e3e15640 1 Processor -- start 2024-08-19T00:21:59.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:59.548+0000 7f88e3e15640 1 -- start start 2024-08-19T00:21:59.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:59.549+0000 7f88e3e15640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88dc1018b0 0x7f88dc074220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:59.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:59.549+0000 7f88e3e15640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f88dc102250 0x7f88dc074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:59.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:59.549+0000 7f88e3e15640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88dc1078b0 0x7f88dc074ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:59.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:59.549+0000 7f88e3e15640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f88dc111cb0 con 0x7f88dc1078b0 2024-08-19T00:21:59.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:59.549+0000 7f88e3e15640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f88dc111b30 con 0x7f88dc102250 2024-08-19T00:21:59.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:59.549+0000 7f88e3e15640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f88dc111e30 con 0x7f88dc1018b0 2024-08-19T00:21:59.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:59.549+0000 7f88e23b2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88dc1078b0 0x7f88dc074ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:59.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:59.549+0000 7f88e23b2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88dc1078b0 0x7f88dc074ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47818/0 (socket says 172.21.15.44:47818) 2024-08-19T00:21:59.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:59.549+0000 7f88e23b2640 1 -- 172.21.15.44:0/3257061981 learned_addr learned my addr 172.21.15.44:0/3257061981 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:21:59.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:59.549+0000 7f88e1bb1640 1 --2- 172.21.15.44:0/3257061981 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88dc1018b0 0x7f88dc074220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:59.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:59.549+0000 7f88e13b0640 1 --2- 172.21.15.44:0/3257061981 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f88dc102250 0x7f88dc074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:59.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:59.549+0000 7f88e23b2640 1 -- 172.21.15.44:0/3257061981 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88dc1018b0 msgr2=0x7f88dc074220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:59.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:59.549+0000 7f88e23b2640 1 --2- 172.21.15.44:0/3257061981 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88dc1018b0 0x7f88dc074220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:59.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:59.549+0000 7f88e23b2640 1 -- 172.21.15.44:0/3257061981 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f88dc102250 msgr2=0x7f88dc074760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:59.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:59.549+0000 7f88e23b2640 1 --2- 172.21.15.44:0/3257061981 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f88dc102250 0x7f88dc074760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:59.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:59.549+0000 7f88e23b2640 1 -- 172.21.15.44:0/3257061981 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88dc1a6630 con 0x7f88dc1078b0 2024-08-19T00:21:59.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:59.549+0000 7f88e13b0640 1 --2- 172.21.15.44:0/3257061981 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f88dc102250 0x7f88dc074760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:21:59.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:59.549+0000 7f88e23b2640 1 --2- 172.21.15.44:0/3257061981 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88dc1078b0 0x7f88dc074ca0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f88d4005cc0 tx=0x7f88d4003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:21:59.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:59.550+0000 7f88d2ffd640 1 -- 172.21.15.44:0/3257061981 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d4004040 con 0x7f88dc1078b0 2024-08-19T00:21:59.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:59.550+0000 7f88d2ffd640 1 -- 172.21.15.44:0/3257061981 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88d40046c0 con 0x7f88dc1078b0 2024-08-19T00:21:59.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:59.550+0000 7f88e3e15640 1 -- 172.21.15.44:0/3257061981 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88dc1a68c0 con 0x7f88dc1078b0 2024-08-19T00:21:59.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:59.550+0000 7f88d2ffd640 1 -- 172.21.15.44:0/3257061981 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d4046480 con 0x7f88dc1078b0 2024-08-19T00:21:59.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:59.550+0000 7f88e3e15640 1 -- 172.21.15.44:0/3257061981 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88dc1a6e00 con 0x7f88dc1078b0 2024-08-19T00:21:59.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:59.551+0000 7f88e3e15640 1 -- 172.21.15.44:0/3257061981 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88dc101d10 con 0x7f88dc1078b0 2024-08-19T00:21:59.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:59.552+0000 7f88d2ffd640 1 -- 172.21.15.44:0/3257061981 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f88d40305a0 con 0x7f88dc1078b0 2024-08-19T00:21:59.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:59.553+0000 7f88d2ffd640 1 --2- 172.21.15.44:0/3257061981 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f88c80a2cf0 0x7f88c80a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:21:59.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:59.553+0000 7f88e1bb1640 1 --2- 172.21.15.44:0/3257061981 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f88c80a2cf0 0x7f88c80a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:21:59.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:59.553+0000 7f88d2ffd640 1 -- 172.21.15.44:0/3257061981 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9533+0+0 (secure 0 0 0) 0x7f88d402e030 con 0x7f88dc1078b0 2024-08-19T00:21:59.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:59.554+0000 7f88e1bb1640 1 --2- 172.21.15.44:0/3257061981 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f88c80a2cf0 0x7f88c80a51b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f88d80058c0 tx=0x7f88d800a250 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:21:59.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:59.557+0000 7f88d2ffd640 1 -- 172.21.15.44:0/3257061981 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f88d404b060 con 0x7f88dc1078b0 2024-08-19T00:21:59.689 INFO:tasks.workunit.client.0.smithi044.stdout: 1 611559 7.46 MB/sec execute 324 sec latency 22126.353 ms 2024-08-19T00:21:59.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:59.768+0000 7f88e3e15640 1 -- 172.21.15.44:0/3257061981 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f88dc109e20 con 0x7f88dc1078b0 2024-08-19T00:21:59.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:59.768+0000 7f88d2ffd640 1 -- 172.21.15.44:0/3257061981 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11989 (secure 0 0 0) 0x7f88d40bd8a0 con 0x7f88dc1078b0 2024-08-19T00:21:59.770 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:21:59.770 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":33,"btime":"2024-08-19T00:17:11:640526+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14511,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1538841896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1538841896},{"type":"v1","addr":"172.21.15.116:6833","nonce":1538841896}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/4044471606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4044471606},{"type":"v1","addr":"172.21.15.44:6835","nonce":4044471606}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":33,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-19T00:10:53.196636+0000","modified":"2024-08-19T00:17:11.586031+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24473,"mds_1":24446,"mds_2":24439,"mds_3":24431,"mds_4":24418},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14529":{"gid":14529,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6837/1824829052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1824829052},{"type":"v1","addr":"172.21.15.44:6837","nonce":1824829052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14577":{"gid":14577,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6839/3591739042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":3591739042},{"type":"v1","addr":"172.21.15.44:6839","nonce":3591739042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14589":{"gid":14589,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6841/3667695717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6840","nonce":3667695717},{"type":"v1","addr":"172.21.15.44:6841","nonce":3667695717}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24388":{"gid":24388,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1183022838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1183022838},{"type":"v1","addr":"172.21.15.171:6833","nonce":1183022838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6835/2190623851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":2190623851},{"type":"v1","addr":"172.21.15.171:6835","nonce":2190623851}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.171:6837/316231795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":316231795},{"type":"v1","addr":"172.21.15.171:6837","nonce":316231795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":20,"addr":"172.21.15.116:6835/3507399322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3507399322},{"type":"v1","addr":"172.21.15.116:6835","nonce":3507399322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.171:6839/1466585795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":1466585795},{"type":"v1","addr":"172.21.15.171:6839","nonce":1466585795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":17,"addr":"172.21.15.116:6837/2764513846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":2764513846},{"type":"v1","addr":"172.21.15.116:6837","nonce":2764513846}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.116:6839/1032741033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":1032741033},{"type":"v1","addr":"172.21.15.116:6839","nonce":1032741033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24446,24439,24431,24418]},"id":1}]} 2024-08-19T00:21:59.770 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 33 2024-08-19T00:21:59.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:59.770+0000 7f88e3e15640 1 -- 172.21.15.44:0/3257061981 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f88c80a2cf0 msgr2=0x7f88c80a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:59.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:59.770+0000 7f88e3e15640 1 --2- 172.21.15.44:0/3257061981 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f88c80a2cf0 0x7f88c80a51b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f88d80058c0 tx=0x7f88d800a250 comp rx=0 tx=0).stop 2024-08-19T00:21:59.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:59.770+0000 7f88e3e15640 1 -- 172.21.15.44:0/3257061981 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88dc1078b0 msgr2=0x7f88dc074ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:21:59.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:59.770+0000 7f88e3e15640 1 --2- 172.21.15.44:0/3257061981 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88dc1078b0 0x7f88dc074ca0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f88d4005cc0 tx=0x7f88d4003970 comp rx=0 tx=0).stop 2024-08-19T00:21:59.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:59.770+0000 7f88e3e15640 1 -- 172.21.15.44:0/3257061981 shutdown_connections 2024-08-19T00:21:59.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:59.770+0000 7f88e3e15640 1 --2- 172.21.15.44:0/3257061981 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f88c80a2cf0 0x7f88c80a51b0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:59.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:59.770+0000 7f88e3e15640 1 --2- 172.21.15.44:0/3257061981 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88dc1078b0 0x7f88dc074ca0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:59.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:59.770+0000 7f88e3e15640 1 --2- 172.21.15.44:0/3257061981 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f88dc102250 0x7f88dc074760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:59.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:59.770+0000 7f88e3e15640 1 --2- 172.21.15.44:0/3257061981 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88dc1018b0 0x7f88dc074220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:21:59.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:59.770+0000 7f88e3e15640 1 -- 172.21.15.44:0/3257061981 >> 172.21.15.44:0/3257061981 conn(0x7f88dc0fd5f0 msgr2=0x7f88dc0fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:21:59.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:59.771+0000 7f88e3e15640 1 -- 172.21.15.44:0/3257061981 shutdown_connections 2024-08-19T00:21:59.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:21:59.771+0000 7f88e3e15640 1 -- 172.21.15.44:0/3257061981 wait complete. 2024-08-19T00:22:00.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:22:00 smithi044 ceph-mon[18489]: pgmap v267: 129 pgs: 129 active+clean; 442 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 54 KiB/s wr, 11 op/s 2024-08-19T00:22:00.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:22:00 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/3257061981' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:22:00.540 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24473 quiesce db --set-id 7ac065e8 --release --await' 2024-08-19T00:22:00.540 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24473 quiesce db --set-id 7ac065e8 --release --await 2024-08-19T00:22:00.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:22:00 smithi171 ceph-mon[21810]: pgmap v267: 129 pgs: 129 active+clean; 442 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 54 KiB/s wr, 11 op/s 2024-08-19T00:22:00.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:22:00 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/3257061981' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:22:00.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:22:00 smithi116 ceph-mon[21873]: pgmap v267: 129 pgs: 129 active+clean; 442 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 54 KiB/s wr, 11 op/s 2024-08-19T00:22:00.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:22:00 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/3257061981' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:22:00.689 INFO:tasks.workunit.client.0.smithi044.stdout: 1 611559 7.44 MB/sec execute 325 sec latency 23126.393 ms 2024-08-19T00:22:00.802 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:22:01.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.298+0000 7ff240ecc640 1 -- 172.21.15.44:0/2437785174 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff23c1078b0 msgr2=0x7ff23c107c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:22:01.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.298+0000 7ff240ecc640 1 --2- 172.21.15.44:0/2437785174 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff23c1078b0 0x7ff23c107c90 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7ff22c009930 tx=0x7ff22c02a420 comp rx=0 tx=0).stop 2024-08-19T00:22:01.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.298+0000 7ff240ecc640 1 -- 172.21.15.44:0/2437785174 shutdown_connections 2024-08-19T00:22:01.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.298+0000 7ff240ecc640 1 --2- 172.21.15.44:0/2437785174 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff23c1018b0 0x7ff23c101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:01.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.298+0000 7ff240ecc640 1 --2- 172.21.15.44:0/2437785174 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff23c102250 0x7ff23c10e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:01.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.298+0000 7ff240ecc640 1 --2- 172.21.15.44:0/2437785174 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff23c1078b0 0x7ff23c107c90 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:01.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.298+0000 7ff240ecc640 1 -- 172.21.15.44:0/2437785174 >> 172.21.15.44:0/2437785174 conn(0x7ff23c0fd5f0 msgr2=0x7ff23c0ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:22:01.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.298+0000 7ff240ecc640 1 -- 172.21.15.44:0/2437785174 shutdown_connections 2024-08-19T00:22:01.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.298+0000 7ff240ecc640 1 -- 172.21.15.44:0/2437785174 wait complete. 2024-08-19T00:22:01.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.299+0000 7ff240ecc640 1 Processor -- start 2024-08-19T00:22:01.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.299+0000 7ff240ecc640 1 -- start start 2024-08-19T00:22:01.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.299+0000 7ff240ecc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff23c1018b0 0x7ff23c074220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:01.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.299+0000 7ff240ecc640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff23c102250 0x7ff23c074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:01.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.299+0000 7ff240ecc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff23c1078b0 0x7ff23c074ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:01.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.299+0000 7ff240ecc640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff23c111cb0 con 0x7ff23c1018b0 2024-08-19T00:22:01.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.299+0000 7ff240ecc640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7ff23c111b30 con 0x7ff23c1078b0 2024-08-19T00:22:01.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.299+0000 7ff240ecc640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff23c111e30 con 0x7ff23c102250 2024-08-19T00:22:01.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.299+0000 7ff23a59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff23c1018b0 0x7ff23c074220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:01.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.299+0000 7ff23a59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff23c1018b0 0x7ff23c074220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47836/0 (socket says 172.21.15.44:47836) 2024-08-19T00:22:01.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.300+0000 7ff23a59c640 1 -- 172.21.15.44:0/1236368985 learned_addr learned my addr 172.21.15.44:0/1236368985 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:22:01.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.300+0000 7ff233fff640 1 --2- 172.21.15.44:0/1236368985 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff23c102250 0x7ff23c074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:01.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.300+0000 7ff23ad9d640 1 --2- 172.21.15.44:0/1236368985 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff23c1078b0 0x7ff23c074ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:01.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.300+0000 7ff23a59c640 1 -- 172.21.15.44:0/1236368985 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff23c102250 msgr2=0x7ff23c074760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:22:01.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.300+0000 7ff23a59c640 1 --2- 172.21.15.44:0/1236368985 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff23c102250 0x7ff23c074760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:01.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.300+0000 7ff23a59c640 1 -- 172.21.15.44:0/1236368985 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff23c1078b0 msgr2=0x7ff23c074ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:22:01.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.300+0000 7ff23a59c640 1 --2- 172.21.15.44:0/1236368985 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff23c1078b0 0x7ff23c074ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:01.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.300+0000 7ff23a59c640 1 -- 172.21.15.44:0/1236368985 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff23c1a66e0 con 0x7ff23c1018b0 2024-08-19T00:22:01.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.300+0000 7ff23a59c640 1 --2- 172.21.15.44:0/1236368985 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff23c1018b0 0x7ff23c074220 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7ff22c009230 tx=0x7ff22c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:22:01.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.300+0000 7ff2337fe640 1 -- 172.21.15.44:0/1236368985 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff22c03f030 con 0x7ff23c1018b0 2024-08-19T00:22:01.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.300+0000 7ff240ecc640 1 -- 172.21.15.44:0/1236368985 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff23c1a6970 con 0x7ff23c1018b0 2024-08-19T00:22:01.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.300+0000 7ff2337fe640 1 -- 172.21.15.44:0/1236368985 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff22c004440 con 0x7ff23c1018b0 2024-08-19T00:22:01.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.300+0000 7ff2337fe640 1 -- 172.21.15.44:0/1236368985 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff22c035070 con 0x7ff23c1018b0 2024-08-19T00:22:01.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.300+0000 7ff240ecc640 1 -- 172.21.15.44:0/1236368985 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff23c1a6ea0 con 0x7ff23c1018b0 2024-08-19T00:22:01.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.302+0000 7ff2337fe640 1 -- 172.21.15.44:0/1236368985 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7ff22c042030 con 0x7ff23c1018b0 2024-08-19T00:22:01.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.303+0000 7ff2432ca740 1 Processor -- start 2024-08-19T00:22:01.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.303+0000 7ff2432ca740 1 -- start start 2024-08-19T00:22:01.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.303+0000 7ff2432ca740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5616c7b81990 0x5616c7b81d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:01.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.303+0000 7ff2432ca740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616c7b822b0 0x5616c7b8c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:01.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.303+0000 7ff2432ca740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5616c7b8cb70 0x5616c7b8ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:01.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.303+0000 7ff2432ca740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5616c7ae7c60 con 0x5616c7b822b0 2024-08-19T00:22:01.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.303+0000 7ff2432ca740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5616c7a7fb90 con 0x5616c7b81990 2024-08-19T00:22:01.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.303+0000 7ff2432ca740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5616c7ae3c20 con 0x5616c7b8cb70 2024-08-19T00:22:01.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.303+0000 7ff2337fe640 1 --2- 172.21.15.44:0/1236368985 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7ff2280a2cf0 0x7ff2280a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:01.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.303+0000 7ff23a59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616c7b822b0 0x5616c7b8c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:01.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.303+0000 7ff23ad9d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5616c7b81990 0x5616c7b81d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:01.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.303+0000 7ff23a59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616c7b822b0 0x5616c7b8c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47844/0 (socket says 172.21.15.44:47844) 2024-08-19T00:22:01.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.303+0000 7ff23a59c640 1 -- 172.21.15.44:0/1876880421 learned_addr learned my addr 172.21.15.44:0/1876880421 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:22:01.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.303+0000 7ff233fff640 1 --2- 172.21.15.44:0/1876880421 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5616c7b8cb70 0x5616c7b8ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:01.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.303+0000 7ff23ad9d640 1 --2- 172.21.15.44:0/1236368985 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7ff2280a2cf0 0x7ff2280a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:01.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.304+0000 7ff2337fe640 1 -- 172.21.15.44:0/1236368985 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9533+0+0 (secure 0 0 0) 0x7ff22c0efc30 con 0x7ff23c1018b0 2024-08-19T00:22:01.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.304+0000 7ff23a59c640 1 -- 172.21.15.44:0/1876880421 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5616c7b8cb70 msgr2=0x5616c7b8ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:22:01.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.304+0000 7ff23a59c640 1 --2- 172.21.15.44:0/1876880421 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5616c7b8cb70 0x5616c7b8ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:01.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.304+0000 7ff23a59c640 1 -- 172.21.15.44:0/1876880421 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5616c7b81990 msgr2=0x5616c7b81d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:22:01.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.304+0000 7ff23a59c640 1 --2- 172.21.15.44:0/1876880421 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5616c7b81990 0x5616c7b81d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:01.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.304+0000 7ff23a59c640 1 -- 172.21.15.44:0/1876880421 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616c77f7580 con 0x5616c7b822b0 2024-08-19T00:22:01.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.304+0000 7ff23ad9d640 1 --2- 172.21.15.44:0/1876880421 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5616c7b81990 0x5616c7b81d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:22:01.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.304+0000 7ff23ad9d640 1 --2- 172.21.15.44:0/1236368985 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7ff2280a2cf0 0x7ff2280a51b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff234005fd0 tx=0x7ff234009500 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:22:01.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.304+0000 7ff23a59c640 1 --2- 172.21.15.44:0/1876880421 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616c7b822b0 0x5616c7b8c630 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7ff22c0ece70 tx=0x7ff22c03b560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff22f4a5234f402f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:22:01.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.304+0000 7ff230ff9640 1 -- 172.21.15.44:0/1876880421 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff22c049070 con 0x5616c7b822b0 2024-08-19T00:22:01.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.304+0000 7ff230ff9640 1 -- 172.21.15.44:0/1876880421 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff22c0e9070 con 0x5616c7b822b0 2024-08-19T00:22:01.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.304+0000 7ff230ff9640 1 -- 172.21.15.44:0/1876880421 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff22c0ed1b0 con 0x5616c7b822b0 2024-08-19T00:22:01.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.305+0000 7ff2432ca740 1 -- 172.21.15.44:0/1876880421 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616c7b822b0 msgr2=0x5616c7b8c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:22:01.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.305+0000 7ff2432ca740 1 --2- 172.21.15.44:0/1876880421 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616c7b822b0 0x5616c7b8c630 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7ff22c0ece70 tx=0x7ff22c03b560 comp rx=0 tx=0).stop 2024-08-19T00:22:01.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.305+0000 7ff2432ca740 1 -- 172.21.15.44:0/1876880421 shutdown_connections 2024-08-19T00:22:01.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.305+0000 7ff2432ca740 1 --2- 172.21.15.44:0/1876880421 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5616c7b8cb70 0x5616c7b8ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:01.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.305+0000 7ff2432ca740 1 --2- 172.21.15.44:0/1876880421 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616c7b822b0 0x5616c7b8c630 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:01.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.305+0000 7ff2432ca740 1 --2- 172.21.15.44:0/1876880421 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5616c7b81990 0x5616c7b81d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:01.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.305+0000 7ff2432ca740 1 -- 172.21.15.44:0/1876880421 >> 172.21.15.44:0/1876880421 conn(0x5616c7b7df20 msgr2=0x5616c7b7e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:22:01.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.305+0000 7ff2432ca740 1 -- 172.21.15.44:0/1876880421 shutdown_connections 2024-08-19T00:22:01.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.305+0000 7ff2432ca740 1 -- 172.21.15.44:0/1876880421 wait complete. 2024-08-19T00:22:01.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.305+0000 7ff2432ca740 1 -- start start 2024-08-19T00:22:01.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.306+0000 7ff2432ca740 1 Processor -- start 2024-08-19T00:22:01.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.306+0000 7ff2432ca740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5616c7b81990 0x5616c7b89a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:01.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.306+0000 7ff2432ca740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616c7b822b0 0x5616c7b89f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:01.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.306+0000 7ff2432ca740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5616c7b8cb70 0x5616c7b8a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:01.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.306+0000 7ff2432ca740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5616c7ae7c60 con 0x5616c7b822b0 2024-08-19T00:22:01.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.306+0000 7ff2432ca740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5616c7a857c0 con 0x5616c7b81990 2024-08-19T00:22:01.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.306+0000 7ff2432ca740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5616c7b8f500 con 0x5616c7b8cb70 2024-08-19T00:22:01.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.306+0000 7ff2432ca740 10 client.0 _ll_register_callbacks cb 0x5616c7a8ef50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:22:01.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.306+0000 7ff233fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616c7b822b0 0x5616c7b89f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:01.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.306+0000 7ff233fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616c7b822b0 0x5616c7b89f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47860/0 (socket says 172.21.15.44:47860) 2024-08-19T00:22:01.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.306+0000 7ff233fff640 1 -- 172.21.15.44:0/1926668164 learned_addr learned my addr 172.21.15.44:0/1926668164 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:22:01.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.306+0000 7ff23a59c640 1 --2- 172.21.15.44:0/1926668164 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5616c7b81990 0x5616c7b89a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:01.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.306+0000 7ff23ad9d640 1 --2- 172.21.15.44:0/1926668164 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5616c7b8cb70 0x5616c7b8a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:01.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.306+0000 7ff233fff640 1 -- 172.21.15.44:0/1926668164 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5616c7b8cb70 msgr2=0x5616c7b8a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:22:01.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.306+0000 7ff233fff640 1 --2- 172.21.15.44:0/1926668164 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5616c7b8cb70 0x5616c7b8a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:01.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.306+0000 7ff233fff640 1 -- 172.21.15.44:0/1926668164 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5616c7b81990 msgr2=0x5616c7b89a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:22:01.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.306+0000 7ff233fff640 1 --2- 172.21.15.44:0/1926668164 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5616c7b81990 0x5616c7b89a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:01.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.306+0000 7ff233fff640 1 -- 172.21.15.44:0/1926668164 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616c78c1960 con 0x5616c7b822b0 2024-08-19T00:22:01.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.306+0000 7ff23ad9d640 1 --2- 172.21.15.44:0/1926668164 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5616c7b8cb70 0x5616c7b8a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:22:01.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.306+0000 7ff233fff640 1 --2- 172.21.15.44:0/1926668164 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616c7b822b0 0x5616c7b89f50 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7ff224012750 tx=0x7ff224012c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dc342dee5aac7d3 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:22:01.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.306+0000 7ff221ffb640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:22:01.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.307+0000 7ff221ffb640 1 -- 172.21.15.44:0/1926668164 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff224012e60 con 0x5616c7b822b0 2024-08-19T00:22:01.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.307+0000 7ff221ffb640 1 -- 172.21.15.44:0/1926668164 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9533+0+0 (secure 0 0 0) 0x7ff22400f920 con 0x5616c7b822b0 2024-08-19T00:22:01.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.307+0000 7ff2432ca740 1 -- 172.21.15.44:0/1926668164 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff22c0e9070 con 0x5616c7b822b0 2024-08-19T00:22:01.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.307+0000 7ff221ffb640 1 -- 172.21.15.44:0/1926668164 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7ff22400fb20 con 0x5616c7b822b0 2024-08-19T00:22:01.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.307+0000 7ff2432ca740 10 client.16623 fetch_fsmap learned FSMap version 33 2024-08-19T00:22:01.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.307+0000 7ff2432ca740 1 -- 172.21.15.44:0/1926668164 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5616c7b9b340 con 0x5616c7b822b0 2024-08-19T00:22:01.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.307+0000 7ff221ffb640 1 -- 172.21.15.44:0/1926668164 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff22c0e9070 con 0x5616c7b822b0 2024-08-19T00:22:01.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.307+0000 7ff221ffb640 1 -- 172.21.15.44:0/1926668164 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7ff22401c420 con 0x5616c7b822b0 2024-08-19T00:22:01.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.307+0000 7ff2432ca740 10 client.16623 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:22:01.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.307+0000 7ff2432ca740 10 client.16623 resolve_mds: validated gid 24473 aka daemon mds.b 2024-08-19T00:22:01.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.307+0000 7ff2432ca740 20 client.16623 populate_metadata read hostname 'smithi044' 2024-08-19T00:22:01.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.307+0000 7ff2432ca740 1 --2- 172.21.15.44:0/1926668164 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5616c7b9c8f0 0x5616c7b9ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:01.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.307+0000 7ff2432ca740 4 client.16623 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:22:01.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.307+0000 7ff2432ca740 1 -- 172.21.15.44:0/1926668164 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5616c7af51d0 con 0x5616c7b9c8f0 2024-08-19T00:22:01.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.308+0000 7ff23a59c640 1 --2- 172.21.15.44:0/1926668164 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5616c7b9c8f0 0x5616c7b9ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:01.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.308+0000 7ff221ffb640 10 client.16623 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:22:01.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.308+0000 7ff23a59c640 1 --2- 172.21.15.44:0/1926668164 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5616c7b9c8f0 0x5616c7b9ece0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=725bb04079b3b1b1 server_cookie=b3bce61d9e5e6295 in_seq=0 out_seq=0 2024-08-19T00:22:01.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.309+0000 7ff221ffb640 1 -- 172.21.15.44:0/1926668164 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5616c7af51d0 con 0x5616c7b9c8f0 2024-08-19T00:22:01.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.309+0000 7ff221ffb640 10 client.16623 handle_command_reply: tid=0 2024-08-19T00:22:01.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.309+0000 7ff2432ca740 1 client.16623 shutdown 2024-08-19T00:22:01.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.309+0000 7ff2432ca740 1 -- 172.21.15.44:0/1926668164 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616c7b822b0 msgr2=0x5616c7b89f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:22:01.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.309+0000 7ff2432ca740 1 --2- 172.21.15.44:0/1926668164 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616c7b822b0 0x5616c7b89f50 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7ff224012750 tx=0x7ff224012c10 comp rx=0 tx=0).stop 2024-08-19T00:22:01.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.309+0000 7ff2432ca740 1 -- 172.21.15.44:0/1926668164 shutdown_connections 2024-08-19T00:22:01.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.309+0000 7ff2432ca740 1 --2- 172.21.15.44:0/1926668164 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5616c7b9c8f0 0x5616c7b9ece0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:01.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.309+0000 7ff2432ca740 1 --2- 172.21.15.44:0/1926668164 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5616c7b8cb70 0x5616c7b8a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:01.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.309+0000 7ff221ffb640 0 client.16623 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:22:01.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.309+0000 7ff2432ca740 1 --2- 172.21.15.44:0/1926668164 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616c7b822b0 0x5616c7b89f50 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:01.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.309+0000 7ff2432ca740 1 --2- 172.21.15.44:0/1926668164 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5616c7b81990 0x5616c7b89a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:01.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.309+0000 7ff2432ca740 1 -- 172.21.15.44:0/1926668164 >> 172.21.15.44:0/1926668164 conn(0x5616c7b7df20 msgr2=0x5616c7b7d080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:22:01.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.309+0000 7ff2432ca740 1 -- 172.21.15.44:0/1926668164 shutdown_connections 2024-08-19T00:22:01.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.309+0000 7ff2432ca740 1 -- 172.21.15.44:0/1926668164 wait complete. 2024-08-19T00:22:01.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.309+0000 7ff2432ca740 20 client.16623 trim_cache size 0 max 16384 2024-08-19T00:22:01.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.326+0000 7ff2432ca740 1 Processor -- start 2024-08-19T00:22:01.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.327+0000 7ff2432ca740 1 -- start start 2024-08-19T00:22:01.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.327+0000 7ff2432ca740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616c7b81990 0x5616c7b8b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:01.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.327+0000 7ff2432ca740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5616c7b822b0 0x5616c7ba45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:01.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.327+0000 7ff2432ca740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5616c7b8cb70 0x5616c7ba4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:01.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.327+0000 7ff2432ca740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff23c1b1120 con 0x5616c7b81990 2024-08-19T00:22:01.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.327+0000 7ff2432ca740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7ff23c1b2c60 con 0x5616c7b8cb70 2024-08-19T00:22:01.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.327+0000 7ff2432ca740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff23c1b17f0 con 0x5616c7b822b0 2024-08-19T00:22:01.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.327+0000 7ff23a59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616c7b81990 0x5616c7b8b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:01.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.327+0000 7ff23a59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616c7b81990 0x5616c7b8b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47874/0 (socket says 172.21.15.44:47874) 2024-08-19T00:22:01.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.327+0000 7ff23a59c640 1 -- 172.21.15.44:0/1144385161 learned_addr learned my addr 172.21.15.44:0/1144385161 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:22:01.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.327+0000 7ff233fff640 1 --2- 172.21.15.44:0/1144385161 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5616c7b822b0 0x5616c7ba45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:01.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.327+0000 7ff23a59c640 1 -- 172.21.15.44:0/1144385161 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5616c7b822b0 msgr2=0x5616c7ba45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:22:01.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.327+0000 7ff23a59c640 1 --2- 172.21.15.44:0/1144385161 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5616c7b822b0 0x5616c7ba45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:01.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.327+0000 7ff23a59c640 1 -- 172.21.15.44:0/1144385161 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5616c7b8cb70 msgr2=0x5616c7ba4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:22:01.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.327+0000 7ff23a59c640 1 --2- 172.21.15.44:0/1144385161 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5616c7b8cb70 0x5616c7ba4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:01.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.327+0000 7ff23a59c640 1 -- 172.21.15.44:0/1144385161 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616c7b7d9c0 con 0x5616c7b81990 2024-08-19T00:22:01.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.327+0000 7ff23a59c640 1 --2- 172.21.15.44:0/1144385161 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616c7b81990 0x5616c7b8b980 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7ff22c0bba00 tx=0x7ff22c02a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba56f0a45a488961 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:22:01.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.328+0000 7ff223fff640 1 -- 172.21.15.44:0/1144385161 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff22c049040 con 0x5616c7b81990 2024-08-19T00:22:01.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.328+0000 7ff223fff640 1 -- 172.21.15.44:0/1144385161 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff22c0c4970 con 0x5616c7b81990 2024-08-19T00:22:01.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.328+0000 7ff223fff640 1 -- 172.21.15.44:0/1144385161 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff22c0ed1b0 con 0x5616c7b81990 2024-08-19T00:22:01.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.328+0000 7ff2432ca740 1 -- 172.21.15.44:0/1144385161 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616c7b81990 msgr2=0x5616c7b8b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:22:01.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.328+0000 7ff2432ca740 1 --2- 172.21.15.44:0/1144385161 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616c7b81990 0x5616c7b8b980 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7ff22c0bba00 tx=0x7ff22c02a420 comp rx=0 tx=0).stop 2024-08-19T00:22:01.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.328+0000 7ff2432ca740 1 -- 172.21.15.44:0/1144385161 shutdown_connections 2024-08-19T00:22:01.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.328+0000 7ff2432ca740 1 --2- 172.21.15.44:0/1144385161 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5616c7b822b0 0x5616c7ba45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:01.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.328+0000 7ff2432ca740 1 --2- 172.21.15.44:0/1144385161 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5616c7b8cb70 0x5616c7ba4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:01.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.328+0000 7ff2432ca740 1 --2- 172.21.15.44:0/1144385161 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616c7b81990 0x5616c7b8b980 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:01.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.328+0000 7ff2432ca740 1 -- 172.21.15.44:0/1144385161 >> 172.21.15.44:0/1144385161 conn(0x5616c7b7df20 msgr2=0x5616c7b8b270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:22:01.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.328+0000 7ff2432ca740 1 -- 172.21.15.44:0/1144385161 shutdown_connections 2024-08-19T00:22:01.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.328+0000 7ff2432ca740 1 -- 172.21.15.44:0/1144385161 wait complete. 2024-08-19T00:22:01.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.329+0000 7ff2432ca740 1 -- start start 2024-08-19T00:22:01.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.329+0000 7ff2432ca740 1 Processor -- start 2024-08-19T00:22:01.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.329+0000 7ff2432ca740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616c7b81990 0x5616c7b90660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:01.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.329+0000 7ff2432ca740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5616c7b822b0 0x5616c7b90ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:01.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.329+0000 7ff2432ca740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5616c7b8cb70 0x5616c7b910e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:01.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.329+0000 7ff2432ca740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff23c1b2590 con 0x5616c7b81990 2024-08-19T00:22:01.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.329+0000 7ff2432ca740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7ff23c1b1ec0 con 0x5616c7b8cb70 2024-08-19T00:22:01.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.329+0000 7ff2432ca740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff23c1af120 con 0x5616c7b822b0 2024-08-19T00:22:01.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.329+0000 7ff2432ca740 10 client.0 _ll_register_callbacks cb 0x7ff224009ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:22:01.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.329+0000 7ff23a59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616c7b81990 0x5616c7b90660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:01.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.329+0000 7ff23a59c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616c7b81990 0x5616c7b90660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47888/0 (socket says 172.21.15.44:47888) 2024-08-19T00:22:01.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.329+0000 7ff23a59c640 1 -- 172.21.15.44:0/2106598630 learned_addr learned my addr 172.21.15.44:0/2106598630 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:22:01.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.329+0000 7ff23a59c640 1 -- 172.21.15.44:0/2106598630 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5616c7b822b0 msgr2=0x5616c7b90ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:22:01.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.329+0000 7ff23a59c640 1 --2- 172.21.15.44:0/2106598630 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5616c7b822b0 0x5616c7b90ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:01.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.329+0000 7ff23ad9d640 1 --2- 172.21.15.44:0/2106598630 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5616c7b8cb70 0x5616c7b910e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:01.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.329+0000 7ff23a59c640 1 -- 172.21.15.44:0/2106598630 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5616c7b8cb70 msgr2=0x5616c7b910e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:22:01.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.329+0000 7ff23a59c640 1 --2- 172.21.15.44:0/2106598630 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5616c7b8cb70 0x5616c7b910e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:01.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.329+0000 7ff23a59c640 1 -- 172.21.15.44:0/2106598630 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616c7c06810 con 0x5616c7b81990 2024-08-19T00:22:01.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.329+0000 7ff23a59c640 1 --2- 172.21.15.44:0/2106598630 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616c7b81990 0x5616c7b90660 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7ff22c0c4440 tx=0x7ff22c0bbe00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90f30b72c51f8878 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:22:01.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.329+0000 7ff221ffb640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:22:01.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.330+0000 7ff221ffb640 1 -- 172.21.15.44:0/2106598630 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff22c0d8070 con 0x5616c7b81990 2024-08-19T00:22:01.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.330+0000 7ff221ffb640 1 -- 172.21.15.44:0/2106598630 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9533+0+0 (secure 0 0 0) 0x7ff22c0ed1b0 con 0x5616c7b81990 2024-08-19T00:22:01.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.330+0000 7ff2432ca740 1 -- 172.21.15.44:0/2106598630 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5616c7aef6e0 con 0x5616c7b81990 2024-08-19T00:22:01.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.330+0000 7ff221ffb640 1 -- 172.21.15.44:0/2106598630 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7ff22c049050 con 0x5616c7b81990 2024-08-19T00:22:01.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.330+0000 7ff2432ca740 10 client.16629 fetch_fsmap learned FSMap version 33 2024-08-19T00:22:01.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.330+0000 7ff2432ca740 1 -- 172.21.15.44:0/2106598630 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5616c7c07b30 con 0x5616c7b81990 2024-08-19T00:22:01.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.330+0000 7ff221ffb640 1 -- 172.21.15.44:0/2106598630 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5616c7aef6e0 con 0x5616c7b81990 2024-08-19T00:22:01.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.330+0000 7ff221ffb640 1 -- 172.21.15.44:0/2106598630 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7ff22c0bb150 con 0x5616c7b81990 2024-08-19T00:22:01.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.330+0000 7ff2432ca740 10 client.16629 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:22:01.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.330+0000 7ff2432ca740 10 client.16629 resolve_mds: validated gid 24473 aka daemon mds.b 2024-08-19T00:22:01.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.330+0000 7ff2432ca740 20 client.16629 populate_metadata read hostname 'smithi044' 2024-08-19T00:22:01.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.330+0000 7ff2432ca740 1 --2- 172.21.15.44:0/2106598630 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5616c7c080b0 0x5616c7c0a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:01.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.330+0000 7ff2432ca740 4 client.16629 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "7ac065e8", "release": true, "await": true}] 2024-08-19T00:22:01.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.330+0000 7ff2432ca740 1 -- 172.21.15.44:0/2106598630 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "quiesce db", "set_id": "7ac065e8", "release": true, "await": true}) -- 0x5616c7a6c5a0 con 0x5616c7c080b0 2024-08-19T00:22:01.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.331+0000 7ff233fff640 1 --2- 172.21.15.44:0/2106598630 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5616c7c080b0 0x5616c7c0a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:01.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.331+0000 7ff233fff640 1 --2- 172.21.15.44:0/2106598630 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5616c7c080b0 0x5616c7c0a4a0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c75bd02d9c280e5 server_cookie=5f7fabc46fce9cdb in_seq=0 out_seq=0 2024-08-19T00:22:01.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.331+0000 7ff221ffb640 10 client.16629 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:22:01.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.340+0000 7ff221ffb640 1 -- 172.21.15.44:0/2106598630 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5616c7a6c5a0 con 0x5616c7c080b0 2024-08-19T00:22:01.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.340+0000 7ff221ffb640 10 client.16629 handle_command_reply: tid=0 2024-08-19T00:22:01.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.340+0000 7ff2432ca740 1 client.16629 shutdown 2024-08-19T00:22:01.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.340+0000 7ff2432ca740 1 -- 172.21.15.44:0/2106598630 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616c7b81990 msgr2=0x5616c7b90660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:22:01.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.340+0000 7ff2432ca740 1 --2- 172.21.15.44:0/2106598630 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616c7b81990 0x5616c7b90660 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7ff22c0c4440 tx=0x7ff22c0bbe00 comp rx=0 tx=0).stop 2024-08-19T00:22:01.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.340+0000 7ff2432ca740 1 -- 172.21.15.44:0/2106598630 shutdown_connections 2024-08-19T00:22:01.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.340+0000 7ff2432ca740 1 --2- 172.21.15.44:0/2106598630 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5616c7c080b0 0x5616c7c0a4a0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:01.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.340+0000 7ff2432ca740 1 --2- 172.21.15.44:0/2106598630 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5616c7b822b0 0x5616c7b90ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:01.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.340+0000 7ff2432ca740 1 --2- 172.21.15.44:0/2106598630 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5616c7b8cb70 0x5616c7b910e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:01.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.340+0000 7ff221ffb640 0 client.16629 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:22:01.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.340+0000 7ff2432ca740 1 --2- 172.21.15.44:0/2106598630 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616c7b81990 0x5616c7b90660 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:01.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.340+0000 7ff2432ca740 1 -- 172.21.15.44:0/2106598630 >> 172.21.15.44:0/2106598630 conn(0x5616c7b7df20 msgr2=0x5616c7b7d080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:22:01.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.340+0000 7ff2432ca740 1 -- 172.21.15.44:0/2106598630 shutdown_connections 2024-08-19T00:22:01.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.340+0000 7ff2432ca740 1 -- 172.21.15.44:0/2106598630 wait complete. 2024-08-19T00:22:01.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.340+0000 7ff2432ca740 20 client.16629 trim_cache size 0 max 16384 2024-08-19T00:22:01.346 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-08-19T00:22:01.346 INFO:teuthology.orchestra.run.smithi044.stdout: "epoch": 33, 2024-08-19T00:22:01.346 INFO:teuthology.orchestra.run.smithi044.stdout: "leader": 24473, 2024-08-19T00:22:01.346 INFO:teuthology.orchestra.run.smithi044.stdout: "set_version": 32, 2024-08-19T00:22:01.346 INFO:teuthology.orchestra.run.smithi044.stdout: "sets": { 2024-08-19T00:22:01.346 INFO:teuthology.orchestra.run.smithi044.stdout: "7ac065e8": { 2024-08-19T00:22:01.346 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 32, 2024-08-19T00:22:01.347 INFO:teuthology.orchestra.run.smithi044.stdout: "age_ref": 0.0, 2024-08-19T00:22:01.347 INFO:teuthology.orchestra.run.smithi044.stdout: "state": { 2024-08-19T00:22:01.347 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "RELEASED", 2024-08-19T00:22:01.347 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.0 2024-08-19T00:22:01.347 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:22:01.347 INFO:teuthology.orchestra.run.smithi044.stdout: "timeout": 90.0, 2024-08-19T00:22:01.347 INFO:teuthology.orchestra.run.smithi044.stdout: "expiration": 143.8, 2024-08-19T00:22:01.347 INFO:teuthology.orchestra.run.smithi044.stdout: "members": { 2024-08-19T00:22:01.347 INFO:teuthology.orchestra.run.smithi044.stdout: "file:/": { 2024-08-19T00:22:01.347 INFO:teuthology.orchestra.run.smithi044.stdout: "excluded": false, 2024-08-19T00:22:01.347 INFO:teuthology.orchestra.run.smithi044.stdout: "state": { 2024-08-19T00:22:01.347 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "RELEASED", 2024-08-19T00:22:01.347 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.0 2024-08-19T00:22:01.348 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:22:01.348 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:22:01.348 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:22:01.348 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:22:01.348 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:22:01.348 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-08-19T00:22:01.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.340+0000 7ff240ecc640 1 -- 172.21.15.44:0/1236368985 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7ff2280a2cf0 msgr2=0x7ff2280a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:22:01.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.340+0000 7ff240ecc640 1 --2- 172.21.15.44:0/1236368985 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7ff2280a2cf0 0x7ff2280a51b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff234005fd0 tx=0x7ff234009500 comp rx=0 tx=0).stop 2024-08-19T00:22:01.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.340+0000 7ff240ecc640 1 -- 172.21.15.44:0/1236368985 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff23c1018b0 msgr2=0x7ff23c074220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:22:01.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.340+0000 7ff240ecc640 1 --2- 172.21.15.44:0/1236368985 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff23c1018b0 0x7ff23c074220 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7ff22c009230 tx=0x7ff22c004040 comp rx=0 tx=0).stop 2024-08-19T00:22:01.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.341+0000 7ff240ecc640 1 -- 172.21.15.44:0/1236368985 shutdown_connections 2024-08-19T00:22:01.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.341+0000 7ff240ecc640 1 --2- 172.21.15.44:0/1236368985 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7ff2280a2cf0 0x7ff2280a51b0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:01.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.341+0000 7ff240ecc640 1 --2- 172.21.15.44:0/1236368985 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff23c102250 0x7ff23c074760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:01.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.341+0000 7ff240ecc640 1 --2- 172.21.15.44:0/1236368985 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff23c1078b0 0x7ff23c074ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:01.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.341+0000 7ff240ecc640 1 --2- 172.21.15.44:0/1236368985 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff23c1018b0 0x7ff23c074220 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:01.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.341+0000 7ff240ecc640 1 -- 172.21.15.44:0/1236368985 >> 172.21.15.44:0/1236368985 conn(0x7ff23c0fd5f0 msgr2=0x7ff23c0fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:22:01.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.341+0000 7ff240ecc640 1 -- 172.21.15.44:0/1236368985 shutdown_connections 2024-08-19T00:22:01.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:22:01.341+0000 7ff240ecc640 1 -- 172.21.15.44:0/1236368985 wait complete. 2024-08-19T00:22:01.689 INFO:tasks.workunit.client.0.smithi044.stdout: 1 612145 7.42 MB/sec execute 326 sec latency 23782.247 ms 2024-08-19T00:22:02.065 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '7ac065e8', total seconds elapsed: 27.0 2024-08-19T00:22:02.370 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:22:02 smithi044 ceph-mon[18489]: pgmap v268: 129 pgs: 129 active+clean; 442 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 59 KiB/s wr, 17 op/s 2024-08-19T00:22:02.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:22:02 smithi171 ceph-mon[21810]: pgmap v268: 129 pgs: 129 active+clean; 442 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 59 KiB/s wr, 17 op/s 2024-08-19T00:22:02.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:22:02 smithi116 ceph-mon[21873]: pgmap v268: 129 pgs: 129 active+clean; 442 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 59 KiB/s wr, 17 op/s 2024-08-19T00:22:02.689 INFO:tasks.workunit.client.0.smithi044.stdout: 1 614638 7.45 MB/sec execute 327 sec latency 25.901 ms 2024-08-19T00:22:03.689 INFO:tasks.workunit.client.0.smithi044.stdout: 1 616578 7.45 MB/sec execute 328 sec latency 13.748 ms 2024-08-19T00:22:04.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:22:04 smithi171 ceph-mon[21810]: pgmap v269: 129 pgs: 129 active+clean; 442 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 6.3 KiB/s wr, 10 op/s 2024-08-19T00:22:04.618 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:22:04 smithi116 ceph-mon[21873]: pgmap v269: 129 pgs: 129 active+clean; 442 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 6.3 KiB/s wr, 10 op/s 2024-08-19T00:22:04.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:22:04 smithi044 ceph-mon[18489]: pgmap v269: 129 pgs: 129 active+clean; 442 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 6.3 KiB/s wr, 10 op/s 2024-08-19T00:22:04.689 INFO:tasks.workunit.client.0.smithi044.stdout: 1 618718 7.47 MB/sec execute 329 sec latency 24.649 ms 2024-08-19T00:22:05.689 INFO:tasks.workunit.client.0.smithi044.stdout: 1 621008 7.48 MB/sec execute 330 sec latency 15.477 ms 2024-08-19T00:22:06.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:22:06 smithi171 ceph-mon[21810]: pgmap v270: 129 pgs: 129 active+clean; 449 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 105 op/s 2024-08-19T00:22:06.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:22:06 smithi116 ceph-mon[21873]: pgmap v270: 129 pgs: 129 active+clean; 449 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 105 op/s 2024-08-19T00:22:06.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:22:06 smithi044 ceph-mon[18489]: pgmap v270: 129 pgs: 129 active+clean; 449 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 105 op/s 2024-08-19T00:22:06.689 INFO:tasks.workunit.client.0.smithi044.stdout: 1 622962 7.49 MB/sec execute 331 sec latency 20.333 ms 2024-08-19T00:22:07.689 INFO:tasks.workunit.client.0.smithi044.stdout: 1 624882 7.50 MB/sec execute 332 sec latency 40.085 ms 2024-08-19T00:22:08.097 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.092+0000 7f254dfbb640 1 -- 172.21.15.44:0/243058361 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f25481066f0 msgr2=0x7f2548106ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:22:08.097 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.092+0000 7f254dfbb640 1 --2- 172.21.15.44:0/243058361 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f25481066f0 0x7f2548106ad0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f2538009930 tx=0x7f253802a420 comp rx=0 tx=0).stop 2024-08-19T00:22:08.097 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.092+0000 7f254dfbb640 1 -- 172.21.15.44:0/243058361 shutdown_connections 2024-08-19T00:22:08.097 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.092+0000 7f254dfbb640 1 --2- 172.21.15.44:0/243058361 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2548101080 0x7f254810d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:08.098 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.092+0000 7f254dfbb640 1 --2- 172.21.15.44:0/243058361 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25481006e0 0x7f2548100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:08.098 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.092+0000 7f254dfbb640 1 --2- 172.21.15.44:0/243058361 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f25481066f0 0x7f2548106ad0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:08.098 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.092+0000 7f254dfbb640 1 -- 172.21.15.44:0/243058361 >> 172.21.15.44:0/243058361 conn(0x7f25480776c0 msgr2=0x7f25480fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:22:08.098 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.092+0000 7f254dfbb640 1 -- 172.21.15.44:0/243058361 shutdown_connections 2024-08-19T00:22:08.098 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.092+0000 7f254dfbb640 1 -- 172.21.15.44:0/243058361 wait complete. 2024-08-19T00:22:08.098 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.093+0000 7f254dfbb640 1 Processor -- start 2024-08-19T00:22:08.098 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.093+0000 7f254dfbb640 1 -- start start 2024-08-19T00:22:08.098 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.093+0000 7f254dfbb640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f25481006e0 0x7f2548196f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:08.098 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.093+0000 7f254dfbb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2548101080 0x7f25481974a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:08.098 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.093+0000 7f254dfbb640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25481066f0 0x7f254819b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:08.098 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.093+0000 7f254dfbb640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2548110b30 con 0x7f2548101080 2024-08-19T00:22:08.098 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.093+0000 7f254dfbb640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f25481109b0 con 0x7f25481066f0 2024-08-19T00:22:08.099 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.093+0000 7f254dfbb640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2548110cb0 con 0x7f25481006e0 2024-08-19T00:22:08.099 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.094+0000 7f2546ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2548101080 0x7f25481974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:08.099 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.094+0000 7f2546ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2548101080 0x7f25481974a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47900/0 (socket says 172.21.15.44:47900) 2024-08-19T00:22:08.099 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.094+0000 7f2546ffd640 1 -- 172.21.15.44:0/1378619583 learned_addr learned my addr 172.21.15.44:0/1378619583 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:22:08.099 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.094+0000 7f25477fe640 1 --2- 172.21.15.44:0/1378619583 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f25481006e0 0x7f2548196f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:08.099 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.094+0000 7f2547fff640 1 --2- 172.21.15.44:0/1378619583 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25481066f0 0x7f254819b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:08.099 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.094+0000 7f2546ffd640 1 -- 172.21.15.44:0/1378619583 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f25481006e0 msgr2=0x7f2548196f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:22:08.099 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.094+0000 7f2546ffd640 1 --2- 172.21.15.44:0/1378619583 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f25481006e0 0x7f2548196f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:08.099 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.094+0000 7f2546ffd640 1 -- 172.21.15.44:0/1378619583 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25481066f0 msgr2=0x7f254819b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:22:08.099 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.094+0000 7f2546ffd640 1 --2- 172.21.15.44:0/1378619583 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25481066f0 0x7f254819b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:08.099 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.094+0000 7f2546ffd640 1 -- 172.21.15.44:0/1378619583 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f254819bf50 con 0x7f2548101080 2024-08-19T00:22:08.099 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.094+0000 7f25477fe640 1 --2- 172.21.15.44:0/1378619583 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f25481006e0 0x7f2548196f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:22:08.099 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.094+0000 7f2546ffd640 1 --2- 172.21.15.44:0/1378619583 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2548101080 0x7f25481974a0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f253000eb70 tx=0x7f253000b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:22:08.100 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.094+0000 7f2544ff9640 1 -- 172.21.15.44:0/1378619583 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253000be60 con 0x7f2548101080 2024-08-19T00:22:08.100 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.094+0000 7f254dfbb640 1 -- 172.21.15.44:0/1378619583 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f254819c240 con 0x7f2548101080 2024-08-19T00:22:08.100 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.094+0000 7f2544ff9640 1 -- 172.21.15.44:0/1378619583 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f25300035f0 con 0x7f2548101080 2024-08-19T00:22:08.100 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.094+0000 7f2544ff9640 1 -- 172.21.15.44:0/1378619583 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25300146e0 con 0x7f2548101080 2024-08-19T00:22:08.100 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.094+0000 7f254dfbb640 1 -- 172.21.15.44:0/1378619583 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25480695d0 con 0x7f2548101080 2024-08-19T00:22:08.107 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.097+0000 7f2544ff9640 1 -- 172.21.15.44:0/1378619583 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f25300037a0 con 0x7f2548101080 2024-08-19T00:22:08.107 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.097+0000 7f2550e4b740 1 Processor -- start 2024-08-19T00:22:08.107 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.097+0000 7f2550e4b740 1 -- start start 2024-08-19T00:22:08.107 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.097+0000 7f2550e4b740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e4f2c547d0 0x55e4f2c54bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:08.107 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.097+0000 7f2550e4b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e4f2c550f0 0x55e4f2c5f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:08.107 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.097+0000 7f2550e4b740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e4f2c5f990 0x55e4f2c61d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:08.107 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.097+0000 7f2550e4b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e4f2bb89d0 con 0x55e4f2c550f0 2024-08-19T00:22:08.107 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.097+0000 7f2550e4b740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55e4f2b60820 con 0x55e4f2c5f990 2024-08-19T00:22:08.107 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.097+0000 7f2550e4b740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55e4f2bb4990 con 0x55e4f2c547d0 2024-08-19T00:22:08.108 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.097+0000 7f2544ff9640 1 --2- 172.21.15.44:0/1378619583 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f25340a2da0 0x7f25340a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:08.108 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.097+0000 7f25477fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e4f2c550f0 0x55e4f2c5f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:08.108 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.097+0000 7f2546ffd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e4f2c5f990 0x55e4f2c61d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:08.108 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.097+0000 7f25477fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e4f2c550f0 0x55e4f2c5f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47904/0 (socket says 172.21.15.44:47904) 2024-08-19T00:22:08.108 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.098+0000 7f25477fe640 1 -- 172.21.15.44:0/2222460697 learned_addr learned my addr 172.21.15.44:0/2222460697 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:22:08.108 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.098+0000 7f2547fff640 1 --2- 172.21.15.44:0/2222460697 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e4f2c547d0 0x55e4f2c54bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:08.108 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.098+0000 7f2547fff640 1 --2- 172.21.15.44:0/1378619583 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f25340a2da0 0x7f25340a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:08.108 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.098+0000 7f2544ff9640 1 -- 172.21.15.44:0/1378619583 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9621+0+0 (secure 0 0 0) 0x7f25300d1330 con 0x7f2548101080 2024-08-19T00:22:08.108 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.098+0000 7f25477fe640 1 -- 172.21.15.44:0/2222460697 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e4f2c547d0 msgr2=0x55e4f2c54bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:22:08.108 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.098+0000 7f25477fe640 1 --2- 172.21.15.44:0/2222460697 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e4f2c547d0 0x55e4f2c54bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:08.108 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.098+0000 7f25477fe640 1 -- 172.21.15.44:0/2222460697 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e4f2c5f990 msgr2=0x55e4f2c61d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:22:08.108 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.098+0000 7f25477fe640 1 --2- 172.21.15.44:0/2222460697 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e4f2c5f990 0x55e4f2c61d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:08.108 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.098+0000 7f25477fe640 1 -- 172.21.15.44:0/2222460697 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4f28cc210 con 0x55e4f2c550f0 2024-08-19T00:22:08.109 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.098+0000 7f2546ffd640 1 --2- 172.21.15.44:0/2222460697 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e4f2c5f990 0x55e4f2c61d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:22:08.109 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.098+0000 7f2547fff640 1 --2- 172.21.15.44:0/1378619583 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f25340a2da0 0x7f25340a5260 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2540005fd0 tx=0x7f2540009500 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:22:08.109 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.098+0000 7f25477fe640 1 --2- 172.21.15.44:0/2222460697 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e4f2c550f0 0x55e4f2c5f450 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f2538000c00 tx=0x7f2538005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a24e2fa4ed1e382 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:22:08.109 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.098+0000 7f253dffb640 1 -- 172.21.15.44:0/2222460697 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2538035040 con 0x55e4f2c550f0 2024-08-19T00:22:08.109 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.098+0000 7f253dffb640 1 -- 172.21.15.44:0/2222460697 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2538031830 con 0x55e4f2c550f0 2024-08-19T00:22:08.109 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.098+0000 7f253dffb640 1 -- 172.21.15.44:0/2222460697 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2538003cf0 con 0x55e4f2c550f0 2024-08-19T00:22:08.109 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.099+0000 7f2550e4b740 1 -- 172.21.15.44:0/2222460697 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e4f2c550f0 msgr2=0x55e4f2c5f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:22:08.109 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.099+0000 7f2550e4b740 1 --2- 172.21.15.44:0/2222460697 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e4f2c550f0 0x55e4f2c5f450 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f2538000c00 tx=0x7f2538005d50 comp rx=0 tx=0).stop 2024-08-19T00:22:08.109 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.099+0000 7f2550e4b740 1 -- 172.21.15.44:0/2222460697 shutdown_connections 2024-08-19T00:22:08.109 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.099+0000 7f2550e4b740 1 --2- 172.21.15.44:0/2222460697 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e4f2c5f990 0x55e4f2c61d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:08.110 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.099+0000 7f2550e4b740 1 --2- 172.21.15.44:0/2222460697 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e4f2c550f0 0x55e4f2c5f450 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:08.110 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.099+0000 7f2550e4b740 1 --2- 172.21.15.44:0/2222460697 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e4f2c547d0 0x55e4f2c54bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:08.110 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.099+0000 7f2550e4b740 1 -- 172.21.15.44:0/2222460697 >> 172.21.15.44:0/2222460697 conn(0x55e4f2c50d40 msgr2=0x55e4f2c51120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:22:08.110 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.099+0000 7f2550e4b740 1 -- 172.21.15.44:0/2222460697 shutdown_connections 2024-08-19T00:22:08.110 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.099+0000 7f2550e4b740 1 -- 172.21.15.44:0/2222460697 wait complete. 2024-08-19T00:22:08.110 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.099+0000 7f2550e4b740 1 -- start start 2024-08-19T00:22:08.110 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.100+0000 7f2550e4b740 1 Processor -- start 2024-08-19T00:22:08.110 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.100+0000 7f2550e4b740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e4f2c547d0 0x55e4f2c5c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:08.110 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.100+0000 7f2550e4b740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e4f2c550f0 0x55e4f2c5ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:08.110 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.100+0000 7f2550e4b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e4f2c5f990 0x55e4f2c5d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:08.110 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.100+0000 7f2550e4b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e4f2c62560 con 0x55e4f2c5f990 2024-08-19T00:22:08.110 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.100+0000 7f2550e4b740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55e4f2b74520 con 0x55e4f2c547d0 2024-08-19T00:22:08.110 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.100+0000 7f2550e4b740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55e4f2c626e0 con 0x55e4f2c550f0 2024-08-19T00:22:08.111 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.100+0000 7f2550e4b740 10 client.0 _ll_register_callbacks cb 0x55e4f28cba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:22:08.111 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.100+0000 7f2547fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e4f2c5f990 0x55e4f2c5d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:08.111 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.100+0000 7f25477fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e4f2c547d0 0x55e4f2c5c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:08.111 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.100+0000 7f2547fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e4f2c5f990 0x55e4f2c5d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47916/0 (socket says 172.21.15.44:47916) 2024-08-19T00:22:08.111 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.100+0000 7f2547fff640 1 -- 172.21.15.44:0/3197283579 learned_addr learned my addr 172.21.15.44:0/3197283579 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:22:08.111 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.100+0000 7f2546ffd640 1 --2- 172.21.15.44:0/3197283579 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e4f2c550f0 0x55e4f2c5ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:08.111 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.100+0000 7f2547fff640 1 -- 172.21.15.44:0/3197283579 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e4f2c550f0 msgr2=0x55e4f2c5ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:22:08.111 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.100+0000 7f2547fff640 1 --2- 172.21.15.44:0/3197283579 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e4f2c550f0 0x55e4f2c5ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:08.111 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.100+0000 7f2547fff640 1 -- 172.21.15.44:0/3197283579 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e4f2c547d0 msgr2=0x55e4f2c5c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:22:08.111 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.100+0000 7f2547fff640 1 --2- 172.21.15.44:0/3197283579 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e4f2c547d0 0x55e4f2c5c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:08.111 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.100+0000 7f2547fff640 1 -- 172.21.15.44:0/3197283579 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4f2998620 con 0x55e4f2c5f990 2024-08-19T00:22:08.111 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.100+0000 7f2546ffd640 1 --2- 172.21.15.44:0/3197283579 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e4f2c550f0 0x55e4f2c5ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:22:08.111 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.100+0000 7f25477fe640 1 --2- 172.21.15.44:0/3197283579 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e4f2c547d0 0x55e4f2c5c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:22:08.112 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.101+0000 7f2547fff640 1 --2- 172.21.15.44:0/3197283579 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e4f2c5f990 0x55e4f2c5d390 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f254000ff20 tx=0x7f2540004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b8d56c50a43eca server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:22:08.112 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.101+0000 7f2526ffd640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:22:08.112 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.101+0000 7f2526ffd640 1 -- 172.21.15.44:0/3197283579 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f254002a440 con 0x55e4f2c5f990 2024-08-19T00:22:08.112 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.101+0000 7f2526ffd640 1 -- 172.21.15.44:0/3197283579 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9621+0+0 (secure 0 0 0) 0x7f2540010430 con 0x55e4f2c5f990 2024-08-19T00:22:08.112 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.101+0000 7f2550e4b740 1 -- 172.21.15.44:0/3197283579 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2538031830 con 0x55e4f2c5f990 2024-08-19T00:22:08.112 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.101+0000 7f2526ffd640 1 -- 172.21.15.44:0/3197283579 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f254002f700 con 0x55e4f2c5f990 2024-08-19T00:22:08.112 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.101+0000 7f2550e4b740 10 client.16641 fetch_fsmap learned FSMap version 33 2024-08-19T00:22:08.112 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.101+0000 7f2550e4b740 1 -- 172.21.15.44:0/3197283579 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55e4f2c6e2b0 con 0x55e4f2c5f990 2024-08-19T00:22:08.112 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.101+0000 7f2526ffd640 1 -- 172.21.15.44:0/3197283579 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2538031830 con 0x55e4f2c5f990 2024-08-19T00:22:08.112 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.101+0000 7f2526ffd640 1 -- 172.21.15.44:0/3197283579 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f2540028070 con 0x55e4f2c5f990 2024-08-19T00:22:08.112 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.101+0000 7f2550e4b740 10 client.16641 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:22:08.112 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.101+0000 7f2550e4b740 10 client.16641 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:22:08.112 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.101+0000 7f2550e4b740 20 client.16641 populate_metadata read hostname 'smithi044' 2024-08-19T00:22:08.113 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.101+0000 7f2550e4b740 1 --2- 172.21.15.44:0/3197283579 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55e4f2c6f770 0x55e4f2c71be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:08.113 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.101+0000 7f2550e4b740 4 client.16641 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:22:08.113 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.101+0000 7f2550e4b740 1 -- 172.21.15.44:0/3197283579 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e4f2bc6100 con 0x55e4f2c6f770 2024-08-19T00:22:08.113 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.102+0000 7f25477fe640 1 --2- 172.21.15.44:0/3197283579 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55e4f2c6f770 0x55e4f2c71be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:08.113 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.102+0000 7f25477fe640 1 --2- 172.21.15.44:0/3197283579 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55e4f2c6f770 0x55e4f2c71be0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=404dac8ad5c00817 server_cookie=bdb0438f8788c5be in_seq=0 out_seq=0 2024-08-19T00:22:08.113 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.102+0000 7f2526ffd640 10 client.16641 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:22:08.113 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.102+0000 7f2526ffd640 1 -- 172.21.15.44:0/3197283579 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e4f2bc6100 con 0x55e4f2c6f770 2024-08-19T00:22:08.113 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.102+0000 7f2526ffd640 10 client.16641 handle_command_reply: tid=0 2024-08-19T00:22:08.113 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.102+0000 7f2550e4b740 1 client.16641 shutdown 2024-08-19T00:22:08.113 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.103+0000 7f2550e4b740 1 -- 172.21.15.44:0/3197283579 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e4f2c5f990 msgr2=0x55e4f2c5d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:22:08.113 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.103+0000 7f2550e4b740 1 --2- 172.21.15.44:0/3197283579 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e4f2c5f990 0x55e4f2c5d390 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f254000ff20 tx=0x7f2540004a40 comp rx=0 tx=0).stop 2024-08-19T00:22:08.113 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.103+0000 7f2550e4b740 1 -- 172.21.15.44:0/3197283579 shutdown_connections 2024-08-19T00:22:08.113 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.103+0000 7f2550e4b740 1 --2- 172.21.15.44:0/3197283579 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55e4f2c6f770 0x55e4f2c71be0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:08.114 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.103+0000 7f2550e4b740 1 --2- 172.21.15.44:0/3197283579 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e4f2c550f0 0x55e4f2c5ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:08.114 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.103+0000 7f2550e4b740 1 --2- 172.21.15.44:0/3197283579 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e4f2c5f990 0x55e4f2c5d390 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:08.114 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.103+0000 7f2526ffd640 0 client.16641 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:22:08.114 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.103+0000 7f2550e4b740 1 --2- 172.21.15.44:0/3197283579 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e4f2c547d0 0x55e4f2c5c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:08.114 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.103+0000 7f2550e4b740 1 -- 172.21.15.44:0/3197283579 >> 172.21.15.44:0/3197283579 conn(0x55e4f2c50d40 msgr2=0x55e4f2c4fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:22:08.114 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.103+0000 7f2550e4b740 1 -- 172.21.15.44:0/3197283579 shutdown_connections 2024-08-19T00:22:08.114 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.103+0000 7f2550e4b740 1 -- 172.21.15.44:0/3197283579 wait complete. 2024-08-19T00:22:08.114 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.103+0000 7f2550e4b740 20 client.16641 trim_cache size 0 max 16384 2024-08-19T00:22:08.120 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.117+0000 7f2550e4b740 1 Processor -- start 2024-08-19T00:22:08.120 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.117+0000 7f2550e4b740 1 -- start start 2024-08-19T00:22:08.120 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.118+0000 7f2550e4b740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e4f2c547d0 0x55e4f2c4fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:08.120 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.118+0000 7f2550e4b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e4f2c550f0 0x55e4f2c77540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:08.120 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.118+0000 7f2550e4b740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e4f2c5f990 0x55e4f2c77a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:08.121 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.118+0000 7f2550e4b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f25481accc0 con 0x55e4f2c550f0 2024-08-19T00:22:08.121 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.118+0000 7f2550e4b740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f25481ae800 con 0x55e4f2c5f990 2024-08-19T00:22:08.121 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.118+0000 7f2550e4b740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f25481ad390 con 0x55e4f2c547d0 2024-08-19T00:22:08.121 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.118+0000 7f2546ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e4f2c550f0 0x55e4f2c77540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:08.121 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.118+0000 7f2546ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e4f2c550f0 0x55e4f2c77540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47924/0 (socket says 172.21.15.44:47924) 2024-08-19T00:22:08.121 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.118+0000 7f2546ffd640 1 -- 172.21.15.44:0/1175801919 learned_addr learned my addr 172.21.15.44:0/1175801919 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:22:08.121 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.118+0000 7f25477fe640 1 --2- 172.21.15.44:0/1175801919 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e4f2c547d0 0x55e4f2c4fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:08.121 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.118+0000 7f2547fff640 1 --2- 172.21.15.44:0/1175801919 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e4f2c5f990 0x55e4f2c77a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:08.121 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.118+0000 7f2546ffd640 1 -- 172.21.15.44:0/1175801919 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e4f2c547d0 msgr2=0x55e4f2c4fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:22:08.121 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.118+0000 7f2546ffd640 1 --2- 172.21.15.44:0/1175801919 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e4f2c547d0 0x55e4f2c4fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:08.121 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.118+0000 7f2546ffd640 1 -- 172.21.15.44:0/1175801919 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e4f2c5f990 msgr2=0x55e4f2c77a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:22:08.121 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.118+0000 7f2546ffd640 1 --2- 172.21.15.44:0/1175801919 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e4f2c5f990 0x55e4f2c77a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:08.121 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.118+0000 7f2546ffd640 1 -- 172.21.15.44:0/1175801919 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4f2c6bf90 con 0x55e4f2c550f0 2024-08-19T00:22:08.122 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.118+0000 7f25477fe640 1 --2- 172.21.15.44:0/1175801919 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e4f2c547d0 0x55e4f2c4fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:22:08.122 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.118+0000 7f2547fff640 1 --2- 172.21.15.44:0/1175801919 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e4f2c5f990 0x55e4f2c77a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:22:08.122 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.118+0000 7f2546ffd640 1 --2- 172.21.15.44:0/1175801919 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e4f2c550f0 0x55e4f2c77540 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f253000eb40 tx=0x7f25300bd040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97345c6b80702037 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:22:08.122 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.118+0000 7f253d7fa640 1 -- 172.21.15.44:0/1175801919 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25300a17b0 con 0x55e4f2c550f0 2024-08-19T00:22:08.122 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.118+0000 7f253d7fa640 1 -- 172.21.15.44:0/1175801919 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f25300a6070 con 0x55e4f2c550f0 2024-08-19T00:22:08.122 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.118+0000 7f253d7fa640 1 -- 172.21.15.44:0/1175801919 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253009c900 con 0x55e4f2c550f0 2024-08-19T00:22:08.126 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.119+0000 7f2550e4b740 1 -- 172.21.15.44:0/1175801919 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e4f2c550f0 msgr2=0x55e4f2c77540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:22:08.126 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.119+0000 7f2550e4b740 1 --2- 172.21.15.44:0/1175801919 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e4f2c550f0 0x55e4f2c77540 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f253000eb40 tx=0x7f25300bd040 comp rx=0 tx=0).stop 2024-08-19T00:22:08.126 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.119+0000 7f2550e4b740 1 -- 172.21.15.44:0/1175801919 shutdown_connections 2024-08-19T00:22:08.126 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.119+0000 7f2550e4b740 1 --2- 172.21.15.44:0/1175801919 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e4f2c5f990 0x55e4f2c77a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:08.126 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.119+0000 7f2550e4b740 1 --2- 172.21.15.44:0/1175801919 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e4f2c550f0 0x55e4f2c77540 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:08.126 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.119+0000 7f2550e4b740 1 --2- 172.21.15.44:0/1175801919 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e4f2c547d0 0x55e4f2c4fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:08.126 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.119+0000 7f2550e4b740 1 -- 172.21.15.44:0/1175801919 >> 172.21.15.44:0/1175801919 conn(0x55e4f2c50d40 msgr2=0x55e4f2c4f680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:22:08.126 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.119+0000 7f2550e4b740 1 -- 172.21.15.44:0/1175801919 shutdown_connections 2024-08-19T00:22:08.126 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.119+0000 7f2550e4b740 1 -- 172.21.15.44:0/1175801919 wait complete. 2024-08-19T00:22:08.126 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.119+0000 7f2550e4b740 1 -- start start 2024-08-19T00:22:08.126 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.120+0000 7f2550e4b740 1 Processor -- start 2024-08-19T00:22:08.126 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.120+0000 7f2550e4b740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e4f2c547d0 0x55e4f2c67e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:08.127 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.120+0000 7f2550e4b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e4f2c550f0 0x55e4f2c59410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:08.127 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.120+0000 7f2550e4b740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e4f2c5f990 0x55e4f2c59950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:08.127 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.120+0000 7f2550e4b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f25481ae130 con 0x55e4f2c550f0 2024-08-19T00:22:08.127 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.120+0000 7f2550e4b740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f25481ada60 con 0x55e4f2c5f990 2024-08-19T00:22:08.127 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.120+0000 7f2550e4b740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f25481aacc0 con 0x55e4f2c547d0 2024-08-19T00:22:08.127 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.120+0000 7f2550e4b740 10 client.0 _ll_register_callbacks cb 0x7f254000fdb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:22:08.127 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.120+0000 7f2546ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e4f2c550f0 0x55e4f2c59410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:08.127 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.120+0000 7f2546ffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e4f2c550f0 0x55e4f2c59410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47930/0 (socket says 172.21.15.44:47930) 2024-08-19T00:22:08.127 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.120+0000 7f2546ffd640 1 -- 172.21.15.44:0/296457125 learned_addr learned my addr 172.21.15.44:0/296457125 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:22:08.127 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.120+0000 7f25477fe640 1 --2- 172.21.15.44:0/296457125 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e4f2c547d0 0x55e4f2c67e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:08.127 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.120+0000 7f2547fff640 1 --2- 172.21.15.44:0/296457125 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e4f2c5f990 0x55e4f2c59950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:08.127 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.120+0000 7f2546ffd640 1 -- 172.21.15.44:0/296457125 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e4f2c547d0 msgr2=0x55e4f2c67e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:22:08.127 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.120+0000 7f2546ffd640 1 --2- 172.21.15.44:0/296457125 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e4f2c547d0 0x55e4f2c67e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:08.128 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.120+0000 7f2546ffd640 1 -- 172.21.15.44:0/296457125 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e4f2c5f990 msgr2=0x55e4f2c59950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:22:08.128 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.120+0000 7f2546ffd640 1 --2- 172.21.15.44:0/296457125 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e4f2c5f990 0x55e4f2c59950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:08.128 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.120+0000 7f2546ffd640 1 -- 172.21.15.44:0/296457125 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4f2c59ec0 con 0x55e4f2c550f0 2024-08-19T00:22:08.128 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.120+0000 7f2547fff640 1 --2- 172.21.15.44:0/296457125 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e4f2c5f990 0x55e4f2c59950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:22:08.128 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.121+0000 7f2546ffd640 1 --2- 172.21.15.44:0/296457125 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e4f2c550f0 0x55e4f2c59410 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f2530005860 tx=0x7f25300ce650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d245ab4c6ee9fee server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:22:08.128 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.121+0000 7f2526ffd640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:22:08.128 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.121+0000 7f2526ffd640 1 -- 172.21.15.44:0/296457125 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2530003b10 con 0x55e4f2c550f0 2024-08-19T00:22:08.128 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.121+0000 7f2526ffd640 1 -- 172.21.15.44:0/296457125 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9621+0+0 (secure 0 0 0) 0x7f25300b6260 con 0x55e4f2c550f0 2024-08-19T00:22:08.128 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.121+0000 7f2550e4b740 1 -- 172.21.15.44:0/296457125 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f25300a6070 con 0x55e4f2c550f0 2024-08-19T00:22:08.128 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.121+0000 7f2526ffd640 1 -- 172.21.15.44:0/296457125 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f2530099200 con 0x55e4f2c550f0 2024-08-19T00:22:08.128 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.121+0000 7f2550e4b740 10 client.16647 fetch_fsmap learned FSMap version 33 2024-08-19T00:22:08.128 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.121+0000 7f2550e4b740 1 -- 172.21.15.44:0/296457125 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55e4f2cda210 con 0x55e4f2c550f0 2024-08-19T00:22:08.128 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.121+0000 7f2526ffd640 1 -- 172.21.15.44:0/296457125 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f25300a6070 con 0x55e4f2c550f0 2024-08-19T00:22:08.129 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.121+0000 7f2526ffd640 1 -- 172.21.15.44:0/296457125 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f2530004020 con 0x55e4f2c550f0 2024-08-19T00:22:08.129 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.121+0000 7f2550e4b740 10 client.16647 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:22:08.129 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.121+0000 7f2550e4b740 10 client.16647 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:22:08.129 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.121+0000 7f2550e4b740 20 client.16647 populate_metadata read hostname 'smithi044' 2024-08-19T00:22:08.129 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.121+0000 7f2550e4b740 1 --2- 172.21.15.44:0/296457125 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55e4f2cda8f0 0x55e4f2cdcd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:08.129 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.121+0000 7f2550e4b740 4 client.16647 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-19T00:22:08.129 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.121+0000 7f2550e4b740 1 -- 172.21.15.44:0/296457125 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e4f2bc0450 con 0x55e4f2cda8f0 2024-08-19T00:22:08.129 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.121+0000 7f25477fe640 1 --2- 172.21.15.44:0/296457125 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55e4f2cda8f0 0x55e4f2cdcd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:08.129 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.122+0000 7f2526ffd640 10 client.16647 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:22:08.129 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.122+0000 7f25477fe640 1 --2- 172.21.15.44:0/296457125 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55e4f2cda8f0 0x55e4f2cdcd10 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8fde208a41160ac server_cookie=659546db406a3cbf in_seq=0 out_seq=0 2024-08-19T00:22:08.133 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.131+0000 7f2526ffd640 1 -- 172.21.15.44:0/296457125 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e4f2bc0450 con 0x55e4f2cda8f0 2024-08-19T00:22:08.133 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.131+0000 7f2526ffd640 10 client.16647 handle_command_reply: tid=0 2024-08-19T00:22:08.133 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.131+0000 7f2550e4b740 1 client.16647 shutdown 2024-08-19T00:22:08.133 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.131+0000 7f2550e4b740 1 -- 172.21.15.44:0/296457125 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e4f2c550f0 msgr2=0x55e4f2c59410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:22:08.133 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.131+0000 7f2550e4b740 1 --2- 172.21.15.44:0/296457125 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e4f2c550f0 0x55e4f2c59410 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f2530005860 tx=0x7f25300ce650 comp rx=0 tx=0).stop 2024-08-19T00:22:08.134 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.131+0000 7f2550e4b740 1 -- 172.21.15.44:0/296457125 shutdown_connections 2024-08-19T00:22:08.134 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.131+0000 7f2550e4b740 1 --2- 172.21.15.44:0/296457125 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55e4f2cda8f0 0x55e4f2cdcd10 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:08.134 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.131+0000 7f2550e4b740 1 --2- 172.21.15.44:0/296457125 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e4f2c5f990 0x55e4f2c59950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:08.134 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.131+0000 7f2550e4b740 1 --2- 172.21.15.44:0/296457125 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e4f2c550f0 0x55e4f2c59410 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:08.134 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.131+0000 7f2526ffd640 0 client.16647 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:22:08.134 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.131+0000 7f2550e4b740 1 --2- 172.21.15.44:0/296457125 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e4f2c547d0 0x55e4f2c67e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:08.134 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.131+0000 7f2550e4b740 1 -- 172.21.15.44:0/296457125 >> 172.21.15.44:0/296457125 conn(0x55e4f2c50d40 msgr2=0x55e4f2c4fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:22:08.134 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.131+0000 7f2550e4b740 1 -- 172.21.15.44:0/296457125 shutdown_connections 2024-08-19T00:22:08.134 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.131+0000 7f2550e4b740 1 -- 172.21.15.44:0/296457125 wait complete. 2024-08-19T00:22:08.134 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.131+0000 7f2550e4b740 20 client.16647 trim_cache size 0 max 16384 2024-08-19T00:22:08.135 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:{ 2024-08-19T00:22:08.135 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "message": "", 2024-08-19T00:22:08.135 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "return_code": 0 2024-08-19T00:22:08.135 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:} 2024-08-19T00:22:08.135 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.132+0000 7f254dfbb640 1 -- 172.21.15.44:0/1378619583 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f25340a2da0 msgr2=0x7f25340a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:22:08.136 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.132+0000 7f254dfbb640 1 --2- 172.21.15.44:0/1378619583 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f25340a2da0 0x7f25340a5260 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2540005fd0 tx=0x7f2540009500 comp rx=0 tx=0).stop 2024-08-19T00:22:08.136 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.132+0000 7f254dfbb640 1 -- 172.21.15.44:0/1378619583 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2548101080 msgr2=0x7f25481974a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:22:08.136 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.132+0000 7f254dfbb640 1 --2- 172.21.15.44:0/1378619583 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2548101080 0x7f25481974a0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f253000eb70 tx=0x7f253000b690 comp rx=0 tx=0).stop 2024-08-19T00:22:08.136 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.132+0000 7f254dfbb640 1 -- 172.21.15.44:0/1378619583 shutdown_connections 2024-08-19T00:22:08.136 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.132+0000 7f254dfbb640 1 --2- 172.21.15.44:0/1378619583 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f25340a2da0 0x7f25340a5260 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:08.136 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.132+0000 7f254dfbb640 1 --2- 172.21.15.44:0/1378619583 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25481066f0 0x7f254819b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:08.136 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.132+0000 7f254dfbb640 1 --2- 172.21.15.44:0/1378619583 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2548101080 0x7f25481974a0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:08.136 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.132+0000 7f254dfbb640 1 --2- 172.21.15.44:0/1378619583 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f25481006e0 0x7f2548196f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:08.136 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.132+0000 7f254dfbb640 1 -- 172.21.15.44:0/1378619583 >> 172.21.15.44:0/1378619583 conn(0x7f25480776c0 msgr2=0x7f25481034e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:22:08.136 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.132+0000 7f254dfbb640 1 -- 172.21.15.44:0/1378619583 shutdown_connections 2024-08-19T00:22:08.137 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:08.132+0000 7f254dfbb640 1 -- 172.21.15.44:0/1378619583 wait complete. 2024-08-19T00:22:08.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:22:08 smithi171 ceph-mon[21810]: pgmap v271: 129 pgs: 129 active+clean; 449 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 101 op/s 2024-08-19T00:22:08.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:22:08 smithi171 ceph-mon[21810]: osdmap e100: 12 total, 12 up, 12 in 2024-08-19T00:22:08.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:22:08 smithi116 ceph-mon[21873]: pgmap v271: 129 pgs: 129 active+clean; 449 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 101 op/s 2024-08-19T00:22:08.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:22:08 smithi116 ceph-mon[21873]: osdmap e100: 12 total, 12 up, 12 in 2024-08-19T00:22:08.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:22:08 smithi044 ceph-mon[18489]: pgmap v271: 129 pgs: 129 active+clean; 449 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 101 op/s 2024-08-19T00:22:08.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:22:08 smithi044 ceph-mon[18489]: osdmap e100: 12 total, 12 up, 12 in 2024-08-19T00:22:08.689 INFO:tasks.workunit.client.0.smithi044.stdout: 1 626667 7.51 MB/sec execute 333 sec latency 13.219 ms 2024-08-19T00:22:09.690 INFO:tasks.workunit.client.0.smithi044.stdout: 1 629076 7.53 MB/sec execute 334 sec latency 18.987 ms 2024-08-19T00:22:10.508 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:22:10 smithi044 ceph-mon[18489]: pgmap v273: 129 pgs: 129 active+clean; 449 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 121 op/s 2024-08-19T00:22:10.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:22:10 smithi171 ceph-mon[21810]: pgmap v273: 129 pgs: 129 active+clean; 449 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 121 op/s 2024-08-19T00:22:10.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:22:10 smithi116 ceph-mon[21873]: pgmap v273: 129 pgs: 129 active+clean; 449 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 121 op/s 2024-08-19T00:22:10.690 INFO:tasks.workunit.client.0.smithi044.stdout: 1 631066 7.52 MB/sec execute 335 sec latency 32.130 ms 2024-08-19T00:22:11.690 INFO:tasks.workunit.client.0.smithi044.stdout: 1 633146 7.54 MB/sec execute 336 sec latency 11.922 ms 2024-08-19T00:22:12.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:22:12 smithi171 ceph-mon[21810]: pgmap v274: 129 pgs: 129 active+clean; 456 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 2.7 MiB/s wr, 219 op/s 2024-08-19T00:22:12.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:22:12 smithi116 ceph-mon[21873]: pgmap v274: 129 pgs: 129 active+clean; 456 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 2.7 MiB/s wr, 219 op/s 2024-08-19T00:22:12.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:22:12 smithi044 ceph-mon[18489]: pgmap v274: 129 pgs: 129 active+clean; 456 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 2.7 MiB/s wr, 219 op/s 2024-08-19T00:22:12.690 INFO:tasks.workunit.client.0.smithi044.stdout: 1 635717 7.57 MB/sec execute 337 sec latency 22.992 ms 2024-08-19T00:22:13.690 INFO:tasks.workunit.client.0.smithi044.stdout: 1 637319 7.57 MB/sec execute 338 sec latency 18.630 ms 2024-08-19T00:22:14.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:22:14 smithi171 ceph-mon[21810]: pgmap v275: 129 pgs: 129 active+clean; 456 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 2.7 MiB/s wr, 219 op/s 2024-08-19T00:22:14.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:22:14 smithi171 ceph-mon[21810]: osdmap e101: 12 total, 12 up, 12 in 2024-08-19T00:22:14.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:22:14 smithi116 ceph-mon[21873]: pgmap v275: 129 pgs: 129 active+clean; 456 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 2.7 MiB/s wr, 219 op/s 2024-08-19T00:22:14.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:22:14 smithi116 ceph-mon[21873]: osdmap e101: 12 total, 12 up, 12 in 2024-08-19T00:22:14.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:22:14 smithi044 ceph-mon[18489]: pgmap v275: 129 pgs: 129 active+clean; 456 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 2.7 MiB/s wr, 219 op/s 2024-08-19T00:22:14.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:22:14 smithi044 ceph-mon[18489]: osdmap e101: 12 total, 12 up, 12 in 2024-08-19T00:22:14.690 INFO:tasks.workunit.client.0.smithi044.stdout: 1 639720 7.58 MB/sec execute 339 sec latency 17.077 ms 2024-08-19T00:22:15.690 INFO:tasks.workunit.client.0.smithi044.stdout: 1 641754 7.58 MB/sec execute 340 sec latency 15.304 ms 2024-08-19T00:22:16.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:22:16 smithi171 ceph-mon[21810]: pgmap v277: 129 pgs: 129 active+clean; 465 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 2.8 MiB/s wr, 258 op/s 2024-08-19T00:22:16.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:22:16 smithi116 ceph-mon[21873]: pgmap v277: 129 pgs: 129 active+clean; 465 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 2.8 MiB/s wr, 258 op/s 2024-08-19T00:22:16.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:22:16 smithi044 ceph-mon[18489]: pgmap v277: 129 pgs: 129 active+clean; 465 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 2.8 MiB/s wr, 258 op/s 2024-08-19T00:22:16.690 INFO:tasks.workunit.client.0.smithi044.stdout: 1 644008 7.60 MB/sec execute 341 sec latency 11.692 ms 2024-08-19T00:22:17.690 INFO:tasks.workunit.client.0.smithi044.stdout: 1 646358 7.62 MB/sec execute 342 sec latency 88.857 ms 2024-08-19T00:22:18.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:22:18 smithi171 ceph-mon[21810]: pgmap v278: 129 pgs: 129 active+clean; 465 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 2.4 MiB/s wr, 219 op/s 2024-08-19T00:22:18.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:22:18 smithi116 ceph-mon[21873]: pgmap v278: 129 pgs: 129 active+clean; 465 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 2.4 MiB/s wr, 219 op/s 2024-08-19T00:22:18.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:22:18 smithi044 ceph-mon[18489]: pgmap v278: 129 pgs: 129 active+clean; 465 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 2.4 MiB/s wr, 219 op/s 2024-08-19T00:22:18.690 INFO:tasks.workunit.client.0.smithi044.stdout: 1 647988 7.62 MB/sec execute 343 sec latency 18.710 ms 2024-08-19T00:22:19.690 INFO:tasks.workunit.client.0.smithi044.stdout: 1 650353 7.64 MB/sec execute 344 sec latency 16.495 ms 2024-08-19T00:22:20.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:22:20 smithi171 ceph-mon[21810]: pgmap v279: 129 pgs: 129 active+clean; 465 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 2.3 MiB/s wr, 206 op/s 2024-08-19T00:22:20.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:22:20 smithi116 ceph-mon[21873]: pgmap v279: 129 pgs: 129 active+clean; 465 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 2.3 MiB/s wr, 206 op/s 2024-08-19T00:22:20.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:22:20 smithi044 ceph-mon[18489]: pgmap v279: 129 pgs: 129 active+clean; 465 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 2.3 MiB/s wr, 206 op/s 2024-08-19T00:22:20.690 INFO:tasks.workunit.client.0.smithi044.stdout: 1 652493 7.64 MB/sec execute 345 sec latency 19.958 ms 2024-08-19T00:22:21.225 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.222+0000 7f34e72ae640 1 -- 172.21.15.44:0/1247959787 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34e01006e0 msgr2=0x7f34e0100b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:22:21.226 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.222+0000 7f34e72ae640 1 --2- 172.21.15.44:0/1247959787 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34e01006e0 0x7f34e0100b40 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f34d4009930 tx=0x7f34d402a420 comp rx=0 tx=0).stop 2024-08-19T00:22:21.226 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.222+0000 7f34e72ae640 1 -- 172.21.15.44:0/1247959787 shutdown_connections 2024-08-19T00:22:21.226 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.222+0000 7f34e72ae640 1 --2- 172.21.15.44:0/1247959787 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f34e0101080 0x7f34e010d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:21.226 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.222+0000 7f34e72ae640 1 --2- 172.21.15.44:0/1247959787 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34e01006e0 0x7f34e0100b40 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:21.227 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.222+0000 7f34e72ae640 1 --2- 172.21.15.44:0/1247959787 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f34e01066f0 0x7f34e0106ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:21.227 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.222+0000 7f34e72ae640 1 -- 172.21.15.44:0/1247959787 >> 172.21.15.44:0/1247959787 conn(0x7f34e00776c0 msgr2=0x7f34e00fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:22:21.227 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.222+0000 7f34e72ae640 1 -- 172.21.15.44:0/1247959787 shutdown_connections 2024-08-19T00:22:21.227 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.222+0000 7f34e72ae640 1 -- 172.21.15.44:0/1247959787 wait complete. 2024-08-19T00:22:21.227 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.222+0000 7f34e72ae640 1 Processor -- start 2024-08-19T00:22:21.227 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.223+0000 7f34e72ae640 1 -- start start 2024-08-19T00:22:21.228 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.223+0000 7f34e72ae640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f34e01006e0 0x7f34e0198f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:21.228 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.223+0000 7f34e72ae640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34e0101080 0x7f34e0199460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:21.228 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.223+0000 7f34e72ae640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f34e01066f0 0x7f34e01a3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:21.242 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.223+0000 7f34e72ae640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f34e0110b30 con 0x7f34e0101080 2024-08-19T00:22:21.242 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.223+0000 7f34e72ae640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f34e01109b0 con 0x7f34e01006e0 2024-08-19T00:22:21.242 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.223+0000 7f34e72ae640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f34e0110cb0 con 0x7f34e01066f0 2024-08-19T00:22:21.242 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.223+0000 7f34e4849640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34e0101080 0x7f34e0199460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:21.242 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.223+0000 7f34e504a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f34e01006e0 0x7f34e0198f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:21.242 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.223+0000 7f34e4849640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34e0101080 0x7f34e0199460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39850/0 (socket says 172.21.15.44:39850) 2024-08-19T00:22:21.242 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.223+0000 7f34e4849640 1 -- 172.21.15.44:0/2567306067 learned_addr learned my addr 172.21.15.44:0/2567306067 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:22:21.242 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.223+0000 7f34e584b640 1 --2- 172.21.15.44:0/2567306067 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f34e01066f0 0x7f34e01a3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:21.243 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.223+0000 7f34e4849640 1 -- 172.21.15.44:0/2567306067 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f34e01066f0 msgr2=0x7f34e01a3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:22:21.243 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.223+0000 7f34e4849640 1 --2- 172.21.15.44:0/2567306067 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f34e01066f0 0x7f34e01a3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:21.243 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.223+0000 7f34e4849640 1 -- 172.21.15.44:0/2567306067 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f34e01006e0 msgr2=0x7f34e0198f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:22:21.243 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.223+0000 7f34e4849640 1 --2- 172.21.15.44:0/2567306067 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f34e01006e0 0x7f34e0198f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:21.243 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.223+0000 7f34e4849640 1 -- 172.21.15.44:0/2567306067 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34e01a44e0 con 0x7f34e0101080 2024-08-19T00:22:21.243 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.223+0000 7f34e504a640 1 --2- 172.21.15.44:0/2567306067 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f34e01006e0 0x7f34e0198f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:22:21.243 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.223+0000 7f34e4849640 1 --2- 172.21.15.44:0/2567306067 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34e0101080 0x7f34e0199460 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f34d4009230 tx=0x7f34d4004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:22:21.243 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.224+0000 7f34de7fc640 1 -- 172.21.15.44:0/2567306067 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d403f030 con 0x7f34e0101080 2024-08-19T00:22:21.243 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.224+0000 7f34de7fc640 1 -- 172.21.15.44:0/2567306067 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34d4004440 con 0x7f34e0101080 2024-08-19T00:22:21.244 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.224+0000 7f34e72ae640 1 -- 172.21.15.44:0/2567306067 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34e01a46b0 con 0x7f34e0101080 2024-08-19T00:22:21.244 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.224+0000 7f34de7fc640 1 -- 172.21.15.44:0/2567306067 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d4035070 con 0x7f34e0101080 2024-08-19T00:22:21.244 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.224+0000 7f34e72ae640 1 -- 172.21.15.44:0/2567306067 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34e01a4b10 con 0x7f34e0101080 2024-08-19T00:22:21.244 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.226+0000 7f34de7fc640 1 -- 172.21.15.44:0/2567306067 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f34d4042030 con 0x7f34e0101080 2024-08-19T00:22:21.244 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.226+0000 7f34ea06d740 1 Processor -- start 2024-08-19T00:22:21.244 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.226+0000 7f34ea06d740 1 -- start start 2024-08-19T00:22:21.245 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.227+0000 7f34ea06d740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eb1e1a1be0 0x55eb1e1a1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:21.245 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.227+0000 7f34ea06d740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb1e1a2500 0x55eb1e1ac860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:21.245 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.227+0000 7f34ea06d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb1e1acda0 0x55eb1e1af190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:21.245 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.227+0000 7f34ea06d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55eb1e1019d0 con 0x55eb1e1acda0 2024-08-19T00:22:21.245 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.227+0000 7f34ea06d740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55eb1e0a9820 con 0x55eb1e1a2500 2024-08-19T00:22:21.245 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.227+0000 7f34ea06d740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55eb1e0fd990 con 0x55eb1e1a1be0 2024-08-19T00:22:21.245 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.227+0000 7f34e584b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eb1e1a1be0 0x55eb1e1a1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:21.245 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.227+0000 7f34e4849640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb1e1acda0 0x55eb1e1af190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:21.245 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.227+0000 7f34e584b640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eb1e1a1be0 0x55eb1e1a1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.44:54970/0 (socket says 172.21.15.44:54970) 2024-08-19T00:22:21.245 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.227+0000 7f34e584b640 1 -- 172.21.15.44:0/3618721690 learned_addr learned my addr 172.21.15.44:0/3618721690 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:22:21.246 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.227+0000 7f34de7fc640 1 --2- 172.21.15.44:0/2567306067 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f34c80a2da0 0x7f34c80a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:21.246 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.227+0000 7f34e504a640 1 --2- 172.21.15.44:0/3618721690 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb1e1a2500 0x55eb1e1ac860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:21.246 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.227+0000 7f34e584b640 1 --2- 172.21.15.44:0/2567306067 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f34c80a2da0 0x7f34c80a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:21.246 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.227+0000 7f34e584b640 1 -- 172.21.15.44:0/3618721690 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb1e1a2500 msgr2=0x55eb1e1ac860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:22:21.246 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.227+0000 7f34de7fc640 1 -- 172.21.15.44:0/2567306067 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9533+0+0 (secure 0 0 0) 0x7f34d40efb20 con 0x7f34e0101080 2024-08-19T00:22:21.246 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.227+0000 7f34e584b640 1 --2- 172.21.15.44:0/3618721690 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb1e1a2500 0x55eb1e1ac860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:21.246 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.227+0000 7f34e584b640 1 -- 172.21.15.44:0/3618721690 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb1e1acda0 msgr2=0x55eb1e1af190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:22:21.246 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.227+0000 7f34e584b640 1 --2- 172.21.15.44:0/3618721690 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb1e1acda0 0x55eb1e1af190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:21.247 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.227+0000 7f34e584b640 1 -- 172.21.15.44:0/3618721690 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb1de15210 con 0x55eb1e1a1be0 2024-08-19T00:22:21.247 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.227+0000 7f34e584b640 1 --2- 172.21.15.44:0/3618721690 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eb1e1a1be0 0x55eb1e1a1fc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f34d80138b0 tx=0x7f34d8013d70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ca5170a228522b3 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:22:21.247 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.228+0000 7f34e584b640 1 --2- 172.21.15.44:0/2567306067 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f34c80a2da0 0x7f34c80a5260 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f34d801e000 tx=0x7f34d8020000 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:22:21.247 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.228+0000 7f34c77fe640 1 -- 172.21.15.44:0/3618721690 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d8012280 con 0x55eb1e1a1be0 2024-08-19T00:22:21.247 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.228+0000 7f34c77fe640 1 -- 172.21.15.44:0/3618721690 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34d8023070 con 0x55eb1e1a1be0 2024-08-19T00:22:21.247 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.228+0000 7f34c77fe640 1 -- 172.21.15.44:0/3618721690 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d80035f0 con 0x55eb1e1a1be0 2024-08-19T00:22:21.247 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.228+0000 7f34ea06d740 1 -- 172.21.15.44:0/3618721690 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eb1e1a1be0 msgr2=0x55eb1e1a1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:22:21.247 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.228+0000 7f34ea06d740 1 --2- 172.21.15.44:0/3618721690 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eb1e1a1be0 0x55eb1e1a1fc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f34d80138b0 tx=0x7f34d8013d70 comp rx=0 tx=0).stop 2024-08-19T00:22:21.247 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.228+0000 7f34ea06d740 1 -- 172.21.15.44:0/3618721690 shutdown_connections 2024-08-19T00:22:21.247 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.228+0000 7f34ea06d740 1 --2- 172.21.15.44:0/3618721690 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb1e1acda0 0x55eb1e1af190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:21.247 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.228+0000 7f34ea06d740 1 --2- 172.21.15.44:0/3618721690 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb1e1a2500 0x55eb1e1ac860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:21.248 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.228+0000 7f34ea06d740 1 --2- 172.21.15.44:0/3618721690 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eb1e1a1be0 0x55eb1e1a1fc0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:21.248 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.228+0000 7f34ea06d740 1 -- 172.21.15.44:0/3618721690 >> 172.21.15.44:0/3618721690 conn(0x55eb1e19e150 msgr2=0x55eb1e19e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:22:21.248 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.229+0000 7f34ea06d740 1 -- 172.21.15.44:0/3618721690 shutdown_connections 2024-08-19T00:22:21.248 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.229+0000 7f34ea06d740 1 -- 172.21.15.44:0/3618721690 wait complete. 2024-08-19T00:22:21.248 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.229+0000 7f34ea06d740 1 -- start start 2024-08-19T00:22:21.248 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.229+0000 7f34ea06d740 1 Processor -- start 2024-08-19T00:22:21.248 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.229+0000 7f34ea06d740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb1e1a1be0 0x55eb1e1a9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:21.248 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.229+0000 7f34ea06d740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eb1e1a2500 0x55eb1e1aa200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:21.248 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.229+0000 7f34ea06d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb1e1acda0 0x55eb1e1aa740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:21.248 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.229+0000 7f34ea06d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55eb1e1af970 con 0x55eb1e1acda0 2024-08-19T00:22:21.248 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.229+0000 7f34ea06d740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55eb1e0bd520 con 0x55eb1e1a1be0 2024-08-19T00:22:21.249 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.229+0000 7f34ea06d740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55eb1e1afaf0 con 0x55eb1e1a2500 2024-08-19T00:22:21.249 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.229+0000 7f34ea06d740 10 client.0 _ll_register_callbacks cb 0x55eb1de14a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:22:21.249 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.229+0000 7f34e584b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb1e1acda0 0x55eb1e1aa740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:21.249 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.230+0000 7f34e4849640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eb1e1a2500 0x55eb1e1aa200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:21.249 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.230+0000 7f34e584b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb1e1acda0 0x55eb1e1aa740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39872/0 (socket says 172.21.15.44:39872) 2024-08-19T00:22:21.249 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.230+0000 7f34e4849640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eb1e1a2500 0x55eb1e1aa200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.44:54972/0 (socket says 172.21.15.44:54972) 2024-08-19T00:22:21.249 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.230+0000 7f34e584b640 1 -- 172.21.15.44:0/370495302 learned_addr learned my addr 172.21.15.44:0/370495302 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:22:21.249 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.230+0000 7f34e504a640 1 --2- 172.21.15.44:0/370495302 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb1e1a1be0 0x55eb1e1a9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:21.249 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.230+0000 7f34e4849640 1 -- 172.21.15.44:0/370495302 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb1e1a1be0 msgr2=0x55eb1e1a9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:22:21.249 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.230+0000 7f34e4849640 1 --2- 172.21.15.44:0/370495302 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb1e1a1be0 0x55eb1e1a9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:21.250 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.230+0000 7f34e4849640 1 -- 172.21.15.44:0/370495302 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb1e1acda0 msgr2=0x55eb1e1aa740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:22:21.250 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.230+0000 7f34e4849640 1 --2- 172.21.15.44:0/370495302 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb1e1acda0 0x55eb1e1aa740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:21.250 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.230+0000 7f34e4849640 1 -- 172.21.15.44:0/370495302 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb1dee1620 con 0x55eb1e1a2500 2024-08-19T00:22:21.250 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.230+0000 7f34e504a640 1 --2- 172.21.15.44:0/370495302 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb1e1a1be0 0x55eb1e1a9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:22:21.250 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.230+0000 7f34e4849640 1 --2- 172.21.15.44:0/370495302 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eb1e1a2500 0x55eb1e1aa200 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f34d40ece80 tx=0x7f34d403b560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7cb50ce2b1efaac8 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:22:21.250 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.230+0000 7f34c4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.171:3300/0 2024-08-19T00:22:21.251 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.230+0000 7f34c4ff9640 1 -- 172.21.15.44:0/370495302 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d4049040 con 0x55eb1e1a2500 2024-08-19T00:22:21.251 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.230+0000 7f34ea06d740 1 -- 172.21.15.44:0/370495302 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34d8023070 con 0x55eb1e1a2500 2024-08-19T00:22:21.252 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.230+0000 7f34c4ff9640 1 -- 172.21.15.44:0/370495302 <== mon.1 v2:172.21.15.171:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9533+0+0 (secure 0 0 0) 0x7f34d40b8370 con 0x55eb1e1a2500 2024-08-19T00:22:21.252 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.230+0000 7f34c4ff9640 1 -- 172.21.15.44:0/370495302 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f34d40c48c0 con 0x55eb1e1a2500 2024-08-19T00:22:21.252 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.230+0000 7f34ea06d740 10 client.25957 fetch_fsmap learned FSMap version 33 2024-08-19T00:22:21.252 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.230+0000 7f34ea06d740 1 -- 172.21.15.44:0/370495302 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55eb1e1af970 con 0x55eb1e1a2500 2024-08-19T00:22:21.252 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.231+0000 7f34c4ff9640 1 -- 172.21.15.44:0/370495302 <== mon.1 v2:172.21.15.171:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34d40d4e50 con 0x55eb1e1a2500 2024-08-19T00:22:21.252 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.231+0000 7f34c4ff9640 1 -- 172.21.15.44:0/370495302 <== mon.1 v2:172.21.15.171:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f34d40c4430 con 0x55eb1e1a2500 2024-08-19T00:22:21.253 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.231+0000 7f34ea06d740 10 client.25957 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:22:21.253 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.231+0000 7f34ea06d740 10 client.25957 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:22:21.253 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.231+0000 7f34ea06d740 20 client.25957 populate_metadata read hostname 'smithi044' 2024-08-19T00:22:21.253 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.231+0000 7f34ea06d740 1 --2- 172.21.15.44:0/370495302 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55eb1e1bc980 0x55eb1e1bedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:21.253 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.231+0000 7f34ea06d740 4 client.25957 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:22:21.253 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.231+0000 7f34ea06d740 1 -- 172.21.15.44:0/370495302 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eb1e10f100 con 0x55eb1e1bc980 2024-08-19T00:22:21.254 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.231+0000 7f34e504a640 1 --2- 172.21.15.44:0/370495302 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55eb1e1bc980 0x55eb1e1bedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:21.254 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.231+0000 7f34c4ff9640 10 client.25957 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:22:21.254 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.231+0000 7f34e504a640 1 --2- 172.21.15.44:0/370495302 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55eb1e1bc980 0x55eb1e1bedb0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab52c402e03ceecb server_cookie=6c3e1d7d130d3468 in_seq=0 out_seq=0 2024-08-19T00:22:21.255 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.232+0000 7f34c4ff9640 1 -- 172.21.15.44:0/370495302 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55eb1e10f100 con 0x55eb1e1bc980 2024-08-19T00:22:21.255 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.232+0000 7f34c4ff9640 10 client.25957 handle_command_reply: tid=0 2024-08-19T00:22:21.255 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.232+0000 7f34ea06d740 1 client.25957 shutdown 2024-08-19T00:22:21.255 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.232+0000 7f34ea06d740 1 -- 172.21.15.44:0/370495302 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eb1e1a2500 msgr2=0x55eb1e1aa200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:22:21.255 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.232+0000 7f34ea06d740 1 --2- 172.21.15.44:0/370495302 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eb1e1a2500 0x55eb1e1aa200 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f34d40ece80 tx=0x7f34d403b560 comp rx=0 tx=0).stop 2024-08-19T00:22:21.256 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.232+0000 7f34ea06d740 1 -- 172.21.15.44:0/370495302 shutdown_connections 2024-08-19T00:22:21.256 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.232+0000 7f34ea06d740 1 --2- 172.21.15.44:0/370495302 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55eb1e1bc980 0x55eb1e1bedb0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:21.256 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.232+0000 7f34ea06d740 1 --2- 172.21.15.44:0/370495302 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eb1e1a2500 0x55eb1e1aa200 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:21.256 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.232+0000 7f34c4ff9640 0 client.25957 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:22:21.256 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.232+0000 7f34ea06d740 1 --2- 172.21.15.44:0/370495302 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb1e1acda0 0x55eb1e1aa740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:21.258 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.232+0000 7f34ea06d740 1 --2- 172.21.15.44:0/370495302 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb1e1a1be0 0x55eb1e1a9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:21.258 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.232+0000 7f34ea06d740 1 -- 172.21.15.44:0/370495302 >> 172.21.15.44:0/370495302 conn(0x55eb1e19e150 msgr2=0x55eb1e198ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:22:21.258 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.232+0000 7f34ea06d740 1 -- 172.21.15.44:0/370495302 shutdown_connections 2024-08-19T00:22:21.259 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.232+0000 7f34ea06d740 1 -- 172.21.15.44:0/370495302 wait complete. 2024-08-19T00:22:21.259 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.232+0000 7f34ea06d740 20 client.25957 trim_cache size 0 max 16384 2024-08-19T00:22:21.265 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.247+0000 7f34ea06d740 1 Processor -- start 2024-08-19T00:22:21.265 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.248+0000 7f34ea06d740 1 -- start start 2024-08-19T00:22:21.266 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.248+0000 7f34ea06d740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb1e1a1be0 0x55eb1e1c46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:21.266 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.248+0000 7f34ea06d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb1e1a2500 0x55eb1e1c4c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:21.266 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.248+0000 7f34ea06d740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eb1e1acda0 0x55eb1e1a6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:21.266 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.248+0000 7f34ea06d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f34e01acad0 con 0x55eb1e1a2500 2024-08-19T00:22:21.266 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.248+0000 7f34ea06d740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f34e01ae610 con 0x55eb1e1a1be0 2024-08-19T00:22:21.266 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.248+0000 7f34ea06d740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f34e01ad1a0 con 0x55eb1e1acda0 2024-08-19T00:22:21.266 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.248+0000 7f34e4849640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb1e1a2500 0x55eb1e1c4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:21.267 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.248+0000 7f34e504a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb1e1a1be0 0x55eb1e1c46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:21.267 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.248+0000 7f34e4849640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb1e1a2500 0x55eb1e1c4c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39878/0 (socket says 172.21.15.44:39878) 2024-08-19T00:22:21.267 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.248+0000 7f34e4849640 1 -- 172.21.15.44:0/1086249212 learned_addr learned my addr 172.21.15.44:0/1086249212 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:22:21.267 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.248+0000 7f34e584b640 1 --2- 172.21.15.44:0/1086249212 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eb1e1acda0 0x55eb1e1a6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:21.267 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.248+0000 7f34e4849640 1 -- 172.21.15.44:0/1086249212 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eb1e1acda0 msgr2=0x55eb1e1a6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:22:21.267 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.248+0000 7f34e4849640 1 --2- 172.21.15.44:0/1086249212 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eb1e1acda0 0x55eb1e1a6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:21.267 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.248+0000 7f34e4849640 1 -- 172.21.15.44:0/1086249212 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb1e1a1be0 msgr2=0x55eb1e1c46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:22:21.267 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.248+0000 7f34e4849640 1 --2- 172.21.15.44:0/1086249212 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb1e1a1be0 0x55eb1e1c46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:21.267 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.248+0000 7f34e4849640 1 -- 172.21.15.44:0/1086249212 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb1e1a2330 con 0x55eb1e1a2500 2024-08-19T00:22:21.267 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.248+0000 7f34e504a640 1 --2- 172.21.15.44:0/1086249212 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb1e1a1be0 0x55eb1e1c46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:22:21.268 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.248+0000 7f34e4849640 1 --2- 172.21.15.44:0/1086249212 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb1e1a2500 0x55eb1e1c4c00 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f34d40b86d0 tx=0x7f34d4003f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd1ccabb2613ffff server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:22:21.268 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.249+0000 7f34c6ffd640 1 -- 172.21.15.44:0/1086249212 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d4049070 con 0x55eb1e1a2500 2024-08-19T00:22:21.268 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.249+0000 7f34c6ffd640 1 -- 172.21.15.44:0/1086249212 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34d40d4e50 con 0x55eb1e1a2500 2024-08-19T00:22:21.268 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.249+0000 7f34c6ffd640 1 -- 172.21.15.44:0/1086249212 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d40d1030 con 0x55eb1e1a2500 2024-08-19T00:22:21.268 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.249+0000 7f34ea06d740 1 -- 172.21.15.44:0/1086249212 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb1e1a2500 msgr2=0x55eb1e1c4c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:22:21.268 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.249+0000 7f34ea06d740 1 --2- 172.21.15.44:0/1086249212 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb1e1a2500 0x55eb1e1c4c00 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f34d40b86d0 tx=0x7f34d4003f30 comp rx=0 tx=0).stop 2024-08-19T00:22:21.268 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.249+0000 7f34ea06d740 1 -- 172.21.15.44:0/1086249212 shutdown_connections 2024-08-19T00:22:21.268 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.249+0000 7f34ea06d740 1 --2- 172.21.15.44:0/1086249212 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eb1e1acda0 0x55eb1e1a6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:21.268 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.249+0000 7f34ea06d740 1 --2- 172.21.15.44:0/1086249212 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb1e1a2500 0x55eb1e1c4c00 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:21.268 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.249+0000 7f34ea06d740 1 --2- 172.21.15.44:0/1086249212 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb1e1a1be0 0x55eb1e1c46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:21.268 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.249+0000 7f34ea06d740 1 -- 172.21.15.44:0/1086249212 >> 172.21.15.44:0/1086249212 conn(0x55eb1e19e150 msgr2=0x55eb1e1abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:22:21.268 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.249+0000 7f34ea06d740 1 -- 172.21.15.44:0/1086249212 shutdown_connections 2024-08-19T00:22:21.268 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.249+0000 7f34ea06d740 1 -- 172.21.15.44:0/1086249212 wait complete. 2024-08-19T00:22:21.268 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.250+0000 7f34ea06d740 1 -- start start 2024-08-19T00:22:21.269 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.250+0000 7f34ea06d740 1 Processor -- start 2024-08-19T00:22:21.269 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.250+0000 7f34ea06d740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eb1e1a1be0 0x55eb1e1b0a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:21.269 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.250+0000 7f34ea06d740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb1e1a2500 0x55eb1e1b0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:21.269 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.250+0000 7f34ea06d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb1e1acda0 0x55eb1e1b14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:21.269 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.250+0000 7f34ea06d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f34e01adf40 con 0x55eb1e1acda0 2024-08-19T00:22:21.269 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.250+0000 7f34ea06d740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f34e01ad870 con 0x55eb1e1a2500 2024-08-19T00:22:21.269 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.250+0000 7f34ea06d740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f34e01aaad0 con 0x55eb1e1a1be0 2024-08-19T00:22:21.269 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.250+0000 7f34ea06d740 10 client.0 _ll_register_callbacks cb 0x7f34d4009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:22:21.269 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.250+0000 7f34e584b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb1e1acda0 0x55eb1e1b14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:21.269 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.250+0000 7f34e504a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eb1e1a1be0 0x55eb1e1b0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:21.269 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.250+0000 7f34e584b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb1e1acda0 0x55eb1e1b14b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39882/0 (socket says 172.21.15.44:39882) 2024-08-19T00:22:21.269 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.250+0000 7f34e584b640 1 -- 172.21.15.44:0/3329770009 learned_addr learned my addr 172.21.15.44:0/3329770009 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:22:21.269 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.251+0000 7f34e4849640 1 --2- 172.21.15.44:0/3329770009 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb1e1a2500 0x55eb1e1b0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:21.270 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.251+0000 7f34e584b640 1 -- 172.21.15.44:0/3329770009 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eb1e1a1be0 msgr2=0x55eb1e1b0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:22:21.270 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.251+0000 7f34e584b640 1 --2- 172.21.15.44:0/3329770009 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eb1e1a1be0 0x55eb1e1b0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:21.270 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.251+0000 7f34e584b640 1 -- 172.21.15.44:0/3329770009 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb1e1a2500 msgr2=0x55eb1e1b0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:22:21.270 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.251+0000 7f34e584b640 1 --2- 172.21.15.44:0/3329770009 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb1e1a2500 0x55eb1e1b0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:21.270 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.251+0000 7f34e584b640 1 -- 172.21.15.44:0/3329770009 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb1e226690 con 0x55eb1e1acda0 2024-08-19T00:22:21.270 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.251+0000 7f34e4849640 1 --2- 172.21.15.44:0/3329770009 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb1e1a2500 0x55eb1e1b0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:22:21.277 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.251+0000 7f34e504a640 1 --2- 172.21.15.44:0/3329770009 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eb1e1a1be0 0x55eb1e1b0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:22:21.277 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.251+0000 7f34e584b640 1 --2- 172.21.15.44:0/3329770009 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb1e1acda0 0x55eb1e1b14b0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f34d801fb80 tx=0x7f34d8012300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d905ac02a2acb0f8 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:22:21.277 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.251+0000 7f34c4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:22:21.277 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.251+0000 7f34c4ff9640 1 -- 172.21.15.44:0/3329770009 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d803b060 con 0x55eb1e1acda0 2024-08-19T00:22:21.278 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.251+0000 7f34c4ff9640 1 -- 172.21.15.44:0/3329770009 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9533+0+0 (secure 0 0 0) 0x7f34d8005110 con 0x55eb1e1acda0 2024-08-19T00:22:21.278 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.251+0000 7f34ea06d740 1 -- 172.21.15.44:0/3329770009 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34d40d4e50 con 0x55eb1e1acda0 2024-08-19T00:22:21.278 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.251+0000 7f34c4ff9640 1 -- 172.21.15.44:0/3329770009 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f34d80097d0 con 0x55eb1e1acda0 2024-08-19T00:22:21.278 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.251+0000 7f34ea06d740 10 client.16665 fetch_fsmap learned FSMap version 33 2024-08-19T00:22:21.278 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.251+0000 7f34ea06d740 1 -- 172.21.15.44:0/3329770009 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55eb1e2278e0 con 0x55eb1e1acda0 2024-08-19T00:22:21.278 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.252+0000 7f34c4ff9640 1 -- 172.21.15.44:0/3329770009 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34d40d4e50 con 0x55eb1e1acda0 2024-08-19T00:22:21.278 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.252+0000 7f34c4ff9640 1 -- 172.21.15.44:0/3329770009 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f34d8003950 con 0x55eb1e1acda0 2024-08-19T00:22:21.278 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.252+0000 7f34ea06d740 10 client.16665 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:22:21.278 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.252+0000 7f34ea06d740 10 client.16665 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:22:21.278 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.252+0000 7f34ea06d740 20 client.16665 populate_metadata read hostname 'smithi044' 2024-08-19T00:22:21.278 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.252+0000 7f34ea06d740 1 --2- 172.21.15.44:0/3329770009 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55eb1e227e00 0x55eb1e22a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:21.278 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.252+0000 7f34ea06d740 4 client.16665 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-19T00:22:21.279 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.252+0000 7f34ea06d740 1 -- 172.21.15.44:0/3329770009 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55eb1e109450 con 0x55eb1e227e00 2024-08-19T00:22:21.279 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.252+0000 7f34e504a640 1 --2- 172.21.15.44:0/3329770009 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55eb1e227e00 0x55eb1e22a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:21.279 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.252+0000 7f34e504a640 1 --2- 172.21.15.44:0/3329770009 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55eb1e227e00 0x55eb1e22a1f0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69acb0e96a7454a3 server_cookie=f4671425651ed02c in_seq=0 out_seq=0 2024-08-19T00:22:21.279 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.252+0000 7f34c4ff9640 10 client.16665 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:22:21.279 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.263+0000 7f34c4ff9640 1 -- 172.21.15.44:0/3329770009 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55eb1e109450 con 0x55eb1e227e00 2024-08-19T00:22:21.279 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.263+0000 7f34c4ff9640 10 client.16665 handle_command_reply: tid=0 2024-08-19T00:22:21.279 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.263+0000 7f34ea06d740 1 client.16665 shutdown 2024-08-19T00:22:21.279 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.263+0000 7f34ea06d740 1 -- 172.21.15.44:0/3329770009 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb1e1acda0 msgr2=0x55eb1e1b14b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:22:21.279 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.263+0000 7f34ea06d740 1 --2- 172.21.15.44:0/3329770009 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb1e1acda0 0x55eb1e1b14b0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f34d801fb80 tx=0x7f34d8012300 comp rx=0 tx=0).stop 2024-08-19T00:22:21.279 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.263+0000 7f34ea06d740 1 -- 172.21.15.44:0/3329770009 shutdown_connections 2024-08-19T00:22:21.279 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.263+0000 7f34ea06d740 1 --2- 172.21.15.44:0/3329770009 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55eb1e227e00 0x55eb1e22a1f0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:21.279 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.263+0000 7f34ea06d740 1 --2- 172.21.15.44:0/3329770009 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55eb1e1acda0 0x55eb1e1b14b0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:21.280 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.263+0000 7f34ea06d740 1 --2- 172.21.15.44:0/3329770009 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb1e1a2500 0x55eb1e1b0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:21.280 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.263+0000 7f34c4ff9640 0 client.16665 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:22:21.280 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.263+0000 7f34ea06d740 1 --2- 172.21.15.44:0/3329770009 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eb1e1a1be0 0x55eb1e1b0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:21.280 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.263+0000 7f34ea06d740 1 -- 172.21.15.44:0/3329770009 >> 172.21.15.44:0/3329770009 conn(0x55eb1e19e150 msgr2=0x55eb1e1a3690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:22:21.280 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.264+0000 7f34ea06d740 1 -- 172.21.15.44:0/3329770009 shutdown_connections 2024-08-19T00:22:21.280 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.264+0000 7f34ea06d740 1 -- 172.21.15.44:0/3329770009 wait complete. 2024-08-19T00:22:21.280 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.264+0000 7f34ea06d740 20 client.16665 trim_cache size 0 max 16384 2024-08-19T00:22:21.281 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:{ 2024-08-19T00:22:21.281 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "message": "", 2024-08-19T00:22:21.281 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "return_code": 0 2024-08-19T00:22:21.281 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:} 2024-08-19T00:22:21.282 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.264+0000 7f34e72ae640 1 -- 172.21.15.44:0/2567306067 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f34c80a2da0 msgr2=0x7f34c80a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:22:21.282 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.264+0000 7f34e72ae640 1 --2- 172.21.15.44:0/2567306067 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f34c80a2da0 0x7f34c80a5260 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f34d801e000 tx=0x7f34d8020000 comp rx=0 tx=0).stop 2024-08-19T00:22:21.282 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.264+0000 7f34e72ae640 1 -- 172.21.15.44:0/2567306067 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34e0101080 msgr2=0x7f34e0199460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:22:21.282 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.264+0000 7f34e72ae640 1 --2- 172.21.15.44:0/2567306067 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34e0101080 0x7f34e0199460 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f34d4009230 tx=0x7f34d4004040 comp rx=0 tx=0).stop 2024-08-19T00:22:21.282 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.264+0000 7f34e72ae640 1 -- 172.21.15.44:0/2567306067 shutdown_connections 2024-08-19T00:22:21.282 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.264+0000 7f34e72ae640 1 --2- 172.21.15.44:0/2567306067 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f34c80a2da0 0x7f34c80a5260 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:21.282 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.264+0000 7f34e72ae640 1 --2- 172.21.15.44:0/2567306067 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f34e01066f0 0x7f34e01a3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:21.282 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.264+0000 7f34e72ae640 1 --2- 172.21.15.44:0/2567306067 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34e0101080 0x7f34e0199460 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:21.282 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.264+0000 7f34e72ae640 1 --2- 172.21.15.44:0/2567306067 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f34e01006e0 0x7f34e0198f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:21.282 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.264+0000 7f34e72ae640 1 -- 172.21.15.44:0/2567306067 >> 172.21.15.44:0/2567306067 conn(0x7f34e00776c0 msgr2=0x7f34e01034a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:22:21.282 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.264+0000 7f34e72ae640 1 -- 172.21.15.44:0/2567306067 shutdown_connections 2024-08-19T00:22:21.283 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:21.264+0000 7f34e72ae640 1 -- 172.21.15.44:0/2567306067 wait complete. 2024-08-19T00:22:21.690 INFO:tasks.workunit.client.0.smithi044.stdout: 1 654679 7.66 MB/sec execute 346 sec latency 11.926 ms 2024-08-19T00:22:22.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:22:22 smithi171 ceph-mon[21810]: pgmap v280: 129 pgs: 129 active+clean; 475 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 2.3 MiB/s wr, 199 op/s 2024-08-19T00:22:22.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:22:22 smithi116 ceph-mon[21873]: pgmap v280: 129 pgs: 129 active+clean; 475 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 2.3 MiB/s wr, 199 op/s 2024-08-19T00:22:22.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:22:22 smithi044 ceph-mon[18489]: pgmap v280: 129 pgs: 129 active+clean; 475 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 2.3 MiB/s wr, 199 op/s 2024-08-19T00:22:22.690 INFO:tasks.workunit.client.0.smithi044.stdout: 1 657233 7.68 MB/sec execute 347 sec latency 27.365 ms 2024-08-19T00:22:23.690 INFO:tasks.workunit.client.0.smithi044.stdout: 1 659319 7.68 MB/sec execute 348 sec latency 15.172 ms 2024-08-19T00:22:24.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:22:24 smithi171 ceph-mon[21810]: pgmap v281: 129 pgs: 129 active+clean; 475 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 2.3 MiB/s wr, 199 op/s 2024-08-19T00:22:24.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:22:24 smithi116 ceph-mon[21873]: pgmap v281: 129 pgs: 129 active+clean; 475 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 2.3 MiB/s wr, 199 op/s 2024-08-19T00:22:24.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:22:24 smithi044 ceph-mon[18489]: pgmap v281: 129 pgs: 129 active+clean; 475 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 2.3 MiB/s wr, 199 op/s 2024-08-19T00:22:24.690 INFO:tasks.workunit.client.0.smithi044.stdout: 1 661352 7.70 MB/sec execute 349 sec latency 13.307 ms 2024-08-19T00:22:25.690 INFO:tasks.workunit.client.0.smithi044.stdout: 1 663906 7.71 MB/sec execute 350 sec latency 49.780 ms 2024-08-19T00:22:26.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:22:26 smithi171 ceph-mon[21810]: pgmap v282: 129 pgs: 129 active+clean; 486 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 3.2 MiB/s wr, 282 op/s 2024-08-19T00:22:26.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:22:26 smithi116 ceph-mon[21873]: pgmap v282: 129 pgs: 129 active+clean; 486 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 3.2 MiB/s wr, 282 op/s 2024-08-19T00:22:26.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:22:26 smithi044 ceph-mon[18489]: pgmap v282: 129 pgs: 129 active+clean; 486 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 3.2 MiB/s wr, 282 op/s 2024-08-19T00:22:26.690 INFO:tasks.workunit.client.0.smithi044.stdout: 1 665765 7.72 MB/sec execute 351 sec latency 12.704 ms 2024-08-19T00:22:27.691 INFO:tasks.workunit.client.0.smithi044.stdout: 1 668156 7.74 MB/sec execute 352 sec latency 12.259 ms 2024-08-19T00:22:28.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:22:28 smithi171 ceph-mon[21810]: pgmap v283: 129 pgs: 129 active+clean; 486 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.0 MiB/s wr, 169 op/s 2024-08-19T00:22:28.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:22:28 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:22:28.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:22:28 smithi116 ceph-mon[21873]: pgmap v283: 129 pgs: 129 active+clean; 486 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.0 MiB/s wr, 169 op/s 2024-08-19T00:22:28.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:22:28 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:22:28.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:22:28 smithi044 ceph-mon[18489]: pgmap v283: 129 pgs: 129 active+clean; 486 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.0 MiB/s wr, 169 op/s 2024-08-19T00:22:28.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:22:28 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:22:28.690 INFO:tasks.workunit.client.0.smithi044.stdout: 1 670013 7.74 MB/sec execute 353 sec latency 68.671 ms 2024-08-19T00:22:29.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:22:29 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:22:29.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:22:29 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:22:29.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:22:29 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:22:29.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:22:29 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:22:29.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:22:29 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:22:29.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:22:29 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:22:29.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:22:29 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:22:29.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:22:29 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:22:29.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:22:29 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:22:29.690 INFO:tasks.workunit.client.0.smithi044.stdout: 1 672076 7.75 MB/sec execute 354 sec latency 23.113 ms 2024-08-19T00:22:30.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:22:30 smithi171 ceph-mon[21810]: pgmap v284: 129 pgs: 129 active+clean; 486 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.0 MiB/s wr, 169 op/s 2024-08-19T00:22:30.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:22:30 smithi116 ceph-mon[21873]: pgmap v284: 129 pgs: 129 active+clean; 486 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.0 MiB/s wr, 169 op/s 2024-08-19T00:22:30.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:22:30 smithi044 ceph-mon[18489]: pgmap v284: 129 pgs: 129 active+clean; 486 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.0 MiB/s wr, 169 op/s 2024-08-19T00:22:30.690 INFO:tasks.workunit.client.0.smithi044.stdout: 1 674826 7.78 MB/sec execute 355 sec latency 13.406 ms 2024-08-19T00:22:31.691 INFO:tasks.workunit.client.0.smithi044.stdout: 1 676470 7.77 MB/sec execute 356 sec latency 19.836 ms 2024-08-19T00:22:32.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:22:32 smithi171 ceph-mon[21810]: pgmap v285: 129 pgs: 129 active+clean; 496 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 2.9 MiB/s wr, 251 op/s 2024-08-19T00:22:32.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:22:32 smithi116 ceph-mon[21873]: pgmap v285: 129 pgs: 129 active+clean; 496 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 2.9 MiB/s wr, 251 op/s 2024-08-19T00:22:32.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:22:32 smithi044 ceph-mon[18489]: pgmap v285: 129 pgs: 129 active+clean; 496 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 2.9 MiB/s wr, 251 op/s 2024-08-19T00:22:32.691 INFO:tasks.workunit.client.0.smithi044.stdout: 1 678879 7.79 MB/sec execute 357 sec latency 15.260 ms 2024-08-19T00:22:33.691 INFO:tasks.workunit.client.0.smithi044.stdout: 1 680777 7.79 MB/sec execute 358 sec latency 67.283 ms 2024-08-19T00:22:34.361 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.357+0000 7fa555b83640 1 -- 172.21.15.44:0/825852923 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa550101080 msgr2=0x7fa55010d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:22:34.361 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.357+0000 7fa555b83640 1 --2- 172.21.15.44:0/825852923 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa550101080 0x7fa55010d5b0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fa548009cd0 tx=0x7fa54802a8e0 comp rx=0 tx=0).stop 2024-08-19T00:22:34.361 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.357+0000 7fa555b83640 1 -- 172.21.15.44:0/825852923 shutdown_connections 2024-08-19T00:22:34.361 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.357+0000 7fa555b83640 1 --2- 172.21.15.44:0/825852923 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa550101080 0x7fa55010d5b0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:34.361 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.357+0000 7fa555b83640 1 --2- 172.21.15.44:0/825852923 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa5501006e0 0x7fa550100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:34.361 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.357+0000 7fa555b83640 1 --2- 172.21.15.44:0/825852923 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa5501066f0 0x7fa550106ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:34.361 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.357+0000 7fa555b83640 1 -- 172.21.15.44:0/825852923 >> 172.21.15.44:0/825852923 conn(0x7fa5500776c0 msgr2=0x7fa5500fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:22:34.362 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.357+0000 7fa555b83640 1 -- 172.21.15.44:0/825852923 shutdown_connections 2024-08-19T00:22:34.362 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.357+0000 7fa555b83640 1 -- 172.21.15.44:0/825852923 wait complete. 2024-08-19T00:22:34.362 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.358+0000 7fa555b83640 1 Processor -- start 2024-08-19T00:22:34.362 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.358+0000 7fa555b83640 1 -- start start 2024-08-19T00:22:34.362 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.358+0000 7fa555b83640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa5501006e0 0x7fa550198030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:34.362 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.358+0000 7fa555b83640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa550101080 0x7fa550198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:34.362 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.358+0000 7fa555b83640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa5501066f0 0x7fa55019c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:34.362 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.358+0000 7fa555b83640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa550110b30 con 0x7fa550101080 2024-08-19T00:22:34.362 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.358+0000 7fa555b83640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fa5501109b0 con 0x7fa5501006e0 2024-08-19T00:22:34.362 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.358+0000 7fa555b83640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa550110cb0 con 0x7fa5501066f0 2024-08-19T00:22:34.362 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.358+0000 7fa54effd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa550101080 0x7fa550198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:34.362 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.358+0000 7fa54effd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa550101080 0x7fa550198570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55608/0 (socket says 172.21.15.44:55608) 2024-08-19T00:22:34.363 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.359+0000 7fa54effd640 1 -- 172.21.15.44:0/3034548472 learned_addr learned my addr 172.21.15.44:0/3034548472 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:22:34.363 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.359+0000 7fa54f7fe640 1 --2- 172.21.15.44:0/3034548472 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa5501006e0 0x7fa550198030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:34.363 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.359+0000 7fa54ffff640 1 --2- 172.21.15.44:0/3034548472 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa5501066f0 0x7fa55019c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:34.363 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.359+0000 7fa54effd640 1 -- 172.21.15.44:0/3034548472 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa5501066f0 msgr2=0x7fa55019c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:22:34.363 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.359+0000 7fa54effd640 1 --2- 172.21.15.44:0/3034548472 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa5501066f0 0x7fa55019c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:34.363 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.359+0000 7fa54effd640 1 -- 172.21.15.44:0/3034548472 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa5501006e0 msgr2=0x7fa550198030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:22:34.363 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.359+0000 7fa54effd640 1 --2- 172.21.15.44:0/3034548472 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa5501006e0 0x7fa550198030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:34.363 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.359+0000 7fa54effd640 1 -- 172.21.15.44:0/3034548472 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa55019d020 con 0x7fa550101080 2024-08-19T00:22:34.363 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.359+0000 7fa54f7fe640 1 --2- 172.21.15.44:0/3034548472 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa5501006e0 0x7fa550198030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:22:34.363 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.359+0000 7fa54effd640 1 --2- 172.21.15.44:0/3034548472 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa550101080 0x7fa550198570 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fa54400e9f0 tx=0x7fa54400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:22:34.363 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.359+0000 7fa54cff9640 1 -- 172.21.15.44:0/3034548472 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa54400cd80 con 0x7fa550101080 2024-08-19T00:22:34.363 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.359+0000 7fa54cff9640 1 -- 172.21.15.44:0/3034548472 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa544010910 con 0x7fa550101080 2024-08-19T00:22:34.363 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.359+0000 7fa54cff9640 1 -- 172.21.15.44:0/3034548472 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa544018990 con 0x7fa550101080 2024-08-19T00:22:34.363 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.359+0000 7fa555b83640 1 -- 172.21.15.44:0/3034548472 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa55019d310 con 0x7fa550101080 2024-08-19T00:22:34.364 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.359+0000 7fa555b83640 1 -- 172.21.15.44:0/3034548472 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5501a4ba0 con 0x7fa550101080 2024-08-19T00:22:34.366 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.362+0000 7fa54cff9640 1 -- 172.21.15.44:0/3034548472 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fa544010ac0 con 0x7fa550101080 2024-08-19T00:22:34.366 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.362+0000 7fa558a14740 1 Processor -- start 2024-08-19T00:22:34.366 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.362+0000 7fa558a14740 1 -- start start 2024-08-19T00:22:34.367 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.363+0000 7fa558a14740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a8c2897d0 0x563a8c289bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:34.367 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.363+0000 7fa558a14740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a8c28a0f0 0x563a8c294450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:34.367 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.363+0000 7fa558a14740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563a8c294990 0x563a8c296d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:34.367 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.363+0000 7fa558a14740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x563a8c1ed9d0 con 0x563a8c28a0f0 2024-08-19T00:22:34.367 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.363+0000 7fa558a14740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x563a8c195820 con 0x563a8c294990 2024-08-19T00:22:34.367 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.363+0000 7fa558a14740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x563a8c1e9990 con 0x563a8c2897d0 2024-08-19T00:22:34.367 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.363+0000 7fa54f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a8c28a0f0 0x563a8c294450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:34.367 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.363+0000 7fa54f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a8c28a0f0 0x563a8c294450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55618/0 (socket says 172.21.15.44:55618) 2024-08-19T00:22:34.367 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.363+0000 7fa54f7fe640 1 -- 172.21.15.44:0/4081989234 learned_addr learned my addr 172.21.15.44:0/4081989234 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:22:34.367 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.363+0000 7fa54ffff640 1 --2- 172.21.15.44:0/4081989234 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a8c2897d0 0x563a8c289bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:34.367 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.363+0000 7fa54effd640 1 --2- 172.21.15.44:0/4081989234 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563a8c294990 0x563a8c296d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:34.367 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.363+0000 7fa54ffff640 1 -- 172.21.15.44:0/4081989234 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563a8c294990 msgr2=0x563a8c296d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:22:34.368 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.363+0000 7fa54ffff640 1 --2- 172.21.15.44:0/4081989234 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563a8c294990 0x563a8c296d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:34.368 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.363+0000 7fa54cff9640 1 --2- 172.21.15.44:0/3034548472 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fa5380a2da0 0x7fa5380a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:34.368 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.363+0000 7fa54ffff640 1 -- 172.21.15.44:0/4081989234 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a8c28a0f0 msgr2=0x563a8c294450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:22:34.368 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.363+0000 7fa54ffff640 1 --2- 172.21.15.44:0/4081989234 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a8c28a0f0 0x563a8c294450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:34.368 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.363+0000 7fa54ffff640 1 -- 172.21.15.44:0/4081989234 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a8bf01210 con 0x563a8c2897d0 2024-08-19T00:22:34.368 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.363+0000 7fa54f7fe640 1 --2- 172.21.15.44:0/4081989234 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a8c28a0f0 0x563a8c294450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:22:34.368 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.363+0000 7fa54effd640 1 --2- 172.21.15.44:0/4081989234 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563a8c294990 0x563a8c296d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:22:34.368 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.363+0000 7fa54cff9640 1 -- 172.21.15.44:0/3034548472 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9533+0+0 (secure 0 0 0) 0x7fa5440cfb30 con 0x7fa550101080 2024-08-19T00:22:34.368 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.364+0000 7fa54ffff640 1 --2- 172.21.15.44:0/4081989234 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a8c2897d0 0x563a8c289bb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa548009ca0 tx=0x7fa548009a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88a1c94148c2c77b server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:22:34.368 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.364+0000 7fa54ffff640 1 --2- 172.21.15.44:0/3034548472 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fa5380a2da0 0x7fa5380a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:34.368 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.364+0000 7fa535ffb640 1 -- 172.21.15.44:0/4081989234 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa548048070 con 0x563a8c2897d0 2024-08-19T00:22:34.368 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.364+0000 7fa535ffb640 1 -- 172.21.15.44:0/4081989234 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa548036070 con 0x563a8c2897d0 2024-08-19T00:22:34.368 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.364+0000 7fa535ffb640 1 -- 172.21.15.44:0/4081989234 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5480305a0 con 0x563a8c2897d0 2024-08-19T00:22:34.369 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.364+0000 7fa558a14740 1 -- 172.21.15.44:0/4081989234 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a8c2897d0 msgr2=0x563a8c289bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:22:34.369 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.364+0000 7fa54ffff640 1 --2- 172.21.15.44:0/3034548472 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fa5380a2da0 0x7fa5380a5260 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa548006010 tx=0x7fa548030c70 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:22:34.369 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.364+0000 7fa558a14740 1 --2- 172.21.15.44:0/4081989234 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a8c2897d0 0x563a8c289bb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa548009ca0 tx=0x7fa548009a20 comp rx=0 tx=0).stop 2024-08-19T00:22:34.369 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.365+0000 7fa558a14740 1 -- 172.21.15.44:0/4081989234 shutdown_connections 2024-08-19T00:22:34.369 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.365+0000 7fa558a14740 1 --2- 172.21.15.44:0/4081989234 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563a8c294990 0x563a8c296d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:34.369 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.365+0000 7fa558a14740 1 --2- 172.21.15.44:0/4081989234 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a8c28a0f0 0x563a8c294450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:34.369 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.365+0000 7fa558a14740 1 --2- 172.21.15.44:0/4081989234 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a8c2897d0 0x563a8c289bb0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:34.369 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.365+0000 7fa558a14740 1 -- 172.21.15.44:0/4081989234 >> 172.21.15.44:0/4081989234 conn(0x563a8c285d40 msgr2=0x563a8c286120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:22:34.369 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.365+0000 7fa558a14740 1 -- 172.21.15.44:0/4081989234 shutdown_connections 2024-08-19T00:22:34.369 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.365+0000 7fa558a14740 1 -- 172.21.15.44:0/4081989234 wait complete. 2024-08-19T00:22:34.369 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.365+0000 7fa558a14740 1 -- start start 2024-08-19T00:22:34.369 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.365+0000 7fa558a14740 1 Processor -- start 2024-08-19T00:22:34.373 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.365+0000 7fa558a14740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a8c2897d0 0x563a8c291880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:34.373 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.365+0000 7fa558a14740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563a8c28a0f0 0x563a8c291dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:34.373 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.365+0000 7fa558a14740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a8c294990 0x563a8c292300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:34.373 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.365+0000 7fa558a14740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x563a8c297560 con 0x563a8c294990 2024-08-19T00:22:34.373 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.365+0000 7fa558a14740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x563a8c1a9520 con 0x563a8c28a0f0 2024-08-19T00:22:34.373 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.365+0000 7fa558a14740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x563a8c2976e0 con 0x563a8c2897d0 2024-08-19T00:22:34.373 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.365+0000 7fa558a14740 10 client.0 _ll_register_callbacks cb 0x563a8bf00a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:22:34.373 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.366+0000 7fa54f7fe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a8c2897d0 0x563a8c291880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:34.373 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.366+0000 7fa54ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a8c294990 0x563a8c292300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:34.373 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.366+0000 7fa54f7fe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a8c2897d0 0x563a8c291880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.44:56576/0 (socket says 172.21.15.44:56576) 2024-08-19T00:22:34.374 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.366+0000 7fa54f7fe640 1 -- 172.21.15.44:0/2713435202 learned_addr learned my addr 172.21.15.44:0/2713435202 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:22:34.374 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.366+0000 7fa54effd640 1 --2- 172.21.15.44:0/2713435202 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563a8c28a0f0 0x563a8c291dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:34.374 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.366+0000 7fa54effd640 1 -- 172.21.15.44:0/2713435202 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a8c2897d0 msgr2=0x563a8c291880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:22:34.374 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.366+0000 7fa54effd640 1 --2- 172.21.15.44:0/2713435202 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a8c2897d0 0x563a8c291880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:34.374 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.366+0000 7fa54effd640 1 -- 172.21.15.44:0/2713435202 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a8c294990 msgr2=0x563a8c292300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:22:34.374 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.366+0000 7fa54effd640 1 --2- 172.21.15.44:0/2713435202 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a8c294990 0x563a8c292300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:34.374 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.366+0000 7fa54effd640 1 -- 172.21.15.44:0/2713435202 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a8bfcd620 con 0x563a8c28a0f0 2024-08-19T00:22:34.374 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.366+0000 7fa54f7fe640 1 --2- 172.21.15.44:0/2713435202 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a8c2897d0 0x563a8c291880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:22:34.374 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.366+0000 7fa54ffff640 1 --2- 172.21.15.44:0/2713435202 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a8c294990 0x563a8c292300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:22:34.374 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.366+0000 7fa54effd640 1 --2- 172.21.15.44:0/2713435202 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563a8c28a0f0 0x563a8c291dc0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa5440cce90 tx=0x7fa54409b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe00e0badf447dbc server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:22:34.374 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.366+0000 7fa52effd640 10 client.0 ms_handle_connect on v2:172.21.15.116:3300/0 2024-08-19T00:22:34.374 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.366+0000 7fa52effd640 1 -- 172.21.15.44:0/2713435202 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa544018d30 con 0x563a8c28a0f0 2024-08-19T00:22:34.375 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.366+0000 7fa558a14740 1 -- 172.21.15.44:0/2713435202 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa548036070 con 0x563a8c28a0f0 2024-08-19T00:22:34.375 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.366+0000 7fa52effd640 1 -- 172.21.15.44:0/2713435202 <== mon.2 v2:172.21.15.116:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9533+0+0 (secure 0 0 0) 0x7fa54409b160 con 0x563a8c28a0f0 2024-08-19T00:22:34.375 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.366+0000 7fa52effd640 1 -- 172.21.15.44:0/2713435202 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fa5440a0010 con 0x563a8c28a0f0 2024-08-19T00:22:34.375 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.366+0000 7fa558a14740 10 client.26090 fetch_fsmap learned FSMap version 33 2024-08-19T00:22:34.375 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.366+0000 7fa558a14740 1 -- 172.21.15.44:0/2713435202 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x563a8c2a3220 con 0x563a8c28a0f0 2024-08-19T00:22:34.375 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.367+0000 7fa52effd640 1 -- 172.21.15.44:0/2713435202 <== mon.2 v2:172.21.15.116:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa548036070 con 0x563a8c28a0f0 2024-08-19T00:22:34.375 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.367+0000 7fa52effd640 1 -- 172.21.15.44:0/2713435202 <== mon.2 v2:172.21.15.116:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7fa5440b4020 con 0x563a8c28a0f0 2024-08-19T00:22:34.375 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.367+0000 7fa558a14740 10 client.26090 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:22:34.375 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.367+0000 7fa558a14740 10 client.26090 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:22:34.375 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.367+0000 7fa558a14740 20 client.26090 populate_metadata read hostname 'smithi044' 2024-08-19T00:22:34.375 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.367+0000 7fa558a14740 1 --2- 172.21.15.44:0/2713435202 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x563a8c2a4810 0x563a8c2a6c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:34.375 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.367+0000 7fa558a14740 4 client.26090 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:22:34.375 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.367+0000 7fa558a14740 1 -- 172.21.15.44:0/2713435202 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563a8c1fb100 con 0x563a8c2a4810 2024-08-19T00:22:34.375 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.367+0000 7fa54f7fe640 1 --2- 172.21.15.44:0/2713435202 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x563a8c2a4810 0x563a8c2a6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:34.376 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.367+0000 7fa52effd640 10 client.26090 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:22:34.376 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.367+0000 7fa54f7fe640 1 --2- 172.21.15.44:0/2713435202 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x563a8c2a4810 0x563a8c2a6c00 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6bd7ebf4aa67116 server_cookie=b05600f6fb5d6e77 in_seq=0 out_seq=0 2024-08-19T00:22:34.376 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.368+0000 7fa52effd640 1 -- 172.21.15.44:0/2713435202 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563a8c1fb100 con 0x563a8c2a4810 2024-08-19T00:22:34.376 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.368+0000 7fa52effd640 10 client.26090 handle_command_reply: tid=0 2024-08-19T00:22:34.376 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.368+0000 7fa558a14740 1 client.26090 shutdown 2024-08-19T00:22:34.376 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.368+0000 7fa558a14740 1 -- 172.21.15.44:0/2713435202 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563a8c28a0f0 msgr2=0x563a8c291dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:22:34.376 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.368+0000 7fa558a14740 1 --2- 172.21.15.44:0/2713435202 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563a8c28a0f0 0x563a8c291dc0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa5440cce90 tx=0x7fa54409b910 comp rx=0 tx=0).stop 2024-08-19T00:22:34.376 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.368+0000 7fa558a14740 1 -- 172.21.15.44:0/2713435202 shutdown_connections 2024-08-19T00:22:34.376 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.368+0000 7fa558a14740 1 --2- 172.21.15.44:0/2713435202 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x563a8c2a4810 0x563a8c2a6c00 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:34.376 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.368+0000 7fa558a14740 1 --2- 172.21.15.44:0/2713435202 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a8c294990 0x563a8c292300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:34.376 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.368+0000 7fa558a14740 1 --2- 172.21.15.44:0/2713435202 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563a8c28a0f0 0x563a8c291dc0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:34.376 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.368+0000 7fa558a14740 1 --2- 172.21.15.44:0/2713435202 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a8c2897d0 0x563a8c291880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:34.376 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.368+0000 7fa52effd640 0 client.26090 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:22:34.377 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.368+0000 7fa558a14740 1 -- 172.21.15.44:0/2713435202 >> 172.21.15.44:0/2713435202 conn(0x563a8c285d40 msgr2=0x563a8c28ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:22:34.377 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.368+0000 7fa558a14740 1 -- 172.21.15.44:0/2713435202 shutdown_connections 2024-08-19T00:22:34.377 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.368+0000 7fa558a14740 1 -- 172.21.15.44:0/2713435202 wait complete. 2024-08-19T00:22:34.377 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.368+0000 7fa558a14740 20 client.26090 trim_cache size 0 max 16384 2024-08-19T00:22:34.388 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.385+0000 7fa558a14740 1 Processor -- start 2024-08-19T00:22:34.388 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.385+0000 7fa558a14740 1 -- start start 2024-08-19T00:22:34.388 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.385+0000 7fa558a14740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563a8c2897d0 0x563a8c280920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:34.388 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.385+0000 7fa558a14740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a8c28a0f0 0x563a8c292130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:34.388 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.385+0000 7fa558a14740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a8c294990 0x563a8c2ac3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:34.388 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.385+0000 7fa558a14740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa5501aece0 con 0x563a8c294990 2024-08-19T00:22:34.388 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.385+0000 7fa558a14740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fa5501b0820 con 0x563a8c2897d0 2024-08-19T00:22:34.388 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.385+0000 7fa558a14740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa5501af3b0 con 0x563a8c28a0f0 2024-08-19T00:22:34.388 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.385+0000 7fa54ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a8c294990 0x563a8c2ac3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:34.388 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.385+0000 7fa54ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a8c294990 0x563a8c2ac3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55638/0 (socket says 172.21.15.44:55638) 2024-08-19T00:22:34.388 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.385+0000 7fa54ffff640 1 -- 172.21.15.44:0/2945605239 learned_addr learned my addr 172.21.15.44:0/2945605239 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:22:34.389 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.385+0000 7fa54effd640 1 --2- 172.21.15.44:0/2945605239 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a8c28a0f0 0x563a8c292130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:34.389 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.385+0000 7fa54f7fe640 1 --2- 172.21.15.44:0/2945605239 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563a8c2897d0 0x563a8c280920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:34.389 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.385+0000 7fa54ffff640 1 -- 172.21.15.44:0/2945605239 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a8c28a0f0 msgr2=0x563a8c292130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:22:34.389 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.385+0000 7fa54ffff640 1 --2- 172.21.15.44:0/2945605239 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a8c28a0f0 0x563a8c292130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:34.389 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.385+0000 7fa54ffff640 1 -- 172.21.15.44:0/2945605239 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563a8c2897d0 msgr2=0x563a8c280920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:22:34.389 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.385+0000 7fa54ffff640 1 --2- 172.21.15.44:0/2945605239 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563a8c2897d0 0x563a8c280920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:34.389 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.385+0000 7fa54ffff640 1 -- 172.21.15.44:0/2945605239 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a8c290810 con 0x563a8c294990 2024-08-19T00:22:34.389 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.385+0000 7fa54f7fe640 1 --2- 172.21.15.44:0/2945605239 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563a8c2897d0 0x563a8c280920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:22:34.389 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.386+0000 7fa54ffff640 1 --2- 172.21.15.44:0/2945605239 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a8c294990 0x563a8c2ac3e0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fa54803c7e0 tx=0x7fa548050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e221093845480c46 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:22:34.389 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.386+0000 7fa5357fa640 1 -- 172.21.15.44:0/2945605239 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa548048040 con 0x563a8c294990 2024-08-19T00:22:34.389 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.386+0000 7fa5357fa640 1 -- 172.21.15.44:0/2945605239 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa548060070 con 0x563a8c294990 2024-08-19T00:22:34.389 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.386+0000 7fa5357fa640 1 -- 172.21.15.44:0/2945605239 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa54803c960 con 0x563a8c294990 2024-08-19T00:22:34.393 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.387+0000 7fa558a14740 1 -- 172.21.15.44:0/2945605239 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a8c294990 msgr2=0x563a8c2ac3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:22:34.393 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.387+0000 7fa558a14740 1 --2- 172.21.15.44:0/2945605239 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a8c294990 0x563a8c2ac3e0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fa54803c7e0 tx=0x7fa548050000 comp rx=0 tx=0).stop 2024-08-19T00:22:34.393 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.387+0000 7fa558a14740 1 -- 172.21.15.44:0/2945605239 shutdown_connections 2024-08-19T00:22:34.393 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.387+0000 7fa558a14740 1 --2- 172.21.15.44:0/2945605239 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a8c28a0f0 0x563a8c292130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:34.393 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.387+0000 7fa558a14740 1 --2- 172.21.15.44:0/2945605239 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a8c294990 0x563a8c2ac3e0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:34.393 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.387+0000 7fa558a14740 1 --2- 172.21.15.44:0/2945605239 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563a8c2897d0 0x563a8c280920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:34.393 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.387+0000 7fa558a14740 1 -- 172.21.15.44:0/2945605239 >> 172.21.15.44:0/2945605239 conn(0x563a8c285d40 msgr2=0x563a8c2937f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:22:34.393 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.387+0000 7fa558a14740 1 -- 172.21.15.44:0/2945605239 shutdown_connections 2024-08-19T00:22:34.393 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.387+0000 7fa558a14740 1 -- 172.21.15.44:0/2945605239 wait complete. 2024-08-19T00:22:34.393 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.387+0000 7fa558a14740 1 -- start start 2024-08-19T00:22:34.393 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.387+0000 7fa558a14740 1 Processor -- start 2024-08-19T00:22:34.394 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.387+0000 7fa558a14740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a8c2897d0 0x563a8c29d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:34.394 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.388+0000 7fa558a14740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a8c28a0f0 0x563a8c298430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:34.394 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.388+0000 7fa558a14740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563a8c294990 0x563a8c298970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:34.394 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.388+0000 7fa558a14740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa5501b0150 con 0x563a8c2897d0 2024-08-19T00:22:34.394 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.388+0000 7fa558a14740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fa5501afa80 con 0x563a8c294990 2024-08-19T00:22:34.394 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.388+0000 7fa558a14740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa5501acce0 con 0x563a8c28a0f0 2024-08-19T00:22:34.394 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.388+0000 7fa558a14740 10 client.0 _ll_register_callbacks cb 0x7fa544098060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:22:34.394 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.388+0000 7fa54f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a8c2897d0 0x563a8c29d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:34.394 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.388+0000 7fa54f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a8c2897d0 0x563a8c29d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55640/0 (socket says 172.21.15.44:55640) 2024-08-19T00:22:34.394 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.388+0000 7fa54f7fe640 1 -- 172.21.15.44:0/2925547713 learned_addr learned my addr 172.21.15.44:0/2925547713 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:22:34.394 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.388+0000 7fa54effd640 1 --2- 172.21.15.44:0/2925547713 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a8c28a0f0 0x563a8c298430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:34.394 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.388+0000 7fa54ffff640 1 --2- 172.21.15.44:0/2925547713 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563a8c294990 0x563a8c298970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:34.394 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.388+0000 7fa54f7fe640 1 -- 172.21.15.44:0/2925547713 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a8c28a0f0 msgr2=0x563a8c298430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:22:34.395 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.388+0000 7fa54f7fe640 1 --2- 172.21.15.44:0/2925547713 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a8c28a0f0 0x563a8c298430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:34.395 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.388+0000 7fa54f7fe640 1 -- 172.21.15.44:0/2925547713 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563a8c294990 msgr2=0x563a8c298970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:22:34.395 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.388+0000 7fa54f7fe640 1 --2- 172.21.15.44:0/2925547713 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563a8c294990 0x563a8c298970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:34.395 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.388+0000 7fa54f7fe640 1 -- 172.21.15.44:0/2925547713 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a8c2a6f70 con 0x563a8c2897d0 2024-08-19T00:22:34.395 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.388+0000 7fa54f7fe640 1 --2- 172.21.15.44:0/2925547713 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a8c2897d0 0x563a8c29d110 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fa540005f60 tx=0x7fa540012e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ca3763cecc3d0d9 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:22:34.395 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.388+0000 7fa52effd640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:22:34.395 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.388+0000 7fa52effd640 1 -- 172.21.15.44:0/2925547713 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa540022070 con 0x563a8c2897d0 2024-08-19T00:22:34.395 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.388+0000 7fa52effd640 1 -- 172.21.15.44:0/2925547713 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9533+0+0 (secure 0 0 0) 0x7fa540005220 con 0x563a8c2897d0 2024-08-19T00:22:34.395 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.388+0000 7fa558a14740 1 -- 172.21.15.44:0/2925547713 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa548060070 con 0x563a8c2897d0 2024-08-19T00:22:34.395 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.388+0000 7fa52effd640 1 -- 172.21.15.44:0/2925547713 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fa540005420 con 0x563a8c2897d0 2024-08-19T00:22:34.395 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.388+0000 7fa558a14740 10 client.16683 fetch_fsmap learned FSMap version 33 2024-08-19T00:22:34.395 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.388+0000 7fa558a14740 1 -- 172.21.15.44:0/2925547713 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x563a8c30f2b0 con 0x563a8c2897d0 2024-08-19T00:22:34.395 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.389+0000 7fa52effd640 1 -- 172.21.15.44:0/2925547713 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa548060070 con 0x563a8c2897d0 2024-08-19T00:22:34.396 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.389+0000 7fa52effd640 1 -- 172.21.15.44:0/2925547713 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7fa5400038f0 con 0x563a8c2897d0 2024-08-19T00:22:34.396 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.389+0000 7fa558a14740 10 client.16683 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:22:34.396 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.389+0000 7fa558a14740 10 client.16683 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:22:34.396 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.389+0000 7fa558a14740 20 client.16683 populate_metadata read hostname 'smithi044' 2024-08-19T00:22:34.396 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.389+0000 7fa558a14740 1 --2- 172.21.15.44:0/2925547713 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x563a8c30fa00 0x563a8c311e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:34.396 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.389+0000 7fa558a14740 4 client.16683 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-19T00:22:34.396 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.389+0000 7fa558a14740 1 -- 172.21.15.44:0/2925547713 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563a8c1f5450 con 0x563a8c30fa00 2024-08-19T00:22:34.396 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.389+0000 7fa54effd640 1 --2- 172.21.15.44:0/2925547713 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x563a8c30fa00 0x563a8c311e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:34.396 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.389+0000 7fa52effd640 10 client.16683 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:22:34.396 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.389+0000 7fa54effd640 1 --2- 172.21.15.44:0/2925547713 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x563a8c30fa00 0x563a8c311e20 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1c2d45154fa7bb6 server_cookie=5a3a0291441695b5 in_seq=0 out_seq=0 2024-08-19T00:22:34.400 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.398+0000 7fa52effd640 1 -- 172.21.15.44:0/2925547713 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563a8c1f5450 con 0x563a8c30fa00 2024-08-19T00:22:34.400 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.398+0000 7fa52effd640 10 client.16683 handle_command_reply: tid=0 2024-08-19T00:22:34.400 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.398+0000 7fa558a14740 1 client.16683 shutdown 2024-08-19T00:22:34.400 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.398+0000 7fa558a14740 1 -- 172.21.15.44:0/2925547713 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a8c2897d0 msgr2=0x563a8c29d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:22:34.400 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.398+0000 7fa558a14740 1 --2- 172.21.15.44:0/2925547713 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a8c2897d0 0x563a8c29d110 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fa540005f60 tx=0x7fa540012e00 comp rx=0 tx=0).stop 2024-08-19T00:22:34.401 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.398+0000 7fa558a14740 1 -- 172.21.15.44:0/2925547713 shutdown_connections 2024-08-19T00:22:34.401 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.398+0000 7fa558a14740 1 --2- 172.21.15.44:0/2925547713 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x563a8c30fa00 0x563a8c311e20 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:34.401 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.398+0000 7fa558a14740 1 --2- 172.21.15.44:0/2925547713 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a8c28a0f0 0x563a8c298430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:34.401 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.398+0000 7fa558a14740 1 --2- 172.21.15.44:0/2925547713 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563a8c294990 0x563a8c298970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:34.401 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.398+0000 7fa52effd640 0 client.16683 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:22:34.401 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.398+0000 7fa558a14740 1 --2- 172.21.15.44:0/2925547713 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563a8c2897d0 0x563a8c29d110 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:34.401 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.398+0000 7fa558a14740 1 -- 172.21.15.44:0/2925547713 >> 172.21.15.44:0/2925547713 conn(0x563a8c285d40 msgr2=0x563a8c284680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:22:34.401 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.398+0000 7fa558a14740 1 -- 172.21.15.44:0/2925547713 shutdown_connections 2024-08-19T00:22:34.401 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.398+0000 7fa558a14740 1 -- 172.21.15.44:0/2925547713 wait complete. 2024-08-19T00:22:34.401 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.398+0000 7fa558a14740 20 client.16683 trim_cache size 0 max 16384 2024-08-19T00:22:34.401 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:{ 2024-08-19T00:22:34.402 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "message": "", 2024-08-19T00:22:34.402 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "return_code": 0 2024-08-19T00:22:34.402 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:} 2024-08-19T00:22:34.403 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.399+0000 7fa555b83640 1 -- 172.21.15.44:0/3034548472 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fa5380a2da0 msgr2=0x7fa5380a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:22:34.403 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.399+0000 7fa555b83640 1 --2- 172.21.15.44:0/3034548472 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fa5380a2da0 0x7fa5380a5260 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa548006010 tx=0x7fa548030c70 comp rx=0 tx=0).stop 2024-08-19T00:22:34.403 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.399+0000 7fa555b83640 1 -- 172.21.15.44:0/3034548472 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa550101080 msgr2=0x7fa550198570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:22:34.403 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.399+0000 7fa555b83640 1 --2- 172.21.15.44:0/3034548472 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa550101080 0x7fa550198570 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fa54400e9f0 tx=0x7fa54400eeb0 comp rx=0 tx=0).stop 2024-08-19T00:22:34.403 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.399+0000 7fa555b83640 1 -- 172.21.15.44:0/3034548472 shutdown_connections 2024-08-19T00:22:34.403 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.399+0000 7fa555b83640 1 --2- 172.21.15.44:0/3034548472 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fa5380a2da0 0x7fa5380a5260 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:34.403 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.399+0000 7fa555b83640 1 --2- 172.21.15.44:0/3034548472 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa5501066f0 0x7fa55019c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:34.403 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.399+0000 7fa555b83640 1 --2- 172.21.15.44:0/3034548472 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa550101080 0x7fa550198570 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:34.403 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.399+0000 7fa555b83640 1 --2- 172.21.15.44:0/3034548472 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa5501006e0 0x7fa550198030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:34.403 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.399+0000 7fa555b83640 1 -- 172.21.15.44:0/3034548472 >> 172.21.15.44:0/3034548472 conn(0x7fa5500776c0 msgr2=0x7fa5500ff320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:22:34.403 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.399+0000 7fa555b83640 1 -- 172.21.15.44:0/3034548472 shutdown_connections 2024-08-19T00:22:34.403 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:34.399+0000 7fa555b83640 1 -- 172.21.15.44:0/3034548472 wait complete. 2024-08-19T00:22:34.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:22:34 smithi171 ceph-mon[21810]: pgmap v286: 129 pgs: 129 active+clean; 496 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 1.9 MiB/s wr, 168 op/s 2024-08-19T00:22:34.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:22:34 smithi116 ceph-mon[21873]: pgmap v286: 129 pgs: 129 active+clean; 496 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 1.9 MiB/s wr, 168 op/s 2024-08-19T00:22:34.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:22:34 smithi044 ceph-mon[18489]: pgmap v286: 129 pgs: 129 active+clean; 496 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 1.9 MiB/s wr, 168 op/s 2024-08-19T00:22:34.691 INFO:tasks.workunit.client.0.smithi044.stdout: 1 682741 7.80 MB/sec execute 359 sec latency 11.774 ms 2024-08-19T00:22:35.691 INFO:tasks.workunit.client.0.smithi044.stdout: 1 685398 7.83 MB/sec execute 360 sec latency 17.535 ms 2024-08-19T00:22:36.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:22:36 smithi171 ceph-mon[21810]: pgmap v287: 129 pgs: 129 active+clean; 506 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 3.0 MiB/s wr, 258 op/s 2024-08-19T00:22:36.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:22:36 smithi116 ceph-mon[21873]: pgmap v287: 129 pgs: 129 active+clean; 506 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 3.0 MiB/s wr, 258 op/s 2024-08-19T00:22:36.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:22:36 smithi044 ceph-mon[18489]: pgmap v287: 129 pgs: 129 active+clean; 506 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 3.0 MiB/s wr, 258 op/s 2024-08-19T00:22:36.691 INFO:tasks.workunit.client.0.smithi044.stdout: 1 687049 7.82 MB/sec execute 361 sec latency 15.618 ms 2024-08-19T00:22:37.691 INFO:tasks.workunit.client.0.smithi044.stdout: 1 689288 7.84 MB/sec execute 362 sec latency 39.666 ms 2024-08-19T00:22:38.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:22:38 smithi171 ceph-mon[21810]: pgmap v288: 129 pgs: 129 active+clean; 506 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.0 MiB/s wr, 171 op/s 2024-08-19T00:22:38.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:22:38 smithi116 ceph-mon[21873]: pgmap v288: 129 pgs: 129 active+clean; 506 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.0 MiB/s wr, 171 op/s 2024-08-19T00:22:38.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:22:38 smithi044 ceph-mon[18489]: pgmap v288: 129 pgs: 129 active+clean; 506 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.0 MiB/s wr, 171 op/s 2024-08-19T00:22:38.691 INFO:tasks.workunit.client.0.smithi044.stdout: 1 691149 7.84 MB/sec execute 363 sec latency 23.562 ms 2024-08-19T00:22:39.691 INFO:tasks.workunit.client.0.smithi044.stdout: 1 693243 7.85 MB/sec execute 364 sec latency 29.437 ms 2024-08-19T00:22:40.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:22:40 smithi171 ceph-mon[21810]: pgmap v289: 129 pgs: 129 active+clean; 506 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.0 MiB/s wr, 171 op/s 2024-08-19T00:22:40.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:22:40 smithi116 ceph-mon[21873]: pgmap v289: 129 pgs: 129 active+clean; 506 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.0 MiB/s wr, 171 op/s 2024-08-19T00:22:40.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:22:40 smithi044 ceph-mon[18489]: pgmap v289: 129 pgs: 129 active+clean; 506 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.0 MiB/s wr, 171 op/s 2024-08-19T00:22:40.691 INFO:tasks.workunit.client.0.smithi044.stdout: 1 695489 7.86 MB/sec execute 365 sec latency 19.525 ms 2024-08-19T00:22:41.691 INFO:tasks.workunit.client.0.smithi044.stdout: 1 697475 7.87 MB/sec execute 366 sec latency 13.283 ms 2024-08-19T00:22:42.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:22:42 smithi171 ceph-mon[21810]: pgmap v290: 129 pgs: 129 active+clean; 515 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 3.7 MiB/s wr, 277 op/s 2024-08-19T00:22:42.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:22:42 smithi116 ceph-mon[21873]: pgmap v290: 129 pgs: 129 active+clean; 515 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 3.7 MiB/s wr, 277 op/s 2024-08-19T00:22:42.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:22:42 smithi044 ceph-mon[18489]: pgmap v290: 129 pgs: 129 active+clean; 515 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 3.7 MiB/s wr, 277 op/s 2024-08-19T00:22:42.691 INFO:tasks.workunit.client.0.smithi044.stdout: 1 699741 7.89 MB/sec execute 367 sec latency 69.516 ms 2024-08-19T00:22:43.691 INFO:tasks.workunit.client.0.smithi044.stdout: 1 701242 7.88 MB/sec execute 368 sec latency 20.255 ms 2024-08-19T00:22:44.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:22:44 smithi171 ceph-mon[21810]: pgmap v291: 129 pgs: 129 active+clean; 515 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.7 MiB/s wr, 195 op/s 2024-08-19T00:22:44.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:22:44 smithi116 ceph-mon[21873]: pgmap v291: 129 pgs: 129 active+clean; 515 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.7 MiB/s wr, 195 op/s 2024-08-19T00:22:44.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:22:44 smithi044 ceph-mon[18489]: pgmap v291: 129 pgs: 129 active+clean; 515 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.7 MiB/s wr, 195 op/s 2024-08-19T00:22:44.691 INFO:tasks.workunit.client.0.smithi044.stdout: 1 703569 7.90 MB/sec execute 369 sec latency 19.361 ms 2024-08-19T00:22:45.691 INFO:tasks.workunit.client.0.smithi044.stdout: 1 705621 7.90 MB/sec execute 370 sec latency 16.023 ms 2024-08-19T00:22:46.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:22:46 smithi171 ceph-mon[21810]: pgmap v292: 129 pgs: 129 active+clean; 492 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 4.6 MiB/s wr, 305 op/s 2024-08-19T00:22:46.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:22:46 smithi116 ceph-mon[21873]: pgmap v292: 129 pgs: 129 active+clean; 492 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 4.6 MiB/s wr, 305 op/s 2024-08-19T00:22:46.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:22:46 smithi044 ceph-mon[18489]: pgmap v292: 129 pgs: 129 active+clean; 492 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 4.6 MiB/s wr, 305 op/s 2024-08-19T00:22:46.691 INFO:tasks.workunit.client.0.smithi044.stdout: 1 707809 7.91 MB/sec execute 371 sec latency 12.295 ms 2024-08-19T00:22:47.493 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.489+0000 7fdda64fc640 1 -- 172.21.15.44:0/1341294859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdda0106710 msgr2=0x7fdda0106af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:22:47.493 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.489+0000 7fdda64fc640 1 --2- 172.21.15.44:0/1341294859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdda0106710 0x7fdda0106af0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fdd90009930 tx=0x7fdd9002a420 comp rx=0 tx=0).stop 2024-08-19T00:22:47.493 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.489+0000 7fdda64fc640 1 -- 172.21.15.44:0/1341294859 shutdown_connections 2024-08-19T00:22:47.493 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.489+0000 7fdda64fc640 1 --2- 172.21.15.44:0/1341294859 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdda01010a0 0x7fdda010d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:47.493 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.489+0000 7fdda64fc640 1 --2- 172.21.15.44:0/1341294859 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdda0100700 0x7fdda0100b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:47.494 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.489+0000 7fdda64fc640 1 --2- 172.21.15.44:0/1341294859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdda0106710 0x7fdda0106af0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:47.494 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.489+0000 7fdda64fc640 1 -- 172.21.15.44:0/1341294859 >> 172.21.15.44:0/1341294859 conn(0x7fdda00fc3e0 msgr2=0x7fdda00fe800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:22:47.494 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.489+0000 7fdda64fc640 1 -- 172.21.15.44:0/1341294859 shutdown_connections 2024-08-19T00:22:47.494 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.489+0000 7fdda64fc640 1 -- 172.21.15.44:0/1341294859 wait complete. 2024-08-19T00:22:47.494 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.490+0000 7fdda64fc640 1 Processor -- start 2024-08-19T00:22:47.494 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.490+0000 7fdda64fc640 1 -- start start 2024-08-19T00:22:47.494 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.490+0000 7fdda64fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdda0100700 0x7fdda019a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:47.494 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.490+0000 7fdda64fc640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdda01010a0 0x7fdda019a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:47.494 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.490+0000 7fdda64fc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdda0106710 0x7fdda019eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:47.494 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.490+0000 7fdda64fc640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdda0111c40 con 0x7fdda0100700 2024-08-19T00:22:47.495 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.490+0000 7fdda64fc640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fdda0111ac0 con 0x7fdda0106710 2024-08-19T00:22:47.495 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.490+0000 7fdda64fc640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fdda0111dc0 con 0x7fdda01010a0 2024-08-19T00:22:47.495 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.490+0000 7fdd9ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdda0100700 0x7fdda019a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:47.495 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.490+0000 7fdd9ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdda0100700 0x7fdda019a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52140/0 (socket says 172.21.15.44:52140) 2024-08-19T00:22:47.495 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.490+0000 7fdd9ffff640 1 -- 172.21.15.44:0/3349225656 learned_addr learned my addr 172.21.15.44:0/3349225656 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:22:47.495 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.490+0000 7fdd9f7fe640 1 --2- 172.21.15.44:0/3349225656 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdda01010a0 0x7fdda019a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:47.495 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.491+0000 7fdda4a99640 1 --2- 172.21.15.44:0/3349225656 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdda0106710 0x7fdda019eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:47.495 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.491+0000 7fdd9ffff640 1 -- 172.21.15.44:0/3349225656 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdda01010a0 msgr2=0x7fdda019a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:22:47.495 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.491+0000 7fdd9ffff640 1 --2- 172.21.15.44:0/3349225656 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdda01010a0 0x7fdda019a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:47.495 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.491+0000 7fdd9ffff640 1 -- 172.21.15.44:0/3349225656 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdda0106710 msgr2=0x7fdda019eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:22:47.495 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.491+0000 7fdd9ffff640 1 --2- 172.21.15.44:0/3349225656 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdda0106710 0x7fdda019eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:47.495 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.491+0000 7fdd9ffff640 1 -- 172.21.15.44:0/3349225656 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdda019f2d0 con 0x7fdda0100700 2024-08-19T00:22:47.496 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.491+0000 7fdda4a99640 1 --2- 172.21.15.44:0/3349225656 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdda0106710 0x7fdda019eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:22:47.496 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.491+0000 7fdd9ffff640 1 --2- 172.21.15.44:0/3349225656 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdda0100700 0x7fdda019a2e0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fdd90009230 tx=0x7fdd90004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:22:47.496 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.491+0000 7fdd9d7fa640 1 -- 172.21.15.44:0/3349225656 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd9003f030 con 0x7fdda0100700 2024-08-19T00:22:47.496 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.491+0000 7fdda64fc640 1 -- 172.21.15.44:0/3349225656 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdda019f560 con 0x7fdda0100700 2024-08-19T00:22:47.496 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.491+0000 7fdd9d7fa640 1 -- 172.21.15.44:0/3349225656 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd90004440 con 0x7fdda0100700 2024-08-19T00:22:47.496 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.491+0000 7fdd9d7fa640 1 -- 172.21.15.44:0/3349225656 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd90035070 con 0x7fdda0100700 2024-08-19T00:22:47.496 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.491+0000 7fdda64fc640 1 -- 172.21.15.44:0/3349225656 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdda01a6e50 con 0x7fdda0100700 2024-08-19T00:22:47.503 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.494+0000 7fdd9d7fa640 1 -- 172.21.15.44:0/3349225656 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fdd90042030 con 0x7fdda0100700 2024-08-19T00:22:47.503 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.494+0000 7fdd9d7fa640 1 --2- 172.21.15.44:0/3349225656 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fdd880a2da0 0x7fdd880a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:47.503 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.495+0000 7fdd9f7fe640 1 --2- 172.21.15.44:0/3349225656 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fdd880a2da0 0x7fdd880a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:47.503 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.495+0000 7fdd9d7fa640 1 -- 172.21.15.44:0/3349225656 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9533+0+0 (secure 0 0 0) 0x7fdd900efb30 con 0x7fdda0100700 2024-08-19T00:22:47.503 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.495+0000 7fdda92b6740 1 Processor -- start 2024-08-19T00:22:47.503 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.495+0000 7fdda92b6740 1 -- start start 2024-08-19T00:22:47.503 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.495+0000 7fdda92b6740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55596e0bd7d0 0x55596e0bdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:47.503 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.495+0000 7fdda92b6740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55596e0be0f0 0x55596e0c8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:47.503 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.495+0000 7fdda92b6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55596e0c8990 0x55596e0cad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:47.504 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.495+0000 7fdda92b6740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55596e0219d0 con 0x55596e0c8990 2024-08-19T00:22:47.504 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.495+0000 7fdda92b6740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55596dfc9820 con 0x55596e0be0f0 2024-08-19T00:22:47.504 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.495+0000 7fdda92b6740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55596e01d990 con 0x55596e0bd7d0 2024-08-19T00:22:47.504 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.495+0000 7fdd9ffff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55596e0bd7d0 0x55596e0bdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:47.504 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.495+0000 7fdda4a99640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55596e0c8990 0x55596e0cad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:47.504 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.495+0000 7fdd9f7fe640 1 --2- 172.21.15.44:0/3349225656 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fdd880a2da0 0x7fdd880a5260 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdda010cce0 tx=0x7fdd94005f90 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:22:47.504 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.495+0000 7fdd9ffff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55596e0bd7d0 0x55596e0bdbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.44:39192/0 (socket says 172.21.15.44:39192) 2024-08-19T00:22:47.504 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.495+0000 7fdd9ffff640 1 -- 172.21.15.44:0/1133839731 learned_addr learned my addr 172.21.15.44:0/1133839731 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:22:47.504 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.495+0000 7fdda4a99640 1 --2- 172.21.15.44:0/1133839731 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55596e0c8990 0x55596e0cad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52150/0 (socket says 172.21.15.44:52150) 2024-08-19T00:22:47.504 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.495+0000 7fdd9f7fe640 1 --2- 172.21.15.44:0/1133839731 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55596e0be0f0 0x55596e0c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:47.504 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.495+0000 7fdd9ffff640 1 -- 172.21.15.44:0/1133839731 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55596e0be0f0 msgr2=0x55596e0c8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:22:47.504 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.495+0000 7fdd9ffff640 1 --2- 172.21.15.44:0/1133839731 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55596e0be0f0 0x55596e0c8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:47.504 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.495+0000 7fdd9ffff640 1 -- 172.21.15.44:0/1133839731 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55596e0c8990 msgr2=0x55596e0cad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:22:47.505 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.495+0000 7fdd9ffff640 1 --2- 172.21.15.44:0/1133839731 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55596e0c8990 0x55596e0cad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:47.505 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.495+0000 7fdd9ffff640 1 -- 172.21.15.44:0/1133839731 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55596dd35210 con 0x55596e0bd7d0 2024-08-19T00:22:47.505 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.495+0000 7fdda4a99640 1 --2- 172.21.15.44:0/1133839731 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55596e0c8990 0x55596e0cad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:22:47.505 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.496+0000 7fdd9ffff640 1 --2- 172.21.15.44:0/1133839731 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55596e0bd7d0 0x55596e0bdbb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdd900c43a0 tx=0x7fdd90009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34ea3157a2f2c35e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:22:47.505 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.496+0000 7fdd867fc640 1 -- 172.21.15.44:0/1133839731 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd90049040 con 0x55596e0bd7d0 2024-08-19T00:22:47.505 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.496+0000 7fdd867fc640 1 -- 172.21.15.44:0/1133839731 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd900d1070 con 0x55596e0bd7d0 2024-08-19T00:22:47.505 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.496+0000 7fdd867fc640 1 -- 172.21.15.44:0/1133839731 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd900bb160 con 0x55596e0bd7d0 2024-08-19T00:22:47.505 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.497+0000 7fdda92b6740 1 -- 172.21.15.44:0/1133839731 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55596e0bd7d0 msgr2=0x55596e0bdbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:22:47.505 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.497+0000 7fdda92b6740 1 --2- 172.21.15.44:0/1133839731 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55596e0bd7d0 0x55596e0bdbb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdd900c43a0 tx=0x7fdd90009260 comp rx=0 tx=0).stop 2024-08-19T00:22:47.505 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.497+0000 7fdda92b6740 1 -- 172.21.15.44:0/1133839731 shutdown_connections 2024-08-19T00:22:47.505 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.497+0000 7fdda92b6740 1 --2- 172.21.15.44:0/1133839731 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55596e0c8990 0x55596e0cad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:47.505 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.497+0000 7fdda92b6740 1 --2- 172.21.15.44:0/1133839731 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55596e0be0f0 0x55596e0c8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:47.505 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.497+0000 7fdda92b6740 1 --2- 172.21.15.44:0/1133839731 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55596e0bd7d0 0x55596e0bdbb0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:47.506 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.497+0000 7fdda92b6740 1 -- 172.21.15.44:0/1133839731 >> 172.21.15.44:0/1133839731 conn(0x55596e0b9d40 msgr2=0x55596e0ba120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:22:47.506 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.497+0000 7fdda92b6740 1 -- 172.21.15.44:0/1133839731 shutdown_connections 2024-08-19T00:22:47.506 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.497+0000 7fdda92b6740 1 -- 172.21.15.44:0/1133839731 wait complete. 2024-08-19T00:22:47.506 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.497+0000 7fdda92b6740 1 -- start start 2024-08-19T00:22:47.506 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.497+0000 7fdda92b6740 1 Processor -- start 2024-08-19T00:22:47.506 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.498+0000 7fdda92b6740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55596e0bd7d0 0x55596e0c5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:47.506 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.498+0000 7fdda92b6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55596e0be0f0 0x55596e0c5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:47.506 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.498+0000 7fdda92b6740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55596e0c8990 0x55596e0c6380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:47.506 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.498+0000 7fdda92b6740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55596e0cb320 con 0x55596e0be0f0 2024-08-19T00:22:47.507 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.498+0000 7fdda92b6740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55596dfdd520 con 0x55596e0c8990 2024-08-19T00:22:47.507 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.498+0000 7fdda92b6740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55596e0cb4a0 con 0x55596e0bd7d0 2024-08-19T00:22:47.507 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.498+0000 7fdda92b6740 10 client.0 _ll_register_callbacks cb 0x55596dd34a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:22:47.507 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.498+0000 7fdd9f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55596e0be0f0 0x55596e0c5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:47.507 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.498+0000 7fdd9f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55596e0be0f0 0x55596e0c5e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52162/0 (socket says 172.21.15.44:52162) 2024-08-19T00:22:47.507 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.498+0000 7fdd9f7fe640 1 -- 172.21.15.44:0/2132384346 learned_addr learned my addr 172.21.15.44:0/2132384346 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:22:47.507 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.498+0000 7fdd9ffff640 1 --2- 172.21.15.44:0/2132384346 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55596e0bd7d0 0x55596e0c5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:47.507 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.498+0000 7fdda4a99640 1 --2- 172.21.15.44:0/2132384346 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55596e0c8990 0x55596e0c6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:47.507 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.498+0000 7fdd9f7fe640 1 -- 172.21.15.44:0/2132384346 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55596e0bd7d0 msgr2=0x55596e0c5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:22:47.507 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.498+0000 7fdd9f7fe640 1 --2- 172.21.15.44:0/2132384346 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55596e0bd7d0 0x55596e0c5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:47.507 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.498+0000 7fdd9f7fe640 1 -- 172.21.15.44:0/2132384346 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55596e0c8990 msgr2=0x55596e0c6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:22:47.507 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.498+0000 7fdd9f7fe640 1 --2- 172.21.15.44:0/2132384346 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55596e0c8990 0x55596e0c6380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:47.507 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.498+0000 7fdd9f7fe640 1 -- 172.21.15.44:0/2132384346 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55596de01620 con 0x55596e0be0f0 2024-08-19T00:22:47.508 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.498+0000 7fdd9f7fe640 1 --2- 172.21.15.44:0/2132384346 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55596e0be0f0 0x55596e0c5e40 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fdd9400ed20 tx=0x7fdd94004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d266e76f7a305d0a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:22:47.508 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.498+0000 7fdd7f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:22:47.508 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.498+0000 7fdd7f7fe640 1 -- 172.21.15.44:0/2132384346 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd9401daa0 con 0x55596e0be0f0 2024-08-19T00:22:47.508 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.498+0000 7fdda92b6740 1 -- 172.21.15.44:0/2132384346 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd900d1070 con 0x55596e0be0f0 2024-08-19T00:22:47.508 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.498+0000 7fdd7f7fe640 1 -- 172.21.15.44:0/2132384346 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9533+0+0 (secure 0 0 0) 0x7fdd9401dc40 con 0x55596e0be0f0 2024-08-19T00:22:47.508 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.499+0000 7fdd7f7fe640 1 -- 172.21.15.44:0/2132384346 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fdd94031050 con 0x55596e0be0f0 2024-08-19T00:22:47.508 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.499+0000 7fdda92b6740 10 client.16695 fetch_fsmap learned FSMap version 33 2024-08-19T00:22:47.508 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.499+0000 7fdda92b6740 1 -- 172.21.15.44:0/2132384346 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55596e0d6fa0 con 0x55596e0be0f0 2024-08-19T00:22:47.508 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.499+0000 7fdd7f7fe640 1 -- 172.21.15.44:0/2132384346 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd900d1070 con 0x55596e0be0f0 2024-08-19T00:22:47.508 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.499+0000 7fdd7f7fe640 1 -- 172.21.15.44:0/2132384346 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7fdd94005490 con 0x55596e0be0f0 2024-08-19T00:22:47.509 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.499+0000 7fdda92b6740 10 client.16695 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:22:47.509 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.499+0000 7fdda92b6740 10 client.16695 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:22:47.509 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.499+0000 7fdda92b6740 20 client.16695 populate_metadata read hostname 'smithi044' 2024-08-19T00:22:47.509 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.499+0000 7fdda92b6740 1 --2- 172.21.15.44:0/2132384346 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55596e0d84d0 0x55596e0da910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:47.509 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.499+0000 7fdda92b6740 4 client.16695 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:22:47.510 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.499+0000 7fdda92b6740 1 -- 172.21.15.44:0/2132384346 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55596e02f100 con 0x55596e0d84d0 2024-08-19T00:22:47.510 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.499+0000 7fdd9ffff640 1 --2- 172.21.15.44:0/2132384346 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55596e0d84d0 0x55596e0da910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:47.510 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.500+0000 7fdd7f7fe640 10 client.16695 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:22:47.510 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.500+0000 7fdd9ffff640 1 --2- 172.21.15.44:0/2132384346 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55596e0d84d0 0x55596e0da910 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66a4fa5817cd16f8 server_cookie=2084c3bc568a6cff in_seq=0 out_seq=0 2024-08-19T00:22:47.510 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.500+0000 7fdd7f7fe640 1 -- 172.21.15.44:0/2132384346 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55596e02f100 con 0x55596e0d84d0 2024-08-19T00:22:47.510 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.500+0000 7fdd7f7fe640 10 client.16695 handle_command_reply: tid=0 2024-08-19T00:22:47.510 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.500+0000 7fdda92b6740 1 client.16695 shutdown 2024-08-19T00:22:47.510 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.500+0000 7fdda92b6740 1 -- 172.21.15.44:0/2132384346 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55596e0be0f0 msgr2=0x55596e0c5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:22:47.510 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.500+0000 7fdda92b6740 1 --2- 172.21.15.44:0/2132384346 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55596e0be0f0 0x55596e0c5e40 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fdd9400ed20 tx=0x7fdd94004730 comp rx=0 tx=0).stop 2024-08-19T00:22:47.510 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.500+0000 7fdda92b6740 1 -- 172.21.15.44:0/2132384346 shutdown_connections 2024-08-19T00:22:47.510 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.500+0000 7fdda92b6740 1 --2- 172.21.15.44:0/2132384346 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55596e0d84d0 0x55596e0da910 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:47.511 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.500+0000 7fdda92b6740 1 --2- 172.21.15.44:0/2132384346 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55596e0c8990 0x55596e0c6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:47.511 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.500+0000 7fdda92b6740 1 --2- 172.21.15.44:0/2132384346 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55596e0be0f0 0x55596e0c5e40 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:47.511 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.500+0000 7fdd7f7fe640 0 client.16695 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:22:47.511 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.500+0000 7fdda92b6740 1 --2- 172.21.15.44:0/2132384346 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55596e0bd7d0 0x55596e0c5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:47.511 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.500+0000 7fdda92b6740 1 -- 172.21.15.44:0/2132384346 >> 172.21.15.44:0/2132384346 conn(0x55596e0b9d40 msgr2=0x55596e0bfa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:22:47.511 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.501+0000 7fdda92b6740 1 -- 172.21.15.44:0/2132384346 shutdown_connections 2024-08-19T00:22:47.511 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.501+0000 7fdda92b6740 1 -- 172.21.15.44:0/2132384346 wait complete. 2024-08-19T00:22:47.511 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.501+0000 7fdda92b6740 20 client.16695 trim_cache size 0 max 16384 2024-08-19T00:22:47.523 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.515+0000 7fdda92b6740 1 Processor -- start 2024-08-19T00:22:47.523 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.515+0000 7fdda92b6740 1 -- start start 2024-08-19T00:22:47.523 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.516+0000 7fdda92b6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55596e0bd7d0 0x55596e0b9690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:47.524 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.516+0000 7fdda92b6740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55596e0be0f0 0x55596e0c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:47.524 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.516+0000 7fdda92b6740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55596e0c8990 0x55596e0e01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:47.524 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.516+0000 7fdda92b6740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdda01b1030 con 0x55596e0bd7d0 2024-08-19T00:22:47.524 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.516+0000 7fdda92b6740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fdda01b2b70 con 0x55596e0c8990 2024-08-19T00:22:47.524 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.516+0000 7fdda92b6740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fdda01b1700 con 0x55596e0be0f0 2024-08-19T00:22:47.524 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.516+0000 7fdd9ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55596e0bd7d0 0x55596e0b9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:47.524 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.516+0000 7fdd9ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55596e0bd7d0 0x55596e0b9690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52168/0 (socket says 172.21.15.44:52168) 2024-08-19T00:22:47.524 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.516+0000 7fdd9ffff640 1 -- 172.21.15.44:0/2725893941 learned_addr learned my addr 172.21.15.44:0/2725893941 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:22:47.524 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.516+0000 7fdda4a99640 1 --2- 172.21.15.44:0/2725893941 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55596e0c8990 0x55596e0e01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:47.524 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.516+0000 7fdd9f7fe640 1 --2- 172.21.15.44:0/2725893941 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55596e0be0f0 0x55596e0c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:47.524 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.516+0000 7fdd9ffff640 1 -- 172.21.15.44:0/2725893941 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55596e0be0f0 msgr2=0x55596e0c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:22:47.524 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.516+0000 7fdd9ffff640 1 --2- 172.21.15.44:0/2725893941 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55596e0be0f0 0x55596e0c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:47.525 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.516+0000 7fdd9ffff640 1 -- 172.21.15.44:0/2725893941 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55596e0c8990 msgr2=0x55596e0e01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:22:47.525 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.516+0000 7fdd9ffff640 1 --2- 172.21.15.44:0/2725893941 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55596e0c8990 0x55596e0e01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:47.525 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.516+0000 7fdd9ffff640 1 -- 172.21.15.44:0/2725893941 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55596e0bd600 con 0x55596e0bd7d0 2024-08-19T00:22:47.525 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.516+0000 7fdd9ffff640 1 --2- 172.21.15.44:0/2725893941 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55596e0bd7d0 0x55596e0b9690 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fdd90009900 tx=0x7fdd9002a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=842097a75f089e58 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:22:47.525 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.516+0000 7fdd85ffb640 1 -- 172.21.15.44:0/2725893941 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd900d4e60 con 0x55596e0bd7d0 2024-08-19T00:22:47.525 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.516+0000 7fdd85ffb640 1 -- 172.21.15.44:0/2725893941 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd900d1040 con 0x55596e0bd7d0 2024-08-19T00:22:47.525 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.516+0000 7fdd85ffb640 1 -- 172.21.15.44:0/2725893941 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd90049040 con 0x55596e0bd7d0 2024-08-19T00:22:47.525 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.517+0000 7fdda92b6740 1 -- 172.21.15.44:0/2725893941 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55596e0bd7d0 msgr2=0x55596e0b9690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:22:47.525 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.517+0000 7fdda92b6740 1 --2- 172.21.15.44:0/2725893941 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55596e0bd7d0 0x55596e0b9690 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fdd90009900 tx=0x7fdd9002a420 comp rx=0 tx=0).stop 2024-08-19T00:22:47.525 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.517+0000 7fdda92b6740 1 -- 172.21.15.44:0/2725893941 shutdown_connections 2024-08-19T00:22:47.525 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.517+0000 7fdda92b6740 1 --2- 172.21.15.44:0/2725893941 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55596e0be0f0 0x55596e0c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:47.525 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.517+0000 7fdda92b6740 1 --2- 172.21.15.44:0/2725893941 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55596e0c8990 0x55596e0e01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:47.526 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.517+0000 7fdda92b6740 1 --2- 172.21.15.44:0/2725893941 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55596e0bd7d0 0x55596e0b9690 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:47.526 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.517+0000 7fdda92b6740 1 -- 172.21.15.44:0/2725893941 >> 172.21.15.44:0/2725893941 conn(0x55596e0b9d40 msgr2=0x55596e0c7050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:22:47.526 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.517+0000 7fdda92b6740 1 -- 172.21.15.44:0/2725893941 shutdown_connections 2024-08-19T00:22:47.526 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.517+0000 7fdda92b6740 1 -- 172.21.15.44:0/2725893941 wait complete. 2024-08-19T00:22:47.526 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.517+0000 7fdda92b6740 1 -- start start 2024-08-19T00:22:47.526 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.518+0000 7fdda92b6740 1 Processor -- start 2024-08-19T00:22:47.526 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.518+0000 7fdda92b6740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55596e0bd7d0 0x55596e0c29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:47.526 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.518+0000 7fdda92b6740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55596e0be0f0 0x55596e0c2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:47.526 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.518+0000 7fdda92b6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55596e0c8990 0x55596e0c3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:47.526 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.518+0000 7fdda92b6740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdda01b24a0 con 0x55596e0c8990 2024-08-19T00:22:47.526 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.518+0000 7fdda92b6740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fdda01b1dd0 con 0x55596e0bd7d0 2024-08-19T00:22:47.526 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.518+0000 7fdda92b6740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fdda01af030 con 0x55596e0be0f0 2024-08-19T00:22:47.526 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.518+0000 7fdda92b6740 10 client.0 _ll_register_callbacks cb 0x7fdd9400e470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:22:47.527 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.518+0000 7fdda4a99640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55596e0c8990 0x55596e0c3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:47.527 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.518+0000 7fdda4a99640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55596e0c8990 0x55596e0c3420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52176/0 (socket says 172.21.15.44:52176) 2024-08-19T00:22:47.527 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.518+0000 7fdda4a99640 1 -- 172.21.15.44:0/490779844 learned_addr learned my addr 172.21.15.44:0/490779844 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:22:47.527 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.518+0000 7fdd9ffff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55596e0bd7d0 0x55596e0c29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:47.527 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.518+0000 7fdd9f7fe640 1 --2- 172.21.15.44:0/490779844 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55596e0be0f0 0x55596e0c2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:47.527 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.518+0000 7fdda4a99640 1 -- 172.21.15.44:0/490779844 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55596e0be0f0 msgr2=0x55596e0c2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:22:47.527 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.518+0000 7fdda4a99640 1 --2- 172.21.15.44:0/490779844 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55596e0be0f0 0x55596e0c2ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:47.527 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.518+0000 7fdda4a99640 1 -- 172.21.15.44:0/490779844 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55596e0bd7d0 msgr2=0x55596e0c29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:22:47.528 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.518+0000 7fdda4a99640 1 --2- 172.21.15.44:0/490779844 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55596e0bd7d0 0x55596e0c29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:47.528 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.518+0000 7fdda4a99640 1 -- 172.21.15.44:0/490779844 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55596e142260 con 0x55596e0c8990 2024-08-19T00:22:47.528 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.518+0000 7fdd9ffff640 1 --2- 172.21.15.44:0/490779844 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55596e0bd7d0 0x55596e0c29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:22:47.528 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.518+0000 7fdda4a99640 1 --2- 172.21.15.44:0/490779844 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55596e0c8990 0x55596e0c3420 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fdd98005c00 tx=0x7fdd980128e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e340a6bfc60f9e9 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:22:47.528 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.518+0000 7fdd7f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:22:47.528 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.518+0000 7fdd7f7fe640 1 -- 172.21.15.44:0/490779844 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd98022020 con 0x55596e0c8990 2024-08-19T00:22:47.528 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.519+0000 7fdd7f7fe640 1 -- 172.21.15.44:0/490779844 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9533+0+0 (secure 0 0 0) 0x7fdd98004d20 con 0x55596e0c8990 2024-08-19T00:22:47.528 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.519+0000 7fdda92b6740 1 -- 172.21.15.44:0/490779844 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd900d1040 con 0x55596e0c8990 2024-08-19T00:22:47.528 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.519+0000 7fdd7f7fe640 1 -- 172.21.15.44:0/490779844 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fdd9802a050 con 0x55596e0c8990 2024-08-19T00:22:47.528 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.519+0000 7fdda92b6740 10 client.16701 fetch_fsmap learned FSMap version 33 2024-08-19T00:22:47.528 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.519+0000 7fdda92b6740 1 -- 172.21.15.44:0/490779844 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55596e1435b0 con 0x55596e0c8990 2024-08-19T00:22:47.528 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.519+0000 7fdd7f7fe640 1 -- 172.21.15.44:0/490779844 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd900d1040 con 0x55596e0c8990 2024-08-19T00:22:47.528 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.519+0000 7fdd7f7fe640 1 -- 172.21.15.44:0/490779844 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7fdd98010690 con 0x55596e0c8990 2024-08-19T00:22:47.529 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.519+0000 7fdda92b6740 10 client.16701 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:22:47.529 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.519+0000 7fdda92b6740 10 client.16701 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:22:47.529 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.519+0000 7fdda92b6740 20 client.16701 populate_metadata read hostname 'smithi044' 2024-08-19T00:22:47.529 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.519+0000 7fdda92b6740 1 --2- 172.21.15.44:0/490779844 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55596e143d80 0x55596e1461a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:22:47.529 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.519+0000 7fdda92b6740 4 client.16701 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-19T00:22:47.529 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.519+0000 7fdda92b6740 1 -- 172.21.15.44:0/490779844 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55596e029450 con 0x55596e143d80 2024-08-19T00:22:47.529 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.519+0000 7fdd9ffff640 1 --2- 172.21.15.44:0/490779844 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55596e143d80 0x55596e1461a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:22:47.529 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.520+0000 7fdd9ffff640 1 --2- 172.21.15.44:0/490779844 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55596e143d80 0x55596e1461a0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e24c31a867a699 server_cookie=a8ba23b70617b229 in_seq=0 out_seq=0 2024-08-19T00:22:47.529 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.520+0000 7fdd7f7fe640 10 client.16701 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:22:47.531 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.529+0000 7fdd7f7fe640 1 -- 172.21.15.44:0/490779844 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55596e029450 con 0x55596e143d80 2024-08-19T00:22:47.531 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.529+0000 7fdd7f7fe640 10 client.16701 handle_command_reply: tid=0 2024-08-19T00:22:47.531 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.529+0000 7fdda92b6740 1 client.16701 shutdown 2024-08-19T00:22:47.532 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.529+0000 7fdda92b6740 1 -- 172.21.15.44:0/490779844 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55596e0c8990 msgr2=0x55596e0c3420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:22:47.532 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.529+0000 7fdda92b6740 1 --2- 172.21.15.44:0/490779844 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55596e0c8990 0x55596e0c3420 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fdd98005c00 tx=0x7fdd980128e0 comp rx=0 tx=0).stop 2024-08-19T00:22:47.532 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.529+0000 7fdda92b6740 1 -- 172.21.15.44:0/490779844 shutdown_connections 2024-08-19T00:22:47.532 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.529+0000 7fdda92b6740 1 --2- 172.21.15.44:0/490779844 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55596e143d80 0x55596e1461a0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:47.532 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.529+0000 7fdda92b6740 1 --2- 172.21.15.44:0/490779844 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55596e0be0f0 0x55596e0c2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:47.532 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.529+0000 7fdda92b6740 1 --2- 172.21.15.44:0/490779844 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55596e0c8990 0x55596e0c3420 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:47.532 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.529+0000 7fdd7f7fe640 0 client.16701 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:22:47.532 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.529+0000 7fdda92b6740 1 --2- 172.21.15.44:0/490779844 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55596e0bd7d0 0x55596e0c29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:47.532 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.529+0000 7fdda92b6740 1 -- 172.21.15.44:0/490779844 >> 172.21.15.44:0/490779844 conn(0x55596e0b9d40 msgr2=0x55596e0bfa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:22:47.532 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.529+0000 7fdda92b6740 1 -- 172.21.15.44:0/490779844 shutdown_connections 2024-08-19T00:22:47.532 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.529+0000 7fdda92b6740 1 -- 172.21.15.44:0/490779844 wait complete. 2024-08-19T00:22:47.532 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.530+0000 7fdda92b6740 20 client.16701 trim_cache size 0 max 16384 2024-08-19T00:22:47.533 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:{ 2024-08-19T00:22:47.533 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "message": "", 2024-08-19T00:22:47.533 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "return_code": 0 2024-08-19T00:22:47.533 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:} 2024-08-19T00:22:47.534 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.530+0000 7fdda64fc640 1 -- 172.21.15.44:0/3349225656 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fdd880a2da0 msgr2=0x7fdd880a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:22:47.534 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.530+0000 7fdda64fc640 1 --2- 172.21.15.44:0/3349225656 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fdd880a2da0 0x7fdd880a5260 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdda010cce0 tx=0x7fdd94005f90 comp rx=0 tx=0).stop 2024-08-19T00:22:47.534 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.530+0000 7fdda64fc640 1 -- 172.21.15.44:0/3349225656 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdda0100700 msgr2=0x7fdda019a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:22:47.534 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.530+0000 7fdda64fc640 1 --2- 172.21.15.44:0/3349225656 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdda0100700 0x7fdda019a2e0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fdd90009230 tx=0x7fdd90004040 comp rx=0 tx=0).stop 2024-08-19T00:22:47.534 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.530+0000 7fdda64fc640 1 -- 172.21.15.44:0/3349225656 shutdown_connections 2024-08-19T00:22:47.534 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.530+0000 7fdda64fc640 1 --2- 172.21.15.44:0/3349225656 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fdd880a2da0 0x7fdd880a5260 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:47.534 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.530+0000 7fdda64fc640 1 --2- 172.21.15.44:0/3349225656 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdda01010a0 0x7fdda019a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:47.534 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.530+0000 7fdda64fc640 1 --2- 172.21.15.44:0/3349225656 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdda0106710 0x7fdda019eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:47.534 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.530+0000 7fdda64fc640 1 --2- 172.21.15.44:0/3349225656 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdda0100700 0x7fdda019a2e0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:22:47.535 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.530+0000 7fdda64fc640 1 -- 172.21.15.44:0/3349225656 >> 172.21.15.44:0/3349225656 conn(0x7fdda00fc3e0 msgr2=0x7fdda010bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:22:47.535 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.530+0000 7fdda64fc640 1 -- 172.21.15.44:0/3349225656 shutdown_connections 2024-08-19T00:22:47.535 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:22:47.530+0000 7fdda64fc640 1 -- 172.21.15.44:0/3349225656 wait complete. 2024-08-19T00:22:47.692 INFO:tasks.workunit.client.0.smithi044.stdout: 1 710200 7.93 MB/sec execute 372 sec latency 32.656 ms 2024-08-19T00:22:48.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:22:48 smithi171 ceph-mon[21810]: pgmap v293: 129 pgs: 129 active+clean; 492 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.6 MiB/s wr, 216 op/s 2024-08-19T00:22:48.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:22:48 smithi116 ceph-mon[21873]: pgmap v293: 129 pgs: 129 active+clean; 492 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.6 MiB/s wr, 216 op/s 2024-08-19T00:22:48.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:22:48 smithi044 ceph-mon[18489]: pgmap v293: 129 pgs: 129 active+clean; 492 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.6 MiB/s wr, 216 op/s 2024-08-19T00:22:48.691 INFO:tasks.workunit.client.0.smithi044.stdout: 1 711503 7.92 MB/sec execute 373 sec latency 59.627 ms 2024-08-19T00:22:49.691 INFO:tasks.workunit.client.0.smithi044.stdout: 1 714009 7.95 MB/sec execute 374 sec latency 14.319 ms 2024-08-19T00:22:50.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:22:50 smithi171 ceph-mon[21810]: pgmap v294: 129 pgs: 129 active+clean; 492 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.6 MiB/s wr, 216 op/s 2024-08-19T00:22:50.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:22:50 smithi116 ceph-mon[21873]: pgmap v294: 129 pgs: 129 active+clean; 492 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.6 MiB/s wr, 216 op/s 2024-08-19T00:22:50.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:22:50 smithi044 ceph-mon[18489]: pgmap v294: 129 pgs: 129 active+clean; 492 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.6 MiB/s wr, 216 op/s 2024-08-19T00:22:50.691 INFO:tasks.workunit.client.0.smithi044.stdout: 1 716065 7.94 MB/sec execute 375 sec latency 15.078 ms 2024-08-19T00:22:51.691 INFO:tasks.workunit.client.0.smithi044.stdout: 1 718094 7.96 MB/sec execute 376 sec latency 14.559 ms 2024-08-19T00:22:52.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:22:52 smithi171 ceph-mon[21810]: pgmap v295: 129 pgs: 129 active+clean; 501 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.3 MiB/s wr, 329 op/s 2024-08-19T00:22:52.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:22:52 smithi116 ceph-mon[21873]: pgmap v295: 129 pgs: 129 active+clean; 501 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.3 MiB/s wr, 329 op/s 2024-08-19T00:22:52.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:22:52 smithi044 ceph-mon[18489]: pgmap v295: 129 pgs: 129 active+clean; 501 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.3 MiB/s wr, 329 op/s 2024-08-19T00:22:52.691 INFO:tasks.workunit.client.0.smithi044.stdout: 1 720334 7.97 MB/sec execute 377 sec latency 14.830 ms 2024-08-19T00:22:53.691 INFO:tasks.workunit.client.0.smithi044.stdout: 1 721902 7.97 MB/sec execute 378 sec latency 52.149 ms 2024-08-19T00:22:54.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:22:54 smithi171 ceph-mon[21810]: pgmap v296: 129 pgs: 129 active+clean; 501 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.7 MiB/s wr, 223 op/s 2024-08-19T00:22:54.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:22:54 smithi116 ceph-mon[21873]: pgmap v296: 129 pgs: 129 active+clean; 501 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.7 MiB/s wr, 223 op/s 2024-08-19T00:22:54.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:22:54 smithi044 ceph-mon[18489]: pgmap v296: 129 pgs: 129 active+clean; 501 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.7 MiB/s wr, 223 op/s 2024-08-19T00:22:54.691 INFO:tasks.workunit.client.0.smithi044.stdout: 1 724472 7.99 MB/sec execute 379 sec latency 24.526 ms 2024-08-19T00:22:55.692 INFO:tasks.workunit.client.0.smithi044.stdout: 1 726108 7.99 MB/sec execute 380 sec latency 15.459 ms 2024-08-19T00:22:56.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:22:56 smithi171 ceph-mon[21810]: pgmap v297: 129 pgs: 129 active+clean; 510 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.4 MiB/s wr, 331 op/s 2024-08-19T00:22:56.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:22:56 smithi116 ceph-mon[21873]: pgmap v297: 129 pgs: 129 active+clean; 510 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.4 MiB/s wr, 331 op/s 2024-08-19T00:22:56.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:22:56 smithi044 ceph-mon[18489]: pgmap v297: 129 pgs: 129 active+clean; 510 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.4 MiB/s wr, 331 op/s 2024-08-19T00:22:56.692 INFO:tasks.workunit.client.0.smithi044.stdout: 1 728482 8.00 MB/sec execute 381 sec latency 19.398 ms 2024-08-19T00:22:57.693 INFO:tasks.workunit.client.0.smithi044.stdout: 1 730548 8.00 MB/sec execute 382 sec latency 35.795 ms 2024-08-19T00:22:58.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:22:58 smithi171 ceph-mon[21810]: pgmap v298: 129 pgs: 129 active+clean; 510 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.4 MiB/s wr, 220 op/s 2024-08-19T00:22:58.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:22:58 smithi116 ceph-mon[21873]: pgmap v298: 129 pgs: 129 active+clean; 510 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.4 MiB/s wr, 220 op/s 2024-08-19T00:22:58.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:22:58 smithi044 ceph-mon[18489]: pgmap v298: 129 pgs: 129 active+clean; 510 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.4 MiB/s wr, 220 op/s 2024-08-19T00:22:58.692 INFO:tasks.workunit.client.0.smithi044.stdout: 1 732298 8.01 MB/sec execute 383 sec latency 71.070 ms 2024-08-19T00:22:59.692 INFO:tasks.workunit.client.0.smithi044.stdout: 1 734374 8.02 MB/sec execute 384 sec latency 47.709 ms 2024-08-19T00:23:00.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:23:00 smithi171 ceph-mon[21810]: pgmap v299: 129 pgs: 129 active+clean; 510 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.4 MiB/s wr, 220 op/s 2024-08-19T00:23:00.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:23:00 smithi116 ceph-mon[21873]: pgmap v299: 129 pgs: 129 active+clean; 510 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.4 MiB/s wr, 220 op/s 2024-08-19T00:23:00.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:23:00 smithi044 ceph-mon[18489]: pgmap v299: 129 pgs: 129 active+clean; 510 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.4 MiB/s wr, 220 op/s 2024-08-19T00:23:00.632 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.631+0000 7fb52af6f640 1 -- 172.21.15.44:0/1435925360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5241032d0 msgr2=0x7fb52410b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:00.632 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.631+0000 7fb52af6f640 1 --2- 172.21.15.44:0/1435925360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5241032d0 0x7fb52410b7b0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fb510009900 tx=0x7fb51002a480 comp rx=0 tx=0).stop 2024-08-19T00:23:00.633 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.631+0000 7fb52af6f640 1 -- 172.21.15.44:0/1435925360 shutdown_connections 2024-08-19T00:23:00.633 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.631+0000 7fb52af6f640 1 --2- 172.21.15.44:0/1435925360 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb52410be00 0x7fb52410e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:00.633 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.631+0000 7fb52af6f640 1 --2- 172.21.15.44:0/1435925360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5241032d0 0x7fb52410b7b0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:00.633 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.631+0000 7fb52af6f640 1 --2- 172.21.15.44:0/1435925360 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb5241029b0 0x7fb524102d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:00.633 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.631+0000 7fb52af6f640 1 -- 172.21.15.44:0/1435925360 >> 172.21.15.44:0/1435925360 conn(0x7fb5240776c0 msgr2=0x7fb5240fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:23:00.633 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.631+0000 7fb52af6f640 1 -- 172.21.15.44:0/1435925360 shutdown_connections 2024-08-19T00:23:00.633 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.631+0000 7fb52af6f640 1 -- 172.21.15.44:0/1435925360 wait complete. 2024-08-19T00:23:00.636 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.631+0000 7fb52af6f640 1 Processor -- start 2024-08-19T00:23:00.636 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.631+0000 7fb52af6f640 1 -- start start 2024-08-19T00:23:00.636 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.632+0000 7fb52af6f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb5241029b0 0x7fb5241a4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:00.636 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.632+0000 7fb52af6f640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5241032d0 0x7fb5241a4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:00.636 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.632+0000 7fb52af6f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb52410be00 0x7fb52410a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:00.636 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.632+0000 7fb52af6f640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb524111be0 con 0x7fb52410be00 2024-08-19T00:23:00.636 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.632+0000 7fb52af6f640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fb524111a60 con 0x7fb5241029b0 2024-08-19T00:23:00.636 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.632+0000 7fb52af6f640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb524111d60 con 0x7fb5241032d0 2024-08-19T00:23:00.636 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.632+0000 7fb52950c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb52410be00 0x7fb52410a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:00.636 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.632+0000 7fb528d0b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb5241029b0 0x7fb5241a4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:00.637 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.632+0000 7fb52950c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb52410be00 0x7fb52410a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59504/0 (socket says 172.21.15.44:59504) 2024-08-19T00:23:00.637 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.632+0000 7fb52950c640 1 -- 172.21.15.44:0/1102600512 learned_addr learned my addr 172.21.15.44:0/1102600512 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:23:00.637 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.632+0000 7fb523fff640 1 --2- 172.21.15.44:0/1102600512 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5241032d0 0x7fb5241a4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:00.637 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.632+0000 7fb52950c640 1 -- 172.21.15.44:0/1102600512 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5241032d0 msgr2=0x7fb5241a4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:00.637 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.632+0000 7fb52950c640 1 --2- 172.21.15.44:0/1102600512 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5241032d0 0x7fb5241a4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:00.637 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.632+0000 7fb52950c640 1 -- 172.21.15.44:0/1102600512 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb5241029b0 msgr2=0x7fb5241a4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:00.637 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.632+0000 7fb52950c640 1 --2- 172.21.15.44:0/1102600512 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb5241029b0 0x7fb5241a4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:00.637 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.632+0000 7fb52950c640 1 -- 172.21.15.44:0/1102600512 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb52410b0b0 con 0x7fb52410be00 2024-08-19T00:23:00.637 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.632+0000 7fb528d0b640 1 --2- 172.21.15.44:0/1102600512 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb5241029b0 0x7fb5241a4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:23:00.637 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.632+0000 7fb52950c640 1 --2- 172.21.15.44:0/1102600512 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb52410be00 0x7fb52410a930 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fb51c00eaa0 tx=0x7fb51c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:23:00.637 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.633+0000 7fb521ffb640 1 -- 172.21.15.44:0/1102600512 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb51c00cdb0 con 0x7fb52410be00 2024-08-19T00:23:00.637 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.633+0000 7fb521ffb640 1 -- 172.21.15.44:0/1102600512 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb51c005020 con 0x7fb52410be00 2024-08-19T00:23:00.638 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.633+0000 7fb521ffb640 1 -- 172.21.15.44:0/1102600512 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb51c0116b0 con 0x7fb52410be00 2024-08-19T00:23:00.638 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.633+0000 7fb52af6f640 1 -- 172.21.15.44:0/1102600512 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb52410b3a0 con 0x7fb52410be00 2024-08-19T00:23:00.638 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.633+0000 7fb52af6f640 1 -- 172.21.15.44:0/1102600512 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5241ab170 con 0x7fb52410be00 2024-08-19T00:23:00.644 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.636+0000 7fb521ffb640 1 -- 172.21.15.44:0/1102600512 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fb51c005560 con 0x7fb52410be00 2024-08-19T00:23:00.644 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.636+0000 7fb52de0b740 1 Processor -- start 2024-08-19T00:23:00.644 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.636+0000 7fb52de0b740 1 -- start start 2024-08-19T00:23:00.644 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.637+0000 7fb52de0b740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55dad01257d0 0x55dad0125bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:00.645 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.637+0000 7fb52de0b740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dad01260f0 0x55dad0130450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:00.645 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.637+0000 7fb52de0b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dad0130990 0x55dad0132d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:00.645 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.637+0000 7fb52de0b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55dad00899d0 con 0x55dad0130990 2024-08-19T00:23:00.645 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.637+0000 7fb52de0b740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55dad0031820 con 0x55dad01257d0 2024-08-19T00:23:00.645 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.637+0000 7fb52de0b740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55dad0085990 con 0x55dad01260f0 2024-08-19T00:23:00.645 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.637+0000 7fb523fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dad0130990 0x55dad0132d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:00.645 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.637+0000 7fb523fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dad0130990 0x55dad0132d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59506/0 (socket says 172.21.15.44:59506) 2024-08-19T00:23:00.645 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.637+0000 7fb523fff640 1 -- 172.21.15.44:0/2466292669 learned_addr learned my addr 172.21.15.44:0/2466292669 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:23:00.645 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.637+0000 7fb523fff640 1 --2- 172.21.15.44:0/2466292669 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55dad01257d0 0x55dad0125bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:00.645 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.637+0000 7fb521ffb640 1 --2- 172.21.15.44:0/1102600512 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fb5140a2e20 0x7fb5140a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:00.646 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.637+0000 7fb52950c640 1 --2- 172.21.15.44:0/1102600512 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fb5140a2e20 0x7fb5140a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:00.646 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.637+0000 7fb523fff640 1 -- 172.21.15.44:0/2466292669 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dad01260f0 msgr2=0x55dad0130450 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-19T00:23:00.646 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.637+0000 7fb523fff640 1 --2- 172.21.15.44:0/2466292669 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dad01260f0 0x55dad0130450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:00.646 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.637+0000 7fb523fff640 1 -- 172.21.15.44:0/2466292669 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dad0130990 msgr2=0x55dad0132d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:23:00.646 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.637+0000 7fb523fff640 1 --2- 172.21.15.44:0/2466292669 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dad0130990 0x55dad0132d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:00.646 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.637+0000 7fb521ffb640 1 -- 172.21.15.44:0/1102600512 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9533+0+0 (secure 0 0 0) 0x7fb51c0cf8c0 con 0x7fb52410be00 2024-08-19T00:23:00.646 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.637+0000 7fb523fff640 1 -- 172.21.15.44:0/2466292669 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dacfd9d210 con 0x55dad01257d0 2024-08-19T00:23:00.646 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.638+0000 7fb523fff640 1 --2- 172.21.15.44:0/2466292669 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55dad01257d0 0x55dad0125bb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb510031550 tx=0x7fb5100058d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46c63973e4b40514 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:23:00.646 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.638+0000 7fb50effd640 1 -- 172.21.15.44:0/2466292669 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb510035070 con 0x55dad01257d0 2024-08-19T00:23:00.646 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.638+0000 7fb50effd640 1 -- 172.21.15.44:0/2466292669 <== mon.2 v2:172.21.15.116:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb510032e30 con 0x55dad01257d0 2024-08-19T00:23:00.646 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.638+0000 7fb50effd640 1 -- 172.21.15.44:0/2466292669 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb510005650 con 0x55dad01257d0 2024-08-19T00:23:00.647 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.639+0000 7fb52de0b740 1 -- 172.21.15.44:0/2466292669 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55dad01257d0 msgr2=0x55dad0125bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:00.647 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.639+0000 7fb52de0b740 1 --2- 172.21.15.44:0/2466292669 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55dad01257d0 0x55dad0125bb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb510031550 tx=0x7fb5100058d0 comp rx=0 tx=0).stop 2024-08-19T00:23:00.647 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.639+0000 7fb52950c640 1 --2- 172.21.15.44:0/1102600512 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fb5140a2e20 0x7fb5140a52e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb51c00efd0 tx=0x7fb51c086040 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:23:00.647 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.639+0000 7fb52de0b740 1 -- 172.21.15.44:0/2466292669 shutdown_connections 2024-08-19T00:23:00.647 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.639+0000 7fb52de0b740 1 --2- 172.21.15.44:0/2466292669 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dad01260f0 0x55dad0130450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:00.647 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.639+0000 7fb52de0b740 1 --2- 172.21.15.44:0/2466292669 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dad0130990 0x55dad0132d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:00.647 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.639+0000 7fb52de0b740 1 --2- 172.21.15.44:0/2466292669 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55dad01257d0 0x55dad0125bb0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:00.647 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.639+0000 7fb52de0b740 1 -- 172.21.15.44:0/2466292669 >> 172.21.15.44:0/2466292669 conn(0x55dad0121d40 msgr2=0x55dad0122120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:23:00.647 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.639+0000 7fb52de0b740 1 -- 172.21.15.44:0/2466292669 shutdown_connections 2024-08-19T00:23:00.647 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.639+0000 7fb52de0b740 1 -- 172.21.15.44:0/2466292669 wait complete. 2024-08-19T00:23:00.647 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.640+0000 7fb52de0b740 1 -- start start 2024-08-19T00:23:00.647 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.640+0000 7fb52de0b740 1 Processor -- start 2024-08-19T00:23:00.647 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.640+0000 7fb52de0b740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55dad01257d0 0x55dad012d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:00.648 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.640+0000 7fb52de0b740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dad01260f0 0x55dad012dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:00.648 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.640+0000 7fb52de0b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dad0130990 0x55dad012e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:00.648 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.640+0000 7fb52de0b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55dad0133560 con 0x55dad0130990 2024-08-19T00:23:00.648 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.640+0000 7fb52de0b740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55dad0045520 con 0x55dad01257d0 2024-08-19T00:23:00.648 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.640+0000 7fb52de0b740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55dad01336e0 con 0x55dad01260f0 2024-08-19T00:23:00.648 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.640+0000 7fb523fff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55dad01257d0 0x55dad012d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:00.648 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.640+0000 7fb523fff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55dad01257d0 0x55dad012d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.44:49672/0 (socket says 172.21.15.44:49672) 2024-08-19T00:23:00.648 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.640+0000 7fb523fff640 1 -- 172.21.15.44:0/1068923262 learned_addr learned my addr 172.21.15.44:0/1068923262 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:23:00.648 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.640+0000 7fb52de0b740 10 client.0 _ll_register_callbacks cb 0x55dacfd9ca00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:23:00.648 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.640+0000 7fb523fff640 1 --2- 172.21.15.44:0/1068923262 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dad0130990 0x55dad012e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:00.648 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.641+0000 7fb528d0b640 1 --2- 172.21.15.44:0/1068923262 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dad01260f0 0x55dad012dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:00.648 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.641+0000 7fb523fff640 1 -- 172.21.15.44:0/1068923262 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dad01260f0 msgr2=0x55dad012dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:23:00.649 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.641+0000 7fb523fff640 1 --2- 172.21.15.44:0/1068923262 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dad01260f0 0x55dad012dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:00.649 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.641+0000 7fb523fff640 1 -- 172.21.15.44:0/1068923262 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dad0130990 msgr2=0x55dad012e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:23:00.649 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.641+0000 7fb523fff640 1 --2- 172.21.15.44:0/1068923262 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dad0130990 0x55dad012e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:00.649 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.641+0000 7fb523fff640 1 -- 172.21.15.44:0/1068923262 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dacfe69620 con 0x55dad01257d0 2024-08-19T00:23:00.649 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.641+0000 7fb528d0b640 1 --2- 172.21.15.44:0/1068923262 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dad01260f0 0x55dad012dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:23:00.649 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.641+0000 7fb523fff640 1 --2- 172.21.15.44:0/1068923262 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55dad01257d0 0x55dad012d8a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb510031520 tx=0x7fb510005230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=408d423271b60143 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:23:00.649 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.641+0000 7fb503fff640 10 client.0 ms_handle_connect on v2:172.21.15.116:3300/0 2024-08-19T00:23:00.649 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.641+0000 7fb503fff640 1 -- 172.21.15.44:0/1068923262 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb510035040 con 0x55dad01257d0 2024-08-19T00:23:00.649 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.641+0000 7fb52de0b740 1 -- 172.21.15.44:0/1068923262 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb510032e30 con 0x55dad01257d0 2024-08-19T00:23:00.649 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.641+0000 7fb503fff640 1 -- 172.21.15.44:0/1068923262 <== mon.2 v2:172.21.15.116:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9533+0+0 (secure 0 0 0) 0x7fb5100048c0 con 0x55dad01257d0 2024-08-19T00:23:00.649 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.641+0000 7fb503fff640 1 -- 172.21.15.44:0/1068923262 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fb510004ac0 con 0x55dad01257d0 2024-08-19T00:23:00.649 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.641+0000 7fb52de0b740 10 client.26126 fetch_fsmap learned FSMap version 33 2024-08-19T00:23:00.650 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.641+0000 7fb52de0b740 1 -- 172.21.15.44:0/1068923262 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55dad013f210 con 0x55dad01257d0 2024-08-19T00:23:00.650 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.642+0000 7fb503fff640 1 -- 172.21.15.44:0/1068923262 <== mon.2 v2:172.21.15.116:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb510032e30 con 0x55dad01257d0 2024-08-19T00:23:00.650 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.642+0000 7fb503fff640 1 -- 172.21.15.44:0/1068923262 <== mon.2 v2:172.21.15.116:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7fb510050450 con 0x55dad01257d0 2024-08-19T00:23:00.650 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.642+0000 7fb52de0b740 10 client.26126 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:23:00.650 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.642+0000 7fb52de0b740 10 client.26126 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:23:00.650 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.642+0000 7fb52de0b740 20 client.26126 populate_metadata read hostname 'smithi044' 2024-08-19T00:23:00.650 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.642+0000 7fb52de0b740 1 --2- 172.21.15.44:0/1068923262 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55dad0140560 0x55dad0142950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:00.650 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.642+0000 7fb52de0b740 4 client.26126 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:23:00.650 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.642+0000 7fb52de0b740 1 -- 172.21.15.44:0/1068923262 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dad0097100 con 0x55dad0140560 2024-08-19T00:23:00.650 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.642+0000 7fb528d0b640 1 --2- 172.21.15.44:0/1068923262 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55dad0140560 0x55dad0142950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:00.650 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.643+0000 7fb528d0b640 1 --2- 172.21.15.44:0/1068923262 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55dad0140560 0x55dad0142950 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45f85d8151a558a8 server_cookie=fff4a63fadcea72f in_seq=0 out_seq=0 2024-08-19T00:23:00.650 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.643+0000 7fb503fff640 10 client.26126 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:23:00.652 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.643+0000 7fb503fff640 1 -- 172.21.15.44:0/1068923262 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dad0097100 con 0x55dad0140560 2024-08-19T00:23:00.652 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.643+0000 7fb503fff640 10 client.26126 handle_command_reply: tid=0 2024-08-19T00:23:00.652 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.643+0000 7fb52de0b740 1 client.26126 shutdown 2024-08-19T00:23:00.652 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.644+0000 7fb52de0b740 1 -- 172.21.15.44:0/1068923262 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55dad01257d0 msgr2=0x55dad012d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:00.652 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.644+0000 7fb52de0b740 1 --2- 172.21.15.44:0/1068923262 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55dad01257d0 0x55dad012d8a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb510031520 tx=0x7fb510005230 comp rx=0 tx=0).stop 2024-08-19T00:23:00.652 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.644+0000 7fb52de0b740 1 -- 172.21.15.44:0/1068923262 shutdown_connections 2024-08-19T00:23:00.652 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.644+0000 7fb52de0b740 1 --2- 172.21.15.44:0/1068923262 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55dad0140560 0x55dad0142950 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:00.652 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.644+0000 7fb52de0b740 1 --2- 172.21.15.44:0/1068923262 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dad01260f0 0x55dad012dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:00.652 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.644+0000 7fb503fff640 0 client.26126 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:23:00.652 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.644+0000 7fb52de0b740 1 --2- 172.21.15.44:0/1068923262 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dad0130990 0x55dad012e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:00.652 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.644+0000 7fb52de0b740 1 --2- 172.21.15.44:0/1068923262 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55dad01257d0 0x55dad012d8a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:00.653 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.644+0000 7fb52de0b740 1 -- 172.21.15.44:0/1068923262 >> 172.21.15.44:0/1068923262 conn(0x55dad0121d40 msgr2=0x55dad0120ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:23:00.653 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.644+0000 7fb52de0b740 1 -- 172.21.15.44:0/1068923262 shutdown_connections 2024-08-19T00:23:00.653 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.644+0000 7fb52de0b740 1 -- 172.21.15.44:0/1068923262 wait complete. 2024-08-19T00:23:00.653 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.644+0000 7fb52de0b740 20 client.26126 trim_cache size 0 max 16384 2024-08-19T00:23:00.670 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.667+0000 7fb52de0b740 1 Processor -- start 2024-08-19T00:23:00.670 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.667+0000 7fb52de0b740 1 -- start start 2024-08-19T00:23:00.670 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.667+0000 7fb52de0b740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55dad01257d0 0x55dad012ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:00.670 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.667+0000 7fb52de0b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dad01260f0 0x55dad012b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:00.670 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.667+0000 7fb52de0b740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dad0130990 0x55dad012eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:00.670 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.667+0000 7fb52de0b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb5241b5370 con 0x55dad01260f0 2024-08-19T00:23:00.671 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.667+0000 7fb52de0b740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fb5241b6eb0 con 0x55dad01257d0 2024-08-19T00:23:00.671 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.667+0000 7fb52de0b740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb5241b5a40 con 0x55dad0130990 2024-08-19T00:23:00.671 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.668+0000 7fb523fff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55dad01257d0 0x55dad012ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:00.671 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.668+0000 7fb523fff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55dad01257d0 0x55dad012ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.44:49686/0 (socket says 172.21.15.44:49686) 2024-08-19T00:23:00.671 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.668+0000 7fb523fff640 1 -- 172.21.15.44:0/1509772606 learned_addr learned my addr 172.21.15.44:0/1509772606 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:23:00.671 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.668+0000 7fb523fff640 1 --2- 172.21.15.44:0/1509772606 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dad0130990 0x55dad012eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:00.671 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.668+0000 7fb523fff640 1 -- 172.21.15.44:0/1509772606 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dad0130990 msgr2=0x55dad012eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:23:00.671 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.668+0000 7fb523fff640 1 --2- 172.21.15.44:0/1509772606 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dad0130990 0x55dad012eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:00.671 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.668+0000 7fb523fff640 1 -- 172.21.15.44:0/1509772606 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dad01260f0 msgr2=0x55dad012b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:23:00.671 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.668+0000 7fb523fff640 1 --2- 172.21.15.44:0/1509772606 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dad01260f0 0x55dad012b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:00.671 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.668+0000 7fb523fff640 1 -- 172.21.15.44:0/1509772606 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dad0125600 con 0x55dad01257d0 2024-08-19T00:23:00.671 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.668+0000 7fb523fff640 1 --2- 172.21.15.44:0/1509772606 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55dad01257d0 0x55dad012ab80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb510031710 tx=0x7fb510005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84165c0b9f92d0db server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:23:00.671 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.668+0000 7fb50e7fc640 1 -- 172.21.15.44:0/1509772606 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb510035070 con 0x55dad01257d0 2024-08-19T00:23:00.671 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.668+0000 7fb50e7fc640 1 -- 172.21.15.44:0/1509772606 <== mon.2 v2:172.21.15.116:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb510063070 con 0x55dad01257d0 2024-08-19T00:23:00.672 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.668+0000 7fb50e7fc640 1 -- 172.21.15.44:0/1509772606 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb510050450 con 0x55dad01257d0 2024-08-19T00:23:00.674 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.669+0000 7fb52de0b740 1 -- 172.21.15.44:0/1509772606 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55dad01257d0 msgr2=0x55dad012ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:00.674 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.669+0000 7fb52de0b740 1 --2- 172.21.15.44:0/1509772606 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55dad01257d0 0x55dad012ab80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb510031710 tx=0x7fb510005fd0 comp rx=0 tx=0).stop 2024-08-19T00:23:00.674 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.669+0000 7fb52de0b740 1 -- 172.21.15.44:0/1509772606 shutdown_connections 2024-08-19T00:23:00.674 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.669+0000 7fb52de0b740 1 --2- 172.21.15.44:0/1509772606 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dad0130990 0x55dad012eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:00.674 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.669+0000 7fb52de0b740 1 --2- 172.21.15.44:0/1509772606 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dad01260f0 0x55dad012b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:00.674 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.669+0000 7fb52de0b740 1 --2- 172.21.15.44:0/1509772606 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55dad01257d0 0x55dad012ab80 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:00.674 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.669+0000 7fb52de0b740 1 -- 172.21.15.44:0/1509772606 >> 172.21.15.44:0/1509772606 conn(0x55dad0121d40 msgr2=0x55dad012c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:23:00.675 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.669+0000 7fb52de0b740 1 -- 172.21.15.44:0/1509772606 shutdown_connections 2024-08-19T00:23:00.675 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.669+0000 7fb52de0b740 1 -- 172.21.15.44:0/1509772606 wait complete. 2024-08-19T00:23:00.675 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.670+0000 7fb52de0b740 1 -- start start 2024-08-19T00:23:00.675 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.670+0000 7fb52de0b740 1 Processor -- start 2024-08-19T00:23:00.675 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.670+0000 7fb52de0b740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dad01257d0 0x55dad0143ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:00.675 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.670+0000 7fb52de0b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dad01260f0 0x55dad0144020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:00.675 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.670+0000 7fb52de0b740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55dad0130990 0x55dad01a9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:00.675 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.670+0000 7fb52de0b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb5241b67e0 con 0x55dad01260f0 2024-08-19T00:23:00.675 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.670+0000 7fb52de0b740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fb5241b6110 con 0x55dad0130990 2024-08-19T00:23:00.675 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.670+0000 7fb52de0b740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb5241b3370 con 0x55dad01257d0 2024-08-19T00:23:00.675 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.670+0000 7fb52de0b740 10 client.0 _ll_register_callbacks cb 0x7fb518005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:23:00.675 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.671+0000 7fb523fff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55dad0130990 0x55dad01a9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:00.676 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.671+0000 7fb523fff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55dad0130990 0x55dad01a9ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.44:49694/0 (socket says 172.21.15.44:49694) 2024-08-19T00:23:00.676 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.671+0000 7fb523fff640 1 -- 172.21.15.44:0/1234794022 learned_addr learned my addr 172.21.15.44:0/1234794022 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:23:00.676 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.671+0000 7fb528d0b640 1 --2- 172.21.15.44:0/1234794022 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dad01260f0 0x55dad0144020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:00.676 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.671+0000 7fb523fff640 1 --2- 172.21.15.44:0/1234794022 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dad01257d0 0x55dad0143ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:00.676 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.671+0000 7fb523fff640 1 -- 172.21.15.44:0/1234794022 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dad01257d0 msgr2=0x55dad0143ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:23:00.676 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.671+0000 7fb523fff640 1 --2- 172.21.15.44:0/1234794022 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dad01257d0 0x55dad0143ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:00.676 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.671+0000 7fb523fff640 1 -- 172.21.15.44:0/1234794022 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dad01260f0 msgr2=0x55dad0144020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:23:00.676 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.671+0000 7fb523fff640 1 --2- 172.21.15.44:0/1234794022 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dad01260f0 0x55dad0144020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:00.676 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.671+0000 7fb523fff640 1 -- 172.21.15.44:0/1234794022 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dad01aa3e0 con 0x55dad0130990 2024-08-19T00:23:00.676 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.671+0000 7fb523fff640 1 --2- 172.21.15.44:0/1234794022 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55dad0130990 0x55dad01a9ea0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb51002a9a0 tx=0x7fb510004de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72b7d1fc3998a668 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:23:00.676 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.671+0000 7fb503fff640 10 client.0 ms_handle_connect on v2:172.21.15.116:3300/0 2024-08-19T00:23:00.676 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.671+0000 7fb503fff640 1 -- 172.21.15.44:0/1234794022 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb510035040 con 0x55dad0130990 2024-08-19T00:23:00.676 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.671+0000 7fb503fff640 1 -- 172.21.15.44:0/1234794022 <== mon.2 v2:172.21.15.116:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9533+0+0 (secure 0 0 0) 0x7fb510032e30 con 0x55dad0130990 2024-08-19T00:23:00.677 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.671+0000 7fb52de0b740 1 -- 172.21.15.44:0/1234794022 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb510063070 con 0x55dad0130990 2024-08-19T00:23:00.677 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.672+0000 7fb503fff640 1 -- 172.21.15.44:0/1234794022 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fb510009520 con 0x55dad0130990 2024-08-19T00:23:00.677 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.672+0000 7fb52de0b740 10 client.26132 fetch_fsmap learned FSMap version 33 2024-08-19T00:23:00.677 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.672+0000 7fb52de0b740 1 -- 172.21.15.44:0/1234794022 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55dad01aa3e0 con 0x55dad0130990 2024-08-19T00:23:00.677 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.672+0000 7fb503fff640 1 -- 172.21.15.44:0/1234794022 <== mon.2 v2:172.21.15.116:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb510063070 con 0x55dad0130990 2024-08-19T00:23:00.677 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.672+0000 7fb503fff640 1 -- 172.21.15.44:0/1234794022 <== mon.2 v2:172.21.15.116:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7fb5100035f0 con 0x55dad0130990 2024-08-19T00:23:00.677 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.672+0000 7fb52de0b740 10 client.26132 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:23:00.677 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.672+0000 7fb52de0b740 10 client.26132 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:23:00.677 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.672+0000 7fb52de0b740 20 client.26132 populate_metadata read hostname 'smithi044' 2024-08-19T00:23:00.677 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.672+0000 7fb52de0b740 1 --2- 172.21.15.44:0/1234794022 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55dad0140560 0x55dad01ad900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:00.677 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.672+0000 7fb52de0b740 4 client.26132 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-19T00:23:00.677 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.672+0000 7fb52de0b740 1 -- 172.21.15.44:0/1234794022 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55dad0091450 con 0x55dad0140560 2024-08-19T00:23:00.677 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.672+0000 7fb528d0b640 1 --2- 172.21.15.44:0/1234794022 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55dad0140560 0x55dad01ad900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:00.678 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.673+0000 7fb528d0b640 1 --2- 172.21.15.44:0/1234794022 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55dad0140560 0x55dad01ad900 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe0eb001f453bd50 server_cookie=832ce903663a35f6 in_seq=0 out_seq=0 2024-08-19T00:23:00.678 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:00.673+0000 7fb503fff640 10 client.26132 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:23:00.692 INFO:tasks.workunit.client.0.smithi044.stdout: 1 736046 8.02 MB/sec execute 385 sec latency 55.530 ms 2024-08-19T00:23:01.596 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:01.594+0000 7fb503fff640 1 -- 172.21.15.44:0/1234794022 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55dad0091450 con 0x55dad0140560 2024-08-19T00:23:01.596 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:01.594+0000 7fb503fff640 10 client.26132 handle_command_reply: tid=0 2024-08-19T00:23:01.596 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:01.594+0000 7fb52de0b740 1 client.26132 shutdown 2024-08-19T00:23:01.596 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:01.594+0000 7fb52de0b740 1 -- 172.21.15.44:0/1234794022 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55dad0130990 msgr2=0x55dad01a9ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:01.596 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:01.594+0000 7fb52de0b740 1 --2- 172.21.15.44:0/1234794022 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55dad0130990 0x55dad01a9ea0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb51002a9a0 tx=0x7fb510004de0 comp rx=0 tx=0).stop 2024-08-19T00:23:01.597 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:01.594+0000 7fb52de0b740 1 -- 172.21.15.44:0/1234794022 shutdown_connections 2024-08-19T00:23:01.597 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:01.594+0000 7fb52de0b740 1 --2- 172.21.15.44:0/1234794022 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55dad0140560 0x55dad01ad900 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:01.597 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:01.594+0000 7fb52de0b740 1 --2- 172.21.15.44:0/1234794022 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55dad0130990 0x55dad01a9ea0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:01.597 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:01.594+0000 7fb503fff640 0 client.26132 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:23:01.597 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:01.594+0000 7fb52de0b740 1 --2- 172.21.15.44:0/1234794022 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dad01260f0 0x55dad0144020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:01.597 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:01.594+0000 7fb52de0b740 1 --2- 172.21.15.44:0/1234794022 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dad01257d0 0x55dad0143ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:01.597 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:01.594+0000 7fb52de0b740 1 -- 172.21.15.44:0/1234794022 >> 172.21.15.44:0/1234794022 conn(0x55dad0121d40 msgr2=0x55dad013b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:23:01.597 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:01.594+0000 7fb52de0b740 1 -- 172.21.15.44:0/1234794022 shutdown_connections 2024-08-19T00:23:01.597 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:01.594+0000 7fb52de0b740 1 -- 172.21.15.44:0/1234794022 wait complete. 2024-08-19T00:23:01.597 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:01.594+0000 7fb52de0b740 20 client.26132 trim_cache size 0 max 16384 2024-08-19T00:23:01.598 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:{ 2024-08-19T00:23:01.598 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "message": "", 2024-08-19T00:23:01.598 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "return_code": 0 2024-08-19T00:23:01.598 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:} 2024-08-19T00:23:01.598 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:01.595+0000 7fb52af6f640 1 -- 172.21.15.44:0/1102600512 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fb5140a2e20 msgr2=0x7fb5140a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:01.599 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:01.595+0000 7fb52af6f640 1 --2- 172.21.15.44:0/1102600512 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fb5140a2e20 0x7fb5140a52e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb51c00efd0 tx=0x7fb51c086040 comp rx=0 tx=0).stop 2024-08-19T00:23:01.599 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:01.595+0000 7fb52af6f640 1 -- 172.21.15.44:0/1102600512 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb52410be00 msgr2=0x7fb52410a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:01.599 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:01.595+0000 7fb52af6f640 1 --2- 172.21.15.44:0/1102600512 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb52410be00 0x7fb52410a930 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fb51c00eaa0 tx=0x7fb51c00ef60 comp rx=0 tx=0).stop 2024-08-19T00:23:01.599 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:01.595+0000 7fb52af6f640 1 -- 172.21.15.44:0/1102600512 shutdown_connections 2024-08-19T00:23:01.599 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:01.595+0000 7fb52af6f640 1 --2- 172.21.15.44:0/1102600512 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fb5140a2e20 0x7fb5140a52e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:01.599 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:01.595+0000 7fb52af6f640 1 --2- 172.21.15.44:0/1102600512 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5241032d0 0x7fb5241a4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:01.599 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:01.595+0000 7fb52af6f640 1 --2- 172.21.15.44:0/1102600512 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb52410be00 0x7fb52410a930 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:01.599 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:01.595+0000 7fb52af6f640 1 --2- 172.21.15.44:0/1102600512 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb5241029b0 0x7fb5241a4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:01.599 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:01.595+0000 7fb52af6f640 1 -- 172.21.15.44:0/1102600512 >> 172.21.15.44:0/1102600512 conn(0x7fb5240776c0 msgr2=0x7fb524100530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:23:01.599 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:01.595+0000 7fb52af6f640 1 -- 172.21.15.44:0/1102600512 shutdown_connections 2024-08-19T00:23:01.599 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:01.595+0000 7fb52af6f640 1 -- 172.21.15.44:0/1102600512 wait complete. 2024-08-19T00:23:01.692 INFO:tasks.workunit.client.0.smithi044.stdout: 1 736599 8.01 MB/sec execute 386 sec latency 65.997 ms 2024-08-19T00:23:02.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:23:02 smithi171 ceph-mon[21810]: pgmap v300: 129 pgs: 129 active+clean; 518 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.1 MiB/s wr, 325 op/s 2024-08-19T00:23:02.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:23:02 smithi116 ceph-mon[21873]: pgmap v300: 129 pgs: 129 active+clean; 518 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.1 MiB/s wr, 325 op/s 2024-08-19T00:23:02.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:23:02 smithi044 ceph-mon[18489]: pgmap v300: 129 pgs: 129 active+clean; 518 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.1 MiB/s wr, 325 op/s 2024-08-19T00:23:02.692 INFO:tasks.workunit.client.0.smithi044.stdout: 1 738894 8.03 MB/sec execute 387 sec latency 20.280 ms 2024-08-19T00:23:03.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:23:03 smithi171 ceph-mon[21810]: osdmap e102: 12 total, 12 up, 12 in 2024-08-19T00:23:03.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:23:03 smithi116 ceph-mon[21873]: osdmap e102: 12 total, 12 up, 12 in 2024-08-19T00:23:03.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:23:03 smithi044 ceph-mon[18489]: osdmap e102: 12 total, 12 up, 12 in 2024-08-19T00:23:03.692 INFO:tasks.workunit.client.0.smithi044.stdout: 1 740553 8.02 MB/sec execute 388 sec latency 54.004 ms 2024-08-19T00:23:04.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:23:04 smithi171 ceph-mon[21810]: pgmap v302: 129 pgs: 129 active+clean; 518 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.1 MiB/s wr, 255 op/s 2024-08-19T00:23:04.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:23:04 smithi116 ceph-mon[21873]: pgmap v302: 129 pgs: 129 active+clean; 518 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.1 MiB/s wr, 255 op/s 2024-08-19T00:23:04.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:23:04 smithi044 ceph-mon[18489]: pgmap v302: 129 pgs: 129 active+clean; 518 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.1 MiB/s wr, 255 op/s 2024-08-19T00:23:04.692 INFO:tasks.workunit.client.0.smithi044.stdout: 1 742663 8.03 MB/sec execute 389 sec latency 24.500 ms 2024-08-19T00:23:05.692 INFO:tasks.workunit.client.0.smithi044.stdout: 1 744668 8.03 MB/sec execute 390 sec latency 14.243 ms 2024-08-19T00:23:06.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:23:06 smithi171 ceph-mon[21810]: pgmap v303: 129 pgs: 129 active+clean; 526 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.1 MiB/s wr, 286 op/s 2024-08-19T00:23:06.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:23:06 smithi116 ceph-mon[21873]: pgmap v303: 129 pgs: 129 active+clean; 526 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.1 MiB/s wr, 286 op/s 2024-08-19T00:23:06.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:23:06 smithi044 ceph-mon[18489]: pgmap v303: 129 pgs: 129 active+clean; 526 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.1 MiB/s wr, 286 op/s 2024-08-19T00:23:06.692 INFO:tasks.workunit.client.0.smithi044.stdout: 1 746770 8.05 MB/sec execute 391 sec latency 15.640 ms 2024-08-19T00:23:07.692 INFO:tasks.workunit.client.0.smithi044.stdout: 1 749165 8.07 MB/sec execute 392 sec latency 135.711 ms 2024-08-19T00:23:08.615 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:23:08 smithi116 ceph-mon[21873]: pgmap v304: 129 pgs: 129 active+clean; 526 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.1 MiB/s wr, 286 op/s 2024-08-19T00:23:08.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:23:08 smithi044 ceph-mon[18489]: pgmap v304: 129 pgs: 129 active+clean; 526 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.1 MiB/s wr, 286 op/s 2024-08-19T00:23:08.692 INFO:tasks.workunit.client.0.smithi044.stdout: 1 749165 8.05 MB/sec execute 393 sec latency 1135.812 ms 2024-08-19T00:23:08.842 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:23:08 smithi171 ceph-mon[21810]: pgmap v304: 129 pgs: 129 active+clean; 526 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.1 MiB/s wr, 286 op/s 2024-08-19T00:23:09.693 INFO:tasks.workunit.client.0.smithi044.stdout: 1 749165 8.03 MB/sec execute 394 sec latency 2135.917 ms 2024-08-19T00:23:10.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:23:09 smithi171 ceph-mon[21810]: pgmap v305: 129 pgs: 129 active+clean; 526 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.1 MiB/s wr, 286 op/s 2024-08-19T00:23:10.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:23:09 smithi171 ceph-mon[21810]: osdmap e103: 12 total, 12 up, 12 in 2024-08-19T00:23:10.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:23:09 smithi116 ceph-mon[21873]: pgmap v305: 129 pgs: 129 active+clean; 526 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.1 MiB/s wr, 286 op/s 2024-08-19T00:23:10.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:23:09 smithi116 ceph-mon[21873]: osdmap e103: 12 total, 12 up, 12 in 2024-08-19T00:23:10.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:23:09 smithi044 ceph-mon[18489]: pgmap v305: 129 pgs: 129 active+clean; 526 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.1 MiB/s wr, 286 op/s 2024-08-19T00:23:10.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:23:09 smithi044 ceph-mon[18489]: osdmap e103: 12 total, 12 up, 12 in 2024-08-19T00:23:10.693 INFO:tasks.workunit.client.0.smithi044.stdout: 1 749165 8.00 MB/sec execute 395 sec latency 3136.018 ms 2024-08-19T00:23:11.693 INFO:tasks.workunit.client.0.smithi044.stdout: 1 749165 7.98 MB/sec execute 396 sec latency 4136.086 ms 2024-08-19T00:23:12.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:23:11 smithi171 ceph-mon[21810]: pgmap v307: 129 pgs: 129 active+clean; 541 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.4 MiB/s wr, 290 op/s 2024-08-19T00:23:12.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:23:11 smithi116 ceph-mon[21873]: pgmap v307: 129 pgs: 129 active+clean; 541 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.4 MiB/s wr, 290 op/s 2024-08-19T00:23:12.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:23:11 smithi044 ceph-mon[18489]: pgmap v307: 129 pgs: 129 active+clean; 541 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.4 MiB/s wr, 290 op/s 2024-08-19T00:23:12.693 INFO:tasks.workunit.client.0.smithi044.stdout: 1 749165 7.96 MB/sec execute 397 sec latency 5136.194 ms 2024-08-19T00:23:13.693 INFO:tasks.workunit.client.0.smithi044.stdout: 1 749165 7.94 MB/sec execute 398 sec latency 6136.299 ms 2024-08-19T00:23:14.171 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:23:13 smithi044 ceph-mon[18489]: pgmap v308: 129 pgs: 129 active+clean; 541 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.7 MiB/s wr, 242 op/s 2024-08-19T00:23:14.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:23:13 smithi171 ceph-mon[21810]: pgmap v308: 129 pgs: 129 active+clean; 541 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.7 MiB/s wr, 242 op/s 2024-08-19T00:23:14.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:23:13 smithi116 ceph-mon[21873]: pgmap v308: 129 pgs: 129 active+clean; 541 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.7 MiB/s wr, 242 op/s 2024-08-19T00:23:14.693 INFO:tasks.workunit.client.0.smithi044.stdout: 1 749165 7.92 MB/sec execute 399 sec latency 7136.334 ms 2024-08-19T00:23:14.695 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.693+0000 7f633e913640 1 -- 172.21.15.44:0/2842390940 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6338101800 msgr2=0x7f6338101c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:14.695 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.693+0000 7f633e913640 1 --2- 172.21.15.44:0/2842390940 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6338101800 0x7f6338101c60 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f632c009930 tx=0x7f632c02a420 comp rx=0 tx=0).stop 2024-08-19T00:23:14.695 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.693+0000 7f633e913640 1 -- 172.21.15.44:0/2842390940 shutdown_connections 2024-08-19T00:23:14.695 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.693+0000 7f633e913640 1 --2- 172.21.15.44:0/2842390940 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f63381021a0 0x7f633810e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:14.695 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.693+0000 7f633e913640 1 --2- 172.21.15.44:0/2842390940 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6338101800 0x7f6338101c60 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:14.695 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.693+0000 7f633e913640 1 --2- 172.21.15.44:0/2842390940 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6338107810 0x7f6338107bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:14.695 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.693+0000 7f633e913640 1 -- 172.21.15.44:0/2842390940 >> 172.21.15.44:0/2842390940 conn(0x7f63380fd500 msgr2=0x7f63380ff920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:23:14.695 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.693+0000 7f633e913640 1 -- 172.21.15.44:0/2842390940 shutdown_connections 2024-08-19T00:23:14.695 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.693+0000 7f633e913640 1 -- 172.21.15.44:0/2842390940 wait complete. 2024-08-19T00:23:14.695 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.693+0000 7f633e913640 1 Processor -- start 2024-08-19T00:23:14.696 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.693+0000 7f633e913640 1 -- start start 2024-08-19T00:23:14.698 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.694+0000 7f633e913640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6338101800 0x7f633819a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:14.698 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.694+0000 7f633e913640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f63381021a0 0x7f633819a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:14.698 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.694+0000 7f633e913640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6338107810 0x7f633819eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:14.698 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.694+0000 7f633e913640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6338111c50 con 0x7f6338101800 2024-08-19T00:23:14.698 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.694+0000 7f633e913640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f6338111ad0 con 0x7f6338107810 2024-08-19T00:23:14.698 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.694+0000 7f633e913640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6338111dd0 con 0x7f63381021a0 2024-08-19T00:23:14.698 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.694+0000 7f6337fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6338101800 0x7f633819a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:14.698 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.694+0000 7f6337fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6338101800 0x7f633819a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33842/0 (socket says 172.21.15.44:33842) 2024-08-19T00:23:14.698 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.694+0000 7f6337fff640 1 -- 172.21.15.44:0/2472008375 learned_addr learned my addr 172.21.15.44:0/2472008375 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:23:14.698 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.694+0000 7f633ceb0640 1 --2- 172.21.15.44:0/2472008375 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6338107810 0x7f633819eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:14.698 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.694+0000 7f63377fe640 1 --2- 172.21.15.44:0/2472008375 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f63381021a0 0x7f633819a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:14.699 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.694+0000 7f6337fff640 1 -- 172.21.15.44:0/2472008375 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f63381021a0 msgr2=0x7f633819a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:14.699 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.694+0000 7f6337fff640 1 --2- 172.21.15.44:0/2472008375 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f63381021a0 0x7f633819a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:14.699 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.694+0000 7f6337fff640 1 -- 172.21.15.44:0/2472008375 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6338107810 msgr2=0x7f633819eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:14.699 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.694+0000 7f6337fff640 1 --2- 172.21.15.44:0/2472008375 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6338107810 0x7f633819eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:14.699 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.694+0000 7f6337fff640 1 -- 172.21.15.44:0/2472008375 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f633819f1d0 con 0x7f6338101800 2024-08-19T00:23:14.699 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.694+0000 7f633ceb0640 1 --2- 172.21.15.44:0/2472008375 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6338107810 0x7f633819eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:23:14.699 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.695+0000 7f6337fff640 1 --2- 172.21.15.44:0/2472008375 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6338101800 0x7f633819a1e0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f632800c920 tx=0x7f632800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:23:14.699 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.695+0000 7f63357fa640 1 -- 172.21.15.44:0/2472008375 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6328007c70 con 0x7f6338101800 2024-08-19T00:23:14.699 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.695+0000 7f633e913640 1 -- 172.21.15.44:0/2472008375 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f633819f4c0 con 0x7f6338101800 2024-08-19T00:23:14.700 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.695+0000 7f63357fa640 1 -- 172.21.15.44:0/2472008375 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6328007e10 con 0x7f6338101800 2024-08-19T00:23:14.700 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.695+0000 7f63357fa640 1 -- 172.21.15.44:0/2472008375 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6328018890 con 0x7f6338101800 2024-08-19T00:23:14.700 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.695+0000 7f633e913640 1 -- 172.21.15.44:0/2472008375 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63381a6d50 con 0x7f6338101800 2024-08-19T00:23:14.707 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.697+0000 7f63357fa640 1 -- 172.21.15.44:0/2472008375 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f6328018a70 con 0x7f6338101800 2024-08-19T00:23:14.707 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.698+0000 7f63416cb740 1 Processor -- start 2024-08-19T00:23:14.707 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.698+0000 7f63416cb740 1 -- start start 2024-08-19T00:23:14.707 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.698+0000 7f63416cb740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fcb15417d0 0x55fcb1541bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:14.707 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.698+0000 7f63416cb740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fcb15420f0 0x55fcb154c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:14.707 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.698+0000 7f63357fa640 1 --2- 172.21.15.44:0/2472008375 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f63200a2da0 0x7f63200a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:14.708 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.698+0000 7f63416cb740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcb154c990 0x55fcb154ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:14.708 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.698+0000 7f63416cb740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55fcb14a59d0 con 0x55fcb154c990 2024-08-19T00:23:14.708 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.698+0000 7f63416cb740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55fcb144d820 con 0x55fcb15417d0 2024-08-19T00:23:14.708 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.698+0000 7f63416cb740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55fcb14a1990 con 0x55fcb15420f0 2024-08-19T00:23:14.708 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.698+0000 7f633ceb0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcb154c990 0x55fcb154ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:14.708 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.698+0000 7f63377fe640 1 --2- 172.21.15.44:0/2472008375 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f63200a2da0 0x7f63200a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:14.708 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.698+0000 7f633ceb0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcb154c990 0x55fcb154ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33848/0 (socket says 172.21.15.44:33848) 2024-08-19T00:23:14.708 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.698+0000 7f633ceb0640 1 -- 172.21.15.44:0/1196844163 learned_addr learned my addr 172.21.15.44:0/1196844163 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:23:14.708 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.698+0000 7f63357fa640 1 -- 172.21.15.44:0/2472008375 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9533+0+0 (secure 0 0 0) 0x7f63280cf860 con 0x7f6338101800 2024-08-19T00:23:14.708 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.698+0000 7f6337fff640 1 --2- 172.21.15.44:0/1196844163 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fcb15420f0 0x55fcb154c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:14.708 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.698+0000 7f633ceb0640 1 --2- 172.21.15.44:0/1196844163 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fcb15417d0 0x55fcb1541bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:14.708 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.698+0000 7f633ceb0640 1 -- 172.21.15.44:0/1196844163 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fcb15420f0 msgr2=0x55fcb154c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:23:14.708 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.698+0000 7f633ceb0640 1 --2- 172.21.15.44:0/1196844163 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fcb15420f0 0x55fcb154c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:14.709 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.698+0000 7f633ceb0640 1 -- 172.21.15.44:0/1196844163 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fcb15417d0 msgr2=0x55fcb1541bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:23:14.709 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.698+0000 7f633ceb0640 1 --2- 172.21.15.44:0/1196844163 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fcb15417d0 0x55fcb1541bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:14.709 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.698+0000 7f633ceb0640 1 -- 172.21.15.44:0/1196844163 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcb11b9210 con 0x55fcb154c990 2024-08-19T00:23:14.709 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.699+0000 7f633ceb0640 1 --2- 172.21.15.44:0/1196844163 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcb154c990 0x55fcb154ed80 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f633000fca0 tx=0x7f633000f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0590b46ea860e23 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:23:14.709 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.699+0000 7f63377fe640 1 --2- 172.21.15.44:0/2472008375 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f63200a2da0 0x7f63200a5260 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f632c009900 tx=0x7f632c0058d0 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:23:14.709 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.699+0000 7f631e7fc640 1 -- 172.21.15.44:0/1196844163 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63300131b0 con 0x55fcb154c990 2024-08-19T00:23:14.709 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.699+0000 7f631e7fc640 1 -- 172.21.15.44:0/1196844163 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6330003e50 con 0x55fcb154c990 2024-08-19T00:23:14.709 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.699+0000 7f631e7fc640 1 -- 172.21.15.44:0/1196844163 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6330010430 con 0x55fcb154c990 2024-08-19T00:23:14.709 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.700+0000 7f63416cb740 1 -- 172.21.15.44:0/1196844163 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcb154c990 msgr2=0x55fcb154ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:14.709 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.700+0000 7f63416cb740 1 --2- 172.21.15.44:0/1196844163 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcb154c990 0x55fcb154ed80 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f633000fca0 tx=0x7f633000f3c0 comp rx=0 tx=0).stop 2024-08-19T00:23:14.709 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.700+0000 7f63416cb740 1 -- 172.21.15.44:0/1196844163 shutdown_connections 2024-08-19T00:23:14.709 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.700+0000 7f63416cb740 1 --2- 172.21.15.44:0/1196844163 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fcb15420f0 0x55fcb154c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:14.709 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.700+0000 7f63416cb740 1 --2- 172.21.15.44:0/1196844163 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcb154c990 0x55fcb154ed80 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:14.710 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.700+0000 7f63416cb740 1 --2- 172.21.15.44:0/1196844163 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fcb15417d0 0x55fcb1541bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:14.710 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.700+0000 7f63416cb740 1 -- 172.21.15.44:0/1196844163 >> 172.21.15.44:0/1196844163 conn(0x55fcb153dd40 msgr2=0x55fcb153e120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:23:14.710 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.700+0000 7f63416cb740 1 -- 172.21.15.44:0/1196844163 shutdown_connections 2024-08-19T00:23:14.710 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.700+0000 7f63416cb740 1 -- 172.21.15.44:0/1196844163 wait complete. 2024-08-19T00:23:14.710 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.700+0000 7f63416cb740 1 -- start start 2024-08-19T00:23:14.710 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.700+0000 7f63416cb740 1 Processor -- start 2024-08-19T00:23:14.710 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.701+0000 7f63416cb740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcb15417d0 0x55fcb1549890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:14.710 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.701+0000 7f63416cb740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fcb15420f0 0x55fcb1549dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:14.710 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.701+0000 7f63416cb740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fcb154c990 0x55fcb154a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:14.710 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.701+0000 7f63416cb740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55fcb154f560 con 0x55fcb15417d0 2024-08-19T00:23:14.710 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.701+0000 7f63416cb740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55fcb1461520 con 0x55fcb154c990 2024-08-19T00:23:14.711 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.701+0000 7f63416cb740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55fcb154f6e0 con 0x55fcb15420f0 2024-08-19T00:23:14.711 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.701+0000 7f63416cb740 10 client.0 _ll_register_callbacks cb 0x55fcb11b8a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:23:14.711 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.701+0000 7f6337fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcb15417d0 0x55fcb1549890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:14.711 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.701+0000 7f6337fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcb15417d0 0x55fcb1549890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33862/0 (socket says 172.21.15.44:33862) 2024-08-19T00:23:14.711 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.701+0000 7f6337fff640 1 -- 172.21.15.44:0/4057990805 learned_addr learned my addr 172.21.15.44:0/4057990805 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:23:14.711 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.701+0000 7f63377fe640 1 --2- 172.21.15.44:0/4057990805 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fcb15420f0 0x55fcb1549dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:14.711 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.701+0000 7f6337fff640 1 -- 172.21.15.44:0/4057990805 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fcb15420f0 msgr2=0x55fcb1549dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:23:14.711 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.701+0000 7f6337fff640 1 --2- 172.21.15.44:0/4057990805 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fcb15420f0 0x55fcb1549dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:14.711 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.701+0000 7f633ceb0640 1 --2- 172.21.15.44:0/4057990805 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fcb154c990 0x55fcb154a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:14.711 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.701+0000 7f6337fff640 1 -- 172.21.15.44:0/4057990805 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fcb154c990 msgr2=0x55fcb154a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:23:14.711 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.701+0000 7f6337fff640 1 --2- 172.21.15.44:0/4057990805 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fcb154c990 0x55fcb154a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:14.711 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.701+0000 7f6337fff640 1 -- 172.21.15.44:0/4057990805 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcb1285620 con 0x55fcb15417d0 2024-08-19T00:23:14.711 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.701+0000 7f63377fe640 1 --2- 172.21.15.44:0/4057990805 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fcb15420f0 0x55fcb1549dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:23:14.711 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.701+0000 7f633ceb0640 1 --2- 172.21.15.44:0/4057990805 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fcb154c990 0x55fcb154a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:23:14.712 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.701+0000 7f6337fff640 1 --2- 172.21.15.44:0/4057990805 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcb15417d0 0x55fcb1549890 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f632809b690 tx=0x7f6328099ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da821622baf1bfbe server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:23:14.712 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.701+0000 7f63177fe640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:23:14.712 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.701+0000 7f63177fe640 1 -- 172.21.15.44:0/4057990805 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f632809fd40 con 0x55fcb15417d0 2024-08-19T00:23:14.712 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.701+0000 7f63177fe640 1 -- 172.21.15.44:0/4057990805 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9533+0+0 (secure 0 0 0) 0x7f632800fb30 con 0x55fcb15417d0 2024-08-19T00:23:14.712 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.701+0000 7f63416cb740 1 -- 172.21.15.44:0/4057990805 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6330003e50 con 0x55fcb15417d0 2024-08-19T00:23:14.712 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.701+0000 7f63177fe640 1 -- 172.21.15.44:0/4057990805 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f63280a4600 con 0x55fcb15417d0 2024-08-19T00:23:14.712 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.701+0000 7f63416cb740 10 client.16728 fetch_fsmap learned FSMap version 33 2024-08-19T00:23:14.712 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.702+0000 7f63416cb740 1 -- 172.21.15.44:0/4057990805 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55fcb155b260 con 0x55fcb15417d0 2024-08-19T00:23:14.712 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.702+0000 7f63177fe640 1 -- 172.21.15.44:0/4057990805 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6330003e50 con 0x55fcb15417d0 2024-08-19T00:23:14.712 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.702+0000 7f63177fe640 1 -- 172.21.15.44:0/4057990805 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f63280cf410 con 0x55fcb15417d0 2024-08-19T00:23:14.712 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.702+0000 7f63416cb740 10 client.16728 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:23:14.712 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.702+0000 7f63416cb740 10 client.16728 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:23:14.712 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.702+0000 7f63416cb740 20 client.16728 populate_metadata read hostname 'smithi044' 2024-08-19T00:23:14.713 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.702+0000 7f63416cb740 1 --2- 172.21.15.44:0/4057990805 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55fcb155c6d0 0x55fcb155eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:14.713 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.702+0000 7f63416cb740 4 client.16728 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:23:14.713 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.702+0000 7f63416cb740 1 -- 172.21.15.44:0/4057990805 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fcb14b3100 con 0x55fcb155c6d0 2024-08-19T00:23:14.713 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.702+0000 7f63377fe640 1 --2- 172.21.15.44:0/4057990805 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55fcb155c6d0 0x55fcb155eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:14.713 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.703+0000 7f63177fe640 10 client.16728 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:23:14.713 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.703+0000 7f63377fe640 1 --2- 172.21.15.44:0/4057990805 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55fcb155c6d0 0x55fcb155eac0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e543934dda11645 server_cookie=c4654e999c849ed0 in_seq=0 out_seq=0 2024-08-19T00:23:14.713 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.704+0000 7f63177fe640 1 -- 172.21.15.44:0/4057990805 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fcb14b3100 con 0x55fcb155c6d0 2024-08-19T00:23:14.713 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.704+0000 7f63177fe640 10 client.16728 handle_command_reply: tid=0 2024-08-19T00:23:14.713 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.704+0000 7f63416cb740 1 client.16728 shutdown 2024-08-19T00:23:14.713 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.704+0000 7f63416cb740 1 -- 172.21.15.44:0/4057990805 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcb15417d0 msgr2=0x55fcb1549890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:14.713 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.704+0000 7f63416cb740 1 --2- 172.21.15.44:0/4057990805 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcb15417d0 0x55fcb1549890 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f632809b690 tx=0x7f6328099ea0 comp rx=0 tx=0).stop 2024-08-19T00:23:14.713 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.704+0000 7f63416cb740 1 -- 172.21.15.44:0/4057990805 shutdown_connections 2024-08-19T00:23:14.713 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.704+0000 7f63416cb740 1 --2- 172.21.15.44:0/4057990805 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55fcb155c6d0 0x55fcb155eac0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:14.713 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.704+0000 7f63416cb740 1 --2- 172.21.15.44:0/4057990805 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fcb15420f0 0x55fcb1549dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:14.713 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.704+0000 7f63416cb740 1 --2- 172.21.15.44:0/4057990805 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fcb154c990 0x55fcb154a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:14.714 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.704+0000 7f63416cb740 1 --2- 172.21.15.44:0/4057990805 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcb15417d0 0x55fcb1549890 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:14.714 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.704+0000 7f63177fe640 0 client.16728 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:23:14.714 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.704+0000 7f63416cb740 1 -- 172.21.15.44:0/4057990805 >> 172.21.15.44:0/4057990805 conn(0x55fcb153dd40 msgr2=0x55fcb1543a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:23:14.714 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.704+0000 7f63416cb740 1 -- 172.21.15.44:0/4057990805 shutdown_connections 2024-08-19T00:23:14.714 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.704+0000 7f63416cb740 1 -- 172.21.15.44:0/4057990805 wait complete. 2024-08-19T00:23:14.714 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.704+0000 7f63416cb740 20 client.16728 trim_cache size 0 max 16384 2024-08-19T00:23:14.722 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.719+0000 7f63416cb740 1 Processor -- start 2024-08-19T00:23:14.722 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.719+0000 7f63416cb740 1 -- start start 2024-08-19T00:23:14.722 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.719+0000 7f63416cb740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fcb15417d0 0x55fcb15487b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:14.722 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.719+0000 7f63416cb740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fcb15420f0 0x55fcb154b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:14.722 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.719+0000 7f63416cb740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcb154c990 0x55fcb1564360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:14.723 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.719+0000 7f63416cb740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f63381b0ea0 con 0x55fcb154c990 2024-08-19T00:23:14.723 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.719+0000 7f63416cb740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f63381b29e0 con 0x55fcb15420f0 2024-08-19T00:23:14.723 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.719+0000 7f63416cb740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f63381b1570 con 0x55fcb15417d0 2024-08-19T00:23:14.723 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.719+0000 7f633ceb0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcb154c990 0x55fcb1564360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:14.723 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.719+0000 7f633ceb0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcb154c990 0x55fcb1564360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33864/0 (socket says 172.21.15.44:33864) 2024-08-19T00:23:14.723 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.719+0000 7f633ceb0640 1 -- 172.21.15.44:0/1404638921 learned_addr learned my addr 172.21.15.44:0/1404638921 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:23:14.723 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.719+0000 7f63377fe640 1 --2- 172.21.15.44:0/1404638921 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fcb15420f0 0x55fcb154b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:14.723 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.719+0000 7f6337fff640 1 --2- 172.21.15.44:0/1404638921 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fcb15417d0 0x55fcb15487b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:14.723 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.719+0000 7f633ceb0640 1 -- 172.21.15.44:0/1404638921 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fcb15417d0 msgr2=0x55fcb15487b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:23:14.723 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.719+0000 7f633ceb0640 1 --2- 172.21.15.44:0/1404638921 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fcb15417d0 0x55fcb15487b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:14.723 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.719+0000 7f633ceb0640 1 -- 172.21.15.44:0/1404638921 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fcb15420f0 msgr2=0x55fcb154b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:23:14.723 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.719+0000 7f633ceb0640 1 --2- 172.21.15.44:0/1404638921 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fcb15420f0 0x55fcb154b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:14.724 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.719+0000 7f633ceb0640 1 -- 172.21.15.44:0/1404638921 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcb154f0c0 con 0x55fcb154c990 2024-08-19T00:23:14.724 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.719+0000 7f63377fe640 1 --2- 172.21.15.44:0/1404638921 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fcb15420f0 0x55fcb154b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:23:14.724 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.719+0000 7f6337fff640 1 --2- 172.21.15.44:0/1404638921 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fcb15417d0 0x55fcb15487b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:23:14.724 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.719+0000 7f633ceb0640 1 --2- 172.21.15.44:0/1404638921 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcb154c990 0x55fcb1564360 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f6330006010 tx=0x7f6330005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e170976fc830f1a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:23:14.724 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.720+0000 7f631dffb640 1 -- 172.21.15.44:0/1404638921 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6330009480 con 0x55fcb154c990 2024-08-19T00:23:14.724 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.720+0000 7f631dffb640 1 -- 172.21.15.44:0/1404638921 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6330003e50 con 0x55fcb154c990 2024-08-19T00:23:14.724 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.720+0000 7f631dffb640 1 -- 172.21.15.44:0/1404638921 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6330005470 con 0x55fcb154c990 2024-08-19T00:23:14.724 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.720+0000 7f63416cb740 1 -- 172.21.15.44:0/1404638921 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcb154c990 msgr2=0x55fcb1564360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:14.724 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.720+0000 7f63416cb740 1 --2- 172.21.15.44:0/1404638921 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcb154c990 0x55fcb1564360 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f6330006010 tx=0x7f6330005c50 comp rx=0 tx=0).stop 2024-08-19T00:23:14.724 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.720+0000 7f63416cb740 1 -- 172.21.15.44:0/1404638921 shutdown_connections 2024-08-19T00:23:14.724 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.720+0000 7f63416cb740 1 --2- 172.21.15.44:0/1404638921 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcb154c990 0x55fcb1564360 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:14.724 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.720+0000 7f63416cb740 1 --2- 172.21.15.44:0/1404638921 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fcb15420f0 0x55fcb154b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:14.724 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.720+0000 7f63416cb740 1 --2- 172.21.15.44:0/1404638921 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fcb15417d0 0x55fcb15487b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:14.725 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.720+0000 7f63416cb740 1 -- 172.21.15.44:0/1404638921 >> 172.21.15.44:0/1404638921 conn(0x55fcb153dd40 msgr2=0x55fcb154afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:23:14.725 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.720+0000 7f63416cb740 1 -- 172.21.15.44:0/1404638921 shutdown_connections 2024-08-19T00:23:14.725 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.720+0000 7f63416cb740 1 -- 172.21.15.44:0/1404638921 wait complete. 2024-08-19T00:23:14.725 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.721+0000 7f63416cb740 1 -- start start 2024-08-19T00:23:14.725 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.721+0000 7f63416cb740 1 Processor -- start 2024-08-19T00:23:14.728 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.721+0000 7f63416cb740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fcb15417d0 0x55fcb1554c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:14.728 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.721+0000 7f63416cb740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fcb15420f0 0x55fcb1555180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:14.728 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.721+0000 7f63416cb740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcb154c990 0x55fcb15461f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:14.728 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.721+0000 7f63416cb740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f63381b2310 con 0x55fcb154c990 2024-08-19T00:23:14.728 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.721+0000 7f63416cb740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f63381b1c40 con 0x55fcb15420f0 2024-08-19T00:23:14.728 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.721+0000 7f63416cb740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f63381aeea0 con 0x55fcb15417d0 2024-08-19T00:23:14.728 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.721+0000 7f63416cb740 10 client.0 _ll_register_callbacks cb 0x7f63280975c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:23:14.728 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.721+0000 7f633ceb0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcb154c990 0x55fcb15461f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:14.728 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.721+0000 7f633ceb0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcb154c990 0x55fcb15461f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33866/0 (socket says 172.21.15.44:33866) 2024-08-19T00:23:14.728 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.721+0000 7f633ceb0640 1 -- 172.21.15.44:0/4109930662 learned_addr learned my addr 172.21.15.44:0/4109930662 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:23:14.729 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.721+0000 7f6337fff640 1 --2- 172.21.15.44:0/4109930662 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fcb15417d0 0x55fcb1554c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:14.729 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.721+0000 7f63377fe640 1 --2- 172.21.15.44:0/4109930662 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fcb15420f0 0x55fcb1555180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:14.729 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.722+0000 7f633ceb0640 1 -- 172.21.15.44:0/4109930662 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fcb15417d0 msgr2=0x55fcb1554c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:23:14.729 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.722+0000 7f633ceb0640 1 --2- 172.21.15.44:0/4109930662 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fcb15417d0 0x55fcb1554c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:14.729 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.722+0000 7f633ceb0640 1 -- 172.21.15.44:0/4109930662 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fcb15420f0 msgr2=0x55fcb1555180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:23:14.729 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.722+0000 7f633ceb0640 1 --2- 172.21.15.44:0/4109930662 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fcb15420f0 0x55fcb1555180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:14.729 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.722+0000 7f633ceb0640 1 -- 172.21.15.44:0/4109930662 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcb15469f0 con 0x55fcb154c990 2024-08-19T00:23:14.729 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.722+0000 7f633ceb0640 1 --2- 172.21.15.44:0/4109930662 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcb154c990 0x55fcb15461f0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f6330002230 tx=0x7f6330005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=371791f6fc825235 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:23:14.729 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.722+0000 7f63177fe640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:23:14.729 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.722+0000 7f63177fe640 1 -- 172.21.15.44:0/4109930662 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63300055f0 con 0x55fcb154c990 2024-08-19T00:23:14.729 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.722+0000 7f63177fe640 1 -- 172.21.15.44:0/4109930662 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9533+0+0 (secure 0 0 0) 0x7f6330005790 con 0x55fcb154c990 2024-08-19T00:23:14.729 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.722+0000 7f63416cb740 1 -- 172.21.15.44:0/4109930662 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6330003e50 con 0x55fcb154c990 2024-08-19T00:23:14.729 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.722+0000 7f63177fe640 1 -- 172.21.15.44:0/4109930662 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f6330009480 con 0x55fcb154c990 2024-08-19T00:23:14.730 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.722+0000 7f63416cb740 10 client.16734 fetch_fsmap learned FSMap version 33 2024-08-19T00:23:14.730 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.722+0000 7f63416cb740 1 -- 172.21.15.44:0/4109930662 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55fcb15c6e30 con 0x55fcb154c990 2024-08-19T00:23:14.730 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.722+0000 7f63177fe640 1 -- 172.21.15.44:0/4109930662 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6330003e50 con 0x55fcb154c990 2024-08-19T00:23:14.730 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.722+0000 7f63177fe640 1 -- 172.21.15.44:0/4109930662 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f633001e070 con 0x55fcb154c990 2024-08-19T00:23:14.730 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.723+0000 7f63416cb740 10 client.16734 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:23:14.730 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.723+0000 7f63416cb740 10 client.16734 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:23:14.730 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.723+0000 7f63416cb740 20 client.16734 populate_metadata read hostname 'smithi044' 2024-08-19T00:23:14.730 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.723+0000 7f63416cb740 1 --2- 172.21.15.44:0/4109930662 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55fcb15c7250 0x55fcb15c9640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:14.730 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.723+0000 7f63416cb740 4 client.16734 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-19T00:23:14.730 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.723+0000 7f63416cb740 1 -- 172.21.15.44:0/4109930662 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fcb14ad450 con 0x55fcb15c7250 2024-08-19T00:23:14.730 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.723+0000 7f6337fff640 1 --2- 172.21.15.44:0/4109930662 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55fcb15c7250 0x55fcb15c9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:14.730 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.723+0000 7f63177fe640 10 client.16734 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:23:14.730 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.723+0000 7f6337fff640 1 --2- 172.21.15.44:0/4109930662 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55fcb15c7250 0x55fcb15c9640 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=114787ac991ad0bd server_cookie=42656f5b994f4da7 in_seq=0 out_seq=0 2024-08-19T00:23:14.736 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.734+0000 7f63177fe640 1 -- 172.21.15.44:0/4109930662 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fcb14ad450 con 0x55fcb15c7250 2024-08-19T00:23:14.736 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.734+0000 7f63177fe640 10 client.16734 handle_command_reply: tid=0 2024-08-19T00:23:14.736 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.734+0000 7f63416cb740 1 client.16734 shutdown 2024-08-19T00:23:14.736 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.734+0000 7f63416cb740 1 -- 172.21.15.44:0/4109930662 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcb154c990 msgr2=0x55fcb15461f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:14.737 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.734+0000 7f63416cb740 1 --2- 172.21.15.44:0/4109930662 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcb154c990 0x55fcb15461f0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f6330002230 tx=0x7f6330005ef0 comp rx=0 tx=0).stop 2024-08-19T00:23:14.737 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.734+0000 7f63416cb740 1 -- 172.21.15.44:0/4109930662 shutdown_connections 2024-08-19T00:23:14.737 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.734+0000 7f63416cb740 1 --2- 172.21.15.44:0/4109930662 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55fcb15c7250 0x55fcb15c9640 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:14.737 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.734+0000 7f63416cb740 1 --2- 172.21.15.44:0/4109930662 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fcb154c990 0x55fcb15461f0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:14.737 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.734+0000 7f63416cb740 1 --2- 172.21.15.44:0/4109930662 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fcb15420f0 0x55fcb1555180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:14.737 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.734+0000 7f63416cb740 1 --2- 172.21.15.44:0/4109930662 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fcb15417d0 0x55fcb1554c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:14.737 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.734+0000 7f63177fe640 0 client.16734 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:23:14.737 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.734+0000 7f63416cb740 1 -- 172.21.15.44:0/4109930662 >> 172.21.15.44:0/4109930662 conn(0x55fcb153dd40 msgr2=0x55fcb153cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:23:14.737 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.735+0000 7f63416cb740 1 -- 172.21.15.44:0/4109930662 shutdown_connections 2024-08-19T00:23:14.737 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.735+0000 7f63416cb740 1 -- 172.21.15.44:0/4109930662 wait complete. 2024-08-19T00:23:14.737 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.735+0000 7f63416cb740 20 client.16734 trim_cache size 0 max 16384 2024-08-19T00:23:14.738 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:{ 2024-08-19T00:23:14.738 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "message": "", 2024-08-19T00:23:14.738 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "return_code": 0 2024-08-19T00:23:14.738 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:} 2024-08-19T00:23:14.739 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.735+0000 7f633e913640 1 -- 172.21.15.44:0/2472008375 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f63200a2da0 msgr2=0x7f63200a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:14.739 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.735+0000 7f633e913640 1 --2- 172.21.15.44:0/2472008375 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f63200a2da0 0x7f63200a5260 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f632c009900 tx=0x7f632c0058d0 comp rx=0 tx=0).stop 2024-08-19T00:23:14.739 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.735+0000 7f633e913640 1 -- 172.21.15.44:0/2472008375 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6338101800 msgr2=0x7f633819a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:14.739 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.735+0000 7f633e913640 1 --2- 172.21.15.44:0/2472008375 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6338101800 0x7f633819a1e0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f632800c920 tx=0x7f632800cde0 comp rx=0 tx=0).stop 2024-08-19T00:23:14.739 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.735+0000 7f633e913640 1 -- 172.21.15.44:0/2472008375 shutdown_connections 2024-08-19T00:23:14.739 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.735+0000 7f633e913640 1 --2- 172.21.15.44:0/2472008375 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f63200a2da0 0x7f63200a5260 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:14.739 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.735+0000 7f633e913640 1 --2- 172.21.15.44:0/2472008375 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f63381021a0 0x7f633819a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:14.739 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.735+0000 7f633e913640 1 --2- 172.21.15.44:0/2472008375 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6338107810 0x7f633819eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:14.739 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.735+0000 7f633e913640 1 --2- 172.21.15.44:0/2472008375 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6338101800 0x7f633819a1e0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:14.739 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.735+0000 7f633e913640 1 -- 172.21.15.44:0/2472008375 >> 172.21.15.44:0/2472008375 conn(0x7f63380fd500 msgr2=0x7f63380fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:23:14.739 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.735+0000 7f633e913640 1 -- 172.21.15.44:0/2472008375 shutdown_connections 2024-08-19T00:23:14.739 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:14.735+0000 7f633e913640 1 -- 172.21.15.44:0/2472008375 wait complete. 2024-08-19T00:23:15.693 INFO:tasks.workunit.client.0.smithi044.stdout: 1 749165 7.90 MB/sec execute 400 sec latency 8136.433 ms 2024-08-19T00:23:16.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:23:15 smithi171 ceph-mon[21810]: pgmap v309: 129 pgs: 129 active+clean; 542 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.8 MiB/s wr, 124 op/s 2024-08-19T00:23:16.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:23:15 smithi116 ceph-mon[21873]: pgmap v309: 129 pgs: 129 active+clean; 542 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.8 MiB/s wr, 124 op/s 2024-08-19T00:23:16.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:23:15 smithi044 ceph-mon[18489]: pgmap v309: 129 pgs: 129 active+clean; 542 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.8 MiB/s wr, 124 op/s 2024-08-19T00:23:16.693 INFO:tasks.workunit.client.0.smithi044.stdout: 1 749165 7.89 MB/sec execute 401 sec latency 9136.563 ms 2024-08-19T00:23:17.693 INFO:tasks.workunit.client.0.smithi044.stdout: 1 749464 7.87 MB/sec execute 402 sec latency 9711.555 ms 2024-08-19T00:23:18.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:23:17 smithi171 ceph-mon[21810]: pgmap v310: 129 pgs: 129 active+clean; 542 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.8 MiB/s wr, 124 op/s 2024-08-19T00:23:18.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:23:17 smithi116 ceph-mon[21873]: pgmap v310: 129 pgs: 129 active+clean; 542 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.8 MiB/s wr, 124 op/s 2024-08-19T00:23:18.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:23:17 smithi044 ceph-mon[18489]: pgmap v310: 129 pgs: 129 active+clean; 542 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.8 MiB/s wr, 124 op/s 2024-08-19T00:23:18.693 INFO:tasks.workunit.client.0.smithi044.stdout: 1 750878 7.86 MB/sec execute 403 sec latency 61.140 ms 2024-08-19T00:23:19.693 INFO:tasks.workunit.client.0.smithi044.stdout: 1 752904 7.87 MB/sec execute 404 sec latency 24.817 ms 2024-08-19T00:23:20.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:23:19 smithi171 ceph-mon[21810]: pgmap v311: 129 pgs: 129 active+clean; 542 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.8 MiB/s wr, 124 op/s 2024-08-19T00:23:20.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:23:19 smithi116 ceph-mon[21873]: pgmap v311: 129 pgs: 129 active+clean; 542 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.8 MiB/s wr, 124 op/s 2024-08-19T00:23:20.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:23:19 smithi044 ceph-mon[18489]: pgmap v311: 129 pgs: 129 active+clean; 542 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.8 MiB/s wr, 124 op/s 2024-08-19T00:23:20.693 INFO:tasks.workunit.client.0.smithi044.stdout: 1 754630 7.87 MB/sec execute 405 sec latency 13.179 ms 2024-08-19T00:23:21.693 INFO:tasks.workunit.client.0.smithi044.stdout: 1 756566 7.89 MB/sec execute 406 sec latency 17.663 ms 2024-08-19T00:23:22.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:23:21 smithi171 ceph-mon[21810]: pgmap v312: 129 pgs: 129 active+clean; 537 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.7 MiB/s wr, 184 op/s 2024-08-19T00:23:22.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:23:21 smithi116 ceph-mon[21873]: pgmap v312: 129 pgs: 129 active+clean; 537 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.7 MiB/s wr, 184 op/s 2024-08-19T00:23:22.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:23:21 smithi044 ceph-mon[18489]: pgmap v312: 129 pgs: 129 active+clean; 537 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.7 MiB/s wr, 184 op/s 2024-08-19T00:23:22.693 INFO:tasks.workunit.client.0.smithi044.stdout: 1 758495 7.88 MB/sec execute 407 sec latency 16.954 ms 2024-08-19T00:23:23.693 INFO:tasks.workunit.client.0.smithi044.stdout: 1 760119 7.89 MB/sec execute 408 sec latency 128.207 ms 2024-08-19T00:23:24.167 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:23:23 smithi116 ceph-mon[21873]: pgmap v313: 129 pgs: 129 active+clean; 537 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 980 KiB/s rd, 2.3 MiB/s wr, 112 op/s 2024-08-19T00:23:24.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:23:23 smithi171 ceph-mon[21810]: pgmap v313: 129 pgs: 129 active+clean; 537 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 980 KiB/s rd, 2.3 MiB/s wr, 112 op/s 2024-08-19T00:23:24.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:23:23 smithi044 ceph-mon[18489]: pgmap v313: 129 pgs: 129 active+clean; 537 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 980 KiB/s rd, 2.3 MiB/s wr, 112 op/s 2024-08-19T00:23:24.693 INFO:tasks.workunit.client.0.smithi044.stdout: 1 761727 7.89 MB/sec execute 409 sec latency 31.681 ms 2024-08-19T00:23:25.693 INFO:tasks.workunit.client.0.smithi044.stdout: 1 763783 7.90 MB/sec execute 410 sec latency 13.618 ms 2024-08-19T00:23:26.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:23:25 smithi171 ceph-mon[21810]: pgmap v314: 129 pgs: 129 active+clean; 546 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.0 MiB/s wr, 208 op/s 2024-08-19T00:23:26.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:23:25 smithi116 ceph-mon[21873]: pgmap v314: 129 pgs: 129 active+clean; 546 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.0 MiB/s wr, 208 op/s 2024-08-19T00:23:26.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:23:25 smithi044 ceph-mon[18489]: pgmap v314: 129 pgs: 129 active+clean; 546 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.0 MiB/s wr, 208 op/s 2024-08-19T00:23:26.693 INFO:tasks.workunit.client.0.smithi044.stdout: 1 765827 7.90 MB/sec execute 411 sec latency 14.995 ms 2024-08-19T00:23:27.693 INFO:tasks.workunit.client.0.smithi044.stdout: 1 767431 7.91 MB/sec execute 412 sec latency 16.982 ms 2024-08-19T00:23:27.826 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.824+0000 7f65e1e1e640 1 -- 172.21.15.44:0/1946719172 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65dc1006e0 msgr2=0x7f65dc100b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:27.826 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.824+0000 7f65e1e1e640 1 --2- 172.21.15.44:0/1946719172 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65dc1006e0 0x7f65dc100b40 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f65d0009930 tx=0x7f65d002a420 comp rx=0 tx=0).stop 2024-08-19T00:23:27.826 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.824+0000 7f65e1e1e640 1 -- 172.21.15.44:0/1946719172 shutdown_connections 2024-08-19T00:23:27.826 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.824+0000 7f65e1e1e640 1 --2- 172.21.15.44:0/1946719172 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f65dc101080 0x7f65dc10d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:27.827 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.824+0000 7f65e1e1e640 1 --2- 172.21.15.44:0/1946719172 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65dc1006e0 0x7f65dc100b40 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:27.827 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.824+0000 7f65e1e1e640 1 --2- 172.21.15.44:0/1946719172 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f65dc1066f0 0x7f65dc106ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:27.827 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.824+0000 7f65e1e1e640 1 -- 172.21.15.44:0/1946719172 >> 172.21.15.44:0/1946719172 conn(0x7f65dc0776c0 msgr2=0x7f65dc0fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:23:27.827 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.824+0000 7f65e1e1e640 1 -- 172.21.15.44:0/1946719172 shutdown_connections 2024-08-19T00:23:27.827 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.824+0000 7f65e1e1e640 1 -- 172.21.15.44:0/1946719172 wait complete. 2024-08-19T00:23:27.827 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.825+0000 7f65e1e1e640 1 Processor -- start 2024-08-19T00:23:27.829 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.825+0000 7f65e1e1e640 1 -- start start 2024-08-19T00:23:27.829 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.825+0000 7f65e1e1e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f65dc1006e0 0x7f65dc198f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:27.829 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.825+0000 7f65e1e1e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f65dc101080 0x7f65dc199450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:27.829 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.825+0000 7f65e1e1e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65dc1066f0 0x7f65dc1a3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:27.829 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.825+0000 7f65e1e1e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f65dc110b30 con 0x7f65dc1066f0 2024-08-19T00:23:27.829 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.825+0000 7f65e1e1e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f65dc1109b0 con 0x7f65dc101080 2024-08-19T00:23:27.829 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.825+0000 7f65e1e1e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f65dc110cb0 con 0x7f65dc1006e0 2024-08-19T00:23:27.829 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.826+0000 7f65db7fe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f65dc1006e0 0x7f65dc198f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:27.830 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.826+0000 7f65daffd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f65dc101080 0x7f65dc199450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:27.830 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.826+0000 7f65db7fe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f65dc1006e0 0x7f65dc198f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.44:38280/0 (socket says 172.21.15.44:38280) 2024-08-19T00:23:27.830 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.826+0000 7f65db7fe640 1 -- 172.21.15.44:0/1441171261 learned_addr learned my addr 172.21.15.44:0/1441171261 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:23:27.830 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.826+0000 7f65dbfff640 1 --2- 172.21.15.44:0/1441171261 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65dc1066f0 0x7f65dc1a3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:27.830 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.826+0000 7f65db7fe640 1 -- 172.21.15.44:0/1441171261 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f65dc101080 msgr2=0x7f65dc199450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:27.830 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.826+0000 7f65db7fe640 1 --2- 172.21.15.44:0/1441171261 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f65dc101080 0x7f65dc199450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:27.830 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.826+0000 7f65db7fe640 1 -- 172.21.15.44:0/1441171261 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65dc1066f0 msgr2=0x7f65dc1a3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:27.830 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.826+0000 7f65db7fe640 1 --2- 172.21.15.44:0/1441171261 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65dc1066f0 0x7f65dc1a3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:27.830 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.826+0000 7f65db7fe640 1 -- 172.21.15.44:0/1441171261 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65dc1a44d0 con 0x7f65dc1006e0 2024-08-19T00:23:27.830 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.826+0000 7f65dbfff640 1 --2- 172.21.15.44:0/1441171261 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65dc1066f0 0x7f65dc1a3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:23:27.830 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.826+0000 7f65db7fe640 1 --2- 172.21.15.44:0/1441171261 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f65dc1006e0 0x7f65dc198f10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f65cc009f40 tx=0x7f65cc00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:23:27.831 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.826+0000 7f65d8ff9640 1 -- 172.21.15.44:0/1441171261 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65cc00cd80 con 0x7f65dc1006e0 2024-08-19T00:23:27.831 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.826+0000 7f65e1e1e640 1 -- 172.21.15.44:0/1441171261 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65dc196d00 con 0x7f65dc1006e0 2024-08-19T00:23:27.831 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.826+0000 7f65d8ff9640 1 -- 172.21.15.44:0/1441171261 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65cc005500 con 0x7f65dc1006e0 2024-08-19T00:23:27.831 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.826+0000 7f65d8ff9640 1 -- 172.21.15.44:0/1441171261 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65cc004a00 con 0x7f65dc1006e0 2024-08-19T00:23:27.831 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.827+0000 7f65e1e1e640 1 -- 172.21.15.44:0/1441171261 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65dc1971d0 con 0x7f65dc1006e0 2024-08-19T00:23:27.832 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.829+0000 7f65d8ff9640 1 -- 172.21.15.44:0/1441171261 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f65cc004ba0 con 0x7f65dc1006e0 2024-08-19T00:23:27.833 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.829+0000 7f65e4be0740 1 Processor -- start 2024-08-19T00:23:27.833 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.829+0000 7f65e4be0740 1 -- start start 2024-08-19T00:23:27.833 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.830+0000 7f65e4be0740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5629f8fac7d0 0x5629f8facbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:27.833 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.830+0000 7f65e4be0740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5629f8fad0f0 0x5629f8fb7450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:27.833 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.830+0000 7f65e4be0740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5629f8fb7990 0x5629f8fb9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:27.833 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.830+0000 7f65e4be0740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5629f8f109d0 con 0x5629f8fac7d0 2024-08-19T00:23:27.833 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.830+0000 7f65e4be0740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5629f8eb8820 con 0x5629f8fad0f0 2024-08-19T00:23:27.833 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.830+0000 7f65e4be0740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5629f8f0c990 con 0x5629f8fb7990 2024-08-19T00:23:27.834 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.830+0000 7f65dbfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5629f8fac7d0 0x5629f8facbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:27.834 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.830+0000 7f65dbfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5629f8fac7d0 0x5629f8facbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42154/0 (socket says 172.21.15.44:42154) 2024-08-19T00:23:27.834 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.830+0000 7f65dbfff640 1 -- 172.21.15.44:0/2447671071 learned_addr learned my addr 172.21.15.44:0/2447671071 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:23:27.834 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.830+0000 7f65d8ff9640 1 --2- 172.21.15.44:0/1441171261 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f65c40a2da0 0x7f65c40a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:27.834 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.830+0000 7f65db7fe640 1 --2- 172.21.15.44:0/2447671071 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5629f8fad0f0 0x5629f8fb7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:27.834 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.830+0000 7f65daffd640 1 --2- 172.21.15.44:0/2447671071 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5629f8fb7990 0x5629f8fb9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:27.834 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.830+0000 7f65dbfff640 1 --2- 172.21.15.44:0/1441171261 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f65c40a2da0 0x7f65c40a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:27.834 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.830+0000 7f65d8ff9640 1 -- 172.21.15.44:0/1441171261 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9533+0+0 (secure 0 0 0) 0x7f65cc0d3a90 con 0x7f65dc1006e0 2024-08-19T00:23:27.834 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.830+0000 7f65db7fe640 1 -- 172.21.15.44:0/2447671071 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5629f8fb7990 msgr2=0x5629f8fb9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:23:27.834 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.830+0000 7f65db7fe640 1 --2- 172.21.15.44:0/2447671071 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5629f8fb7990 0x5629f8fb9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:27.834 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.830+0000 7f65db7fe640 1 -- 172.21.15.44:0/2447671071 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5629f8fac7d0 msgr2=0x5629f8facbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:23:27.834 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.830+0000 7f65db7fe640 1 --2- 172.21.15.44:0/2447671071 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5629f8fac7d0 0x5629f8facbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:27.834 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.830+0000 7f65db7fe640 1 -- 172.21.15.44:0/2447671071 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629f8c24210 con 0x5629f8fad0f0 2024-08-19T00:23:27.835 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.830+0000 7f65daffd640 1 --2- 172.21.15.44:0/2447671071 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5629f8fb7990 0x5629f8fb9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:23:27.835 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.831+0000 7f65db7fe640 1 --2- 172.21.15.44:0/2447671071 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5629f8fad0f0 0x5629f8fb7450 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f65cc0d0f00 tx=0x7f65cc009720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=647ebd47677fbad9 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:23:27.835 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.831+0000 7f65c1ffb640 1 -- 172.21.15.44:0/2447671071 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65cc09f630 con 0x5629f8fad0f0 2024-08-19T00:23:27.835 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.831+0000 7f65c1ffb640 1 -- 172.21.15.44:0/2447671071 <== mon.2 v2:172.21.15.116:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65cc0a03d0 con 0x5629f8fad0f0 2024-08-19T00:23:27.835 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.831+0000 7f65c1ffb640 1 -- 172.21.15.44:0/2447671071 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65cc0056b0 con 0x5629f8fad0f0 2024-08-19T00:23:27.838 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.832+0000 7f65e4be0740 1 -- 172.21.15.44:0/2447671071 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5629f8fad0f0 msgr2=0x5629f8fb7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:27.838 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.832+0000 7f65dbfff640 1 --2- 172.21.15.44:0/1441171261 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f65c40a2da0 0x7f65c40a5260 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f65d4005c40 tx=0x7f65d4004ab0 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:23:27.838 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.832+0000 7f65e4be0740 1 --2- 172.21.15.44:0/2447671071 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5629f8fad0f0 0x5629f8fb7450 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f65cc0d0f00 tx=0x7f65cc009720 comp rx=0 tx=0).stop 2024-08-19T00:23:27.838 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.832+0000 7f65e4be0740 1 -- 172.21.15.44:0/2447671071 shutdown_connections 2024-08-19T00:23:27.838 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.832+0000 7f65e4be0740 1 --2- 172.21.15.44:0/2447671071 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5629f8fb7990 0x5629f8fb9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:27.838 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.832+0000 7f65e4be0740 1 --2- 172.21.15.44:0/2447671071 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5629f8fad0f0 0x5629f8fb7450 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:27.838 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.832+0000 7f65e4be0740 1 --2- 172.21.15.44:0/2447671071 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5629f8fac7d0 0x5629f8facbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:27.838 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.832+0000 7f65e4be0740 1 -- 172.21.15.44:0/2447671071 >> 172.21.15.44:0/2447671071 conn(0x5629f8fa8d40 msgr2=0x5629f8fa9120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:23:27.838 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.832+0000 7f65e4be0740 1 -- 172.21.15.44:0/2447671071 shutdown_connections 2024-08-19T00:23:27.838 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.832+0000 7f65e4be0740 1 -- 172.21.15.44:0/2447671071 wait complete. 2024-08-19T00:23:27.838 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.833+0000 7f65e4be0740 1 -- start start 2024-08-19T00:23:27.839 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.833+0000 7f65e4be0740 1 Processor -- start 2024-08-19T00:23:27.839 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.833+0000 7f65e4be0740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5629f8fac7d0 0x5629f8fb4990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:27.839 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.833+0000 7f65e4be0740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5629f8fad0f0 0x5629f8fb4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:27.839 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.833+0000 7f65e4be0740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5629f8fb7990 0x5629f8fb5410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:27.839 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.833+0000 7f65e4be0740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5629f8fba560 con 0x5629f8fad0f0 2024-08-19T00:23:27.839 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.833+0000 7f65e4be0740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5629f8ecc520 con 0x5629f8fac7d0 2024-08-19T00:23:27.839 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.833+0000 7f65e4be0740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5629f8fba6e0 con 0x5629f8fb7990 2024-08-19T00:23:27.839 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.833+0000 7f65e4be0740 10 client.0 _ll_register_callbacks cb 0x5629f8c23a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:23:27.839 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.833+0000 7f65daffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5629f8fad0f0 0x5629f8fb4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:27.839 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.833+0000 7f65db7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5629f8fac7d0 0x5629f8fb4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:27.839 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.833+0000 7f65db7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5629f8fac7d0 0x5629f8fb4990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.44:36064/0 (socket says 172.21.15.44:36064) 2024-08-19T00:23:27.839 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.833+0000 7f65daffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5629f8fad0f0 0x5629f8fb4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42166/0 (socket says 172.21.15.44:42166) 2024-08-19T00:23:27.840 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.833+0000 7f65db7fe640 1 -- 172.21.15.44:0/3643818298 learned_addr learned my addr 172.21.15.44:0/3643818298 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:23:27.840 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.833+0000 7f65dbfff640 1 --2- 172.21.15.44:0/3643818298 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5629f8fb7990 0x5629f8fb5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:27.840 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.834+0000 7f65db7fe640 1 -- 172.21.15.44:0/3643818298 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5629f8fb7990 msgr2=0x5629f8fb5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:23:27.840 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.834+0000 7f65db7fe640 1 --2- 172.21.15.44:0/3643818298 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5629f8fb7990 0x5629f8fb5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:27.840 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.834+0000 7f65db7fe640 1 -- 172.21.15.44:0/3643818298 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5629f8fad0f0 msgr2=0x5629f8fb4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:23:27.840 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.834+0000 7f65db7fe640 1 --2- 172.21.15.44:0/3643818298 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5629f8fad0f0 0x5629f8fb4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:27.840 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.834+0000 7f65db7fe640 1 -- 172.21.15.44:0/3643818298 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629f8cf0620 con 0x5629f8fac7d0 2024-08-19T00:23:27.840 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.834+0000 7f65db7fe640 1 --2- 172.21.15.44:0/3643818298 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5629f8fac7d0 0x5629f8fb4990 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f65cc09fc60 tx=0x7f65cc0056b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7fee9386107643da server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:23:27.840 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.834+0000 7f65baffd640 10 client.0 ms_handle_connect on v2:172.21.15.116:3300/0 2024-08-19T00:23:27.840 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.834+0000 7f65baffd640 1 -- 172.21.15.44:0/3643818298 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65cc09fcd0 con 0x5629f8fac7d0 2024-08-19T00:23:27.840 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.834+0000 7f65baffd640 1 -- 172.21.15.44:0/3643818298 <== mon.2 v2:172.21.15.116:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9533+0+0 (secure 0 0 0) 0x7f65cc09ff30 con 0x5629f8fac7d0 2024-08-19T00:23:27.840 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.834+0000 7f65e4be0740 1 -- 172.21.15.44:0/3643818298 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65cc0a03d0 con 0x5629f8fac7d0 2024-08-19T00:23:27.840 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.834+0000 7f65baffd640 1 -- 172.21.15.44:0/3643818298 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f65cc0a8940 con 0x5629f8fac7d0 2024-08-19T00:23:27.841 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.834+0000 7f65e4be0740 10 client.26153 fetch_fsmap learned FSMap version 33 2024-08-19T00:23:27.841 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.834+0000 7f65e4be0740 1 -- 172.21.15.44:0/3643818298 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5629f8fc62d0 con 0x5629f8fac7d0 2024-08-19T00:23:27.841 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.835+0000 7f65baffd640 1 -- 172.21.15.44:0/3643818298 <== mon.2 v2:172.21.15.116:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65cc0a03d0 con 0x5629f8fac7d0 2024-08-19T00:23:27.841 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.835+0000 7f65baffd640 1 -- 172.21.15.44:0/3643818298 <== mon.2 v2:172.21.15.116:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f65cc09f240 con 0x5629f8fac7d0 2024-08-19T00:23:27.841 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.835+0000 7f65e4be0740 10 client.26153 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:23:27.841 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.835+0000 7f65e4be0740 10 client.26153 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:23:27.841 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.835+0000 7f65e4be0740 20 client.26153 populate_metadata read hostname 'smithi044' 2024-08-19T00:23:27.841 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.835+0000 7f65e4be0740 1 --2- 172.21.15.44:0/3643818298 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5629f8fc7620 0x5629f8fc9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:27.841 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.835+0000 7f65e4be0740 4 client.26153 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:23:27.841 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.835+0000 7f65e4be0740 1 -- 172.21.15.44:0/3643818298 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5629f8f1e100 con 0x5629f8fc7620 2024-08-19T00:23:27.841 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.835+0000 7f65daffd640 1 --2- 172.21.15.44:0/3643818298 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5629f8fc7620 0x5629f8fc9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:27.841 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.836+0000 7f65baffd640 10 client.26153 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:23:27.841 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.836+0000 7f65daffd640 1 --2- 172.21.15.44:0/3643818298 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5629f8fc7620 0x5629f8fc9a10 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9aed894355e9a279 server_cookie=c4639123b81078b2 in_seq=0 out_seq=0 2024-08-19T00:23:27.843 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.837+0000 7f65baffd640 1 -- 172.21.15.44:0/3643818298 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5629f8f1e100 con 0x5629f8fc7620 2024-08-19T00:23:27.843 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.837+0000 7f65baffd640 10 client.26153 handle_command_reply: tid=0 2024-08-19T00:23:27.843 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.837+0000 7f65e4be0740 1 client.26153 shutdown 2024-08-19T00:23:27.843 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.837+0000 7f65e4be0740 1 -- 172.21.15.44:0/3643818298 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5629f8fac7d0 msgr2=0x5629f8fb4990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:27.843 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.837+0000 7f65e4be0740 1 --2- 172.21.15.44:0/3643818298 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5629f8fac7d0 0x5629f8fb4990 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f65cc09fc60 tx=0x7f65cc0056b0 comp rx=0 tx=0).stop 2024-08-19T00:23:27.843 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.837+0000 7f65e4be0740 1 -- 172.21.15.44:0/3643818298 shutdown_connections 2024-08-19T00:23:27.843 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.837+0000 7f65e4be0740 1 --2- 172.21.15.44:0/3643818298 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5629f8fc7620 0x5629f8fc9a10 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:27.843 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.837+0000 7f65e4be0740 1 --2- 172.21.15.44:0/3643818298 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5629f8fb7990 0x5629f8fb5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:27.843 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.837+0000 7f65baffd640 0 client.26153 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:23:27.843 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.837+0000 7f65e4be0740 1 --2- 172.21.15.44:0/3643818298 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5629f8fad0f0 0x5629f8fb4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:27.843 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.837+0000 7f65e4be0740 1 --2- 172.21.15.44:0/3643818298 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5629f8fac7d0 0x5629f8fb4990 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:27.844 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.837+0000 7f65e4be0740 1 -- 172.21.15.44:0/3643818298 >> 172.21.15.44:0/3643818298 conn(0x5629f8fa8d40 msgr2=0x5629f8faeaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:23:27.844 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.837+0000 7f65e4be0740 1 -- 172.21.15.44:0/3643818298 shutdown_connections 2024-08-19T00:23:27.844 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.837+0000 7f65e4be0740 1 -- 172.21.15.44:0/3643818298 wait complete. 2024-08-19T00:23:27.844 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.837+0000 7f65e4be0740 20 client.26153 trim_cache size 0 max 16384 2024-08-19T00:23:27.858 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.852+0000 7f65e4be0740 1 Processor -- start 2024-08-19T00:23:27.859 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.852+0000 7f65e4be0740 1 -- start start 2024-08-19T00:23:27.859 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.852+0000 7f65e4be0740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5629f8fac7d0 0x5629f8fa7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:27.859 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.852+0000 7f65e4be0740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5629f8fad0f0 0x5629f8fb1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:27.859 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.852+0000 7f65e4be0740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5629f8fb7990 0x5629f8fb2110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:27.860 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.853+0000 7f65e4be0740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f65dc1acc10 con 0x5629f8fb7990 2024-08-19T00:23:27.860 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.853+0000 7f65e4be0740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f65dc1ae750 con 0x5629f8fad0f0 2024-08-19T00:23:27.860 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.853+0000 7f65e4be0740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f65dc1ad2e0 con 0x5629f8fac7d0 2024-08-19T00:23:27.860 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.853+0000 7f65dbfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5629f8fb7990 0x5629f8fb2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:27.860 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.853+0000 7f65dbfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5629f8fb7990 0x5629f8fb2110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42178/0 (socket says 172.21.15.44:42178) 2024-08-19T00:23:27.860 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.853+0000 7f65dbfff640 1 -- 172.21.15.44:0/3846594922 learned_addr learned my addr 172.21.15.44:0/3846594922 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:23:27.860 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.853+0000 7f65daffd640 1 --2- 172.21.15.44:0/3846594922 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5629f8fad0f0 0x5629f8fb1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:27.860 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.853+0000 7f65db7fe640 1 --2- 172.21.15.44:0/3846594922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5629f8fac7d0 0x5629f8fa7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:27.860 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.853+0000 7f65dbfff640 1 -- 172.21.15.44:0/3846594922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5629f8fac7d0 msgr2=0x5629f8fa7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:23:27.860 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.853+0000 7f65dbfff640 1 --2- 172.21.15.44:0/3846594922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5629f8fac7d0 0x5629f8fa7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:27.860 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.853+0000 7f65dbfff640 1 -- 172.21.15.44:0/3846594922 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5629f8fad0f0 msgr2=0x5629f8fb1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:23:27.860 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.853+0000 7f65dbfff640 1 --2- 172.21.15.44:0/3846594922 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5629f8fad0f0 0x5629f8fb1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:27.860 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.853+0000 7f65dbfff640 1 -- 172.21.15.44:0/3846594922 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629f8fb9d80 con 0x5629f8fb7990 2024-08-19T00:23:27.861 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.853+0000 7f65daffd640 1 --2- 172.21.15.44:0/3846594922 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5629f8fad0f0 0x5629f8fb1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:23:27.861 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.853+0000 7f65db7fe640 1 --2- 172.21.15.44:0/3846594922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5629f8fac7d0 0x5629f8fa7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:23:27.861 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.853+0000 7f65dbfff640 1 --2- 172.21.15.44:0/3846594922 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5629f8fb7990 0x5629f8fb2110 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f65d4012fd0 tx=0x7f65d4009af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3b365231e9fe0d1 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:23:27.861 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.853+0000 7f65c17fa640 1 -- 172.21.15.44:0/3846594922 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d40121d0 con 0x5629f8fb7990 2024-08-19T00:23:27.861 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.853+0000 7f65c17fa640 1 -- 172.21.15.44:0/3846594922 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65d4010920 con 0x5629f8fb7990 2024-08-19T00:23:27.861 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.853+0000 7f65c17fa640 1 -- 172.21.15.44:0/3846594922 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d40055b0 con 0x5629f8fb7990 2024-08-19T00:23:27.861 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.854+0000 7f65e4be0740 1 -- 172.21.15.44:0/3846594922 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5629f8fb7990 msgr2=0x5629f8fb2110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:27.861 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.854+0000 7f65e4be0740 1 --2- 172.21.15.44:0/3846594922 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5629f8fb7990 0x5629f8fb2110 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f65d4012fd0 tx=0x7f65d4009af0 comp rx=0 tx=0).stop 2024-08-19T00:23:27.861 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.854+0000 7f65e4be0740 1 -- 172.21.15.44:0/3846594922 shutdown_connections 2024-08-19T00:23:27.861 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.854+0000 7f65e4be0740 1 --2- 172.21.15.44:0/3846594922 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5629f8fb7990 0x5629f8fb2110 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:27.861 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.854+0000 7f65e4be0740 1 --2- 172.21.15.44:0/3846594922 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5629f8fad0f0 0x5629f8fb1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:27.861 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.854+0000 7f65e4be0740 1 --2- 172.21.15.44:0/3846594922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5629f8fac7d0 0x5629f8fa7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:27.862 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.854+0000 7f65e4be0740 1 -- 172.21.15.44:0/3846594922 >> 172.21.15.44:0/3846594922 conn(0x5629f8fa8d40 msgr2=0x5629f8fa7680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:23:27.862 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.854+0000 7f65e4be0740 1 -- 172.21.15.44:0/3846594922 shutdown_connections 2024-08-19T00:23:27.862 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.854+0000 7f65e4be0740 1 -- 172.21.15.44:0/3846594922 wait complete. 2024-08-19T00:23:27.862 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.854+0000 7f65e4be0740 1 -- start start 2024-08-19T00:23:27.862 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.855+0000 7f65e4be0740 1 Processor -- start 2024-08-19T00:23:27.862 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.855+0000 7f65e4be0740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5629f8fac7d0 0x5629f8fcab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:27.862 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.855+0000 7f65e4be0740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5629f8fad0f0 0x5629f8fcb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:27.862 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.855+0000 7f65e4be0740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5629f8fb7990 0x5629f9030f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:27.862 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.855+0000 7f65e4be0740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f65dc1ae080 con 0x5629f8fad0f0 2024-08-19T00:23:27.862 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.855+0000 7f65e4be0740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f65dc1ad9b0 con 0x5629f8fb7990 2024-08-19T00:23:27.862 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.855+0000 7f65e4be0740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f65dc1aac10 con 0x5629f8fac7d0 2024-08-19T00:23:27.862 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.855+0000 7f65e4be0740 10 client.0 _ll_register_callbacks cb 0x7f65d4012490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:23:27.862 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.855+0000 7f65daffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5629f8fad0f0 0x5629f8fcb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:27.863 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.855+0000 7f65daffd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5629f8fad0f0 0x5629f8fcb0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42180/0 (socket says 172.21.15.44:42180) 2024-08-19T00:23:27.863 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.855+0000 7f65daffd640 1 -- 172.21.15.44:0/267947431 learned_addr learned my addr 172.21.15.44:0/267947431 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:23:27.863 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.855+0000 7f65dbfff640 1 --2- 172.21.15.44:0/267947431 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5629f8fb7990 0x5629f9030f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:27.863 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.855+0000 7f65db7fe640 1 --2- 172.21.15.44:0/267947431 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5629f8fac7d0 0x5629f8fcab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:27.863 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.855+0000 7f65daffd640 1 -- 172.21.15.44:0/267947431 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5629f8fac7d0 msgr2=0x5629f8fcab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:23:27.863 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.855+0000 7f65daffd640 1 --2- 172.21.15.44:0/267947431 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5629f8fac7d0 0x5629f8fcab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:27.863 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.855+0000 7f65daffd640 1 -- 172.21.15.44:0/267947431 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5629f8fb7990 msgr2=0x5629f9030f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:23:27.863 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.855+0000 7f65daffd640 1 --2- 172.21.15.44:0/267947431 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5629f8fb7990 0x5629f9030f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:27.863 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.855+0000 7f65daffd640 1 -- 172.21.15.44:0/267947431 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629f90314a0 con 0x5629f8fad0f0 2024-08-19T00:23:27.863 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.855+0000 7f65daffd640 1 --2- 172.21.15.44:0/267947431 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5629f8fad0f0 0x5629f8fcb0c0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f65d0009930 tx=0x7f65d0031860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee0ff7697c3c4753 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:23:27.863 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.855+0000 7f65baffd640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:23:27.863 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.856+0000 7f65baffd640 1 -- 172.21.15.44:0/267947431 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d0035040 con 0x5629f8fad0f0 2024-08-19T00:23:27.863 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.856+0000 7f65baffd640 1 -- 172.21.15.44:0/267947431 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9533+0+0 (secure 0 0 0) 0x7f65d0004240 con 0x5629f8fad0f0 2024-08-19T00:23:27.864 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.856+0000 7f65e4be0740 1 -- 172.21.15.44:0/267947431 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65d4010920 con 0x5629f8fad0f0 2024-08-19T00:23:27.864 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.856+0000 7f65baffd640 1 -- 172.21.15.44:0/267947431 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f65d0057050 con 0x5629f8fad0f0 2024-08-19T00:23:27.864 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.856+0000 7f65e4be0740 10 client.16752 fetch_fsmap learned FSMap version 33 2024-08-19T00:23:27.864 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.856+0000 7f65e4be0740 1 -- 172.21.15.44:0/267947431 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5629f9032630 con 0x5629f8fad0f0 2024-08-19T00:23:27.864 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.856+0000 7f65baffd640 1 -- 172.21.15.44:0/267947431 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65d4010920 con 0x5629f8fad0f0 2024-08-19T00:23:27.864 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.856+0000 7f65baffd640 1 -- 172.21.15.44:0/267947431 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f65d00475a0 con 0x5629f8fad0f0 2024-08-19T00:23:27.864 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.856+0000 7f65e4be0740 10 client.16752 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:23:27.864 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.856+0000 7f65e4be0740 10 client.16752 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:23:27.864 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.856+0000 7f65e4be0740 20 client.16752 populate_metadata read hostname 'smithi044' 2024-08-19T00:23:27.864 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.856+0000 7f65e4be0740 1 --2- 172.21.15.44:0/267947431 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5629f9032de0 0x5629f9035200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:27.864 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.856+0000 7f65e4be0740 4 client.16752 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-19T00:23:27.864 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.856+0000 7f65e4be0740 1 -- 172.21.15.44:0/267947431 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5629f8f18450 con 0x5629f9032de0 2024-08-19T00:23:27.864 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.857+0000 7f65db7fe640 1 --2- 172.21.15.44:0/267947431 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5629f9032de0 0x5629f9035200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:27.865 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.857+0000 7f65db7fe640 1 --2- 172.21.15.44:0/267947431 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5629f9032de0 0x5629f9035200 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e93ef72024ac90a3 server_cookie=e6453db8fe9d40d0 in_seq=0 out_seq=0 2024-08-19T00:23:27.865 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.857+0000 7f65baffd640 10 client.16752 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:23:27.870 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.868+0000 7f65baffd640 1 -- 172.21.15.44:0/267947431 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5629f8f18450 con 0x5629f9032de0 2024-08-19T00:23:27.870 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.868+0000 7f65baffd640 10 client.16752 handle_command_reply: tid=0 2024-08-19T00:23:27.870 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.868+0000 7f65e4be0740 1 client.16752 shutdown 2024-08-19T00:23:27.870 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.868+0000 7f65e4be0740 1 -- 172.21.15.44:0/267947431 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5629f8fad0f0 msgr2=0x5629f8fcb0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:27.870 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.868+0000 7f65e4be0740 1 --2- 172.21.15.44:0/267947431 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5629f8fad0f0 0x5629f8fcb0c0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f65d0009930 tx=0x7f65d0031860 comp rx=0 tx=0).stop 2024-08-19T00:23:27.870 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.868+0000 7f65e4be0740 1 -- 172.21.15.44:0/267947431 shutdown_connections 2024-08-19T00:23:27.870 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.868+0000 7f65e4be0740 1 --2- 172.21.15.44:0/267947431 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5629f9032de0 0x5629f9035200 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:27.871 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.868+0000 7f65e4be0740 1 --2- 172.21.15.44:0/267947431 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5629f8fb7990 0x5629f9030f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:27.871 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.868+0000 7f65e4be0740 1 --2- 172.21.15.44:0/267947431 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5629f8fad0f0 0x5629f8fcb0c0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:27.871 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.868+0000 7f65baffd640 0 client.16752 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:23:27.871 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.868+0000 7f65e4be0740 1 --2- 172.21.15.44:0/267947431 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5629f8fac7d0 0x5629f8fcab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:27.871 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.868+0000 7f65e4be0740 1 -- 172.21.15.44:0/267947431 >> 172.21.15.44:0/267947431 conn(0x5629f8fa8d40 msgr2=0x5629f8fb5150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:23:27.871 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.868+0000 7f65e4be0740 1 -- 172.21.15.44:0/267947431 shutdown_connections 2024-08-19T00:23:27.871 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.868+0000 7f65e4be0740 1 -- 172.21.15.44:0/267947431 wait complete. 2024-08-19T00:23:27.871 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.868+0000 7f65e4be0740 20 client.16752 trim_cache size 0 max 16384 2024-08-19T00:23:27.871 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:{ 2024-08-19T00:23:27.871 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "message": "", 2024-08-19T00:23:27.872 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "return_code": 0 2024-08-19T00:23:27.872 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:} 2024-08-19T00:23:27.872 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.869+0000 7f65e1e1e640 1 -- 172.21.15.44:0/1441171261 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f65c40a2da0 msgr2=0x7f65c40a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:27.872 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.869+0000 7f65e1e1e640 1 --2- 172.21.15.44:0/1441171261 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f65c40a2da0 0x7f65c40a5260 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f65d4005c40 tx=0x7f65d4004ab0 comp rx=0 tx=0).stop 2024-08-19T00:23:27.873 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.869+0000 7f65e1e1e640 1 -- 172.21.15.44:0/1441171261 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f65dc1006e0 msgr2=0x7f65dc198f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:27.873 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.869+0000 7f65e1e1e640 1 --2- 172.21.15.44:0/1441171261 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f65dc1006e0 0x7f65dc198f10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f65cc009f40 tx=0x7f65cc00ee80 comp rx=0 tx=0).stop 2024-08-19T00:23:27.873 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.869+0000 7f65e1e1e640 1 -- 172.21.15.44:0/1441171261 shutdown_connections 2024-08-19T00:23:27.873 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.869+0000 7f65e1e1e640 1 --2- 172.21.15.44:0/1441171261 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f65c40a2da0 0x7f65c40a5260 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:27.873 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.869+0000 7f65e1e1e640 1 --2- 172.21.15.44:0/1441171261 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65dc1066f0 0x7f65dc1a3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:27.873 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.869+0000 7f65e1e1e640 1 --2- 172.21.15.44:0/1441171261 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f65dc101080 0x7f65dc199450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:27.873 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.869+0000 7f65e1e1e640 1 --2- 172.21.15.44:0/1441171261 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f65dc1006e0 0x7f65dc198f10 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:27.873 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.869+0000 7f65e1e1e640 1 -- 172.21.15.44:0/1441171261 >> 172.21.15.44:0/1441171261 conn(0x7f65dc0776c0 msgr2=0x7f65dc103560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:23:27.873 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.869+0000 7f65e1e1e640 1 -- 172.21.15.44:0/1441171261 shutdown_connections 2024-08-19T00:23:27.873 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:27.869+0000 7f65e1e1e640 1 -- 172.21.15.44:0/1441171261 wait complete. 2024-08-19T00:23:28.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:23:27 smithi171 ceph-mon[21810]: pgmap v315: 129 pgs: 129 active+clean; 546 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.0 MiB/s wr, 172 op/s 2024-08-19T00:23:28.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:23:27 smithi116 ceph-mon[21873]: pgmap v315: 129 pgs: 129 active+clean; 546 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.0 MiB/s wr, 172 op/s 2024-08-19T00:23:28.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:23:27 smithi044 ceph-mon[18489]: pgmap v315: 129 pgs: 129 active+clean; 546 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.0 MiB/s wr, 172 op/s 2024-08-19T00:23:28.693 INFO:tasks.workunit.client.0.smithi044.stdout: 1 769326 7.91 MB/sec execute 413 sec latency 54.374 ms 2024-08-19T00:23:29.201 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:23:28 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:23:29.216 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:23:28 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:23:29.292 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:23:28 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:23:29.694 INFO:tasks.workunit.client.0.smithi044.stdout: 1 770693 7.92 MB/sec execute 414 sec latency 59.056 ms 2024-08-19T00:23:30.280 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 22.0 2024-08-19T00:23:30.281 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-19T00:23:30.304 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:23:29 smithi044 ceph-mon[18489]: pgmap v316: 129 pgs: 129 active+clean; 546 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.0 MiB/s wr, 172 op/s 2024-08-19T00:23:30.305 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:23:29 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:23:30.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:23:29 smithi171 ceph-mon[21810]: pgmap v316: 129 pgs: 129 active+clean; 546 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.0 MiB/s wr, 172 op/s 2024-08-19T00:23:30.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:23:29 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:23:30.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:23:29 smithi116 ceph-mon[21873]: pgmap v316: 129 pgs: 129 active+clean; 546 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.0 MiB/s wr, 172 op/s 2024-08-19T00:23:30.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:23:29 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:23:30.556 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:23:30.694 INFO:tasks.workunit.client.0.smithi044.stdout: 1 772167 7.91 MB/sec execute 415 sec latency 13.775 ms 2024-08-19T00:23:30.983 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:23:30 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:23:30.984 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:23:30 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:23:30.984 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:23:30 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:23:30.984 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:23:30 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:23:30.984 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:23:30 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:23:30.984 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:23:30 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:23:30.984 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:23:30 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:23:30.984 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:23:30 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:23:30.984 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:23:30 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:23:30.984 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:23:30 smithi044 ceph-mon[18489]: Adjusting osd_memory_target on smithi044 to 177.1M 2024-08-19T00:23:30.984 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:23:30 smithi044 ceph-mon[18489]: Unable to set osd_memory_target on smithi044 to 185704960: error parsing value: Value '185704960' is below minimum 939524096 2024-08-19T00:23:30.984 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:23:30 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:23:30.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:23:30 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:23:30.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:23:30 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:23:30.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:23:30 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:23:30.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:23:30 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:23:30.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:23:30 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:23:30.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:23:30 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:23:30.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:23:30 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:23:30.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:23:30 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:23:30.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:23:30 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:23:30.985 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:23:30 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:23:31.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:31.069+0000 7fd3173b0640 1 -- 172.21.15.44:0/2782453910 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd310102260 msgr2=0x7fd31010e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:31.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:31.069+0000 7fd3173b0640 1 --2- 172.21.15.44:0/2782453910 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd310102260 0x7fd31010e790 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fd308009cd0 tx=0x7fd30802a8e0 comp rx=0 tx=0).stop 2024-08-19T00:23:31.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:31.069+0000 7fd3173b0640 1 -- 172.21.15.44:0/2782453910 shutdown_connections 2024-08-19T00:23:31.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:31.069+0000 7fd3173b0640 1 --2- 172.21.15.44:0/2782453910 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd3101018c0 0x7fd310101d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:31.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:31.069+0000 7fd3173b0640 1 --2- 172.21.15.44:0/2782453910 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd310102260 0x7fd31010e790 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:31.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:31.069+0000 7fd3173b0640 1 --2- 172.21.15.44:0/2782453910 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd3101078c0 0x7fd310107ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:31.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:31.069+0000 7fd3173b0640 1 -- 172.21.15.44:0/2782453910 >> 172.21.15.44:0/2782453910 conn(0x7fd3100fd620 msgr2=0x7fd3100ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:23:31.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:31.069+0000 7fd3173b0640 1 -- 172.21.15.44:0/2782453910 shutdown_connections 2024-08-19T00:23:31.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:31.069+0000 7fd3173b0640 1 -- 172.21.15.44:0/2782453910 wait complete. 2024-08-19T00:23:31.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:31.070+0000 7fd3173b0640 1 Processor -- start 2024-08-19T00:23:31.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:31.070+0000 7fd3173b0640 1 -- start start 2024-08-19T00:23:31.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:31.070+0000 7fd3173b0640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd3101018c0 0x7fd310198170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:31.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:31.070+0000 7fd3173b0640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd310102260 0x7fd3101986b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:31.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:31.070+0000 7fd3173b0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3101078c0 0x7fd31019ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:31.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:31.070+0000 7fd3173b0640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd310111cc0 con 0x7fd3101078c0 2024-08-19T00:23:31.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:31.070+0000 7fd3173b0640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fd310111b40 con 0x7fd3101018c0 2024-08-19T00:23:31.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:31.070+0000 7fd3173b0640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd310111e40 con 0x7fd310102260 2024-08-19T00:23:31.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:31.070+0000 7fd31594d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3101078c0 0x7fd31019ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:31.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:31.070+0000 7fd31514c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd3101018c0 0x7fd310198170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:31.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:31.070+0000 7fd31594d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3101078c0 0x7fd31019ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56382/0 (socket says 172.21.15.44:56382) 2024-08-19T00:23:31.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:31.070+0000 7fd31594d640 1 -- 172.21.15.44:0/2140931504 learned_addr learned my addr 172.21.15.44:0/2140931504 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:23:31.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:31.070+0000 7fd31494b640 1 --2- 172.21.15.44:0/2140931504 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd310102260 0x7fd3101986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:31.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:31.070+0000 7fd31594d640 1 -- 172.21.15.44:0/2140931504 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd310102260 msgr2=0x7fd3101986b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:31.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:31.070+0000 7fd31594d640 1 --2- 172.21.15.44:0/2140931504 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd310102260 0x7fd3101986b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:31.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:31.070+0000 7fd31594d640 1 -- 172.21.15.44:0/2140931504 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd3101018c0 msgr2=0x7fd310198170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:31.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:31.070+0000 7fd31594d640 1 --2- 172.21.15.44:0/2140931504 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd3101018c0 0x7fd310198170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:31.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:31.071+0000 7fd31594d640 1 -- 172.21.15.44:0/2140931504 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd31019d120 con 0x7fd3101078c0 2024-08-19T00:23:31.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:31.071+0000 7fd31514c640 1 --2- 172.21.15.44:0/2140931504 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd3101018c0 0x7fd310198170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:23:31.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:31.071+0000 7fd31594d640 1 --2- 172.21.15.44:0/2140931504 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3101078c0 0x7fd31019ca40 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fd308005cc0 tx=0x7fd308032f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:23:31.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:31.071+0000 7fd3067fc640 1 -- 172.21.15.44:0/2140931504 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd308004040 con 0x7fd3101078c0 2024-08-19T00:23:31.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:31.071+0000 7fd3067fc640 1 -- 172.21.15.44:0/2140931504 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3080046c0 con 0x7fd3101078c0 2024-08-19T00:23:31.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:31.071+0000 7fd3173b0640 1 -- 172.21.15.44:0/2140931504 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd31019d3b0 con 0x7fd3101078c0 2024-08-19T00:23:31.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:31.071+0000 7fd3067fc640 1 -- 172.21.15.44:0/2140931504 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd308030e00 con 0x7fd3101078c0 2024-08-19T00:23:31.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:31.071+0000 7fd3173b0640 1 -- 172.21.15.44:0/2140931504 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3101a4cf0 con 0x7fd3101078c0 2024-08-19T00:23:31.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:31.072+0000 7fd3173b0640 1 -- 172.21.15.44:0/2140931504 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd310101d20 con 0x7fd3101078c0 2024-08-19T00:23:31.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:31.073+0000 7fd3067fc640 1 -- 172.21.15.44:0/2140931504 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fd3080305a0 con 0x7fd3101078c0 2024-08-19T00:23:31.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:31.074+0000 7fd3067fc640 1 --2- 172.21.15.44:0/2140931504 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fd2fc0a2cf0 0x7fd2fc0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:31.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:31.074+0000 7fd3067fc640 1 -- 172.21.15.44:0/2140931504 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9533+0+0 (secure 0 0 0) 0x7fd30802e030 con 0x7fd3101078c0 2024-08-19T00:23:31.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:31.074+0000 7fd31514c640 1 --2- 172.21.15.44:0/2140931504 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fd2fc0a2cf0 0x7fd2fc0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:31.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:31.075+0000 7fd31514c640 1 --2- 172.21.15.44:0/2140931504 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fd2fc0a2cf0 0x7fd2fc0a51b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd30c009f40 tx=0x7fd30c005f90 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:23:31.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:31.077+0000 7fd3067fc640 1 -- 172.21.15.44:0/2140931504 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fd30804b060 con 0x7fd3101078c0 2024-08-19T00:23:31.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:31.298+0000 7fd3173b0640 1 -- 172.21.15.44:0/2140931504 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd3101994d0 con 0x7fd3101078c0 2024-08-19T00:23:31.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:31.298+0000 7fd3067fc640 1 -- 172.21.15.44:0/2140931504 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11989 (secure 0 0 0) 0x7fd3101994d0 con 0x7fd3101078c0 2024-08-19T00:23:31.300 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:23:31.300 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":33,"btime":"2024-08-19T00:17:11:640526+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14511,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1538841896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1538841896},{"type":"v1","addr":"172.21.15.116:6833","nonce":1538841896}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/4044471606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4044471606},{"type":"v1","addr":"172.21.15.44:6835","nonce":4044471606}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":33,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-19T00:10:53.196636+0000","modified":"2024-08-19T00:17:11.586031+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24473,"mds_1":24446,"mds_2":24439,"mds_3":24431,"mds_4":24418},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14529":{"gid":14529,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6837/1824829052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1824829052},{"type":"v1","addr":"172.21.15.44:6837","nonce":1824829052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14577":{"gid":14577,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6839/3591739042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":3591739042},{"type":"v1","addr":"172.21.15.44:6839","nonce":3591739042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14589":{"gid":14589,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6841/3667695717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6840","nonce":3667695717},{"type":"v1","addr":"172.21.15.44:6841","nonce":3667695717}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24388":{"gid":24388,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1183022838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1183022838},{"type":"v1","addr":"172.21.15.171:6833","nonce":1183022838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6835/2190623851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":2190623851},{"type":"v1","addr":"172.21.15.171:6835","nonce":2190623851}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.171:6837/316231795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":316231795},{"type":"v1","addr":"172.21.15.171:6837","nonce":316231795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":20,"addr":"172.21.15.116:6835/3507399322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3507399322},{"type":"v1","addr":"172.21.15.116:6835","nonce":3507399322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.171:6839/1466585795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":1466585795},{"type":"v1","addr":"172.21.15.171:6839","nonce":1466585795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":17,"addr":"172.21.15.116:6837/2764513846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":2764513846},{"type":"v1","addr":"172.21.15.116:6837","nonce":2764513846}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.116:6839/1032741033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":1032741033},{"type":"v1","addr":"172.21.15.116:6839","nonce":1032741033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24446,24439,24431,24418]},"id":1}]} 2024-08-19T00:23:31.301 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 33 2024-08-19T00:23:31.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:31.301+0000 7fd3173b0640 1 -- 172.21.15.44:0/2140931504 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fd2fc0a2cf0 msgr2=0x7fd2fc0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:31.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:31.301+0000 7fd3173b0640 1 --2- 172.21.15.44:0/2140931504 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fd2fc0a2cf0 0x7fd2fc0a51b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd30c009f40 tx=0x7fd30c005f90 comp rx=0 tx=0).stop 2024-08-19T00:23:31.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:31.301+0000 7fd3173b0640 1 -- 172.21.15.44:0/2140931504 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3101078c0 msgr2=0x7fd31019ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:31.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:31.301+0000 7fd3173b0640 1 --2- 172.21.15.44:0/2140931504 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3101078c0 0x7fd31019ca40 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fd308005cc0 tx=0x7fd308032f40 comp rx=0 tx=0).stop 2024-08-19T00:23:31.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:31.301+0000 7fd3173b0640 1 -- 172.21.15.44:0/2140931504 shutdown_connections 2024-08-19T00:23:31.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:31.301+0000 7fd3173b0640 1 --2- 172.21.15.44:0/2140931504 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fd2fc0a2cf0 0x7fd2fc0a51b0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:31.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:31.301+0000 7fd3173b0640 1 --2- 172.21.15.44:0/2140931504 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd310102260 0x7fd3101986b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:31.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:31.301+0000 7fd3173b0640 1 --2- 172.21.15.44:0/2140931504 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3101078c0 0x7fd31019ca40 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:31.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:31.301+0000 7fd3173b0640 1 --2- 172.21.15.44:0/2140931504 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd3101018c0 0x7fd310198170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:31.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:31.301+0000 7fd3173b0640 1 -- 172.21.15.44:0/2140931504 >> 172.21.15.44:0/2140931504 conn(0x7fd3100fd620 msgr2=0x7fd3100fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:23:31.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:31.301+0000 7fd3173b0640 1 -- 172.21.15.44:0/2140931504 shutdown_connections 2024-08-19T00:23:31.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:31.301+0000 7fd3173b0640 1 -- 172.21.15.44:0/2140931504 wait complete. 2024-08-19T00:23:31.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:23:30 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:23:31.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:23:30 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:23:31.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:23:30 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:23:31.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:23:30 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:23:31.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:23:30 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:23:31.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:23:30 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:23:31.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:23:30 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:23:31.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:23:30 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:23:31.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:23:30 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:23:31.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:23:30 smithi171 ceph-mon[21810]: Adjusting osd_memory_target on smithi044 to 177.1M 2024-08-19T00:23:31.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:23:30 smithi171 ceph-mon[21810]: Unable to set osd_memory_target on smithi044 to 185704960: error parsing value: Value '185704960' is below minimum 939524096 2024-08-19T00:23:31.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:23:30 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:23:31.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:23:30 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:23:31.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:23:30 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:23:31.344 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:23:30 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:23:31.344 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:23:30 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:23:31.344 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:23:30 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:23:31.344 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:23:30 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:23:31.344 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:23:30 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:23:31.344 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:23:30 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:23:31.344 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:23:30 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:23:31.344 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:23:30 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:23:31.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:23:30 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:23:31.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:23:30 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:23:31.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:23:30 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:23:31.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:23:30 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:23:31.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:23:30 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:23:31.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:23:30 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:23:31.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:23:30 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:23:31.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:23:30 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:23:31.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:23:30 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:23:31.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:23:30 smithi116 ceph-mon[21873]: Adjusting osd_memory_target on smithi044 to 177.1M 2024-08-19T00:23:31.367 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:23:30 smithi116 ceph-mon[21873]: Unable to set osd_memory_target on smithi044 to 185704960: error parsing value: Value '185704960' is below minimum 939524096 2024-08-19T00:23:31.367 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:23:30 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:23:31.367 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:23:30 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:23:31.367 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:23:30 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:23:31.367 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:23:30 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:23:31.367 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:23:30 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:23:31.367 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:23:30 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:23:31.367 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:23:30 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:23:31.367 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:23:30 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:23:31.367 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:23:30 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:23:31.367 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:23:30 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:23:31.368 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:23:30 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:23:31.694 INFO:tasks.workunit.client.0.smithi044.stdout: 1 774190 7.92 MB/sec execute 416 sec latency 17.970 ms 2024-08-19T00:23:32.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:23:31 smithi044 ceph-mon[18489]: Adjusting osd_memory_target on smithi171 to 176.0M 2024-08-19T00:23:32.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:23:31 smithi044 ceph-mon[18489]: Adjusting osd_memory_target on smithi116 to 176.0M 2024-08-19T00:23:32.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:23:31 smithi044 ceph-mon[18489]: Unable to set osd_memory_target on smithi171 to 184595353: error parsing value: Value '184595353' is below minimum 939524096 2024-08-19T00:23:32.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:23:31 smithi044 ceph-mon[18489]: Unable to set osd_memory_target on smithi116 to 184593920: error parsing value: Value '184593920' is below minimum 939524096 2024-08-19T00:23:32.120 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:23:31 smithi044 ceph-mon[18489]: pgmap v317: 129 pgs: 129 active+clean; 522 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.6 MiB/s wr, 270 op/s 2024-08-19T00:23:32.120 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:23:31 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/2140931504' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:23:32.270 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24473 quiesce db / --timeout 90 --expiration 142.0 --await-for 45.0' 2024-08-19T00:23:32.270 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24473 quiesce db / --timeout 90 --expiration 142.0 --await-for 45.0 2024-08-19T00:23:32.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:23:31 smithi171 ceph-mon[21810]: Adjusting osd_memory_target on smithi171 to 176.0M 2024-08-19T00:23:32.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:23:31 smithi171 ceph-mon[21810]: Adjusting osd_memory_target on smithi116 to 176.0M 2024-08-19T00:23:32.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:23:31 smithi171 ceph-mon[21810]: Unable to set osd_memory_target on smithi171 to 184595353: error parsing value: Value '184595353' is below minimum 939524096 2024-08-19T00:23:32.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:23:31 smithi171 ceph-mon[21810]: Unable to set osd_memory_target on smithi116 to 184593920: error parsing value: Value '184593920' is below minimum 939524096 2024-08-19T00:23:32.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:23:31 smithi171 ceph-mon[21810]: pgmap v317: 129 pgs: 129 active+clean; 522 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.6 MiB/s wr, 270 op/s 2024-08-19T00:23:32.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:23:31 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/2140931504' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:23:32.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:23:31 smithi116 ceph-mon[21873]: Adjusting osd_memory_target on smithi171 to 176.0M 2024-08-19T00:23:32.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:23:31 smithi116 ceph-mon[21873]: Adjusting osd_memory_target on smithi116 to 176.0M 2024-08-19T00:23:32.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:23:31 smithi116 ceph-mon[21873]: Unable to set osd_memory_target on smithi171 to 184595353: error parsing value: Value '184595353' is below minimum 939524096 2024-08-19T00:23:32.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:23:31 smithi116 ceph-mon[21873]: Unable to set osd_memory_target on smithi116 to 184593920: error parsing value: Value '184593920' is below minimum 939524096 2024-08-19T00:23:32.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:23:31 smithi116 ceph-mon[21873]: pgmap v317: 129 pgs: 129 active+clean; 522 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.6 MiB/s wr, 270 op/s 2024-08-19T00:23:32.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:23:31 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/2140931504' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:23:32.583 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:23:32.694 INFO:tasks.workunit.client.0.smithi044.stdout: 1 775823 7.92 MB/sec execute 417 sec latency 13.797 ms 2024-08-19T00:23:33.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.255+0000 7f3647544640 1 -- 172.21.15.44:0/1503160868 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3640101150 msgr2=0x7f364010d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:33.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.255+0000 7f3647544640 1 --2- 172.21.15.44:0/1503160868 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3640101150 0x7f364010d680 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f3638009cd0 tx=0x7f363802a8e0 comp rx=0 tx=0).stop 2024-08-19T00:23:33.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.255+0000 7f3647544640 1 -- 172.21.15.44:0/1503160868 shutdown_connections 2024-08-19T00:23:33.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.255+0000 7f3647544640 1 --2- 172.21.15.44:0/1503160868 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3640101150 0x7f364010d680 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:33.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.255+0000 7f3647544640 1 --2- 172.21.15.44:0/1503160868 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f36401007b0 0x7f3640100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:33.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.255+0000 7f3647544640 1 --2- 172.21.15.44:0/1503160868 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36401067b0 0x7f3640106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:33.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.255+0000 7f3647544640 1 -- 172.21.15.44:0/1503160868 >> 172.21.15.44:0/1503160868 conn(0x7f36400fc4d0 msgr2=0x7f36400fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:23:33.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.255+0000 7f3647544640 1 -- 172.21.15.44:0/1503160868 shutdown_connections 2024-08-19T00:23:33.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.256+0000 7f3647544640 1 -- 172.21.15.44:0/1503160868 wait complete. 2024-08-19T00:23:33.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.257+0000 7f3647544640 1 Processor -- start 2024-08-19T00:23:33.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.257+0000 7f3647544640 1 -- start start 2024-08-19T00:23:33.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.257+0000 7f3647544640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f36401007b0 0x7f36401981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:33.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.257+0000 7f3647544640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3640101150 0x7f3640198720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:33.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.257+0000 7f3647544640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36401067b0 0x7f364019ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:33.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.257+0000 7f3647544640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3640110bb0 con 0x7f36401007b0 2024-08-19T00:23:33.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.257+0000 7f3647544640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f3640110a30 con 0x7f3640101150 2024-08-19T00:23:33.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.257+0000 7f3647544640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f3640110d30 con 0x7f36401067b0 2024-08-19T00:23:33.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.257+0000 7f36452e0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f36401007b0 0x7f36401981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:33.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.257+0000 7f36452e0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f36401007b0 0x7f36401981e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56402/0 (socket says 172.21.15.44:56402) 2024-08-19T00:23:33.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.257+0000 7f36452e0640 1 -- 172.21.15.44:0/3670672000 learned_addr learned my addr 172.21.15.44:0/3670672000 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:23:33.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.257+0000 7f3645ae1640 1 --2- 172.21.15.44:0/3670672000 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36401067b0 0x7f364019ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:33.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.257+0000 7f3644adf640 1 --2- 172.21.15.44:0/3670672000 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3640101150 0x7f3640198720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:33.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.257+0000 7f36452e0640 1 -- 172.21.15.44:0/3670672000 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36401067b0 msgr2=0x7f364019ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:33.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.257+0000 7f36452e0640 1 --2- 172.21.15.44:0/3670672000 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36401067b0 0x7f364019ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:33.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.257+0000 7f36452e0640 1 -- 172.21.15.44:0/3670672000 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3640101150 msgr2=0x7f3640198720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:33.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.257+0000 7f36452e0640 1 --2- 172.21.15.44:0/3670672000 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3640101150 0x7f3640198720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:33.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.257+0000 7f36452e0640 1 -- 172.21.15.44:0/3670672000 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f364019d0f0 con 0x7f36401007b0 2024-08-19T00:23:33.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.258+0000 7f36452e0640 1 --2- 172.21.15.44:0/3670672000 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f36401007b0 0x7f36401981e0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f363400e9f0 tx=0x7f363400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:23:33.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.258+0000 7f36327fc640 1 -- 172.21.15.44:0/3670672000 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f363400cd80 con 0x7f36401007b0 2024-08-19T00:23:33.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.258+0000 7f3647544640 1 -- 172.21.15.44:0/3670672000 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f364019d3e0 con 0x7f36401007b0 2024-08-19T00:23:33.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.258+0000 7f36327fc640 1 -- 172.21.15.44:0/3670672000 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3634005500 con 0x7f36401007b0 2024-08-19T00:23:33.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.258+0000 7f36327fc640 1 -- 172.21.15.44:0/3670672000 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3634010690 con 0x7f36401007b0 2024-08-19T00:23:33.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.258+0000 7f3647544640 1 -- 172.21.15.44:0/3670672000 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36401a4cc0 con 0x7f36401007b0 2024-08-19T00:23:33.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.260+0000 7f36327fc640 1 -- 172.21.15.44:0/3670672000 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f36340046c0 con 0x7f36401007b0 2024-08-19T00:23:33.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.261+0000 7f3649942740 1 Processor -- start 2024-08-19T00:23:33.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.261+0000 7f3649942740 1 -- start start 2024-08-19T00:23:33.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.261+0000 7f3649942740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e090184130 0x55e090184510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:33.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.261+0000 7f3649942740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e090184a50 0x55e09018edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:33.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.261+0000 7f3649942740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e09018f310 0x55e090191700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:33.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.261+0000 7f3649942740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e0900e9a70 con 0x55e090184a50 2024-08-19T00:23:33.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.261+0000 7f3649942740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55e090081780 con 0x55e09018f310 2024-08-19T00:23:33.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.261+0000 7f3649942740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55e0900e5a30 con 0x55e090184130 2024-08-19T00:23:33.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.261+0000 7f36452e0640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e090184a50 0x55e09018edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:33.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.261+0000 7f36327fc640 1 --2- 172.21.15.44:0/3670672000 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f362c0a2cf0 0x7f362c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:33.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.261+0000 7f3644adf640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e09018f310 0x55e090191700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:33.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.261+0000 7f3645ae1640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e090184130 0x55e090184510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:33.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.261+0000 7f3644adf640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e09018f310 0x55e090191700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.44:40182/0 (socket says 172.21.15.44:40182) 2024-08-19T00:23:33.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.261+0000 7f3644adf640 1 -- 172.21.15.44:0/3252194011 learned_addr learned my addr 172.21.15.44:0/3252194011 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:23:33.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.261+0000 7f36327fc640 1 -- 172.21.15.44:0/3670672000 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9533+0+0 (secure 0 0 0) 0x7f36340cfc40 con 0x7f36401007b0 2024-08-19T00:23:33.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.262+0000 7f3645ae1640 1 --2- 172.21.15.44:0/3670672000 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f362c0a2cf0 0x7f362c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:33.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.262+0000 7f3644adf640 1 -- 172.21.15.44:0/3252194011 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e090184130 msgr2=0x55e090184510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:23:33.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.262+0000 7f3644adf640 1 --2- 172.21.15.44:0/3252194011 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e090184130 0x55e090184510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:33.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.262+0000 7f3644adf640 1 -- 172.21.15.44:0/3252194011 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e090184a50 msgr2=0x55e09018edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:23:33.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.262+0000 7f3644adf640 1 --2- 172.21.15.44:0/3252194011 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e090184a50 0x55e09018edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:33.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.262+0000 7f3644adf640 1 -- 172.21.15.44:0/3252194011 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e08fe5bb90 con 0x55e09018f310 2024-08-19T00:23:33.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.262+0000 7f3644adf640 1 --2- 172.21.15.44:0/3252194011 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e09018f310 0x55e090191700 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f363c009c90 tx=0x7f363c011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ad76dbc5f6f87f3 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:23:33.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.262+0000 7f362b7fe640 1 -- 172.21.15.44:0/3252194011 <== mon.2 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f363c01e070 con 0x55e09018f310 2024-08-19T00:23:33.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.262+0000 7f362b7fe640 1 -- 172.21.15.44:0/3252194011 <== mon.2 v2:172.21.15.116:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f363c019b10 con 0x55e09018f310 2024-08-19T00:23:33.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.262+0000 7f362b7fe640 1 -- 172.21.15.44:0/3252194011 <== mon.2 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f363c00eaf0 con 0x55e09018f310 2024-08-19T00:23:33.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.263+0000 7f3649942740 1 -- 172.21.15.44:0/3252194011 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e09018f310 msgr2=0x55e090191700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:33.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.263+0000 7f3649942740 1 --2- 172.21.15.44:0/3252194011 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e09018f310 0x55e090191700 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f363c009c90 tx=0x7f363c011810 comp rx=0 tx=0).stop 2024-08-19T00:23:33.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.263+0000 7f3645ae1640 1 --2- 172.21.15.44:0/3670672000 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f362c0a2cf0 0x7f362c0a51b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3638004ab0 tx=0x7f363802a8e0 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:23:33.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.263+0000 7f3649942740 1 -- 172.21.15.44:0/3252194011 shutdown_connections 2024-08-19T00:23:33.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.263+0000 7f3649942740 1 --2- 172.21.15.44:0/3252194011 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e09018f310 0x55e090191700 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:33.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.263+0000 7f3649942740 1 --2- 172.21.15.44:0/3252194011 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e090184a50 0x55e09018edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:33.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.263+0000 7f3649942740 1 --2- 172.21.15.44:0/3252194011 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e090184130 0x55e090184510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:33.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.263+0000 7f3649942740 1 -- 172.21.15.44:0/3252194011 >> 172.21.15.44:0/3252194011 conn(0x55e0901806c0 msgr2=0x55e090180aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:23:33.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.263+0000 7f3649942740 1 -- 172.21.15.44:0/3252194011 shutdown_connections 2024-08-19T00:23:33.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.263+0000 7f3649942740 1 -- 172.21.15.44:0/3252194011 wait complete. 2024-08-19T00:23:33.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.263+0000 7f3649942740 1 -- start start 2024-08-19T00:23:33.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.263+0000 7f3649942740 1 Processor -- start 2024-08-19T00:23:33.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.264+0000 7f3649942740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e090184130 0x55e09018c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:33.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.264+0000 7f3649942740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e090184a50 0x55e09018c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:33.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.264+0000 7f3649942740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e09018f310 0x55e09018cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:33.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.264+0000 7f3649942740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e090191ee0 con 0x55e090184a50 2024-08-19T00:23:33.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.264+0000 7f3649942740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55e0900a4990 con 0x55e090184130 2024-08-19T00:23:33.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.264+0000 7f3649942740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55e090192060 con 0x55e09018f310 2024-08-19T00:23:33.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.264+0000 7f3649942740 10 client.0 _ll_register_callbacks cb 0x55e08fdf9090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:23:33.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.264+0000 7f3644adf640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e090184a50 0x55e09018c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:33.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.264+0000 7f36452e0640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e090184130 0x55e09018c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:33.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.264+0000 7f3644adf640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e090184a50 0x55e09018c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56422/0 (socket says 172.21.15.44:56422) 2024-08-19T00:23:33.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.264+0000 7f3644adf640 1 -- 172.21.15.44:0/24055677 learned_addr learned my addr 172.21.15.44:0/24055677 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:23:33.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.264+0000 7f3645ae1640 1 --2- 172.21.15.44:0/24055677 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e09018f310 0x55e09018cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:33.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.264+0000 7f3644adf640 1 -- 172.21.15.44:0/24055677 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e09018f310 msgr2=0x55e09018cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:23:33.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.264+0000 7f3644adf640 1 --2- 172.21.15.44:0/24055677 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e09018f310 0x55e09018cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:33.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.264+0000 7f3644adf640 1 -- 172.21.15.44:0/24055677 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e090184130 msgr2=0x55e09018c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:23:33.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.264+0000 7f3644adf640 1 --2- 172.21.15.44:0/24055677 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e090184130 0x55e09018c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:33.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.264+0000 7f3644adf640 1 -- 172.21.15.44:0/24055677 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0900a36c0 con 0x55e090184a50 2024-08-19T00:23:33.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.264+0000 7f36452e0640 1 --2- 172.21.15.44:0/24055677 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e090184130 0x55e09018c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:23:33.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.264+0000 7f3644adf640 1 --2- 172.21.15.44:0/24055677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e090184a50 0x55e09018c730 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f363c0097d0 tx=0x7f363c005d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ca9cd6a2d333f57 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:23:33.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.264+0000 7f3628ff9640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:23:33.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.265+0000 7f3628ff9640 1 -- 172.21.15.44:0/24055677 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f363c01e050 con 0x55e090184a50 2024-08-19T00:23:33.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.265+0000 7f3628ff9640 1 -- 172.21.15.44:0/24055677 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9533+0+0 (secure 0 0 0) 0x7f363c004230 con 0x55e090184a50 2024-08-19T00:23:33.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.265+0000 7f3649942740 1 -- 172.21.15.44:0/24055677 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f363c019b10 con 0x55e090184a50 2024-08-19T00:23:33.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.265+0000 7f3628ff9640 1 -- 172.21.15.44:0/24055677 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f363c032050 con 0x55e090184a50 2024-08-19T00:23:33.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.265+0000 7f3649942740 10 client.16770 fetch_fsmap learned FSMap version 33 2024-08-19T00:23:33.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.265+0000 7f3649942740 1 -- 172.21.15.44:0/24055677 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55e09019db90 con 0x55e090184a50 2024-08-19T00:23:33.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.265+0000 7f3628ff9640 1 -- 172.21.15.44:0/24055677 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f363c019b10 con 0x55e090184a50 2024-08-19T00:23:33.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.265+0000 7f3628ff9640 1 -- 172.21.15.44:0/24055677 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f363c02d030 con 0x55e090184a50 2024-08-19T00:23:33.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.265+0000 7f3649942740 10 client.16770 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:23:33.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.265+0000 7f3649942740 10 client.16770 resolve_mds: validated gid 24473 aka daemon mds.b 2024-08-19T00:23:33.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.265+0000 7f3649942740 20 client.16770 populate_metadata read hostname 'smithi044' 2024-08-19T00:23:33.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.265+0000 7f3649942740 1 --2- 172.21.15.44:0/24055677 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55e09019efa0 0x55e0901a1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:33.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.265+0000 7f3649942740 4 client.16770 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:23:33.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.265+0000 7f3649942740 1 -- 172.21.15.44:0/24055677 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e0900f71a0 con 0x55e09019efa0 2024-08-19T00:23:33.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.265+0000 7f36452e0640 1 --2- 172.21.15.44:0/24055677 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55e09019efa0 0x55e0901a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:33.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.266+0000 7f3628ff9640 10 client.16770 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:23:33.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.266+0000 7f36452e0640 1 --2- 172.21.15.44:0/24055677 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55e09019efa0 0x55e0901a1390 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24a1f7ac788f863d server_cookie=b75930b6a3b88329 in_seq=0 out_seq=0 2024-08-19T00:23:33.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.266+0000 7f3628ff9640 1 -- 172.21.15.44:0/24055677 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e0900f71a0 con 0x55e09019efa0 2024-08-19T00:23:33.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.266+0000 7f3628ff9640 10 client.16770 handle_command_reply: tid=0 2024-08-19T00:23:33.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.266+0000 7f3649942740 1 client.16770 shutdown 2024-08-19T00:23:33.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.267+0000 7f3649942740 1 -- 172.21.15.44:0/24055677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e090184a50 msgr2=0x55e09018c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:33.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.267+0000 7f3649942740 1 --2- 172.21.15.44:0/24055677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e090184a50 0x55e09018c730 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f363c0097d0 tx=0x7f363c005d30 comp rx=0 tx=0).stop 2024-08-19T00:23:33.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.267+0000 7f3649942740 1 -- 172.21.15.44:0/24055677 shutdown_connections 2024-08-19T00:23:33.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.267+0000 7f3649942740 1 --2- 172.21.15.44:0/24055677 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55e09019efa0 0x55e0901a1390 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:33.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.267+0000 7f3649942740 1 --2- 172.21.15.44:0/24055677 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e09018f310 0x55e09018cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:33.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.267+0000 7f3649942740 1 --2- 172.21.15.44:0/24055677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e090184a50 0x55e09018c730 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:33.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.267+0000 7f3649942740 1 --2- 172.21.15.44:0/24055677 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e090184130 0x55e09018c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:33.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.267+0000 7f3649942740 1 -- 172.21.15.44:0/24055677 >> 172.21.15.44:0/24055677 conn(0x55e0901806c0 msgr2=0x55e0901863f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:23:33.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.267+0000 7f3628ff9640 0 client.16770 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:23:33.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.267+0000 7f3649942740 1 -- 172.21.15.44:0/24055677 shutdown_connections 2024-08-19T00:23:33.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.267+0000 7f3649942740 1 -- 172.21.15.44:0/24055677 wait complete. 2024-08-19T00:23:33.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.267+0000 7f3649942740 20 client.16770 trim_cache size 0 max 16384 2024-08-19T00:23:33.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.285+0000 7f3649942740 1 Processor -- start 2024-08-19T00:23:33.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.285+0000 7f3649942740 1 -- start start 2024-08-19T00:23:33.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.285+0000 7f3649942740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e090184130 0x55e09018aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:33.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.285+0000 7f3649942740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e090184a50 0x55e0901a6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:33.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.285+0000 7f3649942740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e09018f310 0x55e0901a70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:33.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.285+0000 7f3649942740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f36401aeef0 con 0x55e090184a50 2024-08-19T00:23:33.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.285+0000 7f3649942740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f36401b0a30 con 0x55e090184130 2024-08-19T00:23:33.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.285+0000 7f3649942740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f36401af5c0 con 0x55e09018f310 2024-08-19T00:23:33.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.285+0000 7f3644adf640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e090184a50 0x55e0901a6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:33.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.285+0000 7f36452e0640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e090184130 0x55e09018aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:33.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.285+0000 7f3644adf640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e090184a50 0x55e0901a6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56424/0 (socket says 172.21.15.44:56424) 2024-08-19T00:23:33.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.285+0000 7f3644adf640 1 -- 172.21.15.44:0/259046948 learned_addr learned my addr 172.21.15.44:0/259046948 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:23:33.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.285+0000 7f3645ae1640 1 --2- 172.21.15.44:0/259046948 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e09018f310 0x55e0901a70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:33.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.285+0000 7f3644adf640 1 -- 172.21.15.44:0/259046948 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e09018f310 msgr2=0x55e0901a70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:23:33.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.285+0000 7f3644adf640 1 --2- 172.21.15.44:0/259046948 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e09018f310 0x55e0901a70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:33.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.285+0000 7f3644adf640 1 -- 172.21.15.44:0/259046948 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e090184130 msgr2=0x55e09018aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:23:33.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.285+0000 7f3644adf640 1 --2- 172.21.15.44:0/259046948 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e090184130 0x55e09018aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:33.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.285+0000 7f3644adf640 1 -- 172.21.15.44:0/259046948 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0901a1690 con 0x55e090184a50 2024-08-19T00:23:33.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.285+0000 7f3645ae1640 1 --2- 172.21.15.44:0/259046948 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e09018f310 0x55e0901a70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:23:33.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.285+0000 7f36452e0640 1 --2- 172.21.15.44:0/259046948 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e090184130 0x55e09018aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:23:33.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.286+0000 7f3644adf640 1 --2- 172.21.15.44:0/259046948 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e090184a50 0x55e0901a6b90 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f363c01c040 tx=0x7f363c009570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aedef32f22e61926 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:23:33.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.286+0000 7f362affd640 1 -- 172.21.15.44:0/259046948 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f363c03b070 con 0x55e090184a50 2024-08-19T00:23:33.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.286+0000 7f362affd640 1 -- 172.21.15.44:0/259046948 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f363c01f040 con 0x55e090184a50 2024-08-19T00:23:33.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.286+0000 7f362affd640 1 -- 172.21.15.44:0/259046948 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f363c01e070 con 0x55e090184a50 2024-08-19T00:23:33.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.287+0000 7f3649942740 1 -- 172.21.15.44:0/259046948 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e090184a50 msgr2=0x55e0901a6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:33.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.287+0000 7f3649942740 1 --2- 172.21.15.44:0/259046948 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e090184a50 0x55e0901a6b90 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f363c01c040 tx=0x7f363c009570 comp rx=0 tx=0).stop 2024-08-19T00:23:33.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.287+0000 7f3649942740 1 -- 172.21.15.44:0/259046948 shutdown_connections 2024-08-19T00:23:33.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.287+0000 7f3649942740 1 --2- 172.21.15.44:0/259046948 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e09018f310 0x55e0901a70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:33.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.287+0000 7f3649942740 1 --2- 172.21.15.44:0/259046948 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e090184a50 0x55e0901a6b90 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:33.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.287+0000 7f3649942740 1 --2- 172.21.15.44:0/259046948 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e090184130 0x55e09018aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:33.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.287+0000 7f3649942740 1 -- 172.21.15.44:0/259046948 >> 172.21.15.44:0/259046948 conn(0x55e0901806c0 msgr2=0x55e09018e270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:23:33.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.287+0000 7f3649942740 1 -- 172.21.15.44:0/259046948 shutdown_connections 2024-08-19T00:23:33.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.287+0000 7f3649942740 1 -- 172.21.15.44:0/259046948 wait complete. 2024-08-19T00:23:33.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.287+0000 7f3649942740 1 -- start start 2024-08-19T00:23:33.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.287+0000 7f3649942740 1 Processor -- start 2024-08-19T00:23:33.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.288+0000 7f3649942740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e090184130 0x55e0901892c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:33.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.288+0000 7f3649942740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e090184a50 0x55e090189800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:33.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.288+0000 7f3649942740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e09018f310 0x55e090189d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:33.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.288+0000 7f3649942740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f36401b0360 con 0x55e09018f310 2024-08-19T00:23:33.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.288+0000 7f3649942740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f36401afc90 con 0x55e090184130 2024-08-19T00:23:33.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.288+0000 7f3649942740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f36401acef0 con 0x55e090184a50 2024-08-19T00:23:33.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.288+0000 7f3649942740 10 client.0 _ll_register_callbacks cb 0x7f363c01c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:23:33.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.288+0000 7f3645ae1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e09018f310 0x55e090189d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:33.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.288+0000 7f36452e0640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e090184130 0x55e0901892c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:33.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.288+0000 7f3645ae1640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e09018f310 0x55e090189d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56436/0 (socket says 172.21.15.44:56436) 2024-08-19T00:23:33.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.288+0000 7f3645ae1640 1 -- 172.21.15.44:0/3976226397 learned_addr learned my addr 172.21.15.44:0/3976226397 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:23:33.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.288+0000 7f3644adf640 1 --2- 172.21.15.44:0/3976226397 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e090184a50 0x55e090189800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:33.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.288+0000 7f3645ae1640 1 -- 172.21.15.44:0/3976226397 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e090184a50 msgr2=0x55e090189800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:23:33.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.288+0000 7f3645ae1640 1 --2- 172.21.15.44:0/3976226397 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e090184a50 0x55e090189800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:33.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.288+0000 7f3645ae1640 1 -- 172.21.15.44:0/3976226397 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e090184130 msgr2=0x55e0901892c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:23:33.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.288+0000 7f3645ae1640 1 --2- 172.21.15.44:0/3976226397 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e090184130 0x55e0901892c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:33.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.288+0000 7f3645ae1640 1 -- 172.21.15.44:0/3976226397 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e09018b1a0 con 0x55e09018f310 2024-08-19T00:23:33.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.288+0000 7f36452e0640 1 --2- 172.21.15.44:0/3976226397 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e090184130 0x55e0901892c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:23:33.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.288+0000 7f3645ae1640 1 --2- 172.21.15.44:0/3976226397 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e09018f310 0x55e090189d40 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f3638035000 tx=0x7f36380095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27e0d9379626dcbf server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:23:33.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.288+0000 7f3628ff9640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:23:33.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.288+0000 7f3628ff9640 1 -- 172.21.15.44:0/3976226397 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36380047c0 con 0x55e09018f310 2024-08-19T00:23:33.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.288+0000 7f3628ff9640 1 -- 172.21.15.44:0/3976226397 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9533+0+0 (secure 0 0 0) 0x7f36380305a0 con 0x55e09018f310 2024-08-19T00:23:33.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.288+0000 7f3649942740 1 -- 172.21.15.44:0/3976226397 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f363c01f040 con 0x55e09018f310 2024-08-19T00:23:33.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.289+0000 7f3628ff9640 1 -- 172.21.15.44:0/3976226397 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f36380307a0 con 0x55e09018f310 2024-08-19T00:23:33.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.289+0000 7f3649942740 10 client.16776 fetch_fsmap learned FSMap version 33 2024-08-19T00:23:33.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.289+0000 7f3649942740 1 -- 172.21.15.44:0/3976226397 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55e090184880 con 0x55e09018f310 2024-08-19T00:23:33.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.289+0000 7f3628ff9640 1 -- 172.21.15.44:0/3976226397 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f363c01f040 con 0x55e09018f310 2024-08-19T00:23:33.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.289+0000 7f3628ff9640 1 -- 172.21.15.44:0/3976226397 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f3638030070 con 0x55e09018f310 2024-08-19T00:23:33.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.289+0000 7f3649942740 10 client.16776 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:23:33.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.289+0000 7f3649942740 10 client.16776 resolve_mds: validated gid 24473 aka daemon mds.b 2024-08-19T00:23:33.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.289+0000 7f3649942740 20 client.16776 populate_metadata read hostname 'smithi044' 2024-08-19T00:23:33.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.289+0000 7f3649942740 1 --2- 172.21.15.44:0/3976226397 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55e09020a340 0x55e09020c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:33.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.289+0000 7f3649942740 4 client.16776 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.0, "await_for": 45.0}] 2024-08-19T00:23:33.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.289+0000 7f3649942740 1 -- 172.21.15.44:0/3976226397 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.0, "await_for": 45.0}) -- 0x55e0900f14f0 con 0x55e09020a340 2024-08-19T00:23:33.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.289+0000 7f36452e0640 1 --2- 172.21.15.44:0/3976226397 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55e09020a340 0x55e09020c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:33.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.290+0000 7f36452e0640 1 --2- 172.21.15.44:0/3976226397 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55e09020a340 0x55e09020c760 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37af8b556d0bc3a2 server_cookie=578ef027f43743f9 in_seq=0 out_seq=0 2024-08-19T00:23:33.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.290+0000 7f3628ff9640 10 client.16776 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:23:33.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.387+0000 7f3628ff9640 1 -- 172.21.15.44:0/3976226397 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55e0900f14f0 con 0x55e09020a340 2024-08-19T00:23:33.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.387+0000 7f3628ff9640 10 client.16776 handle_command_reply: tid=0 2024-08-19T00:23:33.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.387+0000 7f3649942740 1 client.16776 shutdown 2024-08-19T00:23:33.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.387+0000 7f3649942740 1 -- 172.21.15.44:0/3976226397 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e09018f310 msgr2=0x55e090189d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:33.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.387+0000 7f3649942740 1 --2- 172.21.15.44:0/3976226397 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e09018f310 0x55e090189d40 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f3638035000 tx=0x7f36380095c0 comp rx=0 tx=0).stop 2024-08-19T00:23:33.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.387+0000 7f3649942740 1 -- 172.21.15.44:0/3976226397 shutdown_connections 2024-08-19T00:23:33.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.387+0000 7f3649942740 1 --2- 172.21.15.44:0/3976226397 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55e09020a340 0x55e09020c760 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:33.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.387+0000 7f3649942740 1 --2- 172.21.15.44:0/3976226397 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e090184a50 0x55e090189800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:33.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.387+0000 7f3628ff9640 0 client.16776 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:23:33.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.387+0000 7f3649942740 1 --2- 172.21.15.44:0/3976226397 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e09018f310 0x55e090189d40 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:33.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.387+0000 7f3649942740 1 --2- 172.21.15.44:0/3976226397 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e090184130 0x55e0901892c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:33.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.387+0000 7f3649942740 1 -- 172.21.15.44:0/3976226397 >> 172.21.15.44:0/3976226397 conn(0x55e0901806c0 msgr2=0x55e09018e270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:23:33.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.387+0000 7f3649942740 1 -- 172.21.15.44:0/3976226397 shutdown_connections 2024-08-19T00:23:33.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.387+0000 7f3649942740 1 -- 172.21.15.44:0/3976226397 wait complete. 2024-08-19T00:23:33.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.387+0000 7f3649942740 20 client.16776 trim_cache size 0 max 16384 2024-08-19T00:23:33.391 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-08-19T00:23:33.391 INFO:teuthology.orchestra.run.smithi044.stdout: "epoch": 33, 2024-08-19T00:23:33.391 INFO:teuthology.orchestra.run.smithi044.stdout: "leader": 24473, 2024-08-19T00:23:33.391 INFO:teuthology.orchestra.run.smithi044.stdout: "set_version": 34, 2024-08-19T00:23:33.391 INFO:teuthology.orchestra.run.smithi044.stdout: "sets": { 2024-08-19T00:23:33.391 INFO:teuthology.orchestra.run.smithi044.stdout: "dfe56178": { 2024-08-19T00:23:33.391 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 34, 2024-08-19T00:23:33.391 INFO:teuthology.orchestra.run.smithi044.stdout: "age_ref": 0.0, 2024-08-19T00:23:33.392 INFO:teuthology.orchestra.run.smithi044.stdout: "state": { 2024-08-19T00:23:33.392 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "QUIESCED", 2024-08-19T00:23:33.392 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.0 2024-08-19T00:23:33.392 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:23:33.392 INFO:teuthology.orchestra.run.smithi044.stdout: "timeout": 90.0, 2024-08-19T00:23:33.392 INFO:teuthology.orchestra.run.smithi044.stdout: "expiration": 142.0, 2024-08-19T00:23:33.392 INFO:teuthology.orchestra.run.smithi044.stdout: "members": { 2024-08-19T00:23:33.392 INFO:teuthology.orchestra.run.smithi044.stdout: "file:/": { 2024-08-19T00:23:33.392 INFO:teuthology.orchestra.run.smithi044.stdout: "excluded": false, 2024-08-19T00:23:33.392 INFO:teuthology.orchestra.run.smithi044.stdout: "state": { 2024-08-19T00:23:33.392 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "QUIESCED", 2024-08-19T00:23:33.392 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.0 2024-08-19T00:23:33.392 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:23:33.392 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:23:33.393 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:23:33.393 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:23:33.393 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:23:33.393 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-08-19T00:23:33.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.388+0000 7f3647544640 1 -- 172.21.15.44:0/3670672000 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f362c0a2cf0 msgr2=0x7f362c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:33.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.388+0000 7f3647544640 1 --2- 172.21.15.44:0/3670672000 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f362c0a2cf0 0x7f362c0a51b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3638004ab0 tx=0x7f363802a8e0 comp rx=0 tx=0).stop 2024-08-19T00:23:33.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.388+0000 7f3647544640 1 -- 172.21.15.44:0/3670672000 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f36401007b0 msgr2=0x7f36401981e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:33.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.388+0000 7f3647544640 1 --2- 172.21.15.44:0/3670672000 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f36401007b0 0x7f36401981e0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f363400e9f0 tx=0x7f363400edf0 comp rx=0 tx=0).stop 2024-08-19T00:23:33.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.388+0000 7f3647544640 1 -- 172.21.15.44:0/3670672000 shutdown_connections 2024-08-19T00:23:33.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.388+0000 7f3647544640 1 --2- 172.21.15.44:0/3670672000 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f362c0a2cf0 0x7f362c0a51b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:33.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.388+0000 7f3647544640 1 --2- 172.21.15.44:0/3670672000 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36401067b0 0x7f364019ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:33.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.388+0000 7f3647544640 1 --2- 172.21.15.44:0/3670672000 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3640101150 0x7f3640198720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:33.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.388+0000 7f3647544640 1 --2- 172.21.15.44:0/3670672000 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f36401007b0 0x7f36401981e0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:33.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.388+0000 7f3647544640 1 -- 172.21.15.44:0/3670672000 >> 172.21.15.44:0/3670672000 conn(0x7f36400fc4d0 msgr2=0x7f3640104580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:23:33.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.388+0000 7f3647544640 1 -- 172.21.15.44:0/3670672000 shutdown_connections 2024-08-19T00:23:33.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:33.388+0000 7f3647544640 1 -- 172.21.15.44:0/3670672000 wait complete. 2024-08-19T00:23:33.694 INFO:tasks.workunit.client.0.smithi044.stdout: 1 777592 7.93 MB/sec execute 418 sec latency 301.429 ms 2024-08-19T00:23:34.323 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:23:33 smithi044 ceph-mon[18489]: pgmap v318: 129 pgs: 129 active+clean; 522 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.2 MiB/s wr, 192 op/s 2024-08-19T00:23:34.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:23:33 smithi171 ceph-mon[21810]: pgmap v318: 129 pgs: 129 active+clean; 522 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.2 MiB/s wr, 192 op/s 2024-08-19T00:23:34.350 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'dfe56178', quiesce took 4.1 seconds. Will release after: 17.9 2024-08-19T00:23:34.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:23:33 smithi116 ceph-mon[21873]: pgmap v318: 129 pgs: 129 active+clean; 522 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.2 MiB/s wr, 192 op/s 2024-08-19T00:23:34.694 INFO:tasks.workunit.client.0.smithi044.stdout: 1 777592 7.91 MB/sec execute 419 sec latency 1301.530 ms 2024-08-19T00:23:35.694 INFO:tasks.workunit.client.0.smithi044.stdout: 1 777592 7.89 MB/sec execute 420 sec latency 2301.619 ms 2024-08-19T00:23:36.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:23:35 smithi171 ceph-mon[21810]: pgmap v319: 129 pgs: 129 active+clean; 532 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.3 MiB/s wr, 263 op/s 2024-08-19T00:23:36.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:23:35 smithi116 ceph-mon[21873]: pgmap v319: 129 pgs: 129 active+clean; 532 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.3 MiB/s wr, 263 op/s 2024-08-19T00:23:36.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:23:35 smithi044 ceph-mon[18489]: pgmap v319: 129 pgs: 129 active+clean; 532 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.3 MiB/s wr, 263 op/s 2024-08-19T00:23:36.694 INFO:tasks.workunit.client.0.smithi044.stdout: 1 777592 7.87 MB/sec execute 421 sec latency 3301.757 ms 2024-08-19T00:23:37.694 INFO:tasks.workunit.client.0.smithi044.stdout: 1 777592 7.86 MB/sec execute 422 sec latency 4301.874 ms 2024-08-19T00:23:38.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:23:37 smithi171 ceph-mon[21810]: pgmap v320: 129 pgs: 129 active+clean; 532 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.6 MiB/s wr, 168 op/s 2024-08-19T00:23:38.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:23:37 smithi116 ceph-mon[21873]: pgmap v320: 129 pgs: 129 active+clean; 532 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.6 MiB/s wr, 168 op/s 2024-08-19T00:23:38.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:23:37 smithi044 ceph-mon[18489]: pgmap v320: 129 pgs: 129 active+clean; 532 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.6 MiB/s wr, 168 op/s 2024-08-19T00:23:38.695 INFO:tasks.workunit.client.0.smithi044.stdout: 1 777592 7.84 MB/sec execute 423 sec latency 5301.990 ms 2024-08-19T00:23:39.694 INFO:tasks.workunit.client.0.smithi044.stdout: 1 777592 7.82 MB/sec execute 424 sec latency 6302.095 ms 2024-08-19T00:23:40.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:23:39 smithi171 ceph-mon[21810]: pgmap v321: 129 pgs: 129 active+clean; 532 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.6 MiB/s wr, 168 op/s 2024-08-19T00:23:40.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:23:39 smithi116 ceph-mon[21873]: pgmap v321: 129 pgs: 129 active+clean; 532 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.6 MiB/s wr, 168 op/s 2024-08-19T00:23:40.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:23:39 smithi044 ceph-mon[18489]: pgmap v321: 129 pgs: 129 active+clean; 532 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.6 MiB/s wr, 168 op/s 2024-08-19T00:23:40.695 INFO:tasks.workunit.client.0.smithi044.stdout: 1 777592 7.80 MB/sec execute 425 sec latency 7302.204 ms 2024-08-19T00:23:40.971 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.969+0000 7fe13e2a4640 1 -- 172.21.15.44:0/998926350 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe138107820 msgr2=0x7fe138107c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:40.971 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.969+0000 7fe13e2a4640 1 --2- 172.21.15.44:0/998926350 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe138107820 0x7fe138107c00 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fe128009930 tx=0x7fe12802a420 comp rx=0 tx=0).stop 2024-08-19T00:23:40.971 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.969+0000 7fe13e2a4640 1 -- 172.21.15.44:0/998926350 shutdown_connections 2024-08-19T00:23:40.971 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.969+0000 7fe13e2a4640 1 --2- 172.21.15.44:0/998926350 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe138101810 0x7fe138101c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:40.971 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.969+0000 7fe13e2a4640 1 --2- 172.21.15.44:0/998926350 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe1381021b0 0x7fe13810e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:40.972 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.969+0000 7fe13e2a4640 1 --2- 172.21.15.44:0/998926350 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe138107820 0x7fe138107c00 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:40.972 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.969+0000 7fe13e2a4640 1 -- 172.21.15.44:0/998926350 >> 172.21.15.44:0/998926350 conn(0x7fe1380fd510 msgr2=0x7fe1380ff930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:23:40.972 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.969+0000 7fe13e2a4640 1 -- 172.21.15.44:0/998926350 shutdown_connections 2024-08-19T00:23:40.972 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.969+0000 7fe13e2a4640 1 -- 172.21.15.44:0/998926350 wait complete. 2024-08-19T00:23:40.972 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.970+0000 7fe13e2a4640 1 Processor -- start 2024-08-19T00:23:40.972 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.970+0000 7fe13e2a4640 1 -- start start 2024-08-19T00:23:40.974 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.970+0000 7fe13e2a4640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe138101810 0x7fe1381980f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:40.974 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.970+0000 7fe13e2a4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1381021b0 0x7fe138198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:40.974 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.970+0000 7fe13e2a4640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe138107820 0x7fe13819c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:40.974 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.970+0000 7fe13e2a4640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe138111c60 con 0x7fe1381021b0 2024-08-19T00:23:40.974 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.970+0000 7fe13e2a4640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fe138111ae0 con 0x7fe138107820 2024-08-19T00:23:40.974 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.970+0000 7fe13e2a4640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe138111de0 con 0x7fe138101810 2024-08-19T00:23:40.974 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.970+0000 7fe1377fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1381021b0 0x7fe138198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:40.974 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.970+0000 7fe1377fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1381021b0 0x7fe138198630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46728/0 (socket says 172.21.15.44:46728) 2024-08-19T00:23:40.974 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.970+0000 7fe1377fe640 1 -- 172.21.15.44:0/2211152011 learned_addr learned my addr 172.21.15.44:0/2211152011 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:23:40.974 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.970+0000 7fe137fff640 1 --2- 172.21.15.44:0/2211152011 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe138101810 0x7fe1381980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:40.975 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.970+0000 7fe13c841640 1 --2- 172.21.15.44:0/2211152011 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe138107820 0x7fe13819c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:40.975 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.971+0000 7fe1377fe640 1 -- 172.21.15.44:0/2211152011 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe138101810 msgr2=0x7fe1381980f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:40.975 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.971+0000 7fe1377fe640 1 --2- 172.21.15.44:0/2211152011 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe138101810 0x7fe1381980f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:40.975 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.971+0000 7fe1377fe640 1 -- 172.21.15.44:0/2211152011 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe138107820 msgr2=0x7fe13819c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:40.975 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.971+0000 7fe1377fe640 1 --2- 172.21.15.44:0/2211152011 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe138107820 0x7fe13819c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:40.975 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.971+0000 7fe1377fe640 1 -- 172.21.15.44:0/2211152011 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe13819d0e0 con 0x7fe1381021b0 2024-08-19T00:23:40.975 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.971+0000 7fe13c841640 1 --2- 172.21.15.44:0/2211152011 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe138107820 0x7fe13819c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:23:40.975 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.971+0000 7fe1377fe640 1 --2- 172.21.15.44:0/2211152011 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1381021b0 0x7fe138198630 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fe12c00d770 tx=0x7fe12c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:23:40.975 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.971+0000 7fe1357fa640 1 -- 172.21.15.44:0/2211152011 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe12c017070 con 0x7fe1381021b0 2024-08-19T00:23:40.975 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.971+0000 7fe1357fa640 1 -- 172.21.15.44:0/2211152011 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe12c005500 con 0x7fe1381021b0 2024-08-19T00:23:40.975 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.971+0000 7fe13e2a4640 1 -- 172.21.15.44:0/2211152011 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe13819d3d0 con 0x7fe1381021b0 2024-08-19T00:23:40.975 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.971+0000 7fe1357fa640 1 -- 172.21.15.44:0/2211152011 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe12c004e00 con 0x7fe1381021b0 2024-08-19T00:23:40.976 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.971+0000 7fe13e2a4640 1 -- 172.21.15.44:0/2211152011 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1381a4c60 con 0x7fe1381021b0 2024-08-19T00:23:40.982 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.973+0000 7fe1357fa640 1 -- 172.21.15.44:0/2211152011 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fe12c004fa0 con 0x7fe1381021b0 2024-08-19T00:23:40.982 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.974+0000 7fe141061740 1 Processor -- start 2024-08-19T00:23:40.982 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.974+0000 7fe141061740 1 -- start start 2024-08-19T00:23:40.982 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.974+0000 7fe1357fa640 1 --2- 172.21.15.44:0/2211152011 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fe1200a2da0 0x7fe1200a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:40.982 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.974+0000 7fe141061740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5650455fd690 0x5650455fda70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:40.982 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.974+0000 7fe141061740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5650455fdfb0 0x56504560c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:40.982 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.974+0000 7fe141061740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56504560cda0 0x56504560f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:40.982 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.974+0000 7fe141061740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5650455619d0 con 0x5650455fd690 2024-08-19T00:23:40.982 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.974+0000 7fe141061740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x565045509820 con 0x56504560cda0 2024-08-19T00:23:40.983 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.974+0000 7fe141061740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x56504555d990 con 0x5650455fdfb0 2024-08-19T00:23:40.983 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.974+0000 7fe13c841640 1 --2- 172.21.15.44:0/2211152011 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fe1200a2da0 0x7fe1200a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:40.983 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.974+0000 7fe137fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5650455fd690 0x5650455fda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:40.983 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.974+0000 7fe1357fa640 1 -- 172.21.15.44:0/2211152011 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9533+0+0 (secure 0 0 0) 0x7fe12c0cf320 con 0x7fe1381021b0 2024-08-19T00:23:40.983 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.974+0000 7fe137fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5650455fd690 0x5650455fda70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46732/0 (socket says 172.21.15.44:46732) 2024-08-19T00:23:40.983 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.974+0000 7fe137fff640 1 -- 172.21.15.44:0/344835338 learned_addr learned my addr 172.21.15.44:0/344835338 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:23:40.983 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.974+0000 7fe1377fe640 1 --2- 172.21.15.44:0/344835338 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5650455fdfb0 0x56504560c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:40.983 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.974+0000 7fe13c841640 1 --2- 172.21.15.44:0/344835338 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56504560cda0 0x56504560f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:40.983 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.975+0000 7fe137fff640 1 -- 172.21.15.44:0/344835338 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5650455fdfb0 msgr2=0x56504560c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:23:40.983 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.975+0000 7fe137fff640 1 --2- 172.21.15.44:0/344835338 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5650455fdfb0 0x56504560c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:40.983 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.975+0000 7fe137fff640 1 -- 172.21.15.44:0/344835338 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56504560cda0 msgr2=0x56504560f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:23:40.983 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.975+0000 7fe137fff640 1 --2- 172.21.15.44:0/344835338 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56504560cda0 0x56504560f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:40.983 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.975+0000 7fe137fff640 1 -- 172.21.15.44:0/344835338 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565045275210 con 0x5650455fd690 2024-08-19T00:23:40.984 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.975+0000 7fe13c841640 1 --2- 172.21.15.44:0/2211152011 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fe1200a2da0 0x7fe1200a5260 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe130009370 tx=0x7fe130013ba0 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:23:40.984 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.975+0000 7fe137fff640 1 --2- 172.21.15.44:0/344835338 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5650455fd690 0x5650455fda70 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fe12802a940 tx=0x7fe128005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2d7c1ec7a9dceaf server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:23:40.984 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.975+0000 7fe11e7fc640 1 -- 172.21.15.44:0/344835338 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe128040070 con 0x5650455fd690 2024-08-19T00:23:40.984 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.975+0000 7fe11e7fc640 1 -- 172.21.15.44:0/344835338 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe128031930 con 0x5650455fd690 2024-08-19T00:23:40.984 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.975+0000 7fe11e7fc640 1 -- 172.21.15.44:0/344835338 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe128035040 con 0x5650455fd690 2024-08-19T00:23:40.984 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.976+0000 7fe141061740 1 -- 172.21.15.44:0/344835338 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5650455fd690 msgr2=0x5650455fda70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:40.984 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.976+0000 7fe141061740 1 --2- 172.21.15.44:0/344835338 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5650455fd690 0x5650455fda70 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fe12802a940 tx=0x7fe128005c00 comp rx=0 tx=0).stop 2024-08-19T00:23:40.984 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.976+0000 7fe141061740 1 -- 172.21.15.44:0/344835338 shutdown_connections 2024-08-19T00:23:40.984 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.976+0000 7fe141061740 1 --2- 172.21.15.44:0/344835338 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5650455fdfb0 0x56504560c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:40.984 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.976+0000 7fe141061740 1 --2- 172.21.15.44:0/344835338 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56504560cda0 0x56504560f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:40.984 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.976+0000 7fe141061740 1 --2- 172.21.15.44:0/344835338 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5650455fd690 0x5650455fda70 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:40.984 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.976+0000 7fe141061740 1 -- 172.21.15.44:0/344835338 >> 172.21.15.44:0/344835338 conn(0x5650455f9d40 msgr2=0x5650455fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:23:40.984 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.976+0000 7fe141061740 1 -- 172.21.15.44:0/344835338 shutdown_connections 2024-08-19T00:23:40.985 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.976+0000 7fe141061740 1 -- 172.21.15.44:0/344835338 wait complete. 2024-08-19T00:23:40.985 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.976+0000 7fe141061740 1 -- start start 2024-08-19T00:23:40.985 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.976+0000 7fe141061740 1 Processor -- start 2024-08-19T00:23:40.985 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.977+0000 7fe141061740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5650455fd690 0x565045609c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:40.985 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.977+0000 7fe141061740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5650455fdfb0 0x56504560a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:40.985 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.977+0000 7fe141061740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56504560cda0 0x56504560a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:40.985 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.977+0000 7fe141061740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56504560f910 con 0x56504560cda0 2024-08-19T00:23:40.985 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.977+0000 7fe141061740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x56504551d520 con 0x5650455fdfb0 2024-08-19T00:23:40.985 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.977+0000 7fe141061740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x56504560fa90 con 0x5650455fd690 2024-08-19T00:23:40.985 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.977+0000 7fe141061740 10 client.0 _ll_register_callbacks cb 0x565045274a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:23:40.985 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.977+0000 7fe13c841640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56504560cda0 0x56504560a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:40.985 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.977+0000 7fe13c841640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56504560cda0 0x56504560a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46734/0 (socket says 172.21.15.44:46734) 2024-08-19T00:23:40.985 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.977+0000 7fe13c841640 1 -- 172.21.15.44:0/3281166064 learned_addr learned my addr 172.21.15.44:0/3281166064 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:23:40.986 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.977+0000 7fe137fff640 1 --2- 172.21.15.44:0/3281166064 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5650455fd690 0x565045609c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:40.986 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.977+0000 7fe1377fe640 1 --2- 172.21.15.44:0/3281166064 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5650455fdfb0 0x56504560a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:40.986 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.977+0000 7fe13c841640 1 -- 172.21.15.44:0/3281166064 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5650455fd690 msgr2=0x565045609c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:23:40.986 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.977+0000 7fe13c841640 1 --2- 172.21.15.44:0/3281166064 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5650455fd690 0x565045609c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:40.986 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.977+0000 7fe13c841640 1 -- 172.21.15.44:0/3281166064 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5650455fdfb0 msgr2=0x56504560a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:23:40.986 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.977+0000 7fe13c841640 1 --2- 172.21.15.44:0/3281166064 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5650455fdfb0 0x56504560a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:40.986 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.977+0000 7fe13c841640 1 -- 172.21.15.44:0/3281166064 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565045341620 con 0x56504560cda0 2024-08-19T00:23:40.986 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.977+0000 7fe1377fe640 1 --2- 172.21.15.44:0/3281166064 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5650455fdfb0 0x56504560a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:23:40.986 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.977+0000 7fe13c841640 1 --2- 172.21.15.44:0/3281166064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56504560cda0 0x56504560a680 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fe130011bc0 tx=0x7fe130004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15f4294d49b6f113 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:23:40.986 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.977+0000 7fe1177fe640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:23:40.986 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.977+0000 7fe1177fe640 1 -- 172.21.15.44:0/3281166064 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe130024030 con 0x56504560cda0 2024-08-19T00:23:40.986 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.977+0000 7fe1177fe640 1 -- 172.21.15.44:0/3281166064 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9533+0+0 (secure 0 0 0) 0x7fe13000e990 con 0x56504560cda0 2024-08-19T00:23:40.987 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.977+0000 7fe141061740 1 -- 172.21.15.44:0/3281166064 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe128031930 con 0x56504560cda0 2024-08-19T00:23:40.987 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.978+0000 7fe1177fe640 1 -- 172.21.15.44:0/3281166064 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fe130030050 con 0x56504560cda0 2024-08-19T00:23:40.987 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.978+0000 7fe141061740 10 client.16788 fetch_fsmap learned FSMap version 33 2024-08-19T00:23:40.987 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.978+0000 7fe141061740 1 -- 172.21.15.44:0/3281166064 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x56504561b510 con 0x56504560cda0 2024-08-19T00:23:40.987 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.978+0000 7fe1177fe640 1 -- 172.21.15.44:0/3281166064 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe128031930 con 0x56504560cda0 2024-08-19T00:23:40.987 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.978+0000 7fe1177fe640 1 -- 172.21.15.44:0/3281166064 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7fe1300043b0 con 0x56504560cda0 2024-08-19T00:23:40.987 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.978+0000 7fe141061740 10 client.16788 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:23:40.987 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.978+0000 7fe141061740 10 client.16788 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:23:40.987 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.978+0000 7fe141061740 20 client.16788 populate_metadata read hostname 'smithi044' 2024-08-19T00:23:40.987 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.978+0000 7fe141061740 1 --2- 172.21.15.44:0/3281166064 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x56504561c980 0x56504561edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:40.987 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.978+0000 7fe141061740 4 client.16788 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:23:40.987 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.978+0000 7fe141061740 1 -- 172.21.15.44:0/3281166064 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56504556f100 con 0x56504561c980 2024-08-19T00:23:40.987 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.978+0000 7fe137fff640 1 --2- 172.21.15.44:0/3281166064 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x56504561c980 0x56504561edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:40.987 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.979+0000 7fe1177fe640 10 client.16788 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:23:40.988 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.979+0000 7fe137fff640 1 --2- 172.21.15.44:0/3281166064 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x56504561c980 0x56504561edf0 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=690ef15103cfe86c server_cookie=32f3ed288cdefec5 in_seq=0 out_seq=0 2024-08-19T00:23:40.988 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.979+0000 7fe1177fe640 1 -- 172.21.15.44:0/3281166064 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56504556f100 con 0x56504561c980 2024-08-19T00:23:40.988 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.979+0000 7fe1177fe640 10 client.16788 handle_command_reply: tid=0 2024-08-19T00:23:40.988 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.980+0000 7fe141061740 1 client.16788 shutdown 2024-08-19T00:23:40.988 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.980+0000 7fe141061740 1 -- 172.21.15.44:0/3281166064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56504560cda0 msgr2=0x56504560a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:40.988 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.980+0000 7fe141061740 1 --2- 172.21.15.44:0/3281166064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56504560cda0 0x56504560a680 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fe130011bc0 tx=0x7fe130004ab0 comp rx=0 tx=0).stop 2024-08-19T00:23:40.988 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.980+0000 7fe141061740 1 -- 172.21.15.44:0/3281166064 shutdown_connections 2024-08-19T00:23:40.988 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.980+0000 7fe141061740 1 --2- 172.21.15.44:0/3281166064 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x56504561c980 0x56504561edf0 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:40.988 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.980+0000 7fe141061740 1 --2- 172.21.15.44:0/3281166064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56504560cda0 0x56504560a680 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:40.988 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.980+0000 7fe141061740 1 --2- 172.21.15.44:0/3281166064 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5650455fdfb0 0x56504560a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:40.988 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.980+0000 7fe1177fe640 0 client.16788 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:23:40.988 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.980+0000 7fe141061740 1 --2- 172.21.15.44:0/3281166064 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5650455fd690 0x565045609c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:40.988 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.980+0000 7fe141061740 1 -- 172.21.15.44:0/3281166064 >> 172.21.15.44:0/3281166064 conn(0x5650455f9d40 msgr2=0x5650455ff9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:23:40.989 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.980+0000 7fe141061740 1 -- 172.21.15.44:0/3281166064 shutdown_connections 2024-08-19T00:23:40.989 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.980+0000 7fe141061740 1 -- 172.21.15.44:0/3281166064 wait complete. 2024-08-19T00:23:40.989 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.980+0000 7fe141061740 20 client.16788 trim_cache size 0 max 16384 2024-08-19T00:23:40.998 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.995+0000 7fe141061740 1 Processor -- start 2024-08-19T00:23:40.998 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.995+0000 7fe141061740 1 -- start start 2024-08-19T00:23:40.998 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.995+0000 7fe141061740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5650455fd690 0x565045624750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:40.998 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.995+0000 7fe141061740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5650455fdfb0 0x565045624c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:40.999 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.995+0000 7fe141061740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56504560cda0 0x5650455f8680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:40.999 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.995+0000 7fe141061740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe1381acbb0 con 0x5650455fdfb0 2024-08-19T00:23:40.999 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.995+0000 7fe141061740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fe1381ae6f0 con 0x5650455fd690 2024-08-19T00:23:40.999 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.995+0000 7fe141061740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe1381ad280 con 0x56504560cda0 2024-08-19T00:23:40.999 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.995+0000 7fe1377fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5650455fdfb0 0x565045624c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:40.999 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.995+0000 7fe1377fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5650455fdfb0 0x565045624c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46750/0 (socket says 172.21.15.44:46750) 2024-08-19T00:23:40.999 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.995+0000 7fe1377fe640 1 -- 172.21.15.44:0/1353020317 learned_addr learned my addr 172.21.15.44:0/1353020317 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:23:40.999 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.995+0000 7fe1377fe640 1 -- 172.21.15.44:0/1353020317 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56504560cda0 msgr2=0x5650455f8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:23:40.999 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.995+0000 7fe13c841640 1 --2- 172.21.15.44:0/1353020317 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56504560cda0 0x5650455f8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:40.999 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.995+0000 7fe137fff640 1 --2- 172.21.15.44:0/1353020317 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5650455fd690 0x565045624750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:40.999 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.995+0000 7fe1377fe640 1 --2- 172.21.15.44:0/1353020317 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56504560cda0 0x5650455f8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:40.999 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.995+0000 7fe1377fe640 1 -- 172.21.15.44:0/1353020317 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5650455fd690 msgr2=0x565045624750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:23:40.999 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.995+0000 7fe1377fe640 1 --2- 172.21.15.44:0/1353020317 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5650455fd690 0x565045624750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:41.000 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.995+0000 7fe1377fe640 1 -- 172.21.15.44:0/1353020317 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650455f9b70 con 0x5650455fdfb0 2024-08-19T00:23:41.000 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.995+0000 7fe137fff640 1 --2- 172.21.15.44:0/1353020317 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5650455fd690 0x565045624750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:23:41.000 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.995+0000 7fe13c841640 1 --2- 172.21.15.44:0/1353020317 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56504560cda0 0x5650455f8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:23:41.000 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.996+0000 7fe1377fe640 1 --2- 172.21.15.44:0/1353020317 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5650455fdfb0 0x565045624c90 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fe12c09b0f0 tx=0x7fe12c09ae30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58f6cbef01b3a1f0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:23:41.000 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.996+0000 7fe11dffb640 1 -- 172.21.15.44:0/1353020317 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe12c020040 con 0x5650455fdfb0 2024-08-19T00:23:41.000 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.996+0000 7fe11dffb640 1 -- 172.21.15.44:0/1353020317 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe12c09b3f0 con 0x5650455fdfb0 2024-08-19T00:23:41.000 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.996+0000 7fe11dffb640 1 -- 172.21.15.44:0/1353020317 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe12c087120 con 0x5650455fdfb0 2024-08-19T00:23:41.000 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.996+0000 7fe141061740 1 -- 172.21.15.44:0/1353020317 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5650455fdfb0 msgr2=0x565045624c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:41.000 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.996+0000 7fe141061740 1 --2- 172.21.15.44:0/1353020317 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5650455fdfb0 0x565045624c90 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fe12c09b0f0 tx=0x7fe12c09ae30 comp rx=0 tx=0).stop 2024-08-19T00:23:41.000 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.996+0000 7fe141061740 1 -- 172.21.15.44:0/1353020317 shutdown_connections 2024-08-19T00:23:41.000 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.996+0000 7fe141061740 1 --2- 172.21.15.44:0/1353020317 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56504560cda0 0x5650455f8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:41.000 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.996+0000 7fe141061740 1 --2- 172.21.15.44:0/1353020317 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5650455fdfb0 0x565045624c90 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:41.000 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.996+0000 7fe141061740 1 --2- 172.21.15.44:0/1353020317 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5650455fd690 0x565045624750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:41.000 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.996+0000 7fe141061740 1 -- 172.21.15.44:0/1353020317 >> 172.21.15.44:0/1353020317 conn(0x5650455f9d40 msgr2=0x565045608cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:23:41.001 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.996+0000 7fe141061740 1 -- 172.21.15.44:0/1353020317 shutdown_connections 2024-08-19T00:23:41.001 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.996+0000 7fe141061740 1 -- 172.21.15.44:0/1353020317 wait complete. 2024-08-19T00:23:41.001 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.997+0000 7fe141061740 1 -- start start 2024-08-19T00:23:41.001 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.997+0000 7fe141061740 1 Processor -- start 2024-08-19T00:23:41.004 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.997+0000 7fe141061740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5650455fd690 0x565045615410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:41.004 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.997+0000 7fe141061740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5650455fdfb0 0x565045606880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:41.004 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.997+0000 7fe141061740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56504560cda0 0x565045606dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:41.004 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.997+0000 7fe141061740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe1381ae020 con 0x5650455fdfb0 2024-08-19T00:23:41.004 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.997+0000 7fe141061740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fe1381ad950 con 0x56504560cda0 2024-08-19T00:23:41.004 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.997+0000 7fe141061740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe1381aabb0 con 0x5650455fd690 2024-08-19T00:23:41.004 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.997+0000 7fe141061740 10 client.0 _ll_register_callbacks cb 0x7fe1300119d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:23:41.004 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.997+0000 7fe1377fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5650455fdfb0 0x565045606880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:41.004 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.997+0000 7fe1377fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5650455fdfb0 0x565045606880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46760/0 (socket says 172.21.15.44:46760) 2024-08-19T00:23:41.004 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.997+0000 7fe1377fe640 1 -- 172.21.15.44:0/2783987135 learned_addr learned my addr 172.21.15.44:0/2783987135 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:23:41.004 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.997+0000 7fe13c841640 1 --2- 172.21.15.44:0/2783987135 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56504560cda0 0x565045606dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:41.004 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.998+0000 7fe137fff640 1 --2- 172.21.15.44:0/2783987135 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5650455fd690 0x565045615410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:41.004 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.998+0000 7fe1377fe640 1 -- 172.21.15.44:0/2783987135 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5650455fd690 msgr2=0x565045615410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:23:41.004 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.998+0000 7fe1377fe640 1 --2- 172.21.15.44:0/2783987135 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5650455fd690 0x565045615410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:41.005 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.998+0000 7fe1377fe640 1 -- 172.21.15.44:0/2783987135 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56504560cda0 msgr2=0x565045606dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:23:41.005 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.998+0000 7fe1377fe640 1 --2- 172.21.15.44:0/2783987135 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56504560cda0 0x565045606dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:41.005 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.998+0000 7fe1377fe640 1 -- 172.21.15.44:0/2783987135 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565045604a30 con 0x5650455fdfb0 2024-08-19T00:23:41.005 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.998+0000 7fe13c841640 1 --2- 172.21.15.44:0/2783987135 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56504560cda0 0x565045606dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:23:41.005 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.998+0000 7fe1377fe640 1 --2- 172.21.15.44:0/2783987135 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5650455fdfb0 0x565045606880 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fe12c097dc0 tx=0x7fe12c09bc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=619b4e82b0132596 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:23:41.005 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.998+0000 7fe1177fe640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:23:41.005 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.998+0000 7fe1177fe640 1 -- 172.21.15.44:0/2783987135 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe12c020040 con 0x5650455fdfb0 2024-08-19T00:23:41.005 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.998+0000 7fe1177fe640 1 -- 172.21.15.44:0/2783987135 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9533+0+0 (secure 0 0 0) 0x7fe12c091e10 con 0x5650455fdfb0 2024-08-19T00:23:41.005 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.998+0000 7fe141061740 1 -- 172.21.15.44:0/2783987135 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe12c09b3f0 con 0x5650455fdfb0 2024-08-19T00:23:41.005 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.998+0000 7fe1177fe640 1 -- 172.21.15.44:0/2783987135 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fe12c0997b0 con 0x5650455fdfb0 2024-08-19T00:23:41.005 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.998+0000 7fe141061740 10 client.16794 fetch_fsmap learned FSMap version 33 2024-08-19T00:23:41.005 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.998+0000 7fe141061740 1 -- 172.21.15.44:0/2783987135 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x565045687470 con 0x5650455fdfb0 2024-08-19T00:23:41.005 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.998+0000 7fe1177fe640 1 -- 172.21.15.44:0/2783987135 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe12c09b3f0 con 0x5650455fdfb0 2024-08-19T00:23:41.005 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.998+0000 7fe1177fe640 1 -- 172.21.15.44:0/2783987135 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7fe12c0cc930 con 0x5650455fdfb0 2024-08-19T00:23:41.006 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.998+0000 7fe141061740 10 client.16794 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:23:41.006 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.998+0000 7fe141061740 10 client.16794 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:23:41.006 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.998+0000 7fe141061740 20 client.16794 populate_metadata read hostname 'smithi044' 2024-08-19T00:23:41.006 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.998+0000 7fe141061740 1 --2- 172.21.15.44:0/2783987135 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x565045687b00 0x565045689f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:41.006 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.998+0000 7fe141061740 4 client.16794 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-19T00:23:41.006 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.998+0000 7fe141061740 1 -- 172.21.15.44:0/2783987135 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "flush journal"}) -- 0x565045569450 con 0x565045687b00 2024-08-19T00:23:41.006 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.999+0000 7fe137fff640 1 --2- 172.21.15.44:0/2783987135 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x565045687b00 0x565045689f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:41.006 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.999+0000 7fe137fff640 1 --2- 172.21.15.44:0/2783987135 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x565045687b00 0x565045689f20 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39e120006e744050 server_cookie=93467993a29801bf in_seq=0 out_seq=0 2024-08-19T00:23:41.006 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:40.999+0000 7fe1177fe640 10 client.16794 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:23:41.012 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:41.010+0000 7fe1177fe640 1 -- 172.21.15.44:0/2783987135 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x565045569450 con 0x565045687b00 2024-08-19T00:23:41.012 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:41.010+0000 7fe1177fe640 10 client.16794 handle_command_reply: tid=0 2024-08-19T00:23:41.013 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:41.010+0000 7fe141061740 1 client.16794 shutdown 2024-08-19T00:23:41.013 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:41.011+0000 7fe141061740 1 -- 172.21.15.44:0/2783987135 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5650455fdfb0 msgr2=0x565045606880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:41.013 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:41.011+0000 7fe141061740 1 --2- 172.21.15.44:0/2783987135 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5650455fdfb0 0x565045606880 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fe12c097dc0 tx=0x7fe12c09bc30 comp rx=0 tx=0).stop 2024-08-19T00:23:41.013 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:41.011+0000 7fe141061740 1 -- 172.21.15.44:0/2783987135 shutdown_connections 2024-08-19T00:23:41.013 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:41.011+0000 7fe141061740 1 --2- 172.21.15.44:0/2783987135 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x565045687b00 0x565045689f20 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:41.013 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:41.011+0000 7fe141061740 1 --2- 172.21.15.44:0/2783987135 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56504560cda0 0x565045606dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:41.013 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:41.011+0000 7fe1177fe640 0 client.16794 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:23:41.013 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:41.011+0000 7fe141061740 1 --2- 172.21.15.44:0/2783987135 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5650455fdfb0 0x565045606880 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:41.013 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:41.011+0000 7fe141061740 1 --2- 172.21.15.44:0/2783987135 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5650455fd690 0x565045615410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:41.013 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:41.011+0000 7fe141061740 1 -- 172.21.15.44:0/2783987135 >> 172.21.15.44:0/2783987135 conn(0x5650455f9d40 msgr2=0x565045609bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:23:41.013 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:41.011+0000 7fe141061740 1 -- 172.21.15.44:0/2783987135 shutdown_connections 2024-08-19T00:23:41.013 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:41.011+0000 7fe141061740 1 -- 172.21.15.44:0/2783987135 wait complete. 2024-08-19T00:23:41.013 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:41.011+0000 7fe141061740 20 client.16794 trim_cache size 0 max 16384 2024-08-19T00:23:41.014 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:{ 2024-08-19T00:23:41.014 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "message": "", 2024-08-19T00:23:41.014 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "return_code": 0 2024-08-19T00:23:41.014 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:} 2024-08-19T00:23:41.015 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:41.011+0000 7fe13e2a4640 1 -- 172.21.15.44:0/2211152011 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fe1200a2da0 msgr2=0x7fe1200a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:41.015 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:41.011+0000 7fe13e2a4640 1 --2- 172.21.15.44:0/2211152011 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fe1200a2da0 0x7fe1200a5260 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe130009370 tx=0x7fe130013ba0 comp rx=0 tx=0).stop 2024-08-19T00:23:41.015 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:41.011+0000 7fe13e2a4640 1 -- 172.21.15.44:0/2211152011 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1381021b0 msgr2=0x7fe138198630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:41.015 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:41.011+0000 7fe13e2a4640 1 --2- 172.21.15.44:0/2211152011 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1381021b0 0x7fe138198630 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fe12c00d770 tx=0x7fe12c00dc30 comp rx=0 tx=0).stop 2024-08-19T00:23:41.015 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:41.011+0000 7fe13e2a4640 1 -- 172.21.15.44:0/2211152011 shutdown_connections 2024-08-19T00:23:41.015 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:41.011+0000 7fe13e2a4640 1 --2- 172.21.15.44:0/2211152011 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fe1200a2da0 0x7fe1200a5260 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:41.015 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:41.011+0000 7fe13e2a4640 1 --2- 172.21.15.44:0/2211152011 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe138107820 0x7fe13819c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:41.015 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:41.011+0000 7fe13e2a4640 1 --2- 172.21.15.44:0/2211152011 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1381021b0 0x7fe138198630 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:41.015 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:41.011+0000 7fe13e2a4640 1 --2- 172.21.15.44:0/2211152011 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe138101810 0x7fe1381980f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:41.015 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:41.012+0000 7fe13e2a4640 1 -- 172.21.15.44:0/2211152011 >> 172.21.15.44:0/2211152011 conn(0x7fe1380fd510 msgr2=0x7fe1380fdca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:23:41.015 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:41.012+0000 7fe13e2a4640 1 -- 172.21.15.44:0/2211152011 shutdown_connections 2024-08-19T00:23:41.016 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:41.012+0000 7fe13e2a4640 1 -- 172.21.15.44:0/2211152011 wait complete. 2024-08-19T00:23:41.695 INFO:tasks.workunit.client.0.smithi044.stdout: 1 777592 7.78 MB/sec execute 426 sec latency 8302.314 ms 2024-08-19T00:23:42.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:23:41 smithi171 ceph-mon[21810]: pgmap v322: 129 pgs: 129 active+clean; 536 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.3 MiB/s wr, 194 op/s 2024-08-19T00:23:42.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:23:41 smithi116 ceph-mon[21873]: pgmap v322: 129 pgs: 129 active+clean; 536 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.3 MiB/s wr, 194 op/s 2024-08-19T00:23:42.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:23:41 smithi044 ceph-mon[18489]: pgmap v322: 129 pgs: 129 active+clean; 536 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.3 MiB/s wr, 194 op/s 2024-08-19T00:23:42.695 INFO:tasks.workunit.client.0.smithi044.stdout: 1 777592 7.76 MB/sec execute 427 sec latency 9302.394 ms 2024-08-19T00:23:43.695 INFO:tasks.workunit.client.0.smithi044.stdout: 1 777592 7.75 MB/sec execute 428 sec latency 10302.463 ms 2024-08-19T00:23:44.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:23:43 smithi171 ceph-mon[21810]: pgmap v323: 129 pgs: 129 active+clean; 536 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 97 op/s 2024-08-19T00:23:44.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:23:43 smithi116 ceph-mon[21873]: pgmap v323: 129 pgs: 129 active+clean; 536 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 97 op/s 2024-08-19T00:23:44.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:23:43 smithi044 ceph-mon[18489]: pgmap v323: 129 pgs: 129 active+clean; 536 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 97 op/s 2024-08-19T00:23:44.695 INFO:tasks.workunit.client.0.smithi044.stdout: 1 777592 7.73 MB/sec execute 429 sec latency 11302.568 ms 2024-08-19T00:23:45.695 INFO:tasks.workunit.client.0.smithi044.stdout: 1 777592 7.71 MB/sec execute 430 sec latency 12302.638 ms 2024-08-19T00:23:46.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:23:45 smithi171 ceph-mon[21810]: pgmap v324: 129 pgs: 129 active+clean; 528 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 115 op/s 2024-08-19T00:23:46.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:23:45 smithi116 ceph-mon[21873]: pgmap v324: 129 pgs: 129 active+clean; 528 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 115 op/s 2024-08-19T00:23:46.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:23:45 smithi044 ceph-mon[18489]: pgmap v324: 129 pgs: 129 active+clean; 528 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 115 op/s 2024-08-19T00:23:46.695 INFO:tasks.workunit.client.0.smithi044.stdout: 1 777592 7.69 MB/sec execute 431 sec latency 13302.713 ms 2024-08-19T00:23:47.695 INFO:tasks.workunit.client.0.smithi044.stdout: 1 777592 7.67 MB/sec execute 432 sec latency 14302.750 ms 2024-08-19T00:23:48.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:23:47 smithi171 ceph-mon[21810]: pgmap v325: 129 pgs: 129 active+clean; 528 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 789 KiB/s wr, 44 op/s 2024-08-19T00:23:48.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:23:47 smithi116 ceph-mon[21873]: pgmap v325: 129 pgs: 129 active+clean; 528 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 789 KiB/s wr, 44 op/s 2024-08-19T00:23:48.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:23:47 smithi044 ceph-mon[18489]: pgmap v325: 129 pgs: 129 active+clean; 528 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 789 KiB/s wr, 44 op/s 2024-08-19T00:23:48.695 INFO:tasks.workunit.client.0.smithi044.stdout: 1 777592 7.66 MB/sec execute 433 sec latency 15302.867 ms 2024-08-19T00:23:49.695 INFO:tasks.workunit.client.0.smithi044.stdout: 1 777592 7.64 MB/sec execute 434 sec latency 16302.981 ms 2024-08-19T00:23:50.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:23:49 smithi171 ceph-mon[21810]: pgmap v326: 129 pgs: 129 active+clean; 528 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 789 KiB/s wr, 44 op/s 2024-08-19T00:23:50.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:23:49 smithi116 ceph-mon[21873]: pgmap v326: 129 pgs: 129 active+clean; 528 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 789 KiB/s wr, 44 op/s 2024-08-19T00:23:50.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:23:49 smithi044 ceph-mon[18489]: pgmap v326: 129 pgs: 129 active+clean; 528 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 789 KiB/s wr, 44 op/s 2024-08-19T00:23:50.695 INFO:tasks.workunit.client.0.smithi044.stdout: 1 777592 7.62 MB/sec execute 435 sec latency 17303.066 ms 2024-08-19T00:23:51.696 INFO:tasks.workunit.client.0.smithi044.stdout: 1 777592 7.60 MB/sec execute 436 sec latency 18303.179 ms 2024-08-19T00:23:52.251 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-19T00:23:52.282 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:23:51 smithi044 ceph-mon[18489]: pgmap v327: 129 pgs: 129 active+clean; 529 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 852 KiB/s wr, 53 op/s 2024-08-19T00:23:52.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:23:51 smithi171 ceph-mon[21810]: pgmap v327: 129 pgs: 129 active+clean; 529 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 852 KiB/s wr, 53 op/s 2024-08-19T00:23:52.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:23:51 smithi116 ceph-mon[21873]: pgmap v327: 129 pgs: 129 active+clean; 529 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 852 KiB/s wr, 53 op/s 2024-08-19T00:23:52.528 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:23:52.696 INFO:tasks.workunit.client.0.smithi044.stdout: 1 777592 7.59 MB/sec execute 437 sec latency 19303.266 ms 2024-08-19T00:23:53.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:53.028+0000 7fdb863ab640 1 -- 172.21.15.44:0/3131202271 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb80102c20 msgr2=0x7fdb8010d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:53.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:53.028+0000 7fdb863ab640 1 --2- 172.21.15.44:0/3131202271 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb80102c20 0x7fdb8010d770 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fdb78009ca0 tx=0x7fdb7802a950 comp rx=0 tx=0).stop 2024-08-19T00:23:53.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:53.028+0000 7fdb863ab640 1 -- 172.21.15.44:0/3131202271 shutdown_connections 2024-08-19T00:23:53.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:53.028+0000 7fdb863ab640 1 --2- 172.21.15.44:0/3131202271 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdb801022a0 0x7fdb801026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:53.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:53.028+0000 7fdb863ab640 1 --2- 172.21.15.44:0/3131202271 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb80102c20 0x7fdb8010d770 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:53.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:53.028+0000 7fdb863ab640 1 --2- 172.21.15.44:0/3131202271 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdb80100b50 0x7fdb80100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:53.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:53.028+0000 7fdb863ab640 1 -- 172.21.15.44:0/3131202271 >> 172.21.15.44:0/3131202271 conn(0x7fdb800fc500 msgr2=0x7fdb800fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:23:53.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:53.028+0000 7fdb863ab640 1 -- 172.21.15.44:0/3131202271 shutdown_connections 2024-08-19T00:23:53.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:53.028+0000 7fdb863ab640 1 -- 172.21.15.44:0/3131202271 wait complete. 2024-08-19T00:23:53.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:53.029+0000 7fdb863ab640 1 Processor -- start 2024-08-19T00:23:53.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:53.029+0000 7fdb863ab640 1 -- start start 2024-08-19T00:23:53.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:53.029+0000 7fdb863ab640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdb80100b50 0x7fdb80197090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:53.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:53.029+0000 7fdb863ab640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb801022a0 0x7fdb801975d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:53.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:53.029+0000 7fdb863ab640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdb80102c20 0x7fdb8019b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:53.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:53.029+0000 7fdb863ab640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdb80110cb0 con 0x7fdb801022a0 2024-08-19T00:23:53.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:53.029+0000 7fdb863ab640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fdb80110b30 con 0x7fdb80102c20 2024-08-19T00:23:53.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:53.029+0000 7fdb863ab640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fdb80110e30 con 0x7fdb80100b50 2024-08-19T00:23:53.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:53.029+0000 7fdb7f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb801022a0 0x7fdb801975d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:53.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:53.029+0000 7fdb7ffff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdb80100b50 0x7fdb80197090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:53.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:53.029+0000 7fdb7f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb801022a0 0x7fdb801975d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48964/0 (socket says 172.21.15.44:48964) 2024-08-19T00:23:53.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:53.029+0000 7fdb7ffff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdb80100b50 0x7fdb80197090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.44:40584/0 (socket says 172.21.15.44:40584) 2024-08-19T00:23:53.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:53.029+0000 7fdb7f7fe640 1 -- 172.21.15.44:0/1223977163 learned_addr learned my addr 172.21.15.44:0/1223977163 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:23:53.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:53.030+0000 7fdb84948640 1 --2- 172.21.15.44:0/1223977163 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdb80102c20 0x7fdb8019b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:53.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:53.030+0000 7fdb7f7fe640 1 -- 172.21.15.44:0/1223977163 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdb80100b50 msgr2=0x7fdb80197090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:53.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:53.030+0000 7fdb7f7fe640 1 --2- 172.21.15.44:0/1223977163 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdb80100b50 0x7fdb80197090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:53.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:53.030+0000 7fdb7f7fe640 1 -- 172.21.15.44:0/1223977163 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdb80102c20 msgr2=0x7fdb8019b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:53.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:53.030+0000 7fdb7f7fe640 1 --2- 172.21.15.44:0/1223977163 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdb80102c20 0x7fdb8019b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:53.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:53.030+0000 7fdb7f7fe640 1 -- 172.21.15.44:0/1223977163 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb8019c040 con 0x7fdb801022a0 2024-08-19T00:23:53.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:53.030+0000 7fdb7f7fe640 1 --2- 172.21.15.44:0/1223977163 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb801022a0 0x7fdb801975d0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fdb74009900 tx=0x7fdb74009dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:23:53.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:53.030+0000 7fdb7d7fa640 1 -- 172.21.15.44:0/1223977163 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb7400d030 con 0x7fdb801022a0 2024-08-19T00:23:53.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:53.030+0000 7fdb863ab640 1 -- 172.21.15.44:0/1223977163 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb8019c330 con 0x7fdb801022a0 2024-08-19T00:23:53.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:53.030+0000 7fdb7d7fa640 1 -- 172.21.15.44:0/1223977163 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb7400d1d0 con 0x7fdb801022a0 2024-08-19T00:23:53.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:53.030+0000 7fdb7d7fa640 1 -- 172.21.15.44:0/1223977163 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb74005280 con 0x7fdb801022a0 2024-08-19T00:23:53.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:53.030+0000 7fdb863ab640 1 -- 172.21.15.44:0/1223977163 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb80069ca0 con 0x7fdb801022a0 2024-08-19T00:23:53.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:53.031+0000 7fdb863ab640 1 -- 172.21.15.44:0/1223977163 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb80100f30 con 0x7fdb801022a0 2024-08-19T00:23:53.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:53.032+0000 7fdb7d7fa640 1 -- 172.21.15.44:0/1223977163 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fdb740054e0 con 0x7fdb801022a0 2024-08-19T00:23:53.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:53.033+0000 7fdb7d7fa640 1 --2- 172.21.15.44:0/1223977163 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fdb680a2cf0 0x7fdb680a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:53.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:53.033+0000 7fdb7ffff640 1 --2- 172.21.15.44:0/1223977163 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fdb680a2cf0 0x7fdb680a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:53.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:53.033+0000 7fdb7d7fa640 1 -- 172.21.15.44:0/1223977163 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9533+0+0 (secure 0 0 0) 0x7fdb740d0b00 con 0x7fdb801022a0 2024-08-19T00:23:53.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:53.033+0000 7fdb7ffff640 1 --2- 172.21.15.44:0/1223977163 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fdb680a2cf0 0x7fdb680a51b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdb7000bbe0 tx=0x7fdb7000b390 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:23:53.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:53.037+0000 7fdb7d7fa640 1 -- 172.21.15.44:0/1223977163 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fdb7409cce0 con 0x7fdb801022a0 2024-08-19T00:23:53.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:53.247+0000 7fdb863ab640 1 -- 172.21.15.44:0/1223977163 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdb80069f60 con 0x7fdb801022a0 2024-08-19T00:23:53.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:53.248+0000 7fdb7d7fa640 1 -- 172.21.15.44:0/1223977163 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11989 (secure 0 0 0) 0x7fdb740a0fe0 con 0x7fdb801022a0 2024-08-19T00:23:53.250 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:23:53.250 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":33,"btime":"2024-08-19T00:17:11:640526+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14511,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1538841896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1538841896},{"type":"v1","addr":"172.21.15.116:6833","nonce":1538841896}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/4044471606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4044471606},{"type":"v1","addr":"172.21.15.44:6835","nonce":4044471606}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":33,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-19T00:10:53.196636+0000","modified":"2024-08-19T00:17:11.586031+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24473,"mds_1":24446,"mds_2":24439,"mds_3":24431,"mds_4":24418},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14529":{"gid":14529,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6837/1824829052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1824829052},{"type":"v1","addr":"172.21.15.44:6837","nonce":1824829052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14577":{"gid":14577,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6839/3591739042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":3591739042},{"type":"v1","addr":"172.21.15.44:6839","nonce":3591739042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14589":{"gid":14589,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6841/3667695717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6840","nonce":3667695717},{"type":"v1","addr":"172.21.15.44:6841","nonce":3667695717}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24388":{"gid":24388,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1183022838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1183022838},{"type":"v1","addr":"172.21.15.171:6833","nonce":1183022838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6835/2190623851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":2190623851},{"type":"v1","addr":"172.21.15.171:6835","nonce":2190623851}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.171:6837/316231795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":316231795},{"type":"v1","addr":"172.21.15.171:6837","nonce":316231795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":20,"addr":"172.21.15.116:6835/3507399322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3507399322},{"type":"v1","addr":"172.21.15.116:6835","nonce":3507399322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.171:6839/1466585795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":1466585795},{"type":"v1","addr":"172.21.15.171:6839","nonce":1466585795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":17,"addr":"172.21.15.116:6837/2764513846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":2764513846},{"type":"v1","addr":"172.21.15.116:6837","nonce":2764513846}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.116:6839/1032741033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":1032741033},{"type":"v1","addr":"172.21.15.116:6839","nonce":1032741033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24446,24439,24431,24418]},"id":1}]} 2024-08-19T00:23:53.250 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 33 2024-08-19T00:23:53.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:53.250+0000 7fdb863ab640 1 -- 172.21.15.44:0/1223977163 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fdb680a2cf0 msgr2=0x7fdb680a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:53.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:53.250+0000 7fdb863ab640 1 --2- 172.21.15.44:0/1223977163 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fdb680a2cf0 0x7fdb680a51b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdb7000bbe0 tx=0x7fdb7000b390 comp rx=0 tx=0).stop 2024-08-19T00:23:53.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:53.250+0000 7fdb863ab640 1 -- 172.21.15.44:0/1223977163 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb801022a0 msgr2=0x7fdb801975d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:53.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:53.250+0000 7fdb863ab640 1 --2- 172.21.15.44:0/1223977163 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb801022a0 0x7fdb801975d0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fdb74009900 tx=0x7fdb74009dc0 comp rx=0 tx=0).stop 2024-08-19T00:23:53.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:53.250+0000 7fdb863ab640 1 -- 172.21.15.44:0/1223977163 shutdown_connections 2024-08-19T00:23:53.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:53.250+0000 7fdb863ab640 1 --2- 172.21.15.44:0/1223977163 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fdb680a2cf0 0x7fdb680a51b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:53.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:53.250+0000 7fdb863ab640 1 --2- 172.21.15.44:0/1223977163 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdb80102c20 0x7fdb8019b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:53.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:53.250+0000 7fdb863ab640 1 --2- 172.21.15.44:0/1223977163 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb801022a0 0x7fdb801975d0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:53.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:53.250+0000 7fdb863ab640 1 --2- 172.21.15.44:0/1223977163 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdb80100b50 0x7fdb80197090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:53.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:53.250+0000 7fdb863ab640 1 -- 172.21.15.44:0/1223977163 >> 172.21.15.44:0/1223977163 conn(0x7fdb800fc500 msgr2=0x7fdb80106570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:23:53.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:53.250+0000 7fdb863ab640 1 -- 172.21.15.44:0/1223977163 shutdown_connections 2024-08-19T00:23:53.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:53.250+0000 7fdb863ab640 1 -- 172.21.15.44:0/1223977163 wait complete. 2024-08-19T00:23:53.696 INFO:tasks.workunit.client.0.smithi044.stdout: 1 777592 7.57 MB/sec execute 438 sec latency 20303.369 ms 2024-08-19T00:23:54.074 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24473 quiesce db --set-id dfe56178 --release --await' 2024-08-19T00:23:54.074 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24473 quiesce db --set-id dfe56178 --release --await 2024-08-19T00:23:54.111 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.108+0000 7ff331e63640 1 -- 172.21.15.44:0/3957295099 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff32c1066f0 msgr2=0x7ff32c106ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:54.112 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.108+0000 7ff331e63640 1 --2- 172.21.15.44:0/3957295099 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff32c1066f0 0x7ff32c106ad0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7ff31c009930 tx=0x7ff31c02a420 comp rx=0 tx=0).stop 2024-08-19T00:23:54.112 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.108+0000 7ff331e63640 1 -- 172.21.15.44:0/3957295099 shutdown_connections 2024-08-19T00:23:54.112 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.108+0000 7ff331e63640 1 --2- 172.21.15.44:0/3957295099 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff32c1006e0 0x7ff32c100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.112 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.108+0000 7ff331e63640 1 --2- 172.21.15.44:0/3957295099 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff32c101080 0x7ff32c10d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.112 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.108+0000 7ff331e63640 1 --2- 172.21.15.44:0/3957295099 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff32c1066f0 0x7ff32c106ad0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.112 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.108+0000 7ff331e63640 1 -- 172.21.15.44:0/3957295099 >> 172.21.15.44:0/3957295099 conn(0x7ff32c0776c0 msgr2=0x7ff32c0fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:23:54.112 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.108+0000 7ff331e63640 1 -- 172.21.15.44:0/3957295099 shutdown_connections 2024-08-19T00:23:54.112 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.108+0000 7ff331e63640 1 -- 172.21.15.44:0/3957295099 wait complete. 2024-08-19T00:23:54.112 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.109+0000 7ff331e63640 1 Processor -- start 2024-08-19T00:23:54.112 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.109+0000 7ff331e63640 1 -- start start 2024-08-19T00:23:54.112 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.109+0000 7ff331e63640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff32c1006e0 0x7ff32c198120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:54.113 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.109+0000 7ff331e63640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff32c101080 0x7ff32c198660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:54.113 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.109+0000 7ff331e63640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff32c1066f0 0x7ff32c19c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:54.113 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.109+0000 7ff331e63640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c110b30 con 0x7ff32c1066f0 2024-08-19T00:23:54.115 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.109+0000 7ff331e63640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c1109b0 con 0x7ff32c101080 2024-08-19T00:23:54.115 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.109+0000 7ff331e63640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c110cb0 con 0x7ff32c1006e0 2024-08-19T00:23:54.115 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.109+0000 7ff32bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff32c1066f0 0x7ff32c19c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:54.115 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.109+0000 7ff32b7fe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff32c1006e0 0x7ff32c198120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:54.115 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.110+0000 7ff32b7fe640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff32c1006e0 0x7ff32c198120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.44:40596/0 (socket says 172.21.15.44:40596) 2024-08-19T00:23:54.115 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.110+0000 7ff32b7fe640 1 -- 172.21.15.44:0/2220293965 learned_addr learned my addr 172.21.15.44:0/2220293965 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:23:54.115 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.110+0000 7ff32bfff640 1 --2- 172.21.15.44:0/2220293965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff32c1066f0 0x7ff32c19c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48988/0 (socket says 172.21.15.44:48988) 2024-08-19T00:23:54.116 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.110+0000 7ff32affd640 1 --2- 172.21.15.44:0/2220293965 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff32c101080 0x7ff32c198660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:54.116 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.110+0000 7ff32bfff640 1 -- 172.21.15.44:0/2220293965 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff32c1006e0 msgr2=0x7ff32c198120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:54.116 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.110+0000 7ff32bfff640 1 --2- 172.21.15.44:0/2220293965 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff32c1006e0 0x7ff32c198120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.116 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.110+0000 7ff32bfff640 1 -- 172.21.15.44:0/2220293965 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff32c101080 msgr2=0x7ff32c198660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:54.116 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.110+0000 7ff32bfff640 1 --2- 172.21.15.44:0/2220293965 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff32c101080 0x7ff32c198660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.116 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.110+0000 7ff32bfff640 1 -- 172.21.15.44:0/2220293965 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff32c19d110 con 0x7ff32c1066f0 2024-08-19T00:23:54.116 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.110+0000 7ff32bfff640 1 --2- 172.21.15.44:0/2220293965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff32c1066f0 0x7ff32c19c9e0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7ff32400ca30 tx=0x7ff32400cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:23:54.116 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.110+0000 7ff328ff9640 1 -- 172.21.15.44:0/2220293965 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff324007d90 con 0x7ff32c1066f0 2024-08-19T00:23:54.117 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.110+0000 7ff328ff9640 1 -- 172.21.15.44:0/2220293965 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff324005020 con 0x7ff32c1066f0 2024-08-19T00:23:54.117 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.110+0000 7ff328ff9640 1 -- 172.21.15.44:0/2220293965 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff32400f780 con 0x7ff32c1066f0 2024-08-19T00:23:54.117 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.110+0000 7ff331e63640 1 -- 172.21.15.44:0/2220293965 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff32c19d400 con 0x7ff32c1066f0 2024-08-19T00:23:54.117 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.110+0000 7ff331e63640 1 -- 172.21.15.44:0/2220293965 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff32c1a4c90 con 0x7ff32c1066f0 2024-08-19T00:23:54.124 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.113+0000 7ff328ff9640 1 -- 172.21.15.44:0/2220293965 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7ff3240051d0 con 0x7ff32c1066f0 2024-08-19T00:23:54.124 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.113+0000 7ff334c1f740 1 Processor -- start 2024-08-19T00:23:54.124 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.113+0000 7ff334c1f740 1 -- start start 2024-08-19T00:23:54.124 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.113+0000 7ff334c1f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2a0bc77d0 0x55b2a0bc7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:54.124 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.113+0000 7ff334c1f740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b2a0bc80f0 0x55b2a0bd2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:54.124 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.113+0000 7ff334c1f740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b2a0bd2990 0x55b2a0bd4d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:54.124 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.113+0000 7ff334c1f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b2a0b2b9d0 con 0x55b2a0bc77d0 2024-08-19T00:23:54.125 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.113+0000 7ff334c1f740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55b2a0ad3820 con 0x55b2a0bd2990 2024-08-19T00:23:54.125 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.113+0000 7ff334c1f740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55b2a0b27990 con 0x55b2a0bc80f0 2024-08-19T00:23:54.125 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.113+0000 7ff32affd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2a0bc77d0 0x55b2a0bc7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:54.125 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.113+0000 7ff32affd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2a0bc77d0 0x55b2a0bc7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48990/0 (socket says 172.21.15.44:48990) 2024-08-19T00:23:54.125 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.113+0000 7ff32affd640 1 -- 172.21.15.44:0/3004790983 learned_addr learned my addr 172.21.15.44:0/3004790983 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:23:54.125 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.114+0000 7ff32b7fe640 1 --2- 172.21.15.44:0/3004790983 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b2a0bc80f0 0x55b2a0bd2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:54.125 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.114+0000 7ff328ff9640 1 --2- 172.21.15.44:0/2220293965 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7ff3140a2e20 0x7ff3140a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:54.125 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.114+0000 7ff32affd640 1 -- 172.21.15.44:0/3004790983 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b2a0bc80f0 msgr2=0x55b2a0bd2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:23:54.125 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.114+0000 7ff32affd640 1 --2- 172.21.15.44:0/3004790983 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b2a0bc80f0 0x55b2a0bd2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.125 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.114+0000 7ff32affd640 1 -- 172.21.15.44:0/3004790983 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b2a0bd2990 msgr2=0x55b2a0bd4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:23:54.125 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.114+0000 7ff32affd640 1 --2- 172.21.15.44:0/3004790983 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b2a0bd2990 0x55b2a0bd4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.125 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.114+0000 7ff32affd640 1 -- 172.21.15.44:0/3004790983 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2a083f210 con 0x55b2a0bc77d0 2024-08-19T00:23:54.125 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.114+0000 7ff32bfff640 1 --2- 172.21.15.44:0/2220293965 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7ff3140a2e20 0x7ff3140a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:54.126 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.114+0000 7ff328ff9640 1 -- 172.21.15.44:0/2220293965 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9533+0+0 (secure 0 0 0) 0x7ff3240cf9b0 con 0x7ff32c1066f0 2024-08-19T00:23:54.126 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.114+0000 7ff32affd640 1 --2- 172.21.15.44:0/3004790983 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2a0bc77d0 0x55b2a0bc7bb0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7ff32000bd40 tx=0x7ff320011750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2368d348606b926e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:23:54.126 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.114+0000 7ff311ffb640 1 -- 172.21.15.44:0/3004790983 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff32001a400 con 0x55b2a0bc77d0 2024-08-19T00:23:54.126 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.114+0000 7ff311ffb640 1 -- 172.21.15.44:0/3004790983 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff32001aa80 con 0x55b2a0bc77d0 2024-08-19T00:23:54.126 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.114+0000 7ff311ffb640 1 -- 172.21.15.44:0/3004790983 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff320012ae0 con 0x55b2a0bc77d0 2024-08-19T00:23:54.127 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.114+0000 7ff32bfff640 1 --2- 172.21.15.44:0/2220293965 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7ff3140a2e20 0x7ff3140a52e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff3240984b0 tx=0x7ff3240976c0 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:23:54.127 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.115+0000 7ff334c1f740 1 -- 172.21.15.44:0/3004790983 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2a0bc77d0 msgr2=0x55b2a0bc7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:54.127 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.115+0000 7ff334c1f740 1 --2- 172.21.15.44:0/3004790983 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2a0bc77d0 0x55b2a0bc7bb0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7ff32000bd40 tx=0x7ff320011750 comp rx=0 tx=0).stop 2024-08-19T00:23:54.127 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.115+0000 7ff334c1f740 1 -- 172.21.15.44:0/3004790983 shutdown_connections 2024-08-19T00:23:54.127 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.115+0000 7ff334c1f740 1 --2- 172.21.15.44:0/3004790983 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b2a0bc80f0 0x55b2a0bd2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.127 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.115+0000 7ff334c1f740 1 --2- 172.21.15.44:0/3004790983 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b2a0bd2990 0x55b2a0bd4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.127 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.115+0000 7ff334c1f740 1 --2- 172.21.15.44:0/3004790983 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2a0bc77d0 0x55b2a0bc7bb0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.127 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.115+0000 7ff334c1f740 1 -- 172.21.15.44:0/3004790983 >> 172.21.15.44:0/3004790983 conn(0x55b2a0bc3d40 msgr2=0x55b2a0bc4120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:23:54.127 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.115+0000 7ff334c1f740 1 -- 172.21.15.44:0/3004790983 shutdown_connections 2024-08-19T00:23:54.128 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.115+0000 7ff334c1f740 1 -- 172.21.15.44:0/3004790983 wait complete. 2024-08-19T00:23:54.128 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.115+0000 7ff334c1f740 1 -- start start 2024-08-19T00:23:54.128 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.116+0000 7ff334c1f740 1 Processor -- start 2024-08-19T00:23:54.128 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.116+0000 7ff334c1f740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b2a0bc77d0 0x55b2a0bcf820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:54.128 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.116+0000 7ff334c1f740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b2a0bc80f0 0x55b2a0bcfd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:54.128 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.116+0000 7ff334c1f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2a0bd2990 0x55b2a0bd02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:54.128 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.116+0000 7ff334c1f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b2a0bd5560 con 0x55b2a0bd2990 2024-08-19T00:23:54.128 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.116+0000 7ff334c1f740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55b2a0ae7520 con 0x55b2a0bc77d0 2024-08-19T00:23:54.128 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.116+0000 7ff334c1f740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55b2a0bd56e0 con 0x55b2a0bc80f0 2024-08-19T00:23:54.128 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.116+0000 7ff334c1f740 10 client.0 _ll_register_callbacks cb 0x55b2a083ea00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:23:54.129 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.116+0000 7ff32affd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2a0bd2990 0x55b2a0bd02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:54.129 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.116+0000 7ff32affd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2a0bd2990 0x55b2a0bd02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49004/0 (socket says 172.21.15.44:49004) 2024-08-19T00:23:54.129 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.116+0000 7ff32affd640 1 -- 172.21.15.44:0/654582392 learned_addr learned my addr 172.21.15.44:0/654582392 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:23:54.129 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.116+0000 7ff32b7fe640 1 --2- 172.21.15.44:0/654582392 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b2a0bc80f0 0x55b2a0bcfd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:54.129 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.116+0000 7ff32affd640 1 --2- 172.21.15.44:0/654582392 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b2a0bc77d0 0x55b2a0bcf820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:54.129 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.117+0000 7ff32affd640 1 -- 172.21.15.44:0/654582392 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b2a0bc80f0 msgr2=0x55b2a0bcfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:23:54.129 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.117+0000 7ff32affd640 1 --2- 172.21.15.44:0/654582392 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b2a0bc80f0 0x55b2a0bcfd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.129 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.117+0000 7ff32affd640 1 -- 172.21.15.44:0/654582392 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b2a0bc77d0 msgr2=0x55b2a0bcf820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:23:54.129 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.117+0000 7ff32affd640 1 --2- 172.21.15.44:0/654582392 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b2a0bc77d0 0x55b2a0bcf820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.129 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.117+0000 7ff32affd640 1 -- 172.21.15.44:0/654582392 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2a090b620 con 0x55b2a0bd2990 2024-08-19T00:23:54.130 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.117+0000 7ff32b7fe640 1 --2- 172.21.15.44:0/654582392 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b2a0bc80f0 0x55b2a0bcfd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:23:54.130 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.117+0000 7ff32affd640 1 --2- 172.21.15.44:0/654582392 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2a0bd2990 0x55b2a0bd02a0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7ff320012740 tx=0x7ff320005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65480eaca658337f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:23:54.130 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.117+0000 7ff30affd640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:23:54.130 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.117+0000 7ff30affd640 1 -- 172.21.15.44:0/654582392 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff32001a810 con 0x55b2a0bd2990 2024-08-19T00:23:54.130 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.117+0000 7ff30affd640 1 -- 172.21.15.44:0/654582392 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9533+0+0 (secure 0 0 0) 0x7ff320012880 con 0x55b2a0bd2990 2024-08-19T00:23:54.130 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.117+0000 7ff334c1f740 1 -- 172.21.15.44:0/654582392 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff32001aa80 con 0x55b2a0bd2990 2024-08-19T00:23:54.130 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.117+0000 7ff30affd640 1 -- 172.21.15.44:0/654582392 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7ff320012a80 con 0x55b2a0bd2990 2024-08-19T00:23:54.130 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.117+0000 7ff334c1f740 10 client.16812 fetch_fsmap learned FSMap version 33 2024-08-19T00:23:54.130 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.117+0000 7ff334c1f740 1 -- 172.21.15.44:0/654582392 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55b2a0be11a0 con 0x55b2a0bd2990 2024-08-19T00:23:54.130 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.117+0000 7ff30affd640 1 -- 172.21.15.44:0/654582392 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff32001aa80 con 0x55b2a0bd2990 2024-08-19T00:23:54.131 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.118+0000 7ff30affd640 1 -- 172.21.15.44:0/654582392 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7ff320029c00 con 0x55b2a0bd2990 2024-08-19T00:23:54.131 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.118+0000 7ff334c1f740 10 client.16812 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:23:54.131 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.118+0000 7ff334c1f740 10 client.16812 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:23:54.131 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.118+0000 7ff334c1f740 20 client.16812 populate_metadata read hostname 'smithi044' 2024-08-19T00:23:54.131 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.118+0000 7ff334c1f740 1 --2- 172.21.15.44:0/654582392 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55b2a0be2550 0x55b2a0be4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:54.131 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.118+0000 7ff334c1f740 4 client.16812 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:23:54.131 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.118+0000 7ff334c1f740 1 -- 172.21.15.44:0/654582392 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b2a0b39100 con 0x55b2a0be2550 2024-08-19T00:23:54.131 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.118+0000 7ff32b7fe640 1 --2- 172.21.15.44:0/654582392 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55b2a0be2550 0x55b2a0be4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:54.131 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.119+0000 7ff32b7fe640 1 --2- 172.21.15.44:0/654582392 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55b2a0be2550 0x55b2a0be4940 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5de365ad80c4938e server_cookie=2aa7b5d22685b3c1 in_seq=0 out_seq=0 2024-08-19T00:23:54.131 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.119+0000 7ff30affd640 10 client.16812 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:23:54.131 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.119+0000 7ff30affd640 1 -- 172.21.15.44:0/654582392 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b2a0b39100 con 0x55b2a0be2550 2024-08-19T00:23:54.131 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.119+0000 7ff30affd640 10 client.16812 handle_command_reply: tid=0 2024-08-19T00:23:54.131 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.119+0000 7ff334c1f740 1 client.16812 shutdown 2024-08-19T00:23:54.132 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.119+0000 7ff334c1f740 1 -- 172.21.15.44:0/654582392 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2a0bd2990 msgr2=0x55b2a0bd02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:54.132 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.119+0000 7ff334c1f740 1 --2- 172.21.15.44:0/654582392 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2a0bd2990 0x55b2a0bd02a0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7ff320012740 tx=0x7ff320005c90 comp rx=0 tx=0).stop 2024-08-19T00:23:54.132 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.119+0000 7ff334c1f740 1 -- 172.21.15.44:0/654582392 shutdown_connections 2024-08-19T00:23:54.132 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.119+0000 7ff334c1f740 1 --2- 172.21.15.44:0/654582392 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55b2a0be2550 0x55b2a0be4940 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.132 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.120+0000 7ff334c1f740 1 --2- 172.21.15.44:0/654582392 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b2a0bc80f0 0x55b2a0bcfd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.132 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.120+0000 7ff334c1f740 1 --2- 172.21.15.44:0/654582392 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2a0bd2990 0x55b2a0bd02a0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.133 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.120+0000 7ff30affd640 0 client.16812 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:23:54.133 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.120+0000 7ff334c1f740 1 --2- 172.21.15.44:0/654582392 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b2a0bc77d0 0x55b2a0bcf820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.133 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.120+0000 7ff334c1f740 1 -- 172.21.15.44:0/654582392 >> 172.21.15.44:0/654582392 conn(0x55b2a0bc3d40 msgr2=0x55b2a0bc9a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:23:54.133 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.120+0000 7ff334c1f740 1 -- 172.21.15.44:0/654582392 shutdown_connections 2024-08-19T00:23:54.133 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.120+0000 7ff334c1f740 1 -- 172.21.15.44:0/654582392 wait complete. 2024-08-19T00:23:54.133 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.120+0000 7ff334c1f740 20 client.16812 trim_cache size 0 max 16384 2024-08-19T00:23:54.157 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.136+0000 7ff334c1f740 1 Processor -- start 2024-08-19T00:23:54.157 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.136+0000 7ff334c1f740 1 -- start start 2024-08-19T00:23:54.157 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.136+0000 7ff334c1f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2a0bc77d0 0x55b2a0bbec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:54.157 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.136+0000 7ff334c1f740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b2a0bc80f0 0x55b2a0bea080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:54.157 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.136+0000 7ff334c1f740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b2a0bd2990 0x55b2a0bea5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:54.157 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.136+0000 7ff334c1f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c1aee50 con 0x55b2a0bc77d0 2024-08-19T00:23:54.157 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.136+0000 7ff334c1f740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c1b0990 con 0x55b2a0bc80f0 2024-08-19T00:23:54.157 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.136+0000 7ff334c1f740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c1af520 con 0x55b2a0bd2990 2024-08-19T00:23:54.157 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.136+0000 7ff32affd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2a0bc77d0 0x55b2a0bbec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:54.157 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.136+0000 7ff32affd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2a0bc77d0 0x55b2a0bbec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49016/0 (socket says 172.21.15.44:49016) 2024-08-19T00:23:54.158 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.136+0000 7ff32affd640 1 -- 172.21.15.44:0/880269958 learned_addr learned my addr 172.21.15.44:0/880269958 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:23:54.158 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.137+0000 7ff32b7fe640 1 --2- 172.21.15.44:0/880269958 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b2a0bc80f0 0x55b2a0bea080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:54.158 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.137+0000 7ff32affd640 1 -- 172.21.15.44:0/880269958 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b2a0bd2990 msgr2=0x55b2a0bea5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:23:54.158 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.137+0000 7ff32affd640 1 --2- 172.21.15.44:0/880269958 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b2a0bd2990 0x55b2a0bea5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.158 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.137+0000 7ff32affd640 1 -- 172.21.15.44:0/880269958 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b2a0bc80f0 msgr2=0x55b2a0bea080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:23:54.158 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.137+0000 7ff32affd640 1 --2- 172.21.15.44:0/880269958 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b2a0bc80f0 0x55b2a0bea080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.158 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.137+0000 7ff32affd640 1 -- 172.21.15.44:0/880269958 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2a0bc3b70 con 0x55b2a0bc77d0 2024-08-19T00:23:54.158 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.137+0000 7ff32b7fe640 1 --2- 172.21.15.44:0/880269958 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b2a0bc80f0 0x55b2a0bea080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:23:54.158 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.137+0000 7ff32affd640 1 --2- 172.21.15.44:0/880269958 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2a0bc77d0 0x55b2a0bbec10 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7ff32002c580 tx=0x7ff32000ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf13ae656df1bebd server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:23:54.158 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.137+0000 7ff3117fa640 1 -- 172.21.15.44:0/880269958 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff32003a070 con 0x55b2a0bc77d0 2024-08-19T00:23:54.158 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.137+0000 7ff3117fa640 1 -- 172.21.15.44:0/880269958 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff320011c50 con 0x55b2a0bc77d0 2024-08-19T00:23:54.159 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.137+0000 7ff3117fa640 1 -- 172.21.15.44:0/880269958 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff32001a870 con 0x55b2a0bc77d0 2024-08-19T00:23:54.159 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.138+0000 7ff334c1f740 1 -- 172.21.15.44:0/880269958 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2a0bc77d0 msgr2=0x55b2a0bbec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:54.159 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.138+0000 7ff334c1f740 1 --2- 172.21.15.44:0/880269958 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2a0bc77d0 0x55b2a0bbec10 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7ff32002c580 tx=0x7ff32000ba70 comp rx=0 tx=0).stop 2024-08-19T00:23:54.159 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.138+0000 7ff334c1f740 1 -- 172.21.15.44:0/880269958 shutdown_connections 2024-08-19T00:23:54.159 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.138+0000 7ff334c1f740 1 --2- 172.21.15.44:0/880269958 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b2a0bd2990 0x55b2a0bea5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.159 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.138+0000 7ff334c1f740 1 --2- 172.21.15.44:0/880269958 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b2a0bc80f0 0x55b2a0bea080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.159 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.138+0000 7ff334c1f740 1 --2- 172.21.15.44:0/880269958 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2a0bc77d0 0x55b2a0bbec10 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.159 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.138+0000 7ff334c1f740 1 -- 172.21.15.44:0/880269958 >> 172.21.15.44:0/880269958 conn(0x55b2a0bc3d40 msgr2=0x55b2a0bc2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:23:54.159 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.138+0000 7ff334c1f740 1 -- 172.21.15.44:0/880269958 shutdown_connections 2024-08-19T00:23:54.159 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.138+0000 7ff334c1f740 1 -- 172.21.15.44:0/880269958 wait complete. 2024-08-19T00:23:54.159 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.138+0000 7ff334c1f740 1 -- start start 2024-08-19T00:23:54.160 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.139+0000 7ff334c1f740 1 Processor -- start 2024-08-19T00:23:54.160 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.139+0000 7ff334c1f740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b2a0bc77d0 0x55b2a0bdab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:54.160 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.139+0000 7ff334c1f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2a0bc80f0 0x55b2a0bdb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:54.160 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.139+0000 7ff334c1f740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b2a0bd2990 0x55b2a0bcc050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:54.160 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.139+0000 7ff334c1f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c1b02c0 con 0x55b2a0bc80f0 2024-08-19T00:23:54.160 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.139+0000 7ff334c1f740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c1afbf0 con 0x55b2a0bd2990 2024-08-19T00:23:54.160 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.139+0000 7ff334c1f740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c1ace50 con 0x55b2a0bc77d0 2024-08-19T00:23:54.160 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.139+0000 7ff334c1f740 10 client.0 _ll_register_callbacks cb 0x7ff32000bc10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:23:54.160 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.139+0000 7ff32b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2a0bc80f0 0x55b2a0bdb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:54.160 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.139+0000 7ff32b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2a0bc80f0 0x55b2a0bdb0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49030/0 (socket says 172.21.15.44:49030) 2024-08-19T00:23:54.160 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.139+0000 7ff32b7fe640 1 -- 172.21.15.44:0/2075290403 learned_addr learned my addr 172.21.15.44:0/2075290403 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:23:54.160 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.139+0000 7ff32affd640 1 --2- 172.21.15.44:0/2075290403 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b2a0bc77d0 0x55b2a0bdab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:54.160 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.139+0000 7ff32b7fe640 1 -- 172.21.15.44:0/2075290403 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b2a0bc77d0 msgr2=0x55b2a0bdab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:23:54.160 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.139+0000 7ff32b7fe640 1 --2- 172.21.15.44:0/2075290403 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b2a0bc77d0 0x55b2a0bdab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.161 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.139+0000 7ff32b7fe640 1 -- 172.21.15.44:0/2075290403 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b2a0bd2990 msgr2=0x55b2a0bcc050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:23:54.161 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.139+0000 7ff32b7fe640 1 --2- 172.21.15.44:0/2075290403 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b2a0bd2990 0x55b2a0bcc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.161 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.139+0000 7ff32b7fe640 1 -- 172.21.15.44:0/2075290403 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2a0bcc790 con 0x55b2a0bc80f0 2024-08-19T00:23:54.161 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.139+0000 7ff32affd640 1 --2- 172.21.15.44:0/2075290403 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b2a0bc77d0 0x55b2a0bdab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:23:54.161 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.139+0000 7ff32b7fe640 1 --2- 172.21.15.44:0/2075290403 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2a0bc80f0 0x55b2a0bdb0d0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7ff31c009230 tx=0x7ff31c031960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26eaa97c54901d0f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:23:54.161 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.139+0000 7ff30affd640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:23:54.161 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.140+0000 7ff30affd640 1 -- 172.21.15.44:0/2075290403 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff31c049070 con 0x55b2a0bc80f0 2024-08-19T00:23:54.161 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.140+0000 7ff30affd640 1 -- 172.21.15.44:0/2075290403 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9533+0+0 (secure 0 0 0) 0x7ff31c004450 con 0x55b2a0bc80f0 2024-08-19T00:23:54.161 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.140+0000 7ff334c1f740 1 -- 172.21.15.44:0/2075290403 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff320011c50 con 0x55b2a0bc80f0 2024-08-19T00:23:54.161 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.140+0000 7ff30affd640 1 -- 172.21.15.44:0/2075290403 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7ff31c035040 con 0x55b2a0bc80f0 2024-08-19T00:23:54.162 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.140+0000 7ff334c1f740 10 client.16818 fetch_fsmap learned FSMap version 33 2024-08-19T00:23:54.162 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.140+0000 7ff334c1f740 1 -- 172.21.15.44:0/2075290403 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55b2a0c4caf0 con 0x55b2a0bc80f0 2024-08-19T00:23:54.162 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.140+0000 7ff30affd640 1 -- 172.21.15.44:0/2075290403 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff320011c50 con 0x55b2a0bc80f0 2024-08-19T00:23:54.162 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.140+0000 7ff30affd640 1 -- 172.21.15.44:0/2075290403 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7ff31c03c6e0 con 0x55b2a0bc80f0 2024-08-19T00:23:54.162 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.140+0000 7ff334c1f740 10 client.16818 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:23:54.163 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.140+0000 7ff334c1f740 10 client.16818 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:23:54.163 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.140+0000 7ff334c1f740 20 client.16818 populate_metadata read hostname 'smithi044' 2024-08-19T00:23:54.163 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.140+0000 7ff334c1f740 1 --2- 172.21.15.44:0/2075290403 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55b2a0c4d250 0x55b2a0c4f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:54.163 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.140+0000 7ff334c1f740 4 client.16818 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-19T00:23:54.163 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.140+0000 7ff334c1f740 1 -- 172.21.15.44:0/2075290403 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b2a0b33450 con 0x55b2a0c4d250 2024-08-19T00:23:54.163 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.141+0000 7ff32affd640 1 --2- 172.21.15.44:0/2075290403 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55b2a0c4d250 0x55b2a0c4f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:54.163 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.141+0000 7ff32affd640 1 --2- 172.21.15.44:0/2075290403 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55b2a0c4d250 0x55b2a0c4f670 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=524fe23e2bde7af3 server_cookie=9062e19456069213 in_seq=0 out_seq=0 2024-08-19T00:23:54.163 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.141+0000 7ff30affd640 10 client.16818 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:23:54.163 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.152+0000 7ff30affd640 1 -- 172.21.15.44:0/2075290403 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b2a0b33450 con 0x55b2a0c4d250 2024-08-19T00:23:54.163 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.152+0000 7ff30affd640 10 client.16818 handle_command_reply: tid=0 2024-08-19T00:23:54.163 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.152+0000 7ff334c1f740 1 client.16818 shutdown 2024-08-19T00:23:54.163 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.152+0000 7ff334c1f740 1 -- 172.21.15.44:0/2075290403 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2a0bc80f0 msgr2=0x55b2a0bdb0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:54.163 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.152+0000 7ff334c1f740 1 --2- 172.21.15.44:0/2075290403 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2a0bc80f0 0x55b2a0bdb0d0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7ff31c009230 tx=0x7ff31c031960 comp rx=0 tx=0).stop 2024-08-19T00:23:54.164 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.152+0000 7ff334c1f740 1 -- 172.21.15.44:0/2075290403 shutdown_connections 2024-08-19T00:23:54.164 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.152+0000 7ff334c1f740 1 --2- 172.21.15.44:0/2075290403 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55b2a0c4d250 0x55b2a0c4f670 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.164 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.152+0000 7ff334c1f740 1 --2- 172.21.15.44:0/2075290403 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b2a0bd2990 0x55b2a0bcc050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.164 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.152+0000 7ff334c1f740 1 --2- 172.21.15.44:0/2075290403 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b2a0bc80f0 0x55b2a0bdb0d0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.164 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.152+0000 7ff30affd640 0 client.16818 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:23:54.164 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.152+0000 7ff334c1f740 1 --2- 172.21.15.44:0/2075290403 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b2a0bc77d0 0x55b2a0bdab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.164 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.152+0000 7ff334c1f740 1 -- 172.21.15.44:0/2075290403 >> 172.21.15.44:0/2075290403 conn(0x55b2a0bc3d40 msgr2=0x55b2a0bcf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:23:54.164 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.152+0000 7ff334c1f740 1 -- 172.21.15.44:0/2075290403 shutdown_connections 2024-08-19T00:23:54.165 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.152+0000 7ff334c1f740 1 -- 172.21.15.44:0/2075290403 wait complete. 2024-08-19T00:23:54.165 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.152+0000 7ff334c1f740 20 client.16818 trim_cache size 0 max 16384 2024-08-19T00:23:54.165 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:{ 2024-08-19T00:23:54.165 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "message": "", 2024-08-19T00:23:54.165 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout: "return_code": 0 2024-08-19T00:23:54.165 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stdout:} 2024-08-19T00:23:54.166 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.153+0000 7ff331e63640 1 -- 172.21.15.44:0/2220293965 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7ff3140a2e20 msgr2=0x7ff3140a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:54.166 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.153+0000 7ff331e63640 1 --2- 172.21.15.44:0/2220293965 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7ff3140a2e20 0x7ff3140a52e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff3240984b0 tx=0x7ff3240976c0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.167 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.153+0000 7ff331e63640 1 -- 172.21.15.44:0/2220293965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff32c1066f0 msgr2=0x7ff32c19c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:54.167 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.153+0000 7ff331e63640 1 --2- 172.21.15.44:0/2220293965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff32c1066f0 0x7ff32c19c9e0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7ff32400ca30 tx=0x7ff32400cef0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.167 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.153+0000 7ff331e63640 1 -- 172.21.15.44:0/2220293965 shutdown_connections 2024-08-19T00:23:54.167 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.153+0000 7ff331e63640 1 --2- 172.21.15.44:0/2220293965 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7ff3140a2e20 0x7ff3140a52e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.167 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.153+0000 7ff331e63640 1 --2- 172.21.15.44:0/2220293965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff32c1066f0 0x7ff32c19c9e0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.167 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.153+0000 7ff331e63640 1 --2- 172.21.15.44:0/2220293965 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff32c101080 0x7ff32c198660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.168 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.153+0000 7ff331e63640 1 --2- 172.21.15.44:0/2220293965 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff32c1006e0 0x7ff32c198120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.168 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.153+0000 7ff331e63640 1 -- 172.21.15.44:0/2220293965 >> 172.21.15.44:0/2220293965 conn(0x7ff32c0776c0 msgr2=0x7ff32c069710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:23:54.168 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.153+0000 7ff331e63640 1 -- 172.21.15.44:0/2220293965 shutdown_connections 2024-08-19T00:23:54.168 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:23:54.153+0000 7ff331e63640 1 -- 172.21.15.44:0/2220293965 wait complete. 2024-08-19T00:23:54.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:23:53 smithi171 ceph-mon[21810]: pgmap v328: 129 pgs: 129 active+clean; 529 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 136 KiB/s wr, 27 op/s 2024-08-19T00:23:54.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:23:53 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/1223977163' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:23:54.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:23:53 smithi116 ceph-mon[21873]: pgmap v328: 129 pgs: 129 active+clean; 529 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 136 KiB/s wr, 27 op/s 2024-08-19T00:23:54.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:23:53 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/1223977163' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:23:54.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:23:53 smithi044 ceph-mon[18489]: pgmap v328: 129 pgs: 129 active+clean; 529 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 136 KiB/s wr, 27 op/s 2024-08-19T00:23:54.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:23:53 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/1223977163' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:23:54.401 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:23:54.696 INFO:tasks.workunit.client.0.smithi044.stdout: 1 777592 7.55 MB/sec execute 439 sec latency 21303.409 ms 2024-08-19T00:23:54.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.889+0000 7f8d3a705640 1 -- 172.21.15.44:0/436207404 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8d34108030 msgr2=0x7f8d3410e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:54.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.889+0000 7f8d3a705640 1 --2- 172.21.15.44:0/436207404 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8d34108030 0x7f8d3410e9a0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c009cd0 tx=0x7f8d2c02a8d0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.889+0000 7f8d3a705640 1 -- 172.21.15.44:0/436207404 shutdown_connections 2024-08-19T00:23:54.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.889+0000 7f8d3a705640 1 --2- 172.21.15.44:0/436207404 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8d34108030 0x7f8d3410e9a0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.889+0000 7f8d3a705640 1 --2- 172.21.15.44:0/436207404 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8d341034b0 0x7f8d341078f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.889+0000 7f8d3a705640 1 --2- 172.21.15.44:0/436207404 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d34102b00 0x7f8d34102ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.889+0000 7f8d3a705640 1 -- 172.21.15.44:0/436207404 >> 172.21.15.44:0/436207404 conn(0x7f8d340fc500 msgr2=0x7f8d340fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:23:54.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.889+0000 7f8d3a705640 1 -- 172.21.15.44:0/436207404 shutdown_connections 2024-08-19T00:23:54.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.889+0000 7f8d3a705640 1 -- 172.21.15.44:0/436207404 wait complete. 2024-08-19T00:23:54.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.889+0000 7f8d3a705640 1 Processor -- start 2024-08-19T00:23:54.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.890+0000 7f8d3a705640 1 -- start start 2024-08-19T00:23:54.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.890+0000 7f8d3a705640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8d34102b00 0x7f8d341982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:54.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.890+0000 7f8d3a705640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d341034b0 0x7f8d341987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:54.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.890+0000 7f8d3a705640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8d34108030 0x7f8d3419cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:54.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.890+0000 7f8d3a705640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8d34111e00 con 0x7f8d34108030 2024-08-19T00:23:54.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.890+0000 7f8d3a705640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f8d34111c80 con 0x7f8d34102b00 2024-08-19T00:23:54.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.890+0000 7f8d3a705640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8d34111f80 con 0x7f8d341034b0 2024-08-19T00:23:54.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.890+0000 7f8d38ca2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8d34108030 0x7f8d3419cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:54.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.890+0000 7f8d2bfff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d341034b0 0x7f8d341987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:54.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.890+0000 7f8d33fff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8d34102b00 0x7f8d341982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:54.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.890+0000 7f8d2bfff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d341034b0 0x7f8d341987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.44:40660/0 (socket says 172.21.15.44:40660) 2024-08-19T00:23:54.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.890+0000 7f8d2bfff640 1 -- 172.21.15.44:0/1667441728 learned_addr learned my addr 172.21.15.44:0/1667441728 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:23:54.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.890+0000 7f8d2bfff640 1 -- 172.21.15.44:0/1667441728 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8d34102b00 msgr2=0x7f8d341982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:54.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.890+0000 7f8d2bfff640 1 --2- 172.21.15.44:0/1667441728 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8d34102b00 0x7f8d341982a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.890+0000 7f8d2bfff640 1 -- 172.21.15.44:0/1667441728 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8d34108030 msgr2=0x7f8d3419cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:54.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.890+0000 7f8d2bfff640 1 --2- 172.21.15.44:0/1667441728 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8d34108030 0x7f8d3419cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.890+0000 7f8d2bfff640 1 -- 172.21.15.44:0/1667441728 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d3419d250 con 0x7f8d341034b0 2024-08-19T00:23:54.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.890+0000 7f8d38ca2640 1 --2- 172.21.15.44:0/1667441728 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8d34108030 0x7f8d3419cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:23:54.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.891+0000 7f8d2bfff640 1 --2- 172.21.15.44:0/1667441728 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d341034b0 0x7f8d341987e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c00d950 tx=0x7f8d1c00de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:23:54.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.891+0000 7f8d31ffb640 1 -- 172.21.15.44:0/1667441728 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c017070 con 0x7f8d341034b0 2024-08-19T00:23:54.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.891+0000 7f8d3a705640 1 -- 172.21.15.44:0/1667441728 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d3419d540 con 0x7f8d341034b0 2024-08-19T00:23:54.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.891+0000 7f8d31ffb640 1 -- 172.21.15.44:0/1667441728 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d1c009c30 con 0x7f8d341034b0 2024-08-19T00:23:54.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.891+0000 7f8d31ffb640 1 -- 172.21.15.44:0/1667441728 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c0047a0 con 0x7f8d341034b0 2024-08-19T00:23:54.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.891+0000 7f8d3a705640 1 -- 172.21.15.44:0/1667441728 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d341a4e20 con 0x7f8d341034b0 2024-08-19T00:23:54.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.894+0000 7f8d31ffb640 1 -- 172.21.15.44:0/1667441728 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f8d1c004020 con 0x7f8d341034b0 2024-08-19T00:23:54.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.894+0000 7f8d3cb03740 1 Processor -- start 2024-08-19T00:23:54.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.894+0000 7f8d3cb03740 1 -- start start 2024-08-19T00:23:54.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.894+0000 7f8d3cb03740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55596495a990 0x55596495ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:54.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.894+0000 7f8d3cb03740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55596495b2b0 0x555964965630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:54.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.894+0000 7f8d3cb03740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555964965b70 0x555964967f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:54.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.894+0000 7f8d3cb03740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5559648c0c60 con 0x55596495a990 2024-08-19T00:23:54.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.894+0000 7f8d3cb03740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x555964858b90 con 0x555964965b70 2024-08-19T00:23:54.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.894+0000 7f8d3cb03740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5559648bcc20 con 0x55596495b2b0 2024-08-19T00:23:54.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.894+0000 7f8d38ca2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55596495a990 0x55596495ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:54.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.894+0000 7f8d38ca2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55596495a990 0x55596495ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49054/0 (socket says 172.21.15.44:49054) 2024-08-19T00:23:54.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.894+0000 7f8d38ca2640 1 -- 172.21.15.44:0/753601328 learned_addr learned my addr 172.21.15.44:0/753601328 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:23:54.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.894+0000 7f8d2bfff640 1 --2- 172.21.15.44:0/753601328 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555964965b70 0x555964967f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:54.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.894+0000 7f8d33fff640 1 --2- 172.21.15.44:0/753601328 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55596495b2b0 0x555964965630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:54.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.895+0000 7f8d38ca2640 1 -- 172.21.15.44:0/753601328 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55596495b2b0 msgr2=0x555964965630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:23:54.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.895+0000 7f8d38ca2640 1 --2- 172.21.15.44:0/753601328 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55596495b2b0 0x555964965630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.895+0000 7f8d38ca2640 1 -- 172.21.15.44:0/753601328 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555964965b70 msgr2=0x555964967f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:23:54.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.895+0000 7f8d38ca2640 1 --2- 172.21.15.44:0/753601328 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555964965b70 0x555964967f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.895+0000 7f8d38ca2640 1 -- 172.21.15.44:0/753601328 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559645d0580 con 0x55596495a990 2024-08-19T00:23:54.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.895+0000 7f8d31ffb640 1 --2- 172.21.15.44:0/1667441728 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f8d200a2cf0 0x7f8d200a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:54.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.895+0000 7f8d2bfff640 1 --2- 172.21.15.44:0/753601328 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555964965b70 0x555964967f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:23:54.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.895+0000 7f8d33fff640 1 --2- 172.21.15.44:0/1667441728 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f8d200a2cf0 0x7f8d200a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:54.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.895+0000 7f8d31ffb640 1 -- 172.21.15.44:0/1667441728 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9533+0+0 (secure 0 0 0) 0x7f8d1c0cf3d0 con 0x7f8d341034b0 2024-08-19T00:23:54.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.895+0000 7f8d38ca2640 1 --2- 172.21.15.44:0/753601328 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55596495a990 0x55596495ad70 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c02adf0 tx=0x7f8d2c009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e79d54ec75f35194 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:23:54.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.895+0000 7f8d2a7fc640 1 -- 172.21.15.44:0/753601328 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d2c031cb0 con 0x55596495a990 2024-08-19T00:23:54.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.895+0000 7f8d2a7fc640 1 -- 172.21.15.44:0/753601328 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d2c036030 con 0x55596495a990 2024-08-19T00:23:54.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.895+0000 7f8d2a7fc640 1 -- 172.21.15.44:0/753601328 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d2c004280 con 0x55596495a990 2024-08-19T00:23:54.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.896+0000 7f8d3cb03740 1 -- 172.21.15.44:0/753601328 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55596495a990 msgr2=0x55596495ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:54.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.896+0000 7f8d33fff640 1 --2- 172.21.15.44:0/1667441728 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f8d200a2cf0 0x7f8d200a51b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x555964957d80 tx=0x7f8d24005f90 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:23:54.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.896+0000 7f8d3cb03740 1 --2- 172.21.15.44:0/753601328 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55596495a990 0x55596495ad70 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c02adf0 tx=0x7f8d2c009800 comp rx=0 tx=0).stop 2024-08-19T00:23:54.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.896+0000 7f8d3cb03740 1 -- 172.21.15.44:0/753601328 shutdown_connections 2024-08-19T00:23:54.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.896+0000 7f8d3cb03740 1 --2- 172.21.15.44:0/753601328 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55596495b2b0 0x555964965630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.896+0000 7f8d3cb03740 1 --2- 172.21.15.44:0/753601328 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555964965b70 0x555964967f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.896+0000 7f8d3cb03740 1 --2- 172.21.15.44:0/753601328 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55596495a990 0x55596495ad70 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.896+0000 7f8d3cb03740 1 -- 172.21.15.44:0/753601328 >> 172.21.15.44:0/753601328 conn(0x555964956f20 msgr2=0x555964957300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:23:54.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.896+0000 7f8d3cb03740 1 -- 172.21.15.44:0/753601328 shutdown_connections 2024-08-19T00:23:54.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.896+0000 7f8d3cb03740 1 -- 172.21.15.44:0/753601328 wait complete. 2024-08-19T00:23:54.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.896+0000 7f8d3cb03740 1 -- start start 2024-08-19T00:23:54.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.896+0000 7f8d3cb03740 1 Processor -- start 2024-08-19T00:23:54.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.897+0000 7f8d3cb03740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55596495a990 0x555964962a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:54.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.897+0000 7f8d3cb03740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55596495b2b0 0x555964962f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:54.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.897+0000 7f8d3cb03740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555964965b70 0x555964963480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:54.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.897+0000 7f8d3cb03740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x555964968740 con 0x555964965b70 2024-08-19T00:23:54.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.897+0000 7f8d3cb03740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55596485e7c0 con 0x55596495b2b0 2024-08-19T00:23:54.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.897+0000 7f8d3cb03740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x5559649688c0 con 0x55596495a990 2024-08-19T00:23:54.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.897+0000 7f8d3cb03740 10 client.0 _ll_register_callbacks cb 0x555964867f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:23:54.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.897+0000 7f8d38ca2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555964965b70 0x555964963480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:54.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.897+0000 7f8d38ca2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555964965b70 0x555964963480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49062/0 (socket says 172.21.15.44:49062) 2024-08-19T00:23:54.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.897+0000 7f8d38ca2640 1 -- 172.21.15.44:0/917352894 learned_addr learned my addr 172.21.15.44:0/917352894 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:23:54.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.897+0000 7f8d33fff640 1 --2- 172.21.15.44:0/917352894 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55596495a990 0x555964962a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:54.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.897+0000 7f8d2bfff640 1 --2- 172.21.15.44:0/917352894 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55596495b2b0 0x555964962f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:54.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.897+0000 7f8d38ca2640 1 -- 172.21.15.44:0/917352894 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55596495a990 msgr2=0x555964962a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:23:54.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.897+0000 7f8d38ca2640 1 --2- 172.21.15.44:0/917352894 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55596495a990 0x555964962a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.897+0000 7f8d38ca2640 1 -- 172.21.15.44:0/917352894 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55596495b2b0 msgr2=0x555964962f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:23:54.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.897+0000 7f8d38ca2640 1 --2- 172.21.15.44:0/917352894 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55596495b2b0 0x555964962f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.897+0000 7f8d38ca2640 1 -- 172.21.15.44:0/917352894 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55596469a960 con 0x555964965b70 2024-08-19T00:23:54.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.897+0000 7f8d38ca2640 1 --2- 172.21.15.44:0/917352894 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555964965b70 0x555964963480 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c009bf0 tx=0x7f8d2c0099f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95a342e24c6da202 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:23:54.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.897+0000 7f8d137fe640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:23:54.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.897+0000 7f8d137fe640 1 -- 172.21.15.44:0/917352894 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d2c04a040 con 0x555964965b70 2024-08-19T00:23:54.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.898+0000 7f8d137fe640 1 -- 172.21.15.44:0/917352894 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9533+0+0 (secure 0 0 0) 0x7f8d2c031cb0 con 0x555964965b70 2024-08-19T00:23:54.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.898+0000 7f8d3cb03740 1 -- 172.21.15.44:0/917352894 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d2c036030 con 0x555964965b70 2024-08-19T00:23:54.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.898+0000 7f8d137fe640 1 -- 172.21.15.44:0/917352894 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f8d2c05e050 con 0x555964965b70 2024-08-19T00:23:54.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.898+0000 7f8d3cb03740 10 client.16830 fetch_fsmap learned FSMap version 33 2024-08-19T00:23:54.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.898+0000 7f8d3cb03740 1 -- 172.21.15.44:0/917352894 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x555964968740 con 0x555964965b70 2024-08-19T00:23:54.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.898+0000 7f8d137fe640 1 -- 172.21.15.44:0/917352894 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d2c036030 con 0x555964965b70 2024-08-19T00:23:54.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.898+0000 7f8d137fe640 1 -- 172.21.15.44:0/917352894 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f8d2c04d030 con 0x555964965b70 2024-08-19T00:23:54.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.898+0000 7f8d3cb03740 10 client.16830 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:23:54.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.898+0000 7f8d3cb03740 10 client.16830 resolve_mds: validated gid 24473 aka daemon mds.b 2024-08-19T00:23:54.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.898+0000 7f8d3cb03740 20 client.16830 populate_metadata read hostname 'smithi044' 2024-08-19T00:23:54.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.898+0000 7f8d3cb03740 1 --2- 172.21.15.44:0/917352894 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x555964975890 0x555964977c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:54.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.898+0000 7f8d3cb03740 4 client.16830 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:23:54.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.898+0000 7f8d3cb03740 1 -- 172.21.15.44:0/917352894 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5559648ce1d0 con 0x555964975890 2024-08-19T00:23:54.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.899+0000 7f8d33fff640 1 --2- 172.21.15.44:0/917352894 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x555964975890 0x555964977c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:54.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.899+0000 7f8d137fe640 10 client.16830 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:23:54.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.899+0000 7f8d33fff640 1 --2- 172.21.15.44:0/917352894 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x555964975890 0x555964977c80 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eddbca51ba13f62d server_cookie=1c7ed3e2a316c780 in_seq=0 out_seq=0 2024-08-19T00:23:54.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.900+0000 7f8d137fe640 1 -- 172.21.15.44:0/917352894 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5559648ce1d0 con 0x555964975890 2024-08-19T00:23:54.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.900+0000 7f8d137fe640 10 client.16830 handle_command_reply: tid=0 2024-08-19T00:23:54.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.900+0000 7f8d3cb03740 1 client.16830 shutdown 2024-08-19T00:23:54.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.900+0000 7f8d3cb03740 1 -- 172.21.15.44:0/917352894 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555964965b70 msgr2=0x555964963480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:54.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.900+0000 7f8d3cb03740 1 --2- 172.21.15.44:0/917352894 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555964965b70 0x555964963480 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c009bf0 tx=0x7f8d2c0099f0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.900+0000 7f8d3cb03740 1 -- 172.21.15.44:0/917352894 shutdown_connections 2024-08-19T00:23:54.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.900+0000 7f8d3cb03740 1 --2- 172.21.15.44:0/917352894 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x555964975890 0x555964977c80 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.900+0000 7f8d3cb03740 1 --2- 172.21.15.44:0/917352894 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555964965b70 0x555964963480 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.900+0000 7f8d3cb03740 1 --2- 172.21.15.44:0/917352894 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55596495b2b0 0x555964962f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.900+0000 7f8d137fe640 0 client.16830 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:23:54.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.900+0000 7f8d3cb03740 1 --2- 172.21.15.44:0/917352894 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55596495a990 0x555964962a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.900+0000 7f8d3cb03740 1 -- 172.21.15.44:0/917352894 >> 172.21.15.44:0/917352894 conn(0x555964956f20 msgr2=0x55596495cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:23:54.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.900+0000 7f8d3cb03740 1 -- 172.21.15.44:0/917352894 shutdown_connections 2024-08-19T00:23:54.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.900+0000 7f8d3cb03740 1 -- 172.21.15.44:0/917352894 wait complete. 2024-08-19T00:23:54.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.900+0000 7f8d3cb03740 20 client.16830 trim_cache size 0 max 16384 2024-08-19T00:23:54.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.918+0000 7f8d3cb03740 1 Processor -- start 2024-08-19T00:23:54.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.918+0000 7f8d3cb03740 1 -- start start 2024-08-19T00:23:54.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.918+0000 7f8d3cb03740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55596495a990 0x5559649632d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:54.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.918+0000 7f8d3cb03740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55596495b2b0 0x5559649619c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:54.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.918+0000 7f8d3cb03740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555964965b70 0x55596497d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:54.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.918+0000 7f8d3cb03740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8d341aedb0 con 0x555964965b70 2024-08-19T00:23:54.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.918+0000 7f8d3cb03740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f8d341b08f0 con 0x55596495a990 2024-08-19T00:23:54.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.918+0000 7f8d3cb03740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8d341af480 con 0x55596495b2b0 2024-08-19T00:23:54.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.918+0000 7f8d2bfff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55596495b2b0 0x5559649619c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:54.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.918+0000 7f8d2bfff640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55596495b2b0 0x5559649619c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.44:40686/0 (socket says 172.21.15.44:40686) 2024-08-19T00:23:54.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.918+0000 7f8d2bfff640 1 -- 172.21.15.44:0/1606701985 learned_addr learned my addr 172.21.15.44:0/1606701985 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:23:54.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.918+0000 7f8d38ca2640 1 --2- 172.21.15.44:0/1606701985 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555964965b70 0x55596497d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:54.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.918+0000 7f8d33fff640 1 --2- 172.21.15.44:0/1606701985 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55596495a990 0x5559649632d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:54.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.919+0000 7f8d2bfff640 1 -- 172.21.15.44:0/1606701985 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55596495a990 msgr2=0x5559649632d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:23:54.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.919+0000 7f8d2bfff640 1 --2- 172.21.15.44:0/1606701985 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55596495a990 0x5559649632d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.919+0000 7f8d2bfff640 1 -- 172.21.15.44:0/1606701985 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555964965b70 msgr2=0x55596497d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:23:54.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.919+0000 7f8d2bfff640 1 --2- 172.21.15.44:0/1606701985 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555964965b70 0x55596497d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.919+0000 7f8d2bfff640 1 -- 172.21.15.44:0/1606701985 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555964957fd0 con 0x55596495b2b0 2024-08-19T00:23:54.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.919+0000 7f8d2bfff640 1 --2- 172.21.15.44:0/1606701985 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55596495b2b0 0x5559649619c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c0ccd30 tx=0x7f8d1c00bf70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dfdb0c534ca3c0bf server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:23:54.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.919+0000 7f8d29ffb640 1 -- 172.21.15.44:0/1606701985 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c09b040 con 0x55596495b2b0 2024-08-19T00:23:54.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.919+0000 7f8d29ffb640 1 -- 172.21.15.44:0/1606701985 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d1c09bc00 con 0x55596495b2b0 2024-08-19T00:23:54.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.919+0000 7f8d29ffb640 1 -- 172.21.15.44:0/1606701985 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c09ae60 con 0x55596495b2b0 2024-08-19T00:23:54.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.920+0000 7f8d3cb03740 1 -- 172.21.15.44:0/1606701985 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55596495b2b0 msgr2=0x5559649619c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:54.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.920+0000 7f8d3cb03740 1 --2- 172.21.15.44:0/1606701985 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55596495b2b0 0x5559649619c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c0ccd30 tx=0x7f8d1c00bf70 comp rx=0 tx=0).stop 2024-08-19T00:23:54.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.920+0000 7f8d3cb03740 1 -- 172.21.15.44:0/1606701985 shutdown_connections 2024-08-19T00:23:54.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.920+0000 7f8d3cb03740 1 --2- 172.21.15.44:0/1606701985 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55596495b2b0 0x5559649619c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.920+0000 7f8d3cb03740 1 --2- 172.21.15.44:0/1606701985 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555964965b70 0x55596497d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.920+0000 7f8d3cb03740 1 --2- 172.21.15.44:0/1606701985 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55596495a990 0x5559649632d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.920+0000 7f8d3cb03740 1 -- 172.21.15.44:0/1606701985 >> 172.21.15.44:0/1606701985 conn(0x555964956f20 msgr2=0x555964964b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:23:54.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.920+0000 7f8d3cb03740 1 -- 172.21.15.44:0/1606701985 shutdown_connections 2024-08-19T00:23:54.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.920+0000 7f8d3cb03740 1 -- 172.21.15.44:0/1606701985 wait complete. 2024-08-19T00:23:54.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.920+0000 7f8d3cb03740 1 -- start start 2024-08-19T00:23:54.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.921+0000 7f8d3cb03740 1 Processor -- start 2024-08-19T00:23:54.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.921+0000 7f8d3cb03740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55596495a990 0x55596496e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:54.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.921+0000 7f8d3cb03740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55596495b2b0 0x55596495f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:54.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.921+0000 7f8d3cb03740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555964965b70 0x55596495fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:54.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.921+0000 7f8d3cb03740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8d341b0220 con 0x555964965b70 2024-08-19T00:23:54.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.921+0000 7f8d3cb03740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f8d341afb50 con 0x55596495b2b0 2024-08-19T00:23:54.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.921+0000 7f8d3cb03740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8d341acdb0 con 0x55596495a990 2024-08-19T00:23:54.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.921+0000 7f8d3cb03740 10 client.0 _ll_register_callbacks cb 0x7f8d2c02f2e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:23:54.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.921+0000 7f8d38ca2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555964965b70 0x55596495fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:54.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.921+0000 7f8d38ca2640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555964965b70 0x55596495fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49090/0 (socket says 172.21.15.44:49090) 2024-08-19T00:23:54.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.921+0000 7f8d38ca2640 1 -- 172.21.15.44:0/3679164787 learned_addr learned my addr 172.21.15.44:0/3679164787 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:23:54.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.921+0000 7f8d33fff640 1 --2- 172.21.15.44:0/3679164787 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55596495a990 0x55596496e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:54.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.921+0000 7f8d2bfff640 1 --2- 172.21.15.44:0/3679164787 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55596495b2b0 0x55596495f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:54.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.921+0000 7f8d38ca2640 1 -- 172.21.15.44:0/3679164787 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55596495a990 msgr2=0x55596496e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:23:54.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.921+0000 7f8d38ca2640 1 --2- 172.21.15.44:0/3679164787 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55596495a990 0x55596496e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.921+0000 7f8d38ca2640 1 -- 172.21.15.44:0/3679164787 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55596495b2b0 msgr2=0x55596495f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:23:54.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.921+0000 7f8d38ca2640 1 --2- 172.21.15.44:0/3679164787 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55596495b2b0 0x55596495f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.921+0000 7f8d38ca2640 1 -- 172.21.15.44:0/3679164787 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555964960190 con 0x555964965b70 2024-08-19T00:23:54.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.921+0000 7f8d33fff640 1 --2- 172.21.15.44:0/3679164787 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55596495a990 0x55596496e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:23:54.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.922+0000 7f8d38ca2640 1 --2- 172.21.15.44:0/3679164787 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555964965b70 0x55596495fb20 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c005e30 tx=0x7f8d2c009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87cf329b48cc48a7 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:23:54.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.922+0000 7f8d137fe640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:23:54.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.922+0000 7f8d137fe640 1 -- 172.21.15.44:0/3679164787 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d2c031420 con 0x555964965b70 2024-08-19T00:23:54.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.922+0000 7f8d137fe640 1 -- 172.21.15.44:0/3679164787 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9533+0+0 (secure 0 0 0) 0x7f8d2c0315c0 con 0x555964965b70 2024-08-19T00:23:54.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.922+0000 7f8d3cb03740 1 -- 172.21.15.44:0/3679164787 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d1c09bc00 con 0x555964965b70 2024-08-19T00:23:54.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.922+0000 7f8d137fe640 1 -- 172.21.15.44:0/3679164787 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f8d2c06b050 con 0x555964965b70 2024-08-19T00:23:54.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.922+0000 7f8d3cb03740 10 client.16836 fetch_fsmap learned FSMap version 33 2024-08-19T00:23:54.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.922+0000 7f8d3cb03740 1 -- 172.21.15.44:0/3679164787 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5559649e46d0 con 0x555964965b70 2024-08-19T00:23:54.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.922+0000 7f8d137fe640 1 -- 172.21.15.44:0/3679164787 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d1c09bc00 con 0x555964965b70 2024-08-19T00:23:54.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.923+0000 7f8d137fe640 1 -- 172.21.15.44:0/3679164787 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f8d2c04d040 con 0x555964965b70 2024-08-19T00:23:54.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.923+0000 7f8d3cb03740 10 client.16836 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:23:54.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.923+0000 7f8d3cb03740 10 client.16836 resolve_mds: validated gid 24473 aka daemon mds.b 2024-08-19T00:23:54.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.923+0000 7f8d3cb03740 20 client.16836 populate_metadata read hostname 'smithi044' 2024-08-19T00:23:54.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.923+0000 7f8d3cb03740 1 --2- 172.21.15.44:0/3679164787 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5559649e4d30 0x5559649e7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:23:54.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.923+0000 7f8d3cb03740 4 client.16836 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "dfe56178", "release": true, "await": true}] 2024-08-19T00:23:54.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.923+0000 7f8d3cb03740 1 -- 172.21.15.44:0/3679164787 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "quiesce db", "set_id": "dfe56178", "release": true, "await": true}) -- 0x5559648c86e0 con 0x5559649e4d30 2024-08-19T00:23:54.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.923+0000 7f8d33fff640 1 --2- 172.21.15.44:0/3679164787 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5559649e4d30 0x5559649e7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:23:54.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.923+0000 7f8d137fe640 10 client.16836 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:23:54.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.923+0000 7f8d33fff640 1 --2- 172.21.15.44:0/3679164787 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5559649e4d30 0x5559649e7120 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e055ec6d50d5d6c1 server_cookie=fb06f88821358496 in_seq=0 out_seq=0 2024-08-19T00:23:54.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.934+0000 7f8d137fe640 1 -- 172.21.15.44:0/3679164787 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5559648c86e0 con 0x5559649e4d30 2024-08-19T00:23:54.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.934+0000 7f8d137fe640 10 client.16836 handle_command_reply: tid=0 2024-08-19T00:23:54.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.934+0000 7f8d3cb03740 1 client.16836 shutdown 2024-08-19T00:23:54.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.934+0000 7f8d3cb03740 1 -- 172.21.15.44:0/3679164787 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555964965b70 msgr2=0x55596495fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:54.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.934+0000 7f8d3cb03740 1 --2- 172.21.15.44:0/3679164787 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555964965b70 0x55596495fb20 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c005e30 tx=0x7f8d2c009800 comp rx=0 tx=0).stop 2024-08-19T00:23:54.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.934+0000 7f8d3cb03740 1 -- 172.21.15.44:0/3679164787 shutdown_connections 2024-08-19T00:23:54.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.934+0000 7f8d3cb03740 1 --2- 172.21.15.44:0/3679164787 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x5559649e4d30 0x5559649e7120 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.934+0000 7f8d3cb03740 1 --2- 172.21.15.44:0/3679164787 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555964965b70 0x55596495fb20 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.934+0000 7f8d3cb03740 1 --2- 172.21.15.44:0/3679164787 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55596495b2b0 0x55596495f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.934+0000 7f8d3cb03740 1 --2- 172.21.15.44:0/3679164787 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55596495a990 0x55596496e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.934+0000 7f8d3cb03740 1 -- 172.21.15.44:0/3679164787 >> 172.21.15.44:0/3679164787 conn(0x555964956f20 msgr2=0x555964956080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:23:54.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.934+0000 7f8d137fe640 0 client.16836 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:23:54.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.934+0000 7f8d3cb03740 1 -- 172.21.15.44:0/3679164787 shutdown_connections 2024-08-19T00:23:54.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.934+0000 7f8d3cb03740 1 -- 172.21.15.44:0/3679164787 wait complete. 2024-08-19T00:23:54.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.934+0000 7f8d3cb03740 20 client.16836 trim_cache size 0 max 16384 2024-08-19T00:23:54.937 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-08-19T00:23:54.937 INFO:teuthology.orchestra.run.smithi044.stdout: "epoch": 33, 2024-08-19T00:23:54.937 INFO:teuthology.orchestra.run.smithi044.stdout: "leader": 24473, 2024-08-19T00:23:54.937 INFO:teuthology.orchestra.run.smithi044.stdout: "set_version": 36, 2024-08-19T00:23:54.937 INFO:teuthology.orchestra.run.smithi044.stdout: "sets": { 2024-08-19T00:23:54.937 INFO:teuthology.orchestra.run.smithi044.stdout: "dfe56178": { 2024-08-19T00:23:54.937 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 36, 2024-08-19T00:23:54.937 INFO:teuthology.orchestra.run.smithi044.stdout: "age_ref": 0.0, 2024-08-19T00:23:54.937 INFO:teuthology.orchestra.run.smithi044.stdout: "state": { 2024-08-19T00:23:54.938 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "RELEASED", 2024-08-19T00:23:54.938 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.0 2024-08-19T00:23:54.938 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:23:54.938 INFO:teuthology.orchestra.run.smithi044.stdout: "timeout": 90.0, 2024-08-19T00:23:54.938 INFO:teuthology.orchestra.run.smithi044.stdout: "expiration": 142.0, 2024-08-19T00:23:54.938 INFO:teuthology.orchestra.run.smithi044.stdout: "members": { 2024-08-19T00:23:54.938 INFO:teuthology.orchestra.run.smithi044.stdout: "file:/": { 2024-08-19T00:23:54.938 INFO:teuthology.orchestra.run.smithi044.stdout: "excluded": false, 2024-08-19T00:23:54.938 INFO:teuthology.orchestra.run.smithi044.stdout: "state": { 2024-08-19T00:23:54.938 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "RELEASED", 2024-08-19T00:23:54.938 INFO:teuthology.orchestra.run.smithi044.stdout: "age": 0.0 2024-08-19T00:23:54.938 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:23:54.938 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:23:54.938 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:23:54.939 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:23:54.939 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:23:54.939 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-08-19T00:23:54.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.935+0000 7f8d3a705640 1 -- 172.21.15.44:0/1667441728 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f8d200a2cf0 msgr2=0x7f8d200a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:54.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.935+0000 7f8d3a705640 1 --2- 172.21.15.44:0/1667441728 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f8d200a2cf0 0x7f8d200a51b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x555964957d80 tx=0x7f8d24005f90 comp rx=0 tx=0).stop 2024-08-19T00:23:54.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.935+0000 7f8d3a705640 1 -- 172.21.15.44:0/1667441728 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d341034b0 msgr2=0x7f8d341987e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:23:54.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.935+0000 7f8d3a705640 1 --2- 172.21.15.44:0/1667441728 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d341034b0 0x7f8d341987e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c00d950 tx=0x7f8d1c00de10 comp rx=0 tx=0).stop 2024-08-19T00:23:54.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.935+0000 7f8d3a705640 1 -- 172.21.15.44:0/1667441728 shutdown_connections 2024-08-19T00:23:54.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.935+0000 7f8d3a705640 1 --2- 172.21.15.44:0/1667441728 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f8d200a2cf0 0x7f8d200a51b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.935+0000 7f8d3a705640 1 --2- 172.21.15.44:0/1667441728 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d341034b0 0x7f8d341987e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.935+0000 7f8d3a705640 1 --2- 172.21.15.44:0/1667441728 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8d34108030 0x7f8d3419cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.935+0000 7f8d3a705640 1 --2- 172.21.15.44:0/1667441728 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8d34102b00 0x7f8d341982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:23:54.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.935+0000 7f8d3a705640 1 -- 172.21.15.44:0/1667441728 >> 172.21.15.44:0/1667441728 conn(0x7f8d340fc500 msgr2=0x7f8d341060e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:23:54.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.935+0000 7f8d3a705640 1 -- 172.21.15.44:0/1667441728 shutdown_connections 2024-08-19T00:23:54.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:23:54.935+0000 7f8d3a705640 1 -- 172.21.15.44:0/1667441728 wait complete. 2024-08-19T00:23:55.609 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'dfe56178', total seconds elapsed: 25.3 2024-08-19T00:23:55.696 INFO:tasks.workunit.client.0.smithi044.stdout: 1 778323 7.54 MB/sec execute 440 sec latency 21543.438 ms 2024-08-19T00:23:56.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:23:55 smithi171 ceph-mon[21810]: pgmap v329: 129 pgs: 129 active+clean; 537 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 891 KiB/s wr, 48 op/s 2024-08-19T00:23:56.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:23:55 smithi116 ceph-mon[21873]: pgmap v329: 129 pgs: 129 active+clean; 537 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 891 KiB/s wr, 48 op/s 2024-08-19T00:23:56.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:23:55 smithi044 ceph-mon[18489]: pgmap v329: 129 pgs: 129 active+clean; 537 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 891 KiB/s wr, 48 op/s 2024-08-19T00:23:56.696 INFO:tasks.workunit.client.0.smithi044.stdout: 1 780581 7.55 MB/sec execute 441 sec latency 17.225 ms 2024-08-19T00:23:57.696 INFO:tasks.workunit.client.0.smithi044.stdout: 1 781946 7.55 MB/sec execute 442 sec latency 25.748 ms 2024-08-19T00:23:58.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:23:57 smithi171 ceph-mon[21810]: pgmap v330: 129 pgs: 129 active+clean; 537 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 818 KiB/s wr, 29 op/s 2024-08-19T00:23:58.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:23:57 smithi116 ceph-mon[21873]: pgmap v330: 129 pgs: 129 active+clean; 537 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 818 KiB/s wr, 29 op/s 2024-08-19T00:23:58.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:23:57 smithi044 ceph-mon[18489]: pgmap v330: 129 pgs: 129 active+clean; 537 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 818 KiB/s wr, 29 op/s 2024-08-19T00:23:58.696 INFO:tasks.workunit.client.0.smithi044.stdout: 1 784488 7.56 MB/sec execute 443 sec latency 18.397 ms 2024-08-19T00:23:59.697 INFO:tasks.workunit.client.0.smithi044.stdout: 1 785471 7.56 MB/sec execute 444 sec latency 36.644 ms 2024-08-19T00:24:00.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:23:59 smithi171 ceph-mon[21810]: pgmap v331: 129 pgs: 129 active+clean; 537 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 818 KiB/s wr, 29 op/s 2024-08-19T00:24:00.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:23:59 smithi116 ceph-mon[21873]: pgmap v331: 129 pgs: 129 active+clean; 537 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 818 KiB/s wr, 29 op/s 2024-08-19T00:24:00.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:23:59 smithi044 ceph-mon[18489]: pgmap v331: 129 pgs: 129 active+clean; 537 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 818 KiB/s wr, 29 op/s 2024-08-19T00:24:00.696 INFO:tasks.workunit.client.0.smithi044.stdout: 1 786955 7.55 MB/sec execute 445 sec latency 55.980 ms 2024-08-19T00:24:01.696 INFO:tasks.workunit.client.0.smithi044.stdout: 1 788071 7.55 MB/sec execute 446 sec latency 66.886 ms 2024-08-19T00:24:02.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:01 smithi171 ceph-mon[21810]: pgmap v332: 129 pgs: 129 active+clean; 544 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.3 MiB/s wr, 112 op/s 2024-08-19T00:24:02.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:01 smithi116 ceph-mon[21873]: pgmap v332: 129 pgs: 129 active+clean; 544 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.3 MiB/s wr, 112 op/s 2024-08-19T00:24:02.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:01 smithi044 ceph-mon[18489]: pgmap v332: 129 pgs: 129 active+clean; 544 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.3 MiB/s wr, 112 op/s 2024-08-19T00:24:02.696 INFO:tasks.workunit.client.0.smithi044.stdout: 1 789302 7.55 MB/sec execute 447 sec latency 21.317 ms 2024-08-19T00:24:02.881 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T00:24:02.881 INFO:tasks.workunit.client.0.smithi044.stdout:[789754] write failed on handle 10469 (Resource temporarily unavailable) 2024-08-19T00:24:02.881 INFO:tasks.workunit.client.0.smithi044.stdout:Child failed with status 1 2024-08-19T00:24:02.881 INFO:tasks.workunit:Stopping ['suites/dbench.sh'] on client.0... 2024-08-19T00:24:02.882 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-08-19T00:24:03.186 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/workunit.py", line 293, in _spawn_on_all_clients with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test suites/dbench.sh) on smithi044 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=78215f5a1cf5eaf321d506a66539942e12851f34 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh' 2024-08-19T00:24:03.377 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=bbe1e76f69294bbc8f5fb27e04a84ea4 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/workunit.py", line 293, in _spawn_on_all_clients with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test suites/dbench.sh) on smithi044 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=78215f5a1cf5eaf321d506a66539942e12851f34 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh' 2024-08-19T00:24:03.380 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-08-19T00:24:03.390 INFO:tasks.quiescer:joining Quiescers 2024-08-19T00:24:03.390 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-08-19T00:24:03.391 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-19T00:24:03.648 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:24:04.118 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:03 smithi044 ceph-mon[18489]: pgmap v333: 129 pgs: 129 active+clean; 544 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.2 MiB/s wr, 103 op/s 2024-08-19T00:24:04.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:03 smithi171 ceph-mon[21810]: pgmap v333: 129 pgs: 129 active+clean; 544 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.2 MiB/s wr, 103 op/s 2024-08-19T00:24:04.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:04.356+0000 7f459fb01640 1 -- 172.21.15.44:0/1414457038 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4598100b60 msgr2=0x7f4598104bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:04.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:04.356+0000 7f459fb01640 1 --2- 172.21.15.44:0/1414457038 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4598100b60 0x7f4598104bb0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f4588009900 tx=0x7f458802a410 comp rx=0 tx=0).stop 2024-08-19T00:24:04.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:04.356+0000 7f459fb01640 1 -- 172.21.15.44:0/1414457038 shutdown_connections 2024-08-19T00:24:04.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:04.356+0000 7f459fb01640 1 --2- 172.21.15.44:0/1414457038 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f45981052e0 0x7f459810ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:04.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:04.356+0000 7f459fb01640 1 --2- 172.21.15.44:0/1414457038 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4598100b60 0x7f4598104bb0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:04.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:04.356+0000 7f459fb01640 1 --2- 172.21.15.44:0/1414457038 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f45981001b0 0x7f4598100590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:04.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:04.356+0000 7f459fb01640 1 -- 172.21.15.44:0/1414457038 >> 172.21.15.44:0/1414457038 conn(0x7f4598076f40 msgr2=0x7f45980fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:24:04.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:04.356+0000 7f459fb01640 1 -- 172.21.15.44:0/1414457038 shutdown_connections 2024-08-19T00:24:04.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:04.356+0000 7f459fb01640 1 -- 172.21.15.44:0/1414457038 wait complete. 2024-08-19T00:24:04.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:04.357+0000 7f459fb01640 1 Processor -- start 2024-08-19T00:24:04.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:04.357+0000 7f459fb01640 1 -- start start 2024-08-19T00:24:04.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:04.357+0000 7f459fb01640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f45981001b0 0x7f4598198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:04.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:04.357+0000 7f459fb01640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4598100b60 0x7f45981988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:04.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:04.357+0000 7f459fb01640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f45981052e0 0x7f459819cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:04.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:04.357+0000 7f459fb01640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f459810fba0 con 0x7f45981052e0 2024-08-19T00:24:04.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:04.357+0000 7f459fb01640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f459810fa20 con 0x7f45981001b0 2024-08-19T00:24:04.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:04.357+0000 7f459fb01640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f459810fd20 con 0x7f4598100b60 2024-08-19T00:24:04.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:04.357+0000 7f459e09e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f45981052e0 0x7f459819cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:04.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:04.357+0000 7f459e09e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f45981052e0 0x7f459819cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43510/0 (socket says 172.21.15.44:43510) 2024-08-19T00:24:04.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:04.357+0000 7f459e09e640 1 -- 172.21.15.44:0/2900279429 learned_addr learned my addr 172.21.15.44:0/2900279429 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:24:04.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:04.357+0000 7f459d09c640 1 --2- 172.21.15.44:0/2900279429 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4598100b60 0x7f45981988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:04.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:04.357+0000 7f459d89d640 1 --2- 172.21.15.44:0/2900279429 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f45981001b0 0x7f4598198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:04.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:04.358+0000 7f459e09e640 1 -- 172.21.15.44:0/2900279429 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4598100b60 msgr2=0x7f45981988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:04.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:04.358+0000 7f459e09e640 1 --2- 172.21.15.44:0/2900279429 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4598100b60 0x7f45981988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:04.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:04.358+0000 7f459e09e640 1 -- 172.21.15.44:0/2900279429 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f45981001b0 msgr2=0x7f4598198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:04.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:04.358+0000 7f459e09e640 1 --2- 172.21.15.44:0/2900279429 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f45981001b0 0x7f4598198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:04.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:04.358+0000 7f459e09e640 1 -- 172.21.15.44:0/2900279429 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f459819d330 con 0x7f45981052e0 2024-08-19T00:24:04.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:04.358+0000 7f459d89d640 1 --2- 172.21.15.44:0/2900279429 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f45981001b0 0x7f4598198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:24:04.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:04.358+0000 7f459e09e640 1 --2- 172.21.15.44:0/2900279429 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f45981052e0 0x7f459819cc50 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f459000b970 tx=0x7f459000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:24:04.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:04.358+0000 7f458effd640 1 -- 172.21.15.44:0/2900279429 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4590019070 con 0x7f45981052e0 2024-08-19T00:24:04.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:04.358+0000 7f458effd640 1 -- 172.21.15.44:0/2900279429 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f459000cb40 con 0x7f45981052e0 2024-08-19T00:24:04.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:04.358+0000 7f459fb01640 1 -- 172.21.15.44:0/2900279429 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f459819d620 con 0x7f45981052e0 2024-08-19T00:24:04.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:04.358+0000 7f458effd640 1 -- 172.21.15.44:0/2900279429 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4590007650 con 0x7f45981052e0 2024-08-19T00:24:04.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:04.358+0000 7f459fb01640 1 -- 172.21.15.44:0/2900279429 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45981a4f00 con 0x7f45981052e0 2024-08-19T00:24:04.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:04.359+0000 7f459fb01640 1 -- 172.21.15.44:0/2900279429 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4598100610 con 0x7f45981052e0 2024-08-19T00:24:04.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:04.360+0000 7f458effd640 1 -- 172.21.15.44:0/2900279429 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f459001c070 con 0x7f45981052e0 2024-08-19T00:24:04.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:04.361+0000 7f458effd640 1 --2- 172.21.15.44:0/2900279429 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f45840a2ce0 0x7f45840a51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:04.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:04.361+0000 7f458effd640 1 -- 172.21.15.44:0/2900279429 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9533+0+0 (secure 0 0 0) 0x7f45900cf850 con 0x7f45981052e0 2024-08-19T00:24:04.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:04.361+0000 7f459d89d640 1 --2- 172.21.15.44:0/2900279429 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f45840a2ce0 0x7f45840a51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:04.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:04.362+0000 7f459d89d640 1 --2- 172.21.15.44:0/2900279429 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f45840a2ce0 0x7f45840a51a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4594009930 tx=0x7f4594008040 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:24:04.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:03 smithi116 ceph-mon[21873]: pgmap v333: 129 pgs: 129 active+clean; 544 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.2 MiB/s wr, 103 op/s 2024-08-19T00:24:04.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:04.364+0000 7f458effd640 1 -- 172.21.15.44:0/2900279429 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f4590023030 con 0x7f45981052e0 2024-08-19T00:24:04.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:04.615+0000 7f459fb01640 1 -- 172.21.15.44:0/2900279429 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f459810a4d0 con 0x7f45981052e0 2024-08-19T00:24:04.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:04.615+0000 7f458effd640 1 -- 172.21.15.44:0/2900279429 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11989 (secure 0 0 0) 0x7f459009c190 con 0x7f45981052e0 2024-08-19T00:24:04.618 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:24:04.618 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":33,"btime":"2024-08-19T00:17:11:640526+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14511,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1538841896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1538841896},{"type":"v1","addr":"172.21.15.116:6833","nonce":1538841896}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/4044471606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4044471606},{"type":"v1","addr":"172.21.15.44:6835","nonce":4044471606}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":33,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-19T00:10:53.196636+0000","modified":"2024-08-19T00:17:11.586031+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24473,"mds_1":24446,"mds_2":24439,"mds_3":24431,"mds_4":24418},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14529":{"gid":14529,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6837/1824829052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1824829052},{"type":"v1","addr":"172.21.15.44:6837","nonce":1824829052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14577":{"gid":14577,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6839/3591739042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":3591739042},{"type":"v1","addr":"172.21.15.44:6839","nonce":3591739042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14589":{"gid":14589,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6841/3667695717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6840","nonce":3667695717},{"type":"v1","addr":"172.21.15.44:6841","nonce":3667695717}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24388":{"gid":24388,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1183022838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1183022838},{"type":"v1","addr":"172.21.15.171:6833","nonce":1183022838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6835/2190623851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":2190623851},{"type":"v1","addr":"172.21.15.171:6835","nonce":2190623851}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.171:6837/316231795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":316231795},{"type":"v1","addr":"172.21.15.171:6837","nonce":316231795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":20,"addr":"172.21.15.116:6835/3507399322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3507399322},{"type":"v1","addr":"172.21.15.116:6835","nonce":3507399322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.171:6839/1466585795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":1466585795},{"type":"v1","addr":"172.21.15.171:6839","nonce":1466585795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":17,"addr":"172.21.15.116:6837/2764513846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":2764513846},{"type":"v1","addr":"172.21.15.116:6837","nonce":2764513846}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.116:6839/1032741033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":1032741033},{"type":"v1","addr":"172.21.15.116:6839","nonce":1032741033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24446,24439,24431,24418]},"id":1}]} 2024-08-19T00:24:04.618 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 33 2024-08-19T00:24:04.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:04.617+0000 7f459fb01640 1 -- 172.21.15.44:0/2900279429 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f45840a2ce0 msgr2=0x7f45840a51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:04.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:04.617+0000 7f459fb01640 1 --2- 172.21.15.44:0/2900279429 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f45840a2ce0 0x7f45840a51a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4594009930 tx=0x7f4594008040 comp rx=0 tx=0).stop 2024-08-19T00:24:04.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:04.617+0000 7f459fb01640 1 -- 172.21.15.44:0/2900279429 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f45981052e0 msgr2=0x7f459819cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:04.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:04.617+0000 7f459fb01640 1 --2- 172.21.15.44:0/2900279429 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f45981052e0 0x7f459819cc50 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f459000b970 tx=0x7f459000be30 comp rx=0 tx=0).stop 2024-08-19T00:24:04.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:04.617+0000 7f459fb01640 1 -- 172.21.15.44:0/2900279429 shutdown_connections 2024-08-19T00:24:04.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:04.617+0000 7f459fb01640 1 --2- 172.21.15.44:0/2900279429 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f45840a2ce0 0x7f45840a51a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:04.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:04.617+0000 7f459fb01640 1 --2- 172.21.15.44:0/2900279429 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4598100b60 0x7f45981988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:04.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:04.617+0000 7f459fb01640 1 --2- 172.21.15.44:0/2900279429 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f45981052e0 0x7f459819cc50 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:04.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:04.617+0000 7f459fb01640 1 --2- 172.21.15.44:0/2900279429 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f45981001b0 0x7f4598198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:04.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:04.617+0000 7f459fb01640 1 -- 172.21.15.44:0/2900279429 >> 172.21.15.44:0/2900279429 conn(0x7f4598076f40 msgr2=0x7f45980fea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:24:04.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:04.618+0000 7f459fb01640 1 -- 172.21.15.44:0/2900279429 shutdown_connections 2024-08-19T00:24:04.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:04.618+0000 7f459fb01640 1 -- 172.21.15.44:0/2900279429 wait complete. 2024-08-19T00:24:05.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:04 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/2900279429' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:24:05.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:04 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/2900279429' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:24:05.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:04 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/2900279429' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:24:05.710 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24473 quiesce db --cancel --all' 2024-08-19T00:24:05.710 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24473 quiesce db --cancel --all 2024-08-19T00:24:05.967 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:24:06.303 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:05 smithi044 ceph-mon[18489]: pgmap v334: 129 pgs: 129 active+clean; 546 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.3 MiB/s wr, 202 op/s 2024-08-19T00:24:06.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:05 smithi171 ceph-mon[21810]: pgmap v334: 129 pgs: 129 active+clean; 546 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.3 MiB/s wr, 202 op/s 2024-08-19T00:24:06.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:05 smithi116 ceph-mon[21873]: pgmap v334: 129 pgs: 129 active+clean; 546 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.3 MiB/s wr, 202 op/s 2024-08-19T00:24:06.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.521+0000 7f9f529ad640 1 -- 172.21.15.44:0/1227289801 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f4c1078b0 msgr2=0x7f9f4c107c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:06.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.521+0000 7f9f529ad640 1 --2- 172.21.15.44:0/1227289801 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f4c1078b0 0x7f9f4c107c90 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c009930 tx=0x7f9f3c02a420 comp rx=0 tx=0).stop 2024-08-19T00:24:06.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.521+0000 7f9f529ad640 1 -- 172.21.15.44:0/1227289801 shutdown_connections 2024-08-19T00:24:06.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.521+0000 7f9f529ad640 1 --2- 172.21.15.44:0/1227289801 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f4c1018b0 0x7f9f4c101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:06.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.521+0000 7f9f529ad640 1 --2- 172.21.15.44:0/1227289801 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9f4c102250 0x7f9f4c10e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:06.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.521+0000 7f9f529ad640 1 --2- 172.21.15.44:0/1227289801 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f4c1078b0 0x7f9f4c107c90 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:06.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.521+0000 7f9f529ad640 1 -- 172.21.15.44:0/1227289801 >> 172.21.15.44:0/1227289801 conn(0x7f9f4c0fd5f0 msgr2=0x7f9f4c0ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:24:06.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.521+0000 7f9f529ad640 1 -- 172.21.15.44:0/1227289801 shutdown_connections 2024-08-19T00:24:06.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.521+0000 7f9f529ad640 1 -- 172.21.15.44:0/1227289801 wait complete. 2024-08-19T00:24:06.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.522+0000 7f9f529ad640 1 Processor -- start 2024-08-19T00:24:06.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.522+0000 7f9f529ad640 1 -- start start 2024-08-19T00:24:06.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.522+0000 7f9f529ad640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9f4c1018b0 0x7f9f4c198240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:06.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.522+0000 7f9f529ad640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f4c102250 0x7f9f4c198780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:06.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.522+0000 7f9f529ad640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f4c1078b0 0x7f9f4c19cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:06.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.522+0000 7f9f529ad640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9f4c111d20 con 0x7f9f4c1078b0 2024-08-19T00:24:06.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.522+0000 7f9f529ad640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f9f4c111ba0 con 0x7f9f4c1018b0 2024-08-19T00:24:06.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.522+0000 7f9f529ad640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9f4c111ea0 con 0x7f9f4c102250 2024-08-19T00:24:06.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.522+0000 7f9f50f4a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f4c1078b0 0x7f9f4c19cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:06.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.522+0000 7f9f50f4a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f4c1078b0 0x7f9f4c19cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43524/0 (socket says 172.21.15.44:43524) 2024-08-19T00:24:06.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.522+0000 7f9f50f4a640 1 -- 172.21.15.44:0/1478357861 learned_addr learned my addr 172.21.15.44:0/1478357861 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:24:06.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.522+0000 7f9f4bfff640 1 --2- 172.21.15.44:0/1478357861 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9f4c1018b0 0x7f9f4c198240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:06.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.522+0000 7f9f4b7fe640 1 --2- 172.21.15.44:0/1478357861 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f4c102250 0x7f9f4c198780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:06.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.523+0000 7f9f50f4a640 1 -- 172.21.15.44:0/1478357861 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f4c102250 msgr2=0x7f9f4c198780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:06.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.523+0000 7f9f50f4a640 1 --2- 172.21.15.44:0/1478357861 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f4c102250 0x7f9f4c198780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:06.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.523+0000 7f9f50f4a640 1 -- 172.21.15.44:0/1478357861 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9f4c1018b0 msgr2=0x7f9f4c198240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:06.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.523+0000 7f9f50f4a640 1 --2- 172.21.15.44:0/1478357861 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9f4c1018b0 0x7f9f4c198240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:06.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.523+0000 7f9f50f4a640 1 -- 172.21.15.44:0/1478357861 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f4c19d1f0 con 0x7f9f4c1078b0 2024-08-19T00:24:06.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.523+0000 7f9f50f4a640 1 --2- 172.21.15.44:0/1478357861 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f4c1078b0 0x7f9f4c19cb10 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f9f4400eaa0 tx=0x7f9f4400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:24:06.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.523+0000 7f9f497fa640 1 -- 172.21.15.44:0/1478357861 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f4400cdb0 con 0x7f9f4c1078b0 2024-08-19T00:24:06.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.523+0000 7f9f497fa640 1 -- 172.21.15.44:0/1478357861 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f44005020 con 0x7f9f4c1078b0 2024-08-19T00:24:06.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.523+0000 7f9f529ad640 1 -- 172.21.15.44:0/1478357861 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f4c19d4e0 con 0x7f9f4c1078b0 2024-08-19T00:24:06.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.523+0000 7f9f497fa640 1 -- 172.21.15.44:0/1478357861 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f440116b0 con 0x7f9f4c1078b0 2024-08-19T00:24:06.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.523+0000 7f9f529ad640 1 -- 172.21.15.44:0/1478357861 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f4c1a4dc0 con 0x7f9f4c1078b0 2024-08-19T00:24:06.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.526+0000 7f9f497fa640 1 -- 172.21.15.44:0/1478357861 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f9f44005560 con 0x7f9f4c1078b0 2024-08-19T00:24:06.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.526+0000 7f9f54dab740 1 Processor -- start 2024-08-19T00:24:06.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.526+0000 7f9f54dab740 1 -- start start 2024-08-19T00:24:06.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.526+0000 7f9f54dab740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ff4353f6a0 0x55ff4353fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:06.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.526+0000 7f9f54dab740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff4353ffc0 0x55ff4354a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:06.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.526+0000 7f9f54dab740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff4354a880 0x55ff4354cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:06.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.526+0000 7f9f54dab740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ff434a08c0 con 0x55ff4353ffc0 2024-08-19T00:24:06.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.526+0000 7f9f54dab740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55ff434529e0 con 0x55ff4353f6a0 2024-08-19T00:24:06.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.526+0000 7f9f54dab740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55ff434ae540 con 0x55ff4354a880 2024-08-19T00:24:06.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.527+0000 7f9f4bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff4353ffc0 0x55ff4354a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:06.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.527+0000 7f9f4bfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff4353ffc0 0x55ff4354a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43530/0 (socket says 172.21.15.44:43530) 2024-08-19T00:24:06.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.527+0000 7f9f4bfff640 1 -- 172.21.15.44:0/3597332620 learned_addr learned my addr 172.21.15.44:0/3597332620 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:24:06.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.527+0000 7f9f4b7fe640 1 --2- 172.21.15.44:0/3597332620 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff4354a880 0x55ff4354cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:06.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.527+0000 7f9f4b7fe640 1 --2- 172.21.15.44:0/3597332620 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ff4353f6a0 0x55ff4353fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:06.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.527+0000 7f9f4bfff640 1 -- 172.21.15.44:0/3597332620 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff4354a880 msgr2=0x55ff4354cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:24:06.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.527+0000 7f9f4bfff640 1 --2- 172.21.15.44:0/3597332620 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff4354a880 0x55ff4354cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:06.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.527+0000 7f9f4bfff640 1 -- 172.21.15.44:0/3597332620 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ff4353f6a0 msgr2=0x55ff4353fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:24:06.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.527+0000 7f9f4bfff640 1 --2- 172.21.15.44:0/3597332620 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ff4353f6a0 0x55ff4353fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:06.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.527+0000 7f9f4bfff640 1 -- 172.21.15.44:0/3597332620 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff4343c640 con 0x55ff4353ffc0 2024-08-19T00:24:06.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.527+0000 7f9f4b7fe640 1 --2- 172.21.15.44:0/3597332620 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ff4353f6a0 0x55ff4353fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:24:06.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.527+0000 7f9f497fa640 1 --2- 172.21.15.44:0/1478357861 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f9f340a2cf0 0x7f9f340a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:06.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.527+0000 7f9f4bfff640 1 --2- 172.21.15.44:0/3597332620 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff4353ffc0 0x55ff4354a340 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c009930 tx=0x7f9f3c004180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b9674dd374be0f3 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:24:06.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.527+0000 7f9f4b7fe640 1 --2- 172.21.15.44:0/1478357861 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f9f340a2cf0 0x7f9f340a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:06.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.527+0000 7f9f497fa640 1 -- 172.21.15.44:0/1478357861 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9533+0+0 (secure 0 0 0) 0x7f9f440cfac0 con 0x7f9f4c1078b0 2024-08-19T00:24:06.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.527+0000 7f9f327fc640 1 -- 172.21.15.44:0/3597332620 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c035040 con 0x55ff4353ffc0 2024-08-19T00:24:06.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.527+0000 7f9f327fc640 1 -- 172.21.15.44:0/3597332620 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f3c005520 con 0x55ff4353ffc0 2024-08-19T00:24:06.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.528+0000 7f9f327fc640 1 -- 172.21.15.44:0/3597332620 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c003850 con 0x55ff4353ffc0 2024-08-19T00:24:06.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.528+0000 7f9f54dab740 1 -- 172.21.15.44:0/3597332620 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff4353ffc0 msgr2=0x55ff4354a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:06.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.528+0000 7f9f4b7fe640 1 --2- 172.21.15.44:0/1478357861 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f9f340a2cf0 0x7f9f340a51b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9f40006fd0 tx=0x7f9f40008040 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:24:06.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.528+0000 7f9f54dab740 1 --2- 172.21.15.44:0/3597332620 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff4353ffc0 0x55ff4354a340 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c009930 tx=0x7f9f3c004180 comp rx=0 tx=0).stop 2024-08-19T00:24:06.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.528+0000 7f9f54dab740 1 -- 172.21.15.44:0/3597332620 shutdown_connections 2024-08-19T00:24:06.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.528+0000 7f9f54dab740 1 --2- 172.21.15.44:0/3597332620 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff4354a880 0x55ff4354cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:06.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.528+0000 7f9f54dab740 1 --2- 172.21.15.44:0/3597332620 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff4353ffc0 0x55ff4354a340 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:06.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.528+0000 7f9f54dab740 1 --2- 172.21.15.44:0/3597332620 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ff4353f6a0 0x55ff4353fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:06.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.528+0000 7f9f54dab740 1 -- 172.21.15.44:0/3597332620 >> 172.21.15.44:0/3597332620 conn(0x55ff4353bc30 msgr2=0x55ff4353c010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:24:06.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.528+0000 7f9f54dab740 1 -- 172.21.15.44:0/3597332620 shutdown_connections 2024-08-19T00:24:06.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.528+0000 7f9f54dab740 1 -- 172.21.15.44:0/3597332620 wait complete. 2024-08-19T00:24:06.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.529+0000 7f9f54dab740 1 -- start start 2024-08-19T00:24:06.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.529+0000 7f9f54dab740 1 Processor -- start 2024-08-19T00:24:06.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.529+0000 7f9f54dab740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ff4353f6a0 0x55ff4354a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:06.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.529+0000 7f9f54dab740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff4353ffc0 0x55ff43547400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:06.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.529+0000 7f9f54dab740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff4354a880 0x55ff43547940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:06.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.529+0000 7f9f54dab740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ff434a3c10 con 0x55ff4354a880 2024-08-19T00:24:06.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.529+0000 7f9f54dab740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55ff43462f00 con 0x55ff4353f6a0 2024-08-19T00:24:06.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.529+0000 7f9f54dab740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55ff434a8f30 con 0x55ff4353ffc0 2024-08-19T00:24:06.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.529+0000 7f9f54dab740 10 client.0 _ll_register_callbacks cb 0x55ff431b3b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:24:06.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.529+0000 7f9f50f4a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff4354a880 0x55ff43547940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:06.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.529+0000 7f9f50f4a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff4354a880 0x55ff43547940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43538/0 (socket says 172.21.15.44:43538) 2024-08-19T00:24:06.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.529+0000 7f9f50f4a640 1 -- 172.21.15.44:0/666877791 learned_addr learned my addr 172.21.15.44:0/666877791 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:24:06.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.529+0000 7f9f4bfff640 1 --2- 172.21.15.44:0/666877791 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ff4353f6a0 0x55ff4354a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:06.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.530+0000 7f9f4b7fe640 1 --2- 172.21.15.44:0/666877791 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff4353ffc0 0x55ff43547400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:06.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.530+0000 7f9f50f4a640 1 -- 172.21.15.44:0/666877791 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff4353ffc0 msgr2=0x55ff43547400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:24:06.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.530+0000 7f9f50f4a640 1 --2- 172.21.15.44:0/666877791 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff4353ffc0 0x55ff43547400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:06.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.530+0000 7f9f50f4a640 1 -- 172.21.15.44:0/666877791 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ff4353f6a0 msgr2=0x55ff4354a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:24:06.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.530+0000 7f9f50f4a640 1 --2- 172.21.15.44:0/666877791 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ff4353f6a0 0x55ff4354a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:06.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.530+0000 7f9f50f4a640 1 -- 172.21.15.44:0/666877791 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff43216620 con 0x55ff4354a880 2024-08-19T00:24:06.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.530+0000 7f9f50f4a640 1 --2- 172.21.15.44:0/666877791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff4354a880 0x55ff43547940 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f9f440cd420 tx=0x7f9f4409bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31ede6a82bcd5b13 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:24:06.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.530+0000 7f9f2b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:24:06.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.530+0000 7f9f2b7fe640 1 -- 172.21.15.44:0/666877791 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f4401f070 con 0x55ff4354a880 2024-08-19T00:24:06.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.530+0000 7f9f2b7fe640 1 -- 172.21.15.44:0/666877791 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9533+0+0 (secure 0 0 0) 0x7f9f4409b040 con 0x55ff4354a880 2024-08-19T00:24:06.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.530+0000 7f9f54dab740 1 -- 172.21.15.44:0/666877791 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f3c005520 con 0x55ff4354a880 2024-08-19T00:24:06.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.530+0000 7f9f2b7fe640 1 -- 172.21.15.44:0/666877791 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f9f4409b280 con 0x55ff4354a880 2024-08-19T00:24:06.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.530+0000 7f9f54dab740 10 client.16854 fetch_fsmap learned FSMap version 33 2024-08-19T00:24:06.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.530+0000 7f9f54dab740 1 -- 172.21.15.44:0/666877791 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55ff43558df0 con 0x55ff4354a880 2024-08-19T00:24:06.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.530+0000 7f9f2b7fe640 1 -- 172.21.15.44:0/666877791 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f3c005520 con 0x55ff4354a880 2024-08-19T00:24:06.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.531+0000 7f9f2b7fe640 1 -- 172.21.15.44:0/666877791 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f9f4400f040 con 0x55ff4354a880 2024-08-19T00:24:06.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.531+0000 7f9f54dab740 10 client.16854 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:24:06.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.531+0000 7f9f54dab740 10 client.16854 resolve_mds: validated gid 24473 aka daemon mds.b 2024-08-19T00:24:06.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.531+0000 7f9f54dab740 20 client.16854 populate_metadata read hostname 'smithi044' 2024-08-19T00:24:06.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.531+0000 7f9f54dab740 1 --2- 172.21.15.44:0/666877791 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55ff4355a2a0 0x55ff4355c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:06.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.531+0000 7f9f54dab740 4 client.16854 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:24:06.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.531+0000 7f9f54dab740 1 -- 172.21.15.44:0/666877791 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ff434b1e70 con 0x55ff4355a2a0 2024-08-19T00:24:06.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.531+0000 7f9f4bfff640 1 --2- 172.21.15.44:0/666877791 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55ff4355a2a0 0x55ff4355c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:06.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.531+0000 7f9f2b7fe640 10 client.16854 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:24:06.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.531+0000 7f9f4bfff640 1 --2- 172.21.15.44:0/666877791 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55ff4355a2a0 0x55ff4355c720 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd53e1454688d00c server_cookie=e31789b530492865 in_seq=0 out_seq=0 2024-08-19T00:24:06.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.532+0000 7f9f2b7fe640 1 -- 172.21.15.44:0/666877791 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ff434b1e70 con 0x55ff4355a2a0 2024-08-19T00:24:06.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.532+0000 7f9f2b7fe640 10 client.16854 handle_command_reply: tid=0 2024-08-19T00:24:06.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.532+0000 7f9f54dab740 1 client.16854 shutdown 2024-08-19T00:24:06.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.532+0000 7f9f54dab740 1 -- 172.21.15.44:0/666877791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff4354a880 msgr2=0x55ff43547940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:06.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.532+0000 7f9f54dab740 1 --2- 172.21.15.44:0/666877791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff4354a880 0x55ff43547940 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f9f440cd420 tx=0x7f9f4409bcb0 comp rx=0 tx=0).stop 2024-08-19T00:24:06.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.532+0000 7f9f54dab740 1 -- 172.21.15.44:0/666877791 shutdown_connections 2024-08-19T00:24:06.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.532+0000 7f9f54dab740 1 --2- 172.21.15.44:0/666877791 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55ff4355a2a0 0x55ff4355c720 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:06.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.532+0000 7f9f54dab740 1 --2- 172.21.15.44:0/666877791 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff4353ffc0 0x55ff43547400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:06.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.532+0000 7f9f54dab740 1 --2- 172.21.15.44:0/666877791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff4354a880 0x55ff43547940 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:06.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.532+0000 7f9f54dab740 1 --2- 172.21.15.44:0/666877791 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ff4353f6a0 0x55ff4354a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:06.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.532+0000 7f9f54dab740 1 -- 172.21.15.44:0/666877791 >> 172.21.15.44:0/666877791 conn(0x55ff4353bc30 msgr2=0x55ff43541960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:24:06.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.532+0000 7f9f2b7fe640 0 client.16854 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:24:06.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.532+0000 7f9f54dab740 1 -- 172.21.15.44:0/666877791 shutdown_connections 2024-08-19T00:24:06.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.533+0000 7f9f54dab740 1 -- 172.21.15.44:0/666877791 wait complete. 2024-08-19T00:24:06.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.533+0000 7f9f54dab740 20 client.16854 trim_cache size 0 max 16384 2024-08-19T00:24:06.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.550+0000 7f9f54dab740 1 Processor -- start 2024-08-19T00:24:06.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.550+0000 7f9f54dab740 1 -- start start 2024-08-19T00:24:06.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.550+0000 7f9f54dab740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff4353f6a0 0x55ff43546340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:06.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.550+0000 7f9f54dab740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff4353ffc0 0x55ff435475f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:06.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.550+0000 7f9f54dab740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ff4354a880 0x55ff43561ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:06.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.550+0000 7f9f54dab740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9f4c1b0a70 con 0x55ff4353ffc0 2024-08-19T00:24:06.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.550+0000 7f9f54dab740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f9f4c1af600 con 0x55ff4354a880 2024-08-19T00:24:06.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.550+0000 7f9f54dab740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9f4c1afcd0 con 0x55ff4353f6a0 2024-08-19T00:24:06.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.550+0000 7f9f4b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff4353ffc0 0x55ff435475f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:06.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.550+0000 7f9f4b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff4353ffc0 0x55ff435475f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43544/0 (socket says 172.21.15.44:43544) 2024-08-19T00:24:06.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.550+0000 7f9f4b7fe640 1 -- 172.21.15.44:0/3863725099 learned_addr learned my addr 172.21.15.44:0/3863725099 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:24:06.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.550+0000 7f9f4b7fe640 1 -- 172.21.15.44:0/3863725099 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff4353f6a0 msgr2=0x55ff43546340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:24:06.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.550+0000 7f9f4b7fe640 1 --2- 172.21.15.44:0/3863725099 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff4353f6a0 0x55ff43546340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:06.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.550+0000 7f9f4b7fe640 1 -- 172.21.15.44:0/3863725099 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ff4354a880 msgr2=0x55ff43561ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:24:06.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.550+0000 7f9f4b7fe640 1 --2- 172.21.15.44:0/3863725099 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ff4354a880 0x55ff43561ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:06.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.550+0000 7f9f4b7fe640 1 -- 172.21.15.44:0/3863725099 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff4353cda0 con 0x55ff4353ffc0 2024-08-19T00:24:06.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.550+0000 7f9f4b7fe640 1 --2- 172.21.15.44:0/3863725099 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff4353ffc0 0x55ff435475f0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f9f40010c60 tx=0x7f9f40013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3b3f31f076fe97b server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:24:06.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.551+0000 7f9f31ffb640 1 -- 172.21.15.44:0/3863725099 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f40010c90 con 0x55ff4353ffc0 2024-08-19T00:24:06.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.551+0000 7f9f31ffb640 1 -- 172.21.15.44:0/3863725099 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f40027070 con 0x55ff4353ffc0 2024-08-19T00:24:06.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.551+0000 7f9f31ffb640 1 -- 172.21.15.44:0/3863725099 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f40022420 con 0x55ff4353ffc0 2024-08-19T00:24:06.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.551+0000 7f9f54dab740 1 -- 172.21.15.44:0/3863725099 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff4353ffc0 msgr2=0x55ff435475f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:06.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.551+0000 7f9f54dab740 1 --2- 172.21.15.44:0/3863725099 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff4353ffc0 0x55ff435475f0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f9f40010c60 tx=0x7f9f40013000 comp rx=0 tx=0).stop 2024-08-19T00:24:06.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.551+0000 7f9f54dab740 1 -- 172.21.15.44:0/3863725099 shutdown_connections 2024-08-19T00:24:06.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.551+0000 7f9f54dab740 1 --2- 172.21.15.44:0/3863725099 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ff4354a880 0x55ff43561ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:06.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.551+0000 7f9f54dab740 1 --2- 172.21.15.44:0/3863725099 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff4353ffc0 0x55ff435475f0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:06.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.551+0000 7f9f54dab740 1 --2- 172.21.15.44:0/3863725099 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff4353f6a0 0x55ff43546340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:06.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.551+0000 7f9f54dab740 1 -- 172.21.15.44:0/3863725099 >> 172.21.15.44:0/3863725099 conn(0x55ff4353bc30 msgr2=0x55ff43549480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:24:06.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.552+0000 7f9f54dab740 1 -- 172.21.15.44:0/3863725099 shutdown_connections 2024-08-19T00:24:06.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.552+0000 7f9f54dab740 1 -- 172.21.15.44:0/3863725099 wait complete. 2024-08-19T00:24:06.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.552+0000 7f9f54dab740 1 -- start start 2024-08-19T00:24:06.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.552+0000 7f9f54dab740 1 Processor -- start 2024-08-19T00:24:06.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.553+0000 7f9f54dab740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff4353f6a0 0x55ff43550950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:06.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.553+0000 7f9f54dab740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff4353ffc0 0x55ff43550e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:06.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.553+0000 7f9f54dab740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ff4354a880 0x55ff435c3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:06.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.553+0000 7f9f54dab740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9f4c1acf30 con 0x55ff4353ffc0 2024-08-19T00:24:06.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.553+0000 7f9f54dab740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f9f4c1b03a0 con 0x55ff4354a880 2024-08-19T00:24:06.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.553+0000 7f9f54dab740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9f4c1ad580 con 0x55ff4353f6a0 2024-08-19T00:24:06.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.553+0000 7f9f4b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff4353ffc0 0x55ff43550e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:06.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.553+0000 7f9f4b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff4353ffc0 0x55ff43550e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43550/0 (socket says 172.21.15.44:43550) 2024-08-19T00:24:06.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.553+0000 7f9f4b7fe640 1 -- 172.21.15.44:0/3624992249 learned_addr learned my addr 172.21.15.44:0/3624992249 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:24:06.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.553+0000 7f9f54dab740 10 client.0 _ll_register_callbacks cb 0x7f9f44097f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:24:06.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.553+0000 7f9f4bfff640 1 --2- 172.21.15.44:0/3624992249 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff4353f6a0 0x55ff43550950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:06.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.553+0000 7f9f50f4a640 1 --2- 172.21.15.44:0/3624992249 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ff4354a880 0x55ff435c3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:06.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.553+0000 7f9f4b7fe640 1 -- 172.21.15.44:0/3624992249 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff4353f6a0 msgr2=0x55ff43550950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:24:06.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.553+0000 7f9f4b7fe640 1 --2- 172.21.15.44:0/3624992249 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff4353f6a0 0x55ff43550950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:06.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.553+0000 7f9f4b7fe640 1 -- 172.21.15.44:0/3624992249 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ff4354a880 msgr2=0x55ff435c3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:24:06.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.553+0000 7f9f4b7fe640 1 --2- 172.21.15.44:0/3624992249 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ff4354a880 0x55ff435c3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:06.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.553+0000 7f9f4b7fe640 1 -- 172.21.15.44:0/3624992249 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff435c4510 con 0x55ff4353ffc0 2024-08-19T00:24:06.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.553+0000 7f9f4b7fe640 1 --2- 172.21.15.44:0/3624992249 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff4353ffc0 0x55ff43550e90 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f9f40004700 tx=0x7f9f40010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a64ed0dc67b0cc6 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:24:06.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.553+0000 7f9f2b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:24:06.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.553+0000 7f9f2b7fe640 1 -- 172.21.15.44:0/3624992249 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f40014640 con 0x55ff4353ffc0 2024-08-19T00:24:06.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.553+0000 7f9f2b7fe640 1 -- 172.21.15.44:0/3624992249 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9533+0+0 (secure 0 0 0) 0x7f9f4001e040 con 0x55ff4353ffc0 2024-08-19T00:24:06.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.554+0000 7f9f54dab740 1 -- 172.21.15.44:0/3624992249 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f40027070 con 0x55ff4353ffc0 2024-08-19T00:24:06.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.554+0000 7f9f2b7fe640 1 -- 172.21.15.44:0/3624992249 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f9f4003a050 con 0x55ff4353ffc0 2024-08-19T00:24:06.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.554+0000 7f9f54dab740 10 client.16860 fetch_fsmap learned FSMap version 33 2024-08-19T00:24:06.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.554+0000 7f9f54dab740 1 -- 172.21.15.44:0/3624992249 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55ff435c5730 con 0x55ff4353ffc0 2024-08-19T00:24:06.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.554+0000 7f9f2b7fe640 1 -- 172.21.15.44:0/3624992249 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f40027070 con 0x55ff4353ffc0 2024-08-19T00:24:06.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.554+0000 7f9f2b7fe640 1 -- 172.21.15.44:0/3624992249 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f9f4002b410 con 0x55ff4353ffc0 2024-08-19T00:24:06.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.554+0000 7f9f54dab740 10 client.16860 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:24:06.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.554+0000 7f9f54dab740 10 client.16860 resolve_mds: validated gid 24473 aka daemon mds.b 2024-08-19T00:24:06.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.554+0000 7f9f54dab740 20 client.16860 populate_metadata read hostname 'smithi044' 2024-08-19T00:24:06.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.554+0000 7f9f54dab740 1 --2- 172.21.15.44:0/3624992249 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55ff435c5e50 0x55ff435c8270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:06.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.554+0000 7f9f54dab740 4 client.16860 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-08-19T00:24:06.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.554+0000 7f9f54dab740 1 -- 172.21.15.44:0/3624992249 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x55ff434ac380 con 0x55ff435c5e50 2024-08-19T00:24:06.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.554+0000 7f9f4bfff640 1 --2- 172.21.15.44:0/3624992249 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55ff435c5e50 0x55ff435c8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:06.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.555+0000 7f9f4bfff640 1 --2- 172.21.15.44:0/3624992249 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55ff435c5e50 0x55ff435c8270 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4125df3d3667ef7 server_cookie=1f6612b24f1320f5 in_seq=0 out_seq=0 2024-08-19T00:24:06.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.555+0000 7f9f2b7fe640 10 client.16860 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:24:06.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.555+0000 7f9f2b7fe640 1 -- 172.21.15.44:0/3624992249 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+80 (crc 0 0 0) 0x55ff434ac380 con 0x55ff435c5e50 2024-08-19T00:24:06.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.555+0000 7f9f2b7fe640 10 client.16860 handle_command_reply: tid=0 2024-08-19T00:24:06.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.555+0000 7f9f54dab740 1 client.16860 shutdown 2024-08-19T00:24:06.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.555+0000 7f9f54dab740 1 -- 172.21.15.44:0/3624992249 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff4353ffc0 msgr2=0x55ff43550e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:06.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.555+0000 7f9f54dab740 1 --2- 172.21.15.44:0/3624992249 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff4353ffc0 0x55ff43550e90 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f9f40004700 tx=0x7f9f40010f40 comp rx=0 tx=0).stop 2024-08-19T00:24:06.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.555+0000 7f9f54dab740 1 -- 172.21.15.44:0/3624992249 shutdown_connections 2024-08-19T00:24:06.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.555+0000 7f9f54dab740 1 --2- 172.21.15.44:0/3624992249 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x55ff435c5e50 0x55ff435c8270 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:06.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.555+0000 7f9f2b7fe640 0 client.16860 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:24:06.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.555+0000 7f9f54dab740 1 --2- 172.21.15.44:0/3624992249 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ff4354a880 0x55ff435c3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:06.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.555+0000 7f9f54dab740 1 --2- 172.21.15.44:0/3624992249 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff4353ffc0 0x55ff43550e90 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:06.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.555+0000 7f9f54dab740 1 --2- 172.21.15.44:0/3624992249 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff4353f6a0 0x55ff43550950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:06.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.555+0000 7f9f54dab740 1 -- 172.21.15.44:0/3624992249 >> 172.21.15.44:0/3624992249 conn(0x55ff4353bc30 msgr2=0x55ff4353a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:24:06.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.556+0000 7f9f54dab740 1 -- 172.21.15.44:0/3624992249 shutdown_connections 2024-08-19T00:24:06.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.556+0000 7f9f54dab740 1 -- 172.21.15.44:0/3624992249 wait complete. 2024-08-19T00:24:06.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.556+0000 7f9f54dab740 20 client.16860 trim_cache size 0 max 16384 2024-08-19T00:24:06.567 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-08-19T00:24:06.567 INFO:teuthology.orchestra.run.smithi044.stdout: "epoch": 33, 2024-08-19T00:24:06.567 INFO:teuthology.orchestra.run.smithi044.stdout: "leader": 24473, 2024-08-19T00:24:06.567 INFO:teuthology.orchestra.run.smithi044.stdout: "set_version": 36, 2024-08-19T00:24:06.567 INFO:teuthology.orchestra.run.smithi044.stdout: "sets": {} 2024-08-19T00:24:06.567 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-08-19T00:24:06.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.556+0000 7f9f529ad640 1 -- 172.21.15.44:0/1478357861 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f9f340a2cf0 msgr2=0x7f9f340a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:06.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.556+0000 7f9f529ad640 1 --2- 172.21.15.44:0/1478357861 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f9f340a2cf0 0x7f9f340a51b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9f40006fd0 tx=0x7f9f40008040 comp rx=0 tx=0).stop 2024-08-19T00:24:06.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.556+0000 7f9f529ad640 1 -- 172.21.15.44:0/1478357861 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f4c1078b0 msgr2=0x7f9f4c19cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:06.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.556+0000 7f9f529ad640 1 --2- 172.21.15.44:0/1478357861 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f4c1078b0 0x7f9f4c19cb10 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f9f4400eaa0 tx=0x7f9f4400ef60 comp rx=0 tx=0).stop 2024-08-19T00:24:06.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.556+0000 7f9f529ad640 1 -- 172.21.15.44:0/1478357861 shutdown_connections 2024-08-19T00:24:06.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.556+0000 7f9f529ad640 1 --2- 172.21.15.44:0/1478357861 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f9f340a2cf0 0x7f9f340a51b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:06.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.556+0000 7f9f529ad640 1 --2- 172.21.15.44:0/1478357861 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f4c102250 0x7f9f4c198780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:06.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.556+0000 7f9f529ad640 1 --2- 172.21.15.44:0/1478357861 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f4c1078b0 0x7f9f4c19cb10 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:06.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.556+0000 7f9f529ad640 1 --2- 172.21.15.44:0/1478357861 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9f4c1018b0 0x7f9f4c198240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:06.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.556+0000 7f9f529ad640 1 -- 172.21.15.44:0/1478357861 >> 172.21.15.44:0/1478357861 conn(0x7f9f4c0fd5f0 msgr2=0x7f9f4c0fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:24:06.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.556+0000 7f9f529ad640 1 -- 172.21.15.44:0/1478357861 shutdown_connections 2024-08-19T00:24:06.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:06.556+0000 7f9f529ad640 1 -- 172.21.15.44:0/1478357861 wait complete. 2024-08-19T00:24:07.248 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.246+0000 7f1fe88be640 1 -- 172.21.15.44:0/4240385206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1fe41066f0 msgr2=0x7f1fe4106ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:07.248 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.246+0000 7f1fe88be640 1 --2- 172.21.15.44:0/4240385206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1fe41066f0 0x7f1fe4106ad0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f1fd4009930 tx=0x7f1fd402a420 comp rx=0 tx=0).stop 2024-08-19T00:24:07.248 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.246+0000 7f1fe88be640 1 -- 172.21.15.44:0/4240385206 shutdown_connections 2024-08-19T00:24:07.249 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.246+0000 7f1fe88be640 1 --2- 172.21.15.44:0/4240385206 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1fe4101080 0x7f1fe410d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:07.249 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.246+0000 7f1fe88be640 1 --2- 172.21.15.44:0/4240385206 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1fe41006e0 0x7f1fe4100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:07.249 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.246+0000 7f1fe88be640 1 --2- 172.21.15.44:0/4240385206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1fe41066f0 0x7f1fe4106ad0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:07.249 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.246+0000 7f1fe88be640 1 -- 172.21.15.44:0/4240385206 >> 172.21.15.44:0/4240385206 conn(0x7f1fe40776c0 msgr2=0x7f1fe40fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:24:07.249 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.246+0000 7f1fe88be640 1 -- 172.21.15.44:0/4240385206 shutdown_connections 2024-08-19T00:24:07.249 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.246+0000 7f1fe88be640 1 -- 172.21.15.44:0/4240385206 wait complete. 2024-08-19T00:24:07.251 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.247+0000 7f1fe88be640 1 Processor -- start 2024-08-19T00:24:07.251 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.247+0000 7f1fe88be640 1 -- start start 2024-08-19T00:24:07.252 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.247+0000 7f1fe88be640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1fe41006e0 0x7f1fe4196ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:07.252 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.247+0000 7f1fe88be640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1fe4101080 0x7f1fe4197420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:07.252 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.247+0000 7f1fe88be640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1fe41066f0 0x7f1fe419b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:07.252 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.247+0000 7f1fe88be640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1fe4110b30 con 0x7f1fe41066f0 2024-08-19T00:24:07.252 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.247+0000 7f1fe88be640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f1fe41109b0 con 0x7f1fe4101080 2024-08-19T00:24:07.252 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.247+0000 7f1fe88be640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1fe4110cb0 con 0x7f1fe41006e0 2024-08-19T00:24:07.252 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.247+0000 7f1fe2d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1fe41066f0 0x7f1fe419b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:07.253 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.247+0000 7f1fe2d9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1fe41066f0 0x7f1fe419b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43574/0 (socket says 172.21.15.44:43574) 2024-08-19T00:24:07.253 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.247+0000 7f1fe2d9d640 1 -- 172.21.15.44:0/1596479032 learned_addr learned my addr 172.21.15.44:0/1596479032 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:24:07.253 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.247+0000 7f1fe1d9b640 1 --2- 172.21.15.44:0/1596479032 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1fe4101080 0x7f1fe4197420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:07.253 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.247+0000 7f1fe259c640 1 --2- 172.21.15.44:0/1596479032 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1fe41006e0 0x7f1fe4196ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:07.253 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.247+0000 7f1fe2d9d640 1 -- 172.21.15.44:0/1596479032 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1fe41006e0 msgr2=0x7f1fe4196ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:07.253 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.247+0000 7f1fe2d9d640 1 --2- 172.21.15.44:0/1596479032 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1fe41006e0 0x7f1fe4196ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:07.253 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.247+0000 7f1fe2d9d640 1 -- 172.21.15.44:0/1596479032 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1fe4101080 msgr2=0x7f1fe4197420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:07.253 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.247+0000 7f1fe2d9d640 1 --2- 172.21.15.44:0/1596479032 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1fe4101080 0x7f1fe4197420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:07.254 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.248+0000 7f1fe2d9d640 1 -- 172.21.15.44:0/1596479032 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fe419bed0 con 0x7f1fe41066f0 2024-08-19T00:24:07.254 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.248+0000 7f1fe259c640 1 --2- 172.21.15.44:0/1596479032 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1fe41006e0 0x7f1fe4196ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:24:07.254 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.248+0000 7f1fe2d9d640 1 --2- 172.21.15.44:0/1596479032 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1fe41066f0 0x7f1fe419b7a0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc00eaa0 tx=0x7f1fdc00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:24:07.254 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.248+0000 7f1fd37fe640 1 -- 172.21.15.44:0/1596479032 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc004d20 con 0x7f1fe41066f0 2024-08-19T00:24:07.254 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.248+0000 7f1fe88be640 1 -- 172.21.15.44:0/1596479032 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fe419c1c0 con 0x7f1fe41066f0 2024-08-19T00:24:07.254 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.248+0000 7f1fd37fe640 1 -- 172.21.15.44:0/1596479032 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1fdc005020 con 0x7f1fe41066f0 2024-08-19T00:24:07.254 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.248+0000 7f1fd37fe640 1 -- 172.21.15.44:0/1596479032 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc0116d0 con 0x7f1fe41066f0 2024-08-19T00:24:07.255 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.248+0000 7f1fe88be640 1 -- 172.21.15.44:0/1596479032 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fe41a3a50 con 0x7f1fe41066f0 2024-08-19T00:24:07.257 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.250+0000 7f1fd37fe640 1 -- 172.21.15.44:0/1596479032 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f1fdc0051d0 con 0x7f1fe41066f0 2024-08-19T00:24:07.257 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.251+0000 7f1feb678740 1 Processor -- start 2024-08-19T00:24:07.257 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.251+0000 7f1feb678740 1 -- start start 2024-08-19T00:24:07.257 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.251+0000 7f1feb678740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d2a0496f0 0x561d2a049ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:07.257 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.251+0000 7f1feb678740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561d2a04a010 0x561d2a056660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:07.258 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.251+0000 7f1feb678740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561d2a056ba0 0x561d2a058f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:07.258 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.251+0000 7f1feb678740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561d29fad9d0 con 0x561d2a0496f0 2024-08-19T00:24:07.258 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.251+0000 7f1feb678740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x561d29f55820 con 0x561d2a056ba0 2024-08-19T00:24:07.258 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.251+0000 7f1feb678740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x561d29fa9990 con 0x561d2a04a010 2024-08-19T00:24:07.258 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.251+0000 7f1fd37fe640 1 --2- 172.21.15.44:0/1596479032 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f1fcc0a2da0 0x7f1fcc0a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:07.258 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.252+0000 7f1fe1d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d2a0496f0 0x561d2a049ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:07.258 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.252+0000 7f1fe1d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d2a0496f0 0x561d2a049ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43586/0 (socket says 172.21.15.44:43586) 2024-08-19T00:24:07.259 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.252+0000 7f1fe1d9b640 1 -- 172.21.15.44:0/2428475240 learned_addr learned my addr 172.21.15.44:0/2428475240 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:24:07.259 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.252+0000 7f1fe2d9d640 1 --2- 172.21.15.44:0/1596479032 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f1fcc0a2da0 0x7f1fcc0a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:07.259 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.252+0000 7f1fe259c640 1 --2- 172.21.15.44:0/2428475240 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561d2a04a010 0x561d2a056660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:07.259 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.252+0000 7f1fe1d9b640 1 --2- 172.21.15.44:0/2428475240 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561d2a056ba0 0x561d2a058f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:07.259 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.252+0000 7f1fd37fe640 1 -- 172.21.15.44:0/1596479032 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 9621+0+0 (secure 0 0 0) 0x7f1fdc0cfa10 con 0x7f1fe41066f0 2024-08-19T00:24:07.259 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.252+0000 7f1fe1d9b640 1 -- 172.21.15.44:0/2428475240 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561d2a04a010 msgr2=0x561d2a056660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:24:07.259 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.252+0000 7f1fe1d9b640 1 --2- 172.21.15.44:0/2428475240 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561d2a04a010 0x561d2a056660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:07.260 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.252+0000 7f1fe1d9b640 1 -- 172.21.15.44:0/2428475240 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561d2a056ba0 msgr2=0x561d2a058f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:24:07.260 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.252+0000 7f1fe1d9b640 1 --2- 172.21.15.44:0/2428475240 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561d2a056ba0 0x561d2a058f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:07.260 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.252+0000 7f1fe1d9b640 1 -- 172.21.15.44:0/2428475240 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d29cc1210 con 0x561d2a0496f0 2024-08-19T00:24:07.260 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.252+0000 7f1fe259c640 1 --2- 172.21.15.44:0/2428475240 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561d2a04a010 0x561d2a056660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:24:07.261 INFO:tasks.quiescer:done joining Quiescers 2024-08-19T00:24:07.262 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-08-19T00:24:07.272 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi044.front.sepia.ceph.com 2024-08-19T00:24:07.277 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.252+0000 7f1fe1d9b640 1 --2- 172.21.15.44:0/2428475240 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d2a0496f0 0x561d2a049ad0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f1fd8013610 tx=0x7f1fd800a800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68402431f511bfa2 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:24:07.277 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.252+0000 7f1fe2d9d640 1 --2- 172.21.15.44:0/1596479032 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f1fcc0a2da0 0x7f1fcc0a5260 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc097f40 tx=0x7f1fdc06daa0 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:24:07.277 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.252+0000 7f1fd0ff9640 1 -- 172.21.15.44:0/2428475240 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fd8019030 con 0x561d2a0496f0 2024-08-19T00:24:07.277 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.252+0000 7f1fd0ff9640 1 -- 172.21.15.44:0/2428475240 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1fd80110d0 con 0x561d2a0496f0 2024-08-19T00:24:07.277 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.252+0000 7f1fd0ff9640 1 -- 172.21.15.44:0/2428475240 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fd800f870 con 0x561d2a0496f0 2024-08-19T00:24:07.277 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.253+0000 7f1feb678740 1 -- 172.21.15.44:0/2428475240 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d2a0496f0 msgr2=0x561d2a049ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:07.277 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.253+0000 7f1feb678740 1 --2- 172.21.15.44:0/2428475240 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d2a0496f0 0x561d2a049ad0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f1fd8013610 tx=0x7f1fd800a800 comp rx=0 tx=0).stop 2024-08-19T00:24:07.278 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.253+0000 7f1feb678740 1 -- 172.21.15.44:0/2428475240 shutdown_connections 2024-08-19T00:24:07.278 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.253+0000 7f1feb678740 1 --2- 172.21.15.44:0/2428475240 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561d2a04a010 0x561d2a056660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:07.278 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.253+0000 7f1feb678740 1 --2- 172.21.15.44:0/2428475240 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561d2a056ba0 0x561d2a058f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:07.278 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.253+0000 7f1feb678740 1 --2- 172.21.15.44:0/2428475240 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d2a0496f0 0x561d2a049ad0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:07.278 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.253+0000 7f1feb678740 1 -- 172.21.15.44:0/2428475240 >> 172.21.15.44:0/2428475240 conn(0x561d2a045d40 msgr2=0x561d2a046120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:24:07.278 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.253+0000 7f1feb678740 1 -- 172.21.15.44:0/2428475240 shutdown_connections 2024-08-19T00:24:07.278 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.253+0000 7f1feb678740 1 -- 172.21.15.44:0/2428475240 wait complete. 2024-08-19T00:24:07.279 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.253+0000 7f1feb678740 1 -- start start 2024-08-19T00:24:07.279 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.254+0000 7f1feb678740 1 Processor -- start 2024-08-19T00:24:07.279 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.254+0000 7f1feb678740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d2a0496f0 0x561d2a053aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:07.279 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.254+0000 7f1feb678740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561d2a04a010 0x561d2a053fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:07.279 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.254+0000 7f1feb678740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561d2a056ba0 0x561d2a054520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:07.279 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.254+0000 7f1feb678740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561d2a059770 con 0x561d2a0496f0 2024-08-19T00:24:07.279 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.254+0000 7f1feb678740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x561d29f69520 con 0x561d2a04a010 2024-08-19T00:24:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.254+0000 7f1feb678740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x561d2a0598f0 con 0x561d2a056ba0 2024-08-19T00:24:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.254+0000 7f1feb678740 10 client.0 _ll_register_callbacks cb 0x561d29cc0a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-19T00:24:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.254+0000 7f1fe1d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d2a0496f0 0x561d2a053aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.254+0000 7f1fe1d9b640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d2a0496f0 0x561d2a053aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43594/0 (socket says 172.21.15.44:43594) 2024-08-19T00:24:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.254+0000 7f1fe1d9b640 1 -- 172.21.15.44:0/3450592672 learned_addr learned my addr 172.21.15.44:0/3450592672 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:24:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.254+0000 7f1fe1d9b640 1 --2- 172.21.15.44:0/3450592672 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561d2a056ba0 0x561d2a054520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.254+0000 7f1fe259c640 1 --2- 172.21.15.44:0/3450592672 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561d2a04a010 0x561d2a053fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.254+0000 7f1fe1d9b640 1 -- 172.21.15.44:0/3450592672 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561d2a056ba0 msgr2=0x561d2a054520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:24:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.254+0000 7f1fe1d9b640 1 --2- 172.21.15.44:0/3450592672 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561d2a056ba0 0x561d2a054520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.254+0000 7f1fe1d9b640 1 -- 172.21.15.44:0/3450592672 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561d2a04a010 msgr2=0x561d2a053fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-19T00:24:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.254+0000 7f1fe1d9b640 1 --2- 172.21.15.44:0/3450592672 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561d2a04a010 0x561d2a053fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.254+0000 7f1fe1d9b640 1 -- 172.21.15.44:0/3450592672 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d29d8d620 con 0x561d2a0496f0 2024-08-19T00:24:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.254+0000 7f1fe1d9b640 1 --2- 172.21.15.44:0/3450592672 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d2a0496f0 0x561d2a053aa0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f1fd8005bd0 tx=0x7f1fd8011280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beff9b1c0244fb33 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:24:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.254+0000 7f1fc9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-08-19T00:24:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.255+0000 7f1fc9ffb640 1 -- 172.21.15.44:0/3450592672 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fd8019070 con 0x561d2a0496f0 2024-08-19T00:24:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.255+0000 7f1feb678740 1 -- 172.21.15.44:0/3450592672 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1fd80110d0 con 0x561d2a0496f0 2024-08-19T00:24:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.255+0000 7f1fc9ffb640 1 -- 172.21.15.44:0/3450592672 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 9621+0+0 (secure 0 0 0) 0x7f1fd8005450 con 0x561d2a0496f0 2024-08-19T00:24:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.255+0000 7f1fc9ffb640 1 -- 172.21.15.44:0/3450592672 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f1fd8005650 con 0x561d2a0496f0 2024-08-19T00:24:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.255+0000 7f1feb678740 10 client.16872 fetch_fsmap learned FSMap version 33 2024-08-19T00:24:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.255+0000 7f1feb678740 1 -- 172.21.15.44:0/3450592672 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x561d2a065410 con 0x561d2a0496f0 2024-08-19T00:24:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.255+0000 7f1fc9ffb640 1 -- 172.21.15.44:0/3450592672 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1fd80110d0 con 0x561d2a0496f0 2024-08-19T00:24:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.255+0000 7f1fc9ffb640 1 -- 172.21.15.44:0/3450592672 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f1fd800f9c0 con 0x561d2a0496f0 2024-08-19T00:24:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.255+0000 7f1feb678740 10 client.16872 fetch_fsmap finished waiting for FSMap version 33 2024-08-19T00:24:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.255+0000 7f1feb678740 10 client.16872 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-19T00:24:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.255+0000 7f1feb678740 20 client.16872 populate_metadata read hostname 'smithi044' 2024-08-19T00:24:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.255+0000 7f1feb678740 1 --2- 172.21.15.44:0/3450592672 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x561d2a066880 0x561d2a068c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.255+0000 7f1feb678740 4 client.16872 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-19T00:24:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.255+0000 7f1feb678740 1 -- 172.21.15.44:0/3450592672 --> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561d29fbb100 con 0x561d2a066880 2024-08-19T00:24:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.255+0000 7f1fe259c640 1 --2- 172.21.15.44:0/3450592672 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x561d2a066880 0x561d2a068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.256+0000 7f1fe259c640 1 --2- 172.21.15.44:0/3450592672 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x561d2a066880 0x561d2a068c70 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ed395f9eee90c02 server_cookie=7c4ba15ea1755fb in_seq=0 out_seq=0 2024-08-19T00:24:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.256+0000 7f1fc9ffb640 10 client.16872 ms_handle_connect on v2:172.21.15.116:6838/1032741033 2024-08-19T00:24:07.284 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.256+0000 7f1fc9ffb640 1 -- 172.21.15.44:0/3450592672 <== mds.0 v2:172.21.15.116:6838/1032741033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561d29fbb100 con 0x561d2a066880 2024-08-19T00:24:07.284 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.256+0000 7f1fc9ffb640 10 client.16872 handle_command_reply: tid=0 2024-08-19T00:24:07.284 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.256+0000 7f1feb678740 1 client.16872 shutdown 2024-08-19T00:24:07.284 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.256+0000 7f1feb678740 1 -- 172.21.15.44:0/3450592672 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d2a0496f0 msgr2=0x561d2a053aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:07.284 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.256+0000 7f1feb678740 1 --2- 172.21.15.44:0/3450592672 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d2a0496f0 0x561d2a053aa0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f1fd8005bd0 tx=0x7f1fd8011280 comp rx=0 tx=0).stop 2024-08-19T00:24:07.284 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.257+0000 7f1feb678740 1 -- 172.21.15.44:0/3450592672 shutdown_connections 2024-08-19T00:24:07.284 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.257+0000 7f1feb678740 1 --2- 172.21.15.44:0/3450592672 >> [v2:172.21.15.116:6838/1032741033,v1:172.21.15.116:6839/1032741033] conn(0x561d2a066880 0x561d2a068c70 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:07.284 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.257+0000 7f1feb678740 1 --2- 172.21.15.44:0/3450592672 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561d2a056ba0 0x561d2a054520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:07.285 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.257+0000 7f1feb678740 1 --2- 172.21.15.44:0/3450592672 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561d2a04a010 0x561d2a053fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:07.285 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.257+0000 7f1feb678740 1 --2- 172.21.15.44:0/3450592672 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d2a0496f0 0x561d2a053aa0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:07.285 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.257+0000 7f1fc9ffb640 0 client.16872 ms_handle_reset on v2:172.21.15.116:6838/1032741033 2024-08-19T00:24:07.285 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.257+0000 7f1feb678740 1 -- 172.21.15.44:0/3450592672 >> 172.21.15.44:0/3450592672 conn(0x561d2a045d40 msgr2=0x561d2a044ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:24:07.285 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.257+0000 7f1feb678740 1 -- 172.21.15.44:0/3450592672 shutdown_connections 2024-08-19T00:24:07.285 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.257+0000 7f1feb678740 1 -- 172.21.15.44:0/3450592672 wait complete. 2024-08-19T00:24:07.286 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.257+0000 7f1feb678740 20 client.16872 trim_cache size 0 max 16384 2024-08-19T00:24:07.286 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.271+0000 7f1feb678740 1 Processor -- start 2024-08-19T00:24:07.286 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.271+0000 7f1feb678740 1 -- start start 2024-08-19T00:24:07.286 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.271+0000 7f1feb678740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561d2a0496f0 0x561d2a06e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:07.286 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.271+0000 7f1feb678740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561d2a04a010 0x561d2a06e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:07.286 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.271+0000 7f1feb678740 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561d2a056ba0 0x561d2a053a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:07.286 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.271+0000 7f1feb678740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1fe41acc80 con 0x561d2a04a010 2024-08-19T00:24:07.287 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.271+0000 7f1feb678740 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f1fe41ae7c0 con 0x561d2a056ba0 2024-08-19T00:24:07.287 INFO:teuthology.task.background_exec.ubuntu@smithi044.front.sepia.ceph.com.smithi044.stderr:2024-08-19T00:24:07.271+0000 7f1feb678740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1fe41ad350 con 0x561d2a0496f0 2024-08-19T00:24:07.288 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-08-19T00:24:07.304 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-08-19T00:24:07.305 INFO:teuthology.task.exec:Executing custom commands... 2024-08-19T00:24:07.305 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi044.front.sepia.ceph.com 2024-08-19T00:24:07.305 DEBUG:teuthology.orchestra.run.smithi044:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-08-19T00:24:07.357 DEBUG:teuthology.orchestra.run.smithi044:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-08-19T00:24:07.427 DEBUG:teuthology.orchestra.run.smithi044:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-08-19T00:24:07.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.568+0000 7fb7a5477640 1 -- 172.21.15.44:0/653094189 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7a0100710 msgr2=0x7fb7a0100b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:07.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.568+0000 7fb7a5477640 1 --2- 172.21.15.44:0/653094189 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7a0100710 0x7fb7a0100b70 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fb788009930 tx=0x7fb78802a420 comp rx=0 tx=0).stop 2024-08-19T00:24:07.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.568+0000 7fb7a5477640 1 -- 172.21.15.44:0/653094189 shutdown_connections 2024-08-19T00:24:07.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.568+0000 7fb7a5477640 1 --2- 172.21.15.44:0/653094189 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb7a01010b0 0x7fb7a010d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:07.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.568+0000 7fb7a5477640 1 --2- 172.21.15.44:0/653094189 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7a0100710 0x7fb7a0100b70 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:07.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.568+0000 7fb7a5477640 1 --2- 172.21.15.44:0/653094189 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7a0106720 0x7fb7a0106b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:07.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.568+0000 7fb7a5477640 1 -- 172.21.15.44:0/653094189 >> 172.21.15.44:0/653094189 conn(0x7fb7a00fc3f0 msgr2=0x7fb7a00fe810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:24:07.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.568+0000 7fb7a5477640 1 -- 172.21.15.44:0/653094189 shutdown_connections 2024-08-19T00:24:07.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.568+0000 7fb7a5477640 1 -- 172.21.15.44:0/653094189 wait complete. 2024-08-19T00:24:07.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.569+0000 7fb7a5477640 1 Processor -- start 2024-08-19T00:24:07.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.569+0000 7fb7a5477640 1 -- start start 2024-08-19T00:24:07.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.569+0000 7fb7a5477640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7a0100710 0x7fb7a019a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:07.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.569+0000 7fb7a5477640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7a01010b0 0x7fb7a019a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:07.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.569+0000 7fb7a5477640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb7a0106720 0x7fb7a019ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:07.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.569+0000 7fb7a5477640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a0110bb0 con 0x7fb7a0100710 2024-08-19T00:24:07.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.569+0000 7fb7a5477640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a0110a30 con 0x7fb7a0106720 2024-08-19T00:24:07.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.569+0000 7fb7a5477640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a0110d30 con 0x7fb7a01010b0 2024-08-19T00:24:07.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.569+0000 7fb79effd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7a0100710 0x7fb7a019a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:07.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.569+0000 7fb79effd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7a0100710 0x7fb7a019a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43632/0 (socket says 172.21.15.44:43632) 2024-08-19T00:24:07.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.569+0000 7fb79effd640 1 -- 172.21.15.44:0/746129457 learned_addr learned my addr 172.21.15.44:0/746129457 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:24:07.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.569+0000 7fb79f7fe640 1 --2- 172.21.15.44:0/746129457 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb7a0106720 0x7fb7a019ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:07.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.569+0000 7fb797fff640 1 --2- 172.21.15.44:0/746129457 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7a01010b0 0x7fb7a019a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:07.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.569+0000 7fb79effd640 1 -- 172.21.15.44:0/746129457 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7a01010b0 msgr2=0x7fb7a019a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:07.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.569+0000 7fb79effd640 1 --2- 172.21.15.44:0/746129457 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7a01010b0 0x7fb7a019a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:07.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.569+0000 7fb79effd640 1 -- 172.21.15.44:0/746129457 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb7a0106720 msgr2=0x7fb7a019ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:07.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.569+0000 7fb79effd640 1 --2- 172.21.15.44:0/746129457 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb7a0106720 0x7fb7a019ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:07.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.569+0000 7fb79effd640 1 -- 172.21.15.44:0/746129457 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7a019f2e0 con 0x7fb7a0100710 2024-08-19T00:24:07.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.569+0000 7fb797fff640 1 --2- 172.21.15.44:0/746129457 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7a01010b0 0x7fb7a019a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:24:07.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.570+0000 7fb79effd640 1 --2- 172.21.15.44:0/746129457 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7a0100710 0x7fb7a019a2f0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fb79000d950 tx=0x7fb79000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:24:07.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.570+0000 7fb79cff9640 1 -- 172.21.15.44:0/746129457 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb790017070 con 0x7fb7a0100710 2024-08-19T00:24:07.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.570+0000 7fb7a5477640 1 -- 172.21.15.44:0/746129457 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7a019f5d0 con 0x7fb7a0100710 2024-08-19T00:24:07.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.570+0000 7fb79cff9640 1 -- 172.21.15.44:0/746129457 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb790009c30 con 0x7fb7a0100710 2024-08-19T00:24:07.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.570+0000 7fb79cff9640 1 -- 172.21.15.44:0/746129457 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb79000f6b0 con 0x7fb7a0100710 2024-08-19T00:24:07.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.570+0000 7fb7a5477640 1 -- 172.21.15.44:0/746129457 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7a01a6e60 con 0x7fb7a0100710 2024-08-19T00:24:07.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.571+0000 7fb7a5477640 1 -- 172.21.15.44:0/746129457 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7a0100b70 con 0x7fb7a0100710 2024-08-19T00:24:07.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.572+0000 7fb79cff9640 1 -- 172.21.15.44:0/746129457 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fb7900109d0 con 0x7fb7a0100710 2024-08-19T00:24:07.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.573+0000 7fb79cff9640 1 --2- 172.21.15.44:0/746129457 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fb78c0a2da0 0x7fb78c0a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:07.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.573+0000 7fb797fff640 1 --2- 172.21.15.44:0/746129457 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fb78c0a2da0 0x7fb78c0a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:07.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.573+0000 7fb79cff9640 1 -- 172.21.15.44:0/746129457 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 9621+0+0 (secure 0 0 0) 0x7fb7900cf4a0 con 0x7fb7a0100710 2024-08-19T00:24:07.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.573+0000 7fb797fff640 1 --2- 172.21.15.44:0/746129457 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fb78c0a2da0 0x7fb78c0a5260 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb788006010 tx=0x7fb788005a20 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:24:07.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.577+0000 7fb79cff9640 1 -- 172.21.15.44:0/746129457 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fb790009de0 con 0x7fb7a0100710 2024-08-19T00:24:07.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.772+0000 7fb7a5477640 1 -- 172.21.15.44:0/746129457 --> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7fb7a006a7e0 con 0x7fb78c0a2da0 2024-08-19T00:24:07.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.781+0000 7fb79cff9640 1 -- 172.21.15.44:0/746129457 <== mgr.15297 v2:172.21.15.44:6800/1029670730 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7fb7a006a7e0 con 0x7fb78c0a2da0 2024-08-19T00:24:07.783 INFO:teuthology.orchestra.run.smithi044.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-08-19T00:00:00", "created": "2024-08-19T00:13:21", "first": "2024-08-19T00:14:00", "last": "2024-08-19T00:24:00", "last_pruned": "2024-08-19T00:24:00", "created_count": 11, "pruned_count": 5, "active": true} 2024-08-19T00:24:07.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.783+0000 7fb7a5477640 1 -- 172.21.15.44:0/746129457 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fb78c0a2da0 msgr2=0x7fb78c0a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:07.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.783+0000 7fb7a5477640 1 --2- 172.21.15.44:0/746129457 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fb78c0a2da0 0x7fb78c0a5260 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb788006010 tx=0x7fb788005a20 comp rx=0 tx=0).stop 2024-08-19T00:24:07.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.783+0000 7fb7a5477640 1 -- 172.21.15.44:0/746129457 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7a0100710 msgr2=0x7fb7a019a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:07.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.783+0000 7fb7a5477640 1 --2- 172.21.15.44:0/746129457 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7a0100710 0x7fb7a019a2f0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fb79000d950 tx=0x7fb79000de10 comp rx=0 tx=0).stop 2024-08-19T00:24:07.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.783+0000 7fb7a5477640 1 -- 172.21.15.44:0/746129457 shutdown_connections 2024-08-19T00:24:07.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.783+0000 7fb7a5477640 1 --2- 172.21.15.44:0/746129457 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fb78c0a2da0 0x7fb78c0a5260 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:07.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.783+0000 7fb7a5477640 1 --2- 172.21.15.44:0/746129457 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7a01010b0 0x7fb7a019a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:07.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.783+0000 7fb7a5477640 1 --2- 172.21.15.44:0/746129457 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb7a0106720 0x7fb7a019ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:07.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.783+0000 7fb7a5477640 1 --2- 172.21.15.44:0/746129457 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7a0100710 0x7fb7a019a2f0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:07.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.783+0000 7fb7a5477640 1 -- 172.21.15.44:0/746129457 >> 172.21.15.44:0/746129457 conn(0x7fb7a00fc3f0 msgr2=0x7fb7a006a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:24:07.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.783+0000 7fb7a5477640 1 -- 172.21.15.44:0/746129457 shutdown_connections 2024-08-19T00:24:07.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.783+0000 7fb7a5477640 1 -- 172.21.15.44:0/746129457 wait complete. 2024-08-19T00:24:07.795 DEBUG:teuthology.orchestra.run.smithi044:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-08-19T00:24:07.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.896+0000 7fa74189d640 1 -- 172.21.15.44:0/2302145405 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa73c106710 msgr2=0x7fa73c106af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:07.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.896+0000 7fa74189d640 1 --2- 172.21.15.44:0/2302145405 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa73c106710 0x7fa73c106af0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fa72c009930 tx=0x7fa72c02a420 comp rx=0 tx=0).stop 2024-08-19T00:24:07.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.896+0000 7fa74189d640 1 -- 172.21.15.44:0/2302145405 shutdown_connections 2024-08-19T00:24:07.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.896+0000 7fa74189d640 1 --2- 172.21.15.44:0/2302145405 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa73c1010a0 0x7fa73c10d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:07.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.896+0000 7fa74189d640 1 --2- 172.21.15.44:0/2302145405 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa73c100700 0x7fa73c100b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:07.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.896+0000 7fa74189d640 1 --2- 172.21.15.44:0/2302145405 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa73c106710 0x7fa73c106af0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:07.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.896+0000 7fa74189d640 1 -- 172.21.15.44:0/2302145405 >> 172.21.15.44:0/2302145405 conn(0x7fa73c0fc420 msgr2=0x7fa73c0fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:24:07.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.896+0000 7fa74189d640 1 -- 172.21.15.44:0/2302145405 shutdown_connections 2024-08-19T00:24:07.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.896+0000 7fa74189d640 1 -- 172.21.15.44:0/2302145405 wait complete. 2024-08-19T00:24:07.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.896+0000 7fa74189d640 1 Processor -- start 2024-08-19T00:24:07.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.897+0000 7fa74189d640 1 -- start start 2024-08-19T00:24:07.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.897+0000 7fa74189d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa73c100700 0x7fa73c1980f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:07.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.897+0000 7fa74189d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa73c1010a0 0x7fa73c198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:07.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.897+0000 7fa74189d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa73c106710 0x7fa73c19c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:07.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.897+0000 7fa74189d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa73c111c60 con 0x7fa73c106710 2024-08-19T00:24:07.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.897+0000 7fa74189d640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fa73c111ae0 con 0x7fa73c1010a0 2024-08-19T00:24:07.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.897+0000 7fa74189d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa73c111de0 con 0x7fa73c100700 2024-08-19T00:24:07.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.897+0000 7fa73b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa73c106710 0x7fa73c19c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:07.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.897+0000 7fa73b7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa73c106710 0x7fa73c19c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43646/0 (socket says 172.21.15.44:43646) 2024-08-19T00:24:07.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.897+0000 7fa73b7fe640 1 -- 172.21.15.44:0/1946405623 learned_addr learned my addr 172.21.15.44:0/1946405623 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:24:07.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.897+0000 7fa73affd640 1 --2- 172.21.15.44:0/1946405623 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa73c100700 0x7fa73c1980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:07.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.897+0000 7fa73a7fc640 1 --2- 172.21.15.44:0/1946405623 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa73c1010a0 0x7fa73c198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:07.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.897+0000 7fa73b7fe640 1 -- 172.21.15.44:0/1946405623 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa73c100700 msgr2=0x7fa73c1980f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:07.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.897+0000 7fa73b7fe640 1 --2- 172.21.15.44:0/1946405623 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa73c100700 0x7fa73c1980f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:07.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.897+0000 7fa73b7fe640 1 -- 172.21.15.44:0/1946405623 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa73c1010a0 msgr2=0x7fa73c198630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:07.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.897+0000 7fa73b7fe640 1 --2- 172.21.15.44:0/1946405623 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa73c1010a0 0x7fa73c198630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:07.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.897+0000 7fa73b7fe640 1 -- 172.21.15.44:0/1946405623 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa73c19d0e0 con 0x7fa73c106710 2024-08-19T00:24:07.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.897+0000 7fa73affd640 1 --2- 172.21.15.44:0/1946405623 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa73c100700 0x7fa73c1980f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:24:07.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.897+0000 7fa73b7fe640 1 --2- 172.21.15.44:0/1946405623 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa73c106710 0x7fa73c19c9b0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fa73400eaa0 tx=0x7fa73400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:24:07.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.898+0000 7fa74089b640 1 -- 172.21.15.44:0/1946405623 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa73400cdb0 con 0x7fa73c106710 2024-08-19T00:24:07.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.898+0000 7fa74089b640 1 -- 172.21.15.44:0/1946405623 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa734005020 con 0x7fa73c106710 2024-08-19T00:24:07.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.898+0000 7fa74189d640 1 -- 172.21.15.44:0/1946405623 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa73c19d3d0 con 0x7fa73c106710 2024-08-19T00:24:07.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.898+0000 7fa74089b640 1 -- 172.21.15.44:0/1946405623 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7340116b0 con 0x7fa73c106710 2024-08-19T00:24:07.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.898+0000 7fa74189d640 1 -- 172.21.15.44:0/1946405623 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa73c1a4c60 con 0x7fa73c106710 2024-08-19T00:24:07.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.899+0000 7fa74189d640 1 -- 172.21.15.44:0/1946405623 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa73c100b60 con 0x7fa73c106710 2024-08-19T00:24:07.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.900+0000 7fa74089b640 1 -- 172.21.15.44:0/1946405623 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fa734005560 con 0x7fa73c106710 2024-08-19T00:24:07.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.900+0000 7fa74089b640 1 --2- 172.21.15.44:0/1946405623 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fa7240a2da0 0x7fa7240a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:07.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.900+0000 7fa73affd640 1 --2- 172.21.15.44:0/1946405623 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fa7240a2da0 0x7fa7240a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:07.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.901+0000 7fa74089b640 1 -- 172.21.15.44:0/1946405623 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 9621+0+0 (secure 0 0 0) 0x7fa7340cff00 con 0x7fa73c106710 2024-08-19T00:24:07.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.901+0000 7fa73affd640 1 --2- 172.21.15.44:0/1946405623 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fa7240a2da0 0x7fa7240a5260 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa72c000c00 tx=0x7fa72c005a20 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:24:07.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:07.903+0000 7fa74089b640 1 -- 172.21.15.44:0/1946405623 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fa734016030 con 0x7fa73c106710 2024-08-19T00:24:08.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.101+0000 7fa74189d640 1 -- 172.21.15.44:0/1946405623 --> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7fa73c0fd2a0 con 0x7fa7240a2da0 2024-08-19T00:24:08.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.110+0000 7fa74089b640 1 -- 172.21.15.44:0/1946405623 <== mgr.15297 v2:172.21.15.44:6800/1029670730 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7fa73c0fd2a0 con 0x7fa7240a2da0 2024-08-19T00:24:08.112 INFO:teuthology.orchestra.run.smithi044.stdout:/ 1m 6m3h 2024-08-19T00:24:08.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.112+0000 7fa74189d640 1 -- 172.21.15.44:0/1946405623 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fa7240a2da0 msgr2=0x7fa7240a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:08.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.112+0000 7fa74189d640 1 --2- 172.21.15.44:0/1946405623 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fa7240a2da0 0x7fa7240a5260 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa72c000c00 tx=0x7fa72c005a20 comp rx=0 tx=0).stop 2024-08-19T00:24:08.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.112+0000 7fa74189d640 1 -- 172.21.15.44:0/1946405623 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa73c106710 msgr2=0x7fa73c19c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:08.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.112+0000 7fa74189d640 1 --2- 172.21.15.44:0/1946405623 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa73c106710 0x7fa73c19c9b0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fa73400eaa0 tx=0x7fa73400ef60 comp rx=0 tx=0).stop 2024-08-19T00:24:08.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.112+0000 7fa74189d640 1 -- 172.21.15.44:0/1946405623 shutdown_connections 2024-08-19T00:24:08.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.112+0000 7fa74189d640 1 --2- 172.21.15.44:0/1946405623 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fa7240a2da0 0x7fa7240a5260 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:08.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.112+0000 7fa74189d640 1 --2- 172.21.15.44:0/1946405623 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa73c106710 0x7fa73c19c9b0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:08.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.112+0000 7fa74189d640 1 --2- 172.21.15.44:0/1946405623 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa73c1010a0 0x7fa73c198630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:08.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.112+0000 7fa74189d640 1 --2- 172.21.15.44:0/1946405623 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa73c100700 0x7fa73c1980f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:08.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.112+0000 7fa74189d640 1 -- 172.21.15.44:0/1946405623 >> 172.21.15.44:0/1946405623 conn(0x7fa73c0fc420 msgr2=0x7fa73c0fcb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:24:08.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.112+0000 7fa74189d640 1 -- 172.21.15.44:0/1946405623 shutdown_connections 2024-08-19T00:24:08.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.112+0000 7fa74189d640 1 -- 172.21.15.44:0/1946405623 wait complete. 2024-08-19T00:24:08.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:07 smithi044 ceph-mon[18489]: pgmap v335: 129 pgs: 129 active+clean; 546 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.6 MiB/s wr, 181 op/s 2024-08-19T00:24:08.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:07 smithi044 ceph-mon[18489]: osdmap e104: 12 total, 12 up, 12 in 2024-08-19T00:24:08.124 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-08-19T00:24:08.136 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-19T00:24:08.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.236+0000 7f76bcc6e640 1 -- 172.21.15.44:0/750100911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f76b8107920 msgr2=0x7f76b8107d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:08.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.236+0000 7f76bcc6e640 1 --2- 172.21.15.44:0/750100911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f76b8107920 0x7f76b8107d00 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f76a8009900 tx=0x7f76a802a410 comp rx=0 tx=0).stop 2024-08-19T00:24:08.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.236+0000 7f76bcc6e640 1 -- 172.21.15.44:0/750100911 shutdown_connections 2024-08-19T00:24:08.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.236+0000 7f76bcc6e640 1 --2- 172.21.15.44:0/750100911 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76b80ffd00 0x7f76b8100160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:08.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.236+0000 7f76bcc6e640 1 --2- 172.21.15.44:0/750100911 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f76b81006a0 0x7f76b810e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:08.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.236+0000 7f76bcc6e640 1 --2- 172.21.15.44:0/750100911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f76b8107920 0x7f76b8107d00 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:08.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.236+0000 7f76bcc6e640 1 -- 172.21.15.44:0/750100911 >> 172.21.15.44:0/750100911 conn(0x7f76b8076ed0 msgr2=0x7f76b80fe220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:24:08.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.236+0000 7f76bcc6e640 1 -- 172.21.15.44:0/750100911 shutdown_connections 2024-08-19T00:24:08.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.236+0000 7f76bcc6e640 1 -- 172.21.15.44:0/750100911 wait complete. 2024-08-19T00:24:08.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.237+0000 7f76bcc6e640 1 Processor -- start 2024-08-19T00:24:08.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.237+0000 7f76bcc6e640 1 -- start start 2024-08-19T00:24:08.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.237+0000 7f76bcc6e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f76b80ffd00 0x7f76b81980f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:08.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.237+0000 7f76bcc6e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76b81006a0 0x7f76b8198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:08.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.237+0000 7f76bcc6e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f76b8107920 0x7f76b819c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:08.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.237+0000 7f76bcc6e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f76b8111c20 con 0x7f76b80ffd00 2024-08-19T00:24:08.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.237+0000 7f76bcc6e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f76b8111aa0 con 0x7f76b8107920 2024-08-19T00:24:08.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.237+0000 7f76bcc6e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f76b8111da0 con 0x7f76b81006a0 2024-08-19T00:24:08.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.237+0000 7f76b659c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f76b80ffd00 0x7f76b81980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:08.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.237+0000 7f76b659c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f76b80ffd00 0x7f76b81980f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43660/0 (socket says 172.21.15.44:43660) 2024-08-19T00:24:08.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.237+0000 7f76b659c640 1 -- 172.21.15.44:0/2054000321 learned_addr learned my addr 172.21.15.44:0/2054000321 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:24:08.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.237+0000 7f76b6d9d640 1 --2- 172.21.15.44:0/2054000321 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f76b8107920 0x7f76b819c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:08.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.237+0000 7f76b659c640 1 -- 172.21.15.44:0/2054000321 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76b81006a0 msgr2=0x7f76b8198630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:08.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.237+0000 7f76b5d9b640 1 --2- 172.21.15.44:0/2054000321 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76b81006a0 0x7f76b8198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:08.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.237+0000 7f76b659c640 1 --2- 172.21.15.44:0/2054000321 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76b81006a0 0x7f76b8198630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:08.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.237+0000 7f76b659c640 1 -- 172.21.15.44:0/2054000321 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f76b8107920 msgr2=0x7f76b819c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:08.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.237+0000 7f76b659c640 1 --2- 172.21.15.44:0/2054000321 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f76b8107920 0x7f76b819c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:08.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.238+0000 7f76b659c640 1 -- 172.21.15.44:0/2054000321 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76b819d0e0 con 0x7f76b80ffd00 2024-08-19T00:24:08.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.238+0000 7f76b659c640 1 --2- 172.21.15.44:0/2054000321 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f76b80ffd00 0x7f76b81980f0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f76a8006010 tx=0x7f76a80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:24:08.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.238+0000 7f76af7fe640 1 -- 172.21.15.44:0/2054000321 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76a803f030 con 0x7f76b80ffd00 2024-08-19T00:24:08.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.238+0000 7f76af7fe640 1 -- 172.21.15.44:0/2054000321 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76a8003ce0 con 0x7f76b80ffd00 2024-08-19T00:24:08.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.238+0000 7f76bcc6e640 1 -- 172.21.15.44:0/2054000321 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76b819d370 con 0x7f76b80ffd00 2024-08-19T00:24:08.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.238+0000 7f76af7fe640 1 -- 172.21.15.44:0/2054000321 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76a8035070 con 0x7f76b80ffd00 2024-08-19T00:24:08.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.238+0000 7f76bcc6e640 1 -- 172.21.15.44:0/2054000321 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76b81a4c60 con 0x7f76b80ffd00 2024-08-19T00:24:08.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.239+0000 7f76bcc6e640 1 -- 172.21.15.44:0/2054000321 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76b8100160 con 0x7f76b80ffd00 2024-08-19T00:24:08.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.240+0000 7f76af7fe640 1 -- 172.21.15.44:0/2054000321 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f76a8042030 con 0x7f76b80ffd00 2024-08-19T00:24:08.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.241+0000 7f76af7fe640 1 --2- 172.21.15.44:0/2054000321 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f76a40a2d00 0x7f76a40a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:08.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.241+0000 7f76b5d9b640 1 --2- 172.21.15.44:0/2054000321 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f76a40a2d00 0x7f76a40a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:08.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.241+0000 7f76af7fe640 1 -- 172.21.15.44:0/2054000321 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 9621+0+0 (secure 0 0 0) 0x7f76a80efe60 con 0x7f76b80ffd00 2024-08-19T00:24:08.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.241+0000 7f76b5d9b640 1 --2- 172.21.15.44:0/2054000321 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f76a40a2d00 0x7f76a40a51c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f76b80fde30 tx=0x7f76a0005c60 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:24:08.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.245+0000 7f76af7fe640 1 -- 172.21.15.44:0/2054000321 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f76a80bc6f0 con 0x7f76b80ffd00 2024-08-19T00:24:08.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:07 smithi171 ceph-mon[21810]: pgmap v335: 129 pgs: 129 active+clean; 546 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.6 MiB/s wr, 181 op/s 2024-08-19T00:24:08.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:07 smithi171 ceph-mon[21810]: osdmap e104: 12 total, 12 up, 12 in 2024-08-19T00:24:08.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:07 smithi116 ceph-mon[21873]: pgmap v335: 129 pgs: 129 active+clean; 546 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.6 MiB/s wr, 181 op/s 2024-08-19T00:24:08.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:07 smithi116 ceph-mon[21873]: osdmap e104: 12 total, 12 up, 12 in 2024-08-19T00:24:08.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.422+0000 7f76bcc6e640 1 -- 172.21.15.44:0/2054000321 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f76b8109ca0 con 0x7f76b80ffd00 2024-08-19T00:24:08.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.424+0000 7f76af7fe640 1 -- 172.21.15.44:0/2054000321 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v104) ==== 74+0+25498 (secure 0 0 0) 0x7f76a80bbff0 con 0x7f76b80ffd00 2024-08-19T00:24:08.426 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:24:08.426 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":104,"fsid":"647ded64-5dbe-11ef-bccf-c7b262605968","created":"2024-08-19T00:03:43.667929+0000","modified":"2024-08-19T00:24:06.978442+0000","last_up_change":"2024-08-19T00:10:01.557590+0000","last_in_change":"2024-08-19T00:09:42.433933+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T00:06:42.706553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-19T00:10:48.735065+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-19T00:10:51.481810+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":104,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-19T00:10:58.013004+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":104,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b15ad904-d07d-4ecb-be8f-d99323425eed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":600251465},{"type":"v1","addr":"172.21.15.44:6803","nonce":600251465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":600251465},{"type":"v1","addr":"172.21.15.44:6805","nonce":600251465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":600251465},{"type":"v1","addr":"172.21.15.44:6809","nonce":600251465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":600251465},{"type":"v1","addr":"172.21.15.44:6807","nonce":600251465}]},"public_addr":"172.21.15.44:6803/600251465","cluster_addr":"172.21.15.44:6805/600251465","heartbeat_back_addr":"172.21.15.44:6809/600251465","heartbeat_front_addr":"172.21.15.44:6807/600251465","state":["exists","up"]},{"osd":1,"uuid":"8f70512f-21a3-4fec-8278-04b2bc9b2d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":613509556},{"type":"v1","addr":"172.21.15.116:6801","nonce":613509556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":613509556},{"type":"v1","addr":"172.21.15.116:6803","nonce":613509556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":613509556},{"type":"v1","addr":"172.21.15.116:6807","nonce":613509556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":613509556},{"type":"v1","addr":"172.21.15.116:6805","nonce":613509556}]},"public_addr":"172.21.15.116:6801/613509556","cluster_addr":"172.21.15.116:6803/613509556","heartbeat_back_addr":"172.21.15.116:6807/613509556","heartbeat_front_addr":"172.21.15.116:6805/613509556","state":["exists","up"]},{"osd":2,"uuid":"56994dfd-5fcf-4d82-addf-38764239d82a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2130938937},{"type":"v1","addr":"172.21.15.171:6801","nonce":2130938937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2130938937},{"type":"v1","addr":"172.21.15.171:6803","nonce":2130938937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2130938937},{"type":"v1","addr":"172.21.15.171:6807","nonce":2130938937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2130938937},{"type":"v1","addr":"172.21.15.171:6805","nonce":2130938937}]},"public_addr":"172.21.15.171:6801/2130938937","cluster_addr":"172.21.15.171:6803/2130938937","heartbeat_back_addr":"172.21.15.171:6807/2130938937","heartbeat_front_addr":"172.21.15.171:6805/2130938937","state":["exists","up"]},{"osd":3,"uuid":"6d2ddb19-74e0-4e68-b9ea-58b73fd1e9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":3537027669},{"type":"v1","addr":"172.21.15.44:6811","nonce":3537027669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":3537027669},{"type":"v1","addr":"172.21.15.44:6813","nonce":3537027669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3537027669},{"type":"v1","addr":"172.21.15.44:6817","nonce":3537027669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":3537027669},{"type":"v1","addr":"172.21.15.44:6815","nonce":3537027669}]},"public_addr":"172.21.15.44:6811/3537027669","cluster_addr":"172.21.15.44:6813/3537027669","heartbeat_back_addr":"172.21.15.44:6817/3537027669","heartbeat_front_addr":"172.21.15.44:6815/3537027669","state":["exists","up"]},{"osd":4,"uuid":"190d208e-ae54-497d-ad72-d07a5a26991b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":3768627455},{"type":"v1","addr":"172.21.15.116:6809","nonce":3768627455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":3768627455},{"type":"v1","addr":"172.21.15.116:6811","nonce":3768627455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":3768627455},{"type":"v1","addr":"172.21.15.116:6815","nonce":3768627455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":3768627455},{"type":"v1","addr":"172.21.15.116:6813","nonce":3768627455}]},"public_addr":"172.21.15.116:6809/3768627455","cluster_addr":"172.21.15.116:6811/3768627455","heartbeat_back_addr":"172.21.15.116:6815/3768627455","heartbeat_front_addr":"172.21.15.116:6813/3768627455","state":["exists","up"]},{"osd":5,"uuid":"d8afacad-6d3d-4703-9744-8d01ff2a2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":938785018},{"type":"v1","addr":"172.21.15.171:6809","nonce":938785018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":938785018},{"type":"v1","addr":"172.21.15.171:6811","nonce":938785018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":938785018},{"type":"v1","addr":"172.21.15.171:6815","nonce":938785018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":938785018},{"type":"v1","addr":"172.21.15.171:6813","nonce":938785018}]},"public_addr":"172.21.15.171:6809/938785018","cluster_addr":"172.21.15.171:6811/938785018","heartbeat_back_addr":"172.21.15.171:6815/938785018","heartbeat_front_addr":"172.21.15.171:6813/938785018","state":["exists","up"]},{"osd":6,"uuid":"55bf1f89-99e5-409d-99fa-f0124aa042df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":1219334797},{"type":"v1","addr":"172.21.15.44:6819","nonce":1219334797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":1219334797},{"type":"v1","addr":"172.21.15.44:6821","nonce":1219334797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":1219334797},{"type":"v1","addr":"172.21.15.44:6825","nonce":1219334797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":1219334797},{"type":"v1","addr":"172.21.15.44:6823","nonce":1219334797}]},"public_addr":"172.21.15.44:6819/1219334797","cluster_addr":"172.21.15.44:6821/1219334797","heartbeat_back_addr":"172.21.15.44:6825/1219334797","heartbeat_front_addr":"172.21.15.44:6823/1219334797","state":["exists","up"]},{"osd":7,"uuid":"70130d71-d28c-4a58-b603-75610c8d3ea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":3861873415},{"type":"v1","addr":"172.21.15.116:6817","nonce":3861873415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":3861873415},{"type":"v1","addr":"172.21.15.116:6819","nonce":3861873415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":3861873415},{"type":"v1","addr":"172.21.15.116:6823","nonce":3861873415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":3861873415},{"type":"v1","addr":"172.21.15.116:6821","nonce":3861873415}]},"public_addr":"172.21.15.116:6817/3861873415","cluster_addr":"172.21.15.116:6819/3861873415","heartbeat_back_addr":"172.21.15.116:6823/3861873415","heartbeat_front_addr":"172.21.15.116:6821/3861873415","state":["exists","up"]},{"osd":8,"uuid":"c5121f70-e423-4f86-a3c6-90945c9385f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":843701060},{"type":"v1","addr":"172.21.15.171:6817","nonce":843701060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":843701060},{"type":"v1","addr":"172.21.15.171:6819","nonce":843701060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":843701060},{"type":"v1","addr":"172.21.15.171:6823","nonce":843701060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":843701060},{"type":"v1","addr":"172.21.15.171:6821","nonce":843701060}]},"public_addr":"172.21.15.171:6817/843701060","cluster_addr":"172.21.15.171:6819/843701060","heartbeat_back_addr":"172.21.15.171:6823/843701060","heartbeat_front_addr":"172.21.15.171:6821/843701060","state":["exists","up"]},{"osd":9,"uuid":"cd13693a-0f25-47cc-b1a5-9c42481935ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3206550013},{"type":"v1","addr":"172.21.15.44:6827","nonce":3206550013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":3206550013},{"type":"v1","addr":"172.21.15.44:6829","nonce":3206550013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3206550013},{"type":"v1","addr":"172.21.15.44:6833","nonce":3206550013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3206550013},{"type":"v1","addr":"172.21.15.44:6831","nonce":3206550013}]},"public_addr":"172.21.15.44:6827/3206550013","cluster_addr":"172.21.15.44:6829/3206550013","heartbeat_back_addr":"172.21.15.44:6833/3206550013","heartbeat_front_addr":"172.21.15.44:6831/3206550013","state":["exists","up"]},{"osd":10,"uuid":"a36ffeb1-6ecf-4899-bdfa-18515afefb86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3034738363},{"type":"v1","addr":"172.21.15.116:6825","nonce":3034738363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3034738363},{"type":"v1","addr":"172.21.15.116:6827","nonce":3034738363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3034738363},{"type":"v1","addr":"172.21.15.116:6831","nonce":3034738363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3034738363},{"type":"v1","addr":"172.21.15.116:6829","nonce":3034738363}]},"public_addr":"172.21.15.116:6825/3034738363","cluster_addr":"172.21.15.116:6827/3034738363","heartbeat_back_addr":"172.21.15.116:6831/3034738363","heartbeat_front_addr":"172.21.15.116:6829/3034738363","state":["exists","up"]},{"osd":11,"uuid":"ffcf44a8-3094-4a29-822e-a6ce95da119e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1500842656},{"type":"v1","addr":"172.21.15.171:6825","nonce":1500842656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1500842656},{"type":"v1","addr":"172.21.15.171:6827","nonce":1500842656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1500842656},{"type":"v1","addr":"172.21.15.171:6831","nonce":1500842656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1500842656},{"type":"v1","addr":"172.21.15.171:6829","nonce":1500842656}]},"public_addr":"172.21.15.171:6825/1500842656","cluster_addr":"172.21.15.171:6827/1500842656","heartbeat_back_addr":"172.21.15.171:6831/1500842656","heartbeat_front_addr":"172.21.15.171:6829/1500842656","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:05:56.916127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:06:17.603805+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:06:38.642970+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:07:00.667062+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:07:22.542529+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:07:44.732304+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:08:07.050742+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:08:29.451498+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:08:52.222169+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:09:15.422629+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:09:37.295311+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:09:59.716431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":7}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9},{"from":5,"to":8}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:0/1732405694":"2024-08-20T00:13:18.502685+0000","172.21.15.44:0/2504116080":"2024-08-20T00:13:18.502685+0000","172.21.15.44:6800/1374527587":"2024-08-20T00:04:14.604141+0000","172.21.15.44:0/1869412718":"2024-08-20T00:04:14.604141+0000","172.21.15.44:0/3023439260":"2024-08-20T00:13:18.502685+0000","172.21.15.44:0/911382683":"2024-08-20T00:04:14.604141+0000","172.21.15.44:0/3096491642":"2024-08-20T00:04:14.604141+0000","172.21.15.44:0/400419582":"2024-08-20T00:04:38.392912+0000","172.21.15.44:0/3800526625":"2024-08-20T00:04:38.392912+0000","172.21.15.44:6801/1374527587":"2024-08-20T00:04:14.604141+0000","172.21.15.44:0/1001446555":"2024-08-20T00:04:38.392912+0000","172.21.15.44:0/3489931602":"2024-08-20T00:13:18.502685+0000","172.21.15.44:6800/1330072146":"2024-08-20T00:13:18.502685+0000","172.21.15.44:6801/1300308907":"2024-08-20T00:04:38.392912+0000","172.21.15.44:6800/1300308907":"2024-08-20T00:04:38.392912+0000","172.21.15.44:6801/1330072146":"2024-08-20T00:13:18.502685+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]},{"pool":4,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"new_removed_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]},{"pool":4,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:24:08.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.426+0000 7f76bcc6e640 1 -- 172.21.15.44:0/2054000321 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f76a40a2d00 msgr2=0x7f76a40a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:08.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.426+0000 7f76bcc6e640 1 --2- 172.21.15.44:0/2054000321 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f76a40a2d00 0x7f76a40a51c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f76b80fde30 tx=0x7f76a0005c60 comp rx=0 tx=0).stop 2024-08-19T00:24:08.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.426+0000 7f76bcc6e640 1 -- 172.21.15.44:0/2054000321 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f76b80ffd00 msgr2=0x7f76b81980f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:08.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.426+0000 7f76bcc6e640 1 --2- 172.21.15.44:0/2054000321 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f76b80ffd00 0x7f76b81980f0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f76a8006010 tx=0x7f76a80042f0 comp rx=0 tx=0).stop 2024-08-19T00:24:08.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.426+0000 7f76bcc6e640 1 -- 172.21.15.44:0/2054000321 shutdown_connections 2024-08-19T00:24:08.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.426+0000 7f76bcc6e640 1 --2- 172.21.15.44:0/2054000321 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f76a40a2d00 0x7f76a40a51c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:08.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.426+0000 7f76bcc6e640 1 --2- 172.21.15.44:0/2054000321 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76b81006a0 0x7f76b8198630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:08.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.426+0000 7f76bcc6e640 1 --2- 172.21.15.44:0/2054000321 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f76b8107920 0x7f76b819c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:08.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.426+0000 7f76bcc6e640 1 --2- 172.21.15.44:0/2054000321 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f76b80ffd00 0x7f76b81980f0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:08.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.426+0000 7f76bcc6e640 1 -- 172.21.15.44:0/2054000321 >> 172.21.15.44:0/2054000321 conn(0x7f76b8076ed0 msgr2=0x7f76b80fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:24:08.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.426+0000 7f76bcc6e640 1 -- 172.21.15.44:0/2054000321 shutdown_connections 2024-08-19T00:24:08.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.426+0000 7f76bcc6e640 1 -- 172.21.15.44:0/2054000321 wait complete. 2024-08-19T00:24:08.439 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-19T00:06:42.706553+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-19T00:10:48.735065+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-19T00:10:51.481810+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '104', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 17, 'snap_epoch': 104, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-08-19T00:10:58.013004+0000', 'flags': 8197, 'flags_names': 'hashpspool,ec_overwrites,selfmanaged_snaps', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '104', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 17, 'snap_epoch': 104, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-19T00:24:08.440 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-19T00:24:08.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.542+0000 7fc15d7bf640 1 -- 172.21.15.44:0/1282272308 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc158103340 msgr2=0x7fc15810b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:08.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.542+0000 7fc15d7bf640 1 --2- 172.21.15.44:0/1282272308 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc158103340 0x7fc15810b820 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fc14c009900 tx=0x7fc14c02a480 comp rx=0 tx=0).stop 2024-08-19T00:24:08.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.542+0000 7fc15d7bf640 1 -- 172.21.15.44:0/1282272308 shutdown_connections 2024-08-19T00:24:08.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.542+0000 7fc15d7bf640 1 --2- 172.21.15.44:0/1282272308 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc15810bdf0 0x7fc15810e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:08.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.542+0000 7fc15d7bf640 1 --2- 172.21.15.44:0/1282272308 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc158103340 0x7fc15810b820 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:08.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.542+0000 7fc15d7bf640 1 --2- 172.21.15.44:0/1282272308 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc158102a20 0x7fc158102e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:08.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.542+0000 7fc15d7bf640 1 -- 172.21.15.44:0/1282272308 >> 172.21.15.44:0/1282272308 conn(0x7fc158077700 msgr2=0x7fc1580feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:24:08.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.542+0000 7fc15d7bf640 1 -- 172.21.15.44:0/1282272308 shutdown_connections 2024-08-19T00:24:08.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.542+0000 7fc15d7bf640 1 -- 172.21.15.44:0/1282272308 wait complete. 2024-08-19T00:24:08.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.543+0000 7fc15d7bf640 1 Processor -- start 2024-08-19T00:24:08.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.543+0000 7fc15d7bf640 1 -- start start 2024-08-19T00:24:08.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.543+0000 7fc15d7bf640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc158102a20 0x7fc1581980b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:08.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.543+0000 7fc15d7bf640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc158103340 0x7fc1581985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:08.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.543+0000 7fc15d7bf640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc15810bdf0 0x7fc15819c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:08.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.543+0000 7fc15d7bf640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc158111c10 con 0x7fc158103340 2024-08-19T00:24:08.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.543+0000 7fc15d7bf640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fc158111a90 con 0x7fc158102a20 2024-08-19T00:24:08.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.543+0000 7fc15d7bf640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc158111d90 con 0x7fc15810bdf0 2024-08-19T00:24:08.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.543+0000 7fc1567fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc158103340 0x7fc1581985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:08.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.543+0000 7fc1567fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc158103340 0x7fc1581985f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43686/0 (socket says 172.21.15.44:43686) 2024-08-19T00:24:08.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.543+0000 7fc1567fc640 1 -- 172.21.15.44:0/4116507622 learned_addr learned my addr 172.21.15.44:0/4116507622 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:24:08.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.544+0000 7fc156ffd640 1 --2- 172.21.15.44:0/4116507622 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc158102a20 0x7fc1581980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:08.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.544+0000 7fc1577fe640 1 --2- 172.21.15.44:0/4116507622 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc15810bdf0 0x7fc15819c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:08.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.544+0000 7fc1567fc640 1 -- 172.21.15.44:0/4116507622 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc15810bdf0 msgr2=0x7fc15819c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:08.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.544+0000 7fc1567fc640 1 --2- 172.21.15.44:0/4116507622 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc15810bdf0 0x7fc15819c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:08.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.544+0000 7fc1567fc640 1 -- 172.21.15.44:0/4116507622 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc158102a20 msgr2=0x7fc1581980b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:08.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.544+0000 7fc1567fc640 1 --2- 172.21.15.44:0/4116507622 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc158102a20 0x7fc1581980b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:08.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.544+0000 7fc1567fc640 1 -- 172.21.15.44:0/4116507622 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc15819d0a0 con 0x7fc158103340 2024-08-19T00:24:08.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.544+0000 7fc1567fc640 1 --2- 172.21.15.44:0/4116507622 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc158103340 0x7fc1581985f0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fc14c004770 tx=0x7fc14c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:24:08.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.544+0000 7fc13ffff640 1 -- 172.21.15.44:0/4116507622 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc14c03f070 con 0x7fc158103340 2024-08-19T00:24:08.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.544+0000 7fc13ffff640 1 -- 172.21.15.44:0/4116507622 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc14c031ca0 con 0x7fc158103340 2024-08-19T00:24:08.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.544+0000 7fc13ffff640 1 -- 172.21.15.44:0/4116507622 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc14c035030 con 0x7fc158103340 2024-08-19T00:24:08.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.544+0000 7fc15d7bf640 1 -- 172.21.15.44:0/4116507622 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc15819d330 con 0x7fc158103340 2024-08-19T00:24:08.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.544+0000 7fc15d7bf640 1 -- 172.21.15.44:0/4116507622 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1581a4c20 con 0x7fc158103340 2024-08-19T00:24:08.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.545+0000 7fc15d7bf640 1 -- 172.21.15.44:0/4116507622 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc158102e00 con 0x7fc158103340 2024-08-19T00:24:08.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.546+0000 7fc13ffff640 1 -- 172.21.15.44:0/4116507622 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fc14c042070 con 0x7fc158103340 2024-08-19T00:24:08.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.547+0000 7fc13ffff640 1 --2- 172.21.15.44:0/4116507622 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fc1400a2d00 0x7fc1400a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:08.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.547+0000 7fc13ffff640 1 -- 172.21.15.44:0/4116507622 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 9621+0+0 (secure 0 0 0) 0x7fc14c0f04c0 con 0x7fc158103340 2024-08-19T00:24:08.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.547+0000 7fc156ffd640 1 --2- 172.21.15.44:0/4116507622 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fc1400a2d00 0x7fc1400a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:08.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.548+0000 7fc156ffd640 1 --2- 172.21.15.44:0/4116507622 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fc1400a2d00 0x7fc1400a51c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc148005fd0 tx=0x7fc148009870 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:24:08.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.550+0000 7fc13ffff640 1 -- 172.21.15.44:0/4116507622 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fc14c0bcda0 con 0x7fc158103340 2024-08-19T00:24:08.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.727+0000 7fc15d7bf640 1 -- 172.21.15.44:0/4116507622 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc158106e70 con 0x7fc158103340 2024-08-19T00:24:08.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.728+0000 7fc13ffff640 1 -- 172.21.15.44:0/4116507622 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v104) ==== 93+0+10 (secure 0 0 0) 0x7fc14c0bc6a0 con 0x7fc158103340 2024-08-19T00:24:08.730 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-08-19T00:24:08.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.730+0000 7fc15d7bf640 1 -- 172.21.15.44:0/4116507622 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fc1400a2d00 msgr2=0x7fc1400a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:08.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.730+0000 7fc15d7bf640 1 --2- 172.21.15.44:0/4116507622 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fc1400a2d00 0x7fc1400a51c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc148005fd0 tx=0x7fc148009870 comp rx=0 tx=0).stop 2024-08-19T00:24:08.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.730+0000 7fc15d7bf640 1 -- 172.21.15.44:0/4116507622 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc158103340 msgr2=0x7fc1581985f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:08.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.730+0000 7fc15d7bf640 1 --2- 172.21.15.44:0/4116507622 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc158103340 0x7fc1581985f0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fc14c004770 tx=0x7fc14c003c10 comp rx=0 tx=0).stop 2024-08-19T00:24:08.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.730+0000 7fc15d7bf640 1 -- 172.21.15.44:0/4116507622 shutdown_connections 2024-08-19T00:24:08.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.730+0000 7fc15d7bf640 1 --2- 172.21.15.44:0/4116507622 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fc1400a2d00 0x7fc1400a51c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:08.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.730+0000 7fc15d7bf640 1 --2- 172.21.15.44:0/4116507622 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc15810bdf0 0x7fc15819c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:08.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.730+0000 7fc15d7bf640 1 --2- 172.21.15.44:0/4116507622 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc158103340 0x7fc1581985f0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:08.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.730+0000 7fc15d7bf640 1 --2- 172.21.15.44:0/4116507622 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc158102a20 0x7fc1581980b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:08.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.730+0000 7fc15d7bf640 1 -- 172.21.15.44:0/4116507622 >> 172.21.15.44:0/4116507622 conn(0x7fc158077700 msgr2=0x7fc1580fcee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:24:08.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.730+0000 7fc15d7bf640 1 -- 172.21.15.44:0/4116507622 shutdown_connections 2024-08-19T00:24:08.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.730+0000 7fc15d7bf640 1 -- 172.21.15.44:0/4116507622 wait complete. 2024-08-19T00:24:08.743 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-19T00:24:08.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.845+0000 7fefb697a640 1 -- 172.21.15.44:0/1743269750 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefb01032a0 msgr2=0x7fefb010b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:08.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.845+0000 7fefb697a640 1 --2- 172.21.15.44:0/1743269750 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefb01032a0 0x7fefb010b780 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fefa4009900 tx=0x7fefa402a480 comp rx=0 tx=0).stop 2024-08-19T00:24:08.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.845+0000 7fefb697a640 1 -- 172.21.15.44:0/1743269750 shutdown_connections 2024-08-19T00:24:08.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.845+0000 7fefb697a640 1 --2- 172.21.15.44:0/1743269750 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fefb010bdd0 0x7fefb010e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:08.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.845+0000 7fefb697a640 1 --2- 172.21.15.44:0/1743269750 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefb01032a0 0x7fefb010b780 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:08.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.845+0000 7fefb697a640 1 --2- 172.21.15.44:0/1743269750 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fefb0102980 0x7fefb0102d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:08.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.845+0000 7fefb697a640 1 -- 172.21.15.44:0/1743269750 >> 172.21.15.44:0/1743269750 conn(0x7fefb00fc390 msgr2=0x7fefb00fe7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:24:08.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.845+0000 7fefb697a640 1 -- 172.21.15.44:0/1743269750 shutdown_connections 2024-08-19T00:24:08.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.845+0000 7fefb697a640 1 -- 172.21.15.44:0/1743269750 wait complete. 2024-08-19T00:24:08.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.846+0000 7fefb697a640 1 Processor -- start 2024-08-19T00:24:08.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.846+0000 7fefb697a640 1 -- start start 2024-08-19T00:24:08.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.846+0000 7fefb697a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fefb0102980 0x7fefb01005d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:08.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.846+0000 7fefb697a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefb01032a0 0x7fefb0100b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:08.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.846+0000 7fefb697a640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fefb010bdd0 0x7fefb0101050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:08.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.847+0000 7fefb697a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fefb0111c00 con 0x7fefb01032a0 2024-08-19T00:24:08.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.847+0000 7fefb697a640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fefb0111a80 con 0x7fefb0102980 2024-08-19T00:24:08.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.847+0000 7fefb697a640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fefb0111d80 con 0x7fefb010bdd0 2024-08-19T00:24:08.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.847+0000 7fefaf7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefb01032a0 0x7fefb0100b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:08.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.847+0000 7fefaf7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefb01032a0 0x7fefb0100b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53260/0 (socket says 172.21.15.44:53260) 2024-08-19T00:24:08.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.847+0000 7fefaf7fe640 1 -- 172.21.15.44:0/3886830477 learned_addr learned my addr 172.21.15.44:0/3886830477 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:24:08.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.847+0000 7fefb4f17640 1 --2- 172.21.15.44:0/3886830477 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fefb010bdd0 0x7fefb0101050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:08.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.847+0000 7fefaffff640 1 --2- 172.21.15.44:0/3886830477 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fefb0102980 0x7fefb01005d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:08.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.847+0000 7fefaf7fe640 1 -- 172.21.15.44:0/3886830477 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fefb010bdd0 msgr2=0x7fefb0101050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:08.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.847+0000 7fefaf7fe640 1 --2- 172.21.15.44:0/3886830477 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fefb010bdd0 0x7fefb0101050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:08.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.847+0000 7fefaf7fe640 1 -- 172.21.15.44:0/3886830477 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fefb0102980 msgr2=0x7fefb01005d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:08.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.847+0000 7fefaf7fe640 1 --2- 172.21.15.44:0/3886830477 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fefb0102980 0x7fefb01005d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:08.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.847+0000 7fefaf7fe640 1 -- 172.21.15.44:0/3886830477 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefb01a65d0 con 0x7fefb01032a0 2024-08-19T00:24:08.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.847+0000 7fefaf7fe640 1 --2- 172.21.15.44:0/3886830477 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefb01032a0 0x7fefb0100b10 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fefa4004770 tx=0x7fefa4003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:24:08.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.847+0000 7fefad7fa640 1 -- 172.21.15.44:0/3886830477 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa403f070 con 0x7fefb01032a0 2024-08-19T00:24:08.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.847+0000 7fefad7fa640 1 -- 172.21.15.44:0/3886830477 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fefa4031ca0 con 0x7fefb01032a0 2024-08-19T00:24:08.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.847+0000 7fefb697a640 1 -- 172.21.15.44:0/3886830477 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefb01a6860 con 0x7fefb01032a0 2024-08-19T00:24:08.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.847+0000 7fefad7fa640 1 -- 172.21.15.44:0/3886830477 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa4035030 con 0x7fefb01032a0 2024-08-19T00:24:08.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.847+0000 7fefb697a640 1 -- 172.21.15.44:0/3886830477 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefb01a6d50 con 0x7fefb01032a0 2024-08-19T00:24:08.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.848+0000 7fefb697a640 1 -- 172.21.15.44:0/3886830477 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefb0102d60 con 0x7fefb01032a0 2024-08-19T00:24:08.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.850+0000 7fefad7fa640 1 -- 172.21.15.44:0/3886830477 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fefa4042070 con 0x7fefb01032a0 2024-08-19T00:24:08.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.850+0000 7fefad7fa640 1 --2- 172.21.15.44:0/3886830477 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fef980a2d00 0x7fef980a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:08.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.850+0000 7fefaffff640 1 --2- 172.21.15.44:0/3886830477 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fef980a2d00 0x7fef980a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:08.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.850+0000 7fefad7fa640 1 -- 172.21.15.44:0/3886830477 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 9621+0+0 (secure 0 0 0) 0x7fefa40f0510 con 0x7fefb01032a0 2024-08-19T00:24:08.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.851+0000 7fefaffff640 1 --2- 172.21.15.44:0/3886830477 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fef980a2d00 0x7fef980a51c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fefa0005fd0 tx=0x7fefa0005850 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:24:08.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:08.853+0000 7fefad7fa640 1 -- 172.21.15.44:0/3886830477 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fefa40bcd80 con 0x7fefb01032a0 2024-08-19T00:24:08.993 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:08 smithi044 ceph-mon[18489]: from='client.16878 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:24:08.993 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:08 smithi044 ceph-mon[18489]: from='client.16884 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:24:08.993 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:08 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/2054000321' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-19T00:24:08.993 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:08 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/4116507622' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-08-19T00:24:09.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.032+0000 7fefb697a640 1 -- 172.21.15.44:0/3886830477 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fefb0106e20 con 0x7fefb01032a0 2024-08-19T00:24:09.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.032+0000 7fefad7fa640 1 -- 172.21.15.44:0/3886830477 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v104) ==== 104+0+11 (secure 0 0 0) 0x7fefa40bc680 con 0x7fefb01032a0 2024-08-19T00:24:09.034 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-08-19T00:24:09.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.034+0000 7fefb697a640 1 -- 172.21.15.44:0/3886830477 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fef980a2d00 msgr2=0x7fef980a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:09.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.034+0000 7fefb697a640 1 --2- 172.21.15.44:0/3886830477 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fef980a2d00 0x7fef980a51c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fefa0005fd0 tx=0x7fefa0005850 comp rx=0 tx=0).stop 2024-08-19T00:24:09.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.034+0000 7fefb697a640 1 -- 172.21.15.44:0/3886830477 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefb01032a0 msgr2=0x7fefb0100b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:09.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.034+0000 7fefb697a640 1 --2- 172.21.15.44:0/3886830477 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefb01032a0 0x7fefb0100b10 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fefa4004770 tx=0x7fefa4003c10 comp rx=0 tx=0).stop 2024-08-19T00:24:09.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.034+0000 7fefb697a640 1 -- 172.21.15.44:0/3886830477 shutdown_connections 2024-08-19T00:24:09.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.034+0000 7fefb697a640 1 --2- 172.21.15.44:0/3886830477 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fef980a2d00 0x7fef980a51c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:09.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.034+0000 7fefb697a640 1 --2- 172.21.15.44:0/3886830477 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fefb010bdd0 0x7fefb0101050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:09.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.034+0000 7fefb697a640 1 --2- 172.21.15.44:0/3886830477 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefb01032a0 0x7fefb0100b10 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:09.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.034+0000 7fefb697a640 1 --2- 172.21.15.44:0/3886830477 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fefb0102980 0x7fefb01005d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:09.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.034+0000 7fefb697a640 1 -- 172.21.15.44:0/3886830477 >> 172.21.15.44:0/3886830477 conn(0x7fefb00fc390 msgr2=0x7fefb00fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:24:09.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.035+0000 7fefb697a640 1 -- 172.21.15.44:0/3886830477 shutdown_connections 2024-08-19T00:24:09.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.035+0000 7fefb697a640 1 -- 172.21.15.44:0/3886830477 wait complete. 2024-08-19T00:24:09.047 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-19T00:24:09.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.149+0000 7f9107f68640 1 -- 172.21.15.44:0/2565624159 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91001006e0 msgr2=0x7f9100100b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:09.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.149+0000 7f9107f68640 1 --2- 172.21.15.44:0/2565624159 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91001006e0 0x7f9100100b40 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f90f0009930 tx=0x7f90f002a420 comp rx=0 tx=0).stop 2024-08-19T00:24:09.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.150+0000 7f9107f68640 1 -- 172.21.15.44:0/2565624159 shutdown_connections 2024-08-19T00:24:09.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.150+0000 7f9107f68640 1 --2- 172.21.15.44:0/2565624159 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9100101080 0x7f910010d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:09.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.150+0000 7f9107f68640 1 --2- 172.21.15.44:0/2565624159 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91001006e0 0x7f9100100b40 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:09.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.150+0000 7f9107f68640 1 --2- 172.21.15.44:0/2565624159 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91001066f0 0x7f9100106ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:09.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.150+0000 7f9107f68640 1 -- 172.21.15.44:0/2565624159 >> 172.21.15.44:0/2565624159 conn(0x7f91000fc3c0 msgr2=0x7f91000fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:24:09.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.150+0000 7f9107f68640 1 -- 172.21.15.44:0/2565624159 shutdown_connections 2024-08-19T00:24:09.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.150+0000 7f9107f68640 1 -- 172.21.15.44:0/2565624159 wait complete. 2024-08-19T00:24:09.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.150+0000 7f9107f68640 1 Processor -- start 2024-08-19T00:24:09.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.150+0000 7f9107f68640 1 -- start start 2024-08-19T00:24:09.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.150+0000 7f9107f68640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91001006e0 0x7f9100196e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:09.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.150+0000 7f9107f68640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9100101080 0x7f9100197340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:09.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.150+0000 7f9107f68640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f91001066f0 0x7f9100197880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:09.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.150+0000 7f9107f68640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9100110b80 con 0x7f91001006e0 2024-08-19T00:24:09.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.150+0000 7f9107f68640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f9100110a00 con 0x7f91001066f0 2024-08-19T00:24:09.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.150+0000 7f9107f68640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9100110d00 con 0x7f9100101080 2024-08-19T00:24:09.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.151+0000 7f9105d04640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91001006e0 0x7f9100196e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:09.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.151+0000 7f9105d04640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91001006e0 0x7f9100196e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53282/0 (socket says 172.21.15.44:53282) 2024-08-19T00:24:09.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.151+0000 7f9105d04640 1 -- 172.21.15.44:0/844557977 learned_addr learned my addr 172.21.15.44:0/844557977 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:24:09.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.151+0000 7f9105d04640 1 -- 172.21.15.44:0/844557977 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9100101080 msgr2=0x7f9100197340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:09.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.151+0000 7f9106505640 1 --2- 172.21.15.44:0/844557977 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f91001066f0 0x7f9100197880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:09.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.151+0000 7f9105503640 1 --2- 172.21.15.44:0/844557977 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9100101080 0x7f9100197340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:09.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.151+0000 7f9105d04640 1 --2- 172.21.15.44:0/844557977 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9100101080 0x7f9100197340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:09.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.151+0000 7f9105d04640 1 -- 172.21.15.44:0/844557977 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f91001066f0 msgr2=0x7f9100197880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:09.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.151+0000 7f9105d04640 1 --2- 172.21.15.44:0/844557977 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f91001066f0 0x7f9100197880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:09.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.151+0000 7f9105d04640 1 -- 172.21.15.44:0/844557977 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91001a6670 con 0x7f91001006e0 2024-08-19T00:24:09.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.151+0000 7f9106505640 1 --2- 172.21.15.44:0/844557977 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f91001066f0 0x7f9100197880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:24:09.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.151+0000 7f9105d04640 1 --2- 172.21.15.44:0/844557977 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91001006e0 0x7f9100196e00 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f90fc00d770 tx=0x7f90fc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:24:09.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.151+0000 7f90f6ffd640 1 -- 172.21.15.44:0/844557977 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90fc017070 con 0x7f91001006e0 2024-08-19T00:24:09.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.151+0000 7f90f6ffd640 1 -- 172.21.15.44:0/844557977 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90fc005500 con 0x7f91001006e0 2024-08-19T00:24:09.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.151+0000 7f9107f68640 1 -- 172.21.15.44:0/844557977 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91001a6960 con 0x7f91001006e0 2024-08-19T00:24:09.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.151+0000 7f90f6ffd640 1 -- 172.21.15.44:0/844557977 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90fc004e00 con 0x7f91001006e0 2024-08-19T00:24:09.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.151+0000 7f9107f68640 1 -- 172.21.15.44:0/844557977 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91001a6e60 con 0x7f91001006e0 2024-08-19T00:24:09.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.152+0000 7f9107f68640 1 -- 172.21.15.44:0/844557977 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9100100b40 con 0x7f91001006e0 2024-08-19T00:24:09.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.154+0000 7f90f6ffd640 1 -- 172.21.15.44:0/844557977 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f90fc004fa0 con 0x7f91001006e0 2024-08-19T00:24:09.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.154+0000 7f90f6ffd640 1 --2- 172.21.15.44:0/844557977 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f90ec0a2d00 0x7f90ec0a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:09.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.154+0000 7f9105503640 1 --2- 172.21.15.44:0/844557977 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f90ec0a2d00 0x7f90ec0a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:09.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.154+0000 7f90f6ffd640 1 -- 172.21.15.44:0/844557977 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 9621+0+0 (secure 0 0 0) 0x7f90fc0cf750 con 0x7f91001006e0 2024-08-19T00:24:09.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.155+0000 7f9105503640 1 --2- 172.21.15.44:0/844557977 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f90ec0a2d00 0x7f90ec0a51c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f90f00096c0 tx=0x7f90f0005fd0 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:24:09.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.158+0000 7f90f6ffd640 1 -- 172.21.15.44:0/844557977 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f90fc09bf20 con 0x7f91001006e0 2024-08-19T00:24:09.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.331+0000 7f9107f68640 1 -- 172.21.15.44:0/844557977 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f910002d5e0 con 0x7f91001006e0 2024-08-19T00:24:09.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.332+0000 7f90f6ffd640 1 -- 172.21.15.44:0/844557977 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v104) ==== 100+0+11 (secure 0 0 0) 0x7f90fc09b820 con 0x7f91001006e0 2024-08-19T00:24:09.334 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-08-19T00:24:09.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.334+0000 7f9107f68640 1 -- 172.21.15.44:0/844557977 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f90ec0a2d00 msgr2=0x7f90ec0a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:09.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.334+0000 7f9107f68640 1 --2- 172.21.15.44:0/844557977 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f90ec0a2d00 0x7f90ec0a51c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f90f00096c0 tx=0x7f90f0005fd0 comp rx=0 tx=0).stop 2024-08-19T00:24:09.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.334+0000 7f9107f68640 1 -- 172.21.15.44:0/844557977 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91001006e0 msgr2=0x7f9100196e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:09.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.334+0000 7f9107f68640 1 --2- 172.21.15.44:0/844557977 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91001006e0 0x7f9100196e00 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f90fc00d770 tx=0x7f90fc00dc30 comp rx=0 tx=0).stop 2024-08-19T00:24:09.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.334+0000 7f9107f68640 1 -- 172.21.15.44:0/844557977 shutdown_connections 2024-08-19T00:24:09.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.334+0000 7f9107f68640 1 --2- 172.21.15.44:0/844557977 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f90ec0a2d00 0x7f90ec0a51c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:09.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.334+0000 7f9107f68640 1 --2- 172.21.15.44:0/844557977 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9100101080 0x7f9100197340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:09.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.334+0000 7f9107f68640 1 --2- 172.21.15.44:0/844557977 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f91001066f0 0x7f9100197880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:09.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.334+0000 7f9107f68640 1 --2- 172.21.15.44:0/844557977 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91001006e0 0x7f9100196e00 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:09.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.334+0000 7f9107f68640 1 -- 172.21.15.44:0/844557977 >> 172.21.15.44:0/844557977 conn(0x7f91000fc3c0 msgr2=0x7f91000fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:24:09.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.334+0000 7f9107f68640 1 -- 172.21.15.44:0/844557977 shutdown_connections 2024-08-19T00:24:09.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.334+0000 7f9107f68640 1 -- 172.21.15.44:0/844557977 wait complete. 2024-08-19T00:24:09.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:08 smithi171 ceph-mon[21810]: from='client.16878 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:24:09.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:08 smithi171 ceph-mon[21810]: from='client.16884 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:24:09.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:08 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/2054000321' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-19T00:24:09.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:08 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/4116507622' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-08-19T00:24:09.347 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-08-19T00:24:09.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:08 smithi116 ceph-mon[21873]: from='client.16878 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:24:09.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:08 smithi116 ceph-mon[21873]: from='client.16884 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:24:09.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:08 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/2054000321' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-19T00:24:09.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:08 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/4116507622' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-08-19T00:24:09.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.449+0000 7f81a14cb640 1 -- 172.21.15.44:0/1706177337 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f819c1077e0 msgr2=0x7f819c107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:09.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.449+0000 7f81a14cb640 1 --2- 172.21.15.44:0/1706177337 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f819c1077e0 0x7f819c107bc0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f818c009930 tx=0x7f818c02a420 comp rx=0 tx=0).stop 2024-08-19T00:24:09.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.449+0000 7f81a14cb640 1 -- 172.21.15.44:0/1706177337 shutdown_connections 2024-08-19T00:24:09.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.449+0000 7f81a14cb640 1 --2- 172.21.15.44:0/1706177337 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f819c1017d0 0x7f819c101c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:09.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.449+0000 7f81a14cb640 1 --2- 172.21.15.44:0/1706177337 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f819c102170 0x7f819c10e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:09.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.449+0000 7f81a14cb640 1 --2- 172.21.15.44:0/1706177337 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f819c1077e0 0x7f819c107bc0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:09.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.449+0000 7f81a14cb640 1 -- 172.21.15.44:0/1706177337 >> 172.21.15.44:0/1706177337 conn(0x7f819c0fd510 msgr2=0x7f819c0ff930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:24:09.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.449+0000 7f81a14cb640 1 -- 172.21.15.44:0/1706177337 shutdown_connections 2024-08-19T00:24:09.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.449+0000 7f81a14cb640 1 -- 172.21.15.44:0/1706177337 wait complete. 2024-08-19T00:24:09.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.450+0000 7f81a14cb640 1 Processor -- start 2024-08-19T00:24:09.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.450+0000 7f81a14cb640 1 -- start start 2024-08-19T00:24:09.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.450+0000 7f81a14cb640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f819c1017d0 0x7f819c198160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:09.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.450+0000 7f81a14cb640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f819c102170 0x7f819c1986a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:09.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.450+0000 7f81a14cb640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f819c1077e0 0x7f819c19ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:09.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.450+0000 7f81a14cb640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f819c111c70 con 0x7f819c1017d0 2024-08-19T00:24:09.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.450+0000 7f81a14cb640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f819c111af0 con 0x7f819c1077e0 2024-08-19T00:24:09.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.450+0000 7f81a14cb640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f819c111df0 con 0x7f819c102170 2024-08-19T00:24:09.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.450+0000 7f819affd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f819c1017d0 0x7f819c198160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:09.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.450+0000 7f819affd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f819c1017d0 0x7f819c198160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53298/0 (socket says 172.21.15.44:53298) 2024-08-19T00:24:09.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.450+0000 7f819affd640 1 -- 172.21.15.44:0/2531738966 learned_addr learned my addr 172.21.15.44:0/2531738966 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:24:09.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.450+0000 7f819b7fe640 1 --2- 172.21.15.44:0/2531738966 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f819c1077e0 0x7f819c19ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:09.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.450+0000 7f8193fff640 1 --2- 172.21.15.44:0/2531738966 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f819c102170 0x7f819c1986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:09.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.450+0000 7f819affd640 1 -- 172.21.15.44:0/2531738966 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f819c102170 msgr2=0x7f819c1986a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:09.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.450+0000 7f819affd640 1 --2- 172.21.15.44:0/2531738966 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f819c102170 0x7f819c1986a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:09.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.450+0000 7f819affd640 1 -- 172.21.15.44:0/2531738966 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f819c1077e0 msgr2=0x7f819c19ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:09.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.450+0000 7f819affd640 1 --2- 172.21.15.44:0/2531738966 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f819c1077e0 0x7f819c19ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:09.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.450+0000 7f819affd640 1 -- 172.21.15.44:0/2531738966 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f819c19d150 con 0x7f819c1017d0 2024-08-19T00:24:09.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.450+0000 7f8193fff640 1 --2- 172.21.15.44:0/2531738966 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f819c102170 0x7f819c1986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:24:09.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.451+0000 7f819affd640 1 --2- 172.21.15.44:0/2531738966 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f819c1017d0 0x7f819c198160 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f818c02a940 tx=0x7f818c003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:24:09.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.451+0000 7f8198ff9640 1 -- 172.21.15.44:0/2531738966 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f818c03f070 con 0x7f819c1017d0 2024-08-19T00:24:09.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.451+0000 7f8198ff9640 1 -- 172.21.15.44:0/2531738966 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f818c031c90 con 0x7f819c1017d0 2024-08-19T00:24:09.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.451+0000 7f8198ff9640 1 -- 172.21.15.44:0/2531738966 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f818c035030 con 0x7f819c1017d0 2024-08-19T00:24:09.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.451+0000 7f81a14cb640 1 -- 172.21.15.44:0/2531738966 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f819c19d3e0 con 0x7f819c1017d0 2024-08-19T00:24:09.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.451+0000 7f81a14cb640 1 -- 172.21.15.44:0/2531738966 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f819c1a4cd0 con 0x7f819c1017d0 2024-08-19T00:24:09.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.452+0000 7f81a14cb640 1 -- 172.21.15.44:0/2531738966 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f819c101c30 con 0x7f819c1017d0 2024-08-19T00:24:09.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.453+0000 7f8198ff9640 1 -- 172.21.15.44:0/2531738966 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f818c042070 con 0x7f819c1017d0 2024-08-19T00:24:09.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.453+0000 7f8198ff9640 1 --2- 172.21.15.44:0/2531738966 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f81880a2d80 0x7f81880a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:09.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.454+0000 7f8193fff640 1 --2- 172.21.15.44:0/2531738966 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f81880a2d80 0x7f81880a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:09.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.454+0000 7f8198ff9640 1 -- 172.21.15.44:0/2531738966 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 9621+0+0 (secure 0 0 0) 0x7f818c0f0070 con 0x7f819c1017d0 2024-08-19T00:24:09.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.454+0000 7f8193fff640 1 --2- 172.21.15.44:0/2531738966 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f81880a2d80 0x7f81880a5240 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f819c100c10 tx=0x7f8184005e50 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:24:09.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.458+0000 7f8198ff9640 1 -- 172.21.15.44:0/2531738966 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f818c0bc840 con 0x7f819c1017d0 2024-08-19T00:24:09.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.637+0000 7f81a14cb640 1 -- 172.21.15.44:0/2531738966 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f819c109d40 con 0x7f819c1017d0 2024-08-19T00:24:09.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.637+0000 7f8198ff9640 1 -- 172.21.15.44:0/2531738966 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v104) ==== 103+0+11 (secure 0 0 0) 0x7f818c0bc140 con 0x7f819c1017d0 2024-08-19T00:24:09.639 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-08-19T00:24:09.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.639+0000 7f81a14cb640 1 -- 172.21.15.44:0/2531738966 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f81880a2d80 msgr2=0x7f81880a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:09.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.639+0000 7f81a14cb640 1 --2- 172.21.15.44:0/2531738966 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f81880a2d80 0x7f81880a5240 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f819c100c10 tx=0x7f8184005e50 comp rx=0 tx=0).stop 2024-08-19T00:24:09.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.639+0000 7f81a14cb640 1 -- 172.21.15.44:0/2531738966 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f819c1017d0 msgr2=0x7f819c198160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:09.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.639+0000 7f81a14cb640 1 --2- 172.21.15.44:0/2531738966 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f819c1017d0 0x7f819c198160 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f818c02a940 tx=0x7f818c003b90 comp rx=0 tx=0).stop 2024-08-19T00:24:09.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.639+0000 7f81a14cb640 1 -- 172.21.15.44:0/2531738966 shutdown_connections 2024-08-19T00:24:09.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.639+0000 7f81a14cb640 1 --2- 172.21.15.44:0/2531738966 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f81880a2d80 0x7f81880a5240 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:09.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.639+0000 7f81a14cb640 1 --2- 172.21.15.44:0/2531738966 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f819c102170 0x7f819c1986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:09.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.639+0000 7f81a14cb640 1 --2- 172.21.15.44:0/2531738966 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f819c1077e0 0x7f819c19ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:09.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.639+0000 7f81a14cb640 1 --2- 172.21.15.44:0/2531738966 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f819c1017d0 0x7f819c198160 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:09.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.639+0000 7f81a14cb640 1 -- 172.21.15.44:0/2531738966 >> 172.21.15.44:0/2531738966 conn(0x7f819c0fd510 msgr2=0x7f819c0fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:24:09.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.639+0000 7f81a14cb640 1 -- 172.21.15.44:0/2531738966 shutdown_connections 2024-08-19T00:24:09.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.640+0000 7f81a14cb640 1 -- 172.21.15.44:0/2531738966 wait complete. 2024-08-19T00:24:09.652 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-08-19T00:24:09.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.751+0000 7fbf102df640 1 -- 172.21.15.44:0/490699939 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf0810beb0 msgr2=0x7fbf0810e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:09.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.751+0000 7fbf102df640 1 --2- 172.21.15.44:0/490699939 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf0810beb0 0x7fbf0810e320 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fbf00009ca0 tx=0x7fbf0002a8c0 comp rx=0 tx=0).stop 2024-08-19T00:24:09.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.751+0000 7fbf102df640 1 -- 172.21.15.44:0/490699939 shutdown_connections 2024-08-19T00:24:09.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.751+0000 7fbf102df640 1 --2- 172.21.15.44:0/490699939 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf0810beb0 0x7fbf0810e320 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:09.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.751+0000 7fbf102df640 1 --2- 172.21.15.44:0/490699939 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbf08103360 0x7fbf0810b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:09.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.751+0000 7fbf102df640 1 --2- 172.21.15.44:0/490699939 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbf08102a40 0x7fbf08102e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:09.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.751+0000 7fbf102df640 1 -- 172.21.15.44:0/490699939 >> 172.21.15.44:0/490699939 conn(0x7fbf080fc490 msgr2=0x7fbf080fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:24:09.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.751+0000 7fbf102df640 1 -- 172.21.15.44:0/490699939 shutdown_connections 2024-08-19T00:24:09.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.751+0000 7fbf102df640 1 -- 172.21.15.44:0/490699939 wait complete. 2024-08-19T00:24:09.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.752+0000 7fbf102df640 1 Processor -- start 2024-08-19T00:24:09.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.752+0000 7fbf102df640 1 -- start start 2024-08-19T00:24:09.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.752+0000 7fbf102df640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbf08102a40 0x7fbf081981a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:09.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.752+0000 7fbf102df640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbf08103360 0x7fbf081986e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:09.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.752+0000 7fbf102df640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf0810beb0 0x7fbf0819ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:09.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.752+0000 7fbf102df640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbf08111c80 con 0x7fbf0810beb0 2024-08-19T00:24:09.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.752+0000 7fbf102df640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fbf08111b00 con 0x7fbf08103360 2024-08-19T00:24:09.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.752+0000 7fbf102df640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbf08111e00 con 0x7fbf08102a40 2024-08-19T00:24:09.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.752+0000 7fbf0e87c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf0810beb0 0x7fbf0819ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:09.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.752+0000 7fbf0e87c640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf0810beb0 0x7fbf0819ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53302/0 (socket says 172.21.15.44:53302) 2024-08-19T00:24:09.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.752+0000 7fbf0e87c640 1 -- 172.21.15.44:0/3717619637 learned_addr learned my addr 172.21.15.44:0/3717619637 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:24:09.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.752+0000 7fbf0d87a640 1 --2- 172.21.15.44:0/3717619637 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbf08103360 0x7fbf081986e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:09.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.752+0000 7fbf0e07b640 1 --2- 172.21.15.44:0/3717619637 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbf08102a40 0x7fbf081981a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:09.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.752+0000 7fbf0e87c640 1 -- 172.21.15.44:0/3717619637 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbf08102a40 msgr2=0x7fbf081981a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:09.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.752+0000 7fbf0e87c640 1 --2- 172.21.15.44:0/3717619637 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbf08102a40 0x7fbf081981a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:09.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.752+0000 7fbf0e87c640 1 -- 172.21.15.44:0/3717619637 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbf08103360 msgr2=0x7fbf081986e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:09.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.752+0000 7fbf0e87c640 1 --2- 172.21.15.44:0/3717619637 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbf08103360 0x7fbf081986e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:09.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.752+0000 7fbf0e87c640 1 -- 172.21.15.44:0/3717619637 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf0819d190 con 0x7fbf0810beb0 2024-08-19T00:24:09.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.753+0000 7fbf0e87c640 1 --2- 172.21.15.44:0/3717619637 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf0810beb0 0x7fbf0819ca60 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fbf00031a20 tx=0x7fbf00031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:24:09.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.753+0000 7fbeff7fe640 1 -- 172.21.15.44:0/3717619637 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf00003c30 con 0x7fbf0810beb0 2024-08-19T00:24:09.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.753+0000 7fbf102df640 1 -- 172.21.15.44:0/3717619637 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf0819d420 con 0x7fbf0810beb0 2024-08-19T00:24:09.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.753+0000 7fbeff7fe640 1 -- 172.21.15.44:0/3717619637 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf00003dd0 con 0x7fbf0810beb0 2024-08-19T00:24:09.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.753+0000 7fbeff7fe640 1 -- 172.21.15.44:0/3717619637 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf0002fcf0 con 0x7fbf0810beb0 2024-08-19T00:24:09.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.753+0000 7fbf102df640 1 -- 172.21.15.44:0/3717619637 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf081a4d10 con 0x7fbf0810beb0 2024-08-19T00:24:09.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.754+0000 7fbf102df640 1 -- 172.21.15.44:0/3717619637 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf08102e20 con 0x7fbf0810beb0 2024-08-19T00:24:09.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.755+0000 7fbeff7fe640 1 -- 172.21.15.44:0/3717619637 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fbf00004b40 con 0x7fbf0810beb0 2024-08-19T00:24:09.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.755+0000 7fbeff7fe640 1 --2- 172.21.15.44:0/3717619637 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fbef40a2d00 0x7fbef40a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:09.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.756+0000 7fbf0e07b640 1 --2- 172.21.15.44:0/3717619637 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fbef40a2d00 0x7fbef40a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:09.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.756+0000 7fbeff7fe640 1 -- 172.21.15.44:0/3717619637 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 9621+0+0 (secure 0 0 0) 0x7fbf000f0ba0 con 0x7fbf0810beb0 2024-08-19T00:24:09.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.756+0000 7fbf0e07b640 1 --2- 172.21.15.44:0/3717619637 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fbef40a2d00 0x7fbef40a51c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbf04005fd0 tx=0x7fbf0400b390 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:24:09.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.759+0000 7fbeff7fe640 1 -- 172.21.15.44:0/3717619637 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fbf000bd510 con 0x7fbf0810beb0 2024-08-19T00:24:09.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.982+0000 7fbf102df640 1 -- 172.21.15.44:0/3717619637 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7fbf081a4ee0 con 0x7fbf0810beb0 2024-08-19T00:24:09.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.989+0000 7fbeff7fe640 1 -- 172.21.15.44:0/3717619637 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v26) ==== 81+0+740902 (secure 0 0 0) 0x7fbf0002fe90 con 0x7fbf0810beb0 2024-08-19T00:24:09.996 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:24:09.996 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-08-19T00:24:09.996 INFO:teuthology.orchestra.run.smithi044.stdout: "epoch": 26, 2024-08-19T00:24:09.996 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:09.997 INFO:teuthology.orchestra.run.smithi044.stdout: "active_gid": 15297, 2024-08-19T00:24:09.997 INFO:teuthology.orchestra.run.smithi044.stdout: "active_name": "x", 2024-08-19T00:24:09.997 INFO:teuthology.orchestra.run.smithi044.stdout: "active_addrs": { 2024-08-19T00:24:09.997 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-08-19T00:24:09.997 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:09.997 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-08-19T00:24:09.997 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.44:6800", 2024-08-19T00:24:09.997 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 1029670730 2024-08-19T00:24:09.998 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:09.998 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:09.998 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-08-19T00:24:09.998 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.44:6801", 2024-08-19T00:24:09.998 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 1029670730 2024-08-19T00:24:09.998 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:09.998 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-08-19T00:24:09.999 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:09.999 INFO:teuthology.orchestra.run.smithi044.stdout: "active_addr": "172.21.15.44:6801/1029670730", 2024-08-19T00:24:09.999 INFO:teuthology.orchestra.run.smithi044.stdout: "active_change": "2024-08-19T00:13:18.502917+0000", 2024-08-19T00:24:09.999 INFO:teuthology.orchestra.run.smithi044.stdout: "active_mgr_features": 4540701547738038271, 2024-08-19T00:24:09.999 INFO:teuthology.orchestra.run.smithi044.stdout: "available": true, 2024-08-19T00:24:09.999 INFO:teuthology.orchestra.run.smithi044.stdout: "standbys": [ 2024-08-19T00:24:09.999 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:09.999 INFO:teuthology.orchestra.run.smithi044.stdout: "gid": 24808, 2024-08-19T00:24:09.999 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "z", 2024-08-19T00:24:10.000 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr_features": 4540701547738038271, 2024-08-19T00:24:10.000 INFO:teuthology.orchestra.run.smithi044.stdout: "available_modules": [ 2024-08-19T00:24:10.000 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:10.000 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "alerts", 2024-08-19T00:24:10.000 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:10.000 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:10.000 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:10.001 INFO:teuthology.orchestra.run.smithi044.stdout: "interval": { 2024-08-19T00:24:10.001 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "interval", 2024-08-19T00:24:10.001 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", 2024-08-19T00:24:10.001 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.001 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.001 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "60", 2024-08-19T00:24:10.001 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.001 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.001 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.002 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "How frequently to reexamine health status", 2024-08-19T00:24:10.002 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.002 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.002 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.002 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.002 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:10.002 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:10.003 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.003 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.003 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.003 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.003 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.004 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.004 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.004 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.004 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.004 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.004 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.004 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.004 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.005 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.005 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.005 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.005 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.005 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.005 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.005 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:10.005 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:10.005 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.006 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.006 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.006 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.006 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.006 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.006 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.006 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.007 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.007 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.007 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.007 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.007 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:10.007 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:10.007 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.007 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.007 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.008 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:10.008 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.008 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.008 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.008 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.008 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.008 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.008 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.009 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.009 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.009 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.009 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.009 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.009 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.009 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.009 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.010 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:10.010 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:10.010 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.010 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.010 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.010 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.010 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.011 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.011 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.011 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.011 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.011 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.011 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.011 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.011 INFO:teuthology.orchestra.run.smithi044.stdout: "smtp_destination": { 2024-08-19T00:24:10.011 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "smtp_destination", 2024-08-19T00:24:10.012 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.012 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.012 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.012 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.012 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.012 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.012 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.012 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Email address to send alerts to", 2024-08-19T00:24:10.013 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.013 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.013 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.013 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.014 INFO:teuthology.orchestra.run.smithi044.stdout: "smtp_from_name": { 2024-08-19T00:24:10.014 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "smtp_from_name", 2024-08-19T00:24:10.014 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.014 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.014 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.014 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "Ceph", 2024-08-19T00:24:10.014 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.014 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.015 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.015 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Email From: name", 2024-08-19T00:24:10.015 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.015 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.015 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.015 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.015 INFO:teuthology.orchestra.run.smithi044.stdout: "smtp_host": { 2024-08-19T00:24:10.015 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "smtp_host", 2024-08-19T00:24:10.016 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.016 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.016 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.016 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.016 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.016 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.016 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.016 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "SMTP server", 2024-08-19T00:24:10.017 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.017 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.017 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.017 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.017 INFO:teuthology.orchestra.run.smithi044.stdout: "smtp_password": { 2024-08-19T00:24:10.017 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "smtp_password", 2024-08-19T00:24:10.017 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.017 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.017 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.018 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.018 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.018 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.018 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.018 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Password to authenticate with", 2024-08-19T00:24:10.018 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.018 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.019 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.019 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.019 INFO:teuthology.orchestra.run.smithi044.stdout: "smtp_port": { 2024-08-19T00:24:10.019 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "smtp_port", 2024-08-19T00:24:10.019 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:10.019 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.019 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.019 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "465", 2024-08-19T00:24:10.020 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.020 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.020 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.020 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "SMTP port", 2024-08-19T00:24:10.020 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.020 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.020 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.020 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.021 INFO:teuthology.orchestra.run.smithi044.stdout: "smtp_sender": { 2024-08-19T00:24:10.021 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "smtp_sender", 2024-08-19T00:24:10.021 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.021 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.021 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.021 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.021 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.021 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.022 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.022 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "SMTP envelope sender", 2024-08-19T00:24:10.022 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.022 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.022 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.022 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.022 INFO:teuthology.orchestra.run.smithi044.stdout: "smtp_ssl": { 2024-08-19T00:24:10.022 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "smtp_ssl", 2024-08-19T00:24:10.023 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.023 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.023 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.023 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:10.023 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.023 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.024 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.024 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Use SSL to connect to SMTP server", 2024-08-19T00:24:10.024 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.024 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.024 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.024 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.024 INFO:teuthology.orchestra.run.smithi044.stdout: "smtp_user": { 2024-08-19T00:24:10.025 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "smtp_user", 2024-08-19T00:24:10.025 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.025 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.025 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.025 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.025 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.025 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.025 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.026 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "User to authenticate as", 2024-08-19T00:24:10.026 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.026 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.026 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.026 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.026 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.026 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.026 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:10.027 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "balancer", 2024-08-19T00:24:10.027 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:10.027 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:10.027 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:10.027 INFO:teuthology.orchestra.run.smithi044.stdout: "active": { 2024-08-19T00:24:10.027 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "active", 2024-08-19T00:24:10.027 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.027 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.028 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.028 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:10.028 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.028 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.028 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.028 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "automatically balance PGs across cluster", 2024-08-19T00:24:10.028 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.028 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.028 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.029 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.029 INFO:teuthology.orchestra.run.smithi044.stdout: "begin_time": { 2024-08-19T00:24:10.029 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "begin_time", 2024-08-19T00:24:10.029 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.029 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.029 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.029 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "0000", 2024-08-19T00:24:10.029 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.030 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.030 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.030 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "beginning time of day to automatically balance", 2024-08-19T00:24:10.030 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-19T00:24:10.030 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.030 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.030 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.030 INFO:teuthology.orchestra.run.smithi044.stdout: "begin_weekday": { 2024-08-19T00:24:10.031 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "begin_weekday", 2024-08-19T00:24:10.031 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "uint", 2024-08-19T00:24:10.031 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.031 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.031 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "0", 2024-08-19T00:24:10.031 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "0", 2024-08-19T00:24:10.031 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "6", 2024-08-19T00:24:10.031 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.032 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-08-19T00:24:10.032 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-19T00:24:10.032 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.032 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.032 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.032 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_compat_max_iterations": { 2024-08-19T00:24:10.032 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "crush_compat_max_iterations", 2024-08-19T00:24:10.032 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "uint", 2024-08-19T00:24:10.033 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.033 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.033 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "25", 2024-08-19T00:24:10.033 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "1", 2024-08-19T00:24:10.033 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "250", 2024-08-19T00:24:10.033 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.033 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-08-19T00:24:10.033 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.034 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.034 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.034 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.034 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_compat_metrics": { 2024-08-19T00:24:10.034 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "crush_compat_metrics", 2024-08-19T00:24:10.034 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.035 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.035 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.035 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "pgs,objects,bytes", 2024-08-19T00:24:10.035 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.035 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.035 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.035 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-08-19T00:24:10.035 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-08-19T00:24:10.036 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.036 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.036 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.036 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_compat_step": { 2024-08-19T00:24:10.036 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "crush_compat_step", 2024-08-19T00:24:10.036 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "float", 2024-08-19T00:24:10.036 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.036 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.037 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "0.5", 2024-08-19T00:24:10.037 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "0.001", 2024-08-19T00:24:10.037 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "0.999", 2024-08-19T00:24:10.037 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.037 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "aggressiveness of optimization", 2024-08-19T00:24:10.037 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-08-19T00:24:10.037 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.037 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.038 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.038 INFO:teuthology.orchestra.run.smithi044.stdout: "end_time": { 2024-08-19T00:24:10.038 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "end_time", 2024-08-19T00:24:10.038 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.038 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.038 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.038 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "2359", 2024-08-19T00:24:10.038 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.039 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.039 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.039 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "ending time of day to automatically balance", 2024-08-19T00:24:10.039 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-19T00:24:10.039 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.039 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.039 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.039 INFO:teuthology.orchestra.run.smithi044.stdout: "end_weekday": { 2024-08-19T00:24:10.040 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "end_weekday", 2024-08-19T00:24:10.040 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "uint", 2024-08-19T00:24:10.040 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.040 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.040 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "0", 2024-08-19T00:24:10.040 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "0", 2024-08-19T00:24:10.040 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "6", 2024-08-19T00:24:10.040 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.040 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-08-19T00:24:10.041 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-19T00:24:10.041 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.041 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.041 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.041 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:10.041 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:10.041 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.041 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.042 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.042 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.042 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.042 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.042 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.042 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.042 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.042 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.043 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.043 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.043 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.043 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.043 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.043 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.043 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.043 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.044 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.044 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:10.044 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:10.044 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.045 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.045 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.047 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.047 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.047 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.047 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.047 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.047 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.048 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.048 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.048 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.048 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:10.048 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:10.048 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.048 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.048 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.049 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:10.049 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.049 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.049 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.049 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.049 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.049 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.049 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.050 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.050 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.050 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.050 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.050 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.050 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.050 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.050 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.051 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:10.051 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:10.051 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.051 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.051 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.051 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.051 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.051 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.052 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.052 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.052 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.052 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.052 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.052 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.052 INFO:teuthology.orchestra.run.smithi044.stdout: "min_score": { 2024-08-19T00:24:10.052 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "min_score", 2024-08-19T00:24:10.052 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "float", 2024-08-19T00:24:10.053 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.053 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.053 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "0", 2024-08-19T00:24:10.053 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.053 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.053 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.053 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-08-19T00:24:10.053 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.054 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.054 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.054 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.054 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": { 2024-08-19T00:24:10.054 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "mode", 2024-08-19T00:24:10.054 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.055 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.055 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.055 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "upmap", 2024-08-19T00:24:10.055 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.055 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.056 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.056 INFO:teuthology.orchestra.run.smithi044.stdout: "crush-compat", 2024-08-19T00:24:10.056 INFO:teuthology.orchestra.run.smithi044.stdout: "none", 2024-08-19T00:24:10.056 INFO:teuthology.orchestra.run.smithi044.stdout: "read", 2024-08-19T00:24:10.056 INFO:teuthology.orchestra.run.smithi044.stdout: "upmap", 2024-08-19T00:24:10.056 INFO:teuthology.orchestra.run.smithi044.stdout: "upmap-read" 2024-08-19T00:24:10.056 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.056 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Balancer mode", 2024-08-19T00:24:10.057 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.057 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.057 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.057 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.057 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_ids": { 2024-08-19T00:24:10.057 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "pool_ids", 2024-08-19T00:24:10.057 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.058 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.058 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.058 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.058 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.058 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.058 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.058 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-08-19T00:24:10.058 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.059 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.059 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.059 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.059 INFO:teuthology.orchestra.run.smithi044.stdout: "sleep_interval": { 2024-08-19T00:24:10.059 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "sleep_interval", 2024-08-19T00:24:10.059 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", 2024-08-19T00:24:10.059 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.059 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.060 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "60", 2024-08-19T00:24:10.060 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.060 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.060 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.060 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-08-19T00:24:10.060 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.060 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.060 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.061 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.061 INFO:teuthology.orchestra.run.smithi044.stdout: "upmap_max_deviation": { 2024-08-19T00:24:10.061 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "upmap_max_deviation", 2024-08-19T00:24:10.061 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:10.061 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.061 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.061 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "5", 2024-08-19T00:24:10.061 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "1", 2024-08-19T00:24:10.062 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.062 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.062 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "deviation below which no optimization is attempted", 2024-08-19T00:24:10.062 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-08-19T00:24:10.062 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.062 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.062 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.062 INFO:teuthology.orchestra.run.smithi044.stdout: "upmap_max_optimizations": { 2024-08-19T00:24:10.063 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "upmap_max_optimizations", 2024-08-19T00:24:10.063 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "uint", 2024-08-19T00:24:10.063 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.063 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.063 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "10", 2024-08-19T00:24:10.063 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.063 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.063 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.064 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-08-19T00:24:10.064 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.064 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.064 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.064 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.064 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.064 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.064 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:10.065 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "cephadm", 2024-08-19T00:24:10.065 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:10.065 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:10.065 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:10.065 INFO:teuthology.orchestra.run.smithi044.stdout: "agent_down_multiplier": { 2024-08-19T00:24:10.065 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "agent_down_multiplier", 2024-08-19T00:24:10.065 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "float", 2024-08-19T00:24:10.065 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.066 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.066 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "3.0", 2024-08-19T00:24:10.066 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.066 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.066 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.066 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-08-19T00:24:10.066 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.066 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.067 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.067 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.067 INFO:teuthology.orchestra.run.smithi044.stdout: "agent_refresh_rate": { 2024-08-19T00:24:10.067 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "agent_refresh_rate", 2024-08-19T00:24:10.067 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", 2024-08-19T00:24:10.067 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.067 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.067 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "20", 2024-08-19T00:24:10.068 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.068 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.068 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.068 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-08-19T00:24:10.068 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.068 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.068 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.068 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.069 INFO:teuthology.orchestra.run.smithi044.stdout: "agent_starting_port": { 2024-08-19T00:24:10.069 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "agent_starting_port", 2024-08-19T00:24:10.069 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:10.069 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.069 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.069 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "4721", 2024-08-19T00:24:10.069 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.069 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.070 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.070 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-08-19T00:24:10.070 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.070 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.070 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.070 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.070 INFO:teuthology.orchestra.run.smithi044.stdout: "allow_ptrace": { 2024-08-19T00:24:10.071 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "allow_ptrace", 2024-08-19T00:24:10.071 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.071 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.071 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.071 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.071 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.071 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.071 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.072 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-08-19T00:24:10.072 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-08-19T00:24:10.072 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.072 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.072 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.072 INFO:teuthology.orchestra.run.smithi044.stdout: "autotune_interval": { 2024-08-19T00:24:10.072 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "autotune_interval", 2024-08-19T00:24:10.072 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", 2024-08-19T00:24:10.073 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.073 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.073 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "600", 2024-08-19T00:24:10.073 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.073 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.073 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.073 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "how frequently to autotune daemon memory", 2024-08-19T00:24:10.073 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.073 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.074 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.074 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.074 INFO:teuthology.orchestra.run.smithi044.stdout: "autotune_memory_target_ratio": { 2024-08-19T00:24:10.074 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "autotune_memory_target_ratio", 2024-08-19T00:24:10.074 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "float", 2024-08-19T00:24:10.074 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.074 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.074 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "0.7", 2024-08-19T00:24:10.075 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.075 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.075 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.075 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-08-19T00:24:10.075 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.075 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.075 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.075 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.076 INFO:teuthology.orchestra.run.smithi044.stdout: "cephadm_log_destination": { 2024-08-19T00:24:10.076 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "cephadm_log_destination", 2024-08-19T00:24:10.076 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.076 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.076 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.076 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.076 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.076 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.077 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.077 INFO:teuthology.orchestra.run.smithi044.stdout: "file", 2024-08-19T00:24:10.077 INFO:teuthology.orchestra.run.smithi044.stdout: "file,syslog", 2024-08-19T00:24:10.077 INFO:teuthology.orchestra.run.smithi044.stdout: "syslog" 2024-08-19T00:24:10.077 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.077 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-08-19T00:24:10.077 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.077 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.077 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.078 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.078 INFO:teuthology.orchestra.run.smithi044.stdout: "cgroups_split": { 2024-08-19T00:24:10.078 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "cgroups_split", 2024-08-19T00:24:10.078 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.078 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.078 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.078 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:10.078 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.079 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.079 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.079 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-08-19T00:24:10.079 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.079 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.079 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.079 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.080 INFO:teuthology.orchestra.run.smithi044.stdout: "config_checks_enabled": { 2024-08-19T00:24:10.080 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "config_checks_enabled", 2024-08-19T00:24:10.080 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.080 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.080 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.080 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.080 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.080 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.081 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.081 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-08-19T00:24:10.081 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.081 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.081 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.081 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.081 INFO:teuthology.orchestra.run.smithi044.stdout: "config_dashboard": { 2024-08-19T00:24:10.081 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "config_dashboard", 2024-08-19T00:24:10.082 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.082 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.082 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.082 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:10.082 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.082 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.082 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.082 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-08-19T00:24:10.083 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.083 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.083 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.083 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.086 INFO:teuthology.orchestra.run.smithi044.stdout: "container_image_alertmanager": { 2024-08-19T00:24:10.086 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "container_image_alertmanager", 2024-08-19T00:24:10.086 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.086 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.086 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.087 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-08-19T00:24:10.087 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.087 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.087 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.088 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Prometheus container image", 2024-08-19T00:24:10.088 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.088 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.088 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.088 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.088 INFO:teuthology.orchestra.run.smithi044.stdout: "container_image_base": { 2024-08-19T00:24:10.088 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "container_image_base", 2024-08-19T00:24:10.089 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.089 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.089 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.089 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "quay.io/ceph/ceph", 2024-08-19T00:24:10.089 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.089 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.089 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.089 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Container image name, without the tag", 2024-08-19T00:24:10.090 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.090 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.090 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.090 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.090 INFO:teuthology.orchestra.run.smithi044.stdout: "container_image_elasticsearch": { 2024-08-19T00:24:10.090 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "container_image_elasticsearch", 2024-08-19T00:24:10.090 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.090 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.091 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.091 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-08-19T00:24:10.091 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.091 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.091 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.091 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "elasticsearch container image", 2024-08-19T00:24:10.091 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.091 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.092 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.092 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.092 INFO:teuthology.orchestra.run.smithi044.stdout: "container_image_grafana": { 2024-08-19T00:24:10.092 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "container_image_grafana", 2024-08-19T00:24:10.092 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.092 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.092 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.092 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-08-19T00:24:10.093 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.093 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.093 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.093 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Prometheus container image", 2024-08-19T00:24:10.093 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.093 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.093 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.093 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.094 INFO:teuthology.orchestra.run.smithi044.stdout: "container_image_haproxy": { 2024-08-19T00:24:10.094 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "container_image_haproxy", 2024-08-19T00:24:10.094 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.094 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.094 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.094 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-08-19T00:24:10.094 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.094 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.095 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.095 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "HAproxy container image", 2024-08-19T00:24:10.095 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.095 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.095 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.095 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.095 INFO:teuthology.orchestra.run.smithi044.stdout: "container_image_jaeger_agent": { 2024-08-19T00:24:10.095 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "container_image_jaeger_agent", 2024-08-19T00:24:10.096 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.096 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.096 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.096 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-08-19T00:24:10.096 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.096 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.096 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.096 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Jaeger agent container image", 2024-08-19T00:24:10.097 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.097 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.097 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.097 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.097 INFO:teuthology.orchestra.run.smithi044.stdout: "container_image_jaeger_collector": { 2024-08-19T00:24:10.097 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "container_image_jaeger_collector", 2024-08-19T00:24:10.097 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.097 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.098 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.098 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-08-19T00:24:10.098 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.098 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.098 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.098 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Jaeger collector container image", 2024-08-19T00:24:10.098 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.098 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.099 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.099 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.099 INFO:teuthology.orchestra.run.smithi044.stdout: "container_image_jaeger_query": { 2024-08-19T00:24:10.099 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "container_image_jaeger_query", 2024-08-19T00:24:10.099 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.099 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.099 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.099 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-08-19T00:24:10.100 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.100 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.100 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.100 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Jaeger query container image", 2024-08-19T00:24:10.100 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.100 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.100 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.100 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.101 INFO:teuthology.orchestra.run.smithi044.stdout: "container_image_keepalived": { 2024-08-19T00:24:10.101 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "container_image_keepalived", 2024-08-19T00:24:10.101 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.101 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.101 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.101 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-08-19T00:24:10.101 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.101 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.102 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.102 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Keepalived container image", 2024-08-19T00:24:10.102 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.102 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.102 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.102 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.102 INFO:teuthology.orchestra.run.smithi044.stdout: "container_image_loki": { 2024-08-19T00:24:10.102 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "container_image_loki", 2024-08-19T00:24:10.103 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.103 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.103 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.103 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-08-19T00:24:10.103 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.103 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.103 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.103 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Loki container image", 2024-08-19T00:24:10.103 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.104 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.104 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.104 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.104 INFO:teuthology.orchestra.run.smithi044.stdout: "container_image_node_exporter": { 2024-08-19T00:24:10.104 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "container_image_node_exporter", 2024-08-19T00:24:10.104 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.104 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.104 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.105 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-08-19T00:24:10.105 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.105 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.105 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.105 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Prometheus container image", 2024-08-19T00:24:10.105 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.105 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.105 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.106 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.106 INFO:teuthology.orchestra.run.smithi044.stdout: "container_image_nvmeof": { 2024-08-19T00:24:10.106 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "container_image_nvmeof", 2024-08-19T00:24:10.106 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.106 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.106 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.106 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-08-19T00:24:10.106 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.107 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.107 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.107 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Nvme-of container image", 2024-08-19T00:24:10.107 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.107 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.107 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.107 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.107 INFO:teuthology.orchestra.run.smithi044.stdout: "container_image_prometheus": { 2024-08-19T00:24:10.108 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "container_image_prometheus", 2024-08-19T00:24:10.108 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.108 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.108 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.108 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-08-19T00:24:10.108 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.108 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.108 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.109 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Prometheus container image", 2024-08-19T00:24:10.109 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.109 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.109 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.109 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.109 INFO:teuthology.orchestra.run.smithi044.stdout: "container_image_promtail": { 2024-08-19T00:24:10.109 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "container_image_promtail", 2024-08-19T00:24:10.110 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.110 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.110 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.110 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-08-19T00:24:10.110 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.110 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.110 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.110 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Promtail container image", 2024-08-19T00:24:10.110 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.111 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.111 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.111 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.111 INFO:teuthology.orchestra.run.smithi044.stdout: "container_image_samba": { 2024-08-19T00:24:10.111 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "container_image_samba", 2024-08-19T00:24:10.111 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.111 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.112 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.112 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-08-19T00:24:10.112 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.112 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.112 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.112 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Samba/SMB container image", 2024-08-19T00:24:10.112 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.112 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.113 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.113 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.113 INFO:teuthology.orchestra.run.smithi044.stdout: "container_image_snmp_gateway": { 2024-08-19T00:24:10.113 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "container_image_snmp_gateway", 2024-08-19T00:24:10.113 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.113 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.113 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.113 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-08-19T00:24:10.114 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.114 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.114 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.114 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "SNMP Gateway container image", 2024-08-19T00:24:10.114 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.114 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.114 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.114 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.115 INFO:teuthology.orchestra.run.smithi044.stdout: "container_init": { 2024-08-19T00:24:10.115 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "container_init", 2024-08-19T00:24:10.115 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.115 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.115 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.115 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:10.115 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.115 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.116 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.116 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Run podman/docker with `--init`", 2024-08-19T00:24:10.116 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.116 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.116 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.116 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.116 INFO:teuthology.orchestra.run.smithi044.stdout: "daemon_cache_timeout": { 2024-08-19T00:24:10.116 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "daemon_cache_timeout", 2024-08-19T00:24:10.117 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", 2024-08-19T00:24:10.117 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.117 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.117 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "600", 2024-08-19T00:24:10.117 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.117 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.117 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.117 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-08-19T00:24:10.117 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.118 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.118 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.118 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.118 INFO:teuthology.orchestra.run.smithi044.stdout: "default_cephadm_command_timeout": { 2024-08-19T00:24:10.118 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "default_cephadm_command_timeout", 2024-08-19T00:24:10.118 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:10.118 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.119 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.119 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "900", 2024-08-19T00:24:10.119 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.119 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.119 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.119 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-08-19T00:24:10.119 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.119 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.119 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.120 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.120 INFO:teuthology.orchestra.run.smithi044.stdout: "default_registry": { 2024-08-19T00:24:10.120 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "default_registry", 2024-08-19T00:24:10.120 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.120 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.120 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.120 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "docker.io", 2024-08-19T00:24:10.120 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.121 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.121 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.121 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-08-19T00:24:10.121 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.121 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.121 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.121 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.121 INFO:teuthology.orchestra.run.smithi044.stdout: "device_cache_timeout": { 2024-08-19T00:24:10.122 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "device_cache_timeout", 2024-08-19T00:24:10.122 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", 2024-08-19T00:24:10.122 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.122 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.122 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "1800", 2024-08-19T00:24:10.122 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.122 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.122 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.123 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "seconds to cache device inventory", 2024-08-19T00:24:10.123 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.123 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.123 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.123 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.123 INFO:teuthology.orchestra.run.smithi044.stdout: "device_enhanced_scan": { 2024-08-19T00:24:10.123 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "device_enhanced_scan", 2024-08-19T00:24:10.123 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.124 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.124 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.124 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.124 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.124 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.124 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.124 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Use libstoragemgmt during device scans", 2024-08-19T00:24:10.124 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.124 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.125 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.125 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.125 INFO:teuthology.orchestra.run.smithi044.stdout: "facts_cache_timeout": { 2024-08-19T00:24:10.125 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "facts_cache_timeout", 2024-08-19T00:24:10.125 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", 2024-08-19T00:24:10.125 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.125 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.125 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "60", 2024-08-19T00:24:10.126 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.126 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.126 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.126 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "seconds to cache host facts data", 2024-08-19T00:24:10.126 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.126 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.126 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.126 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.127 INFO:teuthology.orchestra.run.smithi044.stdout: "grafana_dashboards_path": { 2024-08-19T00:24:10.127 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "grafana_dashboards_path", 2024-08-19T00:24:10.127 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.127 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.127 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.127 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-08-19T00:24:10.127 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.127 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.128 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.128 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-08-19T00:24:10.128 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.128 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.128 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.128 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.128 INFO:teuthology.orchestra.run.smithi044.stdout: "host_check_interval": { 2024-08-19T00:24:10.128 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "host_check_interval", 2024-08-19T00:24:10.129 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", 2024-08-19T00:24:10.129 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.129 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.129 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "600", 2024-08-19T00:24:10.129 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.129 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.129 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.129 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "how frequently to perform a host check", 2024-08-19T00:24:10.130 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.130 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.130 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.130 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.130 INFO:teuthology.orchestra.run.smithi044.stdout: "hw_monitoring": { 2024-08-19T00:24:10.130 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "hw_monitoring", 2024-08-19T00:24:10.130 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.130 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.131 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.131 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.131 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.131 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.131 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.131 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-08-19T00:24:10.131 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.131 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.131 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.132 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.132 INFO:teuthology.orchestra.run.smithi044.stdout: "inventory_list_all": { 2024-08-19T00:24:10.132 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "inventory_list_all", 2024-08-19T00:24:10.132 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.132 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.132 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.132 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.132 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.133 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.133 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.133 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-08-19T00:24:10.133 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.133 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.133 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.133 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.133 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:10.134 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:10.134 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.134 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.134 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.134 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.134 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.134 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.134 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.135 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.135 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.135 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.135 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.135 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.135 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.135 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.135 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.135 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.136 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.136 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.136 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.136 INFO:teuthology.orchestra.run.smithi044.stdout: "log_refresh_metadata": { 2024-08-19T00:24:10.136 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_refresh_metadata", 2024-08-19T00:24:10.136 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.136 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.136 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.137 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.137 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.137 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.137 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.137 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-08-19T00:24:10.137 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.137 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.137 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.138 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.138 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:10.138 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:10.138 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.138 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.138 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.138 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:10.139 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.139 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.139 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.139 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-08-19T00:24:10.139 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.139 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.139 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.139 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.139 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:10.140 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:10.140 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.140 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.140 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.140 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:10.140 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.140 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.141 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.141 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.141 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.141 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.141 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.141 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.141 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.141 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.141 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.142 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.142 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.142 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.142 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.142 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:10.142 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:10.142 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.143 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.143 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.143 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.143 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.143 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.143 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.143 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.143 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.144 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.144 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.144 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.144 INFO:teuthology.orchestra.run.smithi044.stdout: "manage_etc_ceph_ceph_conf": { 2024-08-19T00:24:10.144 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-08-19T00:24:10.144 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.144 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.144 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.144 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.145 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.145 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.145 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.145 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-08-19T00:24:10.145 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.145 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.145 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.145 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.146 INFO:teuthology.orchestra.run.smithi044.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-08-19T00:24:10.146 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-08-19T00:24:10.146 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.146 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.146 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.146 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "*", 2024-08-19T00:24:10.146 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.146 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.147 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.147 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-08-19T00:24:10.147 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.147 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.147 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.147 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.147 INFO:teuthology.orchestra.run.smithi044.stdout: "max_count_per_host": { 2024-08-19T00:24:10.147 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "max_count_per_host", 2024-08-19T00:24:10.148 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:10.148 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.148 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.148 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "10", 2024-08-19T00:24:10.148 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.148 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.148 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.148 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "max number of daemons per service per host", 2024-08-19T00:24:10.148 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.149 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.149 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.149 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.149 INFO:teuthology.orchestra.run.smithi044.stdout: "max_osd_draining_count": { 2024-08-19T00:24:10.149 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "max_osd_draining_count", 2024-08-19T00:24:10.149 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:10.149 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.149 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.150 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "10", 2024-08-19T00:24:10.150 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.150 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.150 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.150 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-08-19T00:24:10.150 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.150 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.150 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.151 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.151 INFO:teuthology.orchestra.run.smithi044.stdout: "migration_current": { 2024-08-19T00:24:10.151 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "migration_current", 2024-08-19T00:24:10.151 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:10.151 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.151 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.151 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.151 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.152 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.152 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.152 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "internal - do not modify", 2024-08-19T00:24:10.152 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.152 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.152 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.152 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.152 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": { 2024-08-19T00:24:10.153 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "mode", 2024-08-19T00:24:10.153 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.153 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.153 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.153 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "root", 2024-08-19T00:24:10.153 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.153 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.153 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.154 INFO:teuthology.orchestra.run.smithi044.stdout: "cephadm-package", 2024-08-19T00:24:10.154 INFO:teuthology.orchestra.run.smithi044.stdout: "root" 2024-08-19T00:24:10.154 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.154 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "mode for remote execution of cephadm", 2024-08-19T00:24:10.154 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.154 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.154 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.154 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.155 INFO:teuthology.orchestra.run.smithi044.stdout: "oob_default_addr": { 2024-08-19T00:24:10.155 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "oob_default_addr", 2024-08-19T00:24:10.155 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.155 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.155 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.155 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "169.254.1.1", 2024-08-19T00:24:10.155 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.155 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.156 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.156 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Default address for RedFish API (oob management).", 2024-08-19T00:24:10.156 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.156 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.156 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.156 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.156 INFO:teuthology.orchestra.run.smithi044.stdout: "prometheus_alerts_path": { 2024-08-19T00:24:10.156 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "prometheus_alerts_path", 2024-08-19T00:24:10.156 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.157 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.157 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.157 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-08-19T00:24:10.157 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.157 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.157 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.157 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-08-19T00:24:10.158 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.158 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.158 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.158 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.158 INFO:teuthology.orchestra.run.smithi044.stdout: "registry_insecure": { 2024-08-19T00:24:10.158 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "registry_insecure", 2024-08-19T00:24:10.158 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.158 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.159 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.159 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.159 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.159 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.159 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.159 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-08-19T00:24:10.159 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.159 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.160 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.160 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.160 INFO:teuthology.orchestra.run.smithi044.stdout: "registry_password": { 2024-08-19T00:24:10.160 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "registry_password", 2024-08-19T00:24:10.160 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.160 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.160 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.160 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.161 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.161 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.161 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.161 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-08-19T00:24:10.161 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.161 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.161 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.161 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.162 INFO:teuthology.orchestra.run.smithi044.stdout: "registry_url": { 2024-08-19T00:24:10.162 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "registry_url", 2024-08-19T00:24:10.162 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.162 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.162 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.162 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.162 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.162 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.163 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.163 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-08-19T00:24:10.163 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.163 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.163 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.163 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.163 INFO:teuthology.orchestra.run.smithi044.stdout: "registry_username": { 2024-08-19T00:24:10.164 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "registry_username", 2024-08-19T00:24:10.164 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.164 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.164 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.164 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.164 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.164 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.164 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.165 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-08-19T00:24:10.165 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.165 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.165 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.165 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.165 INFO:teuthology.orchestra.run.smithi044.stdout: "secure_monitoring_stack": { 2024-08-19T00:24:10.165 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "secure_monitoring_stack", 2024-08-19T00:24:10.165 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.166 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.166 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.166 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.166 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.166 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.166 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.166 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-08-19T00:24:10.166 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.167 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.167 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.167 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.167 INFO:teuthology.orchestra.run.smithi044.stdout: "service_discovery_port": { 2024-08-19T00:24:10.167 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "service_discovery_port", 2024-08-19T00:24:10.167 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:10.167 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.167 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.168 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "8765", 2024-08-19T00:24:10.168 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.168 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.168 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.168 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "cephadm service discovery port", 2024-08-19T00:24:10.168 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.168 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.168 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.168 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.169 INFO:teuthology.orchestra.run.smithi044.stdout: "ssh_config_file": { 2024-08-19T00:24:10.169 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "ssh_config_file", 2024-08-19T00:24:10.169 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.169 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.169 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.169 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.169 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.169 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.170 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.170 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-08-19T00:24:10.170 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.170 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.170 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.170 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.170 INFO:teuthology.orchestra.run.smithi044.stdout: "use_agent": { 2024-08-19T00:24:10.170 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "use_agent", 2024-08-19T00:24:10.171 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.171 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.171 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.171 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.171 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.171 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.171 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.171 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-08-19T00:24:10.172 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.172 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.172 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.172 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.172 INFO:teuthology.orchestra.run.smithi044.stdout: "use_repo_digest": { 2024-08-19T00:24:10.172 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "use_repo_digest", 2024-08-19T00:24:10.172 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.172 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.173 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.173 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:10.173 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.173 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.173 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.173 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-08-19T00:24:10.173 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.173 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.174 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.174 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.174 INFO:teuthology.orchestra.run.smithi044.stdout: "warn_on_failed_host_check": { 2024-08-19T00:24:10.174 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "warn_on_failed_host_check", 2024-08-19T00:24:10.174 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.174 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.174 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.175 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:10.175 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.175 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.175 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.175 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "raise a health warning if the host check fails", 2024-08-19T00:24:10.175 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.175 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.175 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.175 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.176 INFO:teuthology.orchestra.run.smithi044.stdout: "warn_on_stray_daemons": { 2024-08-19T00:24:10.176 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "warn_on_stray_daemons", 2024-08-19T00:24:10.176 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.176 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.176 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.176 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:10.176 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.177 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.177 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.177 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-08-19T00:24:10.177 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.177 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.177 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.177 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.177 INFO:teuthology.orchestra.run.smithi044.stdout: "warn_on_stray_hosts": { 2024-08-19T00:24:10.177 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "warn_on_stray_hosts", 2024-08-19T00:24:10.178 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.178 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.178 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.178 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:10.178 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.178 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.178 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.178 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-08-19T00:24:10.179 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.179 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.179 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.179 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.179 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.179 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.179 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:10.179 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "crash", 2024-08-19T00:24:10.180 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:10.180 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:10.180 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:10.180 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:10.180 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:10.180 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.180 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.180 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.181 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.181 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.181 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.181 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.181 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.181 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.181 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.181 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.182 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.182 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.182 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.182 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.182 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.182 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.182 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.183 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.183 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:10.183 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:10.183 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.183 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.183 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.183 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.183 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.183 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.184 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.184 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.184 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.184 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.184 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.184 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.184 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:10.184 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:10.185 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.185 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.185 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.185 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:10.185 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.185 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.185 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.185 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.186 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.186 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.186 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.186 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.186 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.186 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.186 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.186 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.187 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.187 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.187 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.187 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:10.187 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:10.187 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.187 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.187 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.188 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.188 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.188 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.188 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.188 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.189 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.189 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.189 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.189 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.189 INFO:teuthology.orchestra.run.smithi044.stdout: "retain_interval": { 2024-08-19T00:24:10.189 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "retain_interval", 2024-08-19T00:24:10.189 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", 2024-08-19T00:24:10.189 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.190 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.190 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "31536000", 2024-08-19T00:24:10.190 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.190 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.190 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.190 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "how long to retain crashes before pruning them", 2024-08-19T00:24:10.190 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.190 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.191 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.191 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.191 INFO:teuthology.orchestra.run.smithi044.stdout: "warn_recent_interval": { 2024-08-19T00:24:10.191 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "warn_recent_interval", 2024-08-19T00:24:10.191 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", 2024-08-19T00:24:10.191 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.191 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.191 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "1209600", 2024-08-19T00:24:10.192 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.192 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.192 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.192 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "time interval in which to warn about recent crashes", 2024-08-19T00:24:10.192 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.192 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.192 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.192 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.193 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.193 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.193 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:10.193 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "dashboard", 2024-08-19T00:24:10.193 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:10.193 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:10.193 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:10.193 INFO:teuthology.orchestra.run.smithi044.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-08-19T00:24:10.194 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-08-19T00:24:10.194 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:10.194 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.194 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.194 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "10", 2024-08-19T00:24:10.194 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.194 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.194 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.195 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.195 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.195 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.195 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.195 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.195 INFO:teuthology.orchestra.run.smithi044.stdout: "ALERTMANAGER_API_HOST": { 2024-08-19T00:24:10.195 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "ALERTMANAGER_API_HOST", 2024-08-19T00:24:10.195 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.196 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.196 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.196 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.196 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.196 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.196 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.196 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.196 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.197 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.197 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.197 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.197 INFO:teuthology.orchestra.run.smithi044.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-08-19T00:24:10.197 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-08-19T00:24:10.197 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.197 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.197 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.197 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:10.198 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.198 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.198 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.198 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.198 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.198 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.198 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.198 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.199 INFO:teuthology.orchestra.run.smithi044.stdout: "AUDIT_API_ENABLED": { 2024-08-19T00:24:10.199 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "AUDIT_API_ENABLED", 2024-08-19T00:24:10.199 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.199 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.199 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.199 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.199 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.200 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.200 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.200 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.200 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.200 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.200 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.200 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.200 INFO:teuthology.orchestra.run.smithi044.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-08-19T00:24:10.201 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-08-19T00:24:10.201 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.201 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.201 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.201 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:10.201 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.201 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.201 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.201 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.202 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.202 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.202 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.202 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.202 INFO:teuthology.orchestra.run.smithi044.stdout: "ENABLE_BROWSABLE_API": { 2024-08-19T00:24:10.202 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "ENABLE_BROWSABLE_API", 2024-08-19T00:24:10.202 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.202 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.203 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.203 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:10.203 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.203 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.203 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.203 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.203 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.203 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.204 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.204 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.204 INFO:teuthology.orchestra.run.smithi044.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-08-19T00:24:10.204 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-08-19T00:24:10.204 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.204 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.204 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.204 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:10.205 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.205 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.205 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.205 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.205 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.205 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.205 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.205 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.206 INFO:teuthology.orchestra.run.smithi044.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-08-19T00:24:10.206 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-08-19T00:24:10.206 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.206 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.206 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.206 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:10.206 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.206 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.207 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.207 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.207 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.207 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.207 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.207 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.207 INFO:teuthology.orchestra.run.smithi044.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-08-19T00:24:10.207 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-08-19T00:24:10.208 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.208 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.208 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.208 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:10.208 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.208 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.208 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.208 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.209 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.209 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.209 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.209 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.209 INFO:teuthology.orchestra.run.smithi044.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-08-19T00:24:10.209 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-08-19T00:24:10.209 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.209 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.209 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.210 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:10.210 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.210 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.210 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.210 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.210 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.210 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.210 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.211 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.211 INFO:teuthology.orchestra.run.smithi044.stdout: "FEATURE_TOGGLE_NFS": { 2024-08-19T00:24:10.211 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-08-19T00:24:10.211 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.211 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.211 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.211 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:10.211 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.212 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.212 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.212 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.212 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.212 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.212 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.212 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.212 INFO:teuthology.orchestra.run.smithi044.stdout: "FEATURE_TOGGLE_RBD": { 2024-08-19T00:24:10.213 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-08-19T00:24:10.213 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.213 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.213 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.213 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:10.213 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.213 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.213 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.214 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.214 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.214 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.214 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.214 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.214 INFO:teuthology.orchestra.run.smithi044.stdout: "FEATURE_TOGGLE_RGW": { 2024-08-19T00:24:10.214 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-08-19T00:24:10.214 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.215 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.215 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.215 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:10.215 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.215 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.215 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.215 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.215 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.216 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.216 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.216 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.216 INFO:teuthology.orchestra.run.smithi044.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-08-19T00:24:10.216 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-08-19T00:24:10.216 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.216 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.216 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.217 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.217 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.217 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.217 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.217 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.217 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.217 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.217 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.218 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.218 INFO:teuthology.orchestra.run.smithi044.stdout: "GRAFANA_API_PASSWORD": { 2024-08-19T00:24:10.218 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "GRAFANA_API_PASSWORD", 2024-08-19T00:24:10.218 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.218 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.218 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.218 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "admin", 2024-08-19T00:24:10.218 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.219 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.219 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.219 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.219 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.219 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.219 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.219 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.219 INFO:teuthology.orchestra.run.smithi044.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-08-19T00:24:10.220 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-08-19T00:24:10.220 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.220 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.220 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.220 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:10.220 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.220 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.220 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.221 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.221 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.221 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.221 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.221 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.221 INFO:teuthology.orchestra.run.smithi044.stdout: "GRAFANA_API_URL": { 2024-08-19T00:24:10.221 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "GRAFANA_API_URL", 2024-08-19T00:24:10.221 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.222 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.222 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.222 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.222 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.222 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.222 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.222 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.222 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.222 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.223 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.223 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.223 INFO:teuthology.orchestra.run.smithi044.stdout: "GRAFANA_API_USERNAME": { 2024-08-19T00:24:10.223 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "GRAFANA_API_USERNAME", 2024-08-19T00:24:10.223 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.223 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.223 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.223 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "admin", 2024-08-19T00:24:10.224 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.224 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.224 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.224 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.224 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.224 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.224 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.224 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.224 INFO:teuthology.orchestra.run.smithi044.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-08-19T00:24:10.225 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-08-19T00:24:10.225 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.225 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.225 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.225 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.225 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.225 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.225 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.226 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.226 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.226 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.226 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.226 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.226 INFO:teuthology.orchestra.run.smithi044.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-08-19T00:24:10.226 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-08-19T00:24:10.227 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.227 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.227 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.227 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.227 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.227 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.227 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.227 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.227 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.228 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.228 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.228 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.228 INFO:teuthology.orchestra.run.smithi044.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-08-19T00:24:10.228 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-08-19T00:24:10.228 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.228 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.228 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.229 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:10.229 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.229 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.229 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.229 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.229 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.229 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.229 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.230 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.230 INFO:teuthology.orchestra.run.smithi044.stdout: "ISSUE_TRACKER_API_KEY": { 2024-08-19T00:24:10.230 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-08-19T00:24:10.230 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.230 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.230 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.230 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.230 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.231 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.231 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.231 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.231 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.231 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.231 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.231 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.231 INFO:teuthology.orchestra.run.smithi044.stdout: "PROMETHEUS_API_HOST": { 2024-08-19T00:24:10.231 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "PROMETHEUS_API_HOST", 2024-08-19T00:24:10.232 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.232 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.232 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.232 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.232 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.232 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.232 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.232 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.233 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.233 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.233 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.233 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.233 INFO:teuthology.orchestra.run.smithi044.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-08-19T00:24:10.233 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-08-19T00:24:10.233 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.233 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.233 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.234 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:10.234 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.234 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.234 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.234 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.234 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.234 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.234 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.235 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.235 INFO:teuthology.orchestra.run.smithi044.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-08-19T00:24:10.235 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-08-19T00:24:10.235 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.235 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.235 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.235 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.235 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.236 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.236 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.236 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.236 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.236 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.236 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.236 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.236 INFO:teuthology.orchestra.run.smithi044.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-08-19T00:24:10.237 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-08-19T00:24:10.237 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.237 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.237 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.237 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.237 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.237 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.237 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.238 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.238 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.238 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.238 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.238 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.238 INFO:teuthology.orchestra.run.smithi044.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-08-19T00:24:10.238 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-08-19T00:24:10.238 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.239 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.239 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.239 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:10.239 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.239 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.239 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.239 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.239 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.240 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.240 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.240 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.240 INFO:teuthology.orchestra.run.smithi044.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-08-19T00:24:10.240 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-08-19T00:24:10.240 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.240 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.240 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.241 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:10.241 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.241 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.241 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.241 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.241 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.241 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.241 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.241 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.242 INFO:teuthology.orchestra.run.smithi044.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-08-19T00:24:10.242 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-08-19T00:24:10.242 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.242 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.242 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.242 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.242 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.243 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.243 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.243 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.243 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.243 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.243 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.243 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.243 INFO:teuthology.orchestra.run.smithi044.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-08-19T00:24:10.244 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-08-19T00:24:10.244 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.244 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.244 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.244 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.244 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.244 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.244 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.245 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.245 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.245 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.245 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.245 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.245 INFO:teuthology.orchestra.run.smithi044.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-08-19T00:24:10.245 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-08-19T00:24:10.245 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.246 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.246 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.246 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.246 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.246 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.246 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.246 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.246 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.247 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.247 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.247 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.247 INFO:teuthology.orchestra.run.smithi044.stdout: "PWD_POLICY_ENABLED": { 2024-08-19T00:24:10.247 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "PWD_POLICY_ENABLED", 2024-08-19T00:24:10.247 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.247 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.247 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.248 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:10.248 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.248 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.248 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.248 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.248 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.248 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.248 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.249 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.249 INFO:teuthology.orchestra.run.smithi044.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-08-19T00:24:10.249 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-08-19T00:24:10.249 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.249 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.249 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.249 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-08-19T00:24:10.249 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.250 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.250 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.250 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.250 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.250 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.250 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.250 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.250 INFO:teuthology.orchestra.run.smithi044.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-08-19T00:24:10.251 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-08-19T00:24:10.251 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:10.251 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.251 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.251 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "10", 2024-08-19T00:24:10.251 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.251 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.251 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.252 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.252 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.252 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.252 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.252 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.252 INFO:teuthology.orchestra.run.smithi044.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-08-19T00:24:10.252 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-08-19T00:24:10.252 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:10.253 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.253 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.253 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "8", 2024-08-19T00:24:10.253 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.253 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.253 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.253 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.253 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.254 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.254 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.254 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.254 INFO:teuthology.orchestra.run.smithi044.stdout: "REST_REQUESTS_TIMEOUT": { 2024-08-19T00:24:10.254 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-08-19T00:24:10.254 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:10.254 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.254 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.255 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "45", 2024-08-19T00:24:10.255 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.255 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.255 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.255 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.255 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.255 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.255 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.256 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.256 INFO:teuthology.orchestra.run.smithi044.stdout: "RGW_API_ACCESS_KEY": { 2024-08-19T00:24:10.256 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "RGW_API_ACCESS_KEY", 2024-08-19T00:24:10.256 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.256 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.256 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.256 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.256 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.257 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.257 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.257 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.257 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.257 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.257 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.257 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.257 INFO:teuthology.orchestra.run.smithi044.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-08-19T00:24:10.258 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-08-19T00:24:10.258 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.258 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.258 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.258 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "admin", 2024-08-19T00:24:10.258 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.258 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.258 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.259 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.259 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.259 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.259 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.259 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.259 INFO:teuthology.orchestra.run.smithi044.stdout: "RGW_API_SECRET_KEY": { 2024-08-19T00:24:10.259 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "RGW_API_SECRET_KEY", 2024-08-19T00:24:10.259 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.260 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.260 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.260 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.260 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.260 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.260 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.260 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.260 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.260 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.261 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.261 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.261 INFO:teuthology.orchestra.run.smithi044.stdout: "RGW_API_SSL_VERIFY": { 2024-08-19T00:24:10.261 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "RGW_API_SSL_VERIFY", 2024-08-19T00:24:10.261 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.261 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.261 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.261 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:10.262 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.262 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.262 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.262 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.262 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.262 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.262 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.263 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.263 INFO:teuthology.orchestra.run.smithi044.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-08-19T00:24:10.263 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-08-19T00:24:10.263 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:10.263 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.263 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.263 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "0", 2024-08-19T00:24:10.263 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.263 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.264 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.264 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.264 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.264 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.264 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.264 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.264 INFO:teuthology.orchestra.run.smithi044.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-08-19T00:24:10.264 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-08-19T00:24:10.265 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:10.265 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.265 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.265 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "10", 2024-08-19T00:24:10.265 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.265 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.265 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.265 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.266 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.266 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.266 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.266 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.266 INFO:teuthology.orchestra.run.smithi044.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-08-19T00:24:10.266 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-08-19T00:24:10.266 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:10.266 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.267 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.267 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "5", 2024-08-19T00:24:10.267 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.267 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.267 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.267 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.267 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.267 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.268 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.268 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.268 INFO:teuthology.orchestra.run.smithi044.stdout: "cross_origin_url": { 2024-08-19T00:24:10.268 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "cross_origin_url", 2024-08-19T00:24:10.268 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.268 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.268 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.268 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.269 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.269 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.269 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.269 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.269 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.269 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.269 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.269 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.269 INFO:teuthology.orchestra.run.smithi044.stdout: "crt_file": { 2024-08-19T00:24:10.270 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "crt_file", 2024-08-19T00:24:10.270 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.270 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.270 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.270 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.270 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.270 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.270 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.271 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.271 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.271 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.271 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.271 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.271 INFO:teuthology.orchestra.run.smithi044.stdout: "debug": { 2024-08-19T00:24:10.271 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "debug", 2024-08-19T00:24:10.272 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.272 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.272 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.272 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.272 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.272 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.272 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.272 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Enable/disable debug options", 2024-08-19T00:24:10.272 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.273 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.273 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.273 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.273 INFO:teuthology.orchestra.run.smithi044.stdout: "jwt_token_ttl": { 2024-08-19T00:24:10.273 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "jwt_token_ttl", 2024-08-19T00:24:10.273 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:10.273 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.273 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.274 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "28800", 2024-08-19T00:24:10.274 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.274 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.274 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.274 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.274 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.274 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.274 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.275 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.275 INFO:teuthology.orchestra.run.smithi044.stdout: "key_file": { 2024-08-19T00:24:10.275 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "key_file", 2024-08-19T00:24:10.275 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.275 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.275 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.275 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.275 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.276 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.276 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.276 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.276 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.276 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.276 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.276 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.276 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:10.277 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:10.277 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.277 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.277 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.277 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.277 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.277 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.277 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.278 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.278 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.278 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.278 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.278 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.278 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.278 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.278 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.279 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.279 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.279 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.279 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.279 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:10.279 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:10.279 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.279 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.279 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.280 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.280 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.280 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.280 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.280 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.280 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.280 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.280 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.281 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.281 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:10.281 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:10.281 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.281 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.281 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.281 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:10.281 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.282 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.282 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.282 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.282 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.282 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.282 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.282 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.282 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.283 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.283 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.283 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.283 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.283 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.283 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.283 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:10.283 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:10.284 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.284 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.284 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.284 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.284 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.284 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.284 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.284 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.284 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.285 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.285 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.285 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.285 INFO:teuthology.orchestra.run.smithi044.stdout: "motd": { 2024-08-19T00:24:10.285 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "motd", 2024-08-19T00:24:10.285 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.285 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.285 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.286 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.286 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.286 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.286 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.286 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "The message of the day", 2024-08-19T00:24:10.286 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.290 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.290 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.290 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.290 INFO:teuthology.orchestra.run.smithi044.stdout: "redirect_resolve_ip_addr": { 2024-08-19T00:24:10.290 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "redirect_resolve_ip_addr", 2024-08-19T00:24:10.290 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.291 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.291 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.291 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.291 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.291 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.291 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.291 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.291 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.292 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.292 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.292 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.292 INFO:teuthology.orchestra.run.smithi044.stdout: "server_addr": { 2024-08-19T00:24:10.292 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "server_addr", 2024-08-19T00:24:10.292 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.292 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.292 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.293 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "::", 2024-08-19T00:24:10.293 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.293 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.293 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.293 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.293 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.293 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.293 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.293 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.294 INFO:teuthology.orchestra.run.smithi044.stdout: "server_port": { 2024-08-19T00:24:10.294 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "server_port", 2024-08-19T00:24:10.294 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:10.294 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.294 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.294 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "8080", 2024-08-19T00:24:10.294 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.295 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.295 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.295 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.295 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.295 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.295 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.295 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.295 INFO:teuthology.orchestra.run.smithi044.stdout: "ssl": { 2024-08-19T00:24:10.296 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "ssl", 2024-08-19T00:24:10.296 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.296 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.296 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.296 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:10.296 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.296 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.296 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.296 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.297 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.297 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.297 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.297 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.297 INFO:teuthology.orchestra.run.smithi044.stdout: "ssl_server_port": { 2024-08-19T00:24:10.297 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "ssl_server_port", 2024-08-19T00:24:10.297 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:10.297 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.298 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.298 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "8443", 2024-08-19T00:24:10.298 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.298 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.298 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.298 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.298 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.298 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.299 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.299 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.299 INFO:teuthology.orchestra.run.smithi044.stdout: "standby_behaviour": { 2024-08-19T00:24:10.299 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "standby_behaviour", 2024-08-19T00:24:10.299 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.299 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.299 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.300 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "redirect", 2024-08-19T00:24:10.300 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.300 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.300 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.300 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.300 INFO:teuthology.orchestra.run.smithi044.stdout: "redirect" 2024-08-19T00:24:10.300 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.300 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.300 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.301 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.301 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.301 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.301 INFO:teuthology.orchestra.run.smithi044.stdout: "standby_error_status_code": { 2024-08-19T00:24:10.301 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "standby_error_status_code", 2024-08-19T00:24:10.301 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:10.301 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.301 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.302 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "500", 2024-08-19T00:24:10.302 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "400", 2024-08-19T00:24:10.302 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "599", 2024-08-19T00:24:10.302 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.302 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.302 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.302 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.302 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.303 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.303 INFO:teuthology.orchestra.run.smithi044.stdout: "url_prefix": { 2024-08-19T00:24:10.303 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "url_prefix", 2024-08-19T00:24:10.303 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.303 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.303 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.303 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.303 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.304 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.304 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.304 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.304 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.304 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.304 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.304 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.304 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.305 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.305 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:10.305 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "devicehealth", 2024-08-19T00:24:10.305 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:10.305 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:10.305 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:10.305 INFO:teuthology.orchestra.run.smithi044.stdout: "enable_monitoring": { 2024-08-19T00:24:10.305 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "enable_monitoring", 2024-08-19T00:24:10.305 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.306 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.306 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.306 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:10.306 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.306 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.306 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.306 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "monitor device health metrics", 2024-08-19T00:24:10.307 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.307 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.307 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.307 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.307 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:10.307 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:10.307 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.307 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.307 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.308 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.308 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.308 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.308 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.308 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.308 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.308 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.308 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.309 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.309 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.309 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.309 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.309 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.309 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.309 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.309 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.309 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:10.310 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:10.310 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.310 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.310 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.310 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.310 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.310 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.310 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.311 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.311 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.311 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.311 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.311 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.311 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:10.311 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:10.311 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.312 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.312 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.312 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:10.312 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.312 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.312 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.312 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.312 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.312 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.313 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.313 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.313 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.313 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.313 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.313 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.313 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.313 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.314 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.314 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:10.314 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:10.314 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.314 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.314 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.314 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.314 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.315 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.315 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.315 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.315 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.315 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.315 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.315 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.315 INFO:teuthology.orchestra.run.smithi044.stdout: "mark_out_threshold": { 2024-08-19T00:24:10.316 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "mark_out_threshold", 2024-08-19T00:24:10.316 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", 2024-08-19T00:24:10.316 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.316 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.316 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "2419200", 2024-08-19T00:24:10.316 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.316 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.316 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.317 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-08-19T00:24:10.317 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.317 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.317 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.317 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.317 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_name": { 2024-08-19T00:24:10.317 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "pool_name", 2024-08-19T00:24:10.317 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.317 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.318 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.318 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "device_health_metrics", 2024-08-19T00:24:10.318 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.318 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.318 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.318 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "name of pool in which to store device health metrics", 2024-08-19T00:24:10.318 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.318 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.319 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.319 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.319 INFO:teuthology.orchestra.run.smithi044.stdout: "retention_period": { 2024-08-19T00:24:10.319 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "retention_period", 2024-08-19T00:24:10.319 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", 2024-08-19T00:24:10.319 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.319 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.319 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "15552000", 2024-08-19T00:24:10.320 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.320 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.320 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.320 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "how long to retain device health metrics", 2024-08-19T00:24:10.320 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.320 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.320 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.320 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.321 INFO:teuthology.orchestra.run.smithi044.stdout: "scrape_frequency": { 2024-08-19T00:24:10.321 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "scrape_frequency", 2024-08-19T00:24:10.321 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", 2024-08-19T00:24:10.321 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.321 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.321 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "86400", 2024-08-19T00:24:10.321 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.321 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.322 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.322 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "how frequently to scrape device health metrics", 2024-08-19T00:24:10.322 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.322 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.322 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.322 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.322 INFO:teuthology.orchestra.run.smithi044.stdout: "self_heal": { 2024-08-19T00:24:10.322 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "self_heal", 2024-08-19T00:24:10.323 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.323 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.323 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.323 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:10.323 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.323 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.323 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.323 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-08-19T00:24:10.324 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.324 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.324 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.324 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.324 INFO:teuthology.orchestra.run.smithi044.stdout: "sleep_interval": { 2024-08-19T00:24:10.324 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "sleep_interval", 2024-08-19T00:24:10.324 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", 2024-08-19T00:24:10.324 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.325 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.325 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "600", 2024-08-19T00:24:10.325 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.325 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.325 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.325 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "how frequently to wake up and check device health", 2024-08-19T00:24:10.325 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.325 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.326 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.326 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.326 INFO:teuthology.orchestra.run.smithi044.stdout: "warn_threshold": { 2024-08-19T00:24:10.326 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "warn_threshold", 2024-08-19T00:24:10.326 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", 2024-08-19T00:24:10.326 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.326 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.326 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "7257600", 2024-08-19T00:24:10.327 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.327 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.327 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.327 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-08-19T00:24:10.327 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.327 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.327 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.327 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.327 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.328 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.328 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:10.328 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "diskprediction_local", 2024-08-19T00:24:10.328 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:10.328 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:10.328 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:10.328 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:10.328 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:10.329 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.329 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.329 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.329 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.329 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.329 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.329 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.329 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.330 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.330 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.330 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.330 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.330 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.330 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.330 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.330 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.330 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.331 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.331 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.331 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:10.331 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:10.331 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.331 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.331 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.331 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.332 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.332 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.332 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.332 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.332 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.332 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.332 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.332 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.333 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:10.333 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:10.333 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.333 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.333 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.333 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:10.333 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.333 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.334 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.334 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.334 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.334 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.334 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.334 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.334 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.334 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.335 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.335 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.335 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.335 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.335 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.335 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:10.335 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:10.335 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.335 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.336 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.336 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.336 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.336 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.336 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.336 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.336 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.336 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.337 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.337 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.337 INFO:teuthology.orchestra.run.smithi044.stdout: "predict_interval": { 2024-08-19T00:24:10.337 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "predict_interval", 2024-08-19T00:24:10.337 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.337 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.337 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.337 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "86400", 2024-08-19T00:24:10.338 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.338 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.338 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.338 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.338 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.338 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.338 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.338 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.339 INFO:teuthology.orchestra.run.smithi044.stdout: "predictor_model": { 2024-08-19T00:24:10.339 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "predictor_model", 2024-08-19T00:24:10.339 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.339 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.339 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.339 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "prophetstor", 2024-08-19T00:24:10.339 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.339 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.339 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.340 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.340 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.340 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.340 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.340 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.340 INFO:teuthology.orchestra.run.smithi044.stdout: "sleep_interval": { 2024-08-19T00:24:10.340 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "sleep_interval", 2024-08-19T00:24:10.340 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.341 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.341 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.341 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "600", 2024-08-19T00:24:10.341 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.341 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.341 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.341 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.341 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.341 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.342 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.342 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.342 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.342 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.342 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:10.342 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "influx", 2024-08-19T00:24:10.342 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": false, 2024-08-19T00:24:10.342 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "influxdb python module not found", 2024-08-19T00:24:10.343 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:10.343 INFO:teuthology.orchestra.run.smithi044.stdout: "batch_size": { 2024-08-19T00:24:10.343 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "batch_size", 2024-08-19T00:24:10.343 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:10.343 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.343 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.343 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "5000", 2024-08-19T00:24:10.343 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.344 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.344 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.344 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-08-19T00:24:10.344 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.344 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.344 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.344 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.344 INFO:teuthology.orchestra.run.smithi044.stdout: "database": { 2024-08-19T00:24:10.345 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "database", 2024-08-19T00:24:10.345 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.345 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.345 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.345 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "ceph", 2024-08-19T00:24:10.345 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.345 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.345 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.346 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-08-19T00:24:10.346 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.346 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.346 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.346 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.346 INFO:teuthology.orchestra.run.smithi044.stdout: "hostname": { 2024-08-19T00:24:10.346 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "hostname", 2024-08-19T00:24:10.346 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.347 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.347 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.347 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.347 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.347 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.347 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.347 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "InfluxDB server hostname", 2024-08-19T00:24:10.347 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.347 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.348 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.348 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.348 INFO:teuthology.orchestra.run.smithi044.stdout: "interval": { 2024-08-19T00:24:10.348 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "interval", 2024-08-19T00:24:10.348 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", 2024-08-19T00:24:10.348 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.348 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.348 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "30", 2024-08-19T00:24:10.349 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "5", 2024-08-19T00:24:10.349 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.349 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.349 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-08-19T00:24:10.349 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.349 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.349 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.349 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.350 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:10.350 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:10.350 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.350 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.350 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.350 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.350 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.350 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.351 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.351 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.351 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.351 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.351 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.351 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.351 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.351 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.352 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.352 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.352 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.352 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.352 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.352 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:10.352 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:10.352 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.352 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.353 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.353 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.353 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.353 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.353 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.353 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.353 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.353 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.354 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.354 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.354 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:10.354 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:10.354 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.354 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.354 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.354 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:10.355 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.355 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.355 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.355 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.355 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.355 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.355 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.355 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.356 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.356 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.356 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.356 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.356 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.356 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.356 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.356 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:10.357 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:10.357 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.357 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.357 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.357 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.357 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.357 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.357 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.357 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.358 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.358 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.358 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.358 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.358 INFO:teuthology.orchestra.run.smithi044.stdout: "password": { 2024-08-19T00:24:10.358 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "password", 2024-08-19T00:24:10.358 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.358 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.359 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.359 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.359 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.359 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.359 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.359 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "password of InfluxDB server user", 2024-08-19T00:24:10.359 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.359 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.360 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.360 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.360 INFO:teuthology.orchestra.run.smithi044.stdout: "port": { 2024-08-19T00:24:10.360 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "port", 2024-08-19T00:24:10.360 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:10.360 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.360 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.360 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "8086", 2024-08-19T00:24:10.361 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.361 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.361 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.361 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "InfluxDB server port", 2024-08-19T00:24:10.361 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.361 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.361 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.361 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.362 INFO:teuthology.orchestra.run.smithi044.stdout: "ssl": { 2024-08-19T00:24:10.362 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "ssl", 2024-08-19T00:24:10.362 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.362 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.362 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.362 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "false", 2024-08-19T00:24:10.362 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.362 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.363 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.363 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-08-19T00:24:10.363 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.363 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.363 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.363 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.363 INFO:teuthology.orchestra.run.smithi044.stdout: "threads": { 2024-08-19T00:24:10.363 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "threads", 2024-08-19T00:24:10.363 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:10.364 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.364 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.364 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "5", 2024-08-19T00:24:10.364 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "1", 2024-08-19T00:24:10.364 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "32", 2024-08-19T00:24:10.364 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.364 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-08-19T00:24:10.364 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.365 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.365 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.365 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.365 INFO:teuthology.orchestra.run.smithi044.stdout: "username": { 2024-08-19T00:24:10.365 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "username", 2024-08-19T00:24:10.365 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.365 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.365 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.366 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.366 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.366 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.366 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.366 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "username of InfluxDB server user", 2024-08-19T00:24:10.366 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.366 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.366 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.367 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.367 INFO:teuthology.orchestra.run.smithi044.stdout: "verify_ssl": { 2024-08-19T00:24:10.367 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "verify_ssl", 2024-08-19T00:24:10.367 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.367 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.367 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.367 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "true", 2024-08-19T00:24:10.367 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.368 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.368 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.368 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-08-19T00:24:10.368 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.368 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.368 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.368 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.368 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.369 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.369 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:10.369 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "insights", 2024-08-19T00:24:10.369 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:10.369 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:10.369 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:10.369 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:10.369 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:10.369 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.370 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.370 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.370 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.370 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.370 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.370 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.370 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.370 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.371 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.371 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.371 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.371 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.371 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.371 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.371 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.371 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.372 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.372 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.372 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:10.372 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:10.372 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.372 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.372 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.372 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.373 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.373 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.373 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.373 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.373 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.373 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.373 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.373 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.373 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:10.374 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:10.374 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.374 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.374 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.374 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:10.374 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.374 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.374 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.375 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.375 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.375 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.375 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.375 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.375 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.375 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.375 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.376 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.376 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.376 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.376 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.376 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:10.376 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:10.376 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.376 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.376 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.377 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.377 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.377 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.377 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.377 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.377 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.377 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.377 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.378 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.378 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.378 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.378 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:10.378 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "iostat", 2024-08-19T00:24:10.378 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:10.378 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:10.378 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:10.379 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:10.379 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:10.379 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.379 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.379 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.379 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.379 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.379 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.380 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.380 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.380 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.380 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.380 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.380 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.380 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.380 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.381 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.381 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.381 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.381 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.381 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.381 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:10.381 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:10.381 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.381 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.382 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.382 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.382 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.382 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.382 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.382 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.382 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.382 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.383 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.383 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.383 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:10.383 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:10.383 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.383 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.383 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.383 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:10.384 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.384 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.384 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.384 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.384 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.384 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.384 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.384 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.384 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.385 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.385 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.385 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.385 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.385 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.385 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.385 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:10.385 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:10.386 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.386 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.386 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.386 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.386 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.386 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.386 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.386 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.387 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.387 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.387 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.387 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.387 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.387 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.387 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:10.387 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "k8sevents", 2024-08-19T00:24:10.388 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:10.388 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:10.388 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:10.388 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_event_retention_days": { 2024-08-19T00:24:10.388 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "ceph_event_retention_days", 2024-08-19T00:24:10.388 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:10.388 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.388 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.389 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "7", 2024-08-19T00:24:10.389 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.389 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.389 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.389 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Days to hold ceph event information within local cache", 2024-08-19T00:24:10.389 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.389 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.389 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.389 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.390 INFO:teuthology.orchestra.run.smithi044.stdout: "config_check_secs": { 2024-08-19T00:24:10.390 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "config_check_secs", 2024-08-19T00:24:10.390 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:10.390 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.390 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.390 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "10", 2024-08-19T00:24:10.390 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "10", 2024-08-19T00:24:10.391 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.391 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.391 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-08-19T00:24:10.391 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.391 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.391 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.391 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.391 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:10.391 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:10.392 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.392 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.392 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.392 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.392 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.392 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.392 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.392 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.393 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.393 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.393 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.393 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.393 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.393 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.393 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.393 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.394 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.394 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.394 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.394 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:10.394 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:10.394 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.394 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.394 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.395 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.395 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.395 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.395 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.395 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.395 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.395 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.396 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.396 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.396 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:10.396 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:10.396 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.396 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.396 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.396 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:10.396 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.397 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.397 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.397 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.397 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.397 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.397 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.397 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.397 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.398 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.398 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.398 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.398 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.398 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.398 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.398 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:10.399 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:10.399 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.399 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.399 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.399 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.399 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.399 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.399 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.400 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.400 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.400 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.400 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.400 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.400 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.400 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.400 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:10.401 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "localpool", 2024-08-19T00:24:10.401 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:10.401 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:10.401 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:10.401 INFO:teuthology.orchestra.run.smithi044.stdout: "failure_domain": { 2024-08-19T00:24:10.401 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "failure_domain", 2024-08-19T00:24:10.401 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.401 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.402 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.402 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "host", 2024-08-19T00:24:10.402 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.402 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.402 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.402 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "failure domain for any created local pool", 2024-08-19T00:24:10.402 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-08-19T00:24:10.402 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.403 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.403 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.403 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:10.403 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:10.403 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.403 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.403 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.403 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.404 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.404 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.404 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.404 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.404 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.404 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.404 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.404 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.405 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.405 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.405 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.405 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.405 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.405 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.405 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.405 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:10.406 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:10.406 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.406 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.406 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.406 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.406 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.407 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.407 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.407 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.407 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.407 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.408 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.408 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.408 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:10.408 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:10.408 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.408 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.409 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.409 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:10.409 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.409 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.409 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.410 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.410 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.410 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.410 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.410 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.410 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.411 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.411 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.411 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.411 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.411 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.411 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.411 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:10.412 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:10.412 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.412 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.412 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.412 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.412 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.412 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.413 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.413 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.413 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.413 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.413 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.413 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.413 INFO:teuthology.orchestra.run.smithi044.stdout: "min_size": { 2024-08-19T00:24:10.414 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "min_size", 2024-08-19T00:24:10.414 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:10.414 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.414 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.414 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.414 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.414 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.415 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.415 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "default min_size for any created local pool", 2024-08-19T00:24:10.415 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-08-19T00:24:10.415 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.415 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.415 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.415 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rep": { 2024-08-19T00:24:10.416 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "num_rep", 2024-08-19T00:24:10.416 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:10.416 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.416 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.416 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "3", 2024-08-19T00:24:10.416 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.418 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:09 smithi116 ceph-mon[21873]: pgmap v337: 129 pgs: 129 active+clean; 546 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.1 MiB/s wr, 217 op/s 2024-08-19T00:24:10.418 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:09 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/3886830477' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-08-19T00:24:10.418 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:09 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/844557977' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-08-19T00:24:10.418 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:09 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/2531738966' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-08-19T00:24:10.419 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:09 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/3717619637' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-08-19T00:24:10.419 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:09 smithi171 ceph-mon[21810]: pgmap v337: 129 pgs: 129 active+clean; 546 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.1 MiB/s wr, 217 op/s 2024-08-19T00:24:10.419 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:09 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/3886830477' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-08-19T00:24:10.419 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:09 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/844557977' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-08-19T00:24:10.419 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:09 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/2531738966' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-08-19T00:24:10.419 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:09 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/3717619637' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-08-19T00:24:10.424 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.425 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.425 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "default replica count for any created local pool", 2024-08-19T00:24:10.425 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.425 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.425 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.425 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.425 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num": { 2024-08-19T00:24:10.426 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "pg_num", 2024-08-19T00:24:10.426 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:10.426 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.426 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.426 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "128", 2024-08-19T00:24:10.426 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.426 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.427 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.427 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "default pg_num for any created local pool", 2024-08-19T00:24:10.427 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.427 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.427 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.427 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.427 INFO:teuthology.orchestra.run.smithi044.stdout: "prefix": { 2024-08-19T00:24:10.428 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "prefix", 2024-08-19T00:24:10.428 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.428 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.428 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.428 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.429 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.429 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.429 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.430 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "name prefix for any created local pool", 2024-08-19T00:24:10.430 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.431 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.431 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.431 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.431 INFO:teuthology.orchestra.run.smithi044.stdout: "subtree": { 2024-08-19T00:24:10.431 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "subtree", 2024-08-19T00:24:10.431 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.432 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.432 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.432 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "rack", 2024-08-19T00:24:10.432 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.432 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.432 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.432 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "CRUSH level for which to create a local pool", 2024-08-19T00:24:10.433 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-08-19T00:24:10.433 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.433 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.433 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.433 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.434 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.434 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:10.434 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "mds_autoscaler", 2024-08-19T00:24:10.434 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:10.434 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:10.435 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:10.435 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:10.435 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:10.435 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.435 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.435 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.435 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.436 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.436 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.436 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.436 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.436 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.436 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.436 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.436 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.437 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.437 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.437 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.437 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.437 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.437 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.437 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.438 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:10.438 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:10.438 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.438 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.438 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.438 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.439 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.439 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.439 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.439 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.439 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.439 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.439 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.439 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.440 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:10.440 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:10.440 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.440 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.440 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.440 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:10.440 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.441 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.441 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.441 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.441 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.441 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.441 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.441 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.442 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.442 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.442 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.442 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.442 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.443 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.443 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.443 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:10.444 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:10.444 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.444 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.444 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.444 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.444 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.445 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.445 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.445 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.445 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.445 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.446 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.446 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.446 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.446 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.447 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:10.447 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "mirroring", 2024-08-19T00:24:10.447 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:10.447 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:10.447 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:10.448 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:10.448 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:10.448 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.448 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.448 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.449 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.449 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.449 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.449 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.450 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.450 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.450 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.450 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.450 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.451 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.451 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.451 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.451 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.451 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.451 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.451 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.452 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:10.452 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:10.452 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.452 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.452 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.452 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.453 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.453 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.453 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.453 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.453 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.453 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.454 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.454 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.454 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:10.454 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:10.454 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.454 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.454 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.455 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:10.455 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.455 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.455 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.455 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.455 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.455 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.456 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.456 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.456 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.456 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.456 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.456 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.457 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.457 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.457 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.457 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:10.457 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:10.457 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.458 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.458 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.458 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.458 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.458 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.458 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.459 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.459 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.459 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.459 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.459 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.460 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.460 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.460 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:10.460 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "nfs", 2024-08-19T00:24:10.460 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:10.460 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:10.461 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:10.461 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:10.461 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:10.461 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.461 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.461 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.462 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.462 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.462 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.462 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.462 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.462 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.463 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.463 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.463 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.463 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.463 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.463 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.464 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.464 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.464 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.464 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.464 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:10.464 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:10.465 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.465 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.465 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.465 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.465 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.466 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.466 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.466 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.466 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.466 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.467 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.467 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.467 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:10.467 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:10.467 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.467 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.468 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.468 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:10.468 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.468 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.468 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.469 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.469 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.469 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.469 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.469 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.469 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.470 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.470 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.470 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.470 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.470 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.471 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.471 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:10.471 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:10.471 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.471 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.472 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.472 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.472 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.472 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.472 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.472 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.473 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.473 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.473 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.473 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.473 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.474 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.474 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:10.474 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "orchestrator", 2024-08-19T00:24:10.474 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:10.475 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:10.475 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:10.475 INFO:teuthology.orchestra.run.smithi044.stdout: "fail_fs": { 2024-08-19T00:24:10.475 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "fail_fs", 2024-08-19T00:24:10.475 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.475 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.476 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.476 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.476 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.476 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.476 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.476 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-08-19T00:24:10.477 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.477 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.477 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.477 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.477 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:10.477 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:10.478 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.478 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.478 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.478 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.478 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.479 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.479 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.479 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.479 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.479 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.480 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.480 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.480 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.480 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.481 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.481 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.481 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.481 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.481 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.482 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:10.482 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:10.482 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.482 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.482 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.483 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.483 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.483 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.483 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.483 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.484 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.484 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.484 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.484 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.484 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:10.485 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:10.485 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.485 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.485 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.485 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:10.485 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.486 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.486 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.486 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.486 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.486 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.486 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.487 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.487 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.487 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.487 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.487 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.488 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.488 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.488 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.488 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:10.488 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:10.489 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.489 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.489 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.489 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.489 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.489 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.490 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.490 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.490 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.490 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.490 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.491 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.491 INFO:teuthology.orchestra.run.smithi044.stdout: "orchestrator": { 2024-08-19T00:24:10.491 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "orchestrator", 2024-08-19T00:24:10.491 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.491 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.491 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.491 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.491 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.492 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.492 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.492 INFO:teuthology.orchestra.run.smithi044.stdout: "cephadm", 2024-08-19T00:24:10.492 INFO:teuthology.orchestra.run.smithi044.stdout: "rook", 2024-08-19T00:24:10.492 INFO:teuthology.orchestra.run.smithi044.stdout: "test_orchestrator" 2024-08-19T00:24:10.494 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.494 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Orchestrator backend", 2024-08-19T00:24:10.494 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.494 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.495 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.495 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.495 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.495 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.496 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:10.496 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "osd_perf_query", 2024-08-19T00:24:10.496 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:10.496 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:10.497 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:10.497 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:10.497 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:10.497 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.497 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.497 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.498 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.498 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.498 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.498 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.498 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.499 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.499 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.499 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.499 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.499 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.499 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.499 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.500 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.500 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.500 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.500 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.500 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:10.500 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:10.501 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.501 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.501 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.501 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.501 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.501 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.502 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.502 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.502 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.502 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.502 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.502 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.503 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:10.503 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:10.503 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.503 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.503 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.503 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:10.503 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.504 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.504 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.504 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.504 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.504 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.505 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.505 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.505 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.505 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.505 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.505 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.506 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.506 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.506 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.506 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:10.506 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:10.506 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.506 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.507 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.507 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.507 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.507 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.507 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.507 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.507 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.508 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.508 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.508 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.508 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.509 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.509 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:10.509 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "osd_support", 2024-08-19T00:24:10.509 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:10.509 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:10.509 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:10.510 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:10.510 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:10.510 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.510 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.510 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.511 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.511 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.511 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.511 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.511 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.511 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.512 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.512 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.512 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.512 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.512 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.512 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.513 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.513 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.513 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.513 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.513 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:10.514 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:10.514 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.514 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.514 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.514 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.515 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.515 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.515 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.515 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.515 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.516 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.516 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.516 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.516 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:10.516 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:10.516 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.516 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.517 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.517 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:10.517 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.517 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.517 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.518 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.518 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.518 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.518 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.518 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.519 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.519 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.519 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.519 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.519 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.519 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.520 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.520 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:10.520 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:10.520 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.520 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.520 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.520 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.521 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.521 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.521 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.521 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.522 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.522 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.522 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.522 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.522 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.523 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.523 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:10.523 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "pg_autoscaler", 2024-08-19T00:24:10.523 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:10.523 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:10.524 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:10.524 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:10.524 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:10.524 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.524 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.524 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.525 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.525 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.525 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.525 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.525 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.526 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.526 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.526 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.526 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.526 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.526 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.527 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.527 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.527 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.527 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.527 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.527 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:10.528 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:10.528 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.528 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.528 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.528 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.528 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.529 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.529 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.529 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.529 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.529 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.529 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.530 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.530 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:10.530 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:10.530 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.530 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.531 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.531 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:10.531 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.531 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.531 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.531 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.531 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.532 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.532 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.532 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.532 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.532 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.532 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.532 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.532 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.533 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.533 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.533 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:10.533 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:10.533 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.533 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.534 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.534 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.534 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.534 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.534 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.534 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.534 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.535 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.535 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.535 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.535 INFO:teuthology.orchestra.run.smithi044.stdout: "sleep_interval": { 2024-08-19T00:24:10.535 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "sleep_interval", 2024-08-19T00:24:10.535 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", 2024-08-19T00:24:10.536 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.536 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.536 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "60", 2024-08-19T00:24:10.536 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.536 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.536 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.536 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.536 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.537 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.537 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.537 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.537 INFO:teuthology.orchestra.run.smithi044.stdout: "threshold": { 2024-08-19T00:24:10.537 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "threshold", 2024-08-19T00:24:10.537 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "float", 2024-08-19T00:24:10.537 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.537 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.538 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "3.0", 2024-08-19T00:24:10.538 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "1.0", 2024-08-19T00:24:10.538 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.538 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.538 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "scaling threshold", 2024-08-19T00:24:10.538 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-08-19T00:24:10.538 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.539 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.539 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.539 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.539 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.539 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:10.539 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "progress", 2024-08-19T00:24:10.539 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:10.539 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:10.540 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:10.540 INFO:teuthology.orchestra.run.smithi044.stdout: "allow_pg_recovery_event": { 2024-08-19T00:24:10.540 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "allow_pg_recovery_event", 2024-08-19T00:24:10.540 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.540 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.540 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.540 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.541 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.541 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.541 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.541 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "allow the module to show pg recovery progress", 2024-08-19T00:24:10.541 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.541 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.542 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.542 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.542 INFO:teuthology.orchestra.run.smithi044.stdout: "enabled": { 2024-08-19T00:24:10.542 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "enabled", 2024-08-19T00:24:10.542 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.542 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.542 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.543 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:10.543 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.543 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.543 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.543 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.543 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.543 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.544 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.544 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.544 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:10.544 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:10.544 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.544 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.544 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.544 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.545 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.545 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.545 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.545 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.545 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.545 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.545 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.546 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.546 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.546 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.546 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.546 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.546 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.546 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.547 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.547 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:10.547 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:10.547 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.547 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.547 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.547 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.548 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.548 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.548 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.548 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.548 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.548 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.549 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.549 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.549 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:10.549 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:10.549 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.550 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.550 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.550 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:10.550 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.550 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.550 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.551 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.551 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.551 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.551 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.551 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.552 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.552 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.552 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.552 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.552 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.552 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.552 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.553 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:10.553 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:10.553 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.553 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.553 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.553 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.554 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.554 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.554 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.554 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.554 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.554 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.555 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.555 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.555 INFO:teuthology.orchestra.run.smithi044.stdout: "max_completed_events": { 2024-08-19T00:24:10.555 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "max_completed_events", 2024-08-19T00:24:10.555 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:10.555 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.556 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.556 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "50", 2024-08-19T00:24:10.556 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.556 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.556 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.556 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "number of past completed events to remember", 2024-08-19T00:24:10.556 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.557 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.557 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.557 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.557 INFO:teuthology.orchestra.run.smithi044.stdout: "sleep_interval": { 2024-08-19T00:24:10.557 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "sleep_interval", 2024-08-19T00:24:10.557 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", 2024-08-19T00:24:10.557 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.557 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.558 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "5", 2024-08-19T00:24:10.558 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.558 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.558 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.558 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "how long the module is going to sleep", 2024-08-19T00:24:10.558 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.559 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.559 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.559 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.559 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.559 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.559 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:10.559 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "prometheus", 2024-08-19T00:24:10.560 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:10.560 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:10.560 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:10.560 INFO:teuthology.orchestra.run.smithi044.stdout: "cache": { 2024-08-19T00:24:10.560 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "cache", 2024-08-19T00:24:10.560 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.560 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.561 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.561 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:10.561 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.561 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.561 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.561 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.561 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.561 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.562 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.562 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.562 INFO:teuthology.orchestra.run.smithi044.stdout: "exclude_perf_counters": { 2024-08-19T00:24:10.562 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "exclude_perf_counters", 2024-08-19T00:24:10.562 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.562 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.562 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.562 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:10.563 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.563 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.563 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.563 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-08-19T00:24:10.563 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-08-19T00:24:10.563 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.563 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.564 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.564 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:10.564 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:10.564 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.564 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.565 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.565 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.565 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.565 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.565 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.565 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.565 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.565 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.566 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.566 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.566 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.566 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.566 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.567 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.567 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.567 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.567 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.567 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:10.568 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:10.568 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.568 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.568 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.568 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.568 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.568 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.569 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.569 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.569 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.569 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.569 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.569 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.569 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:10.569 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:10.570 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.570 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.570 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.570 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:10.570 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.570 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.571 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.571 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.571 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.571 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.571 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.571 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.572 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.572 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.572 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.572 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.572 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.573 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.573 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.573 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:10.573 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:10.573 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.573 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.573 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.574 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.574 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.574 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.574 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.574 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.574 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.575 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.575 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.575 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.575 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_stats_pools": { 2024-08-19T00:24:10.575 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "rbd_stats_pools", 2024-08-19T00:24:10.576 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.576 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.576 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.576 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.576 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.576 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.577 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.577 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.577 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.577 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.577 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.577 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.578 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_stats_pools_refresh_interval": { 2024-08-19T00:24:10.578 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-08-19T00:24:10.578 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:10.578 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.578 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.579 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "300", 2024-08-19T00:24:10.579 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.579 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.579 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.579 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.579 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.579 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.580 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.580 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.580 INFO:teuthology.orchestra.run.smithi044.stdout: "scrape_interval": { 2024-08-19T00:24:10.580 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "scrape_interval", 2024-08-19T00:24:10.580 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "float", 2024-08-19T00:24:10.580 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.580 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.580 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "15.0", 2024-08-19T00:24:10.581 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.581 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.581 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.581 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.581 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.581 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.581 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.582 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.582 INFO:teuthology.orchestra.run.smithi044.stdout: "server_addr": { 2024-08-19T00:24:10.582 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "server_addr", 2024-08-19T00:24:10.582 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.582 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.582 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.582 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "::", 2024-08-19T00:24:10.583 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.583 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.583 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.583 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-08-19T00:24:10.583 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.583 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.583 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.584 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.584 INFO:teuthology.orchestra.run.smithi044.stdout: "server_port": { 2024-08-19T00:24:10.584 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "server_port", 2024-08-19T00:24:10.584 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:10.584 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.585 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.585 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "9283", 2024-08-19T00:24:10.585 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.585 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.585 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.586 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-08-19T00:24:10.586 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.586 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.586 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.586 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.586 INFO:teuthology.orchestra.run.smithi044.stdout: "stale_cache_strategy": { 2024-08-19T00:24:10.587 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "stale_cache_strategy", 2024-08-19T00:24:10.587 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.587 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.587 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.587 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "log", 2024-08-19T00:24:10.587 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.588 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.588 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.588 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.588 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.588 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.588 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.588 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.588 INFO:teuthology.orchestra.run.smithi044.stdout: "standby_behaviour": { 2024-08-19T00:24:10.589 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "standby_behaviour", 2024-08-19T00:24:10.589 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.589 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.589 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.589 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "default", 2024-08-19T00:24:10.589 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.589 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.590 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.590 INFO:teuthology.orchestra.run.smithi044.stdout: "default", 2024-08-19T00:24:10.590 INFO:teuthology.orchestra.run.smithi044.stdout: "error" 2024-08-19T00:24:10.590 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.590 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.590 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.590 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.591 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.591 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.591 INFO:teuthology.orchestra.run.smithi044.stdout: "standby_error_status_code": { 2024-08-19T00:24:10.591 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "standby_error_status_code", 2024-08-19T00:24:10.591 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:10.591 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.591 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.592 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "500", 2024-08-19T00:24:10.592 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "400", 2024-08-19T00:24:10.592 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "599", 2024-08-19T00:24:10.592 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.592 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.592 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.592 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.592 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.593 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.593 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.593 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.593 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:10.593 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "rbd_support", 2024-08-19T00:24:10.593 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:10.593 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:10.594 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:10.594 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:10.594 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:10.594 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.594 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.594 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.594 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.595 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.595 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.595 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.595 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.595 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.595 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.595 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.596 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.596 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.596 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.596 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.596 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.596 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.596 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.596 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.597 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:10.597 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:10.597 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.597 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.597 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.597 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.597 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.598 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.598 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.598 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.598 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.598 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.598 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.598 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.599 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:10.599 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:10.599 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.599 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.599 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.599 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:10.599 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.600 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.600 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.600 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.600 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.600 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.600 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.601 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.601 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.601 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.601 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.602 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.602 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.602 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.602 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.602 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:10.602 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:10.602 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.603 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.603 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.603 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.603 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.604 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.604 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.604 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.604 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.604 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.604 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.604 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.604 INFO:teuthology.orchestra.run.smithi044.stdout: "max_concurrent_snap_create": { 2024-08-19T00:24:10.605 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "max_concurrent_snap_create", 2024-08-19T00:24:10.605 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:10.605 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.605 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.605 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "10", 2024-08-19T00:24:10.605 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.606 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.606 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.606 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.606 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.606 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.607 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.607 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.607 INFO:teuthology.orchestra.run.smithi044.stdout: "mirror_snapshot_schedule": { 2024-08-19T00:24:10.607 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "mirror_snapshot_schedule", 2024-08-19T00:24:10.607 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.608 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.608 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.608 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.608 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.609 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.609 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.609 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.609 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.609 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.609 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.610 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.610 INFO:teuthology.orchestra.run.smithi044.stdout: "trash_purge_schedule": { 2024-08-19T00:24:10.610 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "trash_purge_schedule", 2024-08-19T00:24:10.610 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.610 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.610 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.610 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.610 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.611 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.611 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.611 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.611 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.611 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.611 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.611 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.612 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.612 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.612 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:10.612 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "restful", 2024-08-19T00:24:10.612 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:10.612 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:10.612 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:10.613 INFO:teuthology.orchestra.run.smithi044.stdout: "enable_auth": { 2024-08-19T00:24:10.613 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "enable_auth", 2024-08-19T00:24:10.613 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.613 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.613 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.613 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:10.614 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.614 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.614 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.614 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.614 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.614 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.615 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.615 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.615 INFO:teuthology.orchestra.run.smithi044.stdout: "key_file": { 2024-08-19T00:24:10.615 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "key_file", 2024-08-19T00:24:10.615 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.615 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.616 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.616 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.616 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.616 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.616 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.617 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.617 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.617 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.617 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.618 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.618 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:10.618 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:10.618 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.618 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.618 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.619 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.619 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.619 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.619 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.619 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.619 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.620 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.620 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.620 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.620 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.621 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.621 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.621 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.621 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.622 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.622 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.622 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:10.622 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:10.622 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.622 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.623 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.623 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.623 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.623 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.623 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.623 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.623 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.623 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.624 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.624 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.624 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:10.624 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:10.624 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.624 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.624 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.625 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:10.625 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.625 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.625 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.625 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.625 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.625 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.626 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.626 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.626 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.626 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.626 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.626 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.626 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.627 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.627 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.627 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:10.627 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:10.627 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.627 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.627 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.627 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.628 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.628 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.628 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.628 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.628 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.628 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.628 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.629 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.629 INFO:teuthology.orchestra.run.smithi044.stdout: "server_addr": { 2024-08-19T00:24:10.629 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "server_addr", 2024-08-19T00:24:10.629 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.629 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.629 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.629 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.629 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.630 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.630 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.630 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.630 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.630 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.630 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.630 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.631 INFO:teuthology.orchestra.run.smithi044.stdout: "server_port": { 2024-08-19T00:24:10.631 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "server_port", 2024-08-19T00:24:10.631 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.631 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.631 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.631 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.631 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.632 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.632 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.632 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.632 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.632 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.632 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.632 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.632 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.633 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.633 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:10.633 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "rgw", 2024-08-19T00:24:10.633 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:10.633 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:10.633 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:10.633 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:10.634 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:10.634 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.634 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.634 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.634 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.635 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.635 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.635 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.635 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.635 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.635 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.636 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.636 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.636 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.636 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.636 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.637 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.637 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.637 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.637 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.637 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:10.638 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:10.638 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.638 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.638 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.638 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.639 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.639 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.639 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.639 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.639 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.639 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.640 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.640 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.640 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:10.640 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:10.640 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.641 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.641 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.641 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:10.641 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.641 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.642 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.642 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.642 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.642 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.642 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.643 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.643 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.643 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.643 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.643 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.644 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.644 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.644 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.644 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:10.644 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:10.644 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.644 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.645 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.645 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.645 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.645 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.645 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.645 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.646 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.646 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.646 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.646 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.646 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.646 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.646 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:10.647 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "rook", 2024-08-19T00:24:10.647 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:10.647 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:10.647 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:10.647 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:10.647 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:10.647 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.648 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.648 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.648 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.648 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.648 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.648 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.648 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.649 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.649 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.649 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.649 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.649 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.649 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.649 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.650 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.650 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.650 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.650 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.650 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:10.650 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:10.650 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.651 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.651 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.651 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.651 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.651 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.651 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.651 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.651 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.652 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.652 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.652 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.652 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:10.652 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:10.652 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.652 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.653 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.653 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:10.653 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.653 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.653 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.653 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.653 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.654 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.654 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.654 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.654 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.654 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.655 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.655 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.655 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.655 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.655 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.655 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:10.655 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:10.656 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.656 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.656 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.656 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.656 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.656 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.656 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.656 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.657 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.657 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.657 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.657 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.657 INFO:teuthology.orchestra.run.smithi044.stdout: "storage_class": { 2024-08-19T00:24:10.657 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "storage_class", 2024-08-19T00:24:10.657 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.658 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.658 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.658 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "local", 2024-08-19T00:24:10.658 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.658 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.658 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.658 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-08-19T00:24:10.659 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.659 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.659 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.659 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.659 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.659 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.660 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:10.660 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "selftest", 2024-08-19T00:24:10.660 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:10.660 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:10.660 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:10.660 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:10.661 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:10.661 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.661 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.661 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.661 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.661 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.661 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.662 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.662 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.662 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.662 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.662 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.662 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.663 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.663 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.663 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.663 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.663 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.663 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.663 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.664 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:10.664 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:10.664 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.664 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.664 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.664 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.664 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.665 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.665 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.665 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.665 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.665 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.666 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.666 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.666 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:10.666 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:10.666 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.666 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.666 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.666 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:10.667 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.667 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.667 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.667 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.667 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.667 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.667 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.668 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.668 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.668 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.668 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.668 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.668 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.669 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.669 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.669 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:10.669 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:10.669 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.670 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.670 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.670 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.670 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.670 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.670 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.671 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.671 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.671 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.671 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.671 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.672 INFO:teuthology.orchestra.run.smithi044.stdout: "roption1": { 2024-08-19T00:24:10.672 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "roption1", 2024-08-19T00:24:10.672 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.672 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.672 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.672 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.672 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.673 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.673 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.673 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.673 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.673 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.673 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.673 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.674 INFO:teuthology.orchestra.run.smithi044.stdout: "roption2": { 2024-08-19T00:24:10.674 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "roption2", 2024-08-19T00:24:10.674 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.674 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.674 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.674 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "xyz", 2024-08-19T00:24:10.675 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.675 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.675 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.675 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.675 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.675 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.675 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.676 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.676 INFO:teuthology.orchestra.run.smithi044.stdout: "rwoption1": { 2024-08-19T00:24:10.676 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "rwoption1", 2024-08-19T00:24:10.676 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.677 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.677 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.677 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.677 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.677 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.677 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.678 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.678 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.678 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.678 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.678 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.678 INFO:teuthology.orchestra.run.smithi044.stdout: "rwoption2": { 2024-08-19T00:24:10.678 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "rwoption2", 2024-08-19T00:24:10.679 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:10.679 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.679 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.679 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.679 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.679 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.680 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.680 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.680 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.680 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.680 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.680 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.681 INFO:teuthology.orchestra.run.smithi044.stdout: "rwoption3": { 2024-08-19T00:24:10.681 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "rwoption3", 2024-08-19T00:24:10.681 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "float", 2024-08-19T00:24:10.681 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.681 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.682 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.682 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.682 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.682 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.682 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.682 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.683 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.683 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.683 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.683 INFO:teuthology.orchestra.run.smithi044.stdout: "rwoption4": { 2024-08-19T00:24:10.683 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "rwoption4", 2024-08-19T00:24:10.683 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.683 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.684 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.684 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.684 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.684 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.684 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.684 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.684 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.685 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.685 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.685 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.685 INFO:teuthology.orchestra.run.smithi044.stdout: "rwoption5": { 2024-08-19T00:24:10.685 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "rwoption5", 2024-08-19T00:24:10.685 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.685 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.685 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.686 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.686 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.686 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.686 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.686 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.686 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.686 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.686 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.687 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.687 INFO:teuthology.orchestra.run.smithi044.stdout: "rwoption6": { 2024-08-19T00:24:10.687 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "rwoption6", 2024-08-19T00:24:10.687 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.687 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.687 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.687 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:10.688 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.688 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.688 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.688 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.688 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.688 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.688 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.688 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.689 INFO:teuthology.orchestra.run.smithi044.stdout: "rwoption7": { 2024-08-19T00:24:10.689 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "rwoption7", 2024-08-19T00:24:10.689 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:10.689 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.689 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.689 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.689 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "1", 2024-08-19T00:24:10.689 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "42", 2024-08-19T00:24:10.689 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.690 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.690 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.690 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.690 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.690 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.690 INFO:teuthology.orchestra.run.smithi044.stdout: "testkey": { 2024-08-19T00:24:10.690 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "testkey", 2024-08-19T00:24:10.690 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.691 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.691 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.691 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.691 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.691 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.691 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.691 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.691 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.692 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.692 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.692 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.692 INFO:teuthology.orchestra.run.smithi044.stdout: "testlkey": { 2024-08-19T00:24:10.692 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "testlkey", 2024-08-19T00:24:10.692 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.692 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.692 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.693 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.693 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.693 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.693 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.693 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.693 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.693 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.693 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.693 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.694 INFO:teuthology.orchestra.run.smithi044.stdout: "testnewline": { 2024-08-19T00:24:10.694 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "testnewline", 2024-08-19T00:24:10.694 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.694 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.694 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.694 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.694 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.694 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.695 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.695 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.695 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.695 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.695 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.695 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.695 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.695 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.696 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:10.696 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "snap_schedule", 2024-08-19T00:24:10.696 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:10.696 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:10.696 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:10.696 INFO:teuthology.orchestra.run.smithi044.stdout: "allow_m_granularity": { 2024-08-19T00:24:10.696 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "allow_m_granularity", 2024-08-19T00:24:10.696 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.697 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.697 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.697 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.697 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.697 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.697 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.697 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "allow minute scheduled snapshots", 2024-08-19T00:24:10.697 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.698 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.698 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.698 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.698 INFO:teuthology.orchestra.run.smithi044.stdout: "dump_on_update": { 2024-08-19T00:24:10.698 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "dump_on_update", 2024-08-19T00:24:10.698 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.698 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.698 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.699 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.699 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.699 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.699 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.699 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "dump database to debug log on update", 2024-08-19T00:24:10.699 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.699 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.699 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.700 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.700 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:10.700 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:10.700 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.700 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.700 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.700 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.700 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.700 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.700 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.701 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.701 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.701 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.701 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.701 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.701 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.701 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.701 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.702 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.702 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.702 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.702 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.702 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:10.702 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:10.702 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.703 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.703 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.703 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.703 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.703 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.703 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.703 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.703 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.703 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.704 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.704 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.704 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:10.704 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:10.704 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.704 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.704 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.704 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:10.705 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.705 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.705 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.705 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.705 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.705 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.705 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.705 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.706 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.706 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.706 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.706 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.706 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.706 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.706 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.707 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:10.707 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:10.707 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.707 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.707 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.707 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.707 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.707 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.707 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.708 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.708 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.708 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.708 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.708 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.708 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.708 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.708 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:10.708 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "stats", 2024-08-19T00:24:10.709 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:10.709 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:10.709 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:10.709 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:10.709 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:10.709 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.709 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.709 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.709 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.710 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.710 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.710 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.710 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.710 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.710 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.710 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.711 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.711 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.711 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.711 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.711 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.711 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.711 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.711 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.712 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:10.712 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:10.712 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.712 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.712 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.712 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.712 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.712 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.713 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.713 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.713 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.713 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.713 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.713 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.713 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:10.713 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:10.714 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.714 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.714 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.714 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:10.714 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.714 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.714 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.714 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.715 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.715 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.715 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.715 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.715 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.715 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.715 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.715 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.715 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.716 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.716 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.716 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:10.716 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:10.716 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.716 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.716 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.716 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.717 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.717 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.717 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.717 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.717 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.717 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.717 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.717 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.717 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.718 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.718 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:10.718 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "status", 2024-08-19T00:24:10.718 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:10.718 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:10.718 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:10.718 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:10.719 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:10.719 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.719 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.719 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.719 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.719 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.719 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.719 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.719 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.720 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.720 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.720 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.720 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.720 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.720 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.720 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.720 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.721 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.721 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.721 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.721 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:10.721 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:10.721 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.721 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.721 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.722 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.722 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.722 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.722 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.722 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.722 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.722 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.723 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.723 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.723 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:10.723 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:10.723 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.723 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.723 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.723 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:10.724 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.724 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.724 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.724 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.724 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.724 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.724 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.724 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.725 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.725 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.725 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.725 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.725 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.725 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.725 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.725 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:10.725 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:10.726 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.726 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.726 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.726 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.726 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.726 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.726 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.727 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.727 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.727 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.727 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.727 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.727 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.727 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.727 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:10.728 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "telegraf", 2024-08-19T00:24:10.728 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:10.728 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:10.728 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:10.728 INFO:teuthology.orchestra.run.smithi044.stdout: "address": { 2024-08-19T00:24:10.728 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "address", 2024-08-19T00:24:10.728 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.728 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.729 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.729 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-08-19T00:24:10.729 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.729 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.729 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.729 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.729 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.730 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.730 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.730 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.730 INFO:teuthology.orchestra.run.smithi044.stdout: "interval": { 2024-08-19T00:24:10.730 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "interval", 2024-08-19T00:24:10.730 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", 2024-08-19T00:24:10.730 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.730 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.731 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "15", 2024-08-19T00:24:10.731 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.731 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.731 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.731 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.731 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.731 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.731 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.732 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.732 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:10.732 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:10.732 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.732 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.732 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.732 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.732 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.733 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.733 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.733 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.733 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.733 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.733 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.733 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.733 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.734 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.734 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.734 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.734 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.734 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.734 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.734 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:10.735 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:10.735 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.735 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.735 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.735 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.735 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.735 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.735 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.735 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.736 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.736 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.736 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.736 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.736 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:10.736 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:10.736 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.736 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.736 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.737 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:10.737 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.737 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.737 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.737 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.737 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.737 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.737 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.737 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.738 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.738 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.738 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.738 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.738 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.738 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.738 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.739 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:10.739 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:10.739 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.739 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.739 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.739 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.739 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.739 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.740 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.740 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.740 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.740 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.740 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.740 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.740 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.740 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.740 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:10.741 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "telemetry", 2024-08-19T00:24:10.741 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:10.741 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:10.741 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:10.741 INFO:teuthology.orchestra.run.smithi044.stdout: "channel_basic": { 2024-08-19T00:24:10.741 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "channel_basic", 2024-08-19T00:24:10.741 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.741 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.742 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.742 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:10.742 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.742 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.742 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.742 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Share basic cluster information (size, version)", 2024-08-19T00:24:10.742 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.742 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.743 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.743 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.743 INFO:teuthology.orchestra.run.smithi044.stdout: "channel_crash": { 2024-08-19T00:24:10.743 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "channel_crash", 2024-08-19T00:24:10.743 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.743 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.743 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.743 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:10.743 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.744 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.744 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.744 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-08-19T00:24:10.744 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.744 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.744 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.744 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.744 INFO:teuthology.orchestra.run.smithi044.stdout: "channel_device": { 2024-08-19T00:24:10.745 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "channel_device", 2024-08-19T00:24:10.745 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.745 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.745 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.745 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:10.745 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.745 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.745 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.746 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-08-19T00:24:10.746 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.746 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.746 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.746 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.746 INFO:teuthology.orchestra.run.smithi044.stdout: "channel_ident": { 2024-08-19T00:24:10.746 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "channel_ident", 2024-08-19T00:24:10.747 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.747 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.747 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.747 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.747 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.747 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.747 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.747 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-08-19T00:24:10.747 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.748 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.748 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.748 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.748 INFO:teuthology.orchestra.run.smithi044.stdout: "channel_perf": { 2024-08-19T00:24:10.748 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "channel_perf", 2024-08-19T00:24:10.748 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.748 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.748 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.749 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.749 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.749 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.749 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.749 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Share various performance metrics of a cluster", 2024-08-19T00:24:10.749 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.749 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.749 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.750 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.750 INFO:teuthology.orchestra.run.smithi044.stdout: "contact": { 2024-08-19T00:24:10.750 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "contact", 2024-08-19T00:24:10.750 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.750 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.750 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.750 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.750 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.750 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.751 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.751 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.751 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.751 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.751 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.751 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.751 INFO:teuthology.orchestra.run.smithi044.stdout: "description": { 2024-08-19T00:24:10.751 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "description", 2024-08-19T00:24:10.752 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.752 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.752 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.752 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.752 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.752 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.752 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.753 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.753 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.753 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.753 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.753 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.753 INFO:teuthology.orchestra.run.smithi044.stdout: "device_url": { 2024-08-19T00:24:10.753 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "device_url", 2024-08-19T00:24:10.754 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.754 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.754 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.754 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-08-19T00:24:10.754 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.754 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.754 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.755 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.755 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.755 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.755 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.755 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.755 INFO:teuthology.orchestra.run.smithi044.stdout: "enabled": { 2024-08-19T00:24:10.755 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "enabled", 2024-08-19T00:24:10.756 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.756 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.756 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.756 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.756 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.756 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.756 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.756 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.757 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.757 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.757 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.757 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.757 INFO:teuthology.orchestra.run.smithi044.stdout: "interval": { 2024-08-19T00:24:10.757 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "interval", 2024-08-19T00:24:10.757 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:10.757 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.758 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.758 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "24", 2024-08-19T00:24:10.758 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "8", 2024-08-19T00:24:10.758 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.758 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.758 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.758 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.758 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.759 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.759 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.759 INFO:teuthology.orchestra.run.smithi044.stdout: "last_opt_revision": { 2024-08-19T00:24:10.759 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "last_opt_revision", 2024-08-19T00:24:10.759 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:10.759 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.759 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.759 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "1", 2024-08-19T00:24:10.760 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.760 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.760 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.760 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.760 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.760 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.760 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.760 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.761 INFO:teuthology.orchestra.run.smithi044.stdout: "leaderboard": { 2024-08-19T00:24:10.761 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "leaderboard", 2024-08-19T00:24:10.761 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.761 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.761 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.761 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.761 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.761 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.762 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.762 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.762 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.762 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.762 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.762 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.762 INFO:teuthology.orchestra.run.smithi044.stdout: "leaderboard_description": { 2024-08-19T00:24:10.762 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "leaderboard_description", 2024-08-19T00:24:10.763 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.763 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.763 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.763 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.763 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.763 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.763 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.763 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.764 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.764 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.764 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.764 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.764 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:10.764 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:10.764 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.765 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.765 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.765 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.765 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.765 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.765 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.765 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.765 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.765 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.766 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.766 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.766 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.766 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.766 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.766 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.766 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.766 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.767 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.767 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:10.767 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:10.767 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.767 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.767 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.767 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.767 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.767 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.768 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.768 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.768 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.768 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.768 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.768 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.768 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:10.768 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:10.769 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.769 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.769 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.769 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:10.769 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.769 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.769 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.769 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.770 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.770 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.770 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.770 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.770 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.770 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.770 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.770 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.771 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.771 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.771 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.771 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:10.771 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:10.771 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.771 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.772 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.772 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.772 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.772 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.772 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.772 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.772 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.772 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.773 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.773 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.773 INFO:teuthology.orchestra.run.smithi044.stdout: "organization": { 2024-08-19T00:24:10.773 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "organization", 2024-08-19T00:24:10.773 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.773 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.773 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.773 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.774 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.774 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.774 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.774 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.774 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.774 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.774 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.775 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.775 INFO:teuthology.orchestra.run.smithi044.stdout: "proxy": { 2024-08-19T00:24:10.775 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "proxy", 2024-08-19T00:24:10.775 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.775 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.775 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.775 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.776 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.776 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.776 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.776 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.776 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.776 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.776 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.776 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.777 INFO:teuthology.orchestra.run.smithi044.stdout: "url": { 2024-08-19T00:24:10.777 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "url", 2024-08-19T00:24:10.777 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.777 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.777 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.777 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-08-19T00:24:10.777 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.778 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.778 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.778 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.778 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.778 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.778 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.778 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.778 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.779 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.779 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:10.779 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "test_orchestrator", 2024-08-19T00:24:10.779 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:10.779 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:10.779 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:10.779 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:10.779 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:10.780 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.780 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.780 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.780 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.780 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.780 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.780 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.781 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.781 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.781 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.781 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.781 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.781 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.781 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.782 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.782 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.782 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.782 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.782 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.782 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:10.782 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:10.782 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.783 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.783 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.783 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.783 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.783 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.783 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.783 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.784 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.784 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.784 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.784 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.784 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:10.784 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:10.784 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.785 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.785 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.785 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:10.785 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.785 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.785 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.785 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.785 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.786 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.786 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.786 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.786 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.786 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.786 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.786 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.787 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.787 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.787 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.787 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:10.787 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:10.787 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.787 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.787 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.788 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.788 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.788 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.788 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.788 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.788 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.788 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.788 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.789 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.789 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.789 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.789 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:10.789 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "volumes", 2024-08-19T00:24:10.789 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:10.789 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:10.789 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:10.789 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:10.790 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:10.790 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.790 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.790 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.790 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.790 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.790 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.791 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.791 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.791 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.791 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.791 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.791 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.791 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.791 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.792 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.792 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.792 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.792 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.792 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.792 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:10.792 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:10.792 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.792 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.793 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.793 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.793 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.793 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.793 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.793 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.793 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.793 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.794 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.794 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.794 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:10.794 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:10.794 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.794 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.794 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.794 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:10.795 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.795 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.795 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.795 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.795 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.795 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.795 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.795 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.796 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.796 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.796 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.796 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.796 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.796 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.796 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.797 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:10.797 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:10.797 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.797 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.797 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.797 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.797 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.797 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.798 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.798 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.798 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.798 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.798 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.798 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.798 INFO:teuthology.orchestra.run.smithi044.stdout: "max_concurrent_clones": { 2024-08-19T00:24:10.799 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "max_concurrent_clones", 2024-08-19T00:24:10.799 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:10.799 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.799 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.799 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "4", 2024-08-19T00:24:10.799 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.799 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.800 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.800 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Number of asynchronous cloner threads", 2024-08-19T00:24:10.800 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.800 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.800 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.800 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.800 INFO:teuthology.orchestra.run.smithi044.stdout: "periodic_async_work": { 2024-08-19T00:24:10.800 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "periodic_async_work", 2024-08-19T00:24:10.801 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.801 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.801 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.801 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.801 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.801 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.801 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.801 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Periodically check for async work", 2024-08-19T00:24:10.802 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.802 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.802 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.802 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.802 INFO:teuthology.orchestra.run.smithi044.stdout: "snapshot_clone_delay": { 2024-08-19T00:24:10.802 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "snapshot_clone_delay", 2024-08-19T00:24:10.802 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:10.803 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.803 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.803 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "0", 2024-08-19T00:24:10.803 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.803 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.803 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.803 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-08-19T00:24:10.803 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.803 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.804 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.804 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.804 INFO:teuthology.orchestra.run.smithi044.stdout: "snapshot_clone_no_wait": { 2024-08-19T00:24:10.804 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "snapshot_clone_no_wait", 2024-08-19T00:24:10.804 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.804 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.804 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.804 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:10.804 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.805 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.805 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.805 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-08-19T00:24:10.805 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.805 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.805 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.805 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.805 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.806 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.806 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:10.806 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "zabbix", 2024-08-19T00:24:10.806 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:10.806 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:10.806 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:10.806 INFO:teuthology.orchestra.run.smithi044.stdout: "discovery_interval": { 2024-08-19T00:24:10.806 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "discovery_interval", 2024-08-19T00:24:10.807 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "uint", 2024-08-19T00:24:10.807 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.807 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.807 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "100", 2024-08-19T00:24:10.807 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.807 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.807 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.807 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.808 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.808 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.808 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.808 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.808 INFO:teuthology.orchestra.run.smithi044.stdout: "identifier": { 2024-08-19T00:24:10.808 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "identifier", 2024-08-19T00:24:10.808 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.808 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.808 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.809 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.809 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.809 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.809 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.809 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.809 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.809 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.809 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.810 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.810 INFO:teuthology.orchestra.run.smithi044.stdout: "interval": { 2024-08-19T00:24:10.810 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "interval", 2024-08-19T00:24:10.810 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", 2024-08-19T00:24:10.810 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.810 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.810 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "60", 2024-08-19T00:24:10.810 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.811 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.811 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.811 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.811 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.811 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.811 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.811 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.812 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:10.812 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:10.812 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.812 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.812 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.812 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.812 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.812 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.812 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.813 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.813 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.813 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.813 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.813 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.813 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.813 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.813 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.814 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.814 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.814 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.814 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.814 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:10.814 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:10.814 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.814 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.815 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.815 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.815 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.815 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.815 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.815 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.815 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.815 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.815 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.816 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.816 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:10.816 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:10.816 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.816 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.816 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.816 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:10.817 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.817 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.817 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.817 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.817 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.817 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.817 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.817 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.818 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.818 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.818 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.818 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.818 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.818 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.818 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.819 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:10.819 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:10.819 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.819 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.819 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.819 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.819 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.819 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.819 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.820 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.820 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.820 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.820 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.820 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.820 INFO:teuthology.orchestra.run.smithi044.stdout: "zabbix_host": { 2024-08-19T00:24:10.820 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "zabbix_host", 2024-08-19T00:24:10.820 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.821 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.821 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.821 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.821 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.821 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.821 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.821 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.821 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.822 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.822 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.822 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.822 INFO:teuthology.orchestra.run.smithi044.stdout: "zabbix_port": { 2024-08-19T00:24:10.822 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "zabbix_port", 2024-08-19T00:24:10.822 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:10.822 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.822 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.823 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "10051", 2024-08-19T00:24:10.823 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.823 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.823 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.823 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.823 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.823 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.823 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.824 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.824 INFO:teuthology.orchestra.run.smithi044.stdout: "zabbix_sender": { 2024-08-19T00:24:10.824 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "zabbix_sender", 2024-08-19T00:24:10.824 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.824 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.824 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.824 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-08-19T00:24:10.824 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.824 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.825 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.825 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.825 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.825 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.825 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.825 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.825 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.825 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.826 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-08-19T00:24:10.826 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.826 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:10.826 INFO:teuthology.orchestra.run.smithi044.stdout: "gid": 24902, 2024-08-19T00:24:10.826 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "y", 2024-08-19T00:24:10.826 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr_features": 4540701547738038271, 2024-08-19T00:24:10.826 INFO:teuthology.orchestra.run.smithi044.stdout: "available_modules": [ 2024-08-19T00:24:10.827 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:10.827 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "alerts", 2024-08-19T00:24:10.827 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:10.827 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:10.827 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:10.827 INFO:teuthology.orchestra.run.smithi044.stdout: "interval": { 2024-08-19T00:24:10.827 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "interval", 2024-08-19T00:24:10.828 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", 2024-08-19T00:24:10.828 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.828 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.828 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "60", 2024-08-19T00:24:10.828 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.828 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.828 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.828 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "How frequently to reexamine health status", 2024-08-19T00:24:10.829 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.829 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.829 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.829 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.829 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:10.829 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:10.829 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.830 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.830 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.830 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.830 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.830 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.830 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.830 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.830 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.830 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.831 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.831 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.831 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.831 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.831 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.831 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.831 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.832 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.832 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.832 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:10.832 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:10.832 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.832 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.832 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.833 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.833 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.833 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.833 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.833 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.833 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.833 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.833 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.834 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.834 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:10.834 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:10.834 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.834 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.834 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.834 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:10.835 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.835 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.835 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.835 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.835 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.835 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.836 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.836 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.836 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.836 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.836 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.836 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.836 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.836 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.837 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.837 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:10.837 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:10.837 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.837 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.837 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.837 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.837 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.838 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.838 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.838 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.838 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.838 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.838 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.838 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.838 INFO:teuthology.orchestra.run.smithi044.stdout: "smtp_destination": { 2024-08-19T00:24:10.839 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "smtp_destination", 2024-08-19T00:24:10.839 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.839 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.839 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.839 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.839 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.839 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.840 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.840 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Email address to send alerts to", 2024-08-19T00:24:10.840 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.840 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.840 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.840 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.840 INFO:teuthology.orchestra.run.smithi044.stdout: "smtp_from_name": { 2024-08-19T00:24:10.840 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "smtp_from_name", 2024-08-19T00:24:10.841 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.841 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.841 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.841 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "Ceph", 2024-08-19T00:24:10.841 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.841 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.841 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.841 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Email From: name", 2024-08-19T00:24:10.842 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.842 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.842 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.842 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.842 INFO:teuthology.orchestra.run.smithi044.stdout: "smtp_host": { 2024-08-19T00:24:10.842 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "smtp_host", 2024-08-19T00:24:10.842 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.843 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.843 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.843 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.843 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.843 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.843 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.843 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "SMTP server", 2024-08-19T00:24:10.843 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.844 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.844 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.844 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.844 INFO:teuthology.orchestra.run.smithi044.stdout: "smtp_password": { 2024-08-19T00:24:10.844 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "smtp_password", 2024-08-19T00:24:10.844 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.844 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.844 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.845 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.845 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.845 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.845 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.845 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Password to authenticate with", 2024-08-19T00:24:10.845 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.845 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.845 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.846 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.846 INFO:teuthology.orchestra.run.smithi044.stdout: "smtp_port": { 2024-08-19T00:24:10.846 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "smtp_port", 2024-08-19T00:24:10.846 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:10.846 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.846 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.846 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "465", 2024-08-19T00:24:10.847 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.847 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.847 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.847 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "SMTP port", 2024-08-19T00:24:10.847 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.847 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.847 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.847 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.848 INFO:teuthology.orchestra.run.smithi044.stdout: "smtp_sender": { 2024-08-19T00:24:10.848 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "smtp_sender", 2024-08-19T00:24:10.848 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.848 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.848 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.848 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.848 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.848 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.848 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.849 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "SMTP envelope sender", 2024-08-19T00:24:10.849 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.849 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.849 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.849 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.849 INFO:teuthology.orchestra.run.smithi044.stdout: "smtp_ssl": { 2024-08-19T00:24:10.849 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "smtp_ssl", 2024-08-19T00:24:10.849 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.849 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.850 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.850 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:10.850 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.850 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.850 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.850 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Use SSL to connect to SMTP server", 2024-08-19T00:24:10.850 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.850 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.851 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.851 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.851 INFO:teuthology.orchestra.run.smithi044.stdout: "smtp_user": { 2024-08-19T00:24:10.851 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "smtp_user", 2024-08-19T00:24:10.851 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.851 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.851 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.851 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.852 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.852 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.852 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.852 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "User to authenticate as", 2024-08-19T00:24:10.852 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.852 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.852 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.852 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.853 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.853 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.853 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:10.853 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "balancer", 2024-08-19T00:24:10.853 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:10.853 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:10.853 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:10.853 INFO:teuthology.orchestra.run.smithi044.stdout: "active": { 2024-08-19T00:24:10.853 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "active", 2024-08-19T00:24:10.854 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.854 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.854 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.854 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:10.854 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.854 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.854 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.855 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "automatically balance PGs across cluster", 2024-08-19T00:24:10.855 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.855 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.855 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.855 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.855 INFO:teuthology.orchestra.run.smithi044.stdout: "begin_time": { 2024-08-19T00:24:10.855 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "begin_time", 2024-08-19T00:24:10.855 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.856 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.856 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.856 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "0000", 2024-08-19T00:24:10.856 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.856 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.856 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.856 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "beginning time of day to automatically balance", 2024-08-19T00:24:10.856 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-19T00:24:10.857 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.857 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.857 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.857 INFO:teuthology.orchestra.run.smithi044.stdout: "begin_weekday": { 2024-08-19T00:24:10.857 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "begin_weekday", 2024-08-19T00:24:10.857 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "uint", 2024-08-19T00:24:10.857 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.857 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.858 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "0", 2024-08-19T00:24:10.858 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "0", 2024-08-19T00:24:10.858 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "6", 2024-08-19T00:24:10.858 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.858 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-08-19T00:24:10.858 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-19T00:24:10.858 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.858 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.859 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.859 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_compat_max_iterations": { 2024-08-19T00:24:10.859 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "crush_compat_max_iterations", 2024-08-19T00:24:10.859 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "uint", 2024-08-19T00:24:10.859 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.859 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.859 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "25", 2024-08-19T00:24:10.860 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "1", 2024-08-19T00:24:10.860 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "250", 2024-08-19T00:24:10.860 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.860 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-08-19T00:24:10.860 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.860 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.860 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.860 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.860 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_compat_metrics": { 2024-08-19T00:24:10.861 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "crush_compat_metrics", 2024-08-19T00:24:10.861 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.861 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.861 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.861 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "pgs,objects,bytes", 2024-08-19T00:24:10.861 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.861 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.861 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.862 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-08-19T00:24:10.862 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-08-19T00:24:10.862 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.862 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.862 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.862 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_compat_step": { 2024-08-19T00:24:10.862 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "crush_compat_step", 2024-08-19T00:24:10.862 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "float", 2024-08-19T00:24:10.863 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.863 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.863 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "0.5", 2024-08-19T00:24:10.863 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "0.001", 2024-08-19T00:24:10.863 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "0.999", 2024-08-19T00:24:10.863 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.863 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "aggressiveness of optimization", 2024-08-19T00:24:10.864 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-08-19T00:24:10.864 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.864 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.864 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.864 INFO:teuthology.orchestra.run.smithi044.stdout: "end_time": { 2024-08-19T00:24:10.864 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "end_time", 2024-08-19T00:24:10.864 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.864 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.864 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.865 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "2359", 2024-08-19T00:24:10.865 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.865 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.865 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.865 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "ending time of day to automatically balance", 2024-08-19T00:24:10.865 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-19T00:24:10.865 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.865 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.866 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.866 INFO:teuthology.orchestra.run.smithi044.stdout: "end_weekday": { 2024-08-19T00:24:10.866 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "end_weekday", 2024-08-19T00:24:10.866 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "uint", 2024-08-19T00:24:10.866 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.866 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.866 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "0", 2024-08-19T00:24:10.866 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "0", 2024-08-19T00:24:10.867 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "6", 2024-08-19T00:24:10.867 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.867 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-08-19T00:24:10.867 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-19T00:24:10.867 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.867 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.867 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.867 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:10.868 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:10.868 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.868 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.868 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.868 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.868 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.868 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.868 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.869 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.869 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.869 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.869 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.869 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.869 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.869 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.869 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.870 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.870 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.870 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.870 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.870 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:10.870 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:10.870 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.870 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.871 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.871 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.871 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.871 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.871 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.871 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.871 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.871 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.872 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.872 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.872 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:10.872 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:10.872 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.872 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.872 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.872 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:10.873 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.873 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.873 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.873 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.873 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.873 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.873 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.873 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.873 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.874 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.874 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.874 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.874 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.874 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.874 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.874 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:10.874 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:10.875 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.875 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.875 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.875 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.875 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.875 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.875 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.875 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.876 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.876 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.876 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.876 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.876 INFO:teuthology.orchestra.run.smithi044.stdout: "min_score": { 2024-08-19T00:24:10.876 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "min_score", 2024-08-19T00:24:10.876 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "float", 2024-08-19T00:24:10.876 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.876 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.877 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "0", 2024-08-19T00:24:10.877 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.877 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.877 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.877 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-08-19T00:24:10.877 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.877 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.878 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.878 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.878 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": { 2024-08-19T00:24:10.878 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "mode", 2024-08-19T00:24:10.878 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.878 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.878 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.878 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "upmap", 2024-08-19T00:24:10.879 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.879 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.879 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.879 INFO:teuthology.orchestra.run.smithi044.stdout: "crush-compat", 2024-08-19T00:24:10.879 INFO:teuthology.orchestra.run.smithi044.stdout: "none", 2024-08-19T00:24:10.879 INFO:teuthology.orchestra.run.smithi044.stdout: "read", 2024-08-19T00:24:10.879 INFO:teuthology.orchestra.run.smithi044.stdout: "upmap", 2024-08-19T00:24:10.879 INFO:teuthology.orchestra.run.smithi044.stdout: "upmap-read" 2024-08-19T00:24:10.880 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.880 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Balancer mode", 2024-08-19T00:24:10.880 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.880 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.880 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.880 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.880 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_ids": { 2024-08-19T00:24:10.880 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "pool_ids", 2024-08-19T00:24:10.881 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.881 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.881 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.881 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.881 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.881 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.881 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.881 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-08-19T00:24:10.882 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.882 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.882 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.882 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.882 INFO:teuthology.orchestra.run.smithi044.stdout: "sleep_interval": { 2024-08-19T00:24:10.882 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "sleep_interval", 2024-08-19T00:24:10.882 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", 2024-08-19T00:24:10.882 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.883 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.883 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "60", 2024-08-19T00:24:10.883 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.883 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.883 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.883 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-08-19T00:24:10.883 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.883 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.884 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.884 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.884 INFO:teuthology.orchestra.run.smithi044.stdout: "upmap_max_deviation": { 2024-08-19T00:24:10.884 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "upmap_max_deviation", 2024-08-19T00:24:10.884 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:10.884 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.884 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.884 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "5", 2024-08-19T00:24:10.885 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "1", 2024-08-19T00:24:10.885 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.885 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.885 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "deviation below which no optimization is attempted", 2024-08-19T00:24:10.885 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-08-19T00:24:10.885 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.885 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.885 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.886 INFO:teuthology.orchestra.run.smithi044.stdout: "upmap_max_optimizations": { 2024-08-19T00:24:10.886 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "upmap_max_optimizations", 2024-08-19T00:24:10.886 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "uint", 2024-08-19T00:24:10.886 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.886 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.886 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "10", 2024-08-19T00:24:10.886 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.887 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.887 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.887 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-08-19T00:24:10.887 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.887 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.887 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.887 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.887 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:10.887 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.888 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:10.888 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "cephadm", 2024-08-19T00:24:10.888 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:10.888 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:10.888 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:10.888 INFO:teuthology.orchestra.run.smithi044.stdout: "agent_down_multiplier": { 2024-08-19T00:24:10.888 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "agent_down_multiplier", 2024-08-19T00:24:10.888 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "float", 2024-08-19T00:24:10.889 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.889 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.889 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "3.0", 2024-08-19T00:24:10.889 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.889 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.889 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.889 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-08-19T00:24:10.889 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.890 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.890 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.890 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.890 INFO:teuthology.orchestra.run.smithi044.stdout: "agent_refresh_rate": { 2024-08-19T00:24:10.890 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "agent_refresh_rate", 2024-08-19T00:24:10.890 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", 2024-08-19T00:24:10.890 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.890 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.891 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "20", 2024-08-19T00:24:10.891 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.891 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.891 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.891 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-08-19T00:24:10.891 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.891 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.891 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.892 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.892 INFO:teuthology.orchestra.run.smithi044.stdout: "agent_starting_port": { 2024-08-19T00:24:10.892 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "agent_starting_port", 2024-08-19T00:24:10.892 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:10.892 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.892 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.892 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "4721", 2024-08-19T00:24:10.892 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.893 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.893 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.893 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-08-19T00:24:10.893 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.893 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.893 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.893 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.893 INFO:teuthology.orchestra.run.smithi044.stdout: "allow_ptrace": { 2024-08-19T00:24:10.894 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "allow_ptrace", 2024-08-19T00:24:10.894 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.894 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.894 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.894 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.894 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.894 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.895 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.895 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-08-19T00:24:10.895 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-08-19T00:24:10.895 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.895 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.895 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.895 INFO:teuthology.orchestra.run.smithi044.stdout: "autotune_interval": { 2024-08-19T00:24:10.895 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "autotune_interval", 2024-08-19T00:24:10.896 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", 2024-08-19T00:24:10.896 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.896 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.896 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "600", 2024-08-19T00:24:10.896 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.896 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.896 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.896 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "how frequently to autotune daemon memory", 2024-08-19T00:24:10.896 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.897 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.897 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.897 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.897 INFO:teuthology.orchestra.run.smithi044.stdout: "autotune_memory_target_ratio": { 2024-08-19T00:24:10.897 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "autotune_memory_target_ratio", 2024-08-19T00:24:10.897 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "float", 2024-08-19T00:24:10.897 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.897 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.898 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "0.7", 2024-08-19T00:24:10.898 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.898 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.898 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.898 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-08-19T00:24:10.898 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.898 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.898 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.899 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.899 INFO:teuthology.orchestra.run.smithi044.stdout: "cephadm_log_destination": { 2024-08-19T00:24:10.899 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "cephadm_log_destination", 2024-08-19T00:24:10.899 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.899 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.899 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.899 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.899 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.900 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.900 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.900 INFO:teuthology.orchestra.run.smithi044.stdout: "file", 2024-08-19T00:24:10.900 INFO:teuthology.orchestra.run.smithi044.stdout: "file,syslog", 2024-08-19T00:24:10.900 INFO:teuthology.orchestra.run.smithi044.stdout: "syslog" 2024-08-19T00:24:10.900 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.900 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-08-19T00:24:10.900 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.901 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.901 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.901 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.901 INFO:teuthology.orchestra.run.smithi044.stdout: "cgroups_split": { 2024-08-19T00:24:10.901 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "cgroups_split", 2024-08-19T00:24:10.901 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.901 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.901 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.902 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:10.902 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.902 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.902 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.902 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-08-19T00:24:10.902 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.902 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.903 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.903 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.903 INFO:teuthology.orchestra.run.smithi044.stdout: "config_checks_enabled": { 2024-08-19T00:24:10.903 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "config_checks_enabled", 2024-08-19T00:24:10.903 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.903 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.903 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.903 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.904 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.904 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.904 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.904 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-08-19T00:24:10.904 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.904 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.905 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.905 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.905 INFO:teuthology.orchestra.run.smithi044.stdout: "config_dashboard": { 2024-08-19T00:24:10.905 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "config_dashboard", 2024-08-19T00:24:10.905 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.905 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.905 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.905 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:10.906 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.906 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.906 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.906 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-08-19T00:24:10.906 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.906 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.906 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.906 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.907 INFO:teuthology.orchestra.run.smithi044.stdout: "container_image_alertmanager": { 2024-08-19T00:24:10.907 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "container_image_alertmanager", 2024-08-19T00:24:10.907 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.907 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.907 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.907 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-08-19T00:24:10.907 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.907 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.908 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.908 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Prometheus container image", 2024-08-19T00:24:10.908 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.908 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.908 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.908 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.908 INFO:teuthology.orchestra.run.smithi044.stdout: "container_image_base": { 2024-08-19T00:24:10.908 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "container_image_base", 2024-08-19T00:24:10.908 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.909 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.909 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.909 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "quay.io/ceph/ceph", 2024-08-19T00:24:10.909 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.909 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.909 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.909 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Container image name, without the tag", 2024-08-19T00:24:10.909 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.910 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.910 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.910 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.910 INFO:teuthology.orchestra.run.smithi044.stdout: "container_image_elasticsearch": { 2024-08-19T00:24:10.910 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "container_image_elasticsearch", 2024-08-19T00:24:10.910 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.910 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.910 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.911 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-08-19T00:24:10.911 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.911 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.911 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.911 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "elasticsearch container image", 2024-08-19T00:24:10.911 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.911 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.911 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.912 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.912 INFO:teuthology.orchestra.run.smithi044.stdout: "container_image_grafana": { 2024-08-19T00:24:10.912 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "container_image_grafana", 2024-08-19T00:24:10.912 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.912 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.912 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.912 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-08-19T00:24:10.912 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.913 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.913 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.913 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Prometheus container image", 2024-08-19T00:24:10.913 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.913 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.913 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.913 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.913 INFO:teuthology.orchestra.run.smithi044.stdout: "container_image_haproxy": { 2024-08-19T00:24:10.914 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "container_image_haproxy", 2024-08-19T00:24:10.914 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.914 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.914 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.914 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-08-19T00:24:10.914 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.914 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.914 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.915 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "HAproxy container image", 2024-08-19T00:24:10.915 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.915 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.915 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.915 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.915 INFO:teuthology.orchestra.run.smithi044.stdout: "container_image_jaeger_agent": { 2024-08-19T00:24:10.915 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "container_image_jaeger_agent", 2024-08-19T00:24:10.915 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.916 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.916 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.916 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-08-19T00:24:10.916 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.916 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.916 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.916 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Jaeger agent container image", 2024-08-19T00:24:10.916 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.917 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.917 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.917 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.917 INFO:teuthology.orchestra.run.smithi044.stdout: "container_image_jaeger_collector": { 2024-08-19T00:24:10.917 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "container_image_jaeger_collector", 2024-08-19T00:24:10.917 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.917 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.917 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.918 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-08-19T00:24:10.918 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.918 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.918 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.918 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Jaeger collector container image", 2024-08-19T00:24:10.918 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.918 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.918 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.919 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.919 INFO:teuthology.orchestra.run.smithi044.stdout: "container_image_jaeger_query": { 2024-08-19T00:24:10.919 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "container_image_jaeger_query", 2024-08-19T00:24:10.919 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.919 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.919 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.919 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-08-19T00:24:10.919 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.920 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.920 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.920 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Jaeger query container image", 2024-08-19T00:24:10.920 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.920 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.920 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.920 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.921 INFO:teuthology.orchestra.run.smithi044.stdout: "container_image_keepalived": { 2024-08-19T00:24:10.921 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "container_image_keepalived", 2024-08-19T00:24:10.921 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.921 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.921 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.921 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-08-19T00:24:10.921 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.921 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.921 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.922 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Keepalived container image", 2024-08-19T00:24:10.922 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.922 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.922 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.922 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.922 INFO:teuthology.orchestra.run.smithi044.stdout: "container_image_loki": { 2024-08-19T00:24:10.922 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "container_image_loki", 2024-08-19T00:24:10.923 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.923 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.923 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.923 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-08-19T00:24:10.923 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.923 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.923 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.924 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Loki container image", 2024-08-19T00:24:10.924 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.924 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.924 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.924 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.924 INFO:teuthology.orchestra.run.smithi044.stdout: "container_image_node_exporter": { 2024-08-19T00:24:10.924 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "container_image_node_exporter", 2024-08-19T00:24:10.924 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.924 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.925 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.925 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-08-19T00:24:10.925 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.925 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.925 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.925 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Prometheus container image", 2024-08-19T00:24:10.925 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.925 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.926 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.926 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.926 INFO:teuthology.orchestra.run.smithi044.stdout: "container_image_nvmeof": { 2024-08-19T00:24:10.926 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "container_image_nvmeof", 2024-08-19T00:24:10.926 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.926 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.926 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.927 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-08-19T00:24:10.927 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.927 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.927 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.927 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Nvme-of container image", 2024-08-19T00:24:10.927 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.927 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.927 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.927 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.928 INFO:teuthology.orchestra.run.smithi044.stdout: "container_image_prometheus": { 2024-08-19T00:24:10.928 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "container_image_prometheus", 2024-08-19T00:24:10.928 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.928 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.928 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.928 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-08-19T00:24:10.928 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.928 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.929 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.929 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Prometheus container image", 2024-08-19T00:24:10.929 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.929 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.929 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.929 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.929 INFO:teuthology.orchestra.run.smithi044.stdout: "container_image_promtail": { 2024-08-19T00:24:10.929 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "container_image_promtail", 2024-08-19T00:24:10.930 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.930 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.930 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.930 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-08-19T00:24:10.930 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.930 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.930 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.930 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Promtail container image", 2024-08-19T00:24:10.931 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.931 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.931 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.931 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.931 INFO:teuthology.orchestra.run.smithi044.stdout: "container_image_samba": { 2024-08-19T00:24:10.931 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "container_image_samba", 2024-08-19T00:24:10.931 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.931 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.931 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.932 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-08-19T00:24:10.932 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.932 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.932 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.932 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Samba/SMB container image", 2024-08-19T00:24:10.932 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.932 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.933 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.933 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.933 INFO:teuthology.orchestra.run.smithi044.stdout: "container_image_snmp_gateway": { 2024-08-19T00:24:10.933 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "container_image_snmp_gateway", 2024-08-19T00:24:10.933 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.933 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.933 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.933 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-08-19T00:24:10.934 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.934 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.934 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.934 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "SNMP Gateway container image", 2024-08-19T00:24:10.934 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.934 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.934 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.934 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.935 INFO:teuthology.orchestra.run.smithi044.stdout: "container_init": { 2024-08-19T00:24:10.935 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "container_init", 2024-08-19T00:24:10.935 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.935 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.935 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.935 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:10.935 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.935 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.936 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.936 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Run podman/docker with `--init`", 2024-08-19T00:24:10.936 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.936 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.936 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.936 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.936 INFO:teuthology.orchestra.run.smithi044.stdout: "daemon_cache_timeout": { 2024-08-19T00:24:10.936 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "daemon_cache_timeout", 2024-08-19T00:24:10.937 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", 2024-08-19T00:24:10.937 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.937 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.937 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "600", 2024-08-19T00:24:10.937 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.937 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.937 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.938 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-08-19T00:24:10.938 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.938 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.938 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.938 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.938 INFO:teuthology.orchestra.run.smithi044.stdout: "default_cephadm_command_timeout": { 2024-08-19T00:24:10.938 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "default_cephadm_command_timeout", 2024-08-19T00:24:10.939 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:10.939 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.939 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.939 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "900", 2024-08-19T00:24:10.939 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.939 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.939 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.939 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-08-19T00:24:10.940 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.940 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.940 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.940 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.940 INFO:teuthology.orchestra.run.smithi044.stdout: "default_registry": { 2024-08-19T00:24:10.940 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "default_registry", 2024-08-19T00:24:10.940 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.940 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.941 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.941 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "docker.io", 2024-08-19T00:24:10.941 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.941 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.941 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.941 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-08-19T00:24:10.941 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.941 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.942 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.942 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.942 INFO:teuthology.orchestra.run.smithi044.stdout: "device_cache_timeout": { 2024-08-19T00:24:10.942 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "device_cache_timeout", 2024-08-19T00:24:10.942 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", 2024-08-19T00:24:10.942 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.942 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.942 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "1800", 2024-08-19T00:24:10.943 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.943 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.943 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.943 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "seconds to cache device inventory", 2024-08-19T00:24:10.943 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.943 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.943 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.943 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.943 INFO:teuthology.orchestra.run.smithi044.stdout: "device_enhanced_scan": { 2024-08-19T00:24:10.944 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "device_enhanced_scan", 2024-08-19T00:24:10.944 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.944 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.944 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.944 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.944 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.944 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.944 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.945 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Use libstoragemgmt during device scans", 2024-08-19T00:24:10.945 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.945 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.945 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.945 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.945 INFO:teuthology.orchestra.run.smithi044.stdout: "facts_cache_timeout": { 2024-08-19T00:24:10.945 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "facts_cache_timeout", 2024-08-19T00:24:10.945 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", 2024-08-19T00:24:10.946 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.946 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.946 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "60", 2024-08-19T00:24:10.946 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.946 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.946 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.946 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "seconds to cache host facts data", 2024-08-19T00:24:10.946 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.946 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.947 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.947 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.947 INFO:teuthology.orchestra.run.smithi044.stdout: "grafana_dashboards_path": { 2024-08-19T00:24:10.947 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "grafana_dashboards_path", 2024-08-19T00:24:10.947 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.947 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.947 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.947 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-08-19T00:24:10.948 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.948 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.948 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.948 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-08-19T00:24:10.948 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.948 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.948 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.948 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.948 INFO:teuthology.orchestra.run.smithi044.stdout: "host_check_interval": { 2024-08-19T00:24:10.949 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "host_check_interval", 2024-08-19T00:24:10.949 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", 2024-08-19T00:24:10.949 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.949 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.949 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "600", 2024-08-19T00:24:10.949 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.949 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.949 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.949 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "how frequently to perform a host check", 2024-08-19T00:24:10.950 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.950 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.950 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.950 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.950 INFO:teuthology.orchestra.run.smithi044.stdout: "hw_monitoring": { 2024-08-19T00:24:10.950 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "hw_monitoring", 2024-08-19T00:24:10.950 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.950 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.951 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.951 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.951 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.951 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.951 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.951 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-08-19T00:24:10.951 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.951 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.951 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.952 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.952 INFO:teuthology.orchestra.run.smithi044.stdout: "inventory_list_all": { 2024-08-19T00:24:10.952 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "inventory_list_all", 2024-08-19T00:24:10.952 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.952 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.952 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.952 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.952 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.953 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.953 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.953 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-08-19T00:24:10.953 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.953 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.953 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.953 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.953 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:10.953 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:10.953 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.954 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.954 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.954 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.954 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.954 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.954 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.954 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.955 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.955 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.955 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.955 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.955 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.955 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.955 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.955 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.955 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.956 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.956 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.956 INFO:teuthology.orchestra.run.smithi044.stdout: "log_refresh_metadata": { 2024-08-19T00:24:10.956 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_refresh_metadata", 2024-08-19T00:24:10.956 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.956 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.956 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.956 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.957 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.957 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.957 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.957 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-08-19T00:24:10.957 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.957 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.957 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.957 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.958 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:10.958 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:10.958 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.958 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.958 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.958 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:10.958 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.959 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.959 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.959 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-08-19T00:24:10.959 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.959 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.959 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.959 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.959 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:10.960 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:10.960 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.960 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.960 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.960 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:10.960 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.960 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.961 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.961 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:10.961 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:10.961 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:10.961 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:10.961 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:10.961 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:10.961 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.962 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.962 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.962 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.962 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.962 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.962 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:10.962 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:10.962 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.963 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.963 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:10.963 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.963 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.963 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.963 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.963 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:10.963 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.964 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.964 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.964 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.964 INFO:teuthology.orchestra.run.smithi044.stdout: "manage_etc_ceph_ceph_conf": { 2024-08-19T00:24:10.964 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-08-19T00:24:10.964 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.964 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.964 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.965 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.965 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.965 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.965 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.965 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-08-19T00:24:10.965 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.965 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.966 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.966 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.966 INFO:teuthology.orchestra.run.smithi044.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-08-19T00:24:10.966 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-08-19T00:24:10.966 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.966 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.966 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.967 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "*", 2024-08-19T00:24:10.967 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.967 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.967 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.967 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-08-19T00:24:10.967 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.967 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.967 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.968 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.968 INFO:teuthology.orchestra.run.smithi044.stdout: "max_count_per_host": { 2024-08-19T00:24:10.968 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "max_count_per_host", 2024-08-19T00:24:10.968 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:10.968 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.968 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.968 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "10", 2024-08-19T00:24:10.968 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.969 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.969 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.969 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "max number of daemons per service per host", 2024-08-19T00:24:10.969 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.969 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.969 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.969 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.969 INFO:teuthology.orchestra.run.smithi044.stdout: "max_osd_draining_count": { 2024-08-19T00:24:10.970 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "max_osd_draining_count", 2024-08-19T00:24:10.970 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:10.970 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.970 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.970 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "10", 2024-08-19T00:24:10.970 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.970 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.970 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.971 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-08-19T00:24:10.971 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.971 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.971 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.971 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.971 INFO:teuthology.orchestra.run.smithi044.stdout: "migration_current": { 2024-08-19T00:24:10.971 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "migration_current", 2024-08-19T00:24:10.971 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:10.972 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.972 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.972 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.972 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.972 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.972 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.972 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "internal - do not modify", 2024-08-19T00:24:10.972 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.973 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.973 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.973 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.973 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": { 2024-08-19T00:24:10.973 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "mode", 2024-08-19T00:24:10.973 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.973 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.973 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.974 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "root", 2024-08-19T00:24:10.974 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.974 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.974 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:10.974 INFO:teuthology.orchestra.run.smithi044.stdout: "cephadm-package", 2024-08-19T00:24:10.974 INFO:teuthology.orchestra.run.smithi044.stdout: "root" 2024-08-19T00:24:10.974 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:10.974 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "mode for remote execution of cephadm", 2024-08-19T00:24:10.975 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.975 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.975 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.975 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.975 INFO:teuthology.orchestra.run.smithi044.stdout: "oob_default_addr": { 2024-08-19T00:24:10.975 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "oob_default_addr", 2024-08-19T00:24:10.975 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.975 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.975 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.976 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "169.254.1.1", 2024-08-19T00:24:10.976 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.976 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.976 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.976 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Default address for RedFish API (oob management).", 2024-08-19T00:24:10.976 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.976 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.976 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.977 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.977 INFO:teuthology.orchestra.run.smithi044.stdout: "prometheus_alerts_path": { 2024-08-19T00:24:10.977 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "prometheus_alerts_path", 2024-08-19T00:24:10.977 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.977 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.977 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.977 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-08-19T00:24:10.977 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.978 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.978 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.978 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-08-19T00:24:10.978 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.978 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.978 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.978 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.978 INFO:teuthology.orchestra.run.smithi044.stdout: "registry_insecure": { 2024-08-19T00:24:10.979 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "registry_insecure", 2024-08-19T00:24:10.979 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.979 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.979 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.979 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.979 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.979 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.979 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.980 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-08-19T00:24:10.980 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.980 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.980 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.980 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.980 INFO:teuthology.orchestra.run.smithi044.stdout: "registry_password": { 2024-08-19T00:24:10.980 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "registry_password", 2024-08-19T00:24:10.980 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.981 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.981 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.981 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.981 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.981 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.981 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.981 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-08-19T00:24:10.981 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.982 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.982 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.982 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.982 INFO:teuthology.orchestra.run.smithi044.stdout: "registry_url": { 2024-08-19T00:24:10.982 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "registry_url", 2024-08-19T00:24:10.982 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.982 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.982 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.983 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.983 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.983 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.983 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.983 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-08-19T00:24:10.983 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.983 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.983 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.984 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.984 INFO:teuthology.orchestra.run.smithi044.stdout: "registry_username": { 2024-08-19T00:24:10.984 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "registry_username", 2024-08-19T00:24:10.984 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.984 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.984 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.984 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.984 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.985 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.985 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.985 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-08-19T00:24:10.985 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.985 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.985 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.985 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.985 INFO:teuthology.orchestra.run.smithi044.stdout: "secure_monitoring_stack": { 2024-08-19T00:24:10.986 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "secure_monitoring_stack", 2024-08-19T00:24:10.986 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.986 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.986 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.986 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.986 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.986 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.986 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.987 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-08-19T00:24:10.987 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.987 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.987 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.987 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.987 INFO:teuthology.orchestra.run.smithi044.stdout: "service_discovery_port": { 2024-08-19T00:24:10.987 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "service_discovery_port", 2024-08-19T00:24:10.987 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:10.988 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.988 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.988 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "8765", 2024-08-19T00:24:10.988 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.988 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.988 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.988 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "cephadm service discovery port", 2024-08-19T00:24:10.989 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.989 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.989 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.989 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.989 INFO:teuthology.orchestra.run.smithi044.stdout: "ssh_config_file": { 2024-08-19T00:24:10.989 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "ssh_config_file", 2024-08-19T00:24:10.989 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:10.989 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.990 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.990 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:10.990 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.990 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.990 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.990 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-08-19T00:24:10.990 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.991 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.991 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.991 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.991 INFO:teuthology.orchestra.run.smithi044.stdout: "use_agent": { 2024-08-19T00:24:10.991 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "use_agent", 2024-08-19T00:24:10.991 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.991 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.991 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.992 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:10.992 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.992 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.992 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.992 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-08-19T00:24:10.992 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.992 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.992 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.993 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.993 INFO:teuthology.orchestra.run.smithi044.stdout: "use_repo_digest": { 2024-08-19T00:24:10.993 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "use_repo_digest", 2024-08-19T00:24:10.993 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.993 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.993 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.993 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:10.993 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.994 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.994 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.994 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-08-19T00:24:10.994 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.994 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.994 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.994 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.994 INFO:teuthology.orchestra.run.smithi044.stdout: "warn_on_failed_host_check": { 2024-08-19T00:24:10.995 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "warn_on_failed_host_check", 2024-08-19T00:24:10.995 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.995 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.995 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.995 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:10.995 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.995 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.995 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.996 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "raise a health warning if the host check fails", 2024-08-19T00:24:10.996 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.996 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.996 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.996 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.996 INFO:teuthology.orchestra.run.smithi044.stdout: "warn_on_stray_daemons": { 2024-08-19T00:24:10.996 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "warn_on_stray_daemons", 2024-08-19T00:24:10.997 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.997 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.997 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.997 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:10.997 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.997 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.997 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.997 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-08-19T00:24:10.997 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.998 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:10.998 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:10.998 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:10.998 INFO:teuthology.orchestra.run.smithi044.stdout: "warn_on_stray_hosts": { 2024-08-19T00:24:10.998 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "warn_on_stray_hosts", 2024-08-19T00:24:10.998 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:10.998 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:10.998 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:10.999 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:10.999 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:10.999 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:10.999 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:10.999 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-08-19T00:24:10.999 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:10.999 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.000 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.000 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.000 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.000 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.000 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:11.000 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "crash", 2024-08-19T00:24:11.000 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:11.000 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:11.000 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:11.001 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:11.001 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:11.001 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.001 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.001 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.001 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.001 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.001 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.002 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.002 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.002 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.002 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.002 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.002 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.002 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.003 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.003 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.003 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.003 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.003 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.003 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.003 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:11.003 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:11.003 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.004 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.004 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.004 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.004 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.004 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.004 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.004 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.004 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.005 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.005 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.005 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.005 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:11.005 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:11.005 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.005 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.005 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.006 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:11.006 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.006 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.006 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.006 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.006 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.006 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.006 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.007 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.007 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.007 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.007 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.007 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.007 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.007 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.007 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.008 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:11.008 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:11.008 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.008 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.008 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.008 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.008 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.008 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.008 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.009 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.009 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.009 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.009 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.009 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.009 INFO:teuthology.orchestra.run.smithi044.stdout: "retain_interval": { 2024-08-19T00:24:11.009 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "retain_interval", 2024-08-19T00:24:11.009 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", 2024-08-19T00:24:11.010 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.010 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.010 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "31536000", 2024-08-19T00:24:11.010 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.010 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.010 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.010 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "how long to retain crashes before pruning them", 2024-08-19T00:24:11.010 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.011 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.011 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.011 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.011 INFO:teuthology.orchestra.run.smithi044.stdout: "warn_recent_interval": { 2024-08-19T00:24:11.011 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "warn_recent_interval", 2024-08-19T00:24:11.011 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", 2024-08-19T00:24:11.011 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.011 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.012 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "1209600", 2024-08-19T00:24:11.012 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.012 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.012 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.012 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "time interval in which to warn about recent crashes", 2024-08-19T00:24:11.012 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.012 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.013 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.013 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.013 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.013 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.013 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:11.013 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "dashboard", 2024-08-19T00:24:11.013 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:11.013 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:11.014 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:11.014 INFO:teuthology.orchestra.run.smithi044.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-08-19T00:24:11.014 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-08-19T00:24:11.014 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:11.014 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.014 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.014 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "10", 2024-08-19T00:24:11.014 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.015 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.015 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.015 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.015 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.015 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.015 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.015 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.015 INFO:teuthology.orchestra.run.smithi044.stdout: "ALERTMANAGER_API_HOST": { 2024-08-19T00:24:11.016 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "ALERTMANAGER_API_HOST", 2024-08-19T00:24:11.016 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.016 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.016 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.016 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.016 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.016 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.016 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.017 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.017 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.017 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.017 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.017 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.017 INFO:teuthology.orchestra.run.smithi044.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-08-19T00:24:11.017 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-08-19T00:24:11.017 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.018 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.018 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.018 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:11.018 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.018 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.018 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.018 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.019 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.019 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.019 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.019 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.019 INFO:teuthology.orchestra.run.smithi044.stdout: "AUDIT_API_ENABLED": { 2024-08-19T00:24:11.019 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "AUDIT_API_ENABLED", 2024-08-19T00:24:11.019 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.019 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.019 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.020 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.020 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.020 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.020 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.020 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.020 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.020 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.020 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.021 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.021 INFO:teuthology.orchestra.run.smithi044.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-08-19T00:24:11.021 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-08-19T00:24:11.021 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.021 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.021 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.021 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:11.021 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.021 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.022 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.022 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.022 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.022 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.022 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.022 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.022 INFO:teuthology.orchestra.run.smithi044.stdout: "ENABLE_BROWSABLE_API": { 2024-08-19T00:24:11.023 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "ENABLE_BROWSABLE_API", 2024-08-19T00:24:11.023 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.023 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.023 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.023 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:11.023 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.023 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.023 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.024 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.024 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.024 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.024 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.024 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.024 INFO:teuthology.orchestra.run.smithi044.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-08-19T00:24:11.024 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-08-19T00:24:11.024 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.025 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.025 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.025 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:11.025 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.025 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.025 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.025 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.026 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.026 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.026 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.026 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.026 INFO:teuthology.orchestra.run.smithi044.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-08-19T00:24:11.026 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-08-19T00:24:11.026 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.026 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.027 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.027 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:11.027 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.027 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.027 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.027 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.027 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.027 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.028 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.028 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.028 INFO:teuthology.orchestra.run.smithi044.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-08-19T00:24:11.028 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-08-19T00:24:11.028 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.028 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.028 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.028 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:11.029 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.029 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.029 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.029 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.029 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.029 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.029 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.029 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.030 INFO:teuthology.orchestra.run.smithi044.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-08-19T00:24:11.030 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-08-19T00:24:11.030 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.030 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.030 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.030 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:11.030 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.030 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.031 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.031 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.031 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.031 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.031 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.031 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.031 INFO:teuthology.orchestra.run.smithi044.stdout: "FEATURE_TOGGLE_NFS": { 2024-08-19T00:24:11.031 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-08-19T00:24:11.032 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.032 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.032 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.032 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:11.032 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.032 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.032 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.032 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.033 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.033 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.033 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.033 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.033 INFO:teuthology.orchestra.run.smithi044.stdout: "FEATURE_TOGGLE_RBD": { 2024-08-19T00:24:11.033 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-08-19T00:24:11.033 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.033 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.034 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.034 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:11.034 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.034 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.034 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.034 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.034 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.035 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.035 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.035 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.035 INFO:teuthology.orchestra.run.smithi044.stdout: "FEATURE_TOGGLE_RGW": { 2024-08-19T00:24:11.035 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-08-19T00:24:11.035 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.035 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.035 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.036 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:11.036 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.036 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.036 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.036 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.036 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.036 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.036 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.036 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.037 INFO:teuthology.orchestra.run.smithi044.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-08-19T00:24:11.037 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-08-19T00:24:11.037 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.037 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.037 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.037 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.037 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.038 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.038 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.038 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.038 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.038 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.038 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.038 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.038 INFO:teuthology.orchestra.run.smithi044.stdout: "GRAFANA_API_PASSWORD": { 2024-08-19T00:24:11.038 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "GRAFANA_API_PASSWORD", 2024-08-19T00:24:11.039 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.039 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.039 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.039 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "admin", 2024-08-19T00:24:11.039 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.039 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.039 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.040 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.040 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.040 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.040 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.040 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.040 INFO:teuthology.orchestra.run.smithi044.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-08-19T00:24:11.040 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-08-19T00:24:11.041 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.041 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.041 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.041 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:11.041 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.041 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.041 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.041 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.042 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.042 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.042 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.042 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.042 INFO:teuthology.orchestra.run.smithi044.stdout: "GRAFANA_API_URL": { 2024-08-19T00:24:11.042 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "GRAFANA_API_URL", 2024-08-19T00:24:11.042 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.042 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.043 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.043 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.043 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.043 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.043 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.043 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.043 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.043 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.044 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.044 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.044 INFO:teuthology.orchestra.run.smithi044.stdout: "GRAFANA_API_USERNAME": { 2024-08-19T00:24:11.044 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "GRAFANA_API_USERNAME", 2024-08-19T00:24:11.044 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.044 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.044 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.044 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "admin", 2024-08-19T00:24:11.045 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.045 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.045 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.045 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.045 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.045 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.045 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.045 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.046 INFO:teuthology.orchestra.run.smithi044.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-08-19T00:24:11.046 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-08-19T00:24:11.046 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.046 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.046 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.046 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.046 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.046 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.047 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.047 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.047 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.047 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.047 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.047 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.047 INFO:teuthology.orchestra.run.smithi044.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-08-19T00:24:11.047 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-08-19T00:24:11.048 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.048 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.048 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.048 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.048 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.048 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.048 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.048 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.049 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.049 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.049 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.049 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.049 INFO:teuthology.orchestra.run.smithi044.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-08-19T00:24:11.049 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-08-19T00:24:11.049 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.049 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.049 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.050 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:11.050 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.050 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.050 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.050 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.050 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.050 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.050 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.051 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.051 INFO:teuthology.orchestra.run.smithi044.stdout: "ISSUE_TRACKER_API_KEY": { 2024-08-19T00:24:11.051 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-08-19T00:24:11.051 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.051 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.051 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.051 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.051 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.052 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.052 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.052 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.052 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.052 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.052 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.052 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.052 INFO:teuthology.orchestra.run.smithi044.stdout: "PROMETHEUS_API_HOST": { 2024-08-19T00:24:11.053 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "PROMETHEUS_API_HOST", 2024-08-19T00:24:11.053 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.053 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.053 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.053 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.053 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.053 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.053 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.053 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.054 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.054 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.054 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.054 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.054 INFO:teuthology.orchestra.run.smithi044.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-08-19T00:24:11.054 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-08-19T00:24:11.054 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.055 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.055 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.055 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:11.055 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.055 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.055 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.055 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.055 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.056 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.056 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.056 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.056 INFO:teuthology.orchestra.run.smithi044.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-08-19T00:24:11.056 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-08-19T00:24:11.056 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.056 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.056 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.056 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.057 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.057 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.057 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.057 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.057 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.057 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.057 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.057 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.057 INFO:teuthology.orchestra.run.smithi044.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-08-19T00:24:11.058 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-08-19T00:24:11.058 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.058 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.058 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.058 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.058 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.058 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.058 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.059 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.059 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.059 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.059 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.059 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.059 INFO:teuthology.orchestra.run.smithi044.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-08-19T00:24:11.059 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-08-19T00:24:11.060 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.060 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.060 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.060 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:11.060 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.060 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.060 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.060 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.061 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.061 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.061 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.061 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.061 INFO:teuthology.orchestra.run.smithi044.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-08-19T00:24:11.061 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-08-19T00:24:11.061 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.061 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.062 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.062 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:11.062 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.062 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.062 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.062 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.062 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.062 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.063 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.063 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.063 INFO:teuthology.orchestra.run.smithi044.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-08-19T00:24:11.063 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-08-19T00:24:11.063 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.063 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.063 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.063 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.064 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.064 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.064 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.064 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.064 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.064 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.064 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.065 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.065 INFO:teuthology.orchestra.run.smithi044.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-08-19T00:24:11.065 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-08-19T00:24:11.065 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.065 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.065 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.065 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.065 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.066 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.066 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.066 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.066 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.066 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.066 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.066 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.067 INFO:teuthology.orchestra.run.smithi044.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-08-19T00:24:11.067 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-08-19T00:24:11.067 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.067 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.067 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.067 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.067 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.067 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.068 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.068 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.068 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.068 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.068 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.068 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.068 INFO:teuthology.orchestra.run.smithi044.stdout: "PWD_POLICY_ENABLED": { 2024-08-19T00:24:11.069 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "PWD_POLICY_ENABLED", 2024-08-19T00:24:11.069 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.069 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.069 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.069 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:11.069 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.069 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.069 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.070 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.070 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.070 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.070 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.070 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.070 INFO:teuthology.orchestra.run.smithi044.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-08-19T00:24:11.070 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-08-19T00:24:11.071 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.071 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.071 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.071 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-08-19T00:24:11.071 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.071 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.071 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.071 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.072 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.072 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.072 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.072 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.072 INFO:teuthology.orchestra.run.smithi044.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-08-19T00:24:11.072 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-08-19T00:24:11.072 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:11.073 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.073 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.073 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "10", 2024-08-19T00:24:11.073 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.073 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.073 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.073 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.073 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.074 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.074 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.074 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.074 INFO:teuthology.orchestra.run.smithi044.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-08-19T00:24:11.074 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-08-19T00:24:11.074 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:11.074 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.074 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.075 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "8", 2024-08-19T00:24:11.075 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.075 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.075 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.075 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.075 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.075 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.075 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.076 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.076 INFO:teuthology.orchestra.run.smithi044.stdout: "REST_REQUESTS_TIMEOUT": { 2024-08-19T00:24:11.076 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-08-19T00:24:11.076 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:11.076 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.076 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.076 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "45", 2024-08-19T00:24:11.077 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.077 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.077 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.077 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.077 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.077 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.077 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.077 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.077 INFO:teuthology.orchestra.run.smithi044.stdout: "RGW_API_ACCESS_KEY": { 2024-08-19T00:24:11.078 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "RGW_API_ACCESS_KEY", 2024-08-19T00:24:11.078 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.078 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.078 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.078 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.078 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.078 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.079 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.079 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.079 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.079 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.079 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.079 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.079 INFO:teuthology.orchestra.run.smithi044.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-08-19T00:24:11.079 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-08-19T00:24:11.080 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.080 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.080 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.080 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "admin", 2024-08-19T00:24:11.080 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.080 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.080 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.081 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.081 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.081 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.081 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.081 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.081 INFO:teuthology.orchestra.run.smithi044.stdout: "RGW_API_SECRET_KEY": { 2024-08-19T00:24:11.081 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "RGW_API_SECRET_KEY", 2024-08-19T00:24:11.081 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.082 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.082 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.082 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.082 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.082 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.082 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.082 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.082 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.083 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.083 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.083 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.083 INFO:teuthology.orchestra.run.smithi044.stdout: "RGW_API_SSL_VERIFY": { 2024-08-19T00:24:11.083 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "RGW_API_SSL_VERIFY", 2024-08-19T00:24:11.083 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.083 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.083 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.084 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:11.084 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.084 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.084 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.084 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.084 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.084 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.084 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.085 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.085 INFO:teuthology.orchestra.run.smithi044.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-08-19T00:24:11.085 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-08-19T00:24:11.085 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:11.085 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.085 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.085 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "0", 2024-08-19T00:24:11.085 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.086 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.086 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.086 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.086 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.086 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.086 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.086 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.086 INFO:teuthology.orchestra.run.smithi044.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-08-19T00:24:11.087 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-08-19T00:24:11.087 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:11.087 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.087 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.087 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "10", 2024-08-19T00:24:11.087 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.087 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.087 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.088 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.088 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.088 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.088 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.088 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.088 INFO:teuthology.orchestra.run.smithi044.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-08-19T00:24:11.088 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-08-19T00:24:11.088 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:11.089 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.089 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.089 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "5", 2024-08-19T00:24:11.089 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.089 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.089 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.089 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.090 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.090 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.090 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.090 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.090 INFO:teuthology.orchestra.run.smithi044.stdout: "cross_origin_url": { 2024-08-19T00:24:11.090 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "cross_origin_url", 2024-08-19T00:24:11.090 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.090 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.091 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.091 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.091 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.091 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.091 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.091 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.091 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.091 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.092 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.092 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.092 INFO:teuthology.orchestra.run.smithi044.stdout: "crt_file": { 2024-08-19T00:24:11.092 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "crt_file", 2024-08-19T00:24:11.092 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.092 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.092 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.093 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.093 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.093 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.093 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.093 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.093 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.093 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.093 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.094 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.094 INFO:teuthology.orchestra.run.smithi044.stdout: "debug": { 2024-08-19T00:24:11.094 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "debug", 2024-08-19T00:24:11.094 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.094 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.094 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.094 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.094 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.095 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.095 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.095 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Enable/disable debug options", 2024-08-19T00:24:11.095 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.095 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.095 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.095 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.095 INFO:teuthology.orchestra.run.smithi044.stdout: "jwt_token_ttl": { 2024-08-19T00:24:11.095 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "jwt_token_ttl", 2024-08-19T00:24:11.096 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:11.096 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.096 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.096 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "28800", 2024-08-19T00:24:11.096 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.096 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.096 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.096 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.097 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.097 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.097 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.097 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.097 INFO:teuthology.orchestra.run.smithi044.stdout: "key_file": { 2024-08-19T00:24:11.097 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "key_file", 2024-08-19T00:24:11.097 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.097 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.097 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.097 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.098 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.098 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.098 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.098 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.098 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.098 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.098 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.098 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.099 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:11.099 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:11.099 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.099 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.099 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.099 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.099 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.099 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.099 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.100 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.100 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.100 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.100 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.100 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.100 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.100 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.100 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.100 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.101 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.101 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.101 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.101 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:11.101 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:11.101 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.101 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.102 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.102 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.102 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.102 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.102 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.102 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.102 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.102 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.103 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.103 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.103 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:11.103 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:11.103 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.103 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.103 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.103 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:11.103 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.104 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.104 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.104 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.104 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.104 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.104 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.104 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.104 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.105 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.105 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.105 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.105 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.105 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.105 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.105 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:11.105 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:11.105 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.106 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.106 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.106 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.106 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.106 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.106 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.106 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.106 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.107 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.107 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.107 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.107 INFO:teuthology.orchestra.run.smithi044.stdout: "motd": { 2024-08-19T00:24:11.107 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "motd", 2024-08-19T00:24:11.107 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.107 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.108 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.108 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.108 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.108 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.108 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.108 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "The message of the day", 2024-08-19T00:24:11.108 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.108 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.109 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.109 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.109 INFO:teuthology.orchestra.run.smithi044.stdout: "redirect_resolve_ip_addr": { 2024-08-19T00:24:11.109 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "redirect_resolve_ip_addr", 2024-08-19T00:24:11.109 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.109 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.109 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.109 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.109 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.110 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.110 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.110 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.110 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.110 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.110 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.110 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.111 INFO:teuthology.orchestra.run.smithi044.stdout: "server_addr": { 2024-08-19T00:24:11.111 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "server_addr", 2024-08-19T00:24:11.111 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.111 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.111 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.111 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "::", 2024-08-19T00:24:11.111 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.111 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.111 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.112 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.112 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.112 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.112 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.112 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.112 INFO:teuthology.orchestra.run.smithi044.stdout: "server_port": { 2024-08-19T00:24:11.112 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "server_port", 2024-08-19T00:24:11.113 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:11.113 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.113 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.113 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "8080", 2024-08-19T00:24:11.113 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.113 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.113 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.113 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.114 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.114 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.114 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.114 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.114 INFO:teuthology.orchestra.run.smithi044.stdout: "ssl": { 2024-08-19T00:24:11.114 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "ssl", 2024-08-19T00:24:11.114 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.115 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.115 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.115 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:11.115 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.115 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.115 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.115 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.115 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.116 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.116 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.116 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.116 INFO:teuthology.orchestra.run.smithi044.stdout: "ssl_server_port": { 2024-08-19T00:24:11.116 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "ssl_server_port", 2024-08-19T00:24:11.116 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:11.116 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.116 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.117 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "8443", 2024-08-19T00:24:11.117 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.117 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.117 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.117 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.117 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.117 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.117 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.118 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.118 INFO:teuthology.orchestra.run.smithi044.stdout: "standby_behaviour": { 2024-08-19T00:24:11.118 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "standby_behaviour", 2024-08-19T00:24:11.118 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.118 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.118 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.118 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "redirect", 2024-08-19T00:24:11.119 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.119 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.119 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.119 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.119 INFO:teuthology.orchestra.run.smithi044.stdout: "redirect" 2024-08-19T00:24:11.119 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.119 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.120 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.120 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.120 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.120 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.120 INFO:teuthology.orchestra.run.smithi044.stdout: "standby_error_status_code": { 2024-08-19T00:24:11.120 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "standby_error_status_code", 2024-08-19T00:24:11.120 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:11.120 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.121 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.121 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "500", 2024-08-19T00:24:11.121 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "400", 2024-08-19T00:24:11.121 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "599", 2024-08-19T00:24:11.121 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.121 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.121 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.121 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.122 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.122 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.122 INFO:teuthology.orchestra.run.smithi044.stdout: "url_prefix": { 2024-08-19T00:24:11.122 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "url_prefix", 2024-08-19T00:24:11.122 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.122 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.122 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.122 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.123 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.123 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.123 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.123 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.123 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.123 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.123 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.124 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.124 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.124 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.124 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:11.124 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "devicehealth", 2024-08-19T00:24:11.124 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:11.124 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:11.124 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:11.125 INFO:teuthology.orchestra.run.smithi044.stdout: "enable_monitoring": { 2024-08-19T00:24:11.125 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "enable_monitoring", 2024-08-19T00:24:11.125 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.125 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.125 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.125 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:11.125 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.125 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.125 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.126 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "monitor device health metrics", 2024-08-19T00:24:11.126 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.126 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.126 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.126 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.126 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:11.126 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:11.127 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.127 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.127 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.127 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.127 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.127 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.127 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.127 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.128 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.128 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.128 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.128 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.128 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.128 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.128 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.128 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.129 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.129 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.129 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.129 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:11.129 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:11.129 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.129 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.129 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.129 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.130 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.130 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.130 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.130 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.130 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.130 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.130 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.130 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.131 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:11.131 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:11.131 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.131 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.131 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.131 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:11.131 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.131 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.132 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.132 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.132 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.132 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.132 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.132 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.132 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.132 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.133 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.133 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.133 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.133 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.133 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.133 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:11.133 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:11.133 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.133 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.134 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.134 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.134 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.134 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.134 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.134 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.134 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.134 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.135 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.135 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.135 INFO:teuthology.orchestra.run.smithi044.stdout: "mark_out_threshold": { 2024-08-19T00:24:11.135 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "mark_out_threshold", 2024-08-19T00:24:11.135 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", 2024-08-19T00:24:11.135 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.135 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.135 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "2419200", 2024-08-19T00:24:11.135 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.136 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.136 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.136 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-08-19T00:24:11.136 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.136 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.136 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.136 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.136 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_name": { 2024-08-19T00:24:11.137 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "pool_name", 2024-08-19T00:24:11.137 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.137 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.137 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.137 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "device_health_metrics", 2024-08-19T00:24:11.137 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.137 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.137 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.138 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "name of pool in which to store device health metrics", 2024-08-19T00:24:11.138 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.138 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.138 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.138 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.138 INFO:teuthology.orchestra.run.smithi044.stdout: "retention_period": { 2024-08-19T00:24:11.138 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "retention_period", 2024-08-19T00:24:11.138 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", 2024-08-19T00:24:11.139 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.139 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.139 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "15552000", 2024-08-19T00:24:11.139 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.139 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.139 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.139 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "how long to retain device health metrics", 2024-08-19T00:24:11.139 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.140 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.140 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.140 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.140 INFO:teuthology.orchestra.run.smithi044.stdout: "scrape_frequency": { 2024-08-19T00:24:11.140 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "scrape_frequency", 2024-08-19T00:24:11.140 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", 2024-08-19T00:24:11.140 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.140 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.141 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "86400", 2024-08-19T00:24:11.141 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.141 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.141 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.141 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "how frequently to scrape device health metrics", 2024-08-19T00:24:11.141 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.141 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.141 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.141 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.141 INFO:teuthology.orchestra.run.smithi044.stdout: "self_heal": { 2024-08-19T00:24:11.142 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "self_heal", 2024-08-19T00:24:11.142 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.142 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.142 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.142 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:11.142 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.142 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.142 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.143 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-08-19T00:24:11.143 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.143 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.143 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.143 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.143 INFO:teuthology.orchestra.run.smithi044.stdout: "sleep_interval": { 2024-08-19T00:24:11.143 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "sleep_interval", 2024-08-19T00:24:11.143 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", 2024-08-19T00:24:11.143 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.144 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.144 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "600", 2024-08-19T00:24:11.144 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.144 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.144 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.144 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "how frequently to wake up and check device health", 2024-08-19T00:24:11.145 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.145 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.145 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.145 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.145 INFO:teuthology.orchestra.run.smithi044.stdout: "warn_threshold": { 2024-08-19T00:24:11.145 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "warn_threshold", 2024-08-19T00:24:11.145 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", 2024-08-19T00:24:11.146 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.146 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.146 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "7257600", 2024-08-19T00:24:11.146 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.146 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.146 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.146 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-08-19T00:24:11.146 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.147 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.147 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.147 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.147 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.147 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.147 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:11.147 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "diskprediction_local", 2024-08-19T00:24:11.147 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:11.148 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:11.148 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:11.148 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:11.148 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:11.148 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.148 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.148 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.148 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.149 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.149 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.149 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.149 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.149 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.149 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.149 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.150 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.150 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.150 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.150 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.150 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.150 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.150 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.151 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.151 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:11.151 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:11.151 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.151 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.151 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.151 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.151 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.152 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.152 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.152 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.152 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.152 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.152 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.152 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.152 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:11.152 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:11.153 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.153 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.153 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.153 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:11.153 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.153 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.153 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.153 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.154 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.154 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.154 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.154 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.154 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.154 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.154 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.154 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.155 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.155 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.155 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.155 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:11.155 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:11.155 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.155 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.155 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.156 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.156 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.156 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.156 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.156 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.156 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.156 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.156 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.157 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.157 INFO:teuthology.orchestra.run.smithi044.stdout: "predict_interval": { 2024-08-19T00:24:11.157 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "predict_interval", 2024-08-19T00:24:11.157 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.157 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.157 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.157 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "86400", 2024-08-19T00:24:11.157 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.158 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.158 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.158 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.158 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.158 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.158 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.158 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.158 INFO:teuthology.orchestra.run.smithi044.stdout: "predictor_model": { 2024-08-19T00:24:11.159 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "predictor_model", 2024-08-19T00:24:11.159 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.159 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.159 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.159 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "prophetstor", 2024-08-19T00:24:11.159 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.159 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.159 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.159 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.160 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.160 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.160 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.160 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.160 INFO:teuthology.orchestra.run.smithi044.stdout: "sleep_interval": { 2024-08-19T00:24:11.160 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "sleep_interval", 2024-08-19T00:24:11.160 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.160 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.161 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.161 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "600", 2024-08-19T00:24:11.161 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.161 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.161 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.161 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.161 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.161 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.161 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.162 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.162 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.162 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.162 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:11.162 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "influx", 2024-08-19T00:24:11.162 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": false, 2024-08-19T00:24:11.162 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "influxdb python module not found", 2024-08-19T00:24:11.163 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:11.163 INFO:teuthology.orchestra.run.smithi044.stdout: "batch_size": { 2024-08-19T00:24:11.163 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "batch_size", 2024-08-19T00:24:11.163 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:11.163 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.163 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.163 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "5000", 2024-08-19T00:24:11.163 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.164 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.164 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.164 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-08-19T00:24:11.164 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.164 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.164 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.164 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.164 INFO:teuthology.orchestra.run.smithi044.stdout: "database": { 2024-08-19T00:24:11.165 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "database", 2024-08-19T00:24:11.165 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.165 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.165 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.165 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "ceph", 2024-08-19T00:24:11.165 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.165 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.165 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.166 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-08-19T00:24:11.166 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.166 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.166 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.166 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.166 INFO:teuthology.orchestra.run.smithi044.stdout: "hostname": { 2024-08-19T00:24:11.166 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "hostname", 2024-08-19T00:24:11.167 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.167 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.167 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.167 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.167 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.167 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.167 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.167 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "InfluxDB server hostname", 2024-08-19T00:24:11.168 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.168 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.168 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.168 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.168 INFO:teuthology.orchestra.run.smithi044.stdout: "interval": { 2024-08-19T00:24:11.168 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "interval", 2024-08-19T00:24:11.168 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", 2024-08-19T00:24:11.168 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.169 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.169 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "30", 2024-08-19T00:24:11.169 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "5", 2024-08-19T00:24:11.169 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.169 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.169 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-08-19T00:24:11.169 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.170 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.170 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.170 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.170 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:11.170 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:11.170 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.170 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.170 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.171 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.171 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.171 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.171 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.171 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.171 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.171 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.172 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.172 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.172 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.172 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.172 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.172 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.172 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.172 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.173 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.173 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:11.173 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:11.173 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.173 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.173 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.173 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.173 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.174 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.174 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.174 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.174 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.174 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.174 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.174 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.174 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:11.175 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:11.175 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.175 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.175 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.175 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:11.175 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.175 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.176 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.176 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.176 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.176 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.176 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.176 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.176 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.176 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.177 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.177 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.177 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.177 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.177 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.177 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:11.177 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:11.178 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.178 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.178 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.178 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.178 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.178 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.178 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.178 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.179 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.179 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.179 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.179 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.179 INFO:teuthology.orchestra.run.smithi044.stdout: "password": { 2024-08-19T00:24:11.179 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "password", 2024-08-19T00:24:11.179 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.179 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.180 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.180 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.180 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.180 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.180 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.180 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "password of InfluxDB server user", 2024-08-19T00:24:11.180 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.181 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.181 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.181 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.181 INFO:teuthology.orchestra.run.smithi044.stdout: "port": { 2024-08-19T00:24:11.181 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "port", 2024-08-19T00:24:11.181 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:11.181 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.181 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.182 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "8086", 2024-08-19T00:24:11.182 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.182 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.182 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.182 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "InfluxDB server port", 2024-08-19T00:24:11.182 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.182 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.182 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.183 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.183 INFO:teuthology.orchestra.run.smithi044.stdout: "ssl": { 2024-08-19T00:24:11.183 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "ssl", 2024-08-19T00:24:11.183 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.183 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.183 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.183 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "false", 2024-08-19T00:24:11.183 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.184 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.184 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.184 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-08-19T00:24:11.184 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.184 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.184 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.184 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.184 INFO:teuthology.orchestra.run.smithi044.stdout: "threads": { 2024-08-19T00:24:11.185 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "threads", 2024-08-19T00:24:11.185 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:11.185 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.185 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.185 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "5", 2024-08-19T00:24:11.185 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "1", 2024-08-19T00:24:11.185 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "32", 2024-08-19T00:24:11.185 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.186 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-08-19T00:24:11.186 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.186 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.186 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.186 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.186 INFO:teuthology.orchestra.run.smithi044.stdout: "username": { 2024-08-19T00:24:11.186 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "username", 2024-08-19T00:24:11.186 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.187 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.187 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.187 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.187 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.187 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.187 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.187 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "username of InfluxDB server user", 2024-08-19T00:24:11.187 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.188 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.188 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.188 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.188 INFO:teuthology.orchestra.run.smithi044.stdout: "verify_ssl": { 2024-08-19T00:24:11.188 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "verify_ssl", 2024-08-19T00:24:11.188 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.188 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.188 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.189 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "true", 2024-08-19T00:24:11.189 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.189 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.189 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.189 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-08-19T00:24:11.189 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.189 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.189 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.190 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.190 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.190 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.190 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:11.190 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "insights", 2024-08-19T00:24:11.190 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:11.190 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:11.190 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:11.191 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:11.191 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:11.191 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.191 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.191 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.191 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.191 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.191 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.192 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.192 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.192 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.192 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.192 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.192 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.192 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.193 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.193 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.193 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.193 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.193 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.193 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.193 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:11.193 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:11.194 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.194 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.194 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.194 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.194 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.194 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.194 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.195 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.195 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.195 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.195 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.195 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.195 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:11.195 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:11.195 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.195 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.196 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.196 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:11.196 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.196 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.196 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.196 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.196 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.196 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.196 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.196 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.197 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.197 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.197 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.197 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.197 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.197 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.197 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.197 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:11.197 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:11.198 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.198 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.198 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.198 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.198 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.198 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.198 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.198 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.199 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.199 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.199 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.199 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.199 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.199 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.199 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:11.199 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "iostat", 2024-08-19T00:24:11.200 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:11.200 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:11.200 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:11.200 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:11.200 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:11.200 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.200 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.200 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.201 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.201 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.201 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.201 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.201 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.201 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.201 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.201 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.202 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.202 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.202 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.202 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.202 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.202 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.202 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.202 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.203 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:11.203 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:11.203 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.203 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.203 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.203 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.203 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.204 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.204 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.204 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.204 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.204 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.204 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.204 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.204 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:11.205 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:11.205 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.205 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.205 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.205 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:11.205 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.205 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.206 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.206 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.206 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.206 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.206 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.206 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.206 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.206 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.207 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.207 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.207 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.207 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.207 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.207 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:11.207 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:11.208 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.208 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.208 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.208 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.208 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.208 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.208 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.208 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.208 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.209 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.209 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.209 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.209 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.209 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.209 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:11.209 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "k8sevents", 2024-08-19T00:24:11.209 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:11.210 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:11.210 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:11.210 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_event_retention_days": { 2024-08-19T00:24:11.210 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "ceph_event_retention_days", 2024-08-19T00:24:11.210 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:11.210 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.210 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.210 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "7", 2024-08-19T00:24:11.211 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.211 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.211 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.211 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Days to hold ceph event information within local cache", 2024-08-19T00:24:11.211 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.211 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.211 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.211 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.212 INFO:teuthology.orchestra.run.smithi044.stdout: "config_check_secs": { 2024-08-19T00:24:11.212 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "config_check_secs", 2024-08-19T00:24:11.212 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:11.212 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.212 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.212 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "10", 2024-08-19T00:24:11.212 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "10", 2024-08-19T00:24:11.212 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.213 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.213 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-08-19T00:24:11.213 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.213 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.213 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.213 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.213 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:11.214 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:11.214 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.214 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.214 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.214 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.214 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.214 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.214 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.215 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.215 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.215 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.215 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.215 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.215 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.215 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.215 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.216 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.216 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.216 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.216 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.216 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:11.216 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:11.216 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.216 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.217 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.217 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.217 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.217 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.217 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.217 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.217 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.217 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.218 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.218 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.218 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:11.218 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:11.218 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.218 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.218 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.218 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:11.219 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.219 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.219 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.219 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.219 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.219 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.219 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.219 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.220 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.220 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.220 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.220 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.220 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.220 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.220 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.220 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:11.221 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:11.221 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.221 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.221 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.221 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.221 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.221 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.221 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.222 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.222 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.222 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.222 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.222 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.222 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.222 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.222 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:11.223 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "localpool", 2024-08-19T00:24:11.223 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:11.223 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:11.223 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:11.223 INFO:teuthology.orchestra.run.smithi044.stdout: "failure_domain": { 2024-08-19T00:24:11.223 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "failure_domain", 2024-08-19T00:24:11.223 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.223 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.224 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.224 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "host", 2024-08-19T00:24:11.224 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.224 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.224 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.224 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "failure domain for any created local pool", 2024-08-19T00:24:11.224 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-08-19T00:24:11.225 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.225 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.225 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.225 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:11.225 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:11.225 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.225 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.225 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.226 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.226 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.226 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.226 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.226 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.226 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.226 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.226 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.227 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.227 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.227 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.227 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.227 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.227 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.227 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.227 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.228 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:11.228 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:11.228 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.228 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.228 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.228 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.228 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.228 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.229 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.229 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.229 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.229 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.229 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.229 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.229 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:11.229 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:11.229 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.230 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.230 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.230 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:11.230 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.230 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.230 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.230 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.231 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.231 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.231 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.231 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.231 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.231 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.231 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.231 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.231 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.232 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.232 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.232 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:11.232 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:11.232 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.232 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.232 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.233 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.233 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.233 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.233 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.233 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.233 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.233 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.233 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.234 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.234 INFO:teuthology.orchestra.run.smithi044.stdout: "min_size": { 2024-08-19T00:24:11.234 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "min_size", 2024-08-19T00:24:11.234 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:11.234 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.234 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.234 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.234 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.235 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.235 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.235 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "default min_size for any created local pool", 2024-08-19T00:24:11.235 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-08-19T00:24:11.235 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.235 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.235 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.235 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rep": { 2024-08-19T00:24:11.236 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "num_rep", 2024-08-19T00:24:11.236 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:11.236 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.236 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.236 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "3", 2024-08-19T00:24:11.236 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.236 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.236 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.236 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "default replica count for any created local pool", 2024-08-19T00:24:11.237 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.237 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.237 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.237 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.237 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num": { 2024-08-19T00:24:11.237 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "pg_num", 2024-08-19T00:24:11.237 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:11.237 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.238 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.238 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "128", 2024-08-19T00:24:11.238 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.238 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.238 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.238 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "default pg_num for any created local pool", 2024-08-19T00:24:11.239 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.239 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.239 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.239 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.239 INFO:teuthology.orchestra.run.smithi044.stdout: "prefix": { 2024-08-19T00:24:11.239 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "prefix", 2024-08-19T00:24:11.239 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.239 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.239 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.240 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.240 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.240 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.240 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.240 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "name prefix for any created local pool", 2024-08-19T00:24:11.240 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.240 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.240 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.241 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.241 INFO:teuthology.orchestra.run.smithi044.stdout: "subtree": { 2024-08-19T00:24:11.241 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "subtree", 2024-08-19T00:24:11.241 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.241 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.241 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.241 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "rack", 2024-08-19T00:24:11.242 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.242 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.242 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.242 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "CRUSH level for which to create a local pool", 2024-08-19T00:24:11.242 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-08-19T00:24:11.242 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.242 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.242 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.243 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.243 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.243 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:11.243 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "mds_autoscaler", 2024-08-19T00:24:11.243 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:11.243 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:11.243 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:11.243 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:11.243 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:11.244 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.244 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.244 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.244 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.244 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.244 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.244 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.244 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.245 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.245 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.245 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.245 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.245 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.245 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.245 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.245 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.246 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.246 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.246 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.246 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:11.246 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:11.246 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.246 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.246 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.247 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.247 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.247 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.247 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.247 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.247 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.247 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.247 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.247 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.248 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:11.248 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:11.248 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.248 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.248 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.248 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:11.248 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.248 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.249 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.249 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.249 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.249 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.249 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.249 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.249 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.249 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.250 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.250 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.250 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.250 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.250 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.250 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:11.250 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:11.250 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.251 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.251 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.251 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.251 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.251 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.251 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.251 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.252 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.252 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.252 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.252 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.252 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.252 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.252 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:11.252 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "mirroring", 2024-08-19T00:24:11.252 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:11.253 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:11.253 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:11.253 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:11.253 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:11.253 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.253 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.253 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.253 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.254 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.254 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.254 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.254 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.254 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.254 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.254 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.254 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.255 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.255 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.255 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.255 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.255 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.255 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.255 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.256 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:11.256 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:11.256 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.256 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.256 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.256 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.256 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.256 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.256 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.257 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.257 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.257 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.257 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.257 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.257 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:11.257 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:11.258 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.258 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.258 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.258 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:11.258 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.258 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.258 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.258 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.259 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.259 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.259 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.259 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.259 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.259 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.259 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.259 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.260 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.260 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.260 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.260 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:11.260 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:11.260 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.260 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.260 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.261 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.261 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.261 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.261 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.261 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.261 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.261 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.261 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.262 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.262 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.262 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.262 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:11.262 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "nfs", 2024-08-19T00:24:11.262 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:11.262 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:11.262 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:11.263 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:11.263 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:11.263 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.263 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.263 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.263 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.263 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.263 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.264 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.264 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.264 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.264 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.264 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.264 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.264 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.264 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.265 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.265 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.265 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.265 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.265 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.265 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:11.265 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:11.265 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.266 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.266 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.266 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.266 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.266 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.266 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.266 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.266 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.267 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.267 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.267 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.267 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:11.267 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:11.267 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.267 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.267 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.268 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:11.268 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.268 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.268 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.268 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.268 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.268 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.268 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.268 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.269 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.269 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.269 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.269 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.269 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.269 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.269 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.269 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:11.269 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:11.270 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.270 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.270 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.270 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.270 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.270 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.270 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.270 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.271 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.271 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.271 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.271 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.271 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.271 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.271 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:11.271 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "orchestrator", 2024-08-19T00:24:11.272 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:11.272 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:11.272 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:11.272 INFO:teuthology.orchestra.run.smithi044.stdout: "fail_fs": { 2024-08-19T00:24:11.272 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "fail_fs", 2024-08-19T00:24:11.272 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.272 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.273 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.273 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.273 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.273 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.273 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.273 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-08-19T00:24:11.273 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.273 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.274 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.274 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.274 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:11.274 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:11.274 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.274 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.274 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.275 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.275 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.275 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.275 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.275 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.275 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.275 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.275 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.276 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.276 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.276 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.276 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.276 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.276 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.276 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.276 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.276 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:11.277 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:11.277 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.277 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.277 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.277 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.277 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.277 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.277 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.278 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.278 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.278 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.278 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.278 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.278 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:11.278 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:11.279 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.279 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.279 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.279 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:11.279 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.279 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.279 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.279 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.280 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.280 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.280 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.280 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.280 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.280 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.280 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.280 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.281 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.281 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.281 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.281 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:11.281 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:11.281 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.281 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.282 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.282 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.282 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.282 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.282 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.282 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.282 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.282 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.283 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.283 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.283 INFO:teuthology.orchestra.run.smithi044.stdout: "orchestrator": { 2024-08-19T00:24:11.283 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "orchestrator", 2024-08-19T00:24:11.283 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.283 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.283 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.283 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.284 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.284 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.284 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.284 INFO:teuthology.orchestra.run.smithi044.stdout: "cephadm", 2024-08-19T00:24:11.284 INFO:teuthology.orchestra.run.smithi044.stdout: "rook", 2024-08-19T00:24:11.284 INFO:teuthology.orchestra.run.smithi044.stdout: "test_orchestrator" 2024-08-19T00:24:11.284 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.284 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Orchestrator backend", 2024-08-19T00:24:11.285 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.285 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.285 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.285 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.285 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.285 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.285 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:11.285 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "osd_perf_query", 2024-08-19T00:24:11.286 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:11.286 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:11.286 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:11.286 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:11.286 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:11.286 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.286 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.286 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.287 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.287 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.287 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.287 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.287 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.287 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.287 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.288 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.288 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.288 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.288 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.288 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.288 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.288 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.288 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.289 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.289 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:11.289 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:11.289 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.289 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.289 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.289 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.289 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.290 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.290 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.290 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.290 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.290 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.290 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.290 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.290 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:11.291 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:11.291 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.291 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.291 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.291 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:11.291 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.291 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.292 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.292 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.292 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.292 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.292 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.292 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.292 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.292 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.293 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.293 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.293 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.293 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.293 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.293 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:11.293 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:11.293 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.294 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.294 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.294 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.294 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.294 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.294 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.294 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.294 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.295 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.295 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.295 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.295 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.295 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.295 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:11.295 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "osd_support", 2024-08-19T00:24:11.296 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:11.296 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:11.296 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:11.296 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:11.296 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:11.296 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.296 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.296 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.296 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.297 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.297 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.297 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.297 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.297 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.297 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.297 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.297 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.298 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.298 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.298 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.298 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.298 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.298 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.298 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.298 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:11.299 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:11.299 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.299 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.299 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.299 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.299 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.299 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.299 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.300 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.300 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.300 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.300 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.300 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.300 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:11.300 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:11.300 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.301 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.301 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.301 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:11.301 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.301 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.301 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.301 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.301 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.302 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.302 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.302 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.302 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.302 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.302 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.302 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.302 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.303 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.303 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.303 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:11.303 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:11.303 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.303 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.303 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.303 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.304 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.304 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.304 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.304 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.304 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.304 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.304 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.305 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.305 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.305 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.305 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:11.305 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "pg_autoscaler", 2024-08-19T00:24:11.305 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:11.305 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:11.305 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:11.305 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:11.306 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:11.306 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.306 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.306 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.306 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.306 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.306 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.307 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.307 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.307 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.307 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.307 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.307 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.307 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.307 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.307 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.308 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.308 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.308 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.308 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.308 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:11.308 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:11.308 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.309 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.309 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.309 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.309 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.309 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.309 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.309 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.309 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.310 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.310 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.310 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.310 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:11.310 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:11.310 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.310 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.310 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.311 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:11.311 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.311 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.311 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.311 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.311 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.311 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.314 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.314 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.314 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.314 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.314 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.314 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.315 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.315 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.315 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.315 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:11.315 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:11.315 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.315 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.315 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.316 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.316 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.316 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.316 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.316 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.316 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.316 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.316 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.317 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.317 INFO:teuthology.orchestra.run.smithi044.stdout: "sleep_interval": { 2024-08-19T00:24:11.317 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "sleep_interval", 2024-08-19T00:24:11.317 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", 2024-08-19T00:24:11.317 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.317 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.317 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "60", 2024-08-19T00:24:11.317 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.318 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.318 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.318 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.318 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.318 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.318 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.318 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.318 INFO:teuthology.orchestra.run.smithi044.stdout: "threshold": { 2024-08-19T00:24:11.319 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "threshold", 2024-08-19T00:24:11.319 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "float", 2024-08-19T00:24:11.319 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.319 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.319 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "3.0", 2024-08-19T00:24:11.319 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "1.0", 2024-08-19T00:24:11.319 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.319 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.320 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "scaling threshold", 2024-08-19T00:24:11.320 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-08-19T00:24:11.320 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.320 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.320 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.320 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.320 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.320 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:11.321 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "progress", 2024-08-19T00:24:11.321 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:11.321 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:11.321 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:11.321 INFO:teuthology.orchestra.run.smithi044.stdout: "allow_pg_recovery_event": { 2024-08-19T00:24:11.321 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "allow_pg_recovery_event", 2024-08-19T00:24:11.321 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.321 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.322 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.322 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.322 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.322 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.322 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.322 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "allow the module to show pg recovery progress", 2024-08-19T00:24:11.322 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.322 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.323 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.323 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.323 INFO:teuthology.orchestra.run.smithi044.stdout: "enabled": { 2024-08-19T00:24:11.323 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "enabled", 2024-08-19T00:24:11.323 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.323 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.323 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.323 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:11.324 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.324 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.324 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.324 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.324 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.324 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.324 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.324 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.325 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:11.325 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:11.325 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.325 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.325 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.325 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.325 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.325 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.325 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.326 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.326 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.326 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.326 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.326 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.326 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.326 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.326 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.327 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.327 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.327 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.327 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.327 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:11.327 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:11.327 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.327 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.328 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.328 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.328 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.328 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.328 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.328 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.328 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.328 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.329 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.329 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.329 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:11.329 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:11.329 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.329 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.329 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.329 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:11.329 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.330 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.330 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.330 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.330 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.330 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.330 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.330 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.330 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.331 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.331 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.331 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.331 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.331 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.331 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.331 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:11.331 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:11.332 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.332 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.332 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.332 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.332 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.332 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.332 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.332 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.332 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.333 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.333 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.333 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.333 INFO:teuthology.orchestra.run.smithi044.stdout: "max_completed_events": { 2024-08-19T00:24:11.333 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "max_completed_events", 2024-08-19T00:24:11.333 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:11.333 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.333 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.334 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "50", 2024-08-19T00:24:11.334 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.334 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.334 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.334 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "number of past completed events to remember", 2024-08-19T00:24:11.334 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.334 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.334 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.335 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.335 INFO:teuthology.orchestra.run.smithi044.stdout: "sleep_interval": { 2024-08-19T00:24:11.335 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "sleep_interval", 2024-08-19T00:24:11.335 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", 2024-08-19T00:24:11.335 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.335 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.335 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "5", 2024-08-19T00:24:11.335 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.336 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.336 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.336 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "how long the module is going to sleep", 2024-08-19T00:24:11.336 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.336 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.336 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.336 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.336 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.337 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.337 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:11.337 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "prometheus", 2024-08-19T00:24:11.337 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:11.337 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:11.337 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:11.337 INFO:teuthology.orchestra.run.smithi044.stdout: "cache": { 2024-08-19T00:24:11.337 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "cache", 2024-08-19T00:24:11.338 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.338 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.338 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.338 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:11.338 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.338 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.338 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.339 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.339 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.339 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.339 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.339 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.339 INFO:teuthology.orchestra.run.smithi044.stdout: "exclude_perf_counters": { 2024-08-19T00:24:11.339 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "exclude_perf_counters", 2024-08-19T00:24:11.339 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.339 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.340 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.340 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:11.340 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.340 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.340 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.340 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-08-19T00:24:11.340 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-08-19T00:24:11.340 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.341 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.341 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.341 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:11.341 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:11.341 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.341 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.341 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.341 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.341 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.342 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.342 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.342 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.342 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.342 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.342 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.342 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.342 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.343 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.343 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.343 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.343 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.343 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.344 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.344 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:11.344 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:11.344 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.344 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.344 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.344 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.344 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.345 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.345 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.345 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.345 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.345 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.345 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.345 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.345 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:11.346 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:11.346 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.346 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.346 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.346 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:11.346 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.346 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.346 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.347 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.347 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.347 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.347 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.347 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.347 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.347 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.347 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.347 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.348 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.348 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.348 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.348 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:11.348 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:11.348 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.348 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.348 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.349 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.349 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.349 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.349 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.349 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.349 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.349 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.350 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.350 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.350 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_stats_pools": { 2024-08-19T00:24:11.350 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "rbd_stats_pools", 2024-08-19T00:24:11.350 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.350 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.350 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.351 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.351 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.351 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.351 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.351 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.351 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.351 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.352 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.352 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.352 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_stats_pools_refresh_interval": { 2024-08-19T00:24:11.352 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-08-19T00:24:11.352 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:11.352 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.352 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.352 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "300", 2024-08-19T00:24:11.353 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.353 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.353 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.353 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.353 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.353 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.353 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.353 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.354 INFO:teuthology.orchestra.run.smithi044.stdout: "scrape_interval": { 2024-08-19T00:24:11.354 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "scrape_interval", 2024-08-19T00:24:11.354 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "float", 2024-08-19T00:24:11.354 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.354 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.354 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "15.0", 2024-08-19T00:24:11.354 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.355 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.355 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.355 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.355 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.355 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.355 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.355 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.355 INFO:teuthology.orchestra.run.smithi044.stdout: "server_addr": { 2024-08-19T00:24:11.356 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "server_addr", 2024-08-19T00:24:11.356 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.356 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.356 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.356 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "::", 2024-08-19T00:24:11.356 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.356 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.356 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.357 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-08-19T00:24:11.357 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.357 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.357 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.357 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.357 INFO:teuthology.orchestra.run.smithi044.stdout: "server_port": { 2024-08-19T00:24:11.357 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "server_port", 2024-08-19T00:24:11.357 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:11.358 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.358 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.358 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "9283", 2024-08-19T00:24:11.358 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.358 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.358 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.358 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-08-19T00:24:11.358 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.359 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.359 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.359 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.359 INFO:teuthology.orchestra.run.smithi044.stdout: "stale_cache_strategy": { 2024-08-19T00:24:11.359 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "stale_cache_strategy", 2024-08-19T00:24:11.359 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.359 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.360 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.360 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "log", 2024-08-19T00:24:11.360 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.360 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.360 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.360 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.360 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.360 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.361 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.361 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.361 INFO:teuthology.orchestra.run.smithi044.stdout: "standby_behaviour": { 2024-08-19T00:24:11.361 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "standby_behaviour", 2024-08-19T00:24:11.361 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.361 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.361 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.362 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "default", 2024-08-19T00:24:11.362 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.362 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.362 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.362 INFO:teuthology.orchestra.run.smithi044.stdout: "default", 2024-08-19T00:24:11.362 INFO:teuthology.orchestra.run.smithi044.stdout: "error" 2024-08-19T00:24:11.362 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.362 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.363 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.363 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.363 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.363 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.363 INFO:teuthology.orchestra.run.smithi044.stdout: "standby_error_status_code": { 2024-08-19T00:24:11.363 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "standby_error_status_code", 2024-08-19T00:24:11.363 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:11.363 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.364 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.364 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "500", 2024-08-19T00:24:11.364 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "400", 2024-08-19T00:24:11.364 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "599", 2024-08-19T00:24:11.364 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.364 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.364 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.364 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.365 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.365 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.365 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.365 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.365 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:11.365 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "rbd_support", 2024-08-19T00:24:11.365 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:11.365 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:11.366 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:11.366 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:11.366 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:11.366 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.366 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.366 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.366 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.366 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.367 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.367 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.367 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.367 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.367 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.367 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.367 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.367 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.368 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.368 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.368 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.368 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.368 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.368 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.368 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:11.368 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:11.369 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.369 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.369 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.369 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.369 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.369 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.369 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.369 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.370 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.370 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.370 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.370 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.370 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:11.370 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:11.370 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.370 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.371 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.371 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:11.371 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.371 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.371 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.371 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.371 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.371 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.371 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.372 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.372 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.372 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.372 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.372 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.372 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.372 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.372 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.373 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:11.373 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:11.373 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.373 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.373 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.373 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.373 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.373 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.373 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.374 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.374 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.374 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.374 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.374 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.374 INFO:teuthology.orchestra.run.smithi044.stdout: "max_concurrent_snap_create": { 2024-08-19T00:24:11.374 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "max_concurrent_snap_create", 2024-08-19T00:24:11.375 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:11.375 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.375 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.375 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "10", 2024-08-19T00:24:11.375 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.375 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.375 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.375 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.375 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.376 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.376 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.376 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.376 INFO:teuthology.orchestra.run.smithi044.stdout: "mirror_snapshot_schedule": { 2024-08-19T00:24:11.376 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "mirror_snapshot_schedule", 2024-08-19T00:24:11.376 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.376 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.376 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.377 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.377 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.377 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.377 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.377 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.377 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.377 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.377 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.378 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.378 INFO:teuthology.orchestra.run.smithi044.stdout: "trash_purge_schedule": { 2024-08-19T00:24:11.378 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "trash_purge_schedule", 2024-08-19T00:24:11.378 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.378 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.378 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.378 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.379 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.379 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.379 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.379 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.379 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.379 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.379 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.379 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.380 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.380 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.380 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:11.380 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "restful", 2024-08-19T00:24:11.380 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:11.380 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:11.380 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:11.380 INFO:teuthology.orchestra.run.smithi044.stdout: "enable_auth": { 2024-08-19T00:24:11.381 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "enable_auth", 2024-08-19T00:24:11.381 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.381 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.381 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.381 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:11.381 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.381 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.381 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.381 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.382 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.382 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.382 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.382 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.382 INFO:teuthology.orchestra.run.smithi044.stdout: "key_file": { 2024-08-19T00:24:11.382 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "key_file", 2024-08-19T00:24:11.382 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.382 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.383 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.383 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.383 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.383 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.383 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.383 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.383 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.383 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.383 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.384 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.384 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:11.384 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:11.384 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.384 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.384 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.384 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.384 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.385 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.385 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.385 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.385 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.385 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.385 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.385 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.385 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.386 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.386 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.386 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.386 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.386 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.386 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.386 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:11.386 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:11.387 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.387 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.387 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.387 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.387 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.387 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.387 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.387 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.388 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.388 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.388 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.388 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.388 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:11.388 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:11.388 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.389 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.389 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.389 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:11.389 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.389 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.389 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.389 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.389 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.390 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.390 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.390 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.390 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.390 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.390 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.390 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.390 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.391 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.391 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.391 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:11.391 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:11.391 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.391 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.391 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.391 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.392 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.392 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.392 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.392 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.392 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.392 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.392 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.393 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.393 INFO:teuthology.orchestra.run.smithi044.stdout: "server_addr": { 2024-08-19T00:24:11.393 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "server_addr", 2024-08-19T00:24:11.393 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.393 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.393 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.393 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.393 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.394 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.394 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.394 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.394 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.394 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.394 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.394 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.394 INFO:teuthology.orchestra.run.smithi044.stdout: "server_port": { 2024-08-19T00:24:11.395 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "server_port", 2024-08-19T00:24:11.395 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.395 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.395 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.395 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.395 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.395 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.396 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.396 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.396 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.396 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.396 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.396 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.396 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.396 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.396 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:11.397 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "rgw", 2024-08-19T00:24:11.397 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:11.397 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:11.397 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:11.397 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:11.397 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:11.397 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.397 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.398 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.398 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.398 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.398 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.398 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.398 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.398 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.398 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.399 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.399 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.399 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.399 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.399 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.399 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.400 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.400 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.400 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.400 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:11.400 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:11.400 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.400 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.400 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.401 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.401 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.401 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.401 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.401 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.401 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.401 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.401 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.402 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.402 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:11.402 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:11.402 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.402 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.402 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.402 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:11.402 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.403 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.403 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.403 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.403 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.403 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.403 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.403 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.403 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.404 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.404 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.404 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.404 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.404 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.404 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.404 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:11.404 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:11.405 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.405 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.405 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.405 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.405 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.405 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.405 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.405 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.405 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.406 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.406 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.406 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.406 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.406 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.406 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:11.406 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "rook", 2024-08-19T00:24:11.407 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:11.407 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:11.407 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:11.407 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:11.407 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:11.407 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.407 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.407 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.408 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.408 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.408 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.408 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.408 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.408 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.408 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.408 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.409 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.409 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.409 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.409 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.409 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.409 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.409 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.409 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.410 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:11.410 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:11.410 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.410 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.410 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.410 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.410 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.411 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.411 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.411 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.411 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.411 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.411 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.411 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.411 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:11.412 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:11.412 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.412 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.412 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.412 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:11.412 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.412 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.413 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.413 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.413 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.413 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.413 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.413 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.413 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.413 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.413 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.414 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.414 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.414 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.414 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.414 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:11.414 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:11.414 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.415 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.415 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.415 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.415 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.415 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.415 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.415 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.415 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.416 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.416 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.416 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.416 INFO:teuthology.orchestra.run.smithi044.stdout: "storage_class": { 2024-08-19T00:24:11.416 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "storage_class", 2024-08-19T00:24:11.416 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.416 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.416 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.417 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "local", 2024-08-19T00:24:11.417 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.417 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.417 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.417 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-08-19T00:24:11.417 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.417 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.418 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.418 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.418 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.418 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.418 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:11.418 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "selftest", 2024-08-19T00:24:11.418 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:11.419 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:11.419 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:11.419 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:11.419 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:11.419 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.419 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.419 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.420 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.420 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.420 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.420 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.420 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.420 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.420 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.421 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.421 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.421 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.421 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.421 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.421 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.421 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.421 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.422 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.422 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:11.422 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:11.422 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.422 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.422 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.422 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.423 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.423 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.423 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.423 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.423 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.423 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.423 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.423 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.424 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:11.424 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:11.424 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.424 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.424 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.424 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:11.424 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.424 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.425 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.425 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.425 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.425 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.425 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.425 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.425 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.425 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.426 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.426 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.426 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.426 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.426 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.426 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:11.426 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:11.427 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.427 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.427 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.427 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.427 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.427 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.427 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.427 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.428 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.428 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.428 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.428 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.428 INFO:teuthology.orchestra.run.smithi044.stdout: "roption1": { 2024-08-19T00:24:11.428 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "roption1", 2024-08-19T00:24:11.428 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.428 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.428 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.429 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.429 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.429 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.429 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.429 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.429 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.429 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.429 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.430 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.430 INFO:teuthology.orchestra.run.smithi044.stdout: "roption2": { 2024-08-19T00:24:11.430 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "roption2", 2024-08-19T00:24:11.430 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.430 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.430 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.430 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "xyz", 2024-08-19T00:24:11.430 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.431 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.431 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.431 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.431 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.431 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.431 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.431 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.431 INFO:teuthology.orchestra.run.smithi044.stdout: "rwoption1": { 2024-08-19T00:24:11.432 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "rwoption1", 2024-08-19T00:24:11.432 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.432 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.432 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.432 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.432 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.432 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.432 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.432 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.433 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.433 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.433 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.433 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.433 INFO:teuthology.orchestra.run.smithi044.stdout: "rwoption2": { 2024-08-19T00:24:11.433 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "rwoption2", 2024-08-19T00:24:11.433 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:11.433 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.434 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.434 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.434 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.434 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.434 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.434 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.434 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.434 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.435 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.435 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.435 INFO:teuthology.orchestra.run.smithi044.stdout: "rwoption3": { 2024-08-19T00:24:11.435 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "rwoption3", 2024-08-19T00:24:11.435 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "float", 2024-08-19T00:24:11.435 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.435 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.435 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.436 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.436 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.436 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.436 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.436 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.436 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.436 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.437 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.437 INFO:teuthology.orchestra.run.smithi044.stdout: "rwoption4": { 2024-08-19T00:24:11.437 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "rwoption4", 2024-08-19T00:24:11.437 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.437 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.437 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.437 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.438 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.438 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.438 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.438 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.438 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.438 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.438 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.438 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.439 INFO:teuthology.orchestra.run.smithi044.stdout: "rwoption5": { 2024-08-19T00:24:11.439 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "rwoption5", 2024-08-19T00:24:11.439 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.439 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.439 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.439 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.439 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.439 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.440 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.440 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.440 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.440 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.440 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.440 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.440 INFO:teuthology.orchestra.run.smithi044.stdout: "rwoption6": { 2024-08-19T00:24:11.440 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "rwoption6", 2024-08-19T00:24:11.440 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.441 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.441 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.441 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:11.441 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.441 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.441 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.441 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.442 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.442 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.442 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.442 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.442 INFO:teuthology.orchestra.run.smithi044.stdout: "rwoption7": { 2024-08-19T00:24:11.442 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "rwoption7", 2024-08-19T00:24:11.442 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:11.442 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.443 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.443 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.443 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "1", 2024-08-19T00:24:11.443 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "42", 2024-08-19T00:24:11.443 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.443 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.443 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.443 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.443 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.444 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.444 INFO:teuthology.orchestra.run.smithi044.stdout: "testkey": { 2024-08-19T00:24:11.444 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "testkey", 2024-08-19T00:24:11.444 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.444 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.444 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.444 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.444 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.445 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.445 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.445 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.445 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.445 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.445 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.445 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.445 INFO:teuthology.orchestra.run.smithi044.stdout: "testlkey": { 2024-08-19T00:24:11.446 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "testlkey", 2024-08-19T00:24:11.446 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.446 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.446 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.446 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.446 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.446 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.446 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.447 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.447 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.447 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.447 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.447 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.447 INFO:teuthology.orchestra.run.smithi044.stdout: "testnewline": { 2024-08-19T00:24:11.447 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "testnewline", 2024-08-19T00:24:11.448 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.448 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.448 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.448 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.448 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.448 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.448 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.448 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.449 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.449 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.449 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.449 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.449 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.449 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.449 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:11.449 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "snap_schedule", 2024-08-19T00:24:11.450 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:11.450 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:11.450 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:11.450 INFO:teuthology.orchestra.run.smithi044.stdout: "allow_m_granularity": { 2024-08-19T00:24:11.450 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "allow_m_granularity", 2024-08-19T00:24:11.450 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.450 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.451 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.451 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.451 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.451 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.451 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.451 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "allow minute scheduled snapshots", 2024-08-19T00:24:11.451 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.451 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.452 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.452 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.452 INFO:teuthology.orchestra.run.smithi044.stdout: "dump_on_update": { 2024-08-19T00:24:11.452 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "dump_on_update", 2024-08-19T00:24:11.452 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.452 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.452 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.452 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.453 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.453 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.453 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.453 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "dump database to debug log on update", 2024-08-19T00:24:11.453 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.453 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.453 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.454 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.454 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:11.454 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:11.454 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.454 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.454 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.454 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.454 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.455 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.455 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.455 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.455 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.455 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.455 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.455 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.455 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.456 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.456 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.456 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.456 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.456 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.456 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.456 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:11.456 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:11.456 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.457 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.457 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.457 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.457 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.457 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.457 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.457 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.458 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.458 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.458 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.458 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.458 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:11.458 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:11.458 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.458 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.459 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.459 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:11.459 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.459 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.459 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.459 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.459 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.459 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.459 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.460 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.460 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.460 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.460 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.460 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.460 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.460 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.461 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.461 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:11.461 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:11.461 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.461 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.461 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.461 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.461 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.462 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.462 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.462 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.462 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.462 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.462 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.462 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.462 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.463 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.463 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:11.463 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "stats", 2024-08-19T00:24:11.463 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:11.463 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:11.463 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:11.463 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:11.463 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:11.464 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.464 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.464 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.464 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.464 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.464 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.465 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.465 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.465 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.465 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.465 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.465 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.465 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.465 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.466 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.466 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.466 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.466 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.466 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.466 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:11.466 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:11.466 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.467 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.467 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.467 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.467 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.467 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.467 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.467 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.467 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.468 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.468 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.468 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.468 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:11.468 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:11.468 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.468 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.468 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.469 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:11.469 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.469 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.469 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.469 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.469 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.469 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.469 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.470 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.470 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.470 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.470 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.470 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.470 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.470 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.470 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.471 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:11.471 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:11.471 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.471 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.471 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.471 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.471 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.471 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.472 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.472 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.472 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.472 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.472 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.472 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.472 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.472 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.472 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:11.473 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "status", 2024-08-19T00:24:11.473 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:11.473 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:11.473 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:11.473 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:11.473 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:11.473 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.474 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.474 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.474 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.474 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.474 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.474 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.474 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.474 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.475 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.475 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.475 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.475 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.475 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.475 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.475 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.475 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.476 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.476 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.476 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:11.476 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:11.476 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.476 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.476 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.476 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.477 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.477 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.477 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.477 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.477 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.477 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.477 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.477 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.478 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:11.478 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:11.478 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.478 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.478 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.478 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:11.478 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.478 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.479 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.479 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.479 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.479 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.479 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.479 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.479 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.480 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.480 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.480 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.480 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.480 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.480 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.480 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:11.480 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:11.481 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.481 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.481 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.481 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.481 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.481 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.481 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.481 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.482 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.482 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.482 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.482 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.482 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.482 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.482 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:11.483 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "telegraf", 2024-08-19T00:24:11.483 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:11.483 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:11.483 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:11.483 INFO:teuthology.orchestra.run.smithi044.stdout: "address": { 2024-08-19T00:24:11.483 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "address", 2024-08-19T00:24:11.483 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.483 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.484 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.484 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-08-19T00:24:11.484 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.484 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.484 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.484 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.484 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.485 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.485 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.485 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.485 INFO:teuthology.orchestra.run.smithi044.stdout: "interval": { 2024-08-19T00:24:11.485 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "interval", 2024-08-19T00:24:11.485 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", 2024-08-19T00:24:11.485 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.485 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.486 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "15", 2024-08-19T00:24:11.486 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.486 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.486 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.486 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.486 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.486 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.486 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.487 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.487 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:11.487 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:11.487 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.487 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.487 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.487 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.487 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.488 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.488 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.488 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.488 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.488 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.488 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.488 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.488 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.489 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.489 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.489 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.489 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.489 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.489 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.489 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:11.489 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:11.490 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.490 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.490 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.490 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.490 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.490 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.490 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.490 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.491 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.491 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.491 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.491 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.491 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:11.491 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:11.491 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.492 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.492 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.492 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:11.492 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.492 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.492 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.492 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.492 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.493 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.493 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.493 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.493 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.493 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.493 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.493 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.494 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.494 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.494 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.494 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:11.494 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:11.494 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.494 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.495 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.495 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.495 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.495 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.495 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.495 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.495 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.496 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.496 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.496 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.496 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.496 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.496 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:11.496 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "telemetry", 2024-08-19T00:24:11.497 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:11.497 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:11.497 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:11.497 INFO:teuthology.orchestra.run.smithi044.stdout: "channel_basic": { 2024-08-19T00:24:11.497 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "channel_basic", 2024-08-19T00:24:11.497 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.497 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.497 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.498 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:11.498 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.498 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.498 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.498 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Share basic cluster information (size, version)", 2024-08-19T00:24:11.498 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.498 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.499 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.499 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.499 INFO:teuthology.orchestra.run.smithi044.stdout: "channel_crash": { 2024-08-19T00:24:11.499 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "channel_crash", 2024-08-19T00:24:11.499 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.499 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.499 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.499 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:11.500 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.500 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.500 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.500 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-08-19T00:24:11.500 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.500 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.500 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.500 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.501 INFO:teuthology.orchestra.run.smithi044.stdout: "channel_device": { 2024-08-19T00:24:11.501 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "channel_device", 2024-08-19T00:24:11.501 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.501 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.501 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.501 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:11.501 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.501 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.502 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.502 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-08-19T00:24:11.502 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.502 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.502 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.502 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.502 INFO:teuthology.orchestra.run.smithi044.stdout: "channel_ident": { 2024-08-19T00:24:11.503 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "channel_ident", 2024-08-19T00:24:11.503 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.503 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.503 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.503 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.503 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.503 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.503 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.504 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-08-19T00:24:11.504 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.504 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.504 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.504 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.504 INFO:teuthology.orchestra.run.smithi044.stdout: "channel_perf": { 2024-08-19T00:24:11.504 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "channel_perf", 2024-08-19T00:24:11.504 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.505 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.505 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.505 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.505 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.505 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.505 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.505 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Share various performance metrics of a cluster", 2024-08-19T00:24:11.505 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.506 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.506 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.506 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.506 INFO:teuthology.orchestra.run.smithi044.stdout: "contact": { 2024-08-19T00:24:11.506 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "contact", 2024-08-19T00:24:11.506 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.506 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.507 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.507 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.507 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.507 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.507 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.507 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.507 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.507 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.508 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.508 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.508 INFO:teuthology.orchestra.run.smithi044.stdout: "description": { 2024-08-19T00:24:11.508 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "description", 2024-08-19T00:24:11.508 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.508 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.508 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.508 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.508 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.509 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.509 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.509 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.509 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.509 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.509 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.509 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.510 INFO:teuthology.orchestra.run.smithi044.stdout: "device_url": { 2024-08-19T00:24:11.510 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "device_url", 2024-08-19T00:24:11.510 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.510 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.510 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.510 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-08-19T00:24:11.510 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.511 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.511 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.511 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.511 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.511 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.511 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.511 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.511 INFO:teuthology.orchestra.run.smithi044.stdout: "enabled": { 2024-08-19T00:24:11.512 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "enabled", 2024-08-19T00:24:11.512 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.512 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.512 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.512 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.512 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.512 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.512 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.513 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.513 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.513 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.513 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.513 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.513 INFO:teuthology.orchestra.run.smithi044.stdout: "interval": { 2024-08-19T00:24:11.513 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "interval", 2024-08-19T00:24:11.513 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:11.514 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.514 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.514 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "24", 2024-08-19T00:24:11.514 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "8", 2024-08-19T00:24:11.514 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.514 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.514 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.514 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.515 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.515 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.515 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.515 INFO:teuthology.orchestra.run.smithi044.stdout: "last_opt_revision": { 2024-08-19T00:24:11.515 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "last_opt_revision", 2024-08-19T00:24:11.515 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:11.515 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.516 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.516 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "1", 2024-08-19T00:24:11.516 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.516 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.516 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.516 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.516 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.516 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.517 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.517 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.517 INFO:teuthology.orchestra.run.smithi044.stdout: "leaderboard": { 2024-08-19T00:24:11.517 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "leaderboard", 2024-08-19T00:24:11.517 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.517 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.518 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.518 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.518 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.518 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.518 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.518 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.518 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.519 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.519 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.519 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.519 INFO:teuthology.orchestra.run.smithi044.stdout: "leaderboard_description": { 2024-08-19T00:24:11.519 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "leaderboard_description", 2024-08-19T00:24:11.519 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.520 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.520 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.520 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.520 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.520 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.520 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.520 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.520 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.521 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.521 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.521 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.521 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:11.521 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:11.521 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.521 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.521 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.522 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.522 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.522 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.522 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.522 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.522 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.522 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.523 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.523 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.523 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.523 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.523 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.523 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.523 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.523 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.524 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.524 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:11.524 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:11.524 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.524 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.524 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.524 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.524 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.525 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.525 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.525 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.525 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.525 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.525 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.525 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.525 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:11.526 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:11.526 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.526 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.526 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.526 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:11.527 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.527 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.527 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.527 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.527 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.527 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.527 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.528 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.528 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.528 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.528 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.528 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.528 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.528 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.528 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.529 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:11.529 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:11.529 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.529 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.529 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.529 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.529 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.529 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.530 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.530 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.530 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.530 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.530 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.530 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.530 INFO:teuthology.orchestra.run.smithi044.stdout: "organization": { 2024-08-19T00:24:11.531 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "organization", 2024-08-19T00:24:11.531 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.531 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.531 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.531 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.531 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.531 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.531 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.532 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.532 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.532 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.532 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.532 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.532 INFO:teuthology.orchestra.run.smithi044.stdout: "proxy": { 2024-08-19T00:24:11.532 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "proxy", 2024-08-19T00:24:11.532 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.533 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.533 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.533 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.533 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.533 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.533 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.533 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.533 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.534 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.534 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.534 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.534 INFO:teuthology.orchestra.run.smithi044.stdout: "url": { 2024-08-19T00:24:11.534 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "url", 2024-08-19T00:24:11.534 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.534 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.535 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.535 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-08-19T00:24:11.535 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.535 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.535 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.535 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.535 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.995+0000 7fbf102df640 1 -- 172.21.15.44:0/3717619637 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fbef40a2d00 msgr2=0x7fbef40a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:11.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.995+0000 7fbf102df640 1 --2- 172.21.15.44:0/3717619637 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fbef40a2d00 0x7fbef40a51c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbf04005fd0 tx=0x7fbf0400b390 comp rx=0 tx=0).stop 2024-08-19T00:24:11.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.995+0000 7fbf102df640 1 -- 172.21.15.44:0/3717619637 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf0810beb0 msgr2=0x7fbf0819ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:11.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.995+0000 7fbf102df640 1 --2- 172.21.15.44:0/3717619637 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf0810beb0 0x7fbf0819ca60 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fbf00031a20 tx=0x7fbf00031a50 comp rx=0 tx=0).stop 2024-08-19T00:24:11.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.995+0000 7fbf102df640 1 -- 172.21.15.44:0/3717619637 shutdown_connections 2024-08-19T00:24:11.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.995+0000 7fbf102df640 1 --2- 172.21.15.44:0/3717619637 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fbef40a2d00 0x7fbef40a51c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:11.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.995+0000 7fbf102df640 1 --2- 172.21.15.44:0/3717619637 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf0810beb0 0x7fbf0819ca60 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:11.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.995+0000 7fbf102df640 1 --2- 172.21.15.44:0/3717619637 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbf08103360 0x7fbf081986e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:11.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.995+0000 7fbf102df640 1 --2- 172.21.15.44:0/3717619637 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbf08102a40 0x7fbf081981a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:11.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.995+0000 7fbf102df640 1 -- 172.21.15.44:0/3717619637 >> 172.21.15.44:0/3717619637 conn(0x7fbf080fc490 msgr2=0x7fbf080fdb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:24:11.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.995+0000 7fbf102df640 1 -- 172.21.15.44:0/3717619637 shutdown_connections 2024-08-19T00:24:11.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:09.995+0000 7fbf102df640 1 -- 172.21.15.44:0/3717619637 wait complete. 2024-08-19T00:24:11.540 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.541 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.541 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.541 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.541 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.541 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:11.541 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "test_orchestrator", 2024-08-19T00:24:11.541 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:11.541 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:11.542 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:11.542 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:11.542 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:11.542 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.542 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.542 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.542 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.542 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.543 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.543 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.543 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.543 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.543 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.543 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.543 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.543 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.544 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.544 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.544 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.544 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.544 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.544 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.544 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:11.544 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:11.545 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.545 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.545 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.545 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.545 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.545 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.545 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.545 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.545 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.546 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.546 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.546 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.546 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:11.546 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:11.546 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.546 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.546 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.547 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:11.547 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.547 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.547 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.547 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.547 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.547 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.547 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.548 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.548 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.548 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.548 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.548 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.548 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.548 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.548 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.549 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:11.549 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:11.549 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.549 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.549 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.549 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.549 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.549 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.550 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.550 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.550 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.550 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.550 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.550 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.550 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.550 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.551 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:11.551 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "volumes", 2024-08-19T00:24:11.551 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:11.551 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:11.551 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:11.551 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:11.551 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:11.551 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.552 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.552 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.552 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.552 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.552 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.552 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.552 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.553 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.553 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.553 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.553 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.553 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.553 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.553 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.553 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.554 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.554 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.554 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.554 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:11.554 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:11.554 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.554 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.554 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.555 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.555 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.555 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.555 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.555 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.555 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.555 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.555 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.556 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.556 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:11.556 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:11.556 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.556 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.556 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.556 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:11.556 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.557 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.557 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.557 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.557 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.557 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.557 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.557 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.557 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.557 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.558 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.558 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.558 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.558 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.558 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.558 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:11.558 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:11.559 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.559 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.559 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.559 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.559 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.559 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.559 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.559 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.560 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.560 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.560 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.560 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.560 INFO:teuthology.orchestra.run.smithi044.stdout: "max_concurrent_clones": { 2024-08-19T00:24:11.560 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "max_concurrent_clones", 2024-08-19T00:24:11.560 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:11.560 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.561 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.561 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "4", 2024-08-19T00:24:11.561 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.561 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.561 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.561 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Number of asynchronous cloner threads", 2024-08-19T00:24:11.561 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.562 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.562 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.562 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.562 INFO:teuthology.orchestra.run.smithi044.stdout: "periodic_async_work": { 2024-08-19T00:24:11.562 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "periodic_async_work", 2024-08-19T00:24:11.562 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.562 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.563 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.563 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.563 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.563 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.563 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.563 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Periodically check for async work", 2024-08-19T00:24:11.563 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.563 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.564 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.564 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.564 INFO:teuthology.orchestra.run.smithi044.stdout: "snapshot_clone_delay": { 2024-08-19T00:24:11.564 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "snapshot_clone_delay", 2024-08-19T00:24:11.564 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:11.564 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.564 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.564 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "0", 2024-08-19T00:24:11.565 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.565 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.565 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.565 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-08-19T00:24:11.565 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.565 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.565 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.566 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.566 INFO:teuthology.orchestra.run.smithi044.stdout: "snapshot_clone_no_wait": { 2024-08-19T00:24:11.566 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "snapshot_clone_no_wait", 2024-08-19T00:24:11.566 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.566 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.566 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.566 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:11.566 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.567 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.567 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.567 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-08-19T00:24:11.567 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.567 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.567 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.567 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.567 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.568 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.568 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:11.568 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "zabbix", 2024-08-19T00:24:11.568 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:11.568 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:11.568 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:11.568 INFO:teuthology.orchestra.run.smithi044.stdout: "discovery_interval": { 2024-08-19T00:24:11.568 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "discovery_interval", 2024-08-19T00:24:11.569 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "uint", 2024-08-19T00:24:11.569 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.569 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.569 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "100", 2024-08-19T00:24:11.569 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.569 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.569 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.569 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.570 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.570 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.570 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.570 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.570 INFO:teuthology.orchestra.run.smithi044.stdout: "identifier": { 2024-08-19T00:24:11.570 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "identifier", 2024-08-19T00:24:11.570 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.570 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.571 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.571 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.571 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.571 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.571 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.571 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.571 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.571 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.572 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.572 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.572 INFO:teuthology.orchestra.run.smithi044.stdout: "interval": { 2024-08-19T00:24:11.572 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "interval", 2024-08-19T00:24:11.572 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", 2024-08-19T00:24:11.572 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.572 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.572 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "60", 2024-08-19T00:24:11.573 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.573 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.573 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.573 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.573 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.573 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.573 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.573 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.574 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:11.574 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:11.574 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.574 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.574 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.574 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.574 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.574 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.575 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.575 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.575 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.575 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.575 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.575 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.575 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.575 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.576 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.576 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.576 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.576 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.576 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.576 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:11.576 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:11.576 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.577 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.577 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.577 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.577 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.577 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.577 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.577 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.577 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.577 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.578 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.578 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.578 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:11.578 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:11.578 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.578 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.578 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.578 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:11.579 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.579 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.579 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.579 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.579 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.579 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.579 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.579 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.580 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.580 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.580 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.580 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.580 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.580 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.580 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.580 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:11.581 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:11.581 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.581 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.581 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.581 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.581 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.581 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.581 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.581 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.582 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.582 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.582 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.582 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.582 INFO:teuthology.orchestra.run.smithi044.stdout: "zabbix_host": { 2024-08-19T00:24:11.582 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "zabbix_host", 2024-08-19T00:24:11.582 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.583 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.583 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.583 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.583 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.583 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.583 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.583 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.583 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.583 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.584 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.584 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.584 INFO:teuthology.orchestra.run.smithi044.stdout: "zabbix_port": { 2024-08-19T00:24:11.584 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "zabbix_port", 2024-08-19T00:24:11.584 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:11.584 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.584 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.584 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "10051", 2024-08-19T00:24:11.585 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.585 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.585 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.585 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.585 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.585 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.585 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.585 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.586 INFO:teuthology.orchestra.run.smithi044.stdout: "zabbix_sender": { 2024-08-19T00:24:11.586 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "zabbix_sender", 2024-08-19T00:24:11.586 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.586 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.586 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.586 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-08-19T00:24:11.586 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.587 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.587 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.587 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.587 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.587 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.587 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.587 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.587 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.588 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.588 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-08-19T00:24:11.588 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.588 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.588 INFO:teuthology.orchestra.run.smithi044.stdout: "modules": [ 2024-08-19T00:24:11.588 INFO:teuthology.orchestra.run.smithi044.stdout: "cephadm", 2024-08-19T00:24:11.588 INFO:teuthology.orchestra.run.smithi044.stdout: "dashboard", 2024-08-19T00:24:11.588 INFO:teuthology.orchestra.run.smithi044.stdout: "iostat", 2024-08-19T00:24:11.589 INFO:teuthology.orchestra.run.smithi044.stdout: "nfs", 2024-08-19T00:24:11.589 INFO:teuthology.orchestra.run.smithi044.stdout: "restful", 2024-08-19T00:24:11.589 INFO:teuthology.orchestra.run.smithi044.stdout: "snap_schedule" 2024-08-19T00:24:11.589 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.589 INFO:teuthology.orchestra.run.smithi044.stdout: "available_modules": [ 2024-08-19T00:24:11.589 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:11.589 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "alerts", 2024-08-19T00:24:11.589 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:11.590 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:11.590 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:11.590 INFO:teuthology.orchestra.run.smithi044.stdout: "interval": { 2024-08-19T00:24:11.590 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "interval", 2024-08-19T00:24:11.590 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", 2024-08-19T00:24:11.590 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.591 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.591 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "60", 2024-08-19T00:24:11.591 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.591 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.591 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.591 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "How frequently to reexamine health status", 2024-08-19T00:24:11.591 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.592 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.592 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.592 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.592 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:11.592 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:11.592 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.592 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.592 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.593 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.593 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.593 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.593 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.593 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.593 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.593 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.594 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.594 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.594 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.594 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.594 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.594 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.594 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.595 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.595 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.595 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:11.595 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:11.595 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.595 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.595 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.595 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.596 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.596 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.596 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.596 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.596 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.596 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.596 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.597 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.597 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:11.597 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:11.597 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.597 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.597 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.597 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:11.598 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.598 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.598 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.598 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.598 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.598 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.598 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.599 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.599 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.599 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.599 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.599 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.599 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.599 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.599 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.600 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:11.600 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:11.600 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.600 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.600 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.600 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.600 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.600 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.601 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.601 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.601 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.601 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.601 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.601 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.601 INFO:teuthology.orchestra.run.smithi044.stdout: "smtp_destination": { 2024-08-19T00:24:11.602 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "smtp_destination", 2024-08-19T00:24:11.602 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.602 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.602 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.602 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.602 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.602 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.603 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.603 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Email address to send alerts to", 2024-08-19T00:24:11.603 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.603 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.603 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.603 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.603 INFO:teuthology.orchestra.run.smithi044.stdout: "smtp_from_name": { 2024-08-19T00:24:11.603 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "smtp_from_name", 2024-08-19T00:24:11.604 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.604 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.604 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.604 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "Ceph", 2024-08-19T00:24:11.604 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.604 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.604 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.605 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Email From: name", 2024-08-19T00:24:11.605 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.605 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.605 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.605 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.605 INFO:teuthology.orchestra.run.smithi044.stdout: "smtp_host": { 2024-08-19T00:24:11.605 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "smtp_host", 2024-08-19T00:24:11.605 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.606 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.606 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.606 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.606 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.606 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.606 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.606 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "SMTP server", 2024-08-19T00:24:11.607 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.607 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.607 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.607 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.607 INFO:teuthology.orchestra.run.smithi044.stdout: "smtp_password": { 2024-08-19T00:24:11.607 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "smtp_password", 2024-08-19T00:24:11.607 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.607 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.608 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.608 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.608 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.608 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.608 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.608 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Password to authenticate with", 2024-08-19T00:24:11.608 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.609 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.609 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.609 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.609 INFO:teuthology.orchestra.run.smithi044.stdout: "smtp_port": { 2024-08-19T00:24:11.609 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "smtp_port", 2024-08-19T00:24:11.609 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:11.609 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.609 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.610 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "465", 2024-08-19T00:24:11.610 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.610 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.610 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.610 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "SMTP port", 2024-08-19T00:24:11.610 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.610 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.611 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.611 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.611 INFO:teuthology.orchestra.run.smithi044.stdout: "smtp_sender": { 2024-08-19T00:24:11.611 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "smtp_sender", 2024-08-19T00:24:11.611 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.611 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.611 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.611 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.612 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.612 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.612 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.612 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "SMTP envelope sender", 2024-08-19T00:24:11.612 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.612 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.612 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.612 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.613 INFO:teuthology.orchestra.run.smithi044.stdout: "smtp_ssl": { 2024-08-19T00:24:11.613 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "smtp_ssl", 2024-08-19T00:24:11.613 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.613 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.613 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.613 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:11.613 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.613 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.614 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.614 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Use SSL to connect to SMTP server", 2024-08-19T00:24:11.614 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.614 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.614 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.614 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.614 INFO:teuthology.orchestra.run.smithi044.stdout: "smtp_user": { 2024-08-19T00:24:11.615 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "smtp_user", 2024-08-19T00:24:11.615 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.615 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.615 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.615 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.615 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.615 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.615 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.616 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "User to authenticate as", 2024-08-19T00:24:11.616 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.616 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.616 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.616 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.616 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.616 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.616 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:11.617 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "balancer", 2024-08-19T00:24:11.617 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:11.617 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:11.617 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:11.617 INFO:teuthology.orchestra.run.smithi044.stdout: "active": { 2024-08-19T00:24:11.617 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "active", 2024-08-19T00:24:11.617 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.618 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.618 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.618 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:11.618 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.618 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.618 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.618 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "automatically balance PGs across cluster", 2024-08-19T00:24:11.618 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.619 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.619 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.619 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.619 INFO:teuthology.orchestra.run.smithi044.stdout: "begin_time": { 2024-08-19T00:24:11.619 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "begin_time", 2024-08-19T00:24:11.619 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.619 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.620 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.620 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "0000", 2024-08-19T00:24:11.620 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.620 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.620 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.620 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "beginning time of day to automatically balance", 2024-08-19T00:24:11.620 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-19T00:24:11.620 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.621 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.621 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.621 INFO:teuthology.orchestra.run.smithi044.stdout: "begin_weekday": { 2024-08-19T00:24:11.621 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "begin_weekday", 2024-08-19T00:24:11.621 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "uint", 2024-08-19T00:24:11.621 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.621 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.621 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "0", 2024-08-19T00:24:11.622 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "0", 2024-08-19T00:24:11.622 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "6", 2024-08-19T00:24:11.622 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.622 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-08-19T00:24:11.622 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-19T00:24:11.622 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.622 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.623 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.623 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_compat_max_iterations": { 2024-08-19T00:24:11.623 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "crush_compat_max_iterations", 2024-08-19T00:24:11.623 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "uint", 2024-08-19T00:24:11.623 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.623 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.623 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "25", 2024-08-19T00:24:11.623 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "1", 2024-08-19T00:24:11.624 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "250", 2024-08-19T00:24:11.624 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.624 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-08-19T00:24:11.624 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.624 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.624 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.624 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.625 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_compat_metrics": { 2024-08-19T00:24:11.625 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "crush_compat_metrics", 2024-08-19T00:24:11.625 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.625 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.625 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.625 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "pgs,objects,bytes", 2024-08-19T00:24:11.625 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.625 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.626 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.626 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-08-19T00:24:11.626 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-08-19T00:24:11.626 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.626 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.626 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.626 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_compat_step": { 2024-08-19T00:24:11.626 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "crush_compat_step", 2024-08-19T00:24:11.627 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "float", 2024-08-19T00:24:11.627 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.627 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.627 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "0.5", 2024-08-19T00:24:11.627 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "0.001", 2024-08-19T00:24:11.627 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "0.999", 2024-08-19T00:24:11.627 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.628 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "aggressiveness of optimization", 2024-08-19T00:24:11.628 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-08-19T00:24:11.628 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.628 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.628 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.628 INFO:teuthology.orchestra.run.smithi044.stdout: "end_time": { 2024-08-19T00:24:11.628 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "end_time", 2024-08-19T00:24:11.628 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.629 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.629 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.629 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "2359", 2024-08-19T00:24:11.629 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.629 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.629 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.629 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "ending time of day to automatically balance", 2024-08-19T00:24:11.629 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-19T00:24:11.630 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.630 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.630 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.630 INFO:teuthology.orchestra.run.smithi044.stdout: "end_weekday": { 2024-08-19T00:24:11.630 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "end_weekday", 2024-08-19T00:24:11.630 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "uint", 2024-08-19T00:24:11.630 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.631 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.631 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "0", 2024-08-19T00:24:11.631 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "0", 2024-08-19T00:24:11.631 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "6", 2024-08-19T00:24:11.631 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.631 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-08-19T00:24:11.631 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-19T00:24:11.631 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.632 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.632 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.632 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:11.632 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:11.632 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.632 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.632 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.633 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.633 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.633 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.633 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.633 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.633 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.633 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.633 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.634 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.634 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.634 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.634 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.634 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.634 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.634 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.634 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.635 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:11.635 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:11.635 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.635 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.635 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.635 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.635 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.636 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.636 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.636 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.636 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.636 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.636 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.636 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.636 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:11.637 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:11.637 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.637 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.637 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.637 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:11.637 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.637 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.637 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.638 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.638 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.638 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.638 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.638 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.638 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.638 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.638 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.639 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.639 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.639 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.639 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.639 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:11.639 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:11.639 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.639 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.640 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.640 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.640 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.640 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.640 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.640 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.640 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.640 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.641 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.641 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.641 INFO:teuthology.orchestra.run.smithi044.stdout: "min_score": { 2024-08-19T00:24:11.641 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "min_score", 2024-08-19T00:24:11.641 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "float", 2024-08-19T00:24:11.641 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.641 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.641 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "0", 2024-08-19T00:24:11.642 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.642 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.642 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.642 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-08-19T00:24:11.642 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.642 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.642 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.643 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.643 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": { 2024-08-19T00:24:11.643 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "mode", 2024-08-19T00:24:11.643 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.643 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.643 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.643 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "upmap", 2024-08-19T00:24:11.643 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.644 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.644 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.644 INFO:teuthology.orchestra.run.smithi044.stdout: "crush-compat", 2024-08-19T00:24:11.644 INFO:teuthology.orchestra.run.smithi044.stdout: "none", 2024-08-19T00:24:11.644 INFO:teuthology.orchestra.run.smithi044.stdout: "read", 2024-08-19T00:24:11.644 INFO:teuthology.orchestra.run.smithi044.stdout: "upmap", 2024-08-19T00:24:11.644 INFO:teuthology.orchestra.run.smithi044.stdout: "upmap-read" 2024-08-19T00:24:11.645 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.645 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Balancer mode", 2024-08-19T00:24:11.645 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.645 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.645 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.645 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.645 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_ids": { 2024-08-19T00:24:11.645 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "pool_ids", 2024-08-19T00:24:11.646 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.646 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.646 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.646 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.646 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.646 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.646 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.646 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-08-19T00:24:11.647 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.647 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.647 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.647 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.647 INFO:teuthology.orchestra.run.smithi044.stdout: "sleep_interval": { 2024-08-19T00:24:11.647 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "sleep_interval", 2024-08-19T00:24:11.647 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", 2024-08-19T00:24:11.647 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.648 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.648 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "60", 2024-08-19T00:24:11.648 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.648 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.648 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.648 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-08-19T00:24:11.648 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.649 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.649 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.649 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.649 INFO:teuthology.orchestra.run.smithi044.stdout: "upmap_max_deviation": { 2024-08-19T00:24:11.649 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "upmap_max_deviation", 2024-08-19T00:24:11.649 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:11.649 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.649 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.650 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "5", 2024-08-19T00:24:11.650 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "1", 2024-08-19T00:24:11.650 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.650 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.650 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "deviation below which no optimization is attempted", 2024-08-19T00:24:11.650 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-08-19T00:24:11.650 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.651 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.651 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.651 INFO:teuthology.orchestra.run.smithi044.stdout: "upmap_max_optimizations": { 2024-08-19T00:24:11.651 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "upmap_max_optimizations", 2024-08-19T00:24:11.651 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "uint", 2024-08-19T00:24:11.651 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.651 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.651 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "10", 2024-08-19T00:24:11.652 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.652 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.652 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.652 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-08-19T00:24:11.652 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.652 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.652 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.653 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.653 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.653 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.653 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:11.653 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "cephadm", 2024-08-19T00:24:11.653 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:11.653 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:11.653 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:11.654 INFO:teuthology.orchestra.run.smithi044.stdout: "agent_down_multiplier": { 2024-08-19T00:24:11.654 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "agent_down_multiplier", 2024-08-19T00:24:11.654 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "float", 2024-08-19T00:24:11.654 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.654 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.654 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "3.0", 2024-08-19T00:24:11.654 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.654 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.655 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.655 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-08-19T00:24:11.655 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.655 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.655 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.655 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.655 INFO:teuthology.orchestra.run.smithi044.stdout: "agent_refresh_rate": { 2024-08-19T00:24:11.656 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "agent_refresh_rate", 2024-08-19T00:24:11.656 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", 2024-08-19T00:24:11.656 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.656 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.656 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "20", 2024-08-19T00:24:11.656 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.656 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.656 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.657 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-08-19T00:24:11.657 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.657 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.657 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.657 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.657 INFO:teuthology.orchestra.run.smithi044.stdout: "agent_starting_port": { 2024-08-19T00:24:11.657 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "agent_starting_port", 2024-08-19T00:24:11.657 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:11.658 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.658 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.658 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "4721", 2024-08-19T00:24:11.658 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.658 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.658 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.658 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-08-19T00:24:11.659 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.659 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.659 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.659 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.659 INFO:teuthology.orchestra.run.smithi044.stdout: "allow_ptrace": { 2024-08-19T00:24:11.659 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "allow_ptrace", 2024-08-19T00:24:11.659 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.659 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.660 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.660 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.660 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.660 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.660 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.660 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-08-19T00:24:11.660 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-08-19T00:24:11.660 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.661 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.661 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.661 INFO:teuthology.orchestra.run.smithi044.stdout: "autotune_interval": { 2024-08-19T00:24:11.661 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "autotune_interval", 2024-08-19T00:24:11.661 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", 2024-08-19T00:24:11.661 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.661 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.661 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "600", 2024-08-19T00:24:11.662 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.662 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.662 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.662 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "how frequently to autotune daemon memory", 2024-08-19T00:24:11.662 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.662 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.662 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.663 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.663 INFO:teuthology.orchestra.run.smithi044.stdout: "autotune_memory_target_ratio": { 2024-08-19T00:24:11.663 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "autotune_memory_target_ratio", 2024-08-19T00:24:11.663 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "float", 2024-08-19T00:24:11.663 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.663 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.663 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "0.7", 2024-08-19T00:24:11.663 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.664 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.664 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.664 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-08-19T00:24:11.664 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.664 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.664 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.664 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.664 INFO:teuthology.orchestra.run.smithi044.stdout: "cephadm_log_destination": { 2024-08-19T00:24:11.665 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "cephadm_log_destination", 2024-08-19T00:24:11.665 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.665 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.665 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.665 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.665 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.665 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.666 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.666 INFO:teuthology.orchestra.run.smithi044.stdout: "file", 2024-08-19T00:24:11.666 INFO:teuthology.orchestra.run.smithi044.stdout: "file,syslog", 2024-08-19T00:24:11.666 INFO:teuthology.orchestra.run.smithi044.stdout: "syslog" 2024-08-19T00:24:11.666 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.666 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-08-19T00:24:11.666 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.666 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.667 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.667 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.667 INFO:teuthology.orchestra.run.smithi044.stdout: "cgroups_split": { 2024-08-19T00:24:11.667 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "cgroups_split", 2024-08-19T00:24:11.667 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.667 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.667 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.668 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:11.668 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.668 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.668 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.668 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-08-19T00:24:11.668 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.668 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.668 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.669 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.669 INFO:teuthology.orchestra.run.smithi044.stdout: "config_checks_enabled": { 2024-08-19T00:24:11.669 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "config_checks_enabled", 2024-08-19T00:24:11.669 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.669 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.669 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.669 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.669 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.670 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.670 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.670 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-08-19T00:24:11.670 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.670 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.670 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.670 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.671 INFO:teuthology.orchestra.run.smithi044.stdout: "config_dashboard": { 2024-08-19T00:24:11.671 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "config_dashboard", 2024-08-19T00:24:11.671 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.671 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.671 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.671 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:11.671 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.671 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.672 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.672 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-08-19T00:24:11.672 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.672 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.672 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.672 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.672 INFO:teuthology.orchestra.run.smithi044.stdout: "container_image_alertmanager": { 2024-08-19T00:24:11.672 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "container_image_alertmanager", 2024-08-19T00:24:11.673 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.673 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.673 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.673 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-08-19T00:24:11.673 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.673 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.673 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.673 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Prometheus container image", 2024-08-19T00:24:11.673 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.674 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.674 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.674 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.674 INFO:teuthology.orchestra.run.smithi044.stdout: "container_image_base": { 2024-08-19T00:24:11.674 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "container_image_base", 2024-08-19T00:24:11.674 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.674 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.674 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.675 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "quay.io/ceph/ceph", 2024-08-19T00:24:11.675 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.675 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.675 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.675 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Container image name, without the tag", 2024-08-19T00:24:11.675 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.675 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.676 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.676 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.676 INFO:teuthology.orchestra.run.smithi044.stdout: "container_image_elasticsearch": { 2024-08-19T00:24:11.676 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "container_image_elasticsearch", 2024-08-19T00:24:11.676 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.676 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.676 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.676 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-08-19T00:24:11.676 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.677 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.677 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.677 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "elasticsearch container image", 2024-08-19T00:24:11.677 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.677 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.677 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.677 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.677 INFO:teuthology.orchestra.run.smithi044.stdout: "container_image_grafana": { 2024-08-19T00:24:11.678 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "container_image_grafana", 2024-08-19T00:24:11.678 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.678 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.678 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.678 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-08-19T00:24:11.678 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.678 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.678 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.679 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Prometheus container image", 2024-08-19T00:24:11.679 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.679 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.679 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.679 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.679 INFO:teuthology.orchestra.run.smithi044.stdout: "container_image_haproxy": { 2024-08-19T00:24:11.679 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "container_image_haproxy", 2024-08-19T00:24:11.679 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.680 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.680 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.680 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-08-19T00:24:11.680 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.680 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.680 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.680 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "HAproxy container image", 2024-08-19T00:24:11.680 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.680 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.681 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.681 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.681 INFO:teuthology.orchestra.run.smithi044.stdout: "container_image_jaeger_agent": { 2024-08-19T00:24:11.681 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "container_image_jaeger_agent", 2024-08-19T00:24:11.681 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.681 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.681 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.681 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-08-19T00:24:11.682 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.682 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.682 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.682 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Jaeger agent container image", 2024-08-19T00:24:11.682 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.682 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.682 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.682 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.683 INFO:teuthology.orchestra.run.smithi044.stdout: "container_image_jaeger_collector": { 2024-08-19T00:24:11.683 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "container_image_jaeger_collector", 2024-08-19T00:24:11.683 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.683 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.683 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.683 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-08-19T00:24:11.683 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.683 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.683 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.684 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Jaeger collector container image", 2024-08-19T00:24:11.684 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.684 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.684 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.684 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.684 INFO:teuthology.orchestra.run.smithi044.stdout: "container_image_jaeger_query": { 2024-08-19T00:24:11.684 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "container_image_jaeger_query", 2024-08-19T00:24:11.684 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.685 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.685 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.685 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-08-19T00:24:11.685 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.685 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.685 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.685 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Jaeger query container image", 2024-08-19T00:24:11.685 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.686 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.686 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.686 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.686 INFO:teuthology.orchestra.run.smithi044.stdout: "container_image_keepalived": { 2024-08-19T00:24:11.686 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "container_image_keepalived", 2024-08-19T00:24:11.686 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.686 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.686 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.687 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-08-19T00:24:11.687 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.687 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.687 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.687 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Keepalived container image", 2024-08-19T00:24:11.687 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.687 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.687 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.688 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.688 INFO:teuthology.orchestra.run.smithi044.stdout: "container_image_loki": { 2024-08-19T00:24:11.688 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "container_image_loki", 2024-08-19T00:24:11.688 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.688 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.688 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.688 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-08-19T00:24:11.688 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.688 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.689 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.689 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Loki container image", 2024-08-19T00:24:11.689 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.689 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.689 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.689 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.689 INFO:teuthology.orchestra.run.smithi044.stdout: "container_image_node_exporter": { 2024-08-19T00:24:11.689 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "container_image_node_exporter", 2024-08-19T00:24:11.690 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.690 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.690 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.690 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-08-19T00:24:11.690 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.690 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.690 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.691 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Prometheus container image", 2024-08-19T00:24:11.691 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.691 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.691 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.691 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.691 INFO:teuthology.orchestra.run.smithi044.stdout: "container_image_nvmeof": { 2024-08-19T00:24:11.691 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "container_image_nvmeof", 2024-08-19T00:24:11.691 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.692 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.692 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.692 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-08-19T00:24:11.692 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.692 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.692 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.692 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Nvme-of container image", 2024-08-19T00:24:11.692 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.693 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.693 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.693 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.693 INFO:teuthology.orchestra.run.smithi044.stdout: "container_image_prometheus": { 2024-08-19T00:24:11.693 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "container_image_prometheus", 2024-08-19T00:24:11.693 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.693 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.693 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.694 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-08-19T00:24:11.694 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.694 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.694 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.694 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Prometheus container image", 2024-08-19T00:24:11.694 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.694 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.695 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.695 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.695 INFO:teuthology.orchestra.run.smithi044.stdout: "container_image_promtail": { 2024-08-19T00:24:11.695 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "container_image_promtail", 2024-08-19T00:24:11.695 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.695 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.695 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.695 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-08-19T00:24:11.696 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.696 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.696 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.696 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Promtail container image", 2024-08-19T00:24:11.696 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.696 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.696 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.696 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.697 INFO:teuthology.orchestra.run.smithi044.stdout: "container_image_samba": { 2024-08-19T00:24:11.697 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "container_image_samba", 2024-08-19T00:24:11.697 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.697 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.697 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.697 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-08-19T00:24:11.697 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.697 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.697 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.698 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Samba/SMB container image", 2024-08-19T00:24:11.698 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.698 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.698 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.698 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.698 INFO:teuthology.orchestra.run.smithi044.stdout: "container_image_snmp_gateway": { 2024-08-19T00:24:11.698 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "container_image_snmp_gateway", 2024-08-19T00:24:11.699 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.699 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.699 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.699 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-08-19T00:24:11.699 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.699 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.699 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.699 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "SNMP Gateway container image", 2024-08-19T00:24:11.699 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.700 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.700 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.700 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.700 INFO:teuthology.orchestra.run.smithi044.stdout: "container_init": { 2024-08-19T00:24:11.700 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "container_init", 2024-08-19T00:24:11.700 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.700 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.700 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.701 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:11.701 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.701 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.701 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.701 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Run podman/docker with `--init`", 2024-08-19T00:24:11.701 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.701 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.701 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.702 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.702 INFO:teuthology.orchestra.run.smithi044.stdout: "daemon_cache_timeout": { 2024-08-19T00:24:11.702 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "daemon_cache_timeout", 2024-08-19T00:24:11.702 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", 2024-08-19T00:24:11.702 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.702 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.702 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "600", 2024-08-19T00:24:11.703 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.703 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.703 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.703 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-08-19T00:24:11.703 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.703 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.703 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.703 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.703 INFO:teuthology.orchestra.run.smithi044.stdout: "default_cephadm_command_timeout": { 2024-08-19T00:24:11.704 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "default_cephadm_command_timeout", 2024-08-19T00:24:11.704 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:11.704 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.704 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.704 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "900", 2024-08-19T00:24:11.704 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.704 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.704 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.705 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-08-19T00:24:11.705 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.705 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.705 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.705 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.705 INFO:teuthology.orchestra.run.smithi044.stdout: "default_registry": { 2024-08-19T00:24:11.705 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "default_registry", 2024-08-19T00:24:11.705 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.706 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.706 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.706 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "docker.io", 2024-08-19T00:24:11.706 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.706 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.706 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.706 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-08-19T00:24:11.706 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.707 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.707 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.707 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.707 INFO:teuthology.orchestra.run.smithi044.stdout: "device_cache_timeout": { 2024-08-19T00:24:11.707 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "device_cache_timeout", 2024-08-19T00:24:11.707 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", 2024-08-19T00:24:11.707 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.707 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.708 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "1800", 2024-08-19T00:24:11.708 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.708 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.708 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.708 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "seconds to cache device inventory", 2024-08-19T00:24:11.708 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.708 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.708 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.709 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.709 INFO:teuthology.orchestra.run.smithi044.stdout: "device_enhanced_scan": { 2024-08-19T00:24:11.709 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "device_enhanced_scan", 2024-08-19T00:24:11.709 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.709 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.709 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.709 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.709 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.709 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.710 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.710 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Use libstoragemgmt during device scans", 2024-08-19T00:24:11.710 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.710 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.710 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.710 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.710 INFO:teuthology.orchestra.run.smithi044.stdout: "facts_cache_timeout": { 2024-08-19T00:24:11.711 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "facts_cache_timeout", 2024-08-19T00:24:11.711 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", 2024-08-19T00:24:11.711 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.711 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.711 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "60", 2024-08-19T00:24:11.711 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.711 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.711 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.711 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "seconds to cache host facts data", 2024-08-19T00:24:11.712 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.712 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.712 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.712 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.712 INFO:teuthology.orchestra.run.smithi044.stdout: "grafana_dashboards_path": { 2024-08-19T00:24:11.712 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "grafana_dashboards_path", 2024-08-19T00:24:11.712 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.712 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.713 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.713 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-08-19T00:24:11.713 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.713 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.713 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.713 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-08-19T00:24:11.713 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.713 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.714 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.714 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.714 INFO:teuthology.orchestra.run.smithi044.stdout: "host_check_interval": { 2024-08-19T00:24:11.714 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "host_check_interval", 2024-08-19T00:24:11.714 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", 2024-08-19T00:24:11.714 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.714 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.715 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "600", 2024-08-19T00:24:11.718 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.718 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.718 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.718 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "how frequently to perform a host check", 2024-08-19T00:24:11.718 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.719 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.719 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.719 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.719 INFO:teuthology.orchestra.run.smithi044.stdout: "hw_monitoring": { 2024-08-19T00:24:11.719 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "hw_monitoring", 2024-08-19T00:24:11.719 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.719 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.719 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.720 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.720 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.720 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.720 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.720 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-08-19T00:24:11.720 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.720 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.720 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.721 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.721 INFO:teuthology.orchestra.run.smithi044.stdout: "inventory_list_all": { 2024-08-19T00:24:11.721 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "inventory_list_all", 2024-08-19T00:24:11.721 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.721 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.721 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.721 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.721 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.722 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.722 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.722 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-08-19T00:24:11.722 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.722 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.722 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.722 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.722 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:11.723 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:11.723 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.723 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.723 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.723 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.723 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.723 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.723 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.724 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.724 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.724 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.724 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.724 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.724 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.724 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.724 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.725 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.725 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.725 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.725 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.725 INFO:teuthology.orchestra.run.smithi044.stdout: "log_refresh_metadata": { 2024-08-19T00:24:11.725 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_refresh_metadata", 2024-08-19T00:24:11.725 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.725 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.725 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.726 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.726 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.726 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.726 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.726 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-08-19T00:24:11.726 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.726 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.726 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.727 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.727 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:11.727 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:11.727 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.727 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.727 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.727 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:11.728 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.728 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.728 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.728 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-08-19T00:24:11.728 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.728 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.728 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.728 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.728 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:11.729 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:11.729 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.729 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.729 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.729 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:11.729 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.729 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.729 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.730 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.730 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.730 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.730 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.730 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.730 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.730 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.730 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.731 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.731 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.731 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.731 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.731 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:11.731 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:11.731 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.731 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.731 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.732 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.732 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.732 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.732 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.732 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.732 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.732 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.732 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.733 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.733 INFO:teuthology.orchestra.run.smithi044.stdout: "manage_etc_ceph_ceph_conf": { 2024-08-19T00:24:11.733 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-08-19T00:24:11.733 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.733 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.733 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.733 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.733 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.734 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.734 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.734 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-08-19T00:24:11.734 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.734 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.734 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.734 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.734 INFO:teuthology.orchestra.run.smithi044.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-08-19T00:24:11.735 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-08-19T00:24:11.735 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.735 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.735 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.735 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "*", 2024-08-19T00:24:11.735 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.735 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.736 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.736 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-08-19T00:24:11.736 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.736 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.736 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.736 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.736 INFO:teuthology.orchestra.run.smithi044.stdout: "max_count_per_host": { 2024-08-19T00:24:11.736 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "max_count_per_host", 2024-08-19T00:24:11.737 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:11.737 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.737 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.737 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "10", 2024-08-19T00:24:11.737 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.737 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.737 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.737 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "max number of daemons per service per host", 2024-08-19T00:24:11.738 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.738 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.738 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.738 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.738 INFO:teuthology.orchestra.run.smithi044.stdout: "max_osd_draining_count": { 2024-08-19T00:24:11.738 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "max_osd_draining_count", 2024-08-19T00:24:11.738 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:11.739 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.739 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.739 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "10", 2024-08-19T00:24:11.739 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.739 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.739 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.739 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-08-19T00:24:11.739 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.740 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.740 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.740 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.740 INFO:teuthology.orchestra.run.smithi044.stdout: "migration_current": { 2024-08-19T00:24:11.740 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "migration_current", 2024-08-19T00:24:11.740 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:11.740 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.740 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.741 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.741 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.741 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.741 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.741 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "internal - do not modify", 2024-08-19T00:24:11.741 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.741 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.741 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.742 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.742 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": { 2024-08-19T00:24:11.742 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "mode", 2024-08-19T00:24:11.742 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.742 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.742 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.742 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "root", 2024-08-19T00:24:11.743 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.743 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.743 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.743 INFO:teuthology.orchestra.run.smithi044.stdout: "cephadm-package", 2024-08-19T00:24:11.743 INFO:teuthology.orchestra.run.smithi044.stdout: "root" 2024-08-19T00:24:11.743 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.743 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "mode for remote execution of cephadm", 2024-08-19T00:24:11.743 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.744 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.744 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.744 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.744 INFO:teuthology.orchestra.run.smithi044.stdout: "oob_default_addr": { 2024-08-19T00:24:11.744 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "oob_default_addr", 2024-08-19T00:24:11.744 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.744 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.744 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.745 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "169.254.1.1", 2024-08-19T00:24:11.745 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.745 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.745 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.745 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Default address for RedFish API (oob management).", 2024-08-19T00:24:11.745 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.745 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.745 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.746 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.746 INFO:teuthology.orchestra.run.smithi044.stdout: "prometheus_alerts_path": { 2024-08-19T00:24:11.746 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "prometheus_alerts_path", 2024-08-19T00:24:11.746 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.746 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.746 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.746 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-08-19T00:24:11.747 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.747 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.747 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.747 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-08-19T00:24:11.747 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.747 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.747 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.747 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.748 INFO:teuthology.orchestra.run.smithi044.stdout: "registry_insecure": { 2024-08-19T00:24:11.748 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "registry_insecure", 2024-08-19T00:24:11.748 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.748 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.748 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.748 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.748 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.749 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.749 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.749 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-08-19T00:24:11.749 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.749 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.749 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.749 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.749 INFO:teuthology.orchestra.run.smithi044.stdout: "registry_password": { 2024-08-19T00:24:11.750 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "registry_password", 2024-08-19T00:24:11.750 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.750 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.750 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.750 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.750 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.750 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.750 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.751 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-08-19T00:24:11.751 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.751 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.751 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.751 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.751 INFO:teuthology.orchestra.run.smithi044.stdout: "registry_url": { 2024-08-19T00:24:11.751 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "registry_url", 2024-08-19T00:24:11.751 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.751 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.752 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.752 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.752 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.752 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.752 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.752 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-08-19T00:24:11.752 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.752 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.753 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.753 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.753 INFO:teuthology.orchestra.run.smithi044.stdout: "registry_username": { 2024-08-19T00:24:11.753 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "registry_username", 2024-08-19T00:24:11.753 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.753 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.753 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.754 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.754 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.754 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.754 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.754 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-08-19T00:24:11.754 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.754 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.754 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.755 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.755 INFO:teuthology.orchestra.run.smithi044.stdout: "secure_monitoring_stack": { 2024-08-19T00:24:11.755 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "secure_monitoring_stack", 2024-08-19T00:24:11.755 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.755 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.755 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.756 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.756 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.756 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.756 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.756 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-08-19T00:24:11.756 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.757 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.757 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.757 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.757 INFO:teuthology.orchestra.run.smithi044.stdout: "service_discovery_port": { 2024-08-19T00:24:11.757 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "service_discovery_port", 2024-08-19T00:24:11.758 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:11.758 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.758 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.758 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "8765", 2024-08-19T00:24:11.758 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.758 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.759 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.759 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "cephadm service discovery port", 2024-08-19T00:24:11.759 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.759 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.759 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.759 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.760 INFO:teuthology.orchestra.run.smithi044.stdout: "ssh_config_file": { 2024-08-19T00:24:11.760 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "ssh_config_file", 2024-08-19T00:24:11.760 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.760 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.760 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.760 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.761 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.761 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.761 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.761 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-08-19T00:24:11.761 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.761 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.761 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.762 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.762 INFO:teuthology.orchestra.run.smithi044.stdout: "use_agent": { 2024-08-19T00:24:11.762 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "use_agent", 2024-08-19T00:24:11.762 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.762 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.762 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.762 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.762 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.763 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.763 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.763 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-08-19T00:24:11.763 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.763 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.763 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.763 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.763 INFO:teuthology.orchestra.run.smithi044.stdout: "use_repo_digest": { 2024-08-19T00:24:11.764 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "use_repo_digest", 2024-08-19T00:24:11.764 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.764 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.764 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.764 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:11.764 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.764 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.764 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.765 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-08-19T00:24:11.765 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.765 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.765 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.765 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.765 INFO:teuthology.orchestra.run.smithi044.stdout: "warn_on_failed_host_check": { 2024-08-19T00:24:11.765 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "warn_on_failed_host_check", 2024-08-19T00:24:11.765 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.766 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.766 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.766 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:11.766 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.766 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.766 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.766 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "raise a health warning if the host check fails", 2024-08-19T00:24:11.766 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.767 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.767 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.767 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.767 INFO:teuthology.orchestra.run.smithi044.stdout: "warn_on_stray_daemons": { 2024-08-19T00:24:11.767 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "warn_on_stray_daemons", 2024-08-19T00:24:11.767 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.767 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.767 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.767 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:11.768 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.768 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.768 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.768 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-08-19T00:24:11.768 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.768 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.768 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.768 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.769 INFO:teuthology.orchestra.run.smithi044.stdout: "warn_on_stray_hosts": { 2024-08-19T00:24:11.769 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "warn_on_stray_hosts", 2024-08-19T00:24:11.769 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.769 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.769 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.769 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:11.769 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.769 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.770 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.770 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-08-19T00:24:11.770 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.770 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.770 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.770 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.770 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.770 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.771 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:11.771 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "crash", 2024-08-19T00:24:11.771 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:11.771 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:11.771 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:11.771 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:11.771 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:11.771 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.772 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.772 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.772 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.772 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.772 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.772 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.772 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.772 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.773 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.773 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.773 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.773 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.773 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.773 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.773 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.773 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.773 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.774 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.774 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:11.774 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:11.774 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.774 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.774 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.774 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.774 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.775 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.775 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.775 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.775 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.775 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.775 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.775 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.776 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:11.776 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:11.776 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.776 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.776 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.776 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:11.776 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.777 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.777 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.777 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.777 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.777 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.777 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.777 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.778 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.778 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.778 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.778 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.778 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.778 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.778 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.778 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:11.779 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:11.779 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.779 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.779 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.779 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.779 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.779 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.779 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.780 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.780 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.780 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.780 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.780 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.780 INFO:teuthology.orchestra.run.smithi044.stdout: "retain_interval": { 2024-08-19T00:24:11.780 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "retain_interval", 2024-08-19T00:24:11.780 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", 2024-08-19T00:24:11.781 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.781 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.781 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "31536000", 2024-08-19T00:24:11.781 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.781 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.781 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.781 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "how long to retain crashes before pruning them", 2024-08-19T00:24:11.781 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.782 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.782 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.782 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.782 INFO:teuthology.orchestra.run.smithi044.stdout: "warn_recent_interval": { 2024-08-19T00:24:11.782 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "warn_recent_interval", 2024-08-19T00:24:11.782 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", 2024-08-19T00:24:11.783 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.783 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.783 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "1209600", 2024-08-19T00:24:11.783 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.783 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.783 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.783 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "time interval in which to warn about recent crashes", 2024-08-19T00:24:11.784 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.784 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.784 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.784 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.784 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.784 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.784 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:11.784 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "dashboard", 2024-08-19T00:24:11.785 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:11.785 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:11.785 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:11.785 INFO:teuthology.orchestra.run.smithi044.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-08-19T00:24:11.785 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-08-19T00:24:11.785 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:11.786 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.786 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.786 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "10", 2024-08-19T00:24:11.786 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.786 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.786 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.787 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.787 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.787 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.787 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.787 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.787 INFO:teuthology.orchestra.run.smithi044.stdout: "ALERTMANAGER_API_HOST": { 2024-08-19T00:24:11.788 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "ALERTMANAGER_API_HOST", 2024-08-19T00:24:11.788 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.788 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.788 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.788 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.788 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.788 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.789 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.789 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.789 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.789 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.789 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.790 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.790 INFO:teuthology.orchestra.run.smithi044.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-08-19T00:24:11.790 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-08-19T00:24:11.790 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.790 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.790 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.791 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:11.791 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.791 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.791 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.791 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.791 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.792 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.792 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.792 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.792 INFO:teuthology.orchestra.run.smithi044.stdout: "AUDIT_API_ENABLED": { 2024-08-19T00:24:11.792 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "AUDIT_API_ENABLED", 2024-08-19T00:24:11.792 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.792 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.792 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.793 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.793 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.793 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.793 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.793 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.793 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.793 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.793 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.794 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.794 INFO:teuthology.orchestra.run.smithi044.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-08-19T00:24:11.794 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-08-19T00:24:11.794 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.794 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.794 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.794 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:11.794 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.795 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.795 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.795 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.795 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.795 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.795 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.795 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.795 INFO:teuthology.orchestra.run.smithi044.stdout: "ENABLE_BROWSABLE_API": { 2024-08-19T00:24:11.796 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "ENABLE_BROWSABLE_API", 2024-08-19T00:24:11.796 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.796 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.796 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.796 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:11.796 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.796 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.796 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.797 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.797 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.797 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.797 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.797 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.797 INFO:teuthology.orchestra.run.smithi044.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-08-19T00:24:11.797 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-08-19T00:24:11.797 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.798 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.798 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.798 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:11.798 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.798 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.798 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.798 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.798 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.799 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.799 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.799 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.799 INFO:teuthology.orchestra.run.smithi044.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-08-19T00:24:11.799 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-08-19T00:24:11.799 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.799 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.799 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.799 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:11.800 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.800 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.800 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.800 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.800 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.800 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.800 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.800 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.801 INFO:teuthology.orchestra.run.smithi044.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-08-19T00:24:11.801 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-08-19T00:24:11.801 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.801 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.801 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.801 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:11.801 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.801 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.802 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.802 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.802 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.802 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.802 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.802 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.802 INFO:teuthology.orchestra.run.smithi044.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-08-19T00:24:11.803 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-08-19T00:24:11.803 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.803 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.803 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.803 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:11.803 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.803 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.804 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.804 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.804 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.804 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.804 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.804 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.804 INFO:teuthology.orchestra.run.smithi044.stdout: "FEATURE_TOGGLE_NFS": { 2024-08-19T00:24:11.804 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-08-19T00:24:11.804 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.805 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.805 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.805 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:11.805 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.805 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.805 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.805 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.805 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.805 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.806 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.806 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.806 INFO:teuthology.orchestra.run.smithi044.stdout: "FEATURE_TOGGLE_RBD": { 2024-08-19T00:24:11.806 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-08-19T00:24:11.806 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.806 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.806 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.807 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:11.807 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.807 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.807 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.807 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.807 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.807 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.807 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.807 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.808 INFO:teuthology.orchestra.run.smithi044.stdout: "FEATURE_TOGGLE_RGW": { 2024-08-19T00:24:11.808 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-08-19T00:24:11.808 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.808 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.808 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.808 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:11.808 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.808 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.809 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.809 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.809 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.809 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.809 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.809 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.809 INFO:teuthology.orchestra.run.smithi044.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-08-19T00:24:11.809 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-08-19T00:24:11.810 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.810 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.810 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.810 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.810 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.810 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.810 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.810 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.811 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.811 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.811 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.811 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.811 INFO:teuthology.orchestra.run.smithi044.stdout: "GRAFANA_API_PASSWORD": { 2024-08-19T00:24:11.811 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "GRAFANA_API_PASSWORD", 2024-08-19T00:24:11.811 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.811 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.812 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.812 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "admin", 2024-08-19T00:24:11.812 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.812 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.812 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.812 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.812 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.812 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.813 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.813 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.813 INFO:teuthology.orchestra.run.smithi044.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-08-19T00:24:11.813 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-08-19T00:24:11.813 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.813 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.813 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.813 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:11.813 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.814 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.814 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.814 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.814 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.814 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.814 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.814 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.814 INFO:teuthology.orchestra.run.smithi044.stdout: "GRAFANA_API_URL": { 2024-08-19T00:24:11.814 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "GRAFANA_API_URL", 2024-08-19T00:24:11.815 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.815 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.815 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.815 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.815 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.815 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.815 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.816 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.816 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.816 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.816 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.816 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.816 INFO:teuthology.orchestra.run.smithi044.stdout: "GRAFANA_API_USERNAME": { 2024-08-19T00:24:11.816 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "GRAFANA_API_USERNAME", 2024-08-19T00:24:11.817 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.817 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.817 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.817 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "admin", 2024-08-19T00:24:11.817 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.817 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.817 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.817 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.817 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.818 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.818 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.818 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.818 INFO:teuthology.orchestra.run.smithi044.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-08-19T00:24:11.818 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-08-19T00:24:11.818 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.818 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.818 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.819 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.819 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.819 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.819 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.819 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.819 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.819 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.819 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.820 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.820 INFO:teuthology.orchestra.run.smithi044.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-08-19T00:24:11.820 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-08-19T00:24:11.820 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.820 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.820 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.820 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.820 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.821 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.821 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.821 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.821 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.821 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.821 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.821 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.822 INFO:teuthology.orchestra.run.smithi044.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-08-19T00:24:11.822 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-08-19T00:24:11.822 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.822 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.822 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.822 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:11.822 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.823 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.823 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.823 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.823 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.823 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.823 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.823 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.823 INFO:teuthology.orchestra.run.smithi044.stdout: "ISSUE_TRACKER_API_KEY": { 2024-08-19T00:24:11.823 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-08-19T00:24:11.824 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.824 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.824 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.824 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.824 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.824 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.824 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.824 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.825 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.825 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.825 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.825 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.825 INFO:teuthology.orchestra.run.smithi044.stdout: "PROMETHEUS_API_HOST": { 2024-08-19T00:24:11.825 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "PROMETHEUS_API_HOST", 2024-08-19T00:24:11.825 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.825 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.826 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.826 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.826 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.826 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.826 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.826 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.826 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.826 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.827 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.827 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.827 INFO:teuthology.orchestra.run.smithi044.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-08-19T00:24:11.827 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-08-19T00:24:11.827 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.827 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.827 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.827 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:11.827 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.828 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.828 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.828 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.828 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.828 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.828 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.828 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.829 INFO:teuthology.orchestra.run.smithi044.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-08-19T00:24:11.829 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-08-19T00:24:11.829 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.829 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.829 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.829 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.829 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.829 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.830 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.830 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.830 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.830 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.830 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.830 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.830 INFO:teuthology.orchestra.run.smithi044.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-08-19T00:24:11.830 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-08-19T00:24:11.831 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.831 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.831 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.831 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.831 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.831 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.831 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.831 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.832 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.832 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.832 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.832 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.832 INFO:teuthology.orchestra.run.smithi044.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-08-19T00:24:11.832 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-08-19T00:24:11.832 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.832 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.833 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.833 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:11.833 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.833 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.833 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.833 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.833 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.833 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.834 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.834 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.834 INFO:teuthology.orchestra.run.smithi044.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-08-19T00:24:11.834 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-08-19T00:24:11.834 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.834 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.834 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.834 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:11.835 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.835 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.835 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.835 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.835 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.835 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.835 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.835 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.836 INFO:teuthology.orchestra.run.smithi044.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-08-19T00:24:11.836 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-08-19T00:24:11.836 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.836 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.836 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.836 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.836 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.836 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.837 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.837 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.837 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.837 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.837 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.837 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.837 INFO:teuthology.orchestra.run.smithi044.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-08-19T00:24:11.837 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-08-19T00:24:11.838 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.838 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.838 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.838 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.838 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.838 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.838 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.838 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.838 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.839 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.839 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.839 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.839 INFO:teuthology.orchestra.run.smithi044.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-08-19T00:24:11.839 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-08-19T00:24:11.839 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.839 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.839 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.840 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.840 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.840 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.840 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.840 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.840 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.840 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.840 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.841 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.841 INFO:teuthology.orchestra.run.smithi044.stdout: "PWD_POLICY_ENABLED": { 2024-08-19T00:24:11.841 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "PWD_POLICY_ENABLED", 2024-08-19T00:24:11.841 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.841 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.841 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.841 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:11.841 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.842 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.842 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.842 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.842 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.842 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.842 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.842 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.842 INFO:teuthology.orchestra.run.smithi044.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-08-19T00:24:11.843 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-08-19T00:24:11.843 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.843 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.843 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.843 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-08-19T00:24:11.843 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.843 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.843 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.844 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.844 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.844 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.844 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.844 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.844 INFO:teuthology.orchestra.run.smithi044.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-08-19T00:24:11.844 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-08-19T00:24:11.844 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:11.844 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.845 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.845 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "10", 2024-08-19T00:24:11.845 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.845 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.845 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.845 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.845 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.845 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.846 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.846 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.846 INFO:teuthology.orchestra.run.smithi044.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-08-19T00:24:11.846 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-08-19T00:24:11.846 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:11.846 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.846 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.847 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "8", 2024-08-19T00:24:11.847 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.847 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.847 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.847 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.847 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.847 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.847 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.848 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.848 INFO:teuthology.orchestra.run.smithi044.stdout: "REST_REQUESTS_TIMEOUT": { 2024-08-19T00:24:11.848 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-08-19T00:24:11.848 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:11.848 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.848 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.848 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "45", 2024-08-19T00:24:11.848 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.849 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.849 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.849 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.849 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.849 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.849 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.849 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.849 INFO:teuthology.orchestra.run.smithi044.stdout: "RGW_API_ACCESS_KEY": { 2024-08-19T00:24:11.849 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "RGW_API_ACCESS_KEY", 2024-08-19T00:24:11.850 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.850 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.850 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.850 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.850 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.850 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.850 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.850 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.851 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.851 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.851 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.851 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.851 INFO:teuthology.orchestra.run.smithi044.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-08-19T00:24:11.851 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-08-19T00:24:11.851 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.851 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.852 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.852 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "admin", 2024-08-19T00:24:11.852 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.852 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.852 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.852 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.852 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.852 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.852 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.853 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.853 INFO:teuthology.orchestra.run.smithi044.stdout: "RGW_API_SECRET_KEY": { 2024-08-19T00:24:11.853 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "RGW_API_SECRET_KEY", 2024-08-19T00:24:11.853 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.853 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.853 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.853 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.853 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.854 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.854 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.854 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.854 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.854 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.854 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.854 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.854 INFO:teuthology.orchestra.run.smithi044.stdout: "RGW_API_SSL_VERIFY": { 2024-08-19T00:24:11.855 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "RGW_API_SSL_VERIFY", 2024-08-19T00:24:11.855 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.855 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.855 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.855 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:11.855 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.855 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.855 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.856 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.856 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.856 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.856 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.856 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.856 INFO:teuthology.orchestra.run.smithi044.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-08-19T00:24:11.856 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-08-19T00:24:11.856 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:11.857 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.857 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.857 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "0", 2024-08-19T00:24:11.857 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.857 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.857 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.857 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.857 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.858 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.858 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.858 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.858 INFO:teuthology.orchestra.run.smithi044.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-08-19T00:24:11.858 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-08-19T00:24:11.858 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:11.858 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.858 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.859 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "10", 2024-08-19T00:24:11.859 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.859 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.859 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.859 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.859 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.859 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.859 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.860 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.860 INFO:teuthology.orchestra.run.smithi044.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-08-19T00:24:11.860 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-08-19T00:24:11.860 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:11.860 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.860 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.860 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "5", 2024-08-19T00:24:11.860 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.861 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.861 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.861 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.861 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.861 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.861 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.861 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.861 INFO:teuthology.orchestra.run.smithi044.stdout: "cross_origin_url": { 2024-08-19T00:24:11.862 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "cross_origin_url", 2024-08-19T00:24:11.862 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.862 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.862 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.862 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.862 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.862 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.862 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.863 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.863 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.863 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.863 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.863 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.863 INFO:teuthology.orchestra.run.smithi044.stdout: "crt_file": { 2024-08-19T00:24:11.863 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "crt_file", 2024-08-19T00:24:11.863 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.864 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.864 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.864 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.864 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.864 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.864 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.864 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.864 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.865 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.865 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.865 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.865 INFO:teuthology.orchestra.run.smithi044.stdout: "debug": { 2024-08-19T00:24:11.865 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "debug", 2024-08-19T00:24:11.865 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.866 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.866 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.866 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.866 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.866 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.866 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.867 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Enable/disable debug options", 2024-08-19T00:24:11.867 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.867 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.867 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.867 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.867 INFO:teuthology.orchestra.run.smithi044.stdout: "jwt_token_ttl": { 2024-08-19T00:24:11.867 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "jwt_token_ttl", 2024-08-19T00:24:11.867 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:11.868 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.868 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.868 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "28800", 2024-08-19T00:24:11.868 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.868 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.868 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.868 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.868 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.869 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.869 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.869 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.869 INFO:teuthology.orchestra.run.smithi044.stdout: "key_file": { 2024-08-19T00:24:11.869 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "key_file", 2024-08-19T00:24:11.869 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.869 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.869 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.869 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.870 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.870 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.870 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.870 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.870 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.870 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.870 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.870 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.871 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:11.871 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:11.871 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.871 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.871 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.871 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.871 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.871 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.872 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.872 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.872 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.872 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.872 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.872 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.872 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.872 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.873 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.873 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.873 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.873 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.873 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.873 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:11.873 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:11.873 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.873 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.874 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.874 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.874 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.874 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.874 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.874 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.874 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.874 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.874 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.875 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.875 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:11.875 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:11.875 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.875 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.875 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.875 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:11.875 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.875 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.876 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.876 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.876 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.876 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.876 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.876 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.876 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.876 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.877 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.877 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.877 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.877 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.877 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.877 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:11.877 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:11.877 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.878 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.878 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.878 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.878 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.878 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.878 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.878 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.879 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.879 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.879 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.879 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.879 INFO:teuthology.orchestra.run.smithi044.stdout: "motd": { 2024-08-19T00:24:11.879 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "motd", 2024-08-19T00:24:11.879 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.879 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.880 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.880 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.880 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.880 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.880 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.880 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "The message of the day", 2024-08-19T00:24:11.880 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.880 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.881 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.881 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.881 INFO:teuthology.orchestra.run.smithi044.stdout: "redirect_resolve_ip_addr": { 2024-08-19T00:24:11.881 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "redirect_resolve_ip_addr", 2024-08-19T00:24:11.881 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.881 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.881 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.882 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.882 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.882 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.882 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.882 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.882 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.882 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.882 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.883 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.883 INFO:teuthology.orchestra.run.smithi044.stdout: "server_addr": { 2024-08-19T00:24:11.883 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "server_addr", 2024-08-19T00:24:11.883 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.883 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.883 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.883 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "::", 2024-08-19T00:24:11.883 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.884 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.884 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.884 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.884 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.884 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.884 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.884 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.885 INFO:teuthology.orchestra.run.smithi044.stdout: "server_port": { 2024-08-19T00:24:11.885 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "server_port", 2024-08-19T00:24:11.885 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:11.885 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.885 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.885 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "8080", 2024-08-19T00:24:11.885 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.885 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.886 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.886 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.886 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.886 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.886 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.886 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.886 INFO:teuthology.orchestra.run.smithi044.stdout: "ssl": { 2024-08-19T00:24:11.886 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "ssl", 2024-08-19T00:24:11.887 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.887 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.887 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.887 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:11.887 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.887 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.887 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.888 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.888 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.888 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.888 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.888 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.888 INFO:teuthology.orchestra.run.smithi044.stdout: "ssl_server_port": { 2024-08-19T00:24:11.889 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "ssl_server_port", 2024-08-19T00:24:11.889 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:11.889 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.889 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.889 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "8443", 2024-08-19T00:24:11.889 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.889 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.889 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.890 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.890 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.890 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.890 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.890 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.890 INFO:teuthology.orchestra.run.smithi044.stdout: "standby_behaviour": { 2024-08-19T00:24:11.890 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "standby_behaviour", 2024-08-19T00:24:11.891 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.891 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.891 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.891 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "redirect", 2024-08-19T00:24:11.891 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.891 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.892 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.892 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.892 INFO:teuthology.orchestra.run.smithi044.stdout: "redirect" 2024-08-19T00:24:11.892 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.892 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.892 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.892 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.893 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.893 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.893 INFO:teuthology.orchestra.run.smithi044.stdout: "standby_error_status_code": { 2024-08-19T00:24:11.893 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "standby_error_status_code", 2024-08-19T00:24:11.893 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:11.893 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.893 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.894 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "500", 2024-08-19T00:24:11.894 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "400", 2024-08-19T00:24:11.894 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "599", 2024-08-19T00:24:11.894 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.894 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.895 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.895 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.895 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.895 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.895 INFO:teuthology.orchestra.run.smithi044.stdout: "url_prefix": { 2024-08-19T00:24:11.895 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "url_prefix", 2024-08-19T00:24:11.895 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.896 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.896 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.896 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.896 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.896 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.896 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.896 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.897 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.897 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.897 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.897 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.897 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.897 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.898 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:11.898 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "devicehealth", 2024-08-19T00:24:11.898 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:11.898 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:11.898 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:11.898 INFO:teuthology.orchestra.run.smithi044.stdout: "enable_monitoring": { 2024-08-19T00:24:11.898 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "enable_monitoring", 2024-08-19T00:24:11.899 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.899 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.899 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.899 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:11.899 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.899 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.899 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.899 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "monitor device health metrics", 2024-08-19T00:24:11.900 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.900 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.900 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.900 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.900 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:11.900 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:11.900 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.900 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.901 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.901 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.901 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.901 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.901 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.901 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.901 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.902 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.902 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.902 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.902 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.902 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.903 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.903 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.903 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.903 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.903 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.903 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:11.903 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:11.903 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.904 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.904 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.904 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.904 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.904 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.904 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.904 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.905 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.905 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.905 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.905 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.905 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:11.905 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:11.905 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.905 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.905 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.906 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:11.906 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.906 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.906 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.906 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.906 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.906 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.906 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.907 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.907 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.907 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.907 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.907 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.907 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.907 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.907 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.908 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:11.908 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:11.908 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.908 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.908 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.908 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.908 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.908 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.908 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.909 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.909 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.909 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.909 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.909 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.909 INFO:teuthology.orchestra.run.smithi044.stdout: "mark_out_threshold": { 2024-08-19T00:24:11.909 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "mark_out_threshold", 2024-08-19T00:24:11.910 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", 2024-08-19T00:24:11.910 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.910 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.910 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "2419200", 2024-08-19T00:24:11.910 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.910 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.910 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.910 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-08-19T00:24:11.911 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.911 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.911 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.911 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.911 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_name": { 2024-08-19T00:24:11.911 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "pool_name", 2024-08-19T00:24:11.911 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.911 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.912 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.912 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "device_health_metrics", 2024-08-19T00:24:11.912 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.912 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.912 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.912 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "name of pool in which to store device health metrics", 2024-08-19T00:24:11.912 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.912 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.913 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.913 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.913 INFO:teuthology.orchestra.run.smithi044.stdout: "retention_period": { 2024-08-19T00:24:11.913 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "retention_period", 2024-08-19T00:24:11.913 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", 2024-08-19T00:24:11.913 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.913 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.913 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "15552000", 2024-08-19T00:24:11.914 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.914 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.914 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.914 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "how long to retain device health metrics", 2024-08-19T00:24:11.914 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.914 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.914 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.914 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.915 INFO:teuthology.orchestra.run.smithi044.stdout: "scrape_frequency": { 2024-08-19T00:24:11.915 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "scrape_frequency", 2024-08-19T00:24:11.915 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", 2024-08-19T00:24:11.915 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.915 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.915 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "86400", 2024-08-19T00:24:11.915 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.915 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.916 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.916 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "how frequently to scrape device health metrics", 2024-08-19T00:24:11.916 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.916 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.916 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.916 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.916 INFO:teuthology.orchestra.run.smithi044.stdout: "self_heal": { 2024-08-19T00:24:11.916 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "self_heal", 2024-08-19T00:24:11.916 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.917 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.917 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.917 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:11.917 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.917 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.917 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.917 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-08-19T00:24:11.917 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.918 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.918 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.918 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.918 INFO:teuthology.orchestra.run.smithi044.stdout: "sleep_interval": { 2024-08-19T00:24:11.918 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "sleep_interval", 2024-08-19T00:24:11.918 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", 2024-08-19T00:24:11.918 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.919 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.919 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "600", 2024-08-19T00:24:11.919 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.919 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.919 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.919 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "how frequently to wake up and check device health", 2024-08-19T00:24:11.919 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.919 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.920 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.920 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.920 INFO:teuthology.orchestra.run.smithi044.stdout: "warn_threshold": { 2024-08-19T00:24:11.920 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "warn_threshold", 2024-08-19T00:24:11.920 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", 2024-08-19T00:24:11.920 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.920 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.920 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "7257600", 2024-08-19T00:24:11.920 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.921 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.921 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.921 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-08-19T00:24:11.921 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.921 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.921 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.921 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.921 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.921 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.922 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:11.922 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "diskprediction_local", 2024-08-19T00:24:11.922 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:11.922 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:11.922 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:11.922 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:11.922 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:11.922 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.923 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.923 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.923 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.923 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.923 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.923 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.923 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.924 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.924 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.924 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.924 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.924 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.924 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.924 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.924 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.924 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.925 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.925 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.925 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:11.925 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:11.925 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.925 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.925 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.925 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.926 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.926 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.926 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.926 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.926 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.926 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.926 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.926 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.927 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:11.927 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:11.927 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.927 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.927 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.927 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:11.927 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.927 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.928 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.928 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.928 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.928 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.928 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.928 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.928 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.928 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.929 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.929 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.929 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.929 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.929 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.929 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:11.929 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:11.929 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.930 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.930 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.930 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.930 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.930 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.930 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.930 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.931 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.931 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.931 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.931 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.931 INFO:teuthology.orchestra.run.smithi044.stdout: "predict_interval": { 2024-08-19T00:24:11.931 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "predict_interval", 2024-08-19T00:24:11.931 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.931 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.932 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.932 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "86400", 2024-08-19T00:24:11.932 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.932 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.932 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.932 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.932 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.932 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.933 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.933 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.933 INFO:teuthology.orchestra.run.smithi044.stdout: "predictor_model": { 2024-08-19T00:24:11.933 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "predictor_model", 2024-08-19T00:24:11.933 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.933 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.933 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.933 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "prophetstor", 2024-08-19T00:24:11.934 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.934 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.934 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.934 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.934 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.934 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.934 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.934 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.935 INFO:teuthology.orchestra.run.smithi044.stdout: "sleep_interval": { 2024-08-19T00:24:11.935 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "sleep_interval", 2024-08-19T00:24:11.935 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.935 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.935 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.935 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "600", 2024-08-19T00:24:11.935 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.935 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.936 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.936 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.936 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.936 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.936 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.936 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.937 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.937 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.937 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:11.937 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "influx", 2024-08-19T00:24:11.937 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": false, 2024-08-19T00:24:11.937 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "influxdb python module not found", 2024-08-19T00:24:11.938 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:11.938 INFO:teuthology.orchestra.run.smithi044.stdout: "batch_size": { 2024-08-19T00:24:11.938 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "batch_size", 2024-08-19T00:24:11.938 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:11.938 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.939 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.939 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "5000", 2024-08-19T00:24:11.939 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.939 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.939 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.939 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-08-19T00:24:11.939 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.939 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.940 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.940 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.940 INFO:teuthology.orchestra.run.smithi044.stdout: "database": { 2024-08-19T00:24:11.940 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "database", 2024-08-19T00:24:11.940 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.940 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.940 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.940 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "ceph", 2024-08-19T00:24:11.941 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.941 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.941 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.941 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-08-19T00:24:11.941 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.941 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.941 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.941 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.941 INFO:teuthology.orchestra.run.smithi044.stdout: "hostname": { 2024-08-19T00:24:11.942 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "hostname", 2024-08-19T00:24:11.942 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.942 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.942 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.942 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.942 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.942 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.942 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.943 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "InfluxDB server hostname", 2024-08-19T00:24:11.943 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.943 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.943 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.943 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.943 INFO:teuthology.orchestra.run.smithi044.stdout: "interval": { 2024-08-19T00:24:11.943 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "interval", 2024-08-19T00:24:11.943 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", 2024-08-19T00:24:11.944 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.944 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.944 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "30", 2024-08-19T00:24:11.944 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "5", 2024-08-19T00:24:11.944 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.944 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.944 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-08-19T00:24:11.945 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.945 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.945 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.945 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.945 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:11.945 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:11.945 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.945 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.946 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.946 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.946 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.946 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.946 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.946 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.946 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.946 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.947 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.947 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.947 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.947 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.947 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.947 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.947 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.947 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.948 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.948 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:11.948 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:11.948 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.948 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.948 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.948 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.948 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.949 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.949 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.949 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.949 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.949 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.949 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.949 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.949 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:11.950 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:11.950 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.950 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.950 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.950 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:11.950 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.950 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.950 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.951 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.951 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.951 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.951 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.951 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.951 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.951 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.951 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.952 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.952 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.952 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.952 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.952 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:11.952 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:11.952 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.952 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.953 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.953 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.953 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.953 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.953 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.953 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.953 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.953 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.954 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.954 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.954 INFO:teuthology.orchestra.run.smithi044.stdout: "password": { 2024-08-19T00:24:11.954 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "password", 2024-08-19T00:24:11.954 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.954 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.954 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.954 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.955 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.955 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.955 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.955 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "password of InfluxDB server user", 2024-08-19T00:24:11.955 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.955 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.955 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.955 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.956 INFO:teuthology.orchestra.run.smithi044.stdout: "port": { 2024-08-19T00:24:11.956 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "port", 2024-08-19T00:24:11.956 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:11.956 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.956 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.956 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "8086", 2024-08-19T00:24:11.956 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.956 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.957 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.957 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "InfluxDB server port", 2024-08-19T00:24:11.957 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.957 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.957 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.957 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.957 INFO:teuthology.orchestra.run.smithi044.stdout: "ssl": { 2024-08-19T00:24:11.957 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "ssl", 2024-08-19T00:24:11.958 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.958 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.958 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.958 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "false", 2024-08-19T00:24:11.958 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.958 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.958 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.959 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-08-19T00:24:11.959 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.959 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.959 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.959 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.959 INFO:teuthology.orchestra.run.smithi044.stdout: "threads": { 2024-08-19T00:24:11.959 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "threads", 2024-08-19T00:24:11.959 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:11.960 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.960 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.960 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "5", 2024-08-19T00:24:11.960 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "1", 2024-08-19T00:24:11.960 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "32", 2024-08-19T00:24:11.960 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.961 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-08-19T00:24:11.961 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.961 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.961 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.961 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.961 INFO:teuthology.orchestra.run.smithi044.stdout: "username": { 2024-08-19T00:24:11.961 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "username", 2024-08-19T00:24:11.962 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.962 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.962 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.962 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.962 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.962 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.963 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.963 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "username of InfluxDB server user", 2024-08-19T00:24:11.963 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.963 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.963 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.963 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.963 INFO:teuthology.orchestra.run.smithi044.stdout: "verify_ssl": { 2024-08-19T00:24:11.963 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "verify_ssl", 2024-08-19T00:24:11.964 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.964 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.964 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.964 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "true", 2024-08-19T00:24:11.964 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.964 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.964 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.965 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-08-19T00:24:11.965 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.965 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.965 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.965 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.965 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.965 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.966 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:11.966 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "insights", 2024-08-19T00:24:11.966 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:11.966 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:11.966 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:11.966 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:11.967 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:11.967 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.967 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.967 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.967 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.967 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.967 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.968 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.968 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.968 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.968 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.968 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.968 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.968 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.969 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.969 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.969 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.969 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.969 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.969 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.969 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:11.970 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:11.970 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.970 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.970 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.970 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.970 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.971 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.971 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.971 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.971 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.971 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.971 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.972 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.972 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:11.972 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:11.972 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.972 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.972 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.972 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:11.973 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.973 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.973 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.973 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.973 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.973 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.973 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.973 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.974 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.974 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.974 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.974 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.974 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.974 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.974 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.975 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:11.975 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:11.975 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.975 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.975 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.975 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.976 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.976 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.976 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.976 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.976 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.976 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.976 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.977 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.977 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.977 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.977 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:11.977 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "iostat", 2024-08-19T00:24:11.977 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:11.977 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:11.977 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:11.978 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:11.978 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:11.978 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.978 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.978 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.978 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.978 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.979 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.979 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.979 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.979 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.979 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.979 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.979 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.979 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.980 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.980 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.980 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.980 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.980 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.980 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.980 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:11.980 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:11.981 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.981 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.981 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.981 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.981 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.981 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.981 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.982 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.982 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.982 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.982 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.982 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.982 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:11.982 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:11.983 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.983 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.983 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.983 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:11.983 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.983 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.983 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.983 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.984 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.984 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.984 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.984 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.984 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.984 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.984 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.984 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.984 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.985 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.985 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.985 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:11.985 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:11.985 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.985 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.985 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.985 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.985 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.986 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.986 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.986 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.986 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.986 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.986 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.986 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.986 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:11.987 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.987 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:11.987 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "k8sevents", 2024-08-19T00:24:11.987 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:11.987 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:11.987 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:11.987 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_event_retention_days": { 2024-08-19T00:24:11.988 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "ceph_event_retention_days", 2024-08-19T00:24:11.988 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:11.988 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.988 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.988 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "7", 2024-08-19T00:24:11.988 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.988 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.988 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.989 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Days to hold ceph event information within local cache", 2024-08-19T00:24:11.989 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.989 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.989 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.989 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.989 INFO:teuthology.orchestra.run.smithi044.stdout: "config_check_secs": { 2024-08-19T00:24:11.989 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "config_check_secs", 2024-08-19T00:24:11.989 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:11.990 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.990 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:11.990 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "10", 2024-08-19T00:24:11.990 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "10", 2024-08-19T00:24:11.990 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.990 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.990 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-08-19T00:24:11.991 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.991 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.991 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.991 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.991 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:11.991 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:11.991 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.991 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.992 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.992 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:11.992 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.992 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.992 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.992 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.992 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.992 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.993 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.993 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.993 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.993 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.993 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.993 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.993 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.993 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.993 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.994 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:11.994 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:11.994 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.994 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.994 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.994 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.994 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.995 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.995 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:11.995 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.995 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.995 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.995 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.995 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.995 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:11.995 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:11.996 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:11.996 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.996 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.996 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:11.996 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.996 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:11.996 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:11.997 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:11.997 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:11.997 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:11.997 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:11.997 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:11.997 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:11.997 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:11.997 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:11.998 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:11.998 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:11.998 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:11.998 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:11.998 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:11.998 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:11.999 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:11.999 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:11.999 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:11.999 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:11.999 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:11.999 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.000 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.000 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.000 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.000 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.000 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.000 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:12.001 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:12.001 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.001 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:12.001 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "localpool", 2024-08-19T00:24:12.001 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:12.001 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:12.001 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:12.001 INFO:teuthology.orchestra.run.smithi044.stdout: "failure_domain": { 2024-08-19T00:24:12.002 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "failure_domain", 2024-08-19T00:24:12.002 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.002 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.002 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.002 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "host", 2024-08-19T00:24:12.002 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.003 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.003 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.003 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "failure domain for any created local pool", 2024-08-19T00:24:12.003 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-08-19T00:24:12.003 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.003 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.003 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.003 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:12.004 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:12.004 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.004 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.004 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.004 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:12.004 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.006 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.006 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:12.006 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:12.007 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:12.007 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:12.007 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:12.007 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:12.007 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:12.008 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:12.008 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.008 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.008 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.008 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.008 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.008 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:12.009 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:12.009 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.009 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.009 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.009 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:12.009 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.010 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.010 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.010 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.010 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.010 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.010 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.011 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.011 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:12.011 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:12.011 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.011 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.011 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.011 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:12.012 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.012 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.012 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:12.012 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:12.012 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:12.012 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:12.012 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:12.012 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:12.013 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:12.013 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:12.013 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.013 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.013 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.013 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.013 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.013 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:12.014 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:12.014 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.014 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.014 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.014 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:12.014 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.014 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.014 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.015 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.015 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.015 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.015 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.015 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.015 INFO:teuthology.orchestra.run.smithi044.stdout: "min_size": { 2024-08-19T00:24:12.015 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "min_size", 2024-08-19T00:24:12.016 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:12.016 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.016 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.016 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:12.016 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.016 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.016 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.016 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "default min_size for any created local pool", 2024-08-19T00:24:12.016 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-08-19T00:24:12.017 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.017 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.017 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.017 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rep": { 2024-08-19T00:24:12.017 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "num_rep", 2024-08-19T00:24:12.017 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:12.017 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.017 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.018 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "3", 2024-08-19T00:24:12.018 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.018 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.018 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.018 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "default replica count for any created local pool", 2024-08-19T00:24:12.018 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.018 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.018 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.019 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.019 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_num": { 2024-08-19T00:24:12.019 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "pg_num", 2024-08-19T00:24:12.019 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:12.019 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.019 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.019 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "128", 2024-08-19T00:24:12.019 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.020 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.020 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.020 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "default pg_num for any created local pool", 2024-08-19T00:24:12.020 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.020 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.020 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.020 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.020 INFO:teuthology.orchestra.run.smithi044.stdout: "prefix": { 2024-08-19T00:24:12.021 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "prefix", 2024-08-19T00:24:12.021 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.021 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.021 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.021 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:12.021 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.021 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.021 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.021 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "name prefix for any created local pool", 2024-08-19T00:24:12.022 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.022 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.022 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.022 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.022 INFO:teuthology.orchestra.run.smithi044.stdout: "subtree": { 2024-08-19T00:24:12.022 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "subtree", 2024-08-19T00:24:12.022 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.022 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.023 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.023 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "rack", 2024-08-19T00:24:12.023 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.023 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.023 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.023 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "CRUSH level for which to create a local pool", 2024-08-19T00:24:12.023 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-08-19T00:24:12.023 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.024 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.024 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:12.024 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:12.024 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.024 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:12.024 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "mds_autoscaler", 2024-08-19T00:24:12.024 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:12.024 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:12.025 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:12.025 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:12.025 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:12.025 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.025 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.025 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.025 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:12.025 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.026 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.026 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:12.026 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:12.026 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:12.026 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:12.026 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:12.026 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:12.026 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:12.027 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:12.027 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.027 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.027 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.027 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.027 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.027 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:12.027 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:12.028 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.028 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.028 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.028 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:12.028 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.028 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.028 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.029 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.029 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.029 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.029 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.029 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.029 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:12.029 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:12.029 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.030 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.030 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.030 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:12.030 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.030 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.030 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:12.030 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:12.030 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:12.031 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:12.031 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:12.031 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:12.031 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:12.031 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:12.031 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.032 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.032 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.032 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.032 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.032 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:12.033 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:12.033 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.033 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.033 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.033 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:12.033 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.033 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.034 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.034 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.034 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.034 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.034 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.034 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:12.035 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:12.035 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.035 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:12.035 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "mirroring", 2024-08-19T00:24:12.035 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:12.035 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:12.035 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:12.036 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:12.036 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:12.036 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.036 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.036 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.036 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:12.036 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.037 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.037 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:12.037 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:12.037 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:12.037 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:12.037 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:12.038 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:12.038 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:12.038 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:12.038 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.038 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.038 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.039 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.039 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.039 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:12.039 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:12.039 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.039 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.039 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.040 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:12.040 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.040 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.040 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.040 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.040 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.040 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.041 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.041 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.041 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:12.041 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:12.041 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.041 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.042 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.042 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:12.042 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.042 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.042 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:12.043 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:12.043 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:12.043 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:12.043 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:12.043 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:12.043 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:12.043 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:12.044 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.044 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.044 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.044 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.044 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.044 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:12.044 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:12.044 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.045 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.045 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.045 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:12.045 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.045 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.045 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.045 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.045 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.046 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.046 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.046 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:12.046 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:12.046 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.046 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:12.046 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "nfs", 2024-08-19T00:24:12.046 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:12.047 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:12.047 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:12.047 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:12.047 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:12.047 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.047 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.047 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.047 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:12.048 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.048 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.048 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:12.048 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:12.048 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:12.048 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:12.048 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:12.049 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:12.049 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:12.049 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:12.049 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.049 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.049 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.049 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.049 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.049 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:12.050 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:12.050 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.050 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.050 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.050 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:12.050 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.050 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.051 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.051 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.051 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.051 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.051 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.051 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.051 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:12.051 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:12.052 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.052 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.052 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.052 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:12.052 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.052 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.052 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:12.052 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:12.053 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:12.053 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:12.053 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:12.053 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:12.053 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:12.053 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:12.053 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.054 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.054 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.054 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.054 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.054 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:12.054 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:12.054 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.054 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.055 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.055 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:12.055 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.055 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.055 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.055 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.055 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.056 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.056 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.056 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:12.056 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:12.056 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.056 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:12.056 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "orchestrator", 2024-08-19T00:24:12.056 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:12.057 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:12.057 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:12.057 INFO:teuthology.orchestra.run.smithi044.stdout: "fail_fs": { 2024-08-19T00:24:12.057 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "fail_fs", 2024-08-19T00:24:12.057 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.057 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.057 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:12.057 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:12.057 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.058 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.058 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.058 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-08-19T00:24:12.058 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.058 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.058 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.058 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.058 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:12.059 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:12.059 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.059 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.059 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.059 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:12.059 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.059 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.059 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:12.059 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:12.060 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:12.060 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:12.060 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:12.060 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:12.060 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:12.060 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:12.060 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.060 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.061 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.061 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.061 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.061 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:12.061 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:12.061 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.061 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.062 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.062 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:12.062 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.062 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.062 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.062 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.062 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.062 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.063 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.063 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.063 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:12.063 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:12.063 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.063 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.063 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.063 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:12.064 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.064 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.064 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:12.064 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:12.064 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:12.064 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:12.064 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:12.065 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:12.065 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:12.065 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:12.065 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.065 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.065 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.065 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.066 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.066 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:12.066 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:12.066 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.066 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.066 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.066 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:12.066 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.067 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.067 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.067 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.067 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.067 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.067 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.067 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.067 INFO:teuthology.orchestra.run.smithi044.stdout: "orchestrator": { 2024-08-19T00:24:12.068 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "orchestrator", 2024-08-19T00:24:12.068 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.068 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.068 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.068 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:12.068 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.068 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.069 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:12.069 INFO:teuthology.orchestra.run.smithi044.stdout: "cephadm", 2024-08-19T00:24:12.069 INFO:teuthology.orchestra.run.smithi044.stdout: "rook", 2024-08-19T00:24:12.069 INFO:teuthology.orchestra.run.smithi044.stdout: "test_orchestrator" 2024-08-19T00:24:12.069 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:12.069 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Orchestrator backend", 2024-08-19T00:24:12.069 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.069 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.070 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.070 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:12.070 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:12.070 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.070 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:12.070 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "osd_perf_query", 2024-08-19T00:24:12.070 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:12.070 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:12.071 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:12.071 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:12.071 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:12.071 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.071 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.071 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.071 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:12.072 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.072 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.072 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:12.072 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:12.072 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:12.072 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:12.072 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:12.072 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:12.072 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:12.073 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:12.073 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.073 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.073 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.073 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.073 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.073 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:12.073 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:12.074 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.074 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.074 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.074 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:12.074 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.074 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.074 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.074 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.075 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.075 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.075 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.075 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.075 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:12.075 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:12.075 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.075 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.076 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.076 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:12.076 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.076 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.076 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:12.076 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:12.076 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:12.076 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:12.076 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:12.077 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:12.077 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:12.077 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:12.077 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.077 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.077 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.077 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.077 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.078 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:12.078 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:12.078 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.078 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.078 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.078 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:12.078 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.078 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.079 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.079 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.079 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.079 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.079 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.079 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:12.079 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:12.079 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.080 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:12.080 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "osd_support", 2024-08-19T00:24:12.080 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:12.080 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:12.080 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:12.080 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:12.080 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:12.080 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.081 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.081 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.081 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:12.081 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.081 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.081 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:12.081 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:12.081 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:12.082 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:12.082 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:12.082 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:12.082 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:12.082 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:12.082 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.082 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.082 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.083 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.083 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.083 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:12.083 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:12.083 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.083 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.083 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.083 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:12.084 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.084 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.084 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.084 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.084 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.084 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.084 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.085 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.085 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:12.085 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:12.085 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.085 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.085 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.085 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:12.085 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.086 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.086 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:12.086 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:12.086 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:12.086 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:12.086 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:12.086 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:12.086 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:12.087 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:12.087 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.087 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.087 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.087 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.087 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.087 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:12.087 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:12.088 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.088 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.088 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.088 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:12.088 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.088 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.088 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.088 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.089 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.089 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.089 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.089 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:12.089 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:12.089 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.089 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:12.089 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "pg_autoscaler", 2024-08-19T00:24:12.090 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:12.090 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:12.090 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:12.090 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:12.090 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:12.090 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.090 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.091 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.091 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:12.091 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.091 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.091 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:12.091 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:12.091 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:12.091 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:12.092 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:12.092 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:12.092 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:12.092 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:12.092 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.092 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.092 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.092 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.093 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.093 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:12.093 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:12.093 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.093 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.093 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.093 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:12.093 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.094 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.094 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.094 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.094 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.094 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.094 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.094 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.094 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:12.094 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:12.095 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.095 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.095 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.095 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:12.095 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.095 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.095 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:12.096 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:12.096 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:12.096 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:12.096 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:12.096 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:12.096 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:12.096 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:12.096 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.097 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.097 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.097 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.097 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.097 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:12.097 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:12.097 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.098 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.098 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.098 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:12.098 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.098 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.098 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.098 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.099 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.099 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.099 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.099 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.099 INFO:teuthology.orchestra.run.smithi044.stdout: "sleep_interval": { 2024-08-19T00:24:12.099 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "sleep_interval", 2024-08-19T00:24:12.099 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", 2024-08-19T00:24:12.100 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.100 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:12.100 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "60", 2024-08-19T00:24:12.100 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.100 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.100 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.100 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.100 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.100 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.101 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.101 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.101 INFO:teuthology.orchestra.run.smithi044.stdout: "threshold": { 2024-08-19T00:24:12.101 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "threshold", 2024-08-19T00:24:12.101 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "float", 2024-08-19T00:24:12.101 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.101 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:12.102 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "3.0", 2024-08-19T00:24:12.102 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "1.0", 2024-08-19T00:24:12.102 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.102 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.102 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "scaling threshold", 2024-08-19T00:24:12.102 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-08-19T00:24:12.102 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.103 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.103 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:12.103 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:12.103 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.103 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:12.103 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "progress", 2024-08-19T00:24:12.103 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:12.104 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:12.104 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:12.104 INFO:teuthology.orchestra.run.smithi044.stdout: "allow_pg_recovery_event": { 2024-08-19T00:24:12.104 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "allow_pg_recovery_event", 2024-08-19T00:24:12.104 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.104 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.104 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.104 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:12.105 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.105 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.105 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.105 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "allow the module to show pg recovery progress", 2024-08-19T00:24:12.105 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.105 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.105 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.105 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.106 INFO:teuthology.orchestra.run.smithi044.stdout: "enabled": { 2024-08-19T00:24:12.106 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "enabled", 2024-08-19T00:24:12.106 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.106 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.106 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:12.106 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:12.106 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.107 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.107 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.107 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.107 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.107 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.107 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.107 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.107 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:12.108 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:12.108 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.108 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.108 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.108 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:12.108 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.108 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.108 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:12.109 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:12.109 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:12.109 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:12.109 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:12.109 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:12.109 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:12.109 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:12.109 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.110 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.110 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.110 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.110 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.110 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:12.110 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:12.110 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.110 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.111 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.111 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:12.111 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.111 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.111 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.111 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.111 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.111 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.112 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.112 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.112 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:12.112 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:12.112 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.112 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.112 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.112 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:12.113 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.113 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.113 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:12.113 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:12.113 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:12.113 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:12.113 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:12.113 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:12.114 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:12.114 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:12.114 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.114 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.114 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.114 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.114 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.114 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:12.115 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:12.115 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.115 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.115 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.115 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:12.115 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.115 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.115 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.116 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.116 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.116 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.116 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.116 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.116 INFO:teuthology.orchestra.run.smithi044.stdout: "max_completed_events": { 2024-08-19T00:24:12.116 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "max_completed_events", 2024-08-19T00:24:12.116 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:12.116 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.117 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.117 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "50", 2024-08-19T00:24:12.117 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.117 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.117 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.117 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "number of past completed events to remember", 2024-08-19T00:24:12.117 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.117 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.117 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.118 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.118 INFO:teuthology.orchestra.run.smithi044.stdout: "sleep_interval": { 2024-08-19T00:24:12.118 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "sleep_interval", 2024-08-19T00:24:12.118 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", 2024-08-19T00:24:12.118 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.118 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.118 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "5", 2024-08-19T00:24:12.118 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.119 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.119 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.119 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "how long the module is going to sleep", 2024-08-19T00:24:12.119 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.119 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.119 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.119 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:12.119 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:12.120 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.120 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:12.120 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "prometheus", 2024-08-19T00:24:12.120 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:12.120 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:12.120 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:12.120 INFO:teuthology.orchestra.run.smithi044.stdout: "cache": { 2024-08-19T00:24:12.120 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "cache", 2024-08-19T00:24:12.121 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.121 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.121 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:12.121 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:12.121 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.121 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.121 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.121 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.122 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.122 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.122 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.122 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.122 INFO:teuthology.orchestra.run.smithi044.stdout: "exclude_perf_counters": { 2024-08-19T00:24:12.122 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "exclude_perf_counters", 2024-08-19T00:24:12.122 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.122 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.122 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.126 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:12.126 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.126 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.126 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.126 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-08-19T00:24:12.127 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-08-19T00:24:12.127 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.127 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.127 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.127 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:12.127 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:12.127 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.127 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.128 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.128 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:12.128 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.128 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.128 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:12.128 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:12.128 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:12.128 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:12.129 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:12.129 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:12.129 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:12.129 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:12.129 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.129 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.129 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.129 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.130 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.130 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:12.130 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:12.130 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.130 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.130 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.130 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:12.130 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.131 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.131 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.131 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.131 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.131 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.131 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.131 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.132 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:12.132 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:12.132 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.132 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.132 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.132 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:12.132 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.132 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.133 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:12.133 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:12.133 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:12.133 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:12.133 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:12.133 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:12.133 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:12.133 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:12.133 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.134 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.134 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.134 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.134 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.134 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:12.134 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:12.134 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.134 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.135 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.135 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:12.135 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.135 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.135 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.135 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.135 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.135 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.135 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.136 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.136 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_stats_pools": { 2024-08-19T00:24:12.136 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "rbd_stats_pools", 2024-08-19T00:24:12.136 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.136 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.136 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:12.136 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:12.136 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.136 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.137 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.137 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.137 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.137 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.137 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.137 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.137 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_stats_pools_refresh_interval": { 2024-08-19T00:24:12.137 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-08-19T00:24:12.137 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:12.138 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.138 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:12.138 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "300", 2024-08-19T00:24:12.138 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.138 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.138 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.138 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.138 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.139 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.139 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.139 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.139 INFO:teuthology.orchestra.run.smithi044.stdout: "scrape_interval": { 2024-08-19T00:24:12.139 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "scrape_interval", 2024-08-19T00:24:12.139 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "float", 2024-08-19T00:24:12.139 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.139 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:12.139 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "15.0", 2024-08-19T00:24:12.140 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.140 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.140 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.140 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.140 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.140 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.140 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.140 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.141 INFO:teuthology.orchestra.run.smithi044.stdout: "server_addr": { 2024-08-19T00:24:12.141 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "server_addr", 2024-08-19T00:24:12.141 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.141 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.141 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:12.141 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "::", 2024-08-19T00:24:12.141 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.141 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.142 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.142 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-08-19T00:24:12.142 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.142 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.142 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.142 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.142 INFO:teuthology.orchestra.run.smithi044.stdout: "server_port": { 2024-08-19T00:24:12.142 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "server_port", 2024-08-19T00:24:12.143 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:12.143 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.143 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.143 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "9283", 2024-08-19T00:24:12.143 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.143 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.143 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.144 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-08-19T00:24:12.144 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.144 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.144 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.144 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.144 INFO:teuthology.orchestra.run.smithi044.stdout: "stale_cache_strategy": { 2024-08-19T00:24:12.144 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "stale_cache_strategy", 2024-08-19T00:24:12.144 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.145 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.145 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:12.145 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "log", 2024-08-19T00:24:12.145 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.145 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.145 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.145 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.146 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.146 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.146 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.146 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.146 INFO:teuthology.orchestra.run.smithi044.stdout: "standby_behaviour": { 2024-08-19T00:24:12.146 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "standby_behaviour", 2024-08-19T00:24:12.146 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.147 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.147 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.147 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "default", 2024-08-19T00:24:12.147 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.147 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.147 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:12.148 INFO:teuthology.orchestra.run.smithi044.stdout: "default", 2024-08-19T00:24:12.148 INFO:teuthology.orchestra.run.smithi044.stdout: "error" 2024-08-19T00:24:12.148 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:12.148 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.148 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.148 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.149 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.149 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.149 INFO:teuthology.orchestra.run.smithi044.stdout: "standby_error_status_code": { 2024-08-19T00:24:12.149 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "standby_error_status_code", 2024-08-19T00:24:12.149 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:12.149 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.150 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.150 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "500", 2024-08-19T00:24:12.150 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "400", 2024-08-19T00:24:12.150 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "599", 2024-08-19T00:24:12.150 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.150 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.151 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.151 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.151 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.151 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:12.151 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:12.151 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.151 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:12.152 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "rbd_support", 2024-08-19T00:24:12.152 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:12.152 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:12.152 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:12.152 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:12.152 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:12.153 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.153 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.153 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.153 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:12.153 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.153 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.153 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:12.153 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:12.154 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:12.154 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:12.154 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:12.154 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:12.154 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:12.154 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:12.154 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.154 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.155 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.155 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.155 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.155 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:12.155 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:12.155 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.155 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.156 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.156 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:12.156 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.156 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.156 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.156 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.156 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.156 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.157 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.157 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.157 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:12.157 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:12.157 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.157 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.157 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.157 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:12.158 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.158 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.158 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:12.158 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:12.158 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:12.158 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:12.158 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:12.159 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:12.159 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:12.159 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:12.159 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.159 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.159 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.159 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.159 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.159 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:12.160 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:12.160 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.160 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.160 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.160 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:12.160 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.160 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.161 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.161 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.161 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.161 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.161 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.161 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.161 INFO:teuthology.orchestra.run.smithi044.stdout: "max_concurrent_snap_create": { 2024-08-19T00:24:12.161 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "max_concurrent_snap_create", 2024-08-19T00:24:12.162 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:12.162 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.162 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:12.162 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "10", 2024-08-19T00:24:12.162 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.162 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.162 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.162 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.163 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.163 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.163 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.163 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.163 INFO:teuthology.orchestra.run.smithi044.stdout: "mirror_snapshot_schedule": { 2024-08-19T00:24:12.163 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "mirror_snapshot_schedule", 2024-08-19T00:24:12.163 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.163 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.164 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:12.164 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:12.164 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.164 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.164 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.164 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.164 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.164 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.165 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.165 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.165 INFO:teuthology.orchestra.run.smithi044.stdout: "trash_purge_schedule": { 2024-08-19T00:24:12.165 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "trash_purge_schedule", 2024-08-19T00:24:12.165 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.165 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.165 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:12.165 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:12.165 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.166 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.166 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.166 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.166 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.166 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.166 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.166 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:12.166 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:12.167 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.167 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:12.167 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "restful", 2024-08-19T00:24:12.167 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:12.167 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:12.167 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:12.167 INFO:teuthology.orchestra.run.smithi044.stdout: "enable_auth": { 2024-08-19T00:24:12.168 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "enable_auth", 2024-08-19T00:24:12.168 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.168 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.168 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:12.168 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:12.168 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.168 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.168 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.169 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.169 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.169 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.169 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.169 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.169 INFO:teuthology.orchestra.run.smithi044.stdout: "key_file": { 2024-08-19T00:24:12.169 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "key_file", 2024-08-19T00:24:12.169 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.170 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.170 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:12.170 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:12.170 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.170 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.170 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.170 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.170 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.171 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.171 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.171 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.171 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:12.171 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:12.171 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.171 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.171 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.172 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:12.172 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.172 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.172 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:12.172 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:12.172 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:12.172 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:12.172 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:12.173 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:12.173 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:12.173 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:12.173 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.173 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.173 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.173 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.173 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.173 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:12.174 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:12.174 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.174 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.174 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.174 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:12.174 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.174 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.174 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.175 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.175 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.175 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.175 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.175 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.175 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:12.175 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:12.176 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.176 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.176 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.176 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:12.176 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.176 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.176 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:12.176 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:12.176 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:12.177 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:12.177 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:12.177 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:12.177 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:12.177 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:12.177 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.177 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.177 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.178 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.178 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.178 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:12.178 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:12.178 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.178 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.178 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.179 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:12.179 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.179 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.179 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.179 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.179 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.179 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.179 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.180 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.180 INFO:teuthology.orchestra.run.smithi044.stdout: "server_addr": { 2024-08-19T00:24:12.180 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "server_addr", 2024-08-19T00:24:12.180 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.180 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.180 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:12.180 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:12.180 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.181 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.181 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.181 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.181 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.181 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.181 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.181 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.182 INFO:teuthology.orchestra.run.smithi044.stdout: "server_port": { 2024-08-19T00:24:12.182 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "server_port", 2024-08-19T00:24:12.182 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.182 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.182 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:12.182 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:12.182 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.183 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.183 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.183 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.183 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.183 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.183 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.183 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:12.183 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:12.184 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.184 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:12.184 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "rgw", 2024-08-19T00:24:12.184 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:12.184 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:12.184 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:12.184 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:12.185 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:12.185 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.185 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.185 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.185 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:12.185 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.185 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.185 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:12.186 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:12.186 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:12.186 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:12.186 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:12.186 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:12.186 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:12.186 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:12.187 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.187 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.187 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.187 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.187 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.187 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:12.187 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:12.187 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.188 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.188 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.188 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:12.188 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.188 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.188 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.188 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.189 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.189 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.189 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.189 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.189 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:12.189 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:12.189 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.189 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.190 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.190 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:12.190 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.190 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.190 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:12.190 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:12.190 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:12.190 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:12.191 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:12.191 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:12.191 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:12.191 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:12.191 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.191 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.191 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.191 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.192 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.192 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:12.192 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:12.192 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.192 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.192 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.192 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:12.192 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.193 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.193 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.193 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.193 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.193 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.193 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.193 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:12.194 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:12.194 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.194 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:12.194 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "rook", 2024-08-19T00:24:12.194 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:12.194 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:12.194 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:12.194 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:12.195 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:12.195 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.195 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.195 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.195 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:12.195 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.195 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.195 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:12.196 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:12.196 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:12.196 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:12.196 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:12.196 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:12.196 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:12.196 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:12.196 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.197 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.197 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.197 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.197 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.197 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:12.197 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:12.197 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.197 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.198 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.198 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:12.198 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.198 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.198 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.198 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.198 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.198 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.199 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.199 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.199 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:12.199 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:12.199 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.199 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.199 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.199 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:12.200 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.200 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.200 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:12.200 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:12.200 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:12.200 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:12.200 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:12.200 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:12.201 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:12.201 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:12.201 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.201 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.201 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.201 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.201 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.201 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:12.202 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:12.202 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.202 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.202 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.202 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:12.202 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.202 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.202 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.203 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.203 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.203 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.203 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.203 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.203 INFO:teuthology.orchestra.run.smithi044.stdout: "storage_class": { 2024-08-19T00:24:12.203 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "storage_class", 2024-08-19T00:24:12.203 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.204 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.204 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:12.204 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "local", 2024-08-19T00:24:12.204 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.204 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.204 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.204 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-08-19T00:24:12.205 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.205 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.205 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.205 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:12.205 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:12.205 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.205 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:12.205 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "selftest", 2024-08-19T00:24:12.206 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:12.206 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:12.206 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:12.206 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:12.206 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:12.206 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.206 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.206 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.207 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:12.207 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.207 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.207 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:12.207 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:12.207 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:12.207 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:12.207 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:12.208 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:12.208 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:12.208 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:12.208 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.208 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.208 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.208 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.209 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.209 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:12.209 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:12.209 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.209 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.209 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.209 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:12.209 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.210 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.210 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.210 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.210 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.210 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.210 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.210 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.211 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:12.211 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:12.211 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.211 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.211 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.211 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:12.211 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.212 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.212 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:12.212 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:12.212 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:12.212 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:12.212 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:12.212 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:12.212 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:12.213 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:12.213 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.213 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.213 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.213 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.213 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.213 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:12.213 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:12.214 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.214 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.214 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.214 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:12.214 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.214 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.214 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.215 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.215 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.215 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.215 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.215 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.215 INFO:teuthology.orchestra.run.smithi044.stdout: "roption1": { 2024-08-19T00:24:12.215 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "roption1", 2024-08-19T00:24:12.215 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.216 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.216 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:12.216 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:12.216 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.216 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.216 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.216 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.216 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.217 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.217 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.217 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.217 INFO:teuthology.orchestra.run.smithi044.stdout: "roption2": { 2024-08-19T00:24:12.217 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "roption2", 2024-08-19T00:24:12.217 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.217 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.217 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:12.218 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "xyz", 2024-08-19T00:24:12.218 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.218 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.218 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.218 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.218 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.218 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.218 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.219 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.219 INFO:teuthology.orchestra.run.smithi044.stdout: "rwoption1": { 2024-08-19T00:24:12.219 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "rwoption1", 2024-08-19T00:24:12.219 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.219 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.219 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:12.219 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:12.219 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.219 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.220 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.220 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.220 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.220 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.220 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.220 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.220 INFO:teuthology.orchestra.run.smithi044.stdout: "rwoption2": { 2024-08-19T00:24:12.220 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "rwoption2", 2024-08-19T00:24:12.221 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:12.221 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.221 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:12.221 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:12.221 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.221 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.221 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.221 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.221 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.222 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.222 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.222 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.222 INFO:teuthology.orchestra.run.smithi044.stdout: "rwoption3": { 2024-08-19T00:24:12.222 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "rwoption3", 2024-08-19T00:24:12.222 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "float", 2024-08-19T00:24:12.222 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.223 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:12.223 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:12.223 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.223 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.223 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.223 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.223 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.223 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.224 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.224 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.224 INFO:teuthology.orchestra.run.smithi044.stdout: "rwoption4": { 2024-08-19T00:24:12.224 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "rwoption4", 2024-08-19T00:24:12.224 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.224 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.224 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:12.224 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:12.224 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.225 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.225 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.225 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.225 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.225 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.225 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.225 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.225 INFO:teuthology.orchestra.run.smithi044.stdout: "rwoption5": { 2024-08-19T00:24:12.226 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "rwoption5", 2024-08-19T00:24:12.226 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.226 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.226 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:12.226 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:12.226 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.226 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.226 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.227 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.227 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.227 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.227 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.227 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.227 INFO:teuthology.orchestra.run.smithi044.stdout: "rwoption6": { 2024-08-19T00:24:12.227 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "rwoption6", 2024-08-19T00:24:12.227 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.228 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.228 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:12.228 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:12.228 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.228 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.228 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.228 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.228 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.228 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.229 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.229 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.229 INFO:teuthology.orchestra.run.smithi044.stdout: "rwoption7": { 2024-08-19T00:24:12.229 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "rwoption7", 2024-08-19T00:24:12.229 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:12.229 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.229 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:12.229 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:12.230 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "1", 2024-08-19T00:24:12.230 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "42", 2024-08-19T00:24:12.230 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.230 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.230 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.230 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.230 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.230 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.231 INFO:teuthology.orchestra.run.smithi044.stdout: "testkey": { 2024-08-19T00:24:12.231 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "testkey", 2024-08-19T00:24:12.231 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.231 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.231 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:12.231 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:12.231 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.231 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.231 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.232 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.232 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.232 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.232 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.232 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.232 INFO:teuthology.orchestra.run.smithi044.stdout: "testlkey": { 2024-08-19T00:24:12.232 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "testlkey", 2024-08-19T00:24:12.232 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.233 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.233 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:12.233 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:12.233 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.233 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.233 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.233 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.233 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.233 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.234 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.234 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.234 INFO:teuthology.orchestra.run.smithi044.stdout: "testnewline": { 2024-08-19T00:24:12.234 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "testnewline", 2024-08-19T00:24:12.234 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.234 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.234 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:12.234 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:12.235 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.235 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.235 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.235 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.235 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.235 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.235 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.236 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:12.236 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:12.236 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.236 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:12.236 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "snap_schedule", 2024-08-19T00:24:12.236 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:12.236 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:12.236 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:12.237 INFO:teuthology.orchestra.run.smithi044.stdout: "allow_m_granularity": { 2024-08-19T00:24:12.237 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "allow_m_granularity", 2024-08-19T00:24:12.237 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.237 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.237 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.237 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:12.237 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.237 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.238 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.238 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "allow minute scheduled snapshots", 2024-08-19T00:24:12.238 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.238 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.238 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.238 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.238 INFO:teuthology.orchestra.run.smithi044.stdout: "dump_on_update": { 2024-08-19T00:24:12.239 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "dump_on_update", 2024-08-19T00:24:12.239 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.239 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.239 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.239 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:12.239 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.239 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.239 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.240 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "dump database to debug log on update", 2024-08-19T00:24:12.240 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.240 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.240 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.240 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.240 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:12.240 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:12.240 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.240 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.240 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.241 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:12.241 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.241 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.241 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:12.241 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:12.241 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:12.241 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:12.241 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:12.242 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:12.242 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:12.242 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:12.242 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.242 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.242 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.242 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.243 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.243 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:12.243 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:12.243 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.243 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.243 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.244 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:12.244 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.244 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.244 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.244 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.244 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.244 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.245 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.245 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.245 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:12.245 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:12.245 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.245 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.246 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.246 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:12.246 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.246 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.246 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:12.246 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:12.247 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:12.247 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:12.247 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:12.247 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:12.247 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:12.247 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:12.247 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.247 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.248 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.248 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.248 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.248 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:12.248 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:12.248 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.248 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.249 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.249 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:12.249 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.249 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.249 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.249 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.249 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.250 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.250 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.250 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:12.250 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:12.250 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.250 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:12.250 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "stats", 2024-08-19T00:24:12.251 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:12.251 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:12.251 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:12.251 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:12.251 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:12.251 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.251 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.252 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.252 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:12.252 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.252 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.252 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:12.252 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:12.252 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:12.253 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:12.253 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:12.253 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:12.253 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:12.253 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:12.253 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.254 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.254 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.254 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.254 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.254 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:12.254 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:12.255 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.255 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.255 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.255 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:12.255 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.255 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.256 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.256 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.256 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.256 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.256 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.256 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.257 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:12.257 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:12.257 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.257 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.257 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.257 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:12.257 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.257 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.258 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:12.258 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:12.258 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:12.258 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:12.258 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:12.258 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:12.258 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:12.258 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:12.259 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.259 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.259 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.259 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.259 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.259 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:12.259 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:12.259 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.260 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.260 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.260 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:12.260 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.260 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.260 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.260 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.260 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.261 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.261 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.261 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:12.261 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:12.261 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.261 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:12.261 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "status", 2024-08-19T00:24:12.262 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:12.262 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:12.262 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:12.262 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:12.262 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:12.262 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.262 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.262 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.263 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:12.263 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.263 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.263 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:12.263 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:12.263 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:12.263 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:12.263 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:12.264 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:12.264 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:12.264 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:12.264 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.264 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.264 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.264 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.264 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.265 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:12.265 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:12.265 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.265 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.265 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.265 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:12.265 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.265 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.266 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.266 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.266 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.266 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.266 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.266 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.266 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:12.266 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:12.267 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.267 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.267 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.267 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:12.267 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.267 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.267 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:12.267 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:12.268 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:12.268 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:12.268 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:12.268 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:12.268 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:12.268 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:12.268 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.268 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.269 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.269 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.269 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.269 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:12.269 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:12.269 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.269 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.269 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.270 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:12.270 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.270 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.270 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.270 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.270 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.270 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.270 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.271 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:12.271 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:12.271 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.271 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:12.271 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "telegraf", 2024-08-19T00:24:12.271 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:12.271 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:12.271 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:12.272 INFO:teuthology.orchestra.run.smithi044.stdout: "address": { 2024-08-19T00:24:12.272 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "address", 2024-08-19T00:24:12.272 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.272 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.272 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:12.272 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-08-19T00:24:12.272 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.272 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.273 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.273 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.273 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.273 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.273 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.273 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.273 INFO:teuthology.orchestra.run.smithi044.stdout: "interval": { 2024-08-19T00:24:12.273 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "interval", 2024-08-19T00:24:12.274 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", 2024-08-19T00:24:12.274 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.274 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:12.274 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "15", 2024-08-19T00:24:12.274 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.274 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.274 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.274 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.275 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.275 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.275 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.275 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.275 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:12.275 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:12.275 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.275 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.275 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.276 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:12.276 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.276 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.276 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:12.276 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:12.276 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:12.276 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:12.276 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:12.276 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:12.277 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:12.277 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:12.277 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.277 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.277 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.277 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.277 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.277 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:12.278 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:12.278 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.278 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.278 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.278 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:12.278 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.278 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.278 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.279 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.279 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.279 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.279 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.279 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.279 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:12.279 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:12.280 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.280 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.280 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.280 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:12.280 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.280 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.280 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:12.280 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:12.281 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:12.281 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:12.281 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:12.281 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:12.281 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:12.281 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:12.281 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.281 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.282 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.282 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.282 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.282 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:12.282 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:12.282 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.282 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.282 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.283 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:12.283 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.283 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.283 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.283 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.283 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.284 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.284 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.284 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:12.284 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:12.284 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.284 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:12.284 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "telemetry", 2024-08-19T00:24:12.284 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:12.284 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:12.285 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:12.285 INFO:teuthology.orchestra.run.smithi044.stdout: "channel_basic": { 2024-08-19T00:24:12.285 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "channel_basic", 2024-08-19T00:24:12.285 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.285 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.285 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:12.286 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:12.286 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.286 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.286 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.286 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Share basic cluster information (size, version)", 2024-08-19T00:24:12.286 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.286 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.286 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.287 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.287 INFO:teuthology.orchestra.run.smithi044.stdout: "channel_crash": { 2024-08-19T00:24:12.287 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "channel_crash", 2024-08-19T00:24:12.287 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.287 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.287 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:12.287 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:12.287 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.288 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.288 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.288 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-08-19T00:24:12.288 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.288 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.288 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.288 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.289 INFO:teuthology.orchestra.run.smithi044.stdout: "channel_device": { 2024-08-19T00:24:12.289 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "channel_device", 2024-08-19T00:24:12.289 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.289 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.289 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:12.289 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:12.290 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.290 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.290 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.290 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-08-19T00:24:12.290 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.290 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.290 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.291 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.291 INFO:teuthology.orchestra.run.smithi044.stdout: "channel_ident": { 2024-08-19T00:24:12.291 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "channel_ident", 2024-08-19T00:24:12.291 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.291 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.291 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:12.291 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:12.292 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.292 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.292 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.292 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-08-19T00:24:12.292 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.292 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.292 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.292 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.293 INFO:teuthology.orchestra.run.smithi044.stdout: "channel_perf": { 2024-08-19T00:24:12.293 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "channel_perf", 2024-08-19T00:24:12.293 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.293 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.293 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:12.293 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:12.293 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.294 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.294 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.294 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Share various performance metrics of a cluster", 2024-08-19T00:24:12.294 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.294 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.294 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.294 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.294 INFO:teuthology.orchestra.run.smithi044.stdout: "contact": { 2024-08-19T00:24:12.295 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "contact", 2024-08-19T00:24:12.295 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.295 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.295 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:12.295 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:12.295 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.295 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.295 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.296 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.296 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.296 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.296 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.296 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.296 INFO:teuthology.orchestra.run.smithi044.stdout: "description": { 2024-08-19T00:24:12.296 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "description", 2024-08-19T00:24:12.296 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.297 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.297 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:12.297 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:12.297 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.297 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.297 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.297 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.297 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.298 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.298 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.298 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.298 INFO:teuthology.orchestra.run.smithi044.stdout: "device_url": { 2024-08-19T00:24:12.298 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "device_url", 2024-08-19T00:24:12.298 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.298 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.299 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:12.299 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-08-19T00:24:12.299 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.299 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.299 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.299 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.299 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.299 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.299 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.300 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.300 INFO:teuthology.orchestra.run.smithi044.stdout: "enabled": { 2024-08-19T00:24:12.300 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "enabled", 2024-08-19T00:24:12.300 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.300 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.300 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:12.300 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:12.301 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.301 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.301 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.301 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.301 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.301 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.301 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.301 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.302 INFO:teuthology.orchestra.run.smithi044.stdout: "interval": { 2024-08-19T00:24:12.302 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "interval", 2024-08-19T00:24:12.302 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:12.302 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.302 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:12.302 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "24", 2024-08-19T00:24:12.302 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "8", 2024-08-19T00:24:12.302 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.303 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.303 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.303 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.303 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.303 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.303 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.303 INFO:teuthology.orchestra.run.smithi044.stdout: "last_opt_revision": { 2024-08-19T00:24:12.303 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "last_opt_revision", 2024-08-19T00:24:12.304 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:12.304 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.304 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:12.304 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "1", 2024-08-19T00:24:12.304 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.304 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.304 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.304 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.305 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.305 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.305 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.305 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.305 INFO:teuthology.orchestra.run.smithi044.stdout: "leaderboard": { 2024-08-19T00:24:12.305 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "leaderboard", 2024-08-19T00:24:12.305 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.306 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.306 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:12.306 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:12.306 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.306 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.306 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.306 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.307 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.307 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.307 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.307 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.307 INFO:teuthology.orchestra.run.smithi044.stdout: "leaderboard_description": { 2024-08-19T00:24:12.307 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "leaderboard_description", 2024-08-19T00:24:12.307 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.307 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.308 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:12.308 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:12.308 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.308 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.308 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.308 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.308 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.308 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.309 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.309 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.309 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:12.309 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:12.309 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.309 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.309 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.309 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:12.310 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.310 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.310 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:12.310 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:12.310 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:12.310 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:12.310 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:12.310 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:12.310 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:12.311 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:12.311 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.311 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.311 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.311 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.311 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.311 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:12.311 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:12.312 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.312 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.312 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.312 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:12.312 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.312 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.312 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.312 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.313 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.313 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.313 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.313 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.313 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:12.313 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:12.313 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.313 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.314 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.314 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:12.314 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.314 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.314 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:12.314 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:12.314 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:12.314 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:12.315 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:12.315 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:12.315 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:12.315 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:12.315 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.315 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.315 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.315 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.316 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.316 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:12.316 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:12.316 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.316 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.316 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.316 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:12.316 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.316 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.317 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.317 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.317 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.317 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.317 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.317 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.317 INFO:teuthology.orchestra.run.smithi044.stdout: "organization": { 2024-08-19T00:24:12.317 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "organization", 2024-08-19T00:24:12.318 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.318 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.318 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:12.318 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:12.318 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.318 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.318 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.318 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.319 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.319 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.319 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.319 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.319 INFO:teuthology.orchestra.run.smithi044.stdout: "proxy": { 2024-08-19T00:24:12.319 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "proxy", 2024-08-19T00:24:12.320 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.320 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.320 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:12.320 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:12.320 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.320 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.320 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.320 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.321 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.321 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.321 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.321 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.321 INFO:teuthology.orchestra.run.smithi044.stdout: "url": { 2024-08-19T00:24:12.321 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "url", 2024-08-19T00:24:12.322 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.322 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.322 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:12.322 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-08-19T00:24:12.322 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.322 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.322 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.323 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.323 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.323 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.323 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.323 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:12.323 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:12.324 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.324 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:12.324 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "test_orchestrator", 2024-08-19T00:24:12.324 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:12.324 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:12.324 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:12.324 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:12.325 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:12.325 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.325 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.325 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.325 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:12.325 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.325 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.326 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:12.326 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:12.326 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:12.326 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:12.326 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:12.326 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:12.330 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:12.330 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:12.330 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.330 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.331 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.331 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.331 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.331 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:12.331 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:12.331 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.331 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.331 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.332 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:12.332 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.332 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.332 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.332 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.332 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.332 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.332 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.333 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.333 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:12.333 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:12.333 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.333 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.333 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.333 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:12.333 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.334 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.334 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:12.334 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:12.334 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:12.334 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:12.334 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:12.334 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:12.334 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:12.335 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:12.335 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.335 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.335 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.335 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.335 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.335 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:12.335 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:12.335 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.336 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.336 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.336 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:12.336 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.336 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.336 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.336 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.336 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.337 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.337 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.337 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:12.337 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:12.337 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.337 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:12.337 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "volumes", 2024-08-19T00:24:12.337 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:12.338 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:12.338 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:12.338 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:12.338 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:12.338 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.338 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.338 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.338 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:12.339 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.339 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.339 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:12.339 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:12.339 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:12.339 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:12.339 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:12.339 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:12.339 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:12.340 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:12.340 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.340 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.340 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.340 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.340 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.340 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:12.340 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:12.341 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.341 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.341 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.341 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:12.341 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.341 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.341 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.341 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.342 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.342 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.342 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.342 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.342 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:12.342 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:12.342 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.342 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.343 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.343 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:12.343 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.343 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.343 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:12.343 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:12.343 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:12.343 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:12.344 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:12.344 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:12.344 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:12.344 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:12.344 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.344 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.344 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.344 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.345 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.345 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:12.345 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:12.345 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.345 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.345 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.345 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:12.345 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.345 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.346 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.346 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.346 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.346 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.346 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.346 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.346 INFO:teuthology.orchestra.run.smithi044.stdout: "max_concurrent_clones": { 2024-08-19T00:24:12.346 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "max_concurrent_clones", 2024-08-19T00:24:12.347 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:12.347 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.347 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:12.347 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "4", 2024-08-19T00:24:12.347 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.347 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.347 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.347 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Number of asynchronous cloner threads", 2024-08-19T00:24:12.348 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.348 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.348 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.348 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.348 INFO:teuthology.orchestra.run.smithi044.stdout: "periodic_async_work": { 2024-08-19T00:24:12.348 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "periodic_async_work", 2024-08-19T00:24:12.348 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.348 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.349 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:12.349 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:12.349 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.349 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.349 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.349 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Periodically check for async work", 2024-08-19T00:24:12.349 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.349 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.350 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.350 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.350 INFO:teuthology.orchestra.run.smithi044.stdout: "snapshot_clone_delay": { 2024-08-19T00:24:12.350 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "snapshot_clone_delay", 2024-08-19T00:24:12.350 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:12.350 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.350 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:12.350 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "0", 2024-08-19T00:24:12.351 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.351 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.351 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.351 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-08-19T00:24:12.351 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.351 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.351 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.351 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.351 INFO:teuthology.orchestra.run.smithi044.stdout: "snapshot_clone_no_wait": { 2024-08-19T00:24:12.352 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "snapshot_clone_no_wait", 2024-08-19T00:24:12.352 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.352 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.352 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:12.352 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", 2024-08-19T00:24:12.352 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.352 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.352 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.353 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-08-19T00:24:12.353 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.353 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.353 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.353 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:12.353 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:12.353 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.353 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:12.354 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "zabbix", 2024-08-19T00:24:12.354 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, 2024-08-19T00:24:12.354 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", 2024-08-19T00:24:12.354 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": { 2024-08-19T00:24:12.354 INFO:teuthology.orchestra.run.smithi044.stdout: "discovery_interval": { 2024-08-19T00:24:12.354 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "discovery_interval", 2024-08-19T00:24:12.354 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "uint", 2024-08-19T00:24:12.354 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.355 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:12.355 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "100", 2024-08-19T00:24:12.355 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.355 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.355 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.355 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.355 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.355 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.356 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.356 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.356 INFO:teuthology.orchestra.run.smithi044.stdout: "identifier": { 2024-08-19T00:24:12.356 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "identifier", 2024-08-19T00:24:12.356 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.356 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.356 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:12.356 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:12.356 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.357 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.357 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.357 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.357 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.357 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.357 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.357 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.357 INFO:teuthology.orchestra.run.smithi044.stdout: "interval": { 2024-08-19T00:24:12.358 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "interval", 2024-08-19T00:24:12.358 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", 2024-08-19T00:24:12.358 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.358 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:12.358 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "60", 2024-08-19T00:24:12.358 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.358 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.358 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.359 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.359 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.359 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.359 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.359 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.359 INFO:teuthology.orchestra.run.smithi044.stdout: "log_level": { 2024-08-19T00:24:12.359 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_level", 2024-08-19T00:24:12.359 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.360 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.360 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.360 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:12.360 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.360 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.360 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:12.360 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:12.360 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:12.361 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:12.361 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:12.361 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:12.361 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:12.361 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:12.361 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.361 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.361 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.362 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.362 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.362 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster": { 2024-08-19T00:24:12.362 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster", 2024-08-19T00:24:12.362 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.362 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.362 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.362 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:12.363 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.363 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.363 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.363 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.363 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.363 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.363 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.363 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.363 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_cluster_level": { 2024-08-19T00:24:12.364 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_cluster_level", 2024-08-19T00:24:12.364 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.364 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.364 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.364 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "info", 2024-08-19T00:24:12.364 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.364 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.365 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [ 2024-08-19T00:24:12.365 INFO:teuthology.orchestra.run.smithi044.stdout: "", 2024-08-19T00:24:12.365 INFO:teuthology.orchestra.run.smithi044.stdout: "critical", 2024-08-19T00:24:12.365 INFO:teuthology.orchestra.run.smithi044.stdout: "debug", 2024-08-19T00:24:12.365 INFO:teuthology.orchestra.run.smithi044.stdout: "error", 2024-08-19T00:24:12.365 INFO:teuthology.orchestra.run.smithi044.stdout: "info", 2024-08-19T00:24:12.365 INFO:teuthology.orchestra.run.smithi044.stdout: "warning" 2024-08-19T00:24:12.365 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:12.366 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.366 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.366 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.366 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.366 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.366 INFO:teuthology.orchestra.run.smithi044.stdout: "log_to_file": { 2024-08-19T00:24:12.366 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "log_to_file", 2024-08-19T00:24:12.366 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", 2024-08-19T00:24:12.367 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.367 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, 2024-08-19T00:24:12.367 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", 2024-08-19T00:24:12.367 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.367 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.367 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.367 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.367 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.368 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.368 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.368 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.368 INFO:teuthology.orchestra.run.smithi044.stdout: "zabbix_host": { 2024-08-19T00:24:12.368 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "zabbix_host", 2024-08-19T00:24:12.368 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.368 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.368 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:12.368 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", 2024-08-19T00:24:12.369 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.369 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.369 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.369 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.369 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.369 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.369 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.369 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.370 INFO:teuthology.orchestra.run.smithi044.stdout: "zabbix_port": { 2024-08-19T00:24:12.370 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "zabbix_port", 2024-08-19T00:24:12.370 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", 2024-08-19T00:24:12.370 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.370 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:12.370 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "10051", 2024-08-19T00:24:12.370 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.370 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.371 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.371 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.371 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.371 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.371 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.371 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.371 INFO:teuthology.orchestra.run.smithi044.stdout: "zabbix_sender": { 2024-08-19T00:24:12.371 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "zabbix_sender", 2024-08-19T00:24:12.372 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", 2024-08-19T00:24:12.372 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", 2024-08-19T00:24:12.372 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, 2024-08-19T00:24:12.372 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-08-19T00:24:12.372 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", 2024-08-19T00:24:12.372 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", 2024-08-19T00:24:12.372 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], 2024-08-19T00:24:12.373 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", 2024-08-19T00:24:12.373 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", 2024-08-19T00:24:12.373 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], 2024-08-19T00:24:12.373 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] 2024-08-19T00:24:12.373 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:12.373 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:12.373 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:12.374 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:12.374 INFO:teuthology.orchestra.run.smithi044.stdout: "services": { 2024-08-19T00:24:12.374 INFO:teuthology.orchestra.run.smithi044.stdout: "dashboard": "https://172.21.15.44:8443/" 2024-08-19T00:24:12.374 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.374 INFO:teuthology.orchestra.run.smithi044.stdout: "always_on_modules": { 2024-08-19T00:24:12.374 INFO:teuthology.orchestra.run.smithi044.stdout: "octopus": [ 2024-08-19T00:24:12.374 INFO:teuthology.orchestra.run.smithi044.stdout: "balancer", 2024-08-19T00:24:12.374 INFO:teuthology.orchestra.run.smithi044.stdout: "crash", 2024-08-19T00:24:12.375 INFO:teuthology.orchestra.run.smithi044.stdout: "devicehealth", 2024-08-19T00:24:12.375 INFO:teuthology.orchestra.run.smithi044.stdout: "orchestrator", 2024-08-19T00:24:12.375 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_autoscaler", 2024-08-19T00:24:12.375 INFO:teuthology.orchestra.run.smithi044.stdout: "progress", 2024-08-19T00:24:12.375 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_support", 2024-08-19T00:24:12.375 INFO:teuthology.orchestra.run.smithi044.stdout: "status", 2024-08-19T00:24:12.375 INFO:teuthology.orchestra.run.smithi044.stdout: "telemetry", 2024-08-19T00:24:12.375 INFO:teuthology.orchestra.run.smithi044.stdout: "volumes" 2024-08-19T00:24:12.376 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:12.376 INFO:teuthology.orchestra.run.smithi044.stdout: "pacific": [ 2024-08-19T00:24:12.376 INFO:teuthology.orchestra.run.smithi044.stdout: "balancer", 2024-08-19T00:24:12.376 INFO:teuthology.orchestra.run.smithi044.stdout: "crash", 2024-08-19T00:24:12.376 INFO:teuthology.orchestra.run.smithi044.stdout: "devicehealth", 2024-08-19T00:24:12.376 INFO:teuthology.orchestra.run.smithi044.stdout: "orchestrator", 2024-08-19T00:24:12.376 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_autoscaler", 2024-08-19T00:24:12.376 INFO:teuthology.orchestra.run.smithi044.stdout: "progress", 2024-08-19T00:24:12.377 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_support", 2024-08-19T00:24:12.377 INFO:teuthology.orchestra.run.smithi044.stdout: "status", 2024-08-19T00:24:12.377 INFO:teuthology.orchestra.run.smithi044.stdout: "telemetry", 2024-08-19T00:24:12.377 INFO:teuthology.orchestra.run.smithi044.stdout: "volumes" 2024-08-19T00:24:12.377 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:12.377 INFO:teuthology.orchestra.run.smithi044.stdout: "quincy": [ 2024-08-19T00:24:12.377 INFO:teuthology.orchestra.run.smithi044.stdout: "balancer", 2024-08-19T00:24:12.377 INFO:teuthology.orchestra.run.smithi044.stdout: "crash", 2024-08-19T00:24:12.377 INFO:teuthology.orchestra.run.smithi044.stdout: "devicehealth", 2024-08-19T00:24:12.378 INFO:teuthology.orchestra.run.smithi044.stdout: "orchestrator", 2024-08-19T00:24:12.378 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_autoscaler", 2024-08-19T00:24:12.378 INFO:teuthology.orchestra.run.smithi044.stdout: "progress", 2024-08-19T00:24:12.378 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_support", 2024-08-19T00:24:12.378 INFO:teuthology.orchestra.run.smithi044.stdout: "status", 2024-08-19T00:24:12.378 INFO:teuthology.orchestra.run.smithi044.stdout: "telemetry", 2024-08-19T00:24:12.378 INFO:teuthology.orchestra.run.smithi044.stdout: "volumes" 2024-08-19T00:24:12.378 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:12.379 INFO:teuthology.orchestra.run.smithi044.stdout: "reef": [ 2024-08-19T00:24:12.379 INFO:teuthology.orchestra.run.smithi044.stdout: "balancer", 2024-08-19T00:24:12.379 INFO:teuthology.orchestra.run.smithi044.stdout: "crash", 2024-08-19T00:24:12.379 INFO:teuthology.orchestra.run.smithi044.stdout: "devicehealth", 2024-08-19T00:24:12.379 INFO:teuthology.orchestra.run.smithi044.stdout: "orchestrator", 2024-08-19T00:24:12.379 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_autoscaler", 2024-08-19T00:24:12.379 INFO:teuthology.orchestra.run.smithi044.stdout: "progress", 2024-08-19T00:24:12.379 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_support", 2024-08-19T00:24:12.380 INFO:teuthology.orchestra.run.smithi044.stdout: "status", 2024-08-19T00:24:12.380 INFO:teuthology.orchestra.run.smithi044.stdout: "telemetry", 2024-08-19T00:24:12.380 INFO:teuthology.orchestra.run.smithi044.stdout: "volumes" 2024-08-19T00:24:12.380 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-08-19T00:24:12.380 INFO:teuthology.orchestra.run.smithi044.stdout: "squid": [ 2024-08-19T00:24:12.380 INFO:teuthology.orchestra.run.smithi044.stdout: "balancer", 2024-08-19T00:24:12.380 INFO:teuthology.orchestra.run.smithi044.stdout: "crash", 2024-08-19T00:24:12.380 INFO:teuthology.orchestra.run.smithi044.stdout: "devicehealth", 2024-08-19T00:24:12.381 INFO:teuthology.orchestra.run.smithi044.stdout: "orchestrator", 2024-08-19T00:24:12.381 INFO:teuthology.orchestra.run.smithi044.stdout: "pg_autoscaler", 2024-08-19T00:24:12.381 INFO:teuthology.orchestra.run.smithi044.stdout: "progress", 2024-08-19T00:24:12.381 INFO:teuthology.orchestra.run.smithi044.stdout: "rbd_support", 2024-08-19T00:24:12.381 INFO:teuthology.orchestra.run.smithi044.stdout: "status", 2024-08-19T00:24:12.381 INFO:teuthology.orchestra.run.smithi044.stdout: "telemetry", 2024-08-19T00:24:12.381 INFO:teuthology.orchestra.run.smithi044.stdout: "volumes" 2024-08-19T00:24:12.381 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-08-19T00:24:12.381 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.382 INFO:teuthology.orchestra.run.smithi044.stdout: "last_failure_osd_epoch": 95, 2024-08-19T00:24:12.382 INFO:teuthology.orchestra.run.smithi044.stdout: "active_clients": [ 2024-08-19T00:24:12.382 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:12.382 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "devicehealth", 2024-08-19T00:24:12.382 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-08-19T00:24:12.382 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:12.382 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-08-19T00:24:12.382 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.44:0", 2024-08-19T00:24:12.383 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 3429604099 2024-08-19T00:24:12.383 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:12.383 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-08-19T00:24:12.383 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.383 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:12.383 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "libcephsqlite", 2024-08-19T00:24:12.383 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-08-19T00:24:12.383 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:12.384 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-08-19T00:24:12.384 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.44:0", 2024-08-19T00:24:12.384 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 346222040 2024-08-19T00:24:12.384 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:12.384 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-08-19T00:24:12.384 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.384 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:12.384 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "rbd_support", 2024-08-19T00:24:12.385 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-08-19T00:24:12.385 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:12.385 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-08-19T00:24:12.385 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.44:0", 2024-08-19T00:24:12.385 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 3866420540 2024-08-19T00:24:12.385 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:12.385 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-08-19T00:24:12.385 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.385 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:12.386 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "snap_schedule", 2024-08-19T00:24:12.386 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-08-19T00:24:12.386 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:12.386 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-08-19T00:24:12.386 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.44:0", 2024-08-19T00:24:12.386 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 3360337237 2024-08-19T00:24:12.386 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:12.386 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-08-19T00:24:12.387 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.387 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:12.387 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "snap_schedule", 2024-08-19T00:24:12.387 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-08-19T00:24:12.387 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:12.387 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-08-19T00:24:12.387 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.44:0", 2024-08-19T00:24:12.387 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 3089645323 2024-08-19T00:24:12.388 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:12.388 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-08-19T00:24:12.388 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:12.388 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:12.388 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "volumes", 2024-08-19T00:24:12.388 INFO:teuthology.orchestra.run.smithi044.stdout: "addrvec": [ 2024-08-19T00:24:12.388 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-08-19T00:24:12.388 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v2", 2024-08-19T00:24:12.388 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.44:0", 2024-08-19T00:24:12.389 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 3646762929 2024-08-19T00:24:12.389 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:12.389 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-08-19T00:24:12.389 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:12.389 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-08-19T00:24:12.389 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-08-19T00:24:12.397 DEBUG:tasks.check_counter:Getting stats from a 2024-08-19T00:24:12.397 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph daemon mds.a perf dump 2024-08-19T00:24:12.398 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:09 smithi044 ceph-mon[18489]: pgmap v337: 129 pgs: 129 active+clean; 546 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.1 MiB/s wr, 217 op/s 2024-08-19T00:24:12.398 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:09 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/3886830477' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-08-19T00:24:12.398 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:09 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/844557977' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-08-19T00:24:12.399 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:09 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/2531738966' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-08-19T00:24:12.399 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:09 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/3717619637' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-08-19T00:24:12.399 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:11 smithi044 ceph-mon[18489]: pgmap v338: 129 pgs: 129 active+clean; 539 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 142 op/s 2024-08-19T00:24:12.400 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:11 smithi116 ceph-mon[21873]: pgmap v338: 129 pgs: 129 active+clean; 539 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 142 op/s 2024-08-19T00:24:12.400 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:11 smithi171 ceph-mon[21810]: pgmap v338: 129 pgs: 129 active+clean; 539 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 142 op/s 2024-08-19T00:24:12.671 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:24:13.355 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-08-19T00:24:13.355 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-0": { 2024-08-19T00:24:13.355 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 1109, 2024-08-19T00:24:13.355 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 1111, 2024-08-19T00:24:13.356 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 206557396, 2024-08-19T00:24:13.356 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 352726, 2024-08-19T00:24:13.356 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 8, 2024-08-19T00:24:13.356 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 4, 2024-08-19T00:24:13.356 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 0.186599776, 2024-08-19T00:24:13.357 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.022497402, 2024-08-19T00:24:13.357 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.134998661, 2024-08-19T00:24:13.357 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.021658188, 2024-08-19T00:24:13.357 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2024-08-19T00:24:13.357 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 1109, 2024-08-19T00:24:13.357 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.026398643, 2024-08-19T00:24:13.357 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000023804 2024-08-19T00:24:13.357 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:13.358 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2024-08-19T00:24:13.358 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:13.358 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:13.358 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:13.358 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:13.358 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-19T00:24:13.359 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_encrypted_bytes": 0 2024-08-19T00:24:13.359 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:13.359 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-1": { 2024-08-19T00:24:13.359 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 914, 2024-08-19T00:24:13.359 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 1079, 2024-08-19T00:24:13.359 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 209956983, 2024-08-19T00:24:13.359 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 736997, 2024-08-19T00:24:13.360 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 9, 2024-08-19T00:24:13.360 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 7, 2024-08-19T00:24:13.360 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 0.187276290, 2024-08-19T00:24:13.360 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.026050610, 2024-08-19T00:24:13.360 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.134979304, 2024-08-19T00:24:13.361 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.018930208, 2024-08-19T00:24:13.361 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2024-08-19T00:24:13.361 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 1076, 2024-08-19T00:24:13.361 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.026819718, 2024-08-19T00:24:13.361 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000024925 2024-08-19T00:24:13.361 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:13.361 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2024-08-19T00:24:13.361 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:13.362 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:13.362 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:13.362 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:13.362 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_encrypted_bytes": 320, 2024-08-19T00:24:13.362 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_encrypted_bytes": 446976 2024-08-19T00:24:13.363 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:13.363 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-2": { 2024-08-19T00:24:13.363 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 1457, 2024-08-19T00:24:13.363 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 1438, 2024-08-19T00:24:13.363 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 119469424, 2024-08-19T00:24:13.363 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 519330, 2024-08-19T00:24:13.364 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 5, 2024-08-19T00:24:13.364 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 4, 2024-08-19T00:24:13.364 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 0.199337327, 2024-08-19T00:24:13.364 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.053350232, 2024-08-19T00:24:13.364 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.124438287, 2024-08-19T00:24:13.364 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.027764098, 2024-08-19T00:24:13.365 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2024-08-19T00:24:13.365 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 1438, 2024-08-19T00:24:13.365 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.051198953, 2024-08-19T00:24:13.365 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000035604 2024-08-19T00:24:13.365 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:13.365 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2024-08-19T00:24:13.366 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:13.366 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:13.366 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:13.366 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:13.366 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_encrypted_bytes": 1653984, 2024-08-19T00:24:13.366 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_encrypted_bytes": 138048 2024-08-19T00:24:13.367 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:13.367 INFO:teuthology.orchestra.run.smithi044.stdout: "cct": { 2024-08-19T00:24:13.367 INFO:teuthology.orchestra.run.smithi044.stdout: "total_workers": 1, 2024-08-19T00:24:13.367 INFO:teuthology.orchestra.run.smithi044.stdout: "unhealthy_workers": 0 2024-08-19T00:24:13.367 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:13.367 INFO:teuthology.orchestra.run.smithi044.stdout: "finisher-MDSRank": { 2024-08-19T00:24:13.367 INFO:teuthology.orchestra.run.smithi044.stdout: "queue_len": 0, 2024-08-19T00:24:13.367 INFO:teuthology.orchestra.run.smithi044.stdout: "complete_latency": { 2024-08-19T00:24:13.368 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 5103, 2024-08-19T00:24:13.368 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.110048287, 2024-08-19T00:24:13.368 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000021565 2024-08-19T00:24:13.368 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:13.368 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:13.368 INFO:teuthology.orchestra.run.smithi044.stdout: "finisher-PurgeQueue": { 2024-08-19T00:24:13.368 INFO:teuthology.orchestra.run.smithi044.stdout: "queue_len": 0, 2024-08-19T00:24:13.369 INFO:teuthology.orchestra.run.smithi044.stdout: "complete_latency": { 2024-08-19T00:24:13.369 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:13.369 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:13.369 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:13.369 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:13.369 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:13.370 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": { 2024-08-19T00:24:13.370 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 0, 2024-08-19T00:24:13.370 INFO:teuthology.orchestra.run.smithi044.stdout: "reply": 0, 2024-08-19T00:24:13.370 INFO:teuthology.orchestra.run.smithi044.stdout: "reply_latency": { 2024-08-19T00:24:13.370 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:13.370 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:13.370 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:13.371 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:13.371 INFO:teuthology.orchestra.run.smithi044.stdout: "slow_reply": 0, 2024-08-19T00:24:13.371 INFO:teuthology.orchestra.run.smithi044.stdout: "forward": 0, 2024-08-19T00:24:13.371 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_fetch_complete": 0, 2024-08-19T00:24:13.371 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_fetch_keys": 0, 2024-08-19T00:24:13.371 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_commit": 0, 2024-08-19T00:24:13.371 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_split": 0, 2024-08-19T00:24:13.371 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_merge": 0, 2024-08-19T00:24:13.372 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes": 24578, 2024-08-19T00:24:13.372 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_top": 3551, 2024-08-19T00:24:13.372 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_bottom": 21027, 2024-08-19T00:24:13.372 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_pin_tail": 0, 2024-08-19T00:24:13.372 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_pinned": 19506, 2024-08-19T00:24:13.372 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_expired": 0, 2024-08-19T00:24:13.372 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_with_caps": 0, 2024-08-19T00:24:13.372 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 0, 2024-08-19T00:24:13.373 INFO:teuthology.orchestra.run.smithi044.stdout: "subtrees": 4, 2024-08-19T00:24:13.373 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse": 0, 2024-08-19T00:24:13.373 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_hit": 0, 2024-08-19T00:24:13.373 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_forward": 0, 2024-08-19T00:24:13.373 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_discover": 0, 2024-08-19T00:24:13.373 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_dir_fetch": 0, 2024-08-19T00:24:13.373 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_remote_ino": 0, 2024-08-19T00:24:13.373 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_lock": 0, 2024-08-19T00:24:13.374 INFO:teuthology.orchestra.run.smithi044.stdout: "load_cent": 0, 2024-08-19T00:24:13.374 INFO:teuthology.orchestra.run.smithi044.stdout: "q": 0, 2024-08-19T00:24:13.374 INFO:teuthology.orchestra.run.smithi044.stdout: "exported": 0, 2024-08-19T00:24:13.374 INFO:teuthology.orchestra.run.smithi044.stdout: "exported_inodes": 0, 2024-08-19T00:24:13.374 INFO:teuthology.orchestra.run.smithi044.stdout: "imported": 0, 2024-08-19T00:24:13.374 INFO:teuthology.orchestra.run.smithi044.stdout: "imported_inodes": 0, 2024-08-19T00:24:13.374 INFO:teuthology.orchestra.run.smithi044.stdout: "openino_dir_fetch": 0, 2024-08-19T00:24:13.374 INFO:teuthology.orchestra.run.smithi044.stdout: "openino_backtrace_fetch": 0, 2024-08-19T00:24:13.375 INFO:teuthology.orchestra.run.smithi044.stdout: "openino_peer_discover": 0, 2024-08-19T00:24:13.375 INFO:teuthology.orchestra.run.smithi044.stdout: "root_rfiles": 0, 2024-08-19T00:24:13.375 INFO:teuthology.orchestra.run.smithi044.stdout: "root_rbytes": 0, 2024-08-19T00:24:13.375 INFO:teuthology.orchestra.run.smithi044.stdout: "root_rsnaps": 0, 2024-08-19T00:24:13.375 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_backtrace_fetch": 0, 2024-08-19T00:24:13.375 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_set_tag": 0, 2024-08-19T00:24:13.375 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_backtrace_repaired": 0, 2024-08-19T00:24:13.375 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_inotable_repaired": 0, 2024-08-19T00:24:13.376 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_dir_inodes": 0, 2024-08-19T00:24:13.376 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_dir_base_inodes": 0, 2024-08-19T00:24:13.376 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_dirfrag_rstats": 0, 2024-08-19T00:24:13.376 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_file_inodes": 0, 2024-08-19T00:24:13.376 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_inode_file_caps": 0, 2024-08-19T00:24:13.376 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_revoke": 0, 2024-08-19T00:24:13.376 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_grant": 0, 2024-08-19T00:24:13.377 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_trunc": 0, 2024-08-19T00:24:13.377 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-19T00:24:13.377 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-19T00:24:13.377 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_caps": 0, 2024-08-19T00:24:13.377 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_caps_dirty": 0, 2024-08-19T00:24:13.377 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_cap_release": 0, 2024-08-19T00:24:13.377 INFO:teuthology.orchestra.run.smithi044.stdout: "process_request_cap_release": 0 2024-08-19T00:24:13.378 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:13.378 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_cache": { 2024-08-19T00:24:13.378 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_update": 0, 2024-08-19T00:24:13.378 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_update_receipt": 0, 2024-08-19T00:24:13.378 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_try_discover": 0, 2024-08-19T00:24:13.378 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_send_discover": 0, 2024-08-19T00:24:13.378 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_handle_discover": 0, 2024-08-19T00:24:13.378 INFO:teuthology.orchestra.run.smithi044.stdout: "num_strays": 0, 2024-08-19T00:24:13.379 INFO:teuthology.orchestra.run.smithi044.stdout: "num_strays_delayed": 0, 2024-08-19T00:24:13.379 INFO:teuthology.orchestra.run.smithi044.stdout: "num_strays_enqueuing": 0, 2024-08-19T00:24:13.379 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_created": 0, 2024-08-19T00:24:13.379 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_enqueued": 0, 2024-08-19T00:24:13.379 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_reintegrated": 0, 2024-08-19T00:24:13.379 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_migrated": 0, 2024-08-19T00:24:13.379 INFO:teuthology.orchestra.run.smithi044.stdout: "num_recovering_processing": 0, 2024-08-19T00:24:13.380 INFO:teuthology.orchestra.run.smithi044.stdout: "num_recovering_enqueued": 0, 2024-08-19T00:24:13.380 INFO:teuthology.orchestra.run.smithi044.stdout: "num_recovering_prioritized": 0, 2024-08-19T00:24:13.380 INFO:teuthology.orchestra.run.smithi044.stdout: "recovery_started": 0, 2024-08-19T00:24:13.380 INFO:teuthology.orchestra.run.smithi044.stdout: "recovery_completed": 0, 2024-08-19T00:24:13.380 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_quiesce_path": 0, 2024-08-19T00:24:13.380 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_quiesce_inode": 0, 2024-08-19T00:24:13.380 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_enqueue_scrub": 0, 2024-08-19T00:24:13.380 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_exportdir": 0, 2024-08-19T00:24:13.381 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_flush": 0, 2024-08-19T00:24:13.381 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_fragmentdir": 0, 2024-08-19T00:24:13.381 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_fragstats": 0, 2024-08-19T00:24:13.381 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_inodestats": 0 2024-08-19T00:24:13.381 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:13.381 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_log": { 2024-08-19T00:24:13.381 INFO:teuthology.orchestra.run.smithi044.stdout: "evlrg": 0, 2024-08-19T00:24:13.382 INFO:teuthology.orchestra.run.smithi044.stdout: "evadd": 0, 2024-08-19T00:24:13.382 INFO:teuthology.orchestra.run.smithi044.stdout: "evex": 0, 2024-08-19T00:24:13.382 INFO:teuthology.orchestra.run.smithi044.stdout: "evtrm": 0, 2024-08-19T00:24:13.382 INFO:teuthology.orchestra.run.smithi044.stdout: "ev": 115441, 2024-08-19T00:24:13.382 INFO:teuthology.orchestra.run.smithi044.stdout: "evexg": 0, 2024-08-19T00:24:13.382 INFO:teuthology.orchestra.run.smithi044.stdout: "evexd": 0, 2024-08-19T00:24:13.382 INFO:teuthology.orchestra.run.smithi044.stdout: "segadd": 0, 2024-08-19T00:24:13.382 INFO:teuthology.orchestra.run.smithi044.stdout: "segex": 0, 2024-08-19T00:24:13.383 INFO:teuthology.orchestra.run.smithi044.stdout: "segtrm": 0, 2024-08-19T00:24:13.383 INFO:teuthology.orchestra.run.smithi044.stdout: "seg": 134, 2024-08-19T00:24:13.383 INFO:teuthology.orchestra.run.smithi044.stdout: "segmjr": 11, 2024-08-19T00:24:13.383 INFO:teuthology.orchestra.run.smithi044.stdout: "segexg": 0, 2024-08-19T00:24:13.383 INFO:teuthology.orchestra.run.smithi044.stdout: "segexd": 0, 2024-08-19T00:24:13.383 INFO:teuthology.orchestra.run.smithi044.stdout: "expos": 74003840, 2024-08-19T00:24:13.383 INFO:teuthology.orchestra.run.smithi044.stdout: "wrpos": 537611773, 2024-08-19T00:24:13.384 INFO:teuthology.orchestra.run.smithi044.stdout: "rdpos": 537604955, 2024-08-19T00:24:13.384 INFO:teuthology.orchestra.run.smithi044.stdout: "jlat": { 2024-08-19T00:24:13.384 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:13.384 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:13.384 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:13.384 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:13.384 INFO:teuthology.orchestra.run.smithi044.stdout: "replayed": 115441 2024-08-19T00:24:13.384 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:13.385 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_mem": { 2024-08-19T00:24:13.385 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 709, 2024-08-19T00:24:13.385 INFO:teuthology.orchestra.run.smithi044.stdout: "ino+": 24519, 2024-08-19T00:24:13.385 INFO:teuthology.orchestra.run.smithi044.stdout: "ino-": 23810, 2024-08-19T00:24:13.385 INFO:teuthology.orchestra.run.smithi044.stdout: "dir": 44, 2024-08-19T00:24:13.385 INFO:teuthology.orchestra.run.smithi044.stdout: "dir+": 102, 2024-08-19T00:24:13.386 INFO:teuthology.orchestra.run.smithi044.stdout: "dir-": 58, 2024-08-19T00:24:13.386 INFO:teuthology.orchestra.run.smithi044.stdout: "dn": 24578, 2024-08-19T00:24:13.386 INFO:teuthology.orchestra.run.smithi044.stdout: "dn+": 24578, 2024-08-19T00:24:13.386 INFO:teuthology.orchestra.run.smithi044.stdout: "dn-": 0, 2024-08-19T00:24:13.386 INFO:teuthology.orchestra.run.smithi044.stdout: "cap": 0, 2024-08-19T00:24:13.386 INFO:teuthology.orchestra.run.smithi044.stdout: "cap+": 0, 2024-08-19T00:24:13.386 INFO:teuthology.orchestra.run.smithi044.stdout: "cap-": 0, 2024-08-19T00:24:13.387 INFO:teuthology.orchestra.run.smithi044.stdout: "rss": 78288, 2024-08-19T00:24:13.387 INFO:teuthology.orchestra.run.smithi044.stdout: "heap": 215328 2024-08-19T00:24:13.387 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:13.387 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_server": { 2024-08-19T00:24:13.387 INFO:teuthology.orchestra.run.smithi044.stdout: "dispatch_client_request": 0, 2024-08-19T00:24:13.387 INFO:teuthology.orchestra.run.smithi044.stdout: "dispatch_server_request": 0, 2024-08-19T00:24:13.387 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_request": 0, 2024-08-19T00:24:13.387 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_session": 0, 2024-08-19T00:24:13.387 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_peer_request": 0, 2024-08-19T00:24:13.388 INFO:teuthology.orchestra.run.smithi044.stdout: "req_create_latency": { 2024-08-19T00:24:13.388 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:13.388 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:13.388 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:13.388 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:13.388 INFO:teuthology.orchestra.run.smithi044.stdout: "req_getattr_latency": { 2024-08-19T00:24:13.388 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:13.388 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:13.389 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:13.389 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:13.389 INFO:teuthology.orchestra.run.smithi044.stdout: "req_getfilelock_latency": { 2024-08-19T00:24:13.389 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:13.389 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:13.389 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:13.389 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:13.390 INFO:teuthology.orchestra.run.smithi044.stdout: "req_link_latency": { 2024-08-19T00:24:13.390 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:13.390 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:13.390 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:13.390 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:13.390 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookup_latency": { 2024-08-19T00:24:13.391 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:13.391 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:13.391 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:13.391 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:13.391 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookuphash_latency": { 2024-08-19T00:24:13.391 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:13.392 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:13.392 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:13.392 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:13.392 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupino_latency": { 2024-08-19T00:24:13.392 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:13.392 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:13.392 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:13.393 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:13.393 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupname_latency": { 2024-08-19T00:24:13.393 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:13.393 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:13.393 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:13.393 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:13.394 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupparent_latency": { 2024-08-19T00:24:13.394 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:13.394 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:13.394 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:13.394 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:13.394 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupsnap_latency": { 2024-08-19T00:24:13.394 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:13.395 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:13.395 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:13.395 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:13.395 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lssnap_latency": { 2024-08-19T00:24:13.395 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:13.395 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:13.396 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:13.396 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:13.396 INFO:teuthology.orchestra.run.smithi044.stdout: "req_mkdir_latency": { 2024-08-19T00:24:13.396 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:13.396 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:13.397 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:13.397 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:13.397 INFO:teuthology.orchestra.run.smithi044.stdout: "req_mknod_latency": { 2024-08-19T00:24:13.397 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:13.397 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:13.397 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:13.397 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:13.397 INFO:teuthology.orchestra.run.smithi044.stdout: "req_mksnap_latency": { 2024-08-19T00:24:13.398 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:13.398 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:13.398 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:13.398 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:13.398 INFO:teuthology.orchestra.run.smithi044.stdout: "req_open_latency": { 2024-08-19T00:24:13.399 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:13.399 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:13.399 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:13.399 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:13.399 INFO:teuthology.orchestra.run.smithi044.stdout: "req_readdir_latency": { 2024-08-19T00:24:13.399 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:13.399 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:13.400 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:13.400 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:13.400 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rename_latency": { 2024-08-19T00:24:13.400 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:13.401 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:13.401 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:13.401 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:13.401 INFO:teuthology.orchestra.run.smithi044.stdout: "req_renamesnap_latency": { 2024-08-19T00:24:13.401 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:13.401 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:13.402 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:13.402 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:13.402 INFO:teuthology.orchestra.run.smithi044.stdout: "req_snapdiff_latency": { 2024-08-19T00:24:13.402 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:13.402 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:13.402 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:13.403 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:13.403 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rmdir_latency": { 2024-08-19T00:24:13.403 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:13.403 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:13.403 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:13.404 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:13.404 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rmsnap_latency": { 2024-08-19T00:24:13.404 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:13.404 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:13.404 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:13.405 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:13.405 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rmxattr_latency": { 2024-08-19T00:24:13.405 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:13.405 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:13.405 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:13.405 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:13.406 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setattr_latency": { 2024-08-19T00:24:13.406 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:13.406 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:13.406 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:13.406 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:13.406 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setdirlayout_latency": { 2024-08-19T00:24:13.406 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:13.407 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:13.407 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:13.407 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:13.407 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setfilelock_latency": { 2024-08-19T00:24:13.407 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:13.407 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:13.407 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:13.407 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:13.408 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setlayout_latency": { 2024-08-19T00:24:13.408 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:13.408 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:13.408 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:13.408 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:13.408 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setxattr_latency": { 2024-08-19T00:24:13.408 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:13.408 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:13.409 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:13.409 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:13.409 INFO:teuthology.orchestra.run.smithi044.stdout: "req_symlink_latency": { 2024-08-19T00:24:13.409 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:13.409 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:13.409 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:13.409 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:13.409 INFO:teuthology.orchestra.run.smithi044.stdout: "req_unlink_latency": { 2024-08-19T00:24:13.409 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:13.410 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:13.410 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:13.410 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:13.410 INFO:teuthology.orchestra.run.smithi044.stdout: "cap_revoke_eviction": 0, 2024-08-19T00:24:13.410 INFO:teuthology.orchestra.run.smithi044.stdout: "cap_acquisition_throttle": 0, 2024-08-19T00:24:13.410 INFO:teuthology.orchestra.run.smithi044.stdout: "req_getvxattr_latency": { 2024-08-19T00:24:13.410 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:13.411 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:13.411 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:13.411 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:13.411 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:13.411 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_sessions": { 2024-08-19T00:24:13.411 INFO:teuthology.orchestra.run.smithi044.stdout: "session_count": 2, 2024-08-19T00:24:13.411 INFO:teuthology.orchestra.run.smithi044.stdout: "session_add": 3, 2024-08-19T00:24:13.411 INFO:teuthology.orchestra.run.smithi044.stdout: "session_remove": 1, 2024-08-19T00:24:13.412 INFO:teuthology.orchestra.run.smithi044.stdout: "sessions_open": 3, 2024-08-19T00:24:13.412 INFO:teuthology.orchestra.run.smithi044.stdout: "sessions_stale": 0, 2024-08-19T00:24:13.412 INFO:teuthology.orchestra.run.smithi044.stdout: "total_load": 0, 2024-08-19T00:24:13.412 INFO:teuthology.orchestra.run.smithi044.stdout: "average_load": 0, 2024-08-19T00:24:13.412 INFO:teuthology.orchestra.run.smithi044.stdout: "avg_session_uptime": 2080, 2024-08-19T00:24:13.412 INFO:teuthology.orchestra.run.smithi044.stdout: "mdthresh_evicted": 0 2024-08-19T00:24:13.412 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:13.412 INFO:teuthology.orchestra.run.smithi044.stdout: "mempool": { 2024-08-19T00:24:13.413 INFO:teuthology.orchestra.run.smithi044.stdout: "bloom_filter_bytes": 0, 2024-08-19T00:24:13.413 INFO:teuthology.orchestra.run.smithi044.stdout: "bloom_filter_items": 0, 2024-08-19T00:24:13.413 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_alloc_bytes": 0, 2024-08-19T00:24:13.413 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_alloc_items": 0, 2024-08-19T00:24:13.413 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_data_bytes": 0, 2024-08-19T00:24:13.413 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_data_items": 0, 2024-08-19T00:24:13.413 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-19T00:24:13.413 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_onode_items": 0, 2024-08-19T00:24:13.414 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-19T00:24:13.414 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_meta_items": 0, 2024-08-19T00:24:13.414 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_other_bytes": 0, 2024-08-19T00:24:13.414 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_other_items": 0, 2024-08-19T00:24:13.414 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-19T00:24:13.414 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_buffer_items": 0, 2024-08-19T00:24:13.414 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_extent_bytes": 0, 2024-08-19T00:24:13.414 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_extent_items": 0, 2024-08-19T00:24:13.415 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_blob_bytes": 0, 2024-08-19T00:24:13.415 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_blob_items": 0, 2024-08-19T00:24:13.415 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-19T00:24:13.415 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_shared_blob_items": 0, 2024-08-19T00:24:13.415 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-19T00:24:13.415 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_inline_bl_items": 0, 2024-08-19T00:24:13.415 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_bytes": 0, 2024-08-19T00:24:13.415 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_items": 0, 2024-08-19T00:24:13.415 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_txc_bytes": 0, 2024-08-19T00:24:13.416 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_txc_items": 0, 2024-08-19T00:24:13.416 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-19T00:24:13.416 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_deferred_items": 0, 2024-08-19T00:24:13.416 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_bytes": 0, 2024-08-19T00:24:13.416 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_items": 0, 2024-08-19T00:24:13.416 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_bytes": 0, 2024-08-19T00:24:13.416 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_items": 0, 2024-08-19T00:24:13.416 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_reader_bytes": 0, 2024-08-19T00:24:13.417 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_reader_items": 0, 2024-08-19T00:24:13.417 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_writer_bytes": 0, 2024-08-19T00:24:13.417 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_writer_items": 0, 2024-08-19T00:24:13.417 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_anon_bytes": 269566, 2024-08-19T00:24:13.417 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_anon_items": 874, 2024-08-19T00:24:13.417 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_meta_bytes": 0, 2024-08-19T00:24:13.417 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_meta_items": 0, 2024-08-19T00:24:13.418 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_bytes": 0, 2024-08-19T00:24:13.418 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_items": 0, 2024-08-19T00:24:13.418 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mapbl_bytes": 0, 2024-08-19T00:24:13.418 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mapbl_items": 0, 2024-08-19T00:24:13.418 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pglog_bytes": 0, 2024-08-19T00:24:13.418 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pglog_items": 0, 2024-08-19T00:24:13.418 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_bytes": 9952, 2024-08-19T00:24:13.418 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_items": 203, 2024-08-19T00:24:13.419 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_mapping_bytes": 0, 2024-08-19T00:24:13.419 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_mapping_items": 0, 2024-08-19T00:24:13.419 INFO:teuthology.orchestra.run.smithi044.stdout: "pgmap_bytes": 0, 2024-08-19T00:24:13.419 INFO:teuthology.orchestra.run.smithi044.stdout: "pgmap_items": 0, 2024-08-19T00:24:13.419 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_co_bytes": 19219255, 2024-08-19T00:24:13.419 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_co_items": 132065, 2024-08-19T00:24:13.419 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_1_bytes": 0, 2024-08-19T00:24:13.419 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_1_items": 0, 2024-08-19T00:24:13.419 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_2_bytes": 0, 2024-08-19T00:24:13.420 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_2_items": 0 2024-08-19T00:24:13.420 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:13.420 INFO:teuthology.orchestra.run.smithi044.stdout: "objecter": { 2024-08-19T00:24:13.420 INFO:teuthology.orchestra.run.smithi044.stdout: "op_active": 0, 2024-08-19T00:24:13.420 INFO:teuthology.orchestra.run.smithi044.stdout: "op_laggy": 0, 2024-08-19T00:24:13.420 INFO:teuthology.orchestra.run.smithi044.stdout: "op_send": 3220, 2024-08-19T00:24:13.420 INFO:teuthology.orchestra.run.smithi044.stdout: "op_send_bytes": 21, 2024-08-19T00:24:13.420 INFO:teuthology.orchestra.run.smithi044.stdout: "op_resend": 3, 2024-08-19T00:24:13.420 INFO:teuthology.orchestra.run.smithi044.stdout: "op_reply": 3220, 2024-08-19T00:24:13.421 INFO:teuthology.orchestra.run.smithi044.stdout: "op_latency": { 2024-08-19T00:24:13.421 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 3220, 2024-08-19T00:24:13.421 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 2.909957055, 2024-08-19T00:24:13.421 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000903713 2024-08-19T00:24:13.421 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:13.421 INFO:teuthology.orchestra.run.smithi044.stdout: "op_inflight": 0, 2024-08-19T00:24:13.421 INFO:teuthology.orchestra.run.smithi044.stdout: "oplen_avg": { 2024-08-19T00:24:13.421 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 3220, 2024-08-19T00:24:13.422 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 3221 2024-08-19T00:24:13.422 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:13.422 INFO:teuthology.orchestra.run.smithi044.stdout: "op": 3220, 2024-08-19T00:24:13.422 INFO:teuthology.orchestra.run.smithi044.stdout: "op_r": 3220, 2024-08-19T00:24:13.422 INFO:teuthology.orchestra.run.smithi044.stdout: "op_w": 0, 2024-08-19T00:24:13.422 INFO:teuthology.orchestra.run.smithi044.stdout: "op_rmw": 0, 2024-08-19T00:24:13.422 INFO:teuthology.orchestra.run.smithi044.stdout: "op_pg": 0, 2024-08-19T00:24:13.423 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_stat": 1928, 2024-08-19T00:24:13.423 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_create": 0, 2024-08-19T00:24:13.423 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_read": 1290, 2024-08-19T00:24:13.423 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_write": 0, 2024-08-19T00:24:13.423 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_writefull": 0, 2024-08-19T00:24:13.423 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_writesame": 0, 2024-08-19T00:24:13.423 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_append": 0, 2024-08-19T00:24:13.423 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_zero": 0, 2024-08-19T00:24:13.424 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_truncate": 0, 2024-08-19T00:24:13.424 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_delete": 0, 2024-08-19T00:24:13.424 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_mapext": 0, 2024-08-19T00:24:13.424 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_sparse_read": 0, 2024-08-19T00:24:13.424 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_clonerange": 0, 2024-08-19T00:24:13.424 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_getxattr": 1, 2024-08-19T00:24:13.424 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_setxattr": 0, 2024-08-19T00:24:13.424 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_cmpxattr": 0, 2024-08-19T00:24:13.425 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_rmxattr": 0, 2024-08-19T00:24:13.425 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_resetxattrs": 0, 2024-08-19T00:24:13.425 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_call": 0, 2024-08-19T00:24:13.425 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_watch": 0, 2024-08-19T00:24:13.425 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_notify": 0, 2024-08-19T00:24:13.425 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_src_cmpxattr": 0, 2024-08-19T00:24:13.425 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_pgls": 0, 2024-08-19T00:24:13.426 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_pgls_filter": 0, 2024-08-19T00:24:13.426 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_other": 0, 2024-08-19T00:24:13.426 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_active": 0, 2024-08-19T00:24:13.426 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_send": 0, 2024-08-19T00:24:13.426 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_resend": 0, 2024-08-19T00:24:13.427 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_ping": 0, 2024-08-19T00:24:13.427 INFO:teuthology.orchestra.run.smithi044.stdout: "poolop_active": 0, 2024-08-19T00:24:13.427 INFO:teuthology.orchestra.run.smithi044.stdout: "poolop_send": 0, 2024-08-19T00:24:13.427 INFO:teuthology.orchestra.run.smithi044.stdout: "poolop_resend": 0, 2024-08-19T00:24:13.427 INFO:teuthology.orchestra.run.smithi044.stdout: "poolstat_active": 0, 2024-08-19T00:24:13.427 INFO:teuthology.orchestra.run.smithi044.stdout: "poolstat_send": 0, 2024-08-19T00:24:13.428 INFO:teuthology.orchestra.run.smithi044.stdout: "poolstat_resend": 0, 2024-08-19T00:24:13.428 INFO:teuthology.orchestra.run.smithi044.stdout: "statfs_active": 0, 2024-08-19T00:24:13.428 INFO:teuthology.orchestra.run.smithi044.stdout: "statfs_send": 0, 2024-08-19T00:24:13.428 INFO:teuthology.orchestra.run.smithi044.stdout: "statfs_resend": 0, 2024-08-19T00:24:13.428 INFO:teuthology.orchestra.run.smithi044.stdout: "command_active": 0, 2024-08-19T00:24:13.428 INFO:teuthology.orchestra.run.smithi044.stdout: "command_send": 0, 2024-08-19T00:24:13.429 INFO:teuthology.orchestra.run.smithi044.stdout: "command_resend": 0, 2024-08-19T00:24:13.429 INFO:teuthology.orchestra.run.smithi044.stdout: "map_epoch": 104, 2024-08-19T00:24:13.429 INFO:teuthology.orchestra.run.smithi044.stdout: "map_full": 0, 2024-08-19T00:24:13.429 INFO:teuthology.orchestra.run.smithi044.stdout: "map_inc": 14, 2024-08-19T00:24:13.429 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_sessions": 11, 2024-08-19T00:24:13.429 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_session_open": 11, 2024-08-19T00:24:13.429 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_session_close": 0, 2024-08-19T00:24:13.430 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_laggy": 0, 2024-08-19T00:24:13.430 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_wr": 0, 2024-08-19T00:24:13.430 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_rd": 2, 2024-08-19T00:24:13.430 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_del": 0 2024-08-19T00:24:13.430 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:13.430 INFO:teuthology.orchestra.run.smithi044.stdout: "oft": { 2024-08-19T00:24:13.431 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_objs": 0, 2024-08-19T00:24:13.431 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_kv_pairs": 0, 2024-08-19T00:24:13.431 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_updates": 0, 2024-08-19T00:24:13.431 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_removes": 0 2024-08-19T00:24:13.431 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:13.431 INFO:teuthology.orchestra.run.smithi044.stdout: "osd-slow-ops": { 2024-08-19T00:24:13.432 INFO:teuthology.orchestra.run.smithi044.stdout: "slow_ops_count": 0 2024-08-19T00:24:13.432 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:13.432 INFO:teuthology.orchestra.run.smithi044.stdout: "purge_queue": { 2024-08-19T00:24:13.432 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing_ops": 0, 2024-08-19T00:24:13.432 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing_ops_high_water": 0, 2024-08-19T00:24:13.432 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing": 0, 2024-08-19T00:24:13.433 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing_high_water": 0, 2024-08-19T00:24:13.433 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executed_ops": 0, 2024-08-19T00:24:13.433 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executed": 0, 2024-08-19T00:24:13.433 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_item_in_journal": 0 2024-08-19T00:24:13.433 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:13.433 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-19T00:24:13.434 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-08-19T00:24:13.434 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 104857600, 2024-08-19T00:24:13.434 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-08-19T00:24:13.434 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 3476, 2024-08-19T00:24:13.434 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 535654982, 2024-08-19T00:24:13.435 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-08-19T00:24:13.435 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 3476, 2024-08-19T00:24:13.435 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2024-08-19T00:24:13.435 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2024-08-19T00:24:13.435 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 3476, 2024-08-19T00:24:13.436 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 535654982, 2024-08-19T00:24:13.436 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-08-19T00:24:13.436 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:13.436 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:13.436 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:13.436 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:13.437 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:13.437 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-objecter_bytes": { 2024-08-19T00:24:13.437 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-08-19T00:24:13.437 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 104857600, 2024-08-19T00:24:13.438 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-08-19T00:24:13.438 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2024-08-19T00:24:13.438 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2024-08-19T00:24:13.438 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-08-19T00:24:13.438 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2024-08-19T00:24:13.439 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 3220, 2024-08-19T00:24:13.439 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 533443149, 2024-08-19T00:24:13.439 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 3220, 2024-08-19T00:24:13.439 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 533443149, 2024-08-19T00:24:13.439 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-08-19T00:24:13.439 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:13.439 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:13.440 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:13.440 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:13.440 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:13.440 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-objecter_ops": { 2024-08-19T00:24:13.440 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-08-19T00:24:13.440 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 1024, 2024-08-19T00:24:13.440 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-08-19T00:24:13.441 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2024-08-19T00:24:13.441 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2024-08-19T00:24:13.441 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-08-19T00:24:13.441 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2024-08-19T00:24:13.441 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 3220, 2024-08-19T00:24:13.441 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 3220, 2024-08-19T00:24:13.441 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 3220, 2024-08-19T00:24:13.441 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 3220, 2024-08-19T00:24:13.442 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-08-19T00:24:13.442 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:13.442 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:13.442 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:13.442 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:13.442 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:13.442 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-write_buf_throttle": { 2024-08-19T00:24:13.443 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-08-19T00:24:13.443 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 3758096384, 2024-08-19T00:24:13.443 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-08-19T00:24:13.443 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2024-08-19T00:24:13.443 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2024-08-19T00:24:13.443 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-08-19T00:24:13.443 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2024-08-19T00:24:13.443 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2024-08-19T00:24:13.443 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2024-08-19T00:24:13.444 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 0, 2024-08-19T00:24:13.444 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 0, 2024-08-19T00:24:13.444 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-08-19T00:24:13.444 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:13.444 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:13.444 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:13.444 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:13.445 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:13.445 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-write_buf_throttle-0x561b32d48b40": { 2024-08-19T00:24:13.445 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-08-19T00:24:13.445 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 3758096384, 2024-08-19T00:24:13.445 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-08-19T00:24:13.445 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2024-08-19T00:24:13.445 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2024-08-19T00:24:13.445 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-08-19T00:24:13.445 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2024-08-19T00:24:13.446 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2024-08-19T00:24:13.446 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2024-08-19T00:24:13.446 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 0, 2024-08-19T00:24:13.446 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 0, 2024-08-19T00:24:13.446 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-08-19T00:24:13.446 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:13.446 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:13.446 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:13.447 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:13.447 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:13.447 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-08-19T00:24:14.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:13 smithi044 ceph-mon[18489]: pgmap v339: 129 pgs: 129 active+clean; 539 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 142 op/s 2024-08-19T00:24:14.120 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:13 smithi044 ceph-mon[18489]: osdmap e105: 12 total, 12 up, 12 in 2024-08-19T00:24:14.222 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-08-19T00:24:14.222 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-08-19T00:24:14.222 INFO:tasks.check_counter:Daemon mds.a mds.root_rsnaps=0 2024-08-19T00:24:14.223 INFO:tasks.check_counter:Daemon mds.a mds_server.req_mksnap_latency.avgcount=0 2024-08-19T00:24:14.223 INFO:tasks.check_counter:Daemon mds.a mds_server.req_rmsnap_latency.avgcount=0 2024-08-19T00:24:14.223 DEBUG:tasks.check_counter:Getting stats from d 2024-08-19T00:24:14.223 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph daemon mds.d perf dump 2024-08-19T00:24:14.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:13 smithi171 ceph-mon[21810]: pgmap v339: 129 pgs: 129 active+clean; 539 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 142 op/s 2024-08-19T00:24:14.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:13 smithi171 ceph-mon[21810]: osdmap e105: 12 total, 12 up, 12 in 2024-08-19T00:24:14.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:13 smithi116 ceph-mon[21873]: pgmap v339: 129 pgs: 129 active+clean; 539 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 142 op/s 2024-08-19T00:24:14.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:13 smithi116 ceph-mon[21873]: osdmap e105: 12 total, 12 up, 12 in 2024-08-19T00:24:14.484 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:24:15.095 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-08-19T00:24:15.095 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-0": { 2024-08-19T00:24:15.096 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 759, 2024-08-19T00:24:15.096 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 761, 2024-08-19T00:24:15.096 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 254969, 2024-08-19T00:24:15.096 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 241363, 2024-08-19T00:24:15.096 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 6, 2024-08-19T00:24:15.096 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 2, 2024-08-19T00:24:15.096 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 0.074023212, 2024-08-19T00:24:15.097 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.030844511, 2024-08-19T00:24:15.097 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.016401314, 2024-08-19T00:24:15.097 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.019239333, 2024-08-19T00:24:15.097 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2024-08-19T00:24:15.097 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 759, 2024-08-19T00:24:15.097 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.031857352, 2024-08-19T00:24:15.097 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000041972 2024-08-19T00:24:15.097 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:15.098 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2024-08-19T00:24:15.098 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:15.098 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:15.098 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:15.098 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:15.098 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-19T00:24:15.098 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_encrypted_bytes": 0 2024-08-19T00:24:15.098 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:15.099 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-1": { 2024-08-19T00:24:15.099 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 1423, 2024-08-19T00:24:15.099 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 1593, 2024-08-19T00:24:15.099 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 364957, 2024-08-19T00:24:15.099 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 901407, 2024-08-19T00:24:15.099 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 7, 2024-08-19T00:24:15.099 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 5, 2024-08-19T00:24:15.099 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 0.089616756, 2024-08-19T00:24:15.100 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.030271453, 2024-08-19T00:24:15.100 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.021737576, 2024-08-19T00:24:15.100 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.029898892, 2024-08-19T00:24:15.100 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2024-08-19T00:24:15.100 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 1590, 2024-08-19T00:24:15.100 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.049927816, 2024-08-19T00:24:15.100 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000031401 2024-08-19T00:24:15.100 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:15.101 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2024-08-19T00:24:15.101 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:15.101 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:15.101 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:15.101 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:15.101 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_encrypted_bytes": 320, 2024-08-19T00:24:15.101 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_encrypted_bytes": 449472 2024-08-19T00:24:15.101 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:15.101 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-2": { 2024-08-19T00:24:15.102 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 268, 2024-08-19T00:24:15.102 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 249, 2024-08-19T00:24:15.102 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 1657540, 2024-08-19T00:24:15.102 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 142549, 2024-08-19T00:24:15.102 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 4, 2024-08-19T00:24:15.102 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 3, 2024-08-19T00:24:15.102 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 0.044217511, 2024-08-19T00:24:15.102 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.014489187, 2024-08-19T00:24:15.103 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.043429593, 2024-08-19T00:24:15.103 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.000077483, 2024-08-19T00:24:15.103 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2024-08-19T00:24:15.103 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 249, 2024-08-19T00:24:15.103 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.019451081, 2024-08-19T00:24:15.103 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000078116 2024-08-19T00:24:15.103 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:15.103 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2024-08-19T00:24:15.104 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:15.104 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:15.104 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:15.104 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:15.104 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_encrypted_bytes": 1656192, 2024-08-19T00:24:15.104 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_encrypted_bytes": 141584 2024-08-19T00:24:15.104 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:15.104 INFO:teuthology.orchestra.run.smithi044.stdout: "cct": { 2024-08-19T00:24:15.105 INFO:teuthology.orchestra.run.smithi044.stdout: "total_workers": 1, 2024-08-19T00:24:15.105 INFO:teuthology.orchestra.run.smithi044.stdout: "unhealthy_workers": 0 2024-08-19T00:24:15.105 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:15.105 INFO:teuthology.orchestra.run.smithi044.stdout: "finisher-MDSRank": { 2024-08-19T00:24:15.105 INFO:teuthology.orchestra.run.smithi044.stdout: "queue_len": 0, 2024-08-19T00:24:15.105 INFO:teuthology.orchestra.run.smithi044.stdout: "complete_latency": { 2024-08-19T00:24:15.105 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 3672, 2024-08-19T00:24:15.105 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.080447921, 2024-08-19T00:24:15.106 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000021908 2024-08-19T00:24:15.106 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:15.106 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:15.106 INFO:teuthology.orchestra.run.smithi044.stdout: "finisher-PurgeQueue": { 2024-08-19T00:24:15.106 INFO:teuthology.orchestra.run.smithi044.stdout: "queue_len": 0, 2024-08-19T00:24:15.106 INFO:teuthology.orchestra.run.smithi044.stdout: "complete_latency": { 2024-08-19T00:24:15.106 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:15.106 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:15.107 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:15.107 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:15.107 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:15.107 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": { 2024-08-19T00:24:15.107 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 0, 2024-08-19T00:24:15.107 INFO:teuthology.orchestra.run.smithi044.stdout: "reply": 0, 2024-08-19T00:24:15.107 INFO:teuthology.orchestra.run.smithi044.stdout: "reply_latency": { 2024-08-19T00:24:15.107 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:15.107 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:15.108 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:15.108 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:15.108 INFO:teuthology.orchestra.run.smithi044.stdout: "slow_reply": 0, 2024-08-19T00:24:15.108 INFO:teuthology.orchestra.run.smithi044.stdout: "forward": 0, 2024-08-19T00:24:15.108 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_fetch_complete": 0, 2024-08-19T00:24:15.108 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_fetch_keys": 0, 2024-08-19T00:24:15.108 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_commit": 0, 2024-08-19T00:24:15.108 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_split": 0, 2024-08-19T00:24:15.109 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_merge": 0, 2024-08-19T00:24:15.109 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes": 0, 2024-08-19T00:24:15.109 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_top": 0, 2024-08-19T00:24:15.109 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_bottom": 0, 2024-08-19T00:24:15.109 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_pin_tail": 0, 2024-08-19T00:24:15.109 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_pinned": 0, 2024-08-19T00:24:15.109 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_expired": 0, 2024-08-19T00:24:15.109 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_with_caps": 0, 2024-08-19T00:24:15.110 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 0, 2024-08-19T00:24:15.110 INFO:teuthology.orchestra.run.smithi044.stdout: "subtrees": 1, 2024-08-19T00:24:15.110 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse": 0, 2024-08-19T00:24:15.110 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_hit": 0, 2024-08-19T00:24:15.110 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_forward": 0, 2024-08-19T00:24:15.110 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_discover": 0, 2024-08-19T00:24:15.111 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_dir_fetch": 0, 2024-08-19T00:24:15.111 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_remote_ino": 0, 2024-08-19T00:24:15.111 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_lock": 0, 2024-08-19T00:24:15.111 INFO:teuthology.orchestra.run.smithi044.stdout: "load_cent": 0, 2024-08-19T00:24:15.111 INFO:teuthology.orchestra.run.smithi044.stdout: "q": 0, 2024-08-19T00:24:15.111 INFO:teuthology.orchestra.run.smithi044.stdout: "exported": 0, 2024-08-19T00:24:15.111 INFO:teuthology.orchestra.run.smithi044.stdout: "exported_inodes": 0, 2024-08-19T00:24:15.111 INFO:teuthology.orchestra.run.smithi044.stdout: "imported": 0, 2024-08-19T00:24:15.112 INFO:teuthology.orchestra.run.smithi044.stdout: "imported_inodes": 0, 2024-08-19T00:24:15.112 INFO:teuthology.orchestra.run.smithi044.stdout: "openino_dir_fetch": 0, 2024-08-19T00:24:15.112 INFO:teuthology.orchestra.run.smithi044.stdout: "openino_backtrace_fetch": 0, 2024-08-19T00:24:15.112 INFO:teuthology.orchestra.run.smithi044.stdout: "openino_peer_discover": 0, 2024-08-19T00:24:15.112 INFO:teuthology.orchestra.run.smithi044.stdout: "root_rfiles": 0, 2024-08-19T00:24:15.112 INFO:teuthology.orchestra.run.smithi044.stdout: "root_rbytes": 0, 2024-08-19T00:24:15.112 INFO:teuthology.orchestra.run.smithi044.stdout: "root_rsnaps": 0, 2024-08-19T00:24:15.112 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_backtrace_fetch": 0, 2024-08-19T00:24:15.112 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_set_tag": 0, 2024-08-19T00:24:15.113 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_backtrace_repaired": 0, 2024-08-19T00:24:15.113 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_inotable_repaired": 0, 2024-08-19T00:24:15.113 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_dir_inodes": 0, 2024-08-19T00:24:15.113 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_dir_base_inodes": 0, 2024-08-19T00:24:15.113 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_dirfrag_rstats": 0, 2024-08-19T00:24:15.113 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_file_inodes": 0, 2024-08-19T00:24:15.113 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_inode_file_caps": 0, 2024-08-19T00:24:15.113 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_revoke": 0, 2024-08-19T00:24:15.114 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_grant": 0, 2024-08-19T00:24:15.114 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_trunc": 0, 2024-08-19T00:24:15.114 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-19T00:24:15.114 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-19T00:24:15.114 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_caps": 0, 2024-08-19T00:24:15.114 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_caps_dirty": 0, 2024-08-19T00:24:15.114 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_cap_release": 0, 2024-08-19T00:24:15.114 INFO:teuthology.orchestra.run.smithi044.stdout: "process_request_cap_release": 0 2024-08-19T00:24:15.115 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:15.115 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_cache": { 2024-08-19T00:24:15.115 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_update": 0, 2024-08-19T00:24:15.115 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_update_receipt": 0, 2024-08-19T00:24:15.115 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_try_discover": 0, 2024-08-19T00:24:15.115 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_send_discover": 0, 2024-08-19T00:24:15.115 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_handle_discover": 0, 2024-08-19T00:24:15.115 INFO:teuthology.orchestra.run.smithi044.stdout: "num_strays": 0, 2024-08-19T00:24:15.116 INFO:teuthology.orchestra.run.smithi044.stdout: "num_strays_delayed": 0, 2024-08-19T00:24:15.116 INFO:teuthology.orchestra.run.smithi044.stdout: "num_strays_enqueuing": 0, 2024-08-19T00:24:15.116 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_created": 0, 2024-08-19T00:24:15.116 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_enqueued": 0, 2024-08-19T00:24:15.116 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_reintegrated": 0, 2024-08-19T00:24:15.116 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_migrated": 0, 2024-08-19T00:24:15.116 INFO:teuthology.orchestra.run.smithi044.stdout: "num_recovering_processing": 0, 2024-08-19T00:24:15.116 INFO:teuthology.orchestra.run.smithi044.stdout: "num_recovering_enqueued": 0, 2024-08-19T00:24:15.116 INFO:teuthology.orchestra.run.smithi044.stdout: "num_recovering_prioritized": 0, 2024-08-19T00:24:15.117 INFO:teuthology.orchestra.run.smithi044.stdout: "recovery_started": 0, 2024-08-19T00:24:15.117 INFO:teuthology.orchestra.run.smithi044.stdout: "recovery_completed": 0, 2024-08-19T00:24:15.117 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_quiesce_path": 0, 2024-08-19T00:24:15.117 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_quiesce_inode": 0, 2024-08-19T00:24:15.117 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_enqueue_scrub": 0, 2024-08-19T00:24:15.117 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_exportdir": 0, 2024-08-19T00:24:15.117 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_flush": 0, 2024-08-19T00:24:15.117 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_fragmentdir": 0, 2024-08-19T00:24:15.118 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_fragstats": 0, 2024-08-19T00:24:15.118 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_inodestats": 0 2024-08-19T00:24:15.118 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:15.118 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_log": { 2024-08-19T00:24:15.118 INFO:teuthology.orchestra.run.smithi044.stdout: "evlrg": 0, 2024-08-19T00:24:15.118 INFO:teuthology.orchestra.run.smithi044.stdout: "evadd": 0, 2024-08-19T00:24:15.118 INFO:teuthology.orchestra.run.smithi044.stdout: "evex": 0, 2024-08-19T00:24:15.118 INFO:teuthology.orchestra.run.smithi044.stdout: "evtrm": 0, 2024-08-19T00:24:15.119 INFO:teuthology.orchestra.run.smithi044.stdout: "ev": 10, 2024-08-19T00:24:15.119 INFO:teuthology.orchestra.run.smithi044.stdout: "evexg": 0, 2024-08-19T00:24:15.119 INFO:teuthology.orchestra.run.smithi044.stdout: "evexd": 0, 2024-08-19T00:24:15.119 INFO:teuthology.orchestra.run.smithi044.stdout: "segadd": 0, 2024-08-19T00:24:15.119 INFO:teuthology.orchestra.run.smithi044.stdout: "segex": 0, 2024-08-19T00:24:15.119 INFO:teuthology.orchestra.run.smithi044.stdout: "segtrm": 0, 2024-08-19T00:24:15.119 INFO:teuthology.orchestra.run.smithi044.stdout: "seg": 2, 2024-08-19T00:24:15.119 INFO:teuthology.orchestra.run.smithi044.stdout: "segmjr": 2, 2024-08-19T00:24:15.120 INFO:teuthology.orchestra.run.smithi044.stdout: "segexg": 0, 2024-08-19T00:24:15.120 INFO:teuthology.orchestra.run.smithi044.stdout: "segexd": 0, 2024-08-19T00:24:15.120 INFO:teuthology.orchestra.run.smithi044.stdout: "expos": 4194304, 2024-08-19T00:24:15.120 INFO:teuthology.orchestra.run.smithi044.stdout: "wrpos": 4197183, 2024-08-19T00:24:15.120 INFO:teuthology.orchestra.run.smithi044.stdout: "rdpos": 4197042, 2024-08-19T00:24:15.120 INFO:teuthology.orchestra.run.smithi044.stdout: "jlat": { 2024-08-19T00:24:15.120 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:15.120 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:15.121 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:15.121 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:15.121 INFO:teuthology.orchestra.run.smithi044.stdout: "replayed": 10 2024-08-19T00:24:15.121 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:15.121 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_mem": { 2024-08-19T00:24:15.121 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 3, 2024-08-19T00:24:15.121 INFO:teuthology.orchestra.run.smithi044.stdout: "ino+": 3, 2024-08-19T00:24:15.121 INFO:teuthology.orchestra.run.smithi044.stdout: "ino-": 0, 2024-08-19T00:24:15.121 INFO:teuthology.orchestra.run.smithi044.stdout: "dir": 1, 2024-08-19T00:24:15.122 INFO:teuthology.orchestra.run.smithi044.stdout: "dir+": 1, 2024-08-19T00:24:15.122 INFO:teuthology.orchestra.run.smithi044.stdout: "dir-": 0, 2024-08-19T00:24:15.122 INFO:teuthology.orchestra.run.smithi044.stdout: "dn": 0, 2024-08-19T00:24:15.122 INFO:teuthology.orchestra.run.smithi044.stdout: "dn+": 0, 2024-08-19T00:24:15.122 INFO:teuthology.orchestra.run.smithi044.stdout: "dn-": 0, 2024-08-19T00:24:15.122 INFO:teuthology.orchestra.run.smithi044.stdout: "cap": 0, 2024-08-19T00:24:15.122 INFO:teuthology.orchestra.run.smithi044.stdout: "cap+": 0, 2024-08-19T00:24:15.122 INFO:teuthology.orchestra.run.smithi044.stdout: "cap-": 0, 2024-08-19T00:24:15.123 INFO:teuthology.orchestra.run.smithi044.stdout: "rss": 48532, 2024-08-19T00:24:15.123 INFO:teuthology.orchestra.run.smithi044.stdout: "heap": 215328 2024-08-19T00:24:15.123 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:15.123 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_server": { 2024-08-19T00:24:15.123 INFO:teuthology.orchestra.run.smithi044.stdout: "dispatch_client_request": 0, 2024-08-19T00:24:15.123 INFO:teuthology.orchestra.run.smithi044.stdout: "dispatch_server_request": 0, 2024-08-19T00:24:15.123 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_request": 0, 2024-08-19T00:24:15.123 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_session": 0, 2024-08-19T00:24:15.124 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_peer_request": 0, 2024-08-19T00:24:15.124 INFO:teuthology.orchestra.run.smithi044.stdout: "req_create_latency": { 2024-08-19T00:24:15.124 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:15.124 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:15.124 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:15.124 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:15.124 INFO:teuthology.orchestra.run.smithi044.stdout: "req_getattr_latency": { 2024-08-19T00:24:15.124 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:15.124 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:15.125 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:15.125 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:15.125 INFO:teuthology.orchestra.run.smithi044.stdout: "req_getfilelock_latency": { 2024-08-19T00:24:15.125 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:15.125 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:15.125 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:15.125 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:15.125 INFO:teuthology.orchestra.run.smithi044.stdout: "req_link_latency": { 2024-08-19T00:24:15.126 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:15.126 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:15.126 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:15.126 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:15.126 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookup_latency": { 2024-08-19T00:24:15.126 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:15.126 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:15.126 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:15.127 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:15.127 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookuphash_latency": { 2024-08-19T00:24:15.127 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:15.127 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:15.127 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:15.127 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:15.127 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupino_latency": { 2024-08-19T00:24:15.127 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:15.128 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:15.128 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:15.128 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:15.128 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupname_latency": { 2024-08-19T00:24:15.128 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:15.128 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:15.128 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:15.128 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:15.129 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupparent_latency": { 2024-08-19T00:24:15.129 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:15.129 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:15.129 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:15.129 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:15.129 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupsnap_latency": { 2024-08-19T00:24:15.129 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:15.129 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:15.129 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:15.130 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:15.130 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lssnap_latency": { 2024-08-19T00:24:15.130 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:15.130 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:15.130 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:15.130 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:15.130 INFO:teuthology.orchestra.run.smithi044.stdout: "req_mkdir_latency": { 2024-08-19T00:24:15.131 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:15.131 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:15.131 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:15.131 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:15.132 INFO:teuthology.orchestra.run.smithi044.stdout: "req_mknod_latency": { 2024-08-19T00:24:15.132 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:15.132 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:15.132 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:15.132 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:15.132 INFO:teuthology.orchestra.run.smithi044.stdout: "req_mksnap_latency": { 2024-08-19T00:24:15.132 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:15.133 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:15.133 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:15.133 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:15.133 INFO:teuthology.orchestra.run.smithi044.stdout: "req_open_latency": { 2024-08-19T00:24:15.133 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:15.133 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:15.133 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:15.133 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:15.133 INFO:teuthology.orchestra.run.smithi044.stdout: "req_readdir_latency": { 2024-08-19T00:24:15.134 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:15.134 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:15.134 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:15.134 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:15.134 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rename_latency": { 2024-08-19T00:24:15.134 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:15.134 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:15.134 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:15.135 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:15.135 INFO:teuthology.orchestra.run.smithi044.stdout: "req_renamesnap_latency": { 2024-08-19T00:24:15.135 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:15.135 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:15.135 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:15.135 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:15.135 INFO:teuthology.orchestra.run.smithi044.stdout: "req_snapdiff_latency": { 2024-08-19T00:24:15.135 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:15.136 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:15.136 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:15.136 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:15.136 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rmdir_latency": { 2024-08-19T00:24:15.136 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:15.136 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:15.136 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:15.136 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:15.137 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rmsnap_latency": { 2024-08-19T00:24:15.137 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:15.137 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:15.137 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:15.137 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:15.137 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rmxattr_latency": { 2024-08-19T00:24:15.137 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:15.137 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:15.138 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:15.138 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:15.138 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setattr_latency": { 2024-08-19T00:24:15.138 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:15.138 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:15.138 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:15.138 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:15.138 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setdirlayout_latency": { 2024-08-19T00:24:15.139 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:15.139 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:15.139 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:15.139 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:15.139 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setfilelock_latency": { 2024-08-19T00:24:15.139 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:15.139 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:15.139 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:15.140 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:15.140 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setlayout_latency": { 2024-08-19T00:24:15.140 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:15.140 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:15.140 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:15.140 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:15.140 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setxattr_latency": { 2024-08-19T00:24:15.141 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:15.141 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:15.141 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:15.141 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:15.141 INFO:teuthology.orchestra.run.smithi044.stdout: "req_symlink_latency": { 2024-08-19T00:24:15.141 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:15.141 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:15.141 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:15.141 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:15.142 INFO:teuthology.orchestra.run.smithi044.stdout: "req_unlink_latency": { 2024-08-19T00:24:15.142 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:15.142 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:15.142 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:15.142 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:15.142 INFO:teuthology.orchestra.run.smithi044.stdout: "cap_revoke_eviction": 0, 2024-08-19T00:24:15.142 INFO:teuthology.orchestra.run.smithi044.stdout: "cap_acquisition_throttle": 0, 2024-08-19T00:24:15.143 INFO:teuthology.orchestra.run.smithi044.stdout: "req_getvxattr_latency": { 2024-08-19T00:24:15.143 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:15.143 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:15.143 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:15.143 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:15.143 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:15.143 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_sessions": { 2024-08-19T00:24:15.143 INFO:teuthology.orchestra.run.smithi044.stdout: "session_count": 2, 2024-08-19T00:24:15.143 INFO:teuthology.orchestra.run.smithi044.stdout: "session_add": 5, 2024-08-19T00:24:15.144 INFO:teuthology.orchestra.run.smithi044.stdout: "session_remove": 3, 2024-08-19T00:24:15.144 INFO:teuthology.orchestra.run.smithi044.stdout: "sessions_open": 5, 2024-08-19T00:24:15.144 INFO:teuthology.orchestra.run.smithi044.stdout: "sessions_stale": 0, 2024-08-19T00:24:15.144 INFO:teuthology.orchestra.run.smithi044.stdout: "total_load": 0, 2024-08-19T00:24:15.144 INFO:teuthology.orchestra.run.smithi044.stdout: "average_load": 0, 2024-08-19T00:24:15.144 INFO:teuthology.orchestra.run.smithi044.stdout: "avg_session_uptime": 3038, 2024-08-19T00:24:15.144 INFO:teuthology.orchestra.run.smithi044.stdout: "mdthresh_evicted": 0 2024-08-19T00:24:15.144 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:15.145 INFO:teuthology.orchestra.run.smithi044.stdout: "mempool": { 2024-08-19T00:24:15.145 INFO:teuthology.orchestra.run.smithi044.stdout: "bloom_filter_bytes": 0, 2024-08-19T00:24:15.145 INFO:teuthology.orchestra.run.smithi044.stdout: "bloom_filter_items": 0, 2024-08-19T00:24:15.145 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_alloc_bytes": 0, 2024-08-19T00:24:15.145 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_alloc_items": 0, 2024-08-19T00:24:15.145 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_data_bytes": 0, 2024-08-19T00:24:15.145 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_data_items": 0, 2024-08-19T00:24:15.145 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-19T00:24:15.146 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_onode_items": 0, 2024-08-19T00:24:15.146 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-19T00:24:15.146 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_meta_items": 0, 2024-08-19T00:24:15.146 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_other_bytes": 0, 2024-08-19T00:24:15.146 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_other_items": 0, 2024-08-19T00:24:15.146 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-19T00:24:15.146 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_buffer_items": 0, 2024-08-19T00:24:15.147 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_extent_bytes": 0, 2024-08-19T00:24:15.147 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_extent_items": 0, 2024-08-19T00:24:15.147 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_blob_bytes": 0, 2024-08-19T00:24:15.147 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_blob_items": 0, 2024-08-19T00:24:15.147 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-19T00:24:15.147 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_shared_blob_items": 0, 2024-08-19T00:24:15.147 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-19T00:24:15.147 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_inline_bl_items": 0, 2024-08-19T00:24:15.148 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_bytes": 0, 2024-08-19T00:24:15.148 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_items": 0, 2024-08-19T00:24:15.148 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_txc_bytes": 0, 2024-08-19T00:24:15.148 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_txc_items": 0, 2024-08-19T00:24:15.148 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-19T00:24:15.148 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_deferred_items": 0, 2024-08-19T00:24:15.148 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_bytes": 0, 2024-08-19T00:24:15.148 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_items": 0, 2024-08-19T00:24:15.149 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_bytes": 0, 2024-08-19T00:24:15.149 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_items": 0, 2024-08-19T00:24:15.149 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_reader_bytes": 0, 2024-08-19T00:24:15.149 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_reader_items": 0, 2024-08-19T00:24:15.149 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_writer_bytes": 0, 2024-08-19T00:24:15.149 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_writer_items": 0, 2024-08-19T00:24:15.149 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_anon_bytes": 197491, 2024-08-19T00:24:15.149 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_anon_items": 56, 2024-08-19T00:24:15.149 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_meta_bytes": 0, 2024-08-19T00:24:15.150 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_meta_items": 0, 2024-08-19T00:24:15.150 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_bytes": 0, 2024-08-19T00:24:15.150 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_items": 0, 2024-08-19T00:24:15.150 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mapbl_bytes": 0, 2024-08-19T00:24:15.150 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mapbl_items": 0, 2024-08-19T00:24:15.150 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pglog_bytes": 0, 2024-08-19T00:24:15.150 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pglog_items": 0, 2024-08-19T00:24:15.150 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_bytes": 9712, 2024-08-19T00:24:15.151 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_items": 197, 2024-08-19T00:24:15.151 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_mapping_bytes": 0, 2024-08-19T00:24:15.151 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_mapping_items": 0, 2024-08-19T00:24:15.151 INFO:teuthology.orchestra.run.smithi044.stdout: "pgmap_bytes": 0, 2024-08-19T00:24:15.151 INFO:teuthology.orchestra.run.smithi044.stdout: "pgmap_items": 0, 2024-08-19T00:24:15.151 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_co_bytes": 8512, 2024-08-19T00:24:15.151 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_co_items": 13, 2024-08-19T00:24:15.151 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_1_bytes": 0, 2024-08-19T00:24:15.152 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_1_items": 0, 2024-08-19T00:24:15.152 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_2_bytes": 0, 2024-08-19T00:24:15.152 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_2_items": 0 2024-08-19T00:24:15.152 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:15.152 INFO:teuthology.orchestra.run.smithi044.stdout: "objecter": { 2024-08-19T00:24:15.152 INFO:teuthology.orchestra.run.smithi044.stdout: "op_active": 0, 2024-08-19T00:24:15.152 INFO:teuthology.orchestra.run.smithi044.stdout: "op_laggy": 0, 2024-08-19T00:24:15.152 INFO:teuthology.orchestra.run.smithi044.stdout: "op_send": 2183, 2024-08-19T00:24:15.153 INFO:teuthology.orchestra.run.smithi044.stdout: "op_send_bytes": 21, 2024-08-19T00:24:15.153 INFO:teuthology.orchestra.run.smithi044.stdout: "op_resend": 3, 2024-08-19T00:24:15.153 INFO:teuthology.orchestra.run.smithi044.stdout: "op_reply": 2183, 2024-08-19T00:24:15.153 INFO:teuthology.orchestra.run.smithi044.stdout: "op_latency": { 2024-08-19T00:24:15.153 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 2183, 2024-08-19T00:24:15.153 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 1.005985134, 2024-08-19T00:24:15.153 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000460826 2024-08-19T00:24:15.153 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:15.154 INFO:teuthology.orchestra.run.smithi044.stdout: "op_inflight": 0, 2024-08-19T00:24:15.154 INFO:teuthology.orchestra.run.smithi044.stdout: "oplen_avg": { 2024-08-19T00:24:15.154 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 2183, 2024-08-19T00:24:15.154 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 2184 2024-08-19T00:24:15.154 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:15.154 INFO:teuthology.orchestra.run.smithi044.stdout: "op": 2183, 2024-08-19T00:24:15.154 INFO:teuthology.orchestra.run.smithi044.stdout: "op_r": 2183, 2024-08-19T00:24:15.154 INFO:teuthology.orchestra.run.smithi044.stdout: "op_w": 0, 2024-08-19T00:24:15.155 INFO:teuthology.orchestra.run.smithi044.stdout: "op_rmw": 0, 2024-08-19T00:24:15.155 INFO:teuthology.orchestra.run.smithi044.stdout: "op_pg": 0, 2024-08-19T00:24:15.155 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_stat": 1414, 2024-08-19T00:24:15.155 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_create": 0, 2024-08-19T00:24:15.155 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_read": 767, 2024-08-19T00:24:15.155 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_write": 0, 2024-08-19T00:24:15.155 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_writefull": 0, 2024-08-19T00:24:15.155 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_writesame": 0, 2024-08-19T00:24:15.155 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_append": 0, 2024-08-19T00:24:15.156 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_zero": 0, 2024-08-19T00:24:15.156 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_truncate": 0, 2024-08-19T00:24:15.156 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_delete": 0, 2024-08-19T00:24:15.156 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_mapext": 0, 2024-08-19T00:24:15.156 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_sparse_read": 0, 2024-08-19T00:24:15.156 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_clonerange": 0, 2024-08-19T00:24:15.156 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_getxattr": 1, 2024-08-19T00:24:15.156 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_setxattr": 0, 2024-08-19T00:24:15.157 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_cmpxattr": 0, 2024-08-19T00:24:15.157 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_rmxattr": 0, 2024-08-19T00:24:15.157 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_resetxattrs": 0, 2024-08-19T00:24:15.157 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_call": 0, 2024-08-19T00:24:15.157 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_watch": 0, 2024-08-19T00:24:15.157 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_notify": 0, 2024-08-19T00:24:15.157 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_src_cmpxattr": 0, 2024-08-19T00:24:15.157 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_pgls": 0, 2024-08-19T00:24:15.158 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_pgls_filter": 0, 2024-08-19T00:24:15.158 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_other": 0, 2024-08-19T00:24:15.158 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_active": 0, 2024-08-19T00:24:15.158 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_send": 0, 2024-08-19T00:24:15.158 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_resend": 0, 2024-08-19T00:24:15.158 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_ping": 0, 2024-08-19T00:24:15.158 INFO:teuthology.orchestra.run.smithi044.stdout: "poolop_active": 0, 2024-08-19T00:24:15.158 INFO:teuthology.orchestra.run.smithi044.stdout: "poolop_send": 0, 2024-08-19T00:24:15.159 INFO:teuthology.orchestra.run.smithi044.stdout: "poolop_resend": 0, 2024-08-19T00:24:15.159 INFO:teuthology.orchestra.run.smithi044.stdout: "poolstat_active": 0, 2024-08-19T00:24:15.159 INFO:teuthology.orchestra.run.smithi044.stdout: "poolstat_send": 0, 2024-08-19T00:24:15.159 INFO:teuthology.orchestra.run.smithi044.stdout: "poolstat_resend": 0, 2024-08-19T00:24:15.159 INFO:teuthology.orchestra.run.smithi044.stdout: "statfs_active": 0, 2024-08-19T00:24:15.159 INFO:teuthology.orchestra.run.smithi044.stdout: "statfs_send": 0, 2024-08-19T00:24:15.159 INFO:teuthology.orchestra.run.smithi044.stdout: "statfs_resend": 0, 2024-08-19T00:24:15.159 INFO:teuthology.orchestra.run.smithi044.stdout: "command_active": 0, 2024-08-19T00:24:15.159 INFO:teuthology.orchestra.run.smithi044.stdout: "command_send": 0, 2024-08-19T00:24:15.160 INFO:teuthology.orchestra.run.smithi044.stdout: "command_resend": 0, 2024-08-19T00:24:15.160 INFO:teuthology.orchestra.run.smithi044.stdout: "map_epoch": 105, 2024-08-19T00:24:15.160 INFO:teuthology.orchestra.run.smithi044.stdout: "map_full": 0, 2024-08-19T00:24:15.160 INFO:teuthology.orchestra.run.smithi044.stdout: "map_inc": 15, 2024-08-19T00:24:15.160 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_sessions": 6, 2024-08-19T00:24:15.160 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_session_open": 6, 2024-08-19T00:24:15.160 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_session_close": 0, 2024-08-19T00:24:15.160 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_laggy": 0, 2024-08-19T00:24:15.161 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_wr": 0, 2024-08-19T00:24:15.161 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_rd": 2, 2024-08-19T00:24:15.161 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_del": 0 2024-08-19T00:24:15.161 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:15.161 INFO:teuthology.orchestra.run.smithi044.stdout: "oft": { 2024-08-19T00:24:15.161 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_objs": 0, 2024-08-19T00:24:15.161 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_kv_pairs": 0, 2024-08-19T00:24:15.161 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_updates": 0, 2024-08-19T00:24:15.161 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_removes": 0 2024-08-19T00:24:15.162 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:15.162 INFO:teuthology.orchestra.run.smithi044.stdout: "osd-slow-ops": { 2024-08-19T00:24:15.162 INFO:teuthology.orchestra.run.smithi044.stdout: "slow_ops_count": 0 2024-08-19T00:24:15.162 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:15.162 INFO:teuthology.orchestra.run.smithi044.stdout: "purge_queue": { 2024-08-19T00:24:15.162 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing_ops": 0, 2024-08-19T00:24:15.162 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing_ops_high_water": 0, 2024-08-19T00:24:15.162 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing": 0, 2024-08-19T00:24:15.163 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing_high_water": 0, 2024-08-19T00:24:15.163 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executed_ops": 0, 2024-08-19T00:24:15.163 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executed": 0, 2024-08-19T00:24:15.163 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_item_in_journal": 0 2024-08-19T00:24:15.163 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:15.163 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-19T00:24:15.163 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-08-19T00:24:15.163 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 104857600, 2024-08-19T00:24:15.164 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-08-19T00:24:15.164 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 2446, 2024-08-19T00:24:15.164 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 2040987, 2024-08-19T00:24:15.164 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-08-19T00:24:15.164 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 2446, 2024-08-19T00:24:15.164 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2024-08-19T00:24:15.164 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2024-08-19T00:24:15.164 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 2446, 2024-08-19T00:24:15.164 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 2040987, 2024-08-19T00:24:15.165 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-08-19T00:24:15.165 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:15.165 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:15.165 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:15.165 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:15.165 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:15.165 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-objecter_bytes": { 2024-08-19T00:24:15.165 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-08-19T00:24:15.166 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 104857600, 2024-08-19T00:24:15.166 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-08-19T00:24:15.166 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2024-08-19T00:24:15.166 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2024-08-19T00:24:15.166 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-08-19T00:24:15.166 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2024-08-19T00:24:15.166 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 2183, 2024-08-19T00:24:15.166 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 2884, 2024-08-19T00:24:15.166 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 2183, 2024-08-19T00:24:15.167 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 2884, 2024-08-19T00:24:15.167 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-08-19T00:24:15.167 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:15.167 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:15.167 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:15.167 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:15.167 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:15.167 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-objecter_ops": { 2024-08-19T00:24:15.168 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-08-19T00:24:15.168 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 1024, 2024-08-19T00:24:15.168 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-08-19T00:24:15.168 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2024-08-19T00:24:15.168 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2024-08-19T00:24:15.168 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-08-19T00:24:15.168 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2024-08-19T00:24:15.168 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 2183, 2024-08-19T00:24:15.169 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 2183, 2024-08-19T00:24:15.169 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 2183, 2024-08-19T00:24:15.169 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 2183, 2024-08-19T00:24:15.169 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-08-19T00:24:15.169 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:15.169 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:15.169 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:15.169 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:15.170 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:15.170 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-write_buf_throttle": { 2024-08-19T00:24:15.170 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-08-19T00:24:15.170 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 3758096384, 2024-08-19T00:24:15.170 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-08-19T00:24:15.170 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2024-08-19T00:24:15.170 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2024-08-19T00:24:15.170 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-08-19T00:24:15.171 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2024-08-19T00:24:15.171 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2024-08-19T00:24:15.171 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2024-08-19T00:24:15.171 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 0, 2024-08-19T00:24:15.171 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 0, 2024-08-19T00:24:15.171 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-08-19T00:24:15.171 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:15.171 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:15.172 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:15.172 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:15.172 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:15.172 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-write_buf_throttle-0x5569dd806b40": { 2024-08-19T00:24:15.172 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-08-19T00:24:15.172 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 3758096384, 2024-08-19T00:24:15.172 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-08-19T00:24:15.172 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2024-08-19T00:24:15.173 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2024-08-19T00:24:15.173 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-08-19T00:24:15.173 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2024-08-19T00:24:15.173 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2024-08-19T00:24:15.173 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2024-08-19T00:24:15.173 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 0, 2024-08-19T00:24:15.173 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 0, 2024-08-19T00:24:15.173 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-08-19T00:24:15.173 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:15.174 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:15.174 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:15.174 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:15.174 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:15.174 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-08-19T00:24:16.084 INFO:tasks.check_counter:Daemon mds.d mds.exported=0 2024-08-19T00:24:16.084 INFO:tasks.check_counter:Daemon mds.d mds.imported=0 2024-08-19T00:24:16.084 INFO:tasks.check_counter:Daemon mds.d mds.root_rsnaps=0 2024-08-19T00:24:16.084 INFO:tasks.check_counter:Daemon mds.d mds_server.req_mksnap_latency.avgcount=0 2024-08-19T00:24:16.084 INFO:tasks.check_counter:Daemon mds.d mds_server.req_rmsnap_latency.avgcount=0 2024-08-19T00:24:16.085 DEBUG:tasks.check_counter:Getting stats from g 2024-08-19T00:24:16.085 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph daemon mds.g perf dump 2024-08-19T00:24:16.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:16 smithi171 ceph-mon[21810]: pgmap v341: 129 pgs: 129 active+clean; 539 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 131 KiB/s wr, 39 op/s 2024-08-19T00:24:16.343 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:24:16.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:16 smithi116 ceph-mon[21873]: pgmap v341: 129 pgs: 129 active+clean; 539 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 131 KiB/s wr, 39 op/s 2024-08-19T00:24:16.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:16 smithi044 ceph-mon[18489]: pgmap v341: 129 pgs: 129 active+clean; 539 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 131 KiB/s wr, 39 op/s 2024-08-19T00:24:17.039 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-08-19T00:24:17.040 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-0": { 2024-08-19T00:24:17.040 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 1265, 2024-08-19T00:24:17.041 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 1265, 2024-08-19T00:24:17.041 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 8775725, 2024-08-19T00:24:17.041 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 401447, 2024-08-19T00:24:17.041 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 7, 2024-08-19T00:24:17.041 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 3, 2024-08-19T00:24:17.041 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 0.114682889, 2024-08-19T00:24:17.042 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.035740770, 2024-08-19T00:24:17.042 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.035799208, 2024-08-19T00:24:17.042 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.032901102, 2024-08-19T00:24:17.042 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2024-08-19T00:24:17.042 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 1264, 2024-08-19T00:24:17.042 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.045443888, 2024-08-19T00:24:17.042 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000035952 2024-08-19T00:24:17.043 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:17.043 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2024-08-19T00:24:17.043 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:17.043 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:17.043 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:17.043 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:17.043 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-08-19T00:24:17.044 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_encrypted_bytes": 448 2024-08-19T00:24:17.044 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:17.044 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-1": { 2024-08-19T00:24:17.044 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 1007, 2024-08-19T00:24:17.044 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 1174, 2024-08-19T00:24:17.044 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 21228586, 2024-08-19T00:24:17.044 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 768602, 2024-08-19T00:24:17.044 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 8, 2024-08-19T00:24:17.045 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 6, 2024-08-19T00:24:17.045 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 0.100790661, 2024-08-19T00:24:17.045 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.029252009, 2024-08-19T00:24:17.045 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.038476969, 2024-08-19T00:24:17.045 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.024643548, 2024-08-19T00:24:17.045 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2024-08-19T00:24:17.045 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 1171, 2024-08-19T00:24:17.045 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.041212306, 2024-08-19T00:24:17.046 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000035194 2024-08-19T00:24:17.046 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:17.046 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2024-08-19T00:24:17.046 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:17.046 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:17.046 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:17.046 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:17.046 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_encrypted_bytes": 320, 2024-08-19T00:24:17.047 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_encrypted_bytes": 448944 2024-08-19T00:24:17.047 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:17.047 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-2": { 2024-08-19T00:24:17.047 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 580, 2024-08-19T00:24:17.047 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 563, 2024-08-19T00:24:17.047 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 9187034, 2024-08-19T00:24:17.047 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 241612, 2024-08-19T00:24:17.047 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 4, 2024-08-19T00:24:17.047 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 3, 2024-08-19T00:24:17.048 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 0.068763245, 2024-08-19T00:24:17.048 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.022436077, 2024-08-19T00:24:17.048 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.051384311, 2024-08-19T00:24:17.048 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.007313297, 2024-08-19T00:24:17.048 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2024-08-19T00:24:17.048 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 562, 2024-08-19T00:24:17.048 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.020180082, 2024-08-19T00:24:17.048 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000035907 2024-08-19T00:24:17.049 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:17.049 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2024-08-19T00:24:17.049 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:17.049 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:17.049 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:17.049 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:17.049 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_encrypted_bytes": 1652352, 2024-08-19T00:24:17.049 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_encrypted_bytes": 139216 2024-08-19T00:24:17.050 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:17.050 INFO:teuthology.orchestra.run.smithi044.stdout: "cct": { 2024-08-19T00:24:17.050 INFO:teuthology.orchestra.run.smithi044.stdout: "total_workers": 1, 2024-08-19T00:24:17.050 INFO:teuthology.orchestra.run.smithi044.stdout: "unhealthy_workers": 0 2024-08-19T00:24:17.050 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:17.050 INFO:teuthology.orchestra.run.smithi044.stdout: "finisher-MDSRank": { 2024-08-19T00:24:17.050 INFO:teuthology.orchestra.run.smithi044.stdout: "queue_len": 0, 2024-08-19T00:24:17.050 INFO:teuthology.orchestra.run.smithi044.stdout: "complete_latency": { 2024-08-19T00:24:17.051 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 4439, 2024-08-19T00:24:17.051 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.097360947, 2024-08-19T00:24:17.051 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000021933 2024-08-19T00:24:17.051 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:17.051 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:17.051 INFO:teuthology.orchestra.run.smithi044.stdout: "finisher-PurgeQueue": { 2024-08-19T00:24:17.051 INFO:teuthology.orchestra.run.smithi044.stdout: "queue_len": 0, 2024-08-19T00:24:17.052 INFO:teuthology.orchestra.run.smithi044.stdout: "complete_latency": { 2024-08-19T00:24:17.052 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:17.052 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:17.052 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:17.052 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:17.052 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:17.052 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": { 2024-08-19T00:24:17.052 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 0, 2024-08-19T00:24:17.053 INFO:teuthology.orchestra.run.smithi044.stdout: "reply": 0, 2024-08-19T00:24:17.053 INFO:teuthology.orchestra.run.smithi044.stdout: "reply_latency": { 2024-08-19T00:24:17.053 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:17.053 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:17.053 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:17.053 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:17.053 INFO:teuthology.orchestra.run.smithi044.stdout: "slow_reply": 0, 2024-08-19T00:24:17.053 INFO:teuthology.orchestra.run.smithi044.stdout: "forward": 0, 2024-08-19T00:24:17.054 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_fetch_complete": 0, 2024-08-19T00:24:17.054 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_fetch_keys": 0, 2024-08-19T00:24:17.054 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_commit": 0, 2024-08-19T00:24:17.054 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_split": 0, 2024-08-19T00:24:17.054 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_merge": 0, 2024-08-19T00:24:17.054 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes": 3614, 2024-08-19T00:24:17.055 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_top": 0, 2024-08-19T00:24:17.055 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_bottom": 3614, 2024-08-19T00:24:17.055 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_pin_tail": 0, 2024-08-19T00:24:17.055 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_pinned": 3614, 2024-08-19T00:24:17.055 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_expired": 0, 2024-08-19T00:24:17.055 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_with_caps": 0, 2024-08-19T00:24:17.055 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 0, 2024-08-19T00:24:17.055 INFO:teuthology.orchestra.run.smithi044.stdout: "subtrees": 3, 2024-08-19T00:24:17.056 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse": 0, 2024-08-19T00:24:17.056 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_hit": 0, 2024-08-19T00:24:17.056 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_forward": 0, 2024-08-19T00:24:17.056 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_discover": 0, 2024-08-19T00:24:17.056 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_dir_fetch": 0, 2024-08-19T00:24:17.056 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_remote_ino": 0, 2024-08-19T00:24:17.056 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_lock": 0, 2024-08-19T00:24:17.056 INFO:teuthology.orchestra.run.smithi044.stdout: "load_cent": 0, 2024-08-19T00:24:17.057 INFO:teuthology.orchestra.run.smithi044.stdout: "q": 0, 2024-08-19T00:24:17.057 INFO:teuthology.orchestra.run.smithi044.stdout: "exported": 0, 2024-08-19T00:24:17.057 INFO:teuthology.orchestra.run.smithi044.stdout: "exported_inodes": 0, 2024-08-19T00:24:17.057 INFO:teuthology.orchestra.run.smithi044.stdout: "imported": 0, 2024-08-19T00:24:17.057 INFO:teuthology.orchestra.run.smithi044.stdout: "imported_inodes": 0, 2024-08-19T00:24:17.057 INFO:teuthology.orchestra.run.smithi044.stdout: "openino_dir_fetch": 0, 2024-08-19T00:24:17.057 INFO:teuthology.orchestra.run.smithi044.stdout: "openino_backtrace_fetch": 0, 2024-08-19T00:24:17.057 INFO:teuthology.orchestra.run.smithi044.stdout: "openino_peer_discover": 0, 2024-08-19T00:24:17.058 INFO:teuthology.orchestra.run.smithi044.stdout: "root_rfiles": 0, 2024-08-19T00:24:17.058 INFO:teuthology.orchestra.run.smithi044.stdout: "root_rbytes": 0, 2024-08-19T00:24:17.058 INFO:teuthology.orchestra.run.smithi044.stdout: "root_rsnaps": 0, 2024-08-19T00:24:17.058 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_backtrace_fetch": 0, 2024-08-19T00:24:17.058 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_set_tag": 0, 2024-08-19T00:24:17.058 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_backtrace_repaired": 0, 2024-08-19T00:24:17.058 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_inotable_repaired": 0, 2024-08-19T00:24:17.058 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_dir_inodes": 0, 2024-08-19T00:24:17.059 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_dir_base_inodes": 0, 2024-08-19T00:24:17.059 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_dirfrag_rstats": 0, 2024-08-19T00:24:17.059 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_file_inodes": 0, 2024-08-19T00:24:17.059 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_inode_file_caps": 0, 2024-08-19T00:24:17.059 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_revoke": 0, 2024-08-19T00:24:17.059 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_grant": 0, 2024-08-19T00:24:17.059 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_trunc": 0, 2024-08-19T00:24:17.059 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-19T00:24:17.060 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-19T00:24:17.060 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_caps": 0, 2024-08-19T00:24:17.060 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_caps_dirty": 0, 2024-08-19T00:24:17.060 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_cap_release": 0, 2024-08-19T00:24:17.060 INFO:teuthology.orchestra.run.smithi044.stdout: "process_request_cap_release": 0 2024-08-19T00:24:17.060 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:17.060 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_cache": { 2024-08-19T00:24:17.060 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_update": 0, 2024-08-19T00:24:17.061 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_update_receipt": 0, 2024-08-19T00:24:17.061 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_try_discover": 0, 2024-08-19T00:24:17.061 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_send_discover": 0, 2024-08-19T00:24:17.061 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_handle_discover": 0, 2024-08-19T00:24:17.061 INFO:teuthology.orchestra.run.smithi044.stdout: "num_strays": 0, 2024-08-19T00:24:17.061 INFO:teuthology.orchestra.run.smithi044.stdout: "num_strays_delayed": 0, 2024-08-19T00:24:17.062 INFO:teuthology.orchestra.run.smithi044.stdout: "num_strays_enqueuing": 0, 2024-08-19T00:24:17.062 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_created": 0, 2024-08-19T00:24:17.062 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_enqueued": 0, 2024-08-19T00:24:17.062 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_reintegrated": 0, 2024-08-19T00:24:17.062 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_migrated": 0, 2024-08-19T00:24:17.062 INFO:teuthology.orchestra.run.smithi044.stdout: "num_recovering_processing": 0, 2024-08-19T00:24:17.062 INFO:teuthology.orchestra.run.smithi044.stdout: "num_recovering_enqueued": 0, 2024-08-19T00:24:17.062 INFO:teuthology.orchestra.run.smithi044.stdout: "num_recovering_prioritized": 0, 2024-08-19T00:24:17.063 INFO:teuthology.orchestra.run.smithi044.stdout: "recovery_started": 0, 2024-08-19T00:24:17.063 INFO:teuthology.orchestra.run.smithi044.stdout: "recovery_completed": 0, 2024-08-19T00:24:17.063 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_quiesce_path": 0, 2024-08-19T00:24:17.063 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_quiesce_inode": 0, 2024-08-19T00:24:17.063 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_enqueue_scrub": 0, 2024-08-19T00:24:17.063 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_exportdir": 0, 2024-08-19T00:24:17.063 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_flush": 0, 2024-08-19T00:24:17.063 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_fragmentdir": 0, 2024-08-19T00:24:17.064 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_fragstats": 0, 2024-08-19T00:24:17.064 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_inodestats": 0 2024-08-19T00:24:17.064 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:17.064 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_log": { 2024-08-19T00:24:17.064 INFO:teuthology.orchestra.run.smithi044.stdout: "evlrg": 0, 2024-08-19T00:24:17.064 INFO:teuthology.orchestra.run.smithi044.stdout: "evadd": 0, 2024-08-19T00:24:17.064 INFO:teuthology.orchestra.run.smithi044.stdout: "evex": 0, 2024-08-19T00:24:17.064 INFO:teuthology.orchestra.run.smithi044.stdout: "evtrm": 0, 2024-08-19T00:24:17.064 INFO:teuthology.orchestra.run.smithi044.stdout: "ev": 22549, 2024-08-19T00:24:17.065 INFO:teuthology.orchestra.run.smithi044.stdout: "evexg": 0, 2024-08-19T00:24:17.065 INFO:teuthology.orchestra.run.smithi044.stdout: "evexd": 0, 2024-08-19T00:24:17.065 INFO:teuthology.orchestra.run.smithi044.stdout: "segadd": 0, 2024-08-19T00:24:17.065 INFO:teuthology.orchestra.run.smithi044.stdout: "segex": 0, 2024-08-19T00:24:17.065 INFO:teuthology.orchestra.run.smithi044.stdout: "segtrm": 0, 2024-08-19T00:24:17.065 INFO:teuthology.orchestra.run.smithi044.stdout: "seg": 27, 2024-08-19T00:24:17.065 INFO:teuthology.orchestra.run.smithi044.stdout: "segmjr": 3, 2024-08-19T00:24:17.065 INFO:teuthology.orchestra.run.smithi044.stdout: "segexg": 0, 2024-08-19T00:24:17.066 INFO:teuthology.orchestra.run.smithi044.stdout: "segexd": 0, 2024-08-19T00:24:17.066 INFO:teuthology.orchestra.run.smithi044.stdout: "expos": 4194304, 2024-08-19T00:24:17.066 INFO:teuthology.orchestra.run.smithi044.stdout: "wrpos": 41007646, 2024-08-19T00:24:17.066 INFO:teuthology.orchestra.run.smithi044.stdout: "rdpos": 41007047, 2024-08-19T00:24:17.066 INFO:teuthology.orchestra.run.smithi044.stdout: "jlat": { 2024-08-19T00:24:17.066 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:17.066 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:17.066 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:17.067 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:17.067 INFO:teuthology.orchestra.run.smithi044.stdout: "replayed": 22549 2024-08-19T00:24:17.067 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:17.067 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_mem": { 2024-08-19T00:24:17.067 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 97, 2024-08-19T00:24:17.067 INFO:teuthology.orchestra.run.smithi044.stdout: "ino+": 3605, 2024-08-19T00:24:17.067 INFO:teuthology.orchestra.run.smithi044.stdout: "ino-": 3508, 2024-08-19T00:24:17.067 INFO:teuthology.orchestra.run.smithi044.stdout: "dir": 22, 2024-08-19T00:24:17.068 INFO:teuthology.orchestra.run.smithi044.stdout: "dir+": 22, 2024-08-19T00:24:17.068 INFO:teuthology.orchestra.run.smithi044.stdout: "dir-": 0, 2024-08-19T00:24:17.068 INFO:teuthology.orchestra.run.smithi044.stdout: "dn": 3614, 2024-08-19T00:24:17.068 INFO:teuthology.orchestra.run.smithi044.stdout: "dn+": 3614, 2024-08-19T00:24:17.068 INFO:teuthology.orchestra.run.smithi044.stdout: "dn-": 0, 2024-08-19T00:24:17.068 INFO:teuthology.orchestra.run.smithi044.stdout: "cap": 0, 2024-08-19T00:24:17.068 INFO:teuthology.orchestra.run.smithi044.stdout: "cap+": 0, 2024-08-19T00:24:17.068 INFO:teuthology.orchestra.run.smithi044.stdout: "cap-": 0, 2024-08-19T00:24:17.069 INFO:teuthology.orchestra.run.smithi044.stdout: "rss": 53660, 2024-08-19T00:24:17.069 INFO:teuthology.orchestra.run.smithi044.stdout: "heap": 215328 2024-08-19T00:24:17.069 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:17.069 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_server": { 2024-08-19T00:24:17.069 INFO:teuthology.orchestra.run.smithi044.stdout: "dispatch_client_request": 0, 2024-08-19T00:24:17.069 INFO:teuthology.orchestra.run.smithi044.stdout: "dispatch_server_request": 0, 2024-08-19T00:24:17.069 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_request": 0, 2024-08-19T00:24:17.069 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_session": 0, 2024-08-19T00:24:17.070 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_peer_request": 0, 2024-08-19T00:24:17.070 INFO:teuthology.orchestra.run.smithi044.stdout: "req_create_latency": { 2024-08-19T00:24:17.070 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:17.070 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:17.070 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:17.070 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:17.070 INFO:teuthology.orchestra.run.smithi044.stdout: "req_getattr_latency": { 2024-08-19T00:24:17.070 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:17.071 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:17.071 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:17.071 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:17.071 INFO:teuthology.orchestra.run.smithi044.stdout: "req_getfilelock_latency": { 2024-08-19T00:24:17.071 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:17.071 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:17.071 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:17.071 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:17.072 INFO:teuthology.orchestra.run.smithi044.stdout: "req_link_latency": { 2024-08-19T00:24:17.072 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:17.072 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:17.072 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:17.072 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:17.072 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookup_latency": { 2024-08-19T00:24:17.072 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:17.072 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:17.073 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:17.073 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:17.073 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookuphash_latency": { 2024-08-19T00:24:17.073 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:17.073 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:17.073 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:17.073 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:17.073 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupino_latency": { 2024-08-19T00:24:17.074 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:17.074 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:17.074 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:17.074 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:17.074 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupname_latency": { 2024-08-19T00:24:17.074 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:17.074 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:17.074 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:17.075 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:17.075 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupparent_latency": { 2024-08-19T00:24:17.075 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:17.075 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:17.075 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:17.075 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:17.075 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupsnap_latency": { 2024-08-19T00:24:17.075 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:17.076 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:17.076 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:17.076 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:17.076 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lssnap_latency": { 2024-08-19T00:24:17.076 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:17.076 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:17.076 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:17.077 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:17.077 INFO:teuthology.orchestra.run.smithi044.stdout: "req_mkdir_latency": { 2024-08-19T00:24:17.078 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:17.078 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:17.078 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:17.078 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:17.079 INFO:teuthology.orchestra.run.smithi044.stdout: "req_mknod_latency": { 2024-08-19T00:24:17.079 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:17.079 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:17.079 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:17.079 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:17.079 INFO:teuthology.orchestra.run.smithi044.stdout: "req_mksnap_latency": { 2024-08-19T00:24:17.079 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:17.079 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:17.080 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:17.080 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:17.080 INFO:teuthology.orchestra.run.smithi044.stdout: "req_open_latency": { 2024-08-19T00:24:17.080 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:17.081 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:17.081 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:17.081 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:17.081 INFO:teuthology.orchestra.run.smithi044.stdout: "req_readdir_latency": { 2024-08-19T00:24:17.081 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:17.081 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:17.081 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:17.081 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:17.082 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rename_latency": { 2024-08-19T00:24:17.082 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:17.082 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:17.082 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:17.082 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:17.082 INFO:teuthology.orchestra.run.smithi044.stdout: "req_renamesnap_latency": { 2024-08-19T00:24:17.083 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:17.083 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:17.083 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:17.083 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:17.084 INFO:teuthology.orchestra.run.smithi044.stdout: "req_snapdiff_latency": { 2024-08-19T00:24:17.084 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:17.084 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:17.085 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:17.085 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:17.085 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rmdir_latency": { 2024-08-19T00:24:17.085 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:17.085 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:17.085 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:17.086 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:17.086 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rmsnap_latency": { 2024-08-19T00:24:17.086 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:17.086 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:17.086 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:17.086 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:17.086 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rmxattr_latency": { 2024-08-19T00:24:17.086 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:17.087 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:17.087 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:17.087 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:17.087 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setattr_latency": { 2024-08-19T00:24:17.087 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:17.087 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:17.087 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:17.087 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:17.088 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setdirlayout_latency": { 2024-08-19T00:24:17.088 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:17.088 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:17.088 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:17.088 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:17.088 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setfilelock_latency": { 2024-08-19T00:24:17.088 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:17.088 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:17.089 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:17.089 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:17.089 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setlayout_latency": { 2024-08-19T00:24:17.089 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:17.089 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:17.089 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:17.089 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:17.089 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setxattr_latency": { 2024-08-19T00:24:17.090 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:17.090 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:17.090 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:17.090 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:17.091 INFO:teuthology.orchestra.run.smithi044.stdout: "req_symlink_latency": { 2024-08-19T00:24:17.091 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:17.091 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:17.091 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:17.091 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:17.091 INFO:teuthology.orchestra.run.smithi044.stdout: "req_unlink_latency": { 2024-08-19T00:24:17.091 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:17.092 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:17.092 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:17.092 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:17.092 INFO:teuthology.orchestra.run.smithi044.stdout: "cap_revoke_eviction": 0, 2024-08-19T00:24:17.092 INFO:teuthology.orchestra.run.smithi044.stdout: "cap_acquisition_throttle": 0, 2024-08-19T00:24:17.092 INFO:teuthology.orchestra.run.smithi044.stdout: "req_getvxattr_latency": { 2024-08-19T00:24:17.092 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:17.092 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:17.093 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:17.093 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:17.093 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:17.093 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_sessions": { 2024-08-19T00:24:17.093 INFO:teuthology.orchestra.run.smithi044.stdout: "session_count": 2, 2024-08-19T00:24:17.093 INFO:teuthology.orchestra.run.smithi044.stdout: "session_add": 4, 2024-08-19T00:24:17.093 INFO:teuthology.orchestra.run.smithi044.stdout: "session_remove": 2, 2024-08-19T00:24:17.093 INFO:teuthology.orchestra.run.smithi044.stdout: "sessions_open": 4, 2024-08-19T00:24:17.094 INFO:teuthology.orchestra.run.smithi044.stdout: "sessions_stale": 0, 2024-08-19T00:24:17.094 INFO:teuthology.orchestra.run.smithi044.stdout: "total_load": 0, 2024-08-19T00:24:17.094 INFO:teuthology.orchestra.run.smithi044.stdout: "average_load": 0, 2024-08-19T00:24:17.094 INFO:teuthology.orchestra.run.smithi044.stdout: "avg_session_uptime": 2562, 2024-08-19T00:24:17.094 INFO:teuthology.orchestra.run.smithi044.stdout: "mdthresh_evicted": 0 2024-08-19T00:24:17.095 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:17.095 INFO:teuthology.orchestra.run.smithi044.stdout: "mempool": { 2024-08-19T00:24:17.095 INFO:teuthology.orchestra.run.smithi044.stdout: "bloom_filter_bytes": 0, 2024-08-19T00:24:17.095 INFO:teuthology.orchestra.run.smithi044.stdout: "bloom_filter_items": 0, 2024-08-19T00:24:17.095 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_alloc_bytes": 0, 2024-08-19T00:24:17.095 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_alloc_items": 0, 2024-08-19T00:24:17.095 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_data_bytes": 0, 2024-08-19T00:24:17.096 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_data_items": 0, 2024-08-19T00:24:17.096 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-19T00:24:17.096 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_onode_items": 0, 2024-08-19T00:24:17.096 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-19T00:24:17.096 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_meta_items": 0, 2024-08-19T00:24:17.096 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_other_bytes": 0, 2024-08-19T00:24:17.096 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_other_items": 0, 2024-08-19T00:24:17.096 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-19T00:24:17.097 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_buffer_items": 0, 2024-08-19T00:24:17.097 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_extent_bytes": 0, 2024-08-19T00:24:17.097 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_extent_items": 0, 2024-08-19T00:24:17.097 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_blob_bytes": 0, 2024-08-19T00:24:17.097 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_blob_items": 0, 2024-08-19T00:24:17.097 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-19T00:24:17.097 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_shared_blob_items": 0, 2024-08-19T00:24:17.097 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-19T00:24:17.097 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_inline_bl_items": 0, 2024-08-19T00:24:17.098 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_bytes": 0, 2024-08-19T00:24:17.098 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_items": 0, 2024-08-19T00:24:17.098 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_txc_bytes": 0, 2024-08-19T00:24:17.098 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_txc_items": 0, 2024-08-19T00:24:17.098 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-19T00:24:17.098 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_deferred_items": 0, 2024-08-19T00:24:17.098 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_bytes": 0, 2024-08-19T00:24:17.099 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_items": 0, 2024-08-19T00:24:17.099 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_bytes": 0, 2024-08-19T00:24:17.099 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_items": 0, 2024-08-19T00:24:17.099 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_reader_bytes": 0, 2024-08-19T00:24:17.099 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_reader_items": 0, 2024-08-19T00:24:17.099 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_writer_bytes": 0, 2024-08-19T00:24:17.099 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_writer_items": 0, 2024-08-19T00:24:17.099 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_anon_bytes": 218198, 2024-08-19T00:24:17.100 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_anon_items": 148, 2024-08-19T00:24:17.100 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_meta_bytes": 0, 2024-08-19T00:24:17.100 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_meta_items": 0, 2024-08-19T00:24:17.100 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_bytes": 0, 2024-08-19T00:24:17.100 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_items": 0, 2024-08-19T00:24:17.100 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mapbl_bytes": 0, 2024-08-19T00:24:17.100 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mapbl_items": 0, 2024-08-19T00:24:17.101 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pglog_bytes": 0, 2024-08-19T00:24:17.101 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pglog_items": 0, 2024-08-19T00:24:17.101 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_bytes": 9712, 2024-08-19T00:24:17.101 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_items": 197, 2024-08-19T00:24:17.101 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_mapping_bytes": 0, 2024-08-19T00:24:17.101 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_mapping_items": 0, 2024-08-19T00:24:17.101 INFO:teuthology.orchestra.run.smithi044.stdout: "pgmap_bytes": 0, 2024-08-19T00:24:17.101 INFO:teuthology.orchestra.run.smithi044.stdout: "pgmap_items": 0, 2024-08-19T00:24:17.101 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_co_bytes": 2852254, 2024-08-19T00:24:17.102 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_co_items": 19942, 2024-08-19T00:24:17.102 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_1_bytes": 0, 2024-08-19T00:24:17.102 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_1_items": 0, 2024-08-19T00:24:17.102 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_2_bytes": 0, 2024-08-19T00:24:17.102 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_2_items": 0 2024-08-19T00:24:17.102 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:17.102 INFO:teuthology.orchestra.run.smithi044.stdout: "objecter": { 2024-08-19T00:24:17.102 INFO:teuthology.orchestra.run.smithi044.stdout: "op_active": 0, 2024-08-19T00:24:17.103 INFO:teuthology.orchestra.run.smithi044.stdout: "op_laggy": 0, 2024-08-19T00:24:17.103 INFO:teuthology.orchestra.run.smithi044.stdout: "op_send": 2588, 2024-08-19T00:24:17.103 INFO:teuthology.orchestra.run.smithi044.stdout: "op_send_bytes": 21, 2024-08-19T00:24:17.103 INFO:teuthology.orchestra.run.smithi044.stdout: "op_resend": 3, 2024-08-19T00:24:17.103 INFO:teuthology.orchestra.run.smithi044.stdout: "op_reply": 2588, 2024-08-19T00:24:17.103 INFO:teuthology.orchestra.run.smithi044.stdout: "op_latency": { 2024-08-19T00:24:17.103 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 2588, 2024-08-19T00:24:17.104 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 1.509977650, 2024-08-19T00:24:17.104 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000583453 2024-08-19T00:24:17.104 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:17.104 INFO:teuthology.orchestra.run.smithi044.stdout: "op_inflight": 0, 2024-08-19T00:24:17.104 INFO:teuthology.orchestra.run.smithi044.stdout: "oplen_avg": { 2024-08-19T00:24:17.104 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 2588, 2024-08-19T00:24:17.104 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 2589 2024-08-19T00:24:17.104 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:17.105 INFO:teuthology.orchestra.run.smithi044.stdout: "op": 2588, 2024-08-19T00:24:17.105 INFO:teuthology.orchestra.run.smithi044.stdout: "op_r": 2588, 2024-08-19T00:24:17.105 INFO:teuthology.orchestra.run.smithi044.stdout: "op_w": 0, 2024-08-19T00:24:17.105 INFO:teuthology.orchestra.run.smithi044.stdout: "op_rmw": 0, 2024-08-19T00:24:17.105 INFO:teuthology.orchestra.run.smithi044.stdout: "op_pg": 0, 2024-08-19T00:24:17.105 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_stat": 1414, 2024-08-19T00:24:17.105 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_create": 0, 2024-08-19T00:24:17.106 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_read": 1172, 2024-08-19T00:24:17.106 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_write": 0, 2024-08-19T00:24:17.106 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_writefull": 0, 2024-08-19T00:24:17.106 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_writesame": 0, 2024-08-19T00:24:17.106 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_append": 0, 2024-08-19T00:24:17.106 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_zero": 0, 2024-08-19T00:24:17.106 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_truncate": 0, 2024-08-19T00:24:17.107 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_delete": 0, 2024-08-19T00:24:17.107 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_mapext": 0, 2024-08-19T00:24:17.107 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_sparse_read": 0, 2024-08-19T00:24:17.107 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_clonerange": 0, 2024-08-19T00:24:17.107 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_getxattr": 1, 2024-08-19T00:24:17.107 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_setxattr": 0, 2024-08-19T00:24:17.107 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_cmpxattr": 0, 2024-08-19T00:24:17.107 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_rmxattr": 0, 2024-08-19T00:24:17.107 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_resetxattrs": 0, 2024-08-19T00:24:17.108 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_call": 0, 2024-08-19T00:24:17.108 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_watch": 0, 2024-08-19T00:24:17.108 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_notify": 0, 2024-08-19T00:24:17.108 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_src_cmpxattr": 0, 2024-08-19T00:24:17.108 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_pgls": 0, 2024-08-19T00:24:17.108 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_pgls_filter": 0, 2024-08-19T00:24:17.108 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_other": 0, 2024-08-19T00:24:17.109 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_active": 0, 2024-08-19T00:24:17.109 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_send": 0, 2024-08-19T00:24:17.109 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_resend": 0, 2024-08-19T00:24:17.109 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_ping": 0, 2024-08-19T00:24:17.109 INFO:teuthology.orchestra.run.smithi044.stdout: "poolop_active": 0, 2024-08-19T00:24:17.109 INFO:teuthology.orchestra.run.smithi044.stdout: "poolop_send": 0, 2024-08-19T00:24:17.109 INFO:teuthology.orchestra.run.smithi044.stdout: "poolop_resend": 0, 2024-08-19T00:24:17.109 INFO:teuthology.orchestra.run.smithi044.stdout: "poolstat_active": 0, 2024-08-19T00:24:17.110 INFO:teuthology.orchestra.run.smithi044.stdout: "poolstat_send": 0, 2024-08-19T00:24:17.110 INFO:teuthology.orchestra.run.smithi044.stdout: "poolstat_resend": 0, 2024-08-19T00:24:17.110 INFO:teuthology.orchestra.run.smithi044.stdout: "statfs_active": 0, 2024-08-19T00:24:17.110 INFO:teuthology.orchestra.run.smithi044.stdout: "statfs_send": 0, 2024-08-19T00:24:17.110 INFO:teuthology.orchestra.run.smithi044.stdout: "statfs_resend": 0, 2024-08-19T00:24:17.110 INFO:teuthology.orchestra.run.smithi044.stdout: "command_active": 0, 2024-08-19T00:24:17.110 INFO:teuthology.orchestra.run.smithi044.stdout: "command_send": 0, 2024-08-19T00:24:17.110 INFO:teuthology.orchestra.run.smithi044.stdout: "command_resend": 0, 2024-08-19T00:24:17.111 INFO:teuthology.orchestra.run.smithi044.stdout: "map_epoch": 105, 2024-08-19T00:24:17.111 INFO:teuthology.orchestra.run.smithi044.stdout: "map_full": 0, 2024-08-19T00:24:17.111 INFO:teuthology.orchestra.run.smithi044.stdout: "map_inc": 15, 2024-08-19T00:24:17.111 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_sessions": 8, 2024-08-19T00:24:17.111 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_session_open": 8, 2024-08-19T00:24:17.111 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_session_close": 0, 2024-08-19T00:24:17.111 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_laggy": 0, 2024-08-19T00:24:17.111 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_wr": 0, 2024-08-19T00:24:17.111 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_rd": 2, 2024-08-19T00:24:17.112 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_del": 0 2024-08-19T00:24:17.112 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:17.112 INFO:teuthology.orchestra.run.smithi044.stdout: "oft": { 2024-08-19T00:24:17.112 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_objs": 0, 2024-08-19T00:24:17.112 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_kv_pairs": 0, 2024-08-19T00:24:17.112 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_updates": 0, 2024-08-19T00:24:17.112 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_removes": 0 2024-08-19T00:24:17.112 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:17.113 INFO:teuthology.orchestra.run.smithi044.stdout: "osd-slow-ops": { 2024-08-19T00:24:17.113 INFO:teuthology.orchestra.run.smithi044.stdout: "slow_ops_count": 0 2024-08-19T00:24:17.113 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:17.113 INFO:teuthology.orchestra.run.smithi044.stdout: "purge_queue": { 2024-08-19T00:24:17.113 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing_ops": 0, 2024-08-19T00:24:17.113 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing_ops_high_water": 0, 2024-08-19T00:24:17.113 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing": 0, 2024-08-19T00:24:17.114 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing_high_water": 0, 2024-08-19T00:24:17.114 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executed_ops": 0, 2024-08-19T00:24:17.114 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executed": 0, 2024-08-19T00:24:17.114 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_item_in_journal": 0 2024-08-19T00:24:17.115 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:17.115 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-19T00:24:17.115 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-08-19T00:24:17.115 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 104857600, 2024-08-19T00:24:17.115 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-08-19T00:24:17.115 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 2848, 2024-08-19T00:24:17.115 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 38918842, 2024-08-19T00:24:17.115 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-08-19T00:24:17.116 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 2848, 2024-08-19T00:24:17.116 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2024-08-19T00:24:17.116 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2024-08-19T00:24:17.116 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 2848, 2024-08-19T00:24:17.116 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 38918842, 2024-08-19T00:24:17.116 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-08-19T00:24:17.116 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:17.116 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:17.117 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:17.117 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:17.117 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:17.117 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-objecter_bytes": { 2024-08-19T00:24:17.117 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-08-19T00:24:17.117 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 104857600, 2024-08-19T00:24:17.117 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-08-19T00:24:17.117 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2024-08-19T00:24:17.118 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2024-08-19T00:24:17.118 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-08-19T00:24:17.118 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2024-08-19T00:24:17.118 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 2588, 2024-08-19T00:24:17.118 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 36817037, 2024-08-19T00:24:17.118 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 2588, 2024-08-19T00:24:17.118 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 36817037, 2024-08-19T00:24:17.119 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-08-19T00:24:17.119 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:17.119 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:17.119 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:17.119 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:17.119 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:17.119 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-objecter_ops": { 2024-08-19T00:24:17.120 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-08-19T00:24:17.120 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 1024, 2024-08-19T00:24:17.120 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-08-19T00:24:17.120 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2024-08-19T00:24:17.120 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2024-08-19T00:24:17.120 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-08-19T00:24:17.120 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2024-08-19T00:24:17.120 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 2588, 2024-08-19T00:24:17.121 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 2588, 2024-08-19T00:24:17.121 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 2588, 2024-08-19T00:24:17.121 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 2588, 2024-08-19T00:24:17.121 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-08-19T00:24:17.121 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:17.121 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:17.122 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:17.122 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:17.122 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:17.122 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-write_buf_throttle": { 2024-08-19T00:24:17.122 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-08-19T00:24:17.122 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 3758096384, 2024-08-19T00:24:17.122 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-08-19T00:24:17.123 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2024-08-19T00:24:17.123 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2024-08-19T00:24:17.123 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-08-19T00:24:17.123 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2024-08-19T00:24:17.123 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2024-08-19T00:24:17.123 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2024-08-19T00:24:17.123 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 0, 2024-08-19T00:24:17.123 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 0, 2024-08-19T00:24:17.123 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-08-19T00:24:17.124 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:17.124 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:17.124 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:17.124 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:17.124 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:17.124 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-write_buf_throttle-0x561150efeb40": { 2024-08-19T00:24:17.124 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-08-19T00:24:17.124 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 3758096384, 2024-08-19T00:24:17.125 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-08-19T00:24:17.125 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2024-08-19T00:24:17.125 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2024-08-19T00:24:17.125 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-08-19T00:24:17.125 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2024-08-19T00:24:17.125 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2024-08-19T00:24:17.125 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2024-08-19T00:24:17.125 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 0, 2024-08-19T00:24:17.126 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 0, 2024-08-19T00:24:17.126 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-08-19T00:24:17.126 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:17.126 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:17.126 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:17.126 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:17.126 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:17.126 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-08-19T00:24:18.043 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-08-19T00:24:18.043 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-08-19T00:24:18.043 INFO:tasks.check_counter:Daemon mds.g mds.root_rsnaps=0 2024-08-19T00:24:18.043 INFO:tasks.check_counter:Daemon mds.g mds_server.req_mksnap_latency.avgcount=0 2024-08-19T00:24:18.043 INFO:tasks.check_counter:Daemon mds.g mds_server.req_rmsnap_latency.avgcount=0 2024-08-19T00:24:18.044 DEBUG:tasks.check_counter:Getting stats from j 2024-08-19T00:24:18.044 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph daemon mds.j perf dump 2024-08-19T00:24:18.303 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:24:18.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:18 smithi171 ceph-mon[21810]: pgmap v342: 129 pgs: 129 active+clean; 539 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 108 KiB/s wr, 32 op/s 2024-08-19T00:24:18.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:18 smithi116 ceph-mon[21873]: pgmap v342: 129 pgs: 129 active+clean; 539 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 108 KiB/s wr, 32 op/s 2024-08-19T00:24:18.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:18 smithi044 ceph-mon[18489]: pgmap v342: 129 pgs: 129 active+clean; 539 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 108 KiB/s wr, 32 op/s 2024-08-19T00:24:18.793 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-08-19T00:24:18.793 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-0": { 2024-08-19T00:24:18.793 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 4, 2024-08-19T00:24:18.793 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 4, 2024-08-19T00:24:18.794 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 3024, 2024-08-19T00:24:18.794 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 448, 2024-08-19T00:24:18.794 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 4, 2024-08-19T00:24:18.794 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 0, 2024-08-19T00:24:18.794 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 0.003183158, 2024-08-19T00:24:18.794 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.000043892, 2024-08-19T00:24:18.794 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.002262242, 2024-08-19T00:24:18.795 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-19T00:24:18.795 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2024-08-19T00:24:18.795 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 3, 2024-08-19T00:24:18.795 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.004072669, 2024-08-19T00:24:18.795 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.001357556 2024-08-19T00:24:18.795 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:18.795 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2024-08-19T00:24:18.795 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:18.796 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:18.796 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:18.796 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:18.796 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-08-19T00:24:18.796 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_encrypted_bytes": 448 2024-08-19T00:24:18.796 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:18.796 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-1": { 2024-08-19T00:24:18.796 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 237, 2024-08-19T00:24:18.797 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 226, 2024-08-19T00:24:18.797 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 1585072, 2024-08-19T00:24:18.797 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 138944, 2024-08-19T00:24:18.797 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 2, 2024-08-19T00:24:18.797 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 1, 2024-08-19T00:24:18.797 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 0.040186937, 2024-08-19T00:24:18.797 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.014610420, 2024-08-19T00:24:18.797 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.039548212, 2024-08-19T00:24:18.798 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-19T00:24:18.798 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2024-08-19T00:24:18.798 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 225, 2024-08-19T00:24:18.798 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.010809691, 2024-08-19T00:24:18.798 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000048043 2024-08-19T00:24:18.798 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:18.798 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2024-08-19T00:24:18.798 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:18.799 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:18.799 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:18.799 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:18.799 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_encrypted_bytes": 1585072, 2024-08-19T00:24:18.799 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_encrypted_bytes": 138944 2024-08-19T00:24:18.799 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:18.799 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-2": { 2024-08-19T00:24:18.799 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 2, 2024-08-19T00:24:18.800 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 173, 2024-08-19T00:24:18.800 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 320, 2024-08-19T00:24:18.800 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 187072, 2024-08-19T00:24:18.800 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 5, 2024-08-19T00:24:18.800 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 3, 2024-08-19T00:24:18.800 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 0.012946012, 2024-08-19T00:24:18.800 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.008723189, 2024-08-19T00:24:18.800 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.002030712, 2024-08-19T00:24:18.801 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-19T00:24:18.801 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2024-08-19T00:24:18.801 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 170, 2024-08-19T00:24:18.801 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.011767105, 2024-08-19T00:24:18.801 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000069218 2024-08-19T00:24:18.801 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:18.801 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2024-08-19T00:24:18.801 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:18.802 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:18.802 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:18.802 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:18.802 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_encrypted_bytes": 320, 2024-08-19T00:24:18.802 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_encrypted_bytes": 187072 2024-08-19T00:24:18.802 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:18.802 INFO:teuthology.orchestra.run.smithi044.stdout: "cct": { 2024-08-19T00:24:18.802 INFO:teuthology.orchestra.run.smithi044.stdout: "total_workers": 0, 2024-08-19T00:24:18.803 INFO:teuthology.orchestra.run.smithi044.stdout: "unhealthy_workers": 0 2024-08-19T00:24:18.803 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:18.803 INFO:teuthology.orchestra.run.smithi044.stdout: "mempool": { 2024-08-19T00:24:18.803 INFO:teuthology.orchestra.run.smithi044.stdout: "bloom_filter_bytes": 0, 2024-08-19T00:24:18.803 INFO:teuthology.orchestra.run.smithi044.stdout: "bloom_filter_items": 0, 2024-08-19T00:24:18.803 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_alloc_bytes": 0, 2024-08-19T00:24:18.803 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_alloc_items": 0, 2024-08-19T00:24:18.803 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_data_bytes": 0, 2024-08-19T00:24:18.804 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_data_items": 0, 2024-08-19T00:24:18.804 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-19T00:24:18.804 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_onode_items": 0, 2024-08-19T00:24:18.804 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-19T00:24:18.804 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_meta_items": 0, 2024-08-19T00:24:18.804 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_other_bytes": 0, 2024-08-19T00:24:18.804 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_other_items": 0, 2024-08-19T00:24:18.804 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-19T00:24:18.805 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_buffer_items": 0, 2024-08-19T00:24:18.805 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_extent_bytes": 0, 2024-08-19T00:24:18.805 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_extent_items": 0, 2024-08-19T00:24:18.805 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_blob_bytes": 0, 2024-08-19T00:24:18.805 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_blob_items": 0, 2024-08-19T00:24:18.805 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-19T00:24:18.805 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_shared_blob_items": 0, 2024-08-19T00:24:18.805 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-19T00:24:18.806 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_inline_bl_items": 0, 2024-08-19T00:24:18.806 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_bytes": 0, 2024-08-19T00:24:18.806 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_items": 0, 2024-08-19T00:24:18.806 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_txc_bytes": 0, 2024-08-19T00:24:18.806 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_txc_items": 0, 2024-08-19T00:24:18.806 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-19T00:24:18.806 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_deferred_items": 0, 2024-08-19T00:24:18.806 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_bytes": 0, 2024-08-19T00:24:18.807 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_items": 0, 2024-08-19T00:24:18.807 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_bytes": 0, 2024-08-19T00:24:18.807 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_items": 0, 2024-08-19T00:24:18.807 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_reader_bytes": 0, 2024-08-19T00:24:18.807 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_reader_items": 0, 2024-08-19T00:24:18.807 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_writer_bytes": 0, 2024-08-19T00:24:18.807 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_writer_items": 0, 2024-08-19T00:24:18.807 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_anon_bytes": 148754, 2024-08-19T00:24:18.808 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_anon_items": 31, 2024-08-19T00:24:18.808 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_meta_bytes": 0, 2024-08-19T00:24:18.808 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_meta_items": 0, 2024-08-19T00:24:18.808 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_bytes": 0, 2024-08-19T00:24:18.808 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_items": 0, 2024-08-19T00:24:18.808 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mapbl_bytes": 0, 2024-08-19T00:24:18.808 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mapbl_items": 0, 2024-08-19T00:24:18.808 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pglog_bytes": 0, 2024-08-19T00:24:18.809 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pglog_items": 0, 2024-08-19T00:24:18.809 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_bytes": 0, 2024-08-19T00:24:18.809 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_items": 0, 2024-08-19T00:24:18.809 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_mapping_bytes": 0, 2024-08-19T00:24:18.809 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_mapping_items": 0, 2024-08-19T00:24:18.809 INFO:teuthology.orchestra.run.smithi044.stdout: "pgmap_bytes": 0, 2024-08-19T00:24:18.809 INFO:teuthology.orchestra.run.smithi044.stdout: "pgmap_items": 0, 2024-08-19T00:24:18.809 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_co_bytes": 928, 2024-08-19T00:24:18.810 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_co_items": 2, 2024-08-19T00:24:18.810 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_1_bytes": 0, 2024-08-19T00:24:18.810 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_1_items": 0, 2024-08-19T00:24:18.810 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_2_bytes": 0, 2024-08-19T00:24:18.810 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_2_items": 0 2024-08-19T00:24:18.810 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-08-19T00:24:18.810 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-19T00:24:18.810 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-08-19T00:24:18.811 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 104857600, 2024-08-19T00:24:18.811 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-08-19T00:24:18.811 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 239, 2024-08-19T00:24:18.811 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 1551670, 2024-08-19T00:24:18.811 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-08-19T00:24:18.811 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 239, 2024-08-19T00:24:18.811 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2024-08-19T00:24:18.811 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2024-08-19T00:24:18.812 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 239, 2024-08-19T00:24:18.812 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 1551670, 2024-08-19T00:24:18.812 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-08-19T00:24:18.812 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-08-19T00:24:18.812 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-08-19T00:24:18.812 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-08-19T00:24:18.812 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:18.812 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-08-19T00:24:18.813 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-08-19T00:24:19.516 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-08-19T00:24:19.516 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-08-19T00:24:19.516 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-08-19T00:24:19.516 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-08-19T00:24:19.516 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-08-19T00:24:19.517 DEBUG:tasks.check_counter:Getting stats from b 2024-08-19T00:24:19.517 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph daemon mds.b perf dump 2024-08-19T00:24:19.781 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.b/config 2024-08-19T00:24:20.160 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:20 smithi116 ceph-mon[21873]: pgmap v343: 129 pgs: 129 active+clean; 539 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 104 KiB/s wr, 31 op/s 2024-08-19T00:24:20.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:20 smithi171 ceph-mon[21810]: pgmap v343: 129 pgs: 129 active+clean; 539 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 104 KiB/s wr, 31 op/s 2024-08-19T00:24:20.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:20 smithi044 ceph-mon[18489]: pgmap v343: 129 pgs: 129 active+clean; 539 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 104 KiB/s wr, 31 op/s 2024-08-19T00:24:20.393 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-08-19T00:24:20.393 INFO:teuthology.orchestra.run.smithi116.stdout: "AsyncMessenger::Worker-0": { 2024-08-19T00:24:20.394 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_messages": 2054, 2024-08-19T00:24:20.394 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages": 2015, 2024-08-19T00:24:20.394 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_bytes": 2471399, 2024-08-19T00:24:20.394 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_bytes": 884403, 2024-08-19T00:24:20.394 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_created_connections": 11, 2024-08-19T00:24:20.394 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_active_connections": 3, 2024-08-19T00:24:20.394 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_total_time": 0.190075191, 2024-08-19T00:24:20.394 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_send_time": 0.071216378, 2024-08-19T00:24:20.395 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_recv_time": 0.129065527, 2024-08-19T00:24:20.395 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_fast_dispatch_time": 0.012997254, 2024-08-19T00:24:20.395 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages_queue_lat": { 2024-08-19T00:24:20.395 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 2020, 2024-08-19T00:24:20.395 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.178154540, 2024-08-19T00:24:20.395 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000088195 2024-08-19T00:24:20.395 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:20.396 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_handle_ack_lat": { 2024-08-19T00:24:20.396 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 2807, 2024-08-19T00:24:20.396 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000620181, 2024-08-19T00:24:20.396 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000220 2024-08-19T00:24:20.396 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:20.396 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_encrypted_bytes": 1736960, 2024-08-19T00:24:20.397 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_encrypted_bytes": 151712 2024-08-19T00:24:20.397 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:20.397 INFO:teuthology.orchestra.run.smithi116.stdout: "AsyncMessenger::Worker-1": { 2024-08-19T00:24:20.397 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_messages": 216685, 2024-08-19T00:24:20.397 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages": 135608, 2024-08-19T00:24:20.397 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_bytes": 88902463, 2024-08-19T00:24:20.398 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_bytes": 28230593, 2024-08-19T00:24:20.398 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_created_connections": 19, 2024-08-19T00:24:20.398 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_active_connections": 8, 2024-08-19T00:24:20.398 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_total_time": 9.049217483, 2024-08-19T00:24:20.398 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_send_time": 3.436250717, 2024-08-19T00:24:20.398 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_recv_time": 7.208955711, 2024-08-19T00:24:20.398 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_fast_dispatch_time": 0.227921062, 2024-08-19T00:24:20.398 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages_queue_lat": { 2024-08-19T00:24:20.399 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 135606, 2024-08-19T00:24:20.399 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 2.156173589, 2024-08-19T00:24:20.399 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000015900 2024-08-19T00:24:20.399 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:20.399 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_handle_ack_lat": { 2024-08-19T00:24:20.399 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 338628, 2024-08-19T00:24:20.399 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.051463144, 2024-08-19T00:24:20.400 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000151 2024-08-19T00:24:20.400 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:20.400 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_encrypted_bytes": 329808, 2024-08-19T00:24:20.400 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_encrypted_bytes": 238896 2024-08-19T00:24:20.400 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:20.400 INFO:teuthology.orchestra.run.smithi116.stdout: "AsyncMessenger::Worker-2": { 2024-08-19T00:24:20.400 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_messages": 3130, 2024-08-19T00:24:20.400 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages": 2590, 2024-08-19T00:24:20.401 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_bytes": 1118593, 2024-08-19T00:24:20.401 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_bytes": 7007351, 2024-08-19T00:24:20.401 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_created_connections": 150, 2024-08-19T00:24:20.401 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_active_connections": 7, 2024-08-19T00:24:20.401 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_total_time": 0.264485853, 2024-08-19T00:24:20.401 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_send_time": 0.094386240, 2024-08-19T00:24:20.402 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_recv_time": 0.143087692, 2024-08-19T00:24:20.402 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_fast_dispatch_time": 0.036989506, 2024-08-19T00:24:20.402 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages_queue_lat": { 2024-08-19T00:24:20.402 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 2582, 2024-08-19T00:24:20.402 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.254679359, 2024-08-19T00:24:20.402 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000098636 2024-08-19T00:24:20.402 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:20.403 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_handle_ack_lat": { 2024-08-19T00:24:20.403 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 3269, 2024-08-19T00:24:20.403 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000609142, 2024-08-19T00:24:20.403 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000186 2024-08-19T00:24:20.403 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:20.403 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_encrypted_bytes": 105168, 2024-08-19T00:24:20.403 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_encrypted_bytes": 362928 2024-08-19T00:24:20.403 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:20.404 INFO:teuthology.orchestra.run.smithi116.stdout: "cct": { 2024-08-19T00:24:20.404 INFO:teuthology.orchestra.run.smithi116.stdout: "total_workers": 1, 2024-08-19T00:24:20.404 INFO:teuthology.orchestra.run.smithi116.stdout: "unhealthy_workers": 0 2024-08-19T00:24:20.404 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:20.404 INFO:teuthology.orchestra.run.smithi116.stdout: "finisher-MDSRank": { 2024-08-19T00:24:20.404 INFO:teuthology.orchestra.run.smithi116.stdout: "queue_len": 0, 2024-08-19T00:24:20.404 INFO:teuthology.orchestra.run.smithi116.stdout: "complete_latency": { 2024-08-19T00:24:20.404 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 1657, 2024-08-19T00:24:20.405 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.485492207, 2024-08-19T00:24:20.405 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000292994 2024-08-19T00:24:20.405 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-08-19T00:24:20.405 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:20.405 INFO:teuthology.orchestra.run.smithi116.stdout: "finisher-PurgeQueue": { 2024-08-19T00:24:20.405 INFO:teuthology.orchestra.run.smithi116.stdout: "queue_len": 0, 2024-08-19T00:24:20.405 INFO:teuthology.orchestra.run.smithi116.stdout: "complete_latency": { 2024-08-19T00:24:20.405 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 232, 2024-08-19T00:24:20.406 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.021708353, 2024-08-19T00:24:20.406 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000093570 2024-08-19T00:24:20.406 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-08-19T00:24:20.406 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:20.406 INFO:teuthology.orchestra.run.smithi116.stdout: "mds": { 2024-08-19T00:24:20.407 INFO:teuthology.orchestra.run.smithi116.stdout: "request": 15930, 2024-08-19T00:24:20.407 INFO:teuthology.orchestra.run.smithi116.stdout: "reply": 960, 2024-08-19T00:24:20.407 INFO:teuthology.orchestra.run.smithi116.stdout: "reply_latency": { 2024-08-19T00:24:20.407 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 960, 2024-08-19T00:24:20.407 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 29.985166680, 2024-08-19T00:24:20.407 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.031234548 2024-08-19T00:24:20.407 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:20.407 INFO:teuthology.orchestra.run.smithi116.stdout: "slow_reply": 0, 2024-08-19T00:24:20.408 INFO:teuthology.orchestra.run.smithi116.stdout: "forward": 14970, 2024-08-19T00:24:20.408 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_fetch_complete": 0, 2024-08-19T00:24:20.408 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_fetch_keys": 0, 2024-08-19T00:24:20.408 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_commit": 285, 2024-08-19T00:24:20.408 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_split": 0, 2024-08-19T00:24:20.408 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_merge": 0, 2024-08-19T00:24:20.408 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes": 32, 2024-08-19T00:24:20.408 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_top": 7, 2024-08-19T00:24:20.409 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_bottom": 5, 2024-08-19T00:24:20.409 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_pin_tail": 20, 2024-08-19T00:24:20.409 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_pinned": 22, 2024-08-19T00:24:20.409 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_expired": 222, 2024-08-19T00:24:20.409 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_with_caps": 9, 2024-08-19T00:24:20.409 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": 9, 2024-08-19T00:24:20.409 INFO:teuthology.orchestra.run.smithi116.stdout: "subtrees": 6, 2024-08-19T00:24:20.409 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse": 16370, 2024-08-19T00:24:20.410 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_hit": 1024, 2024-08-19T00:24:20.410 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_forward": 14970, 2024-08-19T00:24:20.410 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_discover": 31, 2024-08-19T00:24:20.410 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_dir_fetch": 0, 2024-08-19T00:24:20.410 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_remote_ino": 0, 2024-08-19T00:24:20.410 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_lock": 18, 2024-08-19T00:24:20.410 INFO:teuthology.orchestra.run.smithi116.stdout: "load_cent": 0, 2024-08-19T00:24:20.410 INFO:teuthology.orchestra.run.smithi116.stdout: "q": 0, 2024-08-19T00:24:20.411 INFO:teuthology.orchestra.run.smithi116.stdout: "exported": 10, 2024-08-19T00:24:20.411 INFO:teuthology.orchestra.run.smithi116.stdout: "exported_inodes": 148, 2024-08-19T00:24:20.411 INFO:teuthology.orchestra.run.smithi116.stdout: "imported": 0, 2024-08-19T00:24:20.411 INFO:teuthology.orchestra.run.smithi116.stdout: "imported_inodes": 0, 2024-08-19T00:24:20.411 INFO:teuthology.orchestra.run.smithi116.stdout: "openino_dir_fetch": 0, 2024-08-19T00:24:20.411 INFO:teuthology.orchestra.run.smithi116.stdout: "openino_backtrace_fetch": 0, 2024-08-19T00:24:20.412 INFO:teuthology.orchestra.run.smithi116.stdout: "openino_peer_discover": 0, 2024-08-19T00:24:20.412 INFO:teuthology.orchestra.run.smithi116.stdout: "root_rfiles": 67, 2024-08-19T00:24:20.412 INFO:teuthology.orchestra.run.smithi116.stdout: "root_rbytes": 21137952, 2024-08-19T00:24:20.412 INFO:teuthology.orchestra.run.smithi116.stdout: "root_rsnaps": 6, 2024-08-19T00:24:20.412 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_backtrace_fetch": 0, 2024-08-19T00:24:20.412 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_set_tag": 0, 2024-08-19T00:24:20.413 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_backtrace_repaired": 0, 2024-08-19T00:24:20.413 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_inotable_repaired": 0, 2024-08-19T00:24:20.413 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_dir_inodes": 0, 2024-08-19T00:24:20.413 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_dir_base_inodes": 0, 2024-08-19T00:24:20.413 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_dirfrag_rstats": 0, 2024-08-19T00:24:20.413 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_file_inodes": 0, 2024-08-19T00:24:20.413 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_inode_file_caps": 2, 2024-08-19T00:24:20.413 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_revoke": 12283, 2024-08-19T00:24:20.414 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_grant": 12793, 2024-08-19T00:24:20.414 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_trunc": 0, 2024-08-19T00:24:20.414 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-19T00:24:20.414 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-19T00:24:20.414 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_caps": 12440, 2024-08-19T00:24:20.414 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_caps_dirty": 99, 2024-08-19T00:24:20.414 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_cap_release": 4, 2024-08-19T00:24:20.414 INFO:teuthology.orchestra.run.smithi116.stdout: "process_request_cap_release": 546 2024-08-19T00:24:20.415 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:20.415 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_cache": { 2024-08-19T00:24:20.415 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_update": 4, 2024-08-19T00:24:20.415 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_update_receipt": 0, 2024-08-19T00:24:20.415 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_try_discover": 0, 2024-08-19T00:24:20.415 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_send_discover": 31, 2024-08-19T00:24:20.415 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_handle_discover": 23, 2024-08-19T00:24:20.416 INFO:teuthology.orchestra.run.smithi116.stdout: "num_strays": 0, 2024-08-19T00:24:20.416 INFO:teuthology.orchestra.run.smithi116.stdout: "num_strays_delayed": 0, 2024-08-19T00:24:20.416 INFO:teuthology.orchestra.run.smithi116.stdout: "num_strays_enqueuing": 0, 2024-08-19T00:24:20.416 INFO:teuthology.orchestra.run.smithi116.stdout: "strays_created": 125, 2024-08-19T00:24:20.416 INFO:teuthology.orchestra.run.smithi116.stdout: "strays_enqueued": 125, 2024-08-19T00:24:20.416 INFO:teuthology.orchestra.run.smithi116.stdout: "strays_reintegrated": 0, 2024-08-19T00:24:20.416 INFO:teuthology.orchestra.run.smithi116.stdout: "strays_migrated": 0, 2024-08-19T00:24:20.416 INFO:teuthology.orchestra.run.smithi116.stdout: "num_recovering_processing": 0, 2024-08-19T00:24:20.417 INFO:teuthology.orchestra.run.smithi116.stdout: "num_recovering_enqueued": 0, 2024-08-19T00:24:20.417 INFO:teuthology.orchestra.run.smithi116.stdout: "num_recovering_prioritized": 0, 2024-08-19T00:24:20.417 INFO:teuthology.orchestra.run.smithi116.stdout: "recovery_started": 0, 2024-08-19T00:24:20.417 INFO:teuthology.orchestra.run.smithi116.stdout: "recovery_completed": 0, 2024-08-19T00:24:20.417 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_quiesce_path": 9, 2024-08-19T00:24:20.417 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_quiesce_inode": 164, 2024-08-19T00:24:20.417 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_enqueue_scrub": 0, 2024-08-19T00:24:20.418 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_exportdir": 10, 2024-08-19T00:24:20.418 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_flush": 0, 2024-08-19T00:24:20.418 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_fragmentdir": 0, 2024-08-19T00:24:20.418 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_fragstats": 0, 2024-08-19T00:24:20.418 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_inodestats": 0 2024-08-19T00:24:20.418 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:20.418 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_log": { 2024-08-19T00:24:20.418 INFO:teuthology.orchestra.run.smithi116.stdout: "evlrg": 0, 2024-08-19T00:24:20.419 INFO:teuthology.orchestra.run.smithi116.stdout: "evadd": 801, 2024-08-19T00:24:20.419 INFO:teuthology.orchestra.run.smithi116.stdout: "evex": 789, 2024-08-19T00:24:20.419 INFO:teuthology.orchestra.run.smithi116.stdout: "evtrm": 789, 2024-08-19T00:24:20.419 INFO:teuthology.orchestra.run.smithi116.stdout: "ev": 12, 2024-08-19T00:24:20.419 INFO:teuthology.orchestra.run.smithi116.stdout: "evexg": 0, 2024-08-19T00:24:20.419 INFO:teuthology.orchestra.run.smithi116.stdout: "evexd": 3, 2024-08-19T00:24:20.419 INFO:teuthology.orchestra.run.smithi116.stdout: "segadd": 50, 2024-08-19T00:24:20.419 INFO:teuthology.orchestra.run.smithi116.stdout: "segex": 49, 2024-08-19T00:24:20.420 INFO:teuthology.orchestra.run.smithi116.stdout: "segtrm": 49, 2024-08-19T00:24:20.420 INFO:teuthology.orchestra.run.smithi116.stdout: "seg": 1, 2024-08-19T00:24:20.420 INFO:teuthology.orchestra.run.smithi116.stdout: "segmjr": 1, 2024-08-19T00:24:20.420 INFO:teuthology.orchestra.run.smithi116.stdout: "segexg": 0, 2024-08-19T00:24:20.420 INFO:teuthology.orchestra.run.smithi116.stdout: "segexd": 1, 2024-08-19T00:24:20.420 INFO:teuthology.orchestra.run.smithi116.stdout: "expos": 7832756, 2024-08-19T00:24:20.420 INFO:teuthology.orchestra.run.smithi116.stdout: "wrpos": 7926248, 2024-08-19T00:24:20.420 INFO:teuthology.orchestra.run.smithi116.stdout: "rdpos": 0, 2024-08-19T00:24:20.421 INFO:teuthology.orchestra.run.smithi116.stdout: "jlat": { 2024-08-19T00:24:20.421 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 445, 2024-08-19T00:24:20.421 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.850600761, 2024-08-19T00:24:20.421 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.001911462 2024-08-19T00:24:20.421 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:20.421 INFO:teuthology.orchestra.run.smithi116.stdout: "replayed": 0 2024-08-19T00:24:20.421 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:20.421 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_mem": { 2024-08-19T00:24:20.422 INFO:teuthology.orchestra.run.smithi116.stdout: "ino": 37, 2024-08-19T00:24:20.422 INFO:teuthology.orchestra.run.smithi116.stdout: "ino+": 266, 2024-08-19T00:24:20.422 INFO:teuthology.orchestra.run.smithi116.stdout: "ino-": 229, 2024-08-19T00:24:20.422 INFO:teuthology.orchestra.run.smithi116.stdout: "dir": 50, 2024-08-19T00:24:20.422 INFO:teuthology.orchestra.run.smithi116.stdout: "dir+": 72, 2024-08-19T00:24:20.423 INFO:teuthology.orchestra.run.smithi116.stdout: "dir-": 22, 2024-08-19T00:24:20.423 INFO:teuthology.orchestra.run.smithi116.stdout: "dn": 32, 2024-08-19T00:24:20.423 INFO:teuthology.orchestra.run.smithi116.stdout: "dn+": 486, 2024-08-19T00:24:20.423 INFO:teuthology.orchestra.run.smithi116.stdout: "dn-": 454, 2024-08-19T00:24:20.423 INFO:teuthology.orchestra.run.smithi116.stdout: "cap": 9, 2024-08-19T00:24:20.423 INFO:teuthology.orchestra.run.smithi116.stdout: "cap+": 219, 2024-08-19T00:24:20.423 INFO:teuthology.orchestra.run.smithi116.stdout: "cap-": 210, 2024-08-19T00:24:20.423 INFO:teuthology.orchestra.run.smithi116.stdout: "rss": 63304, 2024-08-19T00:24:20.424 INFO:teuthology.orchestra.run.smithi116.stdout: "heap": 231712 2024-08-19T00:24:20.424 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:20.424 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_server": { 2024-08-19T00:24:20.424 INFO:teuthology.orchestra.run.smithi116.stdout: "dispatch_client_request": 16181, 2024-08-19T00:24:20.424 INFO:teuthology.orchestra.run.smithi116.stdout: "dispatch_server_request": 63, 2024-08-19T00:24:20.424 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_request": 15930, 2024-08-19T00:24:20.424 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_session": 63, 2024-08-19T00:24:20.424 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_peer_request": 65, 2024-08-19T00:24:20.425 INFO:teuthology.orchestra.run.smithi116.stdout: "req_create_latency": { 2024-08-19T00:24:20.425 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 185, 2024-08-19T00:24:20.425 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.168579249, 2024-08-19T00:24:20.425 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000911239 2024-08-19T00:24:20.425 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:20.425 INFO:teuthology.orchestra.run.smithi116.stdout: "req_getattr_latency": { 2024-08-19T00:24:20.425 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 123, 2024-08-19T00:24:20.425 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.035491754, 2024-08-19T00:24:20.426 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000288550 2024-08-19T00:24:20.426 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:20.426 INFO:teuthology.orchestra.run.smithi116.stdout: "req_getfilelock_latency": { 2024-08-19T00:24:20.426 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:20.426 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:20.427 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:20.427 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:20.427 INFO:teuthology.orchestra.run.smithi116.stdout: "req_link_latency": { 2024-08-19T00:24:20.427 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:20.427 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:20.427 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:20.427 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:20.427 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookup_latency": { 2024-08-19T00:24:20.428 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 206, 2024-08-19T00:24:20.428 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 25.301051508, 2024-08-19T00:24:20.428 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.122820638 2024-08-19T00:24:20.428 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:20.428 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookuphash_latency": { 2024-08-19T00:24:20.428 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:20.429 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:20.429 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:20.429 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:20.429 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookupino_latency": { 2024-08-19T00:24:20.429 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 1, 2024-08-19T00:24:20.429 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000289472, 2024-08-19T00:24:20.429 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000289472 2024-08-19T00:24:20.429 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:20.430 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookupname_latency": { 2024-08-19T00:24:20.430 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:20.430 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:20.430 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:20.430 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:20.431 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookupparent_latency": { 2024-08-19T00:24:20.431 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:20.431 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:20.431 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:20.431 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:20.431 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookupsnap_latency": { 2024-08-19T00:24:20.431 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:20.431 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:20.432 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:20.432 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:20.432 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lssnap_latency": { 2024-08-19T00:24:20.432 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 11, 2024-08-19T00:24:20.432 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.001598023, 2024-08-19T00:24:20.432 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000145274 2024-08-19T00:24:20.433 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:20.433 INFO:teuthology.orchestra.run.smithi116.stdout: "req_mkdir_latency": { 2024-08-19T00:24:20.433 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 20, 2024-08-19T00:24:20.433 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 3.711326017, 2024-08-19T00:24:20.433 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.185566300 2024-08-19T00:24:20.433 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:20.433 INFO:teuthology.orchestra.run.smithi116.stdout: "req_mknod_latency": { 2024-08-19T00:24:20.434 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:20.434 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:20.434 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:20.434 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:20.434 INFO:teuthology.orchestra.run.smithi116.stdout: "req_mksnap_latency": { 2024-08-19T00:24:20.434 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 11, 2024-08-19T00:24:20.434 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.082523686, 2024-08-19T00:24:20.434 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.007502153 2024-08-19T00:24:20.435 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:20.435 INFO:teuthology.orchestra.run.smithi116.stdout: "req_open_latency": { 2024-08-19T00:24:20.435 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 1, 2024-08-19T00:24:20.435 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000187316, 2024-08-19T00:24:20.435 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000187316 2024-08-19T00:24:20.435 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:20.435 INFO:teuthology.orchestra.run.smithi116.stdout: "req_readdir_latency": { 2024-08-19T00:24:20.436 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 229, 2024-08-19T00:24:20.436 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.469810755, 2024-08-19T00:24:20.436 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.002051575 2024-08-19T00:24:20.436 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:20.436 INFO:teuthology.orchestra.run.smithi116.stdout: "req_rename_latency": { 2024-08-19T00:24:20.436 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 28, 2024-08-19T00:24:20.436 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.033130320, 2024-08-19T00:24:20.436 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.001183225 2024-08-19T00:24:20.437 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:20.437 INFO:teuthology.orchestra.run.smithi116.stdout: "req_renamesnap_latency": { 2024-08-19T00:24:20.437 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:20.437 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:20.437 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:20.437 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:20.437 INFO:teuthology.orchestra.run.smithi116.stdout: "req_snapdiff_latency": { 2024-08-19T00:24:20.437 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:20.438 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:20.438 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:20.438 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:20.438 INFO:teuthology.orchestra.run.smithi116.stdout: "req_rmdir_latency": { 2024-08-19T00:24:20.438 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:20.438 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:20.438 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:20.438 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:20.439 INFO:teuthology.orchestra.run.smithi116.stdout: "req_rmsnap_latency": { 2024-08-19T00:24:20.439 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 5, 2024-08-19T00:24:20.439 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.025441654, 2024-08-19T00:24:20.439 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.005088330 2024-08-19T00:24:20.439 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:20.439 INFO:teuthology.orchestra.run.smithi116.stdout: "req_rmxattr_latency": { 2024-08-19T00:24:20.440 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:20.440 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:20.440 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:20.440 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:20.440 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setattr_latency": { 2024-08-19T00:24:20.440 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 2, 2024-08-19T00:24:20.440 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.001135084, 2024-08-19T00:24:20.440 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000567542 2024-08-19T00:24:20.441 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:20.441 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setdirlayout_latency": { 2024-08-19T00:24:20.441 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:20.441 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:20.441 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:20.441 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:20.441 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setfilelock_latency": { 2024-08-19T00:24:20.441 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 4, 2024-08-19T00:24:20.442 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.001193904, 2024-08-19T00:24:20.442 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000298476 2024-08-19T00:24:20.442 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:20.442 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setlayout_latency": { 2024-08-19T00:24:20.442 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:20.442 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:20.442 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:20.442 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:20.443 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setxattr_latency": { 2024-08-19T00:24:20.443 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 9, 2024-08-19T00:24:20.443 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.023272408, 2024-08-19T00:24:20.443 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.002585823 2024-08-19T00:24:20.443 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:20.444 INFO:teuthology.orchestra.run.smithi116.stdout: "req_symlink_latency": { 2024-08-19T00:24:20.444 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:20.444 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:20.444 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:20.444 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:20.444 INFO:teuthology.orchestra.run.smithi116.stdout: "req_unlink_latency": { 2024-08-19T00:24:20.444 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 125, 2024-08-19T00:24:20.444 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.130135530, 2024-08-19T00:24:20.445 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.001041084 2024-08-19T00:24:20.445 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:20.445 INFO:teuthology.orchestra.run.smithi116.stdout: "cap_revoke_eviction": 0, 2024-08-19T00:24:20.445 INFO:teuthology.orchestra.run.smithi116.stdout: "cap_acquisition_throttle": 0, 2024-08-19T00:24:20.445 INFO:teuthology.orchestra.run.smithi116.stdout: "req_getvxattr_latency": { 2024-08-19T00:24:20.445 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:20.445 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:20.445 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:20.446 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-08-19T00:24:20.446 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:20.446 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_sessions": { 2024-08-19T00:24:20.446 INFO:teuthology.orchestra.run.smithi116.stdout: "session_count": 2, 2024-08-19T00:24:20.446 INFO:teuthology.orchestra.run.smithi116.stdout: "session_add": 6, 2024-08-19T00:24:20.446 INFO:teuthology.orchestra.run.smithi116.stdout: "session_remove": 4, 2024-08-19T00:24:20.446 INFO:teuthology.orchestra.run.smithi116.stdout: "sessions_open": 2, 2024-08-19T00:24:20.447 INFO:teuthology.orchestra.run.smithi116.stdout: "sessions_stale": 0, 2024-08-19T00:24:20.447 INFO:teuthology.orchestra.run.smithi116.stdout: "total_load": 29, 2024-08-19T00:24:20.447 INFO:teuthology.orchestra.run.smithi116.stdout: "average_load": 14, 2024-08-19T00:24:20.447 INFO:teuthology.orchestra.run.smithi116.stdout: "avg_session_uptime": 638, 2024-08-19T00:24:20.447 INFO:teuthology.orchestra.run.smithi116.stdout: "mdthresh_evicted": 0 2024-08-19T00:24:20.447 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:20.447 INFO:teuthology.orchestra.run.smithi116.stdout: "mempool": { 2024-08-19T00:24:20.447 INFO:teuthology.orchestra.run.smithi116.stdout: "bloom_filter_bytes": 360, 2024-08-19T00:24:20.448 INFO:teuthology.orchestra.run.smithi116.stdout: "bloom_filter_items": 360, 2024-08-19T00:24:20.448 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_alloc_bytes": 0, 2024-08-19T00:24:20.448 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_alloc_items": 0, 2024-08-19T00:24:20.448 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_data_bytes": 0, 2024-08-19T00:24:20.448 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_data_items": 0, 2024-08-19T00:24:20.448 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-19T00:24:20.448 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_onode_items": 0, 2024-08-19T00:24:20.449 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-19T00:24:20.449 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_meta_items": 0, 2024-08-19T00:24:20.449 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_other_bytes": 0, 2024-08-19T00:24:20.449 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_other_items": 0, 2024-08-19T00:24:20.449 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-19T00:24:20.449 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_buffer_items": 0, 2024-08-19T00:24:20.449 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_extent_bytes": 0, 2024-08-19T00:24:20.449 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_extent_items": 0, 2024-08-19T00:24:20.450 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_blob_bytes": 0, 2024-08-19T00:24:20.450 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_blob_items": 0, 2024-08-19T00:24:20.450 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-19T00:24:20.450 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_shared_blob_items": 0, 2024-08-19T00:24:20.450 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-19T00:24:20.450 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_inline_bl_items": 0, 2024-08-19T00:24:20.451 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_fsck_bytes": 0, 2024-08-19T00:24:20.451 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_fsck_items": 0, 2024-08-19T00:24:20.451 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_txc_bytes": 0, 2024-08-19T00:24:20.451 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_txc_items": 0, 2024-08-19T00:24:20.451 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-19T00:24:20.451 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_deferred_items": 0, 2024-08-19T00:24:20.451 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_bytes": 0, 2024-08-19T00:24:20.452 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_items": 0, 2024-08-19T00:24:20.452 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_bytes": 0, 2024-08-19T00:24:20.452 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_items": 0, 2024-08-19T00:24:20.452 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_reader_bytes": 0, 2024-08-19T00:24:20.452 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_reader_items": 0, 2024-08-19T00:24:20.452 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_writer_bytes": 0, 2024-08-19T00:24:20.452 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_writer_items": 0, 2024-08-19T00:24:20.453 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_anon_bytes": 289488, 2024-08-19T00:24:20.453 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_anon_items": 126, 2024-08-19T00:24:20.453 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_meta_bytes": 0, 2024-08-19T00:24:20.453 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_meta_items": 0, 2024-08-19T00:24:20.453 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_bytes": 0, 2024-08-19T00:24:20.453 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_items": 0, 2024-08-19T00:24:20.454 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mapbl_bytes": 0, 2024-08-19T00:24:20.454 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mapbl_items": 0, 2024-08-19T00:24:20.454 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pglog_bytes": 0, 2024-08-19T00:24:20.454 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pglog_items": 0, 2024-08-19T00:24:20.454 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_bytes": 9712, 2024-08-19T00:24:20.454 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_items": 197, 2024-08-19T00:24:20.454 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_mapping_bytes": 0, 2024-08-19T00:24:20.455 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_mapping_items": 0, 2024-08-19T00:24:20.455 INFO:teuthology.orchestra.run.smithi116.stdout: "pgmap_bytes": 0, 2024-08-19T00:24:20.455 INFO:teuthology.orchestra.run.smithi116.stdout: "pgmap_items": 0, 2024-08-19T00:24:20.455 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_co_bytes": 231561, 2024-08-19T00:24:20.455 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_co_items": 1736, 2024-08-19T00:24:20.455 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_1_bytes": 0, 2024-08-19T00:24:20.455 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_1_items": 0, 2024-08-19T00:24:20.455 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_2_bytes": 0, 2024-08-19T00:24:20.456 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_2_items": 0 2024-08-19T00:24:20.456 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:20.456 INFO:teuthology.orchestra.run.smithi116.stdout: "objecter": { 2024-08-19T00:24:20.456 INFO:teuthology.orchestra.run.smithi116.stdout: "op_active": 0, 2024-08-19T00:24:20.456 INFO:teuthology.orchestra.run.smithi116.stdout: "op_laggy": 0, 2024-08-19T00:24:20.456 INFO:teuthology.orchestra.run.smithi116.stdout: "op_send": 1889, 2024-08-19T00:24:20.456 INFO:teuthology.orchestra.run.smithi116.stdout: "op_send_bytes": 4775488, 2024-08-19T00:24:20.456 INFO:teuthology.orchestra.run.smithi116.stdout: "op_resend": 37, 2024-08-19T00:24:20.457 INFO:teuthology.orchestra.run.smithi116.stdout: "op_reply": 1889, 2024-08-19T00:24:20.457 INFO:teuthology.orchestra.run.smithi116.stdout: "op_latency": { 2024-08-19T00:24:20.457 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 1889, 2024-08-19T00:24:20.457 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 23.514638305, 2024-08-19T00:24:20.457 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.012448193 2024-08-19T00:24:20.457 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:20.457 INFO:teuthology.orchestra.run.smithi116.stdout: "op_inflight": 0, 2024-08-19T00:24:20.457 INFO:teuthology.orchestra.run.smithi116.stdout: "oplen_avg": { 2024-08-19T00:24:20.458 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 1889, 2024-08-19T00:24:20.458 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 2664 2024-08-19T00:24:20.458 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:20.458 INFO:teuthology.orchestra.run.smithi116.stdout: "op": 1889, 2024-08-19T00:24:20.458 INFO:teuthology.orchestra.run.smithi116.stdout: "op_r": 4, 2024-08-19T00:24:20.459 INFO:teuthology.orchestra.run.smithi116.stdout: "op_w": 1885, 2024-08-19T00:24:20.459 INFO:teuthology.orchestra.run.smithi116.stdout: "op_rmw": 0, 2024-08-19T00:24:20.459 INFO:teuthology.orchestra.run.smithi116.stdout: "op_pg": 0, 2024-08-19T00:24:20.459 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_stat": 266, 2024-08-19T00:24:20.459 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_create": 130, 2024-08-19T00:24:20.459 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_read": 4, 2024-08-19T00:24:20.459 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_write": 449, 2024-08-19T00:24:20.460 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_writefull": 173, 2024-08-19T00:24:20.460 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_writesame": 0, 2024-08-19T00:24:20.460 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_append": 0, 2024-08-19T00:24:20.460 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_zero": 0, 2024-08-19T00:24:20.460 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_truncate": 0, 2024-08-19T00:24:20.460 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_delete": 762, 2024-08-19T00:24:20.460 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_mapext": 0, 2024-08-19T00:24:20.460 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_sparse_read": 0, 2024-08-19T00:24:20.461 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_clonerange": 0, 2024-08-19T00:24:20.461 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_getxattr": 0, 2024-08-19T00:24:20.461 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_setxattr": 206, 2024-08-19T00:24:20.461 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_cmpxattr": 0, 2024-08-19T00:24:20.461 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_rmxattr": 0, 2024-08-19T00:24:20.461 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_resetxattrs": 0, 2024-08-19T00:24:20.461 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_call": 0, 2024-08-19T00:24:20.461 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_watch": 0, 2024-08-19T00:24:20.462 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_notify": 0, 2024-08-19T00:24:20.462 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_src_cmpxattr": 0, 2024-08-19T00:24:20.462 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_pgls": 0, 2024-08-19T00:24:20.462 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_pgls_filter": 0, 2024-08-19T00:24:20.462 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_other": 0, 2024-08-19T00:24:20.462 INFO:teuthology.orchestra.run.smithi116.stdout: "linger_active": 0, 2024-08-19T00:24:20.462 INFO:teuthology.orchestra.run.smithi116.stdout: "linger_send": 0, 2024-08-19T00:24:20.462 INFO:teuthology.orchestra.run.smithi116.stdout: "linger_resend": 0, 2024-08-19T00:24:20.463 INFO:teuthology.orchestra.run.smithi116.stdout: "linger_ping": 0, 2024-08-19T00:24:20.463 INFO:teuthology.orchestra.run.smithi116.stdout: "poolop_active": 0, 2024-08-19T00:24:20.463 INFO:teuthology.orchestra.run.smithi116.stdout: "poolop_send": 0, 2024-08-19T00:24:20.463 INFO:teuthology.orchestra.run.smithi116.stdout: "poolop_resend": 0, 2024-08-19T00:24:20.463 INFO:teuthology.orchestra.run.smithi116.stdout: "poolstat_active": 0, 2024-08-19T00:24:20.463 INFO:teuthology.orchestra.run.smithi116.stdout: "poolstat_send": 0, 2024-08-19T00:24:20.463 INFO:teuthology.orchestra.run.smithi116.stdout: "poolstat_resend": 0, 2024-08-19T00:24:20.463 INFO:teuthology.orchestra.run.smithi116.stdout: "statfs_active": 0, 2024-08-19T00:24:20.464 INFO:teuthology.orchestra.run.smithi116.stdout: "statfs_send": 0, 2024-08-19T00:24:20.464 INFO:teuthology.orchestra.run.smithi116.stdout: "statfs_resend": 0, 2024-08-19T00:24:20.464 INFO:teuthology.orchestra.run.smithi116.stdout: "command_active": 0, 2024-08-19T00:24:20.464 INFO:teuthology.orchestra.run.smithi116.stdout: "command_send": 0, 2024-08-19T00:24:20.464 INFO:teuthology.orchestra.run.smithi116.stdout: "command_resend": 0, 2024-08-19T00:24:20.464 INFO:teuthology.orchestra.run.smithi116.stdout: "map_epoch": 105, 2024-08-19T00:24:20.465 INFO:teuthology.orchestra.run.smithi116.stdout: "map_full": 0, 2024-08-19T00:24:20.465 INFO:teuthology.orchestra.run.smithi116.stdout: "map_inc": 21, 2024-08-19T00:24:20.465 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_sessions": 12, 2024-08-19T00:24:20.465 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_session_open": 12, 2024-08-19T00:24:20.465 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_session_close": 0, 2024-08-19T00:24:20.465 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_laggy": 0, 2024-08-19T00:24:20.465 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_wr": 661, 2024-08-19T00:24:20.465 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_rd": 0, 2024-08-19T00:24:20.466 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_del": 13 2024-08-19T00:24:20.466 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:20.466 INFO:teuthology.orchestra.run.smithi116.stdout: "oft": { 2024-08-19T00:24:20.466 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_total_objs": 1, 2024-08-19T00:24:20.466 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_total_kv_pairs": 0, 2024-08-19T00:24:20.466 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_total_updates": 0, 2024-08-19T00:24:20.466 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_total_removes": 0 2024-08-19T00:24:20.467 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:20.467 INFO:teuthology.orchestra.run.smithi116.stdout: "osd-slow-ops": { 2024-08-19T00:24:20.467 INFO:teuthology.orchestra.run.smithi116.stdout: "slow_ops_count": 153 2024-08-19T00:24:20.467 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:20.467 INFO:teuthology.orchestra.run.smithi116.stdout: "purge_queue": { 2024-08-19T00:24:20.467 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executing_ops": 0, 2024-08-19T00:24:20.467 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executing_ops_high_water": 10, 2024-08-19T00:24:20.467 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executing": 0, 2024-08-19T00:24:20.468 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executing_high_water": 5, 2024-08-19T00:24:20.468 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executed_ops": 250, 2024-08-19T00:24:20.468 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executed": 125, 2024-08-19T00:24:20.468 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_item_in_journal": 0 2024-08-19T00:24:20.468 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:20.469 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-19T00:24:20.469 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2024-08-19T00:24:20.469 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 104857600, 2024-08-19T00:24:20.469 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-08-19T00:24:20.469 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 221865, 2024-08-19T00:24:20.469 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 72455876, 2024-08-19T00:24:20.469 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-08-19T00:24:20.470 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 221865, 2024-08-19T00:24:20.470 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 0, 2024-08-19T00:24:20.470 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 0, 2024-08-19T00:24:20.470 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 221865, 2024-08-19T00:24:20.470 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 72455876, 2024-08-19T00:24:20.471 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-08-19T00:24:20.471 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:20.471 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:20.471 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:20.471 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-08-19T00:24:20.471 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:20.471 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-objecter_bytes": { 2024-08-19T00:24:20.471 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2024-08-19T00:24:20.472 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 104857600, 2024-08-19T00:24:20.472 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-08-19T00:24:20.472 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 0, 2024-08-19T00:24:20.472 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 0, 2024-08-19T00:24:20.473 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-08-19T00:24:20.473 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 0, 2024-08-19T00:24:20.473 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 1889, 2024-08-19T00:24:20.473 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 4789113, 2024-08-19T00:24:20.473 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 1889, 2024-08-19T00:24:20.473 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 4789113, 2024-08-19T00:24:20.473 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-08-19T00:24:20.474 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:20.474 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:20.474 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:20.474 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-08-19T00:24:20.474 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:20.474 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-objecter_ops": { 2024-08-19T00:24:20.474 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2024-08-19T00:24:20.475 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 1024, 2024-08-19T00:24:20.475 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-08-19T00:24:20.475 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 0, 2024-08-19T00:24:20.475 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 0, 2024-08-19T00:24:20.475 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-08-19T00:24:20.476 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 0, 2024-08-19T00:24:20.476 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 1889, 2024-08-19T00:24:20.476 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 1889, 2024-08-19T00:24:20.476 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 1889, 2024-08-19T00:24:20.476 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 1889, 2024-08-19T00:24:20.476 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-08-19T00:24:20.476 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:20.476 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:20.477 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:20.477 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-08-19T00:24:20.477 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:20.477 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-write_buf_throttle": { 2024-08-19T00:24:20.477 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2024-08-19T00:24:20.477 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 3758096384, 2024-08-19T00:24:20.477 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-08-19T00:24:20.477 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 125, 2024-08-19T00:24:20.478 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 13625, 2024-08-19T00:24:20.478 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-08-19T00:24:20.478 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 125, 2024-08-19T00:24:20.478 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 0, 2024-08-19T00:24:20.478 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 0, 2024-08-19T00:24:20.478 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 4, 2024-08-19T00:24:20.478 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 13625, 2024-08-19T00:24:20.478 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-08-19T00:24:20.479 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:20.479 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:20.479 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:20.479 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-08-19T00:24:20.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:20.479 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-write_buf_throttle-0x56182b01c960": { 2024-08-19T00:24:20.479 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2024-08-19T00:24:20.479 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 3758096384, 2024-08-19T00:24:20.480 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-08-19T00:24:20.480 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 801, 2024-08-19T00:24:20.480 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 3731944, 2024-08-19T00:24:20.480 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-08-19T00:24:20.480 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 801, 2024-08-19T00:24:20.480 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 0, 2024-08-19T00:24:20.480 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 0, 2024-08-19T00:24:20.480 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 445, 2024-08-19T00:24:20.481 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 3731944, 2024-08-19T00:24:20.481 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-08-19T00:24:20.481 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:20.481 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:20.481 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:20.481 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-08-19T00:24:20.481 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-08-19T00:24:20.481 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-08-19T00:24:21.337 INFO:tasks.check_counter:Daemon mds.b mds.exported=10 2024-08-19T00:24:21.338 INFO:tasks.check_counter:Daemon mds.b mds.imported=0 2024-08-19T00:24:21.338 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-08-19T00:24:21.338 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=11 2024-08-19T00:24:21.339 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=5 2024-08-19T00:24:21.339 DEBUG:tasks.check_counter:Getting stats from e 2024-08-19T00:24:21.339 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph daemon mds.e perf dump 2024-08-19T00:24:21.594 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.b/config 2024-08-19T00:24:22.146 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-08-19T00:24:22.147 INFO:teuthology.orchestra.run.smithi116.stdout: "AsyncMessenger::Worker-0": { 2024-08-19T00:24:22.147 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_messages": 6705, 2024-08-19T00:24:22.147 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages": 6706, 2024-08-19T00:24:22.147 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_bytes": 2084129, 2024-08-19T00:24:22.147 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_bytes": 15586115, 2024-08-19T00:24:22.148 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_created_connections": 16, 2024-08-19T00:24:22.148 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_active_connections": 5, 2024-08-19T00:24:22.148 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_total_time": 0.457376086, 2024-08-19T00:24:22.148 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_send_time": 0.147219907, 2024-08-19T00:24:22.148 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_recv_time": 0.113366035, 2024-08-19T00:24:22.148 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_fast_dispatch_time": 0.165913172, 2024-08-19T00:24:22.148 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages_queue_lat": { 2024-08-19T00:24:22.149 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 6705, 2024-08-19T00:24:22.149 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.215927179, 2024-08-19T00:24:22.149 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000032203 2024-08-19T00:24:22.149 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:22.149 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_handle_ack_lat": { 2024-08-19T00:24:22.149 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 12, 2024-08-19T00:24:22.149 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000001889, 2024-08-19T00:24:22.150 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000157 2024-08-19T00:24:22.150 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:22.150 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_encrypted_bytes": 3952, 2024-08-19T00:24:22.150 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_encrypted_bytes": 1424 2024-08-19T00:24:22.150 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:22.150 INFO:teuthology.orchestra.run.smithi116.stdout: "AsyncMessenger::Worker-1": { 2024-08-19T00:24:22.150 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_messages": 44490, 2024-08-19T00:24:22.150 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages": 62051, 2024-08-19T00:24:22.151 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_bytes": 14993747, 2024-08-19T00:24:22.151 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_bytes": 50912059, 2024-08-19T00:24:22.151 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_created_connections": 7, 2024-08-19T00:24:22.151 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_active_connections": 6, 2024-08-19T00:24:22.151 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_total_time": 2.435809464, 2024-08-19T00:24:22.151 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_send_time": 1.000999569, 2024-08-19T00:24:22.151 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_recv_time": 1.633245164, 2024-08-19T00:24:22.152 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_fast_dispatch_time": 0.112461153, 2024-08-19T00:24:22.152 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages_queue_lat": { 2024-08-19T00:24:22.152 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 62050, 2024-08-19T00:24:22.152 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 1.157552186, 2024-08-19T00:24:22.152 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000018655 2024-08-19T00:24:22.152 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:22.152 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_handle_ack_lat": { 2024-08-19T00:24:22.152 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 92980, 2024-08-19T00:24:22.153 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.014948208, 2024-08-19T00:24:22.153 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000160 2024-08-19T00:24:22.153 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:22.153 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_encrypted_bytes": 1672768, 2024-08-19T00:24:22.153 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_encrypted_bytes": 473584 2024-08-19T00:24:22.153 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:22.153 INFO:teuthology.orchestra.run.smithi116.stdout: "AsyncMessenger::Worker-2": { 2024-08-19T00:24:22.153 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_messages": 164118, 2024-08-19T00:24:22.154 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages": 102470, 2024-08-19T00:24:22.154 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_bytes": 72012794, 2024-08-19T00:24:22.154 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_bytes": 28274165, 2024-08-19T00:24:22.154 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_created_connections": 13, 2024-08-19T00:24:22.154 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_active_connections": 7, 2024-08-19T00:24:22.154 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_total_time": 6.730546732, 2024-08-19T00:24:22.154 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_send_time": 2.607155063, 2024-08-19T00:24:22.155 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_recv_time": 5.316071588, 2024-08-19T00:24:22.155 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_fast_dispatch_time": 0.081466777, 2024-08-19T00:24:22.155 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages_queue_lat": { 2024-08-19T00:24:22.155 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 102467, 2024-08-19T00:24:22.155 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 1.639407924, 2024-08-19T00:24:22.155 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000015999 2024-08-19T00:24:22.155 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:22.155 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_handle_ack_lat": { 2024-08-19T00:24:22.156 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 259710, 2024-08-19T00:24:22.156 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.038137779, 2024-08-19T00:24:22.156 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000146 2024-08-19T00:24:22.156 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:22.156 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_encrypted_bytes": 2816, 2024-08-19T00:24:22.156 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_encrypted_bytes": 133360 2024-08-19T00:24:22.156 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:22.156 INFO:teuthology.orchestra.run.smithi116.stdout: "cct": { 2024-08-19T00:24:22.157 INFO:teuthology.orchestra.run.smithi116.stdout: "total_workers": 1, 2024-08-19T00:24:22.157 INFO:teuthology.orchestra.run.smithi116.stdout: "unhealthy_workers": 0 2024-08-19T00:24:22.157 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:22.157 INFO:teuthology.orchestra.run.smithi116.stdout: "finisher-MDSRank": { 2024-08-19T00:24:22.157 INFO:teuthology.orchestra.run.smithi116.stdout: "queue_len": 0, 2024-08-19T00:24:22.157 INFO:teuthology.orchestra.run.smithi116.stdout: "complete_latency": { 2024-08-19T00:24:22.157 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 12232, 2024-08-19T00:24:22.157 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 5.829745058, 2024-08-19T00:24:22.157 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000476597 2024-08-19T00:24:22.158 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-08-19T00:24:22.158 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:22.158 INFO:teuthology.orchestra.run.smithi116.stdout: "finisher-PurgeQueue": { 2024-08-19T00:24:22.158 INFO:teuthology.orchestra.run.smithi116.stdout: "queue_len": 0, 2024-08-19T00:24:22.158 INFO:teuthology.orchestra.run.smithi116.stdout: "complete_latency": { 2024-08-19T00:24:22.158 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 7159, 2024-08-19T00:24:22.158 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.385907374, 2024-08-19T00:24:22.159 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000053905 2024-08-19T00:24:22.159 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-08-19T00:24:22.159 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:22.159 INFO:teuthology.orchestra.run.smithi116.stdout: "mds": { 2024-08-19T00:24:22.159 INFO:teuthology.orchestra.run.smithi116.stdout: "request": 30592, 2024-08-19T00:24:22.159 INFO:teuthology.orchestra.run.smithi116.stdout: "reply": 21523, 2024-08-19T00:24:22.159 INFO:teuthology.orchestra.run.smithi116.stdout: "reply_latency": { 2024-08-19T00:24:22.159 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 21523, 2024-08-19T00:24:22.160 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 20.178439505, 2024-08-19T00:24:22.160 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000937529 2024-08-19T00:24:22.160 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:22.160 INFO:teuthology.orchestra.run.smithi116.stdout: "slow_reply": 0, 2024-08-19T00:24:22.160 INFO:teuthology.orchestra.run.smithi116.stdout: "forward": 9069, 2024-08-19T00:24:22.160 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_fetch_complete": 0, 2024-08-19T00:24:22.160 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_fetch_keys": 0, 2024-08-19T00:24:22.160 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_commit": 11, 2024-08-19T00:24:22.161 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_split": 0, 2024-08-19T00:24:22.161 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_merge": 0, 2024-08-19T00:24:22.161 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes": 115, 2024-08-19T00:24:22.161 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_top": 3, 2024-08-19T00:24:22.161 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_bottom": 112, 2024-08-19T00:24:22.161 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_pin_tail": 0, 2024-08-19T00:24:22.161 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_pinned": 110, 2024-08-19T00:24:22.162 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_expired": 0, 2024-08-19T00:24:22.162 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_with_caps": 33, 2024-08-19T00:24:22.162 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": 33, 2024-08-19T00:24:22.162 INFO:teuthology.orchestra.run.smithi116.stdout: "subtrees": 4, 2024-08-19T00:24:22.162 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse": 64316, 2024-08-19T00:24:22.162 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_hit": 25533, 2024-08-19T00:24:22.162 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_forward": 9069, 2024-08-19T00:24:22.163 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_discover": 6, 2024-08-19T00:24:22.163 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_dir_fetch": 0, 2024-08-19T00:24:22.163 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_remote_ino": 0, 2024-08-19T00:24:22.163 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_lock": 1326, 2024-08-19T00:24:22.163 INFO:teuthology.orchestra.run.smithi116.stdout: "load_cent": 0, 2024-08-19T00:24:22.163 INFO:teuthology.orchestra.run.smithi116.stdout: "q": 0, 2024-08-19T00:24:22.163 INFO:teuthology.orchestra.run.smithi116.stdout: "exported": 0, 2024-08-19T00:24:22.163 INFO:teuthology.orchestra.run.smithi116.stdout: "exported_inodes": 0, 2024-08-19T00:24:22.164 INFO:teuthology.orchestra.run.smithi116.stdout: "imported": 1, 2024-08-19T00:24:22.164 INFO:teuthology.orchestra.run.smithi116.stdout: "imported_inodes": 14, 2024-08-19T00:24:22.164 INFO:teuthology.orchestra.run.smithi116.stdout: "openino_dir_fetch": 0, 2024-08-19T00:24:22.164 INFO:teuthology.orchestra.run.smithi116.stdout: "openino_backtrace_fetch": 0, 2024-08-19T00:24:22.164 INFO:teuthology.orchestra.run.smithi116.stdout: "openino_peer_discover": 0, 2024-08-19T00:24:22.164 INFO:teuthology.orchestra.run.smithi116.stdout: "root_rfiles": 4, 2024-08-19T00:24:22.164 INFO:teuthology.orchestra.run.smithi116.stdout: "root_rbytes": 234, 2024-08-19T00:24:22.165 INFO:teuthology.orchestra.run.smithi116.stdout: "root_rsnaps": 0, 2024-08-19T00:24:22.165 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_backtrace_fetch": 0, 2024-08-19T00:24:22.165 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_set_tag": 0, 2024-08-19T00:24:22.165 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_backtrace_repaired": 0, 2024-08-19T00:24:22.165 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_inotable_repaired": 0, 2024-08-19T00:24:22.165 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_dir_inodes": 0, 2024-08-19T00:24:22.165 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_dir_base_inodes": 0, 2024-08-19T00:24:22.165 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_dirfrag_rstats": 0, 2024-08-19T00:24:22.166 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_file_inodes": 0, 2024-08-19T00:24:22.166 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_inode_file_caps": 0, 2024-08-19T00:24:22.166 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_revoke": 68, 2024-08-19T00:24:22.166 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_grant": 14433, 2024-08-19T00:24:22.166 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_trunc": 0, 2024-08-19T00:24:22.166 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-19T00:24:22.166 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-19T00:24:22.166 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_caps": 5608, 2024-08-19T00:24:22.167 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_caps_dirty": 3180, 2024-08-19T00:24:22.167 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_cap_release": 2181, 2024-08-19T00:24:22.167 INFO:teuthology.orchestra.run.smithi116.stdout: "process_request_cap_release": 19712 2024-08-19T00:24:22.167 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:22.167 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_cache": { 2024-08-19T00:24:22.167 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_update": 0, 2024-08-19T00:24:22.167 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_update_receipt": 15, 2024-08-19T00:24:22.167 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_try_discover": 10, 2024-08-19T00:24:22.168 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_send_discover": 12, 2024-08-19T00:24:22.168 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_handle_discover": 11, 2024-08-19T00:24:22.168 INFO:teuthology.orchestra.run.smithi116.stdout: "num_strays": 30, 2024-08-19T00:24:22.168 INFO:teuthology.orchestra.run.smithi116.stdout: "num_strays_delayed": 0, 2024-08-19T00:24:22.168 INFO:teuthology.orchestra.run.smithi116.stdout: "num_strays_enqueuing": 0, 2024-08-19T00:24:22.168 INFO:teuthology.orchestra.run.smithi116.stdout: "strays_created": 3538, 2024-08-19T00:24:22.168 INFO:teuthology.orchestra.run.smithi116.stdout: "strays_enqueued": 3508, 2024-08-19T00:24:22.168 INFO:teuthology.orchestra.run.smithi116.stdout: "strays_reintegrated": 0, 2024-08-19T00:24:22.169 INFO:teuthology.orchestra.run.smithi116.stdout: "strays_migrated": 0, 2024-08-19T00:24:22.169 INFO:teuthology.orchestra.run.smithi116.stdout: "num_recovering_processing": 0, 2024-08-19T00:24:22.169 INFO:teuthology.orchestra.run.smithi116.stdout: "num_recovering_enqueued": 0, 2024-08-19T00:24:22.169 INFO:teuthology.orchestra.run.smithi116.stdout: "num_recovering_prioritized": 0, 2024-08-19T00:24:22.169 INFO:teuthology.orchestra.run.smithi116.stdout: "recovery_started": 0, 2024-08-19T00:24:22.169 INFO:teuthology.orchestra.run.smithi116.stdout: "recovery_completed": 0, 2024-08-19T00:24:22.169 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_quiesce_path": 9, 2024-08-19T00:24:22.170 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_quiesce_inode": 157, 2024-08-19T00:24:22.170 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_enqueue_scrub": 0, 2024-08-19T00:24:22.170 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_exportdir": 0, 2024-08-19T00:24:22.170 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_flush": 0, 2024-08-19T00:24:22.170 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_fragmentdir": 0, 2024-08-19T00:24:22.170 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_fragstats": 0, 2024-08-19T00:24:22.170 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_inodestats": 0 2024-08-19T00:24:22.170 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:22.171 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_log": { 2024-08-19T00:24:22.171 INFO:teuthology.orchestra.run.smithi116.stdout: "evlrg": 0, 2024-08-19T00:24:22.171 INFO:teuthology.orchestra.run.smithi116.stdout: "evadd": 22550, 2024-08-19T00:24:22.171 INFO:teuthology.orchestra.run.smithi116.stdout: "evex": 0, 2024-08-19T00:24:22.171 INFO:teuthology.orchestra.run.smithi116.stdout: "evtrm": 0, 2024-08-19T00:24:22.171 INFO:teuthology.orchestra.run.smithi116.stdout: "ev": 22550, 2024-08-19T00:24:22.171 INFO:teuthology.orchestra.run.smithi116.stdout: "evexg": 0, 2024-08-19T00:24:22.171 INFO:teuthology.orchestra.run.smithi116.stdout: "evexd": 0, 2024-08-19T00:24:22.172 INFO:teuthology.orchestra.run.smithi116.stdout: "segadd": 27, 2024-08-19T00:24:22.172 INFO:teuthology.orchestra.run.smithi116.stdout: "segex": 0, 2024-08-19T00:24:22.172 INFO:teuthology.orchestra.run.smithi116.stdout: "segtrm": 0, 2024-08-19T00:24:22.172 INFO:teuthology.orchestra.run.smithi116.stdout: "seg": 27, 2024-08-19T00:24:22.174 INFO:teuthology.orchestra.run.smithi116.stdout: "segmjr": 3, 2024-08-19T00:24:22.174 INFO:teuthology.orchestra.run.smithi116.stdout: "segexg": 0, 2024-08-19T00:24:22.174 INFO:teuthology.orchestra.run.smithi116.stdout: "segexd": 0, 2024-08-19T00:24:22.174 INFO:teuthology.orchestra.run.smithi116.stdout: "expos": 4194304, 2024-08-19T00:24:22.174 INFO:teuthology.orchestra.run.smithi116.stdout: "wrpos": 41008220, 2024-08-19T00:24:22.174 INFO:teuthology.orchestra.run.smithi116.stdout: "rdpos": 0, 2024-08-19T00:24:22.175 INFO:teuthology.orchestra.run.smithi116.stdout: "jlat": { 2024-08-19T00:24:22.175 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 5917, 2024-08-19T00:24:22.175 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 9.706441588, 2024-08-19T00:24:22.175 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.001640432 2024-08-19T00:24:22.175 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:22.175 INFO:teuthology.orchestra.run.smithi116.stdout: "replayed": 0 2024-08-19T00:24:22.175 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:22.175 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_mem": { 2024-08-19T00:24:22.176 INFO:teuthology.orchestra.run.smithi116.stdout: "ino": 102, 2024-08-19T00:24:22.176 INFO:teuthology.orchestra.run.smithi116.stdout: "ino+": 3610, 2024-08-19T00:24:22.176 INFO:teuthology.orchestra.run.smithi116.stdout: "ino-": 3508, 2024-08-19T00:24:22.176 INFO:teuthology.orchestra.run.smithi116.stdout: "dir": 41, 2024-08-19T00:24:22.176 INFO:teuthology.orchestra.run.smithi116.stdout: "dir+": 44, 2024-08-19T00:24:22.176 INFO:teuthology.orchestra.run.smithi116.stdout: "dir-": 3, 2024-08-19T00:24:22.176 INFO:teuthology.orchestra.run.smithi116.stdout: "dn": 115, 2024-08-19T00:24:22.176 INFO:teuthology.orchestra.run.smithi116.stdout: "dn+": 6299, 2024-08-19T00:24:22.177 INFO:teuthology.orchestra.run.smithi116.stdout: "dn-": 6184, 2024-08-19T00:24:22.177 INFO:teuthology.orchestra.run.smithi116.stdout: "cap": 33, 2024-08-19T00:24:22.177 INFO:teuthology.orchestra.run.smithi116.stdout: "cap+": 3541, 2024-08-19T00:24:22.177 INFO:teuthology.orchestra.run.smithi116.stdout: "cap-": 3508, 2024-08-19T00:24:22.177 INFO:teuthology.orchestra.run.smithi116.stdout: "rss": 64688, 2024-08-19T00:24:22.177 INFO:teuthology.orchestra.run.smithi116.stdout: "heap": 223520 2024-08-19T00:24:22.177 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:22.178 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_server": { 2024-08-19T00:24:22.178 INFO:teuthology.orchestra.run.smithi116.stdout: "dispatch_client_request": 51318, 2024-08-19T00:24:22.178 INFO:teuthology.orchestra.run.smithi116.stdout: "dispatch_server_request": 0, 2024-08-19T00:24:22.178 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_request": 30592, 2024-08-19T00:24:22.178 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_session": 909, 2024-08-19T00:24:22.178 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_peer_request": 8435, 2024-08-19T00:24:22.178 INFO:teuthology.orchestra.run.smithi116.stdout: "req_create_latency": { 2024-08-19T00:24:22.178 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 3538, 2024-08-19T00:24:22.179 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 6.513413300, 2024-08-19T00:24:22.179 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.001840987 2024-08-19T00:24:22.179 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:22.179 INFO:teuthology.orchestra.run.smithi116.stdout: "req_getattr_latency": { 2024-08-19T00:24:22.179 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:22.179 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:22.179 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:22.179 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:22.180 INFO:teuthology.orchestra.run.smithi116.stdout: "req_getfilelock_latency": { 2024-08-19T00:24:22.180 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:22.180 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:22.180 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:22.180 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:22.180 INFO:teuthology.orchestra.run.smithi116.stdout: "req_link_latency": { 2024-08-19T00:24:22.180 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:22.181 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:22.181 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:22.181 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:22.181 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookup_latency": { 2024-08-19T00:24:22.181 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 8001, 2024-08-19T00:24:22.181 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 3.844836801, 2024-08-19T00:24:22.181 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000480544 2024-08-19T00:24:22.181 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:22.182 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookuphash_latency": { 2024-08-19T00:24:22.182 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:22.182 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:22.182 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:22.182 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:22.182 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookupino_latency": { 2024-08-19T00:24:22.182 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:22.183 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:22.183 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:22.183 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:22.183 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookupname_latency": { 2024-08-19T00:24:22.183 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:22.183 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:22.183 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:22.183 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:22.184 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookupparent_latency": { 2024-08-19T00:24:22.184 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:22.184 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:22.184 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:22.184 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:22.184 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookupsnap_latency": { 2024-08-19T00:24:22.184 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:22.184 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:22.185 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:22.185 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:22.185 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lssnap_latency": { 2024-08-19T00:24:22.185 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:22.185 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:22.185 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:22.185 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:22.185 INFO:teuthology.orchestra.run.smithi116.stdout: "req_mkdir_latency": { 2024-08-19T00:24:22.186 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:22.186 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:22.186 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:22.186 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:22.186 INFO:teuthology.orchestra.run.smithi116.stdout: "req_mknod_latency": { 2024-08-19T00:24:22.186 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:22.186 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:22.186 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:22.187 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:22.187 INFO:teuthology.orchestra.run.smithi116.stdout: "req_mksnap_latency": { 2024-08-19T00:24:22.187 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:22.187 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:22.187 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:22.187 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:22.187 INFO:teuthology.orchestra.run.smithi116.stdout: "req_open_latency": { 2024-08-19T00:24:22.188 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:22.188 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:22.188 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:22.188 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:22.188 INFO:teuthology.orchestra.run.smithi116.stdout: "req_readdir_latency": { 2024-08-19T00:24:22.188 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 5113, 2024-08-19T00:24:22.188 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 1.936976074, 2024-08-19T00:24:22.188 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000378833 2024-08-19T00:24:22.189 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:22.189 INFO:teuthology.orchestra.run.smithi116.stdout: "req_rename_latency": { 2024-08-19T00:24:22.189 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 1326, 2024-08-19T00:24:22.189 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 2.582854453, 2024-08-19T00:24:22.189 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.001947854 2024-08-19T00:24:22.189 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:22.189 INFO:teuthology.orchestra.run.smithi116.stdout: "req_renamesnap_latency": { 2024-08-19T00:24:22.189 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:22.190 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:22.190 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:22.190 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:22.190 INFO:teuthology.orchestra.run.smithi116.stdout: "req_snapdiff_latency": { 2024-08-19T00:24:22.190 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:22.190 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:22.190 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:22.190 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:22.191 INFO:teuthology.orchestra.run.smithi116.stdout: "req_rmdir_latency": { 2024-08-19T00:24:22.191 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:22.191 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:22.191 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:22.191 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:22.191 INFO:teuthology.orchestra.run.smithi116.stdout: "req_rmsnap_latency": { 2024-08-19T00:24:22.191 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:22.192 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:22.192 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:22.192 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:22.192 INFO:teuthology.orchestra.run.smithi116.stdout: "req_rmxattr_latency": { 2024-08-19T00:24:22.192 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:22.192 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:22.192 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:22.192 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:22.193 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setattr_latency": { 2024-08-19T00:24:22.193 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 7, 2024-08-19T00:24:22.193 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.022369074, 2024-08-19T00:24:22.193 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.003195582 2024-08-19T00:24:22.193 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:22.193 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setdirlayout_latency": { 2024-08-19T00:24:22.193 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:22.193 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:22.194 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:22.194 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:22.194 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setfilelock_latency": { 2024-08-19T00:24:22.194 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:22.194 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:22.194 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:22.194 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:22.194 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setlayout_latency": { 2024-08-19T00:24:22.195 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:22.195 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:22.195 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:22.195 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:22.195 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setxattr_latency": { 2024-08-19T00:24:22.195 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:22.195 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:22.195 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:22.196 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:22.196 INFO:teuthology.orchestra.run.smithi116.stdout: "req_symlink_latency": { 2024-08-19T00:24:22.196 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:22.196 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:22.196 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:22.196 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:22.196 INFO:teuthology.orchestra.run.smithi116.stdout: "req_unlink_latency": { 2024-08-19T00:24:22.196 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 3538, 2024-08-19T00:24:22.197 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 5.277989803, 2024-08-19T00:24:22.197 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.001491800 2024-08-19T00:24:22.197 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:22.197 INFO:teuthology.orchestra.run.smithi116.stdout: "cap_revoke_eviction": 0, 2024-08-19T00:24:22.197 INFO:teuthology.orchestra.run.smithi116.stdout: "cap_acquisition_throttle": 0, 2024-08-19T00:24:22.197 INFO:teuthology.orchestra.run.smithi116.stdout: "req_getvxattr_latency": { 2024-08-19T00:24:22.197 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:22.197 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:22.197 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:22.198 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-08-19T00:24:22.198 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:22.198 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_sessions": { 2024-08-19T00:24:22.198 INFO:teuthology.orchestra.run.smithi116.stdout: "session_count": 2, 2024-08-19T00:24:22.198 INFO:teuthology.orchestra.run.smithi116.stdout: "session_add": 4, 2024-08-19T00:24:22.198 INFO:teuthology.orchestra.run.smithi116.stdout: "session_remove": 2, 2024-08-19T00:24:22.198 INFO:teuthology.orchestra.run.smithi116.stdout: "sessions_open": 2, 2024-08-19T00:24:22.198 INFO:teuthology.orchestra.run.smithi116.stdout: "sessions_stale": 0, 2024-08-19T00:24:22.199 INFO:teuthology.orchestra.run.smithi116.stdout: "total_load": 2801, 2024-08-19T00:24:22.199 INFO:teuthology.orchestra.run.smithi116.stdout: "average_load": 1400, 2024-08-19T00:24:22.199 INFO:teuthology.orchestra.run.smithi116.stdout: "avg_session_uptime": 630, 2024-08-19T00:24:22.199 INFO:teuthology.orchestra.run.smithi116.stdout: "mdthresh_evicted": 0 2024-08-19T00:24:22.199 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:22.199 INFO:teuthology.orchestra.run.smithi116.stdout: "mempool": { 2024-08-19T00:24:22.199 INFO:teuthology.orchestra.run.smithi116.stdout: "bloom_filter_bytes": 0, 2024-08-19T00:24:22.199 INFO:teuthology.orchestra.run.smithi116.stdout: "bloom_filter_items": 0, 2024-08-19T00:24:22.200 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_alloc_bytes": 0, 2024-08-19T00:24:22.200 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_alloc_items": 0, 2024-08-19T00:24:22.200 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_data_bytes": 0, 2024-08-19T00:24:22.200 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_data_items": 0, 2024-08-19T00:24:22.200 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-19T00:24:22.200 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_onode_items": 0, 2024-08-19T00:24:22.200 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-19T00:24:22.200 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_meta_items": 0, 2024-08-19T00:24:22.200 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_other_bytes": 0, 2024-08-19T00:24:22.201 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_other_items": 0, 2024-08-19T00:24:22.201 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-19T00:24:22.201 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_buffer_items": 0, 2024-08-19T00:24:22.201 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_extent_bytes": 0, 2024-08-19T00:24:22.201 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_extent_items": 0, 2024-08-19T00:24:22.201 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_blob_bytes": 0, 2024-08-19T00:24:22.201 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_blob_items": 0, 2024-08-19T00:24:22.201 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-19T00:24:22.202 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_shared_blob_items": 0, 2024-08-19T00:24:22.202 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-19T00:24:22.202 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_inline_bl_items": 0, 2024-08-19T00:24:22.202 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_fsck_bytes": 0, 2024-08-19T00:24:22.202 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_fsck_items": 0, 2024-08-19T00:24:22.202 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_txc_bytes": 0, 2024-08-19T00:24:22.202 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_txc_items": 0, 2024-08-19T00:24:22.203 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-19T00:24:22.203 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_deferred_items": 0, 2024-08-19T00:24:22.203 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_bytes": 0, 2024-08-19T00:24:22.203 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_items": 0, 2024-08-19T00:24:22.203 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_bytes": 0, 2024-08-19T00:24:22.203 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_items": 0, 2024-08-19T00:24:22.203 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_reader_bytes": 0, 2024-08-19T00:24:22.203 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_reader_items": 0, 2024-08-19T00:24:22.204 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_writer_bytes": 0, 2024-08-19T00:24:22.204 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_writer_items": 0, 2024-08-19T00:24:22.204 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_anon_bytes": 303127, 2024-08-19T00:24:22.204 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_anon_items": 183, 2024-08-19T00:24:22.204 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_meta_bytes": 0, 2024-08-19T00:24:22.204 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_meta_items": 0, 2024-08-19T00:24:22.204 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_bytes": 0, 2024-08-19T00:24:22.204 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_items": 0, 2024-08-19T00:24:22.204 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mapbl_bytes": 0, 2024-08-19T00:24:22.205 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mapbl_items": 0, 2024-08-19T00:24:22.205 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pglog_bytes": 0, 2024-08-19T00:24:22.205 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pglog_items": 0, 2024-08-19T00:24:22.205 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_bytes": 9712, 2024-08-19T00:24:22.205 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_items": 197, 2024-08-19T00:24:22.205 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_mapping_bytes": 0, 2024-08-19T00:24:22.205 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_mapping_items": 0, 2024-08-19T00:24:22.205 INFO:teuthology.orchestra.run.smithi116.stdout: "pgmap_bytes": 0, 2024-08-19T00:24:22.205 INFO:teuthology.orchestra.run.smithi116.stdout: "pgmap_items": 0, 2024-08-19T00:24:22.206 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_co_bytes": 447015, 2024-08-19T00:24:22.206 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_co_items": 6723, 2024-08-19T00:24:22.206 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_1_bytes": 0, 2024-08-19T00:24:22.206 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_1_items": 0, 2024-08-19T00:24:22.206 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_2_bytes": 0, 2024-08-19T00:24:22.206 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_2_items": 0 2024-08-19T00:24:22.206 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:22.206 INFO:teuthology.orchestra.run.smithi116.stdout: "objecter": { 2024-08-19T00:24:22.207 INFO:teuthology.orchestra.run.smithi116.stdout: "op_active": 0, 2024-08-19T00:24:22.207 INFO:teuthology.orchestra.run.smithi116.stdout: "op_laggy": 0, 2024-08-19T00:24:22.207 INFO:teuthology.orchestra.run.smithi116.stdout: "op_send": 14207, 2024-08-19T00:24:22.207 INFO:teuthology.orchestra.run.smithi116.stdout: "op_send_bytes": 37623238, 2024-08-19T00:24:22.207 INFO:teuthology.orchestra.run.smithi116.stdout: "op_resend": 33, 2024-08-19T00:24:22.207 INFO:teuthology.orchestra.run.smithi116.stdout: "op_reply": 14207, 2024-08-19T00:24:22.207 INFO:teuthology.orchestra.run.smithi116.stdout: "op_latency": { 2024-08-19T00:24:22.207 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 14207, 2024-08-19T00:24:22.208 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 33.512484466, 2024-08-19T00:24:22.208 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.002358871 2024-08-19T00:24:22.208 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:22.208 INFO:teuthology.orchestra.run.smithi116.stdout: "op_inflight": 0, 2024-08-19T00:24:22.208 INFO:teuthology.orchestra.run.smithi116.stdout: "oplen_avg": { 2024-08-19T00:24:22.208 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 14207, 2024-08-19T00:24:22.208 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 14761 2024-08-19T00:24:22.208 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:22.208 INFO:teuthology.orchestra.run.smithi116.stdout: "op": 14207, 2024-08-19T00:24:22.209 INFO:teuthology.orchestra.run.smithi116.stdout: "op_r": 315, 2024-08-19T00:24:22.209 INFO:teuthology.orchestra.run.smithi116.stdout: "op_w": 13892, 2024-08-19T00:24:22.209 INFO:teuthology.orchestra.run.smithi116.stdout: "op_rmw": 0, 2024-08-19T00:24:22.209 INFO:teuthology.orchestra.run.smithi116.stdout: "op_pg": 0, 2024-08-19T00:24:22.209 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_stat": 0, 2024-08-19T00:24:22.209 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_create": 10, 2024-08-19T00:24:22.209 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_read": 315, 2024-08-19T00:24:22.210 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_write": 6232, 2024-08-19T00:24:22.210 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_writefull": 207, 2024-08-19T00:24:22.210 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_writesame": 0, 2024-08-19T00:24:22.210 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_append": 0, 2024-08-19T00:24:22.210 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_zero": 0, 2024-08-19T00:24:22.210 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_truncate": 0, 2024-08-19T00:24:22.210 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_delete": 7036, 2024-08-19T00:24:22.210 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_mapext": 0, 2024-08-19T00:24:22.211 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_sparse_read": 0, 2024-08-19T00:24:22.211 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_clonerange": 0, 2024-08-19T00:24:22.211 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_getxattr": 0, 2024-08-19T00:24:22.211 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_setxattr": 20, 2024-08-19T00:24:22.211 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_cmpxattr": 0, 2024-08-19T00:24:22.211 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_rmxattr": 0, 2024-08-19T00:24:22.211 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_resetxattrs": 0, 2024-08-19T00:24:22.212 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_call": 0, 2024-08-19T00:24:22.212 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_watch": 0, 2024-08-19T00:24:22.212 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_notify": 0, 2024-08-19T00:24:22.212 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_src_cmpxattr": 0, 2024-08-19T00:24:22.212 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_pgls": 0, 2024-08-19T00:24:22.212 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_pgls_filter": 0, 2024-08-19T00:24:22.212 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_other": 0, 2024-08-19T00:24:22.212 INFO:teuthology.orchestra.run.smithi116.stdout: "linger_active": 0, 2024-08-19T00:24:22.213 INFO:teuthology.orchestra.run.smithi116.stdout: "linger_send": 0, 2024-08-19T00:24:22.213 INFO:teuthology.orchestra.run.smithi116.stdout: "linger_resend": 0, 2024-08-19T00:24:22.213 INFO:teuthology.orchestra.run.smithi116.stdout: "linger_ping": 0, 2024-08-19T00:24:22.213 INFO:teuthology.orchestra.run.smithi116.stdout: "poolop_active": 0, 2024-08-19T00:24:22.213 INFO:teuthology.orchestra.run.smithi116.stdout: "poolop_send": 0, 2024-08-19T00:24:22.213 INFO:teuthology.orchestra.run.smithi116.stdout: "poolop_resend": 0, 2024-08-19T00:24:22.213 INFO:teuthology.orchestra.run.smithi116.stdout: "poolstat_active": 0, 2024-08-19T00:24:22.213 INFO:teuthology.orchestra.run.smithi116.stdout: "poolstat_send": 0, 2024-08-19T00:24:22.213 INFO:teuthology.orchestra.run.smithi116.stdout: "poolstat_resend": 0, 2024-08-19T00:24:22.214 INFO:teuthology.orchestra.run.smithi116.stdout: "statfs_active": 0, 2024-08-19T00:24:22.214 INFO:teuthology.orchestra.run.smithi116.stdout: "statfs_send": 0, 2024-08-19T00:24:22.214 INFO:teuthology.orchestra.run.smithi116.stdout: "statfs_resend": 0, 2024-08-19T00:24:22.214 INFO:teuthology.orchestra.run.smithi116.stdout: "command_active": 0, 2024-08-19T00:24:22.214 INFO:teuthology.orchestra.run.smithi116.stdout: "command_send": 0, 2024-08-19T00:24:22.214 INFO:teuthology.orchestra.run.smithi116.stdout: "command_resend": 0, 2024-08-19T00:24:22.214 INFO:teuthology.orchestra.run.smithi116.stdout: "map_epoch": 105, 2024-08-19T00:24:22.214 INFO:teuthology.orchestra.run.smithi116.stdout: "map_full": 0, 2024-08-19T00:24:22.215 INFO:teuthology.orchestra.run.smithi116.stdout: "map_inc": 15, 2024-08-19T00:24:22.215 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_sessions": 12, 2024-08-19T00:24:22.215 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_session_open": 12, 2024-08-19T00:24:22.215 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_session_close": 0, 2024-08-19T00:24:22.215 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_laggy": 0, 2024-08-19T00:24:22.215 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_wr": 771, 2024-08-19T00:24:22.215 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_rd": 0, 2024-08-19T00:24:22.215 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_del": 170 2024-08-19T00:24:22.216 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:22.216 INFO:teuthology.orchestra.run.smithi116.stdout: "oft": { 2024-08-19T00:24:22.216 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_total_objs": 1, 2024-08-19T00:24:22.216 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_total_kv_pairs": 0, 2024-08-19T00:24:22.216 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_total_updates": 0, 2024-08-19T00:24:22.216 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_total_removes": 0 2024-08-19T00:24:22.216 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:22.216 INFO:teuthology.orchestra.run.smithi116.stdout: "osd-slow-ops": { 2024-08-19T00:24:22.217 INFO:teuthology.orchestra.run.smithi116.stdout: "slow_ops_count": 147 2024-08-19T00:24:22.217 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:22.217 INFO:teuthology.orchestra.run.smithi116.stdout: "purge_queue": { 2024-08-19T00:24:22.217 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executing_ops": 0, 2024-08-19T00:24:22.217 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executing_ops_high_water": 10, 2024-08-19T00:24:22.217 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executing": 0, 2024-08-19T00:24:22.217 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executing_high_water": 5, 2024-08-19T00:24:22.218 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executed_ops": 7016, 2024-08-19T00:24:22.218 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executed": 3508, 2024-08-19T00:24:22.218 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_item_in_journal": 0 2024-08-19T00:24:22.218 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:22.218 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-19T00:24:22.218 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2024-08-19T00:24:22.218 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 104857600, 2024-08-19T00:24:22.218 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-08-19T00:24:22.219 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 215309, 2024-08-19T00:24:22.219 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 69694130, 2024-08-19T00:24:22.219 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-08-19T00:24:22.219 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 215309, 2024-08-19T00:24:22.219 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 0, 2024-08-19T00:24:22.219 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 0, 2024-08-19T00:24:22.219 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 215309, 2024-08-19T00:24:22.219 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 69694130, 2024-08-19T00:24:22.220 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-08-19T00:24:22.220 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:22.220 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:22.220 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:22.220 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-08-19T00:24:22.220 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:22.220 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-objecter_bytes": { 2024-08-19T00:24:22.220 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2024-08-19T00:24:22.220 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 104857600, 2024-08-19T00:24:22.221 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-08-19T00:24:22.221 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 0, 2024-08-19T00:24:22.221 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 0, 2024-08-19T00:24:22.221 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-08-19T00:24:22.221 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 0, 2024-08-19T00:24:22.221 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 14207, 2024-08-19T00:24:22.221 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 38005898, 2024-08-19T00:24:22.222 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 14207, 2024-08-19T00:24:22.222 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 38005898, 2024-08-19T00:24:22.222 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-08-19T00:24:22.222 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:22.222 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:22.222 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:22.222 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-08-19T00:24:22.222 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:22.223 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-objecter_ops": { 2024-08-19T00:24:22.223 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2024-08-19T00:24:22.223 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 1024, 2024-08-19T00:24:22.223 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-08-19T00:24:22.223 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 0, 2024-08-19T00:24:22.223 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 0, 2024-08-19T00:24:22.223 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-08-19T00:24:22.223 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 0, 2024-08-19T00:24:22.224 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 14207, 2024-08-19T00:24:22.224 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 14207, 2024-08-19T00:24:22.224 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 14207, 2024-08-19T00:24:22.224 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 14207, 2024-08-19T00:24:22.224 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-08-19T00:24:22.224 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:22.224 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:22.224 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:22.224 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-08-19T00:24:22.225 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:22.225 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-write_buf_throttle": { 2024-08-19T00:24:22.225 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2024-08-19T00:24:22.225 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 3758096384, 2024-08-19T00:24:22.225 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-08-19T00:24:22.225 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 3508, 2024-08-19T00:24:22.225 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 382660, 2024-08-19T00:24:22.225 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-08-19T00:24:22.226 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 3508, 2024-08-19T00:24:22.226 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 0, 2024-08-19T00:24:22.226 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 0, 2024-08-19T00:24:22.226 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 315, 2024-08-19T00:24:22.226 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 382660, 2024-08-19T00:24:22.226 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-08-19T00:24:22.226 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:22.226 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:22.227 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:22.227 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-08-19T00:24:22.227 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:22.227 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-write_buf_throttle-0x5594a6f0a960": { 2024-08-19T00:24:22.227 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2024-08-19T00:24:22.227 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 3758096384, 2024-08-19T00:24:22.227 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-08-19T00:24:22.227 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 22550, 2024-08-19T00:24:22.228 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 36813916, 2024-08-19T00:24:22.228 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-08-19T00:24:22.228 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 22550, 2024-08-19T00:24:22.228 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 0, 2024-08-19T00:24:22.228 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 0, 2024-08-19T00:24:22.228 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 5917, 2024-08-19T00:24:22.228 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 36813916, 2024-08-19T00:24:22.228 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-08-19T00:24:22.228 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:22.229 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:22.229 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:22.229 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-08-19T00:24:22.229 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-08-19T00:24:22.229 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-08-19T00:24:22.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:22 smithi171 ceph-mon[21810]: pgmap v344: 129 pgs: 129 active+clean; 539 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 27 KiB/s wr, 14 op/s 2024-08-19T00:24:22.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:22 smithi116 ceph-mon[21873]: pgmap v344: 129 pgs: 129 active+clean; 539 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 27 KiB/s wr, 14 op/s 2024-08-19T00:24:22.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:22 smithi044 ceph-mon[18489]: pgmap v344: 129 pgs: 129 active+clean; 539 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 27 KiB/s wr, 14 op/s 2024-08-19T00:24:22.939 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-08-19T00:24:22.939 INFO:tasks.check_counter:Daemon mds.e mds.imported=1 2024-08-19T00:24:22.939 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=0 2024-08-19T00:24:22.939 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2024-08-19T00:24:22.940 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2024-08-19T00:24:22.940 DEBUG:tasks.check_counter:Getting stats from h 2024-08-19T00:24:22.940 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph daemon mds.h perf dump 2024-08-19T00:24:23.190 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.b/config 2024-08-19T00:24:23.660 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-08-19T00:24:23.660 INFO:teuthology.orchestra.run.smithi116.stdout: "AsyncMessenger::Worker-0": { 2024-08-19T00:24:23.660 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_messages": 9956, 2024-08-19T00:24:23.660 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages": 9915, 2024-08-19T00:24:23.660 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_bytes": 4402197, 2024-08-19T00:24:23.661 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_bytes": 1310775, 2024-08-19T00:24:23.661 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_created_connections": 9, 2024-08-19T00:24:23.661 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_active_connections": 5, 2024-08-19T00:24:23.661 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_total_time": 0.647218299, 2024-08-19T00:24:23.661 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_send_time": 0.239993265, 2024-08-19T00:24:23.661 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_recv_time": 0.541436580, 2024-08-19T00:24:23.661 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_fast_dispatch_time": 0.004043312, 2024-08-19T00:24:23.662 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages_queue_lat": { 2024-08-19T00:24:23.662 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 9914, 2024-08-19T00:24:23.662 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.173715768, 2024-08-19T00:24:23.662 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000017522 2024-08-19T00:24:23.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:23.663 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_handle_ack_lat": { 2024-08-19T00:24:23.663 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 19241, 2024-08-19T00:24:23.663 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.003518526, 2024-08-19T00:24:23.663 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000182 2024-08-19T00:24:23.663 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:23.663 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_encrypted_bytes": 1683104, 2024-08-19T00:24:23.663 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_encrypted_bytes": 148800 2024-08-19T00:24:23.663 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:23.664 INFO:teuthology.orchestra.run.smithi116.stdout: "AsyncMessenger::Worker-1": { 2024-08-19T00:24:23.664 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_messages": 130879, 2024-08-19T00:24:23.664 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages": 65421, 2024-08-19T00:24:23.664 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_bytes": 63126384, 2024-08-19T00:24:23.664 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_bytes": 10647613, 2024-08-19T00:24:23.664 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_created_connections": 17, 2024-08-19T00:24:23.664 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_active_connections": 5, 2024-08-19T00:24:23.664 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_total_time": 5.125509504, 2024-08-19T00:24:23.665 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_send_time": 1.939076960, 2024-08-19T00:24:23.665 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_recv_time": 4.307783663, 2024-08-19T00:24:23.665 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_fast_dispatch_time": 0.000481725, 2024-08-19T00:24:23.665 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages_queue_lat": { 2024-08-19T00:24:23.665 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 65418, 2024-08-19T00:24:23.665 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 1.017420197, 2024-08-19T00:24:23.665 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000015552 2024-08-19T00:24:23.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:23.666 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_handle_ack_lat": { 2024-08-19T00:24:23.666 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 196207, 2024-08-19T00:24:23.666 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.029646968, 2024-08-19T00:24:23.666 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000151 2024-08-19T00:24:23.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:23.667 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_encrypted_bytes": 2816, 2024-08-19T00:24:23.667 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_encrypted_bytes": 129840 2024-08-19T00:24:23.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:23.667 INFO:teuthology.orchestra.run.smithi116.stdout: "AsyncMessenger::Worker-2": { 2024-08-19T00:24:23.667 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_messages": 21, 2024-08-19T00:24:23.667 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages": 154, 2024-08-19T00:24:23.668 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_bytes": 7547, 2024-08-19T00:24:23.668 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_bytes": 339687, 2024-08-19T00:24:23.668 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_created_connections": 7, 2024-08-19T00:24:23.668 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_active_connections": 5, 2024-08-19T00:24:23.669 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_total_time": 0.010393265, 2024-08-19T00:24:23.669 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_send_time": 0.004719688, 2024-08-19T00:24:23.669 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_recv_time": 0.004254228, 2024-08-19T00:24:23.669 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_fast_dispatch_time": 0.000434249, 2024-08-19T00:24:23.669 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages_queue_lat": { 2024-08-19T00:24:23.669 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 153, 2024-08-19T00:24:23.669 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.028054972, 2024-08-19T00:24:23.670 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000183365 2024-08-19T00:24:23.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:23.670 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_handle_ack_lat": { 2024-08-19T00:24:23.670 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:23.671 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:23.671 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:23.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:23.671 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_encrypted_bytes": 3184, 2024-08-19T00:24:23.671 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_encrypted_bytes": 326816 2024-08-19T00:24:23.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:23.671 INFO:teuthology.orchestra.run.smithi116.stdout: "cct": { 2024-08-19T00:24:23.672 INFO:teuthology.orchestra.run.smithi116.stdout: "total_workers": 1, 2024-08-19T00:24:23.672 INFO:teuthology.orchestra.run.smithi116.stdout: "unhealthy_workers": 0 2024-08-19T00:24:23.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:23.672 INFO:teuthology.orchestra.run.smithi116.stdout: "finisher-MDSRank": { 2024-08-19T00:24:23.672 INFO:teuthology.orchestra.run.smithi116.stdout: "queue_len": 0, 2024-08-19T00:24:23.672 INFO:teuthology.orchestra.run.smithi116.stdout: "complete_latency": { 2024-08-19T00:24:23.673 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 53, 2024-08-19T00:24:23.673 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.001604991, 2024-08-19T00:24:23.673 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000030282 2024-08-19T00:24:23.673 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-08-19T00:24:23.673 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:23.673 INFO:teuthology.orchestra.run.smithi116.stdout: "finisher-PurgeQueue": { 2024-08-19T00:24:23.673 INFO:teuthology.orchestra.run.smithi116.stdout: "queue_len": 0, 2024-08-19T00:24:23.673 INFO:teuthology.orchestra.run.smithi116.stdout: "complete_latency": { 2024-08-19T00:24:23.673 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 2, 2024-08-19T00:24:23.674 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000010199, 2024-08-19T00:24:23.674 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000005099 2024-08-19T00:24:23.674 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-08-19T00:24:23.674 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:23.674 INFO:teuthology.orchestra.run.smithi116.stdout: "mds": { 2024-08-19T00:24:23.674 INFO:teuthology.orchestra.run.smithi116.stdout: "request": 8925, 2024-08-19T00:24:23.675 INFO:teuthology.orchestra.run.smithi116.stdout: "reply": 5, 2024-08-19T00:24:23.675 INFO:teuthology.orchestra.run.smithi116.stdout: "reply_latency": { 2024-08-19T00:24:23.675 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 5, 2024-08-19T00:24:23.675 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.002493102, 2024-08-19T00:24:23.675 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000498620 2024-08-19T00:24:23.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:23.675 INFO:teuthology.orchestra.run.smithi116.stdout: "slow_reply": 0, 2024-08-19T00:24:23.676 INFO:teuthology.orchestra.run.smithi116.stdout: "forward": 8920, 2024-08-19T00:24:23.676 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_fetch_complete": 0, 2024-08-19T00:24:23.676 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_fetch_keys": 0, 2024-08-19T00:24:23.676 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_commit": 11, 2024-08-19T00:24:23.676 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_split": 0, 2024-08-19T00:24:23.676 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_merge": 0, 2024-08-19T00:24:23.676 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes": 24, 2024-08-19T00:24:23.676 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_top": 3, 2024-08-19T00:24:23.677 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_bottom": 21, 2024-08-19T00:24:23.677 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_pin_tail": 0, 2024-08-19T00:24:23.678 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_pinned": 19, 2024-08-19T00:24:23.678 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_expired": 1, 2024-08-19T00:24:23.678 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_with_caps": 0, 2024-08-19T00:24:23.678 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": 0, 2024-08-19T00:24:23.679 INFO:teuthology.orchestra.run.smithi116.stdout: "subtrees": 3, 2024-08-19T00:24:23.679 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse": 8961, 2024-08-19T00:24:23.679 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_hit": 32, 2024-08-19T00:24:23.679 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_forward": 8920, 2024-08-19T00:24:23.679 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_discover": 7, 2024-08-19T00:24:23.679 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_dir_fetch": 0, 2024-08-19T00:24:23.680 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_remote_ino": 0, 2024-08-19T00:24:23.680 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_lock": 0, 2024-08-19T00:24:23.680 INFO:teuthology.orchestra.run.smithi116.stdout: "load_cent": 0, 2024-08-19T00:24:23.680 INFO:teuthology.orchestra.run.smithi116.stdout: "q": 0, 2024-08-19T00:24:23.680 INFO:teuthology.orchestra.run.smithi116.stdout: "exported": 0, 2024-08-19T00:24:23.680 INFO:teuthology.orchestra.run.smithi116.stdout: "exported_inodes": 0, 2024-08-19T00:24:23.680 INFO:teuthology.orchestra.run.smithi116.stdout: "imported": 0, 2024-08-19T00:24:23.680 INFO:teuthology.orchestra.run.smithi116.stdout: "imported_inodes": 0, 2024-08-19T00:24:23.681 INFO:teuthology.orchestra.run.smithi116.stdout: "openino_dir_fetch": 0, 2024-08-19T00:24:23.681 INFO:teuthology.orchestra.run.smithi116.stdout: "openino_backtrace_fetch": 0, 2024-08-19T00:24:23.681 INFO:teuthology.orchestra.run.smithi116.stdout: "openino_peer_discover": 0, 2024-08-19T00:24:23.681 INFO:teuthology.orchestra.run.smithi116.stdout: "root_rfiles": 4, 2024-08-19T00:24:23.681 INFO:teuthology.orchestra.run.smithi116.stdout: "root_rbytes": 234, 2024-08-19T00:24:23.681 INFO:teuthology.orchestra.run.smithi116.stdout: "root_rsnaps": 0, 2024-08-19T00:24:23.681 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_backtrace_fetch": 0, 2024-08-19T00:24:23.682 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_set_tag": 0, 2024-08-19T00:24:23.682 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_backtrace_repaired": 0, 2024-08-19T00:24:23.682 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_inotable_repaired": 0, 2024-08-19T00:24:23.682 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_dir_inodes": 0, 2024-08-19T00:24:23.682 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_dir_base_inodes": 0, 2024-08-19T00:24:23.682 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_dirfrag_rstats": 0, 2024-08-19T00:24:23.683 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_file_inodes": 0, 2024-08-19T00:24:23.683 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_inode_file_caps": 0, 2024-08-19T00:24:23.683 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_revoke": 4, 2024-08-19T00:24:23.683 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_grant": 0, 2024-08-19T00:24:23.683 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_trunc": 0, 2024-08-19T00:24:23.683 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-19T00:24:23.684 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-19T00:24:23.684 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_caps": 4, 2024-08-19T00:24:23.684 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_caps_dirty": 0, 2024-08-19T00:24:23.684 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_cap_release": 0, 2024-08-19T00:24:23.685 INFO:teuthology.orchestra.run.smithi116.stdout: "process_request_cap_release": 0 2024-08-19T00:24:23.685 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:23.685 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_cache": { 2024-08-19T00:24:23.686 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_update": 0, 2024-08-19T00:24:23.686 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_update_receipt": 17, 2024-08-19T00:24:23.686 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_try_discover": 11, 2024-08-19T00:24:23.686 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_send_discover": 14, 2024-08-19T00:24:23.686 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_handle_discover": 0, 2024-08-19T00:24:23.686 INFO:teuthology.orchestra.run.smithi116.stdout: "num_strays": 0, 2024-08-19T00:24:23.686 INFO:teuthology.orchestra.run.smithi116.stdout: "num_strays_delayed": 0, 2024-08-19T00:24:23.687 INFO:teuthology.orchestra.run.smithi116.stdout: "num_strays_enqueuing": 0, 2024-08-19T00:24:23.687 INFO:teuthology.orchestra.run.smithi116.stdout: "strays_created": 0, 2024-08-19T00:24:23.687 INFO:teuthology.orchestra.run.smithi116.stdout: "strays_enqueued": 0, 2024-08-19T00:24:23.687 INFO:teuthology.orchestra.run.smithi116.stdout: "strays_reintegrated": 0, 2024-08-19T00:24:23.687 INFO:teuthology.orchestra.run.smithi116.stdout: "strays_migrated": 0, 2024-08-19T00:24:23.687 INFO:teuthology.orchestra.run.smithi116.stdout: "num_recovering_processing": 0, 2024-08-19T00:24:23.687 INFO:teuthology.orchestra.run.smithi116.stdout: "num_recovering_enqueued": 0, 2024-08-19T00:24:23.687 INFO:teuthology.orchestra.run.smithi116.stdout: "num_recovering_prioritized": 0, 2024-08-19T00:24:23.688 INFO:teuthology.orchestra.run.smithi116.stdout: "recovery_started": 0, 2024-08-19T00:24:23.688 INFO:teuthology.orchestra.run.smithi116.stdout: "recovery_completed": 0, 2024-08-19T00:24:23.688 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_quiesce_path": 9, 2024-08-19T00:24:23.688 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_quiesce_inode": 122, 2024-08-19T00:24:23.688 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_enqueue_scrub": 0, 2024-08-19T00:24:23.688 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_exportdir": 0, 2024-08-19T00:24:23.688 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_flush": 0, 2024-08-19T00:24:23.689 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_fragmentdir": 0, 2024-08-19T00:24:23.689 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_fragstats": 0, 2024-08-19T00:24:23.689 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_inodestats": 0 2024-08-19T00:24:23.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:23.689 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_log": { 2024-08-19T00:24:23.689 INFO:teuthology.orchestra.run.smithi116.stdout: "evlrg": 0, 2024-08-19T00:24:23.689 INFO:teuthology.orchestra.run.smithi116.stdout: "evadd": 7, 2024-08-19T00:24:23.689 INFO:teuthology.orchestra.run.smithi116.stdout: "evex": 0, 2024-08-19T00:24:23.690 INFO:teuthology.orchestra.run.smithi116.stdout: "evtrm": 0, 2024-08-19T00:24:23.690 INFO:teuthology.orchestra.run.smithi116.stdout: "ev": 7, 2024-08-19T00:24:23.690 INFO:teuthology.orchestra.run.smithi116.stdout: "evexg": 0, 2024-08-19T00:24:23.690 INFO:teuthology.orchestra.run.smithi116.stdout: "evexd": 0, 2024-08-19T00:24:23.690 INFO:teuthology.orchestra.run.smithi116.stdout: "segadd": 2, 2024-08-19T00:24:23.690 INFO:teuthology.orchestra.run.smithi116.stdout: "segex": 0, 2024-08-19T00:24:23.690 INFO:teuthology.orchestra.run.smithi116.stdout: "segtrm": 0, 2024-08-19T00:24:23.691 INFO:teuthology.orchestra.run.smithi116.stdout: "seg": 2, 2024-08-19T00:24:23.691 INFO:teuthology.orchestra.run.smithi116.stdout: "segmjr": 2, 2024-08-19T00:24:23.691 INFO:teuthology.orchestra.run.smithi116.stdout: "segexg": 0, 2024-08-19T00:24:23.691 INFO:teuthology.orchestra.run.smithi116.stdout: "segexd": 0, 2024-08-19T00:24:23.691 INFO:teuthology.orchestra.run.smithi116.stdout: "expos": 4194304, 2024-08-19T00:24:23.691 INFO:teuthology.orchestra.run.smithi116.stdout: "wrpos": 4196262, 2024-08-19T00:24:23.691 INFO:teuthology.orchestra.run.smithi116.stdout: "rdpos": 0, 2024-08-19T00:24:23.691 INFO:teuthology.orchestra.run.smithi116.stdout: "jlat": { 2024-08-19T00:24:23.692 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 6, 2024-08-19T00:24:23.692 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.009044695, 2024-08-19T00:24:23.692 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.001507449 2024-08-19T00:24:23.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:23.692 INFO:teuthology.orchestra.run.smithi116.stdout: "replayed": 0 2024-08-19T00:24:23.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:23.692 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_mem": { 2024-08-19T00:24:23.692 INFO:teuthology.orchestra.run.smithi116.stdout: "ino": 27, 2024-08-19T00:24:23.693 INFO:teuthology.orchestra.run.smithi116.stdout: "ino+": 27, 2024-08-19T00:24:23.693 INFO:teuthology.orchestra.run.smithi116.stdout: "ino-": 0, 2024-08-19T00:24:23.693 INFO:teuthology.orchestra.run.smithi116.stdout: "dir": 40, 2024-08-19T00:24:23.693 INFO:teuthology.orchestra.run.smithi116.stdout: "dir+": 44, 2024-08-19T00:24:23.693 INFO:teuthology.orchestra.run.smithi116.stdout: "dir-": 4, 2024-08-19T00:24:23.693 INFO:teuthology.orchestra.run.smithi116.stdout: "dn": 24, 2024-08-19T00:24:23.694 INFO:teuthology.orchestra.run.smithi116.stdout: "dn+": 25, 2024-08-19T00:24:23.694 INFO:teuthology.orchestra.run.smithi116.stdout: "dn-": 1, 2024-08-19T00:24:23.694 INFO:teuthology.orchestra.run.smithi116.stdout: "cap": 0, 2024-08-19T00:24:23.694 INFO:teuthology.orchestra.run.smithi116.stdout: "cap+": 4, 2024-08-19T00:24:23.694 INFO:teuthology.orchestra.run.smithi116.stdout: "cap-": 4, 2024-08-19T00:24:23.694 INFO:teuthology.orchestra.run.smithi116.stdout: "rss": 54456, 2024-08-19T00:24:23.694 INFO:teuthology.orchestra.run.smithi116.stdout: "heap": 223520 2024-08-19T00:24:23.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:23.695 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_server": { 2024-08-19T00:24:23.695 INFO:teuthology.orchestra.run.smithi116.stdout: "dispatch_client_request": 8930, 2024-08-19T00:24:23.695 INFO:teuthology.orchestra.run.smithi116.stdout: "dispatch_server_request": 0, 2024-08-19T00:24:23.695 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_request": 8925, 2024-08-19T00:24:23.695 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_session": 16, 2024-08-19T00:24:23.695 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_peer_request": 1, 2024-08-19T00:24:23.695 INFO:teuthology.orchestra.run.smithi116.stdout: "req_create_latency": { 2024-08-19T00:24:23.696 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:23.696 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:23.696 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:23.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:23.696 INFO:teuthology.orchestra.run.smithi116.stdout: "req_getattr_latency": { 2024-08-19T00:24:23.696 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 2, 2024-08-19T00:24:23.696 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.001480128, 2024-08-19T00:24:23.696 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000740064 2024-08-19T00:24:23.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:23.697 INFO:teuthology.orchestra.run.smithi116.stdout: "req_getfilelock_latency": { 2024-08-19T00:24:23.697 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:23.697 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:23.697 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:23.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:23.697 INFO:teuthology.orchestra.run.smithi116.stdout: "req_link_latency": { 2024-08-19T00:24:23.697 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:23.698 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:23.698 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:23.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:23.698 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookup_latency": { 2024-08-19T00:24:23.698 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 3, 2024-08-19T00:24:23.698 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.001012974, 2024-08-19T00:24:23.699 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000337658 2024-08-19T00:24:23.699 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:23.699 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookuphash_latency": { 2024-08-19T00:24:23.699 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:23.699 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:23.700 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:23.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:23.700 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookupino_latency": { 2024-08-19T00:24:23.700 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:23.700 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:23.701 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:23.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:23.701 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookupname_latency": { 2024-08-19T00:24:23.701 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:23.701 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:23.701 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:23.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:23.701 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookupparent_latency": { 2024-08-19T00:24:23.702 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:23.702 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:23.702 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:23.702 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:23.702 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookupsnap_latency": { 2024-08-19T00:24:23.702 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:23.703 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:23.703 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:23.703 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:23.703 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lssnap_latency": { 2024-08-19T00:24:23.703 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:23.703 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:23.703 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:23.703 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:23.704 INFO:teuthology.orchestra.run.smithi116.stdout: "req_mkdir_latency": { 2024-08-19T00:24:23.704 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:23.705 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:23.705 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:23.705 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:23.705 INFO:teuthology.orchestra.run.smithi116.stdout: "req_mknod_latency": { 2024-08-19T00:24:23.705 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:23.705 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:23.705 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:23.705 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:23.706 INFO:teuthology.orchestra.run.smithi116.stdout: "req_mksnap_latency": { 2024-08-19T00:24:23.706 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:23.706 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:23.706 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:23.706 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:23.707 INFO:teuthology.orchestra.run.smithi116.stdout: "req_open_latency": { 2024-08-19T00:24:23.707 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:23.707 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:23.707 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:23.707 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:23.707 INFO:teuthology.orchestra.run.smithi116.stdout: "req_readdir_latency": { 2024-08-19T00:24:23.707 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:23.708 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:23.708 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:23.708 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:23.708 INFO:teuthology.orchestra.run.smithi116.stdout: "req_rename_latency": { 2024-08-19T00:24:23.708 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:23.708 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:23.708 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:23.709 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:23.709 INFO:teuthology.orchestra.run.smithi116.stdout: "req_renamesnap_latency": { 2024-08-19T00:24:23.709 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:23.709 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:23.709 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:23.709 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:23.709 INFO:teuthology.orchestra.run.smithi116.stdout: "req_snapdiff_latency": { 2024-08-19T00:24:23.709 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:23.709 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:23.710 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:23.710 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:23.710 INFO:teuthology.orchestra.run.smithi116.stdout: "req_rmdir_latency": { 2024-08-19T00:24:23.710 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:23.710 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:23.710 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:23.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:23.711 INFO:teuthology.orchestra.run.smithi116.stdout: "req_rmsnap_latency": { 2024-08-19T00:24:23.711 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:23.711 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:23.711 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:23.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:23.711 INFO:teuthology.orchestra.run.smithi116.stdout: "req_rmxattr_latency": { 2024-08-19T00:24:23.712 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:23.712 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:23.712 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:23.712 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:23.712 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setattr_latency": { 2024-08-19T00:24:23.712 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:23.712 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:23.712 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:23.713 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:23.713 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setdirlayout_latency": { 2024-08-19T00:24:23.713 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:23.713 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:23.713 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:23.713 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:23.713 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setfilelock_latency": { 2024-08-19T00:24:23.713 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:23.714 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:23.714 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:23.714 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:23.714 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setlayout_latency": { 2024-08-19T00:24:23.714 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:23.714 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:23.714 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:23.715 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:23.715 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setxattr_latency": { 2024-08-19T00:24:23.715 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:23.715 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:23.715 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:23.715 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:23.715 INFO:teuthology.orchestra.run.smithi116.stdout: "req_symlink_latency": { 2024-08-19T00:24:23.715 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:23.716 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:23.716 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:23.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:23.716 INFO:teuthology.orchestra.run.smithi116.stdout: "req_unlink_latency": { 2024-08-19T00:24:23.716 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:23.716 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:23.716 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:23.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:23.716 INFO:teuthology.orchestra.run.smithi116.stdout: "cap_revoke_eviction": 0, 2024-08-19T00:24:23.717 INFO:teuthology.orchestra.run.smithi116.stdout: "cap_acquisition_throttle": 0, 2024-08-19T00:24:23.717 INFO:teuthology.orchestra.run.smithi116.stdout: "req_getvxattr_latency": { 2024-08-19T00:24:23.717 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:23.717 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:23.717 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:23.717 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-08-19T00:24:23.717 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:23.717 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_sessions": { 2024-08-19T00:24:23.718 INFO:teuthology.orchestra.run.smithi116.stdout: "session_count": 1, 2024-08-19T00:24:23.718 INFO:teuthology.orchestra.run.smithi116.stdout: "session_add": 3, 2024-08-19T00:24:23.718 INFO:teuthology.orchestra.run.smithi116.stdout: "session_remove": 2, 2024-08-19T00:24:23.718 INFO:teuthology.orchestra.run.smithi116.stdout: "sessions_open": 1, 2024-08-19T00:24:23.718 INFO:teuthology.orchestra.run.smithi116.stdout: "sessions_stale": 0, 2024-08-19T00:24:23.718 INFO:teuthology.orchestra.run.smithi116.stdout: "total_load": 4, 2024-08-19T00:24:23.719 INFO:teuthology.orchestra.run.smithi116.stdout: "average_load": 2, 2024-08-19T00:24:23.719 INFO:teuthology.orchestra.run.smithi116.stdout: "avg_session_uptime": 551, 2024-08-19T00:24:23.719 INFO:teuthology.orchestra.run.smithi116.stdout: "mdthresh_evicted": 0 2024-08-19T00:24:23.719 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:23.719 INFO:teuthology.orchestra.run.smithi116.stdout: "mempool": { 2024-08-19T00:24:23.719 INFO:teuthology.orchestra.run.smithi116.stdout: "bloom_filter_bytes": 0, 2024-08-19T00:24:23.719 INFO:teuthology.orchestra.run.smithi116.stdout: "bloom_filter_items": 0, 2024-08-19T00:24:23.719 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_alloc_bytes": 0, 2024-08-19T00:24:23.720 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_alloc_items": 0, 2024-08-19T00:24:23.720 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_data_bytes": 0, 2024-08-19T00:24:23.720 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_data_items": 0, 2024-08-19T00:24:23.720 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-19T00:24:23.720 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_onode_items": 0, 2024-08-19T00:24:23.720 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-19T00:24:23.720 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_meta_items": 0, 2024-08-19T00:24:23.720 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_other_bytes": 0, 2024-08-19T00:24:23.721 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_other_items": 0, 2024-08-19T00:24:23.721 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-19T00:24:23.721 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_buffer_items": 0, 2024-08-19T00:24:23.721 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_extent_bytes": 0, 2024-08-19T00:24:23.721 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_extent_items": 0, 2024-08-19T00:24:23.721 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_blob_bytes": 0, 2024-08-19T00:24:23.721 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_blob_items": 0, 2024-08-19T00:24:23.721 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-19T00:24:23.722 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_shared_blob_items": 0, 2024-08-19T00:24:23.722 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-19T00:24:23.722 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_inline_bl_items": 0, 2024-08-19T00:24:23.722 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_fsck_bytes": 0, 2024-08-19T00:24:23.722 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_fsck_items": 0, 2024-08-19T00:24:23.722 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_txc_bytes": 0, 2024-08-19T00:24:23.722 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_txc_items": 0, 2024-08-19T00:24:23.723 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-19T00:24:23.723 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_deferred_items": 0, 2024-08-19T00:24:23.723 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_bytes": 0, 2024-08-19T00:24:23.723 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_items": 0, 2024-08-19T00:24:23.723 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_bytes": 0, 2024-08-19T00:24:23.723 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_items": 0, 2024-08-19T00:24:23.723 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_reader_bytes": 0, 2024-08-19T00:24:23.724 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_reader_items": 0, 2024-08-19T00:24:23.724 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_writer_bytes": 0, 2024-08-19T00:24:23.724 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_writer_items": 0, 2024-08-19T00:24:23.724 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_anon_bytes": 272424, 2024-08-19T00:24:23.725 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_anon_items": 110, 2024-08-19T00:24:23.725 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_meta_bytes": 0, 2024-08-19T00:24:23.725 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_meta_items": 0, 2024-08-19T00:24:23.726 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_bytes": 0, 2024-08-19T00:24:23.726 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_items": 0, 2024-08-19T00:24:23.726 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mapbl_bytes": 0, 2024-08-19T00:24:23.726 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mapbl_items": 0, 2024-08-19T00:24:23.727 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pglog_bytes": 0, 2024-08-19T00:24:23.727 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pglog_items": 0, 2024-08-19T00:24:23.728 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_bytes": 9712, 2024-08-19T00:24:23.728 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_items": 197, 2024-08-19T00:24:23.728 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_mapping_bytes": 0, 2024-08-19T00:24:23.728 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_mapping_items": 0, 2024-08-19T00:24:23.728 INFO:teuthology.orchestra.run.smithi116.stdout: "pgmap_bytes": 0, 2024-08-19T00:24:23.728 INFO:teuthology.orchestra.run.smithi116.stdout: "pgmap_items": 0, 2024-08-19T00:24:23.728 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_co_bytes": 139908, 2024-08-19T00:24:23.728 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_co_items": 750, 2024-08-19T00:24:23.729 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_1_bytes": 0, 2024-08-19T00:24:23.729 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_1_items": 0, 2024-08-19T00:24:23.729 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_2_bytes": 0, 2024-08-19T00:24:23.729 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_2_items": 0 2024-08-19T00:24:23.729 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:23.729 INFO:teuthology.orchestra.run.smithi116.stdout: "objecter": { 2024-08-19T00:24:23.729 INFO:teuthology.orchestra.run.smithi116.stdout: "op_active": 0, 2024-08-19T00:24:23.729 INFO:teuthology.orchestra.run.smithi116.stdout: "op_laggy": 0, 2024-08-19T00:24:23.730 INFO:teuthology.orchestra.run.smithi116.stdout: "op_send": 45, 2024-08-19T00:24:23.730 INFO:teuthology.orchestra.run.smithi116.stdout: "op_send_bytes": 12495, 2024-08-19T00:24:23.730 INFO:teuthology.orchestra.run.smithi116.stdout: "op_resend": 28, 2024-08-19T00:24:23.730 INFO:teuthology.orchestra.run.smithi116.stdout: "op_reply": 45, 2024-08-19T00:24:23.730 INFO:teuthology.orchestra.run.smithi116.stdout: "op_latency": { 2024-08-19T00:24:23.730 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 45, 2024-08-19T00:24:23.730 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.226996516, 2024-08-19T00:24:23.730 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.005044367 2024-08-19T00:24:23.731 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:23.731 INFO:teuthology.orchestra.run.smithi116.stdout: "op_inflight": 0, 2024-08-19T00:24:23.731 INFO:teuthology.orchestra.run.smithi116.stdout: "oplen_avg": { 2024-08-19T00:24:23.731 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 45, 2024-08-19T00:24:23.731 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 69 2024-08-19T00:24:23.731 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:23.731 INFO:teuthology.orchestra.run.smithi116.stdout: "op": 45, 2024-08-19T00:24:23.731 INFO:teuthology.orchestra.run.smithi116.stdout: "op_r": 0, 2024-08-19T00:24:23.732 INFO:teuthology.orchestra.run.smithi116.stdout: "op_w": 45, 2024-08-19T00:24:23.732 INFO:teuthology.orchestra.run.smithi116.stdout: "op_rmw": 0, 2024-08-19T00:24:23.732 INFO:teuthology.orchestra.run.smithi116.stdout: "op_pg": 0, 2024-08-19T00:24:23.732 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_stat": 0, 2024-08-19T00:24:23.732 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_create": 10, 2024-08-19T00:24:23.732 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_read": 0, 2024-08-19T00:24:23.732 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_write": 6, 2024-08-19T00:24:23.732 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_writefull": 8, 2024-08-19T00:24:23.733 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_writesame": 0, 2024-08-19T00:24:23.733 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_append": 0, 2024-08-19T00:24:23.733 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_zero": 0, 2024-08-19T00:24:23.733 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_truncate": 0, 2024-08-19T00:24:23.733 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_delete": 6, 2024-08-19T00:24:23.733 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_mapext": 0, 2024-08-19T00:24:23.733 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_sparse_read": 0, 2024-08-19T00:24:23.733 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_clonerange": 0, 2024-08-19T00:24:23.734 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_getxattr": 0, 2024-08-19T00:24:23.734 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_setxattr": 20, 2024-08-19T00:24:23.734 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_cmpxattr": 0, 2024-08-19T00:24:23.734 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_rmxattr": 0, 2024-08-19T00:24:23.734 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_resetxattrs": 0, 2024-08-19T00:24:23.734 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_call": 0, 2024-08-19T00:24:23.734 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_watch": 0, 2024-08-19T00:24:23.735 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_notify": 0, 2024-08-19T00:24:23.735 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_src_cmpxattr": 0, 2024-08-19T00:24:23.735 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_pgls": 0, 2024-08-19T00:24:23.735 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_pgls_filter": 0, 2024-08-19T00:24:23.735 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_other": 0, 2024-08-19T00:24:23.735 INFO:teuthology.orchestra.run.smithi116.stdout: "linger_active": 0, 2024-08-19T00:24:23.735 INFO:teuthology.orchestra.run.smithi116.stdout: "linger_send": 0, 2024-08-19T00:24:23.735 INFO:teuthology.orchestra.run.smithi116.stdout: "linger_resend": 0, 2024-08-19T00:24:23.735 INFO:teuthology.orchestra.run.smithi116.stdout: "linger_ping": 0, 2024-08-19T00:24:23.736 INFO:teuthology.orchestra.run.smithi116.stdout: "poolop_active": 0, 2024-08-19T00:24:23.736 INFO:teuthology.orchestra.run.smithi116.stdout: "poolop_send": 0, 2024-08-19T00:24:23.736 INFO:teuthology.orchestra.run.smithi116.stdout: "poolop_resend": 0, 2024-08-19T00:24:23.736 INFO:teuthology.orchestra.run.smithi116.stdout: "poolstat_active": 0, 2024-08-19T00:24:23.736 INFO:teuthology.orchestra.run.smithi116.stdout: "poolstat_send": 0, 2024-08-19T00:24:23.736 INFO:teuthology.orchestra.run.smithi116.stdout: "poolstat_resend": 0, 2024-08-19T00:24:23.737 INFO:teuthology.orchestra.run.smithi116.stdout: "statfs_active": 0, 2024-08-19T00:24:23.737 INFO:teuthology.orchestra.run.smithi116.stdout: "statfs_send": 0, 2024-08-19T00:24:23.737 INFO:teuthology.orchestra.run.smithi116.stdout: "statfs_resend": 0, 2024-08-19T00:24:23.737 INFO:teuthology.orchestra.run.smithi116.stdout: "command_active": 0, 2024-08-19T00:24:23.737 INFO:teuthology.orchestra.run.smithi116.stdout: "command_send": 0, 2024-08-19T00:24:23.737 INFO:teuthology.orchestra.run.smithi116.stdout: "command_resend": 0, 2024-08-19T00:24:23.737 INFO:teuthology.orchestra.run.smithi116.stdout: "map_epoch": 105, 2024-08-19T00:24:23.737 INFO:teuthology.orchestra.run.smithi116.stdout: "map_full": 0, 2024-08-19T00:24:23.738 INFO:teuthology.orchestra.run.smithi116.stdout: "map_inc": 15, 2024-08-19T00:24:23.738 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_sessions": 10, 2024-08-19T00:24:23.738 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_session_open": 10, 2024-08-19T00:24:23.738 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_session_close": 0, 2024-08-19T00:24:23.738 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_laggy": 0, 2024-08-19T00:24:23.738 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_wr": 17, 2024-08-19T00:24:23.739 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_rd": 0, 2024-08-19T00:24:23.739 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_del": 2 2024-08-19T00:24:23.739 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:23.739 INFO:teuthology.orchestra.run.smithi116.stdout: "oft": { 2024-08-19T00:24:23.739 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_total_objs": 1, 2024-08-19T00:24:23.739 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_total_kv_pairs": 0, 2024-08-19T00:24:23.739 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_total_updates": 0, 2024-08-19T00:24:23.739 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_total_removes": 0 2024-08-19T00:24:23.740 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:23.740 INFO:teuthology.orchestra.run.smithi116.stdout: "osd-slow-ops": { 2024-08-19T00:24:23.740 INFO:teuthology.orchestra.run.smithi116.stdout: "slow_ops_count": 115 2024-08-19T00:24:23.740 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:23.740 INFO:teuthology.orchestra.run.smithi116.stdout: "purge_queue": { 2024-08-19T00:24:23.740 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executing_ops": 0, 2024-08-19T00:24:23.740 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executing_ops_high_water": 0, 2024-08-19T00:24:23.740 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executing": 0, 2024-08-19T00:24:23.741 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executing_high_water": 0, 2024-08-19T00:24:23.741 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executed_ops": 0, 2024-08-19T00:24:23.741 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executed": 0, 2024-08-19T00:24:23.741 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_item_in_journal": 0 2024-08-19T00:24:23.741 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:23.741 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-19T00:24:23.741 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2024-08-19T00:24:23.742 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 104857600, 2024-08-19T00:24:23.742 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-08-19T00:24:23.742 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 140852, 2024-08-19T00:24:23.742 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 54840782, 2024-08-19T00:24:23.742 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-08-19T00:24:23.742 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 140852, 2024-08-19T00:24:23.742 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 0, 2024-08-19T00:24:23.743 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 0, 2024-08-19T00:24:23.743 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 140852, 2024-08-19T00:24:23.743 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 54840782, 2024-08-19T00:24:23.743 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-08-19T00:24:23.743 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:23.743 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:23.743 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:23.744 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-08-19T00:24:23.744 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:23.744 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-objecter_bytes": { 2024-08-19T00:24:23.744 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2024-08-19T00:24:23.744 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 104857600, 2024-08-19T00:24:23.744 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-08-19T00:24:23.744 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 0, 2024-08-19T00:24:23.744 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 0, 2024-08-19T00:24:23.745 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-08-19T00:24:23.745 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 0, 2024-08-19T00:24:23.745 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 45, 2024-08-19T00:24:23.745 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 12495, 2024-08-19T00:24:23.745 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 45, 2024-08-19T00:24:23.745 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 12495, 2024-08-19T00:24:23.745 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-08-19T00:24:23.746 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:23.746 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:23.746 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:23.746 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-08-19T00:24:23.746 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:23.746 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-objecter_ops": { 2024-08-19T00:24:23.746 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2024-08-19T00:24:23.747 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 1024, 2024-08-19T00:24:23.747 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-08-19T00:24:23.747 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 0, 2024-08-19T00:24:23.747 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 0, 2024-08-19T00:24:23.747 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-08-19T00:24:23.747 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 0, 2024-08-19T00:24:23.747 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 45, 2024-08-19T00:24:23.748 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 45, 2024-08-19T00:24:23.748 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 45, 2024-08-19T00:24:23.748 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 45, 2024-08-19T00:24:23.748 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-08-19T00:24:23.748 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:23.748 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:23.749 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:23.749 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-08-19T00:24:23.749 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:23.749 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-write_buf_throttle": { 2024-08-19T00:24:23.749 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2024-08-19T00:24:23.749 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 3758096384, 2024-08-19T00:24:23.749 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-08-19T00:24:23.750 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 0, 2024-08-19T00:24:23.750 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 0, 2024-08-19T00:24:23.750 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-08-19T00:24:23.750 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 0, 2024-08-19T00:24:23.750 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 0, 2024-08-19T00:24:23.750 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 0, 2024-08-19T00:24:23.750 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 0, 2024-08-19T00:24:23.750 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 0, 2024-08-19T00:24:23.751 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-08-19T00:24:23.751 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:23.751 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:23.751 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:23.751 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-08-19T00:24:23.751 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:23.751 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-write_buf_throttle-0x55a6311e4960": { 2024-08-19T00:24:23.752 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2024-08-19T00:24:23.752 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 3758096384, 2024-08-19T00:24:23.752 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-08-19T00:24:23.752 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 7, 2024-08-19T00:24:23.752 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 1958, 2024-08-19T00:24:23.752 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-08-19T00:24:23.752 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 7, 2024-08-19T00:24:23.753 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 0, 2024-08-19T00:24:23.753 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 0, 2024-08-19T00:24:23.753 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 6, 2024-08-19T00:24:23.753 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 1958, 2024-08-19T00:24:23.753 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-08-19T00:24:23.753 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:23.753 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:23.753 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:23.753 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-08-19T00:24:23.754 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-08-19T00:24:23.754 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-08-19T00:24:24.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:24 smithi171 ceph-mon[21810]: pgmap v345: 129 pgs: 129 active+clean; 539 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 27 KiB/s wr, 14 op/s 2024-08-19T00:24:24.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:24 smithi116 ceph-mon[21873]: pgmap v345: 129 pgs: 129 active+clean; 539 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 27 KiB/s wr, 14 op/s 2024-08-19T00:24:24.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:24 smithi044 ceph-mon[18489]: pgmap v345: 129 pgs: 129 active+clean; 539 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 27 KiB/s wr, 14 op/s 2024-08-19T00:24:24.408 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-08-19T00:24:24.408 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-08-19T00:24:24.408 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=0 2024-08-19T00:24:24.408 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-08-19T00:24:24.408 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-08-19T00:24:24.408 DEBUG:tasks.check_counter:Getting stats from k 2024-08-19T00:24:24.409 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph daemon mds.k perf dump 2024-08-19T00:24:24.659 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.b/config 2024-08-19T00:24:25.212 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-08-19T00:24:25.212 INFO:teuthology.orchestra.run.smithi116.stdout: "AsyncMessenger::Worker-0": { 2024-08-19T00:24:25.213 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_messages": 0, 2024-08-19T00:24:25.213 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages": 2, 2024-08-19T00:24:25.213 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_bytes": 0, 2024-08-19T00:24:25.213 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_bytes": 0, 2024-08-19T00:24:25.213 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_created_connections": 4, 2024-08-19T00:24:25.213 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_active_connections": 0, 2024-08-19T00:24:25.213 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_total_time": 0.001191663, 2024-08-19T00:24:25.213 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_send_time": 0.000000000, 2024-08-19T00:24:25.214 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_recv_time": 0.000369536, 2024-08-19T00:24:25.214 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-19T00:24:25.214 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages_queue_lat": { 2024-08-19T00:24:25.214 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:25.214 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:25.214 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:25.214 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:25.215 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_handle_ack_lat": { 2024-08-19T00:24:25.215 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:25.215 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:25.215 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:25.215 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:25.215 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-19T00:24:25.215 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_encrypted_bytes": 0 2024-08-19T00:24:25.215 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:25.216 INFO:teuthology.orchestra.run.smithi116.stdout: "AsyncMessenger::Worker-1": { 2024-08-19T00:24:25.216 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_messages": 243, 2024-08-19T00:24:25.216 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages": 230, 2024-08-19T00:24:25.216 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_bytes": 1588640, 2024-08-19T00:24:25.216 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_bytes": 140672, 2024-08-19T00:24:25.216 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_created_connections": 2, 2024-08-19T00:24:25.216 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_active_connections": 1, 2024-08-19T00:24:25.217 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_total_time": 0.041330680, 2024-08-19T00:24:25.217 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_send_time": 0.011746917, 2024-08-19T00:24:25.217 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_recv_time": 0.041958689, 2024-08-19T00:24:25.217 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-19T00:24:25.217 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages_queue_lat": { 2024-08-19T00:24:25.217 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 230, 2024-08-19T00:24:25.217 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.016247792, 2024-08-19T00:24:25.217 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000070642 2024-08-19T00:24:25.218 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:25.218 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_handle_ack_lat": { 2024-08-19T00:24:25.218 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:25.218 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:25.218 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:25.218 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:25.218 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_encrypted_bytes": 1588640, 2024-08-19T00:24:25.218 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_encrypted_bytes": 140672 2024-08-19T00:24:25.219 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:25.219 INFO:teuthology.orchestra.run.smithi116.stdout: "AsyncMessenger::Worker-2": { 2024-08-19T00:24:25.219 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_messages": 2, 2024-08-19T00:24:25.219 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages": 175, 2024-08-19T00:24:25.219 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_bytes": 320, 2024-08-19T00:24:25.219 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_bytes": 187424, 2024-08-19T00:24:25.219 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_created_connections": 5, 2024-08-19T00:24:25.219 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_active_connections": 3, 2024-08-19T00:24:25.220 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_total_time": 0.011073558, 2024-08-19T00:24:25.220 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_send_time": 0.007318038, 2024-08-19T00:24:25.220 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_recv_time": 0.001710330, 2024-08-19T00:24:25.220 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-19T00:24:25.220 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages_queue_lat": { 2024-08-19T00:24:25.220 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 172, 2024-08-19T00:24:25.220 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.011798102, 2024-08-19T00:24:25.220 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000068593 2024-08-19T00:24:25.221 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:25.221 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_handle_ack_lat": { 2024-08-19T00:24:25.221 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:25.221 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:25.221 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:25.221 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:25.221 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_encrypted_bytes": 320, 2024-08-19T00:24:25.221 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_encrypted_bytes": 187424 2024-08-19T00:24:25.222 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:25.222 INFO:teuthology.orchestra.run.smithi116.stdout: "cct": { 2024-08-19T00:24:25.222 INFO:teuthology.orchestra.run.smithi116.stdout: "total_workers": 0, 2024-08-19T00:24:25.222 INFO:teuthology.orchestra.run.smithi116.stdout: "unhealthy_workers": 0 2024-08-19T00:24:25.222 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:25.222 INFO:teuthology.orchestra.run.smithi116.stdout: "mempool": { 2024-08-19T00:24:25.222 INFO:teuthology.orchestra.run.smithi116.stdout: "bloom_filter_bytes": 0, 2024-08-19T00:24:25.222 INFO:teuthology.orchestra.run.smithi116.stdout: "bloom_filter_items": 0, 2024-08-19T00:24:25.223 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_alloc_bytes": 0, 2024-08-19T00:24:25.223 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_alloc_items": 0, 2024-08-19T00:24:25.223 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_data_bytes": 0, 2024-08-19T00:24:25.223 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_data_items": 0, 2024-08-19T00:24:25.223 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-19T00:24:25.223 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_onode_items": 0, 2024-08-19T00:24:25.223 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-19T00:24:25.224 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_meta_items": 0, 2024-08-19T00:24:25.224 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_other_bytes": 0, 2024-08-19T00:24:25.224 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_other_items": 0, 2024-08-19T00:24:25.224 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-19T00:24:25.224 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_buffer_items": 0, 2024-08-19T00:24:25.224 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_extent_bytes": 0, 2024-08-19T00:24:25.224 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_extent_items": 0, 2024-08-19T00:24:25.224 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_blob_bytes": 0, 2024-08-19T00:24:25.225 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_blob_items": 0, 2024-08-19T00:24:25.225 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-19T00:24:25.225 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_shared_blob_items": 0, 2024-08-19T00:24:25.225 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-19T00:24:25.225 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_inline_bl_items": 0, 2024-08-19T00:24:25.225 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_fsck_bytes": 0, 2024-08-19T00:24:25.225 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_fsck_items": 0, 2024-08-19T00:24:25.225 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_txc_bytes": 0, 2024-08-19T00:24:25.226 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_txc_items": 0, 2024-08-19T00:24:25.226 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-19T00:24:25.226 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_deferred_items": 0, 2024-08-19T00:24:25.226 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_bytes": 0, 2024-08-19T00:24:25.226 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_items": 0, 2024-08-19T00:24:25.226 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_bytes": 0, 2024-08-19T00:24:25.226 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_items": 0, 2024-08-19T00:24:25.226 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_reader_bytes": 0, 2024-08-19T00:24:25.227 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_reader_items": 0, 2024-08-19T00:24:25.227 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_writer_bytes": 0, 2024-08-19T00:24:25.227 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_writer_items": 0, 2024-08-19T00:24:25.227 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_anon_bytes": 149745, 2024-08-19T00:24:25.227 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_anon_items": 31, 2024-08-19T00:24:25.227 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_meta_bytes": 0, 2024-08-19T00:24:25.227 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_meta_items": 0, 2024-08-19T00:24:25.227 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_bytes": 0, 2024-08-19T00:24:25.228 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_items": 0, 2024-08-19T00:24:25.228 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mapbl_bytes": 0, 2024-08-19T00:24:25.228 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mapbl_items": 0, 2024-08-19T00:24:25.228 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pglog_bytes": 0, 2024-08-19T00:24:25.228 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pglog_items": 0, 2024-08-19T00:24:25.228 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_bytes": 0, 2024-08-19T00:24:25.228 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_items": 0, 2024-08-19T00:24:25.228 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_mapping_bytes": 0, 2024-08-19T00:24:25.229 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_mapping_items": 0, 2024-08-19T00:24:25.229 INFO:teuthology.orchestra.run.smithi116.stdout: "pgmap_bytes": 0, 2024-08-19T00:24:25.229 INFO:teuthology.orchestra.run.smithi116.stdout: "pgmap_items": 0, 2024-08-19T00:24:25.229 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_co_bytes": 928, 2024-08-19T00:24:25.229 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_co_items": 2, 2024-08-19T00:24:25.229 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_1_bytes": 0, 2024-08-19T00:24:25.229 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_1_items": 0, 2024-08-19T00:24:25.229 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_2_bytes": 0, 2024-08-19T00:24:25.230 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_2_items": 0 2024-08-19T00:24:25.230 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-08-19T00:24:25.230 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-19T00:24:25.230 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2024-08-19T00:24:25.230 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 104857600, 2024-08-19T00:24:25.230 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2024-08-19T00:24:25.230 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 241, 2024-08-19T00:24:25.230 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 1551930, 2024-08-19T00:24:25.231 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2024-08-19T00:24:25.231 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 241, 2024-08-19T00:24:25.231 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 0, 2024-08-19T00:24:25.231 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 0, 2024-08-19T00:24:25.231 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 241, 2024-08-19T00:24:25.231 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 1551930, 2024-08-19T00:24:25.231 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2024-08-19T00:24:25.232 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2024-08-19T00:24:25.232 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2024-08-19T00:24:25.232 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2024-08-19T00:24:25.232 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-08-19T00:24:25.232 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-08-19T00:24:25.232 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-08-19T00:24:26.013 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-08-19T00:24:26.013 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-08-19T00:24:26.014 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.k 2024-08-19T00:24:26.014 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.k 2024-08-19T00:24:26.014 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.k 2024-08-19T00:24:26.014 DEBUG:tasks.check_counter:Getting stats from c 2024-08-19T00:24:26.014 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph daemon mds.c perf dump 2024-08-19T00:24:26.268 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.c/config 2024-08-19T00:24:26.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:26 smithi171 ceph-mon[21810]: pgmap v346: 129 pgs: 129 active+clean; 540 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 43 KiB/s wr, 18 op/s 2024-08-19T00:24:26.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:26 smithi116 ceph-mon[21873]: pgmap v346: 129 pgs: 129 active+clean; 540 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 43 KiB/s wr, 18 op/s 2024-08-19T00:24:26.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:26 smithi044 ceph-mon[18489]: pgmap v346: 129 pgs: 129 active+clean; 540 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 43 KiB/s wr, 18 op/s 2024-08-19T00:24:26.800 INFO:teuthology.orchestra.run.smithi171.stdout:{ 2024-08-19T00:24:26.800 INFO:teuthology.orchestra.run.smithi171.stdout: "AsyncMessenger::Worker-0": { 2024-08-19T00:24:26.801 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_messages": 1071, 2024-08-19T00:24:26.801 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages": 1028, 2024-08-19T00:24:26.801 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_bytes": 1921651, 2024-08-19T00:24:26.801 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_bytes": 553633, 2024-08-19T00:24:26.801 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_created_connections": 9, 2024-08-19T00:24:26.801 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_active_connections": 5, 2024-08-19T00:24:26.801 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_total_time": 0.106208108, 2024-08-19T00:24:26.801 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_send_time": 0.038034579, 2024-08-19T00:24:26.802 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_recv_time": 0.080314380, 2024-08-19T00:24:26.802 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_fast_dispatch_time": 0.003969574, 2024-08-19T00:24:26.802 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages_queue_lat": { 2024-08-19T00:24:26.802 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 1028, 2024-08-19T00:24:26.802 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.048422394, 2024-08-19T00:24:26.802 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000047103 2024-08-19T00:24:26.802 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:26.802 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_handle_ack_lat": { 2024-08-19T00:24:26.803 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 1469, 2024-08-19T00:24:26.803 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000392007, 2024-08-19T00:24:26.803 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000266 2024-08-19T00:24:26.803 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:26.803 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_encrypted_bytes": 1669648, 2024-08-19T00:24:26.803 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_encrypted_bytes": 148160 2024-08-19T00:24:26.803 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:26.803 INFO:teuthology.orchestra.run.smithi171.stdout: "AsyncMessenger::Worker-1": { 2024-08-19T00:24:26.804 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_messages": 39, 2024-08-19T00:24:26.804 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages": 110, 2024-08-19T00:24:26.804 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_bytes": 9079, 2024-08-19T00:24:26.804 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_bytes": 224759, 2024-08-19T00:24:26.804 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_created_connections": 17, 2024-08-19T00:24:26.804 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_active_connections": 5, 2024-08-19T00:24:26.804 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_total_time": 0.011073497, 2024-08-19T00:24:26.804 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_send_time": 0.003350789, 2024-08-19T00:24:26.804 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_recv_time": 0.006600666, 2024-08-19T00:24:26.805 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_fast_dispatch_time": 0.000219995, 2024-08-19T00:24:26.805 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages_queue_lat": { 2024-08-19T00:24:26.805 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 107, 2024-08-19T00:24:26.805 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.011953626, 2024-08-19T00:24:26.805 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000111716 2024-08-19T00:24:26.805 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:26.805 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_handle_ack_lat": { 2024-08-19T00:24:26.805 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 77, 2024-08-19T00:24:26.806 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000013981, 2024-08-19T00:24:26.806 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000181 2024-08-19T00:24:26.806 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:26.806 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_encrypted_bytes": 5712, 2024-08-19T00:24:26.806 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_encrypted_bytes": 140880 2024-08-19T00:24:26.806 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:26.806 INFO:teuthology.orchestra.run.smithi171.stdout: "AsyncMessenger::Worker-2": { 2024-08-19T00:24:26.806 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_messages": 130870, 2024-08-19T00:24:26.807 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages": 65510, 2024-08-19T00:24:26.807 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_bytes": 63124128, 2024-08-19T00:24:26.807 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_bytes": 10775015, 2024-08-19T00:24:26.807 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_created_connections": 8, 2024-08-19T00:24:26.807 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_active_connections": 6, 2024-08-19T00:24:26.807 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_total_time": 5.260738829, 2024-08-19T00:24:26.807 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_send_time": 2.315188955, 2024-08-19T00:24:26.807 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_recv_time": 4.071755783, 2024-08-19T00:24:26.807 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_fast_dispatch_time": 0.000434279, 2024-08-19T00:24:26.808 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages_queue_lat": { 2024-08-19T00:24:26.808 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 65508, 2024-08-19T00:24:26.808 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.827271676, 2024-08-19T00:24:26.808 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000012628 2024-08-19T00:24:26.808 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:26.808 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_handle_ack_lat": { 2024-08-19T00:24:26.808 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 196181, 2024-08-19T00:24:26.808 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.025706010, 2024-08-19T00:24:26.809 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000131 2024-08-19T00:24:26.809 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:26.809 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_encrypted_bytes": 160, 2024-08-19T00:24:26.809 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_encrypted_bytes": 328160 2024-08-19T00:24:26.809 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:26.809 INFO:teuthology.orchestra.run.smithi171.stdout: "cct": { 2024-08-19T00:24:26.809 INFO:teuthology.orchestra.run.smithi171.stdout: "total_workers": 1, 2024-08-19T00:24:26.809 INFO:teuthology.orchestra.run.smithi171.stdout: "unhealthy_workers": 0 2024-08-19T00:24:26.809 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:26.810 INFO:teuthology.orchestra.run.smithi171.stdout: "finisher-MDSRank": { 2024-08-19T00:24:26.810 INFO:teuthology.orchestra.run.smithi171.stdout: "queue_len": 0, 2024-08-19T00:24:26.810 INFO:teuthology.orchestra.run.smithi171.stdout: "complete_latency": { 2024-08-19T00:24:26.810 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 55, 2024-08-19T00:24:26.810 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.002237753, 2024-08-19T00:24:26.810 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000040686 2024-08-19T00:24:26.810 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-08-19T00:24:26.810 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:26.811 INFO:teuthology.orchestra.run.smithi171.stdout: "finisher-PurgeQueue": { 2024-08-19T00:24:26.811 INFO:teuthology.orchestra.run.smithi171.stdout: "queue_len": 0, 2024-08-19T00:24:26.811 INFO:teuthology.orchestra.run.smithi171.stdout: "complete_latency": { 2024-08-19T00:24:26.811 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 2, 2024-08-19T00:24:26.811 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000034685, 2024-08-19T00:24:26.811 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000017342 2024-08-19T00:24:26.811 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-08-19T00:24:26.811 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:26.812 INFO:teuthology.orchestra.run.smithi171.stdout: "mds": { 2024-08-19T00:24:26.812 INFO:teuthology.orchestra.run.smithi171.stdout: "request": 53, 2024-08-19T00:24:26.812 INFO:teuthology.orchestra.run.smithi171.stdout: "reply": 3, 2024-08-19T00:24:26.812 INFO:teuthology.orchestra.run.smithi171.stdout: "reply_latency": { 2024-08-19T00:24:26.812 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 3, 2024-08-19T00:24:26.812 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000564861, 2024-08-19T00:24:26.812 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000188287 2024-08-19T00:24:26.812 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:26.813 INFO:teuthology.orchestra.run.smithi171.stdout: "slow_reply": 0, 2024-08-19T00:24:26.813 INFO:teuthology.orchestra.run.smithi171.stdout: "forward": 50, 2024-08-19T00:24:26.813 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_fetch_complete": 0, 2024-08-19T00:24:26.813 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_fetch_keys": 0, 2024-08-19T00:24:26.813 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_commit": 11, 2024-08-19T00:24:26.813 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_split": 0, 2024-08-19T00:24:26.813 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_merge": 0, 2024-08-19T00:24:26.813 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes": 24, 2024-08-19T00:24:26.814 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_top": 3, 2024-08-19T00:24:26.814 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_bottom": 21, 2024-08-19T00:24:26.814 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_pin_tail": 0, 2024-08-19T00:24:26.814 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_pinned": 19, 2024-08-19T00:24:26.814 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_expired": 0, 2024-08-19T00:24:26.814 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_with_caps": 1, 2024-08-19T00:24:26.814 INFO:teuthology.orchestra.run.smithi171.stdout: "caps": 1, 2024-08-19T00:24:26.814 INFO:teuthology.orchestra.run.smithi171.stdout: "subtrees": 3, 2024-08-19T00:24:26.815 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse": 83, 2024-08-19T00:24:26.815 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_hit": 29, 2024-08-19T00:24:26.815 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_forward": 48, 2024-08-19T00:24:26.815 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_discover": 5, 2024-08-19T00:24:26.815 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_dir_fetch": 0, 2024-08-19T00:24:26.815 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_remote_ino": 0, 2024-08-19T00:24:26.815 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_lock": 0, 2024-08-19T00:24:26.815 INFO:teuthology.orchestra.run.smithi171.stdout: "load_cent": 0, 2024-08-19T00:24:26.816 INFO:teuthology.orchestra.run.smithi171.stdout: "q": 0, 2024-08-19T00:24:26.816 INFO:teuthology.orchestra.run.smithi171.stdout: "exported": 0, 2024-08-19T00:24:26.816 INFO:teuthology.orchestra.run.smithi171.stdout: "exported_inodes": 0, 2024-08-19T00:24:26.816 INFO:teuthology.orchestra.run.smithi171.stdout: "imported": 0, 2024-08-19T00:24:26.816 INFO:teuthology.orchestra.run.smithi171.stdout: "imported_inodes": 0, 2024-08-19T00:24:26.816 INFO:teuthology.orchestra.run.smithi171.stdout: "openino_dir_fetch": 0, 2024-08-19T00:24:26.816 INFO:teuthology.orchestra.run.smithi171.stdout: "openino_backtrace_fetch": 0, 2024-08-19T00:24:26.816 INFO:teuthology.orchestra.run.smithi171.stdout: "openino_peer_discover": 0, 2024-08-19T00:24:26.817 INFO:teuthology.orchestra.run.smithi171.stdout: "root_rfiles": 4, 2024-08-19T00:24:26.817 INFO:teuthology.orchestra.run.smithi171.stdout: "root_rbytes": 234, 2024-08-19T00:24:26.817 INFO:teuthology.orchestra.run.smithi171.stdout: "root_rsnaps": 0, 2024-08-19T00:24:26.817 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_backtrace_fetch": 0, 2024-08-19T00:24:26.817 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_set_tag": 0, 2024-08-19T00:24:26.817 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_backtrace_repaired": 0, 2024-08-19T00:24:26.817 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_inotable_repaired": 0, 2024-08-19T00:24:26.817 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_dir_inodes": 0, 2024-08-19T00:24:26.818 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_dir_base_inodes": 0, 2024-08-19T00:24:26.818 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_dirfrag_rstats": 0, 2024-08-19T00:24:26.818 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_file_inodes": 0, 2024-08-19T00:24:26.818 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_inode_file_caps": 0, 2024-08-19T00:24:26.818 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_revoke": 1, 2024-08-19T00:24:26.818 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_grant": 0, 2024-08-19T00:24:26.818 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_trunc": 0, 2024-08-19T00:24:26.818 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-19T00:24:26.819 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-19T00:24:26.819 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_caps": 1, 2024-08-19T00:24:26.819 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_caps_dirty": 0, 2024-08-19T00:24:26.819 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_cap_release": 0, 2024-08-19T00:24:26.819 INFO:teuthology.orchestra.run.smithi171.stdout: "process_request_cap_release": 0 2024-08-19T00:24:26.819 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:26.819 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_cache": { 2024-08-19T00:24:26.819 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_update": 0, 2024-08-19T00:24:26.819 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_update_receipt": 15, 2024-08-19T00:24:26.820 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_try_discover": 10, 2024-08-19T00:24:26.820 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_send_discover": 11, 2024-08-19T00:24:26.820 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_handle_discover": 0, 2024-08-19T00:24:26.820 INFO:teuthology.orchestra.run.smithi171.stdout: "num_strays": 0, 2024-08-19T00:24:26.820 INFO:teuthology.orchestra.run.smithi171.stdout: "num_strays_delayed": 0, 2024-08-19T00:24:26.820 INFO:teuthology.orchestra.run.smithi171.stdout: "num_strays_enqueuing": 0, 2024-08-19T00:24:26.820 INFO:teuthology.orchestra.run.smithi171.stdout: "strays_created": 0, 2024-08-19T00:24:26.820 INFO:teuthology.orchestra.run.smithi171.stdout: "strays_enqueued": 0, 2024-08-19T00:24:26.821 INFO:teuthology.orchestra.run.smithi171.stdout: "strays_reintegrated": 0, 2024-08-19T00:24:26.821 INFO:teuthology.orchestra.run.smithi171.stdout: "strays_migrated": 0, 2024-08-19T00:24:26.821 INFO:teuthology.orchestra.run.smithi171.stdout: "num_recovering_processing": 0, 2024-08-19T00:24:26.821 INFO:teuthology.orchestra.run.smithi171.stdout: "num_recovering_enqueued": 0, 2024-08-19T00:24:26.821 INFO:teuthology.orchestra.run.smithi171.stdout: "num_recovering_prioritized": 0, 2024-08-19T00:24:26.821 INFO:teuthology.orchestra.run.smithi171.stdout: "recovery_started": 0, 2024-08-19T00:24:26.821 INFO:teuthology.orchestra.run.smithi171.stdout: "recovery_completed": 0, 2024-08-19T00:24:26.822 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_quiesce_path": 9, 2024-08-19T00:24:26.822 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_quiesce_inode": 121, 2024-08-19T00:24:26.822 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_enqueue_scrub": 0, 2024-08-19T00:24:26.822 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_exportdir": 0, 2024-08-19T00:24:26.822 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_flush": 0, 2024-08-19T00:24:26.822 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_fragmentdir": 0, 2024-08-19T00:24:26.822 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_fragstats": 0, 2024-08-19T00:24:26.822 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_inodestats": 0 2024-08-19T00:24:26.823 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:26.823 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_log": { 2024-08-19T00:24:26.823 INFO:teuthology.orchestra.run.smithi171.stdout: "evlrg": 0, 2024-08-19T00:24:26.823 INFO:teuthology.orchestra.run.smithi171.stdout: "evadd": 10, 2024-08-19T00:24:26.823 INFO:teuthology.orchestra.run.smithi171.stdout: "evex": 0, 2024-08-19T00:24:26.823 INFO:teuthology.orchestra.run.smithi171.stdout: "evtrm": 0, 2024-08-19T00:24:26.823 INFO:teuthology.orchestra.run.smithi171.stdout: "ev": 10, 2024-08-19T00:24:26.823 INFO:teuthology.orchestra.run.smithi171.stdout: "evexg": 0, 2024-08-19T00:24:26.824 INFO:teuthology.orchestra.run.smithi171.stdout: "evexd": 0, 2024-08-19T00:24:26.824 INFO:teuthology.orchestra.run.smithi171.stdout: "segadd": 2, 2024-08-19T00:24:26.824 INFO:teuthology.orchestra.run.smithi171.stdout: "segex": 0, 2024-08-19T00:24:26.824 INFO:teuthology.orchestra.run.smithi171.stdout: "segtrm": 0, 2024-08-19T00:24:26.824 INFO:teuthology.orchestra.run.smithi171.stdout: "seg": 2, 2024-08-19T00:24:26.824 INFO:teuthology.orchestra.run.smithi171.stdout: "segmjr": 2, 2024-08-19T00:24:26.824 INFO:teuthology.orchestra.run.smithi171.stdout: "segexg": 0, 2024-08-19T00:24:26.824 INFO:teuthology.orchestra.run.smithi171.stdout: "segexd": 0, 2024-08-19T00:24:26.824 INFO:teuthology.orchestra.run.smithi171.stdout: "expos": 4194304, 2024-08-19T00:24:26.825 INFO:teuthology.orchestra.run.smithi171.stdout: "wrpos": 4197183, 2024-08-19T00:24:26.825 INFO:teuthology.orchestra.run.smithi171.stdout: "rdpos": 0, 2024-08-19T00:24:26.825 INFO:teuthology.orchestra.run.smithi171.stdout: "jlat": { 2024-08-19T00:24:26.825 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 9, 2024-08-19T00:24:26.825 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.013518648, 2024-08-19T00:24:26.825 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.001502072 2024-08-19T00:24:26.825 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:26.825 INFO:teuthology.orchestra.run.smithi171.stdout: "replayed": 0 2024-08-19T00:24:26.826 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:26.826 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_mem": { 2024-08-19T00:24:26.826 INFO:teuthology.orchestra.run.smithi171.stdout: "ino": 27, 2024-08-19T00:24:26.826 INFO:teuthology.orchestra.run.smithi171.stdout: "ino+": 27, 2024-08-19T00:24:26.826 INFO:teuthology.orchestra.run.smithi171.stdout: "ino-": 0, 2024-08-19T00:24:26.827 INFO:teuthology.orchestra.run.smithi171.stdout: "dir": 40, 2024-08-19T00:24:26.827 INFO:teuthology.orchestra.run.smithi171.stdout: "dir+": 43, 2024-08-19T00:24:26.827 INFO:teuthology.orchestra.run.smithi171.stdout: "dir-": 3, 2024-08-19T00:24:26.827 INFO:teuthology.orchestra.run.smithi171.stdout: "dn": 24, 2024-08-19T00:24:26.827 INFO:teuthology.orchestra.run.smithi171.stdout: "dn+": 24, 2024-08-19T00:24:26.827 INFO:teuthology.orchestra.run.smithi171.stdout: "dn-": 0, 2024-08-19T00:24:26.827 INFO:teuthology.orchestra.run.smithi171.stdout: "cap": 1, 2024-08-19T00:24:26.827 INFO:teuthology.orchestra.run.smithi171.stdout: "cap+": 1, 2024-08-19T00:24:26.828 INFO:teuthology.orchestra.run.smithi171.stdout: "cap-": 0, 2024-08-19T00:24:26.828 INFO:teuthology.orchestra.run.smithi171.stdout: "rss": 53840, 2024-08-19T00:24:26.828 INFO:teuthology.orchestra.run.smithi171.stdout: "heap": 223520 2024-08-19T00:24:26.828 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:26.828 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_server": { 2024-08-19T00:24:26.828 INFO:teuthology.orchestra.run.smithi171.stdout: "dispatch_client_request": 53, 2024-08-19T00:24:26.828 INFO:teuthology.orchestra.run.smithi171.stdout: "dispatch_server_request": 0, 2024-08-19T00:24:26.828 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_request": 53, 2024-08-19T00:24:26.829 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_session": 29, 2024-08-19T00:24:26.829 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_peer_request": 0, 2024-08-19T00:24:26.829 INFO:teuthology.orchestra.run.smithi171.stdout: "req_create_latency": { 2024-08-19T00:24:26.829 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:26.829 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:26.829 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:26.829 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:26.829 INFO:teuthology.orchestra.run.smithi171.stdout: "req_getattr_latency": { 2024-08-19T00:24:26.830 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 3, 2024-08-19T00:24:26.830 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000564861, 2024-08-19T00:24:26.830 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000188287 2024-08-19T00:24:26.830 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:26.830 INFO:teuthology.orchestra.run.smithi171.stdout: "req_getfilelock_latency": { 2024-08-19T00:24:26.830 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:26.830 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:26.830 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:26.831 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:26.831 INFO:teuthology.orchestra.run.smithi171.stdout: "req_link_latency": { 2024-08-19T00:24:26.831 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:26.831 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:26.831 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:26.831 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:26.831 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookup_latency": { 2024-08-19T00:24:26.831 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:26.832 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:26.832 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:26.832 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:26.832 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookuphash_latency": { 2024-08-19T00:24:26.832 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:26.832 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:26.832 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:26.832 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:26.833 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookupino_latency": { 2024-08-19T00:24:26.833 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:26.833 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:26.833 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:26.833 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:26.833 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookupname_latency": { 2024-08-19T00:24:26.833 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:26.833 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:26.834 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:26.834 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:26.834 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookupparent_latency": { 2024-08-19T00:24:26.834 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:26.834 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:26.834 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:26.834 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:26.835 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookupsnap_latency": { 2024-08-19T00:24:26.835 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:26.835 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:26.835 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:26.835 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:26.835 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lssnap_latency": { 2024-08-19T00:24:26.835 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:26.835 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:26.835 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:26.836 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:26.836 INFO:teuthology.orchestra.run.smithi171.stdout: "req_mkdir_latency": { 2024-08-19T00:24:26.836 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:26.837 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:26.837 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:26.837 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:26.837 INFO:teuthology.orchestra.run.smithi171.stdout: "req_mknod_latency": { 2024-08-19T00:24:26.837 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:26.837 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:26.837 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:26.837 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:26.838 INFO:teuthology.orchestra.run.smithi171.stdout: "req_mksnap_latency": { 2024-08-19T00:24:26.838 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:26.838 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:26.838 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:26.838 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:26.838 INFO:teuthology.orchestra.run.smithi171.stdout: "req_open_latency": { 2024-08-19T00:24:26.838 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:26.839 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:26.839 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:26.839 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:26.839 INFO:teuthology.orchestra.run.smithi171.stdout: "req_readdir_latency": { 2024-08-19T00:24:26.839 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:26.839 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:26.839 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:26.839 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:26.839 INFO:teuthology.orchestra.run.smithi171.stdout: "req_rename_latency": { 2024-08-19T00:24:26.840 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:26.840 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:26.840 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:26.840 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:26.840 INFO:teuthology.orchestra.run.smithi171.stdout: "req_renamesnap_latency": { 2024-08-19T00:24:26.840 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:26.840 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:26.840 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:26.841 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:26.841 INFO:teuthology.orchestra.run.smithi171.stdout: "req_snapdiff_latency": { 2024-08-19T00:24:26.841 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:26.841 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:26.841 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:26.841 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:26.841 INFO:teuthology.orchestra.run.smithi171.stdout: "req_rmdir_latency": { 2024-08-19T00:24:26.841 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:26.842 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:26.842 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:26.842 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:26.842 INFO:teuthology.orchestra.run.smithi171.stdout: "req_rmsnap_latency": { 2024-08-19T00:24:26.842 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:26.842 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:26.842 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:26.842 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:26.843 INFO:teuthology.orchestra.run.smithi171.stdout: "req_rmxattr_latency": { 2024-08-19T00:24:26.843 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:26.843 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:26.843 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:26.843 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:26.843 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setattr_latency": { 2024-08-19T00:24:26.843 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:26.843 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:26.843 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:26.844 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:26.844 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setdirlayout_latency": { 2024-08-19T00:24:26.844 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:26.844 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:26.844 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:26.844 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:26.844 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setfilelock_latency": { 2024-08-19T00:24:26.844 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:26.845 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:26.845 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:26.845 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:26.845 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setlayout_latency": { 2024-08-19T00:24:26.845 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:26.845 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:26.845 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:26.845 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:26.846 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setxattr_latency": { 2024-08-19T00:24:26.846 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:26.846 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:26.846 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:26.846 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:26.846 INFO:teuthology.orchestra.run.smithi171.stdout: "req_symlink_latency": { 2024-08-19T00:24:26.846 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:26.846 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:26.847 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:26.847 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:26.847 INFO:teuthology.orchestra.run.smithi171.stdout: "req_unlink_latency": { 2024-08-19T00:24:26.847 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:26.847 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:26.847 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:26.847 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:26.847 INFO:teuthology.orchestra.run.smithi171.stdout: "cap_revoke_eviction": 0, 2024-08-19T00:24:26.847 INFO:teuthology.orchestra.run.smithi171.stdout: "cap_acquisition_throttle": 0, 2024-08-19T00:24:26.848 INFO:teuthology.orchestra.run.smithi171.stdout: "req_getvxattr_latency": { 2024-08-19T00:24:26.848 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:26.848 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:26.848 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:26.848 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-08-19T00:24:26.848 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:26.848 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_sessions": { 2024-08-19T00:24:26.848 INFO:teuthology.orchestra.run.smithi171.stdout: "session_count": 2, 2024-08-19T00:24:26.849 INFO:teuthology.orchestra.run.smithi171.stdout: "session_add": 5, 2024-08-19T00:24:26.849 INFO:teuthology.orchestra.run.smithi171.stdout: "session_remove": 3, 2024-08-19T00:24:26.849 INFO:teuthology.orchestra.run.smithi171.stdout: "sessions_open": 2, 2024-08-19T00:24:26.849 INFO:teuthology.orchestra.run.smithi171.stdout: "sessions_stale": 0, 2024-08-19T00:24:26.849 INFO:teuthology.orchestra.run.smithi171.stdout: "total_load": 2, 2024-08-19T00:24:26.849 INFO:teuthology.orchestra.run.smithi171.stdout: "average_load": 0, 2024-08-19T00:24:26.849 INFO:teuthology.orchestra.run.smithi171.stdout: "avg_session_uptime": 603, 2024-08-19T00:24:26.849 INFO:teuthology.orchestra.run.smithi171.stdout: "mdthresh_evicted": 0 2024-08-19T00:24:26.849 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:26.850 INFO:teuthology.orchestra.run.smithi171.stdout: "mempool": { 2024-08-19T00:24:26.850 INFO:teuthology.orchestra.run.smithi171.stdout: "bloom_filter_bytes": 0, 2024-08-19T00:24:26.850 INFO:teuthology.orchestra.run.smithi171.stdout: "bloom_filter_items": 0, 2024-08-19T00:24:26.850 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_alloc_bytes": 0, 2024-08-19T00:24:26.850 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_alloc_items": 0, 2024-08-19T00:24:26.850 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_data_bytes": 0, 2024-08-19T00:24:26.850 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_data_items": 0, 2024-08-19T00:24:26.850 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-19T00:24:26.851 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_onode_items": 0, 2024-08-19T00:24:26.851 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-19T00:24:26.851 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_meta_items": 0, 2024-08-19T00:24:26.851 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_other_bytes": 0, 2024-08-19T00:24:26.851 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_other_items": 0, 2024-08-19T00:24:26.851 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-19T00:24:26.851 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_buffer_items": 0, 2024-08-19T00:24:26.851 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_extent_bytes": 0, 2024-08-19T00:24:26.852 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_extent_items": 0, 2024-08-19T00:24:26.852 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_blob_bytes": 0, 2024-08-19T00:24:26.852 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_blob_items": 0, 2024-08-19T00:24:26.852 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-19T00:24:26.852 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_shared_blob_items": 0, 2024-08-19T00:24:26.852 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-19T00:24:26.852 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_inline_bl_items": 0, 2024-08-19T00:24:26.852 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_fsck_bytes": 0, 2024-08-19T00:24:26.852 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_fsck_items": 0, 2024-08-19T00:24:26.853 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_txc_bytes": 0, 2024-08-19T00:24:26.853 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_txc_items": 0, 2024-08-19T00:24:26.853 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-19T00:24:26.853 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_deferred_items": 0, 2024-08-19T00:24:26.853 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_bytes": 0, 2024-08-19T00:24:26.853 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_items": 0, 2024-08-19T00:24:26.853 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_bytes": 0, 2024-08-19T00:24:26.853 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_items": 0, 2024-08-19T00:24:26.854 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_reader_bytes": 0, 2024-08-19T00:24:26.854 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_reader_items": 0, 2024-08-19T00:24:26.854 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_writer_bytes": 0, 2024-08-19T00:24:26.854 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_writer_items": 0, 2024-08-19T00:24:26.854 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_anon_bytes": 255506, 2024-08-19T00:24:26.854 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_anon_items": 105, 2024-08-19T00:24:26.854 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_meta_bytes": 0, 2024-08-19T00:24:26.854 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_meta_items": 0, 2024-08-19T00:24:26.855 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_bytes": 0, 2024-08-19T00:24:26.855 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_items": 0, 2024-08-19T00:24:26.855 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_mapbl_bytes": 0, 2024-08-19T00:24:26.855 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_mapbl_items": 0, 2024-08-19T00:24:26.855 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_pglog_bytes": 0, 2024-08-19T00:24:26.855 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_pglog_items": 0, 2024-08-19T00:24:26.855 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_bytes": 9712, 2024-08-19T00:24:26.855 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_items": 197, 2024-08-19T00:24:26.856 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_mapping_bytes": 0, 2024-08-19T00:24:26.856 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_mapping_items": 0, 2024-08-19T00:24:26.856 INFO:teuthology.orchestra.run.smithi171.stdout: "pgmap_bytes": 0, 2024-08-19T00:24:26.856 INFO:teuthology.orchestra.run.smithi171.stdout: "pgmap_items": 0, 2024-08-19T00:24:26.856 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_co_bytes": 141028, 2024-08-19T00:24:26.856 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_co_items": 743, 2024-08-19T00:24:26.856 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_1_bytes": 0, 2024-08-19T00:24:26.856 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_1_items": 0, 2024-08-19T00:24:26.856 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_2_bytes": 0, 2024-08-19T00:24:26.857 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_2_items": 0 2024-08-19T00:24:26.857 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:26.857 INFO:teuthology.orchestra.run.smithi171.stdout: "objecter": { 2024-08-19T00:24:26.857 INFO:teuthology.orchestra.run.smithi171.stdout: "op_active": 0, 2024-08-19T00:24:26.857 INFO:teuthology.orchestra.run.smithi171.stdout: "op_laggy": 0, 2024-08-19T00:24:26.857 INFO:teuthology.orchestra.run.smithi171.stdout: "op_send": 46, 2024-08-19T00:24:26.857 INFO:teuthology.orchestra.run.smithi171.stdout: "op_send_bytes": 13271, 2024-08-19T00:24:26.857 INFO:teuthology.orchestra.run.smithi171.stdout: "op_resend": 30, 2024-08-19T00:24:26.858 INFO:teuthology.orchestra.run.smithi171.stdout: "op_reply": 46, 2024-08-19T00:24:26.858 INFO:teuthology.orchestra.run.smithi171.stdout: "op_latency": { 2024-08-19T00:24:26.858 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 46, 2024-08-19T00:24:26.858 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.203996161, 2024-08-19T00:24:26.858 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.004434699 2024-08-19T00:24:26.858 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:26.858 INFO:teuthology.orchestra.run.smithi171.stdout: "op_inflight": 0, 2024-08-19T00:24:26.858 INFO:teuthology.orchestra.run.smithi171.stdout: "oplen_avg": { 2024-08-19T00:24:26.859 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 46, 2024-08-19T00:24:26.859 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 68 2024-08-19T00:24:26.859 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:26.859 INFO:teuthology.orchestra.run.smithi171.stdout: "op": 46, 2024-08-19T00:24:26.859 INFO:teuthology.orchestra.run.smithi171.stdout: "op_r": 0, 2024-08-19T00:24:26.859 INFO:teuthology.orchestra.run.smithi171.stdout: "op_w": 46, 2024-08-19T00:24:26.859 INFO:teuthology.orchestra.run.smithi171.stdout: "op_rmw": 0, 2024-08-19T00:24:26.859 INFO:teuthology.orchestra.run.smithi171.stdout: "op_pg": 0, 2024-08-19T00:24:26.860 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_stat": 0, 2024-08-19T00:24:26.860 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_create": 10, 2024-08-19T00:24:26.860 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_read": 0, 2024-08-19T00:24:26.860 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_write": 9, 2024-08-19T00:24:26.860 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_writefull": 8, 2024-08-19T00:24:26.860 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_writesame": 0, 2024-08-19T00:24:26.860 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_append": 0, 2024-08-19T00:24:26.860 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_zero": 0, 2024-08-19T00:24:26.861 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_truncate": 0, 2024-08-19T00:24:26.861 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_delete": 6, 2024-08-19T00:24:26.861 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_mapext": 0, 2024-08-19T00:24:26.861 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_sparse_read": 0, 2024-08-19T00:24:26.861 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_clonerange": 0, 2024-08-19T00:24:26.861 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_getxattr": 0, 2024-08-19T00:24:26.861 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_setxattr": 20, 2024-08-19T00:24:26.861 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_cmpxattr": 0, 2024-08-19T00:24:26.862 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_rmxattr": 0, 2024-08-19T00:24:26.862 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_resetxattrs": 0, 2024-08-19T00:24:26.862 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_call": 0, 2024-08-19T00:24:26.862 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_watch": 0, 2024-08-19T00:24:26.862 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_notify": 0, 2024-08-19T00:24:26.862 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_src_cmpxattr": 0, 2024-08-19T00:24:26.862 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_pgls": 0, 2024-08-19T00:24:26.862 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_pgls_filter": 0, 2024-08-19T00:24:26.862 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_other": 0, 2024-08-19T00:24:26.863 INFO:teuthology.orchestra.run.smithi171.stdout: "linger_active": 0, 2024-08-19T00:24:26.863 INFO:teuthology.orchestra.run.smithi171.stdout: "linger_send": 0, 2024-08-19T00:24:26.863 INFO:teuthology.orchestra.run.smithi171.stdout: "linger_resend": 0, 2024-08-19T00:24:26.863 INFO:teuthology.orchestra.run.smithi171.stdout: "linger_ping": 0, 2024-08-19T00:24:26.863 INFO:teuthology.orchestra.run.smithi171.stdout: "poolop_active": 0, 2024-08-19T00:24:26.863 INFO:teuthology.orchestra.run.smithi171.stdout: "poolop_send": 0, 2024-08-19T00:24:26.863 INFO:teuthology.orchestra.run.smithi171.stdout: "poolop_resend": 0, 2024-08-19T00:24:26.863 INFO:teuthology.orchestra.run.smithi171.stdout: "poolstat_active": 0, 2024-08-19T00:24:26.864 INFO:teuthology.orchestra.run.smithi171.stdout: "poolstat_send": 0, 2024-08-19T00:24:26.864 INFO:teuthology.orchestra.run.smithi171.stdout: "poolstat_resend": 0, 2024-08-19T00:24:26.864 INFO:teuthology.orchestra.run.smithi171.stdout: "statfs_active": 0, 2024-08-19T00:24:26.864 INFO:teuthology.orchestra.run.smithi171.stdout: "statfs_send": 0, 2024-08-19T00:24:26.864 INFO:teuthology.orchestra.run.smithi171.stdout: "statfs_resend": 0, 2024-08-19T00:24:26.864 INFO:teuthology.orchestra.run.smithi171.stdout: "command_active": 0, 2024-08-19T00:24:26.864 INFO:teuthology.orchestra.run.smithi171.stdout: "command_send": 0, 2024-08-19T00:24:26.864 INFO:teuthology.orchestra.run.smithi171.stdout: "command_resend": 0, 2024-08-19T00:24:26.865 INFO:teuthology.orchestra.run.smithi171.stdout: "map_epoch": 105, 2024-08-19T00:24:26.865 INFO:teuthology.orchestra.run.smithi171.stdout: "map_full": 0, 2024-08-19T00:24:26.865 INFO:teuthology.orchestra.run.smithi171.stdout: "map_inc": 15, 2024-08-19T00:24:26.865 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_sessions": 9, 2024-08-19T00:24:26.865 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_session_open": 9, 2024-08-19T00:24:26.865 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_session_close": 0, 2024-08-19T00:24:26.865 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_laggy": 0, 2024-08-19T00:24:26.865 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_wr": 14, 2024-08-19T00:24:26.865 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_rd": 0, 2024-08-19T00:24:26.866 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_del": 1 2024-08-19T00:24:26.866 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:26.866 INFO:teuthology.orchestra.run.smithi171.stdout: "oft": { 2024-08-19T00:24:26.866 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_total_objs": 1, 2024-08-19T00:24:26.866 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_total_kv_pairs": 0, 2024-08-19T00:24:26.866 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_total_updates": 0, 2024-08-19T00:24:26.866 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_total_removes": 0 2024-08-19T00:24:26.866 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:26.867 INFO:teuthology.orchestra.run.smithi171.stdout: "osd-slow-ops": { 2024-08-19T00:24:26.867 INFO:teuthology.orchestra.run.smithi171.stdout: "slow_ops_count": 114 2024-08-19T00:24:26.867 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:26.867 INFO:teuthology.orchestra.run.smithi171.stdout: "purge_queue": { 2024-08-19T00:24:26.867 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executing_ops": 0, 2024-08-19T00:24:26.867 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executing_ops_high_water": 0, 2024-08-19T00:24:26.867 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executing": 0, 2024-08-19T00:24:26.867 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executing_high_water": 0, 2024-08-19T00:24:26.868 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executed_ops": 0, 2024-08-19T00:24:26.868 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executed": 0, 2024-08-19T00:24:26.868 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_item_in_journal": 0 2024-08-19T00:24:26.868 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:26.868 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-19T00:24:26.868 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-08-19T00:24:26.868 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 104857600, 2024-08-19T00:24:26.868 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-08-19T00:24:26.869 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 131976, 2024-08-19T00:24:26.869 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 53158055, 2024-08-19T00:24:26.869 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-08-19T00:24:26.869 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 131976, 2024-08-19T00:24:26.869 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 0, 2024-08-19T00:24:26.869 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 0, 2024-08-19T00:24:26.869 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 131976, 2024-08-19T00:24:26.869 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 53158055, 2024-08-19T00:24:26.870 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-08-19T00:24:26.870 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:26.870 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:26.870 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:26.870 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-08-19T00:24:26.870 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:26.870 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-objecter_bytes": { 2024-08-19T00:24:26.870 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-08-19T00:24:26.871 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 104857600, 2024-08-19T00:24:26.871 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-08-19T00:24:26.871 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 0, 2024-08-19T00:24:26.871 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 0, 2024-08-19T00:24:26.871 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-08-19T00:24:26.871 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 0, 2024-08-19T00:24:26.871 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 46, 2024-08-19T00:24:26.871 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 13271, 2024-08-19T00:24:26.872 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 46, 2024-08-19T00:24:26.872 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 13271, 2024-08-19T00:24:26.872 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-08-19T00:24:26.872 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:26.872 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:26.872 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:26.872 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-08-19T00:24:26.872 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:26.872 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-objecter_ops": { 2024-08-19T00:24:26.873 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-08-19T00:24:26.873 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 1024, 2024-08-19T00:24:26.873 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-08-19T00:24:26.873 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 0, 2024-08-19T00:24:26.873 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 0, 2024-08-19T00:24:26.873 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-08-19T00:24:26.873 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 0, 2024-08-19T00:24:26.873 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 46, 2024-08-19T00:24:26.874 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 46, 2024-08-19T00:24:26.874 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 46, 2024-08-19T00:24:26.874 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 46, 2024-08-19T00:24:26.874 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-08-19T00:24:26.874 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:26.874 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:26.874 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:26.874 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-08-19T00:24:26.875 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:26.875 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-write_buf_throttle": { 2024-08-19T00:24:26.875 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-08-19T00:24:26.875 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 3758096384, 2024-08-19T00:24:26.875 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-08-19T00:24:26.875 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 0, 2024-08-19T00:24:26.875 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 0, 2024-08-19T00:24:26.875 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-08-19T00:24:26.875 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 0, 2024-08-19T00:24:26.876 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 0, 2024-08-19T00:24:26.876 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 0, 2024-08-19T00:24:26.876 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 0, 2024-08-19T00:24:26.876 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 0, 2024-08-19T00:24:26.876 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-08-19T00:24:26.876 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:26.876 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:26.878 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:26.878 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-08-19T00:24:26.878 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:26.878 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-write_buf_throttle-0x555c3833e960": { 2024-08-19T00:24:26.878 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-08-19T00:24:26.879 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 3758096384, 2024-08-19T00:24:26.879 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-08-19T00:24:26.879 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 10, 2024-08-19T00:24:26.879 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 2879, 2024-08-19T00:24:26.879 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-08-19T00:24:26.879 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 10, 2024-08-19T00:24:26.879 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 0, 2024-08-19T00:24:26.879 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 0, 2024-08-19T00:24:26.880 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 9, 2024-08-19T00:24:26.880 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 2879, 2024-08-19T00:24:26.880 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-08-19T00:24:26.880 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:26.880 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:26.880 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:26.880 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-08-19T00:24:26.880 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-08-19T00:24:26.881 INFO:teuthology.orchestra.run.smithi171.stdout:} 2024-08-19T00:24:27.628 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-08-19T00:24:27.629 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-08-19T00:24:27.629 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=0 2024-08-19T00:24:27.629 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-08-19T00:24:27.629 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-08-19T00:24:27.629 DEBUG:tasks.check_counter:Getting stats from f 2024-08-19T00:24:27.629 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph daemon mds.f perf dump 2024-08-19T00:24:27.898 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.c/config 2024-08-19T00:24:28.188 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:28 smithi171 ceph-mon[21810]: pgmap v347: 129 pgs: 129 active+clean; 540 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 10 op/s 2024-08-19T00:24:28.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:28 smithi116 ceph-mon[21873]: pgmap v347: 129 pgs: 129 active+clean; 540 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 10 op/s 2024-08-19T00:24:28.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:28 smithi044 ceph-mon[18489]: pgmap v347: 129 pgs: 129 active+clean; 540 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 10 op/s 2024-08-19T00:24:28.424 INFO:teuthology.orchestra.run.smithi171.stdout:{ 2024-08-19T00:24:28.425 INFO:teuthology.orchestra.run.smithi171.stdout: "AsyncMessenger::Worker-0": { 2024-08-19T00:24:28.425 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_messages": 1687, 2024-08-19T00:24:28.425 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages": 1689, 2024-08-19T00:24:28.425 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_bytes": 4259497, 2024-08-19T00:24:28.425 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_bytes": 536476, 2024-08-19T00:24:28.426 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_created_connections": 6, 2024-08-19T00:24:28.426 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_active_connections": 2, 2024-08-19T00:24:28.426 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_total_time": 0.135113322, 2024-08-19T00:24:28.426 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_send_time": 0.041628277, 2024-08-19T00:24:28.426 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_recv_time": 0.038856939, 2024-08-19T00:24:28.426 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_fast_dispatch_time": 0.041976973, 2024-08-19T00:24:28.426 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages_queue_lat": { 2024-08-19T00:24:28.427 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 1687, 2024-08-19T00:24:28.427 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.054015239, 2024-08-19T00:24:28.427 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000032018 2024-08-19T00:24:28.427 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:28.427 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_handle_ack_lat": { 2024-08-19T00:24:28.427 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:28.427 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:28.427 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:28.428 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:28.428 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-19T00:24:28.428 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_encrypted_bytes": 0 2024-08-19T00:24:28.428 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:28.428 INFO:teuthology.orchestra.run.smithi171.stdout: "AsyncMessenger::Worker-1": { 2024-08-19T00:24:28.428 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_messages": 6, 2024-08-19T00:24:28.428 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages": 177, 2024-08-19T00:24:28.428 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_bytes": 1976, 2024-08-19T00:24:28.429 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_bytes": 454218, 2024-08-19T00:24:28.429 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_created_connections": 7, 2024-08-19T00:24:28.429 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_active_connections": 5, 2024-08-19T00:24:28.429 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_total_time": 0.011292766, 2024-08-19T00:24:28.429 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_send_time": 0.006493515, 2024-08-19T00:24:28.429 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_recv_time": 0.002895397, 2024-08-19T00:24:28.429 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_fast_dispatch_time": 0.000101903, 2024-08-19T00:24:28.429 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages_queue_lat": { 2024-08-19T00:24:28.430 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 174, 2024-08-19T00:24:28.430 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.019638870, 2024-08-19T00:24:28.430 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000112867 2024-08-19T00:24:28.430 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:28.430 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_handle_ack_lat": { 2024-08-19T00:24:28.430 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:28.430 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:28.430 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:28.431 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:28.431 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_encrypted_bytes": 320, 2024-08-19T00:24:28.431 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_encrypted_bytes": 452880 2024-08-19T00:24:28.431 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:28.431 INFO:teuthology.orchestra.run.smithi171.stdout: "AsyncMessenger::Worker-2": { 2024-08-19T00:24:28.431 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_messages": 1040, 2024-08-19T00:24:28.431 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages": 1021, 2024-08-19T00:24:28.431 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_bytes": 1846879, 2024-08-19T00:24:28.432 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_bytes": 388521, 2024-08-19T00:24:28.432 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_created_connections": 3, 2024-08-19T00:24:28.432 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_active_connections": 2, 2024-08-19T00:24:28.432 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_total_time": 0.106589504, 2024-08-19T00:24:28.432 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_send_time": 0.036945482, 2024-08-19T00:24:28.432 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_recv_time": 0.057128219, 2024-08-19T00:24:28.432 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_fast_dispatch_time": 0.022022340, 2024-08-19T00:24:28.433 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages_queue_lat": { 2024-08-19T00:24:28.433 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 1021, 2024-08-19T00:24:28.433 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.042933676, 2024-08-19T00:24:28.433 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000042050 2024-08-19T00:24:28.433 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:28.433 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_handle_ack_lat": { 2024-08-19T00:24:28.433 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:28.433 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:28.434 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:28.434 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:28.434 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_encrypted_bytes": 1656896, 2024-08-19T00:24:28.434 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_encrypted_bytes": 143024 2024-08-19T00:24:28.434 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:28.434 INFO:teuthology.orchestra.run.smithi171.stdout: "cct": { 2024-08-19T00:24:28.434 INFO:teuthology.orchestra.run.smithi171.stdout: "total_workers": 1, 2024-08-19T00:24:28.434 INFO:teuthology.orchestra.run.smithi171.stdout: "unhealthy_workers": 0 2024-08-19T00:24:28.435 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:28.435 INFO:teuthology.orchestra.run.smithi171.stdout: "finisher-MDSRank": { 2024-08-19T00:24:28.435 INFO:teuthology.orchestra.run.smithi171.stdout: "queue_len": 0, 2024-08-19T00:24:28.435 INFO:teuthology.orchestra.run.smithi171.stdout: "complete_latency": { 2024-08-19T00:24:28.435 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 4052, 2024-08-19T00:24:28.435 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.102950035, 2024-08-19T00:24:28.435 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000025407 2024-08-19T00:24:28.435 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-08-19T00:24:28.436 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:28.436 INFO:teuthology.orchestra.run.smithi171.stdout: "finisher-PurgeQueue": { 2024-08-19T00:24:28.436 INFO:teuthology.orchestra.run.smithi171.stdout: "queue_len": 0, 2024-08-19T00:24:28.436 INFO:teuthology.orchestra.run.smithi171.stdout: "complete_latency": { 2024-08-19T00:24:28.436 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:28.436 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:28.436 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:28.436 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-08-19T00:24:28.437 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:28.437 INFO:teuthology.orchestra.run.smithi171.stdout: "mds": { 2024-08-19T00:24:28.437 INFO:teuthology.orchestra.run.smithi171.stdout: "request": 0, 2024-08-19T00:24:28.437 INFO:teuthology.orchestra.run.smithi171.stdout: "reply": 0, 2024-08-19T00:24:28.437 INFO:teuthology.orchestra.run.smithi171.stdout: "reply_latency": { 2024-08-19T00:24:28.437 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:28.437 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:28.437 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:28.438 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:28.438 INFO:teuthology.orchestra.run.smithi171.stdout: "slow_reply": 0, 2024-08-19T00:24:28.438 INFO:teuthology.orchestra.run.smithi171.stdout: "forward": 0, 2024-08-19T00:24:28.438 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_fetch_complete": 0, 2024-08-19T00:24:28.438 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_fetch_keys": 0, 2024-08-19T00:24:28.438 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_commit": 0, 2024-08-19T00:24:28.438 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_split": 0, 2024-08-19T00:24:28.438 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_merge": 0, 2024-08-19T00:24:28.439 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes": 140, 2024-08-19T00:24:28.439 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_top": 4, 2024-08-19T00:24:28.439 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_bottom": 136, 2024-08-19T00:24:28.439 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_pin_tail": 0, 2024-08-19T00:24:28.439 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_pinned": 8, 2024-08-19T00:24:28.439 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_expired": 0, 2024-08-19T00:24:28.439 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_with_caps": 0, 2024-08-19T00:24:28.440 INFO:teuthology.orchestra.run.smithi171.stdout: "caps": 0, 2024-08-19T00:24:28.440 INFO:teuthology.orchestra.run.smithi171.stdout: "subtrees": 3, 2024-08-19T00:24:28.440 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse": 0, 2024-08-19T00:24:28.440 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_hit": 0, 2024-08-19T00:24:28.440 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_forward": 0, 2024-08-19T00:24:28.440 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_discover": 0, 2024-08-19T00:24:28.440 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_dir_fetch": 0, 2024-08-19T00:24:28.441 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_remote_ino": 0, 2024-08-19T00:24:28.441 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_lock": 0, 2024-08-19T00:24:28.441 INFO:teuthology.orchestra.run.smithi171.stdout: "load_cent": 0, 2024-08-19T00:24:28.441 INFO:teuthology.orchestra.run.smithi171.stdout: "q": 0, 2024-08-19T00:24:28.441 INFO:teuthology.orchestra.run.smithi171.stdout: "exported": 0, 2024-08-19T00:24:28.441 INFO:teuthology.orchestra.run.smithi171.stdout: "exported_inodes": 0, 2024-08-19T00:24:28.441 INFO:teuthology.orchestra.run.smithi171.stdout: "imported": 0, 2024-08-19T00:24:28.441 INFO:teuthology.orchestra.run.smithi171.stdout: "imported_inodes": 0, 2024-08-19T00:24:28.442 INFO:teuthology.orchestra.run.smithi171.stdout: "openino_dir_fetch": 0, 2024-08-19T00:24:28.442 INFO:teuthology.orchestra.run.smithi171.stdout: "openino_backtrace_fetch": 0, 2024-08-19T00:24:28.442 INFO:teuthology.orchestra.run.smithi171.stdout: "openino_peer_discover": 0, 2024-08-19T00:24:28.442 INFO:teuthology.orchestra.run.smithi171.stdout: "root_rfiles": 67, 2024-08-19T00:24:28.442 INFO:teuthology.orchestra.run.smithi171.stdout: "root_rbytes": 21137952, 2024-08-19T00:24:28.442 INFO:teuthology.orchestra.run.smithi171.stdout: "root_rsnaps": 6, 2024-08-19T00:24:28.442 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_backtrace_fetch": 0, 2024-08-19T00:24:28.442 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_set_tag": 0, 2024-08-19T00:24:28.443 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_backtrace_repaired": 0, 2024-08-19T00:24:28.443 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_inotable_repaired": 0, 2024-08-19T00:24:28.443 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_dir_inodes": 0, 2024-08-19T00:24:28.443 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_dir_base_inodes": 0, 2024-08-19T00:24:28.443 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_dirfrag_rstats": 0, 2024-08-19T00:24:28.443 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_file_inodes": 0, 2024-08-19T00:24:28.443 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_inode_file_caps": 0, 2024-08-19T00:24:28.443 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_revoke": 0, 2024-08-19T00:24:28.444 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_grant": 0, 2024-08-19T00:24:28.444 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_trunc": 0, 2024-08-19T00:24:28.444 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-19T00:24:28.444 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-19T00:24:28.444 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_caps": 0, 2024-08-19T00:24:28.444 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_caps_dirty": 0, 2024-08-19T00:24:28.444 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_cap_release": 0, 2024-08-19T00:24:28.444 INFO:teuthology.orchestra.run.smithi171.stdout: "process_request_cap_release": 0 2024-08-19T00:24:28.445 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:28.445 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_cache": { 2024-08-19T00:24:28.445 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_update": 0, 2024-08-19T00:24:28.445 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_update_receipt": 0, 2024-08-19T00:24:28.445 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_try_discover": 0, 2024-08-19T00:24:28.445 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_send_discover": 0, 2024-08-19T00:24:28.445 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_handle_discover": 0, 2024-08-19T00:24:28.445 INFO:teuthology.orchestra.run.smithi171.stdout: "num_strays": 0, 2024-08-19T00:24:28.446 INFO:teuthology.orchestra.run.smithi171.stdout: "num_strays_delayed": 0, 2024-08-19T00:24:28.446 INFO:teuthology.orchestra.run.smithi171.stdout: "num_strays_enqueuing": 0, 2024-08-19T00:24:28.446 INFO:teuthology.orchestra.run.smithi171.stdout: "strays_created": 0, 2024-08-19T00:24:28.446 INFO:teuthology.orchestra.run.smithi171.stdout: "strays_enqueued": 0, 2024-08-19T00:24:28.446 INFO:teuthology.orchestra.run.smithi171.stdout: "strays_reintegrated": 0, 2024-08-19T00:24:28.446 INFO:teuthology.orchestra.run.smithi171.stdout: "strays_migrated": 0, 2024-08-19T00:24:28.446 INFO:teuthology.orchestra.run.smithi171.stdout: "num_recovering_processing": 0, 2024-08-19T00:24:28.446 INFO:teuthology.orchestra.run.smithi171.stdout: "num_recovering_enqueued": 0, 2024-08-19T00:24:28.447 INFO:teuthology.orchestra.run.smithi171.stdout: "num_recovering_prioritized": 0, 2024-08-19T00:24:28.447 INFO:teuthology.orchestra.run.smithi171.stdout: "recovery_started": 0, 2024-08-19T00:24:28.447 INFO:teuthology.orchestra.run.smithi171.stdout: "recovery_completed": 0, 2024-08-19T00:24:28.447 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_quiesce_path": 0, 2024-08-19T00:24:28.447 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_quiesce_inode": 0, 2024-08-19T00:24:28.447 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_enqueue_scrub": 0, 2024-08-19T00:24:28.447 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_exportdir": 0, 2024-08-19T00:24:28.447 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_flush": 0, 2024-08-19T00:24:28.448 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_fragmentdir": 0, 2024-08-19T00:24:28.448 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_fragstats": 0, 2024-08-19T00:24:28.448 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_inodestats": 0 2024-08-19T00:24:28.448 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:28.448 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_log": { 2024-08-19T00:24:28.448 INFO:teuthology.orchestra.run.smithi171.stdout: "evlrg": 0, 2024-08-19T00:24:28.448 INFO:teuthology.orchestra.run.smithi171.stdout: "evadd": 0, 2024-08-19T00:24:28.448 INFO:teuthology.orchestra.run.smithi171.stdout: "evex": 0, 2024-08-19T00:24:28.449 INFO:teuthology.orchestra.run.smithi171.stdout: "evtrm": 0, 2024-08-19T00:24:28.449 INFO:teuthology.orchestra.run.smithi171.stdout: "ev": 802, 2024-08-19T00:24:28.449 INFO:teuthology.orchestra.run.smithi171.stdout: "evexg": 0, 2024-08-19T00:24:28.449 INFO:teuthology.orchestra.run.smithi171.stdout: "evexd": 0, 2024-08-19T00:24:28.449 INFO:teuthology.orchestra.run.smithi171.stdout: "segadd": 0, 2024-08-19T00:24:28.449 INFO:teuthology.orchestra.run.smithi171.stdout: "segex": 0, 2024-08-19T00:24:28.449 INFO:teuthology.orchestra.run.smithi171.stdout: "segtrm": 0, 2024-08-19T00:24:28.449 INFO:teuthology.orchestra.run.smithi171.stdout: "seg": 2, 2024-08-19T00:24:28.450 INFO:teuthology.orchestra.run.smithi171.stdout: "segmjr": 50, 2024-08-19T00:24:28.450 INFO:teuthology.orchestra.run.smithi171.stdout: "segexg": 0, 2024-08-19T00:24:28.450 INFO:teuthology.orchestra.run.smithi171.stdout: "segexd": 0, 2024-08-19T00:24:28.450 INFO:teuthology.orchestra.run.smithi171.stdout: "expos": 7832756, 2024-08-19T00:24:28.450 INFO:teuthology.orchestra.run.smithi171.stdout: "wrpos": 7956452, 2024-08-19T00:24:28.450 INFO:teuthology.orchestra.run.smithi171.stdout: "rdpos": 7926248, 2024-08-19T00:24:28.450 INFO:teuthology.orchestra.run.smithi171.stdout: "jlat": { 2024-08-19T00:24:28.450 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:28.451 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:28.451 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:28.451 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:28.451 INFO:teuthology.orchestra.run.smithi171.stdout: "replayed": 802 2024-08-19T00:24:28.451 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:28.451 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_mem": { 2024-08-19T00:24:28.451 INFO:teuthology.orchestra.run.smithi171.stdout: "ino": 16, 2024-08-19T00:24:28.451 INFO:teuthology.orchestra.run.smithi171.stdout: "ino+": 209, 2024-08-19T00:24:28.452 INFO:teuthology.orchestra.run.smithi171.stdout: "ino-": 193, 2024-08-19T00:24:28.452 INFO:teuthology.orchestra.run.smithi171.stdout: "dir": 11, 2024-08-19T00:24:28.452 INFO:teuthology.orchestra.run.smithi171.stdout: "dir+": 23, 2024-08-19T00:24:28.452 INFO:teuthology.orchestra.run.smithi171.stdout: "dir-": 12, 2024-08-19T00:24:28.452 INFO:teuthology.orchestra.run.smithi171.stdout: "dn": 140, 2024-08-19T00:24:28.452 INFO:teuthology.orchestra.run.smithi171.stdout: "dn+": 288, 2024-08-19T00:24:28.452 INFO:teuthology.orchestra.run.smithi171.stdout: "dn-": 148, 2024-08-19T00:24:28.452 INFO:teuthology.orchestra.run.smithi171.stdout: "cap": 0, 2024-08-19T00:24:28.453 INFO:teuthology.orchestra.run.smithi171.stdout: "cap+": 0, 2024-08-19T00:24:28.453 INFO:teuthology.orchestra.run.smithi171.stdout: "cap-": 0, 2024-08-19T00:24:28.453 INFO:teuthology.orchestra.run.smithi171.stdout: "rss": 52188, 2024-08-19T00:24:28.453 INFO:teuthology.orchestra.run.smithi171.stdout: "heap": 215328 2024-08-19T00:24:28.453 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:28.453 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_server": { 2024-08-19T00:24:28.453 INFO:teuthology.orchestra.run.smithi171.stdout: "dispatch_client_request": 0, 2024-08-19T00:24:28.454 INFO:teuthology.orchestra.run.smithi171.stdout: "dispatch_server_request": 0, 2024-08-19T00:24:28.454 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_request": 0, 2024-08-19T00:24:28.454 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_session": 0, 2024-08-19T00:24:28.454 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_peer_request": 0, 2024-08-19T00:24:28.454 INFO:teuthology.orchestra.run.smithi171.stdout: "req_create_latency": { 2024-08-19T00:24:28.454 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:28.454 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:28.454 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:28.455 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:28.455 INFO:teuthology.orchestra.run.smithi171.stdout: "req_getattr_latency": { 2024-08-19T00:24:28.455 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:28.455 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:28.455 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:28.455 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:28.455 INFO:teuthology.orchestra.run.smithi171.stdout: "req_getfilelock_latency": { 2024-08-19T00:24:28.455 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:28.456 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:28.456 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:28.456 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:28.456 INFO:teuthology.orchestra.run.smithi171.stdout: "req_link_latency": { 2024-08-19T00:24:28.456 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:28.456 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:28.456 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:28.457 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:28.457 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookup_latency": { 2024-08-19T00:24:28.457 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:28.457 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:28.457 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:28.457 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:28.457 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookuphash_latency": { 2024-08-19T00:24:28.457 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:28.458 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:28.458 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:28.458 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:28.458 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookupino_latency": { 2024-08-19T00:24:28.458 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:28.458 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:28.458 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:28.458 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:28.459 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookupname_latency": { 2024-08-19T00:24:28.459 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:28.459 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:28.459 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:28.459 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:28.459 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookupparent_latency": { 2024-08-19T00:24:28.459 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:28.459 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:28.460 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:28.460 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:28.460 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookupsnap_latency": { 2024-08-19T00:24:28.460 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:28.460 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:28.461 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:28.461 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:28.461 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lssnap_latency": { 2024-08-19T00:24:28.461 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:28.461 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:28.461 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:28.461 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:28.461 INFO:teuthology.orchestra.run.smithi171.stdout: "req_mkdir_latency": { 2024-08-19T00:24:28.462 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:28.462 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:28.463 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:28.463 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:28.463 INFO:teuthology.orchestra.run.smithi171.stdout: "req_mknod_latency": { 2024-08-19T00:24:28.463 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:28.463 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:28.463 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:28.463 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:28.463 INFO:teuthology.orchestra.run.smithi171.stdout: "req_mksnap_latency": { 2024-08-19T00:24:28.464 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:28.464 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:28.464 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:28.464 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:28.464 INFO:teuthology.orchestra.run.smithi171.stdout: "req_open_latency": { 2024-08-19T00:24:28.464 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:28.464 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:28.464 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:28.465 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:28.465 INFO:teuthology.orchestra.run.smithi171.stdout: "req_readdir_latency": { 2024-08-19T00:24:28.465 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:28.465 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:28.465 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:28.465 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:28.465 INFO:teuthology.orchestra.run.smithi171.stdout: "req_rename_latency": { 2024-08-19T00:24:28.466 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:28.466 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:28.466 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:28.466 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:28.466 INFO:teuthology.orchestra.run.smithi171.stdout: "req_renamesnap_latency": { 2024-08-19T00:24:28.466 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:28.466 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:28.467 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:28.467 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:28.467 INFO:teuthology.orchestra.run.smithi171.stdout: "req_snapdiff_latency": { 2024-08-19T00:24:28.467 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:28.467 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:28.467 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:28.467 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:28.467 INFO:teuthology.orchestra.run.smithi171.stdout: "req_rmdir_latency": { 2024-08-19T00:24:28.468 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:28.468 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:28.468 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:28.468 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:28.468 INFO:teuthology.orchestra.run.smithi171.stdout: "req_rmsnap_latency": { 2024-08-19T00:24:28.468 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:28.468 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:28.468 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:28.469 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:28.469 INFO:teuthology.orchestra.run.smithi171.stdout: "req_rmxattr_latency": { 2024-08-19T00:24:28.469 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:28.469 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:28.469 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:28.469 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:28.469 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setattr_latency": { 2024-08-19T00:24:28.469 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:28.470 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:28.470 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:28.470 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:28.470 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setdirlayout_latency": { 2024-08-19T00:24:28.470 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:28.470 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:28.470 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:28.470 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:28.471 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setfilelock_latency": { 2024-08-19T00:24:28.471 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:28.471 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:28.471 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:28.471 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:28.471 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setlayout_latency": { 2024-08-19T00:24:28.471 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:28.472 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:28.472 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:28.472 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:28.472 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setxattr_latency": { 2024-08-19T00:24:28.472 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:28.472 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:28.472 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:28.472 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:28.473 INFO:teuthology.orchestra.run.smithi171.stdout: "req_symlink_latency": { 2024-08-19T00:24:28.473 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:28.473 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:28.473 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:28.473 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:28.473 INFO:teuthology.orchestra.run.smithi171.stdout: "req_unlink_latency": { 2024-08-19T00:24:28.473 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:28.473 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:28.474 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:28.474 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:28.474 INFO:teuthology.orchestra.run.smithi171.stdout: "cap_revoke_eviction": 0, 2024-08-19T00:24:28.474 INFO:teuthology.orchestra.run.smithi171.stdout: "cap_acquisition_throttle": 0, 2024-08-19T00:24:28.474 INFO:teuthology.orchestra.run.smithi171.stdout: "req_getvxattr_latency": { 2024-08-19T00:24:28.474 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:28.474 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:28.475 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:28.475 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-08-19T00:24:28.475 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:28.475 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_sessions": { 2024-08-19T00:24:28.475 INFO:teuthology.orchestra.run.smithi171.stdout: "session_count": 2, 2024-08-19T00:24:28.475 INFO:teuthology.orchestra.run.smithi171.stdout: "session_add": 6, 2024-08-19T00:24:28.475 INFO:teuthology.orchestra.run.smithi171.stdout: "session_remove": 4, 2024-08-19T00:24:28.475 INFO:teuthology.orchestra.run.smithi171.stdout: "sessions_open": 4, 2024-08-19T00:24:28.476 INFO:teuthology.orchestra.run.smithi171.stdout: "sessions_stale": 0, 2024-08-19T00:24:28.476 INFO:teuthology.orchestra.run.smithi171.stdout: "total_load": 0, 2024-08-19T00:24:28.476 INFO:teuthology.orchestra.run.smithi171.stdout: "average_load": 0, 2024-08-19T00:24:28.476 INFO:teuthology.orchestra.run.smithi171.stdout: "avg_session_uptime": 2524, 2024-08-19T00:24:28.476 INFO:teuthology.orchestra.run.smithi171.stdout: "mdthresh_evicted": 0 2024-08-19T00:24:28.476 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:28.476 INFO:teuthology.orchestra.run.smithi171.stdout: "mempool": { 2024-08-19T00:24:28.476 INFO:teuthology.orchestra.run.smithi171.stdout: "bloom_filter_bytes": 0, 2024-08-19T00:24:28.477 INFO:teuthology.orchestra.run.smithi171.stdout: "bloom_filter_items": 0, 2024-08-19T00:24:28.477 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_alloc_bytes": 0, 2024-08-19T00:24:28.477 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_alloc_items": 0, 2024-08-19T00:24:28.477 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_data_bytes": 0, 2024-08-19T00:24:28.477 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_data_items": 0, 2024-08-19T00:24:28.477 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-19T00:24:28.477 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_onode_items": 0, 2024-08-19T00:24:28.478 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-19T00:24:28.478 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_meta_items": 0, 2024-08-19T00:24:28.478 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_other_bytes": 0, 2024-08-19T00:24:28.478 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_other_items": 0, 2024-08-19T00:24:28.478 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-19T00:24:28.478 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_buffer_items": 0, 2024-08-19T00:24:28.478 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_extent_bytes": 0, 2024-08-19T00:24:28.478 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_extent_items": 0, 2024-08-19T00:24:28.479 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_blob_bytes": 0, 2024-08-19T00:24:28.479 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_blob_items": 0, 2024-08-19T00:24:28.479 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-19T00:24:28.479 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_shared_blob_items": 0, 2024-08-19T00:24:28.479 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-19T00:24:28.479 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_inline_bl_items": 0, 2024-08-19T00:24:28.479 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_fsck_bytes": 0, 2024-08-19T00:24:28.479 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_fsck_items": 0, 2024-08-19T00:24:28.480 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_txc_bytes": 0, 2024-08-19T00:24:28.480 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_txc_items": 0, 2024-08-19T00:24:28.480 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-19T00:24:28.480 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_deferred_items": 0, 2024-08-19T00:24:28.480 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_bytes": 0, 2024-08-19T00:24:28.480 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_items": 0, 2024-08-19T00:24:28.480 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_bytes": 0, 2024-08-19T00:24:28.480 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_items": 0, 2024-08-19T00:24:28.481 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_reader_bytes": 0, 2024-08-19T00:24:28.481 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_reader_items": 0, 2024-08-19T00:24:28.481 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_writer_bytes": 0, 2024-08-19T00:24:28.481 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_writer_items": 0, 2024-08-19T00:24:28.481 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_anon_bytes": 189975, 2024-08-19T00:24:28.481 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_anon_items": 66, 2024-08-19T00:24:28.481 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_meta_bytes": 0, 2024-08-19T00:24:28.482 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_meta_items": 0, 2024-08-19T00:24:28.482 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_bytes": 0, 2024-08-19T00:24:28.482 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_items": 0, 2024-08-19T00:24:28.482 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_mapbl_bytes": 0, 2024-08-19T00:24:28.482 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_mapbl_items": 0, 2024-08-19T00:24:28.482 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_pglog_bytes": 0, 2024-08-19T00:24:28.482 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_pglog_items": 0, 2024-08-19T00:24:28.482 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_bytes": 9712, 2024-08-19T00:24:28.483 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_items": 197, 2024-08-19T00:24:28.483 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_mapping_bytes": 0, 2024-08-19T00:24:28.483 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_mapping_items": 0, 2024-08-19T00:24:28.483 INFO:teuthology.orchestra.run.smithi171.stdout: "pgmap_bytes": 0, 2024-08-19T00:24:28.483 INFO:teuthology.orchestra.run.smithi171.stdout: "pgmap_items": 0, 2024-08-19T00:24:28.483 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_co_bytes": 187794, 2024-08-19T00:24:28.483 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_co_items": 1121, 2024-08-19T00:24:28.483 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_1_bytes": 0, 2024-08-19T00:24:28.484 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_1_items": 0, 2024-08-19T00:24:28.484 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_2_bytes": 0, 2024-08-19T00:24:28.484 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_2_items": 0 2024-08-19T00:24:28.484 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:28.484 INFO:teuthology.orchestra.run.smithi171.stdout: "objecter": { 2024-08-19T00:24:28.484 INFO:teuthology.orchestra.run.smithi171.stdout: "op_active": 0, 2024-08-19T00:24:28.484 INFO:teuthology.orchestra.run.smithi171.stdout: "op_laggy": 0, 2024-08-19T00:24:28.484 INFO:teuthology.orchestra.run.smithi171.stdout: "op_send": 2463, 2024-08-19T00:24:28.485 INFO:teuthology.orchestra.run.smithi171.stdout: "op_send_bytes": 26, 2024-08-19T00:24:28.485 INFO:teuthology.orchestra.run.smithi171.stdout: "op_resend": 4, 2024-08-19T00:24:28.485 INFO:teuthology.orchestra.run.smithi171.stdout: "op_reply": 2463, 2024-08-19T00:24:28.485 INFO:teuthology.orchestra.run.smithi171.stdout: "op_latency": { 2024-08-19T00:24:28.485 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 2463, 2024-08-19T00:24:28.485 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 1.075979776, 2024-08-19T00:24:28.485 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000436857 2024-08-19T00:24:28.486 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:28.486 INFO:teuthology.orchestra.run.smithi171.stdout: "op_inflight": 0, 2024-08-19T00:24:28.486 INFO:teuthology.orchestra.run.smithi171.stdout: "oplen_avg": { 2024-08-19T00:24:28.486 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 2463, 2024-08-19T00:24:28.486 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 2464 2024-08-19T00:24:28.486 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:28.486 INFO:teuthology.orchestra.run.smithi171.stdout: "op": 2463, 2024-08-19T00:24:28.486 INFO:teuthology.orchestra.run.smithi171.stdout: "op_r": 2463, 2024-08-19T00:24:28.487 INFO:teuthology.orchestra.run.smithi171.stdout: "op_w": 0, 2024-08-19T00:24:28.487 INFO:teuthology.orchestra.run.smithi171.stdout: "op_rmw": 0, 2024-08-19T00:24:28.487 INFO:teuthology.orchestra.run.smithi171.stdout: "op_pg": 0, 2024-08-19T00:24:28.487 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_stat": 1542, 2024-08-19T00:24:28.487 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_create": 0, 2024-08-19T00:24:28.487 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_read": 918, 2024-08-19T00:24:28.487 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_write": 0, 2024-08-19T00:24:28.487 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_writefull": 0, 2024-08-19T00:24:28.488 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_writesame": 0, 2024-08-19T00:24:28.488 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_append": 0, 2024-08-19T00:24:28.488 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_zero": 0, 2024-08-19T00:24:28.488 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_truncate": 0, 2024-08-19T00:24:28.488 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_delete": 0, 2024-08-19T00:24:28.488 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_mapext": 0, 2024-08-19T00:24:28.488 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_sparse_read": 0, 2024-08-19T00:24:28.488 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_clonerange": 0, 2024-08-19T00:24:28.489 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_getxattr": 2, 2024-08-19T00:24:28.489 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_setxattr": 0, 2024-08-19T00:24:28.489 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_cmpxattr": 0, 2024-08-19T00:24:28.489 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_rmxattr": 0, 2024-08-19T00:24:28.489 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_resetxattrs": 0, 2024-08-19T00:24:28.489 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_call": 0, 2024-08-19T00:24:28.489 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_watch": 0, 2024-08-19T00:24:28.489 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_notify": 0, 2024-08-19T00:24:28.490 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_src_cmpxattr": 0, 2024-08-19T00:24:28.490 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_pgls": 0, 2024-08-19T00:24:28.490 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_pgls_filter": 0, 2024-08-19T00:24:28.490 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_other": 0, 2024-08-19T00:24:28.490 INFO:teuthology.orchestra.run.smithi171.stdout: "linger_active": 0, 2024-08-19T00:24:28.490 INFO:teuthology.orchestra.run.smithi171.stdout: "linger_send": 0, 2024-08-19T00:24:28.490 INFO:teuthology.orchestra.run.smithi171.stdout: "linger_resend": 0, 2024-08-19T00:24:28.490 INFO:teuthology.orchestra.run.smithi171.stdout: "linger_ping": 0, 2024-08-19T00:24:28.491 INFO:teuthology.orchestra.run.smithi171.stdout: "poolop_active": 0, 2024-08-19T00:24:28.491 INFO:teuthology.orchestra.run.smithi171.stdout: "poolop_send": 0, 2024-08-19T00:24:28.491 INFO:teuthology.orchestra.run.smithi171.stdout: "poolop_resend": 0, 2024-08-19T00:24:28.491 INFO:teuthology.orchestra.run.smithi171.stdout: "poolstat_active": 0, 2024-08-19T00:24:28.491 INFO:teuthology.orchestra.run.smithi171.stdout: "poolstat_send": 0, 2024-08-19T00:24:28.491 INFO:teuthology.orchestra.run.smithi171.stdout: "poolstat_resend": 0, 2024-08-19T00:24:28.491 INFO:teuthology.orchestra.run.smithi171.stdout: "statfs_active": 0, 2024-08-19T00:24:28.491 INFO:teuthology.orchestra.run.smithi171.stdout: "statfs_send": 0, 2024-08-19T00:24:28.492 INFO:teuthology.orchestra.run.smithi171.stdout: "statfs_resend": 0, 2024-08-19T00:24:28.492 INFO:teuthology.orchestra.run.smithi171.stdout: "command_active": 0, 2024-08-19T00:24:28.492 INFO:teuthology.orchestra.run.smithi171.stdout: "command_send": 0, 2024-08-19T00:24:28.492 INFO:teuthology.orchestra.run.smithi171.stdout: "command_resend": 0, 2024-08-19T00:24:28.492 INFO:teuthology.orchestra.run.smithi171.stdout: "map_epoch": 105, 2024-08-19T00:24:28.492 INFO:teuthology.orchestra.run.smithi171.stdout: "map_full": 0, 2024-08-19T00:24:28.492 INFO:teuthology.orchestra.run.smithi171.stdout: "map_inc": 15, 2024-08-19T00:24:28.492 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_sessions": 5, 2024-08-19T00:24:28.493 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_session_open": 5, 2024-08-19T00:24:28.493 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_session_close": 0, 2024-08-19T00:24:28.493 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_laggy": 0, 2024-08-19T00:24:28.493 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_wr": 0, 2024-08-19T00:24:28.493 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_rd": 2, 2024-08-19T00:24:28.493 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_del": 0 2024-08-19T00:24:28.493 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:28.493 INFO:teuthology.orchestra.run.smithi171.stdout: "oft": { 2024-08-19T00:24:28.494 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_total_objs": 0, 2024-08-19T00:24:28.494 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_total_kv_pairs": 0, 2024-08-19T00:24:28.494 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_total_updates": 0, 2024-08-19T00:24:28.494 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_total_removes": 0 2024-08-19T00:24:28.494 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:28.494 INFO:teuthology.orchestra.run.smithi171.stdout: "osd-slow-ops": { 2024-08-19T00:24:28.494 INFO:teuthology.orchestra.run.smithi171.stdout: "slow_ops_count": 0 2024-08-19T00:24:28.494 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:28.495 INFO:teuthology.orchestra.run.smithi171.stdout: "purge_queue": { 2024-08-19T00:24:28.495 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executing_ops": 0, 2024-08-19T00:24:28.495 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executing_ops_high_water": 0, 2024-08-19T00:24:28.495 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executing": 0, 2024-08-19T00:24:28.495 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executing_high_water": 0, 2024-08-19T00:24:28.495 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executed_ops": 0, 2024-08-19T00:24:28.495 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executed": 0, 2024-08-19T00:24:28.496 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_item_in_journal": 0 2024-08-19T00:24:28.496 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:28.496 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-19T00:24:28.496 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-08-19T00:24:28.496 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 104857600, 2024-08-19T00:24:28.496 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-08-19T00:24:28.496 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 2729, 2024-08-19T00:24:28.496 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 5846253, 2024-08-19T00:24:28.497 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-08-19T00:24:28.497 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 2729, 2024-08-19T00:24:28.497 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 0, 2024-08-19T00:24:28.497 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 0, 2024-08-19T00:24:28.497 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 2729, 2024-08-19T00:24:28.497 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 5846253, 2024-08-19T00:24:28.497 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-08-19T00:24:28.497 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:28.497 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:28.498 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:28.498 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-08-19T00:24:28.498 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:28.498 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-objecter_bytes": { 2024-08-19T00:24:28.498 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-08-19T00:24:28.498 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 104857600, 2024-08-19T00:24:28.498 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-08-19T00:24:28.499 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 0, 2024-08-19T00:24:28.499 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 0, 2024-08-19T00:24:28.499 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-08-19T00:24:28.499 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 0, 2024-08-19T00:24:28.499 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 2463, 2024-08-19T00:24:28.499 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 3762158, 2024-08-19T00:24:28.499 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 2463, 2024-08-19T00:24:28.499 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 3762158, 2024-08-19T00:24:28.500 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-08-19T00:24:28.500 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:28.500 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:28.500 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:28.500 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-08-19T00:24:28.500 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:28.500 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-objecter_ops": { 2024-08-19T00:24:28.500 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-08-19T00:24:28.501 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 1024, 2024-08-19T00:24:28.501 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-08-19T00:24:28.501 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 0, 2024-08-19T00:24:28.501 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 0, 2024-08-19T00:24:28.501 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-08-19T00:24:28.501 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 0, 2024-08-19T00:24:28.501 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 2463, 2024-08-19T00:24:28.501 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 2463, 2024-08-19T00:24:28.502 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 2463, 2024-08-19T00:24:28.502 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 2463, 2024-08-19T00:24:28.502 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-08-19T00:24:28.502 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:28.502 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:28.502 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:28.502 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-08-19T00:24:28.503 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:28.503 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-write_buf_throttle": { 2024-08-19T00:24:28.503 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-08-19T00:24:28.503 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 3758096384, 2024-08-19T00:24:28.503 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-08-19T00:24:28.503 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 0, 2024-08-19T00:24:28.503 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 0, 2024-08-19T00:24:28.503 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-08-19T00:24:28.504 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 0, 2024-08-19T00:24:28.504 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 0, 2024-08-19T00:24:28.504 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 0, 2024-08-19T00:24:28.504 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 0, 2024-08-19T00:24:28.504 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 0, 2024-08-19T00:24:28.504 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-08-19T00:24:28.504 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:28.504 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:28.505 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:28.505 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-08-19T00:24:28.505 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:28.505 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-write_buf_throttle-0x5591c2b80b40": { 2024-08-19T00:24:28.505 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-08-19T00:24:28.505 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 3758096384, 2024-08-19T00:24:28.505 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-08-19T00:24:28.505 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 0, 2024-08-19T00:24:28.506 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 0, 2024-08-19T00:24:28.506 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-08-19T00:24:28.506 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 0, 2024-08-19T00:24:28.506 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 0, 2024-08-19T00:24:28.506 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 0, 2024-08-19T00:24:28.506 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 0, 2024-08-19T00:24:28.506 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 0, 2024-08-19T00:24:28.506 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-08-19T00:24:28.507 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:28.507 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:28.507 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:28.507 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-08-19T00:24:28.507 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-08-19T00:24:28.507 INFO:teuthology.orchestra.run.smithi171.stdout:} 2024-08-19T00:24:29.111 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-08-19T00:24:29.111 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-08-19T00:24:29.111 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=6 2024-08-19T00:24:29.111 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2024-08-19T00:24:29.111 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2024-08-19T00:24:29.112 DEBUG:tasks.check_counter:Getting stats from i 2024-08-19T00:24:29.112 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph daemon mds.i perf dump 2024-08-19T00:24:29.363 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.c/config 2024-08-19T00:24:29.858 INFO:teuthology.orchestra.run.smithi171.stdout:{ 2024-08-19T00:24:29.858 INFO:teuthology.orchestra.run.smithi171.stdout: "AsyncMessenger::Worker-0": { 2024-08-19T00:24:29.858 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_messages": 233575, 2024-08-19T00:24:29.858 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages": 388823, 2024-08-19T00:24:29.858 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_bytes": 44422175, 2024-08-19T00:24:29.859 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_bytes": 433648843, 2024-08-19T00:24:29.859 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_created_connections": 11, 2024-08-19T00:24:29.859 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_active_connections": 5, 2024-08-19T00:24:29.859 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_total_time": 13.243145339, 2024-08-19T00:24:29.859 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_send_time": 5.509614380, 2024-08-19T00:24:29.859 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_recv_time": 6.849528592, 2024-08-19T00:24:29.859 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_fast_dispatch_time": 1.189289296, 2024-08-19T00:24:29.859 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages_queue_lat": { 2024-08-19T00:24:29.860 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 388823, 2024-08-19T00:24:29.860 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 7.012311522, 2024-08-19T00:24:29.860 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000018034 2024-08-19T00:24:29.860 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:29.860 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_handle_ack_lat": { 2024-08-19T00:24:29.860 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 534808, 2024-08-19T00:24:29.860 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.085552789, 2024-08-19T00:24:29.860 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000159 2024-08-19T00:24:29.861 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:29.861 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-19T00:24:29.861 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_encrypted_bytes": 0 2024-08-19T00:24:29.861 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:29.861 INFO:teuthology.orchestra.run.smithi171.stdout: "AsyncMessenger::Worker-1": { 2024-08-19T00:24:29.861 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_messages": 349387, 2024-08-19T00:24:29.861 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages": 518829, 2024-08-19T00:24:29.861 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_bytes": 98300025, 2024-08-19T00:24:29.862 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_bytes": 585374032, 2024-08-19T00:24:29.862 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_created_connections": 11, 2024-08-19T00:24:29.862 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_active_connections": 7, 2024-08-19T00:24:29.862 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_total_time": 18.635099050, 2024-08-19T00:24:29.862 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_send_time": 8.234766825, 2024-08-19T00:24:29.862 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_recv_time": 10.944389738, 2024-08-19T00:24:29.862 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_fast_dispatch_time": 1.039294776, 2024-08-19T00:24:29.862 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages_queue_lat": { 2024-08-19T00:24:29.863 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 518826, 2024-08-19T00:24:29.863 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 10.228344087, 2024-08-19T00:24:29.863 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000019714 2024-08-19T00:24:29.863 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:29.863 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_handle_ack_lat": { 2024-08-19T00:24:29.863 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 765594, 2024-08-19T00:24:29.863 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.128823997, 2024-08-19T00:24:29.863 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000168 2024-08-19T00:24:29.864 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:29.864 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_encrypted_bytes": 320, 2024-08-19T00:24:29.864 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_encrypted_bytes": 454320 2024-08-19T00:24:29.864 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:29.864 INFO:teuthology.orchestra.run.smithi171.stdout: "AsyncMessenger::Worker-2": { 2024-08-19T00:24:29.864 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_messages": 83534, 2024-08-19T00:24:29.864 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages": 149026, 2024-08-19T00:24:29.864 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_bytes": 19213374, 2024-08-19T00:24:29.865 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_bytes": 146963653, 2024-08-19T00:24:29.865 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_created_connections": 15, 2024-08-19T00:24:29.865 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_active_connections": 8, 2024-08-19T00:24:29.865 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_total_time": 6.547121779, 2024-08-19T00:24:29.865 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_send_time": 3.043708878, 2024-08-19T00:24:29.865 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_recv_time": 3.215073623, 2024-08-19T00:24:29.865 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_fast_dispatch_time": 0.482578024, 2024-08-19T00:24:29.866 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages_queue_lat": { 2024-08-19T00:24:29.866 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 149024, 2024-08-19T00:24:29.866 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 2.798013031, 2024-08-19T00:24:29.866 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000018775 2024-08-19T00:24:29.866 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:29.866 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_handle_ack_lat": { 2024-08-19T00:24:29.867 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 196078, 2024-08-19T00:24:29.867 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.035192712, 2024-08-19T00:24:29.867 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000179 2024-08-19T00:24:29.867 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:29.867 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_encrypted_bytes": 1682752, 2024-08-19T00:24:29.867 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_encrypted_bytes": 153392 2024-08-19T00:24:29.867 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:29.867 INFO:teuthology.orchestra.run.smithi171.stdout: "cct": { 2024-08-19T00:24:29.868 INFO:teuthology.orchestra.run.smithi171.stdout: "total_workers": 1, 2024-08-19T00:24:29.868 INFO:teuthology.orchestra.run.smithi171.stdout: "unhealthy_workers": 0 2024-08-19T00:24:29.868 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:29.868 INFO:teuthology.orchestra.run.smithi171.stdout: "finisher-MDSRank": { 2024-08-19T00:24:29.868 INFO:teuthology.orchestra.run.smithi171.stdout: "queue_len": 0, 2024-08-19T00:24:29.868 INFO:teuthology.orchestra.run.smithi171.stdout: "complete_latency": { 2024-08-19T00:24:29.868 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 88076, 2024-08-19T00:24:29.868 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 60.831992102, 2024-08-19T00:24:29.869 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000690676 2024-08-19T00:24:29.869 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-08-19T00:24:29.869 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:29.869 INFO:teuthology.orchestra.run.smithi171.stdout: "finisher-PurgeQueue": { 2024-08-19T00:24:29.869 INFO:teuthology.orchestra.run.smithi171.stdout: "queue_len": 0, 2024-08-19T00:24:29.869 INFO:teuthology.orchestra.run.smithi171.stdout: "complete_latency": { 2024-08-19T00:24:29.869 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 44492, 2024-08-19T00:24:29.869 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 4.446498900, 2024-08-19T00:24:29.869 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000099939 2024-08-19T00:24:29.870 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-08-19T00:24:29.870 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:29.870 INFO:teuthology.orchestra.run.smithi171.stdout: "mds": { 2024-08-19T00:24:29.870 INFO:teuthology.orchestra.run.smithi171.stdout: "request": 191016, 2024-08-19T00:24:29.870 INFO:teuthology.orchestra.run.smithi171.stdout: "reply": 188846, 2024-08-19T00:24:29.870 INFO:teuthology.orchestra.run.smithi171.stdout: "reply_latency": { 2024-08-19T00:24:29.870 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 188846, 2024-08-19T00:24:29.870 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 416.771108928, 2024-08-19T00:24:29.871 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.002206936 2024-08-19T00:24:29.871 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:29.871 INFO:teuthology.orchestra.run.smithi171.stdout: "slow_reply": 0, 2024-08-19T00:24:29.871 INFO:teuthology.orchestra.run.smithi171.stdout: "forward": 2170, 2024-08-19T00:24:29.871 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_fetch_complete": 0, 2024-08-19T00:24:29.871 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_fetch_keys": 0, 2024-08-19T00:24:29.871 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_commit": 95, 2024-08-19T00:24:29.871 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_split": 8, 2024-08-19T00:24:29.872 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_merge": 8, 2024-08-19T00:24:29.872 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes": 1655, 2024-08-19T00:24:29.872 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_top": 806, 2024-08-19T00:24:29.872 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_bottom": 849, 2024-08-19T00:24:29.872 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_pin_tail": 0, 2024-08-19T00:24:29.872 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_pinned": 497, 2024-08-19T00:24:29.872 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_expired": 0, 2024-08-19T00:24:29.872 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_with_caps": 45, 2024-08-19T00:24:29.873 INFO:teuthology.orchestra.run.smithi171.stdout: "caps": 45, 2024-08-19T00:24:29.873 INFO:teuthology.orchestra.run.smithi171.stdout: "subtrees": 5, 2024-08-19T00:24:29.873 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse": 292583, 2024-08-19T00:24:29.873 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_hit": 182635, 2024-08-19T00:24:29.873 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_forward": 2170, 2024-08-19T00:24:29.873 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_discover": 8, 2024-08-19T00:24:29.873 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_dir_fetch": 0, 2024-08-19T00:24:29.874 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_remote_ino": 0, 2024-08-19T00:24:29.874 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_lock": 3091, 2024-08-19T00:24:29.874 INFO:teuthology.orchestra.run.smithi171.stdout: "load_cent": 0, 2024-08-19T00:24:29.874 INFO:teuthology.orchestra.run.smithi171.stdout: "q": 0, 2024-08-19T00:24:29.874 INFO:teuthology.orchestra.run.smithi171.stdout: "exported": 0, 2024-08-19T00:24:29.875 INFO:teuthology.orchestra.run.smithi171.stdout: "exported_inodes": 0, 2024-08-19T00:24:29.875 INFO:teuthology.orchestra.run.smithi171.stdout: "imported": 9, 2024-08-19T00:24:29.875 INFO:teuthology.orchestra.run.smithi171.stdout: "imported_inodes": 134, 2024-08-19T00:24:29.875 INFO:teuthology.orchestra.run.smithi171.stdout: "openino_dir_fetch": 0, 2024-08-19T00:24:29.875 INFO:teuthology.orchestra.run.smithi171.stdout: "openino_backtrace_fetch": 0, 2024-08-19T00:24:29.875 INFO:teuthology.orchestra.run.smithi171.stdout: "openino_peer_discover": 0, 2024-08-19T00:24:29.875 INFO:teuthology.orchestra.run.smithi171.stdout: "root_rfiles": 4, 2024-08-19T00:24:29.875 INFO:teuthology.orchestra.run.smithi171.stdout: "root_rbytes": 234, 2024-08-19T00:24:29.876 INFO:teuthology.orchestra.run.smithi171.stdout: "root_rsnaps": 0, 2024-08-19T00:24:29.876 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_backtrace_fetch": 0, 2024-08-19T00:24:29.876 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_set_tag": 0, 2024-08-19T00:24:29.876 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_backtrace_repaired": 0, 2024-08-19T00:24:29.876 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_inotable_repaired": 0, 2024-08-19T00:24:29.876 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_dir_inodes": 0, 2024-08-19T00:24:29.877 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_dir_base_inodes": 0, 2024-08-19T00:24:29.877 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_dirfrag_rstats": 0, 2024-08-19T00:24:29.877 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_file_inodes": 0, 2024-08-19T00:24:29.877 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_inode_file_caps": 5, 2024-08-19T00:24:29.877 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_revoke": 10516, 2024-08-19T00:24:29.877 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_grant": 78477, 2024-08-19T00:24:29.877 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_trunc": 0, 2024-08-19T00:24:29.877 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-19T00:24:29.878 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-19T00:24:29.878 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_caps": 44656, 2024-08-19T00:24:29.878 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_caps_dirty": 18534, 2024-08-19T00:24:29.878 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_cap_release": 8654, 2024-08-19T00:24:29.878 INFO:teuthology.orchestra.run.smithi171.stdout: "process_request_cap_release": 133954 2024-08-19T00:24:29.878 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:29.878 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_cache": { 2024-08-19T00:24:29.878 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_update": 13, 2024-08-19T00:24:29.879 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_update_receipt": 3, 2024-08-19T00:24:29.879 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_try_discover": 2, 2024-08-19T00:24:29.879 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_send_discover": 12, 2024-08-19T00:24:29.879 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_handle_discover": 46, 2024-08-19T00:24:29.879 INFO:teuthology.orchestra.run.smithi171.stdout: "num_strays": 0, 2024-08-19T00:24:29.879 INFO:teuthology.orchestra.run.smithi171.stdout: "num_strays_delayed": 0, 2024-08-19T00:24:29.879 INFO:teuthology.orchestra.run.smithi171.stdout: "num_strays_enqueuing": 0, 2024-08-19T00:24:29.879 INFO:teuthology.orchestra.run.smithi171.stdout: "strays_created": 23946, 2024-08-19T00:24:29.880 INFO:teuthology.orchestra.run.smithi171.stdout: "strays_enqueued": 23946, 2024-08-19T00:24:29.880 INFO:teuthology.orchestra.run.smithi171.stdout: "strays_reintegrated": 0, 2024-08-19T00:24:29.880 INFO:teuthology.orchestra.run.smithi171.stdout: "strays_migrated": 0, 2024-08-19T00:24:29.880 INFO:teuthology.orchestra.run.smithi171.stdout: "num_recovering_processing": 0, 2024-08-19T00:24:29.880 INFO:teuthology.orchestra.run.smithi171.stdout: "num_recovering_enqueued": 0, 2024-08-19T00:24:29.880 INFO:teuthology.orchestra.run.smithi171.stdout: "num_recovering_prioritized": 0, 2024-08-19T00:24:29.880 INFO:teuthology.orchestra.run.smithi171.stdout: "recovery_started": 0, 2024-08-19T00:24:29.881 INFO:teuthology.orchestra.run.smithi171.stdout: "recovery_completed": 0, 2024-08-19T00:24:29.881 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_quiesce_path": 9, 2024-08-19T00:24:29.881 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_quiesce_inode": 634, 2024-08-19T00:24:29.881 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_enqueue_scrub": 0, 2024-08-19T00:24:29.881 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_exportdir": 0, 2024-08-19T00:24:29.881 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_flush": 0, 2024-08-19T00:24:29.881 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_fragmentdir": 16, 2024-08-19T00:24:29.881 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_fragstats": 0, 2024-08-19T00:24:29.882 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_inodestats": 0 2024-08-19T00:24:29.882 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:29.882 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_log": { 2024-08-19T00:24:29.882 INFO:teuthology.orchestra.run.smithi171.stdout: "evlrg": 0, 2024-08-19T00:24:29.882 INFO:teuthology.orchestra.run.smithi171.stdout: "evadd": 115769, 2024-08-19T00:24:29.882 INFO:teuthology.orchestra.run.smithi171.stdout: "evex": 28177, 2024-08-19T00:24:29.882 INFO:teuthology.orchestra.run.smithi171.stdout: "evtrm": 24581, 2024-08-19T00:24:29.882 INFO:teuthology.orchestra.run.smithi171.stdout: "ev": 91188, 2024-08-19T00:24:29.883 INFO:teuthology.orchestra.run.smithi171.stdout: "evexg": 0, 2024-08-19T00:24:29.883 INFO:teuthology.orchestra.run.smithi171.stdout: "evexd": 3596, 2024-08-19T00:24:29.883 INFO:teuthology.orchestra.run.smithi171.stdout: "segadd": 169, 2024-08-19T00:24:29.883 INFO:teuthology.orchestra.run.smithi171.stdout: "segex": 41, 2024-08-19T00:24:29.883 INFO:teuthology.orchestra.run.smithi171.stdout: "segtrm": 35, 2024-08-19T00:24:29.883 INFO:teuthology.orchestra.run.smithi171.stdout: "seg": 134, 2024-08-19T00:24:29.883 INFO:teuthology.orchestra.run.smithi171.stdout: "segmjr": 8, 2024-08-19T00:24:29.883 INFO:teuthology.orchestra.run.smithi171.stdout: "segexg": 0, 2024-08-19T00:24:29.884 INFO:teuthology.orchestra.run.smithi171.stdout: "segexd": 6, 2024-08-19T00:24:29.884 INFO:teuthology.orchestra.run.smithi171.stdout: "expos": 74003840, 2024-08-19T00:24:29.884 INFO:teuthology.orchestra.run.smithi171.stdout: "wrpos": 539103966, 2024-08-19T00:24:29.884 INFO:teuthology.orchestra.run.smithi171.stdout: "rdpos": 0, 2024-08-19T00:24:29.884 INFO:teuthology.orchestra.run.smithi171.stdout: "jlat": { 2024-08-19T00:24:29.884 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 44156, 2024-08-19T00:24:29.884 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 74.610681665, 2024-08-19T00:24:29.884 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.001689706 2024-08-19T00:24:29.885 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:29.885 INFO:teuthology.orchestra.run.smithi171.stdout: "replayed": 0 2024-08-19T00:24:29.885 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:29.885 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_mem": { 2024-08-19T00:24:29.885 INFO:teuthology.orchestra.run.smithi171.stdout: "ino": 736, 2024-08-19T00:24:29.885 INFO:teuthology.orchestra.run.smithi171.stdout: "ino+": 24552, 2024-08-19T00:24:29.885 INFO:teuthology.orchestra.run.smithi171.stdout: "ino-": 23816, 2024-08-19T00:24:29.885 INFO:teuthology.orchestra.run.smithi171.stdout: "dir": 44, 2024-08-19T00:24:29.886 INFO:teuthology.orchestra.run.smithi171.stdout: "dir+": 103, 2024-08-19T00:24:29.886 INFO:teuthology.orchestra.run.smithi171.stdout: "dir-": 59, 2024-08-19T00:24:29.886 INFO:teuthology.orchestra.run.smithi171.stdout: "dn": 1655, 2024-08-19T00:24:29.886 INFO:teuthology.orchestra.run.smithi171.stdout: "dn+": 48480, 2024-08-19T00:24:29.886 INFO:teuthology.orchestra.run.smithi171.stdout: "dn-": 46825, 2024-08-19T00:24:29.886 INFO:teuthology.orchestra.run.smithi171.stdout: "cap": 38, 2024-08-19T00:24:29.886 INFO:teuthology.orchestra.run.smithi171.stdout: "cap+": 26665, 2024-08-19T00:24:29.887 INFO:teuthology.orchestra.run.smithi171.stdout: "cap-": 26627, 2024-08-19T00:24:29.887 INFO:teuthology.orchestra.run.smithi171.stdout: "rss": 79216, 2024-08-19T00:24:29.887 INFO:teuthology.orchestra.run.smithi171.stdout: "heap": 223520 2024-08-19T00:24:29.887 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:29.887 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_server": { 2024-08-19T00:24:29.887 INFO:teuthology.orchestra.run.smithi171.stdout: "dispatch_client_request": 296276, 2024-08-19T00:24:29.887 INFO:teuthology.orchestra.run.smithi171.stdout: "dispatch_server_request": 8416, 2024-08-19T00:24:29.887 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_request": 191016, 2024-08-19T00:24:29.887 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_session": 2933, 2024-08-19T00:24:29.888 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_peer_request": 16874, 2024-08-19T00:24:29.888 INFO:teuthology.orchestra.run.smithi171.stdout: "req_create_latency": { 2024-08-19T00:24:29.888 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 23953, 2024-08-19T00:24:29.888 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 110.356104213, 2024-08-19T00:24:29.888 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.004607193 2024-08-19T00:24:29.888 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:29.888 INFO:teuthology.orchestra.run.smithi171.stdout: "req_getattr_latency": { 2024-08-19T00:24:29.888 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 10988, 2024-08-19T00:24:29.889 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 39.721246045, 2024-08-19T00:24:29.889 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.003614965 2024-08-19T00:24:29.889 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:29.889 INFO:teuthology.orchestra.run.smithi171.stdout: "req_getfilelock_latency": { 2024-08-19T00:24:29.889 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:29.889 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:29.889 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:29.889 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:29.890 INFO:teuthology.orchestra.run.smithi171.stdout: "req_link_latency": { 2024-08-19T00:24:29.890 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:29.890 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:29.890 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:29.890 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:29.890 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookup_latency": { 2024-08-19T00:24:29.890 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 52910, 2024-08-19T00:24:29.890 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 30.740246644, 2024-08-19T00:24:29.891 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000580991 2024-08-19T00:24:29.891 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:29.891 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookuphash_latency": { 2024-08-19T00:24:29.891 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:29.891 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:29.891 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:29.891 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:29.891 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookupino_latency": { 2024-08-19T00:24:29.892 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 1, 2024-08-19T00:24:29.892 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000126340, 2024-08-19T00:24:29.892 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000126340 2024-08-19T00:24:29.892 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:29.892 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookupname_latency": { 2024-08-19T00:24:29.892 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:29.892 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:29.892 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:29.893 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:29.893 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookupparent_latency": { 2024-08-19T00:24:29.893 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:29.893 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:29.893 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:29.893 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:29.893 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookupsnap_latency": { 2024-08-19T00:24:29.893 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:29.893 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:29.894 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:29.894 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:29.894 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lssnap_latency": { 2024-08-19T00:24:29.895 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:29.895 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:29.895 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:29.895 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:29.895 INFO:teuthology.orchestra.run.smithi171.stdout: "req_mkdir_latency": { 2024-08-19T00:24:29.895 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:29.895 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:29.895 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:29.896 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:29.896 INFO:teuthology.orchestra.run.smithi171.stdout: "req_mknod_latency": { 2024-08-19T00:24:29.896 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:29.896 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:29.896 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:29.896 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:29.896 INFO:teuthology.orchestra.run.smithi171.stdout: "req_mksnap_latency": { 2024-08-19T00:24:29.896 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:29.896 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:29.897 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:29.897 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:29.897 INFO:teuthology.orchestra.run.smithi171.stdout: "req_open_latency": { 2024-08-19T00:24:29.897 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:29.897 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:29.897 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:29.897 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:29.897 INFO:teuthology.orchestra.run.smithi171.stdout: "req_readdir_latency": { 2024-08-19T00:24:29.898 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 71726, 2024-08-19T00:24:29.898 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 100.790952898, 2024-08-19T00:24:29.898 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.001405221 2024-08-19T00:24:29.898 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:29.898 INFO:teuthology.orchestra.run.smithi171.stdout: "req_rename_latency": { 2024-08-19T00:24:29.898 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 4431, 2024-08-19T00:24:29.898 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 7.343810317, 2024-08-19T00:24:29.898 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.001657370 2024-08-19T00:24:29.899 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:29.899 INFO:teuthology.orchestra.run.smithi171.stdout: "req_renamesnap_latency": { 2024-08-19T00:24:29.899 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:29.899 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:29.899 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:29.899 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:29.899 INFO:teuthology.orchestra.run.smithi171.stdout: "req_snapdiff_latency": { 2024-08-19T00:24:29.899 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:29.900 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:29.900 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:29.900 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:29.900 INFO:teuthology.orchestra.run.smithi171.stdout: "req_rmdir_latency": { 2024-08-19T00:24:29.900 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:29.900 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:29.900 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:29.900 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:29.901 INFO:teuthology.orchestra.run.smithi171.stdout: "req_rmsnap_latency": { 2024-08-19T00:24:29.901 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:29.901 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:29.901 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:29.901 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:29.901 INFO:teuthology.orchestra.run.smithi171.stdout: "req_rmxattr_latency": { 2024-08-19T00:24:29.901 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:29.901 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:29.902 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:29.902 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:29.902 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setattr_latency": { 2024-08-19T00:24:29.902 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 7, 2024-08-19T00:24:29.902 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.058648160, 2024-08-19T00:24:29.902 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.008378308 2024-08-19T00:24:29.902 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:29.902 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setdirlayout_latency": { 2024-08-19T00:24:29.902 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:29.903 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:29.903 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:29.903 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:29.903 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setfilelock_latency": { 2024-08-19T00:24:29.903 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 884, 2024-08-19T00:24:29.903 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.469337964, 2024-08-19T00:24:29.903 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000530925 2024-08-19T00:24:29.903 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:29.904 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setlayout_latency": { 2024-08-19T00:24:29.904 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:29.904 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:29.904 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:29.904 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:29.904 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setxattr_latency": { 2024-08-19T00:24:29.904 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:29.904 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:29.905 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:29.905 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:29.905 INFO:teuthology.orchestra.run.smithi171.stdout: "req_symlink_latency": { 2024-08-19T00:24:29.905 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:29.905 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:29.905 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:29.905 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:29.905 INFO:teuthology.orchestra.run.smithi171.stdout: "req_unlink_latency": { 2024-08-19T00:24:29.906 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 23946, 2024-08-19T00:24:29.906 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 127.290636347, 2024-08-19T00:24:29.906 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.005315736 2024-08-19T00:24:29.906 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:29.906 INFO:teuthology.orchestra.run.smithi171.stdout: "cap_revoke_eviction": 0, 2024-08-19T00:24:29.906 INFO:teuthology.orchestra.run.smithi171.stdout: "cap_acquisition_throttle": 0, 2024-08-19T00:24:29.906 INFO:teuthology.orchestra.run.smithi171.stdout: "req_getvxattr_latency": { 2024-08-19T00:24:29.906 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:29.907 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:29.907 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:29.907 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-08-19T00:24:29.907 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:29.907 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_sessions": { 2024-08-19T00:24:29.907 INFO:teuthology.orchestra.run.smithi171.stdout: "session_count": 2, 2024-08-19T00:24:29.907 INFO:teuthology.orchestra.run.smithi171.stdout: "session_add": 3, 2024-08-19T00:24:29.907 INFO:teuthology.orchestra.run.smithi171.stdout: "session_remove": 1, 2024-08-19T00:24:29.908 INFO:teuthology.orchestra.run.smithi171.stdout: "sessions_open": 2, 2024-08-19T00:24:29.908 INFO:teuthology.orchestra.run.smithi171.stdout: "sessions_stale": 0, 2024-08-19T00:24:29.908 INFO:teuthology.orchestra.run.smithi171.stdout: "total_load": 28699, 2024-08-19T00:24:29.908 INFO:teuthology.orchestra.run.smithi171.stdout: "average_load": 14349, 2024-08-19T00:24:29.908 INFO:teuthology.orchestra.run.smithi171.stdout: "avg_session_uptime": 640, 2024-08-19T00:24:29.908 INFO:teuthology.orchestra.run.smithi171.stdout: "mdthresh_evicted": 0 2024-08-19T00:24:29.908 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:29.908 INFO:teuthology.orchestra.run.smithi171.stdout: "mempool": { 2024-08-19T00:24:29.908 INFO:teuthology.orchestra.run.smithi171.stdout: "bloom_filter_bytes": 0, 2024-08-19T00:24:29.909 INFO:teuthology.orchestra.run.smithi171.stdout: "bloom_filter_items": 0, 2024-08-19T00:24:29.909 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_alloc_bytes": 0, 2024-08-19T00:24:29.909 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_alloc_items": 0, 2024-08-19T00:24:29.909 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_data_bytes": 0, 2024-08-19T00:24:29.909 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_data_items": 0, 2024-08-19T00:24:29.909 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-19T00:24:29.909 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_onode_items": 0, 2024-08-19T00:24:29.909 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-19T00:24:29.910 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_meta_items": 0, 2024-08-19T00:24:29.910 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_other_bytes": 0, 2024-08-19T00:24:29.910 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_other_items": 0, 2024-08-19T00:24:29.910 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-19T00:24:29.910 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_buffer_items": 0, 2024-08-19T00:24:29.910 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_extent_bytes": 0, 2024-08-19T00:24:29.910 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_extent_items": 0, 2024-08-19T00:24:29.910 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_blob_bytes": 0, 2024-08-19T00:24:29.911 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_blob_items": 0, 2024-08-19T00:24:29.911 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-19T00:24:29.911 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_shared_blob_items": 0, 2024-08-19T00:24:29.911 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-19T00:24:29.911 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_inline_bl_items": 0, 2024-08-19T00:24:29.911 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_fsck_bytes": 0, 2024-08-19T00:24:29.911 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_fsck_items": 0, 2024-08-19T00:24:29.911 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_txc_bytes": 0, 2024-08-19T00:24:29.912 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_txc_items": 0, 2024-08-19T00:24:29.912 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-19T00:24:29.912 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_deferred_items": 0, 2024-08-19T00:24:29.912 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_bytes": 0, 2024-08-19T00:24:29.912 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_items": 0, 2024-08-19T00:24:29.912 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_bytes": 0, 2024-08-19T00:24:29.912 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_items": 0, 2024-08-19T00:24:29.913 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_reader_bytes": 0, 2024-08-19T00:24:29.913 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_reader_items": 0, 2024-08-19T00:24:29.913 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_writer_bytes": 0, 2024-08-19T00:24:29.913 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_writer_items": 0, 2024-08-19T00:24:29.913 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_anon_bytes": 3353387, 2024-08-19T00:24:29.913 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_anon_items": 1079, 2024-08-19T00:24:29.913 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_meta_bytes": 88, 2024-08-19T00:24:29.913 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_meta_items": 1, 2024-08-19T00:24:29.914 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_bytes": 0, 2024-08-19T00:24:29.914 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_items": 0, 2024-08-19T00:24:29.914 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_mapbl_bytes": 0, 2024-08-19T00:24:29.914 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_mapbl_items": 0, 2024-08-19T00:24:29.914 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_pglog_bytes": 0, 2024-08-19T00:24:29.914 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_pglog_items": 0, 2024-08-19T00:24:29.914 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_bytes": 9712, 2024-08-19T00:24:29.914 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_items": 197, 2024-08-19T00:24:29.915 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_mapping_bytes": 0, 2024-08-19T00:24:29.915 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_mapping_items": 0, 2024-08-19T00:24:29.915 INFO:teuthology.orchestra.run.smithi171.stdout: "pgmap_bytes": 0, 2024-08-19T00:24:29.915 INFO:teuthology.orchestra.run.smithi171.stdout: "pgmap_items": 0, 2024-08-19T00:24:29.915 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_co_bytes": 3499968, 2024-08-19T00:24:29.915 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_co_items": 59751, 2024-08-19T00:24:29.915 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_1_bytes": 0, 2024-08-19T00:24:29.915 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_1_items": 0, 2024-08-19T00:24:29.915 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_2_bytes": 0, 2024-08-19T00:24:29.916 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_2_items": 0 2024-08-19T00:24:29.916 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:29.916 INFO:teuthology.orchestra.run.smithi171.stdout: "objecter": { 2024-08-19T00:24:29.916 INFO:teuthology.orchestra.run.smithi171.stdout: "op_active": 0, 2024-08-19T00:24:29.916 INFO:teuthology.orchestra.run.smithi171.stdout: "op_laggy": 0, 2024-08-19T00:24:29.916 INFO:teuthology.orchestra.run.smithi171.stdout: "op_send": 94689, 2024-08-19T00:24:29.916 INFO:teuthology.orchestra.run.smithi171.stdout: "op_send_bytes": 540668411, 2024-08-19T00:24:29.916 INFO:teuthology.orchestra.run.smithi171.stdout: "op_resend": 30, 2024-08-19T00:24:29.916 INFO:teuthology.orchestra.run.smithi171.stdout: "op_reply": 94689, 2024-08-19T00:24:29.917 INFO:teuthology.orchestra.run.smithi171.stdout: "op_latency": { 2024-08-19T00:24:29.917 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 94689, 2024-08-19T00:24:29.917 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 217.033917802, 2024-08-19T00:24:29.917 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.002292071 2024-08-19T00:24:29.917 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:29.917 INFO:teuthology.orchestra.run.smithi171.stdout: "op_inflight": 0, 2024-08-19T00:24:29.917 INFO:teuthology.orchestra.run.smithi171.stdout: "oplen_avg": { 2024-08-19T00:24:29.917 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 94689, 2024-08-19T00:24:29.918 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 95586 2024-08-19T00:24:29.918 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:29.918 INFO:teuthology.orchestra.run.smithi171.stdout: "op": 94689, 2024-08-19T00:24:29.918 INFO:teuthology.orchestra.run.smithi171.stdout: "op_r": 763, 2024-08-19T00:24:29.918 INFO:teuthology.orchestra.run.smithi171.stdout: "op_w": 93926, 2024-08-19T00:24:29.918 INFO:teuthology.orchestra.run.smithi171.stdout: "op_rmw": 0, 2024-08-19T00:24:29.918 INFO:teuthology.orchestra.run.smithi171.stdout: "op_pg": 0, 2024-08-19T00:24:29.918 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_stat": 0, 2024-08-19T00:24:29.919 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_create": 33, 2024-08-19T00:24:29.919 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_read": 763, 2024-08-19T00:24:29.919 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_write": 44919, 2024-08-19T00:24:29.919 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_writefull": 357, 2024-08-19T00:24:29.919 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_writesame": 0, 2024-08-19T00:24:29.919 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_append": 0, 2024-08-19T00:24:29.919 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_zero": 0, 2024-08-19T00:24:29.919 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_truncate": 8, 2024-08-19T00:24:29.920 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_delete": 48097, 2024-08-19T00:24:29.920 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_mapext": 0, 2024-08-19T00:24:29.920 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_sparse_read": 0, 2024-08-19T00:24:29.920 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_clonerange": 0, 2024-08-19T00:24:29.920 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_getxattr": 0, 2024-08-19T00:24:29.920 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_setxattr": 66, 2024-08-19T00:24:29.920 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_cmpxattr": 0, 2024-08-19T00:24:29.920 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_rmxattr": 0, 2024-08-19T00:24:29.921 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_resetxattrs": 0, 2024-08-19T00:24:29.921 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_call": 0, 2024-08-19T00:24:29.921 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_watch": 0, 2024-08-19T00:24:29.921 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_notify": 0, 2024-08-19T00:24:29.921 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_src_cmpxattr": 0, 2024-08-19T00:24:29.921 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_pgls": 0, 2024-08-19T00:24:29.921 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_pgls_filter": 0, 2024-08-19T00:24:29.921 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_other": 0, 2024-08-19T00:24:29.922 INFO:teuthology.orchestra.run.smithi171.stdout: "linger_active": 0, 2024-08-19T00:24:29.922 INFO:teuthology.orchestra.run.smithi171.stdout: "linger_send": 0, 2024-08-19T00:24:29.922 INFO:teuthology.orchestra.run.smithi171.stdout: "linger_resend": 0, 2024-08-19T00:24:29.922 INFO:teuthology.orchestra.run.smithi171.stdout: "linger_ping": 0, 2024-08-19T00:24:29.922 INFO:teuthology.orchestra.run.smithi171.stdout: "poolop_active": 0, 2024-08-19T00:24:29.922 INFO:teuthology.orchestra.run.smithi171.stdout: "poolop_send": 0, 2024-08-19T00:24:29.922 INFO:teuthology.orchestra.run.smithi171.stdout: "poolop_resend": 0, 2024-08-19T00:24:29.922 INFO:teuthology.orchestra.run.smithi171.stdout: "poolstat_active": 0, 2024-08-19T00:24:29.923 INFO:teuthology.orchestra.run.smithi171.stdout: "poolstat_send": 0, 2024-08-19T00:24:29.923 INFO:teuthology.orchestra.run.smithi171.stdout: "poolstat_resend": 0, 2024-08-19T00:24:29.923 INFO:teuthology.orchestra.run.smithi171.stdout: "statfs_active": 0, 2024-08-19T00:24:29.923 INFO:teuthology.orchestra.run.smithi171.stdout: "statfs_send": 0, 2024-08-19T00:24:29.923 INFO:teuthology.orchestra.run.smithi171.stdout: "statfs_resend": 0, 2024-08-19T00:24:29.923 INFO:teuthology.orchestra.run.smithi171.stdout: "command_active": 0, 2024-08-19T00:24:29.923 INFO:teuthology.orchestra.run.smithi171.stdout: "command_send": 0, 2024-08-19T00:24:29.923 INFO:teuthology.orchestra.run.smithi171.stdout: "command_resend": 0, 2024-08-19T00:24:29.924 INFO:teuthology.orchestra.run.smithi171.stdout: "map_epoch": 105, 2024-08-19T00:24:29.924 INFO:teuthology.orchestra.run.smithi171.stdout: "map_full": 0, 2024-08-19T00:24:29.924 INFO:teuthology.orchestra.run.smithi171.stdout: "map_inc": 15, 2024-08-19T00:24:29.924 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_sessions": 12, 2024-08-19T00:24:29.924 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_session_open": 12, 2024-08-19T00:24:29.924 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_session_close": 0, 2024-08-19T00:24:29.924 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_laggy": 0, 2024-08-19T00:24:29.924 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_wr": 970, 2024-08-19T00:24:29.925 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_rd": 0, 2024-08-19T00:24:29.925 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_del": 373 2024-08-19T00:24:29.925 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:29.925 INFO:teuthology.orchestra.run.smithi171.stdout: "oft": { 2024-08-19T00:24:29.925 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_total_objs": 1, 2024-08-19T00:24:29.925 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_total_kv_pairs": 0, 2024-08-19T00:24:29.925 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_total_updates": 0, 2024-08-19T00:24:29.926 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_total_removes": 0 2024-08-19T00:24:29.926 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:29.926 INFO:teuthology.orchestra.run.smithi171.stdout: "osd-slow-ops": { 2024-08-19T00:24:29.926 INFO:teuthology.orchestra.run.smithi171.stdout: "slow_ops_count": 570 2024-08-19T00:24:29.926 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:29.926 INFO:teuthology.orchestra.run.smithi171.stdout: "purge_queue": { 2024-08-19T00:24:29.926 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executing_ops": 0, 2024-08-19T00:24:29.926 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executing_ops_high_water": 10, 2024-08-19T00:24:29.927 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executing": 0, 2024-08-19T00:24:29.927 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executing_high_water": 5, 2024-08-19T00:24:29.927 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executed_ops": 47892, 2024-08-19T00:24:29.927 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executed": 23946, 2024-08-19T00:24:29.927 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_item_in_journal": 0 2024-08-19T00:24:29.927 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:29.927 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-19T00:24:29.927 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-08-19T00:24:29.928 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 104857600, 2024-08-19T00:24:29.928 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-08-19T00:24:29.928 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 666492, 2024-08-19T00:24:29.928 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 101932831, 2024-08-19T00:24:29.928 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-08-19T00:24:29.928 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 666492, 2024-08-19T00:24:29.928 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 0, 2024-08-19T00:24:29.928 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 0, 2024-08-19T00:24:29.928 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 666492, 2024-08-19T00:24:29.929 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 101932831, 2024-08-19T00:24:29.929 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-08-19T00:24:29.929 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:29.929 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:29.929 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:29.929 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-08-19T00:24:29.929 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:29.930 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-objecter_bytes": { 2024-08-19T00:24:29.930 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-08-19T00:24:29.930 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 104857600, 2024-08-19T00:24:29.930 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-08-19T00:24:29.930 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 0, 2024-08-19T00:24:29.930 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 0, 2024-08-19T00:24:29.930 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-08-19T00:24:29.930 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 0, 2024-08-19T00:24:29.931 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 94689, 2024-08-19T00:24:29.931 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 543281813, 2024-08-19T00:24:29.931 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 94689, 2024-08-19T00:24:29.931 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 543281813, 2024-08-19T00:24:29.931 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-08-19T00:24:29.931 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:29.931 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:29.931 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:29.932 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-08-19T00:24:29.932 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:29.932 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-objecter_ops": { 2024-08-19T00:24:29.932 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-08-19T00:24:29.932 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 1024, 2024-08-19T00:24:29.932 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-08-19T00:24:29.932 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 0, 2024-08-19T00:24:29.932 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 0, 2024-08-19T00:24:29.932 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-08-19T00:24:29.933 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 0, 2024-08-19T00:24:29.933 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 94689, 2024-08-19T00:24:29.933 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 94689, 2024-08-19T00:24:29.933 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 94689, 2024-08-19T00:24:29.933 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 94689, 2024-08-19T00:24:29.933 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-08-19T00:24:29.933 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:29.933 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:29.934 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:29.934 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-08-19T00:24:29.934 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:29.934 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-write_buf_throttle": { 2024-08-19T00:24:29.934 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-08-19T00:24:29.934 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 3758096384, 2024-08-19T00:24:29.934 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-08-19T00:24:29.934 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 23946, 2024-08-19T00:24:29.935 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 2613402, 2024-08-19T00:24:29.935 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-08-19T00:24:29.935 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 23946, 2024-08-19T00:24:29.935 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 0, 2024-08-19T00:24:29.935 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 0, 2024-08-19T00:24:29.935 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 763, 2024-08-19T00:24:29.935 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 2613402, 2024-08-19T00:24:29.935 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-08-19T00:24:29.936 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:29.936 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:29.936 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:29.936 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-08-19T00:24:29.936 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:29.936 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-write_buf_throttle-0x55bf2ff74960": { 2024-08-19T00:24:29.936 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 83295, 2024-08-19T00:24:29.936 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 3758096384, 2024-08-19T00:24:29.936 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-08-19T00:24:29.937 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 115769, 2024-08-19T00:24:29.937 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 534909662, 2024-08-19T00:24:29.937 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-08-19T00:24:29.937 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 115769, 2024-08-19T00:24:29.937 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 0, 2024-08-19T00:24:29.937 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 0, 2024-08-19T00:24:29.937 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 44156, 2024-08-19T00:24:29.937 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 534826367, 2024-08-19T00:24:29.938 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-08-19T00:24:29.938 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:29.938 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:29.938 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:29.938 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-08-19T00:24:29.938 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-08-19T00:24:29.938 INFO:teuthology.orchestra.run.smithi171.stdout:} 2024-08-19T00:24:30.328 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:30 smithi171 ceph-mon[21810]: pgmap v348: 129 pgs: 129 active+clean; 540 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 10 op/s 2024-08-19T00:24:30.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:30 smithi116 ceph-mon[21873]: pgmap v348: 129 pgs: 129 active+clean; 540 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 10 op/s 2024-08-19T00:24:30.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:30 smithi044 ceph-mon[18489]: pgmap v348: 129 pgs: 129 active+clean; 540 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 10 op/s 2024-08-19T00:24:30.633 INFO:tasks.check_counter:Daemon mds.i mds.exported=0 2024-08-19T00:24:30.688 INFO:tasks.check_counter:Daemon mds.i mds.imported=9 2024-08-19T00:24:30.688 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=0 2024-08-19T00:24:30.689 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2024-08-19T00:24:30.689 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2024-08-19T00:24:30.689 DEBUG:tasks.check_counter:Getting stats from l 2024-08-19T00:24:30.689 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph daemon mds.l perf dump 2024-08-19T00:24:30.946 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.c/config 2024-08-19T00:24:31.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:31 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:24:31.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:31 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:24:31.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:31 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:24:31.469 INFO:teuthology.orchestra.run.smithi171.stdout:{ 2024-08-19T00:24:31.470 INFO:teuthology.orchestra.run.smithi171.stdout: "AsyncMessenger::Worker-0": { 2024-08-19T00:24:31.470 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_messages": 2228, 2024-08-19T00:24:31.470 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages": 2229, 2024-08-19T00:24:31.470 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_bytes": 632909, 2024-08-19T00:24:31.470 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_bytes": 708193, 2024-08-19T00:24:31.470 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_created_connections": 6, 2024-08-19T00:24:31.470 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_active_connections": 2, 2024-08-19T00:24:31.471 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_total_time": 0.162882800, 2024-08-19T00:24:31.471 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_send_time": 0.051224112, 2024-08-19T00:24:31.471 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_recv_time": 0.041550362, 2024-08-19T00:24:31.471 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_fast_dispatch_time": 0.057884651, 2024-08-19T00:24:31.471 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages_queue_lat": { 2024-08-19T00:24:31.471 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 2227, 2024-08-19T00:24:31.471 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.072070708, 2024-08-19T00:24:31.471 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000032362 2024-08-19T00:24:31.472 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:31.472 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_handle_ack_lat": { 2024-08-19T00:24:31.472 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:31.472 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:31.472 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:31.472 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:31.472 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-19T00:24:31.472 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_encrypted_bytes": 0 2024-08-19T00:24:31.473 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:31.473 INFO:teuthology.orchestra.run.smithi171.stdout: "AsyncMessenger::Worker-1": { 2024-08-19T00:24:31.473 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_messages": 8, 2024-08-19T00:24:31.473 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages": 181, 2024-08-19T00:24:31.473 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_bytes": 3900, 2024-08-19T00:24:31.473 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_bytes": 456346, 2024-08-19T00:24:31.473 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_created_connections": 6, 2024-08-19T00:24:31.473 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_active_connections": 4, 2024-08-19T00:24:31.474 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_total_time": 0.012023374, 2024-08-19T00:24:31.474 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_send_time": 0.006503099, 2024-08-19T00:24:31.474 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_recv_time": 0.003774314, 2024-08-19T00:24:31.474 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_fast_dispatch_time": 0.000067926, 2024-08-19T00:24:31.474 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages_queue_lat": { 2024-08-19T00:24:31.474 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 179, 2024-08-19T00:24:31.474 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.022333948, 2024-08-19T00:24:31.475 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000124770 2024-08-19T00:24:31.475 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:31.475 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_handle_ack_lat": { 2024-08-19T00:24:31.475 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:31.475 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:31.475 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:31.476 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:31.476 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_encrypted_bytes": 3344, 2024-08-19T00:24:31.476 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_encrypted_bytes": 455648 2024-08-19T00:24:31.476 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:31.477 INFO:teuthology.orchestra.run.smithi171.stdout: "AsyncMessenger::Worker-2": { 2024-08-19T00:24:31.477 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_messages": 269, 2024-08-19T00:24:31.477 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages": 252, 2024-08-19T00:24:31.477 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_bytes": 1655340, 2024-08-19T00:24:31.477 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_bytes": 145934, 2024-08-19T00:24:31.477 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_created_connections": 3, 2024-08-19T00:24:31.478 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_active_connections": 2, 2024-08-19T00:24:31.478 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_total_time": 0.042715177, 2024-08-19T00:24:31.478 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_send_time": 0.014260678, 2024-08-19T00:24:31.478 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_recv_time": 0.043741663, 2024-08-19T00:24:31.478 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_fast_dispatch_time": 0.000027999, 2024-08-19T00:24:31.478 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages_queue_lat": { 2024-08-19T00:24:31.479 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 251, 2024-08-19T00:24:31.479 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.013164766, 2024-08-19T00:24:31.479 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000052449 2024-08-19T00:24:31.479 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:31.479 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_handle_ack_lat": { 2024-08-19T00:24:31.479 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:31.480 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:31.480 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:31.480 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:31.480 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_encrypted_bytes": 1655072, 2024-08-19T00:24:31.480 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_encrypted_bytes": 145616 2024-08-19T00:24:31.480 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:31.480 INFO:teuthology.orchestra.run.smithi171.stdout: "cct": { 2024-08-19T00:24:31.480 INFO:teuthology.orchestra.run.smithi171.stdout: "total_workers": 1, 2024-08-19T00:24:31.481 INFO:teuthology.orchestra.run.smithi171.stdout: "unhealthy_workers": 0 2024-08-19T00:24:31.481 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:31.481 INFO:teuthology.orchestra.run.smithi171.stdout: "finisher-MDSRank": { 2024-08-19T00:24:31.481 INFO:teuthology.orchestra.run.smithi171.stdout: "queue_len": 0, 2024-08-19T00:24:31.481 INFO:teuthology.orchestra.run.smithi171.stdout: "complete_latency": { 2024-08-19T00:24:31.481 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 3752, 2024-08-19T00:24:31.481 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.090985702, 2024-08-19T00:24:31.481 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000024249 2024-08-19T00:24:31.482 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-08-19T00:24:31.482 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:31.482 INFO:teuthology.orchestra.run.smithi171.stdout: "finisher-PurgeQueue": { 2024-08-19T00:24:31.482 INFO:teuthology.orchestra.run.smithi171.stdout: "queue_len": 0, 2024-08-19T00:24:31.482 INFO:teuthology.orchestra.run.smithi171.stdout: "complete_latency": { 2024-08-19T00:24:31.483 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:31.483 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:31.483 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:31.483 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-08-19T00:24:31.483 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:31.483 INFO:teuthology.orchestra.run.smithi171.stdout: "mds": { 2024-08-19T00:24:31.483 INFO:teuthology.orchestra.run.smithi171.stdout: "request": 0, 2024-08-19T00:24:31.483 INFO:teuthology.orchestra.run.smithi171.stdout: "reply": 0, 2024-08-19T00:24:31.484 INFO:teuthology.orchestra.run.smithi171.stdout: "reply_latency": { 2024-08-19T00:24:31.484 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:31.484 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:31.484 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:31.484 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:31.484 INFO:teuthology.orchestra.run.smithi171.stdout: "slow_reply": 0, 2024-08-19T00:24:31.485 INFO:teuthology.orchestra.run.smithi171.stdout: "forward": 0, 2024-08-19T00:24:31.485 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_fetch_complete": 0, 2024-08-19T00:24:31.485 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_fetch_keys": 0, 2024-08-19T00:24:31.485 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_commit": 0, 2024-08-19T00:24:31.485 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_split": 0, 2024-08-19T00:24:31.486 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_merge": 0, 2024-08-19T00:24:31.486 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes": 0, 2024-08-19T00:24:31.486 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_top": 0, 2024-08-19T00:24:31.486 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_bottom": 0, 2024-08-19T00:24:31.486 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_pin_tail": 0, 2024-08-19T00:24:31.486 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_pinned": 0, 2024-08-19T00:24:31.486 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_expired": 0, 2024-08-19T00:24:31.486 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_with_caps": 0, 2024-08-19T00:24:31.487 INFO:teuthology.orchestra.run.smithi171.stdout: "caps": 0, 2024-08-19T00:24:31.487 INFO:teuthology.orchestra.run.smithi171.stdout: "subtrees": 1, 2024-08-19T00:24:31.487 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse": 0, 2024-08-19T00:24:31.487 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_hit": 0, 2024-08-19T00:24:31.487 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_forward": 0, 2024-08-19T00:24:31.487 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_discover": 0, 2024-08-19T00:24:31.487 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_dir_fetch": 0, 2024-08-19T00:24:31.487 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_remote_ino": 0, 2024-08-19T00:24:31.488 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_lock": 0, 2024-08-19T00:24:31.488 INFO:teuthology.orchestra.run.smithi171.stdout: "load_cent": 0, 2024-08-19T00:24:31.488 INFO:teuthology.orchestra.run.smithi171.stdout: "q": 0, 2024-08-19T00:24:31.488 INFO:teuthology.orchestra.run.smithi171.stdout: "exported": 0, 2024-08-19T00:24:31.488 INFO:teuthology.orchestra.run.smithi171.stdout: "exported_inodes": 0, 2024-08-19T00:24:31.488 INFO:teuthology.orchestra.run.smithi171.stdout: "imported": 0, 2024-08-19T00:24:31.488 INFO:teuthology.orchestra.run.smithi171.stdout: "imported_inodes": 0, 2024-08-19T00:24:31.488 INFO:teuthology.orchestra.run.smithi171.stdout: "openino_dir_fetch": 0, 2024-08-19T00:24:31.489 INFO:teuthology.orchestra.run.smithi171.stdout: "openino_backtrace_fetch": 0, 2024-08-19T00:24:31.489 INFO:teuthology.orchestra.run.smithi171.stdout: "openino_peer_discover": 0, 2024-08-19T00:24:31.489 INFO:teuthology.orchestra.run.smithi171.stdout: "root_rfiles": 0, 2024-08-19T00:24:31.489 INFO:teuthology.orchestra.run.smithi171.stdout: "root_rbytes": 0, 2024-08-19T00:24:31.489 INFO:teuthology.orchestra.run.smithi171.stdout: "root_rsnaps": 0, 2024-08-19T00:24:31.489 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_backtrace_fetch": 0, 2024-08-19T00:24:31.489 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_set_tag": 0, 2024-08-19T00:24:31.489 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_backtrace_repaired": 0, 2024-08-19T00:24:31.490 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_inotable_repaired": 0, 2024-08-19T00:24:31.490 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_dir_inodes": 0, 2024-08-19T00:24:31.490 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_dir_base_inodes": 0, 2024-08-19T00:24:31.490 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_dirfrag_rstats": 0, 2024-08-19T00:24:31.490 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_file_inodes": 0, 2024-08-19T00:24:31.490 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_inode_file_caps": 0, 2024-08-19T00:24:31.490 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_revoke": 0, 2024-08-19T00:24:31.491 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_grant": 0, 2024-08-19T00:24:31.491 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_trunc": 0, 2024-08-19T00:24:31.491 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-19T00:24:31.491 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-19T00:24:31.491 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_caps": 0, 2024-08-19T00:24:31.491 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_caps_dirty": 0, 2024-08-19T00:24:31.491 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_cap_release": 0, 2024-08-19T00:24:31.491 INFO:teuthology.orchestra.run.smithi171.stdout: "process_request_cap_release": 0 2024-08-19T00:24:31.492 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:31.492 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_cache": { 2024-08-19T00:24:31.492 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_update": 0, 2024-08-19T00:24:31.492 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_update_receipt": 0, 2024-08-19T00:24:31.492 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_try_discover": 0, 2024-08-19T00:24:31.492 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_send_discover": 0, 2024-08-19T00:24:31.492 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_handle_discover": 0, 2024-08-19T00:24:31.492 INFO:teuthology.orchestra.run.smithi171.stdout: "num_strays": 0, 2024-08-19T00:24:31.493 INFO:teuthology.orchestra.run.smithi171.stdout: "num_strays_delayed": 0, 2024-08-19T00:24:31.493 INFO:teuthology.orchestra.run.smithi171.stdout: "num_strays_enqueuing": 0, 2024-08-19T00:24:31.493 INFO:teuthology.orchestra.run.smithi171.stdout: "strays_created": 0, 2024-08-19T00:24:31.493 INFO:teuthology.orchestra.run.smithi171.stdout: "strays_enqueued": 0, 2024-08-19T00:24:31.493 INFO:teuthology.orchestra.run.smithi171.stdout: "strays_reintegrated": 0, 2024-08-19T00:24:31.493 INFO:teuthology.orchestra.run.smithi171.stdout: "strays_migrated": 0, 2024-08-19T00:24:31.493 INFO:teuthology.orchestra.run.smithi171.stdout: "num_recovering_processing": 0, 2024-08-19T00:24:31.493 INFO:teuthology.orchestra.run.smithi171.stdout: "num_recovering_enqueued": 0, 2024-08-19T00:24:31.494 INFO:teuthology.orchestra.run.smithi171.stdout: "num_recovering_prioritized": 0, 2024-08-19T00:24:31.494 INFO:teuthology.orchestra.run.smithi171.stdout: "recovery_started": 0, 2024-08-19T00:24:31.494 INFO:teuthology.orchestra.run.smithi171.stdout: "recovery_completed": 0, 2024-08-19T00:24:31.494 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_quiesce_path": 0, 2024-08-19T00:24:31.494 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_quiesce_inode": 0, 2024-08-19T00:24:31.494 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_enqueue_scrub": 0, 2024-08-19T00:24:31.494 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_exportdir": 0, 2024-08-19T00:24:31.494 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_flush": 0, 2024-08-19T00:24:31.495 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_fragmentdir": 0, 2024-08-19T00:24:31.495 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_fragstats": 0, 2024-08-19T00:24:31.495 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_inodestats": 0 2024-08-19T00:24:31.495 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:31.495 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_log": { 2024-08-19T00:24:31.495 INFO:teuthology.orchestra.run.smithi171.stdout: "evlrg": 0, 2024-08-19T00:24:31.495 INFO:teuthology.orchestra.run.smithi171.stdout: "evadd": 0, 2024-08-19T00:24:31.495 INFO:teuthology.orchestra.run.smithi171.stdout: "evex": 0, 2024-08-19T00:24:31.496 INFO:teuthology.orchestra.run.smithi171.stdout: "evtrm": 0, 2024-08-19T00:24:31.496 INFO:teuthology.orchestra.run.smithi171.stdout: "ev": 7, 2024-08-19T00:24:31.496 INFO:teuthology.orchestra.run.smithi171.stdout: "evexg": 0, 2024-08-19T00:24:31.496 INFO:teuthology.orchestra.run.smithi171.stdout: "evexd": 0, 2024-08-19T00:24:31.496 INFO:teuthology.orchestra.run.smithi171.stdout: "segadd": 0, 2024-08-19T00:24:31.496 INFO:teuthology.orchestra.run.smithi171.stdout: "segex": 0, 2024-08-19T00:24:31.496 INFO:teuthology.orchestra.run.smithi171.stdout: "segtrm": 0, 2024-08-19T00:24:31.496 INFO:teuthology.orchestra.run.smithi171.stdout: "seg": 2, 2024-08-19T00:24:31.497 INFO:teuthology.orchestra.run.smithi171.stdout: "segmjr": 2, 2024-08-19T00:24:31.497 INFO:teuthology.orchestra.run.smithi171.stdout: "segexg": 0, 2024-08-19T00:24:31.497 INFO:teuthology.orchestra.run.smithi171.stdout: "segexd": 0, 2024-08-19T00:24:31.497 INFO:teuthology.orchestra.run.smithi171.stdout: "expos": 4194304, 2024-08-19T00:24:31.497 INFO:teuthology.orchestra.run.smithi171.stdout: "wrpos": 4196262, 2024-08-19T00:24:31.497 INFO:teuthology.orchestra.run.smithi171.stdout: "rdpos": 4195954, 2024-08-19T00:24:31.497 INFO:teuthology.orchestra.run.smithi171.stdout: "jlat": { 2024-08-19T00:24:31.497 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:31.498 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:31.498 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:31.498 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:31.498 INFO:teuthology.orchestra.run.smithi171.stdout: "replayed": 7 2024-08-19T00:24:31.498 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:31.498 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_mem": { 2024-08-19T00:24:31.498 INFO:teuthology.orchestra.run.smithi171.stdout: "ino": 3, 2024-08-19T00:24:31.499 INFO:teuthology.orchestra.run.smithi171.stdout: "ino+": 3, 2024-08-19T00:24:31.499 INFO:teuthology.orchestra.run.smithi171.stdout: "ino-": 0, 2024-08-19T00:24:31.499 INFO:teuthology.orchestra.run.smithi171.stdout: "dir": 1, 2024-08-19T00:24:31.499 INFO:teuthology.orchestra.run.smithi171.stdout: "dir+": 1, 2024-08-19T00:24:31.499 INFO:teuthology.orchestra.run.smithi171.stdout: "dir-": 0, 2024-08-19T00:24:31.499 INFO:teuthology.orchestra.run.smithi171.stdout: "dn": 0, 2024-08-19T00:24:31.499 INFO:teuthology.orchestra.run.smithi171.stdout: "dn+": 0, 2024-08-19T00:24:31.499 INFO:teuthology.orchestra.run.smithi171.stdout: "dn-": 0, 2024-08-19T00:24:31.500 INFO:teuthology.orchestra.run.smithi171.stdout: "cap": 0, 2024-08-19T00:24:31.500 INFO:teuthology.orchestra.run.smithi171.stdout: "cap+": 0, 2024-08-19T00:24:31.500 INFO:teuthology.orchestra.run.smithi171.stdout: "cap-": 0, 2024-08-19T00:24:31.500 INFO:teuthology.orchestra.run.smithi171.stdout: "rss": 48456, 2024-08-19T00:24:31.500 INFO:teuthology.orchestra.run.smithi171.stdout: "heap": 215328 2024-08-19T00:24:31.500 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:31.500 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_server": { 2024-08-19T00:24:31.500 INFO:teuthology.orchestra.run.smithi171.stdout: "dispatch_client_request": 0, 2024-08-19T00:24:31.501 INFO:teuthology.orchestra.run.smithi171.stdout: "dispatch_server_request": 0, 2024-08-19T00:24:31.501 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_request": 0, 2024-08-19T00:24:31.501 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_session": 0, 2024-08-19T00:24:31.501 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_peer_request": 0, 2024-08-19T00:24:31.501 INFO:teuthology.orchestra.run.smithi171.stdout: "req_create_latency": { 2024-08-19T00:24:31.501 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:31.501 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:31.502 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:31.502 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:31.502 INFO:teuthology.orchestra.run.smithi171.stdout: "req_getattr_latency": { 2024-08-19T00:24:31.502 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:31.502 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:31.502 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:31.502 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:31.502 INFO:teuthology.orchestra.run.smithi171.stdout: "req_getfilelock_latency": { 2024-08-19T00:24:31.503 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:31.503 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:31.503 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:31.503 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:31.503 INFO:teuthology.orchestra.run.smithi171.stdout: "req_link_latency": { 2024-08-19T00:24:31.503 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:31.503 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:31.503 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:31.504 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:31.504 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookup_latency": { 2024-08-19T00:24:31.504 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:31.504 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:31.504 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:31.504 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:31.504 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookuphash_latency": { 2024-08-19T00:24:31.504 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:31.505 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:31.505 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:31.505 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:31.505 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookupino_latency": { 2024-08-19T00:24:31.505 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:31.505 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:31.505 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:31.505 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:31.506 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookupname_latency": { 2024-08-19T00:24:31.506 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:31.506 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:31.506 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:31.506 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:31.506 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookupparent_latency": { 2024-08-19T00:24:31.506 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:31.506 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:31.507 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:31.507 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:31.507 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookupsnap_latency": { 2024-08-19T00:24:31.507 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:31.507 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:31.507 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:31.507 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:31.507 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lssnap_latency": { 2024-08-19T00:24:31.508 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:31.508 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:31.508 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:31.508 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:31.508 INFO:teuthology.orchestra.run.smithi171.stdout: "req_mkdir_latency": { 2024-08-19T00:24:31.508 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:31.509 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:31.509 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:31.509 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:31.509 INFO:teuthology.orchestra.run.smithi171.stdout: "req_mknod_latency": { 2024-08-19T00:24:31.510 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:31.510 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:31.510 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:31.510 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:31.510 INFO:teuthology.orchestra.run.smithi171.stdout: "req_mksnap_latency": { 2024-08-19T00:24:31.510 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:31.510 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:31.511 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:31.511 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:31.511 INFO:teuthology.orchestra.run.smithi171.stdout: "req_open_latency": { 2024-08-19T00:24:31.511 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:31.511 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:31.511 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:31.511 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:31.511 INFO:teuthology.orchestra.run.smithi171.stdout: "req_readdir_latency": { 2024-08-19T00:24:31.512 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:31.512 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:31.512 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:31.512 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:31.512 INFO:teuthology.orchestra.run.smithi171.stdout: "req_rename_latency": { 2024-08-19T00:24:31.512 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:31.512 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:31.512 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:31.513 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:31.513 INFO:teuthology.orchestra.run.smithi171.stdout: "req_renamesnap_latency": { 2024-08-19T00:24:31.513 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:31.513 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:31.513 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:31.513 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:31.513 INFO:teuthology.orchestra.run.smithi171.stdout: "req_snapdiff_latency": { 2024-08-19T00:24:31.513 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:31.514 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:31.514 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:31.514 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:31.514 INFO:teuthology.orchestra.run.smithi171.stdout: "req_rmdir_latency": { 2024-08-19T00:24:31.514 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:31.514 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:31.514 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:31.515 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:31.515 INFO:teuthology.orchestra.run.smithi171.stdout: "req_rmsnap_latency": { 2024-08-19T00:24:31.515 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:31.515 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:31.515 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:31.515 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:31.515 INFO:teuthology.orchestra.run.smithi171.stdout: "req_rmxattr_latency": { 2024-08-19T00:24:31.515 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:31.516 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:31.516 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:31.516 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:31.516 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setattr_latency": { 2024-08-19T00:24:31.516 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:31.516 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:31.516 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:31.516 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:31.517 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setdirlayout_latency": { 2024-08-19T00:24:31.517 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:31.517 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:31.517 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:31.517 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:31.517 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setfilelock_latency": { 2024-08-19T00:24:31.517 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:31.517 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:31.518 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:31.518 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:31.518 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setlayout_latency": { 2024-08-19T00:24:31.518 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:31.518 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:31.518 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:31.518 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:31.518 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setxattr_latency": { 2024-08-19T00:24:31.519 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:31.519 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:31.519 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:31.519 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:31.519 INFO:teuthology.orchestra.run.smithi171.stdout: "req_symlink_latency": { 2024-08-19T00:24:31.519 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:31.519 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:31.519 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:31.520 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:31.520 INFO:teuthology.orchestra.run.smithi171.stdout: "req_unlink_latency": { 2024-08-19T00:24:31.520 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:31.520 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:31.520 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:31.520 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:31.520 INFO:teuthology.orchestra.run.smithi171.stdout: "cap_revoke_eviction": 0, 2024-08-19T00:24:31.520 INFO:teuthology.orchestra.run.smithi171.stdout: "cap_acquisition_throttle": 0, 2024-08-19T00:24:31.521 INFO:teuthology.orchestra.run.smithi171.stdout: "req_getvxattr_latency": { 2024-08-19T00:24:31.521 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:31.521 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:31.521 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:31.521 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-08-19T00:24:31.521 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:31.521 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_sessions": { 2024-08-19T00:24:31.521 INFO:teuthology.orchestra.run.smithi171.stdout: "session_count": 1, 2024-08-19T00:24:31.522 INFO:teuthology.orchestra.run.smithi171.stdout: "session_add": 3, 2024-08-19T00:24:31.522 INFO:teuthology.orchestra.run.smithi171.stdout: "session_remove": 2, 2024-08-19T00:24:31.522 INFO:teuthology.orchestra.run.smithi171.stdout: "sessions_open": 1, 2024-08-19T00:24:31.522 INFO:teuthology.orchestra.run.smithi171.stdout: "sessions_stale": 0, 2024-08-19T00:24:31.522 INFO:teuthology.orchestra.run.smithi171.stdout: "total_load": 0, 2024-08-19T00:24:31.522 INFO:teuthology.orchestra.run.smithi171.stdout: "average_load": 0, 2024-08-19T00:24:31.522 INFO:teuthology.orchestra.run.smithi171.stdout: "avg_session_uptime": 1600, 2024-08-19T00:24:31.522 INFO:teuthology.orchestra.run.smithi171.stdout: "mdthresh_evicted": 0 2024-08-19T00:24:31.523 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:31.523 INFO:teuthology.orchestra.run.smithi171.stdout: "mempool": { 2024-08-19T00:24:31.523 INFO:teuthology.orchestra.run.smithi171.stdout: "bloom_filter_bytes": 0, 2024-08-19T00:24:31.523 INFO:teuthology.orchestra.run.smithi171.stdout: "bloom_filter_items": 0, 2024-08-19T00:24:31.523 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_alloc_bytes": 0, 2024-08-19T00:24:31.523 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_alloc_items": 0, 2024-08-19T00:24:31.523 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_data_bytes": 0, 2024-08-19T00:24:31.523 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_data_items": 0, 2024-08-19T00:24:31.524 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-19T00:24:31.524 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_onode_items": 0, 2024-08-19T00:24:31.524 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-19T00:24:31.524 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_meta_items": 0, 2024-08-19T00:24:31.524 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_other_bytes": 0, 2024-08-19T00:24:31.524 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_other_items": 0, 2024-08-19T00:24:31.524 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-19T00:24:31.524 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_buffer_items": 0, 2024-08-19T00:24:31.525 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_extent_bytes": 0, 2024-08-19T00:24:31.525 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_extent_items": 0, 2024-08-19T00:24:31.525 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_blob_bytes": 0, 2024-08-19T00:24:31.525 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_blob_items": 0, 2024-08-19T00:24:31.525 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-19T00:24:31.525 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_shared_blob_items": 0, 2024-08-19T00:24:31.525 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-19T00:24:31.525 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_inline_bl_items": 0, 2024-08-19T00:24:31.526 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_fsck_bytes": 0, 2024-08-19T00:24:31.526 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_fsck_items": 0, 2024-08-19T00:24:31.526 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_txc_bytes": 0, 2024-08-19T00:24:31.526 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_txc_items": 0, 2024-08-19T00:24:31.526 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-19T00:24:31.526 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_deferred_items": 0, 2024-08-19T00:24:31.526 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_bytes": 0, 2024-08-19T00:24:31.526 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_items": 0, 2024-08-19T00:24:31.527 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_bytes": 0, 2024-08-19T00:24:31.527 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_items": 0, 2024-08-19T00:24:31.527 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_reader_bytes": 0, 2024-08-19T00:24:31.527 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_reader_items": 0, 2024-08-19T00:24:31.527 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_writer_bytes": 0, 2024-08-19T00:24:31.527 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_writer_items": 0, 2024-08-19T00:24:31.527 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_anon_bytes": 182049, 2024-08-19T00:24:31.527 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_anon_items": 47, 2024-08-19T00:24:31.527 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_meta_bytes": 0, 2024-08-19T00:24:31.528 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_meta_items": 0, 2024-08-19T00:24:31.528 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_bytes": 0, 2024-08-19T00:24:31.528 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_items": 0, 2024-08-19T00:24:31.528 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_mapbl_bytes": 0, 2024-08-19T00:24:31.528 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_mapbl_items": 0, 2024-08-19T00:24:31.528 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_pglog_bytes": 0, 2024-08-19T00:24:31.528 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_pglog_items": 0, 2024-08-19T00:24:31.528 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_bytes": 9712, 2024-08-19T00:24:31.529 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_items": 197, 2024-08-19T00:24:31.529 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_mapping_bytes": 0, 2024-08-19T00:24:31.529 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_mapping_items": 0, 2024-08-19T00:24:31.529 INFO:teuthology.orchestra.run.smithi171.stdout: "pgmap_bytes": 0, 2024-08-19T00:24:31.529 INFO:teuthology.orchestra.run.smithi171.stdout: "pgmap_items": 0, 2024-08-19T00:24:31.529 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_co_bytes": 8512, 2024-08-19T00:24:31.530 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_co_items": 13, 2024-08-19T00:24:31.530 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_1_bytes": 0, 2024-08-19T00:24:31.530 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_1_items": 0, 2024-08-19T00:24:31.530 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_2_bytes": 0, 2024-08-19T00:24:31.530 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_2_items": 0 2024-08-19T00:24:31.530 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:31.530 INFO:teuthology.orchestra.run.smithi171.stdout: "objecter": { 2024-08-19T00:24:31.530 INFO:teuthology.orchestra.run.smithi171.stdout: "op_active": 0, 2024-08-19T00:24:31.531 INFO:teuthology.orchestra.run.smithi171.stdout: "op_laggy": 0, 2024-08-19T00:24:31.531 INFO:teuthology.orchestra.run.smithi171.stdout: "op_send": 2230, 2024-08-19T00:24:31.531 INFO:teuthology.orchestra.run.smithi171.stdout: "op_send_bytes": 21, 2024-08-19T00:24:31.531 INFO:teuthology.orchestra.run.smithi171.stdout: "op_resend": 3, 2024-08-19T00:24:31.531 INFO:teuthology.orchestra.run.smithi171.stdout: "op_reply": 2230, 2024-08-19T00:24:31.531 INFO:teuthology.orchestra.run.smithi171.stdout: "op_latency": { 2024-08-19T00:24:31.531 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 2230, 2024-08-19T00:24:31.531 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 1.223977038, 2024-08-19T00:24:31.532 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000548868 2024-08-19T00:24:31.532 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:31.532 INFO:teuthology.orchestra.run.smithi171.stdout: "op_inflight": 0, 2024-08-19T00:24:31.532 INFO:teuthology.orchestra.run.smithi171.stdout: "oplen_avg": { 2024-08-19T00:24:31.532 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 2230, 2024-08-19T00:24:31.532 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 2231 2024-08-19T00:24:31.532 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:31.532 INFO:teuthology.orchestra.run.smithi171.stdout: "op": 2230, 2024-08-19T00:24:31.533 INFO:teuthology.orchestra.run.smithi171.stdout: "op_r": 2230, 2024-08-19T00:24:31.533 INFO:teuthology.orchestra.run.smithi171.stdout: "op_w": 0, 2024-08-19T00:24:31.533 INFO:teuthology.orchestra.run.smithi171.stdout: "op_rmw": 0, 2024-08-19T00:24:31.533 INFO:teuthology.orchestra.run.smithi171.stdout: "op_pg": 0, 2024-08-19T00:24:31.533 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_stat": 1446, 2024-08-19T00:24:31.533 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_create": 0, 2024-08-19T00:24:31.533 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_read": 782, 2024-08-19T00:24:31.533 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_write": 0, 2024-08-19T00:24:31.534 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_writefull": 0, 2024-08-19T00:24:31.534 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_writesame": 0, 2024-08-19T00:24:31.534 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_append": 0, 2024-08-19T00:24:31.534 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_zero": 0, 2024-08-19T00:24:31.534 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_truncate": 0, 2024-08-19T00:24:31.534 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_delete": 0, 2024-08-19T00:24:31.534 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_mapext": 0, 2024-08-19T00:24:31.534 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_sparse_read": 0, 2024-08-19T00:24:31.535 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_clonerange": 0, 2024-08-19T00:24:31.535 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_getxattr": 1, 2024-08-19T00:24:31.535 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_setxattr": 0, 2024-08-19T00:24:31.535 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_cmpxattr": 0, 2024-08-19T00:24:31.535 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_rmxattr": 0, 2024-08-19T00:24:31.535 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_resetxattrs": 0, 2024-08-19T00:24:31.535 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_call": 0, 2024-08-19T00:24:31.535 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_watch": 0, 2024-08-19T00:24:31.536 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_notify": 0, 2024-08-19T00:24:31.536 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_src_cmpxattr": 0, 2024-08-19T00:24:31.536 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_pgls": 0, 2024-08-19T00:24:31.536 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_pgls_filter": 0, 2024-08-19T00:24:31.536 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_other": 0, 2024-08-19T00:24:31.536 INFO:teuthology.orchestra.run.smithi171.stdout: "linger_active": 0, 2024-08-19T00:24:31.536 INFO:teuthology.orchestra.run.smithi171.stdout: "linger_send": 0, 2024-08-19T00:24:31.537 INFO:teuthology.orchestra.run.smithi171.stdout: "linger_resend": 0, 2024-08-19T00:24:31.537 INFO:teuthology.orchestra.run.smithi171.stdout: "linger_ping": 0, 2024-08-19T00:24:31.537 INFO:teuthology.orchestra.run.smithi171.stdout: "poolop_active": 0, 2024-08-19T00:24:31.537 INFO:teuthology.orchestra.run.smithi171.stdout: "poolop_send": 0, 2024-08-19T00:24:31.537 INFO:teuthology.orchestra.run.smithi171.stdout: "poolop_resend": 0, 2024-08-19T00:24:31.537 INFO:teuthology.orchestra.run.smithi171.stdout: "poolstat_active": 0, 2024-08-19T00:24:31.537 INFO:teuthology.orchestra.run.smithi171.stdout: "poolstat_send": 0, 2024-08-19T00:24:31.537 INFO:teuthology.orchestra.run.smithi171.stdout: "poolstat_resend": 0, 2024-08-19T00:24:31.538 INFO:teuthology.orchestra.run.smithi171.stdout: "statfs_active": 0, 2024-08-19T00:24:31.538 INFO:teuthology.orchestra.run.smithi171.stdout: "statfs_send": 0, 2024-08-19T00:24:31.538 INFO:teuthology.orchestra.run.smithi171.stdout: "statfs_resend": 0, 2024-08-19T00:24:31.538 INFO:teuthology.orchestra.run.smithi171.stdout: "command_active": 0, 2024-08-19T00:24:31.538 INFO:teuthology.orchestra.run.smithi171.stdout: "command_send": 0, 2024-08-19T00:24:31.538 INFO:teuthology.orchestra.run.smithi171.stdout: "command_resend": 0, 2024-08-19T00:24:31.538 INFO:teuthology.orchestra.run.smithi171.stdout: "map_epoch": 105, 2024-08-19T00:24:31.538 INFO:teuthology.orchestra.run.smithi171.stdout: "map_full": 0, 2024-08-19T00:24:31.538 INFO:teuthology.orchestra.run.smithi171.stdout: "map_inc": 15, 2024-08-19T00:24:31.539 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_sessions": 4, 2024-08-19T00:24:31.539 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_session_open": 4, 2024-08-19T00:24:31.539 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_session_close": 0, 2024-08-19T00:24:31.539 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_laggy": 0, 2024-08-19T00:24:31.539 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_wr": 0, 2024-08-19T00:24:31.539 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_rd": 2, 2024-08-19T00:24:31.539 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_del": 0 2024-08-19T00:24:31.539 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:31.540 INFO:teuthology.orchestra.run.smithi171.stdout: "oft": { 2024-08-19T00:24:31.540 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_total_objs": 0, 2024-08-19T00:24:31.540 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_total_kv_pairs": 0, 2024-08-19T00:24:31.540 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_total_updates": 0, 2024-08-19T00:24:31.540 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_total_removes": 0 2024-08-19T00:24:31.540 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:31.540 INFO:teuthology.orchestra.run.smithi171.stdout: "osd-slow-ops": { 2024-08-19T00:24:31.540 INFO:teuthology.orchestra.run.smithi171.stdout: "slow_ops_count": 0 2024-08-19T00:24:31.541 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:31.541 INFO:teuthology.orchestra.run.smithi171.stdout: "purge_queue": { 2024-08-19T00:24:31.541 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executing_ops": 0, 2024-08-19T00:24:31.541 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executing_ops_high_water": 0, 2024-08-19T00:24:31.541 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executing": 0, 2024-08-19T00:24:31.541 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executing_high_water": 0, 2024-08-19T00:24:31.541 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executed_ops": 0, 2024-08-19T00:24:31.541 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executed": 0, 2024-08-19T00:24:31.541 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_item_in_journal": 0 2024-08-19T00:24:31.542 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:31.542 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-19T00:24:31.542 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-08-19T00:24:31.542 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 104857600, 2024-08-19T00:24:31.542 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-08-19T00:24:31.542 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 2501, 2024-08-19T00:24:31.542 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 2050356, 2024-08-19T00:24:31.543 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-08-19T00:24:31.543 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 2501, 2024-08-19T00:24:31.543 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 0, 2024-08-19T00:24:31.543 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 0, 2024-08-19T00:24:31.543 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 2501, 2024-08-19T00:24:31.543 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 2050356, 2024-08-19T00:24:31.543 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-08-19T00:24:31.544 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:31.544 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:31.544 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:31.544 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-08-19T00:24:31.544 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:31.544 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-objecter_bytes": { 2024-08-19T00:24:31.544 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-08-19T00:24:31.544 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 104857600, 2024-08-19T00:24:31.545 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-08-19T00:24:31.545 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 0, 2024-08-19T00:24:31.545 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 0, 2024-08-19T00:24:31.545 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-08-19T00:24:31.545 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 0, 2024-08-19T00:24:31.545 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 2230, 2024-08-19T00:24:31.545 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 1963, 2024-08-19T00:24:31.545 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 2230, 2024-08-19T00:24:31.546 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 1963, 2024-08-19T00:24:31.546 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-08-19T00:24:31.546 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:31.546 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:31.546 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:31.546 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-08-19T00:24:31.546 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:31.547 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-objecter_ops": { 2024-08-19T00:24:31.547 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-08-19T00:24:31.547 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 1024, 2024-08-19T00:24:31.547 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-08-19T00:24:31.547 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 0, 2024-08-19T00:24:31.547 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 0, 2024-08-19T00:24:31.547 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-08-19T00:24:31.547 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 0, 2024-08-19T00:24:31.548 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 2230, 2024-08-19T00:24:31.548 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 2230, 2024-08-19T00:24:31.548 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 2230, 2024-08-19T00:24:31.548 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 2230, 2024-08-19T00:24:31.548 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-08-19T00:24:31.548 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:31.548 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:31.548 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:31.548 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-08-19T00:24:31.549 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:31.549 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-write_buf_throttle": { 2024-08-19T00:24:31.549 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-08-19T00:24:31.549 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 3758096384, 2024-08-19T00:24:31.549 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-08-19T00:24:31.549 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 0, 2024-08-19T00:24:31.549 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 0, 2024-08-19T00:24:31.549 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-08-19T00:24:31.550 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 0, 2024-08-19T00:24:31.550 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 0, 2024-08-19T00:24:31.550 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 0, 2024-08-19T00:24:31.550 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 0, 2024-08-19T00:24:31.550 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 0, 2024-08-19T00:24:31.550 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-08-19T00:24:31.550 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:31.550 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:31.551 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:31.551 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-08-19T00:24:31.551 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-08-19T00:24:31.551 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-write_buf_throttle-0x55e4f7e52b40": { 2024-08-19T00:24:31.551 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-08-19T00:24:31.551 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 3758096384, 2024-08-19T00:24:31.551 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-08-19T00:24:31.551 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 0, 2024-08-19T00:24:31.552 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 0, 2024-08-19T00:24:31.552 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-08-19T00:24:31.552 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 0, 2024-08-19T00:24:31.552 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 0, 2024-08-19T00:24:31.552 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 0, 2024-08-19T00:24:31.552 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 0, 2024-08-19T00:24:31.552 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 0, 2024-08-19T00:24:31.552 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-08-19T00:24:31.553 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-08-19T00:24:31.553 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-08-19T00:24:31.553 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-08-19T00:24:31.553 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-08-19T00:24:31.553 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-08-19T00:24:31.553 INFO:teuthology.orchestra.run.smithi171.stdout:} 2024-08-19T00:24:32.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:32 smithi171 ceph-mon[21810]: pgmap v349: 129 pgs: 129 active+clean; 540 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 946 KiB/s wr, 45 op/s 2024-08-19T00:24:32.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:32 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:24:32.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:32 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:24:32.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:32 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:24:32.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:32 smithi116 ceph-mon[21873]: pgmap v349: 129 pgs: 129 active+clean; 540 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 946 KiB/s wr, 45 op/s 2024-08-19T00:24:32.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:32 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:24:32.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:32 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:24:32.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:32 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:24:32.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:32 smithi044 ceph-mon[18489]: pgmap v349: 129 pgs: 129 active+clean; 540 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 946 KiB/s wr, 45 op/s 2024-08-19T00:24:32.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:32 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:24:32.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:32 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:24:32.370 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:32 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' 2024-08-19T00:24:32.483 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-08-19T00:24:32.483 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-08-19T00:24:32.484 INFO:tasks.check_counter:Daemon mds.l mds.root_rsnaps=0 2024-08-19T00:24:32.484 INFO:tasks.check_counter:Daemon mds.l mds_server.req_mksnap_latency.avgcount=0 2024-08-19T00:24:32.484 INFO:tasks.check_counter:Daemon mds.l mds_server.req_rmsnap_latency.avgcount=0 2024-08-19T00:24:32.484 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-08-19T00:24:32.495 INFO:tasks.kclient:Unmounting kernel clients... 2024-08-19T00:24:32.495 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-08-19T00:24:32.495 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:24:32.516 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-08-19T00:24:32.516 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T00:24:32.576 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph osd blocklist ls 2024-08-19T00:24:32.886 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:24:33.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:33.338+0000 7f6c80069640 1 -- 172.21.15.44:0/1048121725 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c78108010 msgr2=0x7f6c7810e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:33.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:33.338+0000 7f6c80069640 1 --2- 172.21.15.44:0/1048121725 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c78108010 0x7f6c7810e980 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f6c70009930 tx=0x7f6c7002a420 comp rx=0 tx=0).stop 2024-08-19T00:24:33.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:33.338+0000 7f6c80069640 1 -- 172.21.15.44:0/1048121725 shutdown_connections 2024-08-19T00:24:33.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:33.338+0000 7f6c80069640 1 --2- 172.21.15.44:0/1048121725 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c78108010 0x7f6c7810e980 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:33.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:33.338+0000 7f6c80069640 1 --2- 172.21.15.44:0/1048121725 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6c78103490 0x7f6c781078d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:33.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:33.338+0000 7f6c80069640 1 --2- 172.21.15.44:0/1048121725 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c78102ae0 0x7f6c78102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:33.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:33.338+0000 7f6c80069640 1 -- 172.21.15.44:0/1048121725 >> 172.21.15.44:0/1048121725 conn(0x7f6c780fc500 msgr2=0x7f6c780fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:24:33.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:33.338+0000 7f6c80069640 1 -- 172.21.15.44:0/1048121725 shutdown_connections 2024-08-19T00:24:33.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:33.338+0000 7f6c80069640 1 -- 172.21.15.44:0/1048121725 wait complete. 2024-08-19T00:24:33.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:33.338+0000 7f6c80069640 1 Processor -- start 2024-08-19T00:24:33.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:33.339+0000 7f6c80069640 1 -- start start 2024-08-19T00:24:33.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:33.339+0000 7f6c80069640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6c78102ae0 0x7f6c781981c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:33.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:33.339+0000 7f6c80069640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c78103490 0x7f6c78198700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:33.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:33.339+0000 7f6c80069640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c78108010 0x7f6c7819ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:33.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:33.339+0000 7f6c80069640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6c78111de0 con 0x7f6c78108010 2024-08-19T00:24:33.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:33.339+0000 7f6c80069640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f6c78111c60 con 0x7f6c78102ae0 2024-08-19T00:24:33.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:33.339+0000 7f6c80069640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6c78111f60 con 0x7f6c78103490 2024-08-19T00:24:33.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:33.339+0000 7f6c7e606640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c78108010 0x7f6c7819ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:33.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:33.339+0000 7f6c7e606640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c78108010 0x7f6c7819ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56780/0 (socket says 172.21.15.44:56780) 2024-08-19T00:24:33.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:33.339+0000 7f6c7e606640 1 -- 172.21.15.44:0/1970941408 learned_addr learned my addr 172.21.15.44:0/1970941408 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:24:33.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:33.339+0000 7f6c7d604640 1 --2- 172.21.15.44:0/1970941408 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c78103490 0x7f6c78198700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:33.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:33.339+0000 7f6c7de05640 1 --2- 172.21.15.44:0/1970941408 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6c78102ae0 0x7f6c781981c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:33.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:33.339+0000 7f6c7e606640 1 -- 172.21.15.44:0/1970941408 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c78103490 msgr2=0x7f6c78198700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:33.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:33.339+0000 7f6c7e606640 1 --2- 172.21.15.44:0/1970941408 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c78103490 0x7f6c78198700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:33.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:33.339+0000 7f6c7e606640 1 -- 172.21.15.44:0/1970941408 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6c78102ae0 msgr2=0x7f6c781981c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:33.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:33.339+0000 7f6c7e606640 1 --2- 172.21.15.44:0/1970941408 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6c78102ae0 0x7f6c781981c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:33.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:33.339+0000 7f6c7e606640 1 -- 172.21.15.44:0/1970941408 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c7819d170 con 0x7f6c78108010 2024-08-19T00:24:33.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:33.339+0000 7f6c7d604640 1 --2- 172.21.15.44:0/1970941408 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c78103490 0x7f6c78198700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:24:33.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:33.339+0000 7f6c7e606640 1 --2- 172.21.15.44:0/1970941408 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c78108010 0x7f6c7819ca90 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f6c70005ab0 tx=0x7f6c70003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:24:33.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:33.340+0000 7f6c76ffd640 1 -- 172.21.15.44:0/1970941408 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c7003f070 con 0x7f6c78108010 2024-08-19T00:24:33.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:33.340+0000 7f6c80069640 1 -- 172.21.15.44:0/1970941408 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c7819d400 con 0x7f6c78108010 2024-08-19T00:24:33.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:33.340+0000 7f6c76ffd640 1 -- 172.21.15.44:0/1970941408 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c70031c30 con 0x7f6c78108010 2024-08-19T00:24:33.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:33.340+0000 7f6c76ffd640 1 -- 172.21.15.44:0/1970941408 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c70035030 con 0x7f6c78108010 2024-08-19T00:24:33.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:33.340+0000 7f6c80069640 1 -- 172.21.15.44:0/1970941408 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c78100670 con 0x7f6c78108010 2024-08-19T00:24:33.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:33.341+0000 7f6c80069640 1 -- 172.21.15.44:0/1970941408 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c7806a500 con 0x7f6c78108010 2024-08-19T00:24:33.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:33.342+0000 7f6c76ffd640 1 -- 172.21.15.44:0/1970941408 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f6c70042070 con 0x7f6c78108010 2024-08-19T00:24:33.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:33.343+0000 7f6c76ffd640 1 --2- 172.21.15.44:0/1970941408 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f6c600a2cf0 0x7f6c600a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:33.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:33.343+0000 7f6c7de05640 1 --2- 172.21.15.44:0/1970941408 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f6c600a2cf0 0x7f6c600a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:33.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:33.343+0000 7f6c76ffd640 1 -- 172.21.15.44:0/1970941408 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 9533+0+0 (secure 0 0 0) 0x7f6c700f0810 con 0x7f6c78108010 2024-08-19T00:24:33.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:33.343+0000 7f6c7de05640 1 --2- 172.21.15.44:0/1970941408 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f6c600a2cf0 0x7f6c600a51b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6c68005fd0 tx=0x7f6c68009870 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:24:33.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:33.346+0000 7f6c76ffd640 1 -- 172.21.15.44:0/1970941408 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f6c700bcfe0 con 0x7f6c78108010 2024-08-19T00:24:33.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:33.534+0000 7f6c80069640 1 -- 172.21.15.44:0/1970941408 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6c78199550 con 0x7f6c78108010 2024-08-19T00:24:33.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:33.535+0000 7f6c76ffd640 1 -- 172.21.15.44:0/1970941408 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v105) ==== 81+0+944 (secure 0 0 0) 0x7f6c700a5e20 con 0x7f6c78108010 2024-08-19T00:24:33.537 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:0/1732405694 2024-08-20T00:13:18.502685+0000 2024-08-19T00:24:33.537 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:0/2504116080 2024-08-20T00:13:18.502685+0000 2024-08-19T00:24:33.537 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6800/1374527587 2024-08-20T00:04:14.604141+0000 2024-08-19T00:24:33.537 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:0/1869412718 2024-08-20T00:04:14.604141+0000 2024-08-19T00:24:33.537 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:0/3023439260 2024-08-20T00:13:18.502685+0000 2024-08-19T00:24:33.538 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:0/911382683 2024-08-20T00:04:14.604141+0000 2024-08-19T00:24:33.538 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:0/3096491642 2024-08-20T00:04:14.604141+0000 2024-08-19T00:24:33.538 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:0/400419582 2024-08-20T00:04:38.392912+0000 2024-08-19T00:24:33.538 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:0/3800526625 2024-08-20T00:04:38.392912+0000 2024-08-19T00:24:33.538 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6801/1374527587 2024-08-20T00:04:14.604141+0000 2024-08-19T00:24:33.538 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:0/1001446555 2024-08-20T00:04:38.392912+0000 2024-08-19T00:24:33.538 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:0/3489931602 2024-08-20T00:13:18.502685+0000 2024-08-19T00:24:33.538 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6800/1330072146 2024-08-20T00:13:18.502685+0000 2024-08-19T00:24:33.539 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6801/1300308907 2024-08-20T00:04:38.392912+0000 2024-08-19T00:24:33.539 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6800/1300308907 2024-08-20T00:04:38.392912+0000 2024-08-19T00:24:33.539 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6801/1330072146 2024-08-20T00:13:18.502685+0000 2024-08-19T00:24:33.540 INFO:teuthology.orchestra.run.smithi044.stderr:listed 16 entries 2024-08-19T00:24:33.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:33.537+0000 7f6c80069640 1 -- 172.21.15.44:0/1970941408 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f6c600a2cf0 msgr2=0x7f6c600a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:33.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:33.537+0000 7f6c80069640 1 --2- 172.21.15.44:0/1970941408 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f6c600a2cf0 0x7f6c600a51b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6c68005fd0 tx=0x7f6c68009870 comp rx=0 tx=0).stop 2024-08-19T00:24:33.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:33.537+0000 7f6c80069640 1 -- 172.21.15.44:0/1970941408 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c78108010 msgr2=0x7f6c7819ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:33.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:33.537+0000 7f6c80069640 1 --2- 172.21.15.44:0/1970941408 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c78108010 0x7f6c7819ca90 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f6c70005ab0 tx=0x7f6c70003c10 comp rx=0 tx=0).stop 2024-08-19T00:24:33.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:33.537+0000 7f6c80069640 1 -- 172.21.15.44:0/1970941408 shutdown_connections 2024-08-19T00:24:33.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:33.537+0000 7f6c80069640 1 --2- 172.21.15.44:0/1970941408 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f6c600a2cf0 0x7f6c600a51b0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:33.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:33.537+0000 7f6c80069640 1 --2- 172.21.15.44:0/1970941408 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c78103490 0x7f6c78198700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:33.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:33.537+0000 7f6c80069640 1 --2- 172.21.15.44:0/1970941408 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c78108010 0x7f6c7819ca90 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:33.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:33.537+0000 7f6c80069640 1 --2- 172.21.15.44:0/1970941408 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6c78102ae0 0x7f6c781981c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:33.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:33.537+0000 7f6c80069640 1 -- 172.21.15.44:0/1970941408 >> 172.21.15.44:0/1970941408 conn(0x7f6c780fc500 msgr2=0x7f6c780fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:24:33.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:33.537+0000 7f6c80069640 1 -- 172.21.15.44:0/1970941408 shutdown_connections 2024-08-19T00:24:33.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:33.537+0000 7f6c80069640 1 -- 172.21.15.44:0/1970941408 wait complete. 2024-08-19T00:24:34.280 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:34 smithi044 ceph-mon[18489]: pgmap v350: 129 pgs: 129 active+clean; 540 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 936 KiB/s wr, 39 op/s 2024-08-19T00:24:34.280 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:34 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/1970941408' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-08-19T00:24:34.316 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-19T00:24:34.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:24:34.316 DEBUG:teuthology.orchestra.run.smithi044:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-08-19T00:24:34.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:34 smithi171 ceph-mon[21810]: pgmap v350: 129 pgs: 129 active+clean; 540 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 936 KiB/s wr, 39 op/s 2024-08-19T00:24:34.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:34 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/1970941408' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-08-19T00:24:34.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:34 smithi116 ceph-mon[21873]: pgmap v350: 129 pgs: 129 active+clean; 540 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 936 KiB/s wr, 39 op/s 2024-08-19T00:24:34.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:34 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/1970941408' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-08-19T00:24:34.396 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2024-08-19T00:24:34.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:24:34.396 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-19T00:24:34.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:24:34.431 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2024-08-19T00:24:34.502 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-19T00:24:34.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:24:34.503 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-19T00:24:34.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:24:34.570 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link delete ceph-brx 2024-08-19T00:24:34.669 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-08-19T00:24:34.680 INFO:tasks.cephadm:Teardown begin 2024-08-19T00:24:34.681 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-19T00:24:34.681 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-19T00:24:34.941 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:24:35.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:35.414+0000 7ffa8e307640 1 -- 172.21.15.44:0/210685556 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa88102a70 msgr2=0x7ffa88102e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:35.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:35.414+0000 7ffa8e307640 1 --2- 172.21.15.44:0/210685556 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa88102a70 0x7ffa88102e50 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7ffa78009900 tx=0x7ffa7802a480 comp rx=0 tx=0).stop 2024-08-19T00:24:35.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:35.414+0000 7ffa8e307640 1 -- 172.21.15.44:0/210685556 shutdown_connections 2024-08-19T00:24:35.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:35.414+0000 7ffa8e307640 1 --2- 172.21.15.44:0/210685556 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa88103390 0x7ffa8810b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:35.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:35.414+0000 7ffa8e307640 1 --2- 172.21.15.44:0/210685556 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffa8810bea0 0x7ffa8810e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:35.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:35.414+0000 7ffa8e307640 1 --2- 172.21.15.44:0/210685556 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa88102a70 0x7ffa88102e50 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:35.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:35.414+0000 7ffa8e307640 1 -- 172.21.15.44:0/210685556 >> 172.21.15.44:0/210685556 conn(0x7ffa880fc4d0 msgr2=0x7ffa880fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:24:35.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:35.414+0000 7ffa8e307640 1 -- 172.21.15.44:0/210685556 shutdown_connections 2024-08-19T00:24:35.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:35.414+0000 7ffa8e307640 1 -- 172.21.15.44:0/210685556 wait complete. 2024-08-19T00:24:35.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:35.414+0000 7ffa8e307640 1 Processor -- start 2024-08-19T00:24:35.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:35.414+0000 7ffa8e307640 1 -- start start 2024-08-19T00:24:35.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:35.415+0000 7ffa8e307640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffa88102a70 0x7ffa881982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:35.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:35.415+0000 7ffa8e307640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa88103390 0x7ffa881987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:35.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:35.415+0000 7ffa8e307640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa8810bea0 0x7ffa8819cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:35.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:35.415+0000 7ffa8e307640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ffa88111ce0 con 0x7ffa88103390 2024-08-19T00:24:35.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:35.415+0000 7ffa8e307640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7ffa88111b60 con 0x7ffa88102a70 2024-08-19T00:24:35.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:35.415+0000 7ffa8e307640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ffa88111e60 con 0x7ffa8810bea0 2024-08-19T00:24:35.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:35.415+0000 7ffa7ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa88103390 0x7ffa881987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:35.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:35.415+0000 7ffa87fff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffa88102a70 0x7ffa881982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:35.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:35.415+0000 7ffa87fff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffa88102a70 0x7ffa881982a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.44:53076/0 (socket says 172.21.15.44:53076) 2024-08-19T00:24:35.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:35.415+0000 7ffa7ffff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa88103390 0x7ffa881987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56796/0 (socket says 172.21.15.44:56796) 2024-08-19T00:24:35.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:35.415+0000 7ffa87fff640 1 -- 172.21.15.44:0/4106008226 learned_addr learned my addr 172.21.15.44:0/4106008226 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:24:35.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:35.415+0000 7ffa8c8a4640 1 --2- 172.21.15.44:0/4106008226 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa8810bea0 0x7ffa8819cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:35.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:35.415+0000 7ffa7ffff640 1 -- 172.21.15.44:0/4106008226 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa8810bea0 msgr2=0x7ffa8819cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:35.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:35.415+0000 7ffa7ffff640 1 --2- 172.21.15.44:0/4106008226 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa8810bea0 0x7ffa8819cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:35.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:35.415+0000 7ffa7ffff640 1 -- 172.21.15.44:0/4106008226 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffa88102a70 msgr2=0x7ffa881982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:35.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:35.415+0000 7ffa7ffff640 1 --2- 172.21.15.44:0/4106008226 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffa88102a70 0x7ffa881982a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:35.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:35.415+0000 7ffa7ffff640 1 -- 172.21.15.44:0/4106008226 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa8819d250 con 0x7ffa88103390 2024-08-19T00:24:35.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:35.415+0000 7ffa8c8a4640 1 --2- 172.21.15.44:0/4106008226 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa8810bea0 0x7ffa8819cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:24:35.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:35.415+0000 7ffa87fff640 1 --2- 172.21.15.44:0/4106008226 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffa88102a70 0x7ffa881982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:24:35.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:35.415+0000 7ffa7ffff640 1 --2- 172.21.15.44:0/4106008226 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa88103390 0x7ffa881987e0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7ffa7000b490 tx=0x7ffa7000b950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:24:35.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:35.415+0000 7ffa85ffb640 1 -- 172.21.15.44:0/4106008226 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa70015020 con 0x7ffa88103390 2024-08-19T00:24:35.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:35.416+0000 7ffa85ffb640 1 -- 172.21.15.44:0/4106008226 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa70011d10 con 0x7ffa88103390 2024-08-19T00:24:35.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:35.416+0000 7ffa85ffb640 1 -- 172.21.15.44:0/4106008226 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa70010e60 con 0x7ffa88103390 2024-08-19T00:24:35.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:35.416+0000 7ffa8e307640 1 -- 172.21.15.44:0/4106008226 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa8819d540 con 0x7ffa88103390 2024-08-19T00:24:35.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:35.416+0000 7ffa8e307640 1 -- 172.21.15.44:0/4106008226 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa881a4e20 con 0x7ffa88103390 2024-08-19T00:24:35.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:35.417+0000 7ffa8e307640 1 -- 172.21.15.44:0/4106008226 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa88102e50 con 0x7ffa88103390 2024-08-19T00:24:35.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:35.418+0000 7ffa85ffb640 1 -- 172.21.15.44:0/4106008226 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7ffa70018020 con 0x7ffa88103390 2024-08-19T00:24:35.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:35.418+0000 7ffa85ffb640 1 --2- 172.21.15.44:0/4106008226 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7ffa740a2cf0 0x7ffa740a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:35.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:35.419+0000 7ffa87fff640 1 --2- 172.21.15.44:0/4106008226 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7ffa740a2cf0 0x7ffa740a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:35.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:35.419+0000 7ffa85ffb640 1 -- 172.21.15.44:0/4106008226 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 9533+0+0 (secure 0 0 0) 0x7ffa700cf560 con 0x7ffa88103390 2024-08-19T00:24:35.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:35.419+0000 7ffa87fff640 1 --2- 172.21.15.44:0/4106008226 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7ffa740a2cf0 0x7ffa740a51b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ffa780096c0 tx=0x7ffa78005a20 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:24:35.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:35.422+0000 7ffa85ffb640 1 -- 172.21.15.44:0/4106008226 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7ffa7001f020 con 0x7ffa88103390 2024-08-19T00:24:35.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:35.633+0000 7ffa8e307640 1 -- 172.21.15.44:0/4106008226 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffa88106f70 con 0x7ffa88103390 2024-08-19T00:24:35.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:35.634+0000 7ffa85ffb640 1 -- 172.21.15.44:0/4106008226 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11989 (secure 0 0 0) 0x7ffa7009be40 con 0x7ffa88103390 2024-08-19T00:24:35.636 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:24:35.637 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":33,"btime":"2024-08-19T00:17:11:640526+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14511,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1538841896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1538841896},{"type":"v1","addr":"172.21.15.116:6833","nonce":1538841896}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/4044471606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4044471606},{"type":"v1","addr":"172.21.15.44:6835","nonce":4044471606}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":33,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-19T00:10:53.196636+0000","modified":"2024-08-19T00:17:11.586031+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24473,"mds_1":24446,"mds_2":24439,"mds_3":24431,"mds_4":24418},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14529":{"gid":14529,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6837/1824829052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1824829052},{"type":"v1","addr":"172.21.15.44:6837","nonce":1824829052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14577":{"gid":14577,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6839/3591739042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":3591739042},{"type":"v1","addr":"172.21.15.44:6839","nonce":3591739042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14589":{"gid":14589,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6841/3667695717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6840","nonce":3667695717},{"type":"v1","addr":"172.21.15.44:6841","nonce":3667695717}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24388":{"gid":24388,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1183022838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1183022838},{"type":"v1","addr":"172.21.15.171:6833","nonce":1183022838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6835/2190623851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":2190623851},{"type":"v1","addr":"172.21.15.171:6835","nonce":2190623851}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.171:6837/316231795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":316231795},{"type":"v1","addr":"172.21.15.171:6837","nonce":316231795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":20,"addr":"172.21.15.116:6835/3507399322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3507399322},{"type":"v1","addr":"172.21.15.116:6835","nonce":3507399322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.171:6839/1466585795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":1466585795},{"type":"v1","addr":"172.21.15.171:6839","nonce":1466585795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":17,"addr":"172.21.15.116:6837/2764513846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":2764513846},{"type":"v1","addr":"172.21.15.116:6837","nonce":2764513846}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.116:6839/1032741033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":1032741033},{"type":"v1","addr":"172.21.15.116:6839","nonce":1032741033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24446,24439,24431,24418]},"id":1}]} 2024-08-19T00:24:35.638 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 33 2024-08-19T00:24:35.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:35.636+0000 7ffa8e307640 1 -- 172.21.15.44:0/4106008226 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7ffa740a2cf0 msgr2=0x7ffa740a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:35.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:35.636+0000 7ffa8e307640 1 --2- 172.21.15.44:0/4106008226 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7ffa740a2cf0 0x7ffa740a51b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ffa780096c0 tx=0x7ffa78005a20 comp rx=0 tx=0).stop 2024-08-19T00:24:35.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:35.636+0000 7ffa8e307640 1 -- 172.21.15.44:0/4106008226 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa88103390 msgr2=0x7ffa881987e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:35.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:35.636+0000 7ffa8e307640 1 --2- 172.21.15.44:0/4106008226 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa88103390 0x7ffa881987e0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7ffa7000b490 tx=0x7ffa7000b950 comp rx=0 tx=0).stop 2024-08-19T00:24:35.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:35.636+0000 7ffa8e307640 1 -- 172.21.15.44:0/4106008226 shutdown_connections 2024-08-19T00:24:35.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:35.636+0000 7ffa8e307640 1 --2- 172.21.15.44:0/4106008226 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7ffa740a2cf0 0x7ffa740a51b0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:35.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:35.636+0000 7ffa8e307640 1 --2- 172.21.15.44:0/4106008226 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa8810bea0 0x7ffa8819cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:35.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:35.636+0000 7ffa8e307640 1 --2- 172.21.15.44:0/4106008226 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa88103390 0x7ffa881987e0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:35.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:35.636+0000 7ffa8e307640 1 --2- 172.21.15.44:0/4106008226 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffa88102a70 0x7ffa881982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:35.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:35.636+0000 7ffa8e307640 1 -- 172.21.15.44:0/4106008226 >> 172.21.15.44:0/4106008226 conn(0x7ffa880fc4d0 msgr2=0x7ffa880fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:24:35.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:35.636+0000 7ffa8e307640 1 -- 172.21.15.44:0/4106008226 shutdown_connections 2024-08-19T00:24:35.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:35.636+0000 7ffa8e307640 1 -- 172.21.15.44:0/4106008226 wait complete. 2024-08-19T00:24:36.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:36 smithi171 ceph-mon[21810]: pgmap v351: 129 pgs: 129 active+clean; 540 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 956 KiB/s wr, 45 op/s 2024-08-19T00:24:36.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:36 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/4106008226' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:24:36.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:36 smithi116 ceph-mon[21873]: pgmap v351: 129 pgs: 129 active+clean; 540 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 956 KiB/s wr, 45 op/s 2024-08-19T00:24:36.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:36 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/4106008226' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:24:36.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:36 smithi044 ceph-mon[18489]: pgmap v351: 129 pgs: 129 active+clean; 540 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 956 KiB/s wr, 45 op/s 2024-08-19T00:24:36.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:36 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/4106008226' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:24:36.456 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-19T00:24:36.728 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:24:37.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:37.211+0000 7f7431aac640 1 -- 172.21.15.44:0/460552999 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f742c100b50 msgr2=0x7f742c100f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:37.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:37.211+0000 7f7431aac640 1 --2- 172.21.15.44:0/460552999 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f742c100b50 0x7f742c100f30 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f741c009900 tx=0x7f741c02a480 comp rx=0 tx=0).stop 2024-08-19T00:24:37.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:37.211+0000 7f7431aac640 1 -- 172.21.15.44:0/460552999 shutdown_connections 2024-08-19T00:24:37.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:37.211+0000 7f7431aac640 1 --2- 172.21.15.44:0/460552999 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f742c1022a0 0x7f742c1026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:37.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:37.211+0000 7f7431aac640 1 --2- 172.21.15.44:0/460552999 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f742c102c20 0x7f742c10d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:37.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:37.211+0000 7f7431aac640 1 --2- 172.21.15.44:0/460552999 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f742c100b50 0x7f742c100f30 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:37.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:37.211+0000 7f7431aac640 1 -- 172.21.15.44:0/460552999 >> 172.21.15.44:0/460552999 conn(0x7f742c0fc500 msgr2=0x7f742c0fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:24:37.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:37.211+0000 7f7431aac640 1 -- 172.21.15.44:0/460552999 shutdown_connections 2024-08-19T00:24:37.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:37.211+0000 7f7431aac640 1 -- 172.21.15.44:0/460552999 wait complete. 2024-08-19T00:24:37.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:37.211+0000 7f7431aac640 1 Processor -- start 2024-08-19T00:24:37.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:37.212+0000 7f7431aac640 1 -- start start 2024-08-19T00:24:37.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:37.212+0000 7f7431aac640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f742c100b50 0x7f742c197190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:37.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:37.212+0000 7f7431aac640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f742c1022a0 0x7f742c1976d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:37.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:37.212+0000 7f7431aac640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f742c102c20 0x7f742c19ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:37.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:37.212+0000 7f7431aac640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f742c110cb0 con 0x7f742c1022a0 2024-08-19T00:24:37.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:37.212+0000 7f7431aac640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f742c110b30 con 0x7f742c100b50 2024-08-19T00:24:37.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:37.212+0000 7f7431aac640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f742c110e30 con 0x7f742c102c20 2024-08-19T00:24:37.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:37.212+0000 7f742affd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f742c1022a0 0x7f742c1976d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:37.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:37.212+0000 7f742affd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f742c1022a0 0x7f742c1976d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56806/0 (socket says 172.21.15.44:56806) 2024-08-19T00:24:37.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:37.212+0000 7f742affd640 1 -- 172.21.15.44:0/1425181572 learned_addr learned my addr 172.21.15.44:0/1425181572 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:24:37.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:37.212+0000 7f742b7fe640 1 --2- 172.21.15.44:0/1425181572 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f742c100b50 0x7f742c197190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:37.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:37.212+0000 7f742bfff640 1 --2- 172.21.15.44:0/1425181572 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f742c102c20 0x7f742c19ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:37.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:37.212+0000 7f742affd640 1 -- 172.21.15.44:0/1425181572 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f742c102c20 msgr2=0x7f742c19ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:37.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:37.212+0000 7f742affd640 1 --2- 172.21.15.44:0/1425181572 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f742c102c20 0x7f742c19ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:37.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:37.212+0000 7f742affd640 1 -- 172.21.15.44:0/1425181572 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f742c100b50 msgr2=0x7f742c197190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:37.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:37.212+0000 7f742affd640 1 --2- 172.21.15.44:0/1425181572 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f742c100b50 0x7f742c197190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:37.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:37.212+0000 7f742affd640 1 -- 172.21.15.44:0/1425181572 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f742c19c140 con 0x7f742c1022a0 2024-08-19T00:24:37.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:37.213+0000 7f742bfff640 1 --2- 172.21.15.44:0/1425181572 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f742c102c20 0x7f742c19ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:24:37.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:37.213+0000 7f742affd640 1 --2- 172.21.15.44:0/1425181572 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f742c1022a0 0x7f742c1976d0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f742000d770 tx=0x7f742000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:24:37.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:37.213+0000 7f7428ff9640 1 -- 172.21.15.44:0/1425181572 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7420017070 con 0x7f742c1022a0 2024-08-19T00:24:37.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:37.213+0000 7f7431aac640 1 -- 172.21.15.44:0/1425181572 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f742c19c430 con 0x7f742c1022a0 2024-08-19T00:24:37.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:37.213+0000 7f7428ff9640 1 -- 172.21.15.44:0/1425181572 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7420005500 con 0x7f742c1022a0 2024-08-19T00:24:37.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:37.213+0000 7f7428ff9640 1 -- 172.21.15.44:0/1425181572 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7420004e00 con 0x7f742c1022a0 2024-08-19T00:24:37.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:37.213+0000 7f7431aac640 1 -- 172.21.15.44:0/1425181572 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f742c069ca0 con 0x7f742c1022a0 2024-08-19T00:24:37.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:37.214+0000 7f7431aac640 1 -- 172.21.15.44:0/1425181572 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f742c100f30 con 0x7f742c1022a0 2024-08-19T00:24:37.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:37.215+0000 7f7428ff9640 1 -- 172.21.15.44:0/1425181572 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f7420004fa0 con 0x7f742c1022a0 2024-08-19T00:24:37.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:37.216+0000 7f7428ff9640 1 --2- 172.21.15.44:0/1425181572 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f74140a2cf0 0x7f74140a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:37.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:37.216+0000 7f742b7fe640 1 --2- 172.21.15.44:0/1425181572 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f74140a2cf0 0x7f74140a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:37.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:37.216+0000 7f7428ff9640 1 -- 172.21.15.44:0/1425181572 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 9533+0+0 (secure 0 0 0) 0x7f74200cf7a0 con 0x7f742c1022a0 2024-08-19T00:24:37.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:37.216+0000 7f742b7fe640 1 --2- 172.21.15.44:0/1425181572 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f74140a2cf0 0x7f74140a51b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f741c005ab0 tx=0x7f741c005a20 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:24:37.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:37.223+0000 7f7428ff9640 1 -- 172.21.15.44:0/1425181572 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f742009bfd0 con 0x7f742c1022a0 2024-08-19T00:24:37.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:37.438+0000 7f7431aac640 1 -- 172.21.15.44:0/1425181572 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f742c06a6c0 con 0x7f742c1022a0 2024-08-19T00:24:37.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:37.439+0000 7f7428ff9640 1 -- 172.21.15.44:0/1425181572 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11989 (secure 0 0 0) 0x7f742009b8d0 con 0x7f742c1022a0 2024-08-19T00:24:37.441 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:24:37.441 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":33,"btime":"2024-08-19T00:17:11:640526+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14511,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/1538841896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1538841896},{"type":"v1","addr":"172.21.15.116:6833","nonce":1538841896}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14517,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/4044471606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4044471606},{"type":"v1","addr":"172.21.15.44:6835","nonce":4044471606}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":33,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-19T00:10:53.196636+0000","modified":"2024-08-19T00:17:11.586031+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24473,"mds_1":24446,"mds_2":24439,"mds_3":24431,"mds_4":24418},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14529":{"gid":14529,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6837/1824829052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1824829052},{"type":"v1","addr":"172.21.15.44:6837","nonce":1824829052}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14577":{"gid":14577,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6839/3591739042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":3591739042},{"type":"v1","addr":"172.21.15.44:6839","nonce":3591739042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14589":{"gid":14589,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6841/3667695717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6840","nonce":3667695717},{"type":"v1","addr":"172.21.15.44:6841","nonce":3667695717}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24388":{"gid":24388,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6833/1183022838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1183022838},{"type":"v1","addr":"172.21.15.171:6833","nonce":1183022838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24412":{"gid":24412,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6835/2190623851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":2190623851},{"type":"v1","addr":"172.21.15.171:6835","nonce":2190623851}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.171:6837/316231795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":316231795},{"type":"v1","addr":"172.21.15.171:6837","nonce":316231795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":20,"addr":"172.21.15.116:6835/3507399322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3507399322},{"type":"v1","addr":"172.21.15.116:6835","nonce":3507399322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.171:6839/1466585795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":1466585795},{"type":"v1","addr":"172.21.15.171:6839","nonce":1466585795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":17,"addr":"172.21.15.116:6837/2764513846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":2764513846},{"type":"v1","addr":"172.21.15.116:6837","nonce":2764513846}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.116:6839/1032741033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":1032741033},{"type":"v1","addr":"172.21.15.116:6839","nonce":1032741033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24446,24439,24431,24418]},"id":1}]} 2024-08-19T00:24:37.442 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 33 2024-08-19T00:24:37.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:37.441+0000 7f7431aac640 1 -- 172.21.15.44:0/1425181572 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f74140a2cf0 msgr2=0x7f74140a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:37.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:37.441+0000 7f7431aac640 1 --2- 172.21.15.44:0/1425181572 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f74140a2cf0 0x7f74140a51b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f741c005ab0 tx=0x7f741c005a20 comp rx=0 tx=0).stop 2024-08-19T00:24:37.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:37.441+0000 7f7431aac640 1 -- 172.21.15.44:0/1425181572 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f742c1022a0 msgr2=0x7f742c1976d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:37.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:37.441+0000 7f7431aac640 1 --2- 172.21.15.44:0/1425181572 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f742c1022a0 0x7f742c1976d0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f742000d770 tx=0x7f742000dc30 comp rx=0 tx=0).stop 2024-08-19T00:24:37.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:37.441+0000 7f7431aac640 1 -- 172.21.15.44:0/1425181572 shutdown_connections 2024-08-19T00:24:37.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:37.441+0000 7f7431aac640 1 --2- 172.21.15.44:0/1425181572 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f74140a2cf0 0x7f74140a51b0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:37.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:37.441+0000 7f7431aac640 1 --2- 172.21.15.44:0/1425181572 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f742c102c20 0x7f742c19ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:37.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:37.441+0000 7f7431aac640 1 --2- 172.21.15.44:0/1425181572 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f742c1022a0 0x7f742c1976d0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:37.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:37.441+0000 7f7431aac640 1 --2- 172.21.15.44:0/1425181572 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f742c100b50 0x7f742c197190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:37.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:37.441+0000 7f7431aac640 1 -- 172.21.15.44:0/1425181572 >> 172.21.15.44:0/1425181572 conn(0x7f742c0fc500 msgr2=0x7f742c0fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:24:37.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:37.441+0000 7f7431aac640 1 -- 172.21.15.44:0/1425181572 shutdown_connections 2024-08-19T00:24:37.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:37.441+0000 7f7431aac640 1 -- 172.21.15.44:0/1425181572 wait complete. 2024-08-19T00:24:38.095 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-19T00:24:38.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:38 smithi171 ceph-mon[21810]: pgmap v352: 129 pgs: 129 active+clean; 540 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 940 KiB/s wr, 41 op/s 2024-08-19T00:24:38.347 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:38 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/1425181572' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:24:38.353 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:24:38.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:38 smithi116 ceph-mon[21873]: pgmap v352: 129 pgs: 129 active+clean; 540 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 940 KiB/s wr, 41 op/s 2024-08-19T00:24:38.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:38 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/1425181572' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:24:38.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:38 smithi044 ceph-mon[18489]: pgmap v352: 129 pgs: 129 active+clean; 540 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 940 KiB/s wr, 41 op/s 2024-08-19T00:24:38.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:38 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/1425181572' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:24:38.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:38.844+0000 7f63ab59e640 1 -- 172.21.15.44:0/608891413 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63ac101700 msgr2=0x7f63ac101b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:38.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:38.844+0000 7f63ab59e640 1 --2- 172.21.15.44:0/608891413 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63ac101700 0x7f63ac101b60 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f63a0009930 tx=0x7f63a002a420 comp rx=0 tx=0).stop 2024-08-19T00:24:38.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:38.844+0000 7f63ab59e640 1 -- 172.21.15.44:0/608891413 shutdown_connections 2024-08-19T00:24:38.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:38.844+0000 7f63ab59e640 1 --2- 172.21.15.44:0/608891413 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f63ac1020a0 0x7f63ac10e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:38.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:38.844+0000 7f63ab59e640 1 --2- 172.21.15.44:0/608891413 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63ac101700 0x7f63ac101b60 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:38.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:38.844+0000 7f63ab59e640 1 --2- 172.21.15.44:0/608891413 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f63ac107700 0x7f63ac107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:38.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:38.844+0000 7f63ab59e640 1 -- 172.21.15.44:0/608891413 >> 172.21.15.44:0/608891413 conn(0x7f63ac0fd440 msgr2=0x7f63ac0ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:24:38.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:38.844+0000 7f63ab59e640 1 -- 172.21.15.44:0/608891413 shutdown_connections 2024-08-19T00:24:38.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:38.844+0000 7f63ab59e640 1 -- 172.21.15.44:0/608891413 wait complete. 2024-08-19T00:24:38.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:38.845+0000 7f63ab59e640 1 Processor -- start 2024-08-19T00:24:38.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:38.845+0000 7f63ab59e640 1 -- start start 2024-08-19T00:24:38.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:38.845+0000 7f63ab59e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f63ac101700 0x7f63ac19a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:38.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:38.845+0000 7f63ab59e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f63ac1020a0 0x7f63ac19a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:38.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:38.845+0000 7f63ab59e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63ac107700 0x7f63ac19eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:38.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:38.845+0000 7f63ab59e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f63ac111b40 con 0x7f63ac107700 2024-08-19T00:24:38.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:38.845+0000 7f63ab59e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f63ac1119c0 con 0x7f63ac101700 2024-08-19T00:24:38.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:38.845+0000 7f63ab59e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f63ac111cc0 con 0x7f63ac1020a0 2024-08-19T00:24:38.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:38.845+0000 7f63aad9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63ac107700 0x7f63ac19eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:38.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:38.845+0000 7f63aad9d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63ac107700 0x7f63ac19eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41172/0 (socket says 172.21.15.44:41172) 2024-08-19T00:24:38.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:38.845+0000 7f63aad9d640 1 -- 172.21.15.44:0/1649314925 learned_addr learned my addr 172.21.15.44:0/1649314925 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:24:38.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:38.845+0000 7f63aa59c640 1 --2- 172.21.15.44:0/1649314925 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f63ac101700 0x7f63ac19a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:38.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:38.845+0000 7f63a9d9b640 1 --2- 172.21.15.44:0/1649314925 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f63ac1020a0 0x7f63ac19a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:38.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:38.846+0000 7f63aad9d640 1 -- 172.21.15.44:0/1649314925 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f63ac1020a0 msgr2=0x7f63ac19a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:38.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:38.846+0000 7f63aad9d640 1 --2- 172.21.15.44:0/1649314925 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f63ac1020a0 0x7f63ac19a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:38.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:38.846+0000 7f63aad9d640 1 -- 172.21.15.44:0/1649314925 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f63ac101700 msgr2=0x7f63ac19a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:38.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:38.846+0000 7f63aad9d640 1 --2- 172.21.15.44:0/1649314925 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f63ac101700 0x7f63ac19a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:38.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:38.846+0000 7f63aad9d640 1 -- 172.21.15.44:0/1649314925 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63ac19f270 con 0x7f63ac107700 2024-08-19T00:24:38.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:38.846+0000 7f63a9d9b640 1 --2- 172.21.15.44:0/1649314925 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f63ac1020a0 0x7f63ac19a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:24:38.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:38.846+0000 7f63aad9d640 1 --2- 172.21.15.44:0/1649314925 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63ac107700 0x7f63ac19eb90 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f63a400d750 tx=0x7f63a400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:24:38.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:38.846+0000 7f639b7fe640 1 -- 172.21.15.44:0/1649314925 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a4017070 con 0x7f63ac107700 2024-08-19T00:24:38.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:38.846+0000 7f639b7fe640 1 -- 172.21.15.44:0/1649314925 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f63a4005500 con 0x7f63ac107700 2024-08-19T00:24:38.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:38.846+0000 7f63ab59e640 1 -- 172.21.15.44:0/1649314925 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63ac19f560 con 0x7f63ac107700 2024-08-19T00:24:38.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:38.846+0000 7f639b7fe640 1 -- 172.21.15.44:0/1649314925 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a4004d90 con 0x7f63ac107700 2024-08-19T00:24:38.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:38.846+0000 7f63ab59e640 1 -- 172.21.15.44:0/1649314925 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63ac1a6e40 con 0x7f63ac107700 2024-08-19T00:24:38.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:38.847+0000 7f63ab59e640 1 -- 172.21.15.44:0/1649314925 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63ac101b60 con 0x7f63ac107700 2024-08-19T00:24:38.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:38.848+0000 7f639b7fe640 1 -- 172.21.15.44:0/1649314925 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f63a4004f30 con 0x7f63ac107700 2024-08-19T00:24:38.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:38.849+0000 7f639b7fe640 1 --2- 172.21.15.44:0/1649314925 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f63940a2cf0 0x7f63940a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:38.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:38.849+0000 7f63aa59c640 1 --2- 172.21.15.44:0/1649314925 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f63940a2cf0 0x7f63940a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:38.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:38.849+0000 7f639b7fe640 1 -- 172.21.15.44:0/1649314925 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 9533+0+0 (secure 0 0 0) 0x7f63a40cf5e0 con 0x7f63ac107700 2024-08-19T00:24:38.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:38.850+0000 7f63aa59c640 1 --2- 172.21.15.44:0/1649314925 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f63940a2cf0 0x7f63940a51b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f639c00a400 tx=0x7f639c00d040 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:24:38.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:38.852+0000 7f639b7fe640 1 -- 172.21.15.44:0/1649314925 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f63a409be10 con 0x7f63ac107700 2024-08-19T00:24:39.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:39.030+0000 7f63ab59e640 1 -- 172.21.15.44:0/1649314925 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f63ac1a7010 con 0x7f63ac107700 2024-08-19T00:24:39.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:39.032+0000 7f639b7fe640 1 -- 172.21.15.44:0/1649314925 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v105) ==== 74+0+25363 (secure 0 0 0) 0x7f63a409b710 con 0x7f63ac107700 2024-08-19T00:24:39.034 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-08-19T00:24:39.034 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":105,"fsid":"647ded64-5dbe-11ef-bccf-c7b262605968","created":"2024-08-19T00:03:43.667929+0000","modified":"2024-08-19T00:24:13.906676+0000","last_up_change":"2024-08-19T00:10:01.557590+0000","last_in_change":"2024-08-19T00:09:42.433933+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T00:06:42.706553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-19T00:10:48.735065+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-19T00:10:51.481810+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":104,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-19T00:10:58.013004+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":104,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b15ad904-d07d-4ecb-be8f-d99323425eed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":600251465},{"type":"v1","addr":"172.21.15.44:6803","nonce":600251465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":600251465},{"type":"v1","addr":"172.21.15.44:6805","nonce":600251465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":600251465},{"type":"v1","addr":"172.21.15.44:6809","nonce":600251465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":600251465},{"type":"v1","addr":"172.21.15.44:6807","nonce":600251465}]},"public_addr":"172.21.15.44:6803/600251465","cluster_addr":"172.21.15.44:6805/600251465","heartbeat_back_addr":"172.21.15.44:6809/600251465","heartbeat_front_addr":"172.21.15.44:6807/600251465","state":["exists","up"]},{"osd":1,"uuid":"8f70512f-21a3-4fec-8278-04b2bc9b2d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":613509556},{"type":"v1","addr":"172.21.15.116:6801","nonce":613509556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":613509556},{"type":"v1","addr":"172.21.15.116:6803","nonce":613509556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":613509556},{"type":"v1","addr":"172.21.15.116:6807","nonce":613509556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":613509556},{"type":"v1","addr":"172.21.15.116:6805","nonce":613509556}]},"public_addr":"172.21.15.116:6801/613509556","cluster_addr":"172.21.15.116:6803/613509556","heartbeat_back_addr":"172.21.15.116:6807/613509556","heartbeat_front_addr":"172.21.15.116:6805/613509556","state":["exists","up"]},{"osd":2,"uuid":"56994dfd-5fcf-4d82-addf-38764239d82a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":2130938937},{"type":"v1","addr":"172.21.15.171:6801","nonce":2130938937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":2130938937},{"type":"v1","addr":"172.21.15.171:6803","nonce":2130938937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":2130938937},{"type":"v1","addr":"172.21.15.171:6807","nonce":2130938937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":2130938937},{"type":"v1","addr":"172.21.15.171:6805","nonce":2130938937}]},"public_addr":"172.21.15.171:6801/2130938937","cluster_addr":"172.21.15.171:6803/2130938937","heartbeat_back_addr":"172.21.15.171:6807/2130938937","heartbeat_front_addr":"172.21.15.171:6805/2130938937","state":["exists","up"]},{"osd":3,"uuid":"6d2ddb19-74e0-4e68-b9ea-58b73fd1e9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":3537027669},{"type":"v1","addr":"172.21.15.44:6811","nonce":3537027669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":3537027669},{"type":"v1","addr":"172.21.15.44:6813","nonce":3537027669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3537027669},{"type":"v1","addr":"172.21.15.44:6817","nonce":3537027669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":3537027669},{"type":"v1","addr":"172.21.15.44:6815","nonce":3537027669}]},"public_addr":"172.21.15.44:6811/3537027669","cluster_addr":"172.21.15.44:6813/3537027669","heartbeat_back_addr":"172.21.15.44:6817/3537027669","heartbeat_front_addr":"172.21.15.44:6815/3537027669","state":["exists","up"]},{"osd":4,"uuid":"190d208e-ae54-497d-ad72-d07a5a26991b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":3768627455},{"type":"v1","addr":"172.21.15.116:6809","nonce":3768627455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":3768627455},{"type":"v1","addr":"172.21.15.116:6811","nonce":3768627455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":3768627455},{"type":"v1","addr":"172.21.15.116:6815","nonce":3768627455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":3768627455},{"type":"v1","addr":"172.21.15.116:6813","nonce":3768627455}]},"public_addr":"172.21.15.116:6809/3768627455","cluster_addr":"172.21.15.116:6811/3768627455","heartbeat_back_addr":"172.21.15.116:6815/3768627455","heartbeat_front_addr":"172.21.15.116:6813/3768627455","state":["exists","up"]},{"osd":5,"uuid":"d8afacad-6d3d-4703-9744-8d01ff2a2047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":938785018},{"type":"v1","addr":"172.21.15.171:6809","nonce":938785018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":938785018},{"type":"v1","addr":"172.21.15.171:6811","nonce":938785018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":938785018},{"type":"v1","addr":"172.21.15.171:6815","nonce":938785018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":938785018},{"type":"v1","addr":"172.21.15.171:6813","nonce":938785018}]},"public_addr":"172.21.15.171:6809/938785018","cluster_addr":"172.21.15.171:6811/938785018","heartbeat_back_addr":"172.21.15.171:6815/938785018","heartbeat_front_addr":"172.21.15.171:6813/938785018","state":["exists","up"]},{"osd":6,"uuid":"55bf1f89-99e5-409d-99fa-f0124aa042df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":1219334797},{"type":"v1","addr":"172.21.15.44:6819","nonce":1219334797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":1219334797},{"type":"v1","addr":"172.21.15.44:6821","nonce":1219334797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":1219334797},{"type":"v1","addr":"172.21.15.44:6825","nonce":1219334797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":1219334797},{"type":"v1","addr":"172.21.15.44:6823","nonce":1219334797}]},"public_addr":"172.21.15.44:6819/1219334797","cluster_addr":"172.21.15.44:6821/1219334797","heartbeat_back_addr":"172.21.15.44:6825/1219334797","heartbeat_front_addr":"172.21.15.44:6823/1219334797","state":["exists","up"]},{"osd":7,"uuid":"70130d71-d28c-4a58-b603-75610c8d3ea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":3861873415},{"type":"v1","addr":"172.21.15.116:6817","nonce":3861873415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":3861873415},{"type":"v1","addr":"172.21.15.116:6819","nonce":3861873415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":3861873415},{"type":"v1","addr":"172.21.15.116:6823","nonce":3861873415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":3861873415},{"type":"v1","addr":"172.21.15.116:6821","nonce":3861873415}]},"public_addr":"172.21.15.116:6817/3861873415","cluster_addr":"172.21.15.116:6819/3861873415","heartbeat_back_addr":"172.21.15.116:6823/3861873415","heartbeat_front_addr":"172.21.15.116:6821/3861873415","state":["exists","up"]},{"osd":8,"uuid":"c5121f70-e423-4f86-a3c6-90945c9385f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":843701060},{"type":"v1","addr":"172.21.15.171:6817","nonce":843701060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":843701060},{"type":"v1","addr":"172.21.15.171:6819","nonce":843701060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":843701060},{"type":"v1","addr":"172.21.15.171:6823","nonce":843701060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":843701060},{"type":"v1","addr":"172.21.15.171:6821","nonce":843701060}]},"public_addr":"172.21.15.171:6817/843701060","cluster_addr":"172.21.15.171:6819/843701060","heartbeat_back_addr":"172.21.15.171:6823/843701060","heartbeat_front_addr":"172.21.15.171:6821/843701060","state":["exists","up"]},{"osd":9,"uuid":"cd13693a-0f25-47cc-b1a5-9c42481935ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3206550013},{"type":"v1","addr":"172.21.15.44:6827","nonce":3206550013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":3206550013},{"type":"v1","addr":"172.21.15.44:6829","nonce":3206550013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3206550013},{"type":"v1","addr":"172.21.15.44:6833","nonce":3206550013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3206550013},{"type":"v1","addr":"172.21.15.44:6831","nonce":3206550013}]},"public_addr":"172.21.15.44:6827/3206550013","cluster_addr":"172.21.15.44:6829/3206550013","heartbeat_back_addr":"172.21.15.44:6833/3206550013","heartbeat_front_addr":"172.21.15.44:6831/3206550013","state":["exists","up"]},{"osd":10,"uuid":"a36ffeb1-6ecf-4899-bdfa-18515afefb86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3034738363},{"type":"v1","addr":"172.21.15.116:6825","nonce":3034738363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3034738363},{"type":"v1","addr":"172.21.15.116:6827","nonce":3034738363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3034738363},{"type":"v1","addr":"172.21.15.116:6831","nonce":3034738363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3034738363},{"type":"v1","addr":"172.21.15.116:6829","nonce":3034738363}]},"public_addr":"172.21.15.116:6825/3034738363","cluster_addr":"172.21.15.116:6827/3034738363","heartbeat_back_addr":"172.21.15.116:6831/3034738363","heartbeat_front_addr":"172.21.15.116:6829/3034738363","state":["exists","up"]},{"osd":11,"uuid":"ffcf44a8-3094-4a29-822e-a6ce95da119e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":1500842656},{"type":"v1","addr":"172.21.15.171:6825","nonce":1500842656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":1500842656},{"type":"v1","addr":"172.21.15.171:6827","nonce":1500842656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":1500842656},{"type":"v1","addr":"172.21.15.171:6831","nonce":1500842656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":1500842656},{"type":"v1","addr":"172.21.15.171:6829","nonce":1500842656}]},"public_addr":"172.21.15.171:6825/1500842656","cluster_addr":"172.21.15.171:6827/1500842656","heartbeat_back_addr":"172.21.15.171:6831/1500842656","heartbeat_front_addr":"172.21.15.171:6829/1500842656","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:05:56.916127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:06:17.603805+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:06:38.642970+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:07:00.667062+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:07:22.542529+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:07:44.732304+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:08:07.050742+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:08:29.451498+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:08:52.222169+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:09:15.422629+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:09:37.295311+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:09:59.716431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":7}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9},{"from":5,"to":8}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:0/1732405694":"2024-08-20T00:13:18.502685+0000","172.21.15.44:0/2504116080":"2024-08-20T00:13:18.502685+0000","172.21.15.44:6800/1374527587":"2024-08-20T00:04:14.604141+0000","172.21.15.44:0/1869412718":"2024-08-20T00:04:14.604141+0000","172.21.15.44:0/3023439260":"2024-08-20T00:13:18.502685+0000","172.21.15.44:0/911382683":"2024-08-20T00:04:14.604141+0000","172.21.15.44:0/3096491642":"2024-08-20T00:04:14.604141+0000","172.21.15.44:0/400419582":"2024-08-20T00:04:38.392912+0000","172.21.15.44:0/3800526625":"2024-08-20T00:04:38.392912+0000","172.21.15.44:6801/1374527587":"2024-08-20T00:04:14.604141+0000","172.21.15.44:0/1001446555":"2024-08-20T00:04:38.392912+0000","172.21.15.44:0/3489931602":"2024-08-20T00:13:18.502685+0000","172.21.15.44:6800/1330072146":"2024-08-20T00:13:18.502685+0000","172.21.15.44:6801/1300308907":"2024-08-20T00:04:38.392912+0000","172.21.15.44:6800/1300308907":"2024-08-20T00:04:38.392912+0000","172.21.15.44:6801/1330072146":"2024-08-20T00:13:18.502685+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]},{"pool":4,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:24:39.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:39.034+0000 7f63ab59e640 1 -- 172.21.15.44:0/1649314925 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f63940a2cf0 msgr2=0x7f63940a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:39.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:39.034+0000 7f63ab59e640 1 --2- 172.21.15.44:0/1649314925 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f63940a2cf0 0x7f63940a51b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f639c00a400 tx=0x7f639c00d040 comp rx=0 tx=0).stop 2024-08-19T00:24:39.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:39.034+0000 7f63ab59e640 1 -- 172.21.15.44:0/1649314925 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63ac107700 msgr2=0x7f63ac19eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:39.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:39.034+0000 7f63ab59e640 1 --2- 172.21.15.44:0/1649314925 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63ac107700 0x7f63ac19eb90 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f63a400d750 tx=0x7f63a400dc10 comp rx=0 tx=0).stop 2024-08-19T00:24:39.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:39.034+0000 7f63ab59e640 1 -- 172.21.15.44:0/1649314925 shutdown_connections 2024-08-19T00:24:39.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:39.034+0000 7f63ab59e640 1 --2- 172.21.15.44:0/1649314925 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f63940a2cf0 0x7f63940a51b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:39.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:39.034+0000 7f63ab59e640 1 --2- 172.21.15.44:0/1649314925 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f63ac1020a0 0x7f63ac19a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:39.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:39.034+0000 7f63ab59e640 1 --2- 172.21.15.44:0/1649314925 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63ac107700 0x7f63ac19eb90 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:39.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:39.034+0000 7f63ab59e640 1 --2- 172.21.15.44:0/1649314925 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f63ac101700 0x7f63ac19a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:39.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:39.034+0000 7f63ab59e640 1 -- 172.21.15.44:0/1649314925 >> 172.21.15.44:0/1649314925 conn(0x7f63ac0fd440 msgr2=0x7f63ac10cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:24:39.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:39.034+0000 7f63ab59e640 1 -- 172.21.15.44:0/1649314925 shutdown_connections 2024-08-19T00:24:39.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:39.034+0000 7f63ab59e640 1 -- 172.21.15.44:0/1649314925 wait complete. 2024-08-19T00:24:39.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:39 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/1649314925' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-19T00:24:39.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:39 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/1649314925' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-19T00:24:39.370 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:39 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/1649314925' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-19T00:24:39.706 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph fs fail cephfs 2024-08-19T00:24:39.963 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:24:40.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:40 smithi171 ceph-mon[21810]: pgmap v353: 129 pgs: 129 active+clean; 540 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 940 KiB/s wr, 41 op/s 2024-08-19T00:24:40.363 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:40 smithi044 ceph-mon[18489]: pgmap v353: 129 pgs: 129 active+clean; 540 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 940 KiB/s wr, 41 op/s 2024-08-19T00:24:40.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:40 smithi116 ceph-mon[21873]: pgmap v353: 129 pgs: 129 active+clean; 540 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 940 KiB/s wr, 41 op/s 2024-08-19T00:24:40.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:40.445+0000 7fbfe1d6e640 1 -- 172.21.15.44:0/4004010301 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbfdc1067b0 msgr2=0x7fbfdc106b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:40.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:40.445+0000 7fbfe1d6e640 1 --2- 172.21.15.44:0/4004010301 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbfdc1067b0 0x7fbfdc106b90 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc009930 tx=0x7fbfcc02a420 comp rx=0 tx=0).stop 2024-08-19T00:24:40.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:40.445+0000 7fbfe1d6e640 1 -- 172.21.15.44:0/4004010301 shutdown_connections 2024-08-19T00:24:40.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:40.445+0000 7fbfe1d6e640 1 --2- 172.21.15.44:0/4004010301 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbfdc101150 0x7fbfdc10d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:40.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:40.445+0000 7fbfe1d6e640 1 --2- 172.21.15.44:0/4004010301 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbfdc1007b0 0x7fbfdc100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:40.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:40.445+0000 7fbfe1d6e640 1 --2- 172.21.15.44:0/4004010301 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbfdc1067b0 0x7fbfdc106b90 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:40.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:40.445+0000 7fbfe1d6e640 1 -- 172.21.15.44:0/4004010301 >> 172.21.15.44:0/4004010301 conn(0x7fbfdc0fc4d0 msgr2=0x7fbfdc0fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:24:40.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:40.445+0000 7fbfe1d6e640 1 -- 172.21.15.44:0/4004010301 shutdown_connections 2024-08-19T00:24:40.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:40.445+0000 7fbfe1d6e640 1 -- 172.21.15.44:0/4004010301 wait complete. 2024-08-19T00:24:40.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:40.445+0000 7fbfe1d6e640 1 Processor -- start 2024-08-19T00:24:40.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:40.446+0000 7fbfe1d6e640 1 -- start start 2024-08-19T00:24:40.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:40.446+0000 7fbfe1d6e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbfdc1007b0 0x7fbfdc198fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:40.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:40.446+0000 7fbfe1d6e640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbfdc101150 0x7fbfdc199520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:40.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:40.446+0000 7fbfe1d6e640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbfdc1067b0 0x7fbfdc1a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:40.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:40.446+0000 7fbfe1d6e640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbfdc110bb0 con 0x7fbfdc1067b0 2024-08-19T00:24:40.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:40.446+0000 7fbfe1d6e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fbfdc110a30 con 0x7fbfdc1007b0 2024-08-19T00:24:40.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:40.446+0000 7fbfe1d6e640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbfdc110d30 con 0x7fbfdc101150 2024-08-19T00:24:40.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:40.446+0000 7fbfdbfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbfdc1067b0 0x7fbfdc1a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:40.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:40.446+0000 7fbfdbfff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbfdc1067b0 0x7fbfdc1a4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41180/0 (socket says 172.21.15.44:41180) 2024-08-19T00:24:40.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:40.446+0000 7fbfdbfff640 1 -- 172.21.15.44:0/1056718958 learned_addr learned my addr 172.21.15.44:0/1056718958 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:24:40.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:40.446+0000 7fbfdb7fe640 1 --2- 172.21.15.44:0/1056718958 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbfdc1007b0 0x7fbfdc198fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:40.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:40.446+0000 7fbfdbfff640 1 -- 172.21.15.44:0/1056718958 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbfdc101150 msgr2=0x7fbfdc199520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:40.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:40.446+0000 7fbfdbfff640 1 --2- 172.21.15.44:0/1056718958 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbfdc101150 0x7fbfdc199520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:40.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:40.446+0000 7fbfdbfff640 1 -- 172.21.15.44:0/1056718958 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbfdc1007b0 msgr2=0x7fbfdc198fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:40.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:40.446+0000 7fbfdbfff640 1 --2- 172.21.15.44:0/1056718958 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbfdc1007b0 0x7fbfdc198fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:40.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:40.446+0000 7fbfdbfff640 1 -- 172.21.15.44:0/1056718958 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfdc1a45a0 con 0x7fbfdc1067b0 2024-08-19T00:24:40.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:40.446+0000 7fbfdb7fe640 1 --2- 172.21.15.44:0/1056718958 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbfdc1007b0 0x7fbfdc198fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:24:40.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:40.446+0000 7fbfdbfff640 1 --2- 172.21.15.44:0/1056718958 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbfdc1067b0 0x7fbfdc1a4060 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fbfd400eaa0 tx=0x7fbfd400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:24:40.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:40.447+0000 7fbfd8ff9640 1 -- 172.21.15.44:0/1056718958 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd400cdb0 con 0x7fbfdc1067b0 2024-08-19T00:24:40.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:40.447+0000 7fbfe1d6e640 1 -- 172.21.15.44:0/1056718958 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfdc1a4770 con 0x7fbfdc1067b0 2024-08-19T00:24:40.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:40.447+0000 7fbfd8ff9640 1 -- 172.21.15.44:0/1056718958 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbfd4005020 con 0x7fbfdc1067b0 2024-08-19T00:24:40.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:40.447+0000 7fbfd8ff9640 1 -- 172.21.15.44:0/1056718958 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd40116b0 con 0x7fbfdc1067b0 2024-08-19T00:24:40.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:40.447+0000 7fbfe1d6e640 1 -- 172.21.15.44:0/1056718958 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfdc1a4c80 con 0x7fbfdc1067b0 2024-08-19T00:24:40.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:40.448+0000 7fbfe1d6e640 1 -- 172.21.15.44:0/1056718958 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfdc100c10 con 0x7fbfdc1067b0 2024-08-19T00:24:40.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:40.449+0000 7fbfd8ff9640 1 -- 172.21.15.44:0/1056718958 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fbfd4005560 con 0x7fbfdc1067b0 2024-08-19T00:24:40.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:40.450+0000 7fbfd8ff9640 1 --2- 172.21.15.44:0/1056718958 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fbfc40a2cf0 0x7fbfc40a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:40.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:40.450+0000 7fbfd8ff9640 1 -- 172.21.15.44:0/1056718958 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 9533+0+0 (secure 0 0 0) 0x7fbfd40cfe40 con 0x7fbfdc1067b0 2024-08-19T00:24:40.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:40.450+0000 7fbfdb7fe640 1 --2- 172.21.15.44:0/1056718958 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fbfc40a2cf0 0x7fbfc40a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:40.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:40.450+0000 7fbfdb7fe640 1 --2- 172.21.15.44:0/1056718958 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fbfc40a2cf0 0x7fbfc40a51b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc000c00 tx=0x7fbfcc005a20 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:24:40.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:40.453+0000 7fbfd8ff9640 1 -- 172.21.15.44:0/1056718958 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fbfd4016030 con 0x7fbfdc1067b0 2024-08-19T00:24:40.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:40.664+0000 7fbfe1d6e640 1 -- 172.21.15.44:0/1056718958 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fbfdc02d5e0 con 0x7fbfdc1067b0 2024-08-19T00:24:40.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:40.666+0000 7fbfd8ff9640 1 -- 172.21.15.44:0/1056718958 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v34) ==== 161+0+0 (secure 0 0 0) 0x7fbfd409c670 con 0x7fbfdc1067b0 2024-08-19T00:24:40.668 INFO:teuthology.orchestra.run.smithi044.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-19T00:24:40.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:40.670+0000 7fbfe1d6e640 1 -- 172.21.15.44:0/1056718958 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fbfc40a2cf0 msgr2=0x7fbfc40a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:40.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:40.670+0000 7fbfe1d6e640 1 --2- 172.21.15.44:0/1056718958 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fbfc40a2cf0 0x7fbfc40a51b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc000c00 tx=0x7fbfcc005a20 comp rx=0 tx=0).stop 2024-08-19T00:24:40.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:40.670+0000 7fbfe1d6e640 1 -- 172.21.15.44:0/1056718958 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbfdc1067b0 msgr2=0x7fbfdc1a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:40.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:40.670+0000 7fbfe1d6e640 1 --2- 172.21.15.44:0/1056718958 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbfdc1067b0 0x7fbfdc1a4060 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fbfd400eaa0 tx=0x7fbfd400ef60 comp rx=0 tx=0).stop 2024-08-19T00:24:40.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:40.670+0000 7fbfe1d6e640 1 -- 172.21.15.44:0/1056718958 shutdown_connections 2024-08-19T00:24:40.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:40.670+0000 7fbfe1d6e640 1 --2- 172.21.15.44:0/1056718958 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fbfc40a2cf0 0x7fbfc40a51b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:40.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:40.670+0000 7fbfe1d6e640 1 --2- 172.21.15.44:0/1056718958 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbfdc101150 0x7fbfdc199520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:40.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:40.670+0000 7fbfe1d6e640 1 --2- 172.21.15.44:0/1056718958 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbfdc1067b0 0x7fbfdc1a4060 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:40.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:40.670+0000 7fbfe1d6e640 1 --2- 172.21.15.44:0/1056718958 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbfdc1007b0 0x7fbfdc198fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:40.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:40.670+0000 7fbfe1d6e640 1 -- 172.21.15.44:0/1056718958 >> 172.21.15.44:0/1056718958 conn(0x7fbfdc0fc4d0 msgr2=0x7fbfdc0fdd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:24:40.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:40.675+0000 7fbfe1d6e640 1 -- 172.21.15.44:0/1056718958 shutdown_connections 2024-08-19T00:24:40.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:40.675+0000 7fbfe1d6e640 1 -- 172.21.15.44:0/1056718958 wait complete. 2024-08-19T00:24:41.000 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:40 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mon-a[18485]: 2024-08-19T00:24:40.665+0000 7f7efdd7a640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-19T00:24:41.001 INFO:journalctl@ceph.mds.a.smithi044.stdout:Aug 19 00:24:40 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-a[59187]: ignoring --setuser ceph since I am not root 2024-08-19T00:24:41.001 INFO:journalctl@ceph.mds.a.smithi044.stdout:Aug 19 00:24:40 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-a[59187]: ignoring --setgroup ceph since I am not root 2024-08-19T00:24:41.001 INFO:journalctl@ceph.mds.a.smithi044.stdout:Aug 19 00:24:40 smithi044 ceph-mds[59191]: -- 172.21.15.44:0/4259363489 <== mon.2 v2:172.21.15.116:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55cb279e9c20 con 0x55cb279c7400 2024-08-19T00:24:41.001 INFO:journalctl@ceph.mds.a.smithi044.stdout:Aug 19 00:24:40 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-a[59187]: starting mds.a at 2024-08-19T00:24:41.002 INFO:journalctl@ceph.mds.d.smithi044.stdout:Aug 19 00:24:40 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-d[57995]: ignoring --setuser ceph since I am not root 2024-08-19T00:24:41.002 INFO:journalctl@ceph.mds.d.smithi044.stdout:Aug 19 00:24:40 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-d[57995]: ignoring --setgroup ceph since I am not root 2024-08-19T00:24:41.002 INFO:journalctl@ceph.mds.d.smithi044.stdout:Aug 19 00:24:40 smithi044 ceph-mds[57999]: -- 172.21.15.44:0/4153455120 <== mon.2 v2:172.21.15.116:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557f29605860 con 0x557f295e3400 2024-08-19T00:24:41.002 INFO:journalctl@ceph.mds.d.smithi044.stdout:Aug 19 00:24:40 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-d[57995]: starting mds.d at 2024-08-19T00:24:41.003 INFO:journalctl@ceph.mds.g.smithi044.stdout:Aug 19 00:24:40 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-g[58791]: ignoring --setuser ceph since I am not root 2024-08-19T00:24:41.003 INFO:journalctl@ceph.mds.g.smithi044.stdout:Aug 19 00:24:40 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-g[58791]: ignoring --setgroup ceph since I am not root 2024-08-19T00:24:41.003 INFO:journalctl@ceph.mds.g.smithi044.stdout:Aug 19 00:24:40 smithi044 ceph-mds[58818]: -- 172.21.15.44:0/259430336 <== mon.2 v2:172.21.15.116:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557fbce81c20 con 0x557fbce5f400 2024-08-19T00:24:41.003 INFO:journalctl@ceph.mds.g.smithi044.stdout:Aug 19 00:24:40 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-g[58791]: starting mds.g at 2024-08-19T00:24:41.003 INFO:journalctl@ceph.mds.g.smithi044.stdout:Aug 19 00:24:40 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-g[58791]: 2024-08-19T00:24:40.715+0000 7fb43591e640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6837/0: (98) Address already in use 2024-08-19T00:24:41.066 INFO:journalctl@ceph.mds.f.smithi171.stdout:Aug 19 00:24:40 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-f[51054]: ignoring --setuser ceph since I am not root 2024-08-19T00:24:41.066 INFO:journalctl@ceph.mds.f.smithi171.stdout:Aug 19 00:24:40 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-f[51054]: ignoring --setgroup ceph since I am not root 2024-08-19T00:24:41.066 INFO:journalctl@ceph.mds.f.smithi171.stdout:Aug 19 00:24:40 smithi171 ceph-mds[51058]: -- 172.21.15.171:0/1744575887 <== mon.1 v2:172.21.15.171:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562bd56fd860 con 0x562bd56da800 2024-08-19T00:24:41.067 INFO:journalctl@ceph.mds.f.smithi171.stdout:Aug 19 00:24:40 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-f[51054]: starting mds.f at 2024-08-19T00:24:41.067 INFO:journalctl@ceph.mds.e.smithi116.stdout:Aug 19 00:24:40 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-e[50649]: ignoring --setuser ceph since I am not root 2024-08-19T00:24:41.067 INFO:journalctl@ceph.mds.e.smithi116.stdout:Aug 19 00:24:40 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-e[50649]: ignoring --setgroup ceph since I am not root 2024-08-19T00:24:41.067 INFO:journalctl@ceph.mds.e.smithi116.stdout:Aug 19 00:24:40 smithi116 ceph-mds[50653]: -- 172.21.15.116:0/2501153166 <== mon.2 v2:172.21.15.116:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556203371860 con 0x55620334e800 2024-08-19T00:24:41.067 INFO:journalctl@ceph.mds.e.smithi116.stdout:Aug 19 00:24:40 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-e[50649]: starting mds.e at 2024-08-19T00:24:41.068 INFO:journalctl@ceph.mds.l.smithi171.stdout:Aug 19 00:24:40 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-l[50741]: ignoring --setuser ceph since I am not root 2024-08-19T00:24:41.068 INFO:journalctl@ceph.mds.l.smithi171.stdout:Aug 19 00:24:40 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-l[50741]: ignoring --setgroup ceph since I am not root 2024-08-19T00:24:41.068 INFO:journalctl@ceph.mds.l.smithi171.stdout:Aug 19 00:24:40 smithi171 ceph-mds[50745]: -- 172.21.15.171:0/3059873114 <== mon.2 v2:172.21.15.116:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562cbcb8dc20 con 0x562cbcb6a800 2024-08-19T00:24:41.068 INFO:journalctl@ceph.mds.l.smithi171.stdout:Aug 19 00:24:40 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-l[50741]: starting mds.l at 2024-08-19T00:24:41.069 INFO:journalctl@ceph.mds.b.smithi116.stdout:Aug 19 00:24:40 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-b[51250]: ignoring --setuser ceph since I am not root 2024-08-19T00:24:41.069 INFO:journalctl@ceph.mds.b.smithi116.stdout:Aug 19 00:24:40 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-b[51250]: ignoring --setgroup ceph since I am not root 2024-08-19T00:24:41.069 INFO:journalctl@ceph.mds.b.smithi116.stdout:Aug 19 00:24:40 smithi116 ceph-mds[51254]: -- 172.21.15.116:0/861922139 <== mon.1 v2:172.21.15.171:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f2910f1c20 con 0x55f2910cf000 2024-08-19T00:24:41.069 INFO:journalctl@ceph.mds.b.smithi116.stdout:Aug 19 00:24:40 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-b[51250]: starting mds.b at 2024-08-19T00:24:41.069 INFO:journalctl@ceph.mds.c.smithi171.stdout:Aug 19 00:24:40 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-c[51359]: ignoring --setuser ceph since I am not root 2024-08-19T00:24:41.070 INFO:journalctl@ceph.mds.c.smithi171.stdout:Aug 19 00:24:40 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-c[51359]: ignoring --setgroup ceph since I am not root 2024-08-19T00:24:41.070 INFO:journalctl@ceph.mds.c.smithi171.stdout:Aug 19 00:24:40 smithi171 ceph-mds[51363]: -- 172.21.15.171:0/212905410 <== mon.2 v2:172.21.15.116:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5651259b7860 con 0x565125994800 2024-08-19T00:24:41.070 INFO:journalctl@ceph.mds.c.smithi171.stdout:Aug 19 00:24:40 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-c[51359]: starting mds.c at 2024-08-19T00:24:41.070 INFO:journalctl@ceph.mds.h.smithi116.stdout:Aug 19 00:24:40 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-h[50949]: ignoring --setuser ceph since I am not root 2024-08-19T00:24:41.070 INFO:journalctl@ceph.mds.h.smithi116.stdout:Aug 19 00:24:40 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-h[50949]: ignoring --setgroup ceph since I am not root 2024-08-19T00:24:41.070 INFO:journalctl@ceph.mds.h.smithi116.stdout:Aug 19 00:24:40 smithi116 ceph-mds[50953]: -- 172.21.15.116:0/1007416322 <== mon.2 v2:172.21.15.116:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b5a9ee3860 con 0x55b5a9ec0800 2024-08-19T00:24:41.071 INFO:journalctl@ceph.mds.h.smithi116.stdout:Aug 19 00:24:40 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-h[50949]: starting mds.h at 2024-08-19T00:24:41.071 INFO:journalctl@ceph.mds.i.smithi171.stdout:Aug 19 00:24:40 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-i[51663]: ignoring --setuser ceph since I am not root 2024-08-19T00:24:41.071 INFO:journalctl@ceph.mds.i.smithi171.stdout:Aug 19 00:24:40 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-i[51663]: ignoring --setgroup ceph since I am not root 2024-08-19T00:24:41.071 INFO:journalctl@ceph.mds.i.smithi171.stdout:Aug 19 00:24:40 smithi171 ceph-mds[51667]: -- 172.21.15.171:0/3443677305 <== mon.2 v2:172.21.15.116:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555f8fc39860 con 0x555f8fc17000 2024-08-19T00:24:41.071 INFO:journalctl@ceph.mds.i.smithi171.stdout:Aug 19 00:24:40 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-i[51663]: starting mds.i at 2024-08-19T00:24:41.303 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:41 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/1056718958' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-08-19T00:24:41.303 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:41 smithi044 ceph-mon[18489]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-08-19T00:24:41.303 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:41 smithi044 ceph-mon[18489]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-19T00:24:41.303 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:41 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/1056718958' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-08-19T00:24:41.303 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:41 smithi044 ceph-mon[18489]: osdmap e106: 12 total, 12 up, 12 in 2024-08-19T00:24:41.303 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:41 smithi044 ceph-mon[18489]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-08-19T00:24:41.334 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-08-19T00:24:41.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:41 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/1056718958' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-08-19T00:24:41.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:41 smithi171 ceph-mon[21810]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-08-19T00:24:41.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:41 smithi171 ceph-mon[21810]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-19T00:24:41.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:41 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/1056718958' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-08-19T00:24:41.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:41 smithi171 ceph-mon[21810]: osdmap e106: 12 total, 12 up, 12 in 2024-08-19T00:24:41.344 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:41 smithi171 ceph-mon[21810]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-08-19T00:24:41.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:41 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/1056718958' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-08-19T00:24:41.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:41 smithi116 ceph-mon[21873]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-08-19T00:24:41.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:41 smithi116 ceph-mon[21873]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-19T00:24:41.367 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:41 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/1056718958' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-08-19T00:24:41.367 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:41 smithi116 ceph-mon[21873]: osdmap e106: 12 total, 12 up, 12 in 2024-08-19T00:24:41.367 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:41 smithi116 ceph-mon[21873]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-08-19T00:24:41.595 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:24:42.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:42.071+0000 7f01be31d640 1 -- 172.21.15.44:0/1985788304 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f01b8103410 msgr2=0x7f01b81078c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:42.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:42.071+0000 7f01be31d640 1 --2- 172.21.15.44:0/1985788304 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f01b8103410 0x7f01b81078c0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f01ac009930 tx=0x7f01ac02a420 comp rx=0 tx=0).stop 2024-08-19T00:24:42.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:42.071+0000 7f01be31d640 1 -- 172.21.15.44:0/1985788304 shutdown_connections 2024-08-19T00:24:42.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:42.071+0000 7f01be31d640 1 --2- 172.21.15.44:0/1985788304 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f01b8107fd0 0x7f01b810e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:42.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:42.071+0000 7f01be31d640 1 --2- 172.21.15.44:0/1985788304 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f01b8103410 0x7f01b81078c0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:42.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:42.071+0000 7f01be31d640 1 --2- 172.21.15.44:0/1985788304 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f01b8102a60 0x7f01b8102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:42.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:42.071+0000 7f01be31d640 1 -- 172.21.15.44:0/1985788304 >> 172.21.15.44:0/1985788304 conn(0x7f01b80fc500 msgr2=0x7f01b80fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:24:42.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:42.071+0000 7f01be31d640 1 -- 172.21.15.44:0/1985788304 shutdown_connections 2024-08-19T00:24:42.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:42.071+0000 7f01be31d640 1 -- 172.21.15.44:0/1985788304 wait complete. 2024-08-19T00:24:42.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:42.072+0000 7f01be31d640 1 Processor -- start 2024-08-19T00:24:42.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:42.072+0000 7f01be31d640 1 -- start start 2024-08-19T00:24:42.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:42.072+0000 7f01be31d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f01b8102a60 0x7f01b8198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:42.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:42.072+0000 7f01be31d640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f01b8103410 0x7f01b81988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:42.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:42.072+0000 7f01be31d640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f01b8107fd0 0x7f01b819cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:42.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:42.072+0000 7f01be31d640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f01b8111dd0 con 0x7f01b8103410 2024-08-19T00:24:42.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:42.072+0000 7f01be31d640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f01b8111c50 con 0x7f01b8102a60 2024-08-19T00:24:42.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:42.072+0000 7f01be31d640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f01b8111f50 con 0x7f01b8107fd0 2024-08-19T00:24:42.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:42.072+0000 7f01b77fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f01b8103410 0x7f01b81988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:42.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:42.072+0000 7f01b77fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f01b8103410 0x7f01b81988b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41248/0 (socket says 172.21.15.44:41248) 2024-08-19T00:24:42.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:42.072+0000 7f01b77fe640 1 -- 172.21.15.44:0/2315215444 learned_addr learned my addr 172.21.15.44:0/2315215444 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:24:42.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:42.073+0000 7f01bc8ba640 1 --2- 172.21.15.44:0/2315215444 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f01b8107fd0 0x7f01b819cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:42.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:42.073+0000 7f01b7fff640 1 --2- 172.21.15.44:0/2315215444 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f01b8102a60 0x7f01b8198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:42.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:42.073+0000 7f01b77fe640 1 -- 172.21.15.44:0/2315215444 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f01b8107fd0 msgr2=0x7f01b819cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:42.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:42.073+0000 7f01b77fe640 1 --2- 172.21.15.44:0/2315215444 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f01b8107fd0 0x7f01b819cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:42.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:42.073+0000 7f01b77fe640 1 -- 172.21.15.44:0/2315215444 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f01b8102a60 msgr2=0x7f01b8198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:42.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:42.073+0000 7f01b77fe640 1 --2- 172.21.15.44:0/2315215444 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f01b8102a60 0x7f01b8198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:42.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:42.073+0000 7f01b77fe640 1 -- 172.21.15.44:0/2315215444 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01b819d320 con 0x7f01b8103410 2024-08-19T00:24:42.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:42.073+0000 7f01bc8ba640 1 --2- 172.21.15.44:0/2315215444 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f01b8107fd0 0x7f01b819cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:24:42.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:42.073+0000 7f01b77fe640 1 --2- 172.21.15.44:0/2315215444 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f01b8103410 0x7f01b81988b0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f01ac005940 tx=0x7f01ac0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:24:42.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:42.073+0000 7f01b57fa640 1 -- 172.21.15.44:0/2315215444 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ac03f030 con 0x7f01b8103410 2024-08-19T00:24:42.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:42.073+0000 7f01b57fa640 1 -- 172.21.15.44:0/2315215444 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01ac003ce0 con 0x7f01b8103410 2024-08-19T00:24:42.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:42.073+0000 7f01be31d640 1 -- 172.21.15.44:0/2315215444 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01b819d5b0 con 0x7f01b8103410 2024-08-19T00:24:42.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:42.073+0000 7f01b57fa640 1 -- 172.21.15.44:0/2315215444 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ac035070 con 0x7f01b8103410 2024-08-19T00:24:42.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:42.073+0000 7f01be31d640 1 -- 172.21.15.44:0/2315215444 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01b81a4ef0 con 0x7f01b8103410 2024-08-19T00:24:42.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:42.074+0000 7f01be31d640 1 -- 172.21.15.44:0/2315215444 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01b806a580 con 0x7f01b8103410 2024-08-19T00:24:42.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:42.075+0000 7f01b57fa640 1 -- 172.21.15.44:0/2315215444 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f01ac042030 con 0x7f01b8103410 2024-08-19T00:24:42.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:42.076+0000 7f01b57fa640 1 --2- 172.21.15.44:0/2315215444 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f01a00a2cf0 0x7f01a00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:42.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:42.076+0000 7f01b7fff640 1 --2- 172.21.15.44:0/2315215444 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f01a00a2cf0 0x7f01a00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:42.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:42.076+0000 7f01b57fa640 1 -- 172.21.15.44:0/2315215444 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 9875+0+0 (secure 0 0 0) 0x7f01ac0eff00 con 0x7f01b8103410 2024-08-19T00:24:42.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:42.076+0000 7f01b7fff640 1 --2- 172.21.15.44:0/2315215444 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f01a00a2cf0 0x7f01a00a51b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f01a8005fd0 tx=0x7f01a8005850 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:24:42.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:42.080+0000 7f01b57fa640 1 -- 172.21.15.44:0/2315215444 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f01ac0bc5d0 con 0x7f01b8103410 2024-08-19T00:24:42.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:42.291+0000 7f01be31d640 1 -- 172.21.15.44:0/2315215444 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f01b81996d0 con 0x7f01b8103410 2024-08-19T00:24:42.293 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:42 smithi044 ceph-mon[18489]: pgmap v355: 129 pgs: 129 active+clean; 540 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 28 KiB/s wr, 13 op/s 2024-08-19T00:24:42.294 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:42 smithi044 ceph-mon[18489]: mds.? [v2:172.21.15.116:6834/3361499471,v1:172.21.15.116:6836/3361499471] up:boot 2024-08-19T00:24:42.294 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:42 smithi044 ceph-mon[18489]: mds.? [v2:172.21.15.116:6835/3750528978,v1:172.21.15.116:6838/3750528978] up:boot 2024-08-19T00:24:42.294 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:42 smithi044 ceph-mon[18489]: mds.? [v2:172.21.15.116:6837/74982765,v1:172.21.15.116:6839/74982765] up:boot 2024-08-19T00:24:42.294 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:42 smithi044 ceph-mon[18489]: mds.? [v2:172.21.15.171:6832/51959425,v1:172.21.15.171:6833/51959425] up:boot 2024-08-19T00:24:42.294 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:42 smithi044 ceph-mon[18489]: mds.? [v2:172.21.15.44:6836/90132504,v1:172.21.15.44:6838/90132504] up:boot 2024-08-19T00:24:42.294 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:42 smithi044 ceph-mon[18489]: mds.? [v2:172.21.15.44:6837/873517510,v1:172.21.15.44:6839/873517510] up:boot 2024-08-19T00:24:42.294 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:42 smithi044 ceph-mon[18489]: mds.? [v2:172.21.15.44:6840/2464858345,v1:172.21.15.44:6841/2464858345] up:boot 2024-08-19T00:24:42.295 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:42 smithi044 ceph-mon[18489]: mds.? [v2:172.21.15.171:6834/3509563072,v1:172.21.15.171:6835/3509563072] up:boot 2024-08-19T00:24:42.295 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:42 smithi044 ceph-mon[18489]: mds.? [v2:172.21.15.171:6836/829967473,v1:172.21.15.171:6837/829967473] up:boot 2024-08-19T00:24:42.295 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:42 smithi044 ceph-mon[18489]: mds.? [v2:172.21.15.171:6838/3439012810,v1:172.21.15.171:6839/3439012810] up:boot 2024-08-19T00:24:42.295 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:42 smithi044 ceph-mon[18489]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-08-19T00:24:42.295 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:42 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-08-19T00:24:42.295 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:42 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-08-19T00:24:42.295 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:42 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-08-19T00:24:42.295 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:42 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-08-19T00:24:42.296 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:42 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-08-19T00:24:42.296 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:42 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-08-19T00:24:42.296 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:42 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-08-19T00:24:42.296 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:42 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-08-19T00:24:42.296 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:42 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-08-19T00:24:42.296 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:42 smithi044 ceph-mon[18489]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-08-19T00:24:42.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:42 smithi171 ceph-mon[21810]: pgmap v355: 129 pgs: 129 active+clean; 540 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 28 KiB/s wr, 13 op/s 2024-08-19T00:24:42.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:42 smithi171 ceph-mon[21810]: mds.? [v2:172.21.15.116:6834/3361499471,v1:172.21.15.116:6836/3361499471] up:boot 2024-08-19T00:24:42.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:42 smithi171 ceph-mon[21810]: mds.? [v2:172.21.15.116:6835/3750528978,v1:172.21.15.116:6838/3750528978] up:boot 2024-08-19T00:24:42.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:42 smithi171 ceph-mon[21810]: mds.? [v2:172.21.15.116:6837/74982765,v1:172.21.15.116:6839/74982765] up:boot 2024-08-19T00:24:42.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:42 smithi171 ceph-mon[21810]: mds.? [v2:172.21.15.171:6832/51959425,v1:172.21.15.171:6833/51959425] up:boot 2024-08-19T00:24:42.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:42 smithi171 ceph-mon[21810]: mds.? [v2:172.21.15.44:6836/90132504,v1:172.21.15.44:6838/90132504] up:boot 2024-08-19T00:24:42.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:42 smithi171 ceph-mon[21810]: mds.? [v2:172.21.15.44:6837/873517510,v1:172.21.15.44:6839/873517510] up:boot 2024-08-19T00:24:42.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:42 smithi171 ceph-mon[21810]: mds.? [v2:172.21.15.44:6840/2464858345,v1:172.21.15.44:6841/2464858345] up:boot 2024-08-19T00:24:42.344 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:42 smithi171 ceph-mon[21810]: mds.? [v2:172.21.15.171:6834/3509563072,v1:172.21.15.171:6835/3509563072] up:boot 2024-08-19T00:24:42.344 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:42 smithi171 ceph-mon[21810]: mds.? [v2:172.21.15.171:6836/829967473,v1:172.21.15.171:6837/829967473] up:boot 2024-08-19T00:24:42.344 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:42 smithi171 ceph-mon[21810]: mds.? [v2:172.21.15.171:6838/3439012810,v1:172.21.15.171:6839/3439012810] up:boot 2024-08-19T00:24:42.344 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:42 smithi171 ceph-mon[21810]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-08-19T00:24:42.344 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:42 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-08-19T00:24:42.344 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:42 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-08-19T00:24:42.344 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:42 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-08-19T00:24:42.344 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:42 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-08-19T00:24:42.345 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:42 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-08-19T00:24:42.345 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:42 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-08-19T00:24:42.345 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:42 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-08-19T00:24:42.345 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:42 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-08-19T00:24:42.345 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:42 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-08-19T00:24:42.345 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:42 smithi171 ceph-mon[21810]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-08-19T00:24:42.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:42 smithi116 ceph-mon[21873]: pgmap v355: 129 pgs: 129 active+clean; 540 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 28 KiB/s wr, 13 op/s 2024-08-19T00:24:42.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:42 smithi116 ceph-mon[21873]: mds.? [v2:172.21.15.116:6834/3361499471,v1:172.21.15.116:6836/3361499471] up:boot 2024-08-19T00:24:42.367 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:42 smithi116 ceph-mon[21873]: mds.? [v2:172.21.15.116:6835/3750528978,v1:172.21.15.116:6838/3750528978] up:boot 2024-08-19T00:24:42.367 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:42 smithi116 ceph-mon[21873]: mds.? [v2:172.21.15.116:6837/74982765,v1:172.21.15.116:6839/74982765] up:boot 2024-08-19T00:24:42.367 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:42 smithi116 ceph-mon[21873]: mds.? [v2:172.21.15.171:6832/51959425,v1:172.21.15.171:6833/51959425] up:boot 2024-08-19T00:24:42.367 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:42 smithi116 ceph-mon[21873]: mds.? [v2:172.21.15.44:6836/90132504,v1:172.21.15.44:6838/90132504] up:boot 2024-08-19T00:24:42.367 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:42 smithi116 ceph-mon[21873]: mds.? [v2:172.21.15.44:6837/873517510,v1:172.21.15.44:6839/873517510] up:boot 2024-08-19T00:24:42.367 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:42 smithi116 ceph-mon[21873]: mds.? [v2:172.21.15.44:6840/2464858345,v1:172.21.15.44:6841/2464858345] up:boot 2024-08-19T00:24:42.367 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:42 smithi116 ceph-mon[21873]: mds.? [v2:172.21.15.171:6834/3509563072,v1:172.21.15.171:6835/3509563072] up:boot 2024-08-19T00:24:42.367 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:42 smithi116 ceph-mon[21873]: mds.? [v2:172.21.15.171:6836/829967473,v1:172.21.15.171:6837/829967473] up:boot 2024-08-19T00:24:42.368 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:42 smithi116 ceph-mon[21873]: mds.? [v2:172.21.15.171:6838/3439012810,v1:172.21.15.171:6839/3439012810] up:boot 2024-08-19T00:24:42.368 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:42 smithi116 ceph-mon[21873]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-08-19T00:24:42.368 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:42 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-08-19T00:24:42.368 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:42 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-08-19T00:24:42.368 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:42 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-08-19T00:24:42.368 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:42 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-08-19T00:24:42.368 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:42 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-08-19T00:24:42.368 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:42 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-08-19T00:24:42.368 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:42 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-08-19T00:24:42.369 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:42 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-08-19T00:24:42.369 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:42 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-08-19T00:24:42.369 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:42 smithi116 ceph-mon[21873]: from='mgr.15297 172.21.15.44:0/1113978276' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-08-19T00:24:43.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:43.070+0000 7f01b57fa640 1 -- 172.21.15.44:0/2315215444 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v36) ==== 104+0+0 (secure 0 0 0) 0x7f01ac0bbed0 con 0x7f01b8103410 2024-08-19T00:24:43.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:43.073+0000 7f01be31d640 1 -- 172.21.15.44:0/2315215444 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f01a00a2cf0 msgr2=0x7f01a00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:43.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:43.073+0000 7f01be31d640 1 --2- 172.21.15.44:0/2315215444 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f01a00a2cf0 0x7f01a00a51b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f01a8005fd0 tx=0x7f01a8005850 comp rx=0 tx=0).stop 2024-08-19T00:24:43.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:43.073+0000 7f01be31d640 1 -- 172.21.15.44:0/2315215444 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f01b8103410 msgr2=0x7f01b81988b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:43.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:43.073+0000 7f01be31d640 1 --2- 172.21.15.44:0/2315215444 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f01b8103410 0x7f01b81988b0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f01ac005940 tx=0x7f01ac0042f0 comp rx=0 tx=0).stop 2024-08-19T00:24:43.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:43.073+0000 7f01be31d640 1 -- 172.21.15.44:0/2315215444 shutdown_connections 2024-08-19T00:24:43.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:43.073+0000 7f01be31d640 1 --2- 172.21.15.44:0/2315215444 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f01a00a2cf0 0x7f01a00a51b0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:43.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:43.073+0000 7f01be31d640 1 --2- 172.21.15.44:0/2315215444 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f01b8107fd0 0x7f01b819cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:43.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:43.073+0000 7f01be31d640 1 --2- 172.21.15.44:0/2315215444 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f01b8103410 0x7f01b81988b0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:43.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:43.073+0000 7f01be31d640 1 --2- 172.21.15.44:0/2315215444 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f01b8102a60 0x7f01b8198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:43.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:43.073+0000 7f01be31d640 1 -- 172.21.15.44:0/2315215444 >> 172.21.15.44:0/2315215444 conn(0x7f01b80fc500 msgr2=0x7f01b81060b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:24:43.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:43.073+0000 7f01be31d640 1 -- 172.21.15.44:0/2315215444 shutdown_connections 2024-08-19T00:24:43.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:43.074+0000 7f01be31d640 1 -- 172.21.15.44:0/2315215444 wait complete. 2024-08-19T00:24:43.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:43 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/2315215444' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-08-19T00:24:43.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:43 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/2315215444' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-08-19T00:24:43.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:43 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/2315215444' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-08-19T00:24:43.798 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-19T00:24:44.064 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:24:44.325 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:44 smithi044 ceph-mon[18489]: pgmap v356: 129 pgs: 129 active+clean; 540 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 28 KiB/s wr, 13 op/s 2024-08-19T00:24:44.325 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:44 smithi044 ceph-mon[18489]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-08-19T00:24:44.325 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:44 smithi044 ceph-mon[18489]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-08-19T00:24:44.325 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:44 smithi044 ceph-mon[18489]: Cluster is now healthy 2024-08-19T00:24:44.325 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:44 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/2315215444' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-08-19T00:24:44.325 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:44 smithi044 ceph-mon[18489]: fsmap 12 up:standby 2024-08-19T00:24:44.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:44 smithi171 ceph-mon[21810]: pgmap v356: 129 pgs: 129 active+clean; 540 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 28 KiB/s wr, 13 op/s 2024-08-19T00:24:44.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:44 smithi171 ceph-mon[21810]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-08-19T00:24:44.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:44 smithi171 ceph-mon[21810]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-08-19T00:24:44.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:44 smithi171 ceph-mon[21810]: Cluster is now healthy 2024-08-19T00:24:44.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:44 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/2315215444' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-08-19T00:24:44.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:44 smithi171 ceph-mon[21810]: fsmap 12 up:standby 2024-08-19T00:24:44.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:44 smithi116 ceph-mon[21873]: pgmap v356: 129 pgs: 129 active+clean; 540 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 28 KiB/s wr, 13 op/s 2024-08-19T00:24:44.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:44 smithi116 ceph-mon[21873]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-08-19T00:24:44.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:44 smithi116 ceph-mon[21873]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-08-19T00:24:44.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:44 smithi116 ceph-mon[21873]: Cluster is now healthy 2024-08-19T00:24:44.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:44 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/2315215444' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-08-19T00:24:44.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:44 smithi116 ceph-mon[21873]: fsmap 12 up:standby 2024-08-19T00:24:44.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:44.567+0000 7fa813694640 1 -- 172.21.15.44:0/1061981045 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa80c102c20 msgr2=0x7fa80c10d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:44.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:44.567+0000 7fa813694640 1 --2- 172.21.15.44:0/1061981045 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa80c102c20 0x7fa80c10d770 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fa804009ca0 tx=0x7fa80402a950 comp rx=0 tx=0).stop 2024-08-19T00:24:44.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:44.567+0000 7fa813694640 1 -- 172.21.15.44:0/1061981045 shutdown_connections 2024-08-19T00:24:44.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:44.567+0000 7fa813694640 1 --2- 172.21.15.44:0/1061981045 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa80c102c20 0x7fa80c10d770 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:44.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:44.567+0000 7fa813694640 1 --2- 172.21.15.44:0/1061981045 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa80c1022a0 0x7fa80c1026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:44.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:44.567+0000 7fa813694640 1 --2- 172.21.15.44:0/1061981045 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa80c100b50 0x7fa80c100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:44.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:44.567+0000 7fa813694640 1 -- 172.21.15.44:0/1061981045 >> 172.21.15.44:0/1061981045 conn(0x7fa80c0fc500 msgr2=0x7fa80c0fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:24:44.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:44.567+0000 7fa813694640 1 -- 172.21.15.44:0/1061981045 shutdown_connections 2024-08-19T00:24:44.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:44.567+0000 7fa813694640 1 -- 172.21.15.44:0/1061981045 wait complete. 2024-08-19T00:24:44.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:44.568+0000 7fa813694640 1 Processor -- start 2024-08-19T00:24:44.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:44.568+0000 7fa813694640 1 -- start start 2024-08-19T00:24:44.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:44.568+0000 7fa813694640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa80c100b50 0x7fa80c0fc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:44.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:44.568+0000 7fa813694640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa80c1022a0 0x7fa80c0fcef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:44.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:44.568+0000 7fa813694640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa80c102c20 0x7fa80c0fd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:44.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:44.568+0000 7fa813694640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa80c110d50 con 0x7fa80c100b50 2024-08-19T00:24:44.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:44.568+0000 7fa813694640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fa80c110bd0 con 0x7fa80c102c20 2024-08-19T00:24:44.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:44.568+0000 7fa813694640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa80c110ed0 con 0x7fa80c1022a0 2024-08-19T00:24:44.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:44.568+0000 7fa811430640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa80c100b50 0x7fa80c0fc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:44.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:44.568+0000 7fa811430640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa80c100b50 0x7fa80c0fc9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41270/0 (socket says 172.21.15.44:41270) 2024-08-19T00:24:44.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:44.568+0000 7fa811430640 1 -- 172.21.15.44:0/3018131750 learned_addr learned my addr 172.21.15.44:0/3018131750 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:24:44.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:44.568+0000 7fa811c31640 1 --2- 172.21.15.44:0/3018131750 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa80c102c20 0x7fa80c0fd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:44.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:44.568+0000 7fa810c2f640 1 --2- 172.21.15.44:0/3018131750 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa80c1022a0 0x7fa80c0fcef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:44.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:44.568+0000 7fa811430640 1 -- 172.21.15.44:0/3018131750 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa80c1022a0 msgr2=0x7fa80c0fcef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:44.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:44.568+0000 7fa811430640 1 --2- 172.21.15.44:0/3018131750 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa80c1022a0 0x7fa80c0fcef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:44.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:44.569+0000 7fa811430640 1 -- 172.21.15.44:0/3018131750 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa80c102c20 msgr2=0x7fa80c0fd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:44.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:44.569+0000 7fa811430640 1 --2- 172.21.15.44:0/3018131750 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa80c102c20 0x7fa80c0fd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:44.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:44.569+0000 7fa811430640 1 -- 172.21.15.44:0/3018131750 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa80c1a6880 con 0x7fa80c100b50 2024-08-19T00:24:44.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:44.569+0000 7fa810c2f640 1 --2- 172.21.15.44:0/3018131750 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa80c1022a0 0x7fa80c0fcef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:24:44.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:44.569+0000 7fa811430640 1 --2- 172.21.15.44:0/3018131750 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa80c100b50 0x7fa80c0fc9b0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fa80800b4a0 tx=0x7fa80800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:24:44.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:44.569+0000 7fa7fe7fc640 1 -- 172.21.15.44:0/3018131750 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa808014070 con 0x7fa80c100b50 2024-08-19T00:24:44.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:44.569+0000 7fa7fe7fc640 1 -- 172.21.15.44:0/3018131750 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa808010af0 con 0x7fa80c100b50 2024-08-19T00:24:44.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:44.569+0000 7fa813694640 1 -- 172.21.15.44:0/3018131750 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa80c1a6b70 con 0x7fa80c100b50 2024-08-19T00:24:44.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:44.569+0000 7fa7fe7fc640 1 -- 172.21.15.44:0/3018131750 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa808017d10 con 0x7fa80c100b50 2024-08-19T00:24:44.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:44.569+0000 7fa813694640 1 -- 172.21.15.44:0/3018131750 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa80c1a7060 con 0x7fa80c100b50 2024-08-19T00:24:44.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:44.570+0000 7fa813694640 1 -- 172.21.15.44:0/3018131750 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa80c100fb0 con 0x7fa80c100b50 2024-08-19T00:24:44.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:44.571+0000 7fa7fe7fc640 1 -- 172.21.15.44:0/3018131750 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fa808017070 con 0x7fa80c100b50 2024-08-19T00:24:44.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:44.572+0000 7fa7fe7fc640 1 --2- 172.21.15.44:0/3018131750 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fa7f80a2cf0 0x7fa7f80a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:44.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:44.572+0000 7fa810c2f640 1 --2- 172.21.15.44:0/3018131750 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fa7f80a2cf0 0x7fa7f80a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:44.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:44.572+0000 7fa7fe7fc640 1 -- 172.21.15.44:0/3018131750 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 9875+0+0 (secure 0 0 0) 0x7fa8080cec60 con 0x7fa80c100b50 2024-08-19T00:24:44.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:44.572+0000 7fa810c2f640 1 --2- 172.21.15.44:0/3018131750 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fa7f80a2cf0 0x7fa7f80a51b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa80c0fe440 tx=0x7fa800008040 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:24:44.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:44.576+0000 7fa7fe7fc640 1 -- 172.21.15.44:0/3018131750 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fa80809b440 con 0x7fa80c100b50 2024-08-19T00:24:44.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:44.754+0000 7fa813694640 1 -- 172.21.15.44:0/3018131750 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa80c109dd0 con 0x7fa80c100b50 2024-08-19T00:24:45.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:45.079+0000 7fa7fe7fc640 1 -- 172.21.15.44:0/3018131750 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v107) ==== 181+0+0 (secure 0 0 0) 0x7fa80809ad40 con 0x7fa80c100b50 2024-08-19T00:24:45.081 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_metadata' removed 2024-08-19T00:24:45.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:45.082+0000 7fa813694640 1 -- 172.21.15.44:0/3018131750 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fa7f80a2cf0 msgr2=0x7fa7f80a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:45.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:45.082+0000 7fa813694640 1 --2- 172.21.15.44:0/3018131750 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fa7f80a2cf0 0x7fa7f80a51b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa80c0fe440 tx=0x7fa800008040 comp rx=0 tx=0).stop 2024-08-19T00:24:45.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:45.082+0000 7fa813694640 1 -- 172.21.15.44:0/3018131750 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa80c100b50 msgr2=0x7fa80c0fc9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:45.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:45.082+0000 7fa813694640 1 --2- 172.21.15.44:0/3018131750 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa80c100b50 0x7fa80c0fc9b0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fa80800b4a0 tx=0x7fa80800b960 comp rx=0 tx=0).stop 2024-08-19T00:24:45.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:45.082+0000 7fa813694640 1 -- 172.21.15.44:0/3018131750 shutdown_connections 2024-08-19T00:24:45.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:45.082+0000 7fa813694640 1 --2- 172.21.15.44:0/3018131750 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fa7f80a2cf0 0x7fa7f80a51b0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:45.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:45.082+0000 7fa813694640 1 --2- 172.21.15.44:0/3018131750 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa80c1022a0 0x7fa80c0fcef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:45.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:45.082+0000 7fa813694640 1 --2- 172.21.15.44:0/3018131750 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa80c102c20 0x7fa80c0fd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:45.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:45.082+0000 7fa813694640 1 --2- 172.21.15.44:0/3018131750 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa80c100b50 0x7fa80c0fc9b0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:45.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:45.082+0000 7fa813694640 1 -- 172.21.15.44:0/3018131750 >> 172.21.15.44:0/3018131750 conn(0x7fa80c0fc500 msgr2=0x7fa80c069fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:24:45.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:45.082+0000 7fa813694640 1 -- 172.21.15.44:0/3018131750 shutdown_connections 2024-08-19T00:24:45.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:45.082+0000 7fa813694640 1 -- 172.21.15.44:0/3018131750 wait complete. 2024-08-19T00:24:45.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:45 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/3018131750' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-08-19T00:24:45.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:45 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/3018131750' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-08-19T00:24:45.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:45 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/3018131750' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-08-19T00:24:45.781 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-19T00:24:46.037 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:24:46.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:46 smithi171 ceph-mon[21810]: pgmap v357: 129 pgs: 129 active+clean; 540 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.0 KiB/s wr, 7 op/s 2024-08-19T00:24:46.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:46 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/3018131750' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-08-19T00:24:46.343 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:46 smithi171 ceph-mon[21810]: osdmap e107: 12 total, 12 up, 12 in 2024-08-19T00:24:46.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:46 smithi116 ceph-mon[21873]: pgmap v357: 129 pgs: 129 active+clean; 540 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.0 KiB/s wr, 7 op/s 2024-08-19T00:24:46.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:46 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/3018131750' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-08-19T00:24:46.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:46 smithi116 ceph-mon[21873]: osdmap e107: 12 total, 12 up, 12 in 2024-08-19T00:24:46.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:46 smithi044 ceph-mon[18489]: pgmap v357: 129 pgs: 129 active+clean; 540 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.0 KiB/s wr, 7 op/s 2024-08-19T00:24:46.370 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:46 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/3018131750' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-08-19T00:24:46.370 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:46 smithi044 ceph-mon[18489]: osdmap e107: 12 total, 12 up, 12 in 2024-08-19T00:24:46.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:46.667+0000 7fe8bb4de640 1 -- 172.21.15.44:0/2114549912 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8b41078b0 msgr2=0x7fe8b4107c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:46.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:46.667+0000 7fe8bb4de640 1 --2- 172.21.15.44:0/2114549912 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8b41078b0 0x7fe8b4107c90 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fe8b0009930 tx=0x7fe8b002a420 comp rx=0 tx=0).stop 2024-08-19T00:24:46.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:46.667+0000 7fe8bb4de640 1 -- 172.21.15.44:0/2114549912 shutdown_connections 2024-08-19T00:24:46.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:46.667+0000 7fe8bb4de640 1 --2- 172.21.15.44:0/2114549912 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe8b4102250 0x7fe8b410e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:46.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:46.667+0000 7fe8bb4de640 1 --2- 172.21.15.44:0/2114549912 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe8b41018b0 0x7fe8b4101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:46.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:46.667+0000 7fe8bb4de640 1 --2- 172.21.15.44:0/2114549912 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8b41078b0 0x7fe8b4107c90 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:46.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:46.667+0000 7fe8bb4de640 1 -- 172.21.15.44:0/2114549912 >> 172.21.15.44:0/2114549912 conn(0x7fe8b40fd5f0 msgr2=0x7fe8b40ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:24:46.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:46.667+0000 7fe8bb4de640 1 -- 172.21.15.44:0/2114549912 shutdown_connections 2024-08-19T00:24:46.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:46.667+0000 7fe8bb4de640 1 -- 172.21.15.44:0/2114549912 wait complete. 2024-08-19T00:24:46.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:46.667+0000 7fe8bb4de640 1 Processor -- start 2024-08-19T00:24:46.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:46.668+0000 7fe8bb4de640 1 -- start start 2024-08-19T00:24:46.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:46.668+0000 7fe8bb4de640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8b41018b0 0x7fe8b41981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:46.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:46.668+0000 7fe8bb4de640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe8b4102250 0x7fe8b4198730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:46.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:46.668+0000 7fe8bb4de640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe8b41078b0 0x7fe8b419cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:46.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:46.668+0000 7fe8bb4de640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe8b4111cd0 con 0x7fe8b41018b0 2024-08-19T00:24:46.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:46.668+0000 7fe8bb4de640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fe8b4111b50 con 0x7fe8b4102250 2024-08-19T00:24:46.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:46.668+0000 7fe8bb4de640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe8b4111e50 con 0x7fe8b41078b0 2024-08-19T00:24:46.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:46.668+0000 7fe8b927a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8b41018b0 0x7fe8b41981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:46.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:46.668+0000 7fe8b927a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8b41018b0 0x7fe8b41981f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41284/0 (socket says 172.21.15.44:41284) 2024-08-19T00:24:46.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:46.668+0000 7fe8b927a640 1 -- 172.21.15.44:0/2136482035 learned_addr learned my addr 172.21.15.44:0/2136482035 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:24:46.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:46.668+0000 7fe8b9a7b640 1 --2- 172.21.15.44:0/2136482035 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe8b41078b0 0x7fe8b419cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:46.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:46.668+0000 7fe8b8a79640 1 --2- 172.21.15.44:0/2136482035 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe8b4102250 0x7fe8b4198730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:46.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:46.668+0000 7fe8b927a640 1 -- 172.21.15.44:0/2136482035 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe8b41078b0 msgr2=0x7fe8b419cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:46.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:46.668+0000 7fe8b927a640 1 --2- 172.21.15.44:0/2136482035 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe8b41078b0 0x7fe8b419cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:46.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:46.668+0000 7fe8b927a640 1 -- 172.21.15.44:0/2136482035 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe8b4102250 msgr2=0x7fe8b4198730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:46.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:46.668+0000 7fe8b927a640 1 --2- 172.21.15.44:0/2136482035 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe8b4102250 0x7fe8b4198730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:46.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:46.668+0000 7fe8b927a640 1 -- 172.21.15.44:0/2136482035 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8b419d1a0 con 0x7fe8b41018b0 2024-08-19T00:24:46.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:46.668+0000 7fe8b9a7b640 1 --2- 172.21.15.44:0/2136482035 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe8b41078b0 0x7fe8b419cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:24:46.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:46.668+0000 7fe8b927a640 1 --2- 172.21.15.44:0/2136482035 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8b41018b0 0x7fe8b41981f0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fe8b0009a50 tx=0x7fe8b0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:24:46.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:46.669+0000 7fe8aa7fc640 1 -- 172.21.15.44:0/2136482035 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b003f030 con 0x7fe8b41018b0 2024-08-19T00:24:46.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:46.669+0000 7fe8bb4de640 1 -- 172.21.15.44:0/2136482035 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8b419d430 con 0x7fe8b41018b0 2024-08-19T00:24:46.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:46.669+0000 7fe8aa7fc640 1 -- 172.21.15.44:0/2136482035 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8b0003ce0 con 0x7fe8b41018b0 2024-08-19T00:24:46.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:46.669+0000 7fe8aa7fc640 1 -- 172.21.15.44:0/2136482035 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b0035070 con 0x7fe8b41018b0 2024-08-19T00:24:46.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:46.669+0000 7fe8bb4de640 1 -- 172.21.15.44:0/2136482035 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8b41a4d70 con 0x7fe8b41018b0 2024-08-19T00:24:46.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:46.670+0000 7fe8bb4de640 1 -- 172.21.15.44:0/2136482035 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8b4102ff0 con 0x7fe8b41018b0 2024-08-19T00:24:46.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:46.671+0000 7fe8aa7fc640 1 -- 172.21.15.44:0/2136482035 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fe8b0042030 con 0x7fe8b41018b0 2024-08-19T00:24:46.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:46.672+0000 7fe8aa7fc640 1 --2- 172.21.15.44:0/2136482035 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fe8a00a2cf0 0x7fe8a00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:46.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:46.672+0000 7fe8b8a79640 1 --2- 172.21.15.44:0/2136482035 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fe8a00a2cf0 0x7fe8a00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:46.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:46.672+0000 7fe8aa7fc640 1 -- 172.21.15.44:0/2136482035 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 9350+0+0 (secure 0 0 0) 0x7fe8b00f0290 con 0x7fe8b41018b0 2024-08-19T00:24:46.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:46.672+0000 7fe8b8a79640 1 --2- 172.21.15.44:0/2136482035 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fe8a00a2cf0 0x7fe8a00a51b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe8b40ffbd0 tx=0x7fe8a4008040 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:24:46.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:46.675+0000 7fe8aa7fc640 1 -- 172.21.15.44:0/2136482035 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fe8b00bcb10 con 0x7fe8b41018b0 2024-08-19T00:24:46.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:46.854+0000 7fe8bb4de640 1 -- 172.21.15.44:0/2136482035 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe8b4101d10 con 0x7fe8b41018b0 2024-08-19T00:24:47.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:47.089+0000 7fe8aa7fc640 1 -- 172.21.15.44:0/2136482035 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v108) ==== 169+0+0 (secure 0 0 0) 0x7fe8b00bc410 con 0x7fe8b41018b0 2024-08-19T00:24:47.091 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data' removed 2024-08-19T00:24:47.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:47.093+0000 7fe8bb4de640 1 -- 172.21.15.44:0/2136482035 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fe8a00a2cf0 msgr2=0x7fe8a00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:47.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:47.093+0000 7fe8bb4de640 1 --2- 172.21.15.44:0/2136482035 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fe8a00a2cf0 0x7fe8a00a51b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe8b40ffbd0 tx=0x7fe8a4008040 comp rx=0 tx=0).stop 2024-08-19T00:24:47.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:47.093+0000 7fe8bb4de640 1 -- 172.21.15.44:0/2136482035 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8b41018b0 msgr2=0x7fe8b41981f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:47.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:47.093+0000 7fe8bb4de640 1 --2- 172.21.15.44:0/2136482035 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8b41018b0 0x7fe8b41981f0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fe8b0009a50 tx=0x7fe8b0004270 comp rx=0 tx=0).stop 2024-08-19T00:24:47.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:47.094+0000 7fe8bb4de640 1 -- 172.21.15.44:0/2136482035 shutdown_connections 2024-08-19T00:24:47.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:47.094+0000 7fe8bb4de640 1 --2- 172.21.15.44:0/2136482035 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7fe8a00a2cf0 0x7fe8a00a51b0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:47.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:47.094+0000 7fe8bb4de640 1 --2- 172.21.15.44:0/2136482035 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe8b41078b0 0x7fe8b419cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:47.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:47.094+0000 7fe8bb4de640 1 --2- 172.21.15.44:0/2136482035 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe8b4102250 0x7fe8b4198730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:47.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:47.094+0000 7fe8bb4de640 1 --2- 172.21.15.44:0/2136482035 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8b41018b0 0x7fe8b41981f0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:47.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:47.094+0000 7fe8bb4de640 1 -- 172.21.15.44:0/2136482035 >> 172.21.15.44:0/2136482035 conn(0x7fe8b40fd5f0 msgr2=0x7fe8b40fddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:24:47.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:47.094+0000 7fe8bb4de640 1 -- 172.21.15.44:0/2136482035 shutdown_connections 2024-08-19T00:24:47.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:47.094+0000 7fe8bb4de640 1 -- 172.21.15.44:0/2136482035 wait complete. 2024-08-19T00:24:47.108 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:47 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/2136482035' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-08-19T00:24:47.342 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:47 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/2136482035' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-08-19T00:24:47.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:47 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/2136482035' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-08-19T00:24:47.814 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 shell --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 -- ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-08-19T00:24:48.076 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/mon.a/config 2024-08-19T00:24:48.357 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:48 smithi044 ceph-mon[18489]: pgmap v359: 97 pgs: 97 active+clean; 51 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:24:48.357 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:48 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/2136482035' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-08-19T00:24:48.357 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:48 smithi044 ceph-mon[18489]: osdmap e108: 12 total, 12 up, 12 in 2024-08-19T00:24:48.365 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:48 smithi116 ceph-mon[21873]: pgmap v359: 97 pgs: 97 active+clean; 51 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:24:48.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:48 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/2136482035' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-08-19T00:24:48.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:48 smithi116 ceph-mon[21873]: osdmap e108: 12 total, 12 up, 12 in 2024-08-19T00:24:48.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:48.567+0000 7f8db3ac4640 1 -- 172.21.15.44:0/1114349073 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8dac10bea0 msgr2=0x7f8dac10e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:48.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:48.567+0000 7f8db3ac4640 1 --2- 172.21.15.44:0/1114349073 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8dac10bea0 0x7f8dac10e340 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f8da4009ca0 tx=0x7f8da402a950 comp rx=0 tx=0).stop 2024-08-19T00:24:48.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:48.568+0000 7f8db3ac4640 1 -- 172.21.15.44:0/1114349073 shutdown_connections 2024-08-19T00:24:48.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:48.568+0000 7f8db3ac4640 1 --2- 172.21.15.44:0/1114349073 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8dac103390 0x7f8dac10b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:48.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:48.568+0000 7f8db3ac4640 1 --2- 172.21.15.44:0/1114349073 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8dac10bea0 0x7f8dac10e340 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:48.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:48.568+0000 7f8db3ac4640 1 --2- 172.21.15.44:0/1114349073 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8dac102a70 0x7f8dac102e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:48.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:48.568+0000 7f8db3ac4640 1 -- 172.21.15.44:0/1114349073 >> 172.21.15.44:0/1114349073 conn(0x7f8dac0fc4d0 msgr2=0x7f8dac0fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:24:48.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:48.568+0000 7f8db3ac4640 1 -- 172.21.15.44:0/1114349073 shutdown_connections 2024-08-19T00:24:48.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:48.568+0000 7f8db3ac4640 1 -- 172.21.15.44:0/1114349073 wait complete. 2024-08-19T00:24:48.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:48.568+0000 7f8db3ac4640 1 Processor -- start 2024-08-19T00:24:48.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:48.568+0000 7f8db3ac4640 1 -- start start 2024-08-19T00:24:48.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:48.568+0000 7f8db3ac4640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8dac102a70 0x7f8dac198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:48.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:48.568+0000 7f8db3ac4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8dac103390 0x7f8dac1987a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:48.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:48.568+0000 7f8db3ac4640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8dac10bea0 0x7f8dac19cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:48.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:48.568+0000 7f8db3ac4640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8dac111d60 con 0x7f8dac103390 2024-08-19T00:24:48.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:48.568+0000 7f8db3ac4640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f8dac111be0 con 0x7f8dac102a70 2024-08-19T00:24:48.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:48.568+0000 7f8db3ac4640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8dac111ee0 con 0x7f8dac10bea0 2024-08-19T00:24:48.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:48.569+0000 7f8db105f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8dac103390 0x7f8dac1987a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:48.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:48.569+0000 7f8db105f640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8dac103390 0x7f8dac1987a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41302/0 (socket says 172.21.15.44:41302) 2024-08-19T00:24:48.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:48.569+0000 7f8db105f640 1 -- 172.21.15.44:0/1162762978 learned_addr learned my addr 172.21.15.44:0/1162762978 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-08-19T00:24:48.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:48.569+0000 7f8db1860640 1 --2- 172.21.15.44:0/1162762978 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8dac102a70 0x7f8dac198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:48.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:48.569+0000 7f8db2061640 1 --2- 172.21.15.44:0/1162762978 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8dac10bea0 0x7f8dac19cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:48.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:48.569+0000 7f8db105f640 1 -- 172.21.15.44:0/1162762978 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8dac10bea0 msgr2=0x7f8dac19cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:48.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:48.569+0000 7f8db105f640 1 --2- 172.21.15.44:0/1162762978 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8dac10bea0 0x7f8dac19cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:48.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:48.569+0000 7f8db105f640 1 -- 172.21.15.44:0/1162762978 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8dac102a70 msgr2=0x7f8dac198260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:48.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:48.569+0000 7f8db105f640 1 --2- 172.21.15.44:0/1162762978 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8dac102a70 0x7f8dac198260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:48.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:48.569+0000 7f8db105f640 1 -- 172.21.15.44:0/1162762978 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dac19d210 con 0x7f8dac103390 2024-08-19T00:24:48.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:48.569+0000 7f8db2061640 1 --2- 172.21.15.44:0/1162762978 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8dac10bea0 0x7f8dac19cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:24:48.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:48.569+0000 7f8db105f640 1 --2- 172.21.15.44:0/1162762978 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8dac103390 0x7f8dac1987a0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f8da800b3f0 tx=0x7f8da800b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:24:48.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:48.569+0000 7f8d9effd640 1 -- 172.21.15.44:0/1162762978 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da8015020 con 0x7f8dac103390 2024-08-19T00:24:48.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:48.569+0000 7f8db3ac4640 1 -- 172.21.15.44:0/1162762978 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dac19d500 con 0x7f8dac103390 2024-08-19T00:24:48.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:48.569+0000 7f8d9effd640 1 -- 172.21.15.44:0/1162762978 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8da8011d10 con 0x7f8dac103390 2024-08-19T00:24:48.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:48.569+0000 7f8d9effd640 1 -- 172.21.15.44:0/1162762978 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da8010e60 con 0x7f8dac103390 2024-08-19T00:24:48.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:48.569+0000 7f8db3ac4640 1 -- 172.21.15.44:0/1162762978 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dac1a4de0 con 0x7f8dac103390 2024-08-19T00:24:48.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:48.570+0000 7f8db3ac4640 1 -- 172.21.15.44:0/1162762978 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dac102ed0 con 0x7f8dac103390 2024-08-19T00:24:48.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:48.572+0000 7f8d9effd640 1 -- 172.21.15.44:0/1162762978 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f8da8018020 con 0x7f8dac103390 2024-08-19T00:24:48.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:48.572+0000 7f8d9effd640 1 --2- 172.21.15.44:0/1162762978 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f8d980a2cf0 0x7f8d980a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:24:48.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:48.572+0000 7f8d9effd640 1 -- 172.21.15.44:0/1162762978 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 8754+0+0 (secure 0 0 0) 0x7f8da80cf1d0 con 0x7f8dac103390 2024-08-19T00:24:48.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:48.572+0000 7f8db1860640 1 --2- 172.21.15.44:0/1162762978 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f8d980a2cf0 0x7f8d980a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:24:48.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:48.573+0000 7f8db1860640 1 --2- 172.21.15.44:0/1162762978 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f8d980a2cf0 0x7f8d980a51b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8da0009990 tx=0x7f8da0009110 comp rx=0 tx=0).ready entity=mgr.15297 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:24:48.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:48.576+0000 7f8d9effd640 1 -- 172.21.15.44:0/1162762978 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f8da801f020 con 0x7f8dac103390 2024-08-19T00:24:48.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:48 smithi171 ceph-mon[21810]: pgmap v359: 97 pgs: 97 active+clean; 51 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:24:48.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:48 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/2136482035' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-08-19T00:24:48.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:48 smithi171 ceph-mon[21810]: osdmap e108: 12 total, 12 up, 12 in 2024-08-19T00:24:48.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:48.752+0000 7f8db3ac4640 1 -- 172.21.15.44:0/1162762978 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f8dac106980 con 0x7f8dac103390 2024-08-19T00:24:49.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:49.096+0000 7f8d9effd640 1 -- 172.21.15.44:0/1162762978 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v109) ==== 178+0+0 (secure 0 0 0) 0x7f8da809beb0 con 0x7f8dac103390 2024-08-19T00:24:49.098 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data_ec' removed 2024-08-19T00:24:49.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:49.099+0000 7f8db3ac4640 1 -- 172.21.15.44:0/1162762978 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f8d980a2cf0 msgr2=0x7f8d980a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:49.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:49.099+0000 7f8db3ac4640 1 --2- 172.21.15.44:0/1162762978 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f8d980a2cf0 0x7f8d980a51b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8da0009990 tx=0x7f8da0009110 comp rx=0 tx=0).stop 2024-08-19T00:24:49.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:49.099+0000 7f8db3ac4640 1 -- 172.21.15.44:0/1162762978 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8dac103390 msgr2=0x7f8dac1987a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:24:49.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:49.099+0000 7f8db3ac4640 1 --2- 172.21.15.44:0/1162762978 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8dac103390 0x7f8dac1987a0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f8da800b3f0 tx=0x7f8da800b7f0 comp rx=0 tx=0).stop 2024-08-19T00:24:49.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:49.099+0000 7f8db3ac4640 1 -- 172.21.15.44:0/1162762978 shutdown_connections 2024-08-19T00:24:49.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:49.099+0000 7f8db3ac4640 1 --2- 172.21.15.44:0/1162762978 >> [v2:172.21.15.44:6800/1029670730,v1:172.21.15.44:6801/1029670730] conn(0x7f8d980a2cf0 0x7f8d980a51b0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:49.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:49.099+0000 7f8db3ac4640 1 --2- 172.21.15.44:0/1162762978 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8dac10bea0 0x7f8dac19cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:49.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:49.099+0000 7f8db3ac4640 1 --2- 172.21.15.44:0/1162762978 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8dac103390 0x7f8dac1987a0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:49.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:49.099+0000 7f8db3ac4640 1 --2- 172.21.15.44:0/1162762978 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8dac102a70 0x7f8dac198260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:24:49.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:49.099+0000 7f8db3ac4640 1 -- 172.21.15.44:0/1162762978 >> 172.21.15.44:0/1162762978 conn(0x7f8dac0fc4d0 msgr2=0x7f8dac0fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:24:49.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:49.100+0000 7f8db3ac4640 1 -- 172.21.15.44:0/1162762978 shutdown_connections 2024-08-19T00:24:49.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-08-19T00:24:49.100+0000 7f8db3ac4640 1 -- 172.21.15.44:0/1162762978 wait complete. 2024-08-19T00:24:49.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:49 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/1162762978' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-08-19T00:24:49.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:49 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/1162762978' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-08-19T00:24:49.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:49 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/1162762978' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-08-19T00:24:49.749 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-19T00:24:49.775 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-19T00:24:49.806 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-19T00:24:49.837 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-08-19T00:24:49.837 DEBUG:teuthology.orchestra.run.smithi044:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-08-19T00:24:49.853 DEBUG:teuthology.orchestra.run.smithi116:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-08-19T00:24:49.870 DEBUG:teuthology.orchestra.run.smithi171:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-08-19T00:24:49.893 INFO:tasks.cephadm:Stopping all daemons... 2024-08-19T00:24:49.894 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-08-19T00:24:49.894 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mon.a 2024-08-19T00:24:50.099 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:49 smithi044 systemd[1]: Stopping Ceph mon.a for 647ded64-5dbe-11ef-bccf-c7b262605968... 2024-08-19T00:24:50.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:50 smithi116 ceph-mon[21873]: pgmap v361: 33 pgs: 33 active+clean; 51 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:24:50.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:50 smithi116 ceph-mon[21873]: from='client.? 172.21.15.44:0/1162762978' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-08-19T00:24:50.366 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:50 smithi116 ceph-mon[21873]: osdmap e109: 12 total, 12 up, 12 in 2024-08-19T00:24:50.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:50 smithi044 ceph-mon[18489]: pgmap v361: 33 pgs: 33 active+clean; 51 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:24:50.370 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:50 smithi044 ceph-mon[18489]: from='client.? 172.21.15.44:0/1162762978' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-08-19T00:24:50.370 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:50 smithi044 ceph-mon[18489]: osdmap e109: 12 total, 12 up, 12 in 2024-08-19T00:24:50.370 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:50 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mon-a[18485]: 2024-08-19T00:24:50.215+0000 7f7f03585640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-19T00:24:50.370 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:50 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mon-a[18485]: 2024-08-19T00:24:50.215+0000 7f7f03585640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-08-19T00:24:50.371 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:50 smithi044 podman[88543]: 2024-08-19 00:24:50.318729255 +0000 UTC m=+0.226965049 container died c88c8e2b95d4f27928d02091762fa7eaed22ecd96f0a528af3eef69dd063d035 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mon-a, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, RELEASE=squid-de09dd0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-19T00:24:50.592 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:50 smithi171 ceph-mon[21810]: pgmap v361: 33 pgs: 33 active+clean; 51 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-19T00:24:50.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:50 smithi171 ceph-mon[21810]: from='client.? 172.21.15.44:0/1162762978' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-08-19T00:24:50.593 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:50 smithi171 ceph-mon[21810]: osdmap e109: 12 total, 12 up, 12 in 2024-08-19T00:24:51.069 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:50 smithi044 podman[88543]: 2024-08-19 00:24:50.8579375 +0000 UTC m=+0.766173291 container cleanup c88c8e2b95d4f27928d02091762fa7eaed22ecd96f0a528af3eef69dd063d035 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mon-a, ceph=True, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-de09dd0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-19T00:24:51.069 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:50 smithi044 bash[88543]: ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mon-a 2024-08-19T00:24:51.299 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mon.a.service' 2024-08-19T00:24:51.320 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:51 smithi044 podman[88555]: 2024-08-19 00:24:51.068036243 +0000 UTC m=+0.743642487 container remove c88c8e2b95d4f27928d02091762fa7eaed22ecd96f0a528af3eef69dd063d035 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mon-a, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-de09dd0, io.buildah.version=1.36.0, org.label-schema.license=GPLv2) 2024-08-19T00:24:51.320 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:51 smithi044 systemd[1]: ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mon.a.service: Deactivated successfully. 2024-08-19T00:24:51.321 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:51 smithi044 systemd[1]: Stopped Ceph mon.a for 647ded64-5dbe-11ef-bccf-c7b262605968. 2024-08-19T00:24:51.321 INFO:journalctl@ceph.mon.a.smithi044.stdout:Aug 19 00:24:51 smithi044 systemd[1]: ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mon.a.service: Consumed 22.365s CPU time. 2024-08-19T00:24:51.347 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-19T00:24:51.347 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-08-19T00:24:51.347 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-08-19T00:24:51.348 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mon.b 2024-08-19T00:24:51.670 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:51 smithi116 systemd[1]: Stopping Ceph mon.b for 647ded64-5dbe-11ef-bccf-c7b262605968... 2024-08-19T00:24:52.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:51 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mon-b[21869]: 2024-08-19T00:24:51.669+0000 7f4a65e00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-19T00:24:52.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:51 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mon-b[21869]: 2024-08-19T00:24:51.669+0000 7f4a65e00640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-08-19T00:24:52.116 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:51 smithi116 podman[57017]: 2024-08-19 00:24:51.883887607 +0000 UTC m=+0.332722443 container died 1bd427db0f97ca1d6fc215bd46433c637335d87b66236d6064fe9b94b81591b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mon-b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-de09dd0, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD) 2024-08-19T00:24:52.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:52 smithi116 podman[57017]: 2024-08-19 00:24:52.252878243 +0000 UTC m=+0.701713060 container cleanup 1bd427db0f97ca1d6fc215bd46433c637335d87b66236d6064fe9b94b81591b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mon-b, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-de09dd0, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-08-19T00:24:52.616 INFO:journalctl@ceph.mon.b.smithi116.stdout:Aug 19 00:24:52 smithi116 bash[57017]: ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mon-b 2024-08-19T00:24:52.848 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mon.b.service' 2024-08-19T00:24:52.895 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-19T00:24:52.896 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-08-19T00:24:52.896 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-08-19T00:24:52.896 DEBUG:teuthology.orchestra.run.smithi171:> sudo systemctl stop ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mon.c 2024-08-19T00:24:53.296 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:52 smithi171 systemd[1]: Stopping Ceph mon.c for 647ded64-5dbe-11ef-bccf-c7b262605968... 2024-08-19T00:24:53.568 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:53 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mon-c[21803]: 2024-08-19T00:24:53.308+0000 7feee08e9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-19T00:24:53.569 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:53 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mon-c[21803]: 2024-08-19T00:24:53.308+0000 7feee08e9640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-08-19T00:24:53.569 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:53 smithi171 podman[57589]: 2024-08-19 00:24:53.410773994 +0000 UTC m=+0.225364722 container died 24d8e69f1631f642e12c94220b5453f2b7b92a92f61f6e1213fbd4e0d2efd77b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mon-c, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-de09dd0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-08-19T00:24:54.323 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:53 smithi171 podman[57589]: 2024-08-19 00:24:53.843341436 +0000 UTC m=+0.657932155 container cleanup 24d8e69f1631f642e12c94220b5453f2b7b92a92f61f6e1213fbd4e0d2efd77b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mon-c, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-de09dd0, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-19T00:24:54.323 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:53 smithi171 bash[57589]: ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mon-c 2024-08-19T00:24:54.324 INFO:journalctl@ceph.mon.c.smithi171.stdout:Aug 19 00:24:54 smithi171 podman[57601]: 2024-08-19 00:24:54.07826285 +0000 UTC m=+0.670915495 container remove 24d8e69f1631f642e12c94220b5453f2b7b92a92f61f6e1213fbd4e0d2efd77b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mon-c, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-de09dd0, ceph=True, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-19T00:24:54.339 DEBUG:teuthology.orchestra.run.smithi171:> sudo pkill -f 'journalctl -f -n 0 -u ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mon.c.service' 2024-08-19T00:24:54.380 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-19T00:24:54.380 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-08-19T00:24:54.381 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-08-19T00:24:54.381 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mgr.x 2024-08-19T00:24:54.706 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:24:54 smithi044 systemd[1]: Stopping Ceph mgr.x for 647ded64-5dbe-11ef-bccf-c7b262605968... 2024-08-19T00:24:55.031 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:24:54 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:24:54.702+0000 7f51dc636640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-19T00:24:55.031 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:24:54 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x[18717]: 2024-08-19T00:24:54.702+0000 7f51dc636640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-08-19T00:24:55.031 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:24:54 smithi044 podman[88666]: 2024-08-19 00:24:54.735533772 +0000 UTC m=+0.157062983 container died 1173df5df0ba273065b24c14635dc40ec5e482ed0be6c4a5e11c0cca74daf1e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-de09dd0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-08-19T00:24:55.369 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:24:55 smithi044 podman[88666]: 2024-08-19 00:24:55.221782596 +0000 UTC m=+0.643311806 container cleanup 1173df5df0ba273065b24c14635dc40ec5e482ed0be6c4a5e11c0cca74daf1e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-de09dd0) 2024-08-19T00:24:55.370 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Aug 19 00:24:55 smithi044 bash[88666]: ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-x 2024-08-19T00:24:55.615 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mgr.x.service' 2024-08-19T00:24:55.651 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-19T00:24:55.651 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-08-19T00:24:55.651 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-08-19T00:24:55.652 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mgr.y 2024-08-19T00:24:55.996 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:24:55 smithi116 systemd[1]: Stopping Ceph mgr.y for 647ded64-5dbe-11ef-bccf-c7b262605968... 2024-08-19T00:24:56.251 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:24:55 smithi116 podman[57150]: 2024-08-19 00:24:55.995361525 +0000 UTC m=+0.136769138 container died c21caa90bb7690046d01201773dc1a0500020beec1e06fb4d77457ee2e8557ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-y, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-de09dd0, io.buildah.version=1.36.0) 2024-08-19T00:24:56.615 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:24:56 smithi116 podman[57150]: 2024-08-19 00:24:56.341810501 +0000 UTC m=+0.483218128 container cleanup c21caa90bb7690046d01201773dc1a0500020beec1e06fb4d77457ee2e8557ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-y, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-de09dd0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-19T00:24:56.616 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:24:56 smithi116 bash[57150]: ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-y 2024-08-19T00:24:56.915 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:24:56 smithi116 podman[57162]: 2024-08-19 00:24:56.660379905 +0000 UTC m=+0.659410205 container remove c21caa90bb7690046d01201773dc1a0500020beec1e06fb4d77457ee2e8557ba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-y, ceph=True, RELEASE=squid-de09dd0, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-08-19T00:24:56.915 INFO:journalctl@ceph.mgr.y.smithi116.stdout:Aug 19 00:24:56 smithi116 systemd[1]: ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-08-19T00:24:56.933 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mgr.y.service' 2024-08-19T00:24:56.969 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-19T00:24:56.970 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-08-19T00:24:56.970 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-08-19T00:24:56.970 DEBUG:teuthology.orchestra.run.smithi171:> sudo systemctl stop ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mgr.z 2024-08-19T00:24:57.312 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:24:57 smithi171 systemd[1]: Stopping Ceph mgr.z for 647ded64-5dbe-11ef-bccf-c7b262605968... 2024-08-19T00:24:57.594 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:24:57 smithi171 podman[57723]: 2024-08-19 00:24:57.310662006 +0000 UTC m=+0.139875416 container died b3b6a174db6ef44f1c5008b7ba8c315b7676fb48c0214384e664b5ecc7de3959 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-z, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-de09dd0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-08-19T00:24:57.993 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:24:57 smithi171 podman[57723]: 2024-08-19 00:24:57.698865181 +0000 UTC m=+0.528078590 container cleanup b3b6a174db6ef44f1c5008b7ba8c315b7676fb48c0214384e664b5ecc7de3959 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-z, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.36.0, RELEASE=squid-de09dd0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-08-19T00:24:57.993 INFO:journalctl@ceph.mgr.z.smithi171.stdout:Aug 19 00:24:57 smithi171 bash[57723]: ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mgr-z 2024-08-19T00:24:58.130 DEBUG:teuthology.orchestra.run.smithi171:> sudo pkill -f 'journalctl -f -n 0 -u ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mgr.z.service' 2024-08-19T00:24:58.167 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-19T00:24:58.167 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-08-19T00:24:58.167 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-08-19T00:24:58.168 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-647ded64-5dbe-11ef-bccf-c7b262605968@osd.0 2024-08-19T00:24:58.511 INFO:journalctl@ceph.osd.0.smithi044.stdout:Aug 19 00:24:58 smithi044 systemd[1]: Stopping Ceph osd.0 for 647ded64-5dbe-11ef-bccf-c7b262605968... 2024-08-19T00:24:58.869 INFO:journalctl@ceph.osd.0.smithi044.stdout:Aug 19 00:24:58 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-0[32356]: 2024-08-19T00:24:58.509+0000 7f275fa3e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-19T00:24:58.870 INFO:journalctl@ceph.osd.0.smithi044.stdout:Aug 19 00:24:58 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-0[32356]: 2024-08-19T00:24:58.509+0000 7f275fa3e640 -1 osd.0 109 *** Got signal Terminated *** 2024-08-19T00:24:58.870 INFO:journalctl@ceph.osd.0.smithi044.stdout:Aug 19 00:24:58 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-0[32356]: 2024-08-19T00:24:58.509+0000 7f275fa3e640 -1 osd.0 109 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-19T00:25:04.119 INFO:journalctl@ceph.osd.0.smithi044.stdout:Aug 19 00:25:03 smithi044 podman[88789]: 2024-08-19 00:25:03.865995235 +0000 UTC m=+5.492152553 container died 1e50a86be5ae32f73f361c108cdd2553473f2381d8d88d88bf9ac92ff1ec739b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-de09dd0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-08-19T00:25:04.529 INFO:journalctl@ceph.osd.0.smithi044.stdout:Aug 19 00:25:04 smithi044 podman[88789]: 2024-08-19 00:25:04.243354028 +0000 UTC m=+5.869511340 container cleanup 1e50a86be5ae32f73f361c108cdd2553473f2381d8d88d88bf9ac92ff1ec739b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-de09dd0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0) 2024-08-19T00:25:04.529 INFO:journalctl@ceph.osd.0.smithi044.stdout:Aug 19 00:25:04 smithi044 bash[88789]: ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-0 2024-08-19T00:25:04.870 INFO:journalctl@ceph.osd.0.smithi044.stdout:Aug 19 00:25:04 smithi044 podman[88804]: 2024-08-19 00:25:04.528080039 +0000 UTC m=+0.655469980 container remove 1e50a86be5ae32f73f361c108cdd2553473f2381d8d88d88bf9ac92ff1ec739b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-de09dd0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-08-19T00:25:05.166 INFO:journalctl@ceph.osd.0.smithi044.stdout:Aug 19 00:25:04 smithi044 podman[88892]: 2024-08-19 00:25:04.78497369 +0000 UTC m=+0.016985050 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-19T00:25:05.166 INFO:journalctl@ceph.osd.0.smithi044.stdout:Aug 19 00:25:04 smithi044 podman[88892]: 2024-08-19 00:25:04.904177684 +0000 UTC m=+0.136189043 container create fcc6b379166da1b1e3a1896d97cef8ab4ca0f5f8a0b8bd1bbf1b927ccb4b42e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, RELEASE=squid-de09dd0, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-08-19T00:25:05.620 INFO:journalctl@ceph.osd.0.smithi044.stdout:Aug 19 00:25:05 smithi044 podman[88892]: 2024-08-19 00:25:05.164993769 +0000 UTC m=+0.397005140 container init fcc6b379166da1b1e3a1896d97cef8ab4ca0f5f8a0b8bd1bbf1b927ccb4b42e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-0-deactivate, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-de09dd0, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-08-19T00:25:05.620 INFO:journalctl@ceph.osd.0.smithi044.stdout:Aug 19 00:25:05 smithi044 podman[88892]: 2024-08-19 00:25:05.169918165 +0000 UTC m=+0.401929528 container start fcc6b379166da1b1e3a1896d97cef8ab4ca0f5f8a0b8bd1bbf1b927ccb4b42e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-de09dd0, org.label-schema.build-date=20240731) 2024-08-19T00:25:05.620 INFO:journalctl@ceph.osd.0.smithi044.stdout:Aug 19 00:25:05 smithi044 podman[88892]: 2024-08-19 00:25:05.265052545 +0000 UTC m=+0.497063905 container attach fcc6b379166da1b1e3a1896d97cef8ab4ca0f5f8a0b8bd1bbf1b927ccb4b42e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-de09dd0, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-08-19T00:25:05.620 INFO:journalctl@ceph.osd.0.smithi044.stdout:Aug 19 00:25:05 smithi044 podman[88892]: 2024-08-19 00:25:05.361134176 +0000 UTC m=+0.593145536 container died fcc6b379166da1b1e3a1896d97cef8ab4ca0f5f8a0b8bd1bbf1b927ccb4b42e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, RELEASE=squid-de09dd0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-08-19T00:25:06.179 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-647ded64-5dbe-11ef-bccf-c7b262605968@osd.0.service' 2024-08-19T00:25:06.227 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-19T00:25:06.227 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-08-19T00:25:06.227 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-08-19T00:25:06.227 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-647ded64-5dbe-11ef-bccf-c7b262605968@osd.1 2024-08-19T00:25:06.565 INFO:journalctl@ceph.osd.1.smithi116.stdout:Aug 19 00:25:06 smithi116 systemd[1]: Stopping Ceph osd.1 for 647ded64-5dbe-11ef-bccf-c7b262605968... 2024-08-19T00:25:06.866 INFO:journalctl@ceph.osd.1.smithi116.stdout:Aug 19 00:25:06 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-1[26202]: 2024-08-19T00:25:06.563+0000 7f9026ae6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-19T00:25:06.866 INFO:journalctl@ceph.osd.1.smithi116.stdout:Aug 19 00:25:06 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-1[26202]: 2024-08-19T00:25:06.563+0000 7f9026ae6640 -1 osd.1 109 *** Got signal Terminated *** 2024-08-19T00:25:06.866 INFO:journalctl@ceph.osd.1.smithi116.stdout:Aug 19 00:25:06 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-1[26202]: 2024-08-19T00:25:06.563+0000 7f9026ae6640 -1 osd.1 109 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-19T00:25:12.282 INFO:journalctl@ceph.osd.1.smithi116.stdout:Aug 19 00:25:11 smithi116 podman[57275]: 2024-08-19 00:25:11.99012038 +0000 UTC m=+5.548878242 container died 63a67a7756a14edd743e20447234bd6828b0d727fb5d2751e9808f28f6a05491 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-1, RELEASE=squid-de09dd0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0) 2024-08-19T00:25:12.549 INFO:journalctl@ceph.osd.1.smithi116.stdout:Aug 19 00:25:12 smithi116 podman[57275]: 2024-08-19 00:25:12.35525982 +0000 UTC m=+5.914017672 container cleanup 63a67a7756a14edd743e20447234bd6828b0d727fb5d2751e9808f28f6a05491 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-de09dd0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, ceph=True) 2024-08-19T00:25:12.549 INFO:journalctl@ceph.osd.1.smithi116.stdout:Aug 19 00:25:12 smithi116 bash[57275]: ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-1 2024-08-19T00:25:12.866 INFO:journalctl@ceph.osd.1.smithi116.stdout:Aug 19 00:25:12 smithi116 podman[57291]: 2024-08-19 00:25:12.548244594 +0000 UTC m=+0.553937270 container remove 63a67a7756a14edd743e20447234bd6828b0d727fb5d2751e9808f28f6a05491 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-1, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-de09dd0, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-08-19T00:25:13.245 INFO:journalctl@ceph.osd.1.smithi116.stdout:Aug 19 00:25:12 smithi116 podman[57381]: 2024-08-19 00:25:12.886354831 +0000 UTC m=+0.017267557 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-19T00:25:13.245 INFO:journalctl@ceph.osd.1.smithi116.stdout:Aug 19 00:25:12 smithi116 podman[57381]: 2024-08-19 00:25:12.991271576 +0000 UTC m=+0.122184344 container create a095b07121273a87b248241004b6340d2f822c7d9a2c897e795785f2e5c2ba20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-1-deactivate, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-de09dd0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-08-19T00:25:13.245 INFO:journalctl@ceph.osd.1.smithi116.stdout:Aug 19 00:25:13 smithi116 podman[57381]: 2024-08-19 00:25:13.244075535 +0000 UTC m=+0.374988274 container init a095b07121273a87b248241004b6340d2f822c7d9a2c897e795785f2e5c2ba20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=squid-de09dd0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-08-19T00:25:13.616 INFO:journalctl@ceph.osd.1.smithi116.stdout:Aug 19 00:25:13 smithi116 podman[57381]: 2024-08-19 00:25:13.247917526 +0000 UTC m=+0.378830253 container start a095b07121273a87b248241004b6340d2f822c7d9a2c897e795785f2e5c2ba20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-de09dd0) 2024-08-19T00:25:13.616 INFO:journalctl@ceph.osd.1.smithi116.stdout:Aug 19 00:25:13 smithi116 podman[57381]: 2024-08-19 00:25:13.327438579 +0000 UTC m=+0.458351315 container attach a095b07121273a87b248241004b6340d2f822c7d9a2c897e795785f2e5c2ba20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-de09dd0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-08-19T00:25:13.617 INFO:journalctl@ceph.osd.1.smithi116.stdout:Aug 19 00:25:13 smithi116 podman[57381]: 2024-08-19 00:25:13.435820618 +0000 UTC m=+0.566733347 container died a095b07121273a87b248241004b6340d2f822c7d9a2c897e795785f2e5c2ba20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=squid-de09dd0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-08-19T00:25:14.022 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-647ded64-5dbe-11ef-bccf-c7b262605968@osd.1.service' 2024-08-19T00:25:14.062 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-19T00:25:14.063 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-08-19T00:25:14.063 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-08-19T00:25:14.063 DEBUG:teuthology.orchestra.run.smithi171:> sudo systemctl stop ceph-647ded64-5dbe-11ef-bccf-c7b262605968@osd.2 2024-08-19T00:25:14.342 INFO:journalctl@ceph.osd.2.smithi171.stdout:Aug 19 00:25:14 smithi171 systemd[1]: Stopping Ceph osd.2 for 647ded64-5dbe-11ef-bccf-c7b262605968... 2024-08-19T00:25:14.842 INFO:journalctl@ceph.osd.2.smithi171.stdout:Aug 19 00:25:14 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-2[26744]: 2024-08-19T00:25:14.377+0000 7f0b3e1e6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-19T00:25:14.843 INFO:journalctl@ceph.osd.2.smithi171.stdout:Aug 19 00:25:14 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-2[26744]: 2024-08-19T00:25:14.377+0000 7f0b3e1e6640 -1 osd.2 109 *** Got signal Terminated *** 2024-08-19T00:25:14.843 INFO:journalctl@ceph.osd.2.smithi171.stdout:Aug 19 00:25:14 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-2[26744]: 2024-08-19T00:25:14.377+0000 7f0b3e1e6640 -1 osd.2 109 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-19T00:25:20.022 INFO:journalctl@ceph.osd.2.smithi171.stdout:Aug 19 00:25:19 smithi171 podman[57850]: 2024-08-19 00:25:19.736260561 +0000 UTC m=+5.476365041 container died 43e1c2a6724dbc8dcb8fd24d612a2aed2c08e68ac8ddcd9a98bbfdbd3a2156d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-2, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-de09dd0, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-08-19T00:25:20.342 INFO:journalctl@ceph.osd.2.smithi171.stdout:Aug 19 00:25:20 smithi171 podman[57850]: 2024-08-19 00:25:20.111094891 +0000 UTC m=+5.851199405 container cleanup 43e1c2a6724dbc8dcb8fd24d612a2aed2c08e68ac8ddcd9a98bbfdbd3a2156d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-de09dd0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-08-19T00:25:20.343 INFO:journalctl@ceph.osd.2.smithi171.stdout:Aug 19 00:25:20 smithi171 bash[57850]: ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-2 2024-08-19T00:25:20.738 INFO:journalctl@ceph.osd.2.smithi171.stdout:Aug 19 00:25:20 smithi171 podman[57867]: 2024-08-19 00:25:20.40642044 +0000 UTC m=+0.668067279 container remove 43e1c2a6724dbc8dcb8fd24d612a2aed2c08e68ac8ddcd9a98bbfdbd3a2156d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.36.0, RELEASE=squid-de09dd0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-08-19T00:25:21.028 INFO:journalctl@ceph.osd.2.smithi171.stdout:Aug 19 00:25:20 smithi171 podman[57953]: 2024-08-19 00:25:20.639540313 +0000 UTC m=+0.017220485 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-19T00:25:21.028 INFO:journalctl@ceph.osd.2.smithi171.stdout:Aug 19 00:25:20 smithi171 podman[57953]: 2024-08-19 00:25:20.757514645 +0000 UTC m=+0.135194852 container create e47cbcf35cedd82226fcebbcb98b95156a54ee85db2b9f543543e8200eaa53af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-de09dd0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-19T00:25:21.342 INFO:journalctl@ceph.osd.2.smithi171.stdout:Aug 19 00:25:21 smithi171 podman[57953]: 2024-08-19 00:25:21.027125145 +0000 UTC m=+0.404805311 container init e47cbcf35cedd82226fcebbcb98b95156a54ee85db2b9f543543e8200eaa53af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-de09dd0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, GIT_BRANCH=HEAD) 2024-08-19T00:25:21.343 INFO:journalctl@ceph.osd.2.smithi171.stdout:Aug 19 00:25:21 smithi171 podman[57953]: 2024-08-19 00:25:21.030606314 +0000 UTC m=+0.408286485 container start e47cbcf35cedd82226fcebbcb98b95156a54ee85db2b9f543543e8200eaa53af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-2-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-de09dd0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-19T00:25:21.343 INFO:journalctl@ceph.osd.2.smithi171.stdout:Aug 19 00:25:21 smithi171 podman[57953]: 2024-08-19 00:25:21.127302935 +0000 UTC m=+0.504983121 container attach e47cbcf35cedd82226fcebbcb98b95156a54ee85db2b9f543543e8200eaa53af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-de09dd0) 2024-08-19T00:25:21.343 INFO:journalctl@ceph.osd.2.smithi171.stdout:Aug 19 00:25:21 smithi171 podman[57953]: 2024-08-19 00:25:21.22504304 +0000 UTC m=+0.602723216 container died e47cbcf35cedd82226fcebbcb98b95156a54ee85db2b9f543543e8200eaa53af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-de09dd0, io.buildah.version=1.36.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-19T00:25:21.902 DEBUG:teuthology.orchestra.run.smithi171:> sudo pkill -f 'journalctl -f -n 0 -u ceph-647ded64-5dbe-11ef-bccf-c7b262605968@osd.2.service' 2024-08-19T00:25:21.942 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-19T00:25:21.942 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-08-19T00:25:21.942 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-08-19T00:25:21.943 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-647ded64-5dbe-11ef-bccf-c7b262605968@osd.3 2024-08-19T00:25:22.270 INFO:journalctl@ceph.osd.3.smithi044.stdout:Aug 19 00:25:21 smithi044 systemd[1]: Stopping Ceph osd.3 for 647ded64-5dbe-11ef-bccf-c7b262605968... 2024-08-19T00:25:22.619 INFO:journalctl@ceph.osd.3.smithi044.stdout:Aug 19 00:25:22 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-3[38857]: 2024-08-19T00:25:22.268+0000 7fed96a23640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-19T00:25:22.620 INFO:journalctl@ceph.osd.3.smithi044.stdout:Aug 19 00:25:22 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-3[38857]: 2024-08-19T00:25:22.268+0000 7fed96a23640 -1 osd.3 109 *** Got signal Terminated *** 2024-08-19T00:25:22.620 INFO:journalctl@ceph.osd.3.smithi044.stdout:Aug 19 00:25:22 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-3[38857]: 2024-08-19T00:25:22.268+0000 7fed96a23640 -1 osd.3 109 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-19T00:25:24.869 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:24 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6[45317]: 2024-08-19T00:25:24.540+0000 7f590ffdf640 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:24:58.311869+0000 front 2024-08-19T00:24:58.311932+0000 (oldest deadline 2024-08-19T00:25:24.212094+0000) 2024-08-19T00:25:24.870 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:24 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:24.735+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:01.954691+0000 front 2024-08-19T00:25:01.954869+0000 (oldest deadline 2024-08-19T00:25:24.254908+0000) 2024-08-19T00:25:25.869 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:25 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6[45317]: 2024-08-19T00:25:25.530+0000 7f590ffdf640 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:24:58.311869+0000 front 2024-08-19T00:24:58.311932+0000 (oldest deadline 2024-08-19T00:25:24.212094+0000) 2024-08-19T00:25:25.870 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:25 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:25.687+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:01.954691+0000 front 2024-08-19T00:25:01.954869+0000 (oldest deadline 2024-08-19T00:25:24.254908+0000) 2024-08-19T00:25:26.594 INFO:journalctl@ceph.osd.5.smithi171.stdout:Aug 19 00:25:26 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-5[33174]: 2024-08-19T00:25:26.473+0000 7ff73964b640 -1 osd.5 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.500157+0000 front 2024-08-19T00:25:02.500187+0000 (oldest deadline 2024-08-19T00:25:26.000306+0000) 2024-08-19T00:25:26.595 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:25:26 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:25:26.249+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:25:26.869 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:26 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6[45317]: 2024-08-19T00:25:26.499+0000 7f590ffdf640 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:24:58.311869+0000 front 2024-08-19T00:24:58.311932+0000 (oldest deadline 2024-08-19T00:25:24.212094+0000) 2024-08-19T00:25:26.870 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:26 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:26.643+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:01.954691+0000 front 2024-08-19T00:25:01.954869+0000 (oldest deadline 2024-08-19T00:25:24.254908+0000) 2024-08-19T00:25:27.592 INFO:journalctl@ceph.osd.5.smithi171.stdout:Aug 19 00:25:27 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-5[33174]: 2024-08-19T00:25:27.497+0000 7ff73964b640 -1 osd.5 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.500157+0000 front 2024-08-19T00:25:02.500187+0000 (oldest deadline 2024-08-19T00:25:26.000306+0000) 2024-08-19T00:25:27.593 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:25:27 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:25:27.254+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:25:27.869 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:27 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6[45317]: 2024-08-19T00:25:27.517+0000 7f590ffdf640 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:24:58.311869+0000 front 2024-08-19T00:24:58.311932+0000 (oldest deadline 2024-08-19T00:25:24.212094+0000) 2024-08-19T00:25:27.870 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:27 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:27.669+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:01.954691+0000 front 2024-08-19T00:25:01.954869+0000 (oldest deadline 2024-08-19T00:25:24.254908+0000) 2024-08-19T00:25:27.870 INFO:journalctl@ceph.osd.3.smithi044.stdout:Aug 19 00:25:27 smithi044 podman[89008]: 2024-08-19 00:25:27.642806935 +0000 UTC m=+5.491842712 container died 713366b1a2441569d55be7c782293f699a75bf975c5d4ac9ddc9bbe52813b478 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-3, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-de09dd0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-19T00:25:28.291 INFO:journalctl@ceph.osd.3.smithi044.stdout:Aug 19 00:25:28 smithi044 podman[89008]: 2024-08-19 00:25:28.014493686 +0000 UTC m=+5.863529460 container cleanup 713366b1a2441569d55be7c782293f699a75bf975c5d4ac9ddc9bbe52813b478 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-3, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-de09dd0, io.buildah.version=1.36.0) 2024-08-19T00:25:28.292 INFO:journalctl@ceph.osd.3.smithi044.stdout:Aug 19 00:25:28 smithi044 bash[89008]: ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-3 2024-08-19T00:25:28.520 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:25:28 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:25:28.222+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:25:28.553 INFO:journalctl@ceph.osd.3.smithi044.stdout:Aug 19 00:25:28 smithi044 podman[89023]: 2024-08-19 00:25:28.29071766 +0000 UTC m=+0.650186715 container remove 713366b1a2441569d55be7c782293f699a75bf975c5d4ac9ddc9bbe52813b478 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-3, GIT_CLEAN=True, RELEASE=squid-de09dd0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-19T00:25:28.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:28 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:28.133+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.683396+0000 front 2024-08-19T00:25:02.683292+0000 (oldest deadline 2024-08-19T00:25:27.383313+0000) 2024-08-19T00:25:28.808 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:28 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6[45317]: 2024-08-19T00:25:28.551+0000 7f590ffdf640 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:24:58.311869+0000 front 2024-08-19T00:24:58.311932+0000 (oldest deadline 2024-08-19T00:25:24.212094+0000) 2024-08-19T00:25:28.808 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:28 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:28.626+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:01.954691+0000 front 2024-08-19T00:25:01.954869+0000 (oldest deadline 2024-08-19T00:25:24.254908+0000) 2024-08-19T00:25:28.809 INFO:journalctl@ceph.osd.3.smithi044.stdout:Aug 19 00:25:28 smithi044 podman[89109]: 2024-08-19 00:25:28.562668378 +0000 UTC m=+0.016868577 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-19T00:25:28.809 INFO:journalctl@ceph.osd.3.smithi044.stdout:Aug 19 00:25:28 smithi044 podman[89109]: 2024-08-19 00:25:28.683229431 +0000 UTC m=+0.137429616 container create 7f0b73f4a3a6d8a5a73c9628c83d8fb553863381296fcc779a48045a0288bf91 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-de09dd0, io.buildah.version=1.36.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-08-19T00:25:28.842 INFO:journalctl@ceph.osd.5.smithi171.stdout:Aug 19 00:25:28 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-5[33174]: 2024-08-19T00:25:28.519+0000 7ff73964b640 -1 osd.5 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.500157+0000 front 2024-08-19T00:25:02.500187+0000 (oldest deadline 2024-08-19T00:25:26.000306+0000) 2024-08-19T00:25:29.120 INFO:journalctl@ceph.osd.3.smithi044.stdout:Aug 19 00:25:28 smithi044 podman[89109]: 2024-08-19 00:25:28.961028776 +0000 UTC m=+0.415228975 container init 7f0b73f4a3a6d8a5a73c9628c83d8fb553863381296fcc779a48045a0288bf91 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-3-deactivate, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-de09dd0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0) 2024-08-19T00:25:29.120 INFO:journalctl@ceph.osd.3.smithi044.stdout:Aug 19 00:25:28 smithi044 podman[89109]: 2024-08-19 00:25:28.964455236 +0000 UTC m=+0.418655420 container start 7f0b73f4a3a6d8a5a73c9628c83d8fb553863381296fcc779a48045a0288bf91 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-de09dd0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-08-19T00:25:29.120 INFO:journalctl@ceph.osd.3.smithi044.stdout:Aug 19 00:25:29 smithi044 podman[89109]: 2024-08-19 00:25:29.052644616 +0000 UTC m=+0.506844810 container attach 7f0b73f4a3a6d8a5a73c9628c83d8fb553863381296fcc779a48045a0288bf91 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-de09dd0, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-19T00:25:29.473 INFO:journalctl@ceph.osd.3.smithi044.stdout:Aug 19 00:25:29 smithi044 podman[89109]: 2024-08-19 00:25:29.160745512 +0000 UTC m=+0.614945702 container died 7f0b73f4a3a6d8a5a73c9628c83d8fb553863381296fcc779a48045a0288bf91 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=squid-de09dd0) 2024-08-19T00:25:29.535 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:25:29 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:25:29.172+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:25:29.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:29 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:29.160+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.683396+0000 front 2024-08-19T00:25:02.683292+0000 (oldest deadline 2024-08-19T00:25:27.383313+0000) 2024-08-19T00:25:29.774 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:29 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6[45317]: 2024-08-19T00:25:29.596+0000 7f590ffdf640 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:24:58.311869+0000 front 2024-08-19T00:24:58.311932+0000 (oldest deadline 2024-08-19T00:25:24.212094+0000) 2024-08-19T00:25:29.774 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:29 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:29.661+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:01.954691+0000 front 2024-08-19T00:25:01.954869+0000 (oldest deadline 2024-08-19T00:25:24.254908+0000) 2024-08-19T00:25:29.789 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-647ded64-5dbe-11ef-bccf-c7b262605968@osd.3.service' 2024-08-19T00:25:29.829 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-19T00:25:29.830 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-08-19T00:25:29.830 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-08-19T00:25:29.830 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-647ded64-5dbe-11ef-bccf-c7b262605968@osd.4 2024-08-19T00:25:29.842 INFO:journalctl@ceph.osd.5.smithi171.stdout:Aug 19 00:25:29 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-5[33174]: 2024-08-19T00:25:29.534+0000 7ff73964b640 -1 osd.5 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.500157+0000 front 2024-08-19T00:25:02.500187+0000 (oldest deadline 2024-08-19T00:25:26.000306+0000) 2024-08-19T00:25:30.116 INFO:journalctl@ceph.osd.4.smithi116.stdout:Aug 19 00:25:29 smithi116 systemd[1]: Stopping Ceph osd.4 for 647ded64-5dbe-11ef-bccf-c7b262605968... 2024-08-19T00:25:30.569 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:25:30 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:25:30.220+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:25:30.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:30 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:30.201+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.683396+0000 front 2024-08-19T00:25:02.683292+0000 (oldest deadline 2024-08-19T00:25:27.383313+0000) 2024-08-19T00:25:30.616 INFO:journalctl@ceph.osd.4.smithi116.stdout:Aug 19 00:25:30 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-4[32637]: 2024-08-19T00:25:30.183+0000 7f26664bf640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-19T00:25:30.616 INFO:journalctl@ceph.osd.4.smithi116.stdout:Aug 19 00:25:30 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-4[32637]: 2024-08-19T00:25:30.183+0000 7f26664bf640 -1 osd.4 109 *** Got signal Terminated *** 2024-08-19T00:25:30.617 INFO:journalctl@ceph.osd.4.smithi116.stdout:Aug 19 00:25:30 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-4[32637]: 2024-08-19T00:25:30.183+0000 7f26664bf640 -1 osd.4 109 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-19T00:25:30.842 INFO:journalctl@ceph.osd.5.smithi171.stdout:Aug 19 00:25:30 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-5[33174]: 2024-08-19T00:25:30.568+0000 7ff73964b640 -1 osd.5 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.500157+0000 front 2024-08-19T00:25:02.500187+0000 (oldest deadline 2024-08-19T00:25:26.000306+0000) 2024-08-19T00:25:31.119 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:30 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6[45317]: 2024-08-19T00:25:30.638+0000 7f590ffdf640 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:24:58.311869+0000 front 2024-08-19T00:24:58.311932+0000 (oldest deadline 2024-08-19T00:25:24.212094+0000) 2024-08-19T00:25:31.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:30 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:30.659+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:01.954691+0000 front 2024-08-19T00:25:01.954869+0000 (oldest deadline 2024-08-19T00:25:24.254908+0000) 2024-08-19T00:25:31.558 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:25:31 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:25:31.188+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:25:31.615 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:31 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:31.196+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.683396+0000 front 2024-08-19T00:25:02.683292+0000 (oldest deadline 2024-08-19T00:25:27.383313+0000) 2024-08-19T00:25:31.842 INFO:journalctl@ceph.osd.5.smithi171.stdout:Aug 19 00:25:31 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-5[33174]: 2024-08-19T00:25:31.557+0000 7ff73964b640 -1 osd.5 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.500157+0000 front 2024-08-19T00:25:02.500187+0000 (oldest deadline 2024-08-19T00:25:26.000306+0000) 2024-08-19T00:25:32.119 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:31 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6[45317]: 2024-08-19T00:25:31.686+0000 7f590ffdf640 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:24:58.311869+0000 front 2024-08-19T00:24:58.311932+0000 (oldest deadline 2024-08-19T00:25:24.212094+0000) 2024-08-19T00:25:32.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:31 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:31.625+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:01.954691+0000 front 2024-08-19T00:25:01.954869+0000 (oldest deadline 2024-08-19T00:25:24.254908+0000) 2024-08-19T00:25:32.592 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:25:32 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:25:32.139+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:25:32.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:32 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:32.239+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.683396+0000 front 2024-08-19T00:25:02.683292+0000 (oldest deadline 2024-08-19T00:25:27.383313+0000) 2024-08-19T00:25:33.092 INFO:journalctl@ceph.osd.5.smithi171.stdout:Aug 19 00:25:32 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-5[33174]: 2024-08-19T00:25:32.591+0000 7ff73964b640 -1 osd.5 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.500157+0000 front 2024-08-19T00:25:02.500187+0000 (oldest deadline 2024-08-19T00:25:26.000306+0000) 2024-08-19T00:25:33.119 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:32 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:32.652+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:01.954691+0000 front 2024-08-19T00:25:01.954869+0000 (oldest deadline 2024-08-19T00:25:24.254908+0000) 2024-08-19T00:25:33.119 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:32 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6[45317]: 2024-08-19T00:25:32.695+0000 7f590ffdf640 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:24:58.311869+0000 front 2024-08-19T00:24:58.311932+0000 (oldest deadline 2024-08-19T00:25:24.212094+0000) 2024-08-19T00:25:33.119 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:32 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6[45317]: 2024-08-19T00:25:32.695+0000 7f590ffdf640 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:09.513294+0000 front 2024-08-19T00:25:09.513281+0000 (oldest deadline 2024-08-19T00:25:32.313722+0000) 2024-08-19T00:25:33.552 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:25:33 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:25:33.124+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:25:33.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:33 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:33.268+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.683396+0000 front 2024-08-19T00:25:02.683292+0000 (oldest deadline 2024-08-19T00:25:27.383313+0000) 2024-08-19T00:25:33.842 INFO:journalctl@ceph.osd.5.smithi171.stdout:Aug 19 00:25:33 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-5[33174]: 2024-08-19T00:25:33.550+0000 7ff73964b640 -1 osd.5 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.500157+0000 front 2024-08-19T00:25:02.500187+0000 (oldest deadline 2024-08-19T00:25:26.000306+0000) 2024-08-19T00:25:33.869 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:33 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:33.605+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:01.954691+0000 front 2024-08-19T00:25:01.954869+0000 (oldest deadline 2024-08-19T00:25:24.254908+0000) 2024-08-19T00:25:33.870 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:33 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6[45317]: 2024-08-19T00:25:33.657+0000 7f590ffdf640 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:24:58.311869+0000 front 2024-08-19T00:24:58.311932+0000 (oldest deadline 2024-08-19T00:25:24.212094+0000) 2024-08-19T00:25:33.870 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:33 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6[45317]: 2024-08-19T00:25:33.657+0000 7f590ffdf640 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:09.513294+0000 front 2024-08-19T00:25:09.513281+0000 (oldest deadline 2024-08-19T00:25:32.313722+0000) 2024-08-19T00:25:34.556 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:25:34 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:25:34.123+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:25:34.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:34 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:34.239+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.683396+0000 front 2024-08-19T00:25:02.683292+0000 (oldest deadline 2024-08-19T00:25:27.383313+0000) 2024-08-19T00:25:34.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:34 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:34.239+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:07.383795+0000 front 2024-08-19T00:25:07.383817+0000 (oldest deadline 2024-08-19T00:25:33.283909+0000) 2024-08-19T00:25:34.842 INFO:journalctl@ceph.osd.5.smithi171.stdout:Aug 19 00:25:34 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-5[33174]: 2024-08-19T00:25:34.554+0000 7ff73964b640 -1 osd.5 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.500157+0000 front 2024-08-19T00:25:02.500187+0000 (oldest deadline 2024-08-19T00:25:26.000306+0000) 2024-08-19T00:25:34.843 INFO:journalctl@ceph.osd.5.smithi171.stdout:Aug 19 00:25:34 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-5[33174]: 2024-08-19T00:25:34.554+0000 7ff73964b640 -1 osd.5 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:10.701498+0000 front 2024-08-19T00:25:10.701548+0000 (oldest deadline 2024-08-19T00:25:33.601640+0000) 2024-08-19T00:25:35.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:34 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:34.624+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:01.954691+0000 front 2024-08-19T00:25:01.954869+0000 (oldest deadline 2024-08-19T00:25:24.254908+0000) 2024-08-19T00:25:35.121 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:34 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6[45317]: 2024-08-19T00:25:34.628+0000 7f590ffdf640 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:24:58.311869+0000 front 2024-08-19T00:24:58.311932+0000 (oldest deadline 2024-08-19T00:25:24.212094+0000) 2024-08-19T00:25:35.121 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:34 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6[45317]: 2024-08-19T00:25:34.628+0000 7f590ffdf640 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:09.513294+0000 front 2024-08-19T00:25:09.513281+0000 (oldest deadline 2024-08-19T00:25:32.313722+0000) 2024-08-19T00:25:35.571 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:25:35 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:25:35.166+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:25:35.620 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:25:35 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7[39116]: 2024-08-19T00:25:35.349+0000 7f5475804640 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:09.399138+0000 front 2024-08-19T00:25:09.399073+0000 (oldest deadline 2024-08-19T00:25:35.299243+0000) 2024-08-19T00:25:35.621 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:35 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:35.201+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.683396+0000 front 2024-08-19T00:25:02.683292+0000 (oldest deadline 2024-08-19T00:25:27.383313+0000) 2024-08-19T00:25:35.621 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:35 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:35.201+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:07.383795+0000 front 2024-08-19T00:25:07.383817+0000 (oldest deadline 2024-08-19T00:25:33.283909+0000) 2024-08-19T00:25:35.842 INFO:journalctl@ceph.osd.5.smithi171.stdout:Aug 19 00:25:35 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-5[33174]: 2024-08-19T00:25:35.568+0000 7ff73964b640 -1 osd.5 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.500157+0000 front 2024-08-19T00:25:02.500187+0000 (oldest deadline 2024-08-19T00:25:26.000306+0000) 2024-08-19T00:25:35.843 INFO:journalctl@ceph.osd.5.smithi171.stdout:Aug 19 00:25:35 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-5[33174]: 2024-08-19T00:25:35.568+0000 7ff73964b640 -1 osd.5 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:10.701498+0000 front 2024-08-19T00:25:10.701548+0000 (oldest deadline 2024-08-19T00:25:33.601640+0000) 2024-08-19T00:25:35.869 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:35 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:35.664+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:01.954691+0000 front 2024-08-19T00:25:01.954869+0000 (oldest deadline 2024-08-19T00:25:24.254908+0000) 2024-08-19T00:25:35.870 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:35 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6[45317]: 2024-08-19T00:25:35.598+0000 7f590ffdf640 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:24:58.311869+0000 front 2024-08-19T00:24:58.311932+0000 (oldest deadline 2024-08-19T00:25:24.212094+0000) 2024-08-19T00:25:35.870 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:35 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6[45317]: 2024-08-19T00:25:35.598+0000 7f590ffdf640 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:09.513294+0000 front 2024-08-19T00:25:09.513281+0000 (oldest deadline 2024-08-19T00:25:32.313722+0000) 2024-08-19T00:25:35.928 INFO:journalctl@ceph.osd.4.smithi116.stdout:Aug 19 00:25:35 smithi116 podman[57509]: 2024-08-19 00:25:35.616703923 +0000 UTC m=+5.582839642 container died 725c0b53f22d78ec804823074bb4adae15c6a675a86d0d2578fafa8641b2c6a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=squid-de09dd0, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-08-19T00:25:36.180 INFO:journalctl@ceph.osd.4.smithi116.stdout:Aug 19 00:25:36 smithi116 podman[57509]: 2024-08-19 00:25:36.017884919 +0000 UTC m=+5.984020628 container cleanup 725c0b53f22d78ec804823074bb4adae15c6a675a86d0d2578fafa8641b2c6a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-4, RELEASE=squid-de09dd0, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-19T00:25:36.181 INFO:journalctl@ceph.osd.4.smithi116.stdout:Aug 19 00:25:36 smithi116 bash[57509]: ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-4 2024-08-19T00:25:36.502 INFO:journalctl@ceph.osd.4.smithi116.stdout:Aug 19 00:25:36 smithi116 podman[57526]: 2024-08-19 00:25:36.269376667 +0000 UTC m=+0.647783652 container remove 725c0b53f22d78ec804823074bb4adae15c6a675a86d0d2578fafa8641b2c6a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-4, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-de09dd0) 2024-08-19T00:25:36.502 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:25:36 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7[39116]: 2024-08-19T00:25:36.331+0000 7f5475804640 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:09.399138+0000 front 2024-08-19T00:25:09.399073+0000 (oldest deadline 2024-08-19T00:25:35.299243+0000) 2024-08-19T00:25:36.503 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:36 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:36.178+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.683396+0000 front 2024-08-19T00:25:02.683292+0000 (oldest deadline 2024-08-19T00:25:27.383313+0000) 2024-08-19T00:25:36.503 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:36 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:36.178+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:07.383795+0000 front 2024-08-19T00:25:07.383817+0000 (oldest deadline 2024-08-19T00:25:33.283909+0000) 2024-08-19T00:25:36.592 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:25:36 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:25:36.124+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:25:36.840 INFO:journalctl@ceph.osd.4.smithi116.stdout:Aug 19 00:25:36 smithi116 podman[57617]: 2024-08-19 00:25:36.497177797 +0000 UTC m=+0.017557003 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-19T00:25:36.840 INFO:journalctl@ceph.osd.4.smithi116.stdout:Aug 19 00:25:36 smithi116 podman[57617]: 2024-08-19 00:25:36.612053745 +0000 UTC m=+0.132432955 container create ee53ff35d62aaf756698c351f1545936272184c34880eae342950e645eb91efe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-4-deactivate, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-de09dd0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.build-date=20240731) 2024-08-19T00:25:36.869 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:36 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6[45317]: 2024-08-19T00:25:36.597+0000 7f590ffdf640 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:24:58.311869+0000 front 2024-08-19T00:24:58.311932+0000 (oldest deadline 2024-08-19T00:25:24.212094+0000) 2024-08-19T00:25:36.870 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:36 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6[45317]: 2024-08-19T00:25:36.597+0000 7f590ffdf640 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:09.513294+0000 front 2024-08-19T00:25:09.513281+0000 (oldest deadline 2024-08-19T00:25:32.313722+0000) 2024-08-19T00:25:36.870 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:36 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:36.656+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:01.954691+0000 front 2024-08-19T00:25:01.954869+0000 (oldest deadline 2024-08-19T00:25:24.254908+0000) 2024-08-19T00:25:36.870 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:36 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:36.656+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:10.156120+0000 front 2024-08-19T00:25:10.156097+0000 (oldest deadline 2024-08-19T00:25:36.556729+0000) 2024-08-19T00:25:36.962 INFO:journalctl@ceph.osd.5.smithi171.stdout:Aug 19 00:25:36 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-5[33174]: 2024-08-19T00:25:36.619+0000 7ff73964b640 -1 osd.5 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.500157+0000 front 2024-08-19T00:25:02.500187+0000 (oldest deadline 2024-08-19T00:25:26.000306+0000) 2024-08-19T00:25:36.962 INFO:journalctl@ceph.osd.5.smithi171.stdout:Aug 19 00:25:36 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-5[33174]: 2024-08-19T00:25:36.619+0000 7ff73964b640 -1 osd.5 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:10.701498+0000 front 2024-08-19T00:25:10.701548+0000 (oldest deadline 2024-08-19T00:25:33.601640+0000) 2024-08-19T00:25:37.116 INFO:journalctl@ceph.osd.4.smithi116.stdout:Aug 19 00:25:36 smithi116 podman[57617]: 2024-08-19 00:25:36.839480464 +0000 UTC m=+0.359859689 container init ee53ff35d62aaf756698c351f1545936272184c34880eae342950e645eb91efe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-4-deactivate, RELEASE=squid-de09dd0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-08-19T00:25:37.116 INFO:journalctl@ceph.osd.4.smithi116.stdout:Aug 19 00:25:36 smithi116 podman[57617]: 2024-08-19 00:25:36.84296575 +0000 UTC m=+0.363344956 container start ee53ff35d62aaf756698c351f1545936272184c34880eae342950e645eb91efe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-4-deactivate, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-de09dd0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True) 2024-08-19T00:25:37.117 INFO:journalctl@ceph.osd.4.smithi116.stdout:Aug 19 00:25:36 smithi116 podman[57617]: 2024-08-19 00:25:36.923143311 +0000 UTC m=+0.443522546 container attach ee53ff35d62aaf756698c351f1545936272184c34880eae342950e645eb91efe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-4-deactivate, io.buildah.version=1.36.0, RELEASE=squid-de09dd0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=) 2024-08-19T00:25:37.117 INFO:journalctl@ceph.osd.4.smithi116.stdout:Aug 19 00:25:37 smithi116 podman[57617]: 2024-08-19 00:25:37.028805611 +0000 UTC m=+0.549184823 container died ee53ff35d62aaf756698c351f1545936272184c34880eae342950e645eb91efe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-de09dd0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-19T00:25:37.342 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:25:37 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:25:37.095+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:25:37.343 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:25:36 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:25:36.960+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:06.898931+0000 front 2024-08-19T00:25:06.898987+0000 (oldest deadline 2024-08-19T00:25:36.299520+0000) 2024-08-19T00:25:37.611 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:37 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:37.155+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.683396+0000 front 2024-08-19T00:25:02.683292+0000 (oldest deadline 2024-08-19T00:25:27.383313+0000) 2024-08-19T00:25:37.611 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:37 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:37.155+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:07.383795+0000 front 2024-08-19T00:25:07.383817+0000 (oldest deadline 2024-08-19T00:25:33.283909+0000) 2024-08-19T00:25:37.611 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:25:37 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7[39116]: 2024-08-19T00:25:37.295+0000 7f5475804640 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:09.399138+0000 front 2024-08-19T00:25:09.399073+0000 (oldest deadline 2024-08-19T00:25:35.299243+0000) 2024-08-19T00:25:37.639 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-647ded64-5dbe-11ef-bccf-c7b262605968@osd.4.service' 2024-08-19T00:25:37.679 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-19T00:25:37.679 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-08-19T00:25:37.679 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-08-19T00:25:37.680 DEBUG:teuthology.orchestra.run.smithi171:> sudo systemctl stop ceph-647ded64-5dbe-11ef-bccf-c7b262605968@osd.5 2024-08-19T00:25:37.842 INFO:journalctl@ceph.osd.5.smithi171.stdout:Aug 19 00:25:37 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-5[33174]: 2024-08-19T00:25:37.587+0000 7ff73964b640 -1 osd.5 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.500157+0000 front 2024-08-19T00:25:02.500187+0000 (oldest deadline 2024-08-19T00:25:26.000306+0000) 2024-08-19T00:25:37.843 INFO:journalctl@ceph.osd.5.smithi171.stdout:Aug 19 00:25:37 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-5[33174]: 2024-08-19T00:25:37.587+0000 7ff73964b640 -1 osd.5 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:10.701498+0000 front 2024-08-19T00:25:10.701548+0000 (oldest deadline 2024-08-19T00:25:33.601640+0000) 2024-08-19T00:25:37.843 INFO:journalctl@ceph.osd.5.smithi171.stdout:Aug 19 00:25:37 smithi171 systemd[1]: Stopping Ceph osd.5 for 647ded64-5dbe-11ef-bccf-c7b262605968... 2024-08-19T00:25:37.869 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:37 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6[45317]: 2024-08-19T00:25:37.565+0000 7f590ffdf640 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:24:58.311869+0000 front 2024-08-19T00:24:58.311932+0000 (oldest deadline 2024-08-19T00:25:24.212094+0000) 2024-08-19T00:25:37.870 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:37 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6[45317]: 2024-08-19T00:25:37.565+0000 7f590ffdf640 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:09.513294+0000 front 2024-08-19T00:25:09.513281+0000 (oldest deadline 2024-08-19T00:25:32.313722+0000) 2024-08-19T00:25:37.870 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:37 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:37.607+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:01.954691+0000 front 2024-08-19T00:25:01.954869+0000 (oldest deadline 2024-08-19T00:25:24.254908+0000) 2024-08-19T00:25:37.870 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:37 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:37.607+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:10.156120+0000 front 2024-08-19T00:25:10.156097+0000 (oldest deadline 2024-08-19T00:25:36.556729+0000) 2024-08-19T00:25:38.342 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:25:37 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:25:37.937+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:06.898931+0000 front 2024-08-19T00:25:06.898987+0000 (oldest deadline 2024-08-19T00:25:36.299520+0000) 2024-08-19T00:25:38.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:25:38 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:25:38.080+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:25:38.343 INFO:journalctl@ceph.osd.5.smithi171.stdout:Aug 19 00:25:37 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-5[33174]: 2024-08-19T00:25:37.991+0000 7ff74103d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-19T00:25:38.343 INFO:journalctl@ceph.osd.5.smithi171.stdout:Aug 19 00:25:37 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-5[33174]: 2024-08-19T00:25:37.991+0000 7ff74103d640 -1 osd.5 109 *** Got signal Terminated *** 2024-08-19T00:25:38.343 INFO:journalctl@ceph.osd.5.smithi171.stdout:Aug 19 00:25:37 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-5[33174]: 2024-08-19T00:25:37.991+0000 7ff74103d640 -1 osd.5 109 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-19T00:25:38.616 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:25:38 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7[39116]: 2024-08-19T00:25:38.265+0000 7f5475804640 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:09.399138+0000 front 2024-08-19T00:25:09.399073+0000 (oldest deadline 2024-08-19T00:25:35.299243+0000) 2024-08-19T00:25:38.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:38 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:38.143+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.683396+0000 front 2024-08-19T00:25:02.683292+0000 (oldest deadline 2024-08-19T00:25:27.383313+0000) 2024-08-19T00:25:38.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:38 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:38.143+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:07.383795+0000 front 2024-08-19T00:25:07.383817+0000 (oldest deadline 2024-08-19T00:25:33.283909+0000) 2024-08-19T00:25:38.870 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:38 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6[45317]: 2024-08-19T00:25:38.526+0000 7f590ffdf640 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:24:58.311869+0000 front 2024-08-19T00:24:58.311932+0000 (oldest deadline 2024-08-19T00:25:24.212094+0000) 2024-08-19T00:25:38.870 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:38 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6[45317]: 2024-08-19T00:25:38.526+0000 7f590ffdf640 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:09.513294+0000 front 2024-08-19T00:25:09.513281+0000 (oldest deadline 2024-08-19T00:25:32.313722+0000) 2024-08-19T00:25:38.870 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:38 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:38.572+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:01.954691+0000 front 2024-08-19T00:25:01.954869+0000 (oldest deadline 2024-08-19T00:25:24.254908+0000) 2024-08-19T00:25:38.870 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:38 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:38.572+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:10.156120+0000 front 2024-08-19T00:25:10.156097+0000 (oldest deadline 2024-08-19T00:25:36.556729+0000) 2024-08-19T00:25:38.922 INFO:journalctl@ceph.osd.5.smithi171.stdout:Aug 19 00:25:38 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-5[33174]: 2024-08-19T00:25:38.631+0000 7ff73964b640 -1 osd.5 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.500157+0000 front 2024-08-19T00:25:02.500187+0000 (oldest deadline 2024-08-19T00:25:26.000306+0000) 2024-08-19T00:25:38.923 INFO:journalctl@ceph.osd.5.smithi171.stdout:Aug 19 00:25:38 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-5[33174]: 2024-08-19T00:25:38.631+0000 7ff73964b640 -1 osd.5 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:10.701498+0000 front 2024-08-19T00:25:10.701548+0000 (oldest deadline 2024-08-19T00:25:33.601640+0000) 2024-08-19T00:25:39.342 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:25:39 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:25:39.054+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:25:39.343 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:25:38 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:25:38.921+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:06.898931+0000 front 2024-08-19T00:25:06.898987+0000 (oldest deadline 2024-08-19T00:25:36.299520+0000) 2024-08-19T00:25:39.366 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:25:39 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7[39116]: 2024-08-19T00:25:39.258+0000 7f5475804640 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:09.399138+0000 front 2024-08-19T00:25:09.399073+0000 (oldest deadline 2024-08-19T00:25:35.299243+0000) 2024-08-19T00:25:39.366 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:39 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:39.111+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.683396+0000 front 2024-08-19T00:25:02.683292+0000 (oldest deadline 2024-08-19T00:25:27.383313+0000) 2024-08-19T00:25:39.366 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:39 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:39.111+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:07.383795+0000 front 2024-08-19T00:25:07.383817+0000 (oldest deadline 2024-08-19T00:25:33.283909+0000) 2024-08-19T00:25:39.869 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:39 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6[45317]: 2024-08-19T00:25:39.558+0000 7f590ffdf640 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:24:58.311869+0000 front 2024-08-19T00:24:58.311932+0000 (oldest deadline 2024-08-19T00:25:24.212094+0000) 2024-08-19T00:25:39.870 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:39 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6[45317]: 2024-08-19T00:25:39.558+0000 7f590ffdf640 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:09.513294+0000 front 2024-08-19T00:25:09.513281+0000 (oldest deadline 2024-08-19T00:25:32.313722+0000) 2024-08-19T00:25:39.870 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:39 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:39.597+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:01.954691+0000 front 2024-08-19T00:25:01.954869+0000 (oldest deadline 2024-08-19T00:25:24.254908+0000) 2024-08-19T00:25:39.870 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:39 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:39.597+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:10.156120+0000 front 2024-08-19T00:25:10.156097+0000 (oldest deadline 2024-08-19T00:25:36.556729+0000) 2024-08-19T00:25:39.899 INFO:journalctl@ceph.osd.5.smithi171.stdout:Aug 19 00:25:39 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-5[33174]: 2024-08-19T00:25:39.641+0000 7ff73964b640 -1 osd.5 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.500157+0000 front 2024-08-19T00:25:02.500187+0000 (oldest deadline 2024-08-19T00:25:26.000306+0000) 2024-08-19T00:25:39.899 INFO:journalctl@ceph.osd.5.smithi171.stdout:Aug 19 00:25:39 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-5[33174]: 2024-08-19T00:25:39.641+0000 7ff73964b640 -1 osd.5 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:10.701498+0000 front 2024-08-19T00:25:10.701548+0000 (oldest deadline 2024-08-19T00:25:33.601640+0000) 2024-08-19T00:25:40.342 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:25:40 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:25:40.093+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:25:40.343 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:25:39 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:25:39.897+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:06.898931+0000 front 2024-08-19T00:25:06.898987+0000 (oldest deadline 2024-08-19T00:25:36.299520+0000) 2024-08-19T00:25:40.366 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:25:40 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7[39116]: 2024-08-19T00:25:40.279+0000 7f5475804640 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:09.399138+0000 front 2024-08-19T00:25:09.399073+0000 (oldest deadline 2024-08-19T00:25:35.299243+0000) 2024-08-19T00:25:40.366 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:40 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:40.065+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.683396+0000 front 2024-08-19T00:25:02.683292+0000 (oldest deadline 2024-08-19T00:25:27.383313+0000) 2024-08-19T00:25:40.366 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:40 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:40.065+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:07.383795+0000 front 2024-08-19T00:25:07.383817+0000 (oldest deadline 2024-08-19T00:25:33.283909+0000) 2024-08-19T00:25:40.869 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:40 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:40.632+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:01.954691+0000 front 2024-08-19T00:25:01.954869+0000 (oldest deadline 2024-08-19T00:25:24.254908+0000) 2024-08-19T00:25:40.870 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:40 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:40.632+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:10.156120+0000 front 2024-08-19T00:25:10.156097+0000 (oldest deadline 2024-08-19T00:25:36.556729+0000) 2024-08-19T00:25:40.870 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:40 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6[45317]: 2024-08-19T00:25:40.542+0000 7f590ffdf640 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:24:58.311869+0000 front 2024-08-19T00:24:58.311932+0000 (oldest deadline 2024-08-19T00:25:24.212094+0000) 2024-08-19T00:25:40.870 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:40 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6[45317]: 2024-08-19T00:25:40.542+0000 7f590ffdf640 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:09.513294+0000 front 2024-08-19T00:25:09.513281+0000 (oldest deadline 2024-08-19T00:25:32.313722+0000) 2024-08-19T00:25:40.870 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:40 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6[45317]: 2024-08-19T00:25:40.542+0000 7f590ffdf640 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:19.216437+0000 front 2024-08-19T00:25:19.216411+0000 (oldest deadline 2024-08-19T00:25:40.316406+0000) 2024-08-19T00:25:41.060 INFO:journalctl@ceph.osd.5.smithi171.stdout:Aug 19 00:25:40 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-5[33174]: 2024-08-19T00:25:40.662+0000 7ff73964b640 -1 osd.5 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.500157+0000 front 2024-08-19T00:25:02.500187+0000 (oldest deadline 2024-08-19T00:25:26.000306+0000) 2024-08-19T00:25:41.060 INFO:journalctl@ceph.osd.5.smithi171.stdout:Aug 19 00:25:40 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-5[33174]: 2024-08-19T00:25:40.662+0000 7ff73964b640 -1 osd.5 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:10.701498+0000 front 2024-08-19T00:25:10.701548+0000 (oldest deadline 2024-08-19T00:25:33.601640+0000) 2024-08-19T00:25:41.061 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:25:40 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:25:40.904+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:06.898931+0000 front 2024-08-19T00:25:06.898987+0000 (oldest deadline 2024-08-19T00:25:36.299520+0000) 2024-08-19T00:25:41.061 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:25:40 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:25:40.904+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:16.299966+0000 front 2024-08-19T00:25:16.300073+0000 (oldest deadline 2024-08-19T00:25:40.400126+0000) 2024-08-19T00:25:41.342 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:25:41 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:25:41.058+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:25:41.366 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:25:41 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7[39116]: 2024-08-19T00:25:41.309+0000 7f5475804640 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:09.399138+0000 front 2024-08-19T00:25:09.399073+0000 (oldest deadline 2024-08-19T00:25:35.299243+0000) 2024-08-19T00:25:41.366 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:25:41 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7[39116]: 2024-08-19T00:25:41.309+0000 7f5475804640 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:15.800149+0000 front 2024-08-19T00:25:15.800333+0000 (oldest deadline 2024-08-19T00:25:40.500238+0000) 2024-08-19T00:25:41.366 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:41 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:41.086+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.683396+0000 front 2024-08-19T00:25:02.683292+0000 (oldest deadline 2024-08-19T00:25:27.383313+0000) 2024-08-19T00:25:41.367 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:41 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:41.086+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:07.383795+0000 front 2024-08-19T00:25:07.383817+0000 (oldest deadline 2024-08-19T00:25:33.283909+0000) 2024-08-19T00:25:41.869 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:41 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:41.609+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:01.954691+0000 front 2024-08-19T00:25:01.954869+0000 (oldest deadline 2024-08-19T00:25:24.254908+0000) 2024-08-19T00:25:41.870 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:41 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:41.609+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:10.156120+0000 front 2024-08-19T00:25:10.156097+0000 (oldest deadline 2024-08-19T00:25:36.556729+0000) 2024-08-19T00:25:41.870 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:41 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6[45317]: 2024-08-19T00:25:41.534+0000 7f590ffdf640 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:24:58.311869+0000 front 2024-08-19T00:24:58.311932+0000 (oldest deadline 2024-08-19T00:25:24.212094+0000) 2024-08-19T00:25:41.870 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:41 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6[45317]: 2024-08-19T00:25:41.534+0000 7f590ffdf640 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:09.513294+0000 front 2024-08-19T00:25:09.513281+0000 (oldest deadline 2024-08-19T00:25:32.313722+0000) 2024-08-19T00:25:41.870 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:41 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6[45317]: 2024-08-19T00:25:41.534+0000 7f590ffdf640 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:19.216437+0000 front 2024-08-19T00:25:19.216411+0000 (oldest deadline 2024-08-19T00:25:40.316406+0000) 2024-08-19T00:25:41.938 INFO:journalctl@ceph.osd.5.smithi171.stdout:Aug 19 00:25:41 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-5[33174]: 2024-08-19T00:25:41.655+0000 7ff73964b640 -1 osd.5 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.500157+0000 front 2024-08-19T00:25:02.500187+0000 (oldest deadline 2024-08-19T00:25:26.000306+0000) 2024-08-19T00:25:41.938 INFO:journalctl@ceph.osd.5.smithi171.stdout:Aug 19 00:25:41 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-5[33174]: 2024-08-19T00:25:41.655+0000 7ff73964b640 -1 osd.5 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:10.701498+0000 front 2024-08-19T00:25:10.701548+0000 (oldest deadline 2024-08-19T00:25:33.601640+0000) 2024-08-19T00:25:41.938 INFO:journalctl@ceph.osd.5.smithi171.stdout:Aug 19 00:25:41 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-5[33174]: 2024-08-19T00:25:41.655+0000 7ff73964b640 -1 osd.5 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:18.302797+0000 front 2024-08-19T00:25:18.302825+0000 (oldest deadline 2024-08-19T00:25:41.202998+0000) 2024-08-19T00:25:42.342 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:25:41 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:25:41.935+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:06.898931+0000 front 2024-08-19T00:25:06.898987+0000 (oldest deadline 2024-08-19T00:25:36.299520+0000) 2024-08-19T00:25:42.343 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:25:41 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:25:41.935+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:16.299966+0000 front 2024-08-19T00:25:16.300073+0000 (oldest deadline 2024-08-19T00:25:40.400126+0000) 2024-08-19T00:25:42.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:25:42 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:25:42.053+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:25:42.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:25:42 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:25:42.053+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:18.052701+0000 front 2024-08-19T00:25:18.052756+0000 (oldest deadline 2024-08-19T00:25:41.552819+0000) 2024-08-19T00:25:42.616 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:25:42 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7[39116]: 2024-08-19T00:25:42.344+0000 7f5475804640 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:09.399138+0000 front 2024-08-19T00:25:09.399073+0000 (oldest deadline 2024-08-19T00:25:35.299243+0000) 2024-08-19T00:25:42.616 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:25:42 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7[39116]: 2024-08-19T00:25:42.344+0000 7f5475804640 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:15.800149+0000 front 2024-08-19T00:25:15.800333+0000 (oldest deadline 2024-08-19T00:25:40.500238+0000) 2024-08-19T00:25:42.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:42 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:42.128+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.683396+0000 front 2024-08-19T00:25:02.683292+0000 (oldest deadline 2024-08-19T00:25:27.383313+0000) 2024-08-19T00:25:42.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:42 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:42.128+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:07.383795+0000 front 2024-08-19T00:25:07.383817+0000 (oldest deadline 2024-08-19T00:25:33.283909+0000) 2024-08-19T00:25:42.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:42 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:42.128+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.885585+0000 front 2024-08-19T00:25:17.885614+0000 (oldest deadline 2024-08-19T00:25:41.985680+0000) 2024-08-19T00:25:42.869 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:42 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:42.632+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:01.954691+0000 front 2024-08-19T00:25:01.954869+0000 (oldest deadline 2024-08-19T00:25:24.254908+0000) 2024-08-19T00:25:42.870 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:42 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:42.632+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:10.156120+0000 front 2024-08-19T00:25:10.156097+0000 (oldest deadline 2024-08-19T00:25:36.556729+0000) 2024-08-19T00:25:42.870 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:42 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6[45317]: 2024-08-19T00:25:42.580+0000 7f590ffdf640 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:24:58.311869+0000 front 2024-08-19T00:24:58.311932+0000 (oldest deadline 2024-08-19T00:25:24.212094+0000) 2024-08-19T00:25:42.870 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:42 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6[45317]: 2024-08-19T00:25:42.580+0000 7f590ffdf640 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:09.513294+0000 front 2024-08-19T00:25:09.513281+0000 (oldest deadline 2024-08-19T00:25:32.313722+0000) 2024-08-19T00:25:42.871 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:42 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6[45317]: 2024-08-19T00:25:42.580+0000 7f590ffdf640 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:19.216437+0000 front 2024-08-19T00:25:19.216411+0000 (oldest deadline 2024-08-19T00:25:40.316406+0000) 2024-08-19T00:25:42.961 INFO:journalctl@ceph.osd.5.smithi171.stdout:Aug 19 00:25:42 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-5[33174]: 2024-08-19T00:25:42.672+0000 7ff73964b640 -1 osd.5 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.500157+0000 front 2024-08-19T00:25:02.500187+0000 (oldest deadline 2024-08-19T00:25:26.000306+0000) 2024-08-19T00:25:42.961 INFO:journalctl@ceph.osd.5.smithi171.stdout:Aug 19 00:25:42 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-5[33174]: 2024-08-19T00:25:42.672+0000 7ff73964b640 -1 osd.5 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:10.701498+0000 front 2024-08-19T00:25:10.701548+0000 (oldest deadline 2024-08-19T00:25:33.601640+0000) 2024-08-19T00:25:42.961 INFO:journalctl@ceph.osd.5.smithi171.stdout:Aug 19 00:25:42 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-5[33174]: 2024-08-19T00:25:42.672+0000 7ff73964b640 -1 osd.5 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:18.302797+0000 front 2024-08-19T00:25:18.302825+0000 (oldest deadline 2024-08-19T00:25:41.202998+0000) 2024-08-19T00:25:43.342 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:25:42 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:25:42.959+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:06.898931+0000 front 2024-08-19T00:25:06.898987+0000 (oldest deadline 2024-08-19T00:25:36.299520+0000) 2024-08-19T00:25:43.343 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:25:42 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:25:42.959+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:16.299966+0000 front 2024-08-19T00:25:16.300073+0000 (oldest deadline 2024-08-19T00:25:40.400126+0000) 2024-08-19T00:25:43.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:25:43 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:25:43.091+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:25:43.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:25:43 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:25:43.091+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:18.052701+0000 front 2024-08-19T00:25:18.052756+0000 (oldest deadline 2024-08-19T00:25:41.552819+0000) 2024-08-19T00:25:43.366 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:25:43 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7[39116]: 2024-08-19T00:25:43.355+0000 7f5475804640 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:09.399138+0000 front 2024-08-19T00:25:09.399073+0000 (oldest deadline 2024-08-19T00:25:35.299243+0000) 2024-08-19T00:25:43.366 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:25:43 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7[39116]: 2024-08-19T00:25:43.355+0000 7f5475804640 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:15.800149+0000 front 2024-08-19T00:25:15.800333+0000 (oldest deadline 2024-08-19T00:25:40.500238+0000) 2024-08-19T00:25:43.366 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:43 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:43.109+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.683396+0000 front 2024-08-19T00:25:02.683292+0000 (oldest deadline 2024-08-19T00:25:27.383313+0000) 2024-08-19T00:25:43.366 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:43 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:43.109+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:07.383795+0000 front 2024-08-19T00:25:07.383817+0000 (oldest deadline 2024-08-19T00:25:33.283909+0000) 2024-08-19T00:25:43.367 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:43 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:43.109+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.885585+0000 front 2024-08-19T00:25:17.885614+0000 (oldest deadline 2024-08-19T00:25:41.985680+0000) 2024-08-19T00:25:43.836 INFO:journalctl@ceph.osd.5.smithi171.stdout:Aug 19 00:25:43 smithi171 podman[58069]: 2024-08-19 00:25:43.53545478 +0000 UTC m=+5.655115976 container died dfe579d0888cf1b103df29d15ed3450a1c5797f9a0546e7a0450efdafc866541 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, RELEASE=squid-de09dd0, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-19T00:25:44.092 INFO:journalctl@ceph.osd.5.smithi171.stdout:Aug 19 00:25:43 smithi171 podman[58069]: 2024-08-19 00:25:43.925955739 +0000 UTC m=+6.045616925 container cleanup dfe579d0888cf1b103df29d15ed3450a1c5797f9a0546e7a0450efdafc866541 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-5, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-de09dd0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-08-19T00:25:44.092 INFO:journalctl@ceph.osd.5.smithi171.stdout:Aug 19 00:25:43 smithi171 bash[58069]: ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-5 2024-08-19T00:25:44.093 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:25:43 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:25:43.928+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:06.898931+0000 front 2024-08-19T00:25:06.898987+0000 (oldest deadline 2024-08-19T00:25:36.299520+0000) 2024-08-19T00:25:44.093 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:25:43 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:25:43.928+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:16.299966+0000 front 2024-08-19T00:25:16.300073+0000 (oldest deadline 2024-08-19T00:25:40.400126+0000) 2024-08-19T00:25:44.119 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:43 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6[45317]: 2024-08-19T00:25:43.629+0000 7f590ffdf640 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:24:58.311869+0000 front 2024-08-19T00:24:58.311932+0000 (oldest deadline 2024-08-19T00:25:24.212094+0000) 2024-08-19T00:25:44.119 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:43 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6[45317]: 2024-08-19T00:25:43.629+0000 7f590ffdf640 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:09.513294+0000 front 2024-08-19T00:25:09.513281+0000 (oldest deadline 2024-08-19T00:25:32.313722+0000) 2024-08-19T00:25:44.120 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:43 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6[45317]: 2024-08-19T00:25:43.629+0000 7f590ffdf640 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:19.216437+0000 front 2024-08-19T00:25:19.216411+0000 (oldest deadline 2024-08-19T00:25:40.316406+0000) 2024-08-19T00:25:44.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:43 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:43.681+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:01.954691+0000 front 2024-08-19T00:25:01.954869+0000 (oldest deadline 2024-08-19T00:25:24.254908+0000) 2024-08-19T00:25:44.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:43 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:43.681+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:10.156120+0000 front 2024-08-19T00:25:10.156097+0000 (oldest deadline 2024-08-19T00:25:36.556729+0000) 2024-08-19T00:25:44.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:43 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:43.681+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.058001+0000 front 2024-08-19T00:25:17.057986+0000 (oldest deadline 2024-08-19T00:25:42.958104+0000) 2024-08-19T00:25:44.571 INFO:journalctl@ceph.osd.5.smithi171.stdout:Aug 19 00:25:44 smithi171 podman[58086]: 2024-08-19 00:25:44.19419296 +0000 UTC m=+0.656145556 container remove dfe579d0888cf1b103df29d15ed3450a1c5797f9a0546e7a0450efdafc866541 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-de09dd0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True) 2024-08-19T00:25:44.572 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:25:44 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:25:44.097+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:25:44.572 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:25:44 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:25:44.097+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:18.052701+0000 front 2024-08-19T00:25:18.052756+0000 (oldest deadline 2024-08-19T00:25:41.552819+0000) 2024-08-19T00:25:44.616 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:25:44 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7[39116]: 2024-08-19T00:25:44.375+0000 7f5475804640 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:09.399138+0000 front 2024-08-19T00:25:09.399073+0000 (oldest deadline 2024-08-19T00:25:35.299243+0000) 2024-08-19T00:25:44.616 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:25:44 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7[39116]: 2024-08-19T00:25:44.375+0000 7f5475804640 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:15.800149+0000 front 2024-08-19T00:25:15.800333+0000 (oldest deadline 2024-08-19T00:25:40.500238+0000) 2024-08-19T00:25:44.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:44 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:44.134+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.683396+0000 front 2024-08-19T00:25:02.683292+0000 (oldest deadline 2024-08-19T00:25:27.383313+0000) 2024-08-19T00:25:44.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:44 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:44.134+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:07.383795+0000 front 2024-08-19T00:25:07.383817+0000 (oldest deadline 2024-08-19T00:25:33.283909+0000) 2024-08-19T00:25:44.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:44 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:44.134+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.885585+0000 front 2024-08-19T00:25:17.885614+0000 (oldest deadline 2024-08-19T00:25:41.985680+0000) 2024-08-19T00:25:44.832 INFO:journalctl@ceph.osd.5.smithi171.stdout:Aug 19 00:25:44 smithi171 podman[58175]: 2024-08-19 00:25:44.473266688 +0000 UTC m=+0.017185472 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-19T00:25:44.833 INFO:journalctl@ceph.osd.5.smithi171.stdout:Aug 19 00:25:44 smithi171 podman[58175]: 2024-08-19 00:25:44.578368765 +0000 UTC m=+0.122287545 container create ad4ee4536eaec551ff6089098e5bce65745205813c465bf5c51110418c4c3e3d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-5-deactivate, io.buildah.version=1.36.0, RELEASE=squid-de09dd0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-08-19T00:25:44.833 INFO:journalctl@ceph.osd.5.smithi171.stdout:Aug 19 00:25:44 smithi171 podman[58175]: 2024-08-19 00:25:44.831256471 +0000 UTC m=+0.375175268 container init ad4ee4536eaec551ff6089098e5bce65745205813c465bf5c51110418c4c3e3d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-de09dd0, org.label-schema.schema-version=1.0) 2024-08-19T00:25:45.093 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:25:44 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:25:44.964+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:06.898931+0000 front 2024-08-19T00:25:06.898987+0000 (oldest deadline 2024-08-19T00:25:36.299520+0000) 2024-08-19T00:25:45.093 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:25:44 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:25:44.964+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:16.299966+0000 front 2024-08-19T00:25:16.300073+0000 (oldest deadline 2024-08-19T00:25:40.400126+0000) 2024-08-19T00:25:45.093 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:25:45 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:25:45.074+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:25:45.093 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:25:45 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:25:45.074+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:18.052701+0000 front 2024-08-19T00:25:18.052756+0000 (oldest deadline 2024-08-19T00:25:41.552819+0000) 2024-08-19T00:25:45.094 INFO:journalctl@ceph.osd.5.smithi171.stdout:Aug 19 00:25:44 smithi171 podman[58175]: 2024-08-19 00:25:44.83483711 +0000 UTC m=+0.378755896 container start ad4ee4536eaec551ff6089098e5bce65745205813c465bf5c51110418c4c3e3d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-de09dd0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-08-19T00:25:45.094 INFO:journalctl@ceph.osd.5.smithi171.stdout:Aug 19 00:25:44 smithi171 podman[58175]: 2024-08-19 00:25:44.922905864 +0000 UTC m=+0.466824647 container attach ad4ee4536eaec551ff6089098e5bce65745205813c465bf5c51110418c4c3e3d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-de09dd0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-08-19T00:25:45.094 INFO:journalctl@ceph.osd.5.smithi171.stdout:Aug 19 00:25:45 smithi171 podman[58175]: 2024-08-19 00:25:45.025091824 +0000 UTC m=+0.569010607 container died ad4ee4536eaec551ff6089098e5bce65745205813c465bf5c51110418c4c3e3d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, io.buildah.version=1.36.0, RELEASE=squid-de09dd0, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-19T00:25:45.119 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:44 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6[45317]: 2024-08-19T00:25:44.620+0000 7f590ffdf640 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:24:58.311869+0000 front 2024-08-19T00:24:58.311932+0000 (oldest deadline 2024-08-19T00:25:24.212094+0000) 2024-08-19T00:25:45.120 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:44 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6[45317]: 2024-08-19T00:25:44.620+0000 7f590ffdf640 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:09.513294+0000 front 2024-08-19T00:25:09.513281+0000 (oldest deadline 2024-08-19T00:25:32.313722+0000) 2024-08-19T00:25:45.120 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:44 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6[45317]: 2024-08-19T00:25:44.620+0000 7f590ffdf640 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:19.216437+0000 front 2024-08-19T00:25:19.216411+0000 (oldest deadline 2024-08-19T00:25:40.316406+0000) 2024-08-19T00:25:45.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:44 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:44.655+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:01.954691+0000 front 2024-08-19T00:25:01.954869+0000 (oldest deadline 2024-08-19T00:25:24.254908+0000) 2024-08-19T00:25:45.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:44 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:44.655+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:10.156120+0000 front 2024-08-19T00:25:10.156097+0000 (oldest deadline 2024-08-19T00:25:36.556729+0000) 2024-08-19T00:25:45.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:44 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:44.655+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.058001+0000 front 2024-08-19T00:25:17.057986+0000 (oldest deadline 2024-08-19T00:25:42.958104+0000) 2024-08-19T00:25:45.616 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:25:45 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7[39116]: 2024-08-19T00:25:45.402+0000 7f5475804640 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:09.399138+0000 front 2024-08-19T00:25:09.399073+0000 (oldest deadline 2024-08-19T00:25:35.299243+0000) 2024-08-19T00:25:45.616 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:25:45 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7[39116]: 2024-08-19T00:25:45.402+0000 7f5475804640 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:15.800149+0000 front 2024-08-19T00:25:15.800333+0000 (oldest deadline 2024-08-19T00:25:40.500238+0000) 2024-08-19T00:25:45.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:45 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:45.172+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.683396+0000 front 2024-08-19T00:25:02.683292+0000 (oldest deadline 2024-08-19T00:25:27.383313+0000) 2024-08-19T00:25:45.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:45 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:45.172+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:07.383795+0000 front 2024-08-19T00:25:07.383817+0000 (oldest deadline 2024-08-19T00:25:33.283909+0000) 2024-08-19T00:25:45.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:45 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:45.172+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.885585+0000 front 2024-08-19T00:25:17.885614+0000 (oldest deadline 2024-08-19T00:25:41.985680+0000) 2024-08-19T00:25:45.680 DEBUG:teuthology.orchestra.run.smithi171:> sudo pkill -f 'journalctl -f -n 0 -u ceph-647ded64-5dbe-11ef-bccf-c7b262605968@osd.5.service' 2024-08-19T00:25:45.723 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-19T00:25:45.723 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-08-19T00:25:45.723 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-08-19T00:25:45.724 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-647ded64-5dbe-11ef-bccf-c7b262605968@osd.6 2024-08-19T00:25:46.055 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:45 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:45.674+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:01.954691+0000 front 2024-08-19T00:25:01.954869+0000 (oldest deadline 2024-08-19T00:25:24.254908+0000) 2024-08-19T00:25:46.055 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:45 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:45.674+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:10.156120+0000 front 2024-08-19T00:25:10.156097+0000 (oldest deadline 2024-08-19T00:25:36.556729+0000) 2024-08-19T00:25:46.055 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:45 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:45.674+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.058001+0000 front 2024-08-19T00:25:17.057986+0000 (oldest deadline 2024-08-19T00:25:42.958104+0000) 2024-08-19T00:25:46.056 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:45 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6[45317]: 2024-08-19T00:25:45.642+0000 7f590ffdf640 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:24:58.311869+0000 front 2024-08-19T00:24:58.311932+0000 (oldest deadline 2024-08-19T00:25:24.212094+0000) 2024-08-19T00:25:46.056 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:45 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6[45317]: 2024-08-19T00:25:45.642+0000 7f590ffdf640 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:09.513294+0000 front 2024-08-19T00:25:09.513281+0000 (oldest deadline 2024-08-19T00:25:32.313722+0000) 2024-08-19T00:25:46.056 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:45 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6[45317]: 2024-08-19T00:25:45.642+0000 7f590ffdf640 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:19.216437+0000 front 2024-08-19T00:25:19.216411+0000 (oldest deadline 2024-08-19T00:25:40.316406+0000) 2024-08-19T00:25:46.056 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:45 smithi044 systemd[1]: Stopping Ceph osd.6 for 647ded64-5dbe-11ef-bccf-c7b262605968... 2024-08-19T00:25:46.056 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:46 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6[45317]: 2024-08-19T00:25:46.053+0000 7f59139c9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-19T00:25:46.056 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:46 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6[45317]: 2024-08-19T00:25:46.053+0000 7f59139c9640 -1 osd.6 109 *** Got signal Terminated *** 2024-08-19T00:25:46.056 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:46 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6[45317]: 2024-08-19T00:25:46.053+0000 7f59139c9640 -1 osd.6 109 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-19T00:25:46.342 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:25:45 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:25:45.971+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:06.898931+0000 front 2024-08-19T00:25:06.898987+0000 (oldest deadline 2024-08-19T00:25:36.299520+0000) 2024-08-19T00:25:46.343 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:25:45 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:25:45.971+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:16.299966+0000 front 2024-08-19T00:25:16.300073+0000 (oldest deadline 2024-08-19T00:25:40.400126+0000) 2024-08-19T00:25:46.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:25:46 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:25:46.083+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:25:46.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:25:46 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:25:46.083+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:18.052701+0000 front 2024-08-19T00:25:18.052756+0000 (oldest deadline 2024-08-19T00:25:41.552819+0000) 2024-08-19T00:25:46.616 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:25:46 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7[39116]: 2024-08-19T00:25:46.404+0000 7f5475804640 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:09.399138+0000 front 2024-08-19T00:25:09.399073+0000 (oldest deadline 2024-08-19T00:25:35.299243+0000) 2024-08-19T00:25:46.616 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:25:46 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7[39116]: 2024-08-19T00:25:46.404+0000 7f5475804640 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:15.800149+0000 front 2024-08-19T00:25:15.800333+0000 (oldest deadline 2024-08-19T00:25:40.500238+0000) 2024-08-19T00:25:46.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:46 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:46.176+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.683396+0000 front 2024-08-19T00:25:02.683292+0000 (oldest deadline 2024-08-19T00:25:27.383313+0000) 2024-08-19T00:25:46.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:46 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:46.176+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:07.383795+0000 front 2024-08-19T00:25:07.383817+0000 (oldest deadline 2024-08-19T00:25:33.283909+0000) 2024-08-19T00:25:46.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:46 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:46.176+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.885585+0000 front 2024-08-19T00:25:17.885614+0000 (oldest deadline 2024-08-19T00:25:41.985680+0000) 2024-08-19T00:25:47.119 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:46 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:46.678+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:01.954691+0000 front 2024-08-19T00:25:01.954869+0000 (oldest deadline 2024-08-19T00:25:24.254908+0000) 2024-08-19T00:25:47.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:46 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:46.678+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:10.156120+0000 front 2024-08-19T00:25:10.156097+0000 (oldest deadline 2024-08-19T00:25:36.556729+0000) 2024-08-19T00:25:47.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:46 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:46.678+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.058001+0000 front 2024-08-19T00:25:17.057986+0000 (oldest deadline 2024-08-19T00:25:42.958104+0000) 2024-08-19T00:25:47.120 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:46 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6[45317]: 2024-08-19T00:25:46.666+0000 7f590ffdf640 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:24:58.311869+0000 front 2024-08-19T00:24:58.311932+0000 (oldest deadline 2024-08-19T00:25:24.212094+0000) 2024-08-19T00:25:47.120 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:46 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6[45317]: 2024-08-19T00:25:46.666+0000 7f590ffdf640 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:09.513294+0000 front 2024-08-19T00:25:09.513281+0000 (oldest deadline 2024-08-19T00:25:32.313722+0000) 2024-08-19T00:25:47.121 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:46 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6[45317]: 2024-08-19T00:25:46.666+0000 7f590ffdf640 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:19.216437+0000 front 2024-08-19T00:25:19.216411+0000 (oldest deadline 2024-08-19T00:25:40.316406+0000) 2024-08-19T00:25:47.342 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:25:46 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:25:46.980+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:06.898931+0000 front 2024-08-19T00:25:06.898987+0000 (oldest deadline 2024-08-19T00:25:36.299520+0000) 2024-08-19T00:25:47.343 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:25:46 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:25:46.980+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:16.299966+0000 front 2024-08-19T00:25:16.300073+0000 (oldest deadline 2024-08-19T00:25:40.400126+0000) 2024-08-19T00:25:47.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:25:47 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:25:47.119+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:25:47.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:25:47 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:25:47.119+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:18.052701+0000 front 2024-08-19T00:25:18.052756+0000 (oldest deadline 2024-08-19T00:25:41.552819+0000) 2024-08-19T00:25:47.616 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:25:47 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7[39116]: 2024-08-19T00:25:47.355+0000 7f5475804640 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:09.399138+0000 front 2024-08-19T00:25:09.399073+0000 (oldest deadline 2024-08-19T00:25:35.299243+0000) 2024-08-19T00:25:47.616 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:25:47 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7[39116]: 2024-08-19T00:25:47.355+0000 7f5475804640 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:15.800149+0000 front 2024-08-19T00:25:15.800333+0000 (oldest deadline 2024-08-19T00:25:40.500238+0000) 2024-08-19T00:25:47.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:47 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:47.154+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.683396+0000 front 2024-08-19T00:25:02.683292+0000 (oldest deadline 2024-08-19T00:25:27.383313+0000) 2024-08-19T00:25:47.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:47 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:47.154+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:07.383795+0000 front 2024-08-19T00:25:07.383817+0000 (oldest deadline 2024-08-19T00:25:33.283909+0000) 2024-08-19T00:25:47.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:47 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:47.154+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.885585+0000 front 2024-08-19T00:25:17.885614+0000 (oldest deadline 2024-08-19T00:25:41.985680+0000) 2024-08-19T00:25:47.870 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:47 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6[45317]: 2024-08-19T00:25:47.649+0000 7f590ffdf640 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:24:58.311869+0000 front 2024-08-19T00:24:58.311932+0000 (oldest deadline 2024-08-19T00:25:24.212094+0000) 2024-08-19T00:25:47.870 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:47 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6[45317]: 2024-08-19T00:25:47.649+0000 7f590ffdf640 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:09.513294+0000 front 2024-08-19T00:25:09.513281+0000 (oldest deadline 2024-08-19T00:25:32.313722+0000) 2024-08-19T00:25:47.870 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:47 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6[45317]: 2024-08-19T00:25:47.649+0000 7f590ffdf640 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:19.216437+0000 front 2024-08-19T00:25:19.216411+0000 (oldest deadline 2024-08-19T00:25:40.316406+0000) 2024-08-19T00:25:47.870 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:47 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:47.648+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:01.954691+0000 front 2024-08-19T00:25:01.954869+0000 (oldest deadline 2024-08-19T00:25:24.254908+0000) 2024-08-19T00:25:47.871 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:47 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:47.648+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:10.156120+0000 front 2024-08-19T00:25:10.156097+0000 (oldest deadline 2024-08-19T00:25:36.556729+0000) 2024-08-19T00:25:47.871 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:47 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:47.648+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.058001+0000 front 2024-08-19T00:25:17.057986+0000 (oldest deadline 2024-08-19T00:25:42.958104+0000) 2024-08-19T00:25:48.343 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:25:48 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:25:48.009+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:06.898931+0000 front 2024-08-19T00:25:06.898987+0000 (oldest deadline 2024-08-19T00:25:36.299520+0000) 2024-08-19T00:25:48.343 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:25:48 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:25:48.009+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:16.299966+0000 front 2024-08-19T00:25:16.300073+0000 (oldest deadline 2024-08-19T00:25:40.400126+0000) 2024-08-19T00:25:48.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:25:48 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:25:48.110+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:25:48.344 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:25:48 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:25:48.110+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:18.052701+0000 front 2024-08-19T00:25:18.052756+0000 (oldest deadline 2024-08-19T00:25:41.552819+0000) 2024-08-19T00:25:48.616 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:25:48 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7[39116]: 2024-08-19T00:25:48.404+0000 7f5475804640 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:09.399138+0000 front 2024-08-19T00:25:09.399073+0000 (oldest deadline 2024-08-19T00:25:35.299243+0000) 2024-08-19T00:25:48.616 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:25:48 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7[39116]: 2024-08-19T00:25:48.404+0000 7f5475804640 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:15.800149+0000 front 2024-08-19T00:25:15.800333+0000 (oldest deadline 2024-08-19T00:25:40.500238+0000) 2024-08-19T00:25:48.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:48 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:48.170+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.683396+0000 front 2024-08-19T00:25:02.683292+0000 (oldest deadline 2024-08-19T00:25:27.383313+0000) 2024-08-19T00:25:48.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:48 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:48.170+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:07.383795+0000 front 2024-08-19T00:25:07.383817+0000 (oldest deadline 2024-08-19T00:25:33.283909+0000) 2024-08-19T00:25:48.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:48 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:48.170+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.885585+0000 front 2024-08-19T00:25:17.885614+0000 (oldest deadline 2024-08-19T00:25:41.985680+0000) 2024-08-19T00:25:48.870 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:48 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6[45317]: 2024-08-19T00:25:48.606+0000 7f590ffdf640 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:24:58.311869+0000 front 2024-08-19T00:24:58.311932+0000 (oldest deadline 2024-08-19T00:25:24.212094+0000) 2024-08-19T00:25:48.871 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:48 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6[45317]: 2024-08-19T00:25:48.606+0000 7f590ffdf640 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:09.513294+0000 front 2024-08-19T00:25:09.513281+0000 (oldest deadline 2024-08-19T00:25:32.313722+0000) 2024-08-19T00:25:48.871 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:48 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6[45317]: 2024-08-19T00:25:48.606+0000 7f590ffdf640 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:19.216437+0000 front 2024-08-19T00:25:19.216411+0000 (oldest deadline 2024-08-19T00:25:40.316406+0000) 2024-08-19T00:25:48.871 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:48 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:48.650+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:01.954691+0000 front 2024-08-19T00:25:01.954869+0000 (oldest deadline 2024-08-19T00:25:24.254908+0000) 2024-08-19T00:25:48.871 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:48 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:48.650+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:10.156120+0000 front 2024-08-19T00:25:10.156097+0000 (oldest deadline 2024-08-19T00:25:36.556729+0000) 2024-08-19T00:25:48.872 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:48 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:48.650+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.058001+0000 front 2024-08-19T00:25:17.057986+0000 (oldest deadline 2024-08-19T00:25:42.958104+0000) 2024-08-19T00:25:48.872 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:48 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:48.650+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:22.958529+0000 front 2024-08-19T00:25:22.958516+0000 (oldest deadline 2024-08-19T00:25:48.258674+0000) 2024-08-19T00:25:49.342 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:25:49 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:25:49.010+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:06.898931+0000 front 2024-08-19T00:25:06.898987+0000 (oldest deadline 2024-08-19T00:25:36.299520+0000) 2024-08-19T00:25:49.343 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:25:49 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:25:49.010+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:16.299966+0000 front 2024-08-19T00:25:16.300073+0000 (oldest deadline 2024-08-19T00:25:40.400126+0000) 2024-08-19T00:25:49.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:25:49 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:25:49.155+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:25:49.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:25:49 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:25:49.155+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:18.052701+0000 front 2024-08-19T00:25:18.052756+0000 (oldest deadline 2024-08-19T00:25:41.552819+0000) 2024-08-19T00:25:49.616 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:25:49 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7[39116]: 2024-08-19T00:25:49.382+0000 7f5475804640 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:09.399138+0000 front 2024-08-19T00:25:09.399073+0000 (oldest deadline 2024-08-19T00:25:35.299243+0000) 2024-08-19T00:25:49.616 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:25:49 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7[39116]: 2024-08-19T00:25:49.382+0000 7f5475804640 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:15.800149+0000 front 2024-08-19T00:25:15.800333+0000 (oldest deadline 2024-08-19T00:25:40.500238+0000) 2024-08-19T00:25:49.616 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:25:49 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7[39116]: 2024-08-19T00:25:49.382+0000 7f5475804640 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:21.601225+0000 front 2024-08-19T00:25:21.601313+0000 (oldest deadline 2024-08-19T00:25:49.201794+0000) 2024-08-19T00:25:49.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:49 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:49.146+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.683396+0000 front 2024-08-19T00:25:02.683292+0000 (oldest deadline 2024-08-19T00:25:27.383313+0000) 2024-08-19T00:25:49.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:49 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:49.146+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:07.383795+0000 front 2024-08-19T00:25:07.383817+0000 (oldest deadline 2024-08-19T00:25:33.283909+0000) 2024-08-19T00:25:49.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:49 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:49.146+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.885585+0000 front 2024-08-19T00:25:17.885614+0000 (oldest deadline 2024-08-19T00:25:41.985680+0000) 2024-08-19T00:25:49.869 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:49 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6[45317]: 2024-08-19T00:25:49.595+0000 7f590ffdf640 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:24:58.311869+0000 front 2024-08-19T00:24:58.311932+0000 (oldest deadline 2024-08-19T00:25:24.212094+0000) 2024-08-19T00:25:49.870 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:49 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6[45317]: 2024-08-19T00:25:49.595+0000 7f590ffdf640 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:09.513294+0000 front 2024-08-19T00:25:09.513281+0000 (oldest deadline 2024-08-19T00:25:32.313722+0000) 2024-08-19T00:25:49.870 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:49 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6[45317]: 2024-08-19T00:25:49.595+0000 7f590ffdf640 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:19.216437+0000 front 2024-08-19T00:25:19.216411+0000 (oldest deadline 2024-08-19T00:25:40.316406+0000) 2024-08-19T00:25:49.870 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:49 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:49.694+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:01.954691+0000 front 2024-08-19T00:25:01.954869+0000 (oldest deadline 2024-08-19T00:25:24.254908+0000) 2024-08-19T00:25:49.870 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:49 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:49.694+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:10.156120+0000 front 2024-08-19T00:25:10.156097+0000 (oldest deadline 2024-08-19T00:25:36.556729+0000) 2024-08-19T00:25:49.871 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:49 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:49.694+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.058001+0000 front 2024-08-19T00:25:17.057986+0000 (oldest deadline 2024-08-19T00:25:42.958104+0000) 2024-08-19T00:25:49.871 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:49 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:49.694+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:22.958529+0000 front 2024-08-19T00:25:22.958516+0000 (oldest deadline 2024-08-19T00:25:48.258674+0000) 2024-08-19T00:25:50.342 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:25:50 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:25:50.106+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:25:50.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:25:50 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:25:50.106+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:18.052701+0000 front 2024-08-19T00:25:18.052756+0000 (oldest deadline 2024-08-19T00:25:41.552819+0000) 2024-08-19T00:25:50.343 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:25:50 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:25:50.005+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:06.898931+0000 front 2024-08-19T00:25:06.898987+0000 (oldest deadline 2024-08-19T00:25:36.299520+0000) 2024-08-19T00:25:50.343 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:25:50 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:25:50.005+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:16.299966+0000 front 2024-08-19T00:25:16.300073+0000 (oldest deadline 2024-08-19T00:25:40.400126+0000) 2024-08-19T00:25:50.343 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:25:50 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:25:50.005+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:25.701250+0000 front 2024-08-19T00:25:25.701325+0000 (oldest deadline 2024-08-19T00:25:49.201091+0000) 2024-08-19T00:25:50.616 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:25:50 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7[39116]: 2024-08-19T00:25:50.387+0000 7f5475804640 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:09.399138+0000 front 2024-08-19T00:25:09.399073+0000 (oldest deadline 2024-08-19T00:25:35.299243+0000) 2024-08-19T00:25:50.617 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:25:50 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7[39116]: 2024-08-19T00:25:50.387+0000 7f5475804640 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:15.800149+0000 front 2024-08-19T00:25:15.800333+0000 (oldest deadline 2024-08-19T00:25:40.500238+0000) 2024-08-19T00:25:50.617 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:25:50 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7[39116]: 2024-08-19T00:25:50.387+0000 7f5475804640 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:21.601225+0000 front 2024-08-19T00:25:21.601313+0000 (oldest deadline 2024-08-19T00:25:49.201794+0000) 2024-08-19T00:25:50.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:50 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:50.165+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.683396+0000 front 2024-08-19T00:25:02.683292+0000 (oldest deadline 2024-08-19T00:25:27.383313+0000) 2024-08-19T00:25:50.618 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:50 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:50.165+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:07.383795+0000 front 2024-08-19T00:25:07.383817+0000 (oldest deadline 2024-08-19T00:25:33.283909+0000) 2024-08-19T00:25:50.618 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:50 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:50.165+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.885585+0000 front 2024-08-19T00:25:17.885614+0000 (oldest deadline 2024-08-19T00:25:41.985680+0000) 2024-08-19T00:25:50.869 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:50 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6[45317]: 2024-08-19T00:25:50.613+0000 7f590ffdf640 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:24:58.311869+0000 front 2024-08-19T00:24:58.311932+0000 (oldest deadline 2024-08-19T00:25:24.212094+0000) 2024-08-19T00:25:50.870 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:50 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6[45317]: 2024-08-19T00:25:50.613+0000 7f590ffdf640 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:09.513294+0000 front 2024-08-19T00:25:09.513281+0000 (oldest deadline 2024-08-19T00:25:32.313722+0000) 2024-08-19T00:25:50.870 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:50 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6[45317]: 2024-08-19T00:25:50.613+0000 7f590ffdf640 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:19.216437+0000 front 2024-08-19T00:25:19.216411+0000 (oldest deadline 2024-08-19T00:25:40.316406+0000) 2024-08-19T00:25:50.870 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:50 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6[45317]: 2024-08-19T00:25:50.613+0000 7f590ffdf640 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:25.517751+0000 front 2024-08-19T00:25:25.517732+0000 (oldest deadline 2024-08-19T00:25:50.218011+0000) 2024-08-19T00:25:50.870 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:50 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:50.666+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:01.954691+0000 front 2024-08-19T00:25:01.954869+0000 (oldest deadline 2024-08-19T00:25:24.254908+0000) 2024-08-19T00:25:50.871 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:50 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:50.666+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:10.156120+0000 front 2024-08-19T00:25:10.156097+0000 (oldest deadline 2024-08-19T00:25:36.556729+0000) 2024-08-19T00:25:50.871 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:50 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:50.666+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.058001+0000 front 2024-08-19T00:25:17.057986+0000 (oldest deadline 2024-08-19T00:25:42.958104+0000) 2024-08-19T00:25:50.871 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:50 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:50.666+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:22.958529+0000 front 2024-08-19T00:25:22.958516+0000 (oldest deadline 2024-08-19T00:25:48.258674+0000) 2024-08-19T00:25:51.342 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:25:51 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:25:51.147+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:25:51.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:25:51 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:25:51.147+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:18.052701+0000 front 2024-08-19T00:25:18.052756+0000 (oldest deadline 2024-08-19T00:25:41.552819+0000) 2024-08-19T00:25:51.343 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:25:51 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:25:51.052+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:06.898931+0000 front 2024-08-19T00:25:06.898987+0000 (oldest deadline 2024-08-19T00:25:36.299520+0000) 2024-08-19T00:25:51.343 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:25:51 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:25:51.052+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:16.299966+0000 front 2024-08-19T00:25:16.300073+0000 (oldest deadline 2024-08-19T00:25:40.400126+0000) 2024-08-19T00:25:51.343 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:25:51 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:25:51.052+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:25.701250+0000 front 2024-08-19T00:25:25.701325+0000 (oldest deadline 2024-08-19T00:25:49.201091+0000) 2024-08-19T00:25:51.434 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:51 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:51.128+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.683396+0000 front 2024-08-19T00:25:02.683292+0000 (oldest deadline 2024-08-19T00:25:27.383313+0000) 2024-08-19T00:25:51.435 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:51 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:51.128+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:07.383795+0000 front 2024-08-19T00:25:07.383817+0000 (oldest deadline 2024-08-19T00:25:33.283909+0000) 2024-08-19T00:25:51.435 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:51 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:51.128+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.885585+0000 front 2024-08-19T00:25:17.885614+0000 (oldest deadline 2024-08-19T00:25:41.985680+0000) 2024-08-19T00:25:51.713 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:51 smithi044 podman[89212]: 2024-08-19 00:25:51.403179761 +0000 UTC m=+5.480194052 container died 8283c028cf63162bf61ec59edc17b058c704b05146da61a88552c6a7ed937683 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, RELEASE=squid-de09dd0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731) 2024-08-19T00:25:51.713 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:51 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:51.629+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:01.954691+0000 front 2024-08-19T00:25:01.954869+0000 (oldest deadline 2024-08-19T00:25:24.254908+0000) 2024-08-19T00:25:51.714 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:51 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:51.629+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:10.156120+0000 front 2024-08-19T00:25:10.156097+0000 (oldest deadline 2024-08-19T00:25:36.556729+0000) 2024-08-19T00:25:51.714 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:51 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:51.629+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.058001+0000 front 2024-08-19T00:25:17.057986+0000 (oldest deadline 2024-08-19T00:25:42.958104+0000) 2024-08-19T00:25:51.714 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:51 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:51.629+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:22.958529+0000 front 2024-08-19T00:25:22.958516+0000 (oldest deadline 2024-08-19T00:25:48.258674+0000) 2024-08-19T00:25:51.866 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:25:51 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7[39116]: 2024-08-19T00:25:51.433+0000 7f5475804640 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:09.399138+0000 front 2024-08-19T00:25:09.399073+0000 (oldest deadline 2024-08-19T00:25:35.299243+0000) 2024-08-19T00:25:51.866 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:25:51 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7[39116]: 2024-08-19T00:25:51.433+0000 7f5475804640 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:15.800149+0000 front 2024-08-19T00:25:15.800333+0000 (oldest deadline 2024-08-19T00:25:40.500238+0000) 2024-08-19T00:25:51.866 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:25:51 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7[39116]: 2024-08-19T00:25:51.433+0000 7f5475804640 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:21.601225+0000 front 2024-08-19T00:25:21.601313+0000 (oldest deadline 2024-08-19T00:25:49.201794+0000) 2024-08-19T00:25:52.061 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:51 smithi044 podman[89212]: 2024-08-19 00:25:51.784302009 +0000 UTC m=+5.861316287 container cleanup 8283c028cf63162bf61ec59edc17b058c704b05146da61a88552c6a7ed937683 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-de09dd0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0) 2024-08-19T00:25:52.062 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:51 smithi044 bash[89212]: ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6 2024-08-19T00:25:52.366 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:52 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:52.099+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.683396+0000 front 2024-08-19T00:25:02.683292+0000 (oldest deadline 2024-08-19T00:25:27.383313+0000) 2024-08-19T00:25:52.366 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:52 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:52.099+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:07.383795+0000 front 2024-08-19T00:25:07.383817+0000 (oldest deadline 2024-08-19T00:25:33.283909+0000) 2024-08-19T00:25:52.366 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:52 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:52.099+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.885585+0000 front 2024-08-19T00:25:17.885614+0000 (oldest deadline 2024-08-19T00:25:41.985680+0000) 2024-08-19T00:25:52.366 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:52 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:52.099+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:25.987198+0000 front 2024-08-19T00:25:25.987165+0000 (oldest deadline 2024-08-19T00:25:51.287090+0000) 2024-08-19T00:25:52.369 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:52 smithi044 podman[89239]: 2024-08-19 00:25:52.060887436 +0000 UTC m=+0.649958128 container remove 8283c028cf63162bf61ec59edc17b058c704b05146da61a88552c6a7ed937683 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , RELEASE=squid-de09dd0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-08-19T00:25:52.592 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:25:52 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:25:52.100+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:06.898931+0000 front 2024-08-19T00:25:06.898987+0000 (oldest deadline 2024-08-19T00:25:36.299520+0000) 2024-08-19T00:25:52.593 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:25:52 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:25:52.100+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:16.299966+0000 front 2024-08-19T00:25:16.300073+0000 (oldest deadline 2024-08-19T00:25:40.400126+0000) 2024-08-19T00:25:52.593 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:25:52 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:25:52.100+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:25.701250+0000 front 2024-08-19T00:25:25.701325+0000 (oldest deadline 2024-08-19T00:25:49.201091+0000) 2024-08-19T00:25:52.593 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:25:52 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:25:52.172+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:25:52.593 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:25:52 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:25:52.172+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:18.052701+0000 front 2024-08-19T00:25:18.052756+0000 (oldest deadline 2024-08-19T00:25:41.552819+0000) 2024-08-19T00:25:52.594 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:25:52 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:25:52.172+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:21.553248+0000 front 2024-08-19T00:25:21.553220+0000 (oldest deadline 2024-08-19T00:25:51.553867+0000) 2024-08-19T00:25:52.707 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:52 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:52.608+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:01.954691+0000 front 2024-08-19T00:25:01.954869+0000 (oldest deadline 2024-08-19T00:25:24.254908+0000) 2024-08-19T00:25:52.707 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:52 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:52.608+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:10.156120+0000 front 2024-08-19T00:25:10.156097+0000 (oldest deadline 2024-08-19T00:25:36.556729+0000) 2024-08-19T00:25:52.707 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:52 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:52.608+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.058001+0000 front 2024-08-19T00:25:17.057986+0000 (oldest deadline 2024-08-19T00:25:42.958104+0000) 2024-08-19T00:25:52.707 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:52 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:52.608+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:22.958529+0000 front 2024-08-19T00:25:22.958516+0000 (oldest deadline 2024-08-19T00:25:48.258674+0000) 2024-08-19T00:25:52.707 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:52 smithi044 podman[89329]: 2024-08-19 00:25:52.337539366 +0000 UTC m=+0.017473864 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-19T00:25:52.708 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:52 smithi044 podman[89329]: 2024-08-19 00:25:52.453659215 +0000 UTC m=+0.133593759 container create 31b3874718569a92144f05a7165700e6e47d5b34d463d755bc8dc311dc96a072 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=squid-de09dd0, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-08-19T00:25:52.708 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:52 smithi044 podman[89329]: 2024-08-19 00:25:52.706001597 +0000 UTC m=+0.385936096 container init 31b3874718569a92144f05a7165700e6e47d5b34d463d755bc8dc311dc96a072 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, RELEASE=squid-de09dd0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-08-19T00:25:52.866 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:25:52 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7[39116]: 2024-08-19T00:25:52.442+0000 7f5475804640 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:09.399138+0000 front 2024-08-19T00:25:09.399073+0000 (oldest deadline 2024-08-19T00:25:35.299243+0000) 2024-08-19T00:25:52.866 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:25:52 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7[39116]: 2024-08-19T00:25:52.442+0000 7f5475804640 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:15.800149+0000 front 2024-08-19T00:25:15.800333+0000 (oldest deadline 2024-08-19T00:25:40.500238+0000) 2024-08-19T00:25:52.866 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:25:52 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7[39116]: 2024-08-19T00:25:52.442+0000 7f5475804640 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:21.601225+0000 front 2024-08-19T00:25:21.601313+0000 (oldest deadline 2024-08-19T00:25:49.201794+0000) 2024-08-19T00:25:53.119 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:52 smithi044 podman[89329]: 2024-08-19 00:25:52.71013601 +0000 UTC m=+0.390070508 container start 31b3874718569a92144f05a7165700e6e47d5b34d463d755bc8dc311dc96a072 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-de09dd0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-08-19T00:25:53.120 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:52 smithi044 podman[89329]: 2024-08-19 00:25:52.806102181 +0000 UTC m=+0.486036680 container attach 31b3874718569a92144f05a7165700e6e47d5b34d463d755bc8dc311dc96a072 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=squid-de09dd0, io.buildah.version=1.36.0, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-08-19T00:25:53.120 INFO:journalctl@ceph.osd.6.smithi044.stdout:Aug 19 00:25:52 smithi044 podman[89329]: 2024-08-19 00:25:52.901102011 +0000 UTC m=+0.581036516 container died 31b3874718569a92144f05a7165700e6e47d5b34d463d755bc8dc311dc96a072 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-6-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-de09dd0, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-19T00:25:53.342 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:25:53 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:25:53.066+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:06.898931+0000 front 2024-08-19T00:25:06.898987+0000 (oldest deadline 2024-08-19T00:25:36.299520+0000) 2024-08-19T00:25:53.343 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:25:53 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:25:53.066+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:16.299966+0000 front 2024-08-19T00:25:16.300073+0000 (oldest deadline 2024-08-19T00:25:40.400126+0000) 2024-08-19T00:25:53.343 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:25:53 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:25:53.066+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:25.701250+0000 front 2024-08-19T00:25:25.701325+0000 (oldest deadline 2024-08-19T00:25:49.201091+0000) 2024-08-19T00:25:53.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:25:53 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:25:53.177+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:25:53.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:25:53 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:25:53.177+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:18.052701+0000 front 2024-08-19T00:25:18.052756+0000 (oldest deadline 2024-08-19T00:25:41.552819+0000) 2024-08-19T00:25:53.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:25:53 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:25:53.177+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:21.553248+0000 front 2024-08-19T00:25:21.553220+0000 (oldest deadline 2024-08-19T00:25:51.553867+0000) 2024-08-19T00:25:53.439 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:53 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:53.127+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.683396+0000 front 2024-08-19T00:25:02.683292+0000 (oldest deadline 2024-08-19T00:25:27.383313+0000) 2024-08-19T00:25:53.439 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:53 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:53.127+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:07.383795+0000 front 2024-08-19T00:25:07.383817+0000 (oldest deadline 2024-08-19T00:25:33.283909+0000) 2024-08-19T00:25:53.440 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:53 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:53.127+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.885585+0000 front 2024-08-19T00:25:17.885614+0000 (oldest deadline 2024-08-19T00:25:41.985680+0000) 2024-08-19T00:25:53.440 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:53 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:53.127+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:25.987198+0000 front 2024-08-19T00:25:25.987165+0000 (oldest deadline 2024-08-19T00:25:51.287090+0000) 2024-08-19T00:25:53.492 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-647ded64-5dbe-11ef-bccf-c7b262605968@osd.6.service' 2024-08-19T00:25:53.532 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-19T00:25:53.532 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-08-19T00:25:53.533 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-08-19T00:25:53.533 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-647ded64-5dbe-11ef-bccf-c7b262605968@osd.7 2024-08-19T00:25:53.814 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:25:53 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7[39116]: 2024-08-19T00:25:53.438+0000 7f5475804640 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:09.399138+0000 front 2024-08-19T00:25:09.399073+0000 (oldest deadline 2024-08-19T00:25:35.299243+0000) 2024-08-19T00:25:53.814 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:25:53 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7[39116]: 2024-08-19T00:25:53.438+0000 7f5475804640 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:15.800149+0000 front 2024-08-19T00:25:15.800333+0000 (oldest deadline 2024-08-19T00:25:40.500238+0000) 2024-08-19T00:25:53.814 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:25:53 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7[39116]: 2024-08-19T00:25:53.438+0000 7f5475804640 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:21.601225+0000 front 2024-08-19T00:25:21.601313+0000 (oldest deadline 2024-08-19T00:25:49.201794+0000) 2024-08-19T00:25:53.814 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:25:53 smithi116 systemd[1]: Stopping Ceph osd.7 for 647ded64-5dbe-11ef-bccf-c7b262605968... 2024-08-19T00:25:53.869 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:53 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:53.576+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:01.954691+0000 front 2024-08-19T00:25:01.954869+0000 (oldest deadline 2024-08-19T00:25:24.254908+0000) 2024-08-19T00:25:53.870 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:53 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:53.576+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:10.156120+0000 front 2024-08-19T00:25:10.156097+0000 (oldest deadline 2024-08-19T00:25:36.556729+0000) 2024-08-19T00:25:53.870 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:53 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:53.576+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.058001+0000 front 2024-08-19T00:25:17.057986+0000 (oldest deadline 2024-08-19T00:25:42.958104+0000) 2024-08-19T00:25:53.870 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:53 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:53.576+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:22.958529+0000 front 2024-08-19T00:25:22.958516+0000 (oldest deadline 2024-08-19T00:25:48.258674+0000) 2024-08-19T00:25:54.116 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:25:53 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7[39116]: 2024-08-19T00:25:53.812+0000 7f547d1f6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-19T00:25:54.116 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:25:53 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7[39116]: 2024-08-19T00:25:53.812+0000 7f547d1f6640 -1 osd.7 109 *** Got signal Terminated *** 2024-08-19T00:25:54.116 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:25:53 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7[39116]: 2024-08-19T00:25:53.812+0000 7f547d1f6640 -1 osd.7 109 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-19T00:25:54.342 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:25:54 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:25:54.212+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:25:54.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:25:54 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:25:54.212+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:18.052701+0000 front 2024-08-19T00:25:18.052756+0000 (oldest deadline 2024-08-19T00:25:41.552819+0000) 2024-08-19T00:25:54.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:25:54 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:25:54.212+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:21.553248+0000 front 2024-08-19T00:25:21.553220+0000 (oldest deadline 2024-08-19T00:25:51.553867+0000) 2024-08-19T00:25:54.343 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:25:54 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:25:54.064+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:06.898931+0000 front 2024-08-19T00:25:06.898987+0000 (oldest deadline 2024-08-19T00:25:36.299520+0000) 2024-08-19T00:25:54.343 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:25:54 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:25:54.064+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:16.299966+0000 front 2024-08-19T00:25:16.300073+0000 (oldest deadline 2024-08-19T00:25:40.400126+0000) 2024-08-19T00:25:54.343 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:25:54 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:25:54.064+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:25.701250+0000 front 2024-08-19T00:25:25.701325+0000 (oldest deadline 2024-08-19T00:25:49.201091+0000) 2024-08-19T00:25:54.390 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:54 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:54.125+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.683396+0000 front 2024-08-19T00:25:02.683292+0000 (oldest deadline 2024-08-19T00:25:27.383313+0000) 2024-08-19T00:25:54.390 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:54 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:54.125+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:07.383795+0000 front 2024-08-19T00:25:07.383817+0000 (oldest deadline 2024-08-19T00:25:33.283909+0000) 2024-08-19T00:25:54.390 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:54 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:54.125+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.885585+0000 front 2024-08-19T00:25:17.885614+0000 (oldest deadline 2024-08-19T00:25:41.985680+0000) 2024-08-19T00:25:54.390 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:54 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:54.125+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:25.987198+0000 front 2024-08-19T00:25:25.987165+0000 (oldest deadline 2024-08-19T00:25:51.287090+0000) 2024-08-19T00:25:54.866 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:25:54 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7[39116]: 2024-08-19T00:25:54.389+0000 7f5475804640 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:09.399138+0000 front 2024-08-19T00:25:09.399073+0000 (oldest deadline 2024-08-19T00:25:35.299243+0000) 2024-08-19T00:25:54.866 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:25:54 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7[39116]: 2024-08-19T00:25:54.389+0000 7f5475804640 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:15.800149+0000 front 2024-08-19T00:25:15.800333+0000 (oldest deadline 2024-08-19T00:25:40.500238+0000) 2024-08-19T00:25:54.866 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:25:54 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7[39116]: 2024-08-19T00:25:54.389+0000 7f5475804640 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:21.601225+0000 front 2024-08-19T00:25:21.601313+0000 (oldest deadline 2024-08-19T00:25:49.201794+0000) 2024-08-19T00:25:54.869 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:54 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:54.588+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:01.954691+0000 front 2024-08-19T00:25:01.954869+0000 (oldest deadline 2024-08-19T00:25:24.254908+0000) 2024-08-19T00:25:54.869 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:54 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:54.588+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:10.156120+0000 front 2024-08-19T00:25:10.156097+0000 (oldest deadline 2024-08-19T00:25:36.556729+0000) 2024-08-19T00:25:54.869 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:54 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:54.588+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.058001+0000 front 2024-08-19T00:25:17.057986+0000 (oldest deadline 2024-08-19T00:25:42.958104+0000) 2024-08-19T00:25:54.870 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:54 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:54.588+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:22.958529+0000 front 2024-08-19T00:25:22.958516+0000 (oldest deadline 2024-08-19T00:25:48.258674+0000) 2024-08-19T00:25:55.342 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:25:55 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:25:55.082+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:06.898931+0000 front 2024-08-19T00:25:06.898987+0000 (oldest deadline 2024-08-19T00:25:36.299520+0000) 2024-08-19T00:25:55.343 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:25:55 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:25:55.082+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:16.299966+0000 front 2024-08-19T00:25:16.300073+0000 (oldest deadline 2024-08-19T00:25:40.400126+0000) 2024-08-19T00:25:55.343 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:25:55 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:25:55.082+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:25.701250+0000 front 2024-08-19T00:25:25.701325+0000 (oldest deadline 2024-08-19T00:25:49.201091+0000) 2024-08-19T00:25:55.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:25:55 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:25:55.175+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:25:55.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:25:55 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:25:55.175+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:18.052701+0000 front 2024-08-19T00:25:18.052756+0000 (oldest deadline 2024-08-19T00:25:41.552819+0000) 2024-08-19T00:25:55.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:25:55 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:25:55.175+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:21.553248+0000 front 2024-08-19T00:25:21.553220+0000 (oldest deadline 2024-08-19T00:25:51.553867+0000) 2024-08-19T00:25:55.399 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:55 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:55.132+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.683396+0000 front 2024-08-19T00:25:02.683292+0000 (oldest deadline 2024-08-19T00:25:27.383313+0000) 2024-08-19T00:25:55.399 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:55 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:55.132+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:07.383795+0000 front 2024-08-19T00:25:07.383817+0000 (oldest deadline 2024-08-19T00:25:33.283909+0000) 2024-08-19T00:25:55.400 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:55 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:55.132+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.885585+0000 front 2024-08-19T00:25:17.885614+0000 (oldest deadline 2024-08-19T00:25:41.985680+0000) 2024-08-19T00:25:55.400 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:55 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:55.132+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:25.987198+0000 front 2024-08-19T00:25:25.987165+0000 (oldest deadline 2024-08-19T00:25:51.287090+0000) 2024-08-19T00:25:55.866 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:25:55 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7[39116]: 2024-08-19T00:25:55.398+0000 7f5475804640 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:09.399138+0000 front 2024-08-19T00:25:09.399073+0000 (oldest deadline 2024-08-19T00:25:35.299243+0000) 2024-08-19T00:25:55.866 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:25:55 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7[39116]: 2024-08-19T00:25:55.398+0000 7f5475804640 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:15.800149+0000 front 2024-08-19T00:25:15.800333+0000 (oldest deadline 2024-08-19T00:25:40.500238+0000) 2024-08-19T00:25:55.866 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:25:55 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7[39116]: 2024-08-19T00:25:55.398+0000 7f5475804640 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:21.601225+0000 front 2024-08-19T00:25:21.601313+0000 (oldest deadline 2024-08-19T00:25:49.201794+0000) 2024-08-19T00:25:56.122 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:55 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:55.624+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:01.954691+0000 front 2024-08-19T00:25:01.954869+0000 (oldest deadline 2024-08-19T00:25:24.254908+0000) 2024-08-19T00:25:56.122 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:55 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:55.624+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:10.156120+0000 front 2024-08-19T00:25:10.156097+0000 (oldest deadline 2024-08-19T00:25:36.556729+0000) 2024-08-19T00:25:56.122 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:55 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:55.624+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.058001+0000 front 2024-08-19T00:25:17.057986+0000 (oldest deadline 2024-08-19T00:25:42.958104+0000) 2024-08-19T00:25:56.122 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:55 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:55.624+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:22.958529+0000 front 2024-08-19T00:25:22.958516+0000 (oldest deadline 2024-08-19T00:25:48.258674+0000) 2024-08-19T00:25:56.416 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:25:56 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7[39116]: 2024-08-19T00:25:56.350+0000 7f5475804640 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:09.399138+0000 front 2024-08-19T00:25:09.399073+0000 (oldest deadline 2024-08-19T00:25:35.299243+0000) 2024-08-19T00:25:56.417 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:25:56 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7[39116]: 2024-08-19T00:25:56.350+0000 7f5475804640 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:15.800149+0000 front 2024-08-19T00:25:15.800333+0000 (oldest deadline 2024-08-19T00:25:40.500238+0000) 2024-08-19T00:25:56.417 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:25:56 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7[39116]: 2024-08-19T00:25:56.350+0000 7f5475804640 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:21.601225+0000 front 2024-08-19T00:25:21.601313+0000 (oldest deadline 2024-08-19T00:25:49.201794+0000) 2024-08-19T00:25:56.417 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:56 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:56.135+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.683396+0000 front 2024-08-19T00:25:02.683292+0000 (oldest deadline 2024-08-19T00:25:27.383313+0000) 2024-08-19T00:25:56.417 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:56 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:56.135+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:07.383795+0000 front 2024-08-19T00:25:07.383817+0000 (oldest deadline 2024-08-19T00:25:33.283909+0000) 2024-08-19T00:25:56.417 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:56 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:56.135+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.885585+0000 front 2024-08-19T00:25:17.885614+0000 (oldest deadline 2024-08-19T00:25:41.985680+0000) 2024-08-19T00:25:56.417 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:56 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:56.135+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:25.987198+0000 front 2024-08-19T00:25:25.987165+0000 (oldest deadline 2024-08-19T00:25:51.287090+0000) 2024-08-19T00:25:56.592 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:25:56 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:25:56.105+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:06.898931+0000 front 2024-08-19T00:25:06.898987+0000 (oldest deadline 2024-08-19T00:25:36.299520+0000) 2024-08-19T00:25:56.593 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:25:56 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:25:56.105+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:16.299966+0000 front 2024-08-19T00:25:16.300073+0000 (oldest deadline 2024-08-19T00:25:40.400126+0000) 2024-08-19T00:25:56.593 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:25:56 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:25:56.105+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:25.701250+0000 front 2024-08-19T00:25:25.701325+0000 (oldest deadline 2024-08-19T00:25:49.201091+0000) 2024-08-19T00:25:56.593 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:25:56 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:25:56.136+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:25:56.593 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:25:56 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:25:56.136+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:18.052701+0000 front 2024-08-19T00:25:18.052756+0000 (oldest deadline 2024-08-19T00:25:41.552819+0000) 2024-08-19T00:25:56.593 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:25:56 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:25:56.136+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:21.553248+0000 front 2024-08-19T00:25:21.553220+0000 (oldest deadline 2024-08-19T00:25:51.553867+0000) 2024-08-19T00:25:57.119 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:56 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:56.628+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:01.954691+0000 front 2024-08-19T00:25:01.954869+0000 (oldest deadline 2024-08-19T00:25:24.254908+0000) 2024-08-19T00:25:57.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:56 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:56.628+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:10.156120+0000 front 2024-08-19T00:25:10.156097+0000 (oldest deadline 2024-08-19T00:25:36.556729+0000) 2024-08-19T00:25:57.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:56 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:56.628+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.058001+0000 front 2024-08-19T00:25:17.057986+0000 (oldest deadline 2024-08-19T00:25:42.958104+0000) 2024-08-19T00:25:57.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:56 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:56.628+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:22.958529+0000 front 2024-08-19T00:25:22.958516+0000 (oldest deadline 2024-08-19T00:25:48.258674+0000) 2024-08-19T00:25:57.366 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:25:57 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7[39116]: 2024-08-19T00:25:57.352+0000 7f5475804640 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:09.399138+0000 front 2024-08-19T00:25:09.399073+0000 (oldest deadline 2024-08-19T00:25:35.299243+0000) 2024-08-19T00:25:57.366 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:25:57 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7[39116]: 2024-08-19T00:25:57.352+0000 7f5475804640 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:15.800149+0000 front 2024-08-19T00:25:15.800333+0000 (oldest deadline 2024-08-19T00:25:40.500238+0000) 2024-08-19T00:25:57.367 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:25:57 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7[39116]: 2024-08-19T00:25:57.352+0000 7f5475804640 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:21.601225+0000 front 2024-08-19T00:25:21.601313+0000 (oldest deadline 2024-08-19T00:25:49.201794+0000) 2024-08-19T00:25:57.367 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:25:57 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7[39116]: 2024-08-19T00:25:57.352+0000 7f5475804640 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:34.903343+0000 front 2024-08-19T00:25:34.903383+0000 (oldest deadline 2024-08-19T00:25:57.203526+0000) 2024-08-19T00:25:57.367 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:57 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:57.113+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.683396+0000 front 2024-08-19T00:25:02.683292+0000 (oldest deadline 2024-08-19T00:25:27.383313+0000) 2024-08-19T00:25:57.367 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:57 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:57.113+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:07.383795+0000 front 2024-08-19T00:25:07.383817+0000 (oldest deadline 2024-08-19T00:25:33.283909+0000) 2024-08-19T00:25:57.367 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:57 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:57.113+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.885585+0000 front 2024-08-19T00:25:17.885614+0000 (oldest deadline 2024-08-19T00:25:41.985680+0000) 2024-08-19T00:25:57.368 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:57 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:57.113+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:25.987198+0000 front 2024-08-19T00:25:25.987165+0000 (oldest deadline 2024-08-19T00:25:51.287090+0000) 2024-08-19T00:25:57.592 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:25:57 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:25:57.113+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:06.898931+0000 front 2024-08-19T00:25:06.898987+0000 (oldest deadline 2024-08-19T00:25:36.299520+0000) 2024-08-19T00:25:57.593 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:25:57 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:25:57.113+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:16.299966+0000 front 2024-08-19T00:25:16.300073+0000 (oldest deadline 2024-08-19T00:25:40.400126+0000) 2024-08-19T00:25:57.593 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:25:57 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:25:57.113+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:25.701250+0000 front 2024-08-19T00:25:25.701325+0000 (oldest deadline 2024-08-19T00:25:49.201091+0000) 2024-08-19T00:25:57.593 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:25:57 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:25:57.102+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:25:57.593 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:25:57 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:25:57.102+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:18.052701+0000 front 2024-08-19T00:25:18.052756+0000 (oldest deadline 2024-08-19T00:25:41.552819+0000) 2024-08-19T00:25:57.593 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:25:57 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:25:57.102+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:21.553248+0000 front 2024-08-19T00:25:21.553220+0000 (oldest deadline 2024-08-19T00:25:51.553867+0000) 2024-08-19T00:25:57.594 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:25:57 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:25:57.102+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:34.454979+0000 front 2024-08-19T00:25:34.455005+0000 (oldest deadline 2024-08-19T00:25:56.154930+0000) 2024-08-19T00:25:58.119 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:57 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:57.678+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:01.954691+0000 front 2024-08-19T00:25:01.954869+0000 (oldest deadline 2024-08-19T00:25:24.254908+0000) 2024-08-19T00:25:58.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:57 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:57.678+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:10.156120+0000 front 2024-08-19T00:25:10.156097+0000 (oldest deadline 2024-08-19T00:25:36.556729+0000) 2024-08-19T00:25:58.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:57 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:57.678+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.058001+0000 front 2024-08-19T00:25:17.057986+0000 (oldest deadline 2024-08-19T00:25:42.958104+0000) 2024-08-19T00:25:58.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:57 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:57.678+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:22.958529+0000 front 2024-08-19T00:25:22.958516+0000 (oldest deadline 2024-08-19T00:25:48.258674+0000) 2024-08-19T00:25:58.344 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:25:58 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:25:58.160+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:06.898931+0000 front 2024-08-19T00:25:06.898987+0000 (oldest deadline 2024-08-19T00:25:36.299520+0000) 2024-08-19T00:25:58.344 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:25:58 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:25:58.160+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:16.299966+0000 front 2024-08-19T00:25:16.300073+0000 (oldest deadline 2024-08-19T00:25:40.400126+0000) 2024-08-19T00:25:58.344 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:25:58 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:25:58.160+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:25.701250+0000 front 2024-08-19T00:25:25.701325+0000 (oldest deadline 2024-08-19T00:25:49.201091+0000) 2024-08-19T00:25:58.344 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:25:58 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:25:58.160+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:31.502012+0000 front 2024-08-19T00:25:31.501959+0000 (oldest deadline 2024-08-19T00:25:57.402010+0000) 2024-08-19T00:25:58.345 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:25:58 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:25:58.058+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:25:58.345 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:25:58 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:25:58.058+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:18.052701+0000 front 2024-08-19T00:25:18.052756+0000 (oldest deadline 2024-08-19T00:25:41.552819+0000) 2024-08-19T00:25:58.345 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:25:58 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:25:58.058+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:21.553248+0000 front 2024-08-19T00:25:21.553220+0000 (oldest deadline 2024-08-19T00:25:51.553867+0000) 2024-08-19T00:25:58.345 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:25:58 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:25:58.058+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:34.454979+0000 front 2024-08-19T00:25:34.455005+0000 (oldest deadline 2024-08-19T00:25:56.154930+0000) 2024-08-19T00:25:58.616 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:25:58 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7[39116]: 2024-08-19T00:25:58.344+0000 7f5475804640 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:09.399138+0000 front 2024-08-19T00:25:09.399073+0000 (oldest deadline 2024-08-19T00:25:35.299243+0000) 2024-08-19T00:25:58.616 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:25:58 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7[39116]: 2024-08-19T00:25:58.344+0000 7f5475804640 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:15.800149+0000 front 2024-08-19T00:25:15.800333+0000 (oldest deadline 2024-08-19T00:25:40.500238+0000) 2024-08-19T00:25:58.616 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:25:58 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7[39116]: 2024-08-19T00:25:58.344+0000 7f5475804640 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:21.601225+0000 front 2024-08-19T00:25:21.601313+0000 (oldest deadline 2024-08-19T00:25:49.201794+0000) 2024-08-19T00:25:58.616 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:25:58 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7[39116]: 2024-08-19T00:25:58.344+0000 7f5475804640 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:34.903343+0000 front 2024-08-19T00:25:34.903383+0000 (oldest deadline 2024-08-19T00:25:57.203526+0000) 2024-08-19T00:25:58.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:58 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:58.121+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.683396+0000 front 2024-08-19T00:25:02.683292+0000 (oldest deadline 2024-08-19T00:25:27.383313+0000) 2024-08-19T00:25:58.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:58 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:58.121+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:07.383795+0000 front 2024-08-19T00:25:07.383817+0000 (oldest deadline 2024-08-19T00:25:33.283909+0000) 2024-08-19T00:25:58.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:58 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:58.121+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.885585+0000 front 2024-08-19T00:25:17.885614+0000 (oldest deadline 2024-08-19T00:25:41.985680+0000) 2024-08-19T00:25:58.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:58 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:58.121+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:25.987198+0000 front 2024-08-19T00:25:25.987165+0000 (oldest deadline 2024-08-19T00:25:51.287090+0000) 2024-08-19T00:25:58.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:58 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:58.121+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:31.287376+0000 front 2024-08-19T00:25:31.287401+0000 (oldest deadline 2024-08-19T00:25:57.187488+0000) 2024-08-19T00:25:59.119 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:58 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:58.707+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:01.954691+0000 front 2024-08-19T00:25:01.954869+0000 (oldest deadline 2024-08-19T00:25:24.254908+0000) 2024-08-19T00:25:59.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:58 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:58.707+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:10.156120+0000 front 2024-08-19T00:25:10.156097+0000 (oldest deadline 2024-08-19T00:25:36.556729+0000) 2024-08-19T00:25:59.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:58 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:58.707+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.058001+0000 front 2024-08-19T00:25:17.057986+0000 (oldest deadline 2024-08-19T00:25:42.958104+0000) 2024-08-19T00:25:59.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:58 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:58.707+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:22.958529+0000 front 2024-08-19T00:25:22.958516+0000 (oldest deadline 2024-08-19T00:25:48.258674+0000) 2024-08-19T00:25:59.366 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:25:59 smithi116 podman[57720]: 2024-08-19 00:25:59.251181043 +0000 UTC m=+5.517255993 container died 37bf437106406eb082783d5b99d9c86f0b6426c2350fe15de147591e30193907 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, RELEASE=squid-de09dd0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-08-19T00:25:59.366 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:59 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:59.111+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.683396+0000 front 2024-08-19T00:25:02.683292+0000 (oldest deadline 2024-08-19T00:25:27.383313+0000) 2024-08-19T00:25:59.366 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:59 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:59.111+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:07.383795+0000 front 2024-08-19T00:25:07.383817+0000 (oldest deadline 2024-08-19T00:25:33.283909+0000) 2024-08-19T00:25:59.366 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:59 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:59.111+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.885585+0000 front 2024-08-19T00:25:17.885614+0000 (oldest deadline 2024-08-19T00:25:41.985680+0000) 2024-08-19T00:25:59.367 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:59 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:59.111+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:25.987198+0000 front 2024-08-19T00:25:25.987165+0000 (oldest deadline 2024-08-19T00:25:51.287090+0000) 2024-08-19T00:25:59.367 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:25:59 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:25:59.111+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:31.287376+0000 front 2024-08-19T00:25:31.287401+0000 (oldest deadline 2024-08-19T00:25:57.187488+0000) 2024-08-19T00:25:59.592 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:25:59 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:25:59.126+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:06.898931+0000 front 2024-08-19T00:25:06.898987+0000 (oldest deadline 2024-08-19T00:25:36.299520+0000) 2024-08-19T00:25:59.593 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:25:59 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:25:59.126+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:16.299966+0000 front 2024-08-19T00:25:16.300073+0000 (oldest deadline 2024-08-19T00:25:40.400126+0000) 2024-08-19T00:25:59.593 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:25:59 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:25:59.126+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:25.701250+0000 front 2024-08-19T00:25:25.701325+0000 (oldest deadline 2024-08-19T00:25:49.201091+0000) 2024-08-19T00:25:59.593 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:25:59 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:25:59.126+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:31.502012+0000 front 2024-08-19T00:25:31.501959+0000 (oldest deadline 2024-08-19T00:25:57.402010+0000) 2024-08-19T00:25:59.593 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:25:59 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:25:59.096+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:25:59.593 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:25:59 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:25:59.096+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:18.052701+0000 front 2024-08-19T00:25:18.052756+0000 (oldest deadline 2024-08-19T00:25:41.552819+0000) 2024-08-19T00:25:59.593 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:25:59 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:25:59.096+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:21.553248+0000 front 2024-08-19T00:25:21.553220+0000 (oldest deadline 2024-08-19T00:25:51.553867+0000) 2024-08-19T00:25:59.594 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:25:59 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:25:59.096+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:34.454979+0000 front 2024-08-19T00:25:34.455005+0000 (oldest deadline 2024-08-19T00:25:56.154930+0000) 2024-08-19T00:25:59.866 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:25:59 smithi116 podman[57720]: 2024-08-19 00:25:59.679626062 +0000 UTC m=+5.945701015 container cleanup 37bf437106406eb082783d5b99d9c86f0b6426c2350fe15de147591e30193907 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-de09dd0, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-08-19T00:25:59.866 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:25:59 smithi116 bash[57720]: ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7 2024-08-19T00:26:00.119 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:59 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:59.709+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:01.954691+0000 front 2024-08-19T00:25:01.954869+0000 (oldest deadline 2024-08-19T00:25:24.254908+0000) 2024-08-19T00:26:00.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:59 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:59.709+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:10.156120+0000 front 2024-08-19T00:25:10.156097+0000 (oldest deadline 2024-08-19T00:25:36.556729+0000) 2024-08-19T00:26:00.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:59 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:59.709+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.058001+0000 front 2024-08-19T00:25:17.057986+0000 (oldest deadline 2024-08-19T00:25:42.958104+0000) 2024-08-19T00:26:00.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:59 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:59.709+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:22.958529+0000 front 2024-08-19T00:25:22.958516+0000 (oldest deadline 2024-08-19T00:25:48.258674+0000) 2024-08-19T00:26:00.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:25:59 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:25:59.709+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:34.159858+0000 front 2024-08-19T00:25:34.159986+0000 (oldest deadline 2024-08-19T00:25:58.760125+0000) 2024-08-19T00:26:00.149 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:25:59 smithi116 podman[57748]: 2024-08-19 00:25:59.897764918 +0000 UTC m=+0.644792856 container remove 37bf437106406eb082783d5b99d9c86f0b6426c2350fe15de147591e30193907 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=squid-de09dd0, io.buildah.version=1.36.0) 2024-08-19T00:26:00.342 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:26:00 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:26:00.116+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:06.898931+0000 front 2024-08-19T00:25:06.898987+0000 (oldest deadline 2024-08-19T00:25:36.299520+0000) 2024-08-19T00:26:00.343 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:26:00 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:26:00.116+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:16.299966+0000 front 2024-08-19T00:25:16.300073+0000 (oldest deadline 2024-08-19T00:25:40.400126+0000) 2024-08-19T00:26:00.343 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:26:00 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:26:00.116+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:25.701250+0000 front 2024-08-19T00:25:25.701325+0000 (oldest deadline 2024-08-19T00:25:49.201091+0000) 2024-08-19T00:26:00.343 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:26:00 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:26:00.116+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:31.502012+0000 front 2024-08-19T00:25:31.501959+0000 (oldest deadline 2024-08-19T00:25:57.402010+0000) 2024-08-19T00:26:00.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:00 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:00.059+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:26:00.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:00 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:00.059+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:18.052701+0000 front 2024-08-19T00:25:18.052756+0000 (oldest deadline 2024-08-19T00:25:41.552819+0000) 2024-08-19T00:26:00.344 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:00 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:00.059+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:21.553248+0000 front 2024-08-19T00:25:21.553220+0000 (oldest deadline 2024-08-19T00:25:51.553867+0000) 2024-08-19T00:26:00.344 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:00 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:00.059+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:34.454979+0000 front 2024-08-19T00:25:34.455005+0000 (oldest deadline 2024-08-19T00:25:56.154930+0000) 2024-08-19T00:26:00.408 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:26:00 smithi116 podman[57837]: 2024-08-19 00:26:00.298548466 +0000 UTC m=+0.099153140 container create 7a54181649cc1fe021806c09f59d1424f8e7ceff73597a9d4b5249a508868327 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , RELEASE=squid-de09dd0, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-08-19T00:26:00.409 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:26:00 smithi116 podman[57837]: 2024-08-19 00:26:00.217153191 +0000 UTC m=+0.017757865 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-19T00:26:00.409 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:00 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:00.147+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.683396+0000 front 2024-08-19T00:25:02.683292+0000 (oldest deadline 2024-08-19T00:25:27.383313+0000) 2024-08-19T00:26:00.409 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:00 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:00.147+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:07.383795+0000 front 2024-08-19T00:25:07.383817+0000 (oldest deadline 2024-08-19T00:25:33.283909+0000) 2024-08-19T00:26:00.409 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:00 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:00.147+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.885585+0000 front 2024-08-19T00:25:17.885614+0000 (oldest deadline 2024-08-19T00:25:41.985680+0000) 2024-08-19T00:26:00.409 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:00 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:00.147+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:25.987198+0000 front 2024-08-19T00:25:25.987165+0000 (oldest deadline 2024-08-19T00:25:51.287090+0000) 2024-08-19T00:26:00.410 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:00 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:00.147+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:31.287376+0000 front 2024-08-19T00:25:31.287401+0000 (oldest deadline 2024-08-19T00:25:57.187488+0000) 2024-08-19T00:26:00.699 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:26:00 smithi116 podman[57837]: 2024-08-19 00:26:00.509417617 +0000 UTC m=+0.310022308 container init 7a54181649cc1fe021806c09f59d1424f8e7ceff73597a9d4b5249a508868327 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7-deactivate, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-de09dd0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-08-19T00:26:00.700 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:26:00 smithi116 podman[57837]: 2024-08-19 00:26:00.512600808 +0000 UTC m=+0.313205483 container start 7a54181649cc1fe021806c09f59d1424f8e7ceff73597a9d4b5249a508868327 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-de09dd0, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-19T00:26:00.700 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:26:00 smithi116 podman[57837]: 2024-08-19 00:26:00.584264886 +0000 UTC m=+0.384869574 container attach 7a54181649cc1fe021806c09f59d1424f8e7ceff73597a9d4b5249a508868327 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-de09dd0, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-08-19T00:26:01.021 INFO:journalctl@ceph.osd.7.smithi116.stdout:Aug 19 00:26:00 smithi116 podman[57837]: 2024-08-19 00:26:00.698411477 +0000 UTC m=+0.499016158 container died 7a54181649cc1fe021806c09f59d1424f8e7ceff73597a9d4b5249a508868327 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-de09dd0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-19T00:26:01.119 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:00 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:00.665+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:01.954691+0000 front 2024-08-19T00:25:01.954869+0000 (oldest deadline 2024-08-19T00:25:24.254908+0000) 2024-08-19T00:26:01.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:00 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:00.665+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:10.156120+0000 front 2024-08-19T00:25:10.156097+0000 (oldest deadline 2024-08-19T00:25:36.556729+0000) 2024-08-19T00:26:01.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:00 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:00.665+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.058001+0000 front 2024-08-19T00:25:17.057986+0000 (oldest deadline 2024-08-19T00:25:42.958104+0000) 2024-08-19T00:26:01.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:00 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:00.665+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:22.958529+0000 front 2024-08-19T00:25:22.958516+0000 (oldest deadline 2024-08-19T00:25:48.258674+0000) 2024-08-19T00:26:01.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:00 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:00.665+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:34.159858+0000 front 2024-08-19T00:25:34.159986+0000 (oldest deadline 2024-08-19T00:25:58.760125+0000) 2024-08-19T00:26:01.314 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:01 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:01.163+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.683396+0000 front 2024-08-19T00:25:02.683292+0000 (oldest deadline 2024-08-19T00:25:27.383313+0000) 2024-08-19T00:26:01.315 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:01 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:01.163+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:07.383795+0000 front 2024-08-19T00:25:07.383817+0000 (oldest deadline 2024-08-19T00:25:33.283909+0000) 2024-08-19T00:26:01.315 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:01 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:01.163+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.885585+0000 front 2024-08-19T00:25:17.885614+0000 (oldest deadline 2024-08-19T00:25:41.985680+0000) 2024-08-19T00:26:01.315 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:01 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:01.163+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:25.987198+0000 front 2024-08-19T00:25:25.987165+0000 (oldest deadline 2024-08-19T00:25:51.287090+0000) 2024-08-19T00:26:01.315 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:01 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:01.163+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:31.287376+0000 front 2024-08-19T00:25:31.287401+0000 (oldest deadline 2024-08-19T00:25:57.187488+0000) 2024-08-19T00:26:01.338 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-647ded64-5dbe-11ef-bccf-c7b262605968@osd.7.service' 2024-08-19T00:26:01.342 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:26:01 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:26:01.154+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:06.898931+0000 front 2024-08-19T00:25:06.898987+0000 (oldest deadline 2024-08-19T00:25:36.299520+0000) 2024-08-19T00:26:01.342 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:26:01 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:26:01.154+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:16.299966+0000 front 2024-08-19T00:25:16.300073+0000 (oldest deadline 2024-08-19T00:25:40.400126+0000) 2024-08-19T00:26:01.343 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:26:01 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:26:01.154+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:25.701250+0000 front 2024-08-19T00:25:25.701325+0000 (oldest deadline 2024-08-19T00:25:49.201091+0000) 2024-08-19T00:26:01.343 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:26:01 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:26:01.154+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:31.502012+0000 front 2024-08-19T00:25:31.501959+0000 (oldest deadline 2024-08-19T00:25:57.402010+0000) 2024-08-19T00:26:01.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:01 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:01.025+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:26:01.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:01 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:01.025+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:18.052701+0000 front 2024-08-19T00:25:18.052756+0000 (oldest deadline 2024-08-19T00:25:41.552819+0000) 2024-08-19T00:26:01.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:01 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:01.025+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:21.553248+0000 front 2024-08-19T00:25:21.553220+0000 (oldest deadline 2024-08-19T00:25:51.553867+0000) 2024-08-19T00:26:01.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:01 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:01.025+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:34.454979+0000 front 2024-08-19T00:25:34.455005+0000 (oldest deadline 2024-08-19T00:25:56.154930+0000) 2024-08-19T00:26:01.378 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-19T00:26:01.378 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-08-19T00:26:01.378 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-08-19T00:26:01.378 DEBUG:teuthology.orchestra.run.smithi171:> sudo systemctl stop ceph-647ded64-5dbe-11ef-bccf-c7b262605968@osd.8 2024-08-19T00:26:01.706 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:26:01 smithi171 systemd[1]: Stopping Ceph osd.8 for 647ded64-5dbe-11ef-bccf-c7b262605968... 2024-08-19T00:26:01.996 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:26:01 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:26:01.704+0000 7f8d44ea5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-19T00:26:01.996 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:26:01 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:26:01.704+0000 7f8d44ea5640 -1 osd.8 109 *** Got signal Terminated *** 2024-08-19T00:26:01.996 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:26:01 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:26:01.704+0000 7f8d44ea5640 -1 osd.8 109 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-19T00:26:02.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:01 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:01.626+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:01.954691+0000 front 2024-08-19T00:25:01.954869+0000 (oldest deadline 2024-08-19T00:25:24.254908+0000) 2024-08-19T00:26:02.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:01 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:01.626+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:10.156120+0000 front 2024-08-19T00:25:10.156097+0000 (oldest deadline 2024-08-19T00:25:36.556729+0000) 2024-08-19T00:26:02.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:01 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:01.626+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.058001+0000 front 2024-08-19T00:25:17.057986+0000 (oldest deadline 2024-08-19T00:25:42.958104+0000) 2024-08-19T00:26:02.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:01 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:01.626+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:22.958529+0000 front 2024-08-19T00:25:22.958516+0000 (oldest deadline 2024-08-19T00:25:48.258674+0000) 2024-08-19T00:26:02.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:01 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:01.626+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:34.159858+0000 front 2024-08-19T00:25:34.159986+0000 (oldest deadline 2024-08-19T00:25:58.760125+0000) 2024-08-19T00:26:02.342 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:26:02 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:26:02.120+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:06.898931+0000 front 2024-08-19T00:25:06.898987+0000 (oldest deadline 2024-08-19T00:25:36.299520+0000) 2024-08-19T00:26:02.343 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:26:02 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:26:02.120+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:16.299966+0000 front 2024-08-19T00:25:16.300073+0000 (oldest deadline 2024-08-19T00:25:40.400126+0000) 2024-08-19T00:26:02.343 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:26:02 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:26:02.120+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:25.701250+0000 front 2024-08-19T00:25:25.701325+0000 (oldest deadline 2024-08-19T00:25:49.201091+0000) 2024-08-19T00:26:02.343 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:26:02 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:26:02.120+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:31.502012+0000 front 2024-08-19T00:25:31.501959+0000 (oldest deadline 2024-08-19T00:25:57.402010+0000) 2024-08-19T00:26:02.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:01 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:01.994+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:26:02.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:01 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:01.994+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:18.052701+0000 front 2024-08-19T00:25:18.052756+0000 (oldest deadline 2024-08-19T00:25:41.552819+0000) 2024-08-19T00:26:02.344 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:01 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:01.994+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:21.553248+0000 front 2024-08-19T00:25:21.553220+0000 (oldest deadline 2024-08-19T00:25:51.553867+0000) 2024-08-19T00:26:02.344 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:01 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:01.994+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:34.454979+0000 front 2024-08-19T00:25:34.455005+0000 (oldest deadline 2024-08-19T00:25:56.154930+0000) 2024-08-19T00:26:02.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:02 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:02.133+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.683396+0000 front 2024-08-19T00:25:02.683292+0000 (oldest deadline 2024-08-19T00:25:27.383313+0000) 2024-08-19T00:26:02.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:02 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:02.133+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:07.383795+0000 front 2024-08-19T00:25:07.383817+0000 (oldest deadline 2024-08-19T00:25:33.283909+0000) 2024-08-19T00:26:02.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:02 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:02.133+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.885585+0000 front 2024-08-19T00:25:17.885614+0000 (oldest deadline 2024-08-19T00:25:41.985680+0000) 2024-08-19T00:26:02.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:02 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:02.133+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:25.987198+0000 front 2024-08-19T00:25:25.987165+0000 (oldest deadline 2024-08-19T00:25:51.287090+0000) 2024-08-19T00:26:02.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:02 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:02.133+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:31.287376+0000 front 2024-08-19T00:25:31.287401+0000 (oldest deadline 2024-08-19T00:25:57.187488+0000) 2024-08-19T00:26:03.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:02 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:02.639+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:01.954691+0000 front 2024-08-19T00:25:01.954869+0000 (oldest deadline 2024-08-19T00:25:24.254908+0000) 2024-08-19T00:26:03.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:02 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:02.639+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:10.156120+0000 front 2024-08-19T00:25:10.156097+0000 (oldest deadline 2024-08-19T00:25:36.556729+0000) 2024-08-19T00:26:03.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:02 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:02.639+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.058001+0000 front 2024-08-19T00:25:17.057986+0000 (oldest deadline 2024-08-19T00:25:42.958104+0000) 2024-08-19T00:26:03.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:02 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:02.639+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:22.958529+0000 front 2024-08-19T00:25:22.958516+0000 (oldest deadline 2024-08-19T00:25:48.258674+0000) 2024-08-19T00:26:03.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:02 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:02.639+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:34.159858+0000 front 2024-08-19T00:25:34.159986+0000 (oldest deadline 2024-08-19T00:25:58.760125+0000) 2024-08-19T00:26:03.342 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:02 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:02.984+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:26:03.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:02 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:02.984+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:18.052701+0000 front 2024-08-19T00:25:18.052756+0000 (oldest deadline 2024-08-19T00:25:41.552819+0000) 2024-08-19T00:26:03.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:02 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:02.984+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:21.553248+0000 front 2024-08-19T00:25:21.553220+0000 (oldest deadline 2024-08-19T00:25:51.553867+0000) 2024-08-19T00:26:03.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:02 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:02.984+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:34.454979+0000 front 2024-08-19T00:25:34.455005+0000 (oldest deadline 2024-08-19T00:25:56.154930+0000) 2024-08-19T00:26:03.343 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:26:03 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:26:03.152+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:06.898931+0000 front 2024-08-19T00:25:06.898987+0000 (oldest deadline 2024-08-19T00:25:36.299520+0000) 2024-08-19T00:26:03.343 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:26:03 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:26:03.152+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:16.299966+0000 front 2024-08-19T00:25:16.300073+0000 (oldest deadline 2024-08-19T00:25:40.400126+0000) 2024-08-19T00:26:03.343 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:26:03 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:26:03.152+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:25.701250+0000 front 2024-08-19T00:25:25.701325+0000 (oldest deadline 2024-08-19T00:25:49.201091+0000) 2024-08-19T00:26:03.344 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:26:03 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:26:03.152+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:31.502012+0000 front 2024-08-19T00:25:31.501959+0000 (oldest deadline 2024-08-19T00:25:57.402010+0000) 2024-08-19T00:26:03.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:03 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:03.180+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.683396+0000 front 2024-08-19T00:25:02.683292+0000 (oldest deadline 2024-08-19T00:25:27.383313+0000) 2024-08-19T00:26:03.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:03 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:03.180+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:07.383795+0000 front 2024-08-19T00:25:07.383817+0000 (oldest deadline 2024-08-19T00:25:33.283909+0000) 2024-08-19T00:26:03.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:03 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:03.180+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.885585+0000 front 2024-08-19T00:25:17.885614+0000 (oldest deadline 2024-08-19T00:25:41.985680+0000) 2024-08-19T00:26:03.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:03 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:03.180+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:25.987198+0000 front 2024-08-19T00:25:25.987165+0000 (oldest deadline 2024-08-19T00:25:51.287090+0000) 2024-08-19T00:26:03.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:03 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:03.180+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:31.287376+0000 front 2024-08-19T00:25:31.287401+0000 (oldest deadline 2024-08-19T00:25:57.187488+0000) 2024-08-19T00:26:04.119 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:03 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:03.624+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:01.954691+0000 front 2024-08-19T00:25:01.954869+0000 (oldest deadline 2024-08-19T00:25:24.254908+0000) 2024-08-19T00:26:04.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:03 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:03.624+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:10.156120+0000 front 2024-08-19T00:25:10.156097+0000 (oldest deadline 2024-08-19T00:25:36.556729+0000) 2024-08-19T00:26:04.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:03 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:03.624+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.058001+0000 front 2024-08-19T00:25:17.057986+0000 (oldest deadline 2024-08-19T00:25:42.958104+0000) 2024-08-19T00:26:04.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:03 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:03.624+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:22.958529+0000 front 2024-08-19T00:25:22.958516+0000 (oldest deadline 2024-08-19T00:25:48.258674+0000) 2024-08-19T00:26:04.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:03 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:03.624+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:34.159858+0000 front 2024-08-19T00:25:34.159986+0000 (oldest deadline 2024-08-19T00:25:58.760125+0000) 2024-08-19T00:26:04.342 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:26:04 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:26:04.123+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:06.898931+0000 front 2024-08-19T00:25:06.898987+0000 (oldest deadline 2024-08-19T00:25:36.299520+0000) 2024-08-19T00:26:04.343 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:26:04 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:26:04.123+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:16.299966+0000 front 2024-08-19T00:25:16.300073+0000 (oldest deadline 2024-08-19T00:25:40.400126+0000) 2024-08-19T00:26:04.343 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:26:04 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:26:04.123+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:25.701250+0000 front 2024-08-19T00:25:25.701325+0000 (oldest deadline 2024-08-19T00:25:49.201091+0000) 2024-08-19T00:26:04.343 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:26:04 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:26:04.123+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:31.502012+0000 front 2024-08-19T00:25:31.501959+0000 (oldest deadline 2024-08-19T00:25:57.402010+0000) 2024-08-19T00:26:04.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:04 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:04.021+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:26:04.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:04 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:04.021+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:18.052701+0000 front 2024-08-19T00:25:18.052756+0000 (oldest deadline 2024-08-19T00:25:41.552819+0000) 2024-08-19T00:26:04.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:04 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:04.021+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:21.553248+0000 front 2024-08-19T00:25:21.553220+0000 (oldest deadline 2024-08-19T00:25:51.553867+0000) 2024-08-19T00:26:04.344 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:04 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:04.021+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:34.454979+0000 front 2024-08-19T00:25:34.455005+0000 (oldest deadline 2024-08-19T00:25:56.154930+0000) 2024-08-19T00:26:04.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:04 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:04.174+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.683396+0000 front 2024-08-19T00:25:02.683292+0000 (oldest deadline 2024-08-19T00:25:27.383313+0000) 2024-08-19T00:26:04.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:04 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:04.174+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:07.383795+0000 front 2024-08-19T00:25:07.383817+0000 (oldest deadline 2024-08-19T00:25:33.283909+0000) 2024-08-19T00:26:04.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:04 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:04.174+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.885585+0000 front 2024-08-19T00:25:17.885614+0000 (oldest deadline 2024-08-19T00:25:41.985680+0000) 2024-08-19T00:26:04.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:04 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:04.174+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:25.987198+0000 front 2024-08-19T00:25:25.987165+0000 (oldest deadline 2024-08-19T00:25:51.287090+0000) 2024-08-19T00:26:04.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:04 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:04.174+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:31.287376+0000 front 2024-08-19T00:25:31.287401+0000 (oldest deadline 2024-08-19T00:25:57.187488+0000) 2024-08-19T00:26:05.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:04 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:04.657+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:01.954691+0000 front 2024-08-19T00:25:01.954869+0000 (oldest deadline 2024-08-19T00:25:24.254908+0000) 2024-08-19T00:26:05.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:04 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:04.657+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:10.156120+0000 front 2024-08-19T00:25:10.156097+0000 (oldest deadline 2024-08-19T00:25:36.556729+0000) 2024-08-19T00:26:05.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:04 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:04.657+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.058001+0000 front 2024-08-19T00:25:17.057986+0000 (oldest deadline 2024-08-19T00:25:42.958104+0000) 2024-08-19T00:26:05.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:04 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:04.657+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:22.958529+0000 front 2024-08-19T00:25:22.958516+0000 (oldest deadline 2024-08-19T00:25:48.258674+0000) 2024-08-19T00:26:05.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:04 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:04.657+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:34.159858+0000 front 2024-08-19T00:25:34.159986+0000 (oldest deadline 2024-08-19T00:25:58.760125+0000) 2024-08-19T00:26:05.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:04 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:04.657+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-08-19T00:25:42.861349+0000 front 2024-08-19T00:25:42.861262+0000 (oldest deadline 2024-08-19T00:26:04.561157+0000) 2024-08-19T00:26:05.342 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:26:05 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:26:05.081+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:06.898931+0000 front 2024-08-19T00:25:06.898987+0000 (oldest deadline 2024-08-19T00:25:36.299520+0000) 2024-08-19T00:26:05.343 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:26:05 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:26:05.081+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:16.299966+0000 front 2024-08-19T00:25:16.300073+0000 (oldest deadline 2024-08-19T00:25:40.400126+0000) 2024-08-19T00:26:05.343 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:26:05 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:26:05.081+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:25.701250+0000 front 2024-08-19T00:25:25.701325+0000 (oldest deadline 2024-08-19T00:25:49.201091+0000) 2024-08-19T00:26:05.343 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:26:05 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:26:05.081+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:31.502012+0000 front 2024-08-19T00:25:31.501959+0000 (oldest deadline 2024-08-19T00:25:57.402010+0000) 2024-08-19T00:26:05.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:04 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:04.995+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:26:05.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:04 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:04.995+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:18.052701+0000 front 2024-08-19T00:25:18.052756+0000 (oldest deadline 2024-08-19T00:25:41.552819+0000) 2024-08-19T00:26:05.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:04 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:04.995+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:21.553248+0000 front 2024-08-19T00:25:21.553220+0000 (oldest deadline 2024-08-19T00:25:51.553867+0000) 2024-08-19T00:26:05.344 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:04 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:04.995+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:34.454979+0000 front 2024-08-19T00:25:34.455005+0000 (oldest deadline 2024-08-19T00:25:56.154930+0000) 2024-08-19T00:26:05.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:05 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:05.189+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.683396+0000 front 2024-08-19T00:25:02.683292+0000 (oldest deadline 2024-08-19T00:25:27.383313+0000) 2024-08-19T00:26:05.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:05 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:05.189+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:07.383795+0000 front 2024-08-19T00:25:07.383817+0000 (oldest deadline 2024-08-19T00:25:33.283909+0000) 2024-08-19T00:26:05.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:05 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:05.189+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.885585+0000 front 2024-08-19T00:25:17.885614+0000 (oldest deadline 2024-08-19T00:25:41.985680+0000) 2024-08-19T00:26:05.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:05 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:05.189+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:25.987198+0000 front 2024-08-19T00:25:25.987165+0000 (oldest deadline 2024-08-19T00:25:51.287090+0000) 2024-08-19T00:26:05.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:05 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:05.189+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:31.287376+0000 front 2024-08-19T00:25:31.287401+0000 (oldest deadline 2024-08-19T00:25:57.187488+0000) 2024-08-19T00:26:06.119 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:05 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:05.664+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:01.954691+0000 front 2024-08-19T00:25:01.954869+0000 (oldest deadline 2024-08-19T00:25:24.254908+0000) 2024-08-19T00:26:06.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:05 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:05.664+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:10.156120+0000 front 2024-08-19T00:25:10.156097+0000 (oldest deadline 2024-08-19T00:25:36.556729+0000) 2024-08-19T00:26:06.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:05 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:05.664+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.058001+0000 front 2024-08-19T00:25:17.057986+0000 (oldest deadline 2024-08-19T00:25:42.958104+0000) 2024-08-19T00:26:06.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:05 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:05.664+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:22.958529+0000 front 2024-08-19T00:25:22.958516+0000 (oldest deadline 2024-08-19T00:25:48.258674+0000) 2024-08-19T00:26:06.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:05 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:05.664+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:34.159858+0000 front 2024-08-19T00:25:34.159986+0000 (oldest deadline 2024-08-19T00:25:58.760125+0000) 2024-08-19T00:26:06.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:05 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:05.664+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-08-19T00:25:42.861349+0000 front 2024-08-19T00:25:42.861262+0000 (oldest deadline 2024-08-19T00:26:04.561157+0000) 2024-08-19T00:26:06.342 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:26:06 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:26:06.101+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:06.898931+0000 front 2024-08-19T00:25:06.898987+0000 (oldest deadline 2024-08-19T00:25:36.299520+0000) 2024-08-19T00:26:06.343 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:26:06 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:26:06.101+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:16.299966+0000 front 2024-08-19T00:25:16.300073+0000 (oldest deadline 2024-08-19T00:25:40.400126+0000) 2024-08-19T00:26:06.343 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:26:06 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:26:06.101+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:25.701250+0000 front 2024-08-19T00:25:25.701325+0000 (oldest deadline 2024-08-19T00:25:49.201091+0000) 2024-08-19T00:26:06.343 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:26:06 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8[39874]: 2024-08-19T00:26:06.101+0000 7f8d414bb640 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:31.502012+0000 front 2024-08-19T00:25:31.501959+0000 (oldest deadline 2024-08-19T00:25:57.402010+0000) 2024-08-19T00:26:06.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:06 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:06.033+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:26:06.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:06 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:06.033+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:18.052701+0000 front 2024-08-19T00:25:18.052756+0000 (oldest deadline 2024-08-19T00:25:41.552819+0000) 2024-08-19T00:26:06.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:06 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:06.033+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:21.553248+0000 front 2024-08-19T00:25:21.553220+0000 (oldest deadline 2024-08-19T00:25:51.553867+0000) 2024-08-19T00:26:06.344 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:06 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:06.033+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:34.454979+0000 front 2024-08-19T00:25:34.455005+0000 (oldest deadline 2024-08-19T00:25:56.154930+0000) 2024-08-19T00:26:06.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:06 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:06.218+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.683396+0000 front 2024-08-19T00:25:02.683292+0000 (oldest deadline 2024-08-19T00:25:27.383313+0000) 2024-08-19T00:26:06.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:06 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:06.218+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:07.383795+0000 front 2024-08-19T00:25:07.383817+0000 (oldest deadline 2024-08-19T00:25:33.283909+0000) 2024-08-19T00:26:06.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:06 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:06.218+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.885585+0000 front 2024-08-19T00:25:17.885614+0000 (oldest deadline 2024-08-19T00:25:41.985680+0000) 2024-08-19T00:26:06.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:06 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:06.218+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:25.987198+0000 front 2024-08-19T00:25:25.987165+0000 (oldest deadline 2024-08-19T00:25:51.287090+0000) 2024-08-19T00:26:06.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:06 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:06.218+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:31.287376+0000 front 2024-08-19T00:25:31.287401+0000 (oldest deadline 2024-08-19T00:25:57.187488+0000) 2024-08-19T00:26:07.119 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:06 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:06.694+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:01.954691+0000 front 2024-08-19T00:25:01.954869+0000 (oldest deadline 2024-08-19T00:25:24.254908+0000) 2024-08-19T00:26:07.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:06 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:06.694+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:10.156120+0000 front 2024-08-19T00:25:10.156097+0000 (oldest deadline 2024-08-19T00:25:36.556729+0000) 2024-08-19T00:26:07.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:06 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:06.694+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.058001+0000 front 2024-08-19T00:25:17.057986+0000 (oldest deadline 2024-08-19T00:25:42.958104+0000) 2024-08-19T00:26:07.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:06 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:06.694+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:22.958529+0000 front 2024-08-19T00:25:22.958516+0000 (oldest deadline 2024-08-19T00:25:48.258674+0000) 2024-08-19T00:26:07.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:06 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:06.694+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:34.159858+0000 front 2024-08-19T00:25:34.159986+0000 (oldest deadline 2024-08-19T00:25:58.760125+0000) 2024-08-19T00:26:07.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:06 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:06.694+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-08-19T00:25:42.861349+0000 front 2024-08-19T00:25:42.861262+0000 (oldest deadline 2024-08-19T00:26:04.561157+0000) 2024-08-19T00:26:07.342 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:26:07 smithi171 podman[58277]: 2024-08-19 00:26:07.074144804 +0000 UTC m=+5.484810077 container died 6d1d7cc2da6db67ba5ac1d65c17569391d92819ac431c3da17cf497e9cb82854 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-de09dd0, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-19T00:26:07.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:07 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:07.076+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:26:07.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:07 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:07.076+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:18.052701+0000 front 2024-08-19T00:25:18.052756+0000 (oldest deadline 2024-08-19T00:25:41.552819+0000) 2024-08-19T00:26:07.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:07 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:07.076+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:21.553248+0000 front 2024-08-19T00:25:21.553220+0000 (oldest deadline 2024-08-19T00:25:51.553867+0000) 2024-08-19T00:26:07.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:07 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:07.076+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:34.454979+0000 front 2024-08-19T00:25:34.455005+0000 (oldest deadline 2024-08-19T00:25:56.154930+0000) 2024-08-19T00:26:07.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:07 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:07.076+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-08-19T00:25:42.055865+0000 front 2024-08-19T00:25:42.055981+0000 (oldest deadline 2024-08-19T00:26:06.155968+0000) 2024-08-19T00:26:07.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:07 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:07.182+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.683396+0000 front 2024-08-19T00:25:02.683292+0000 (oldest deadline 2024-08-19T00:25:27.383313+0000) 2024-08-19T00:26:07.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:07 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:07.182+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:07.383795+0000 front 2024-08-19T00:25:07.383817+0000 (oldest deadline 2024-08-19T00:25:33.283909+0000) 2024-08-19T00:26:07.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:07 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:07.182+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.885585+0000 front 2024-08-19T00:25:17.885614+0000 (oldest deadline 2024-08-19T00:25:41.985680+0000) 2024-08-19T00:26:07.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:07 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:07.182+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:25.987198+0000 front 2024-08-19T00:25:25.987165+0000 (oldest deadline 2024-08-19T00:25:51.287090+0000) 2024-08-19T00:26:07.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:07 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:07.182+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:31.287376+0000 front 2024-08-19T00:25:31.287401+0000 (oldest deadline 2024-08-19T00:25:57.187488+0000) 2024-08-19T00:26:07.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:07 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:07.182+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-08-19T00:25:41.189147+0000 front 2024-08-19T00:25:41.189011+0000 (oldest deadline 2024-08-19T00:26:07.088928+0000) 2024-08-19T00:26:07.731 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:26:07 smithi171 podman[58277]: 2024-08-19 00:26:07.429081273 +0000 UTC m=+5.839746544 container cleanup 6d1d7cc2da6db67ba5ac1d65c17569391d92819ac431c3da17cf497e9cb82854 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=squid-de09dd0, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-19T00:26:07.731 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:26:07 smithi171 bash[58277]: ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8 2024-08-19T00:26:08.063 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:26:07 smithi171 podman[58293]: 2024-08-19 00:26:07.730294486 +0000 UTC m=+0.659454670 container remove 6d1d7cc2da6db67ba5ac1d65c17569391d92819ac431c3da17cf497e9cb82854 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-de09dd0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True) 2024-08-19T00:26:08.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:07 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:07.676+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:01.954691+0000 front 2024-08-19T00:25:01.954869+0000 (oldest deadline 2024-08-19T00:25:24.254908+0000) 2024-08-19T00:26:08.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:07 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:07.676+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:10.156120+0000 front 2024-08-19T00:25:10.156097+0000 (oldest deadline 2024-08-19T00:25:36.556729+0000) 2024-08-19T00:26:08.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:07 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:07.676+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.058001+0000 front 2024-08-19T00:25:17.057986+0000 (oldest deadline 2024-08-19T00:25:42.958104+0000) 2024-08-19T00:26:08.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:07 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:07.676+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:22.958529+0000 front 2024-08-19T00:25:22.958516+0000 (oldest deadline 2024-08-19T00:25:48.258674+0000) 2024-08-19T00:26:08.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:07 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:07.676+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:34.159858+0000 front 2024-08-19T00:25:34.159986+0000 (oldest deadline 2024-08-19T00:25:58.760125+0000) 2024-08-19T00:26:08.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:07 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:07.676+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-08-19T00:25:42.861349+0000 front 2024-08-19T00:25:42.861262+0000 (oldest deadline 2024-08-19T00:26:04.561157+0000) 2024-08-19T00:26:08.342 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:26:08 smithi171 podman[58383]: 2024-08-19 00:26:07.965040138 +0000 UTC m=+0.017177858 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-19T00:26:08.343 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:26:08 smithi171 podman[58383]: 2024-08-19 00:26:08.064428632 +0000 UTC m=+0.116566346 container create 0e2c15b832194742521edf2448bb9b3262c023153b814194864e5fb402433c9b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-de09dd0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-19T00:26:08.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:08 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:08.081+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:26:08.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:08 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:08.081+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:18.052701+0000 front 2024-08-19T00:25:18.052756+0000 (oldest deadline 2024-08-19T00:25:41.552819+0000) 2024-08-19T00:26:08.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:08 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:08.081+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:21.553248+0000 front 2024-08-19T00:25:21.553220+0000 (oldest deadline 2024-08-19T00:25:51.553867+0000) 2024-08-19T00:26:08.344 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:08 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:08.081+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:34.454979+0000 front 2024-08-19T00:25:34.455005+0000 (oldest deadline 2024-08-19T00:25:56.154930+0000) 2024-08-19T00:26:08.344 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:08 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:08.081+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-08-19T00:25:42.055865+0000 front 2024-08-19T00:25:42.055981+0000 (oldest deadline 2024-08-19T00:26:06.155968+0000) 2024-08-19T00:26:08.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:08 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:08.208+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.683396+0000 front 2024-08-19T00:25:02.683292+0000 (oldest deadline 2024-08-19T00:25:27.383313+0000) 2024-08-19T00:26:08.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:08 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:08.208+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:07.383795+0000 front 2024-08-19T00:25:07.383817+0000 (oldest deadline 2024-08-19T00:25:33.283909+0000) 2024-08-19T00:26:08.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:08 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:08.208+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.885585+0000 front 2024-08-19T00:25:17.885614+0000 (oldest deadline 2024-08-19T00:25:41.985680+0000) 2024-08-19T00:26:08.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:08 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:08.208+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:25.987198+0000 front 2024-08-19T00:25:25.987165+0000 (oldest deadline 2024-08-19T00:25:51.287090+0000) 2024-08-19T00:26:08.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:08 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:08.208+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:31.287376+0000 front 2024-08-19T00:25:31.287401+0000 (oldest deadline 2024-08-19T00:25:57.187488+0000) 2024-08-19T00:26:08.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:08 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:08.208+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-08-19T00:25:41.189147+0000 front 2024-08-19T00:25:41.189011+0000 (oldest deadline 2024-08-19T00:26:07.088928+0000) 2024-08-19T00:26:08.838 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:26:08 smithi171 podman[58383]: 2024-08-19 00:26:08.342732027 +0000 UTC m=+0.394869754 container init 0e2c15b832194742521edf2448bb9b3262c023153b814194864e5fb402433c9b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-de09dd0, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-19T00:26:08.838 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:26:08 smithi171 podman[58383]: 2024-08-19 00:26:08.346078132 +0000 UTC m=+0.398215846 container start 0e2c15b832194742521edf2448bb9b3262c023153b814194864e5fb402433c9b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, RELEASE=squid-de09dd0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-08-19T00:26:08.838 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:26:08 smithi171 podman[58383]: 2024-08-19 00:26:08.442552902 +0000 UTC m=+0.494690617 container attach 0e2c15b832194742521edf2448bb9b3262c023153b814194864e5fb402433c9b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-de09dd0, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-08-19T00:26:08.838 INFO:journalctl@ceph.osd.8.smithi171.stdout:Aug 19 00:26:08 smithi171 podman[58383]: 2024-08-19 00:26:08.531831198 +0000 UTC m=+0.583968913 container died 0e2c15b832194742521edf2448bb9b3262c023153b814194864e5fb402433c9b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-8-deactivate, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-de09dd0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-08-19T00:26:09.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:08 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:08.632+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:01.954691+0000 front 2024-08-19T00:25:01.954869+0000 (oldest deadline 2024-08-19T00:25:24.254908+0000) 2024-08-19T00:26:09.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:08 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:08.632+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:10.156120+0000 front 2024-08-19T00:25:10.156097+0000 (oldest deadline 2024-08-19T00:25:36.556729+0000) 2024-08-19T00:26:09.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:08 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:08.632+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.058001+0000 front 2024-08-19T00:25:17.057986+0000 (oldest deadline 2024-08-19T00:25:42.958104+0000) 2024-08-19T00:26:09.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:08 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:08.632+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:22.958529+0000 front 2024-08-19T00:25:22.958516+0000 (oldest deadline 2024-08-19T00:25:48.258674+0000) 2024-08-19T00:26:09.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:08 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:08.632+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:34.159858+0000 front 2024-08-19T00:25:34.159986+0000 (oldest deadline 2024-08-19T00:25:58.760125+0000) 2024-08-19T00:26:09.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:08 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:08.632+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-08-19T00:25:42.861349+0000 front 2024-08-19T00:25:42.861262+0000 (oldest deadline 2024-08-19T00:26:04.561157+0000) 2024-08-19T00:26:09.179 DEBUG:teuthology.orchestra.run.smithi171:> sudo pkill -f 'journalctl -f -n 0 -u ceph-647ded64-5dbe-11ef-bccf-c7b262605968@osd.8.service' 2024-08-19T00:26:09.218 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-19T00:26:09.218 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-08-19T00:26:09.219 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-08-19T00:26:09.219 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-647ded64-5dbe-11ef-bccf-c7b262605968@osd.9 2024-08-19T00:26:09.342 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:09 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:09.086+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:26:09.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:09 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:09.086+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:18.052701+0000 front 2024-08-19T00:25:18.052756+0000 (oldest deadline 2024-08-19T00:25:41.552819+0000) 2024-08-19T00:26:09.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:09 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:09.086+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:21.553248+0000 front 2024-08-19T00:25:21.553220+0000 (oldest deadline 2024-08-19T00:25:51.553867+0000) 2024-08-19T00:26:09.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:09 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:09.086+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:34.454979+0000 front 2024-08-19T00:25:34.455005+0000 (oldest deadline 2024-08-19T00:25:56.154930+0000) 2024-08-19T00:26:09.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:09 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:09.086+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-08-19T00:25:42.055865+0000 front 2024-08-19T00:25:42.055981+0000 (oldest deadline 2024-08-19T00:26:06.155968+0000) 2024-08-19T00:26:09.547 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:09 smithi044 systemd[1]: Stopping Ceph osd.9 for 647ded64-5dbe-11ef-bccf-c7b262605968... 2024-08-19T00:26:09.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:09 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:09.179+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.683396+0000 front 2024-08-19T00:25:02.683292+0000 (oldest deadline 2024-08-19T00:25:27.383313+0000) 2024-08-19T00:26:09.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:09 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:09.179+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:07.383795+0000 front 2024-08-19T00:25:07.383817+0000 (oldest deadline 2024-08-19T00:25:33.283909+0000) 2024-08-19T00:26:09.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:09 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:09.179+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.885585+0000 front 2024-08-19T00:25:17.885614+0000 (oldest deadline 2024-08-19T00:25:41.985680+0000) 2024-08-19T00:26:09.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:09 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:09.179+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:25.987198+0000 front 2024-08-19T00:25:25.987165+0000 (oldest deadline 2024-08-19T00:25:51.287090+0000) 2024-08-19T00:26:09.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:09 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:09.179+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:31.287376+0000 front 2024-08-19T00:25:31.287401+0000 (oldest deadline 2024-08-19T00:25:57.187488+0000) 2024-08-19T00:26:09.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:09 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:09.179+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-08-19T00:25:41.189147+0000 front 2024-08-19T00:25:41.189011+0000 (oldest deadline 2024-08-19T00:26:07.088928+0000) 2024-08-19T00:26:09.869 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:09 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:09.545+0000 7f55a6f8f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-19T00:26:09.870 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:09 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:09.545+0000 7f55a6f8f640 -1 osd.9 109 *** Got signal Terminated *** 2024-08-19T00:26:09.870 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:09 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:09.545+0000 7f55a6f8f640 -1 osd.9 109 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-19T00:26:09.870 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:09 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:09.610+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:01.954691+0000 front 2024-08-19T00:25:01.954869+0000 (oldest deadline 2024-08-19T00:25:24.254908+0000) 2024-08-19T00:26:09.870 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:09 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:09.610+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:10.156120+0000 front 2024-08-19T00:25:10.156097+0000 (oldest deadline 2024-08-19T00:25:36.556729+0000) 2024-08-19T00:26:09.870 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:09 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:09.610+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.058001+0000 front 2024-08-19T00:25:17.057986+0000 (oldest deadline 2024-08-19T00:25:42.958104+0000) 2024-08-19T00:26:09.870 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:09 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:09.610+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:22.958529+0000 front 2024-08-19T00:25:22.958516+0000 (oldest deadline 2024-08-19T00:25:48.258674+0000) 2024-08-19T00:26:09.871 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:09 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:09.610+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:34.159858+0000 front 2024-08-19T00:25:34.159986+0000 (oldest deadline 2024-08-19T00:25:58.760125+0000) 2024-08-19T00:26:09.871 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:09 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:09.610+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-08-19T00:25:42.861349+0000 front 2024-08-19T00:25:42.861262+0000 (oldest deadline 2024-08-19T00:26:04.561157+0000) 2024-08-19T00:26:10.342 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:10 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:10.075+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:26:10.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:10 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:10.075+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:18.052701+0000 front 2024-08-19T00:25:18.052756+0000 (oldest deadline 2024-08-19T00:25:41.552819+0000) 2024-08-19T00:26:10.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:10 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:10.075+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:21.553248+0000 front 2024-08-19T00:25:21.553220+0000 (oldest deadline 2024-08-19T00:25:51.553867+0000) 2024-08-19T00:26:10.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:10 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:10.075+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:34.454979+0000 front 2024-08-19T00:25:34.455005+0000 (oldest deadline 2024-08-19T00:25:56.154930+0000) 2024-08-19T00:26:10.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:10 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:10.075+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-08-19T00:25:42.055865+0000 front 2024-08-19T00:25:42.055981+0000 (oldest deadline 2024-08-19T00:26:06.155968+0000) 2024-08-19T00:26:10.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:10 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:10.186+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.683396+0000 front 2024-08-19T00:25:02.683292+0000 (oldest deadline 2024-08-19T00:25:27.383313+0000) 2024-08-19T00:26:10.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:10 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:10.186+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:07.383795+0000 front 2024-08-19T00:25:07.383817+0000 (oldest deadline 2024-08-19T00:25:33.283909+0000) 2024-08-19T00:26:10.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:10 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:10.186+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.885585+0000 front 2024-08-19T00:25:17.885614+0000 (oldest deadline 2024-08-19T00:25:41.985680+0000) 2024-08-19T00:26:10.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:10 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:10.186+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:25.987198+0000 front 2024-08-19T00:25:25.987165+0000 (oldest deadline 2024-08-19T00:25:51.287090+0000) 2024-08-19T00:26:10.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:10 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:10.186+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:31.287376+0000 front 2024-08-19T00:25:31.287401+0000 (oldest deadline 2024-08-19T00:25:57.187488+0000) 2024-08-19T00:26:10.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:10 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:10.186+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-08-19T00:25:41.189147+0000 front 2024-08-19T00:25:41.189011+0000 (oldest deadline 2024-08-19T00:26:07.088928+0000) 2024-08-19T00:26:10.869 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:10 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:10.568+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:01.954691+0000 front 2024-08-19T00:25:01.954869+0000 (oldest deadline 2024-08-19T00:25:24.254908+0000) 2024-08-19T00:26:10.870 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:10 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:10.568+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:10.156120+0000 front 2024-08-19T00:25:10.156097+0000 (oldest deadline 2024-08-19T00:25:36.556729+0000) 2024-08-19T00:26:10.870 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:10 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:10.568+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.058001+0000 front 2024-08-19T00:25:17.057986+0000 (oldest deadline 2024-08-19T00:25:42.958104+0000) 2024-08-19T00:26:10.870 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:10 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:10.568+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:22.958529+0000 front 2024-08-19T00:25:22.958516+0000 (oldest deadline 2024-08-19T00:25:48.258674+0000) 2024-08-19T00:26:10.870 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:10 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:10.568+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:34.159858+0000 front 2024-08-19T00:25:34.159986+0000 (oldest deadline 2024-08-19T00:25:58.760125+0000) 2024-08-19T00:26:10.870 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:10 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:10.568+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-08-19T00:25:42.861349+0000 front 2024-08-19T00:25:42.861262+0000 (oldest deadline 2024-08-19T00:26:04.561157+0000) 2024-08-19T00:26:11.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:11 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:11.047+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:26:11.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:11 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:11.047+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:18.052701+0000 front 2024-08-19T00:25:18.052756+0000 (oldest deadline 2024-08-19T00:25:41.552819+0000) 2024-08-19T00:26:11.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:11 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:11.047+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:21.553248+0000 front 2024-08-19T00:25:21.553220+0000 (oldest deadline 2024-08-19T00:25:51.553867+0000) 2024-08-19T00:26:11.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:11 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:11.047+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:34.454979+0000 front 2024-08-19T00:25:34.455005+0000 (oldest deadline 2024-08-19T00:25:56.154930+0000) 2024-08-19T00:26:11.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:11 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:11.047+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-08-19T00:25:42.055865+0000 front 2024-08-19T00:25:42.055981+0000 (oldest deadline 2024-08-19T00:26:06.155968+0000) 2024-08-19T00:26:11.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:11 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:11.213+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.683396+0000 front 2024-08-19T00:25:02.683292+0000 (oldest deadline 2024-08-19T00:25:27.383313+0000) 2024-08-19T00:26:11.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:11 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:11.213+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:07.383795+0000 front 2024-08-19T00:25:07.383817+0000 (oldest deadline 2024-08-19T00:25:33.283909+0000) 2024-08-19T00:26:11.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:11 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:11.213+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.885585+0000 front 2024-08-19T00:25:17.885614+0000 (oldest deadline 2024-08-19T00:25:41.985680+0000) 2024-08-19T00:26:11.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:11 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:11.213+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:25.987198+0000 front 2024-08-19T00:25:25.987165+0000 (oldest deadline 2024-08-19T00:25:51.287090+0000) 2024-08-19T00:26:11.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:11 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:11.213+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:31.287376+0000 front 2024-08-19T00:25:31.287401+0000 (oldest deadline 2024-08-19T00:25:57.187488+0000) 2024-08-19T00:26:11.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:11 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:11.213+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-08-19T00:25:41.189147+0000 front 2024-08-19T00:25:41.189011+0000 (oldest deadline 2024-08-19T00:26:07.088928+0000) 2024-08-19T00:26:11.870 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:11 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:11.615+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:01.954691+0000 front 2024-08-19T00:25:01.954869+0000 (oldest deadline 2024-08-19T00:25:24.254908+0000) 2024-08-19T00:26:11.870 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:11 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:11.615+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:10.156120+0000 front 2024-08-19T00:25:10.156097+0000 (oldest deadline 2024-08-19T00:25:36.556729+0000) 2024-08-19T00:26:11.870 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:11 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:11.615+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.058001+0000 front 2024-08-19T00:25:17.057986+0000 (oldest deadline 2024-08-19T00:25:42.958104+0000) 2024-08-19T00:26:11.870 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:11 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:11.615+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:22.958529+0000 front 2024-08-19T00:25:22.958516+0000 (oldest deadline 2024-08-19T00:25:48.258674+0000) 2024-08-19T00:26:11.870 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:11 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:11.615+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:34.159858+0000 front 2024-08-19T00:25:34.159986+0000 (oldest deadline 2024-08-19T00:25:58.760125+0000) 2024-08-19T00:26:11.870 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:11 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:11.615+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-08-19T00:25:42.861349+0000 front 2024-08-19T00:25:42.861262+0000 (oldest deadline 2024-08-19T00:26:04.561157+0000) 2024-08-19T00:26:12.342 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:12 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:12.090+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:26:12.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:12 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:12.090+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:18.052701+0000 front 2024-08-19T00:25:18.052756+0000 (oldest deadline 2024-08-19T00:25:41.552819+0000) 2024-08-19T00:26:12.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:12 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:12.090+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:21.553248+0000 front 2024-08-19T00:25:21.553220+0000 (oldest deadline 2024-08-19T00:25:51.553867+0000) 2024-08-19T00:26:12.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:12 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:12.090+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:34.454979+0000 front 2024-08-19T00:25:34.455005+0000 (oldest deadline 2024-08-19T00:25:56.154930+0000) 2024-08-19T00:26:12.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:12 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:12.090+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-08-19T00:25:42.055865+0000 front 2024-08-19T00:25:42.055981+0000 (oldest deadline 2024-08-19T00:26:06.155968+0000) 2024-08-19T00:26:12.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:12 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:12.090+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-08-19T00:25:46.156377+0000 front 2024-08-19T00:25:46.156431+0000 (oldest deadline 2024-08-19T00:26:11.456383+0000) 2024-08-19T00:26:12.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:12 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:12.216+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.683396+0000 front 2024-08-19T00:25:02.683292+0000 (oldest deadline 2024-08-19T00:25:27.383313+0000) 2024-08-19T00:26:12.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:12 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:12.216+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:07.383795+0000 front 2024-08-19T00:25:07.383817+0000 (oldest deadline 2024-08-19T00:25:33.283909+0000) 2024-08-19T00:26:12.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:12 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:12.216+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.885585+0000 front 2024-08-19T00:25:17.885614+0000 (oldest deadline 2024-08-19T00:25:41.985680+0000) 2024-08-19T00:26:12.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:12 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:12.216+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:25.987198+0000 front 2024-08-19T00:25:25.987165+0000 (oldest deadline 2024-08-19T00:25:51.287090+0000) 2024-08-19T00:26:12.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:12 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:12.216+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:31.287376+0000 front 2024-08-19T00:25:31.287401+0000 (oldest deadline 2024-08-19T00:25:57.187488+0000) 2024-08-19T00:26:12.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:12 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:12.216+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-08-19T00:25:41.189147+0000 front 2024-08-19T00:25:41.189011+0000 (oldest deadline 2024-08-19T00:26:07.088928+0000) 2024-08-19T00:26:13.119 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:12 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:12.619+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:01.954691+0000 front 2024-08-19T00:25:01.954869+0000 (oldest deadline 2024-08-19T00:25:24.254908+0000) 2024-08-19T00:26:13.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:12 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:12.619+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:10.156120+0000 front 2024-08-19T00:25:10.156097+0000 (oldest deadline 2024-08-19T00:25:36.556729+0000) 2024-08-19T00:26:13.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:12 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:12.619+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.058001+0000 front 2024-08-19T00:25:17.057986+0000 (oldest deadline 2024-08-19T00:25:42.958104+0000) 2024-08-19T00:26:13.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:12 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:12.619+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:22.958529+0000 front 2024-08-19T00:25:22.958516+0000 (oldest deadline 2024-08-19T00:25:48.258674+0000) 2024-08-19T00:26:13.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:12 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:12.619+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:34.159858+0000 front 2024-08-19T00:25:34.159986+0000 (oldest deadline 2024-08-19T00:25:58.760125+0000) 2024-08-19T00:26:13.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:12 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:12.619+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-08-19T00:25:42.861349+0000 front 2024-08-19T00:25:42.861262+0000 (oldest deadline 2024-08-19T00:26:04.561157+0000) 2024-08-19T00:26:13.342 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:13 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:13.068+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:26:13.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:13 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:13.068+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:18.052701+0000 front 2024-08-19T00:25:18.052756+0000 (oldest deadline 2024-08-19T00:25:41.552819+0000) 2024-08-19T00:26:13.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:13 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:13.068+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:21.553248+0000 front 2024-08-19T00:25:21.553220+0000 (oldest deadline 2024-08-19T00:25:51.553867+0000) 2024-08-19T00:26:13.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:13 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:13.068+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:34.454979+0000 front 2024-08-19T00:25:34.455005+0000 (oldest deadline 2024-08-19T00:25:56.154930+0000) 2024-08-19T00:26:13.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:13 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:13.068+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-08-19T00:25:42.055865+0000 front 2024-08-19T00:25:42.055981+0000 (oldest deadline 2024-08-19T00:26:06.155968+0000) 2024-08-19T00:26:13.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:13 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:13.068+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-08-19T00:25:46.156377+0000 front 2024-08-19T00:25:46.156431+0000 (oldest deadline 2024-08-19T00:26:11.456383+0000) 2024-08-19T00:26:13.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:13 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:13.209+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.683396+0000 front 2024-08-19T00:25:02.683292+0000 (oldest deadline 2024-08-19T00:25:27.383313+0000) 2024-08-19T00:26:13.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:13 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:13.209+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:07.383795+0000 front 2024-08-19T00:25:07.383817+0000 (oldest deadline 2024-08-19T00:25:33.283909+0000) 2024-08-19T00:26:13.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:13 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:13.209+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.885585+0000 front 2024-08-19T00:25:17.885614+0000 (oldest deadline 2024-08-19T00:25:41.985680+0000) 2024-08-19T00:26:13.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:13 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:13.209+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:25.987198+0000 front 2024-08-19T00:25:25.987165+0000 (oldest deadline 2024-08-19T00:25:51.287090+0000) 2024-08-19T00:26:13.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:13 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:13.209+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:31.287376+0000 front 2024-08-19T00:25:31.287401+0000 (oldest deadline 2024-08-19T00:25:57.187488+0000) 2024-08-19T00:26:13.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:13 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:13.209+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-08-19T00:25:41.189147+0000 front 2024-08-19T00:25:41.189011+0000 (oldest deadline 2024-08-19T00:26:07.088928+0000) 2024-08-19T00:26:13.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:13 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:13.209+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-08-19T00:25:49.390216+0000 front 2024-08-19T00:25:49.390238+0000 (oldest deadline 2024-08-19T00:26:12.290009+0000) 2024-08-19T00:26:14.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:13 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:13.621+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:01.954691+0000 front 2024-08-19T00:25:01.954869+0000 (oldest deadline 2024-08-19T00:25:24.254908+0000) 2024-08-19T00:26:14.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:13 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:13.621+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:10.156120+0000 front 2024-08-19T00:25:10.156097+0000 (oldest deadline 2024-08-19T00:25:36.556729+0000) 2024-08-19T00:26:14.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:13 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:13.621+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.058001+0000 front 2024-08-19T00:25:17.057986+0000 (oldest deadline 2024-08-19T00:25:42.958104+0000) 2024-08-19T00:26:14.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:13 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:13.621+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:22.958529+0000 front 2024-08-19T00:25:22.958516+0000 (oldest deadline 2024-08-19T00:25:48.258674+0000) 2024-08-19T00:26:14.120 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:13 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:13.621+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:34.159858+0000 front 2024-08-19T00:25:34.159986+0000 (oldest deadline 2024-08-19T00:25:58.760125+0000) 2024-08-19T00:26:14.121 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:13 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9[52254]: 2024-08-19T00:26:13.621+0000 7f55a35a5640 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-08-19T00:25:42.861349+0000 front 2024-08-19T00:25:42.861262+0000 (oldest deadline 2024-08-19T00:26:04.561157+0000) 2024-08-19T00:26:14.342 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:14 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:14.052+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:26:14.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:14 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:14.052+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:18.052701+0000 front 2024-08-19T00:25:18.052756+0000 (oldest deadline 2024-08-19T00:25:41.552819+0000) 2024-08-19T00:26:14.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:14 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:14.052+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:21.553248+0000 front 2024-08-19T00:25:21.553220+0000 (oldest deadline 2024-08-19T00:25:51.553867+0000) 2024-08-19T00:26:14.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:14 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:14.052+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:34.454979+0000 front 2024-08-19T00:25:34.455005+0000 (oldest deadline 2024-08-19T00:25:56.154930+0000) 2024-08-19T00:26:14.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:14 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:14.052+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-08-19T00:25:42.055865+0000 front 2024-08-19T00:25:42.055981+0000 (oldest deadline 2024-08-19T00:26:06.155968+0000) 2024-08-19T00:26:14.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:14 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:14.052+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-08-19T00:25:46.156377+0000 front 2024-08-19T00:25:46.156431+0000 (oldest deadline 2024-08-19T00:26:11.456383+0000) 2024-08-19T00:26:14.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:14 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:14.226+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.683396+0000 front 2024-08-19T00:25:02.683292+0000 (oldest deadline 2024-08-19T00:25:27.383313+0000) 2024-08-19T00:26:14.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:14 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:14.226+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:07.383795+0000 front 2024-08-19T00:25:07.383817+0000 (oldest deadline 2024-08-19T00:25:33.283909+0000) 2024-08-19T00:26:14.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:14 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:14.226+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.885585+0000 front 2024-08-19T00:25:17.885614+0000 (oldest deadline 2024-08-19T00:25:41.985680+0000) 2024-08-19T00:26:14.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:14 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:14.226+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:25.987198+0000 front 2024-08-19T00:25:25.987165+0000 (oldest deadline 2024-08-19T00:25:51.287090+0000) 2024-08-19T00:26:14.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:14 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:14.226+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:31.287376+0000 front 2024-08-19T00:25:31.287401+0000 (oldest deadline 2024-08-19T00:25:57.187488+0000) 2024-08-19T00:26:14.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:14 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:14.226+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-08-19T00:25:41.189147+0000 front 2024-08-19T00:25:41.189011+0000 (oldest deadline 2024-08-19T00:26:07.088928+0000) 2024-08-19T00:26:14.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:14 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:14.226+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-08-19T00:25:49.390216+0000 front 2024-08-19T00:25:49.390238+0000 (oldest deadline 2024-08-19T00:26:12.290009+0000) 2024-08-19T00:26:15.342 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:15 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:15.032+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:26:15.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:15 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:15.032+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:18.052701+0000 front 2024-08-19T00:25:18.052756+0000 (oldest deadline 2024-08-19T00:25:41.552819+0000) 2024-08-19T00:26:15.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:15 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:15.032+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:21.553248+0000 front 2024-08-19T00:25:21.553220+0000 (oldest deadline 2024-08-19T00:25:51.553867+0000) 2024-08-19T00:26:15.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:15 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:15.032+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:34.454979+0000 front 2024-08-19T00:25:34.455005+0000 (oldest deadline 2024-08-19T00:25:56.154930+0000) 2024-08-19T00:26:15.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:15 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:15.032+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-08-19T00:25:42.055865+0000 front 2024-08-19T00:25:42.055981+0000 (oldest deadline 2024-08-19T00:26:06.155968+0000) 2024-08-19T00:26:15.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:15 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:15.032+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-08-19T00:25:46.156377+0000 front 2024-08-19T00:25:46.156431+0000 (oldest deadline 2024-08-19T00:26:11.456383+0000) 2024-08-19T00:26:15.369 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:15 smithi044 podman[89431]: 2024-08-19 00:26:15.025610142 +0000 UTC m=+5.602508128 container died b9d3f496c074e25121a277ebd9710de9ab1209dea394e1e3334886c933dbefc4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-de09dd0, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-08-19T00:26:15.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:15 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:15.179+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.683396+0000 front 2024-08-19T00:25:02.683292+0000 (oldest deadline 2024-08-19T00:25:27.383313+0000) 2024-08-19T00:26:15.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:15 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:15.179+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:07.383795+0000 front 2024-08-19T00:25:07.383817+0000 (oldest deadline 2024-08-19T00:25:33.283909+0000) 2024-08-19T00:26:15.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:15 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:15.179+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.885585+0000 front 2024-08-19T00:25:17.885614+0000 (oldest deadline 2024-08-19T00:25:41.985680+0000) 2024-08-19T00:26:15.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:15 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:15.179+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:25.987198+0000 front 2024-08-19T00:25:25.987165+0000 (oldest deadline 2024-08-19T00:25:51.287090+0000) 2024-08-19T00:26:15.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:15 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:15.179+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:31.287376+0000 front 2024-08-19T00:25:31.287401+0000 (oldest deadline 2024-08-19T00:25:57.187488+0000) 2024-08-19T00:26:15.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:15 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:15.179+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-08-19T00:25:41.189147+0000 front 2024-08-19T00:25:41.189011+0000 (oldest deadline 2024-08-19T00:26:07.088928+0000) 2024-08-19T00:26:15.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:15 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:15.179+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-08-19T00:25:49.390216+0000 front 2024-08-19T00:25:49.390238+0000 (oldest deadline 2024-08-19T00:26:12.290009+0000) 2024-08-19T00:26:15.870 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:15 smithi044 podman[89431]: 2024-08-19 00:26:15.437447246 +0000 UTC m=+6.014345265 container cleanup b9d3f496c074e25121a277ebd9710de9ab1209dea394e1e3334886c933dbefc4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-de09dd0, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True) 2024-08-19T00:26:15.870 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:15 smithi044 bash[89431]: ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9 2024-08-19T00:26:15.870 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:15 smithi044 podman[89446]: 2024-08-19 00:26:15.638743488 +0000 UTC m=+0.610221547 container remove b9d3f496c074e25121a277ebd9710de9ab1209dea394e1e3334886c933dbefc4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-de09dd0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-08-19T00:26:16.342 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:15 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:15.990+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:26:16.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:15 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:15.990+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:18.052701+0000 front 2024-08-19T00:25:18.052756+0000 (oldest deadline 2024-08-19T00:25:41.552819+0000) 2024-08-19T00:26:16.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:15 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:15.990+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:21.553248+0000 front 2024-08-19T00:25:21.553220+0000 (oldest deadline 2024-08-19T00:25:51.553867+0000) 2024-08-19T00:26:16.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:15 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:15.990+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:34.454979+0000 front 2024-08-19T00:25:34.455005+0000 (oldest deadline 2024-08-19T00:25:56.154930+0000) 2024-08-19T00:26:16.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:15 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:15.990+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-08-19T00:25:42.055865+0000 front 2024-08-19T00:25:42.055981+0000 (oldest deadline 2024-08-19T00:26:06.155968+0000) 2024-08-19T00:26:16.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:15 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:15.990+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-08-19T00:25:46.156377+0000 front 2024-08-19T00:25:46.156431+0000 (oldest deadline 2024-08-19T00:26:11.456383+0000) 2024-08-19T00:26:16.369 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:16 smithi044 podman[89535]: 2024-08-19 00:26:15.980219872 +0000 UTC m=+0.017415665 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-19T00:26:16.370 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:16 smithi044 podman[89535]: 2024-08-19 00:26:16.081326905 +0000 UTC m=+0.118522725 container create a02eea1b7bd0951923d1b11e659428c5c5b791f3af20f0df965357654c32de16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-de09dd0) 2024-08-19T00:26:16.370 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:16 smithi044 podman[89535]: 2024-08-19 00:26:16.317331051 +0000 UTC m=+0.354526845 container init a02eea1b7bd0951923d1b11e659428c5c5b791f3af20f0df965357654c32de16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9-deactivate, maintainer=Guillaume Abrioux , RELEASE=squid-de09dd0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-08-19T00:26:16.370 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:16 smithi044 podman[89535]: 2024-08-19 00:26:16.320412559 +0000 UTC m=+0.357608336 container start a02eea1b7bd0951923d1b11e659428c5c5b791f3af20f0df965357654c32de16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9-deactivate, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-de09dd0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-08-19T00:26:16.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:16 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:16.226+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.683396+0000 front 2024-08-19T00:25:02.683292+0000 (oldest deadline 2024-08-19T00:25:27.383313+0000) 2024-08-19T00:26:16.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:16 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:16.226+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:07.383795+0000 front 2024-08-19T00:25:07.383817+0000 (oldest deadline 2024-08-19T00:25:33.283909+0000) 2024-08-19T00:26:16.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:16 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:16.226+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.885585+0000 front 2024-08-19T00:25:17.885614+0000 (oldest deadline 2024-08-19T00:25:41.985680+0000) 2024-08-19T00:26:16.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:16 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:16.226+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:25.987198+0000 front 2024-08-19T00:25:25.987165+0000 (oldest deadline 2024-08-19T00:25:51.287090+0000) 2024-08-19T00:26:16.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:16 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:16.226+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:31.287376+0000 front 2024-08-19T00:25:31.287401+0000 (oldest deadline 2024-08-19T00:25:57.187488+0000) 2024-08-19T00:26:16.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:16 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:16.226+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-08-19T00:25:41.189147+0000 front 2024-08-19T00:25:41.189011+0000 (oldest deadline 2024-08-19T00:26:07.088928+0000) 2024-08-19T00:26:16.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:16 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:16.226+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-08-19T00:25:49.390216+0000 front 2024-08-19T00:25:49.390238+0000 (oldest deadline 2024-08-19T00:26:12.290009+0000) 2024-08-19T00:26:16.822 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:16 smithi044 podman[89535]: 2024-08-19 00:26:16.400426624 +0000 UTC m=+0.437622403 container attach a02eea1b7bd0951923d1b11e659428c5c5b791f3af20f0df965357654c32de16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9-deactivate, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-de09dd0, io.buildah.version=1.36.0) 2024-08-19T00:26:16.822 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:16 smithi044 podman[89535]: 2024-08-19 00:26:16.51021489 +0000 UTC m=+0.547410665 container died a02eea1b7bd0951923d1b11e659428c5c5b791f3af20f0df965357654c32de16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, RELEASE=squid-de09dd0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-08-19T00:26:17.082 INFO:journalctl@ceph.osd.9.smithi044.stdout:Aug 19 00:26:17 smithi044 podman[89558]: 2024-08-19 00:26:17.063557057 +0000 UTC m=+0.541615584 container remove a02eea1b7bd0951923d1b11e659428c5c5b791f3af20f0df965357654c32de16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-9-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-de09dd0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True) 2024-08-19T00:26:17.088 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-647ded64-5dbe-11ef-bccf-c7b262605968@osd.9.service' 2024-08-19T00:26:17.126 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-19T00:26:17.126 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-08-19T00:26:17.127 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-08-19T00:26:17.127 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-647ded64-5dbe-11ef-bccf-c7b262605968@osd.10 2024-08-19T00:26:17.342 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:16 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:16.968+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:26:17.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:16 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:16.968+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:18.052701+0000 front 2024-08-19T00:25:18.052756+0000 (oldest deadline 2024-08-19T00:25:41.552819+0000) 2024-08-19T00:26:17.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:16 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:16.968+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:21.553248+0000 front 2024-08-19T00:25:21.553220+0000 (oldest deadline 2024-08-19T00:25:51.553867+0000) 2024-08-19T00:26:17.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:16 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:16.968+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:34.454979+0000 front 2024-08-19T00:25:34.455005+0000 (oldest deadline 2024-08-19T00:25:56.154930+0000) 2024-08-19T00:26:17.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:16 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:16.968+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-08-19T00:25:42.055865+0000 front 2024-08-19T00:25:42.055981+0000 (oldest deadline 2024-08-19T00:26:06.155968+0000) 2024-08-19T00:26:17.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:16 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:16.968+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-08-19T00:25:46.156377+0000 front 2024-08-19T00:25:46.156431+0000 (oldest deadline 2024-08-19T00:26:11.456383+0000) 2024-08-19T00:26:17.451 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:17 smithi116 systemd[1]: Stopping Ceph osd.10 for 647ded64-5dbe-11ef-bccf-c7b262605968... 2024-08-19T00:26:17.451 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:17 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:17.187+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.683396+0000 front 2024-08-19T00:25:02.683292+0000 (oldest deadline 2024-08-19T00:25:27.383313+0000) 2024-08-19T00:26:17.451 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:17 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:17.187+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:07.383795+0000 front 2024-08-19T00:25:07.383817+0000 (oldest deadline 2024-08-19T00:25:33.283909+0000) 2024-08-19T00:26:17.451 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:17 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:17.187+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.885585+0000 front 2024-08-19T00:25:17.885614+0000 (oldest deadline 2024-08-19T00:25:41.985680+0000) 2024-08-19T00:26:17.451 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:17 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:17.187+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:25.987198+0000 front 2024-08-19T00:25:25.987165+0000 (oldest deadline 2024-08-19T00:25:51.287090+0000) 2024-08-19T00:26:17.451 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:17 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:17.187+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:31.287376+0000 front 2024-08-19T00:25:31.287401+0000 (oldest deadline 2024-08-19T00:25:57.187488+0000) 2024-08-19T00:26:17.451 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:17 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:17.187+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-08-19T00:25:41.189147+0000 front 2024-08-19T00:25:41.189011+0000 (oldest deadline 2024-08-19T00:26:07.088928+0000) 2024-08-19T00:26:17.452 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:17 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:17.187+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-08-19T00:25:49.390216+0000 front 2024-08-19T00:25:49.390238+0000 (oldest deadline 2024-08-19T00:26:12.290009+0000) 2024-08-19T00:26:17.452 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:17 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:17.449+0000 7f483b2e9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-19T00:26:17.452 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:17 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:17.449+0000 7f483b2e9640 -1 osd.10 109 *** Got signal Terminated *** 2024-08-19T00:26:17.452 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:17 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:17.449+0000 7f483b2e9640 -1 osd.10 109 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-19T00:26:18.342 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:17 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:17.967+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:26:18.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:17 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:17.967+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:18.052701+0000 front 2024-08-19T00:25:18.052756+0000 (oldest deadline 2024-08-19T00:25:41.552819+0000) 2024-08-19T00:26:18.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:17 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:17.967+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:21.553248+0000 front 2024-08-19T00:25:21.553220+0000 (oldest deadline 2024-08-19T00:25:51.553867+0000) 2024-08-19T00:26:18.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:17 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:17.967+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:34.454979+0000 front 2024-08-19T00:25:34.455005+0000 (oldest deadline 2024-08-19T00:25:56.154930+0000) 2024-08-19T00:26:18.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:17 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:17.967+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-08-19T00:25:42.055865+0000 front 2024-08-19T00:25:42.055981+0000 (oldest deadline 2024-08-19T00:26:06.155968+0000) 2024-08-19T00:26:18.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:17 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:17.967+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-08-19T00:25:46.156377+0000 front 2024-08-19T00:25:46.156431+0000 (oldest deadline 2024-08-19T00:26:11.456383+0000) 2024-08-19T00:26:18.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:18 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:18.206+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.683396+0000 front 2024-08-19T00:25:02.683292+0000 (oldest deadline 2024-08-19T00:25:27.383313+0000) 2024-08-19T00:26:18.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:18 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:18.206+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:07.383795+0000 front 2024-08-19T00:25:07.383817+0000 (oldest deadline 2024-08-19T00:25:33.283909+0000) 2024-08-19T00:26:18.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:18 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:18.206+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.885585+0000 front 2024-08-19T00:25:17.885614+0000 (oldest deadline 2024-08-19T00:25:41.985680+0000) 2024-08-19T00:26:18.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:18 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:18.206+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:25.987198+0000 front 2024-08-19T00:25:25.987165+0000 (oldest deadline 2024-08-19T00:25:51.287090+0000) 2024-08-19T00:26:18.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:18 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:18.206+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:31.287376+0000 front 2024-08-19T00:25:31.287401+0000 (oldest deadline 2024-08-19T00:25:57.187488+0000) 2024-08-19T00:26:18.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:18 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:18.206+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-08-19T00:25:41.189147+0000 front 2024-08-19T00:25:41.189011+0000 (oldest deadline 2024-08-19T00:26:07.088928+0000) 2024-08-19T00:26:18.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:18 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:18.206+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-08-19T00:25:49.390216+0000 front 2024-08-19T00:25:49.390238+0000 (oldest deadline 2024-08-19T00:26:12.290009+0000) 2024-08-19T00:26:19.342 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:18 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:18.974+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:26:19.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:18 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:18.974+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:18.052701+0000 front 2024-08-19T00:25:18.052756+0000 (oldest deadline 2024-08-19T00:25:41.552819+0000) 2024-08-19T00:26:19.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:18 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:18.974+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:21.553248+0000 front 2024-08-19T00:25:21.553220+0000 (oldest deadline 2024-08-19T00:25:51.553867+0000) 2024-08-19T00:26:19.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:18 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:18.974+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:34.454979+0000 front 2024-08-19T00:25:34.455005+0000 (oldest deadline 2024-08-19T00:25:56.154930+0000) 2024-08-19T00:26:19.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:18 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:18.974+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-08-19T00:25:42.055865+0000 front 2024-08-19T00:25:42.055981+0000 (oldest deadline 2024-08-19T00:26:06.155968+0000) 2024-08-19T00:26:19.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:18 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:18.974+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-08-19T00:25:46.156377+0000 front 2024-08-19T00:25:46.156431+0000 (oldest deadline 2024-08-19T00:26:11.456383+0000) 2024-08-19T00:26:19.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:19 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:19.181+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.683396+0000 front 2024-08-19T00:25:02.683292+0000 (oldest deadline 2024-08-19T00:25:27.383313+0000) 2024-08-19T00:26:19.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:19 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:19.181+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:07.383795+0000 front 2024-08-19T00:25:07.383817+0000 (oldest deadline 2024-08-19T00:25:33.283909+0000) 2024-08-19T00:26:19.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:19 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:19.181+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.885585+0000 front 2024-08-19T00:25:17.885614+0000 (oldest deadline 2024-08-19T00:25:41.985680+0000) 2024-08-19T00:26:19.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:19 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:19.181+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:25.987198+0000 front 2024-08-19T00:25:25.987165+0000 (oldest deadline 2024-08-19T00:25:51.287090+0000) 2024-08-19T00:26:19.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:19 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:19.181+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:31.287376+0000 front 2024-08-19T00:25:31.287401+0000 (oldest deadline 2024-08-19T00:25:57.187488+0000) 2024-08-19T00:26:19.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:19 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:19.181+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-08-19T00:25:41.189147+0000 front 2024-08-19T00:25:41.189011+0000 (oldest deadline 2024-08-19T00:26:07.088928+0000) 2024-08-19T00:26:19.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:19 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:19.181+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-08-19T00:25:49.390216+0000 front 2024-08-19T00:25:49.390238+0000 (oldest deadline 2024-08-19T00:26:12.290009+0000) 2024-08-19T00:26:20.342 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:19 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:19.977+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:26:20.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:19 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:19.977+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:18.052701+0000 front 2024-08-19T00:25:18.052756+0000 (oldest deadline 2024-08-19T00:25:41.552819+0000) 2024-08-19T00:26:20.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:19 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:19.977+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:21.553248+0000 front 2024-08-19T00:25:21.553220+0000 (oldest deadline 2024-08-19T00:25:51.553867+0000) 2024-08-19T00:26:20.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:19 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:19.977+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:34.454979+0000 front 2024-08-19T00:25:34.455005+0000 (oldest deadline 2024-08-19T00:25:56.154930+0000) 2024-08-19T00:26:20.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:19 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:19.977+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-08-19T00:25:42.055865+0000 front 2024-08-19T00:25:42.055981+0000 (oldest deadline 2024-08-19T00:26:06.155968+0000) 2024-08-19T00:26:20.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:19 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:19.977+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-08-19T00:25:46.156377+0000 front 2024-08-19T00:25:46.156431+0000 (oldest deadline 2024-08-19T00:26:11.456383+0000) 2024-08-19T00:26:20.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:20 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:20.225+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.683396+0000 front 2024-08-19T00:25:02.683292+0000 (oldest deadline 2024-08-19T00:25:27.383313+0000) 2024-08-19T00:26:20.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:20 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:20.225+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:07.383795+0000 front 2024-08-19T00:25:07.383817+0000 (oldest deadline 2024-08-19T00:25:33.283909+0000) 2024-08-19T00:26:20.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:20 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:20.225+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.885585+0000 front 2024-08-19T00:25:17.885614+0000 (oldest deadline 2024-08-19T00:25:41.985680+0000) 2024-08-19T00:26:20.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:20 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:20.225+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:25.987198+0000 front 2024-08-19T00:25:25.987165+0000 (oldest deadline 2024-08-19T00:25:51.287090+0000) 2024-08-19T00:26:20.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:20 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:20.225+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:31.287376+0000 front 2024-08-19T00:25:31.287401+0000 (oldest deadline 2024-08-19T00:25:57.187488+0000) 2024-08-19T00:26:20.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:20 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:20.225+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-08-19T00:25:41.189147+0000 front 2024-08-19T00:25:41.189011+0000 (oldest deadline 2024-08-19T00:26:07.088928+0000) 2024-08-19T00:26:20.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:20 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:20.225+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-08-19T00:25:49.390216+0000 front 2024-08-19T00:25:49.390238+0000 (oldest deadline 2024-08-19T00:26:12.290009+0000) 2024-08-19T00:26:21.342 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:20 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:20.960+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:26:21.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:20 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:20.960+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:18.052701+0000 front 2024-08-19T00:25:18.052756+0000 (oldest deadline 2024-08-19T00:25:41.552819+0000) 2024-08-19T00:26:21.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:20 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:20.960+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:21.553248+0000 front 2024-08-19T00:25:21.553220+0000 (oldest deadline 2024-08-19T00:25:51.553867+0000) 2024-08-19T00:26:21.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:20 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:20.960+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:34.454979+0000 front 2024-08-19T00:25:34.455005+0000 (oldest deadline 2024-08-19T00:25:56.154930+0000) 2024-08-19T00:26:21.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:20 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:20.960+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-08-19T00:25:42.055865+0000 front 2024-08-19T00:25:42.055981+0000 (oldest deadline 2024-08-19T00:26:06.155968+0000) 2024-08-19T00:26:21.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:20 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:20.960+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-08-19T00:25:46.156377+0000 front 2024-08-19T00:25:46.156431+0000 (oldest deadline 2024-08-19T00:26:11.456383+0000) 2024-08-19T00:26:21.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:21 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:21.221+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.683396+0000 front 2024-08-19T00:25:02.683292+0000 (oldest deadline 2024-08-19T00:25:27.383313+0000) 2024-08-19T00:26:21.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:21 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:21.221+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:07.383795+0000 front 2024-08-19T00:25:07.383817+0000 (oldest deadline 2024-08-19T00:25:33.283909+0000) 2024-08-19T00:26:21.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:21 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:21.221+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.885585+0000 front 2024-08-19T00:25:17.885614+0000 (oldest deadline 2024-08-19T00:25:41.985680+0000) 2024-08-19T00:26:21.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:21 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:21.221+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:25.987198+0000 front 2024-08-19T00:25:25.987165+0000 (oldest deadline 2024-08-19T00:25:51.287090+0000) 2024-08-19T00:26:21.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:21 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:21.221+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:31.287376+0000 front 2024-08-19T00:25:31.287401+0000 (oldest deadline 2024-08-19T00:25:57.187488+0000) 2024-08-19T00:26:21.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:21 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:21.221+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-08-19T00:25:41.189147+0000 front 2024-08-19T00:25:41.189011+0000 (oldest deadline 2024-08-19T00:26:07.088928+0000) 2024-08-19T00:26:21.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:21 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:21.221+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-08-19T00:25:49.390216+0000 front 2024-08-19T00:25:49.390238+0000 (oldest deadline 2024-08-19T00:26:12.290009+0000) 2024-08-19T00:26:22.342 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:21 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:21.920+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:26:22.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:21 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:21.920+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:18.052701+0000 front 2024-08-19T00:25:18.052756+0000 (oldest deadline 2024-08-19T00:25:41.552819+0000) 2024-08-19T00:26:22.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:21 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:21.920+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:21.553248+0000 front 2024-08-19T00:25:21.553220+0000 (oldest deadline 2024-08-19T00:25:51.553867+0000) 2024-08-19T00:26:22.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:21 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:21.920+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:34.454979+0000 front 2024-08-19T00:25:34.455005+0000 (oldest deadline 2024-08-19T00:25:56.154930+0000) 2024-08-19T00:26:22.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:21 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:21.920+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-08-19T00:25:42.055865+0000 front 2024-08-19T00:25:42.055981+0000 (oldest deadline 2024-08-19T00:26:06.155968+0000) 2024-08-19T00:26:22.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:21 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:21.920+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-08-19T00:25:46.156377+0000 front 2024-08-19T00:25:46.156431+0000 (oldest deadline 2024-08-19T00:26:11.456383+0000) 2024-08-19T00:26:22.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:22 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:22.181+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.683396+0000 front 2024-08-19T00:25:02.683292+0000 (oldest deadline 2024-08-19T00:25:27.383313+0000) 2024-08-19T00:26:22.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:22 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:22.181+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6804 osd.1 since back 2024-08-19T00:25:07.383795+0000 front 2024-08-19T00:25:07.383817+0000 (oldest deadline 2024-08-19T00:25:33.283909+0000) 2024-08-19T00:26:22.616 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:22 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:22.181+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:17.885585+0000 front 2024-08-19T00:25:17.885614+0000 (oldest deadline 2024-08-19T00:25:41.985680+0000) 2024-08-19T00:26:22.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:22 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:22.181+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:25.987198+0000 front 2024-08-19T00:25:25.987165+0000 (oldest deadline 2024-08-19T00:25:51.287090+0000) 2024-08-19T00:26:22.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:22 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:22.181+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:31.287376+0000 front 2024-08-19T00:25:31.287401+0000 (oldest deadline 2024-08-19T00:25:57.187488+0000) 2024-08-19T00:26:22.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:22 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:22.181+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-08-19T00:25:41.189147+0000 front 2024-08-19T00:25:41.189011+0000 (oldest deadline 2024-08-19T00:26:07.088928+0000) 2024-08-19T00:26:22.617 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:22 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10[46070]: 2024-08-19T00:26:22.181+0000 7f48338f7640 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-08-19T00:25:49.390216+0000 front 2024-08-19T00:25:49.390238+0000 (oldest deadline 2024-08-19T00:26:12.290009+0000) 2024-08-19T00:26:23.201 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:22 smithi116 podman[57940]: 2024-08-19 00:26:22.944210293 +0000 UTC m=+5.625819588 container died 6528b456b8a3e8a283ef9a43ae403857e0771d816e072bbd7709f664356f0b4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-de09dd0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-08-19T00:26:23.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:22 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:22.950+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:26:23.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:22 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:22.950+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:18.052701+0000 front 2024-08-19T00:25:18.052756+0000 (oldest deadline 2024-08-19T00:25:41.552819+0000) 2024-08-19T00:26:23.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:22 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:22.950+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:21.553248+0000 front 2024-08-19T00:25:21.553220+0000 (oldest deadline 2024-08-19T00:25:51.553867+0000) 2024-08-19T00:26:23.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:22 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:22.950+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:34.454979+0000 front 2024-08-19T00:25:34.455005+0000 (oldest deadline 2024-08-19T00:25:56.154930+0000) 2024-08-19T00:26:23.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:22 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:22.950+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-08-19T00:25:42.055865+0000 front 2024-08-19T00:25:42.055981+0000 (oldest deadline 2024-08-19T00:26:06.155968+0000) 2024-08-19T00:26:23.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:22 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:22.950+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-08-19T00:25:46.156377+0000 front 2024-08-19T00:25:46.156431+0000 (oldest deadline 2024-08-19T00:26:11.456383+0000) 2024-08-19T00:26:23.344 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:22 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:22.950+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.116:6820 osd.7 since back 2024-08-19T00:25:58.458130+0000 front 2024-08-19T00:25:58.458113+0000 (oldest deadline 2024-08-19T00:26:22.558078+0000) 2024-08-19T00:26:23.559 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:23 smithi116 podman[57940]: 2024-08-19 00:26:23.307224573 +0000 UTC m=+5.988833867 container cleanup 6528b456b8a3e8a283ef9a43ae403857e0771d816e072bbd7709f664356f0b4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-de09dd0, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2) 2024-08-19T00:26:23.560 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:23 smithi116 bash[57940]: ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10 2024-08-19T00:26:23.866 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:23 smithi116 podman[57955]: 2024-08-19 00:26:23.558633643 +0000 UTC m=+0.602249486 container remove 6528b456b8a3e8a283ef9a43ae403857e0771d816e072bbd7709f664356f0b4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10, org.label-schema.vendor=CentOS, RELEASE=squid-de09dd0, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-08-19T00:26:24.196 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:23 smithi116 podman[58042]: 2024-08-19 00:26:23.892663906 +0000 UTC m=+0.111927592 container create 2664207874d49330f32461b0cc0b3b80abbe06a9f1687db85a03a730a55b5f46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10-deactivate, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-de09dd0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-08-19T00:26:24.196 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:23 smithi116 podman[58042]: 2024-08-19 00:26:23.797475877 +0000 UTC m=+0.016739578 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-19T00:26:24.196 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:24 smithi116 podman[58042]: 2024-08-19 00:26:24.120230293 +0000 UTC m=+0.339493988 container init 2664207874d49330f32461b0cc0b3b80abbe06a9f1687db85a03a730a55b5f46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-de09dd0, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-08-19T00:26:24.196 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:24 smithi116 podman[58042]: 2024-08-19 00:26:24.124021872 +0000 UTC m=+0.343285561 container start 2664207874d49330f32461b0cc0b3b80abbe06a9f1687db85a03a730a55b5f46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-de09dd0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-08-19T00:26:24.196 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:24 smithi116 podman[58042]: 2024-08-19 00:26:24.195016509 +0000 UTC m=+0.414280206 container attach 2664207874d49330f32461b0cc0b3b80abbe06a9f1687db85a03a730a55b5f46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10-deactivate, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=squid-de09dd0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True) 2024-08-19T00:26:24.342 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:23 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:23.942+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:26:24.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:23 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:23.942+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:18.052701+0000 front 2024-08-19T00:25:18.052756+0000 (oldest deadline 2024-08-19T00:25:41.552819+0000) 2024-08-19T00:26:24.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:23 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:23.942+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:21.553248+0000 front 2024-08-19T00:25:21.553220+0000 (oldest deadline 2024-08-19T00:25:51.553867+0000) 2024-08-19T00:26:24.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:23 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:23.942+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:34.454979+0000 front 2024-08-19T00:25:34.455005+0000 (oldest deadline 2024-08-19T00:25:56.154930+0000) 2024-08-19T00:26:24.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:23 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:23.942+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-08-19T00:25:42.055865+0000 front 2024-08-19T00:25:42.055981+0000 (oldest deadline 2024-08-19T00:26:06.155968+0000) 2024-08-19T00:26:24.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:23 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:23.942+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-08-19T00:25:46.156377+0000 front 2024-08-19T00:25:46.156431+0000 (oldest deadline 2024-08-19T00:26:11.456383+0000) 2024-08-19T00:26:24.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:23 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:23.942+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.116:6820 osd.7 since back 2024-08-19T00:25:58.458130+0000 front 2024-08-19T00:25:58.458113+0000 (oldest deadline 2024-08-19T00:26:22.558078+0000) 2024-08-19T00:26:24.598 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:24 smithi116 podman[58042]: 2024-08-19 00:26:24.313881509 +0000 UTC m=+0.533145201 container died 2664207874d49330f32461b0cc0b3b80abbe06a9f1687db85a03a730a55b5f46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-de09dd0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS) 2024-08-19T00:26:24.856 INFO:journalctl@ceph.osd.10.smithi116.stdout:Aug 19 00:26:24 smithi116 podman[58065]: 2024-08-19 00:26:24.839851728 +0000 UTC m=+0.520233320 container remove 2664207874d49330f32461b0cc0b3b80abbe06a9f1687db85a03a730a55b5f46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-10-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=squid-de09dd0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0) 2024-08-19T00:26:24.862 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-647ded64-5dbe-11ef-bccf-c7b262605968@osd.10.service' 2024-08-19T00:26:24.900 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-19T00:26:24.900 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-08-19T00:26:24.900 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-08-19T00:26:24.900 DEBUG:teuthology.orchestra.run.smithi171:> sudo systemctl stop ceph-647ded64-5dbe-11ef-bccf-c7b262605968@osd.11 2024-08-19T00:26:25.233 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:24 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:24.957+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:26:25.234 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:24 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:24.957+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:18.052701+0000 front 2024-08-19T00:25:18.052756+0000 (oldest deadline 2024-08-19T00:25:41.552819+0000) 2024-08-19T00:26:25.234 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:24 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:24.957+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:21.553248+0000 front 2024-08-19T00:25:21.553220+0000 (oldest deadline 2024-08-19T00:25:51.553867+0000) 2024-08-19T00:26:25.234 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:24 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:24.957+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:34.454979+0000 front 2024-08-19T00:25:34.455005+0000 (oldest deadline 2024-08-19T00:25:56.154930+0000) 2024-08-19T00:26:25.234 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:24 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:24.957+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-08-19T00:25:42.055865+0000 front 2024-08-19T00:25:42.055981+0000 (oldest deadline 2024-08-19T00:26:06.155968+0000) 2024-08-19T00:26:25.234 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:24 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:24.957+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-08-19T00:25:46.156377+0000 front 2024-08-19T00:25:46.156431+0000 (oldest deadline 2024-08-19T00:26:11.456383+0000) 2024-08-19T00:26:25.234 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:24 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:24.957+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.116:6820 osd.7 since back 2024-08-19T00:25:58.458130+0000 front 2024-08-19T00:25:58.458113+0000 (oldest deadline 2024-08-19T00:26:22.558078+0000) 2024-08-19T00:26:25.234 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:24 smithi171 systemd[1]: Stopping Ceph osd.11 for 647ded64-5dbe-11ef-bccf-c7b262605968... 2024-08-19T00:26:25.235 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:25 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:25.231+0000 7fdcb5faa640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-19T00:26:25.235 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:25 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:25.231+0000 7fdcb5faa640 -1 osd.11 109 *** Got signal Terminated *** 2024-08-19T00:26:25.235 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:25 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:25.231+0000 7fdcb5faa640 -1 osd.11 109 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-19T00:26:26.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:25 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:25.937+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:26:26.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:25 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:25.937+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:18.052701+0000 front 2024-08-19T00:25:18.052756+0000 (oldest deadline 2024-08-19T00:25:41.552819+0000) 2024-08-19T00:26:26.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:25 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:25.937+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:21.553248+0000 front 2024-08-19T00:25:21.553220+0000 (oldest deadline 2024-08-19T00:25:51.553867+0000) 2024-08-19T00:26:26.344 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:25 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:25.937+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:34.454979+0000 front 2024-08-19T00:25:34.455005+0000 (oldest deadline 2024-08-19T00:25:56.154930+0000) 2024-08-19T00:26:26.344 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:25 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:25.937+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-08-19T00:25:42.055865+0000 front 2024-08-19T00:25:42.055981+0000 (oldest deadline 2024-08-19T00:26:06.155968+0000) 2024-08-19T00:26:26.344 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:25 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:25.937+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-08-19T00:25:46.156377+0000 front 2024-08-19T00:25:46.156431+0000 (oldest deadline 2024-08-19T00:26:11.456383+0000) 2024-08-19T00:26:26.344 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:25 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:25.937+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.116:6820 osd.7 since back 2024-08-19T00:25:58.458130+0000 front 2024-08-19T00:25:58.458113+0000 (oldest deadline 2024-08-19T00:26:22.558078+0000) 2024-08-19T00:26:27.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:26 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:26.906+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:26:27.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:26 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:26.906+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:18.052701+0000 front 2024-08-19T00:25:18.052756+0000 (oldest deadline 2024-08-19T00:25:41.552819+0000) 2024-08-19T00:26:27.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:26 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:26.906+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:21.553248+0000 front 2024-08-19T00:25:21.553220+0000 (oldest deadline 2024-08-19T00:25:51.553867+0000) 2024-08-19T00:26:27.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:26 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:26.906+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:34.454979+0000 front 2024-08-19T00:25:34.455005+0000 (oldest deadline 2024-08-19T00:25:56.154930+0000) 2024-08-19T00:26:27.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:26 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:26.906+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-08-19T00:25:42.055865+0000 front 2024-08-19T00:25:42.055981+0000 (oldest deadline 2024-08-19T00:26:06.155968+0000) 2024-08-19T00:26:27.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:26 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:26.906+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-08-19T00:25:46.156377+0000 front 2024-08-19T00:25:46.156431+0000 (oldest deadline 2024-08-19T00:26:11.456383+0000) 2024-08-19T00:26:27.344 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:26 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:26.906+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.116:6820 osd.7 since back 2024-08-19T00:25:58.458130+0000 front 2024-08-19T00:25:58.458113+0000 (oldest deadline 2024-08-19T00:26:22.558078+0000) 2024-08-19T00:26:28.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:27 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:27.900+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:26:28.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:27 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:27.900+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:18.052701+0000 front 2024-08-19T00:25:18.052756+0000 (oldest deadline 2024-08-19T00:25:41.552819+0000) 2024-08-19T00:26:28.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:27 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:27.900+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:21.553248+0000 front 2024-08-19T00:25:21.553220+0000 (oldest deadline 2024-08-19T00:25:51.553867+0000) 2024-08-19T00:26:28.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:27 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:27.900+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:34.454979+0000 front 2024-08-19T00:25:34.455005+0000 (oldest deadline 2024-08-19T00:25:56.154930+0000) 2024-08-19T00:26:28.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:27 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:27.900+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-08-19T00:25:42.055865+0000 front 2024-08-19T00:25:42.055981+0000 (oldest deadline 2024-08-19T00:26:06.155968+0000) 2024-08-19T00:26:28.344 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:27 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:27.900+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-08-19T00:25:46.156377+0000 front 2024-08-19T00:25:46.156431+0000 (oldest deadline 2024-08-19T00:26:11.456383+0000) 2024-08-19T00:26:28.344 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:27 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:27.900+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.116:6820 osd.7 since back 2024-08-19T00:25:58.458130+0000 front 2024-08-19T00:25:58.458113+0000 (oldest deadline 2024-08-19T00:26:22.558078+0000) 2024-08-19T00:26:29.342 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:28 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:28.875+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:26:29.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:28 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:28.875+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:18.052701+0000 front 2024-08-19T00:25:18.052756+0000 (oldest deadline 2024-08-19T00:25:41.552819+0000) 2024-08-19T00:26:29.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:28 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:28.875+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:21.553248+0000 front 2024-08-19T00:25:21.553220+0000 (oldest deadline 2024-08-19T00:25:51.553867+0000) 2024-08-19T00:26:29.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:28 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:28.875+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:34.454979+0000 front 2024-08-19T00:25:34.455005+0000 (oldest deadline 2024-08-19T00:25:56.154930+0000) 2024-08-19T00:26:29.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:28 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:28.875+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-08-19T00:25:42.055865+0000 front 2024-08-19T00:25:42.055981+0000 (oldest deadline 2024-08-19T00:26:06.155968+0000) 2024-08-19T00:26:29.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:28 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:28.875+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-08-19T00:25:46.156377+0000 front 2024-08-19T00:25:46.156431+0000 (oldest deadline 2024-08-19T00:26:11.456383+0000) 2024-08-19T00:26:29.344 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:28 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:28.875+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.116:6820 osd.7 since back 2024-08-19T00:25:58.458130+0000 front 2024-08-19T00:25:58.458113+0000 (oldest deadline 2024-08-19T00:26:22.558078+0000) 2024-08-19T00:26:29.344 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:28 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:28.875+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6820 osd.8 since back 2024-08-19T00:26:06.659024+0000 front 2024-08-19T00:26:06.659062+0000 (oldest deadline 2024-08-19T00:26:28.359012+0000) 2024-08-19T00:26:30.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:29 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:29.888+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-08-19T00:25:02.950468+0000 front 2024-08-19T00:25:02.950356+0000 (oldest deadline 2024-08-19T00:25:25.250450+0000) 2024-08-19T00:26:30.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:29 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:29.888+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-08-19T00:25:18.052701+0000 front 2024-08-19T00:25:18.052756+0000 (oldest deadline 2024-08-19T00:25:41.552819+0000) 2024-08-19T00:26:30.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:29 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:29.888+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-08-19T00:25:21.553248+0000 front 2024-08-19T00:25:21.553220+0000 (oldest deadline 2024-08-19T00:25:51.553867+0000) 2024-08-19T00:26:30.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:29 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:29.888+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.116:6812 osd.4 since back 2024-08-19T00:25:34.454979+0000 front 2024-08-19T00:25:34.455005+0000 (oldest deadline 2024-08-19T00:25:56.154930+0000) 2024-08-19T00:26:30.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:29 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:29.888+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-08-19T00:25:42.055865+0000 front 2024-08-19T00:25:42.055981+0000 (oldest deadline 2024-08-19T00:26:06.155968+0000) 2024-08-19T00:26:30.344 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:29 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:29.888+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-08-19T00:25:46.156377+0000 front 2024-08-19T00:25:46.156431+0000 (oldest deadline 2024-08-19T00:26:11.456383+0000) 2024-08-19T00:26:30.344 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:29 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:29.888+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.116:6820 osd.7 since back 2024-08-19T00:25:58.458130+0000 front 2024-08-19T00:25:58.458113+0000 (oldest deadline 2024-08-19T00:26:22.558078+0000) 2024-08-19T00:26:30.344 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:29 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11[46374]: 2024-08-19T00:26:29.888+0000 7fdcae5b8640 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.171:6820 osd.8 since back 2024-08-19T00:26:06.659024+0000 front 2024-08-19T00:26:06.659062+0000 (oldest deadline 2024-08-19T00:26:28.359012+0000) 2024-08-19T00:26:31.042 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:30 smithi171 podman[58484]: 2024-08-19 00:26:30.784773966 +0000 UTC m=+5.674880509 container died 80a64a354eea27374d0044c12ddf05ba210e33b2b59e2ebe43ce4c621cb9d9eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-de09dd0, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-19T00:26:31.333 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:31 smithi171 podman[58484]: 2024-08-19 00:26:31.131290385 +0000 UTC m=+6.021396927 container cleanup 80a64a354eea27374d0044c12ddf05ba210e33b2b59e2ebe43ce4c621cb9d9eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-de09dd0, io.buildah.version=1.36.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-08-19T00:26:31.334 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:31 smithi171 bash[58484]: ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11 2024-08-19T00:26:31.592 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:31 smithi171 podman[58513]: 2024-08-19 00:26:31.332658061 +0000 UTC m=+0.541644775 container remove 80a64a354eea27374d0044c12ddf05ba210e33b2b59e2ebe43ce4c621cb9d9eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-de09dd0, ceph=True, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-08-19T00:26:32.028 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:31 smithi171 podman[58600]: 2024-08-19 00:26:31.667052338 +0000 UTC m=+0.016990008 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-19T00:26:32.028 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:31 smithi171 podman[58600]: 2024-08-19 00:26:31.766697057 +0000 UTC m=+0.116634726 container create 5559e0944b195df45abe453cb7d804102a388b2bc21bab60c5da5c6be580f2ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-de09dd0, ceph=True, org.label-schema.schema-version=1.0) 2024-08-19T00:26:32.029 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:32 smithi171 podman[58600]: 2024-08-19 00:26:32.02748823 +0000 UTC m=+0.377425897 container init 5559e0944b195df45abe453cb7d804102a388b2bc21bab60c5da5c6be580f2ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-de09dd0) 2024-08-19T00:26:32.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:32 smithi171 podman[58600]: 2024-08-19 00:26:32.030722174 +0000 UTC m=+0.380659842 container start 5559e0944b195df45abe453cb7d804102a388b2bc21bab60c5da5c6be580f2ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11-deactivate, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-de09dd0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-08-19T00:26:32.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:32 smithi171 podman[58600]: 2024-08-19 00:26:32.119364956 +0000 UTC m=+0.469302638 container attach 5559e0944b195df45abe453cb7d804102a388b2bc21bab60c5da5c6be580f2ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11-deactivate, RELEASE=squid-de09dd0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-19T00:26:32.343 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:32 smithi171 podman[58600]: 2024-08-19 00:26:32.214248897 +0000 UTC m=+0.564186565 container died 5559e0944b195df45abe453cb7d804102a388b2bc21bab60c5da5c6be580f2ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11-deactivate, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-de09dd0, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-08-19T00:26:32.784 DEBUG:teuthology.orchestra.run.smithi171:> sudo pkill -f 'journalctl -f -n 0 -u ceph-647ded64-5dbe-11ef-bccf-c7b262605968@osd.11.service' 2024-08-19T00:26:32.807 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:32 smithi171 podman[58623]: 2024-08-19 00:26:32.755846633 +0000 UTC m=+0.532003845 container remove 5559e0944b195df45abe453cb7d804102a388b2bc21bab60c5da5c6be580f2ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-osd-11-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-de09dd0, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-08-19T00:26:32.808 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:32 smithi171 systemd[1]: ceph-647ded64-5dbe-11ef-bccf-c7b262605968@osd.11.service: Deactivated successfully. 2024-08-19T00:26:32.808 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:32 smithi171 systemd[1]: Stopped Ceph osd.11 for 647ded64-5dbe-11ef-bccf-c7b262605968. 2024-08-19T00:26:32.808 INFO:journalctl@ceph.osd.11.smithi171.stdout:Aug 19 00:26:32 smithi171 systemd[1]: ceph-647ded64-5dbe-11ef-bccf-c7b262605968@osd.11.service: Consumed 1min 1.668s CPU time. 2024-08-19T00:26:32.822 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-19T00:26:32.823 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-08-19T00:26:32.823 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-08-19T00:26:32.823 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mds.a 2024-08-19T00:26:33.120 INFO:journalctl@ceph.mds.a.smithi044.stdout:Aug 19 00:26:32 smithi044 systemd[1]: Stopping Ceph mds.a for 647ded64-5dbe-11ef-bccf-c7b262605968... 2024-08-19T00:26:33.619 INFO:journalctl@ceph.mds.a.smithi044.stdout:Aug 19 00:26:33 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-a[59187]: 2024-08-19T00:26:33.133+0000 7f2d27b22640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-19T00:26:33.620 INFO:journalctl@ceph.mds.a.smithi044.stdout:Aug 19 00:26:33 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-a[59187]: 2024-08-19T00:26:33.133+0000 7f2d27b22640 -1 mds.a *** got signal Terminated *** 2024-08-19T00:26:37.010 INFO:journalctl@ceph.mds.a.smithi044.stdout:Aug 19 00:26:36 smithi044 podman[89650]: 2024-08-19 00:26:36.732182236 +0000 UTC m=+3.694202738 container died 1469e0dc3da40ee3f10d13e720ffc7cd1e07dc4f44aa5d3aef5bb6255174ce6d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-a, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=squid-de09dd0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-08-19T00:26:37.361 INFO:journalctl@ceph.mds.a.smithi044.stdout:Aug 19 00:26:37 smithi044 podman[89650]: 2024-08-19 00:26:37.175676274 +0000 UTC m=+4.137696768 container cleanup 1469e0dc3da40ee3f10d13e720ffc7cd1e07dc4f44aa5d3aef5bb6255174ce6d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-a, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=squid-de09dd0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-08-19T00:26:37.361 INFO:journalctl@ceph.mds.a.smithi044.stdout:Aug 19 00:26:37 smithi044 bash[89650]: ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-a 2024-08-19T00:26:37.619 INFO:journalctl@ceph.mds.a.smithi044.stdout:Aug 19 00:26:37 smithi044 podman[89665]: 2024-08-19 00:26:37.360402672 +0000 UTC m=+0.618298088 container remove 1469e0dc3da40ee3f10d13e720ffc7cd1e07dc4f44aa5d3aef5bb6255174ce6d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-a, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, RELEASE=squid-de09dd0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-19T00:26:37.627 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mds.a.service' 2024-08-19T00:26:37.662 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-19T00:26:37.662 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-08-19T00:26:37.663 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-08-19T00:26:37.663 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mds.d 2024-08-19T00:26:37.990 INFO:journalctl@ceph.mds.d.smithi044.stdout:Aug 19 00:26:37 smithi044 systemd[1]: Stopping Ceph mds.d for 647ded64-5dbe-11ef-bccf-c7b262605968... 2024-08-19T00:26:38.369 INFO:journalctl@ceph.mds.d.smithi044.stdout:Aug 19 00:26:37 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-d[57995]: 2024-08-19T00:26:37.988+0000 7f811c8de640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-19T00:26:38.370 INFO:journalctl@ceph.mds.d.smithi044.stdout:Aug 19 00:26:37 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-d[57995]: 2024-08-19T00:26:37.988+0000 7f811c8de640 -1 mds.d *** got signal Terminated *** 2024-08-19T00:26:40.998 INFO:journalctl@ceph.mds.d.smithi044.stdout:Aug 19 00:26:40 smithi044 podman[89771]: 2024-08-19 00:26:40.745030043 +0000 UTC m=+2.857167172 container died 7d720ee478f88c5afbeeb681804a68d49faaabe09987dc40ed7af2c99da2eefe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-d, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, RELEASE=squid-de09dd0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-08-19T00:26:41.256 INFO:journalctl@ceph.mds.d.smithi044.stdout:Aug 19 00:26:41 smithi044 podman[89771]: 2024-08-19 00:26:41.087946388 +0000 UTC m=+3.200083514 container cleanup 7d720ee478f88c5afbeeb681804a68d49faaabe09987dc40ed7af2c99da2eefe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-d, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-de09dd0, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-08-19T00:26:41.257 INFO:journalctl@ceph.mds.d.smithi044.stdout:Aug 19 00:26:41 smithi044 bash[89771]: ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-d 2024-08-19T00:26:41.496 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mds.d.service' 2024-08-19T00:26:41.516 INFO:journalctl@ceph.mds.d.smithi044.stdout:Aug 19 00:26:41 smithi044 podman[89784]: 2024-08-19 00:26:41.255747762 +0000 UTC m=+0.512669899 container remove 7d720ee478f88c5afbeeb681804a68d49faaabe09987dc40ed7af2c99da2eefe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-d, GIT_BRANCH=HEAD, RELEASE=squid-de09dd0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-19T00:26:41.517 INFO:journalctl@ceph.mds.d.smithi044.stdout:Aug 19 00:26:41 smithi044 systemd[1]: ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mds.d.service: Deactivated successfully. 2024-08-19T00:26:41.517 INFO:journalctl@ceph.mds.d.smithi044.stdout:Aug 19 00:26:41 smithi044 systemd[1]: Stopped Ceph mds.d for 647ded64-5dbe-11ef-bccf-c7b262605968. 2024-08-19T00:26:41.517 INFO:journalctl@ceph.mds.d.smithi044.stdout:Aug 19 00:26:41 smithi044 systemd[1]: ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mds.d.service: Consumed 2.026s CPU time. 2024-08-19T00:26:41.528 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-19T00:26:41.528 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-08-19T00:26:41.528 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-08-19T00:26:41.528 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mds.g 2024-08-19T00:26:41.851 INFO:journalctl@ceph.mds.g.smithi044.stdout:Aug 19 00:26:41 smithi044 systemd[1]: Stopping Ceph mds.g for 647ded64-5dbe-11ef-bccf-c7b262605968... 2024-08-19T00:26:42.119 INFO:journalctl@ceph.mds.g.smithi044.stdout:Aug 19 00:26:41 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-g[58791]: 2024-08-19T00:26:41.849+0000 7fb43391a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-19T00:26:42.119 INFO:journalctl@ceph.mds.g.smithi044.stdout:Aug 19 00:26:41 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-g[58791]: 2024-08-19T00:26:41.849+0000 7fb43391a640 -1 mds.g *** got signal Terminated *** 2024-08-19T00:26:44.993 INFO:journalctl@ceph.mds.g.smithi044.stdout:Aug 19 00:26:44 smithi044 podman[89890]: 2024-08-19 00:26:44.732922428 +0000 UTC m=+2.981195656 container died 4ee6a6cba6cd884f7192bc93d2d13920280a8f07ddd59a133eb56e7d5277f428 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-g, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-de09dd0, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-08-19T00:26:45.252 INFO:journalctl@ceph.mds.g.smithi044.stdout:Aug 19 00:26:45 smithi044 podman[89890]: 2024-08-19 00:26:45.066809448 +0000 UTC m=+3.315082680 container cleanup 4ee6a6cba6cd884f7192bc93d2d13920280a8f07ddd59a133eb56e7d5277f428 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-g, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-de09dd0, org.label-schema.build-date=20240731) 2024-08-19T00:26:45.252 INFO:journalctl@ceph.mds.g.smithi044.stdout:Aug 19 00:26:45 smithi044 bash[89890]: ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-g 2024-08-19T00:26:45.503 INFO:journalctl@ceph.mds.g.smithi044.stdout:Aug 19 00:26:45 smithi044 podman[89905]: 2024-08-19 00:26:45.251340411 +0000 UTC m=+0.510932228 container remove 4ee6a6cba6cd884f7192bc93d2d13920280a8f07ddd59a133eb56e7d5277f428 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-g, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-de09dd0, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-08-19T00:26:45.521 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mds.g.service' 2024-08-19T00:26:45.553 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-19T00:26:45.554 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-08-19T00:26:45.554 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-08-19T00:26:45.554 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mds.j 2024-08-19T00:26:45.869 INFO:journalctl@ceph.mds.j.smithi044.stdout:Aug 19 00:26:45 smithi044 systemd[1]: Stopping Ceph mds.j for 647ded64-5dbe-11ef-bccf-c7b262605968... 2024-08-19T00:26:46.369 INFO:journalctl@ceph.mds.j.smithi044.stdout:Aug 19 00:26:45 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-j[57576]: 2024-08-19T00:26:45.870+0000 7f8530895640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-19T00:26:46.370 INFO:journalctl@ceph.mds.j.smithi044.stdout:Aug 19 00:26:45 smithi044 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-j[57576]: 2024-08-19T00:26:45.870+0000 7f8530895640 -1 mds.j *** got signal Terminated *** 2024-08-19T00:26:48.619 INFO:journalctl@ceph.mds.j.smithi044.stdout:Aug 19 00:26:48 smithi044 podman[90012]: 2024-08-19 00:26:48.361149382 +0000 UTC m=+2.584071204 container died 1d9a797ed8dfa576d385645b84c2d5f4f4e744e464e32c3b0fd824af877cf4b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-j, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-de09dd0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-08-19T00:26:48.905 INFO:journalctl@ceph.mds.j.smithi044.stdout:Aug 19 00:26:48 smithi044 podman[90012]: 2024-08-19 00:26:48.728865669 +0000 UTC m=+2.951787490 container cleanup 1d9a797ed8dfa576d385645b84c2d5f4f4e744e464e32c3b0fd824af877cf4b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-j, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-de09dd0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-19T00:26:48.906 INFO:journalctl@ceph.mds.j.smithi044.stdout:Aug 19 00:26:48 smithi044 bash[90012]: ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-j 2024-08-19T00:26:49.171 INFO:journalctl@ceph.mds.j.smithi044.stdout:Aug 19 00:26:48 smithi044 podman[90024]: 2024-08-19 00:26:48.904879623 +0000 UTC m=+0.537501424 container remove 1d9a797ed8dfa576d385645b84c2d5f4f4e744e464e32c3b0fd824af877cf4b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-j, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-de09dd0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-19T00:26:49.175 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mds.j.service' 2024-08-19T00:26:49.207 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-19T00:26:49.207 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-08-19T00:26:49.208 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-08-19T00:26:49.208 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mds.b 2024-08-19T00:26:49.543 INFO:journalctl@ceph.mds.b.smithi116.stdout:Aug 19 00:26:49 smithi116 systemd[1]: Stopping Ceph mds.b for 647ded64-5dbe-11ef-bccf-c7b262605968... 2024-08-19T00:26:49.866 INFO:journalctl@ceph.mds.b.smithi116.stdout:Aug 19 00:26:49 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-b[51250]: 2024-08-19T00:26:49.540+0000 7f25f803f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-19T00:26:49.866 INFO:journalctl@ceph.mds.b.smithi116.stdout:Aug 19 00:26:49 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-b[51250]: 2024-08-19T00:26:49.540+0000 7f25f803f640 -1 mds.b *** got signal Terminated *** 2024-08-19T00:26:53.116 INFO:journalctl@ceph.mds.b.smithi116.stdout:Aug 19 00:26:52 smithi116 podman[58158]: 2024-08-19 00:26:52.728218925 +0000 UTC m=+3.315333137 container died a7459e3925f6462123a762c840f9ef23e8af79b9cefaa00677ecb281fa87bc95 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-de09dd0) 2024-08-19T00:26:53.450 INFO:journalctl@ceph.mds.b.smithi116.stdout:Aug 19 00:26:53 smithi116 podman[58158]: 2024-08-19 00:26:53.232030404 +0000 UTC m=+3.819144609 container cleanup a7459e3925f6462123a762c840f9ef23e8af79b9cefaa00677ecb281fa87bc95 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, RELEASE=squid-de09dd0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-19T00:26:53.451 INFO:journalctl@ceph.mds.b.smithi116.stdout:Aug 19 00:26:53 smithi116 bash[58158]: ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-b 2024-08-19T00:26:53.594 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mds.b.service' 2024-08-19T00:26:53.628 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-19T00:26:53.628 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-08-19T00:26:53.628 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-08-19T00:26:53.629 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mds.e 2024-08-19T00:26:54.116 INFO:journalctl@ceph.mds.e.smithi116.stdout:Aug 19 00:26:53 smithi116 systemd[1]: Stopping Ceph mds.e for 647ded64-5dbe-11ef-bccf-c7b262605968... 2024-08-19T00:26:54.116 INFO:journalctl@ceph.mds.e.smithi116.stdout:Aug 19 00:26:53 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-e[50649]: 2024-08-19T00:26:53.944+0000 7f6491b70640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-19T00:26:54.116 INFO:journalctl@ceph.mds.e.smithi116.stdout:Aug 19 00:26:53 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-e[50649]: 2024-08-19T00:26:53.944+0000 7f6491b70640 -1 mds.e *** got signal Terminated *** 2024-08-19T00:26:57.021 INFO:journalctl@ceph.mds.e.smithi116.stdout:Aug 19 00:26:56 smithi116 podman[58280]: 2024-08-19 00:26:56.728626316 +0000 UTC m=+2.878242054 container died 36f3dfd2ee355c9d23e183edd87a3e78f7bb85e125a1f292b8a571e701942ed3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-e, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.36.0, RELEASE=squid-de09dd0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-19T00:26:57.299 INFO:journalctl@ceph.mds.e.smithi116.stdout:Aug 19 00:26:57 smithi116 podman[58280]: 2024-08-19 00:26:57.185578008 +0000 UTC m=+3.335193752 container cleanup 36f3dfd2ee355c9d23e183edd87a3e78f7bb85e125a1f292b8a571e701942ed3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-e, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-de09dd0, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-19T00:26:57.300 INFO:journalctl@ceph.mds.e.smithi116.stdout:Aug 19 00:26:57 smithi116 bash[58280]: ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-e 2024-08-19T00:26:57.615 INFO:journalctl@ceph.mds.e.smithi116.stdout:Aug 19 00:26:57 smithi116 podman[58294]: 2024-08-19 00:26:57.47060079 +0000 UTC m=+0.733699076 container remove 36f3dfd2ee355c9d23e183edd87a3e78f7bb85e125a1f292b8a571e701942ed3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-e, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-de09dd0) 2024-08-19T00:26:57.647 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mds.e.service' 2024-08-19T00:26:57.682 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-19T00:26:57.683 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-08-19T00:26:57.683 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-08-19T00:26:57.683 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mds.h 2024-08-19T00:26:57.999 INFO:journalctl@ceph.mds.h.smithi116.stdout:Aug 19 00:26:57 smithi116 systemd[1]: Stopping Ceph mds.h for 647ded64-5dbe-11ef-bccf-c7b262605968... 2024-08-19T00:26:58.250 INFO:journalctl@ceph.mds.h.smithi116.stdout:Aug 19 00:26:57 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-h[50949]: 2024-08-19T00:26:57.998+0000 7f6e82ad9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-19T00:26:58.250 INFO:journalctl@ceph.mds.h.smithi116.stdout:Aug 19 00:26:57 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-h[50949]: 2024-08-19T00:26:57.998+0000 7f6e82ad9640 -1 mds.h *** got signal Terminated *** 2024-08-19T00:27:01.040 INFO:journalctl@ceph.mds.h.smithi116.stdout:Aug 19 00:27:00 smithi116 podman[58410]: 2024-08-19 00:27:00.730124399 +0000 UTC m=+2.827763730 container died 00e71ad36b71a1869a2c73eca9b9d3ce5bfbe78f8cb7d59cfbf363496d9c0fc0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-h, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-de09dd0, ceph=True, GIT_CLEAN=True, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-19T00:27:01.040 INFO:journalctl@ceph.mds.h.smithi116.stdout:Aug 19 00:27:01 smithi116 podman[58410]: 2024-08-19 00:27:01.039298508 +0000 UTC m=+3.136937842 container cleanup 00e71ad36b71a1869a2c73eca9b9d3ce5bfbe78f8cb7d59cfbf363496d9c0fc0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-h, org.label-schema.build-date=20240731, RELEASE=squid-de09dd0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-08-19T00:27:01.366 INFO:journalctl@ceph.mds.h.smithi116.stdout:Aug 19 00:27:01 smithi116 bash[58410]: ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-h 2024-08-19T00:27:01.366 INFO:journalctl@ceph.mds.h.smithi116.stdout:Aug 19 00:27:01 smithi116 podman[58423]: 2024-08-19 00:27:01.240627426 +0000 UTC m=+0.506470284 container remove 00e71ad36b71a1869a2c73eca9b9d3ce5bfbe78f8cb7d59cfbf363496d9c0fc0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-h, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-de09dd0, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-19T00:27:01.489 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mds.h.service' 2024-08-19T00:27:01.521 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-19T00:27:01.522 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-08-19T00:27:01.522 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-08-19T00:27:01.522 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mds.k 2024-08-19T00:27:01.852 INFO:journalctl@ceph.mds.k.smithi116.stdout:Aug 19 00:27:01 smithi116 systemd[1]: Stopping Ceph mds.k for 647ded64-5dbe-11ef-bccf-c7b262605968... 2024-08-19T00:27:02.116 INFO:journalctl@ceph.mds.k.smithi116.stdout:Aug 19 00:27:01 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-k[50332]: 2024-08-19T00:27:01.851+0000 7f0d3d41b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-19T00:27:02.116 INFO:journalctl@ceph.mds.k.smithi116.stdout:Aug 19 00:27:01 smithi116 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-k[50332]: 2024-08-19T00:27:01.851+0000 7f0d3d41b640 -1 mds.k *** got signal Terminated *** 2024-08-19T00:27:05.777 INFO:journalctl@ceph.mds.k.smithi116.stdout:Aug 19 00:27:05 smithi116 podman[58532]: 2024-08-19 00:27:05.457243022 +0000 UTC m=+3.713027744 container died 61d571ed29d810f6e0f665d1142d362144a37c4a1317f900720835f06e19554e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-k, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-de09dd0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.36.0) 2024-08-19T00:27:06.053 INFO:journalctl@ceph.mds.k.smithi116.stdout:Aug 19 00:27:05 smithi116 podman[58532]: 2024-08-19 00:27:05.85944358 +0000 UTC m=+4.115228302 container cleanup 61d571ed29d810f6e0f665d1142d362144a37c4a1317f900720835f06e19554e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-k, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-de09dd0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-08-19T00:27:06.053 INFO:journalctl@ceph.mds.k.smithi116.stdout:Aug 19 00:27:05 smithi116 bash[58532]: ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-k 2024-08-19T00:27:06.206 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mds.k.service' 2024-08-19T00:27:06.239 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-19T00:27:06.240 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-08-19T00:27:06.240 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-08-19T00:27:06.240 DEBUG:teuthology.orchestra.run.smithi171:> sudo systemctl stop ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mds.c 2024-08-19T00:27:06.549 INFO:journalctl@ceph.mds.c.smithi171.stdout:Aug 19 00:27:06 smithi171 systemd[1]: Stopping Ceph mds.c for 647ded64-5dbe-11ef-bccf-c7b262605968... 2024-08-19T00:27:06.842 INFO:journalctl@ceph.mds.c.smithi171.stdout:Aug 19 00:27:06 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-c[51359]: 2024-08-19T00:27:06.547+0000 7f1a25b27640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-19T00:27:06.842 INFO:journalctl@ceph.mds.c.smithi171.stdout:Aug 19 00:27:06 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-c[51359]: 2024-08-19T00:27:06.547+0000 7f1a25b27640 -1 mds.c *** got signal Terminated *** 2024-08-19T00:27:09.022 INFO:journalctl@ceph.mds.c.smithi171.stdout:Aug 19 00:27:08 smithi171 podman[58702]: 2024-08-19 00:27:08.755228968 +0000 UTC m=+2.313460342 container died d71015e120d6e680778c47828715354adba6bd03589b120a058b2d992a7d73dd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-c, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, RELEASE=squid-de09dd0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.36.0) 2024-08-19T00:27:09.342 INFO:journalctl@ceph.mds.c.smithi171.stdout:Aug 19 00:27:09 smithi171 podman[58702]: 2024-08-19 00:27:09.104476948 +0000 UTC m=+2.662708327 container cleanup d71015e120d6e680778c47828715354adba6bd03589b120a058b2d992a7d73dd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-c, RELEASE=squid-de09dd0, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-08-19T00:27:09.342 INFO:journalctl@ceph.mds.c.smithi171.stdout:Aug 19 00:27:09 smithi171 bash[58702]: ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-c 2024-08-19T00:27:09.541 DEBUG:teuthology.orchestra.run.smithi171:> sudo pkill -f 'journalctl -f -n 0 -u ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mds.c.service' 2024-08-19T00:27:09.577 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-19T00:27:09.577 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-08-19T00:27:09.577 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-08-19T00:27:09.578 DEBUG:teuthology.orchestra.run.smithi171:> sudo systemctl stop ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mds.f 2024-08-19T00:27:10.093 INFO:journalctl@ceph.mds.f.smithi171.stdout:Aug 19 00:27:09 smithi171 systemd[1]: Stopping Ceph mds.f for 647ded64-5dbe-11ef-bccf-c7b262605968... 2024-08-19T00:27:10.093 INFO:journalctl@ceph.mds.f.smithi171.stdout:Aug 19 00:27:09 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-f[51054]: 2024-08-19T00:27:09.900+0000 7f4e8dd94640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-19T00:27:10.093 INFO:journalctl@ceph.mds.f.smithi171.stdout:Aug 19 00:27:09 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-f[51054]: 2024-08-19T00:27:09.900+0000 7f4e8dd94640 -1 mds.f *** got signal Terminated *** 2024-08-19T00:27:13.019 INFO:journalctl@ceph.mds.f.smithi171.stdout:Aug 19 00:27:12 smithi171 podman[58834]: 2024-08-19 00:27:12.741519328 +0000 UTC m=+2.934438997 container died b2b25b19b9c7c94a64650830031b6a78ff02babcc52acafc6c6f75bde7208fa9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-f, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-de09dd0, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-19T00:27:13.342 INFO:journalctl@ceph.mds.f.smithi171.stdout:Aug 19 00:27:13 smithi171 podman[58834]: 2024-08-19 00:27:13.091872394 +0000 UTC m=+3.284792054 container cleanup b2b25b19b9c7c94a64650830031b6a78ff02babcc52acafc6c6f75bde7208fa9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-f, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, RELEASE=squid-de09dd0, org.label-schema.license=GPLv2, io.buildah.version=1.36.0) 2024-08-19T00:27:13.343 INFO:journalctl@ceph.mds.f.smithi171.stdout:Aug 19 00:27:13 smithi171 bash[58834]: ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-f 2024-08-19T00:27:13.525 DEBUG:teuthology.orchestra.run.smithi171:> sudo pkill -f 'journalctl -f -n 0 -u ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mds.f.service' 2024-08-19T00:27:13.558 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-19T00:27:13.559 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-08-19T00:27:13.559 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-08-19T00:27:13.559 DEBUG:teuthology.orchestra.run.smithi171:> sudo systemctl stop ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mds.i 2024-08-19T00:27:13.913 INFO:journalctl@ceph.mds.i.smithi171.stdout:Aug 19 00:27:13 smithi171 systemd[1]: Stopping Ceph mds.i for 647ded64-5dbe-11ef-bccf-c7b262605968... 2024-08-19T00:27:14.342 INFO:journalctl@ceph.mds.i.smithi171.stdout:Aug 19 00:27:13 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-i[51663]: 2024-08-19T00:27:13.912+0000 7f2208841640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-19T00:27:14.342 INFO:journalctl@ceph.mds.i.smithi171.stdout:Aug 19 00:27:13 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-i[51663]: 2024-08-19T00:27:13.912+0000 7f2208841640 -1 mds.i *** got signal Terminated *** 2024-08-19T00:27:17.047 INFO:journalctl@ceph.mds.i.smithi171.stdout:Aug 19 00:27:16 smithi171 podman[58954]: 2024-08-19 00:27:16.751923833 +0000 UTC m=+2.966756294 container died 6a564a89c48becae528e629f05c1f8861b80281955f4114a3b2cefe951e5872c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-de09dd0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-08-19T00:27:17.342 INFO:journalctl@ceph.mds.i.smithi171.stdout:Aug 19 00:27:17 smithi171 podman[58954]: 2024-08-19 00:27:17.120546701 +0000 UTC m=+3.335379152 container cleanup 6a564a89c48becae528e629f05c1f8861b80281955f4114a3b2cefe951e5872c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, RELEASE=squid-de09dd0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-19T00:27:17.343 INFO:journalctl@ceph.mds.i.smithi171.stdout:Aug 19 00:27:17 smithi171 bash[58954]: ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-i 2024-08-19T00:27:17.515 DEBUG:teuthology.orchestra.run.smithi171:> sudo pkill -f 'journalctl -f -n 0 -u ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mds.i.service' 2024-08-19T00:27:17.547 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-19T00:27:17.547 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-08-19T00:27:17.548 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-08-19T00:27:17.548 DEBUG:teuthology.orchestra.run.smithi171:> sudo systemctl stop ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mds.l 2024-08-19T00:27:18.092 INFO:journalctl@ceph.mds.l.smithi171.stdout:Aug 19 00:27:17 smithi171 systemd[1]: Stopping Ceph mds.l for 647ded64-5dbe-11ef-bccf-c7b262605968... 2024-08-19T00:27:18.093 INFO:journalctl@ceph.mds.l.smithi171.stdout:Aug 19 00:27:17 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-l[50741]: 2024-08-19T00:27:17.848+0000 7f0e822e4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-19T00:27:18.093 INFO:journalctl@ceph.mds.l.smithi171.stdout:Aug 19 00:27:17 smithi171 ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-l[50741]: 2024-08-19T00:27:17.848+0000 7f0e822e4640 -1 mds.l *** got signal Terminated *** 2024-08-19T00:27:21.050 INFO:journalctl@ceph.mds.l.smithi171.stdout:Aug 19 00:27:20 smithi171 podman[59075]: 2024-08-19 00:27:20.747027228 +0000 UTC m=+2.980890200 container died 3cdd98142e78c03a8610afb7c88610e8533e9c2aaec0a82f550709964d076a26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-l, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-de09dd0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-08-19T00:27:21.050 INFO:journalctl@ceph.mds.l.smithi171.stdout:Aug 19 00:27:21 smithi171 podman[59075]: 2024-08-19 00:27:21.048962734 +0000 UTC m=+3.282825705 container cleanup 3cdd98142e78c03a8610afb7c88610e8533e9c2aaec0a82f550709964d076a26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-l, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, RELEASE=squid-de09dd0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-19T00:27:21.343 INFO:journalctl@ceph.mds.l.smithi171.stdout:Aug 19 00:27:21 smithi171 bash[59075]: ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-l 2024-08-19T00:27:21.343 INFO:journalctl@ceph.mds.l.smithi171.stdout:Aug 19 00:27:21 smithi171 podman[59088]: 2024-08-19 00:27:21.24986013 +0000 UTC m=+0.495639810 container remove 3cdd98142e78c03a8610afb7c88610e8533e9c2aaec0a82f550709964d076a26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-647ded64-5dbe-11ef-bccf-c7b262605968-mds-l, CEPH_POINT_RELEASE=, RELEASE=squid-de09dd0, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-19T00:27:21.387 DEBUG:teuthology.orchestra.run.smithi171:> sudo pkill -f 'journalctl -f -n 0 -u ceph-647ded64-5dbe-11ef-bccf-c7b262605968@mds.l.service' 2024-08-19T00:27:21.419 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-19T00:27:21.419 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-08-19T00:27:21.419 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 --force --keep-logs 2024-08-19T00:27:21.632 INFO:teuthology.orchestra.run.smithi044.stdout:Deleting cluster with fsid: 647ded64-5dbe-11ef-bccf-c7b262605968 2024-08-19T00:27:24.048 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 --force --keep-logs 2024-08-19T00:27:24.252 INFO:teuthology.orchestra.run.smithi116.stdout:Deleting cluster with fsid: 647ded64-5dbe-11ef-bccf-c7b262605968 2024-08-19T00:27:26.977 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 --force --keep-logs 2024-08-19T00:27:27.182 INFO:teuthology.orchestra.run.smithi171.stdout:Deleting cluster with fsid: 647ded64-5dbe-11ef-bccf-c7b262605968 2024-08-19T00:27:29.604 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-19T00:27:29.635 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-19T00:27:29.662 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-19T00:27:29.689 INFO:tasks.cephadm:Archiving crash dumps... 2024-08-19T00:27:29.691 DEBUG:teuthology.misc:Transferring archived files from smithi044:/var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7860043/remote/smithi044/crash 2024-08-19T00:27:29.692 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar c -f - -C /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/crash -- . 2024-08-19T00:27:29.728 INFO:teuthology.orchestra.run.smithi044.stderr:tar: /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/crash: Cannot open: No such file or directory 2024-08-19T00:27:29.728 INFO:teuthology.orchestra.run.smithi044.stderr:tar: Error is not recoverable: exiting now 2024-08-19T00:27:29.730 DEBUG:teuthology.misc:Transferring archived files from smithi116:/var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7860043/remote/smithi116/crash 2024-08-19T00:27:29.731 DEBUG:teuthology.orchestra.run.smithi116:> sudo tar c -f - -C /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/crash -- . 2024-08-19T00:27:29.770 INFO:teuthology.orchestra.run.smithi116.stderr:tar: /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/crash: Cannot open: No such file or directory 2024-08-19T00:27:29.770 INFO:teuthology.orchestra.run.smithi116.stderr:tar: Error is not recoverable: exiting now 2024-08-19T00:27:29.772 DEBUG:teuthology.misc:Transferring archived files from smithi171:/var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7860043/remote/smithi171/crash 2024-08-19T00:27:29.773 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar c -f - -C /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/crash -- . 2024-08-19T00:27:29.806 INFO:teuthology.orchestra.run.smithi171.stderr:tar: /var/lib/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/crash: Cannot open: No such file or directory 2024-08-19T00:27:29.807 INFO:teuthology.orchestra.run.smithi171.stderr:tar: Error is not recoverable: exiting now 2024-08-19T00:27:29.808 INFO:tasks.cephadm:Checking cluster log for badness... 2024-08-19T00:27:29.808 DEBUG:teuthology.orchestra.run.smithi044:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-08-19T00:27:29.844 INFO:tasks.cephadm:Compressing logs... 2024-08-19T00:27:29.844 DEBUG:teuthology.orchestra.run.smithi044:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-19T00:27:29.887 DEBUG:teuthology.orchestra.run.smithi116:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-19T00:27:29.889 DEBUG:teuthology.orchestra.run.smithi171:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-19T00:27:29.913 INFO:teuthology.orchestra.run.smithi116.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-08-19T00:27:29.913 INFO:teuthology.orchestra.run.smithi116.stderr:: No such file or directory 2024-08-19T00:27:29.913 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-volume.log 2024-08-19T00:27:29.913 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-mds.e.log 2024-08-19T00:27:29.913 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-mds.h.log 2024-08-19T00:27:29.914 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph.cephadm.log 2024-08-19T00:27:29.914 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-mds.e.log: /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph.audit.log 2024-08-19T00:27:29.914 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-mds.b.log 2024-08-19T00:27:29.914 INFO:teuthology.orchestra.run.smithi116.stderr: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-08-19T00:27:29.927 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph.audit.log: 82.2% -- replaced with /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph.cephadm.log.gz 2024-08-19T00:27:29.927 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-osd.10.log 2024-08-19T00:27:29.927 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-osd.4.log 2024-08-19T00:27:29.927 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-mds.k.log 2024-08-19T00:27:29.927 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-osd.4.log: 90.4% -- replaced with /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph.audit.log.gz 2024-08-19T00:27:29.928 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-mon.b.log 2024-08-19T00:27:29.928 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-mds.k.log: 94.6% -- replaced with /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-mds.k.log.gz 2024-08-19T00:27:29.928 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-mgr.y.log 2024-08-19T00:27:29.928 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-mon.b.log: 90.9% -- replaced with /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-volume.log.gz 2024-08-19T00:27:29.930 INFO:teuthology.orchestra.run.smithi044.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-08-19T00:27:29.930 INFO:teuthology.orchestra.run.smithi044.stderr:: No such file or directory 2024-08-19T00:27:29.931 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-volume.log 2024-08-19T00:27:29.931 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-osd.3.log 2024-08-19T00:27:29.931 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-mds.d.log 2024-08-19T00:27:29.931 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-mgr.x.log 2024-08-19T00:27:29.931 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph.cephadm.log 2024-08-19T00:27:29.931 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-mds.d.log: /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph.audit.log 2024-08-19T00:27:29.932 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-mon.a.log 2024-08-19T00:27:29.932 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph.audit.log: 84.7% -- replaced with /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph.cephadm.log.gzgzip -5 --verbose -- /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-mds.a.log 2024-08-19T00:27:29.932 INFO:teuthology.orchestra.run.smithi044.stderr: 2024-08-19T00:27:29.932 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-mon.a.log: 90.2% -- replaced with /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph.audit.log.gz 2024-08-19T00:27:29.932 INFO:teuthology.orchestra.run.smithi044.stderr: 93.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-08-19T00:27:29.932 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-osd.9.log 2024-08-19T00:27:29.932 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-osd.6.log 2024-08-19T00:27:29.933 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-mds.j.log 2024-08-19T00:27:29.933 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-osd.6.log: 90.9% -- replaced with /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-volume.log.gz 2024-08-19T00:27:29.934 INFO:teuthology.orchestra.run.smithi171.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-08-19T00:27:29.934 INFO:teuthology.orchestra.run.smithi171.stderr:: No such file or directory 2024-08-19T00:27:29.934 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-volume.log 2024-08-19T00:27:29.934 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5/var/log/ceph/cephadm.log: --verbose -- /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-mgr.z.log 2024-08-19T00:27:29.934 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-osd.2.log 2024-08-19T00:27:29.935 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-osd.11.log 2024-08-19T00:27:29.935 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-mds.f.log 2024-08-19T00:27:29.935 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-osd.2.log: /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph.cephadm.log 2024-08-19T00:27:29.935 INFO:teuthology.orchestra.run.smithi171.stderr: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-08-19T00:27:29.935 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph.audit.log 2024-08-19T00:27:29.935 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-osd.8.log 2024-08-19T00:27:29.935 INFO:teuthology.orchestra.run.smithi171.stderr: 82.2% -- replaced with /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph.cephadm.log.gz 2024-08-19T00:27:29.936 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-mds.i.log 2024-08-19T00:27:29.936 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-mds.c.log 2024-08-19T00:27:29.936 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-osd.8.log: /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-mds.i.log: 90.4% -- replaced with /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph.audit.log.gz 2024-08-19T00:27:29.936 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-osd.5.log 2024-08-19T00:27:29.936 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-mds.c.log: 92.0% -- replaced with /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-mgr.z.log.gz 2024-08-19T00:27:29.936 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph.log 2024-08-19T00:27:29.936 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-osd.5.log: 90.9% -- replaced with /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-volume.log.gz 2024-08-19T00:27:29.937 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-mon.c.log 2024-08-19T00:27:29.937 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph.log: 86.7% -- replaced with /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph.log.gz 2024-08-19T00:27:29.937 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-mds.l.log 2024-08-19T00:27:29.938 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-osd.7.log 2024-08-19T00:27:29.939 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-osd.0.log 2024-08-19T00:27:29.942 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-mds.j.log: 94.6% -- replaced with /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-mds.j.log.gz 2024-08-19T00:27:29.942 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph.log 2024-08-19T00:27:29.944 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-mgr.y.log: 91.9%gzip -5 --verbose -- /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-osd.1.log 2024-08-19T00:27:29.947 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-osd.7.log: -- replaced with /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-mgr.y.log.gz 2024-08-19T00:27:29.952 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-mds.g.log 2024-08-19T00:27:29.952 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph.log 2024-08-19T00:27:29.961 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph.log: 86.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2024-08-19T00:27:29.967 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-mds.g.log: -- replaced with /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph.log.gz 2024-08-19T00:27:29.976 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-osd.1.log: /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph.log: 86.7% -- replaced with /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph.log.gz 2024-08-19T00:27:29.984 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.log: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-08-19T00:27:29.984 INFO:teuthology.orchestra.run.smithi044.stderr: 94.5% -- replaced with /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-mds.d.log.gz 2024-08-19T00:27:30.059 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-mon.c.log: /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-mds.l.log: 93.6% -- replaced with /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-mds.f.log.gz 2024-08-19T00:27:30.062 INFO:teuthology.orchestra.run.smithi171.stderr: 94.6% -- replaced with /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-mds.l.log.gz 2024-08-19T00:27:30.301 INFO:teuthology.orchestra.run.smithi044.stderr: 90.1% -- replaced with /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-mgr.x.log.gz 2024-08-19T00:27:30.383 INFO:teuthology.orchestra.run.smithi171.stderr: 91.9% -- replaced with /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-mon.c.log.gz 2024-08-19T00:27:30.386 INFO:teuthology.orchestra.run.smithi116.stderr: 91.8% -- replaced with /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-mon.b.log.gz 2024-08-19T00:27:31.183 INFO:teuthology.orchestra.run.smithi044.stderr: 91.3% -- replaced with /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-mon.a.log.gz 2024-08-19T00:27:31.292 INFO:teuthology.orchestra.run.smithi044.stderr: 95.3% -- replaced with /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-mds.g.log.gz 2024-08-19T00:27:34.051 INFO:teuthology.orchestra.run.smithi171.stderr: 97.0% -- replaced with /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-mds.c.log.gz 2024-08-19T00:27:34.676 INFO:teuthology.orchestra.run.smithi116.stderr: 96.5% -- replaced with /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-mds.h.log.gz 2024-08-19T00:27:38.372 INFO:teuthology.orchestra.run.smithi044.stderr: 95.7% -- replaced with /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-mds.a.log.gz 2024-08-19T00:27:39.098 INFO:teuthology.orchestra.run.smithi116.stderr: 96.0% -- replaced with /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-mds.b.log.gz 2024-08-19T00:27:41.036 INFO:teuthology.orchestra.run.smithi116.stderr: 91.8% -- replaced with /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-osd.10.log.gz 2024-08-19T00:27:41.484 INFO:teuthology.orchestra.run.smithi171.stderr: 91.7% -- replaced with /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-osd.11.log.gz 2024-08-19T00:27:42.096 INFO:teuthology.orchestra.run.smithi044.stderr: 92.1% -- replaced with /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-osd.0.log.gz 2024-08-19T00:27:43.243 INFO:teuthology.orchestra.run.smithi116.stderr: 92.0% -- replaced with /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-osd.1.log.gz 2024-08-19T00:27:43.489 INFO:teuthology.orchestra.run.smithi171.stderr: 91.4% -- replaced with /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-osd.8.log.gz 2024-08-19T00:27:44.429 INFO:teuthology.orchestra.run.smithi044.stderr: 91.4% -- replaced with /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-osd.6.log.gz 2024-08-19T00:27:45.308 INFO:teuthology.orchestra.run.smithi171.stderr: 91.7% -- replaced with /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-osd.2.log.gz 2024-08-19T00:27:46.157 INFO:teuthology.orchestra.run.smithi044.stderr: 91.9% -- replaced with /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-osd.3.log.gz 2024-08-19T00:27:46.965 INFO:teuthology.orchestra.run.smithi044.stderr: 91.5% -- replaced with /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-osd.9.log.gz 2024-08-19T00:27:46.968 INFO:teuthology.orchestra.run.smithi044.stderr: 2024-08-19T00:27:46.968 INFO:teuthology.orchestra.run.smithi044.stderr:real 0m17.067s 2024-08-19T00:27:46.968 INFO:teuthology.orchestra.run.smithi044.stderr:user 1m9.317s 2024-08-19T00:27:46.968 INFO:teuthology.orchestra.run.smithi044.stderr:sys 0m2.038s 2024-08-19T00:27:47.522 INFO:teuthology.orchestra.run.smithi116.stderr: 91.9% -- replaced with /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-osd.7.log.gz 2024-08-19T00:27:49.116 INFO:teuthology.orchestra.run.smithi116.stderr: 91.6% -- replaced with /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-osd.4.log.gz 2024-08-19T00:27:50.306 INFO:teuthology.orchestra.run.smithi116.stderr: 94.4% -- replaced with /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-mds.e.log.gz 2024-08-19T00:27:50.309 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-08-19T00:27:50.309 INFO:teuthology.orchestra.run.smithi116.stderr:real 0m20.407s 2024-08-19T00:27:50.309 INFO:teuthology.orchestra.run.smithi116.stderr:user 1m32.576s 2024-08-19T00:27:50.309 INFO:teuthology.orchestra.run.smithi116.stderr:sys 0m2.907s 2024-08-19T00:27:53.104 INFO:teuthology.orchestra.run.smithi171.stderr: 91.4% -- replaced with /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-osd.5.log.gz 2024-08-19T00:29:54.864 INFO:teuthology.orchestra.run.smithi171.stderr: 93.6% -- replaced with /var/log/ceph/647ded64-5dbe-11ef-bccf-c7b262605968/ceph-mds.i.log.gz 2024-08-19T00:29:54.866 INFO:teuthology.orchestra.run.smithi171.stderr: 2024-08-19T00:29:54.866 INFO:teuthology.orchestra.run.smithi171.stderr:real 2m24.961s 2024-08-19T00:29:54.867 INFO:teuthology.orchestra.run.smithi171.stderr:user 3m26.490s 2024-08-19T00:29:54.867 INFO:teuthology.orchestra.run.smithi171.stderr:sys 0m6.452s 2024-08-19T00:29:54.868 INFO:tasks.cephadm:Archiving logs... 2024-08-19T00:29:54.868 DEBUG:teuthology.misc:Transferring archived files from smithi044:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7860043/remote/smithi044/log 2024-08-19T00:29:54.869 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-19T00:30:04.427 DEBUG:teuthology.misc:Transferring archived files from smithi116:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7860043/remote/smithi116/log 2024-08-19T00:30:04.428 DEBUG:teuthology.orchestra.run.smithi116:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-19T00:30:16.129 DEBUG:teuthology.misc:Transferring archived files from smithi171:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7860043/remote/smithi171/log 2024-08-19T00:30:16.130 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-19T00:30:47.585 INFO:tasks.cephadm:Removing cluster... 2024-08-19T00:30:47.586 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 --force 2024-08-19T00:30:47.799 INFO:teuthology.orchestra.run.smithi044.stdout:Deleting cluster with fsid: 647ded64-5dbe-11ef-bccf-c7b262605968 2024-08-19T00:30:48.148 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 --force 2024-08-19T00:30:48.352 INFO:teuthology.orchestra.run.smithi116.stdout:Deleting cluster with fsid: 647ded64-5dbe-11ef-bccf-c7b262605968 2024-08-19T00:30:48.776 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 647ded64-5dbe-11ef-bccf-c7b262605968 --force 2024-08-19T00:30:48.981 INFO:teuthology.orchestra.run.smithi171.stdout:Deleting cluster with fsid: 647ded64-5dbe-11ef-bccf-c7b262605968 2024-08-19T00:30:49.483 INFO:tasks.cephadm:Removing cephadm ... 2024-08-19T00:30:49.483 DEBUG:teuthology.orchestra.run.smithi044:> rm -rf /home/ubuntu/cephtest/cephadm 2024-08-19T00:30:49.502 DEBUG:teuthology.orchestra.run.smithi116:> rm -rf /home/ubuntu/cephtest/cephadm 2024-08-19T00:30:49.518 DEBUG:teuthology.orchestra.run.smithi171:> rm -rf /home/ubuntu/cephtest/cephadm 2024-08-19T00:30:49.534 INFO:tasks.cephadm:Teardown complete 2024-08-19T00:30:49.534 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-08-19T00:30:49.545 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-08-19T00:30:49.546 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-19T00:30:49.549 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-19T00:30:49.560 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-19T00:30:49.661 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-08-19T00:30:49.671 INFO:teuthology.task.clock:Checking final clock skew... 2024-08-19T00:30:49.672 DEBUG:teuthology.orchestra.run.smithi044:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-19T00:30:49.675 DEBUG:teuthology.orchestra.run.smithi116:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-19T00:30:49.677 DEBUG:teuthology.orchestra.run.smithi171:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-19T00:30:49.689 INFO:teuthology.orchestra.run.smithi044.stderr:bash: line 1: ntpq: command not found 2024-08-19T00:30:49.691 INFO:teuthology.orchestra.run.smithi116.stderr:bash: line 1: ntpq: command not found 2024-08-19T00:30:49.692 INFO:teuthology.orchestra.run.smithi171.stderr:bash: line 1: ntpq: command not found 2024-08-19T00:30:49.693 INFO:teuthology.orchestra.run.smithi044.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-19T00:30:49.694 INFO:teuthology.orchestra.run.smithi044.stdout:=============================================================================== 2024-08-19T00:30:49.694 INFO:teuthology.orchestra.run.smithi044.stdout:^* hv01.front.sepia.ceph.com 3 6 377 26 +211us[ +231us] +/- 37ms 2024-08-19T00:30:49.694 INFO:teuthology.orchestra.run.smithi044.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 24 -487us[ -487us] +/- 74ms 2024-08-19T00:30:49.694 INFO:teuthology.orchestra.run.smithi044.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 25 +105us[ +105us] +/- 91ms 2024-08-19T00:30:49.694 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-08-19T00:30:49.696 INFO:teuthology.orchestra.run.smithi116.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-19T00:30:49.696 INFO:teuthology.orchestra.run.smithi116.stdout:=============================================================================== 2024-08-19T00:30:49.696 INFO:teuthology.orchestra.run.smithi116.stdout:^* hv01.front.sepia.ceph.com 3 6 377 24 +217us[ +233us] +/- 37ms 2024-08-19T00:30:49.696 INFO:teuthology.orchestra.run.smithi116.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 24 -489us[ -473us] +/- 74ms 2024-08-19T00:30:49.696 INFO:teuthology.orchestra.run.smithi116.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 24 +101us[ +117us] +/- 91ms 2024-08-19T00:30:49.696 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-08-19T00:30:49.697 INFO:teuthology.orchestra.run.smithi171.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-19T00:30:49.697 INFO:teuthology.orchestra.run.smithi171.stdout:=============================================================================== 2024-08-19T00:30:49.698 INFO:teuthology.orchestra.run.smithi171.stdout:^* hv01.front.sepia.ceph.com 3 6 377 25 +206us[ +219us] +/- 37ms 2024-08-19T00:30:49.698 INFO:teuthology.orchestra.run.smithi171.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 27 -492us[ -479us] +/- 74ms 2024-08-19T00:30:49.698 INFO:teuthology.orchestra.run.smithi171.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 22 +108us[ +108us] +/- 91ms 2024-08-19T00:30:49.698 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-08-19T00:30:49.698 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-08-19T00:30:49.708 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-08-19T00:30:49.709 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-08-19T00:30:49.734 DEBUG:teuthology.orchestra.run.smithi044:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-19T00:30:49.805 DEBUG:teuthology.orchestra.run.smithi116:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-19T00:30:49.860 DEBUG:teuthology.orchestra.run.smithi171:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-19T00:30:49.914 DEBUG:teuthology.orchestra.run.smithi044:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-08-19T00:30:49.943 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T00:30:49.944 DEBUG:teuthology.orchestra.run.smithi116:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-08-19T00:30:49.971 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T00:30:49.971 DEBUG:teuthology.orchestra.run.smithi171:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-08-19T00:30:49.998 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T00:30:49.998 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-08-19T00:30:50.009 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-08-19T00:30:50.051 INFO:teuthology.task.internal:Duration was 1903.134349 seconds 2024-08-19T00:30:50.052 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-08-19T00:30:50.084 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-08-19T00:30:50.084 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-19T00:30:50.087 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-19T00:30:50.090 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-19T00:30:50.126 INFO:teuthology.orchestra.run.smithi116.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-19T00:30:50.127 INFO:teuthology.orchestra.run.smithi044.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-19T00:30:50.128 INFO:teuthology.orchestra.run.smithi171.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-19T00:30:50.412 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-08-19T00:30:50.412 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi044.front.sepia.ceph.com 2024-08-19T00:30:50.412 DEBUG:teuthology.orchestra.run.smithi044:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-19T00:30:50.475 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi116.front.sepia.ceph.com 2024-08-19T00:30:50.476 DEBUG:teuthology.orchestra.run.smithi116:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-19T00:30:50.496 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi171.front.sepia.ceph.com 2024-08-19T00:30:50.496 DEBUG:teuthology.orchestra.run.smithi171:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-19T00:30:50.519 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-08-19T00:30:50.519 DEBUG:teuthology.orchestra.run.smithi044:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-19T00:30:50.522 DEBUG:teuthology.orchestra.run.smithi116:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-19T00:30:50.538 DEBUG:teuthology.orchestra.run.smithi171:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-19T00:30:50.587 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-08-19T00:30:50.587 DEBUG:teuthology.orchestra.run.smithi044:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-19T00:30:50.590 DEBUG:teuthology.orchestra.run.smithi116:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-19T00:30:50.604 DEBUG:teuthology.orchestra.run.smithi171:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-19T00:30:51.306 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-08-19T00:30:51.317 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-08-19T00:30:51.318 DEBUG:teuthology.orchestra.run.smithi044:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-19T00:30:51.342 DEBUG:teuthology.orchestra.run.smithi116:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-19T00:30:51.369 DEBUG:teuthology.orchestra.run.smithi171:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-19T00:30:51.395 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-08-19T00:30:51.409 DEBUG:teuthology.orchestra.run.smithi044:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-19T00:30:51.414 DEBUG:teuthology.orchestra.run.smithi116:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-19T00:30:51.417 DEBUG:teuthology.orchestra.run.smithi171:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-19T00:30:51.434 INFO:teuthology.orchestra.run.smithi044.stdout:kernel.core_pattern = core 2024-08-19T00:30:51.438 INFO:teuthology.orchestra.run.smithi116.stdout:kernel.core_pattern = core 2024-08-19T00:30:51.460 INFO:teuthology.orchestra.run.smithi171.stdout:kernel.core_pattern = core 2024-08-19T00:30:51.483 DEBUG:teuthology.orchestra.run.smithi044:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-19T00:30:51.503 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T00:30:51.503 DEBUG:teuthology.orchestra.run.smithi116:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-19T00:30:51.524 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T00:30:51.525 DEBUG:teuthology.orchestra.run.smithi171:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-19T00:30:51.540 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T00:30:51.540 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-08-19T00:30:51.643 INFO:teuthology.task.internal:Transferring archived files... 2024-08-19T00:30:51.645 DEBUG:teuthology.misc:Transferring archived files from smithi044:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7860043/remote/smithi044 2024-08-19T00:30:51.645 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-19T00:30:51.692 DEBUG:teuthology.misc:Transferring archived files from smithi116:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7860043/remote/smithi116 2024-08-19T00:30:51.693 DEBUG:teuthology.orchestra.run.smithi116:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-19T00:30:51.728 DEBUG:teuthology.misc:Transferring archived files from smithi171:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7860043/remote/smithi171 2024-08-19T00:30:51.728 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-19T00:30:51.763 INFO:teuthology.task.internal:Removing archive directory... 2024-08-19T00:30:51.764 DEBUG:teuthology.orchestra.run.smithi044:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-19T00:30:51.766 DEBUG:teuthology.orchestra.run.smithi116:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-19T00:30:51.769 DEBUG:teuthology.orchestra.run.smithi171:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-19T00:30:51.813 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-08-19T00:30:51.832 INFO:teuthology.task.internal:Not uploading archives. 2024-08-19T00:30:51.832 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-08-19T00:30:51.843 INFO:teuthology.task.internal:Tidying up after the test... 2024-08-19T00:30:51.843 DEBUG:teuthology.orchestra.run.smithi044:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-19T00:30:51.846 DEBUG:teuthology.orchestra.run.smithi116:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-19T00:30:51.848 DEBUG:teuthology.orchestra.run.smithi171:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-19T00:30:51.858 INFO:teuthology.orchestra.run.smithi044.stdout: 262218 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 19 00:30 /home/ubuntu/cephtest 2024-08-19T00:30:51.861 INFO:teuthology.orchestra.run.smithi116.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 19 00:30 /home/ubuntu/cephtest 2024-08-19T00:30:51.868 INFO:teuthology.orchestra.run.smithi171.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 19 00:30 /home/ubuntu/cephtest 2024-08-19T00:30:51.869 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-08-19T00:30:51.880 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-08-19T00:30:51.948 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/dbench}} duration: 1903.1343488693237 failure_reason: 'Command failed (workunit test suites/dbench.sh) on smithi044 with status 1: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=78215f5a1cf5eaf321d506a66539942e12851f34 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh''' flavor: default owner: scheduled_teuthology@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=bbe1e76f69294bbc8f5fb27e04a84ea4 status: fail success: false 2024-08-19T00:30:51.949 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-19T00:30:52.035 INFO:teuthology.run:FAIL